2023-10-08T00:11:01.473 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T00:11:01.474 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} --name yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128 -- /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/orig.config.yaml 2023-10-08T00:11:01.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T00:11:01.654 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: yweinste@redhat.com first_in_suite: false job_id: '7418128' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-07-1508-quincy sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-07-1508-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZzmRSjpiIjPSanOdXhFf9PoViSqTfXRRFuwwpn579ZP6QNYrLiD+SmqZoh8c2nS1KuiPstJ7e8TTTwZ8m6h7c= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+asrvhCEdDa/aeQL/fpC2MJoaq3naTK/kKRupFq02V/HwJ3Ozn5G6+UQZy0X3gPxbzxC4oV2BLTK1HSw6tbrs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-07_22:15:20 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T00:11:01.654 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa; will attempt to use it 2023-10-08T00:11:01.655 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks 2023-10-08T00:11:01.655 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T00:11:01.658 INFO:teuthology.task.internal:Checking packages... 2023-10-08T00:11:01.681 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T00:11:01.681 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T00:11:01.681 INFO:teuthology.packaging:ref: None 2023-10-08T00:11:01.681 INFO:teuthology.packaging:tag: None 2023-10-08T00:11:01.681 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T00:11:01.681 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T00:11:01.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T00:11:01.844 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-08T00:11:01.844 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T00:11:01.871 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T00:11:01.872 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T00:11:01.928 INFO:teuthology.task.internal:Saving configuration 2023-10-08T00:11:01.951 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T00:11:02.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T00:11:02.085 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 00:06:03.230466', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZzmRSjpiIjPSanOdXhFf9PoViSqTfXRRFuwwpn579ZP6QNYrLiD+SmqZoh8c2nS1KuiPstJ7e8TTTwZ8m6h7c='} 2023-10-08T00:11:02.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 00:06:03.232417', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+asrvhCEdDa/aeQL/fpC2MJoaq3naTK/kKRupFq02V/HwJ3Ozn5G6+UQZy0X3gPxbzxC4oV2BLTK1HSw6tbrs='} 2023-10-08T00:11:02.105 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T00:11:02.115 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T00:11:02.115 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T00:11:02.115 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T00:11:02.246 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb0b1a5cb80>, signals=[15]) 2023-10-08T00:11:02.246 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T00:11:02.266 INFO:teuthology.task.internal:Opening connections... 2023-10-08T00:11:02.266 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:11:02.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:11:02.337 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:11:02.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:11:02.405 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T00:11:02.425 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-10-08T00:11:02.443 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-10-08T00:11:02.443 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-10-08T00:11:02.500 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T00:11:02.501 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T00:11:02.501 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-10-08T00:11:02.501 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-10-08T00:11:02.501 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.4" 2023-10-08T00:11:02.502 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-10-08T00:11:02.502 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T00:11:02.502 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-10-08T00:11:02.502 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T00:11:02.502 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T00:11:02.502 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T00:11:02.503 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T00:11:02.503 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:11:02.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T00:11:02.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T00:11:02.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T00:11:02.503 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T00:11:02.504 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-10-08T00:11:02.528 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-10-08T00:11:02.546 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-10-08T00:11:02.548 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-10-08T00:11:02.602 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T00:11:02.602 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.4" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T00:11:02.603 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T00:11:02.604 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T00:11:02.604 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-10-08T00:11:02.628 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T00:11:02.651 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T00:11:02.747 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T00:11:02.747 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2023-10-08T00:11:02.751 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-10-08T00:11:02.766 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T00:11:02.808 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T00:11:02.808 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2023-10-08T00:11:02.810 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-10-08T00:11:02.825 INFO:teuthology.orchestra.run.smithi022.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T00:11:02.827 INFO:teuthology.orchestra.run.smithi192.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T00:11:02.827 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T00:11:02.924 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T00:11:02.955 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T00:11:02.955 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-08T00:11:02.955 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-08T00:11:02.956 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T00:11:02.957 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T00:11:02.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:11:02.975 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-10-08T00:11:02.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:11:02.976 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-10-08T00:11:03.031 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T00:11:03.031 INFO:teuthology.task.kernel:Running kernel on smithi192: 4.18.0-305.25.1.el8_4.x86_64 2023-10-08T00:11:03.031 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2023-10-08T00:11:03.033 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T00:11:03.034 INFO:teuthology.task.kernel:Running kernel on smithi022: 4.18.0-305.25.1.el8_4.x86_64 2023-10-08T00:11:03.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2023-10-08T00:11:04.457 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-08T00:11:04.458 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-10-08T00:11:04.544 INFO:teuthology.orchestra.run.smithi022.stdout:Updating Subscription Management repositories. 2023-10-08T00:11:04.545 INFO:teuthology.orchestra.run.smithi022.stdout:Unable to read consumer identity 2023-10-08T00:11:05.939 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-10-08T00:11:05.949 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-08T00:11:06.579 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-08T00:11:06.759 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-08T00:11:10.089 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-10-08T00:11:10.167 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-08T00:11:10.845 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-08T00:11:10.846 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-08T00:11:10.846 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-08T00:11:10.949 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-08T00:11:10.949 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-08T00:11:10.949 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-08T00:11:10.997 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-08T00:11:10.998 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2023-10-08T00:11:10.998 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-08T00:11:11.109 DEBUG:teuthology.orchestra.run.smithi192:> echo no | sudo yum reinstall kernel || true 2023-10-08T00:11:11.117 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-08T00:11:11.119 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-08T00:11:11.119 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-08T00:11:11.229 DEBUG:teuthology.orchestra.run.smithi022:> echo no | sudo yum reinstall kernel || true 2023-10-08T00:11:11.451 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-08T00:11:11.452 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-10-08T00:11:11.594 INFO:teuthology.orchestra.run.smithi022.stdout:Updating Subscription Management repositories. 2023-10-08T00:11:11.594 INFO:teuthology.orchestra.run.smithi022.stdout:Unable to read consumer identity 2023-10-08T00:11:11.749 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 12:11:10 AM UTC. 2023-10-08T00:11:11.877 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T00:11:11.877 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:11.877 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:11.904 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2023-10-08T00:11:11.911 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:01 ago on Sun 08 Oct 2023 12:11:10 AM UTC. 2023-10-08T00:11:11.954 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum reinstall -y kernel || true 2023-10-08T00:11:12.047 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T00:11:12.047 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:12.047 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:12.073 INFO:teuthology.orchestra.run.smithi022.stderr:Error: No packages marked for reinstall. 2023-10-08T00:11:12.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum reinstall -y kernel || true 2023-10-08T00:11:12.297 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-08T00:11:12.297 INFO:teuthology.orchestra.run.smithi192.stdout:Unable to read consumer identity 2023-10-08T00:11:12.490 INFO:teuthology.orchestra.run.smithi022.stdout:Updating Subscription Management repositories. 2023-10-08T00:11:12.490 INFO:teuthology.orchestra.run.smithi022.stdout:Unable to read consumer identity 2023-10-08T00:11:12.587 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:11:10 AM UTC. 2023-10-08T00:11:12.757 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T00:11:12.758 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:12.758 INFO:teuthology.orchestra.run.smithi192.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:12.772 INFO:teuthology.orchestra.run.smithi192.stderr:Error: No packages marked for reinstall. 2023-10-08T00:11:12.795 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:02 ago on Sun 08 Oct 2023 12:11:10 AM UTC. 2023-10-08T00:11:12.822 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T00:11:12.930 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-08T00:11:12.930 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:12.930 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-08T00:11:12.943 INFO:teuthology.orchestra.run.smithi022.stderr:Error: No packages marked for reinstall. 2023-10-08T00:11:12.947 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:12.947 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:12.947 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:12.947 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T00:11:12.947 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T00:11:12.947 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-08T00:11:12.947 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T00:11:12.947 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T00:11:12.996 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T00:11:13.072 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.073 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.073 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2023-10-08T00:11:13.099 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2023-10-08T00:11:13.099 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2023-10-08T00:11:13.099 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.02 2023-10-08T00:11:13.099 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 99.el8_4.1 2023-10-08T00:11:13.099 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Group : System Environment/Base 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 9264631 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Relocations : (not relocatable) 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : Red Hat, Inc. 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : Red Hat, Inc. 2023-10-08T00:11:13.100 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:11:13.101 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T00:11:13.102 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T00:11:13.102 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.102 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T00:11:13.126 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.127 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.127 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-08T00:11:13.127 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-08T00:11:13.127 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-08T00:11:13.127 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2023-10-08T00:11:13.127 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2023-10-08T00:11:13.258 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.258 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2023-10-08T00:11:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2023-10-08T00:11:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2023-10-08T00:11:13.286 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.02 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 99.el8_4.1 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Group : System Environment/Base 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 9264631 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T00:11:13.287 INFO:teuthology.orchestra.run.smithi022.stdout:Relocations : (not relocatable) 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : Red Hat, Inc. 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : Red Hat, Inc. 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2023-10-08T00:11:13.288 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:11:13.289 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T00:11:13.289 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T00:11:13.290 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:13.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T00:11:14.397 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2023-10-08T00:11:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2023-10-08T00:11:16.191 INFO:teuthology.orchestra.run.smithi192.stderr:done 2023-10-08T00:11:16.193 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-10-08T00:11:16.207 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.cSPaeLCni3 2023-10-08T00:11:16.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cSPaeLCni3 2023-10-08T00:11:16.277 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.cSPaeLCni3 2023-10-08T00:11:16.434 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.cSPaeLCni3 is 6KB 2023-10-08T00:11:16.440 INFO:teuthology.orchestra.run.smithi022.stderr:done 2023-10-08T00:11:16.441 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-10-08T00:11:16.463 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.MvpXx4brRt 2023-10-08T00:11:16.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.MvpXx4brRt 2023-10-08T00:11:16.482 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.cSPaeLCni3 2023-10-08T00:11:16.496 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T00:11:16.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.MvpXx4brRt 2023-10-08T00:11:16.569 INFO:teuthology.orchestra.run.smithi192.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T00:11:16.570 INFO:teuthology.orchestra.run.smithi192.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T00:11:16.570 INFO:teuthology.orchestra.run.smithi192.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T00:11:16.570 INFO:teuthology.orchestra.run.smithi192.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T00:11:16.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:16.693 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.MvpXx4brRt is 6KB 2023-10-08T00:11:16.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2023-10-08T00:11:16.741 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.MvpXx4brRt 2023-10-08T00:11:16.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T00:11:16.823 INFO:teuthology.orchestra.run.smithi022.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T00:11:16.823 INFO:teuthology.orchestra.run.smithi022.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T00:11:16.823 INFO:teuthology.orchestra.run.smithi022.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T00:11:16.823 INFO:teuthology.orchestra.run.smithi022.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T00:11:16.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-08T00:11:17.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2023-10-08T00:11:46.754 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-08T00:11:46.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-08T00:11:46.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:11:47.015 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T00:11:47.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-08T00:11:47.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:12:05.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-08T00:12:05.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-10-08T00:12:14.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-08T00:12:14.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:12:14.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-08T00:12:14.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:12:17.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-10-08T00:12:29.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-08T00:12:29.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:13:00.999 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-08T00:13:01.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-08T00:13:01.285 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-08T00:13:01.285 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-10-08T00:13:01.299 INFO:teuthology.orchestra.run.smithi192.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-08T00:13:01.300 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:13:01.300 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T00:13:01.300 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T00:13:02.301 DEBUG:teuthology.parallel:result is None 2023-10-08T00:13:14.378 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T00:13:26.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-08T00:13:26.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:13:26.734 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-10-08T00:13:27.018 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-08T00:13:27.018 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-08T00:13:27.019 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-10-08T00:13:27.034 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-08T00:13:27.035 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-08T00:13:27.035 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T00:13:27.035 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T00:13:28.036 DEBUG:teuthology.parallel:result is None 2023-10-08T00:13:28.037 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T00:13:28.047 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T00:13:28.048 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T00:13:28.050 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T00:13:28.067 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T00:13:28.083 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T00:13:28.133 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T00:13:28.134 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T00:13:28.136 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T00:13:28.171 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T00:13:28.185 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T00:13:28.185 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T00:13:28.205 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T00:13:28.277 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T00:13:28.295 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T00:13:28.318 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T00:13:28.338 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T00:13:28.340 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T00:13:28.350 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T00:13:28.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T00:13:28.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T00:13:28.378 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T00:13:28.387 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T00:13:28.387 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T00:13:28.420 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T00:13:28.435 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T00:13:28.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T00:13:28.561 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T00:13:28.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T00:13:28.683 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:13:28.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T00:13:28.748 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T00:13:28.790 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T00:13:28.852 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T00:13:28.893 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T00:13:28.933 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:13:28.933 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T00:13:28.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2023-10-08T00:13:28.999 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-10-08T00:13:29.046 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T00:13:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T00:13:29.343 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T00:13:29.351 INFO:teuthology.task.internal:Starting timer... 2023-10-08T00:13:29.351 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T00:13:29.395 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T00:13:29.443 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T00:13:29.444 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2023-10-08T00:13:29.532 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: [ OK ] 2023-10-08T00:13:29.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2023-10-08T00:13:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: [ OK ] 2023-10-08T00:13:29.598 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T00:13:29.599 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2023-10-08T00:13:29.625 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2023-10-08T00:13:29.625 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2023-10-08T00:13:29.642 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2023-10-08T00:13:29.643 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2023-10-08T00:13:29.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T00:13:29.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:13:29.691 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T00:13:29.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:13:29.717 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T00:13:29.717 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2023-10-08T00:13:29.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2023-10-08T00:13:29.783 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T00:13:29.792 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T00:13:29.792 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T00:13:29.810 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T00:13:29.811 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T00:21:58.614 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-10-08T00:21:58.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-08T00:21:58.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:21:58.686 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-10-08T00:21:58.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-08T00:21:58.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-08T00:21:58.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T00:21:58.825 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-10-08T00:21:58.893 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-10-08T00:21:58.893 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T00:21:58.904 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T00:21:58.904 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T00:21:58.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T00:21:58.906 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T00:21:58.906 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T00:21:58.936 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T00:21:58.952 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T00:21:58.963 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T00:21:58.977 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T00:21:58.988 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2023-10-08T00:21:58.998 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2023-10-08T00:21:59.012 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2023-10-08T00:21:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T00:21:59.022 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2023-10-08T00:21:59.028 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T00:21:59.036 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T00:21:59.050 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T00:21:59.100 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2023-10-08T00:21:59.102 INFO:teuthology.orchestra.run.smithi022.stdout:210 Number of sources = 4 2023-10-08T00:21:59.102 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T00:21:59.103 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-10-08T00:21:59.103 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.103 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.103 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.103 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.117 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:210 Number of sources = 4 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.120 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:21:59.121 INFO:teuthology.run_tasks:Running task install... 2023-10-08T00:21:59.132 DEBUG:teuthology.task.install:project ceph 2023-10-08T00:21:59.132 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T00:21:59.132 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T00:21:59.132 INFO:teuthology.task.install:Using flavor: default 2023-10-08T00:21:59.138 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T00:21:59.138 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T00:21:59.139 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T00:21:59.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T00:21:59.141 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T00:21:59.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T00:21:59.313 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T00:21:59.313 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T00:21:59.379 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T00:21:59.379 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T00:21:59.432 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T00:21:59.433 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:21:59.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T00:21:59.460 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T00:21:59.461 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T00:21:59.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T00:21:59.555 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T00:21:59.555 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:21:59.555 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T00:21:59.581 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T00:21:59.582 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T00:21:59.603 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T00:21:59.647 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T00:21:59.669 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2023-10-08T00:21:59.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2023-10-08T00:21:59.721 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T00:21:59.784 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2023-10-08T00:21:59.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2023-10-08T00:22:00.080 INFO:teuthology.orchestra.run.smithi022.stdout:Updating Subscription Management repositories. 2023-10-08T00:22:00.174 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-08T00:22:00.428 INFO:teuthology.orchestra.run.smithi022.stdout:44 files removed 2023-10-08T00:22:00.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T00:22:00.483 INFO:teuthology.orchestra.run.smithi192.stdout:44 files removed 2023-10-08T00:22:00.536 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T00:22:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:Updating Subscription Management repositories. 2023-10-08T00:22:00.886 INFO:teuthology.orchestra.run.smithi192.stdout:Updating Subscription Management repositories. 2023-10-08T00:22:01.624 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 349 kB/s | 78 kB 00:00 2023-10-08T00:22:01.680 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 277 kB/s | 78 kB 00:00 2023-10-08T00:22:01.911 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-08T00:22:01.962 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-08T00:22:02.176 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 7.9 kB/s | 1.5 kB 00:00 2023-10-08T00:22:02.186 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-10-08T00:22:02.285 INFO:teuthology.orchestra.run.smithi192.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-08T00:22:02.295 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 44 kB/s | 3.5 kB 00:00 2023-10-08T00:22:03.116 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-08T00:22:03.149 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-08T00:22:06.408 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-10-08T00:22:06.788 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2023-10-08T00:22:06.791 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 127 MB/s | 38 MB 00:00 2023-10-08T00:22:07.237 INFO:teuthology.orchestra.run.smithi022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 105 MB/s | 38 MB 00:00 2023-10-08T00:22:12.308 INFO:teuthology.orchestra.run.smithi192.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 118 MB/s | 33 MB 00:00 2023-10-08T00:22:13.329 INFO:teuthology.orchestra.run.smithi022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 MB/s | 33 MB 00:00 2023-10-08T00:22:20.132 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T00:22:20.132 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T00:22:20.143 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T00:22:20.144 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T00:22:20.145 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T00:22:20.146 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T00:22:20.149 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T00:22:20.150 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T00:22:20.151 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T00:22:20.647 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================================================== 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================================================== 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T00:22:20.659 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T00:22:20.660 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T00:22:20.661 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2023-10-08T00:22:20.662 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T00:22:20.663 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T00:22:20.664 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T00:22:20.665 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T00:22:20.666 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T00:22:20.667 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T00:22:20.667 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T00:22:20.667 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T00:22:20.667 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T00:22:20.667 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T00:22:20.667 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T00:22:20.668 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T00:22:20.669 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T00:22:20.670 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T00:22:20.671 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================================================== 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout:Install 118 Packages 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 2 Packages 2023-10-08T00:22:20.672 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:22:20.673 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 202 M 2023-10-08T00:22:20.673 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2023-10-08T00:22:20.831 INFO:teuthology.orchestra.run.smithi192.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 72 kB/s | 6.4 kB 00:00 2023-10-08T00:22:20.983 INFO:teuthology.orchestra.run.smithi192.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 5.6 MB/s | 876 kB 00:00 2023-10-08T00:22:21.006 INFO:teuthology.orchestra.run.smithi192.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 7.2 MB/s | 162 kB 00:00 2023-10-08T00:22:21.185 INFO:teuthology.orchestra.run.smithi192.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 13 MB/s | 2.3 MB 00:00 2023-10-08T00:22:21.326 INFO:teuthology.orchestra.run.smithi192.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 1.6 MB 00:00 2023-10-08T00:22:21.614 INFO:teuthology.orchestra.run.smithi192.stdout:(6/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 5.9 MB/s | 5.2 MB 00:00 2023-10-08T00:22:21.653 INFO:teuthology.orchestra.run.smithi192.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 12 MB/s | 3.9 MB 00:00 2023-10-08T00:22:22.135 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T00:22:22.135 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T00:22:22.146 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T00:22:22.147 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T00:22:22.148 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T00:22:22.149 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T00:22:22.151 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T00:22:22.153 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T00:22:22.154 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T00:22:22.659 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================================================== 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================================================== 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T00:22:22.672 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T00:22:22.673 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T00:22:22.674 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T00:22:22.675 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T00:22:22.676 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T00:22:22.677 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T00:22:22.678 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T00:22:22.679 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T00:22:22.680 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T00:22:22.681 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================================================== 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout:Install 118 Packages 2023-10-08T00:22:22.682 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 2 Packages 2023-10-08T00:22:22.683 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:22:22.683 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 202 M 2023-10-08T00:22:22.683 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-08T00:22:23.047 INFO:teuthology.orchestra.run.smithi022.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-08T00:22:23.194 INFO:teuthology.orchestra.run.smithi192.stdout:(8/120): ceph-radosgw-17.2.6-1320.g08cac018.el8 11 MB/s | 17 MB 00:01 2023-10-08T00:22:23.256 INFO:teuthology.orchestra.run.smithi192.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 396 kB/s | 24 kB 00:00 2023-10-08T00:22:23.707 INFO:teuthology.orchestra.run.smithi192.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 8.0 MB/s | 17 MB 00:02 2023-10-08T00:22:23.711 INFO:teuthology.orchestra.run.smithi022.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.3 MB/s | 876 kB 00:00 2023-10-08T00:22:23.787 INFO:teuthology.orchestra.run.smithi192.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.2 MB/s | 255 kB 00:00 2023-10-08T00:22:23.849 INFO:teuthology.orchestra.run.smithi022.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.2 MB/s | 162 kB 00:00 2023-10-08T00:22:23.978 INFO:teuthology.orchestra.run.smithi192.stdout:(12/120): ceph-common-17.2.6-1320.g08cac018.el8 7.2 MB/s | 23 MB 00:03 2023-10-08T00:22:24.044 INFO:teuthology.orchestra.run.smithi192.stdout:(13/120): libcephfs-devel-17.2.6-1320.g08cac018 97 kB/s | 25 kB 00:00 2023-10-08T00:22:24.115 INFO:teuthology.orchestra.run.smithi192.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.3 MB/s | 174 kB 00:00 2023-10-08T00:22:24.117 INFO:teuthology.orchestra.run.smithi192.stdout:(15/120): libcephfs2-17.2.6-1320.g08cac018.el8. 5.5 MB/s | 797 kB 00:00 2023-10-08T00:22:24.127 INFO:teuthology.orchestra.run.smithi022.stdout:(4/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 3.7 MB/s | 5.2 MB 00:01 2023-10-08T00:22:24.167 INFO:teuthology.orchestra.run.smithi192.stdout:(16/120): librados-devel-17.2.6-1320.g08cac018. 2.4 MB/s | 130 kB 00:00 2023-10-08T00:22:24.238 INFO:teuthology.orchestra.run.smithi192.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 4.1 MB/s | 507 kB 00:00 2023-10-08T00:22:24.309 INFO:teuthology.orchestra.run.smithi192.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 631 kB/s | 45 kB 00:00 2023-10-08T00:22:24.384 INFO:teuthology.orchestra.run.smithi192.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 1.5 MB/s | 115 kB 00:00 2023-10-08T00:22:24.463 INFO:teuthology.orchestra.run.smithi192.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 2.3 MB/s | 190 kB 00:00 2023-10-08T00:22:24.547 INFO:teuthology.orchestra.run.smithi022.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-10-08T00:22:24.552 INFO:teuthology.orchestra.run.smithi192.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 4.1 MB/s | 371 kB 00:00 2023-10-08T00:22:24.641 INFO:teuthology.orchestra.run.smithi192.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 4.0 MB/s | 358 kB 00:00 2023-10-08T00:22:24.665 INFO:teuthology.orchestra.run.smithi022.stdout:(6/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 2.8 MB/s | 2.3 MB 00:00 2023-10-08T00:22:24.713 INFO:teuthology.orchestra.run.smithi192.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 1.4 MB/s | 107 kB 00:00 2023-10-08T00:22:24.794 INFO:teuthology.orchestra.run.smithi192.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.1 MB/s | 90 kB 00:00 2023-10-08T00:22:25.085 INFO:teuthology.orchestra.run.smithi192.stdout:(25/120): librgw2-17.2.6-1320.g08cac018.el8.x86 6.0 MB/s | 5.6 MB 00:00 2023-10-08T00:22:25.162 INFO:teuthology.orchestra.run.smithi192.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 2.2 MB/s | 173 kB 00:00 2023-10-08T00:22:25.233 INFO:teuthology.orchestra.run.smithi192.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 323 kB/s | 23 kB 00:00 2023-10-08T00:22:25.308 INFO:teuthology.orchestra.run.smithi192.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 1.6 MB/s | 121 kB 00:00 2023-10-08T00:22:25.356 INFO:teuthology.orchestra.run.smithi192.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 6.1 MB/s | 3.5 MB 00:00 2023-10-08T00:22:25.631 INFO:teuthology.orchestra.run.smithi192.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 5.3 MB/s | 1.7 MB 00:00 2023-10-08T00:22:25.699 INFO:teuthology.orchestra.run.smithi022.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 3.4 MB/s | 3.9 MB 00:01 2023-10-08T00:22:25.709 INFO:teuthology.orchestra.run.smithi192.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 3.0 MB/s | 238 kB 00:00 2023-10-08T00:22:25.773 INFO:teuthology.orchestra.run.smithi192.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 745 kB/s | 47 kB 00:00 2023-10-08T00:22:25.836 INFO:teuthology.orchestra.run.smithi192.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 229 kB/s | 14 kB 00:00 2023-10-08T00:22:25.910 INFO:teuthology.orchestra.run.smithi192.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 3.5 MB/s | 267 kB 00:00 2023-10-08T00:22:25.979 INFO:teuthology.orchestra.run.smithi192.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-08T00:22:26.117 INFO:teuthology.orchestra.run.smithi192.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 131 kB/s | 18 kB 00:00 2023-10-08T00:22:26.171 INFO:teuthology.orchestra.run.smithi192.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 5.6 MB/s | 306 kB 00:00 2023-10-08T00:22:26.179 INFO:teuthology.orchestra.run.smithi192.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 6.8 MB/s | 59 kB 00:00 2023-10-08T00:22:26.188 INFO:teuthology.orchestra.run.smithi192.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 8.6 MB/s | 75 kB 00:00 2023-10-08T00:22:26.205 INFO:teuthology.orchestra.run.smithi192.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 28 MB/s | 476 kB 00:00 2023-10-08T00:22:26.214 INFO:teuthology.orchestra.run.smithi192.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 5.3 MB/s | 44 kB 00:00 2023-10-08T00:22:26.223 INFO:teuthology.orchestra.run.smithi192.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 20 MB/s | 185 kB 00:00 2023-10-08T00:22:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 4.0 MB/s | 33 kB 00:00 2023-10-08T00:22:26.240 INFO:teuthology.orchestra.run.smithi192.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 2.0 MB/s | 16 kB 00:00 2023-10-08T00:22:26.249 INFO:teuthology.orchestra.run.smithi192.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 19 MB/s | 173 kB 00:00 2023-10-08T00:22:26.260 INFO:teuthology.orchestra.run.smithi192.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 33 MB/s | 384 kB 00:00 2023-10-08T00:22:26.269 INFO:teuthology.orchestra.run.smithi192.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 9.5 MB/s | 81 kB 00:00 2023-10-08T00:22:26.277 INFO:teuthology.orchestra.run.smithi192.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 1.4 MB/s | 11 kB 00:00 2023-10-08T00:22:26.286 INFO:teuthology.orchestra.run.smithi192.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2023-10-08T00:22:26.304 INFO:teuthology.orchestra.run.smithi192.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 64 MB/s | 1.2 MB 00:00 2023-10-08T00:22:26.313 INFO:teuthology.orchestra.run.smithi192.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 5.6 MB/s | 49 kB 00:00 2023-10-08T00:22:26.321 INFO:teuthology.orchestra.run.smithi192.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 6.7 MB/s | 59 kB 00:00 2023-10-08T00:22:26.330 INFO:teuthology.orchestra.run.smithi192.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 7.2 MB/s | 60 kB 00:00 2023-10-08T00:22:26.340 INFO:teuthology.orchestra.run.smithi192.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 29 MB/s | 283 kB 00:00 2023-10-08T00:22:26.348 INFO:teuthology.orchestra.run.smithi192.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2023-10-08T00:22:26.368 INFO:teuthology.orchestra.run.smithi192.stdout:(56/120): ceph-mgr-diskprediction-local-17.2.6- 7.3 MB/s | 7.4 MB 00:01 2023-10-08T00:22:26.369 INFO:teuthology.orchestra.run.smithi192.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.6 MB/s | 34 kB 00:00 2023-10-08T00:22:26.378 INFO:teuthology.orchestra.run.smithi192.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 7.4 MB/s | 64 kB 00:00 2023-10-08T00:22:26.386 INFO:teuthology.orchestra.run.smithi192.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2023-10-08T00:22:26.394 INFO:teuthology.orchestra.run.smithi192.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 2.9 MB/s | 24 kB 00:00 2023-10-08T00:22:26.403 INFO:teuthology.orchestra.run.smithi192.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 3.6 MB/s | 29 kB 00:00 2023-10-08T00:22:26.411 INFO:teuthology.orchestra.run.smithi192.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 3.4 MB/s | 27 kB 00:00 2023-10-08T00:22:26.417 INFO:teuthology.orchestra.run.smithi192.stdout:(63/120): python3-routes-2.4.1-12.el8.noarch.rp 4.0 MB/s | 196 kB 00:00 2023-10-08T00:22:26.421 INFO:teuthology.orchestra.run.smithi192.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 27 MB/s | 255 kB 00:00 2023-10-08T00:22:26.431 INFO:teuthology.orchestra.run.smithi192.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 5.6 MB/s | 61 kB 00:00 2023-10-08T00:22:26.434 INFO:teuthology.orchestra.run.smithi192.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 15 MB/s | 251 kB 00:00 2023-10-08T00:22:26.440 INFO:teuthology.orchestra.run.smithi192.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 9.7 MB/s | 85 kB 00:00 2023-10-08T00:22:26.442 INFO:teuthology.orchestra.run.smithi192.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 2.8 MB/s | 23 kB 00:00 2023-10-08T00:22:26.447 INFO:teuthology.orchestra.run.smithi192.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-08T00:22:26.466 INFO:teuthology.orchestra.run.smithi192.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 69 MB/s | 1.7 MB 00:00 2023-10-08T00:22:26.479 INFO:teuthology.orchestra.run.smithi192.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 580 kB/s | 19 kB 00:00 2023-10-08T00:22:26.492 INFO:teuthology.orchestra.run.smithi192.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.6 MB/s | 43 kB 00:00 2023-10-08T00:22:26.493 INFO:teuthology.orchestra.run.smithi192.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-08T00:22:26.508 INFO:teuthology.orchestra.run.smithi192.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.4 MB/s | 48 kB 00:00 2023-10-08T00:22:26.508 INFO:teuthology.orchestra.run.smithi192.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-08T00:22:26.521 INFO:teuthology.orchestra.run.smithi192.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.4 MB/s | 43 kB 00:00 2023-10-08T00:22:26.523 INFO:teuthology.orchestra.run.smithi192.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 14 MB/s | 229 kB 00:00 2023-10-08T00:22:26.537 INFO:teuthology.orchestra.run.smithi192.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-10-08T00:22:26.561 INFO:teuthology.orchestra.run.smithi192.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 59 MB/s | 2.3 MB 00:00 2023-10-08T00:22:26.563 INFO:teuthology.orchestra.run.smithi192.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-08T00:22:26.575 INFO:teuthology.orchestra.run.smithi192.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.8 MB/s | 83 kB 00:00 2023-10-08T00:22:26.577 INFO:teuthology.orchestra.run.smithi192.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.4 MB/s | 59 kB 00:00 2023-10-08T00:22:26.589 INFO:teuthology.orchestra.run.smithi192.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2023-10-08T00:22:26.590 INFO:teuthology.orchestra.run.smithi192.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.9 MB/s | 38 kB 00:00 2023-10-08T00:22:26.603 INFO:teuthology.orchestra.run.smithi192.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.2 MB/s | 86 kB 00:00 2023-10-08T00:22:26.604 INFO:teuthology.orchestra.run.smithi192.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.1 MB/s | 58 kB 00:00 2023-10-08T00:22:26.616 INFO:teuthology.orchestra.run.smithi192.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.5 MB/s | 47 kB 00:00 2023-10-08T00:22:26.622 INFO:teuthology.orchestra.run.smithi192.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 30 MB/s | 559 kB 00:00 2023-10-08T00:22:26.636 INFO:teuthology.orchestra.run.smithi192.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 33 MB/s | 639 kB 00:00 2023-10-08T00:22:26.637 INFO:teuthology.orchestra.run.smithi192.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.9 MB/s | 70 kB 00:00 2023-10-08T00:22:26.650 INFO:teuthology.orchestra.run.smithi192.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 14 MB/s | 200 kB 00:00 2023-10-08T00:22:26.651 INFO:teuthology.orchestra.run.smithi192.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.0 MB/s | 97 kB 00:00 2023-10-08T00:22:26.674 INFO:teuthology.orchestra.run.smithi192.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 1.8 MB/s | 44 kB 00:00 2023-10-08T00:22:26.698 INFO:teuthology.orchestra.run.smithi192.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2023-10-08T00:22:26.721 INFO:teuthology.orchestra.run.smithi192.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 6.6 MB/s | 161 kB 00:00 2023-10-08T00:22:26.748 INFO:teuthology.orchestra.run.smithi192.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 12 MB/s | 320 kB 00:00 2023-10-08T00:22:26.776 INFO:teuthology.orchestra.run.smithi192.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 16 MB/s | 457 kB 00:00 2023-10-08T00:22:26.903 INFO:teuthology.orchestra.run.smithi192.stdout:(98/120): python3-scipy-1.0.0-20.module+el8.1.0 58 MB/s | 15 MB 00:00 2023-10-08T00:22:26.926 INFO:teuthology.orchestra.run.smithi192.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.6 MB/s | 39 kB 00:00 2023-10-08T00:22:26.954 INFO:teuthology.orchestra.run.smithi192.stdout:(100/120): python3-babel-2.5.1-5.el8.noarch.rpm 27 MB/s | 4.8 MB 00:00 2023-10-08T00:22:26.961 INFO:teuthology.orchestra.run.smithi192.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 19 MB/s | 688 kB 00:00 2023-10-08T00:22:26.981 INFO:teuthology.orchestra.run.smithi192.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.2 MB/s | 259 kB 00:00 2023-10-08T00:22:26.989 INFO:teuthology.orchestra.run.smithi192.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 7.9 MB/s | 225 kB 00:00 2023-10-08T00:22:27.006 INFO:teuthology.orchestra.run.smithi192.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 5.1 MB/s | 126 kB 00:00 2023-10-08T00:22:27.033 INFO:teuthology.orchestra.run.smithi192.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 6.6 MB/s | 187 kB 00:00 2023-10-08T00:22:27.055 INFO:teuthology.orchestra.run.smithi192.stdout:(106/120): python3-numpy-1.14.3-9.el8.x86_64.rp 57 MB/s | 3.7 MB 00:00 2023-10-08T00:22:27.063 INFO:teuthology.orchestra.run.smithi192.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 18 MB/s | 538 kB 00:00 2023-10-08T00:22:27.083 INFO:teuthology.orchestra.run.smithi192.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2023-10-08T00:22:27.092 INFO:teuthology.orchestra.run.smithi192.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.2 MB/s | 157 kB 00:00 2023-10-08T00:22:27.113 INFO:teuthology.orchestra.run.smithi192.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 3.7 MB/s | 110 kB 00:00 2023-10-08T00:22:27.123 INFO:teuthology.orchestra.run.smithi192.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2023-10-08T00:22:27.142 INFO:teuthology.orchestra.run.smithi192.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 690 kB/s | 20 kB 00:00 2023-10-08T00:22:27.158 INFO:teuthology.orchestra.run.smithi192.stdout:(113/120): libtool-2.4.6-25.el8.x86_64.rpm 20 MB/s | 709 kB 00:00 2023-10-08T00:22:27.171 INFO:teuthology.orchestra.run.smithi192.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.8 MB/s | 54 kB 00:00 2023-10-08T00:22:27.245 INFO:teuthology.orchestra.run.smithi192.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 55 MB/s | 4.7 MB 00:00 2023-10-08T00:22:27.270 INFO:teuthology.orchestra.run.smithi192.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-10-08T00:22:27.278 INFO:teuthology.orchestra.run.smithi192.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2023-10-08T00:22:27.672 INFO:teuthology.orchestra.run.smithi022.stdout:(8/120): ceph-common-17.2.6-1320.g08cac018.el8. 4.7 MB/s | 23 MB 00:04 2023-10-08T00:22:27.736 INFO:teuthology.orchestra.run.smithi022.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 384 kB/s | 24 kB 00:00 2023-10-08T00:22:27.894 INFO:teuthology.orchestra.run.smithi022.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 5.2 MB/s | 17 MB 00:03 2023-10-08T00:22:27.943 INFO:teuthology.orchestra.run.smithi192.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 5.4 MB/s | 3.6 MB 00:00 2023-10-08T00:22:27.977 INFO:teuthology.orchestra.run.smithi022.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.1 MB/s | 255 kB 00:00 2023-10-08T00:22:27.988 INFO:teuthology.orchestra.run.smithi192.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 4.8 MB/s | 3.5 MB 00:00 2023-10-08T00:22:28.024 INFO:teuthology.orchestra.run.smithi022.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 529 kB/s | 25 kB 00:00 2023-10-08T00:22:28.144 INFO:teuthology.orchestra.run.smithi022.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 6.5 MB/s | 797 kB 00:00 2023-10-08T00:22:28.197 INFO:teuthology.orchestra.run.smithi022.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 3.2 MB/s | 174 kB 00:00 2023-10-08T00:22:28.249 INFO:teuthology.orchestra.run.smithi022.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.5 MB/s | 130 kB 00:00 2023-10-08T00:22:28.348 INFO:teuthology.orchestra.run.smithi022.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 5.0 MB/s | 507 kB 00:00 2023-10-08T00:22:29.146 INFO:teuthology.orchestra.run.smithi022.stdout:(17/120): ceph-radosgw-17.2.6-1320.g08cac018.el 4.9 MB/s | 17 MB 00:03 2023-10-08T00:22:29.168 INFO:teuthology.orchestra.run.smithi022.stdout:(18/120): librgw2-17.2.6-1320.g08cac018.el8.x86 6.8 MB/s | 5.6 MB 00:00 2023-10-08T00:22:29.172 INFO:teuthology.orchestra.run.smithi022.stdout:(19/120): python3-ceph-argparse-17.2.6-1320.g08 1.7 MB/s | 45 kB 00:00 2023-10-08T00:22:29.207 INFO:teuthology.orchestra.run.smithi022.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 5.4 MB/s | 190 kB 00:00 2023-10-08T00:22:29.213 INFO:teuthology.orchestra.run.smithi022.stdout:(21/120): python3-ceph-common-17.2.6-1320.g08ca 2.5 MB/s | 115 kB 00:00 2023-10-08T00:22:29.273 INFO:teuthology.orchestra.run.smithi022.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 5.8 MB/s | 358 kB 00:00 2023-10-08T00:22:29.278 INFO:teuthology.orchestra.run.smithi022.stdout:(23/120): python3-rados-17.2.6-1320.g08cac018.e 5.1 MB/s | 371 kB 00:00 2023-10-08T00:22:29.309 INFO:teuthology.orchestra.run.smithi022.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 2.9 MB/s | 90 kB 00:00 2023-10-08T00:22:29.319 INFO:teuthology.orchestra.run.smithi022.stdout:(25/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.3 MB/s | 107 kB 00:00 2023-10-08T00:22:29.360 INFO:teuthology.orchestra.run.smithi022.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 4.2 MB/s | 173 kB 00:00 2023-10-08T00:22:29.396 INFO:teuthology.orchestra.run.smithi022.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 645 kB/s | 23 kB 00:00 2023-10-08T00:22:29.433 INFO:teuthology.orchestra.run.smithi022.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 3.2 MB/s | 121 kB 00:00 2023-10-08T00:22:29.630 INFO:teuthology.orchestra.run.smithi022.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 8.6 MB/s | 1.7 MB 00:00 2023-10-08T00:22:29.660 INFO:teuthology.orchestra.run.smithi022.stdout:(30/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 9.9 MB/s | 3.5 MB 00:00 2023-10-08T00:22:29.683 INFO:teuthology.orchestra.run.smithi022.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 10 MB/s | 238 kB 00:00 2023-10-08T00:22:29.684 INFO:teuthology.orchestra.run.smithi192.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 8.0 MB/s | 52 MB 00:06 2023-10-08T00:22:29.689 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2023-10-08T00:22:29.689 INFO:teuthology.orchestra.run.smithi192.stdout:Total 22 MB/s | 202 MB 00:09 2023-10-08T00:22:29.708 INFO:teuthology.orchestra.run.smithi022.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 1.8 MB/s | 47 kB 00:00 2023-10-08T00:22:29.729 INFO:teuthology.orchestra.run.smithi022.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 699 kB/s | 14 kB 00:00 2023-10-08T00:22:29.740 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2023-10-08T00:22:29.774 INFO:teuthology.orchestra.run.smithi022.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 5.8 MB/s | 267 kB 00:00 2023-10-08T00:22:29.796 INFO:teuthology.orchestra.run.smithi022.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 3.7 MB/s | 80 kB 00:00 2023-10-08T00:22:29.817 INFO:teuthology.orchestra.run.smithi022.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 868 kB/s | 18 kB 00:00 2023-10-08T00:22:29.856 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2023-10-08T00:22:29.856 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2023-10-08T00:22:29.919 INFO:teuthology.orchestra.run.smithi022.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.9 MB/s | 306 kB 00:00 2023-10-08T00:22:29.936 INFO:teuthology.orchestra.run.smithi022.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 3.3 MB/s | 59 kB 00:00 2023-10-08T00:22:29.954 INFO:teuthology.orchestra.run.smithi022.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 4.2 MB/s | 75 kB 00:00 2023-10-08T00:22:29.990 INFO:teuthology.orchestra.run.smithi022.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 13 MB/s | 476 kB 00:00 2023-10-08T00:22:30.007 INFO:teuthology.orchestra.run.smithi022.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.5 MB/s | 44 kB 00:00 2023-10-08T00:22:30.027 INFO:teuthology.orchestra.run.smithi022.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 9.7 MB/s | 185 kB 00:00 2023-10-08T00:22:30.044 INFO:teuthology.orchestra.run.smithi022.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.9 MB/s | 33 kB 00:00 2023-10-08T00:22:30.061 INFO:teuthology.orchestra.run.smithi022.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 966 kB/s | 16 kB 00:00 2023-10-08T00:22:30.080 INFO:teuthology.orchestra.run.smithi022.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 9.1 MB/s | 173 kB 00:00 2023-10-08T00:22:30.101 INFO:teuthology.orchestra.run.smithi022.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 18 MB/s | 384 kB 00:00 2023-10-08T00:22:30.119 INFO:teuthology.orchestra.run.smithi022.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 4.5 MB/s | 81 kB 00:00 2023-10-08T00:22:30.136 INFO:teuthology.orchestra.run.smithi022.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 659 kB/s | 11 kB 00:00 2023-10-08T00:22:30.153 INFO:teuthology.orchestra.run.smithi022.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 1.0 MB/s | 18 kB 00:00 2023-10-08T00:22:30.209 INFO:teuthology.orchestra.run.smithi022.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 21 MB/s | 1.2 MB 00:00 2023-10-08T00:22:30.227 INFO:teuthology.orchestra.run.smithi022.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.8 MB/s | 49 kB 00:00 2023-10-08T00:22:30.245 INFO:teuthology.orchestra.run.smithi022.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 3.3 MB/s | 59 kB 00:00 2023-10-08T00:22:30.262 INFO:teuthology.orchestra.run.smithi022.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.4 MB/s | 60 kB 00:00 2023-10-08T00:22:30.282 INFO:teuthology.orchestra.run.smithi022.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 14 MB/s | 283 kB 00:00 2023-10-08T00:22:30.304 INFO:teuthology.orchestra.run.smithi022.stdout:(55/120): ceph-mgr-diskprediction-local-17.2.6- 11 MB/s | 7.4 MB 00:00 2023-10-08T00:22:30.304 INFO:teuthology.orchestra.run.smithi022.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 707 kB/s | 16 kB 00:00 2023-10-08T00:22:30.321 INFO:teuthology.orchestra.run.smithi022.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.9 MB/s | 34 kB 00:00 2023-10-08T00:22:30.339 INFO:teuthology.orchestra.run.smithi022.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 3.6 MB/s | 64 kB 00:00 2023-10-08T00:22:30.356 INFO:teuthology.orchestra.run.smithi022.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2023-10-08T00:22:30.373 INFO:teuthology.orchestra.run.smithi022.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 1.4 MB/s | 24 kB 00:00 2023-10-08T00:22:30.390 INFO:teuthology.orchestra.run.smithi022.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-10-08T00:22:30.393 INFO:teuthology.orchestra.run.smithi022.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 1.5 MB/s | 29 kB 00:00 2023-10-08T00:22:30.407 INFO:teuthology.orchestra.run.smithi022.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.6 MB/s | 27 kB 00:00 2023-10-08T00:22:30.412 INFO:teuthology.orchestra.run.smithi022.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 13 MB/s | 255 kB 00:00 2023-10-08T00:22:30.429 INFO:teuthology.orchestra.run.smithi022.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 3.4 MB/s | 61 kB 00:00 2023-10-08T00:22:30.442 INFO:teuthology.orchestra.run.smithi022.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 7.2 MB/s | 251 kB 00:00 2023-10-08T00:22:30.447 INFO:teuthology.orchestra.run.smithi022.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 4.7 MB/s | 85 kB 00:00 2023-10-08T00:22:30.459 INFO:teuthology.orchestra.run.smithi022.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.3 MB/s | 23 kB 00:00 2023-10-08T00:22:30.463 INFO:teuthology.orchestra.run.smithi022.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-10-08T00:22:30.497 INFO:teuthology.orchestra.run.smithi022.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 560 kB/s | 19 kB 00:00 2023-10-08T00:22:30.512 INFO:teuthology.orchestra.run.smithi022.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.7 MB/s | 43 kB 00:00 2023-10-08T00:22:30.522 INFO:teuthology.orchestra.run.smithi022.stdout:(72/120): thrift-0.13.0-2.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2023-10-08T00:22:30.528 INFO:teuthology.orchestra.run.smithi022.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.8 MB/s | 155 kB 00:00 2023-10-08T00:22:30.547 INFO:teuthology.orchestra.run.smithi022.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.5 MB/s | 48 kB 00:00 2023-10-08T00:22:30.560 INFO:teuthology.orchestra.run.smithi022.stdout:(75/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.7 MB/s | 220 kB 00:00 2023-10-08T00:22:30.569 INFO:teuthology.orchestra.run.smithi022.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 10 MB/s | 229 kB 00:00 2023-10-08T00:22:30.578 INFO:teuthology.orchestra.run.smithi022.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.5 MB/s | 43 kB 00:00 2023-10-08T00:22:30.597 INFO:teuthology.orchestra.run.smithi022.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 935 kB/s | 18 kB 00:00 2023-10-08T00:22:30.619 INFO:teuthology.orchestra.run.smithi022.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 47 MB/s | 2.3 MB 00:00 2023-10-08T00:22:30.625 INFO:teuthology.orchestra.run.smithi022.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2023-10-08T00:22:30.633 INFO:teuthology.orchestra.run.smithi022.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.7 MB/s | 83 kB 00:00 2023-10-08T00:22:30.642 INFO:teuthology.orchestra.run.smithi022.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.3 MB/s | 59 kB 00:00 2023-10-08T00:22:30.651 INFO:teuthology.orchestra.run.smithi022.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.4 MB/s | 169 kB 00:00 2023-10-08T00:22:30.658 INFO:teuthology.orchestra.run.smithi022.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.4 MB/s | 38 kB 00:00 2023-10-08T00:22:30.666 INFO:teuthology.orchestra.run.smithi022.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.4 MB/s | 86 kB 00:00 2023-10-08T00:22:30.673 INFO:teuthology.orchestra.run.smithi022.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.9 MB/s | 58 kB 00:00 2023-10-08T00:22:30.679 INFO:teuthology.orchestra.run.smithi022.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.6 MB/s | 47 kB 00:00 2023-10-08T00:22:30.692 INFO:teuthology.orchestra.run.smithi022.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 29 MB/s | 559 kB 00:00 2023-10-08T00:22:30.701 INFO:teuthology.orchestra.run.smithi022.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 29 MB/s | 639 kB 00:00 2023-10-08T00:22:30.707 INFO:teuthology.orchestra.run.smithi022.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.6 MB/s | 70 kB 00:00 2023-10-08T00:22:30.716 INFO:teuthology.orchestra.run.smithi022.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-08T00:22:30.724 INFO:teuthology.orchestra.run.smithi022.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.9 MB/s | 97 kB 00:00 2023-10-08T00:22:30.748 INFO:teuthology.orchestra.run.smithi022.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 1.8 MB/s | 44 kB 00:00 2023-10-08T00:22:30.760 INFO:teuthology.orchestra.run.smithi022.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-10-08T00:22:30.774 INFO:teuthology.orchestra.run.smithi022.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-08T00:22:30.791 INFO:teuthology.orchestra.run.smithi022.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-10-08T00:22:30.809 INFO:teuthology.orchestra.run.smithi022.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 25 MB/s | 457 kB 00:00 2023-10-08T00:22:30.899 INFO:teuthology.orchestra.run.smithi022.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 53 MB/s | 4.8 MB 00:00 2023-10-08T00:22:30.912 INFO:teuthology.orchestra.run.smithi022.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 3.1 MB/s | 39 kB 00:00 2023-10-08T00:22:31.018 INFO:teuthology.orchestra.run.smithi022.stdout:(100/120): python3-scipy-1.0.0-20.module+el8.1. 48 MB/s | 15 MB 00:00 2023-10-08T00:22:31.028 INFO:teuthology.orchestra.run.smithi022.stdout:(101/120): bison-3.0.4-10.el8.x86_64.rpm 5.8 MB/s | 688 kB 00:00 2023-10-08T00:22:31.033 INFO:teuthology.orchestra.run.smithi022.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 17 MB/s | 259 kB 00:00 2023-10-08T00:22:31.044 INFO:teuthology.orchestra.run.smithi022.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 14 MB/s | 225 kB 00:00 2023-10-08T00:22:31.047 INFO:teuthology.orchestra.run.smithi022.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 8.7 MB/s | 126 kB 00:00 2023-10-08T00:22:31.065 INFO:teuthology.orchestra.run.smithi022.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-08T00:22:31.088 INFO:teuthology.orchestra.run.smithi022.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-10-08T00:22:31.105 INFO:teuthology.orchestra.run.smithi022.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-10-08T00:22:31.118 INFO:teuthology.orchestra.run.smithi022.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 51 MB/s | 3.7 MB 00:00 2023-10-08T00:22:31.121 INFO:teuthology.orchestra.run.smithi022.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.5 MB/s | 157 kB 00:00 2023-10-08T00:22:31.134 INFO:teuthology.orchestra.run.smithi022.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.8 MB/s | 110 kB 00:00 2023-10-08T00:22:31.146 INFO:teuthology.orchestra.run.smithi022.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 14 MB/s | 353 kB 00:00 2023-10-08T00:22:31.149 INFO:teuthology.orchestra.run.smithi022.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.3 MB/s | 20 kB 00:00 2023-10-08T00:22:31.162 INFO:teuthology.orchestra.run.smithi022.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.2 MB/s | 54 kB 00:00 2023-10-08T00:22:31.169 INFO:teuthology.orchestra.run.smithi022.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 30 MB/s | 709 kB 00:00 2023-10-08T00:22:31.257 INFO:teuthology.orchestra.run.smithi022.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 50 MB/s | 4.7 MB 00:00 2023-10-08T00:22:31.277 INFO:teuthology.orchestra.run.smithi022.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 43 MB/s | 4.6 MB 00:00 2023-10-08T00:22:31.287 INFO:teuthology.orchestra.run.smithi022.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 23 MB/s | 713 kB 00:00 2023-10-08T00:22:31.511 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2023-10-08T00:22:31.516 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2023-10-08T00:22:31.784 INFO:teuthology.orchestra.run.smithi022.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 7.2 MB/s | 3.6 MB 00:00 2023-10-08T00:22:31.794 INFO:teuthology.orchestra.run.smithi022.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 6.7 MB/s | 3.5 MB 00:00 2023-10-08T00:22:32.478 INFO:teuthology.orchestra.run.smithi022.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 11 MB/s | 52 MB 00:04 2023-10-08T00:22:32.482 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-08T00:22:32.483 INFO:teuthology.orchestra.run.smithi022.stdout:Total 21 MB/s | 202 MB 00:09 2023-10-08T00:22:32.542 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-08T00:22:32.673 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-08T00:22:32.673 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-08T00:22:34.368 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-08T00:22:34.373 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-08T00:22:36.365 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2023-10-08T00:22:36.606 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T00:22:36.809 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T00:22:36.939 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T00:22:37.129 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T00:22:37.526 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T00:22:37.734 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T00:22:38.141 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T00:22:38.384 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T00:22:38.501 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T00:22:38.734 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T00:22:38.829 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T00:22:39.048 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-08T00:22:39.055 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T00:22:39.255 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T00:22:39.363 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T00:22:39.462 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T00:22:39.593 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T00:22:39.762 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T00:22:40.003 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T00:22:40.171 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T00:22:40.387 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T00:22:40.425 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T00:22:40.548 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T00:22:40.812 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T00:22:40.823 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T00:22:40.991 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T00:22:41.011 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T00:22:41.129 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T00:22:41.217 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T00:22:41.313 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T00:22:41.345 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T00:22:41.429 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T00:22:41.500 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T00:22:41.566 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T00:22:41.609 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T00:22:41.789 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T00:22:41.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T00:22:42.048 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T00:22:42.282 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T00:22:42.444 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T00:22:42.583 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T00:22:42.629 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T00:22:42.717 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T00:22:42.803 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T00:22:42.891 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T00:22:42.906 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T00:22:43.116 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T00:22:43.277 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T00:22:43.442 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T00:22:43.444 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T00:22:43.580 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T00:22:43.616 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T00:22:43.736 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T00:22:43.815 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T00:22:43.975 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T00:22:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T00:22:44.383 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T00:22:44.403 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T00:22:44.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T00:22:44.790 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T00:22:44.903 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T00:22:45.042 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T00:22:45.091 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T00:22:45.177 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T00:22:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T00:22:45.782 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T00:22:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T00:22:46.079 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T00:22:46.332 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T00:22:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T00:22:46.539 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T00:22:46.669 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T00:22:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T00:22:46.995 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T00:22:47.266 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T00:22:47.492 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T00:22:47.527 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T00:22:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T00:22:47.756 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T00:22:47.992 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T00:22:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T00:22:48.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T00:22:48.530 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T00:22:48.809 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T00:22:49.152 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T00:22:49.462 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T00:22:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T00:22:49.845 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T00:22:50.205 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T00:22:51.260 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T00:22:51.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T00:22:51.886 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T00:22:52.084 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T00:22:52.195 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T00:22:52.329 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T00:22:52.526 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T00:22:52.750 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T00:22:52.971 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T00:22:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T00:22:53.285 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T00:22:53.464 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T00:22:53.630 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T00:22:53.640 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T00:22:53.827 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T00:22:53.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T00:22:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T00:22:54.127 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T00:22:54.223 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T00:22:54.301 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T00:22:54.330 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T00:22:54.490 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T00:22:54.539 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T00:22:54.653 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T00:22:54.749 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T00:22:54.846 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T00:22:55.022 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T00:22:55.023 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T00:22:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T00:22:55.259 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T00:22:55.350 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T00:22:55.434 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T00:22:55.518 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T00:22:55.624 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T00:22:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T00:22:55.839 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T00:22:55.892 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T00:22:55.984 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T00:22:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T00:22:56.189 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T00:22:56.218 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T00:22:56.415 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T00:22:56.435 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T00:22:56.595 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T00:22:56.724 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T00:22:56.756 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T00:22:56.908 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T00:22:57.019 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T00:22:57.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T00:22:57.173 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T00:22:57.215 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T00:22:57.368 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T00:22:57.404 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T00:22:57.589 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T00:22:57.618 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T00:22:57.831 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T00:22:57.914 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T00:22:58.054 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T00:22:58.200 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T00:22:58.205 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T00:22:58.385 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T00:22:58.454 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T00:22:58.573 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T00:22:58.717 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T00:22:58.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T00:22:58.868 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T00:22:59.023 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T00:22:59.049 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T00:22:59.242 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T00:22:59.308 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T00:22:59.436 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T00:22:59.534 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T00:22:59.676 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T00:22:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T00:22:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T00:22:59.942 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T00:23:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T00:23:00.194 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T00:23:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T00:23:00.459 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T00:23:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T00:23:00.721 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T00:23:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T00:23:00.937 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T00:23:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T00:23:01.133 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T00:23:01.223 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T00:23:01.367 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T00:23:01.623 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T00:23:01.833 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T00:23:02.113 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T00:23:02.359 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T00:23:02.377 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T00:23:02.570 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T00:23:02.711 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T00:23:02.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T00:23:02.973 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T00:23:03.291 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T00:23:03.548 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T00:23:03.902 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T00:23:04.070 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T00:23:04.132 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T00:23:04.297 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T00:23:04.366 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T00:23:04.497 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T00:23:04.620 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T00:23:04.940 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T00:23:05.242 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T00:23:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T00:23:05.798 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T00:23:05.977 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T00:23:06.166 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T00:23:09.642 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T00:23:09.855 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T00:23:10.433 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T00:23:10.736 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T00:23:10.826 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T00:23:11.011 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T00:23:11.686 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T00:23:12.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T00:23:12.852 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T00:23:13.135 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T00:23:13.224 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T00:23:13.398 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /run 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2023-10-08T00:23:28.964 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2023-10-08T00:23:28.965 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2023-10-08T00:23:28.965 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2023-10-08T00:23:28.965 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /dev 2023-10-08T00:23:28.965 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:23:29.326 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T00:23:30.816 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T00:23:30.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T00:23:31.197 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T00:23:31.373 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T00:23:31.761 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /run 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2023-10-08T00:23:31.796 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2023-10-08T00:23:31.797 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:23:31.942 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T00:23:31.960 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T00:23:32.195 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T00:23:33.776 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T00:23:33.956 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T00:23:34.191 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T00:23:34.343 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T00:23:34.756 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T00:23:34.789 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T00:23:34.886 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T00:23:34.904 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T00:23:34.979 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T00:23:35.165 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T00:23:35.383 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T00:23:35.551 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T00:23:35.765 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T00:23:35.973 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T00:23:36.942 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T00:23:37.150 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T00:23:37.248 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T00:23:37.662 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T00:23:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T00:23:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T00:23:38.037 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T00:23:38.058 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T00:23:38.069 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T00:23:38.183 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T00:23:38.367 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T00:23:38.680 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T00:23:38.835 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T00:23:39.063 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T00:23:39.280 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T00:23:39.730 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T00:23:39.990 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T00:23:40.082 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T00:23:40.216 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T00:23:40.259 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T00:23:40.312 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T00:23:40.442 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T00:23:40.468 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T00:23:40.572 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T00:23:40.789 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T00:23:40.902 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T00:23:40.992 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T00:23:41.088 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T00:23:41.127 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T00:23:41.277 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T00:23:41.288 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T00:23:42.986 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T00:23:43.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T00:23:43.319 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T00:23:43.460 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T00:23:43.504 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T00:23:43.652 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T00:23:44.023 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T00:23:44.176 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T00:23:45.936 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T00:23:46.890 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T00:23:47.226 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T00:23:47.409 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T00:23:47.667 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T00:23:47.832 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T00:23:47.844 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T00:23:48.061 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T00:23:48.203 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T00:23:48.382 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T00:23:48.557 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T00:23:48.854 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T00:23:49.065 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T00:23:49.126 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T00:23:49.307 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T00:23:49.316 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T00:23:49.438 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T00:23:49.475 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T00:23:49.476 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T00:23:49.726 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T00:23:49.726 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T00:23:50.458 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T00:23:50.559 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T00:23:50.560 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T00:23:50.561 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T00:23:50.562 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T00:23:50.563 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T00:23:50.564 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T00:23:50.565 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T00:23:50.566 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T00:23:50.567 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T00:23:50.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T00:23:50.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T00:23:50.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T00:23:50.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T00:23:50.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T00:23:50.568 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T00:23:50.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T00:23:50.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T00:23:50.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T00:23:50.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T00:23:50.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T00:23:50.569 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T00:23:50.570 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T00:23:50.570 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T00:23:50.570 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T00:23:50.570 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T00:23:50.570 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T00:23:50.570 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T00:23:50.571 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T00:23:50.572 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T00:23:50.572 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T00:23:50.572 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T00:23:50.572 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T00:23:50.790 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T00:23:50.968 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T00:23:51.190 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T00:23:51.391 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T00:23:51.403 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T00:23:51.555 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T00:23:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T00:23:51.867 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T00:23:52.059 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T00:23:52.320 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T00:23:52.516 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T00:23:52.579 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T00:23:52.741 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T00:23:52.750 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T00:23:52.816 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T00:23:52.816 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:40 ago on Sun 08 Oct 2023 12:22:12 AM UTC. 2023-10-08T00:23:52.852 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T00:23:52.852 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T00:23:53.086 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T00:23:53.086 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T00:23:53.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T00:23:53.973 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T00:23:53.974 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T00:23:53.975 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T00:23:53.976 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T00:23:53.977 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T00:23:53.978 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T00:23:53.979 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T00:23:53.980 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T00:23:53.981 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T00:23:53.982 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T00:23:53.982 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T00:23:53.982 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T00:23:53.982 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T00:23:53.982 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T00:23:54.800 INFO:teuthology.orchestra.run.smithi192.stdout:Installed products updated. 2023-10-08T00:23:54.945 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:23:54.946 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2023-10-08T00:23:54.946 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.946 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.946 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2023-10-08T00:23:54.947 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T00:23:54.947 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T00:23:54.947 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.947 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.947 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.947 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.948 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.948 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.948 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.948 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.949 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T00:23:54.950 INFO:teuthology.orchestra.run.smithi192.stdout: jq-1.5-12.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T00:23:54.951 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T00:23:54.952 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.953 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T00:23:54.954 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T00:23:54.955 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T00:23:54.956 INFO:teuthology.orchestra.run.smithi192.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.957 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:23:54.958 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2023-10-08T00:23:55.243 DEBUG:teuthology.parallel:result is None 2023-10-08T00:23:56.165 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T00:23:56.165 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:43 ago on Sun 08 Oct 2023 12:22:13 AM UTC. 2023-10-08T00:23:58.260 INFO:teuthology.orchestra.run.smithi022.stdout:Installed products updated. 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T00:23:58.426 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.427 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T00:23:58.428 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: jq-1.5-12.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T00:23:58.429 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T00:23:58.430 INFO:teuthology.orchestra.run.smithi022.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T00:23:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T00:23:58.432 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T00:23:58.433 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T00:23:58.434 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T00:23:58.435 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T00:23:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T00:23:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T00:23:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T00:23:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T00:23:58.436 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:23:58.436 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-08T00:23:58.700 DEBUG:teuthology.parallel:result is None 2023-10-08T00:23:58.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T00:23:58.927 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T00:23:58.950 INFO:teuthology.orchestra.run.smithi022.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T00:23:58.950 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T00:23:58.950 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T00:23:58.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T00:23:59.096 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T00:23:59.119 INFO:teuthology.orchestra.run.smithi192.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T00:23:59.120 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T00:23:59.120 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T00:23:59.120 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T00:23:59.120 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:23:59.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T00:23:59.163 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:23:59.163 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T00:23:59.203 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T00:23:59.203 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:23:59.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T00:23:59.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T00:23:59.295 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:23:59.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T00:23:59.321 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T00:23:59.385 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T00:23:59.385 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:23:59.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T00:23:59.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T00:23:59.476 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:23:59.476 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T00:23:59.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T00:23:59.565 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T00:23:59.565 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:23:59.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T00:23:59.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T00:23:59.656 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:23:59.656 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T00:23:59.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T00:23:59.744 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T00:23:59.819 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T00:23:59.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2023-10-08T00:23:59.822 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-10-08T00:23:59.846 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T00:23:59.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T00:23:59.887 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T00:23:59.911 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T00:23:59.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T00:23:59.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T00:23:59.982 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T00:23:59.982 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T00:23:59.982 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T00:23:59.983 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:23:59.983 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T00:24:00.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T00:24:00.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T00:24:00.164 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:00.164 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T00:24:00.178 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T00:24:00.293 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T00:24:00.323 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T00:24:00.324 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T00:24:00.324 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7418128', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006', 'targets': {'smithi022.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZzmRSjpiIjPSanOdXhFf9PoViSqTfXRRFuwwpn579ZP6QNYrLiD+SmqZoh8c2nS1KuiPstJ7e8TTTwZ8m6h7c=', 'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+asrvhCEdDa/aeQL/fpC2MJoaq3naTK/kKRupFq02V/HwJ3Ozn5G6+UQZy0X3gPxbzxC4oV2BLTK1HSw6tbrs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-07_22:15:20', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T00:24:00.325 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T00:24:00.327 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T00:24:00.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T00:24:00.383 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T00:24:00.437 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:00.437 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T00:24:00.462 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T00:24:00.462 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2023-10-08T00:24:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 220629 Links: 1 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-08 00:23:53.530427494 +0000 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-08 00:21:29.077424700 +0000 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-08 00:21:29.077424700 +0000 2023-10-08T00:24:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-10-08T00:24:00.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T00:24:00.581 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-08T00:24:00.582 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-08T00:24:00.582 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000121886 s, 4.2 MB/s 2023-10-08T00:24:00.583 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T00:24:00.639 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 217082 Links: 1 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-08 00:23:53.530427494 +0000 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-08 00:21:29.610418108 +0000 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-08 00:21:29.610418108 +0000 2023-10-08T00:24:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-10-08T00:24:00.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T00:24:00.759 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-08T00:24:00.759 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-08T00:24:00.759 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000109665 s, 4.7 MB/s 2023-10-08T00:24:00.760 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T00:24:00.816 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2023-10-08T00:24:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T00:24:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 219745 Links: 1 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-08 00:23:53.530427494 +0000 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-08 00:21:30.160411306 +0000 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-08 00:21:30.160411306 +0000 2023-10-08T00:24:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-10-08T00:24:00.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T00:24:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-08T00:24:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-08T00:24:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000118927 s, 4.3 MB/s 2023-10-08T00:24:00.937 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T00:24:00.993 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2023-10-08T00:24:01.049 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T00:24:01.049 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:01.049 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 224341 Links: 1 2023-10-08T00:24:01.049 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:01.050 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:01.050 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-08 00:23:53.530427494 +0000 2023-10-08T00:24:01.050 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-08 00:21:30.661405109 +0000 2023-10-08T00:24:01.050 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-08 00:21:30.661405109 +0000 2023-10-08T00:24:01.050 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2023-10-08T00:24:01.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T00:24:01.113 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-08T00:24:01.113 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-08T00:24:01.113 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000114038 s, 4.5 MB/s 2023-10-08T00:24:01.115 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T00:24:01.171 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:01.171 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:01.172 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T00:24:01.187 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T00:24:01.187 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2023-10-08T00:24:01.243 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 221387 Links: 1 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-08 00:23:50.162044841 +0000 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-08 00:21:14.271195351 +0000 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-08 00:21:14.271195351 +0000 2023-10-08T00:24:01.244 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-08T00:24:01.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T00:24:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-08T00:24:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-08T00:24:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000258406 s, 2.0 MB/s 2023-10-08T00:24:01.309 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T00:24:01.366 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2023-10-08T00:24:01.422 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 217969 Links: 1 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-08 00:23:50.162044841 +0000 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-08 00:21:14.772185725 +0000 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-08 00:21:14.772185725 +0000 2023-10-08T00:24:01.423 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-08T00:24:01.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T00:24:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-08T00:24:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-08T00:24:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000228798 s, 2.2 MB/s 2023-10-08T00:24:01.487 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T00:24:01.543 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 209894 Links: 1 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-08 00:23:50.162044841 +0000 2023-10-08T00:24:01.599 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-08 00:21:15.273176099 +0000 2023-10-08T00:24:01.600 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-08 00:21:15.273176099 +0000 2023-10-08T00:24:01.600 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-08T00:24:01.600 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T00:24:01.662 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-08T00:24:01.662 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-08T00:24:01.662 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000264566 s, 1.9 MB/s 2023-10-08T00:24:01.663 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T00:24:01.719 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2023-10-08T00:24:01.774 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 220899 Links: 1 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-10-08 00:23:50.162044841 +0000 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-10-08 00:21:15.781166338 +0000 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-10-08 00:21:15.781166338 +0000 2023-10-08T00:24:01.775 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-10-08T00:24:01.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T00:24:01.838 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-10-08T00:24:01.838 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-10-08T00:24:01.838 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.00021873 s, 2.3 MB/s 2023-10-08T00:24:01.839 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T00:24:01.895 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:01.895 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T00:24:01.895 INFO:tasks.ceph:Generating config... 2023-10-08T00:24:01.896 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T00:24:01.897 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T00:24:01.897 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T00:24:01.897 INFO:tasks.ceph:[client] pid file = 2023-10-08T00:24:01.897 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T00:24:01.897 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T00:24:01.897 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-08T00:24:01.897 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T00:24:01.897 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T00:24:01.897 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T00:24:01.897 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T00:24:01.897 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T00:24:01.898 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T00:24:01.899 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T00:24:01.900 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T00:24:01.900 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T00:24:01.900 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T00:24:01.900 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T00:24:01.900 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T00:24:01.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T00:24:01.952 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T00:24:01.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T00:24:01.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T00:24:02.064 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2023-10-08T00:24:02.065 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T00:24:02.066 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:02.066 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T00:24:02.120 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:02.205 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:02.267 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid 583a09b5-95bd-4449-bff4-3bbba2592bdd 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = octopus 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 583a09b5-95bd-4449-bff4-3bbba2592bdd 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2023-10-08T00:24:02.205784+0000 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:created 2023-10-08T00:24:02.205784+0000 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 15 (octopus) 2023-10-08T00:24:02.268 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2023-10-08T00:24:02.269 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2023-10-08T00:24:02.269 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2023-10-08T00:24:02.269 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2023-10-08T00:24:02.269 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T00:24:02.271 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T00:24:02.308 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 583a09b5-95bd-4449-bff4-3bbba2592bdd... 2023-10-08T00:24:02.309 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T00:24:02.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T00:24:02.395 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2023-10-08T00:24:02.396 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T00:24:02.397 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T00:24:02.398 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on skipped message = False 2023-10-08T00:24:02.399 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 583a09b5-95bd-4449-bff4-3bbba2592bdd 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2023-10-08T00:24:02.400 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2023-10-08T00:24:02.401 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2023-10-08T00:24:02.402 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: bdev async discard = True 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: bdev enable discard = True 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore allocator = bitmap 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 1/20 2023-10-08T00:24:02.403 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 1/20 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 4/10 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.404 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2023-10-08T00:24:02.405 INFO:teuthology.orchestra.run.smithi022.stdout: debug finisher = 20 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-10-08T00:24:02.406 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2023-10-08T00:24:02.408 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = "" 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2023-10-08T00:24:02.409 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2023-10-08T00:24:02.410 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2023-10-08T00:24:02.415 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-10-08T00:24:02.415 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.416 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.417 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-10-08T00:24:02.418 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T00:24:02.419 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.22,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 583a09b5-95bd-4449-bff4-3bbba2592bdd 2023-10-08T00:24:02.420 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-10-08T00:24:02.421 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.422 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-10-08T00:24:02.425 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.426 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: bdev async discard = True 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: bdev enable discard = True 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore allocator = bitmap 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 1/20 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 1/20 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-10-08T00:24:02.427 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 4/10 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-10-08T00:24:02.428 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: debug finisher = 20 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.429 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-10-08T00:24:02.430 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.431 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-10-08T00:24:02.432 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-10-08T00:24:02.433 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-10-08T00:24:02.434 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-10-08T00:24:02.434 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-10-08T00:24:02.434 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-10-08T00:24:02.434 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-10-08T00:24:02.434 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-10-08T00:24:02.435 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-10-08T00:24:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-10-08T00:24:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-10-08T00:24:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-10-08T00:24:02.436 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-10-08T00:24:02.436 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T00:24:02.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T00:24:02.507 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T00:24:02.507 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:02.507 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T00:24:02.523 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:02.523 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T00:24:02.582 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:24:02.582 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:02.582 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T00:24:02.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T00:24:02.664 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:02.664 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:02.727 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:24:02.727 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:02.727 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T00:24:02.727 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T00:24:02.765 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:02.766 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:02.823 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T00:24:02.824 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T00:24:02.826 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T00:24:02.876 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T00:24:02.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T00:24:02.937 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T00:24:02.939 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T00:24:02.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T00:24:02.989 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T00:24:02.991 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T00:24:03.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T00:24:03.106 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T00:24:03.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T00:24:03.140 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T00:24:03.188 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T00:24:03.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T00:24:03.261 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T00:24:03.349 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T00:24:03.351 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T00:24:03.376 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T00:24:03.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T00:24:03.416 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T00:24:03.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T00:24:03.515 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T00:24:03.528 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T00:24:03.567 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T00:24:03.579 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T00:24:03.658 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T00:24:03.670 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T00:24:03.671 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T00:24:03.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T00:24:03.697 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:03.697 INFO:tasks.ceph:role: osd.0 2023-10-08T00:24:03.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:24:03.697 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:03.765 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:03.766 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:03.766 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:03.766 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:03.789 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-08T00:24:03.790 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-08T00:24:03.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T00:24:03.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T00:24:03.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T00:24:04.014 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:04.015 INFO:tasks.ceph:role: osd.1 2023-10-08T00:24:04.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:24:04.015 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T00:24:04.080 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:04.080 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:04.081 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:04.103 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-08T00:24:04.104 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-08T00:24:04.105 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T00:24:04.184 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T00:24:04.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T00:24:04.318 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:04.318 INFO:tasks.ceph:role: osd.2 2023-10-08T00:24:04.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:24:04.319 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T00:24:04.383 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:04.383 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:04.383 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:04.383 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2023-10-08T00:24:04.383 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:04.384 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:04.384 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:04.384 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:04.405 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-08T00:24:04.407 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-08T00:24:04.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T00:24:04.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T00:24:04.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T00:24:04.619 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:04.619 INFO:tasks.ceph:role: osd.3 2023-10-08T00:24:04.619 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:24:04.619 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T00:24:04.683 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:04.683 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:04.684 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:04.685 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:04.706 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-08T00:24:04.707 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-08T00:24:04.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T00:24:04.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T00:24:04.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:04.950+0000 7f867721a540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T00:24:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:04.950+0000 7f867721a540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T00:24:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:04.950+0000 7f867721a540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T00:24:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:04.950+0000 7f867721a540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T00:24:04.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:04.950+0000 7f867721a540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T00:24:04.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:04.950+0000 7f867721a540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T00:24:05.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:05.472+0000 7f867721a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:06.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:06.233+0000 7f867721a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:07.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.002+0000 7f867721a540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:07.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T00:24:07.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:07.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.915+0000 7f9b1d936540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T00:24:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.915+0000 7f9b1d936540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T00:24:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.915+0000 7f9b1d936540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T00:24:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.915+0000 7f9b1d936540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T00:24:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.915+0000 7f9b1d936540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T00:24:07.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:07.915+0000 7f9b1d936540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T00:24:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:08.445+0000 7f9b1d936540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:09.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:09.210+0000 7f9b1d936540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:09.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:09.975+0000 7f9b1d936540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:10.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T00:24:10.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:10.888+0000 7ff9f34bb540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T00:24:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:10.888+0000 7ff9f34bb540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T00:24:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:10.888+0000 7ff9f34bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T00:24:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:10.888+0000 7ff9f34bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T00:24:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:10.888+0000 7ff9f34bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T00:24:10.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:10.888+0000 7ff9f34bb540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T00:24:11.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:11.410+0000 7ff9f34bb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:12.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:12.172+0000 7ff9f34bb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:12.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:12.936+0000 7ff9f34bb540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:13.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T00:24:13.767 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:13.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:13.855+0000 7fea16c02540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T00:24:13.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:13.855+0000 7fea16c02540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T00:24:13.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:13.855+0000 7fea16c02540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T00:24:13.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:13.855+0000 7fea16c02540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T00:24:13.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:13.855+0000 7fea16c02540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T00:24:13.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:13.855+0000 7fea16c02540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T00:24:14.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:14.379+0000 7fea16c02540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:15.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:15.142+0000 7fea16c02540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:15.903+0000 7fea16c02540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:16.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T00:24:16.729 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T00:24:16.759 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:16.759 INFO:tasks.ceph:role: osd.4 2023-10-08T00:24:16.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:24:16.760 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:16.836 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:16.837 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:17.270 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-08T00:24:17.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-08T00:24:17.272 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T00:24:17.433 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T00:24:17.467 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T00:24:17.536 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:17.536 INFO:tasks.ceph:role: osd.5 2023-10-08T00:24:17.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:24:17.536 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:17.610 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:17.611 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:18.032 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-08T00:24:18.034 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-08T00:24:18.034 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T00:24:18.152 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T00:24:18.184 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T00:24:18.250 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:18.251 INFO:tasks.ceph:role: osd.6 2023-10-08T00:24:18.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:24:18.251 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:18.324 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:18.325 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:18.325 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:18.325 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:18.776 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-08T00:24:18.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-08T00:24:18.779 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T00:24:18.924 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T00:24:18.956 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T00:24:19.020 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T00:24:19.020 INFO:tasks.ceph:role: osd.7 2023-10-08T00:24:19.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:24:19.021 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T00:24:19.092 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T00:24:19.093 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T00:24:19.538 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2023-10-08T00:24:19.539 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-10-08T00:24:19.539 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T00:24:19.710 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T00:24:19.739 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:19.828 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:19.827+0000 7fae3559d540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T00:24:19.828 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:19.827+0000 7fae3559d540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T00:24:19.828 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:19.827+0000 7fae3559d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T00:24:19.828 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:19.827+0000 7fae3559d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T00:24:19.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:19.827+0000 7fae3559d540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T00:24:19.829 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:19.827+0000 7fae3559d540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T00:24:20.353 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:20.352+0000 7fae3559d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:21.117 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:21.116+0000 7fae3559d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:21.883 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:21.882+0000 7fae3559d540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:22.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T00:24:22.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:22.798 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:22.797+0000 7f994fd93540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T00:24:22.799 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:22.797+0000 7f994fd93540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T00:24:22.799 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:22.797+0000 7f994fd93540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T00:24:22.799 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:22.797+0000 7f994fd93540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T00:24:22.799 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:22.797+0000 7f994fd93540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T00:24:22.799 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:22.798+0000 7f994fd93540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T00:24:23.322 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:23.321+0000 7f994fd93540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:24.084 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:24.083+0000 7f994fd93540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:24.850 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:24.849+0000 7f994fd93540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:25.642 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T00:24:25.669 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:25.752 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:25.752+0000 7f532fb69540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T00:24:25.752 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:25.752+0000 7f532fb69540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T00:24:25.752 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:25.752+0000 7f532fb69540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T00:24:25.753 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:25.752+0000 7f532fb69540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T00:24:25.753 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:25.752+0000 7f532fb69540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T00:24:25.753 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:25.753+0000 7f532fb69540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T00:24:26.283 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:26.282+0000 7f532fb69540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:27.049 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:27.049+0000 7f532fb69540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:27.811 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:27.811+0000 7f532fb69540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:28.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T00:24:28.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:28.757 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:28.757+0000 7f7b278b9540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T00:24:28.758 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:28.757+0000 7f7b278b9540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T00:24:28.758 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:28.757+0000 7f7b278b9540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T00:24:28.758 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:28.757+0000 7f7b278b9540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T00:24:28.758 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:28.757+0000 7f7b278b9540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T00:24:28.758 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:28.758+0000 7f7b278b9540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T00:24:29.281 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:29.281+0000 7f7b278b9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:30.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:30.042+0000 7f7b278b9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:30.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:24:30.328 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:24:30.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:30.806+0000 7f7b278b9540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T00:24:31.600 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T00:24:31.627 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T00:24:31.627 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T00:24:31.658 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T00:24:31.728 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.728 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T00:24:31.797 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T00:24:31.865 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T00:24:31.932 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T00:24:31.999 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:31.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T00:24:32.066 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T00:24:32.095 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.095 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T00:24:32.162 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.162 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T00:24:32.229 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.229 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T00:24:32.295 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T00:24:32.361 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.361 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T00:24:32.427 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.427 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T00:24:32.491 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:32.491 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T00:24:32.507 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:32.507 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T00:24:32.563 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.563 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T00:24:32.578 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:32.578 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T00:24:32.632 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T00:24:32.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T00:24:32.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T00:24:32.674 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw== 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw== 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw== 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q== 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA== 2023-10-08T00:24:32.675 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw== 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw== 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg== 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA== 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw== 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w== 2023-10-08T00:24:32.676 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug== 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA== 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ== 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g== 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout:[client.2] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw== 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg== 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout:[client.3] 2023-10-08T00:24:32.677 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA== 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw== 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw== 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw== 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q== 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-10-08T00:24:32.694 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA== 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw== 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw== 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg== 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA== 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw== 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2023-10-08T00:24:32.695 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w== 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug== 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA== 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ== 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g== 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw== 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2023-10-08T00:24:32.696 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg== 2023-10-08T00:24:32.697 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2023-10-08T00:24:32.697 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA== 2023-10-08T00:24:32.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T00:24:32.721 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T00:24:32.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:32.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:32.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:32.839 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:32.889 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:32.891 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:32.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:32.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:32.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:32.990 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.039 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T00:24:33.088 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T00:24:33.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:33.137 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:33.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:33.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T00:24:33.328 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.390 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.479 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.487 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.538 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T00:24:33.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.628 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.690 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.752 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T00:24:33.911 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T00:24:33.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T00:24:33.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T00:24:34.038 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T00:24:34.076 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T00:24:34.105 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T00:24:34.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T00:24:34.223 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T00:24:34.288 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T00:24:34.380 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T00:24:34.404 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:34.407 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T00:24:34.459 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T00:24:34.460 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T00:24:34.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T00:24:34.463 INFO:tasks.ceph.mon.a:Started 2023-10-08T00:24:34.463 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T00:24:34.463 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T00:24:34.503 INFO:tasks.ceph.mon.b:Started 2023-10-08T00:24:34.503 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T00:24:34.503 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T00:24:34.505 INFO:tasks.ceph.mon.c:Started 2023-10-08T00:24:34.505 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T00:24:34.506 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T00:24:34.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T00:24:34.508 INFO:tasks.ceph.mgr.y:Started 2023-10-08T00:24:34.508 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T00:24:34.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T00:24:34.511 INFO:tasks.ceph.mgr.x:Started 2023-10-08T00:24:34.511 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T00:24:34.511 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T00:24:34.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.630+0000 7f88a7630700 1 Processor -- start 2023-10-08T00:24:34.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.630+0000 7f88a7630700 1 -- start start 2023-10-08T00:24:34.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a7630700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 0x7f88a0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a7630700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f88a0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a7630700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a015c2a0 con 0x7f88a00c8e00 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a7630700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a015b690 con 0x7f88a006bcd0 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a7630700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a015b970 con 0x7f88a006c0a0 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a5bcd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f88a00c8e00 0x7f88a00c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34666/0 (socket says 172.21.15.22:34666) 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a5bcd700 1 -- 172.21.15.22:0/346652834 learned_addr learned my addr 172.21.15.22:0/346652834 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f88a0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.631+0000 7f88a53cc700 1 --2- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 0x7f88a0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a4bcb700 1 -- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 msgr2=0x7f88a0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a4bcb700 1 -- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 msgr2=0x7f88a0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T00:24:34.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a53cc700 1 -- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 msgr2=0x7f88a0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T00:24:34.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f88a0141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T00:24:34.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a53cc700 1 -- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 msgr2=0x7f88a0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T00:24:34.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a53cc700 1 --2- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 0x7f88a0140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T00:24:34.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a53cc700 1 --2- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 0x7f88a0140df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T00:24:34.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.632+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f88a0141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T00:24:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.787+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397982438 0 0) 0x7f88a015c2a0 con 0x7f88a00c8e00 2023-10-08T00:24:34.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.787+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f888c003570 con 0x7f88a00c8e00 2023-10-08T00:24:34.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 881897280 0 0) 0x7f888c003570 con 0x7f88a00c8e00 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 msgr2=0x7f88a0141330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f88a0141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 msgr2=0x7f88a0140df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 --2- 172.21.15.22:0/346652834 >> v2:172.21.15.192:3300/0 conn(0x7f88a006bcd0 0x7f88a0140df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a015bc50 con 0x7f88a00c8e00 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f88980017f0 con 0x7f88a00c8e00 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 >> v1:172.21.15.22:6789/0 conn(0x7f88a00c8e00 legacy=0x7f88a00c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f888c003a60 0x7f888c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f888c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f888c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a015b690 con 0x7f888c004810 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a015b970 con 0x7f888c003a60 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c00bb90 con 0x7f88a006c0a0 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f888c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f88a53cc700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f888c003a60 0x7f888c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.788+0000 7f88a5bcd700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f888c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f88a4bcb700 1 -- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 msgr2=0x7f888c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006c0a0 0x7f888c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f88a4bcb700 1 -- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f888c003a60 msgr2=0x7f888c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f888c003a60 0x7f888c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f88a4bcb700 1 -- 172.21.15.22:0/346652834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c003570 con 0x7f888c004810 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f888c004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f889000bb40 tx=0x7f8890008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2f37d60f3c7aac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:34.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890018070 con 0x7f888c004810 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889000d5d0 con 0x7f888c004810 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.789+0000 7f8897fff700 1 -- 172.21.15.22:0/346652834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000d990 con 0x7f888c004810 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a7630700 1 -- 172.21.15.22:0/346652834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 msgr2=0x7f888c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a7630700 1 --2- 172.21.15.22:0/346652834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f888c004c80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f889000bb40 tx=0x7f8890008040 comp rx=0 tx=0).stop 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a5bcd700 1 -- 172.21.15.22:0/346652834 reap_dead start 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a7630700 1 -- 172.21.15.22:0/346652834 shutdown_connections 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a7630700 1 -- 172.21.15.22:0/346652834 >> 172.21.15.22:0/346652834 conn(0x7f88a00ce600 msgr2=0x7f88a00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a7630700 1 -- 172.21.15.22:0/346652834 shutdown_connections 2023-10-08T00:24:34.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.790+0000 7f88a7630700 1 -- 172.21.15.22:0/346652834 wait complete. 2023-10-08T00:24:34.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.791+0000 7f88a7630700 1 Processor -- start 2023-10-08T00:24:34.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.791+0000 7f88a7630700 1 -- start start 2023-10-08T00:24:34.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a7630700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f88a01580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a7630700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006a9c0 0x7f88a00b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a7630700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00c67d0 0x7f88a00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a7630700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00c7180 con 0x7f888c004810 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a7630700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0158af0 con 0x7f88a00c67d0 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a7630700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a00b3b80 con 0x7f88a006a9c0 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f88a01580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f88a01580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42170/0 (socket says 172.21.15.22:42170) 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a5bcd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00c67d0 0x7f88a00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 -- 172.21.15.22:0/383351709 learned_addr learned my addr 172.21.15.22:0/383351709 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a4bcb700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006a9c0 0x7f88a00b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 -- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006a9c0 msgr2=0x7f88a00b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006a9c0 0x7f88a00b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 -- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00c67d0 msgr2=0x7f88a00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:34.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00c67d0 0x7f88a00c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.792+0000 7f88a53cc700 1 -- 172.21.15.22:0/383351709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00b3e60 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.793+0000 7f88a53cc700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f88a01580f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f889c010cd0 tx=0x7f889c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.793+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00e8d0 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.793+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00ea30 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.793+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a006a1c0 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.793+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00edd0 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.793+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a0069e80 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.794+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f889c016690 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.794+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f889c014780 con 0x7f888c004810 2023-10-08T00:24:34.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.794+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a004c3c0 con 0x7f888c004810 2023-10-08T00:24:34.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.796+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f889c03e6d0 con 0x7f888c004810 2023-10-08T00:24:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.872+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f88a015bf30 con 0x7f888c004810 2023-10-08T00:24:34.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.874+0000 7f88957fa700 1 -- 172.21.15.22:0/383351709 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f889c02d020 con 0x7f888c004810 2023-10-08T00:24:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 msgr2=0x7f88a01580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f88a01580f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f889c010cd0 tx=0x7f889c008040 comp rx=0 tx=0).stop 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 shutdown_connections 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00c67d0 0x7f88a00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f888c004810 0x7f88a01580f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 --2- 172.21.15.22:0/383351709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88a006a9c0 0x7f88a00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 >> 172.21.15.22:0/383351709 conn(0x7f88a00ce600 msgr2=0x7f88a00c47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 shutdown_connections 2023-10-08T00:24:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:34.875+0000 7f88a7630700 1 -- 172.21.15.22:0/383351709 wait complete. 2023-10-08T00:24:34.878 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2023-10-08T00:24:34.888 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T00:24:34.888 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:34.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T00:24:34.914 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:34.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T00:24:34.979 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:34.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T00:24:35.044 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-08T00:24:35.044 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T00:24:35.109 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:35.109 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T00:24:35.134 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:35.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T00:24:35.200 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:35.200 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T00:24:35.264 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-10-08T00:24:35.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T00:24:35.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 70c0c0c8-a26e-496f-9232-c306279b97f9 0 2023-10-08T00:24:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.485+0000 7f8257786700 1 Processor -- start 2023-10-08T00:24:35.485 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.485+0000 7f8257786700 1 -- start start 2023-10-08T00:24:35.488 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8257786700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8250159890 0x7f825015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8257786700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8250159c60 0x7f825015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8257786700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825015a160 con 0x7f825015db10 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8257786700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82500d13a0 con 0x7f8250159c60 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8257786700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825015e140 con 0x7f8250159890 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255522700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8250159890 0x7f825015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255d23700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f825015db10 0x7f8250069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:34824/0 (socket says 172.21.15.192:34824) 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255d23700 1 -- 172.21.15.192:0/879071629 learned_addr learned my addr 172.21.15.192:0/879071629 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-08T00:24:35.489 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8254d21700 1 --2- 172.21.15.192:0/879071629 >> v2:172.21.15.22:3300/0 conn(0x7f8250159c60 0x7f825015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255522700 1 -- 172.21.15.192:0/879071629 >> v2:172.21.15.22:3300/0 conn(0x7f8250159c60 msgr2=0x7f825015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255522700 1 --2- 172.21.15.192:0/879071629 >> v2:172.21.15.22:3300/0 conn(0x7f8250159c60 0x7f825015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255522700 1 -- 172.21.15.192:0/879071629 >> v1:172.21.15.192:6789/0 conn(0x7f825015db10 legacy=0x7f8250069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8247fff700 1 -- 172.21.15.192:0/879071629 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993893839 0 0) 0x7f825015a160 con 0x7f825015db10 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255522700 1 -- 172.21.15.192:0/879071629 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825015a3d0 con 0x7f8250159890 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.486+0000 7f8255522700 1 --2- 172.21.15.192:0/879071629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8250159890 0x7f825015abd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098e0 tx=0x7f824c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28c9fa36a56ce464 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8247fff700 1 -- 172.21.15.192:0/879071629 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c00b640 con 0x7f8250159890 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8247fff700 1 -- 172.21.15.192:0/879071629 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c00b7a0 con 0x7f8250159890 2023-10-08T00:24:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8247fff700 1 -- 172.21.15.192:0/879071629 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c00bb40 con 0x7f8250159890 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 -- 172.21.15.192:0/879071629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8250159890 msgr2=0x7f825015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 --2- 172.21.15.192:0/879071629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8250159890 0x7f825015abd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f824c0098e0 tx=0x7f824c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 -- 172.21.15.192:0/879071629 shutdown_connections 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 --2- 172.21.15.192:0/879071629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8250159890 0x7f825015abd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 --2- 172.21.15.192:0/879071629 >> v2:172.21.15.22:3300/0 conn(0x7f8250159c60 0x7f825015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 -- 172.21.15.192:0/879071629 >> 172.21.15.192:0/879071629 conn(0x7f8250068e20 msgr2=0x7f82500d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 -- 172.21.15.192:0/879071629 shutdown_connections 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.487+0000 7f8257786700 1 -- 172.21.15.192:0/879071629 wait complete. 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.488+0000 7f8257786700 1 Processor -- start 2023-10-08T00:24:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 -- start start 2023-10-08T00:24:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8250159890 0x7f82500b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 0x7f82500ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 0x7f82500cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8250158ba0 con 0x7f8250159890 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825015d0f0 con 0x7f8250159c60 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.489+0000 7f8257786700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82500ce550 con 0x7f825015db10 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 0x7f82500cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8254d21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 0x7f82500ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8254d21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 0x7f82500ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39168/0 (socket says 172.21.15.192:39168) 2023-10-08T00:24:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 0x7f82500cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38620/0 (socket says 172.21.15.192:38620) 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8254d21700 1 -- 172.21.15.192:0/1947777323 learned_addr learned my addr 172.21.15.192:0/1947777323 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255522700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8250159890 0x7f82500b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 -- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 msgr2=0x7f82500ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 0x7f82500ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 -- 172.21.15.192:0/1947777323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8250159890 msgr2=0x7f82500b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8250159890 0x7f82500b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 -- 172.21.15.192:0/1947777323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c009420 con 0x7f825015db10 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8254d21700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 0x7f82500ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8255d23700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 0x7f82500cef20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f824800cb90 tx=0x7f82480018f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800a780 con 0x7f825015db10 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824800a8e0 con 0x7f825015db10 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824800aca0 con 0x7f825015db10 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82500b6420 con 0x7f825015db10 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.490+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82500cdf00 con 0x7f825015db10 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.491+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f8248007300 con 0x7f825015db10 2023-10-08T00:24:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.491+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f824801b750 con 0x7f825015db10 2023-10-08T00:24:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.491+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82500ce6e0 con 0x7f825015db10 2023-10-08T00:24:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.493+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f8248007740 con 0x7f825015db10 2023-10-08T00:24:35.576 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.576+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70c0c0c8-a26e-496f-9232-c306279b97f9", "id": 0} v 0) v1 -- 0x7f825004c3c0 con 0x7f825015db10 2023-10-08T00:24:35.579 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.579+0000 7f82457fa700 1 -- 172.21.15.192:0/1947777323 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70c0c0c8-a26e-496f-9232-c306279b97f9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f82480078e0 con 0x7f825015db10 2023-10-08T00:24:35.579 INFO:teuthology.orchestra.run.smithi192.stdout:0 2023-10-08T00:24:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 msgr2=0x7f82500cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 0x7f82500cef20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f824800cb90 tx=0x7f82480018f0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 shutdown_connections 2023-10-08T00:24:35.580 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f825015db10 0x7f82500cef20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8250159890 0x7f82500b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 --2- 172.21.15.192:0/1947777323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8250159c60 0x7f82500ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 >> 172.21.15.192:0/1947777323 conn(0x7f8250068e20 msgr2=0x7f82500b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 shutdown_connections 2023-10-08T00:24:35.581 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.580+0000 7f8257786700 1 -- 172.21.15.192:0/1947777323 wait complete. 2023-10-08T00:24:35.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new b6694b00-d459-4d13-aae8-4df6fe7764a6 1 2023-10-08T00:24:35.706 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.706+0000 7fda9abb4700 1 Processor -- start 2023-10-08T00:24:35.707 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.707+0000 7fda9abb4700 1 -- start start 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.707+0000 7fda9abb4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 0x7fda9406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.707+0000 7fda9abb4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 0x7fda940c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.707+0000 7fda9abb4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9406bdb0 con 0x7fda940c81f0 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.707+0000 7fda9abb4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda940c8670 con 0x7fda940aca80 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.707+0000 7fda9abb4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda940cb370 con 0x7fda94069d60 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 0x7fda940c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda98950700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 0x7fda9406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.709 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 0x7fda940c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38636/0 (socket says 172.21.15.192:38636) 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda98950700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 0x7fda9406aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39174/0 (socket says 172.21.15.192:39174) 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 -- 172.21.15.192:0/3182859487 learned_addr learned my addr 172.21.15.192:0/3182859487 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 -- 172.21.15.192:0/3182859487 >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 msgr2=0x7fda9406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 --2- 172.21.15.192:0/3182859487 >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 0x7fda9406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 -- 172.21.15.192:0/3182859487 >> v1:172.21.15.22:6789/0 conn(0x7fda940c81f0 legacy=0x7fda94068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 -- 172.21.15.192:0/3182859487 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda94159f60 con 0x7fda94069d60 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda98950700 1 --2- 172.21.15.192:0/3182859487 >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 0x7fda9406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda93fff700 1 --2- 172.21.15.192:0/3182859487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 0x7fda940c7cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda800099b0 tx=0x7fda80009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e95d59f83a0bfa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda937fe700 1 -- 172.21.15.192:0/3182859487 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80009ea0 con 0x7fda94069d60 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda937fe700 1 -- 172.21.15.192:0/3182859487 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8000b860 con 0x7fda94069d60 2023-10-08T00:24:35.710 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.708+0000 7fda937fe700 1 -- 172.21.15.192:0/3182859487 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000bc00 con 0x7fda94069d60 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 -- 172.21.15.192:0/3182859487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 msgr2=0x7fda940c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 --2- 172.21.15.192:0/3182859487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 0x7fda940c7cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fda800099b0 tx=0x7fda80009250 comp rx=0 tx=0).stop 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 -- 172.21.15.192:0/3182859487 shutdown_connections 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 --2- 172.21.15.192:0/3182859487 >> v2:172.21.15.192:3300/0 conn(0x7fda940aca80 0x7fda9406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 --2- 172.21.15.192:0/3182859487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda94069d60 0x7fda940c7cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 -- 172.21.15.192:0/3182859487 >> 172.21.15.192:0/3182859487 conn(0x7fda940cd670 msgr2=0x7fda940cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 -- 172.21.15.192:0/3182859487 shutdown_connections 2023-10-08T00:24:35.711 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.709+0000 7fda9abb4700 1 -- 172.21.15.192:0/3182859487 wait complete. 2023-10-08T00:24:35.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.710+0000 7fda9abb4700 1 Processor -- start 2023-10-08T00:24:35.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.710+0000 7fda9abb4700 1 -- start start 2023-10-08T00:24:35.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94069d60 0x7fda94068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 0x7fda940b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda940c81f0 0x7fda940ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.713 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda940b0a80 con 0x7fda940c81f0 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda941572f0 con 0x7fda94069d60 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda941575d0 con 0x7fda940aca80 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 0x7fda940b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda98950700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94069d60 0x7fda94068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 0x7fda940b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38648/0 (socket says 172.21.15.192:38648) 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 -- 172.21.15.192:0/1856488085 learned_addr learned my addr 172.21.15.192:0/1856488085 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda99151700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda940c81f0 0x7fda940ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 -- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94069d60 msgr2=0x7fda94068950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94069d60 0x7fda94068950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 -- 172.21.15.192:0/1856488085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda940c81f0 msgr2=0x7fda940ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda940c81f0 0x7fda940ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 -- 172.21.15.192:0/1856488085 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda880093c0 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda99151700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda940c81f0 0x7fda940ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda93fff700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 0x7fda940b2b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda940cb4b0 tx=0x7fda80017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8000bbe0 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda80011420 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.711+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800094f0 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.712+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda800117c0 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.712+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda94157b90 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.712+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fda8002e3f0 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.712+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fda800257b0 con 0x7fda940aca80 2023-10-08T00:24:35.715 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.712+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9404c3c0 con 0x7fda940aca80 2023-10-08T00:24:35.716 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.714+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fda80033060 con 0x7fda940aca80 2023-10-08T00:24:35.800 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.800+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b6694b00-d459-4d13-aae8-4df6fe7764a6", "id": 1} v 0) v1 -- 0x7fda9406b510 con 0x7fda940aca80 2023-10-08T00:24:35.803 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda90ff9700 1 -- 172.21.15.192:0/1856488085 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6694b00-d459-4d13-aae8-4df6fe7764a6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda80015020 con 0x7fda940aca80 2023-10-08T00:24:35.804 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 msgr2=0x7fda940b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda9abb4700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 0x7fda940b2b50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda940cb4b0 tx=0x7fda80017000 comp rx=0 tx=0).stop 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 shutdown_connections 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda9abb4700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda940c81f0 0x7fda940ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda9abb4700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda94069d60 0x7fda94068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.804+0000 7fda9abb4700 1 --2- 172.21.15.192:0/1856488085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fda940aca80 0x7fda940b2b50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.805+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 >> 172.21.15.192:0/1856488085 conn(0x7fda940cd670 msgr2=0x7fda940c2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:35.805 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.805+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 shutdown_connections 2023-10-08T00:24:35.806 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.805+0000 7fda9abb4700 1 -- 172.21.15.192:0/1856488085 wait complete. 2023-10-08T00:24:35.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 375599f7-abb0-414a-b832-a1531da4e31a 2 2023-10-08T00:24:35.932 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.932+0000 7f30ef898700 1 Processor -- start 2023-10-08T00:24:35.932 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.932+0000 7f30ef898700 1 -- start start 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ef898700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30e8159890 0x7f30e815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ef898700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30e8069560 0x7f30e80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ef898700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e8069ee0 con 0x7f30e8159c60 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ef898700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e815a160 con 0x7f30e8069560 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ef898700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80d13a0 con 0x7f30e8159890 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ed634700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30e8159890 0x7f30e815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ed634700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30e8159890 0x7f30e815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39190/0 (socket says 172.21.15.192:39190) 2023-10-08T00:24:35.935 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ed634700 1 -- 172.21.15.192:0/2230246269 learned_addr learned my addr 172.21.15.192:0/2230246269 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.933+0000 7f30ede35700 1 --2- 172.21.15.192:0/2230246269 >> v2:172.21.15.22:3300/0 conn(0x7f30e8069560 0x7f30e80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30ed634700 1 -- 172.21.15.192:0/2230246269 >> v2:172.21.15.22:3300/0 conn(0x7f30e8069560 msgr2=0x7f30e80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30ed634700 1 --2- 172.21.15.192:0/2230246269 >> v2:172.21.15.22:3300/0 conn(0x7f30e8069560 0x7f30e80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30ed634700 1 -- 172.21.15.192:0/2230246269 >> v1:172.21.15.22:6789/0 conn(0x7f30e8159c60 legacy=0x7f30e815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30ed634700 1 -- 172.21.15.192:0/2230246269 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e815e140 con 0x7f30e8159890 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30ed634700 1 --2- 172.21.15.192:0/2230246269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e815abd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f30e80d1090 tx=0x7f30d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96932c4cd6389b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30dffff700 1 -- 172.21.15.192:0/2230246269 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8009e70 con 0x7f30e8159890 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30dffff700 1 -- 172.21.15.192:0/2230246269 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800b860 con 0x7f30e8159890 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.934+0000 7f30dffff700 1 -- 172.21.15.192:0/2230246269 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800bc00 con 0x7f30e8159890 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 -- 172.21.15.192:0/2230246269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 msgr2=0x7f30e815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.936 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 --2- 172.21.15.192:0/2230246269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e815abd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f30e80d1090 tx=0x7f30d8009250 comp rx=0 tx=0).stop 2023-10-08T00:24:35.937 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 -- 172.21.15.192:0/2230246269 shutdown_connections 2023-10-08T00:24:35.937 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 --2- 172.21.15.192:0/2230246269 >> v2:172.21.15.22:3300/0 conn(0x7f30e8069560 0x7f30e80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.937 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 --2- 172.21.15.192:0/2230246269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e815abd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.937 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 -- 172.21.15.192:0/2230246269 >> 172.21.15.192:0/2230246269 conn(0x7f30e8068e20 msgr2=0x7f30e80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:35.937 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 -- 172.21.15.192:0/2230246269 shutdown_connections 2023-10-08T00:24:35.937 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.935+0000 7f30ef898700 1 -- 172.21.15.192:0/2230246269 wait complete. 2023-10-08T00:24:35.939 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.936+0000 7f30ef898700 1 Processor -- start 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.936+0000 7f30ef898700 1 -- start start 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ef898700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e8069560 0x7f30e81480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ef898700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e80b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ef898700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e8159c60 0x7f30e815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ef898700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e816ce50 con 0x7f30e8069560 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ef898700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e816d130 con 0x7f30e8159890 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ef898700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e816d410 con 0x7f30e8159c60 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ede35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e8159c60 0x7f30e815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e80b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ede35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e8159c60 0x7f30e815ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38658/0 (socket says 172.21.15.192:38658) 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ede35700 1 -- 172.21.15.192:0/898492451 learned_addr learned my addr 172.21.15.192:0/898492451 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:35.940 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ed634700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e8069560 0x7f30e81480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 -- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e8159c60 msgr2=0x7f30e815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e8159c60 0x7f30e815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 -- 172.21.15.192:0/898492451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e8069560 msgr2=0x7f30e81480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e8069560 0x7f30e81480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 -- 172.21.15.192:0/898492451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d80094f0 con 0x7f30e8159890 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ed634700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e8069560 0x7f30e81480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30ece33700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e80b54a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c490 tx=0x7f30e4007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.938+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e400ce40 con 0x7f30e8159890 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e4011590 con 0x7f30e8159890 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e816d6f0 con 0x7f30e8159890 2023-10-08T00:24:35.941 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4011950 con 0x7f30e8159890 2023-10-08T00:24:35.942 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8148630 con 0x7f30e8159890 2023-10-08T00:24:35.942 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f30e401c440 con 0x7f30e8159890 2023-10-08T00:24:35.942 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f30e4000f90 con 0x7f30e8159890 2023-10-08T00:24:35.942 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.939+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e816dc10 con 0x7f30e8159890 2023-10-08T00:24:35.942 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:35.942+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f30e816dc10 con 0x7f30e8159890 2023-10-08T00:24:35.985 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:35.985+0000 7f7de49af180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T00:24:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.024+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "375599f7-abb0-414a-b832-a1531da4e31a", "id": 2} v 0) v1 -- 0x7f30e804c3c0 con 0x7f30e8159890 2023-10-08T00:24:36.028 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.028+0000 7f30dd7fa700 1 -- 172.21.15.192:0/898492451 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "375599f7-abb0-414a-b832-a1531da4e31a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30e4017070 con 0x7f30e8159890 2023-10-08T00:24:36.028 INFO:teuthology.orchestra.run.smithi192.stdout:2 2023-10-08T00:24:36.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 msgr2=0x7f30e80b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e80b54a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c490 tx=0x7f30e4007ec0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 shutdown_connections 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e8159c60 0x7f30e815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e8069560 0x7f30e81480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 --2- 172.21.15.192:0/898492451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e8159890 0x7f30e80b54a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 >> 172.21.15.192:0/898492451 conn(0x7f30e8068e20 msgr2=0x7f30e81543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 shutdown_connections 2023-10-08T00:24:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.029+0000 7f30ef898700 1 -- 172.21.15.192:0/898492451 wait complete. 2023-10-08T00:24:36.040 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 5e95180c-0f8f-4ac9-9b42-f2fd67b04809 3 2023-10-08T00:24:36.124 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.124+0000 7f7de49af180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T00:24:36.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.155+0000 7feb3c696700 1 Processor -- start 2023-10-08T00:24:36.155 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.155+0000 7feb3c696700 1 -- start start 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb3c696700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb3c696700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb3415df50 0x7feb3415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb3c696700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3415d7e0 con 0x7feb3406bcd0 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb3c696700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3415dac0 con 0x7feb3415df50 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb3c696700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3415aa30 con 0x7feb3406c0a0 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb39c31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb3ac33700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb3415df50 0x7feb3415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.158 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb39c31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38668/0 (socket says 172.21.15.192:38668) 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.156+0000 7feb39c31700 1 -- 172.21.15.192:0/213424171 learned_addr learned my addr 172.21.15.192:0/213424171 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39c31700 1 -- 172.21.15.192:0/213424171 >> v2:172.21.15.192:3300/0 conn(0x7feb3415df50 msgr2=0x7feb3415e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39c31700 1 --2- 172.21.15.192:0/213424171 >> v2:172.21.15.192:3300/0 conn(0x7feb3415df50 0x7feb3415e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39c31700 1 -- 172.21.15.192:0/213424171 >> v1:172.21.15.22:6789/0 conn(0x7feb3406bcd0 legacy=0x7feb3415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39c31700 1 -- 172.21.15.192:0/213424171 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3415ad10 con 0x7feb3406c0a0 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39c31700 1 --2- 172.21.15.192:0/213424171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340caa90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feb300099b0 tx=0x7feb30009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68ad7bd80887080e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39430700 1 -- 172.21.15.192:0/213424171 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30009ea0 con 0x7feb3406c0a0 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39430700 1 -- 172.21.15.192:0/213424171 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000b860 con 0x7feb3406c0a0 2023-10-08T00:24:36.159 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.157+0000 7feb39430700 1 -- 172.21.15.192:0/213424171 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000bc20 con 0x7feb3406c0a0 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 -- 172.21.15.192:0/213424171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 msgr2=0x7feb340caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 --2- 172.21.15.192:0/213424171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340caa90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feb300099b0 tx=0x7feb30009250 comp rx=0 tx=0).stop 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 -- 172.21.15.192:0/213424171 shutdown_connections 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 --2- 172.21.15.192:0/213424171 >> v2:172.21.15.192:3300/0 conn(0x7feb3415df50 0x7feb3415e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 --2- 172.21.15.192:0/213424171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340caa90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 -- 172.21.15.192:0/213424171 >> 172.21.15.192:0/213424171 conn(0x7feb340ce600 msgr2=0x7feb340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 -- 172.21.15.192:0/213424171 shutdown_connections 2023-10-08T00:24:36.160 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.158+0000 7feb3c696700 1 -- 172.21.15.192:0/213424171 wait complete. 2023-10-08T00:24:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 Processor -- start 2023-10-08T00:24:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 -- start start 2023-10-08T00:24:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 0x7feb3414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb3415df50 0x7feb340c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.163 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb340c56b0 con 0x7feb3415df50 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb340c5c70 con 0x7feb3406bcd0 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.159+0000 7feb3c696700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb340b2870 con 0x7feb3406c0a0 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb3a432700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 0x7feb3414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38674/0 (socket says 172.21.15.192:38674) 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb3a432700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 0x7feb3414c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39208/0 (socket says 172.21.15.192:39208) 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 -- 172.21.15.192:0/3444584932 learned_addr learned my addr 172.21.15.192:0/3444584932 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb3ac33700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb3415df50 0x7feb340c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 -- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 msgr2=0x7feb3414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 0x7feb3414c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 -- 172.21.15.192:0/3444584932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb3415df50 msgr2=0x7feb340c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.164 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb3415df50 0x7feb340c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 -- 172.21.15.192:0/3444584932 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300094f0 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb3a432700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 0x7feb3414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb39c31700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340b1db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb3000b3c0 tx=0x7feb30017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3001f070 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30006b10 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb340b2b50 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000bc00 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3414c970 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feb300118b0 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.160+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7feb300238b0 con 0x7feb3406c0a0 2023-10-08T00:24:36.165 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.161+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3404c3c0 con 0x7feb3406c0a0 2023-10-08T00:24:36.166 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.163+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7feb30028070 con 0x7feb3406c0a0 2023-10-08T00:24:36.203 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.203+0000 7f7de49af180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T00:24:36.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.246+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5e95180c-0f8f-4ac9-9b42-f2fd67b04809", "id": 3} v 0) v1 -- 0x7feb340c5db0 con 0x7feb3406c0a0 2023-10-08T00:24:36.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.249+0000 7feb2a7fc700 1 -- 172.21.15.192:0/3444584932 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e95180c-0f8f-4ac9-9b42-f2fd67b04809", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb30015020 con 0x7feb3406c0a0 2023-10-08T00:24:36.249 INFO:teuthology.orchestra.run.smithi192.stdout:3 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 msgr2=0x7feb340b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340b1db0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb3000b3c0 tx=0x7feb30017000 comp rx=0 tx=0).stop 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 shutdown_connections 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb3415df50 0x7feb340c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb3406bcd0 0x7feb3414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 --2- 172.21.15.192:0/3444584932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb3406c0a0 0x7feb340b1db0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.250+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 >> 172.21.15.192:0/3444584932 conn(0x7feb340ce600 msgr2=0x7feb34159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.251+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 shutdown_connections 2023-10-08T00:24:36.251 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.251+0000 7feb3c696700 1 -- 172.21.15.192:0/3444584932 wait complete. 2023-10-08T00:24:36.263 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 67effb79-e51b-4db9-99b7-e5409f84380a 4 2023-10-08T00:24:36.379 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.379+0000 7f585e428700 1 Processor -- start 2023-10-08T00:24:36.380 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.379+0000 7f585e428700 1 -- start start 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585e428700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5858159890 0x7f585815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585e428700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 0x7f585815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585e428700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f585815db10 0x7f5858069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585e428700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585815a160 con 0x7f585815db10 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585e428700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58580d13a0 con 0x7f5858159890 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585e428700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585815e140 con 0x7f5858159c60 2023-10-08T00:24:36.382 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f58577fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 0x7f585815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f5857fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5858159890 0x7f585815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f5857fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5858159890 0x7f585815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39224/0 (socket says 172.21.15.192:39224) 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f5857fff700 1 -- 172.21.15.192:0/3048183726 learned_addr learned my addr 172.21.15.192:0/3048183726 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f58577fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 0x7f585815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38686/0 (socket says 172.21.15.192:38686) 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.380+0000 7f585c9c5700 1 --2- 172.21.15.192:0/3048183726 >> v2:172.21.15.22:3300/0 conn(0x7f585815db10 0x7f5858069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5857fff700 1 -- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 msgr2=0x7f585815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5857fff700 1 --2- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 0x7f585815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5857fff700 1 -- 172.21.15.192:0/3048183726 >> v2:172.21.15.22:3300/0 conn(0x7f585815db10 msgr2=0x7f5858069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:36.383 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5857fff700 1 --2- 172.21.15.192:0/3048183726 >> v2:172.21.15.22:3300/0 conn(0x7f585815db10 0x7f5858069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5857fff700 1 -- 172.21.15.192:0/3048183726 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585815a3d0 con 0x7f5858159890 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f58577fe700 1 --2- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 0x7f585815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5857fff700 1 --2- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585815abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58580d1090 tx=0x7f584c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d84d548e18a519f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5856ffd700 1 -- 172.21.15.192:0/3048183726 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00b640 con 0x7f5858159890 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5856ffd700 1 -- 172.21.15.192:0/3048183726 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c00b7a0 con 0x7f5858159890 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f5856ffd700 1 -- 172.21.15.192:0/3048183726 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c00bb60 con 0x7f5858159890 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f585e428700 1 -- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 msgr2=0x7f585815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.384 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.381+0000 7f585e428700 1 --2- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585815abd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58580d1090 tx=0x7f584c009250 comp rx=0 tx=0).stop 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 -- 172.21.15.192:0/3048183726 shutdown_connections 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 --2- 172.21.15.192:0/3048183726 >> v2:172.21.15.22:3300/0 conn(0x7f585815db10 0x7f5858069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 --2- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585815abd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 --2- 172.21.15.192:0/3048183726 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5858159c60 0x7f585815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 -- 172.21.15.192:0/3048183726 >> 172.21.15.192:0/3048183726 conn(0x7f5858068e20 msgr2=0x7f58580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 -- 172.21.15.192:0/3048183726 shutdown_connections 2023-10-08T00:24:36.385 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.382+0000 7f585e428700 1 -- 172.21.15.192:0/3048183726 wait complete. 2023-10-08T00:24:36.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.383+0000 7f585e428700 1 Processor -- start 2023-10-08T00:24:36.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.383+0000 7f585e428700 1 -- start start 2023-10-08T00:24:36.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5858159c60 0x7f58580b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 0x7f585815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.388 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585814d5f0 con 0x7f5858159c60 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580b4090 con 0x7f5858159890 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580b4370 con 0x7f585815db10 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f5857fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 0x7f585815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f5857fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39234/0 (socket says 172.21.15.192:39234) 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 0x7f585815cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38690/0 (socket says 172.21.15.192:38690) 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f5857fff700 1 -- 172.21.15.192:0/788150668 learned_addr learned my addr 172.21.15.192:0/788150668 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f58577fe700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5858159c60 0x7f58580b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 -- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 msgr2=0x7f585814d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585814d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.389 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 -- 172.21.15.192:0/788150668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5858159c60 msgr2=0x7f58580b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5858159c60 0x7f58580b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 -- 172.21.15.192:0/788150668 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5848009420 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f5857fff700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585814d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585c9c5700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 0x7f585815cc90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f585000ecc0 tx=0x7f585000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000c8c0 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585000f040 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c0094f0 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.384+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000cc90 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.385+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58580b4930 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.385+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5850014690 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.385+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f585001d910 con 0x7f585815db10 2023-10-08T00:24:36.390 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.386+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585804c3c0 con 0x7f585815db10 2023-10-08T00:24:36.391 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.388+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f585003b6d0 con 0x7f585815db10 2023-10-08T00:24:36.405 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:36.403+0000 7fbf96845180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T00:24:36.407 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.407+0000 7f7de49af180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T00:24:36.501 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.501+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67effb79-e51b-4db9-99b7-e5409f84380a", "id": 4} v 0) v1 -- 0x7f58580cbfe0 con 0x7f585815db10 2023-10-08T00:24:36.505 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.505+0000 7f583ffff700 1 -- 172.21.15.192:0/788150668 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67effb79-e51b-4db9-99b7-e5409f84380a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f585002a070 con 0x7f585815db10 2023-10-08T00:24:36.505 INFO:teuthology.orchestra.run.smithi192.stdout:4 2023-10-08T00:24:36.506 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 msgr2=0x7f585815cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.506 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 0x7f585815cc90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f585000ecc0 tx=0x7f585000b040 comp rx=0 tx=0).stop 2023-10-08T00:24:36.506 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 shutdown_connections 2023-10-08T00:24:36.506 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f585815db10 0x7f585815cc90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.506 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5858159890 0x7f585814d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.507 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 --2- 172.21.15.192:0/788150668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5858159c60 0x7f58580b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.507 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 >> 172.21.15.192:0/788150668 conn(0x7f5858068e20 msgr2=0x7f585815b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.507 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 shutdown_connections 2023-10-08T00:24:36.507 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.506+0000 7f585e428700 1 -- 172.21.15.192:0/788150668 wait complete. 2023-10-08T00:24:36.517 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new ea433699-7527-4139-9f5f-0edbe29e9228 5 2023-10-08T00:24:36.543 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:36.542+0000 7fbf96845180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T00:24:36.604 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.604+0000 7f7de49af180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T00:24:36.622 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:36.621+0000 7fbf96845180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T00:24:36.633 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.633+0000 7f0282642700 1 Processor -- start 2023-10-08T00:24:36.633 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.633+0000 7f0282642700 1 -- start start 2023-10-08T00:24:36.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0282642700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b1b40 0x7f027c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0282642700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0cfb00 con 0x7f027c0b4e70 2023-10-08T00:24:36.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0282642700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c0b5c40 con 0x7f027c0b16d0 2023-10-08T00:24:36.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0282642700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0b5f20 con 0x7f027c0b1b40 2023-10-08T00:24:36.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0281e41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b1b40 0x7f027c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0280e3f700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f027c0b16d0 0x7f027c0b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:34836/0 (socket says 172.21.15.192:34836) 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0280e3f700 1 -- 172.21.15.192:0/3632426023 learned_addr learned my addr 172.21.15.192:0/3632426023 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0273fff700 1 -- 172.21.15.192:0/3632426023 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401603577 0 0) 0x7f027c0b5c40 con 0x7f027c0b16d0 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0281e41700 1 -- 172.21.15.192:0/3632426023 >> v1:172.21.15.192:6789/0 conn(0x7f027c0b16d0 legacy=0x7f027c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0281e41700 1 -- 172.21.15.192:0/3632426023 >> v1:172.21.15.22:6789/0 conn(0x7f027c0b4e70 legacy=0x7f027c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.634+0000 7f0281e41700 1 -- 172.21.15.192:0/3632426023 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0b6200 con 0x7f027c0b1b40 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0281e41700 1 --2- 172.21.15.192:0/3632426023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b1b40 0x7f027c0b3ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0274009e90 tx=0x7f0274009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef611715e108de8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0273fff700 1 -- 172.21.15.192:0/3632426023 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400e070 con 0x7f027c0b1b40 2023-10-08T00:24:36.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0273fff700 1 -- 172.21.15.192:0/3632426023 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400bc30 con 0x7f027c0b1b40 2023-10-08T00:24:36.637 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0273fff700 1 -- 172.21.15.192:0/3632426023 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274012430 con 0x7f027c0b1b40 2023-10-08T00:24:36.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0282642700 1 -- 172.21.15.192:0/3632426023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b1b40 msgr2=0x7f027c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0282642700 1 --2- 172.21.15.192:0/3632426023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b1b40 0x7f027c0b3ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0274009e90 tx=0x7f0274009780 comp rx=0 tx=0).stop 2023-10-08T00:24:36.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0282642700 1 -- 172.21.15.192:0/3632426023 shutdown_connections 2023-10-08T00:24:36.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0282642700 1 --2- 172.21.15.192:0/3632426023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b1b40 0x7f027c0b3ac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.635+0000 7f0282642700 1 -- 172.21.15.192:0/3632426023 >> 172.21.15.192:0/3632426023 conn(0x7f027c0d10c0 msgr2=0x7f027c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.636+0000 7f0282642700 1 -- 172.21.15.192:0/3632426023 shutdown_connections 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.636+0000 7f0282642700 1 -- 172.21.15.192:0/3632426023 wait complete. 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 Processor -- start 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 -- start start 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f027c0b16d0 0x7f027c16a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c0b1b40 0x7f027c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 0x7f027c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0cc060 con 0x7f027c0b1b40 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0cc340 con 0x7f027c0b16d0 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0282642700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c169e20 con 0x7f027c0b4e70 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.637+0000 7f0281e41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 0x7f027c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 0x7f027c0cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38706/0 (socket says 172.21.15.192:38706) 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 -- 172.21.15.192:0/2559203964 learned_addr learned my addr 172.21.15.192:0/2559203964 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281640700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f027c0b16d0 0x7f027c16a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0280e3f700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c0b1b40 0x7f027c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 -- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f027c0b16d0 msgr2=0x7f027c16a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f027c0b16d0 0x7f027c16a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 -- 172.21.15.192:0/2559203964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c0b1b40 msgr2=0x7f027c0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c0b1b40 0x7f027c0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 -- 172.21.15.192:0/2559203964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274009a20 con 0x7f027c0b4e70 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0281e41700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 0x7f027c0cb580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f02740099f0 tx=0x7f0274019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274012d20 con 0x7f027c0b4e70 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0274021070 con 0x7f027c0b4e70 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c16a100 con 0x7f027c0b4e70 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274012ea0 con 0x7f027c0b4e70 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c0c6d30 con 0x7f027c0b4e70 2023-10-08T00:24:36.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0274023030 con 0x7f027c0b4e70 2023-10-08T00:24:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.638+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f027401c990 con 0x7f027c0b4e70 2023-10-08T00:24:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.639+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c0c6f20 con 0x7f027c0b4e70 2023-10-08T00:24:36.644 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.643+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f027c0c6f20 con 0x7f027c0b4e70 2023-10-08T00:24:36.686 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.686+0000 7f7de49af180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T00:24:36.725 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.725+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ea433699-7527-4139-9f5f-0edbe29e9228", "id": 5} v 0) v1 -- 0x7f027c04bb80 con 0x7f027c0b4e70 2023-10-08T00:24:36.728 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.729+0000 7f02717fa700 1 -- 172.21.15.192:0/2559203964 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea433699-7527-4139-9f5f-0edbe29e9228", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0274026950 con 0x7f027c0b4e70 2023-10-08T00:24:36.729 INFO:teuthology.orchestra.run.smithi192.stdout:5 2023-10-08T00:24:36.731 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 msgr2=0x7f027c0cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 0x7f027c0cb580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f02740099f0 tx=0x7f0274019000 comp rx=0 tx=0).stop 2023-10-08T00:24:36.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 shutdown_connections 2023-10-08T00:24:36.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f027c0b4e70 0x7f027c0cb580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f027c0b16d0 0x7f027c16a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 --2- 172.21.15.192:0/2559203964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f027c0b1b40 0x7f027c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.733 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 >> 172.21.15.192:0/2559203964 conn(0x7f027c0d10c0 msgr2=0x7f027c15c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.733 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 shutdown_connections 2023-10-08T00:24:36.733 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.730+0000 7f0282642700 1 -- 172.21.15.192:0/2559203964 wait complete. 2023-10-08T00:24:36.742 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 1ffac83b-36fc-44b1-986b-20f6d54e596a 6 2023-10-08T00:24:36.816 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:36.814+0000 7fbf96845180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T00:24:36.831 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.831+0000 7f7de49af180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T00:24:36.859 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.859+0000 7fde3af42700 1 Processor -- start 2023-10-08T00:24:36.860 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.860+0000 7fde3af42700 1 -- start start 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.860+0000 7fde3af42700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 0x7fde340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.860+0000 7fde3af42700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3415d7e0 con 0x7fde3415df50 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.860+0000 7fde3af42700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3415dac0 con 0x7fde3406c0a0 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.860+0000 7fde3af42700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3415aa30 con 0x7fde3406bcd0 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 0x7fde340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 0x7fde340caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38708/0 (socket says 172.21.15.192:38708) 2023-10-08T00:24:36.863 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde33fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fde3406c0a0 0x7fde3415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:34850/0 (socket says 172.21.15.192:34850) 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 -- 172.21.15.192:0/824268396 learned_addr learned my addr 172.21.15.192:0/824268396 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 -- 172.21.15.192:0/824268396 >> v1:172.21.15.192:6789/0 conn(0x7fde3406c0a0 legacy=0x7fde3415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 -- 172.21.15.192:0/824268396 >> v1:172.21.15.22:6789/0 conn(0x7fde3415df50 legacy=0x7fde340c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 -- 172.21.15.192:0/824268396 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3415ad10 con 0x7fde3406bcd0 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde337fe700 1 -- 172.21.15.192:0/824268396 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573852916 0 0) 0x7fde3415dac0 con 0x7fde3406c0a0 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde38cde700 1 --2- 172.21.15.192:0/824268396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 0x7fde340caa90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde280099e0 tx=0x7fde28009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ddccf9ec013d840 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde337fe700 1 -- 172.21.15.192:0/824268396 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800b860 con 0x7fde3406bcd0 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde337fe700 1 -- 172.21.15.192:0/824268396 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800b9c0 con 0x7fde3406bcd0 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.861+0000 7fde337fe700 1 -- 172.21.15.192:0/824268396 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800bd80 con 0x7fde3406bcd0 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 -- 172.21.15.192:0/824268396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 msgr2=0x7fde340caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 --2- 172.21.15.192:0/824268396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 0x7fde340caa90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fde280099e0 tx=0x7fde28009250 comp rx=0 tx=0).stop 2023-10-08T00:24:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 -- 172.21.15.192:0/824268396 shutdown_connections 2023-10-08T00:24:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 --2- 172.21.15.192:0/824268396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406bcd0 0x7fde340caa90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 -- 172.21.15.192:0/824268396 >> 172.21.15.192:0/824268396 conn(0x7fde340ce600 msgr2=0x7fde340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 -- 172.21.15.192:0/824268396 shutdown_connections 2023-10-08T00:24:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.862+0000 7fde3af42700 1 -- 172.21.15.192:0/824268396 wait complete. 2023-10-08T00:24:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.863+0000 7fde3af42700 1 Processor -- start 2023-10-08T00:24:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.863+0000 7fde3af42700 1 -- start start 2023-10-08T00:24:36.867 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde3af42700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 0x7fde34154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.867 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde3af42700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 0x7fde340c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde3af42700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde3415df50 0x7fde34158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde3af42700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340b3ba0 con 0x7fde3415df50 2023-10-08T00:24:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde3af42700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340b13a0 con 0x7fde3406bcd0 2023-10-08T00:24:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde3af42700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340b1680 con 0x7fde3406c0a0 2023-10-08T00:24:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 0x7fde34154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde33fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 0x7fde340c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 0x7fde34154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39240/0 (socket says 172.21.15.192:39240) 2023-10-08T00:24:36.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde33fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 0x7fde340c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38714/0 (socket says 172.21.15.192:38714) 2023-10-08T00:24:36.869 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 -- 172.21.15.192:0/3057055920 learned_addr learned my addr 172.21.15.192:0/3057055920 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:36.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde394df700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde3415df50 0x7fde34158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:36.870 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 -- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 msgr2=0x7fde340c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 0x7fde340c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 -- 172.21.15.192:0/3057055920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde3415df50 msgr2=0x7fde34158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde3415df50 0x7fde34158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 -- 172.21.15.192:0/3057055920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280094f0 con 0x7fde3406bcd0 2023-10-08T00:24:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde33fff700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 0x7fde340c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde38cde700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 0x7fde34154940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde34069220 tx=0x7fde28017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:36.873 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.864+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2801f070 con 0x7fde3406bcd0 2023-10-08T00:24:36.873 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800bb30 con 0x7fde3406bcd0 2023-10-08T00:24:36.873 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde340b3d80 con 0x7fde3406bcd0 2023-10-08T00:24:36.873 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28002f70 con 0x7fde3406bcd0 2023-10-08T00:24:36.873 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde34154e80 con 0x7fde3406bcd0 2023-10-08T00:24:36.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fde28023070 con 0x7fde3406bcd0 2023-10-08T00:24:36.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fde2801aa20 con 0x7fde3406bcd0 2023-10-08T00:24:36.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.865+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde34158a40 con 0x7fde3406bcd0 2023-10-08T00:24:36.874 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.867+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fde2802a070 con 0x7fde3406bcd0 2023-10-08T00:24:36.931 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:36.931+0000 7f7de49af180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T00:24:36.950 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.950+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ffac83b-36fc-44b1-986b-20f6d54e596a", "id": 6} v 0) v1 -- 0x7fde3404c3c0 con 0x7fde3406bcd0 2023-10-08T00:24:36.956 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.956+0000 7fde30ff9700 1 -- 172.21.15.192:0/3057055920 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ffac83b-36fc-44b1-986b-20f6d54e596a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde28015020 con 0x7fde3406bcd0 2023-10-08T00:24:36.956 INFO:teuthology.orchestra.run.smithi192.stdout:6 2023-10-08T00:24:36.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 msgr2=0x7fde34154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:36.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 0x7fde34154940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fde34069220 tx=0x7fde28017000 comp rx=0 tx=0).stop 2023-10-08T00:24:36.957 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 shutdown_connections 2023-10-08T00:24:36.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde3415df50 0x7fde34158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde3406bcd0 0x7fde34154940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 --2- 172.21.15.192:0/3057055920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde3406c0a0 0x7fde340c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:36.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 >> 172.21.15.192:0/3057055920 conn(0x7fde340ce600 msgr2=0x7fde3406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:36.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 shutdown_connections 2023-10-08T00:24:36.958 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:36.957+0000 7fde3af42700 1 -- 172.21.15.192:0/3057055920 wait complete. 2023-10-08T00:24:36.969 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 5897ff5b-cb55-4715-98a4-be89a8a85a9b 7 2023-10-08T00:24:36.997 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:36.996+0000 7fbf96845180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T00:24:37.079 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:37.077+0000 7fbf96845180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T00:24:37.093 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.084+0000 7f4418624700 1 Processor -- start 2023-10-08T00:24:37.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.084+0000 7f4418624700 1 -- start start 2023-10-08T00:24:37.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f4418624700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f44100ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f4418624700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4410156110 0x7f4410156550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f4418624700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441015a490 con 0x7f441006af10 2023-10-08T00:24:37.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f4418624700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441015a2a0 con 0x7f4410156110 2023-10-08T00:24:37.094 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f4418624700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441015a730 con 0x7f441006ab40 2023-10-08T00:24:37.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f44163c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f44100ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f44163c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f44100ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38718/0 (socket says 172.21.15.192:38718) 2023-10-08T00:24:37.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f44163c0700 1 -- 172.21.15.192:0/398896868 learned_addr learned my addr 172.21.15.192:0/398896868 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:37.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.085+0000 7f4416bc1700 1 --2- 172.21.15.192:0/398896868 >> v2:172.21.15.22:3300/0 conn(0x7f4410156110 0x7f4410156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44163c0700 1 -- 172.21.15.192:0/398896868 >> v2:172.21.15.22:3300/0 conn(0x7f4410156110 msgr2=0x7f4410156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:37.095 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44163c0700 1 --2- 172.21.15.192:0/398896868 >> v2:172.21.15.22:3300/0 conn(0x7f4410156110 0x7f4410156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44163c0700 1 -- 172.21.15.192:0/398896868 >> v1:172.21.15.22:6789/0 conn(0x7f441006af10 legacy=0x7f44100c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44163c0700 1 -- 172.21.15.192:0/398896868 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441015aa10 con 0x7f441006ab40 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44163c0700 1 --2- 172.21.15.192:0/398896868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f44100ae010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f440c0099b0 tx=0x7f440c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f052dbc15e6b5315 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44153be700 1 -- 172.21.15.192:0/398896868 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c009ea0 con 0x7f441006ab40 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44153be700 1 -- 172.21.15.192:0/398896868 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00b860 con 0x7f441006ab40 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f44153be700 1 -- 172.21.15.192:0/398896868 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00bc00 con 0x7f441006ab40 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f4418624700 1 -- 172.21.15.192:0/398896868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 msgr2=0x7f44100ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.096 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f4418624700 1 --2- 172.21.15.192:0/398896868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f44100ae010 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f440c0099b0 tx=0x7f440c009250 comp rx=0 tx=0).stop 2023-10-08T00:24:37.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f4418624700 1 -- 172.21.15.192:0/398896868 shutdown_connections 2023-10-08T00:24:37.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f4418624700 1 --2- 172.21.15.192:0/398896868 >> v2:172.21.15.22:3300/0 conn(0x7f4410156110 0x7f4410156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f4418624700 1 --2- 172.21.15.192:0/398896868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f44100ae010 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.086+0000 7f4418624700 1 -- 172.21.15.192:0/398896868 >> 172.21.15.192:0/398896868 conn(0x7f44100cd640 msgr2=0x7f44100cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:37.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.087+0000 7f4418624700 1 -- 172.21.15.192:0/398896868 shutdown_connections 2023-10-08T00:24:37.097 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.087+0000 7f4418624700 1 -- 172.21.15.192:0/398896868 wait complete. 2023-10-08T00:24:37.098 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 Processor -- start 2023-10-08T00:24:37.098 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 -- start start 2023-10-08T00:24:37.098 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f441016b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.098 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f441006af10 0x7f441016af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.098 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4410156110 0x7f4410152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.098 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4410155b80 con 0x7f4410156110 2023-10-08T00:24:37.099 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441015f7f0 con 0x7f441006af10 2023-10-08T00:24:37.099 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4418624700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441015fad0 con 0x7f441006ab40 2023-10-08T00:24:37.099 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f44163c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f441016b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f44163c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f441016b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:38734/0 (socket says 172.21.15.192:38734) 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f44163c0700 1 -- 172.21.15.192:0/1249452352 learned_addr learned my addr 172.21.15.192:0/1249452352 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4415bbf700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f441006af10 0x7f441016af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.088+0000 7f4416bc1700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4410156110 0x7f4410152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44163c0700 1 -- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f441006af10 msgr2=0x7f441016af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44163c0700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f441006af10 0x7f441016af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44163c0700 1 -- 172.21.15.192:0/1249452352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4410156110 msgr2=0x7f4410152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44163c0700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4410156110 0x7f4410152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44163c0700 1 -- 172.21.15.192:0/1249452352 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0094f0 con 0x7f441006ab40 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f4415bbf700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f441006af10 0x7f441016af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:37.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44163c0700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f441016b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f441015a870 tx=0x7f440c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c000d10 con 0x7f441006ab40 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00bbe0 con 0x7f441006ab40 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441015fdb0 con 0x7f441006ab40 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c011690 con 0x7f441006ab40 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441016bca0 con 0x7f441006ab40 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f440c011c80 con 0x7f441006ab40 2023-10-08T00:24:37.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.089+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f440c0253f0 con 0x7f441006ab40 2023-10-08T00:24:37.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.090+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441006b400 con 0x7f441006ab40 2023-10-08T00:24:37.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.092+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f440c033060 con 0x7f441006ab40 2023-10-08T00:24:37.173 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.173+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5897ff5b-cb55-4715-98a4-be89a8a85a9b", "id": 7} v 0) v1 -- 0x7f44100b0020 con 0x7f441006ab40 2023-10-08T00:24:37.181 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.181+0000 7f44067fc700 1 -- 172.21.15.192:0/1249452352 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5897ff5b-cb55-4715-98a4-be89a8a85a9b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f440c015020 con 0x7f441006ab40 2023-10-08T00:24:37.182 INFO:teuthology.orchestra.run.smithi192.stdout:7 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 msgr2=0x7f441016b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f441016b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f441015a870 tx=0x7f440c017000 comp rx=0 tx=0).stop 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 shutdown_connections 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4410156110 0x7f4410152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f441006ab40 0x7f441016b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 --2- 172.21.15.192:0/1249452352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f441006af10 0x7f441016af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.182+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 >> 172.21.15.192:0/1249452352 conn(0x7f44100cd640 msgr2=0x7f44100cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.183+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 shutdown_connections 2023-10-08T00:24:37.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-10-08T00:24:37.183+0000 7f4418624700 1 -- 172.21.15.192:0/1249452352 wait complete. 2023-10-08T00:24:37.194 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T00:24:37.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T00:24:37.196 INFO:tasks.ceph.osd.0:Started 2023-10-08T00:24:37.196 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T00:24:37.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T00:24:37.198 INFO:tasks.ceph.osd.1:Started 2023-10-08T00:24:37.198 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T00:24:37.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T00:24:37.200 INFO:tasks.ceph.osd.2:Started 2023-10-08T00:24:37.200 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T00:24:37.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T00:24:37.202 INFO:tasks.ceph.osd.3:Started 2023-10-08T00:24:37.202 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T00:24:37.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T00:24:37.204 INFO:tasks.ceph.osd.4:Started 2023-10-08T00:24:37.205 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T00:24:37.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T00:24:37.206 INFO:tasks.ceph.osd.5:Started 2023-10-08T00:24:37.207 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T00:24:37.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T00:24:37.208 INFO:tasks.ceph.osd.6:Started 2023-10-08T00:24:37.209 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T00:24:37.209 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T00:24:37.211 INFO:tasks.ceph.osd.7:Started 2023-10-08T00:24:37.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:37.229 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:37.227+0000 7fbf96845180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T00:24:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 Processor -- start 2023-10-08T00:24:37.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 -- start start 2023-10-08T00:24:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81e0159b10 0x7f81e00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81e015d730 0x7f81e015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159ee0 0x7f81e015a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00c74b0 con 0x7f81e015d730 2023-10-08T00:24:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e015e0e0 con 0x7f81e0159b10 2023-10-08T00:24:37.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.343+0000 7f81e656b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00c8700 con 0x7f81e0159ee0 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81e015d730 0x7f81e015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f81e015d730 0x7f81e015dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45014/0 (socket says 172.21.15.22:45014) 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 -- 172.21.15.22:0/2837959578 learned_addr learned my addr 172.21.15.22:0/2837959578 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81dffff700 1 --2- 172.21.15.22:0/2837959578 >> v2:172.21.15.192:3300/0 conn(0x7f81e0159b10 0x7f81e00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81e4b08700 1 --2- 172.21.15.22:0/2837959578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159ee0 0x7f81e015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 -- 172.21.15.22:0/2837959578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159ee0 msgr2=0x7f81e015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 --2- 172.21.15.22:0/2837959578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159ee0 0x7f81e015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 -- 172.21.15.22:0/2837959578 >> v2:172.21.15.192:3300/0 conn(0x7f81e0159b10 msgr2=0x7f81e00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 --2- 172.21.15.22:0/2837959578 >> v2:172.21.15.192:3300/0 conn(0x7f81e0159b10 0x7f81e00cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 -- 172.21.15.22:0/2837959578 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00c9070 con 0x7f81e015d730 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81df7fe700 1 --2- 172.21.15.22:0/2837959578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e015d730 0x7f81e015dba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f81e0063e90 tx=0x7f81d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3106adc69ace25 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81deffd700 1 -- 172.21.15.22:0/2837959578 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400b6d0 con 0x7f81e015d730 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81deffd700 1 -- 172.21.15.22:0/2837959578 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400b830 con 0x7f81e015d730 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.344+0000 7f81deffd700 1 -- 172.21.15.22:0/2837959578 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400bbf0 con 0x7f81e015d730 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 -- 172.21.15.22:0/2837959578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e015d730 msgr2=0x7f81e015dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 --2- 172.21.15.22:0/2837959578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e015d730 0x7f81e015dba0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f81e0063e90 tx=0x7f81d4009250 comp rx=0 tx=0).stop 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 -- 172.21.15.22:0/2837959578 shutdown_connections 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 --2- 172.21.15.22:0/2837959578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159ee0 0x7f81e015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 --2- 172.21.15.22:0/2837959578 >> v2:172.21.15.192:3300/0 conn(0x7f81e0159b10 0x7f81e00cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 --2- 172.21.15.22:0/2837959578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e015d730 0x7f81e015dba0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 -- 172.21.15.22:0/2837959578 >> 172.21.15.22:0/2837959578 conn(0x7f81e00c9870 msgr2=0x7f81e00c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 -- 172.21.15.22:0/2837959578 shutdown_connections 2023-10-08T00:24:37.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.345+0000 7f81e656b700 1 -- 172.21.15.22:0/2837959578 wait complete. 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.346+0000 7f81e656b700 1 Processor -- start 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.346+0000 7f81e656b700 1 -- start start 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e656b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159b10 0x7f81e015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e656b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 0x7f81e013c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e656b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81e015d730 0x7f81e0068e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e656b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015d4a0 con 0x7f81e0159ee0 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e656b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015c120 con 0x7f81e015d730 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e656b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015c400 con 0x7f81e0159b10 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 0x7f81e013c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 0x7f81e013c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45020/0 (socket says 172.21.15.22:45020) 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81df7fe700 1 -- 172.21.15.22:0/1717900785 learned_addr learned my addr 172.21.15.22:0/1717900785 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81dffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159b10 0x7f81e015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81e4b08700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81e015d730 0x7f81e0068e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81df7fe700 1 -- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159b10 msgr2=0x7f81e015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.347+0000 7f81df7fe700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159b10 0x7f81e015a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81df7fe700 1 -- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81e015d730 msgr2=0x7f81e0068e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81df7fe700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81e015d730 0x7f81e0068e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81df7fe700 1 -- 172.21.15.22:0/1717900785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d40094f0 con 0x7f81e0159ee0 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81df7fe700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 0x7f81e013c6f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f81e006cc50 tx=0x7f81d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4000d10 con 0x7f81e0159ee0 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400bbb0 con 0x7f81e0159ee0 2023-10-08T00:24:37.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e015c6e0 con 0x7f81e0159ee0 2023-10-08T00:24:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4011670 con 0x7f81e0159ee0 2023-10-08T00:24:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e015cca0 con 0x7f81e0159ee0 2023-10-08T00:24:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f81d4011c60 con 0x7f81e0159ee0 2023-10-08T00:24:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.348+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f81d40253f0 con 0x7f81e0159ee0 2023-10-08T00:24:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.349+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e004c3c0 con 0x7f81e0159ee0 2023-10-08T00:24:37.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.351+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f81d4033060 con 0x7f81e0159ee0 2023-10-08T00:24:37.360 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:37.359+0000 7fbf96845180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T00:24:37.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.422+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81e00633e0 con 0x7f81e0159ee0 2023-10-08T00:24:37.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.423+0000 7f81c7fff700 1 -- 172.21.15.22:0/1717900785 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f81d4015020 con 0x7f81e0159ee0 2023-10-08T00:24:37.424 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:37.425 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:37.175161+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 msgr2=0x7f81e013c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 0x7f81e013c6f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f81e006cc50 tx=0x7f81d4017000 comp rx=0 tx=0).stop 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 shutdown_connections 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81e015d730 0x7f81e0068e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f81e0159b10 0x7f81e015a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 --2- 172.21.15.22:0/1717900785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81e0159ee0 0x7f81e013c6f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 >> 172.21.15.22:0/1717900785 conn(0x7f81e00c9870 msgr2=0x7f81e00ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 shutdown_connections 2023-10-08T00:24:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:37.424+0000 7f81e656b700 1 -- 172.21.15.22:0/1717900785 wait complete. 2023-10-08T00:24:37.437 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T00:24:37.438 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T00:24:37.494 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:37.494+0000 7f7de49af180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T00:24:37.571 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:37.571+0000 7f7de49af180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T00:24:37.649 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:37.649+0000 7f7de49af180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T00:24:37.801 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-08T00:24:37.801+0000 7fa9c543d540 -1 Falling back to public interface 2023-10-08T00:24:37.802 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-08T00:24:37.801+0000 7fe3e9713540 -1 Falling back to public interface 2023-10-08T00:24:37.802 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-08T00:24:37.802+0000 7fa9bf866700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2023-10-08T00:24:37.802 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-08T00:24:37.802+0000 7fe4f83f5540 -1 Falling back to public interface 2023-10-08T00:24:37.811 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-08T00:24:37.810+0000 7f6b32a49540 -1 Falling back to public interface 2023-10-08T00:24:37.814 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-08T00:24:37.814+0000 7f2b6cce3540 -1 Falling back to public interface 2023-10-08T00:24:37.815 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-08T00:24:37.814+0000 7f9e101e6540 -1 Falling back to public interface 2023-10-08T00:24:37.824 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-08T00:24:37.823+0000 7f8b6ae5d540 -1 Falling back to public interface 2023-10-08T00:24:37.833 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-08T00:24:37.832+0000 7f1ebad1e540 -1 Falling back to public interface 2023-10-08T00:24:37.901 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:37.900+0000 7fbf96845180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T00:24:37.982 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:37.980+0000 7fbf96845180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T00:24:38.062 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:38.061+0000 7fbf96845180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T00:24:38.224 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:38.224+0000 7f7de49af180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T00:24:38.243 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:38.354 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.352+0000 7fc08661b700 1 Processor -- start 2023-10-08T00:24:38.354 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.352+0000 7fc08661b700 1 -- start start 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc08661b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc0800ad420 0x7fc0800b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc08661b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc0800afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc08661b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800ae560 con 0x7fc0800af350 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc08661b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0800af100 con 0x7fc0800ad420 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc08661b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0800ad950 con 0x7fc0800af720 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc07f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc0800ad420 0x7fc0800b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc07ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc0800af350 0x7fc0800ae9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60640/0 (socket says 172.21.15.22:60640) 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc07ffff700 1 -- 172.21.15.22:0/4067556891 learned_addr learned my addr 172.21.15.22:0/4067556891 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:38.357 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.353+0000 7fc084bb8700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc0800afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:38.358 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07f7fe700 1 -- 172.21.15.22:0/4067556891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 msgr2=0x7fc0800afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:38.358 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07f7fe700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc0800afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.358 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07f7fe700 1 -- 172.21.15.22:0/4067556891 >> v1:172.21.15.22:6789/0 conn(0x7fc0800af350 legacy=0x7fc0800ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:38.358 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07effd700 1 -- 172.21.15.22:0/4067556891 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429886383 0 0) 0x7fc0800ae560 con 0x7fc0800af350 2023-10-08T00:24:38.358 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07f7fe700 1 -- 172.21.15.22:0/4067556891 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800adc30 con 0x7fc0800ad420 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc084bb8700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc0800afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07f7fe700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc0800b15f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0700098e0 tx=0x7fc0700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5601294874776746 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07effd700 1 -- 172.21.15.22:0/4067556891 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070009e80 con 0x7fc0800ad420 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07effd700 1 -- 172.21.15.22:0/4067556891 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000b860 con 0x7fc0800ad420 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc07effd700 1 -- 172.21.15.22:0/4067556891 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000bbe0 con 0x7fc0800ad420 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc08661b700 1 -- 172.21.15.22:0/4067556891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 msgr2=0x7fc0800b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.354+0000 7fc08661b700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc0800b15f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0700098e0 tx=0x7fc0700091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.355+0000 7fc08661b700 1 -- 172.21.15.22:0/4067556891 shutdown_connections 2023-10-08T00:24:38.359 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.355+0000 7fc08661b700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc0800afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.360 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.355+0000 7fc08661b700 1 --2- 172.21.15.22:0/4067556891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc0800b15f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.360 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.355+0000 7fc08661b700 1 -- 172.21.15.22:0/4067556891 >> 172.21.15.22:0/4067556891 conn(0x7fc080099ab0 msgr2=0x7fc08006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:38.360 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.355+0000 7fc08661b700 1 -- 172.21.15.22:0/4067556891 shutdown_connections 2023-10-08T00:24:38.360 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.355+0000 7fc08661b700 1 -- 172.21.15.22:0/4067556891 wait complete. 2023-10-08T00:24:38.360 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.356+0000 7fc08661b700 1 Processor -- start 2023-10-08T00:24:38.361 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:38.360+0000 7f7de49af180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T00:24:38.363 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.356+0000 7fc08661b700 1 -- start start 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.356+0000 7fc08661b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc080141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0800af350 0x7fc08015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc08015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08009b0f0 con 0x7fc0800ad420 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08009a520 con 0x7fc0800af350 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08009a7c0 con 0x7fc0800af720 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc080141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc080141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45044/0 (socket says 172.21.15.22:45044) 2023-10-08T00:24:38.364 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 -- 172.21.15.22:0/1511469809 learned_addr learned my addr 172.21.15.22:0/1511469809 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07f7fe700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0800af350 0x7fc08015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc084bb8700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc08015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 -- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 msgr2=0x7fc08015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc08015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 -- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0800af350 msgr2=0x7fc08015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0800af350 0x7fc08015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 -- 172.21.15.22:0/1511469809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070009420 con 0x7fc0800ad420 2023-10-08T00:24:38.365 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc07ffff700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc080141fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c7e0 tx=0x7fc074007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005b30 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074005c90 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08009aaa0 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074007300 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08009da10 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.357+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc07401c440 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.358+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fc074005e00 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.358+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc080088e90 con 0x7fc0800ad420 2023-10-08T00:24:38.366 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.360+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc074017070 con 0x7fc0800ad420 2023-10-08T00:24:38.433 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.432+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0800adf10 con 0x7fc0800ad420 2023-10-08T00:24:38.434 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.432+0000 7fc067fff700 1 -- 172.21.15.22:0/1511469809 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fc07401c920 con 0x7fc0800ad420 2023-10-08T00:24:38.434 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-08T00:24:38.434 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:37.175161+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:38.435 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 msgr2=0x7fc080141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:38.435 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc080141fd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc07400c7e0 tx=0x7fc074007df0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 shutdown_connections 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0800af720 0x7fc08015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0800ad420 0x7fc080141fd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 --2- 172.21.15.22:0/1511469809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0800af350 0x7fc08015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 >> 172.21.15.22:0/1511469809 conn(0x7fc080099ab0 msgr2=0x7fc08015eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 shutdown_connections 2023-10-08T00:24:38.436 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:38.433+0000 7fc08661b700 1 -- 172.21.15.22:0/1511469809 wait complete. 2023-10-08T00:24:38.445 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T00:24:38.452 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:38.452+0000 7f7de49af180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T00:24:38.688 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:38.687+0000 7fbf96845180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T00:24:38.701 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:38.701+0000 7f7de49af180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T00:24:38.778 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:38.778+0000 7f7de49af180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T00:24:38.833 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:38.831+0000 7fbf96845180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T00:24:38.928 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:38.926+0000 7fbf96845180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T00:24:39.185 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:39.184+0000 7fbf96845180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T00:24:39.267 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:39.265+0000 7fbf96845180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T00:24:39.599 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:39.600+0000 7f7de49af180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T00:24:39.672 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:39.672+0000 7f7de49af180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T00:24:39.747 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:39.747+0000 7f7de49af180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T00:24:39.879 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:39.879+0000 7f7de49af180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T00:24:39.962 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:39.962+0000 7f7de49af180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T00:24:40.117 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:40.117+0000 7f7de49af180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T00:24:40.125 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.124+0000 7fbf96845180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T00:24:40.192 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:40.192+0000 7f7de49af180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T00:24:40.202 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.201+0000 7fbf96845180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T00:24:40.272 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:40.272+0000 7f7de49af180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T00:24:40.281 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.280+0000 7fbf96845180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T00:24:40.360 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:40.360+0000 7f7de49af180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T00:24:40.434 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.433+0000 7fbf96845180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T00:24:40.522 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.521+0000 7fbf96845180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T00:24:40.731 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.729+0000 7fbf96845180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T00:24:40.810 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.809+0000 7fbf96845180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T00:24:40.889 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.887+0000 7fbf96845180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T00:24:40.967 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-08T00:24:40.966+0000 7fbf96845180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T00:24:41.079 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-08T00:24:41.079+0000 7fe4f83f5540 -1 osd.4 0 log_to_monitors true 2023-10-08T00:24:41.310 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-08T00:24:41.310+0000 7fe3e9713540 -1 osd.6 0 log_to_monitors true 2023-10-08T00:24:41.314 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-08T00:24:41.313+0000 7f6b32a49540 -1 osd.0 0 log_to_monitors true 2023-10-08T00:24:41.324 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-08T00:24:41.324+0000 7f2b6cce3540 -1 osd.5 0 log_to_monitors true 2023-10-08T00:24:41.337 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-08T00:24:41.337+0000 7fa9c543d540 -1 osd.7 0 log_to_monitors true 2023-10-08T00:24:41.337 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-08T00:24:41.336+0000 7f8b6ae5d540 -1 osd.3 0 log_to_monitors true 2023-10-08T00:24:41.343 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-08T00:24:41.342+0000 7f9e101e6540 -1 osd.1 0 log_to_monitors true 2023-10-08T00:24:41.362 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-08T00:24:41.361+0000 7f1ebad1e540 -1 osd.2 0 log_to_monitors true 2023-10-08T00:24:41.383 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:41.383+0000 7f7d9ddb0700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T00:24:41.385 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:24:41.386+0000 7f7d9ddb0700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T00:24:43.894 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-08T00:24:43.893+0000 7f6b2966b700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T00:24:43.898 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-08T00:24:43.897+0000 7f6b22462700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:43.900 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-08T00:24:43.899+0000 7f9e06e08700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T00:24:43.904 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-08T00:24:43.903+0000 7f8b63282700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T00:24:43.905 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-08T00:24:43.904+0000 7f9dffbff700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:43.922 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-08T00:24:43.921+0000 7f8b5a876700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:43.939 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-08T00:24:43.938+0000 7f1eb3143700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T00:24:43.943 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-08T00:24:43.942+0000 7f1eaa737700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:44.584 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-08T00:24:44.584+0000 7fe3e1b38700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T00:24:44.584 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-08T00:24:44.584+0000 7fa9bc05f700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T00:24:44.587 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-10-08T00:24:44.588+0000 7fa9b4e56700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:44.588 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-10-08T00:24:44.589+0000 7fe3d912c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:44.591 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-08T00:24:44.591+0000 7f2b63905700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T00:24:44.598 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-10-08T00:24:44.598+0000 7f2b5c6fc700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:44.618 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-08T00:24:44.618+0000 7fe4ef017700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T00:24:44.622 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-10-08T00:24:44.622+0000 7fe4e7e0e700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T00:24:45.250 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:45.375 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.373+0000 7fd4ca12f700 1 Processor -- start 2023-10-08T00:24:45.375 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.373+0000 7fd4ca12f700 1 -- start start 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4ca12f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4c4155af0 0x7fd4c40c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4ca12f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406a1c0 0x7fd4c406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4ca12f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c40c7e30 con 0x7fd4c4155ec0 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4ca12f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c40c89d0 con 0x7fd4c4155af0 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4ca12f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c406b400 con 0x7fd4c406a1c0 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4c37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4c4155af0 0x7fd4c40c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4c37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4c4155af0 0x7fd4c40c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45072/0 (socket says 172.21.15.22:45072) 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4c37fe700 1 -- 172.21.15.22:0/147387078 learned_addr learned my addr 172.21.15.22:0/147387078 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.374+0000 7fd4c3fff700 1 --2- 172.21.15.22:0/147387078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406a1c0 0x7fd4c406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.378 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c37fe700 1 -- 172.21.15.22:0/147387078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406a1c0 msgr2=0x7fd4c406e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/147387078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406a1c0 0x7fd4c406e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c37fe700 1 -- 172.21.15.22:0/147387078 >> v1:172.21.15.192:6789/0 conn(0x7fd4c4155ec0 legacy=0x7fd4c40c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c37fe700 1 -- 172.21.15.22:0/147387078 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40c7220 con 0x7fd4c4155af0 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/147387078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c69d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009f70 tx=0x7fd4b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5a690249e1b46 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c27fc700 1 -- 172.21.15.22:0/147387078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400e070 con 0x7fd4c4155af0 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c27fc700 1 -- 172.21.15.22:0/147387078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400ba20 con 0x7fd4c4155af0 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.375+0000 7fd4c27fc700 1 -- 172.21.15.22:0/147387078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40092e0 con 0x7fd4c4155af0 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 -- 172.21.15.22:0/147387078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 msgr2=0x7fd4c40c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/147387078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c69d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009f70 tx=0x7fd4b4009840 comp rx=0 tx=0).stop 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 -- 172.21.15.22:0/147387078 shutdown_connections 2023-10-08T00:24:45.379 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/147387078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c406a1c0 0x7fd4c406e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.380 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/147387078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c69d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.380 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 -- 172.21.15.22:0/147387078 >> 172.21.15.22:0/147387078 conn(0x7fd4c406d350 msgr2=0x7fd4c40cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:45.380 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 -- 172.21.15.22:0/147387078 shutdown_connections 2023-10-08T00:24:45.380 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.376+0000 7fd4ca12f700 1 -- 172.21.15.22:0/147387078 wait complete. 2023-10-08T00:24:45.382 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.377+0000 7fd4ca12f700 1 Processor -- start 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.377+0000 7fd4ca12f700 1 -- start start 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ca12f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406a1c0 0x7fd4c4167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ca12f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ca12f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c4155ec0 0x7fd4c41594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ca12f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4159050 con 0x7fd4c4155af0 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ca12f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4158480 con 0x7fd4c406a1c0 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ca12f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4158720 con 0x7fd4c4155ec0 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45084/0 (socket says 172.21.15.22:45084) 2023-10-08T00:24:45.383 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1970467816 learned_addr learned my addr 172.21.15.22:0/1970467816 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406a1c0 0x7fd4c4167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c3fff700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c4155ec0 0x7fd4c41594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c4155ec0 msgr2=0x7fd4c41594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c4155ec0 0x7fd4c41594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406a1c0 msgr2=0x7fd4c4167bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406a1c0 0x7fd4c4167bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1970467816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009ae0 con 0x7fd4c4155af0 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4c2ffd700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c1c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c590 tx=0x7fd4b8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011590 con 0x7fd4c4155af0 2023-10-08T00:24:45.384 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.378+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8011710 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.379+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c4158a00 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.379+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011ad0 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.379+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c4154030 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.379+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c4068be0 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.380+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd4b801a360 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.380+0000 7fd4ab7fe700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0066ea0 0x7fd4b0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.380+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fd4b8082e30 con 0x7fd4c4155af0 2023-10-08T00:24:45.385 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.380+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0066ea0 0x7fd4b0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.386 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.381+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0066ea0 0x7fd4b0069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4154e80 tx=0x7fd4b4018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:45.386 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.385+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b8050650 con 0x7fd4c4155af0 2023-10-08T00:24:45.582 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.580+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c40c7500 con 0x7fd4c4155af0 2023-10-08T00:24:45.582 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.581+0000 7fd4ab7fe700 1 -- 172.21.15.22:0/1970467816 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10396 (secure 0 0 0) 0x7fd4b8017090 con 0x7fd4c4155af0 2023-10-08T00:24:45.583 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-08T00:24:45.583 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":13,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:44.705998+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:45.585 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0066ea0 msgr2=0x7fd4b0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.585 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0066ea0 0x7fd4b0069350 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4154e80 tx=0x7fd4b4018000 comp rx=0 tx=0).stop 2023-10-08T00:24:45.585 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 msgr2=0x7fd4c40c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.585 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c1c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c590 tx=0x7fd4b8007f50 comp rx=0 tx=0).stop 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 shutdown_connections 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0066ea0 0x7fd4b0069350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c4155ec0 0x7fd4c41594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c406a1c0 0x7fd4c4167bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.583+0000 7fd4ca12f700 1 --2- 172.21.15.22:0/1970467816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4155af0 0x7fd4c40c1c90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.584+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 >> 172.21.15.22:0/1970467816 conn(0x7fd4c406d350 msgr2=0x7fd4c40af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.584+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 shutdown_connections 2023-10-08T00:24:45.586 INFO:teuthology.misc.health.smithi022.stderr:2023-10-08T00:24:45.584+0000 7fd4ca12f700 1 -- 172.21.15.22:0/1970467816 wait complete. 2023-10-08T00:24:45.596 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T00:24:45.596 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T00:24:45.596 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:24:45.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:24:45.599 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:24:45.599 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:24:45.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:24:45.601 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:24:45.601 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:24:45.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:24:45.603 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:24:45.603 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:24:45.603 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:24:45.606 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:24:45.606 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T00:24:45.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:45.675 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:24:45.676 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:24:45.678 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:24:45.679 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:24:45.679 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-08T00:24:45.678+0000 7f643e7a6700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-08T00:24:45.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.730+0000 7fa5deb59700 1 Processor -- start 2023-10-08T00:24:45.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.730+0000 7fa5deb59700 1 -- start start 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5deb59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 0x7fa5d80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5deb59700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa5d815d230 0x7fa5d815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5deb59700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d815dbd0 con 0x7fa5d81597f0 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5deb59700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d80b2980 con 0x7fa5d815d230 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5deb59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80b11d0 con 0x7fa5d8159420 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5dd356700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa5d81597f0 0x7fa5d80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60672/0 (socket says 172.21.15.22:60672) 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5dd356700 1 -- 172.21.15.22:0/4119676761 learned_addr learned my addr 172.21.15.22:0/4119676761 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5de358700 1 --2- 172.21.15.22:0/4119676761 >> v2:172.21.15.192:3300/0 conn(0x7fa5d815d230 0x7fa5d815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478511513 0 0) 0x7fa5c8001110 con 0x7fa5d81597f0 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5ddb57700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 0x7fa5d80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c4003570 con 0x7fa5d81597f0 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.731+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2649040500 0 0) 0x7fa5c4003570 con 0x7fa5d81597f0 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 msgr2=0x7fa5d80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 0x7fa5d80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 >> v2:172.21.15.192:3300/0 conn(0x7fa5d815d230 msgr2=0x7fa5d815d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 --2- 172.21.15.22:0/4119676761 >> v2:172.21.15.192:3300/0 conn(0x7fa5d815d230 0x7fa5d815d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80b14b0 con 0x7fa5d81597f0 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fa5c8001600 con 0x7fa5d81597f0 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 >> v1:172.21.15.22:6789/0 conn(0x7fa5d81597f0 legacy=0x7fa5d80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 0x7fa5c4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c4003fe0 0x7fa5c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5c4004d50 0x7fa5c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80b2980 con 0x7fa5c4004d50 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80b11d0 con 0x7fa5c4003fe0 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c400ba90 con 0x7fa5d8159420 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5c4004d50 0x7fa5c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5ddb57700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 0x7fa5c4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dd356700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c4003fe0 0x7fa5c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 -- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 msgr2=0x7fa5c4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5d8159420 0x7fa5c4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 -- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c4003fe0 msgr2=0x7fa5c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5c4003fe0 0x7fa5c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 -- 172.21.15.22:0/4119676761 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4003570 con 0x7fa5c4004d50 2023-10-08T00:24:45.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5de358700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5c4004d50 0x7fa5c40051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000e210 tx=0x7fa5d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a944b4db1671be0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000ea60 con 0x7fa5c4004d50 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d000f040 con 0x7fa5c4004d50 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.732+0000 7fa5dcb55700 1 -- 172.21.15.22:0/4119676761 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d000ee10 con 0x7fa5c4004d50 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5deb59700 1 -- 172.21.15.22:0/4119676761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5c4004d50 msgr2=0x7fa5c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5deb59700 1 --2- 172.21.15.22:0/4119676761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5c4004d50 0x7fa5c40051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa5d000e210 tx=0x7fa5d000b040 comp rx=0 tx=0).stop 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5de358700 1 -- 172.21.15.22:0/4119676761 reap_dead start 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5deb59700 1 -- 172.21.15.22:0/4119676761 shutdown_connections 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5deb59700 1 -- 172.21.15.22:0/4119676761 >> 172.21.15.22:0/4119676761 conn(0x7fa5d80d0660 msgr2=0x7fa5d80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5deb59700 1 -- 172.21.15.22:0/4119676761 shutdown_connections 2023-10-08T00:24:45.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.733+0000 7fa5deb59700 1 -- 172.21.15.22:0/4119676761 wait complete. 2023-10-08T00:24:45.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.734+0000 7fa5deb59700 1 Processor -- start 2023-10-08T00:24:45.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.734+0000 7fa5deb59700 1 -- start start 2023-10-08T00:24:45.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c4004d50 0x7fa5d80c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 0x7fa5d81696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d8169c00 0x7fa5d816a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d80c6a20 con 0x7fa5d80c74e0 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d815a080 con 0x7fa5d8169c00 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d816a590 con 0x7fa5c4004d50 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 0x7fa5d81696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 0x7fa5d81696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45140/0 (socket says 172.21.15.22:45140) 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5ddb57700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c4004d50 0x7fa5d80c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 -- 172.21.15.22:0/526371320 learned_addr learned my addr 172.21.15.22:0/526371320 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5de358700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d8169c00 0x7fa5d816a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 -- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c4004d50 msgr2=0x7fa5d80c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c4004d50 0x7fa5d80c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 -- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d8169c00 msgr2=0x7fa5d816a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d8169c00 0x7fa5d816a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 -- 172.21.15.22:0/526371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80c6180 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5dd356700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 0x7fa5d81696c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8000fd0 tx=0x7fa5c8007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800f760 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c800f8c0 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d80c6460 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.735+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800fc60 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.736+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d80c5e90 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.737+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d804c3c0 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.737+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fa5c8013600 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.737+0000 7fa5cdffb700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5bc066ea0 0x7fa5bc069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.737+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7fa5c8083f80 con 0x7fa5d80c74e0 2023-10-08T00:24:45.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.737+0000 7fa5ddb57700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5bc066ea0 0x7fa5bc069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:45.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.738+0000 7fa5ddb57700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5bc066ea0 0x7fa5bc069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5d816a880 tx=0x7fa5d40091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:45.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.742+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5c80517a0 con 0x7fa5d80c74e0 2023-10-08T00:24:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.936+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5d815dbd0 con 0x7fa5d80c74e0 2023-10-08T00:24:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.937+0000 7fa5cdffb700 1 -- 172.21.15.22:0/526371320 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10580 (secure 0 0 0) 0x7fa5d815dbd0 con 0x7fa5d80c74e0 2023-10-08T00:24:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:45.939 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:45.931827+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5bc066ea0 msgr2=0x7fa5bc069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5bc066ea0 0x7fa5bc069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5d816a880 tx=0x7fa5d40091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 msgr2=0x7fa5d81696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 0x7fa5d81696c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8000fd0 tx=0x7fa5c8007a80 comp rx=0 tx=0).stop 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 shutdown_connections 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5d8169c00 0x7fa5d816a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5bc066ea0 0x7fa5bc069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5c4004d50 0x7fa5d80c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 --2- 172.21.15.22:0/526371320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5d80c74e0 0x7fa5d81696c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 >> 172.21.15.22:0/526371320 conn(0x7fa5d80d0660 msgr2=0x7fa5d8156f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 shutdown_connections 2023-10-08T00:24:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:45.939+0000 7fa5deb59700 1 -- 172.21.15.22:0/526371320 wait complete. 2023-10-08T00:24:45.953 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-08T00:24:45.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:24:46.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 Processor -- start 2023-10-08T00:24:46.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 -- start start 2023-10-08T00:24:46.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4c84159c10 0x7f4c8415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c840b5ea0 0x7f4c84068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4c84068bb0 0x7f4c8415c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c840b2a40 con 0x7f4c84159c10 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8415c480 con 0x7f4c84068bb0 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.071+0000 7f4c8ae0d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8415b5d0 con 0x7f4c840b5ea0 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4c84159c10 0x7f4c8415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4c84159c10 0x7f4c8415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45154/0 (socket says 172.21.15.22:45154) 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 -- 172.21.15.22:0/3671990135 learned_addr learned my addr 172.21.15.22:0/3671990135 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c893aa700 1 --2- 172.21.15.22:0/3671990135 >> v2:172.21.15.192:3300/0 conn(0x7f4c84068bb0 0x7f4c8415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c83fff700 1 --2- 172.21.15.22:0/3671990135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c840b5ea0 0x7f4c84068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 -- 172.21.15.22:0/3671990135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c840b5ea0 msgr2=0x7f4c84068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:46.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 --2- 172.21.15.22:0/3671990135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c840b5ea0 0x7f4c84068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 -- 172.21.15.22:0/3671990135 >> v2:172.21.15.192:3300/0 conn(0x7f4c84068bb0 msgr2=0x7f4c8415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 --2- 172.21.15.22:0/3671990135 >> v2:172.21.15.192:3300/0 conn(0x7f4c84068bb0 0x7f4c8415c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 -- 172.21.15.22:0/3671990135 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8415b870 con 0x7f4c84159c10 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c88ba9700 1 --2- 172.21.15.22:0/3671990135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c84159c10 0x7f4c8415b090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c8408af20 tx=0x7f4c6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d5189cb33393de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c837fe700 1 -- 172.21.15.22:0/3671990135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c00b860 con 0x7f4c84159c10 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c837fe700 1 -- 172.21.15.22:0/3671990135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c00b9c0 con 0x7f4c84159c10 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.072+0000 7f4c837fe700 1 -- 172.21.15.22:0/3671990135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c00bd60 con 0x7f4c84159c10 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/3671990135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c84159c10 msgr2=0x7f4c8415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/3671990135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c84159c10 0x7f4c8415b090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c8408af20 tx=0x7f4c6c009250 comp rx=0 tx=0).stop 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/3671990135 shutdown_connections 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/3671990135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c84159c10 0x7f4c8415b090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/3671990135 >> v2:172.21.15.192:3300/0 conn(0x7f4c84068bb0 0x7f4c8415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/3671990135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c840b5ea0 0x7f4c84068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/3671990135 >> 172.21.15.22:0/3671990135 conn(0x7f4c84099a20 msgr2=0x7f4c840af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:46.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/3671990135 shutdown_connections 2023-10-08T00:24:46.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.073+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/3671990135 wait complete. 2023-10-08T00:24:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.074+0000 7f4c8ae0d700 1 Processor -- start 2023-10-08T00:24:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.074+0000 7f4c8ae0d700 1 -- start start 2023-10-08T00:24:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c8ae0d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c84068bb0 0x7f4c840b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c8ae0d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 0x7f4c840b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c8ae0d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c84159c10 0x7f4c840c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c8ae0d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8414aca0 con 0x7f4c840b5ea0 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c8ae0d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8414af80 con 0x7f4c84068bb0 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c8ae0d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8414b260 con 0x7f4c84159c10 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 0x7f4c840b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 0x7f4c840b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45164/0 (socket says 172.21.15.22:45164) 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 -- 172.21.15.22:0/4265750128 learned_addr learned my addr 172.21.15.22:0/4265750128 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c88ba9700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c84068bb0 0x7f4c840b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c893aa700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c84159c10 0x7f4c840c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 -- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c84159c10 msgr2=0x7f4c840c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c84159c10 0x7f4c840c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 -- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c84068bb0 msgr2=0x7f4c840b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:46.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c84068bb0 0x7f4c840b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 -- 172.21.15.22:0/4265750128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c0094f0 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c83fff700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 0x7f4c840b08b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400cfc0 tx=0x7f4c740078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.075+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74016430 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.076+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74016590 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.076+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74016930 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.076+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8414b540 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.076+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8414bd40 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.077+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8414bfc0 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.077+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f4c74003020 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.077+0000 7f4c80ff9700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4c64066ea0 0x7f4c64069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.077+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f4c74012070 con 0x7f4c840b5ea0 2023-10-08T00:24:46.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.077+0000 7f4c88ba9700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4c64066ea0 0x7f4c64069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:46.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.078+0000 7f4c88ba9700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4c64066ea0 0x7f4c64069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c8408af20 tx=0x7f4c6c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:46.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.082+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c740526f0 con 0x7f4c840b5ea0 2023-10-08T00:24:46.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.318+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c8404c3c0 con 0x7f4c840b5ea0 2023-10-08T00:24:46.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.319+0000 7f4c80ff9700 1 -- 172.21.15.22:0/4265750128 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f4c74055d10 con 0x7f4c840b5ea0 2023-10-08T00:24:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:46.324 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-08T00:24:46.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4c64066ea0 msgr2=0x7f4c64069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:46.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4c64066ea0 0x7f4c64069350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c8408af20 tx=0x7f4c6c017000 comp rx=0 tx=0).stop 2023-10-08T00:24:46.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 msgr2=0x7f4c840b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 0x7f4c840b08b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400cfc0 tx=0x7f4c740078b0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 shutdown_connections 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4c64066ea0 0x7f4c64069350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4c84159c10 0x7f4c840c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c84068bb0 0x7f4c840b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 --2- 172.21.15.22:0/4265750128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c840b5ea0 0x7f4c840b08b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 >> 172.21.15.22:0/4265750128 conn(0x7f4c84099a20 msgr2=0x7f4c840b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 shutdown_connections 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:46.321+0000 7f4c8ae0d700 1 -- 172.21.15.22:0/4265750128 wait complete. 2023-10-08T00:24:46.326 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 2 2023-10-08T00:24:48.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:24:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.462+0000 7f9eb6e9e700 1 Processor -- start 2023-10-08T00:24:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.462+0000 7f9eb6e9e700 1 -- start start 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb6e9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9eb01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb6e9e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00b2080 con 0x7f9eb013f620 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb6e9e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb006eb10 con 0x7f9eb00c8120 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb6e9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00b00e0 con 0x7f9eb00c85a0 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb5e9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9eb013f620 0x7f9eb00af9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39694/0 (socket says 172.21.15.22:39694) 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb5e9c700 1 -- 172.21.15.22:0/176700210 learned_addr learned my addr 172.21.15.22:0/176700210 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb669d700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9eb01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611608170 0 0) 0x7f9eb00b2080 con 0x7f9eb013f620 2023-10-08T00:24:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.463+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e9c004680 con 0x7f9eb013f620 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630612730 0 0) 0x7f9eb006eb10 con 0x7f9eb00c8120 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb00b2080 con 0x7f9eb00c8120 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1654051793 0 0) 0x7f9e9c004680 con 0x7f9eb013f620 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 msgr2=0x7f9eb01581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9eb01581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 >> v1:172.21.15.192:6789/0 conn(0x7f9eb00c8120 legacy=0x7f9eb0157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00b2320 con 0x7f9eb013f620 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f9ea00013f0 con 0x7f9eb013f620 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb669d700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9eb01581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 >> v1:172.21.15.22:6789/0 conn(0x7f9eb013f620 legacy=0x7f9eb00af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c004d30 0x7f9e9c005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9c005920 0x7f9e9c005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9e9c0062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00b00e0 con 0x7f9e9c005920 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c00ccc0 con 0x7f9e9c004d30 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c00ce80 con 0x7f9eb00c85a0 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb569b700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9c005920 0x7f9e9c005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb5e9c700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c004d30 0x7f9e9c005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb669d700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9e9c0062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb569b700 1 -- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 msgr2=0x7f9e9c0062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb569b700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9e9c0062f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb569b700 1 -- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c004d30 msgr2=0x7f9e9c005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb569b700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c004d30 0x7f9e9c005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb569b700 1 -- 172.21.15.22:0/176700210 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8009a20 con 0x7f9e9c005920 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb669d700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb00c85a0 0x7f9e9c0062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.464+0000 7f9eb5e9c700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c004d30 0x7f9e9c005120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb569b700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9c005920 0x7f9e9c005d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9eac001a10 tx=0x7f9eac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca8893626f5245 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00c5d0 con 0x7f9e9c005920 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac00c730 con 0x7f9e9c005920 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb4e9a700 1 -- 172.21.15.22:0/176700210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00cad0 con 0x7f9e9c005920 2023-10-08T00:24:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/176700210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9c005920 msgr2=0x7f9e9c005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/176700210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9c005920 0x7f9e9c005d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9eac001a10 tx=0x7f9eac007d30 comp rx=0 tx=0).stop 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb669d700 1 -- 172.21.15.22:0/176700210 reap_dead start 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/176700210 shutdown_connections 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/176700210 >> 172.21.15.22:0/176700210 conn(0x7f9eb006ddb0 msgr2=0x7f9eb006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/176700210 shutdown_connections 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.465+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/176700210 wait complete. 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 Processor -- start 2023-10-08T00:24:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 -- start start 2023-10-08T00:24:48.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c005920 0x7f9eb0165d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb006bfc0 0x7f9eb0155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 0x7f9eb00aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00af4b0 con 0x7f9eb00aead0 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb006b870 con 0x7f9e9c005920 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb6e9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0169500 con 0x7f9eb006bfc0 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb669d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 0x7f9eb00aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb669d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 0x7f9eb00aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37518/0 (socket says 172.21.15.22:37518) 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.467+0000 7f9eb669d700 1 -- 172.21.15.22:0/1589871478 learned_addr learned my addr 172.21.15.22:0/1589871478 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb5e9c700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c005920 0x7f9eb0165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb569b700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb006bfc0 0x7f9eb0155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb669d700 1 -- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb006bfc0 msgr2=0x7f9eb0155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb669d700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb006bfc0 0x7f9eb0155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb669d700 1 -- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c005920 msgr2=0x7f9eb0165d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb669d700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c005920 0x7f9eb0165d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb669d700 1 -- 172.21.15.22:0/1589871478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb01688f0 con 0x7f9eb00aead0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb669d700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 0x7f9eb00aef70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0159790 tx=0x7f9ea800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800e040 con 0x7f9eb00aead0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea800f040 con 0x7f9eb00aead0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb0168bd0 con 0x7f9eb00aead0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8015660 con 0x7f9eb00aead0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.468+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb0169190 con 0x7f9eb00aead0 2023-10-08T00:24:48.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.469+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb0169350 con 0x7f9eb00aead0 2023-10-08T00:24:48.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.470+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f9ea80159d0 con 0x7f9eb00aead0 2023-10-08T00:24:48.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.470+0000 7f9ea5ffb700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e94066ea0 0x7f9e94069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.470+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9ea8085690 con 0x7f9eb00aead0 2023-10-08T00:24:48.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.475+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ea8052db0 con 0x7f9eb00aead0 2023-10-08T00:24:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.481+0000 7f9eb5e9c700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e94066ea0 0x7f9e94069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.482+0000 7f9eb5e9c700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e94066ea0 0x7f9e94069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9eb006a570 tx=0x7f9ea0001d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.723+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eb01696b0 con 0x7f9eb00aead0 2023-10-08T00:24:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.723+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/1589871478 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f9eb01696b0 con 0x7f9eb00aead0 2023-10-08T00:24:48.725 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:48.725 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-08T00:24:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.725+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e94066ea0 msgr2=0x7f9e94069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.725+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e94066ea0 0x7f9e94069350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9eb006a570 tx=0x7f9ea0001d30 comp rx=0 tx=0).stop 2023-10-08T00:24:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.725+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 msgr2=0x7f9eb00aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.725+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 0x7f9eb00aef70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0159790 tx=0x7f9ea800b040 comp rx=0 tx=0).stop 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 shutdown_connections 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb00aead0 0x7f9eb00aef70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9c005920 0x7f9eb0165d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e94066ea0 0x7f9e94069350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 --2- 172.21.15.22:0/1589871478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9eb006bfc0 0x7f9eb0155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 >> 172.21.15.22:0/1589871478 conn(0x7f9eb006ddb0 msgr2=0x7f9eb01566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:48.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 shutdown_connections 2023-10-08T00:24:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.726+0000 7f9eb6e9e700 1 -- 172.21.15.22:0/1589871478 wait complete. 2023-10-08T00:24:48.729 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2023-10-08T00:24:48.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:48.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.860+0000 7f647d5a5700 1 Processor -- start 2023-10-08T00:24:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.860+0000 7f647d5a5700 1 -- start start 2023-10-08T00:24:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f647d5a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806b520 0x7f64780cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f647d5a5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64780cc210 con 0x7f64780c91e0 2023-10-08T00:24:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f647d5a5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64780cc4f0 con 0x7f647806aa40 2023-10-08T00:24:48.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f647d5a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64780cc7d0 con 0x7f647806b520 2023-10-08T00:24:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f64767fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f64780c91e0 0x7f647806ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39700/0 (socket says 172.21.15.22:39700) 2023-10-08T00:24:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f64767fc700 1 -- 172.21.15.22:0/1158745723 learned_addr learned my addr 172.21.15.22:0/1158745723 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.861+0000 7f64777fe700 1 --2- 172.21.15.22:0/1158745723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806b520 0x7f64780cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804835551 0 0) 0x7f64780cc4f0 con 0x7f647806aa40 2023-10-08T00:24:48.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6464003570 con 0x7f647806aa40 2023-10-08T00:24:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089928156 0 0) 0x7f64780cc210 con 0x7f64780c91e0 2023-10-08T00:24:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64780cc4f0 con 0x7f64780c91e0 2023-10-08T00:24:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f64777fe700 1 -- 172.21.15.22:0/1158745723 >> v1:172.21.15.192:6789/0 conn(0x7f647806aa40 legacy=0x7f647806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f64777fe700 1 -- 172.21.15.22:0/1158745723 >> v1:172.21.15.22:6789/0 conn(0x7f64780c91e0 legacy=0x7f647806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f64777fe700 1 -- 172.21.15.22:0/1158745723 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64780ccab0 con 0x7f647806b520 2023-10-08T00:24:48.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f64777fe700 1 --2- 172.21.15.22:0/1158745723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806b520 0x7f64780cbc00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6470009910 tx=0x7f64700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189877ea2170042b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011630 con 0x7f647806b520 2023-10-08T00:24:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470011790 con 0x7f647806b520 2023-10-08T00:24:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.862+0000 7f6475ffb700 1 -- 172.21.15.22:0/1158745723 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011b30 con 0x7f647806b520 2023-10-08T00:24:48.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 -- 172.21.15.22:0/1158745723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806b520 msgr2=0x7f64780cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 --2- 172.21.15.22:0/1158745723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806b520 0x7f64780cbc00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6470009910 tx=0x7f64700091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 -- 172.21.15.22:0/1158745723 shutdown_connections 2023-10-08T00:24:48.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 --2- 172.21.15.22:0/1158745723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806b520 0x7f64780cbc00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 -- 172.21.15.22:0/1158745723 >> 172.21.15.22:0/1158745723 conn(0x7f64780cd670 msgr2=0x7f64780cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 -- 172.21.15.22:0/1158745723 shutdown_connections 2023-10-08T00:24:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.863+0000 7f647d5a5700 1 -- 172.21.15.22:0/1158745723 wait complete. 2023-10-08T00:24:48.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.864+0000 7f647d5a5700 1 Processor -- start 2023-10-08T00:24:48.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.864+0000 7f647d5a5700 1 -- start start 2023-10-08T00:24:48.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806aa40 0x7f64780b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 0x7f64780b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64780c91e0 0x7f647814e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64780b1310 con 0x7f647806b520 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647815a830 con 0x7f64780c91e0 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64780b1dc0 con 0x7f647806aa40 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 0x7f64780b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 0x7f64780b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37534/0 (socket says 172.21.15.22:37534) 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 -- 172.21.15.22:0/2678202782 learned_addr learned my addr 172.21.15.22:0/2678202782 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64777fe700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64780c91e0 0x7f647814e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f6476ffd700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806aa40 0x7f64780b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 -- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806aa40 msgr2=0x7f64780b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806aa40 0x7f64780b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 -- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64780c91e0 msgr2=0x7f647814e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64780c91e0 0x7f647814e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 -- 172.21.15.22:0/2678202782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470009420 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f6476ffd700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806aa40 0x7f64780b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f64767fc700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 0x7f64780b0dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f646000c590 tx=0x7f6460007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460005b30 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6460005cb0 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647815aaf0 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460007320 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64780b1800 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.866+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647815ac80 con 0x7f647806b520 2023-10-08T00:24:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.867+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f646001b3b0 con 0x7f647806b520 2023-10-08T00:24:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.867+0000 7f646effd700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6458066ea0 0x7f6458069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.867+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6460083540 con 0x7f647806b520 2023-10-08T00:24:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.867+0000 7f6476ffd700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6458066ea0 0x7f6458069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.868+0000 7f6476ffd700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6458066ea0 0x7f6458069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f646800d7d0 tx=0x7f6468002b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.872+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6460050be0 con 0x7f647806b520 2023-10-08T00:24:48.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:48.946+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6460050fb0 con 0x7f647806b520 2023-10-08T00:24:49.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.067+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f647804c3c0 con 0x7f647806b520 2023-10-08T00:24:49.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.068+0000 7f646effd700 1 -- 172.21.15.22:0/2678202782 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f6460052c40 con 0x7f647806b520 2023-10-08T00:24:49.070 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:49.070 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:48.939855+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6458066ea0 msgr2=0x7f6458069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6458066ea0 0x7f6458069350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f646800d7d0 tx=0x7f6468002b70 comp rx=0 tx=0).stop 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 msgr2=0x7f64780b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 0x7f64780b0dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f646000c590 tx=0x7f6460007e00 comp rx=0 tx=0).stop 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 shutdown_connections 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64780c91e0 0x7f647814e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6458066ea0 0x7f6458069350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f647806aa40 0x7f64780b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 --2- 172.21.15.22:0/2678202782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f647806b520 0x7f64780b0dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 >> 172.21.15.22:0/2678202782 conn(0x7f64780cd670 msgr2=0x7f64780c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 shutdown_connections 2023-10-08T00:24:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.070+0000 7f647d5a5700 1 -- 172.21.15.22:0/2678202782 wait complete. 2023-10-08T00:24:49.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:24:49.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:24:49.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.207+0000 7f3e1c9c9700 1 Processor -- start 2023-10-08T00:24:49.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.207+0000 7f3e1c9c9700 1 -- start start 2023-10-08T00:24:49.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e180b16d0 0x7f3e180b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3e180b33b0 0x7f3e180b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180b2080 con 0x7f3e180b4e70 2023-10-08T00:24:49.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180cfb00 con 0x7f3e180b16d0 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180b5c40 con 0x7f3e180b33b0 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e180b16d0 0x7f3e180b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e180b16d0 0x7f3e180b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37536/0 (socket says 172.21.15.22:37536) 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 -- 172.21.15.22:0/3128383959 learned_addr learned my addr 172.21.15.22:0/3128383959 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1759e700 1 --2- 172.21.15.22:0/3128383959 >> v2:172.21.15.192:3300/0 conn(0x7f3e180b33b0 0x7f3e180b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 -- 172.21.15.22:0/3128383959 >> v2:172.21.15.192:3300/0 conn(0x7f3e180b33b0 msgr2=0x7f3e180b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 --2- 172.21.15.22:0/3128383959 >> v2:172.21.15.192:3300/0 conn(0x7f3e180b33b0 0x7f3e180b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 -- 172.21.15.22:0/3128383959 >> v1:172.21.15.192:6789/0 conn(0x7f3e180b4e70 legacy=0x7f3e180ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 -- 172.21.15.22:0/3128383959 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180b5f20 con 0x7f3e180b16d0 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1759e700 1 --2- 172.21.15.22:0/3128383959 >> v2:172.21.15.192:3300/0 conn(0x7f3e180b33b0 0x7f3e180b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:24:49.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1659c700 1 --2- 172.21.15.22:0/3128383959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b16d0 0x7f3e180b1b40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e18071380 tx=0x7f3e00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd6502dc0fd8630 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e15d9b700 1 -- 172.21.15.22:0/3128383959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000b820 con 0x7f3e180b16d0 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e15d9b700 1 -- 172.21.15.22:0/3128383959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000b980 con 0x7f3e180b16d0 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e15d9b700 1 -- 172.21.15.22:0/3128383959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000bd40 con 0x7f3e180b16d0 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3128383959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b16d0 msgr2=0x7f3e180b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3128383959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b16d0 0x7f3e180b1b40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3e18071380 tx=0x7f3e00009250 comp rx=0 tx=0).stop 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3128383959 shutdown_connections 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3128383959 >> v2:172.21.15.192:3300/0 conn(0x7f3e180b33b0 0x7f3e180b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3128383959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b16d0 0x7f3e180b1b40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3128383959 >> 172.21.15.22:0/3128383959 conn(0x7f3e180d10c0 msgr2=0x7f3e180affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3128383959 shutdown_connections 2023-10-08T00:24:49.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.209+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3128383959 wait complete. 2023-10-08T00:24:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.210+0000 7f3e1c9c9700 1 Processor -- start 2023-10-08T00:24:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 -- start start 2023-10-08T00:24:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e180b16d0 0x7f3e18157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 0x7f3e18069aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e180b4e70 0x7f3e180cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1816c690 con 0x7f3e180b33b0 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1816ba80 con 0x7f3e180b16d0 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1c9c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1816bd60 con 0x7f3e180b4e70 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 0x7f3e18069aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 0x7f3e18069aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37552/0 (socket says 172.21.15.22:37552) 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1659c700 1 -- 172.21.15.22:0/3589742697 learned_addr learned my addr 172.21.15.22:0/3589742697 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e1759e700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e180b4e70 0x7f3e180cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.211+0000 7f3e16d9d700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e180b16d0 0x7f3e18157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1659c700 1 -- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e180b4e70 msgr2=0x7f3e180cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1659c700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e180b4e70 0x7f3e180cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1659c700 1 -- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e180b16d0 msgr2=0x7f3e18157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1659c700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e180b16d0 0x7f3e18157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1659c700 1 -- 172.21.15.22:0/3589742697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e000094f0 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1659c700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 0x7f3e18069aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e18070dd0 tx=0x7f3e00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000b820 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e00020070 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1816c040 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000bd00 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.212+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e18157dc0 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.213+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1816c800 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.214+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e00022030 con 0x7f3e180b33b0 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.214+0000 7f3e0effd700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3df8066f30 0x7f3df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.214+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e00085f20 con 0x7f3e180b33b0 2023-10-08T00:24:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.214+0000 7f3e16d9d700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3df8066f30 0x7f3df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.215+0000 7f3e16d9d700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3df8066f30 0x7f3df80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e08007fd0 tx=0x7f3e080026a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.219+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e000534e0 con 0x7f3e180b33b0 2023-10-08T00:24:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.411+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e1816c7d0 con 0x7f3e180b33b0 2023-10-08T00:24:49.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.411+0000 7f3e0effd700 1 -- 172.21.15.22:0/3589742697 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e00056b00 con 0x7f3e180b33b0 2023-10-08T00:24:49.413 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3df8066f30 msgr2=0x7f3df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3df8066f30 0x7f3df80693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e08007fd0 tx=0x7f3e080026a0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 msgr2=0x7f3e18069aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 0x7f3e18069aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3e18070dd0 tx=0x7f3e00016000 comp rx=0 tx=0).stop 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 shutdown_connections 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3df8066f30 0x7f3df80693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e180b4e70 0x7f3e180cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e180b16d0 0x7f3e18157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 --2- 172.21.15.22:0/3589742697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e180b33b0 0x7f3e18069aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 >> 172.21.15.22:0/3589742697 conn(0x7f3e180d10c0 msgr2=0x7f3e180ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 shutdown_connections 2023-10-08T00:24:49.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.413+0000 7f3e1c9c9700 1 -- 172.21.15.22:0/3589742697 wait complete. 2023-10-08T00:24:49.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:24:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.544+0000 7f28ef3cd700 1 Processor -- start 2023-10-08T00:24:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.544+0000 7f28ef3cd700 1 -- start start 2023-10-08T00:24:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ef3cd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ef3cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c85a0 0x7f28e80c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ef3cd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e8069d30 con 0x7f28e8156fb0 2023-10-08T00:24:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ef3cd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e80c8110 con 0x7f28e80cb5a0 2023-10-08T00:24:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ef3cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80cbf30 con 0x7f28e80c85a0 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ec968700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ec968700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37558/0 (socket says 172.21.15.22:37558) 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ec968700 1 -- 172.21.15.22:0/2157132366 learned_addr learned my addr 172.21.15.22:0/2157132366 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ec968700 1 -- 172.21.15.22:0/2157132366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c85a0 msgr2=0x7f28e80c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.545+0000 7f28ec968700 1 --2- 172.21.15.22:0/2157132366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c85a0 0x7f28e80c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.546+0000 7f28ec968700 1 -- 172.21.15.22:0/2157132366 >> v1:172.21.15.192:6789/0 conn(0x7f28e8156fb0 legacy=0x7f28e806a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.546+0000 7f28ec968700 1 -- 172.21.15.22:0/2157132366 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e81568e0 con 0x7f28e80cb5a0 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.546+0000 7f28ec968700 1 --2- 172.21.15.22:0/2157132366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80cb5a0 0x7f28e80cb9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0099b0 tx=0x7f28dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c767c621be823e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.546+0000 7f28e7fff700 1 -- 172.21.15.22:0/2157132366 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00b820 con 0x7f28e80cb5a0 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.546+0000 7f28e7fff700 1 -- 172.21.15.22:0/2157132366 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc00b980 con 0x7f28e80cb5a0 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.546+0000 7f28e7fff700 1 -- 172.21.15.22:0/2157132366 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00bd20 con 0x7f28e80cb5a0 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 -- 172.21.15.22:0/2157132366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80cb5a0 msgr2=0x7f28e80cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/2157132366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80cb5a0 0x7f28e80cb9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0099b0 tx=0x7f28dc009250 comp rx=0 tx=0).stop 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 -- 172.21.15.22:0/2157132366 shutdown_connections 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/2157132366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c85a0 0x7f28e80c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/2157132366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80cb5a0 0x7f28e80cb9f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 -- 172.21.15.22:0/2157132366 >> 172.21.15.22:0/2157132366 conn(0x7f28e80c9870 msgr2=0x7f28e80c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 -- 172.21.15.22:0/2157132366 shutdown_connections 2023-10-08T00:24:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.547+0000 7f28ef3cd700 1 -- 172.21.15.22:0/2157132366 wait complete. 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.548+0000 7f28ef3cd700 1 Processor -- start 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.548+0000 7f28ef3cd700 1 -- start start 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ef3cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e80c85a0 0x7f28e815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ef3cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80cb5a0 0x7f28e81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ef3cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 0x7f28e80c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ef3cd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8148340 con 0x7f28e8156fb0 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ef3cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80c5680 con 0x7f28e80c85a0 2023-10-08T00:24:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ef3cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815a6f0 con 0x7f28e80cb5a0 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 0x7f28e80c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 0x7f28e80c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37560/0 (socket says 172.21.15.22:37560) 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ec968700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80cb5a0 0x7f28e81575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 -- 172.21.15.22:0/1238340388 learned_addr learned my addr 172.21.15.22:0/1238340388 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed169700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e80c85a0 0x7f28e815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 -- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80cb5a0 msgr2=0x7f28e81575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80cb5a0 0x7f28e81575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 -- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e80c85a0 msgr2=0x7f28e815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e80c85a0 0x7f28e815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.549+0000 7f28ed96a700 1 -- 172.21.15.22:0/1238340388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0094f0 con 0x7f28e8156fb0 2023-10-08T00:24:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.550+0000 7f28ed96a700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 0x7f28e80c5b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28d800bc60 tx=0x7f28d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.550+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d80092e0 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.550+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800c630 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.550+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800c9f0 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.550+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e815a9d0 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.550+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e80c5310 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.551+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e804c3c0 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.551+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28d8012070 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.552+0000 7f28e57fa700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28d4066f30 0x7f28d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.552+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f28d8083d90 con 0x7f28e8156fb0 2023-10-08T00:24:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.552+0000 7f28ed169700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28d4066f30 0x7f28d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.552+0000 7f28ed169700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28d4066f30 0x7f28d40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009ab0 tx=0x7f28e0009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.556+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d8051350 con 0x7f28e8156fb0 2023-10-08T00:24:49.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.750+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28e80c57c0 con 0x7f28e8156fb0 2023-10-08T00:24:49.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.751+0000 7f28e57fa700 1 -- 172.21.15.22:0/1238340388 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f28d8054970 con 0x7f28e8156fb0 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:24:49.753 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28d4066f30 msgr2=0x7f28d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28d4066f30 0x7f28d40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009ab0 tx=0x7f28e0009060 comp rx=0 tx=0).stop 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 msgr2=0x7f28e80c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 0x7f28e80c5b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28d800bc60 tx=0x7f28d8009840 comp rx=0 tx=0).stop 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 shutdown_connections 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e8156fb0 0x7f28e80c5b10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e80c85a0 0x7f28e815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28d4066f30 0x7f28d40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 --2- 172.21.15.22:0/1238340388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80cb5a0 0x7f28e81575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 >> 172.21.15.22:0/1238340388 conn(0x7f28e80c9870 msgr2=0x7f28e80b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:49.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 shutdown_connections 2023-10-08T00:24:49.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.753+0000 7f28ef3cd700 1 -- 172.21.15.22:0/1238340388 wait complete. 2023-10-08T00:24:49.766 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:24:49.767 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:24:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.888+0000 7f515fdcc700 1 Processor -- start 2023-10-08T00:24:49.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.888+0000 7f515fdcc700 1 -- start start 2023-10-08T00:24:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515fdcc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5158155360 0x7f51580b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515fdcc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f51580b40f0 0x7f51580ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515fdcc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51580ceb60 0x7f515806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515fdcc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580b4560 con 0x7f51580ceb60 2023-10-08T00:24:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515fdcc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515815c320 con 0x7f51580b40f0 2023-10-08T00:24:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515fdcc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51580cef90 con 0x7f5158155360 2023-10-08T00:24:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515e369700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51580ceb60 0x7f515806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515e369700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51580ceb60 0x7f515806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37564/0 (socket says 172.21.15.22:37564) 2023-10-08T00:24:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515e369700 1 -- 172.21.15.22:0/3107261385 learned_addr learned my addr 172.21.15.22:0/3107261385 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:49.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515d367700 1 --2- 172.21.15.22:0/3107261385 >> v2:172.21.15.192:3300/0 conn(0x7f51580b40f0 0x7f51580ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.889+0000 7f515db68700 1 --2- 172.21.15.22:0/3107261385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5158155360 0x7f51580b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515e369700 1 -- 172.21.15.22:0/3107261385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5158155360 msgr2=0x7f51580b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515e369700 1 --2- 172.21.15.22:0/3107261385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5158155360 0x7f51580b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515e369700 1 -- 172.21.15.22:0/3107261385 >> v2:172.21.15.192:3300/0 conn(0x7f51580b40f0 msgr2=0x7f51580ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515e369700 1 --2- 172.21.15.22:0/3107261385 >> v2:172.21.15.192:3300/0 conn(0x7f51580b40f0 0x7f51580ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515e369700 1 -- 172.21.15.22:0/3107261385 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515815b710 con 0x7f51580ceb60 2023-10-08T00:24:49.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515e369700 1 --2- 172.21.15.22:0/3107261385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f515806d130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f515806f4f0 tx=0x7f5148009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abcdeb3008ea7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515cb66700 1 -- 172.21.15.22:0/3107261385 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800b640 con 0x7f51580ceb60 2023-10-08T00:24:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515cb66700 1 -- 172.21.15.22:0/3107261385 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514800b7a0 con 0x7f51580ceb60 2023-10-08T00:24:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515cb66700 1 -- 172.21.15.22:0/3107261385 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514800bb60 con 0x7f51580ceb60 2023-10-08T00:24:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 -- 172.21.15.22:0/3107261385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 msgr2=0x7f515806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 --2- 172.21.15.22:0/3107261385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f515806d130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f515806f4f0 tx=0x7f5148009250 comp rx=0 tx=0).stop 2023-10-08T00:24:49.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 -- 172.21.15.22:0/3107261385 shutdown_connections 2023-10-08T00:24:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 --2- 172.21.15.22:0/3107261385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f515806d130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 --2- 172.21.15.22:0/3107261385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5158155360 0x7f51580b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 --2- 172.21.15.22:0/3107261385 >> v2:172.21.15.192:3300/0 conn(0x7f51580b40f0 0x7f51580ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 -- 172.21.15.22:0/3107261385 >> 172.21.15.22:0/3107261385 conn(0x7f515806baf0 msgr2=0x7f515806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.890+0000 7f515fdcc700 1 -- 172.21.15.22:0/3107261385 shutdown_connections 2023-10-08T00:24:49.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.891+0000 7f515fdcc700 1 -- 172.21.15.22:0/3107261385 wait complete. 2023-10-08T00:24:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 Processor -- start 2023-10-08T00:24:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 -- start start 2023-10-08T00:24:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51580b40f0 0x7f51580cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f5158146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5158155360 0x7f51581473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515816d4d0 con 0x7f51580ceb60 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515816d7b0 con 0x7f5158155360 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515fdcc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515816da90 con 0x7f51580b40f0 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515d367700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f5158146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515d367700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f5158146e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37578/0 (socket says 172.21.15.22:37578) 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.892+0000 7f515d367700 1 -- 172.21.15.22:0/861263281 learned_addr learned my addr 172.21.15.22:0/861263281 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:49.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515e369700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5158155360 0x7f51581473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515db68700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51580b40f0 0x7f51580cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515d367700 1 -- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51580b40f0 msgr2=0x7f51580cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515d367700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51580b40f0 0x7f51580cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515d367700 1 -- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5158155360 msgr2=0x7f51581473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515d367700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5158155360 0x7f51581473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:49.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515d367700 1 -- 172.21.15.22:0/861263281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51480094f0 con 0x7f51580ceb60 2023-10-08T00:24:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515d367700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f5158146e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f514c00ec80 tx=0x7f514c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00c9d0 con 0x7f51580ceb60 2023-10-08T00:24:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c00cb30 con 0x7f51580ceb60 2023-10-08T00:24:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515816dd70 con 0x7f51580ceb60 2023-10-08T00:24:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c013470 con 0x7f51580ceb60 2023-10-08T00:24:49.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.893+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5158069e90 con 0x7f51580ceb60 2023-10-08T00:24:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.894+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515816e210 con 0x7f51580ceb60 2023-10-08T00:24:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.894+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f514c013820 con 0x7f51580ceb60 2023-10-08T00:24:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.895+0000 7f5155ffb700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5144066f30 0x7f51440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.895+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f514c084610 con 0x7f51580ceb60 2023-10-08T00:24:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.895+0000 7f515db68700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5144066f30 0x7f51440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:49.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.896+0000 7f515db68700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5144066f30 0x7f51440693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5150007600 tx=0x7f515000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:49.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:49.900+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f514c051b30 con 0x7f51580ceb60 2023-10-08T00:24:50.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.095+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f51580718b0 con 0x7f51580ceb60 2023-10-08T00:24:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.952+0000 7f5155ffb700 1 -- 172.21.15.22:0/861263281 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f514c055150 con 0x7f51580ceb60 2023-10-08T00:24:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5144066f30 msgr2=0x7f51440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5144066f30 0x7f51440693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5150007600 tx=0x7f515000b040 comp rx=0 tx=0).stop 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 msgr2=0x7f5158146e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f5158146e70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f514c00ec80 tx=0x7f514c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 shutdown_connections 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5158155360 0x7f51581473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5144066f30 0x7f51440693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51580b40f0 0x7f51580cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 --2- 172.21.15.22:0/861263281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51580ceb60 0x7f5158146e70 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f514c00ec80 tx=0x7f514c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 >> 172.21.15.22:0/861263281 conn(0x7f515806baf0 msgr2=0x7f51580cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 shutdown_connections 2023-10-08T00:24:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:50.958+0000 7f515fdcc700 1 -- 172.21.15.22:0/861263281 wait complete. 2023-10-08T00:24:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:24:50.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:24:51.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.107+0000 7fe188942700 1 Processor -- start 2023-10-08T00:24:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.107+0000 7fe188942700 1 -- start start 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe188942700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe1841595d0 0x7fe1840ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe188942700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe1840cf480 0x7fe18415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe188942700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe1841599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe188942700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840b10f0 con 0x7fe1840cf480 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe188942700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18415dba0 con 0x7fe1841595d0 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe188942700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840cd530 con 0x7fe18415d760 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe1840cf480 0x7fe18415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe1840cf480 0x7fe18415d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37586/0 (socket says 172.21.15.22:37586) 2023-10-08T00:24:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 -- 172.21.15.22:0/659273908 learned_addr learned my addr 172.21.15.22:0/659273908 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18359e700 1 --2- 172.21.15.22:0/659273908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe1841599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe182d9d700 1 --2- 172.21.15.22:0/659273908 >> v2:172.21.15.192:3300/0 conn(0x7fe1841595d0 0x7fe1840ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 -- 172.21.15.22:0/659273908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 msgr2=0x7fe1841599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 --2- 172.21.15.22:0/659273908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe1841599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 -- 172.21.15.22:0/659273908 >> v2:172.21.15.192:3300/0 conn(0x7fe1841595d0 msgr2=0x7fe1840ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 --2- 172.21.15.22:0/659273908 >> v2:172.21.15.192:3300/0 conn(0x7fe1841595d0 0x7fe1840ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.108+0000 7fe18259c700 1 -- 172.21.15.22:0/659273908 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18415e000 con 0x7fe1840cf480 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe18259c700 1 --2- 172.21.15.22:0/659273908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe18415d220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18406a4d0 tx=0x7fe16c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbf69ba42706525 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe181d9b700 1 -- 172.21.15.22:0/659273908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00b860 con 0x7fe1840cf480 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe181d9b700 1 -- 172.21.15.22:0/659273908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c00b9c0 con 0x7fe1840cf480 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe181d9b700 1 -- 172.21.15.22:0/659273908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00bd60 con 0x7fe1840cf480 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 -- 172.21.15.22:0/659273908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 msgr2=0x7fe18415d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 --2- 172.21.15.22:0/659273908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe18415d220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18406a4d0 tx=0x7fe16c009250 comp rx=0 tx=0).stop 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 -- 172.21.15.22:0/659273908 shutdown_connections 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 --2- 172.21.15.22:0/659273908 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe1841599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 --2- 172.21.15.22:0/659273908 >> v2:172.21.15.192:3300/0 conn(0x7fe1841595d0 0x7fe1840ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 --2- 172.21.15.22:0/659273908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe18415d220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 -- 172.21.15.22:0/659273908 >> 172.21.15.22:0/659273908 conn(0x7fe1840d05f0 msgr2=0x7fe1840d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 -- 172.21.15.22:0/659273908 shutdown_connections 2023-10-08T00:24:51.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.109+0000 7fe188942700 1 -- 172.21.15.22:0/659273908 wait complete. 2023-10-08T00:24:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 Processor -- start 2023-10-08T00:24:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 -- start start 2023-10-08T00:24:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe184152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1841595d0 0x7fe184154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe18416ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184158690 con 0x7fe1840cf480 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841569c0 con 0x7fe1841595d0 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe188942700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841532c0 con 0x7fe18415d760 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe182d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe184152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe182d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe184152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37594/0 (socket says 172.21.15.22:37594) 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe182d9d700 1 -- 172.21.15.22:0/1001760721 learned_addr learned my addr 172.21.15.22:0/1001760721 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe18359e700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe18416ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.111+0000 7fe18259c700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1841595d0 0x7fe184154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe182d9d700 1 -- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 msgr2=0x7fe18416ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe182d9d700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe18416ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe182d9d700 1 -- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1841595d0 msgr2=0x7fe184154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe182d9d700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1841595d0 0x7fe184154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe182d9d700 1 -- 172.21.15.22:0/1001760721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0094f0 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe182d9d700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe184152d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe174009fd0 tx=0x7fe174009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400ec70 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400edd0 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174014670 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe184155db0 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.112+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe184156370 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.113+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe184156ca0 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.113+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1740149e0 con 0x7fe1840cf480 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.114+0000 7fe17affd700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe164066f30 0x7fe1640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.114+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe174084a40 con 0x7fe1840cf480 2023-10-08T00:24:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.114+0000 7fe18259c700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe164066f30 0x7fe1640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.115+0000 7fe18259c700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe164066f30 0x7fe1640693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18406a4d0 tx=0x7fe16c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:51.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.119+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe174086e60 con 0x7fe1840cf480 2023-10-08T00:24:51.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.313+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe18404c3c0 con 0x7fe1840cf480 2023-10-08T00:24:51.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.954+0000 7fe17affd700 1 -- 172.21.15.22:0/1001760721 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe174055920 con 0x7fe1840cf480 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.959+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe164066f30 msgr2=0x7fe1640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.959+0000 7fe188942700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe164066f30 0x7fe1640693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe18406a4d0 tx=0x7fe16c017000 comp rx=0 tx=0).stop 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.959+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 msgr2=0x7fe184152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.959+0000 7fe188942700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe184152d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe174009fd0 tx=0x7fe174009970 comp rx=0 tx=0).stop 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.960+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 shutdown_connections 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.960+0000 7fe188942700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe164066f30 0x7fe1640693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.960+0000 7fe188942700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe18415d760 0x7fe18416ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.960+0000 7fe188942700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1840cf480 0x7fe184152d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.960+0000 7fe188942700 1 --2- 172.21.15.22:0/1001760721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1841595d0 0x7fe184154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.960+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 >> 172.21.15.22:0/1001760721 conn(0x7fe1840d05f0 msgr2=0x7fe184068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.962+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 shutdown_connections 2023-10-08T00:24:51.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:51.964+0000 7fe188942700 1 -- 172.21.15.22:0/1001760721 wait complete. 2023-10-08T00:24:51.968 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:24:51.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:24:52.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.108+0000 7f7244aa6700 1 Processor -- start 2023-10-08T00:24:52.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.108+0000 7f7244aa6700 1 -- start start 2023-10-08T00:24:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f7244aa6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f724006aa40 0x7f72400cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f7244aa6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006bac0 0x7f724006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f7244aa6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f724006b350 0x7f72400c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f7244aa6700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400cc210 con 0x7f724006aa40 2023-10-08T00:24:52.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f7244aa6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72400cc4f0 con 0x7f724006b350 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f7244aa6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72400cc7d0 con 0x7f724006bac0 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f723e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f724006aa40 0x7f72400cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f723e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f724006aa40 0x7f72400cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37610/0 (socket says 172.21.15.22:37610) 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.109+0000 7f723e59c700 1 -- 172.21.15.22:0/3484309787 learned_addr learned my addr 172.21.15.22:0/3484309787 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723ed9d700 1 --2- 172.21.15.22:0/3484309787 >> v2:172.21.15.192:3300/0 conn(0x7f724006b350 0x7f72400c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723dd9b700 1 --2- 172.21.15.22:0/3484309787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006bac0 0x7f724006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723e59c700 1 -- 172.21.15.22:0/3484309787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006bac0 msgr2=0x7f724006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723e59c700 1 --2- 172.21.15.22:0/3484309787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006bac0 0x7f724006ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723e59c700 1 -- 172.21.15.22:0/3484309787 >> v2:172.21.15.192:3300/0 conn(0x7f724006b350 msgr2=0x7f72400c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723e59c700 1 --2- 172.21.15.22:0/3484309787 >> v2:172.21.15.192:3300/0 conn(0x7f724006b350 0x7f72400c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723e59c700 1 -- 172.21.15.22:0/3484309787 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72400ccab0 con 0x7f724006aa40 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723e59c700 1 --2- 172.21.15.22:0/3484309787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006aa40 0x7f72400cbc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72400c7c40 tx=0x7f723000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecafcc74e074bdbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723d59a700 1 -- 172.21.15.22:0/3484309787 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230005c10 con 0x7f724006aa40 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723d59a700 1 -- 172.21.15.22:0/3484309787 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230005d70 con 0x7f724006aa40 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f723d59a700 1 -- 172.21.15.22:0/3484309787 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723000dc30 con 0x7f724006aa40 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f7244aa6700 1 -- 172.21.15.22:0/3484309787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006aa40 msgr2=0x7f72400cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.110+0000 7f7244aa6700 1 --2- 172.21.15.22:0/3484309787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006aa40 0x7f72400cbc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72400c7c40 tx=0x7f723000b4c0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 -- 172.21.15.22:0/3484309787 shutdown_connections 2023-10-08T00:24:52.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 --2- 172.21.15.22:0/3484309787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006aa40 0x7f72400cbc00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 --2- 172.21.15.22:0/3484309787 >> v2:172.21.15.192:3300/0 conn(0x7f724006b350 0x7f72400c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 --2- 172.21.15.22:0/3484309787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006bac0 0x7f724006ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 -- 172.21.15.22:0/3484309787 >> 172.21.15.22:0/3484309787 conn(0x7f72400cd670 msgr2=0x7f72400cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 -- 172.21.15.22:0/3484309787 shutdown_connections 2023-10-08T00:24:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.111+0000 7f7244aa6700 1 -- 172.21.15.22:0/3484309787 wait complete. 2023-10-08T00:24:52.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 Processor -- start 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 -- start start 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006aa40 0x7f724014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 0x7f724016a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f724006bac0 0x7f724014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72400b0780 con 0x7f724006b350 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724016ac30 con 0x7f724006bac0 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.112+0000 7f7244aa6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724016af10 con 0x7f724006aa40 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 0x7f724016a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 0x7f724016a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37614/0 (socket says 172.21.15.22:37614) 2023-10-08T00:24:52.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 -- 172.21.15.22:0/2552499118 learned_addr learned my addr 172.21.15.22:0/2552499118 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723ed9d700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f724006bac0 0x7f724014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723e59c700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006aa40 0x7f724014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 -- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006aa40 msgr2=0x7f724014b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006aa40 0x7f724014b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 -- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f724006bac0 msgr2=0x7f724014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f724006bac0 0x7f724014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 -- 172.21.15.22:0/2552499118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723000b720 con 0x7f724006b350 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f723dd9b700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 0x7f724016a120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f722800d860 tx=0x7f7228008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228011590 con 0x7f724006b350 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280116f0 con 0x7f724006b350 2023-10-08T00:24:52.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724016b1f0 con 0x7f724006b350 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228011a90 con 0x7f724006b350 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.113+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72400afa60 con 0x7f724006b350 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.114+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72400b0930 con 0x7f724006b350 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.115+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f722801c460 con 0x7f724006b350 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.115+0000 7f72367fc700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.115+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7228084490 con 0x7f724006b350 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.115+0000 7f723e59c700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:52.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.116+0000 7f723e59c700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f723000b500 tx=0x7f723001a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:52.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.120+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72400b0930 con 0x7f724006b350 2023-10-08T00:24:52.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.358+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f72400c9d80 con 0x7f724006b350 2023-10-08T00:24:52.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.979+0000 7f72367fc700 1 -- 172.21.15.22:0/2552499118 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7228054f60 con 0x7f724006b350 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7220066f30 msgr2=0x7f72200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f723000b500 tx=0x7f723001a000 comp rx=0 tx=0).stop 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 msgr2=0x7f724016a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 0x7f724016a120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f722800d860 tx=0x7f7228008040 comp rx=0 tx=0).stop 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 shutdown_connections 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f724006bac0 0x7f724014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f723000b500 tx=0x7f723001a000 comp rx=0 tx=0).stop 2023-10-08T00:24:52.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f724006aa40 0x7f724014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 --2- 172.21.15.22:0/2552499118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f724006b350 0x7f724016a120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:52.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.985+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 >> 172.21.15.22:0/2552499118 conn(0x7f72400cd670 msgr2=0x7f72400c26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:52.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.986+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 shutdown_connections 2023-10-08T00:24:52.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:52.986+0000 7f7244aa6700 1 -- 172.21.15.22:0/2552499118 wait complete. 2023-10-08T00:24:52.988 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T00:24:53.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.124+0000 7f3300df4700 1 Processor -- start 2023-10-08T00:24:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.124+0000 7f3300df4700 1 -- start start 2023-10-08T00:24:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f3300df4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32fc0cd1e0 0x7f32fc0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f3300df4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc15c2a0 con 0x7f32fc141500 2023-10-08T00:24:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f3300df4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc15b690 con 0x7f32fc06bcd0 2023-10-08T00:24:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f3300df4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc15b970 con 0x7f32fc0cd1e0 2023-10-08T00:24:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32fad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32fc0cd1e0 0x7f32fc0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32f9d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f32fc141500 0x7f32fc0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39708/0 (socket says 172.21.15.22:39708) 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32f9d9b700 1 -- 172.21.15.22:0/475984385 learned_addr learned my addr 172.21.15.22:0/475984385 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32fad9d700 1 -- 172.21.15.22:0/475984385 >> v1:172.21.15.192:6789/0 conn(0x7f32fc06bcd0 legacy=0x7f32fc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32fad9d700 1 -- 172.21.15.22:0/475984385 >> v1:172.21.15.22:6789/0 conn(0x7f32fc141500 legacy=0x7f32fc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32fad9d700 1 -- 172.21.15.22:0/475984385 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15bc50 con 0x7f32fc0cd1e0 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32f959a700 1 -- 172.21.15.22:0/475984385 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313774994 0 0) 0x7f32fc15c2a0 con 0x7f32fc141500 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.125+0000 7f32fad9d700 1 --2- 172.21.15.22:0/475984385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc0cd1e0 0x7f32fc0c9510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009e60 tx=0x7f32f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7dcfcc93b7cc5d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f32f959a700 1 -- 172.21.15.22:0/475984385 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400e070 con 0x7f32fc0cd1e0 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f32f959a700 1 -- 172.21.15.22:0/475984385 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f400bc30 con 0x7f32fc0cd1e0 2023-10-08T00:24:53.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f32f959a700 1 -- 172.21.15.22:0/475984385 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4012430 con 0x7f32fc0cd1e0 2023-10-08T00:24:53.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 -- 172.21.15.22:0/475984385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc0cd1e0 msgr2=0x7f32fc0c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 --2- 172.21.15.22:0/475984385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc0cd1e0 0x7f32fc0c9510 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009e60 tx=0x7f32f4009780 comp rx=0 tx=0).stop 2023-10-08T00:24:53.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 -- 172.21.15.22:0/475984385 shutdown_connections 2023-10-08T00:24:53.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 --2- 172.21.15.22:0/475984385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc0cd1e0 0x7f32fc0c9510 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 -- 172.21.15.22:0/475984385 >> 172.21.15.22:0/475984385 conn(0x7f32fc0ce600 msgr2=0x7f32fc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 -- 172.21.15.22:0/475984385 shutdown_connections 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.126+0000 7f3300df4700 1 -- 172.21.15.22:0/475984385 wait complete. 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.127+0000 7f3300df4700 1 Processor -- start 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.127+0000 7f3300df4700 1 -- start start 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f3300df4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 0x7f32fc16ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f3300df4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32fc0cd1e0 0x7f32fc15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f3300df4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32fc141500 0x7f32fc15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f3300df4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc06b0e0 con 0x7f32fc06bcd0 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f3300df4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc06a4d0 con 0x7f32fc141500 2023-10-08T00:24:53.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f3300df4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc06a7b0 con 0x7f32fc0cd1e0 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 0x7f32fc16ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f32fa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 0x7f32fc16ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37634/0 (socket says 172.21.15.22:37634) 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f32fa59c700 1 -- 172.21.15.22:0/2263657807 learned_addr learned my addr 172.21.15.22:0/2263657807 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f32fad9d700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32fc141500 0x7f32fc15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.128+0000 7f32f9d9b700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32fc0cd1e0 0x7f32fc15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32fa59c700 1 -- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32fc0cd1e0 msgr2=0x7f32fc15a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32fa59c700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32fc0cd1e0 0x7f32fc15a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32fa59c700 1 -- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32fc141500 msgr2=0x7f32fc15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32fa59c700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32fc141500 0x7f32fc15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32fa59c700 1 -- 172.21.15.22:0/2263657807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009a20 con 0x7f32fc06bcd0 2023-10-08T00:24:53.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32f9d9b700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32fc0cd1e0 0x7f32fc15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32fa59c700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 0x7f32fc16ce10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c590 tx=0x7f32ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011590 con 0x7f32fc06bcd0 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec011710 con 0x7f32fc06bcd0 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc06aa90 con 0x7f32fc06bcd0 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec011ad0 con 0x7f32fc06bcd0 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.129+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc16d350 con 0x7f32fc06bcd0 2023-10-08T00:24:53.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.130+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc0c8d60 con 0x7f32fc06bcd0 2023-10-08T00:24:53.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.130+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32ec01b3b0 con 0x7f32fc06bcd0 2023-10-08T00:24:53.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.131+0000 7f32ea7fc700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.131+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32ec083b00 con 0x7f32fc06bcd0 2023-10-08T00:24:53.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.131+0000 7f32f9d9b700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.131+0000 7f32f9d9b700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f32dc066f30 0x7f32dc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0c7cc0 tx=0x7f32f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.135+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32ec050d70 con 0x7f32fc06bcd0 2023-10-08T00:24:53.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.330+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32fc04c3c0 con 0x7f32fc06bcd0 2023-10-08T00:24:53.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.331+0000 7f32ea7fc700 1 -- 172.21.15.22:0/2263657807 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f32ec017070 con 0x7f32fc06bcd0 2023-10-08T00:24:53.332 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:53.332 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:52.359469+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:53.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f32dc066f30 msgr2=0x7f32dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f32dc066f30 0x7f32dc0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0c7cc0 tx=0x7f32f0009040 comp rx=0 tx=0).stop 2023-10-08T00:24:53.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 msgr2=0x7f32fc16ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 0x7f32fc16ce10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c590 tx=0x7f32ec00c8a0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 shutdown_connections 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f32fc141500 0x7f32fc15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32fc06bcd0 0x7f32fc16ce10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f32dc066f30 0x7f32dc0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 --2- 172.21.15.22:0/2263657807 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f32fc0cd1e0 0x7f32fc15a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 >> 172.21.15.22:0/2263657807 conn(0x7f32fc0ce600 msgr2=0x7f32fc0c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 shutdown_connections 2023-10-08T00:24:53.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.334+0000 7f3300df4700 1 -- 172.21.15.22:0/2263657807 wait complete. 2023-10-08T00:24:53.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:53.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.464+0000 7f7de247a700 1 Processor -- start 2023-10-08T00:24:53.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de247a700 1 -- start start 2023-10-08T00:24:53.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de247a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ddc159890 0x7f7ddc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de247a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ddc159c60 0x7f7ddc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de247a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ddc15a160 con 0x7f7ddc15db10 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de247a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc15df50 con 0x7f7ddc159890 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de247a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ddc0d13a0 con 0x7f7ddc159c60 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7ddbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ddc159890 0x7f7ddc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.465+0000 7f7de0a17700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7ddc15db10 0x7f7ddc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39724/0 (socket says 172.21.15.22:39724) 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ddc159890 0x7f7ddc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37644/0 (socket says 172.21.15.22:37644) 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7de0a17700 1 -- 172.21.15.22:0/3545886958 learned_addr learned my addr 172.21.15.22:0/3545886958 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddb7fe700 1 --2- 172.21.15.22:0/3545886958 >> v2:172.21.15.192:3300/0 conn(0x7f7ddc159c60 0x7f7ddc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddbfff700 1 -- 172.21.15.22:0/3545886958 >> v2:172.21.15.192:3300/0 conn(0x7f7ddc159c60 msgr2=0x7f7ddc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddbfff700 1 --2- 172.21.15.22:0/3545886958 >> v2:172.21.15.192:3300/0 conn(0x7f7ddc159c60 0x7f7ddc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddbfff700 1 -- 172.21.15.22:0/3545886958 >> v1:172.21.15.22:6789/0 conn(0x7f7ddc15db10 legacy=0x7f7ddc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddbfff700 1 -- 172.21.15.22:0/3545886958 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc15e140 con 0x7f7ddc159890 2023-10-08T00:24:53.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddaffd700 1 -- 172.21.15.22:0/3545886958 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586899882 0 0) 0x7f7ddc15a160 con 0x7f7ddc15db10 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddbfff700 1 --2- 172.21.15.22:0/3545886958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc15abd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0b67f0 tx=0x7f7dd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b74807a756bfb61c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddaffd700 1 -- 172.21.15.22:0/3545886958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000b6b0 con 0x7f7ddc159890 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddaffd700 1 -- 172.21.15.22:0/3545886958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000b810 con 0x7f7ddc159890 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.466+0000 7f7ddaffd700 1 -- 172.21.15.22:0/3545886958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bbb0 con 0x7f7ddc159890 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 -- 172.21.15.22:0/3545886958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 msgr2=0x7f7ddc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 --2- 172.21.15.22:0/3545886958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc15abd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc0b67f0 tx=0x7f7dd00091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 -- 172.21.15.22:0/3545886958 shutdown_connections 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 --2- 172.21.15.22:0/3545886958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc15abd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 --2- 172.21.15.22:0/3545886958 >> v2:172.21.15.192:3300/0 conn(0x7f7ddc159c60 0x7f7ddc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 -- 172.21.15.22:0/3545886958 >> 172.21.15.22:0/3545886958 conn(0x7f7ddc068e20 msgr2=0x7f7ddc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 -- 172.21.15.22:0/3545886958 shutdown_connections 2023-10-08T00:24:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.467+0000 7f7de247a700 1 -- 172.21.15.22:0/3545886958 wait complete. 2023-10-08T00:24:53.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.468+0000 7f7de247a700 1 Processor -- start 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.468+0000 7f7de247a700 1 -- start start 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc159c60 0x7f7ddc16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc15db10 0x7f7ddc152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cf3c0 con 0x7f7ddc159890 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cf6a0 con 0x7f7ddc159c60 2023-10-08T00:24:53.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc0cf980 con 0x7f7ddc15db10 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37654/0 (socket says 172.21.15.22:37654) 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 -- 172.21.15.22:0/2362103779 learned_addr learned my addr 172.21.15.22:0/2362103779 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 -- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc15db10 msgr2=0x7f7ddc152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddb7fe700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc159c60 0x7f7ddc16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc15db10 0x7f7ddc152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 -- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc159c60 msgr2=0x7f7ddc16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc159c60 0x7f7ddc16a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 -- 172.21.15.22:0/2362103779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0009420 con 0x7f7ddc159890 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7ddbfff700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc0ceac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc070e20 tx=0x7f7dd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0011420 con 0x7f7ddc159890 2023-10-08T00:24:53.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0011580 con 0x7f7ddc159890 2023-10-08T00:24:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0011940 con 0x7f7ddc159890 2023-10-08T00:24:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.469+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc0cfc60 con 0x7f7ddc159890 2023-10-08T00:24:53.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.470+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc16a710 con 0x7f7ddc159890 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.470+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04c3c0 con 0x7f7ddc159890 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.471+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7dd0011d30 con 0x7f7ddc159890 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.471+0000 7f7dc3fff700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dc8066f30 0x7f7dc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.471+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dd0085a60 con 0x7f7ddc159890 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.471+0000 7f7ddb7fe700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dc8066f30 0x7f7dc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.472+0000 7f7ddb7fe700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dc8066f30 0x7f7dc80693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc1513b0 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.476+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dd0052cd0 con 0x7f7ddc159890 2023-10-08T00:24:53.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.671+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ddc0cbe40 con 0x7f7ddc159890 2023-10-08T00:24:53.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.672+0000 7f7dc3fff700 1 -- 172.21.15.22:0/2362103779 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f7dd0015090 con 0x7f7ddc159890 2023-10-08T00:24:53.672 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:53.672 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":20,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:52.359469+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dc8066f30 msgr2=0x7f7dc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dc8066f30 0x7f7dc80693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc1513b0 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 msgr2=0x7f7ddc0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc0ceac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc070e20 tx=0x7f7dd0017000 comp rx=0 tx=0).stop 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 shutdown_connections 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dc8066f30 0x7f7dc80693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc15db10 0x7f7ddc152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc159890 0x7f7ddc0ceac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 --2- 172.21.15.22:0/2362103779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc159c60 0x7f7ddc16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 >> 172.21.15.22:0/2362103779 conn(0x7f7ddc068e20 msgr2=0x7f7ddc1584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:53.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 shutdown_connections 2023-10-08T00:24:53.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.674+0000 7f7de247a700 1 -- 172.21.15.22:0/2362103779 wait complete. 2023-10-08T00:24:53.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:24:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.809+0000 7f9ac5961700 1 Processor -- start 2023-10-08T00:24:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9ac5961700 1 -- start start 2023-10-08T00:24:53.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9ac5961700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9ac0159890 0x7f9ac015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9ac5961700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0069560 0x7f9ac00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9ac5961700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac0069ee0 con 0x7f9ac0159c60 2023-10-08T00:24:53.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9ac5961700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac015a160 con 0x7f9ac0159890 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9ac5961700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00d13a0 con 0x7f9ac0069560 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9abeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9ac0159890 0x7f9ac015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9abe7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9ac0159c60 0x7f9ac015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39726/0 (socket says 172.21.15.22:39726) 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.810+0000 7f9abe7fc700 1 -- 172.21.15.22:0/1288289889 learned_addr learned my addr 172.21.15.22:0/1288289889 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abf7fe700 1 --2- 172.21.15.22:0/1288289889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0069560 0x7f9ac00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abeffd700 1 -- 172.21.15.22:0/1288289889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0069560 msgr2=0x7f9ac00699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abeffd700 1 --2- 172.21.15.22:0/1288289889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0069560 0x7f9ac00699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abeffd700 1 -- 172.21.15.22:0/1288289889 >> v1:172.21.15.22:6789/0 conn(0x7f9ac0159c60 legacy=0x7f9ac015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abeffd700 1 -- 172.21.15.22:0/1288289889 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac015e140 con 0x7f9ac0159890 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abdffb700 1 -- 172.21.15.22:0/1288289889 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944150118 0 0) 0x7f9ac0069ee0 con 0x7f9ac0159c60 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abeffd700 1 --2- 172.21.15.22:0/1288289889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159890 0x7f9ac015abd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00098e0 tx=0x7f9ab00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b7d54b0f4c735d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abdffb700 1 -- 172.21.15.22:0/1288289889 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0009e80 con 0x7f9ac0159890 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abdffb700 1 -- 172.21.15.22:0/1288289889 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000b860 con 0x7f9ac0159890 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.811+0000 7f9abdffb700 1 -- 172.21.15.22:0/1288289889 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000bbe0 con 0x7f9ac0159890 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 -- 172.21.15.22:0/1288289889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159890 msgr2=0x7f9ac015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1288289889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159890 0x7f9ac015abd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00098e0 tx=0x7f9ab00091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 -- 172.21.15.22:0/1288289889 shutdown_connections 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1288289889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0069560 0x7f9ac00699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1288289889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159890 0x7f9ac015abd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 -- 172.21.15.22:0/1288289889 >> 172.21.15.22:0/1288289889 conn(0x7f9ac0068e20 msgr2=0x7f9ac00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 -- 172.21.15.22:0/1288289889 shutdown_connections 2023-10-08T00:24:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.812+0000 7f9ac5961700 1 -- 172.21.15.22:0/1288289889 wait complete. 2023-10-08T00:24:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.813+0000 7f9ac5961700 1 Processor -- start 2023-10-08T00:24:53.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.813+0000 7f9ac5961700 1 -- start start 2023-10-08T00:24:53.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac0069560 0x7f9ac014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0159890 0x7f9ac00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 0x7f9ac00b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac0169f30 con 0x7f9ac0159c60 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00b4c20 con 0x7f9ac0069560 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00b4380 con 0x7f9ac0159890 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 0x7f9ac00b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 0x7f9ac00b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37666/0 (socket says 172.21.15.22:37666) 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 -- 172.21.15.22:0/1938841174 learned_addr learned my addr 172.21.15.22:0/1938841174 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abeffd700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac0069560 0x7f9ac014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abe7fc700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0159890 0x7f9ac00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 -- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0159890 msgr2=0x7f9ac00b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0159890 0x7f9ac00b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 -- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac0069560 msgr2=0x7f9ac014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac0069560 0x7f9ac014d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 -- 172.21.15.22:0/1938841174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab0009420 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9abf7fe700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 0x7f9ac00b3ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8007f20 tx=0x7f9ab8009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800eb90 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800ed10 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac00b4660 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8014670 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.814+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac00ce410 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.815+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac00ce630 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.816+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ab80149e0 con 0x7f9ac0159c60 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.816+0000 7f9aa6ffd700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9aac066f30 0x7f9aac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:53.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.816+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ab8084ae0 con 0x7f9ac0159c60 2023-10-08T00:24:53.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.816+0000 7f9abeffd700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9aac066f30 0x7f9aac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:53.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.817+0000 7f9abeffd700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9aac066f30 0x7f9aac0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00091e0 tx=0x7f9ab0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:53.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:53.820+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ab8051d50 con 0x7f9ac0159c60 2023-10-08T00:24:54.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.060+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ac004c3c0 con 0x7f9ac0159c60 2023-10-08T00:24:54.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.988+0000 7f9aa6ffd700 1 -- 172.21.15.22:0/1938841174 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ab8055370 con 0x7f9ac0159c60 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9aac066f30 msgr2=0x7f9aac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9aac066f30 0x7f9aac0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00091e0 tx=0x7f9ab0017000 comp rx=0 tx=0).stop 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 msgr2=0x7f9ac00b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 0x7f9ac00b3ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8007f20 tx=0x7f9ab8009860 comp rx=0 tx=0).stop 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 shutdown_connections 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ac0159c60 0x7f9ac00b3ce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac0069560 0x7f9ac014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9aac066f30 0x7f9aac0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 --2- 172.21.15.22:0/1938841174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ac0159890 0x7f9ac00b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:54.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 >> 172.21.15.22:0/1938841174 conn(0x7f9ac0068e20 msgr2=0x7f9ac00d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:54.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 shutdown_connections 2023-10-08T00:24:54.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:54.991+0000 7f9ac5961700 1 -- 172.21.15.22:0/1938841174 wait complete. 2023-10-08T00:24:55.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:24:55.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.134+0000 7fe4935f3700 1 Processor -- start 2023-10-08T00:24:55.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.134+0000 7fe4935f3700 1 -- start start 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe4935f3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe48c159890 0x7fe48c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe4935f3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c15a160 con 0x7fe48c159c60 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe4935f3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0d13a0 con 0x7fe48c069560 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe4935f3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c15e140 con 0x7fe48c159890 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe490b8e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe48c159c60 0x7fe48c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39734/0 (socket says 172.21.15.22:39734) 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe490b8e700 1 -- 172.21.15.22:0/1524416657 learned_addr learned my addr 172.21.15.22:0/1524416657 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe49138f700 1 --2- 172.21.15.22:0/1524416657 >> v2:172.21.15.192:3300/0 conn(0x7fe48c159890 0x7fe48c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778047324 0 0) 0x7fe48c15a160 con 0x7fe48c159c60 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe478003570 con 0x7fe48c159c60 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1101416223 0 0) 0x7fe478003570 con 0x7fe48c159c60 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 >> v2:172.21.15.192:3300/0 conn(0x7fe48c159890 msgr2=0x7fe48c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.135+0000 7fe483fff700 1 --2- 172.21.15.22:0/1524416657 >> v2:172.21.15.192:3300/0 conn(0x7fe48c159890 0x7fe48c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 >> v1:172.21.15.192:6789/0 conn(0x7fe48c069560 legacy=0x7fe48c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c15a3d0 con 0x7fe48c159c60 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fe47c001470 con 0x7fe48c159c60 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 >> v1:172.21.15.22:6789/0 conn(0x7fe48c159c60 legacy=0x7fe48c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe478003a60 0x7fe478003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478004810 0x7fe478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4780051c0 0x7fe47800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c15e140 con 0x7fe478003a60 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800c0d0 con 0x7fe478004810 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800c290 con 0x7fe4780051c0 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe478003a60 0x7fe478003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe490b8e700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478004810 0x7fe478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe491b90700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4780051c0 0x7fe47800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 -- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4780051c0 msgr2=0x7fe47800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe4780051c0 0x7fe47800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 -- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478004810 msgr2=0x7fe478004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478004810 0x7fe478004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 -- 172.21.15.22:0/1524416657 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478003570 con 0x7fe478003a60 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe491b90700 1 -- 172.21.15.22:0/1524416657 reap_dead start 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe49138f700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe478003a60 0x7fe478003e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe488009c00 tx=0x7fe4880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd3d98993920248 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:55.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48800e710 con 0x7fe478003a60 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48800e870 con 0x7fe478003a60 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.136+0000 7fe483fff700 1 -- 172.21.15.22:0/1524416657 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48800ec30 con 0x7fe478003a60 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 -- 172.21.15.22:0/1524416657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe478003a60 msgr2=0x7fe478003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe478003a60 0x7fe478003e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe488009c00 tx=0x7fe4880091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 -- 172.21.15.22:0/1524416657 shutdown_connections 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 --2- 172.21.15.22:0/1524416657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe478003a60 0x7fe478003e70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 -- 172.21.15.22:0/1524416657 >> 172.21.15.22:0/1524416657 conn(0x7fe48c068e20 msgr2=0x7fe48c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 -- 172.21.15.22:0/1524416657 shutdown_connections 2023-10-08T00:24:55.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.137+0000 7fe4935f3700 1 -- 172.21.15.22:0/1524416657 wait complete. 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.138+0000 7fe4935f3700 1 Processor -- start 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.138+0000 7fe4935f3700 1 -- start start 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe4935f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478003a60 0x7fe48c0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe4935f3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 0x7fe48c0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe4935f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0c93c0 0x7fe48c0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe4935f3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0c9d50 con 0x7fe48c0cd850 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe4935f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0b1750 con 0x7fe48c0c93c0 2023-10-08T00:24:55.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe4935f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c146e90 con 0x7fe478003a60 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 0x7fe48c0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 0x7fe48c0c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37684/0 (socket says 172.21.15.22:37684) 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 -- 172.21.15.22:0/3733032088 learned_addr learned my addr 172.21.15.22:0/3733032088 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe491b90700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0c93c0 0x7fe48c0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe49138f700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478003a60 0x7fe48c0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 -- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478003a60 msgr2=0x7fe48c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478003a60 0x7fe48c0cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 -- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0c93c0 msgr2=0x7fe48c0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0c93c0 0x7fe48c0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe490b8e700 1 -- 172.21.15.22:0/3733032088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0cdcc0 con 0x7fe48c0cd850 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.139+0000 7fe491b90700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0c93c0 0x7fe48c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:55.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.140+0000 7fe490b8e700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 0x7fe48c0c8e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe47c007390 tx=0x7fe47c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.140+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c018030 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.140+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c00f8d0 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.140+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00fc90 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.140+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c0cfdd0 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.140+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c0ce270 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.141+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c0b18e0 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.141+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe47c01b070 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.141+0000 7fe4817fa700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe470066f30 0x7fe4700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.142+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe47c019070 con 0x7fe48c0cd850 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.142+0000 7fe49138f700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe470066f30 0x7fe4700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:55.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.142+0000 7fe49138f700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe470066f30 0x7fe4700693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4880091e0 tx=0x7fe48801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:55.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.146+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe47c051690 con 0x7fe48c0cd850 2023-10-08T00:24:55.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.383+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe48c04c3c0 con 0x7fe48c0cd850 2023-10-08T00:24:55.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.990+0000 7fe4817fa700 1 -- 172.21.15.22:0/3733032088 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe47c054cb0 con 0x7fe48c0cd850 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe470066f30 msgr2=0x7fe4700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe470066f30 0x7fe4700693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4880091e0 tx=0x7fe48801a000 comp rx=0 tx=0).stop 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 msgr2=0x7fe48c0c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 0x7fe48c0c8e80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe47c007390 tx=0x7fe47c001e50 comp rx=0 tx=0).stop 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 shutdown_connections 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe48c0c93c0 0x7fe48c0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe470066f30 0x7fe4700693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe478003a60 0x7fe48c0cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 --2- 172.21.15.22:0/3733032088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe48c0cd850 0x7fe48c0c8e80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:55.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 >> 172.21.15.22:0/3733032088 conn(0x7fe48c068e20 msgr2=0x7fe48c0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:55.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 shutdown_connections 2023-10-08T00:24:55.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:55.992+0000 7fe4935f3700 1 -- 172.21.15.22:0/3733032088 wait complete. 2023-10-08T00:24:56.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:24:56.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.131+0000 7faddff64700 1 Processor -- start 2023-10-08T00:24:56.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.131+0000 7faddff64700 1 -- start start 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.131+0000 7faddff64700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 0x7fadd815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddff64700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fadd8159c60 0x7fadd815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddff64700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd815a160 con 0x7fadd815db10 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddff64700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80d13a0 con 0x7fadd8159c60 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddff64700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815e140 con 0x7fadd8159890 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7fadde501700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fadd815db10 0x7fadd8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39748/0 (socket says 172.21.15.22:39748) 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7fadde501700 1 -- 172.21.15.22:0/4009046674 learned_addr learned my addr 172.21.15.22:0/4009046674 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:56.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7fadddd00700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 0x7fadd815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddd4ff700 1 --2- 172.21.15.22:0/4009046674 >> v2:172.21.15.192:3300/0 conn(0x7fadd8159c60 0x7fadd815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313510716 0 0) 0x7fadd815a160 con 0x7fadd815db10 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc0003570 con 0x7fadd815db10 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428252202 0 0) 0x7fadc0003570 con 0x7fadd815db10 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 msgr2=0x7fadd815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 0x7fadd815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 >> v2:172.21.15.192:3300/0 conn(0x7fadd8159c60 msgr2=0x7fadd815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 --2- 172.21.15.22:0/4009046674 >> v2:172.21.15.192:3300/0 conn(0x7fadd8159c60 0x7fadd815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd815a3d0 con 0x7fadd815db10 2023-10-08T00:24:56.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fadd0001470 con 0x7fadd815db10 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 >> v1:172.21.15.22:6789/0 conn(0x7fadd815db10 legacy=0x7fadd8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc0003a60 0x7fadc0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadc0004810 0x7fadc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 0x7fadc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80d13a0 con 0x7fadc0003a60 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd815e140 con 0x7fadc0004810 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc000ba60 con 0x7fadd8159890 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.132+0000 7fadddd00700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc0003a60 0x7fadc0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7faddd4ff700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadc0004810 0x7fadc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadde501700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 0x7fadc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadddd00700 1 -- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 msgr2=0x7fadc00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadddd00700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadd8159890 0x7fadc00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadddd00700 1 -- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadc0004810 msgr2=0x7fadc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadddd00700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadc0004810 0x7fadc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadddd00700 1 -- 172.21.15.22:0/4009046674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0003570 con 0x7fadc0003a60 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7fadddd00700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc0003a60 0x7fadc0003e70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e240 tx=0x7fadc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c969cbc35bed780 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800eaf0 con 0x7fadc0003a60 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800f040 con 0x7fadc0003a60 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7faddccfe700 1 -- 172.21.15.22:0/4009046674 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800eea0 con 0x7fadc0003a60 2023-10-08T00:24:56.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7faddff64700 1 -- 172.21.15.22:0/4009046674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc0003a60 msgr2=0x7fadc0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.133+0000 7faddff64700 1 --2- 172.21.15.22:0/4009046674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadc0003a60 0x7fadc0003e70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e240 tx=0x7fadc800b040 comp rx=0 tx=0).stop 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.134+0000 7fadde501700 1 -- 172.21.15.22:0/4009046674 reap_dead start 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.134+0000 7faddff64700 1 -- 172.21.15.22:0/4009046674 shutdown_connections 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.134+0000 7faddff64700 1 -- 172.21.15.22:0/4009046674 >> 172.21.15.22:0/4009046674 conn(0x7fadd8068e20 msgr2=0x7fadd80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.134+0000 7faddff64700 1 -- 172.21.15.22:0/4009046674 shutdown_connections 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.134+0000 7faddff64700 1 -- 172.21.15.22:0/4009046674 wait complete. 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 Processor -- start 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 -- start start 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadc0003a60 0x7fadd80b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 0x7fadd80b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadd81583e0 0x7fadd8158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8157810 con 0x7fadd80b46d0 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80b3630 con 0x7fadd81583e0 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.135+0000 7faddff64700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80b3910 con 0x7fadc0003a60 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 0x7fadd80b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 0x7fadd80b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37702/0 (socket says 172.21.15.22:37702) 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 -- 172.21.15.22:0/3678663519 learned_addr learned my addr 172.21.15.22:0/3678663519 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7fadde501700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadd81583e0 0x7fadd8158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7fadddd00700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadc0003a60 0x7fadd80b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 -- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadc0003a60 msgr2=0x7fadd80b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadc0003a60 0x7fadd80b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 -- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadd81583e0 msgr2=0x7fadd8158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadd81583e0 0x7fadd8158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 -- 172.21.15.22:0/3678663519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80b3bf0 con 0x7fadd80b46d0 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7fadddd00700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadc0003a60 0x7fadd80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddd4ff700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 0x7fadd80b4b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadcc011b40 tx=0x7fadcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00fa10 con 0x7fadd80b46d0 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc00fb70 con 0x7fadd80b46d0 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc014440 con 0x7fadd80b46d0 2023-10-08T00:24:56.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80b3ed0 con 0x7fadd80b46d0 2023-10-08T00:24:56.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.136+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80b6100 con 0x7fadd80b46d0 2023-10-08T00:24:56.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.137+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd80b4370 con 0x7fadd80b46d0 2023-10-08T00:24:56.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.138+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadcc014870 con 0x7fadd80b46d0 2023-10-08T00:24:56.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.138+0000 7fadd5ffb700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fadc4066f30 0x7fadc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.138+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fadcc018030 con 0x7fadd80b46d0 2023-10-08T00:24:56.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.139+0000 7fadddd00700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fadc4066f30 0x7fadc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.139+0000 7fadddd00700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fadc4066f30 0x7fadc40693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e240 tx=0x7fadc801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.142+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadcc052160 con 0x7fadd80b46d0 2023-10-08T00:24:56.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.383+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd804c3c0 con 0x7fadd80b46d0 2023-10-08T00:24:56.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.384+0000 7fadd5ffb700 1 -- 172.21.15.22:0/3678663519 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fadcc022090 con 0x7fadd80b46d0 2023-10-08T00:24:56.384 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:56.384 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fadc4066f30 msgr2=0x7fadc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fadc4066f30 0x7fadc40693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e240 tx=0x7fadc801a000 comp rx=0 tx=0).stop 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 msgr2=0x7fadd80b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 0x7fadd80b4b40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadcc011b40 tx=0x7fadcc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 shutdown_connections 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadd81583e0 0x7fadd8158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fadc4066f30 0x7fadc40693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fadc0003a60 0x7fadd80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 --2- 172.21.15.22:0/3678663519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadd80b46d0 0x7fadd80b4b40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 >> 172.21.15.22:0/3678663519 conn(0x7fadd8068e20 msgr2=0x7fadd8152c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:56.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 shutdown_connections 2023-10-08T00:24:56.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.386+0000 7faddff64700 1 -- 172.21.15.22:0/3678663519 wait complete. 2023-10-08T00:24:56.388 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:24:56.398 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:56.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.517+0000 7f294d4a5700 1 Processor -- start 2023-10-08T00:24:56.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.517+0000 7f294d4a5700 1 -- start start 2023-10-08T00:24:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294d4a5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2948159420 0x7f29480b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294d4a5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f29481597f0 0x7f29480b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294d4a5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29480b11d0 con 0x7f294815d230 2023-10-08T00:24:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294d4a5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480b14b0 con 0x7f2948159420 2023-10-08T00:24:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294d4a5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29480b1790 con 0x7f29481597f0 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f2947fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2948159420 0x7f29480b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294cca4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f294815d230 0x7f294815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39756/0 (socket says 172.21.15.22:39756) 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f294cca4700 1 -- 172.21.15.22:0/2047394250 learned_addr learned my addr 172.21.15.22:0/2047394250 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f2947fff700 1 -- 172.21.15.22:0/2047394250 >> v2:172.21.15.192:3300/0 conn(0x7f29481597f0 msgr2=0x7f29480b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f2947fff700 1 --2- 172.21.15.22:0/2047394250 >> v2:172.21.15.192:3300/0 conn(0x7f29481597f0 0x7f29480b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.518+0000 7f2947fff700 1 -- 172.21.15.22:0/2047394250 >> v1:172.21.15.22:6789/0 conn(0x7f294815d230 legacy=0x7f294815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f2947fff700 1 -- 172.21.15.22:0/2047394250 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480b1a70 con 0x7f2948159420 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f2946ffd700 1 -- 172.21.15.22:0/2047394250 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571115340 0 0) 0x7f29480b11d0 con 0x7f294815d230 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f2947fff700 1 --2- 172.21.15.22:0/2047394250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29480b5f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2948089750 tx=0x7f29300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284b46e52b0a59d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f2946ffd700 1 -- 172.21.15.22:0/2047394250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000b6b0 con 0x7f2948159420 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f2946ffd700 1 -- 172.21.15.22:0/2047394250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000b810 con 0x7f2948159420 2023-10-08T00:24:56.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f2946ffd700 1 -- 172.21.15.22:0/2047394250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000bbb0 con 0x7f2948159420 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 -- 172.21.15.22:0/2047394250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 msgr2=0x7f29480b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 --2- 172.21.15.22:0/2047394250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29480b5f40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2948089750 tx=0x7f29300091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 -- 172.21.15.22:0/2047394250 shutdown_connections 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 --2- 172.21.15.22:0/2047394250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29480b5f40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 --2- 172.21.15.22:0/2047394250 >> v2:172.21.15.192:3300/0 conn(0x7f29481597f0 0x7f29480b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 -- 172.21.15.22:0/2047394250 >> 172.21.15.22:0/2047394250 conn(0x7f29480d0660 msgr2=0x7f29480d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 -- 172.21.15.22:0/2047394250 shutdown_connections 2023-10-08T00:24:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.519+0000 7f294d4a5700 1 -- 172.21.15.22:0/2047394250 wait complete. 2023-10-08T00:24:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.520+0000 7f294d4a5700 1 Processor -- start 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 -- start start 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29481697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29481597f0 0x7f2948156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f294815d230 0x7f29480c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294816aa70 con 0x7f2948159420 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29481568c0 con 0x7f29481597f0 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.521+0000 7f294d4a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29480c7400 con 0x7f294815d230 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29481697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29481697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37710/0 (socket says 172.21.15.22:37710) 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 -- 172.21.15.22:0/1379266804 learned_addr learned my addr 172.21.15.22:0/1379266804 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 -- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f294815d230 msgr2=0x7f29480c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f294815d230 0x7f29480c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 -- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29481597f0 msgr2=0x7f2948156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29481597f0 0x7f2948156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 -- 172.21.15.22:0/1379266804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2930009420 con 0x7f2948159420 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f2947fff700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29481697c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f293000b0e0 tx=0x7f2930017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000bb90 con 0x7f2948159420 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930011420 con 0x7f2948159420 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2948169e60 con 0x7f2948159420 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29300117c0 con 0x7f2948159420 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.522+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294816a420 con 0x7f2948159420 2023-10-08T00:24:56.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.523+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294804c3c0 con 0x7f2948159420 2023-10-08T00:24:56.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.523+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2930011b30 con 0x7f2948159420 2023-10-08T00:24:56.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.524+0000 7f293ffff700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2928066f30 0x7f29280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.524+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2930085fb0 con 0x7f2948159420 2023-10-08T00:24:56.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.524+0000 7f29477fe700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2928066f30 0x7f29280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.525+0000 7f29477fe700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2928066f30 0x7f29280693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2938006fd0 tx=0x7f2938006db0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.528+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29300b75a0 con 0x7f2948159420 2023-10-08T00:24:56.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.723+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29480b1d50 con 0x7f2948159420 2023-10-08T00:24:56.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.723+0000 7f293ffff700 1 -- 172.21.15.22:0/1379266804 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2930053220 con 0x7f2948159420 2023-10-08T00:24:56.724 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:56.724 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:56.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.725+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2928066f30 msgr2=0x7f29280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.725+0000 7f294d4a5700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2928066f30 0x7f29280693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2938006fd0 tx=0x7f2938006db0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 msgr2=0x7f29481697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29481697c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f293000b0e0 tx=0x7f2930017000 comp rx=0 tx=0).stop 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 shutdown_connections 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2928066f30 0x7f29280693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f294815d230 0x7f29480c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2948159420 0x7f29481697c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 --2- 172.21.15.22:0/1379266804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29481597f0 0x7f2948156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 >> 172.21.15.22:0/1379266804 conn(0x7f29480d0660 msgr2=0x7f2948157110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 shutdown_connections 2023-10-08T00:24:56.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.726+0000 7f294d4a5700 1 -- 172.21.15.22:0/1379266804 wait complete. 2023-10-08T00:24:56.738 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:24:56.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:24:56.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.857+0000 7fc8de5e2700 1 Processor -- start 2023-10-08T00:24:56.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.858+0000 7fc8de5e2700 1 -- start start 2023-10-08T00:24:56.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.858+0000 7fc8de5e2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8d8156a60 0x7fc8d80ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.858+0000 7fc8de5e2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d8157e30 con 0x7fc8d8156690 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.858+0000 7fc8de5e2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d81578b0 con 0x7fc8d80af480 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.858+0000 7fc8de5e2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d806aa00 con 0x7fc8d8156a60 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.858+0000 7fc8d7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc8d8156690 0x7fc8d80c86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59778/0 (socket says 172.21.15.22:59778) 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d7fff700 1 -- 172.21.15.22:0/4254033469 learned_addr learned my addr 172.21.15.22:0/4254033469 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8dcb7f700 1 --2- 172.21.15.22:0/4254033469 >> v2:172.21.15.192:3300/0 conn(0x7fc8d8156a60 0x7fc8d80ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215162570 0 0) 0x7fc8d8157e30 con 0x7fc8d8156690 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c4003570 con 0x7fc8d8156690 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768799275 0 0) 0x7fc8c4003570 con 0x7fc8d8156690 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 >> v2:172.21.15.192:3300/0 conn(0x7fc8d8156a60 msgr2=0x7fc8d80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 --2- 172.21.15.22:0/4254033469 >> v2:172.21.15.192:3300/0 conn(0x7fc8d8156a60 0x7fc8d80ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 >> v1:172.21.15.192:6789/0 conn(0x7fc8d80af480 legacy=0x7fc8d806ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8157b50 con 0x7fc8d8156690 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fc8c0001470 con 0x7fc8d8156690 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 >> v1:172.21.15.22:6789/0 conn(0x7fc8d8156690 legacy=0x7fc8d80c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c4003a60 0x7fc8c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8c4004810 0x7fc8c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c40052e0 0x7fc8c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d806aa00 con 0x7fc8c4004810 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c400c2a0 con 0x7fc8c4003a60 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c400c460 con 0x7fc8c40052e0 2023-10-08T00:24:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8c4004810 0x7fc8c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d7fff700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c4003a60 0x7fc8c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8dcb7f700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c40052e0 0x7fc8c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d77fe700 1 -- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c40052e0 msgr2=0x7fc8c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.859+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c40052e0 0x7fc8c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d77fe700 1 -- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c4003a60 msgr2=0x7fc8c4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8c4003a60 0x7fc8c4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d77fe700 1 -- 172.21.15.22:0/4254033469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c4003570 con 0x7fc8c4004810 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8dcb7f700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c40052e0 0x7fc8c400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8dcb7f700 1 -- 172.21.15.22:0/4254033469 reap_dead start 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8c4004810 0x7fc8c4004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80018b0 tx=0x7fc8c8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ff229e2c79900e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8012420 con 0x7fc8c4004810 2023-10-08T00:24:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80125a0 con 0x7fc8c4004810 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8d6ffd700 1 -- 172.21.15.22:0/4254033469 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8012960 con 0x7fc8c4004810 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 -- 172.21.15.22:0/4254033469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8c4004810 msgr2=0x7fc8c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8c4004810 0x7fc8c4004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80018b0 tx=0x7fc8c8007d30 comp rx=0 tx=0).stop 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 -- 172.21.15.22:0/4254033469 shutdown_connections 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/4254033469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8c4004810 0x7fc8c4004c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 -- 172.21.15.22:0/4254033469 >> 172.21.15.22:0/4254033469 conn(0x7fc8d80c9870 msgr2=0x7fc8d80c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 -- 172.21.15.22:0/4254033469 shutdown_connections 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.860+0000 7fc8de5e2700 1 -- 172.21.15.22:0/4254033469 wait complete. 2023-10-08T00:24:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.861+0000 7fc8de5e2700 1 Processor -- start 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 -- start start 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c4004810 0x7fc8d8140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 0x7fc8d80b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d8068390 0x7fc8d8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8068d40 con 0x7fc8d80b1c40 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80c5570 con 0x7fc8d8068390 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8de5e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80c4f60 con 0x7fc8c4004810 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8d77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 0x7fc8d80b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8d77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 0x7fc8d80b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60086/0 (socket says 172.21.15.22:60086) 2023-10-08T00:24:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.862+0000 7fc8d77fe700 1 -- 172.21.15.22:0/1370352403 learned_addr learned my addr 172.21.15.22:0/1370352403 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d7fff700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c4004810 0x7fc8d8140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8dcb7f700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d8068390 0x7fc8d8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d77fe700 1 -- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c4004810 msgr2=0x7fc8d8140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c4004810 0x7fc8d8140a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d77fe700 1 -- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d8068390 msgr2=0x7fc8d8068800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d8068390 0x7fc8d8068800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d77fe700 1 -- 172.21.15.22:0/1370352403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80b2790 con 0x7fc8d80b1c40 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8d77fe700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 0x7fc8d80b20b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800c3f0 tx=0x7fc8c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8001200 con 0x7fc8d80b1c40 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800caf0 con 0x7fc8d80b1c40 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80c5200 con 0x7fc8d80b1c40 2023-10-08T00:24:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800ce70 con 0x7fc8d80b1c40 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.863+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d8140f40 con 0x7fc8d80b1c40 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.864+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d80c5700 con 0x7fc8d80b1c40 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.864+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8c801f620 con 0x7fc8d80b1c40 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.865+0000 7fc8cffff700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc8b8066f30 0x7fc8b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.865+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8c8085e40 con 0x7fc8d80b1c40 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.865+0000 7fc8d7fff700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc8b8066f30 0x7fc8b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.866+0000 7fc8d7fff700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc8b8066f30 0x7fc8b80693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0001ed0 tx=0x7fc8d80cccd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:56.869+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8c8053170 con 0x7fc8d80b1c40 2023-10-08T00:24:57.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.058+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8d8068d40 con 0x7fc8b8066f30 2023-10-08T00:24:57.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.066+0000 7fc8cffff700 1 -- 172.21.15.22:0/1370352403 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264635 (secure 0 0 0) 0x7fc8d8068d40 con 0x7fc8b8066f30 2023-10-08T00:24:57.070 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc8b8066f30 msgr2=0x7fc8b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc8b8066f30 0x7fc8b80693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0001ed0 tx=0x7fc8d80cccd0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 msgr2=0x7fc8d80b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 0x7fc8d80b20b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800c3f0 tx=0x7fc8c8015000 comp rx=0 tx=0).stop 2023-10-08T00:24:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 shutdown_connections 2023-10-08T00:24:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8d8068390 0x7fc8d8068800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc8b8066f30 0x7fc8b80693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc8c4004810 0x7fc8d8140a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 --2- 172.21.15.22:0/1370352403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8d80b1c40 0x7fc8d80b20b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 >> 172.21.15.22:0/1370352403 conn(0x7fc8d80c9870 msgr2=0x7fc8d8154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 shutdown_connections 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.070+0000 7fc8de5e2700 1 -- 172.21.15.22:0/1370352403 wait complete. 2023-10-08T00:24:57.073 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:24:57.082 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T00:24:56.383563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.432594"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987593+0000","last_change":"2023-10-08T00:24:52.980100+0000","last_active":"2023-10-08T00:24:52.987593+0000","last_peered":"2023-10-08T00:24:52.987593+0000","last_clean":"2023-10-08T00:24:52.987593+0000","last_became_active":"2023-10-08T00:24:52.979488+0000","last_became_peered":"2023-10-08T00:24:52.979488+0000","last_unstale":"2023-10-08T00:24:52.987593+0000","last_undegraded":"2023-10-08T00:24:52.987593+0000","last_fullsized":"2023-10-08T00:24:52.987593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984472+0000","last_change":"2023-10-08T00:24:52.980140+0000","last_active":"2023-10-08T00:24:52.984472+0000","last_peered":"2023-10-08T00:24:52.984472+0000","last_clean":"2023-10-08T00:24:52.984472+0000","last_became_active":"2023-10-08T00:24:52.979888+0000","last_became_peered":"2023-10-08T00:24:52.979888+0000","last_unstale":"2023-10-08T00:24:52.984472+0000","last_undegraded":"2023-10-08T00:24:52.984472+0000","last_fullsized":"2023-10-08T00:24:52.984472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977786+0000","last_change":"2023-10-08T00:24:52.970748+0000","last_active":"2023-10-08T00:24:52.977786+0000","last_peered":"2023-10-08T00:24:52.977786+0000","last_clean":"2023-10-08T00:24:52.977786+0000","last_became_active":"2023-10-08T00:24:52.970491+0000","last_became_peered":"2023-10-08T00:24:52.970491+0000","last_unstale":"2023-10-08T00:24:52.977786+0000","last_undegraded":"2023-10-08T00:24:52.977786+0000","last_fullsized":"2023-10-08T00:24:52.977786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:58:54.945526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988272+0000","last_change":"2023-10-08T00:24:52.983186+0000","last_active":"2023-10-08T00:24:52.988272+0000","last_peered":"2023-10-08T00:24:52.988272+0000","last_clean":"2023-10-08T00:24:52.988272+0000","last_became_active":"2023-10-08T00:24:52.982126+0000","last_became_peered":"2023-10-08T00:24:52.982126+0000","last_unstale":"2023-10-08T00:24:52.988272+0000","last_undegraded":"2023-10-08T00:24:52.988272+0000","last_fullsized":"2023-10-08T00:24:52.988272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985965+0000","last_change":"2023-10-08T00:24:52.979734+0000","last_active":"2023-10-08T00:24:52.985965+0000","last_peered":"2023-10-08T00:24:52.985965+0000","last_clean":"2023-10-08T00:24:52.985965+0000","last_became_active":"2023-10-08T00:24:52.979268+0000","last_became_peered":"2023-10-08T00:24:52.979268+0000","last_unstale":"2023-10-08T00:24:52.985965+0000","last_undegraded":"2023-10-08T00:24:52.985965+0000","last_fullsized":"2023-10-08T00:24:52.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:36:19.519679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985000+0000","last_change":"2023-10-08T00:24:52.981418+0000","last_active":"2023-10-08T00:24:52.985000+0000","last_peered":"2023-10-08T00:24:52.985000+0000","last_clean":"2023-10-08T00:24:52.985000+0000","last_became_active":"2023-10-08T00:24:52.980593+0000","last_became_peered":"2023-10-08T00:24:52.980593+0000","last_unstale":"2023-10-08T00:24:52.985000+0000","last_undegraded":"2023-10-08T00:24:52.985000+0000","last_fullsized":"2023-10-08T00:24:52.985000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985828+0000","last_change":"2023-10-08T00:24:52.981519+0000","last_active":"2023-10-08T00:24:52.985828+0000","last_peered":"2023-10-08T00:24:52.985828+0000","last_clean":"2023-10-08T00:24:52.985828+0000","last_became_active":"2023-10-08T00:24:52.981233+0000","last_became_peered":"2023-10-08T00:24:52.981233+0000","last_unstale":"2023-10-08T00:24:52.985828+0000","last_undegraded":"2023-10-08T00:24:52.985828+0000","last_fullsized":"2023-10-08T00:24:52.985828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992041+0000","last_change":"2023-10-08T00:24:52.987504+0000","last_active":"2023-10-08T00:24:52.992041+0000","last_peered":"2023-10-08T00:24:52.992041+0000","last_clean":"2023-10-08T00:24:52.992041+0000","last_became_active":"2023-10-08T00:24:52.987271+0000","last_became_peered":"2023-10-08T00:24:52.987271+0000","last_unstale":"2023-10-08T00:24:52.992041+0000","last_undegraded":"2023-10-08T00:24:52.992041+0000","last_fullsized":"2023-10-08T00:24:52.992041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991414+0000","last_change":"2023-10-08T00:24:52.984830+0000","last_active":"2023-10-08T00:24:52.991414+0000","last_peered":"2023-10-08T00:24:52.991414+0000","last_clean":"2023-10-08T00:24:52.991414+0000","last_became_active":"2023-10-08T00:24:52.984399+0000","last_became_peered":"2023-10-08T00:24:52.984399+0000","last_unstale":"2023-10-08T00:24:52.991414+0000","last_undegraded":"2023-10-08T00:24:52.991414+0000","last_fullsized":"2023-10-08T00:24:52.991414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990097+0000","last_change":"2023-10-08T00:24:52.982279+0000","last_active":"2023-10-08T00:24:52.990097+0000","last_peered":"2023-10-08T00:24:52.990097+0000","last_clean":"2023-10-08T00:24:52.990097+0000","last_became_active":"2023-10-08T00:24:52.981839+0000","last_became_peered":"2023-10-08T00:24:52.981839+0000","last_unstale":"2023-10-08T00:24:52.990097+0000","last_undegraded":"2023-10-08T00:24:52.990097+0000","last_fullsized":"2023-10-08T00:24:52.990097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990366+0000","last_change":"2023-10-08T00:24:52.985741+0000","last_active":"2023-10-08T00:24:52.990366+0000","last_peered":"2023-10-08T00:24:52.990366+0000","last_clean":"2023-10-08T00:24:52.990366+0000","last_became_active":"2023-10-08T00:24:52.985429+0000","last_became_peered":"2023-10-08T00:24:52.985429+0000","last_unstale":"2023-10-08T00:24:52.990366+0000","last_undegraded":"2023-10-08T00:24:52.990366+0000","last_fullsized":"2023-10-08T00:24:52.990366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988968+0000","last_change":"2023-10-08T00:24:52.978519+0000","last_active":"2023-10-08T00:24:52.988968+0000","last_peered":"2023-10-08T00:24:52.988968+0000","last_clean":"2023-10-08T00:24:52.988968+0000","last_became_active":"2023-10-08T00:24:52.977483+0000","last_became_peered":"2023-10-08T00:24:52.977483+0000","last_unstale":"2023-10-08T00:24:52.988968+0000","last_undegraded":"2023-10-08T00:24:52.988968+0000","last_fullsized":"2023-10-08T00:24:52.988968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:54.276268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992137+0000","last_change":"2023-10-08T00:24:52.987977+0000","last_active":"2023-10-08T00:24:52.992137+0000","last_peered":"2023-10-08T00:24:52.992137+0000","last_clean":"2023-10-08T00:24:52.992137+0000","last_became_active":"2023-10-08T00:24:52.987722+0000","last_became_peered":"2023-10-08T00:24:52.987722+0000","last_unstale":"2023-10-08T00:24:52.992137+0000","last_undegraded":"2023-10-08T00:24:52.992137+0000","last_fullsized":"2023-10-08T00:24:52.992137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986854+0000","last_change":"2023-10-08T00:24:52.978011+0000","last_active":"2023-10-08T00:24:52.986854+0000","last_peered":"2023-10-08T00:24:52.986854+0000","last_clean":"2023-10-08T00:24:52.986854+0000","last_became_active":"2023-10-08T00:24:52.977718+0000","last_became_peered":"2023-10-08T00:24:52.977718+0000","last_unstale":"2023-10-08T00:24:52.986854+0000","last_undegraded":"2023-10-08T00:24:52.986854+0000","last_fullsized":"2023-10-08T00:24:52.986854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983827+0000","last_change":"2023-10-08T00:24:52.977428+0000","last_active":"2023-10-08T00:24:52.983827+0000","last_peered":"2023-10-08T00:24:52.983827+0000","last_clean":"2023-10-08T00:24:52.983827+0000","last_became_active":"2023-10-08T00:24:52.977116+0000","last_became_peered":"2023-10-08T00:24:52.977116+0000","last_unstale":"2023-10-08T00:24:52.983827+0000","last_undegraded":"2023-10-08T00:24:52.983827+0000","last_fullsized":"2023-10-08T00:24:52.983827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991223+0000","last_change":"2023-10-08T00:24:52.988555+0000","last_active":"2023-10-08T00:24:52.991223+0000","last_peered":"2023-10-08T00:24:52.991223+0000","last_clean":"2023-10-08T00:24:52.991223+0000","last_became_active":"2023-10-08T00:24:52.988256+0000","last_became_peered":"2023-10-08T00:24:52.988256+0000","last_unstale":"2023-10-08T00:24:52.991223+0000","last_undegraded":"2023-10-08T00:24:52.991223+0000","last_fullsized":"2023-10-08T00:24:52.991223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984667+0000","last_change":"2023-10-08T00:24:52.980846+0000","last_active":"2023-10-08T00:24:52.984667+0000","last_peered":"2023-10-08T00:24:52.984667+0000","last_clean":"2023-10-08T00:24:52.984667+0000","last_became_active":"2023-10-08T00:24:52.980566+0000","last_became_peered":"2023-10-08T00:24:52.980566+0000","last_unstale":"2023-10-08T00:24:52.984667+0000","last_undegraded":"2023-10-08T00:24:52.984667+0000","last_fullsized":"2023-10-08T00:24:52.984667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983078+0000","last_change":"2023-10-08T00:24:52.976521+0000","last_active":"2023-10-08T00:24:52.983078+0000","last_peered":"2023-10-08T00:24:52.983078+0000","last_clean":"2023-10-08T00:24:52.983078+0000","last_became_active":"2023-10-08T00:24:52.976306+0000","last_became_peered":"2023-10-08T00:24:52.976306+0000","last_unstale":"2023-10-08T00:24:52.983078+0000","last_undegraded":"2023-10-08T00:24:52.983078+0000","last_fullsized":"2023-10-08T00:24:52.983078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987877+0000","last_change":"2023-10-08T00:24:52.980143+0000","last_active":"2023-10-08T00:24:52.987877+0000","last_peered":"2023-10-08T00:24:52.987877+0000","last_clean":"2023-10-08T00:24:52.987877+0000","last_became_active":"2023-10-08T00:24:52.979863+0000","last_became_peered":"2023-10-08T00:24:52.979863+0000","last_unstale":"2023-10-08T00:24:52.987877+0000","last_undegraded":"2023-10-08T00:24:52.987877+0000","last_fullsized":"2023-10-08T00:24:52.987877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:29.094765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992779+0000","last_change":"2023-10-08T00:24:51.970340+0000","last_active":"2023-10-08T00:24:52.992779+0000","last_peered":"2023-10-08T00:24:52.992779+0000","last_clean":"2023-10-08T00:24:52.992779+0000","last_became_active":"2023-10-08T00:24:51.970091+0000","last_became_peered":"2023-10-08T00:24:51.970091+0000","last_unstale":"2023-10-08T00:24:52.992779+0000","last_undegraded":"2023-10-08T00:24:52.992779+0000","last_fullsized":"2023-10-08T00:24:52.992779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:35.474566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991838+0000","last_change":"2023-10-08T00:24:52.978891+0000","last_active":"2023-10-08T00:24:52.991838+0000","last_peered":"2023-10-08T00:24:52.991838+0000","last_clean":"2023-10-08T00:24:52.991838+0000","last_became_active":"2023-10-08T00:24:52.978193+0000","last_became_peered":"2023-10-08T00:24:52.978193+0000","last_unstale":"2023-10-08T00:24:52.991838+0000","last_undegraded":"2023-10-08T00:24:52.991838+0000","last_fullsized":"2023-10-08T00:24:52.991838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992750+0000","last_change":"2023-10-08T00:24:51.975777+0000","last_active":"2023-10-08T00:24:52.992750+0000","last_peered":"2023-10-08T00:24:52.992750+0000","last_clean":"2023-10-08T00:24:52.992750+0000","last_became_active":"2023-10-08T00:24:51.975506+0000","last_became_peered":"2023-10-08T00:24:51.975506+0000","last_unstale":"2023-10-08T00:24:52.992750+0000","last_undegraded":"2023-10-08T00:24:52.992750+0000","last_fullsized":"2023-10-08T00:24:52.992750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987295+0000","last_change":"2023-10-08T00:24:52.980914+0000","last_active":"2023-10-08T00:24:52.987295+0000","last_peered":"2023-10-08T00:24:52.987295+0000","last_clean":"2023-10-08T00:24:52.987295+0000","last_became_active":"2023-10-08T00:24:52.980619+0000","last_became_peered":"2023-10-08T00:24:52.980619+0000","last_unstale":"2023-10-08T00:24:52.987295+0000","last_undegraded":"2023-10-08T00:24:52.987295+0000","last_fullsized":"2023-10-08T00:24:52.987295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991737+0000","last_change":"2023-10-08T00:24:51.971927+0000","last_active":"2023-10-08T00:24:52.991737+0000","last_peered":"2023-10-08T00:24:52.991737+0000","last_clean":"2023-10-08T00:24:52.991737+0000","last_became_active":"2023-10-08T00:24:51.971651+0000","last_became_peered":"2023-10-08T00:24:51.971651+0000","last_unstale":"2023-10-08T00:24:52.991737+0000","last_undegraded":"2023-10-08T00:24:52.991737+0000","last_fullsized":"2023-10-08T00:24:52.991737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:16.625598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984785+0000","last_change":"2023-10-08T00:24:52.981876+0000","last_active":"2023-10-08T00:24:52.984785+0000","last_peered":"2023-10-08T00:24:52.984785+0000","last_clean":"2023-10-08T00:24:52.984785+0000","last_became_active":"2023-10-08T00:24:52.981627+0000","last_became_peered":"2023-10-08T00:24:52.981627+0000","last_unstale":"2023-10-08T00:24:52.984785+0000","last_undegraded":"2023-10-08T00:24:52.984785+0000","last_fullsized":"2023-10-08T00:24:52.984785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991526+0000","last_change":"2023-10-08T00:24:51.974282+0000","last_active":"2023-10-08T00:24:52.991526+0000","last_peered":"2023-10-08T00:24:52.991526+0000","last_clean":"2023-10-08T00:24:52.991526+0000","last_became_active":"2023-10-08T00:24:51.973653+0000","last_became_peered":"2023-10-08T00:24:51.973653+0000","last_unstale":"2023-10-08T00:24:52.991526+0000","last_undegraded":"2023-10-08T00:24:52.991526+0000","last_fullsized":"2023-10-08T00:24:52.991526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989925+0000","last_change":"2023-10-08T00:24:52.984614+0000","last_active":"2023-10-08T00:24:52.989925+0000","last_peered":"2023-10-08T00:24:52.989925+0000","last_clean":"2023-10-08T00:24:52.989925+0000","last_became_active":"2023-10-08T00:24:52.984295+0000","last_became_peered":"2023-10-08T00:24:52.984295+0000","last_unstale":"2023-10-08T00:24:52.989925+0000","last_undegraded":"2023-10-08T00:24:52.989925+0000","last_fullsized":"2023-10-08T00:24:52.989925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.994140+0000","last_change":"2023-10-08T00:24:51.973991+0000","last_active":"2023-10-08T00:24:52.994140+0000","last_peered":"2023-10-08T00:24:52.994140+0000","last_clean":"2023-10-08T00:24:52.994140+0000","last_became_active":"2023-10-08T00:24:51.973771+0000","last_became_peered":"2023-10-08T00:24:51.973771+0000","last_unstale":"2023-10-08T00:24:52.994140+0000","last_undegraded":"2023-10-08T00:24:52.994140+0000","last_fullsized":"2023-10-08T00:24:52.994140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986683+0000","last_change":"2023-10-08T00:24:52.977312+0000","last_active":"2023-10-08T00:24:52.986683+0000","last_peered":"2023-10-08T00:24:52.986683+0000","last_clean":"2023-10-08T00:24:52.986683+0000","last_became_active":"2023-10-08T00:24:52.977056+0000","last_became_peered":"2023-10-08T00:24:52.977056+0000","last_unstale":"2023-10-08T00:24:52.986683+0000","last_undegraded":"2023-10-08T00:24:52.986683+0000","last_fullsized":"2023-10-08T00:24:52.986683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:42.211488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990236+0000","last_change":"2023-10-08T00:24:51.967116+0000","last_active":"2023-10-08T00:24:52.990236+0000","last_peered":"2023-10-08T00:24:52.990236+0000","last_clean":"2023-10-08T00:24:52.990236+0000","last_became_active":"2023-10-08T00:24:51.966840+0000","last_became_peered":"2023-10-08T00:24:51.966840+0000","last_unstale":"2023-10-08T00:24:52.990236+0000","last_undegraded":"2023-10-08T00:24:52.990236+0000","last_fullsized":"2023-10-08T00:24:52.990236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985387+0000","last_change":"2023-10-08T00:24:52.977803+0000","last_active":"2023-10-08T00:24:52.985387+0000","last_peered":"2023-10-08T00:24:52.985387+0000","last_clean":"2023-10-08T00:24:52.985387+0000","last_became_active":"2023-10-08T00:24:52.977087+0000","last_became_peered":"2023-10-08T00:24:52.977087+0000","last_unstale":"2023-10-08T00:24:52.985387+0000","last_undegraded":"2023-10-08T00:24:52.985387+0000","last_fullsized":"2023-10-08T00:24:52.985387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:57.537199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.966959+0000","last_change":"2023-10-08T00:24:51.969025+0000","last_active":"2023-10-08T00:24:52.966959+0000","last_peered":"2023-10-08T00:24:52.966959+0000","last_clean":"2023-10-08T00:24:52.966959+0000","last_became_active":"2023-10-08T00:24:51.968702+0000","last_became_peered":"2023-10-08T00:24:51.968702+0000","last_unstale":"2023-10-08T00:24:52.966959+0000","last_undegraded":"2023-10-08T00:24:52.966959+0000","last_fullsized":"2023-10-08T00:24:52.966959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.978409+0000","last_change":"2023-10-08T00:24:52.976159+0000","last_active":"2023-10-08T00:24:52.978409+0000","last_peered":"2023-10-08T00:24:52.978409+0000","last_clean":"2023-10-08T00:24:52.978409+0000","last_became_active":"2023-10-08T00:24:52.975536+0000","last_became_peered":"2023-10-08T00:24:52.975536+0000","last_unstale":"2023-10-08T00:24:52.978409+0000","last_undegraded":"2023-10-08T00:24:52.978409+0000","last_fullsized":"2023-10-08T00:24:52.978409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976877+0000","last_change":"2023-10-08T00:24:51.969405+0000","last_active":"2023-10-08T00:24:52.976877+0000","last_peered":"2023-10-08T00:24:52.976877+0000","last_clean":"2023-10-08T00:24:52.976877+0000","last_became_active":"2023-10-08T00:24:51.968440+0000","last_became_peered":"2023-10-08T00:24:51.968440+0000","last_unstale":"2023-10-08T00:24:52.976877+0000","last_undegraded":"2023-10-08T00:24:52.976877+0000","last_fullsized":"2023-10-08T00:24:52.976877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984498+0000","last_change":"2023-10-08T00:24:52.982102+0000","last_active":"2023-10-08T00:24:52.984498+0000","last_peered":"2023-10-08T00:24:52.984498+0000","last_clean":"2023-10-08T00:24:52.984498+0000","last_became_active":"2023-10-08T00:24:52.981842+0000","last_became_peered":"2023-10-08T00:24:52.981842+0000","last_unstale":"2023-10-08T00:24:52.984498+0000","last_undegraded":"2023-10-08T00:24:52.984498+0000","last_fullsized":"2023-10-08T00:24:52.984498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969031+0000","last_change":"2023-10-08T00:24:51.968433+0000","last_active":"2023-10-08T00:24:52.969031+0000","last_peered":"2023-10-08T00:24:52.969031+0000","last_clean":"2023-10-08T00:24:52.969031+0000","last_became_active":"2023-10-08T00:24:51.967679+0000","last_became_peered":"2023-10-08T00:24:51.967679+0000","last_unstale":"2023-10-08T00:24:52.969031+0000","last_undegraded":"2023-10-08T00:24:52.969031+0000","last_fullsized":"2023-10-08T00:24:52.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984774+0000","last_change":"2023-10-08T00:24:52.980963+0000","last_active":"2023-10-08T00:24:52.984774+0000","last_peered":"2023-10-08T00:24:52.984774+0000","last_clean":"2023-10-08T00:24:52.984774+0000","last_became_active":"2023-10-08T00:24:52.980687+0000","last_became_peered":"2023-10-08T00:24:52.980687+0000","last_unstale":"2023-10-08T00:24:52.984774+0000","last_undegraded":"2023-10-08T00:24:52.984774+0000","last_fullsized":"2023-10-08T00:24:52.984774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976476+0000","last_change":"2023-10-08T00:24:51.970567+0000","last_active":"2023-10-08T00:24:52.976476+0000","last_peered":"2023-10-08T00:24:52.976476+0000","last_clean":"2023-10-08T00:24:52.976476+0000","last_became_active":"2023-10-08T00:24:51.970311+0000","last_became_peered":"2023-10-08T00:24:51.970311+0000","last_unstale":"2023-10-08T00:24:52.976476+0000","last_undegraded":"2023-10-08T00:24:52.976476+0000","last_fullsized":"2023-10-08T00:24:52.976476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:43:53.665259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988302+0000","last_change":"2023-10-08T00:24:52.986368+0000","last_active":"2023-10-08T00:24:52.988302+0000","last_peered":"2023-10-08T00:24:52.988302+0000","last_clean":"2023-10-08T00:24:52.988302+0000","last_became_active":"2023-10-08T00:24:52.986130+0000","last_became_peered":"2023-10-08T00:24:52.986130+0000","last_unstale":"2023-10-08T00:24:52.988302+0000","last_undegraded":"2023-10-08T00:24:52.988302+0000","last_fullsized":"2023-10-08T00:24:52.988302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993145+0000","last_change":"2023-10-08T00:24:51.973262+0000","last_active":"2023-10-08T00:24:52.993145+0000","last_peered":"2023-10-08T00:24:52.993145+0000","last_clean":"2023-10-08T00:24:52.993145+0000","last_became_active":"2023-10-08T00:24:51.972999+0000","last_became_peered":"2023-10-08T00:24:51.972999+0000","last_unstale":"2023-10-08T00:24:52.993145+0000","last_undegraded":"2023-10-08T00:24:52.993145+0000","last_fullsized":"2023-10-08T00:24:52.993145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989532+0000","last_change":"2023-10-08T00:24:52.982031+0000","last_active":"2023-10-08T00:24:52.989532+0000","last_peered":"2023-10-08T00:24:52.989532+0000","last_clean":"2023-10-08T00:24:52.989532+0000","last_became_active":"2023-10-08T00:24:52.980819+0000","last_became_peered":"2023-10-08T00:24:52.980819+0000","last_unstale":"2023-10-08T00:24:52.989532+0000","last_undegraded":"2023-10-08T00:24:52.989532+0000","last_fullsized":"2023-10-08T00:24:52.989532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.997915+0000","last_change":"2023-10-08T00:24:51.968287+0000","last_active":"2023-10-08T00:24:52.997915+0000","last_peered":"2023-10-08T00:24:52.997915+0000","last_clean":"2023-10-08T00:24:52.997915+0000","last_became_active":"2023-10-08T00:24:51.967698+0000","last_became_peered":"2023-10-08T00:24:51.967698+0000","last_unstale":"2023-10-08T00:24:52.997915+0000","last_undegraded":"2023-10-08T00:24:52.997915+0000","last_fullsized":"2023-10-08T00:24:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990585+0000","last_change":"2023-10-08T00:24:52.983840+0000","last_active":"2023-10-08T00:24:52.990585+0000","last_peered":"2023-10-08T00:24:52.990585+0000","last_clean":"2023-10-08T00:24:52.990585+0000","last_became_active":"2023-10-08T00:24:52.983567+0000","last_became_peered":"2023-10-08T00:24:52.983567+0000","last_unstale":"2023-10-08T00:24:52.990585+0000","last_undegraded":"2023-10-08T00:24:52.990585+0000","last_fullsized":"2023-10-08T00:24:52.990585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:34:31.254296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990688+0000","last_change":"2023-10-08T00:24:51.971465+0000","last_active":"2023-10-08T00:24:52.990688+0000","last_peered":"2023-10-08T00:24:52.990688+0000","last_clean":"2023-10-08T00:24:52.990688+0000","last_became_active":"2023-10-08T00:24:51.971212+0000","last_became_peered":"2023-10-08T00:24:51.971212+0000","last_unstale":"2023-10-08T00:24:52.990688+0000","last_undegraded":"2023-10-08T00:24:52.990688+0000","last_fullsized":"2023-10-08T00:24:52.990688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:19.468028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986877+0000","last_change":"2023-10-08T00:24:52.981698+0000","last_active":"2023-10-08T00:24:52.986877+0000","last_peered":"2023-10-08T00:24:52.986877+0000","last_clean":"2023-10-08T00:24:52.986877+0000","last_became_active":"2023-10-08T00:24:52.981431+0000","last_became_peered":"2023-10-08T00:24:52.981431+0000","last_unstale":"2023-10-08T00:24:52.986877+0000","last_undegraded":"2023-10-08T00:24:52.986877+0000","last_fullsized":"2023-10-08T00:24:52.986877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970306+0000","last_change":"2023-10-08T00:24:51.972585+0000","last_active":"2023-10-08T00:24:52.970306+0000","last_peered":"2023-10-08T00:24:52.970306+0000","last_clean":"2023-10-08T00:24:52.970306+0000","last_became_active":"2023-10-08T00:24:51.972285+0000","last_became_peered":"2023-10-08T00:24:51.972285+0000","last_unstale":"2023-10-08T00:24:52.970306+0000","last_undegraded":"2023-10-08T00:24:52.970306+0000","last_fullsized":"2023-10-08T00:24:52.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991943+0000","last_change":"2023-10-08T00:24:52.990394+0000","last_active":"2023-10-08T00:24:52.991943+0000","last_peered":"2023-10-08T00:24:52.991943+0000","last_clean":"2023-10-08T00:24:52.991943+0000","last_became_active":"2023-10-08T00:24:52.990088+0000","last_became_peered":"2023-10-08T00:24:52.990088+0000","last_unstale":"2023-10-08T00:24:52.991943+0000","last_undegraded":"2023-10-08T00:24:52.991943+0000","last_fullsized":"2023-10-08T00:24:52.991943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968176+0000","last_change":"2023-10-08T00:24:51.965511+0000","last_active":"2023-10-08T00:24:52.968176+0000","last_peered":"2023-10-08T00:24:52.968176+0000","last_clean":"2023-10-08T00:24:52.968176+0000","last_became_active":"2023-10-08T00:24:51.965135+0000","last_became_peered":"2023-10-08T00:24:51.965135+0000","last_unstale":"2023-10-08T00:24:52.968176+0000","last_undegraded":"2023-10-08T00:24:52.968176+0000","last_fullsized":"2023-10-08T00:24:52.968176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989987+0000","last_change":"2023-10-08T00:24:52.979423+0000","last_active":"2023-10-08T00:24:52.989987+0000","last_peered":"2023-10-08T00:24:52.989987+0000","last_clean":"2023-10-08T00:24:52.989987+0000","last_became_active":"2023-10-08T00:24:52.979088+0000","last_became_peered":"2023-10-08T00:24:52.979088+0000","last_unstale":"2023-10-08T00:24:52.989987+0000","last_undegraded":"2023-10-08T00:24:52.989987+0000","last_fullsized":"2023-10-08T00:24:52.989987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992031+0000","last_change":"2023-10-08T00:24:51.971820+0000","last_active":"2023-10-08T00:24:52.992031+0000","last_peered":"2023-10-08T00:24:52.992031+0000","last_clean":"2023-10-08T00:24:52.992031+0000","last_became_active":"2023-10-08T00:24:51.971563+0000","last_became_peered":"2023-10-08T00:24:51.971563+0000","last_unstale":"2023-10-08T00:24:52.992031+0000","last_undegraded":"2023-10-08T00:24:52.992031+0000","last_fullsized":"2023-10-08T00:24:52.992031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991999+0000","last_change":"2023-10-08T00:24:52.990737+0000","last_active":"2023-10-08T00:24:52.991999+0000","last_peered":"2023-10-08T00:24:52.991999+0000","last_clean":"2023-10-08T00:24:52.991999+0000","last_became_active":"2023-10-08T00:24:52.990032+0000","last_became_peered":"2023-10-08T00:24:52.990032+0000","last_unstale":"2023-10-08T00:24:52.991999+0000","last_undegraded":"2023-10-08T00:24:52.991999+0000","last_fullsized":"2023-10-08T00:24:52.991999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991333+0000","last_change":"2023-10-08T00:24:51.964547+0000","last_active":"2023-10-08T00:24:52.991333+0000","last_peered":"2023-10-08T00:24:52.991333+0000","last_clean":"2023-10-08T00:24:52.991333+0000","last_became_active":"2023-10-08T00:24:51.963951+0000","last_became_peered":"2023-10-08T00:24:51.963951+0000","last_unstale":"2023-10-08T00:24:52.991333+0000","last_undegraded":"2023-10-08T00:24:52.991333+0000","last_fullsized":"2023-10-08T00:24:52.991333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:24.358934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991658+0000","last_change":"2023-10-08T00:24:52.987475+0000","last_active":"2023-10-08T00:24:52.991658+0000","last_peered":"2023-10-08T00:24:52.991658+0000","last_clean":"2023-10-08T00:24:52.991658+0000","last_became_active":"2023-10-08T00:24:52.987054+0000","last_became_peered":"2023-10-08T00:24:52.987054+0000","last_unstale":"2023-10-08T00:24:52.991658+0000","last_undegraded":"2023-10-08T00:24:52.991658+0000","last_fullsized":"2023-10-08T00:24:52.991658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970458+0000","last_change":"2023-10-08T00:24:51.971914+0000","last_active":"2023-10-08T00:24:52.970458+0000","last_peered":"2023-10-08T00:24:52.970458+0000","last_clean":"2023-10-08T00:24:52.970458+0000","last_became_active":"2023-10-08T00:24:51.971486+0000","last_became_peered":"2023-10-08T00:24:51.971486+0000","last_unstale":"2023-10-08T00:24:52.970458+0000","last_undegraded":"2023-10-08T00:24:52.970458+0000","last_fullsized":"2023-10-08T00:24:52.970458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996934+0000","last_change":"2023-10-08T00:24:52.995174+0000","last_active":"2023-10-08T00:24:52.996934+0000","last_peered":"2023-10-08T00:24:52.996934+0000","last_clean":"2023-10-08T00:24:52.996934+0000","last_became_active":"2023-10-08T00:24:52.994900+0000","last_became_peered":"2023-10-08T00:24:52.994900+0000","last_unstale":"2023-10-08T00:24:52.996934+0000","last_undegraded":"2023-10-08T00:24:52.996934+0000","last_fullsized":"2023-10-08T00:24:52.996934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970200+0000","last_change":"2023-10-08T00:24:51.969965+0000","last_active":"2023-10-08T00:24:52.970200+0000","last_peered":"2023-10-08T00:24:52.970200+0000","last_clean":"2023-10-08T00:24:52.970200+0000","last_became_active":"2023-10-08T00:24:51.969745+0000","last_became_peered":"2023-10-08T00:24:51.969745+0000","last_unstale":"2023-10-08T00:24:52.970200+0000","last_undegraded":"2023-10-08T00:24:52.970200+0000","last_fullsized":"2023-10-08T00:24:52.970200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.980067+0000","last_change":"2023-10-08T00:24:52.971665+0000","last_active":"2023-10-08T00:24:52.980067+0000","last_peered":"2023-10-08T00:24:52.980067+0000","last_clean":"2023-10-08T00:24:52.980067+0000","last_became_active":"2023-10-08T00:24:52.971399+0000","last_became_peered":"2023-10-08T00:24:52.971399+0000","last_unstale":"2023-10-08T00:24:52.980067+0000","last_undegraded":"2023-10-08T00:24:52.980067+0000","last_fullsized":"2023-10-08T00:24:52.980067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:40.259676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976303+0000","last_change":"2023-10-08T00:24:52.975047+0000","last_active":"2023-10-08T00:24:52.976303+0000","last_peered":"2023-10-08T00:24:52.976303+0000","last_clean":"2023-10-08T00:24:52.976303+0000","last_became_active":"2023-10-08T00:24:52.974783+0000","last_became_peered":"2023-10-08T00:24:52.974783+0000","last_unstale":"2023-10-08T00:24:52.976303+0000","last_undegraded":"2023-10-08T00:24:52.976303+0000","last_fullsized":"2023-10-08T00:24:52.976303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968751+0000","last_change":"2023-10-08T00:24:51.970680+0000","last_active":"2023-10-08T00:24:52.968751+0000","last_peered":"2023-10-08T00:24:52.968751+0000","last_clean":"2023-10-08T00:24:52.968751+0000","last_became_active":"2023-10-08T00:24:51.970251+0000","last_became_peered":"2023-10-08T00:24:51.970251+0000","last_unstale":"2023-10-08T00:24:52.968751+0000","last_undegraded":"2023-10-08T00:24:52.968751+0000","last_fullsized":"2023-10-08T00:24:52.968751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992113+0000","last_change":"2023-10-08T00:24:52.987527+0000","last_active":"2023-10-08T00:24:52.992113+0000","last_peered":"2023-10-08T00:24:52.992113+0000","last_clean":"2023-10-08T00:24:52.992113+0000","last_became_active":"2023-10-08T00:24:52.987201+0000","last_became_peered":"2023-10-08T00:24:52.987201+0000","last_unstale":"2023-10-08T00:24:52.992113+0000","last_undegraded":"2023-10-08T00:24:52.992113+0000","last_fullsized":"2023-10-08T00:24:52.992113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969155+0000","last_change":"2023-10-08T00:24:51.966501+0000","last_active":"2023-10-08T00:24:52.969155+0000","last_peered":"2023-10-08T00:24:52.969155+0000","last_clean":"2023-10-08T00:24:52.969155+0000","last_became_active":"2023-10-08T00:24:51.966163+0000","last_became_peered":"2023-10-08T00:24:51.966163+0000","last_unstale":"2023-10-08T00:24:52.969155+0000","last_undegraded":"2023-10-08T00:24:52.969155+0000","last_fullsized":"2023-10-08T00:24:52.969155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972967+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:24:52.972967+0000","last_peered":"2023-10-08T00:24:52.972967+0000","last_clean":"2023-10-08T00:24:52.972967+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:24:52.972967+0000","last_undegraded":"2023-10-08T00:24:52.972967+0000","last_fullsized":"2023-10-08T00:24:52.972967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987231+0000","last_change":"2023-10-08T00:24:52.977356+0000","last_active":"2023-10-08T00:24:52.987231+0000","last_peered":"2023-10-08T00:24:52.987231+0000","last_clean":"2023-10-08T00:24:52.987231+0000","last_became_active":"2023-10-08T00:24:52.977065+0000","last_became_peered":"2023-10-08T00:24:52.977065+0000","last_unstale":"2023-10-08T00:24:52.987231+0000","last_undegraded":"2023-10-08T00:24:52.987231+0000","last_fullsized":"2023-10-08T00:24:52.987231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971755+0000","last_change":"2023-10-08T00:24:51.972788+0000","last_active":"2023-10-08T00:24:52.971755+0000","last_peered":"2023-10-08T00:24:52.971755+0000","last_clean":"2023-10-08T00:24:52.971755+0000","last_became_active":"2023-10-08T00:24:51.972199+0000","last_became_peered":"2023-10-08T00:24:51.972199+0000","last_unstale":"2023-10-08T00:24:52.971755+0000","last_undegraded":"2023-10-08T00:24:52.971755+0000","last_fullsized":"2023-10-08T00:24:52.971755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972287+0000","last_change":"2023-10-08T00:24:51.975555+0000","last_active":"2023-10-08T00:24:52.972287+0000","last_peered":"2023-10-08T00:24:52.972287+0000","last_clean":"2023-10-08T00:24:52.972287+0000","last_became_active":"2023-10-08T00:24:51.975251+0000","last_became_peered":"2023-10-08T00:24:51.975251+0000","last_unstale":"2023-10-08T00:24:52.972287+0000","last_undegraded":"2023-10-08T00:24:52.972287+0000","last_fullsized":"2023-10-08T00:24:52.972287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984419+0000","last_change":"2023-10-08T00:24:52.978989+0000","last_active":"2023-10-08T00:24:52.984419+0000","last_peered":"2023-10-08T00:24:52.984419+0000","last_clean":"2023-10-08T00:24:52.984419+0000","last_became_active":"2023-10-08T00:24:52.978749+0000","last_became_peered":"2023-10-08T00:24:52.978749+0000","last_unstale":"2023-10-08T00:24:52.984419+0000","last_undegraded":"2023-10-08T00:24:52.984419+0000","last_fullsized":"2023-10-08T00:24:52.984419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971543+0000","last_change":"2023-10-08T00:24:51.972820+0000","last_active":"2023-10-08T00:24:52.971543+0000","last_peered":"2023-10-08T00:24:52.971543+0000","last_clean":"2023-10-08T00:24:52.971543+0000","last_became_active":"2023-10-08T00:24:51.972559+0000","last_became_peered":"2023-10-08T00:24:51.972559+0000","last_unstale":"2023-10-08T00:24:52.971543+0000","last_undegraded":"2023-10-08T00:24:52.971543+0000","last_fullsized":"2023-10-08T00:24:52.971543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992662+0000","last_change":"2023-10-08T00:24:52.989566+0000","last_active":"2023-10-08T00:24:52.992662+0000","last_peered":"2023-10-08T00:24:52.992662+0000","last_clean":"2023-10-08T00:24:52.992662+0000","last_became_active":"2023-10-08T00:24:52.989274+0000","last_became_peered":"2023-10-08T00:24:52.989274+0000","last_unstale":"2023-10-08T00:24:52.992662+0000","last_undegraded":"2023-10-08T00:24:52.992662+0000","last_fullsized":"2023-10-08T00:24:52.992662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992104+0000","last_change":"2023-10-08T00:24:51.968679+0000","last_active":"2023-10-08T00:24:52.992104+0000","last_peered":"2023-10-08T00:24:52.992104+0000","last_clean":"2023-10-08T00:24:52.992104+0000","last_became_active":"2023-10-08T00:24:51.967961+0000","last_became_peered":"2023-10-08T00:24:51.967961+0000","last_unstale":"2023-10-08T00:24:52.992104+0000","last_undegraded":"2023-10-08T00:24:52.992104+0000","last_fullsized":"2023-10-08T00:24:52.992104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985358+0000","last_change":"2023-10-08T00:24:52.977980+0000","last_active":"2023-10-08T00:24:52.985358+0000","last_peered":"2023-10-08T00:24:52.985358+0000","last_clean":"2023-10-08T00:24:52.985358+0000","last_became_active":"2023-10-08T00:24:52.977672+0000","last_became_peered":"2023-10-08T00:24:52.977672+0000","last_unstale":"2023-10-08T00:24:52.985358+0000","last_undegraded":"2023-10-08T00:24:52.985358+0000","last_fullsized":"2023-10-08T00:24:52.985358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970997+0000","last_change":"2023-10-08T00:24:51.972959+0000","last_active":"2023-10-08T00:24:52.970997+0000","last_peered":"2023-10-08T00:24:52.970997+0000","last_clean":"2023-10-08T00:24:52.970997+0000","last_became_active":"2023-10-08T00:24:51.972532+0000","last_became_peered":"2023-10-08T00:24:51.972532+0000","last_unstale":"2023-10-08T00:24:52.970997+0000","last_undegraded":"2023-10-08T00:24:52.970997+0000","last_fullsized":"2023-10-08T00:24:52.970997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.385304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.973482+0000","last_change":"2023-10-08T00:24:52.971403+0000","last_active":"2023-10-08T00:24:52.973482+0000","last_peered":"2023-10-08T00:24:52.973482+0000","last_clean":"2023-10-08T00:24:52.973482+0000","last_became_active":"2023-10-08T00:24:52.971015+0000","last_became_peered":"2023-10-08T00:24:52.971015+0000","last_unstale":"2023-10-08T00:24:52.973482+0000","last_undegraded":"2023-10-08T00:24:52.973482+0000","last_fullsized":"2023-10-08T00:24:52.973482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:39.620318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970036+0000","last_change":"2023-10-08T00:24:51.972990+0000","last_active":"2023-10-08T00:24:52.970036+0000","last_peered":"2023-10-08T00:24:52.970036+0000","last_clean":"2023-10-08T00:24:52.970036+0000","last_became_active":"2023-10-08T00:24:51.972120+0000","last_became_peered":"2023-10-08T00:24:51.972120+0000","last_unstale":"2023-10-08T00:24:52.970036+0000","last_undegraded":"2023-10-08T00:24:52.970036+0000","last_fullsized":"2023-10-08T00:24:52.970036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992020+0000","last_change":"2023-10-08T00:24:52.986965+0000","last_active":"2023-10-08T00:24:52.992020+0000","last_peered":"2023-10-08T00:24:52.992020+0000","last_clean":"2023-10-08T00:24:52.992020+0000","last_became_active":"2023-10-08T00:24:52.981949+0000","last_became_peered":"2023-10-08T00:24:52.981949+0000","last_unstale":"2023-10-08T00:24:52.992020+0000","last_undegraded":"2023-10-08T00:24:52.992020+0000","last_fullsized":"2023-10-08T00:24:52.992020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971126+0000","last_change":"2023-10-08T00:24:51.970488+0000","last_active":"2023-10-08T00:24:52.971126+0000","last_peered":"2023-10-08T00:24:52.971126+0000","last_clean":"2023-10-08T00:24:52.971126+0000","last_became_active":"2023-10-08T00:24:51.970231+0000","last_became_peered":"2023-10-08T00:24:51.970231+0000","last_unstale":"2023-10-08T00:24:52.971126+0000","last_undegraded":"2023-10-08T00:24:52.971126+0000","last_fullsized":"2023-10-08T00:24:52.971126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979310+0000","last_change":"2023-10-08T00:24:52.975874+0000","last_active":"2023-10-08T00:24:52.979310+0000","last_peered":"2023-10-08T00:24:52.979310+0000","last_clean":"2023-10-08T00:24:52.979310+0000","last_became_active":"2023-10-08T00:24:52.975494+0000","last_became_peered":"2023-10-08T00:24:52.975494+0000","last_unstale":"2023-10-08T00:24:52.979310+0000","last_undegraded":"2023-10-08T00:24:52.979310+0000","last_fullsized":"2023-10-08T00:24:52.979310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991514+0000","last_change":"2023-10-08T00:24:51.973894+0000","last_active":"2023-10-08T00:24:52.991514+0000","last_peered":"2023-10-08T00:24:52.991514+0000","last_clean":"2023-10-08T00:24:52.991514+0000","last_became_active":"2023-10-08T00:24:51.973619+0000","last_became_peered":"2023-10-08T00:24:51.973619+0000","last_unstale":"2023-10-08T00:24:52.991514+0000","last_undegraded":"2023-10-08T00:24:52.991514+0000","last_fullsized":"2023-10-08T00:24:52.991514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979160+0000","last_change":"2023-10-08T00:24:52.975531+0000","last_active":"2023-10-08T00:24:52.979160+0000","last_peered":"2023-10-08T00:24:52.979160+0000","last_clean":"2023-10-08T00:24:52.979160+0000","last_became_active":"2023-10-08T00:24:52.974442+0000","last_became_peered":"2023-10-08T00:24:52.974442+0000","last_unstale":"2023-10-08T00:24:52.979160+0000","last_undegraded":"2023-10-08T00:24:52.979160+0000","last_fullsized":"2023-10-08T00:24:52.979160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969018+0000","last_change":"2023-10-08T00:24:51.972849+0000","last_active":"2023-10-08T00:24:52.969018+0000","last_peered":"2023-10-08T00:24:52.969018+0000","last_clean":"2023-10-08T00:24:52.969018+0000","last_became_active":"2023-10-08T00:24:51.972584+0000","last_became_peered":"2023-10-08T00:24:51.972584+0000","last_unstale":"2023-10-08T00:24:52.969018+0000","last_undegraded":"2023-10-08T00:24:52.969018+0000","last_fullsized":"2023-10-08T00:24:52.969018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991780+0000","last_change":"2023-10-08T00:24:52.987901+0000","last_active":"2023-10-08T00:24:52.991780+0000","last_peered":"2023-10-08T00:24:52.991780+0000","last_clean":"2023-10-08T00:24:52.991780+0000","last_became_active":"2023-10-08T00:24:52.987650+0000","last_became_peered":"2023-10-08T00:24:52.987650+0000","last_unstale":"2023-10-08T00:24:52.991780+0000","last_undegraded":"2023-10-08T00:24:52.991780+0000","last_fullsized":"2023-10-08T00:24:52.991780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992854+0000","last_change":"2023-10-08T00:24:51.970706+0000","last_active":"2023-10-08T00:24:52.992854+0000","last_peered":"2023-10-08T00:24:52.992854+0000","last_clean":"2023-10-08T00:24:52.992854+0000","last_became_active":"2023-10-08T00:24:51.969854+0000","last_became_peered":"2023-10-08T00:24:51.969854+0000","last_unstale":"2023-10-08T00:24:52.992854+0000","last_undegraded":"2023-10-08T00:24:52.992854+0000","last_fullsized":"2023-10-08T00:24:52.992854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990618+0000","last_change":"2023-10-08T00:24:52.983945+0000","last_active":"2023-10-08T00:24:52.990618+0000","last_peered":"2023-10-08T00:24:52.990618+0000","last_clean":"2023-10-08T00:24:52.990618+0000","last_became_active":"2023-10-08T00:24:52.983668+0000","last_became_peered":"2023-10-08T00:24:52.983668+0000","last_unstale":"2023-10-08T00:24:52.990618+0000","last_undegraded":"2023-10-08T00:24:52.990618+0000","last_fullsized":"2023-10-08T00:24:52.990618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993949+0000","last_change":"2023-10-08T00:24:51.970895+0000","last_active":"2023-10-08T00:24:52.993949+0000","last_peered":"2023-10-08T00:24:52.993949+0000","last_clean":"2023-10-08T00:24:52.993949+0000","last_became_active":"2023-10-08T00:24:51.970245+0000","last_became_peered":"2023-10-08T00:24:51.970245+0000","last_unstale":"2023-10-08T00:24:52.993949+0000","last_undegraded":"2023-10-08T00:24:52.993949+0000","last_fullsized":"2023-10-08T00:24:52.993949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993961+0000","last_change":"2023-10-08T00:24:52.991574+0000","last_active":"2023-10-08T00:24:52.993961+0000","last_peered":"2023-10-08T00:24:52.993961+0000","last_clean":"2023-10-08T00:24:52.993961+0000","last_became_active":"2023-10-08T00:24:52.990396+0000","last_became_peered":"2023-10-08T00:24:52.990396+0000","last_unstale":"2023-10-08T00:24:52.993961+0000","last_undegraded":"2023-10-08T00:24:52.993961+0000","last_fullsized":"2023-10-08T00:24:52.993961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989966+0000","last_change":"2023-10-08T00:24:52.979422+0000","last_active":"2023-10-08T00:24:52.989966+0000","last_peered":"2023-10-08T00:24:52.989966+0000","last_clean":"2023-10-08T00:24:52.989966+0000","last_became_active":"2023-10-08T00:24:52.979146+0000","last_became_peered":"2023-10-08T00:24:52.979146+0000","last_unstale":"2023-10-08T00:24:52.989966+0000","last_undegraded":"2023-10-08T00:24:52.989966+0000","last_fullsized":"2023-10-08T00:24:52.989966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986972+0000","last_change":"2023-10-08T00:24:52.986197+0000","last_active":"2023-10-08T00:24:52.986972+0000","last_peered":"2023-10-08T00:24:52.986972+0000","last_clean":"2023-10-08T00:24:52.986972+0000","last_became_active":"2023-10-08T00:24:52.985947+0000","last_became_peered":"2023-10-08T00:24:52.985947+0000","last_unstale":"2023-10-08T00:24:52.986972+0000","last_undegraded":"2023-10-08T00:24:52.986972+0000","last_fullsized":"2023-10-08T00:24:52.986972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:47.389930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984505+0000","last_change":"2023-10-08T00:24:52.980865+0000","last_active":"2023-10-08T00:24:52.984505+0000","last_peered":"2023-10-08T00:24:52.984505+0000","last_clean":"2023-10-08T00:24:52.984505+0000","last_became_active":"2023-10-08T00:24:52.980251+0000","last_became_peered":"2023-10-08T00:24:52.980251+0000","last_unstale":"2023-10-08T00:24:52.984505+0000","last_undegraded":"2023-10-08T00:24:52.984505+0000","last_fullsized":"2023-10-08T00:24:52.984505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986453+0000","last_change":"2023-10-08T00:24:52.985277+0000","last_active":"2023-10-08T00:24:52.986453+0000","last_peered":"2023-10-08T00:24:52.986453+0000","last_clean":"2023-10-08T00:24:52.986453+0000","last_became_active":"2023-10-08T00:24:52.981814+0000","last_became_peered":"2023-10-08T00:24:52.981814+0000","last_unstale":"2023-10-08T00:24:52.986453+0000","last_undegraded":"2023-10-08T00:24:52.986453+0000","last_fullsized":"2023-10-08T00:24:52.986453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981430+0000","last_change":"2023-10-08T00:24:52.975549+0000","last_active":"2023-10-08T00:24:52.981430+0000","last_peered":"2023-10-08T00:24:52.981430+0000","last_clean":"2023-10-08T00:24:52.981430+0000","last_became_active":"2023-10-08T00:24:52.975298+0000","last_became_peered":"2023-10-08T00:24:52.975298+0000","last_unstale":"2023-10-08T00:24:52.981430+0000","last_undegraded":"2023-10-08T00:24:52.981430+0000","last_fullsized":"2023-10-08T00:24:52.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984523+0000","last_change":"2023-10-08T00:24:52.978921+0000","last_active":"2023-10-08T00:24:52.984523+0000","last_peered":"2023-10-08T00:24:52.984523+0000","last_clean":"2023-10-08T00:24:52.984523+0000","last_became_active":"2023-10-08T00:24:52.978633+0000","last_became_peered":"2023-10-08T00:24:52.978633+0000","last_unstale":"2023-10-08T00:24:52.984523+0000","last_undegraded":"2023-10-08T00:24:52.984523+0000","last_fullsized":"2023-10-08T00:24:52.984523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990230+0000","last_change":"2023-10-08T00:24:52.985282+0000","last_active":"2023-10-08T00:24:52.990230+0000","last_peered":"2023-10-08T00:24:52.990230+0000","last_clean":"2023-10-08T00:24:52.990230+0000","last_became_active":"2023-10-08T00:24:52.985016+0000","last_became_peered":"2023-10-08T00:24:52.985016+0000","last_unstale":"2023-10-08T00:24:52.990230+0000","last_undegraded":"2023-10-08T00:24:52.990230+0000","last_fullsized":"2023-10-08T00:24:52.990230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977747+0000","last_change":"2023-10-08T00:24:52.974937+0000","last_active":"2023-10-08T00:24:52.977747+0000","last_peered":"2023-10-08T00:24:52.977747+0000","last_clean":"2023-10-08T00:24:52.977747+0000","last_became_active":"2023-10-08T00:24:52.974647+0000","last_became_peered":"2023-10-08T00:24:52.974647+0000","last_unstale":"2023-10-08T00:24:52.977747+0000","last_undegraded":"2023-10-08T00:24:52.977747+0000","last_fullsized":"2023-10-08T00:24:52.977747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996943+0000","last_change":"2023-10-08T00:24:52.995257+0000","last_active":"2023-10-08T00:24:52.996943+0000","last_peered":"2023-10-08T00:24:52.996943+0000","last_clean":"2023-10-08T00:24:52.996943+0000","last_became_active":"2023-10-08T00:24:52.994863+0000","last_became_peered":"2023-10-08T00:24:52.994863+0000","last_unstale":"2023-10-08T00:24:52.996943+0000","last_undegraded":"2023-10-08T00:24:52.996943+0000","last_fullsized":"2023-10-08T00:24:52.996943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981376+0000","last_change":"2023-10-08T00:24:52.976107+0000","last_active":"2023-10-08T00:24:52.981376+0000","last_peered":"2023-10-08T00:24:52.981376+0000","last_clean":"2023-10-08T00:24:52.981376+0000","last_became_active":"2023-10-08T00:24:52.975835+0000","last_became_peered":"2023-10-08T00:24:52.975835+0000","last_unstale":"2023-10-08T00:24:52.981376+0000","last_undegraded":"2023-10-08T00:24:52.981376+0000","last_fullsized":"2023-10-08T00:24:52.981376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985392+0000","last_change":"2023-10-08T00:24:52.982480+0000","last_active":"2023-10-08T00:24:52.985392+0000","last_peered":"2023-10-08T00:24:52.985392+0000","last_clean":"2023-10-08T00:24:52.985392+0000","last_became_active":"2023-10-08T00:24:52.981391+0000","last_became_peered":"2023-10-08T00:24:52.981391+0000","last_unstale":"2023-10-08T00:24:52.985392+0000","last_undegraded":"2023-10-08T00:24:52.985392+0000","last_fullsized":"2023-10-08T00:24:52.985392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986425+0000","last_change":"2023-10-08T00:24:52.982575+0000","last_active":"2023-10-08T00:24:52.986425+0000","last_peered":"2023-10-08T00:24:52.986425+0000","last_clean":"2023-10-08T00:24:52.986425+0000","last_became_active":"2023-10-08T00:24:52.982206+0000","last_became_peered":"2023-10-08T00:24:52.982206+0000","last_unstale":"2023-10-08T00:24:52.986425+0000","last_undegraded":"2023-10-08T00:24:52.986425+0000","last_fullsized":"2023-10-08T00:24:52.986425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.975941+0000","last_change":"2023-10-08T00:24:52.975079+0000","last_active":"2023-10-08T00:24:52.975941+0000","last_peered":"2023-10-08T00:24:52.975941+0000","last_clean":"2023-10-08T00:24:52.975941+0000","last_became_active":"2023-10-08T00:24:52.974531+0000","last_became_peered":"2023-10-08T00:24:52.974531+0000","last_unstale":"2023-10-08T00:24:52.975941+0000","last_undegraded":"2023-10-08T00:24:52.975941+0000","last_fullsized":"2023-10-08T00:24:52.975941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:24:57.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:24:57.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.241+0000 7f750b59e700 1 Processor -- start 2023-10-08T00:24:57.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.241+0000 7f750b59e700 1 -- start start 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f750c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750b59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c0b2980 con 0x7f750c1597f0 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750b59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c15dbb0 con 0x7f750c159420 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0b11d0 con 0x7f750c15d230 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f7509d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f750c1597f0 0x7f750c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59780/0 (socket says 172.21.15.22:59780) 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f7509d9b700 1 -- 172.21.15.22:0/1173201933 learned_addr learned my addr 172.21.15.22:0/1173201933 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750ad9d700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f750c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480707650 0 0) 0x7f750c0b2980 con 0x7f750c1597f0 2023-10-08T00:24:57.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.242+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f8003570 con 0x7f750c1597f0 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441874335 0 0) 0x7f74f8003570 con 0x7f750c1597f0 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 msgr2=0x7f750c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f750c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 >> v1:172.21.15.192:6789/0 conn(0x7f750c159420 legacy=0x7f750c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0b14b0 con 0x7f750c1597f0 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f74f4001470 con 0x7f750c1597f0 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 >> v1:172.21.15.22:6789/0 conn(0x7f750c1597f0 legacy=0x7f750c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74f8003a90 0x7f74f8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f74f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8004d50 0x7f74f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0b11d0 con 0x7f74f8004d50 2023-10-08T00:24:57.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f800bb70 con 0x7f74f8003a90 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f800bd30 con 0x7f750c15d230 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8004d50 0x7f74f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f7509d9b700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f74f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750a59c700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74f8003a90 0x7f74f8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 -- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 msgr2=0x7f74f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f74f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 -- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74f8003a90 msgr2=0x7f74f8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74f8003a90 0x7f74f8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 -- 172.21.15.22:0/1173201933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8003570 con 0x7f74f8004d50 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f7509d9b700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f750c15d230 0x7f74f8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750ad9d700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8004d50 0x7f74f80051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00e210 tx=0x7f74fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851b2bd3e14a39b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:57.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00eac0 con 0x7f74f8004d50 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc00f040 con 0x7f74f8004d50 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.243+0000 7f750959a700 1 -- 172.21.15.22:0/1173201933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00ee70 con 0x7f74f8004d50 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750b59e700 1 -- 172.21.15.22:0/1173201933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8004d50 msgr2=0x7f74f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750b59e700 1 --2- 172.21.15.22:0/1173201933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74f8004d50 0x7f74f80051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00e210 tx=0x7f74fc00b040 comp rx=0 tx=0).stop 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750ad9d700 1 -- 172.21.15.22:0/1173201933 reap_dead start 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750b59e700 1 -- 172.21.15.22:0/1173201933 shutdown_connections 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750b59e700 1 -- 172.21.15.22:0/1173201933 >> 172.21.15.22:0/1173201933 conn(0x7f750c0d0660 msgr2=0x7f750c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750b59e700 1 -- 172.21.15.22:0/1173201933 shutdown_connections 2023-10-08T00:24:57.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.244+0000 7f750b59e700 1 -- 172.21.15.22:0/1173201933 wait complete. 2023-10-08T00:24:57.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.245+0000 7f750b59e700 1 Processor -- start 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.245+0000 7f750b59e700 1 -- start start 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74f8004d50 0x7f750c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f750c157040 0x7f750c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 0x7f750c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750b59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c15c5b0 con 0x7f750c15bb70 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0c5a30 con 0x7f750c157040 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c15bff0 con 0x7f74f8004d50 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 0x7f750c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 0x7f750c0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60108/0 (socket says 172.21.15.22:60108) 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 -- 172.21.15.22:0/3927093618 learned_addr learned my addr 172.21.15.22:0/3927093618 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:57.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750a59c700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74f8004d50 0x7f750c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f7509d9b700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f750c157040 0x7f750c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 -- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74f8004d50 msgr2=0x7f750c156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74f8004d50 0x7f750c156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 -- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f750c157040 msgr2=0x7f750c15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f750c157040 0x7f750c15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 -- 172.21.15.22:0/3927093618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c15c2d0 con 0x7f750c15bb70 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.246+0000 7f750ad9d700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 0x7f750c0c7e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00e800 tx=0x7f74fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:57.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.247+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc01d630 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.247+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc01d7f0 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.247+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc01dbb0 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.247+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c0c56c0 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.247+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c0c83a0 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.248+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c0c5bc0 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.248+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74fc003050 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.248+0000 7f75027fc700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f74ec066f30 0x7f74ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.249+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f74fc085720 con 0x7f750c15bb70 2023-10-08T00:24:57.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.249+0000 7f750a59c700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f74ec066f30 0x7f74ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.249+0000 7f750a59c700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f74ec066f30 0x7f74ec0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:57.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.253+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74fc052990 con 0x7f750c15bb70 2023-10-08T00:24:57.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.441+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f750c04c3c0 con 0x7f74ec066f30 2023-10-08T00:24:57.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.448+0000 7f75027fc700 1 -- 172.21.15.22:0/3927093618 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264635 (secure 0 0 0) 0x7f750c04c3c0 con 0x7f74ec066f30 2023-10-08T00:24:57.452 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.451+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f74ec066f30 msgr2=0x7f74ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.451+0000 7f750b59e700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f74ec066f30 0x7f74ec0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504009040 comp rx=0 tx=0).stop 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.451+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 msgr2=0x7f750c0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.451+0000 7f750b59e700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 0x7f750c0c7e60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74fc00e800 tx=0x7f74fc01a000 comp rx=0 tx=0).stop 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 shutdown_connections 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f750c15bb70 0x7f750c0c7e60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f74ec066f30 0x7f74ec0693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74f8004d50 0x7f750c156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 --2- 172.21.15.22:0/3927093618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f750c157040 0x7f750c15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 >> 172.21.15.22:0/3927093618 conn(0x7f750c0d0660 msgr2=0x7f750c0b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:57.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 shutdown_connections 2023-10-08T00:24:57.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.452+0000 7f750b59e700 1 -- 172.21.15.22:0/3927093618 wait complete. 2023-10-08T00:24:57.455 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:24:57.464 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-08T00:24:56.383563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.432594"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987593+0000","last_change":"2023-10-08T00:24:52.980100+0000","last_active":"2023-10-08T00:24:52.987593+0000","last_peered":"2023-10-08T00:24:52.987593+0000","last_clean":"2023-10-08T00:24:52.987593+0000","last_became_active":"2023-10-08T00:24:52.979488+0000","last_became_peered":"2023-10-08T00:24:52.979488+0000","last_unstale":"2023-10-08T00:24:52.987593+0000","last_undegraded":"2023-10-08T00:24:52.987593+0000","last_fullsized":"2023-10-08T00:24:52.987593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984472+0000","last_change":"2023-10-08T00:24:52.980140+0000","last_active":"2023-10-08T00:24:52.984472+0000","last_peered":"2023-10-08T00:24:52.984472+0000","last_clean":"2023-10-08T00:24:52.984472+0000","last_became_active":"2023-10-08T00:24:52.979888+0000","last_became_peered":"2023-10-08T00:24:52.979888+0000","last_unstale":"2023-10-08T00:24:52.984472+0000","last_undegraded":"2023-10-08T00:24:52.984472+0000","last_fullsized":"2023-10-08T00:24:52.984472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977786+0000","last_change":"2023-10-08T00:24:52.970748+0000","last_active":"2023-10-08T00:24:52.977786+0000","last_peered":"2023-10-08T00:24:52.977786+0000","last_clean":"2023-10-08T00:24:52.977786+0000","last_became_active":"2023-10-08T00:24:52.970491+0000","last_became_peered":"2023-10-08T00:24:52.970491+0000","last_unstale":"2023-10-08T00:24:52.977786+0000","last_undegraded":"2023-10-08T00:24:52.977786+0000","last_fullsized":"2023-10-08T00:24:52.977786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:58:54.945526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988272+0000","last_change":"2023-10-08T00:24:52.983186+0000","last_active":"2023-10-08T00:24:52.988272+0000","last_peered":"2023-10-08T00:24:52.988272+0000","last_clean":"2023-10-08T00:24:52.988272+0000","last_became_active":"2023-10-08T00:24:52.982126+0000","last_became_peered":"2023-10-08T00:24:52.982126+0000","last_unstale":"2023-10-08T00:24:52.988272+0000","last_undegraded":"2023-10-08T00:24:52.988272+0000","last_fullsized":"2023-10-08T00:24:52.988272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985965+0000","last_change":"2023-10-08T00:24:52.979734+0000","last_active":"2023-10-08T00:24:52.985965+0000","last_peered":"2023-10-08T00:24:52.985965+0000","last_clean":"2023-10-08T00:24:52.985965+0000","last_became_active":"2023-10-08T00:24:52.979268+0000","last_became_peered":"2023-10-08T00:24:52.979268+0000","last_unstale":"2023-10-08T00:24:52.985965+0000","last_undegraded":"2023-10-08T00:24:52.985965+0000","last_fullsized":"2023-10-08T00:24:52.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:36:19.519679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985000+0000","last_change":"2023-10-08T00:24:52.981418+0000","last_active":"2023-10-08T00:24:52.985000+0000","last_peered":"2023-10-08T00:24:52.985000+0000","last_clean":"2023-10-08T00:24:52.985000+0000","last_became_active":"2023-10-08T00:24:52.980593+0000","last_became_peered":"2023-10-08T00:24:52.980593+0000","last_unstale":"2023-10-08T00:24:52.985000+0000","last_undegraded":"2023-10-08T00:24:52.985000+0000","last_fullsized":"2023-10-08T00:24:52.985000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985828+0000","last_change":"2023-10-08T00:24:52.981519+0000","last_active":"2023-10-08T00:24:52.985828+0000","last_peered":"2023-10-08T00:24:52.985828+0000","last_clean":"2023-10-08T00:24:52.985828+0000","last_became_active":"2023-10-08T00:24:52.981233+0000","last_became_peered":"2023-10-08T00:24:52.981233+0000","last_unstale":"2023-10-08T00:24:52.985828+0000","last_undegraded":"2023-10-08T00:24:52.985828+0000","last_fullsized":"2023-10-08T00:24:52.985828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992041+0000","last_change":"2023-10-08T00:24:52.987504+0000","last_active":"2023-10-08T00:24:52.992041+0000","last_peered":"2023-10-08T00:24:52.992041+0000","last_clean":"2023-10-08T00:24:52.992041+0000","last_became_active":"2023-10-08T00:24:52.987271+0000","last_became_peered":"2023-10-08T00:24:52.987271+0000","last_unstale":"2023-10-08T00:24:52.992041+0000","last_undegraded":"2023-10-08T00:24:52.992041+0000","last_fullsized":"2023-10-08T00:24:52.992041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991414+0000","last_change":"2023-10-08T00:24:52.984830+0000","last_active":"2023-10-08T00:24:52.991414+0000","last_peered":"2023-10-08T00:24:52.991414+0000","last_clean":"2023-10-08T00:24:52.991414+0000","last_became_active":"2023-10-08T00:24:52.984399+0000","last_became_peered":"2023-10-08T00:24:52.984399+0000","last_unstale":"2023-10-08T00:24:52.991414+0000","last_undegraded":"2023-10-08T00:24:52.991414+0000","last_fullsized":"2023-10-08T00:24:52.991414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990097+0000","last_change":"2023-10-08T00:24:52.982279+0000","last_active":"2023-10-08T00:24:52.990097+0000","last_peered":"2023-10-08T00:24:52.990097+0000","last_clean":"2023-10-08T00:24:52.990097+0000","last_became_active":"2023-10-08T00:24:52.981839+0000","last_became_peered":"2023-10-08T00:24:52.981839+0000","last_unstale":"2023-10-08T00:24:52.990097+0000","last_undegraded":"2023-10-08T00:24:52.990097+0000","last_fullsized":"2023-10-08T00:24:52.990097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990366+0000","last_change":"2023-10-08T00:24:52.985741+0000","last_active":"2023-10-08T00:24:52.990366+0000","last_peered":"2023-10-08T00:24:52.990366+0000","last_clean":"2023-10-08T00:24:52.990366+0000","last_became_active":"2023-10-08T00:24:52.985429+0000","last_became_peered":"2023-10-08T00:24:52.985429+0000","last_unstale":"2023-10-08T00:24:52.990366+0000","last_undegraded":"2023-10-08T00:24:52.990366+0000","last_fullsized":"2023-10-08T00:24:52.990366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988968+0000","last_change":"2023-10-08T00:24:52.978519+0000","last_active":"2023-10-08T00:24:52.988968+0000","last_peered":"2023-10-08T00:24:52.988968+0000","last_clean":"2023-10-08T00:24:52.988968+0000","last_became_active":"2023-10-08T00:24:52.977483+0000","last_became_peered":"2023-10-08T00:24:52.977483+0000","last_unstale":"2023-10-08T00:24:52.988968+0000","last_undegraded":"2023-10-08T00:24:52.988968+0000","last_fullsized":"2023-10-08T00:24:52.988968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:54.276268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992137+0000","last_change":"2023-10-08T00:24:52.987977+0000","last_active":"2023-10-08T00:24:52.992137+0000","last_peered":"2023-10-08T00:24:52.992137+0000","last_clean":"2023-10-08T00:24:52.992137+0000","last_became_active":"2023-10-08T00:24:52.987722+0000","last_became_peered":"2023-10-08T00:24:52.987722+0000","last_unstale":"2023-10-08T00:24:52.992137+0000","last_undegraded":"2023-10-08T00:24:52.992137+0000","last_fullsized":"2023-10-08T00:24:52.992137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986854+0000","last_change":"2023-10-08T00:24:52.978011+0000","last_active":"2023-10-08T00:24:52.986854+0000","last_peered":"2023-10-08T00:24:52.986854+0000","last_clean":"2023-10-08T00:24:52.986854+0000","last_became_active":"2023-10-08T00:24:52.977718+0000","last_became_peered":"2023-10-08T00:24:52.977718+0000","last_unstale":"2023-10-08T00:24:52.986854+0000","last_undegraded":"2023-10-08T00:24:52.986854+0000","last_fullsized":"2023-10-08T00:24:52.986854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983827+0000","last_change":"2023-10-08T00:24:52.977428+0000","last_active":"2023-10-08T00:24:52.983827+0000","last_peered":"2023-10-08T00:24:52.983827+0000","last_clean":"2023-10-08T00:24:52.983827+0000","last_became_active":"2023-10-08T00:24:52.977116+0000","last_became_peered":"2023-10-08T00:24:52.977116+0000","last_unstale":"2023-10-08T00:24:52.983827+0000","last_undegraded":"2023-10-08T00:24:52.983827+0000","last_fullsized":"2023-10-08T00:24:52.983827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991223+0000","last_change":"2023-10-08T00:24:52.988555+0000","last_active":"2023-10-08T00:24:52.991223+0000","last_peered":"2023-10-08T00:24:52.991223+0000","last_clean":"2023-10-08T00:24:52.991223+0000","last_became_active":"2023-10-08T00:24:52.988256+0000","last_became_peered":"2023-10-08T00:24:52.988256+0000","last_unstale":"2023-10-08T00:24:52.991223+0000","last_undegraded":"2023-10-08T00:24:52.991223+0000","last_fullsized":"2023-10-08T00:24:52.991223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984667+0000","last_change":"2023-10-08T00:24:52.980846+0000","last_active":"2023-10-08T00:24:52.984667+0000","last_peered":"2023-10-08T00:24:52.984667+0000","last_clean":"2023-10-08T00:24:52.984667+0000","last_became_active":"2023-10-08T00:24:52.980566+0000","last_became_peered":"2023-10-08T00:24:52.980566+0000","last_unstale":"2023-10-08T00:24:52.984667+0000","last_undegraded":"2023-10-08T00:24:52.984667+0000","last_fullsized":"2023-10-08T00:24:52.984667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983078+0000","last_change":"2023-10-08T00:24:52.976521+0000","last_active":"2023-10-08T00:24:52.983078+0000","last_peered":"2023-10-08T00:24:52.983078+0000","last_clean":"2023-10-08T00:24:52.983078+0000","last_became_active":"2023-10-08T00:24:52.976306+0000","last_became_peered":"2023-10-08T00:24:52.976306+0000","last_unstale":"2023-10-08T00:24:52.983078+0000","last_undegraded":"2023-10-08T00:24:52.983078+0000","last_fullsized":"2023-10-08T00:24:52.983078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987877+0000","last_change":"2023-10-08T00:24:52.980143+0000","last_active":"2023-10-08T00:24:52.987877+0000","last_peered":"2023-10-08T00:24:52.987877+0000","last_clean":"2023-10-08T00:24:52.987877+0000","last_became_active":"2023-10-08T00:24:52.979863+0000","last_became_peered":"2023-10-08T00:24:52.979863+0000","last_unstale":"2023-10-08T00:24:52.987877+0000","last_undegraded":"2023-10-08T00:24:52.987877+0000","last_fullsized":"2023-10-08T00:24:52.987877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:29.094765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992779+0000","last_change":"2023-10-08T00:24:51.970340+0000","last_active":"2023-10-08T00:24:52.992779+0000","last_peered":"2023-10-08T00:24:52.992779+0000","last_clean":"2023-10-08T00:24:52.992779+0000","last_became_active":"2023-10-08T00:24:51.970091+0000","last_became_peered":"2023-10-08T00:24:51.970091+0000","last_unstale":"2023-10-08T00:24:52.992779+0000","last_undegraded":"2023-10-08T00:24:52.992779+0000","last_fullsized":"2023-10-08T00:24:52.992779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:35.474566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991838+0000","last_change":"2023-10-08T00:24:52.978891+0000","last_active":"2023-10-08T00:24:52.991838+0000","last_peered":"2023-10-08T00:24:52.991838+0000","last_clean":"2023-10-08T00:24:52.991838+0000","last_became_active":"2023-10-08T00:24:52.978193+0000","last_became_peered":"2023-10-08T00:24:52.978193+0000","last_unstale":"2023-10-08T00:24:52.991838+0000","last_undegraded":"2023-10-08T00:24:52.991838+0000","last_fullsized":"2023-10-08T00:24:52.991838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992750+0000","last_change":"2023-10-08T00:24:51.975777+0000","last_active":"2023-10-08T00:24:52.992750+0000","last_peered":"2023-10-08T00:24:52.992750+0000","last_clean":"2023-10-08T00:24:52.992750+0000","last_became_active":"2023-10-08T00:24:51.975506+0000","last_became_peered":"2023-10-08T00:24:51.975506+0000","last_unstale":"2023-10-08T00:24:52.992750+0000","last_undegraded":"2023-10-08T00:24:52.992750+0000","last_fullsized":"2023-10-08T00:24:52.992750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987295+0000","last_change":"2023-10-08T00:24:52.980914+0000","last_active":"2023-10-08T00:24:52.987295+0000","last_peered":"2023-10-08T00:24:52.987295+0000","last_clean":"2023-10-08T00:24:52.987295+0000","last_became_active":"2023-10-08T00:24:52.980619+0000","last_became_peered":"2023-10-08T00:24:52.980619+0000","last_unstale":"2023-10-08T00:24:52.987295+0000","last_undegraded":"2023-10-08T00:24:52.987295+0000","last_fullsized":"2023-10-08T00:24:52.987295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991737+0000","last_change":"2023-10-08T00:24:51.971927+0000","last_active":"2023-10-08T00:24:52.991737+0000","last_peered":"2023-10-08T00:24:52.991737+0000","last_clean":"2023-10-08T00:24:52.991737+0000","last_became_active":"2023-10-08T00:24:51.971651+0000","last_became_peered":"2023-10-08T00:24:51.971651+0000","last_unstale":"2023-10-08T00:24:52.991737+0000","last_undegraded":"2023-10-08T00:24:52.991737+0000","last_fullsized":"2023-10-08T00:24:52.991737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:16.625598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984785+0000","last_change":"2023-10-08T00:24:52.981876+0000","last_active":"2023-10-08T00:24:52.984785+0000","last_peered":"2023-10-08T00:24:52.984785+0000","last_clean":"2023-10-08T00:24:52.984785+0000","last_became_active":"2023-10-08T00:24:52.981627+0000","last_became_peered":"2023-10-08T00:24:52.981627+0000","last_unstale":"2023-10-08T00:24:52.984785+0000","last_undegraded":"2023-10-08T00:24:52.984785+0000","last_fullsized":"2023-10-08T00:24:52.984785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991526+0000","last_change":"2023-10-08T00:24:51.974282+0000","last_active":"2023-10-08T00:24:52.991526+0000","last_peered":"2023-10-08T00:24:52.991526+0000","last_clean":"2023-10-08T00:24:52.991526+0000","last_became_active":"2023-10-08T00:24:51.973653+0000","last_became_peered":"2023-10-08T00:24:51.973653+0000","last_unstale":"2023-10-08T00:24:52.991526+0000","last_undegraded":"2023-10-08T00:24:52.991526+0000","last_fullsized":"2023-10-08T00:24:52.991526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989925+0000","last_change":"2023-10-08T00:24:52.984614+0000","last_active":"2023-10-08T00:24:52.989925+0000","last_peered":"2023-10-08T00:24:52.989925+0000","last_clean":"2023-10-08T00:24:52.989925+0000","last_became_active":"2023-10-08T00:24:52.984295+0000","last_became_peered":"2023-10-08T00:24:52.984295+0000","last_unstale":"2023-10-08T00:24:52.989925+0000","last_undegraded":"2023-10-08T00:24:52.989925+0000","last_fullsized":"2023-10-08T00:24:52.989925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.994140+0000","last_change":"2023-10-08T00:24:51.973991+0000","last_active":"2023-10-08T00:24:52.994140+0000","last_peered":"2023-10-08T00:24:52.994140+0000","last_clean":"2023-10-08T00:24:52.994140+0000","last_became_active":"2023-10-08T00:24:51.973771+0000","last_became_peered":"2023-10-08T00:24:51.973771+0000","last_unstale":"2023-10-08T00:24:52.994140+0000","last_undegraded":"2023-10-08T00:24:52.994140+0000","last_fullsized":"2023-10-08T00:24:52.994140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986683+0000","last_change":"2023-10-08T00:24:52.977312+0000","last_active":"2023-10-08T00:24:52.986683+0000","last_peered":"2023-10-08T00:24:52.986683+0000","last_clean":"2023-10-08T00:24:52.986683+0000","last_became_active":"2023-10-08T00:24:52.977056+0000","last_became_peered":"2023-10-08T00:24:52.977056+0000","last_unstale":"2023-10-08T00:24:52.986683+0000","last_undegraded":"2023-10-08T00:24:52.986683+0000","last_fullsized":"2023-10-08T00:24:52.986683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:42.211488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990236+0000","last_change":"2023-10-08T00:24:51.967116+0000","last_active":"2023-10-08T00:24:52.990236+0000","last_peered":"2023-10-08T00:24:52.990236+0000","last_clean":"2023-10-08T00:24:52.990236+0000","last_became_active":"2023-10-08T00:24:51.966840+0000","last_became_peered":"2023-10-08T00:24:51.966840+0000","last_unstale":"2023-10-08T00:24:52.990236+0000","last_undegraded":"2023-10-08T00:24:52.990236+0000","last_fullsized":"2023-10-08T00:24:52.990236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985387+0000","last_change":"2023-10-08T00:24:52.977803+0000","last_active":"2023-10-08T00:24:52.985387+0000","last_peered":"2023-10-08T00:24:52.985387+0000","last_clean":"2023-10-08T00:24:52.985387+0000","last_became_active":"2023-10-08T00:24:52.977087+0000","last_became_peered":"2023-10-08T00:24:52.977087+0000","last_unstale":"2023-10-08T00:24:52.985387+0000","last_undegraded":"2023-10-08T00:24:52.985387+0000","last_fullsized":"2023-10-08T00:24:52.985387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:57.537199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.966959+0000","last_change":"2023-10-08T00:24:51.969025+0000","last_active":"2023-10-08T00:24:52.966959+0000","last_peered":"2023-10-08T00:24:52.966959+0000","last_clean":"2023-10-08T00:24:52.966959+0000","last_became_active":"2023-10-08T00:24:51.968702+0000","last_became_peered":"2023-10-08T00:24:51.968702+0000","last_unstale":"2023-10-08T00:24:52.966959+0000","last_undegraded":"2023-10-08T00:24:52.966959+0000","last_fullsized":"2023-10-08T00:24:52.966959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.978409+0000","last_change":"2023-10-08T00:24:52.976159+0000","last_active":"2023-10-08T00:24:52.978409+0000","last_peered":"2023-10-08T00:24:52.978409+0000","last_clean":"2023-10-08T00:24:52.978409+0000","last_became_active":"2023-10-08T00:24:52.975536+0000","last_became_peered":"2023-10-08T00:24:52.975536+0000","last_unstale":"2023-10-08T00:24:52.978409+0000","last_undegraded":"2023-10-08T00:24:52.978409+0000","last_fullsized":"2023-10-08T00:24:52.978409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976877+0000","last_change":"2023-10-08T00:24:51.969405+0000","last_active":"2023-10-08T00:24:52.976877+0000","last_peered":"2023-10-08T00:24:52.976877+0000","last_clean":"2023-10-08T00:24:52.976877+0000","last_became_active":"2023-10-08T00:24:51.968440+0000","last_became_peered":"2023-10-08T00:24:51.968440+0000","last_unstale":"2023-10-08T00:24:52.976877+0000","last_undegraded":"2023-10-08T00:24:52.976877+0000","last_fullsized":"2023-10-08T00:24:52.976877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984498+0000","last_change":"2023-10-08T00:24:52.982102+0000","last_active":"2023-10-08T00:24:52.984498+0000","last_peered":"2023-10-08T00:24:52.984498+0000","last_clean":"2023-10-08T00:24:52.984498+0000","last_became_active":"2023-10-08T00:24:52.981842+0000","last_became_peered":"2023-10-08T00:24:52.981842+0000","last_unstale":"2023-10-08T00:24:52.984498+0000","last_undegraded":"2023-10-08T00:24:52.984498+0000","last_fullsized":"2023-10-08T00:24:52.984498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969031+0000","last_change":"2023-10-08T00:24:51.968433+0000","last_active":"2023-10-08T00:24:52.969031+0000","last_peered":"2023-10-08T00:24:52.969031+0000","last_clean":"2023-10-08T00:24:52.969031+0000","last_became_active":"2023-10-08T00:24:51.967679+0000","last_became_peered":"2023-10-08T00:24:51.967679+0000","last_unstale":"2023-10-08T00:24:52.969031+0000","last_undegraded":"2023-10-08T00:24:52.969031+0000","last_fullsized":"2023-10-08T00:24:52.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984774+0000","last_change":"2023-10-08T00:24:52.980963+0000","last_active":"2023-10-08T00:24:52.984774+0000","last_peered":"2023-10-08T00:24:52.984774+0000","last_clean":"2023-10-08T00:24:52.984774+0000","last_became_active":"2023-10-08T00:24:52.980687+0000","last_became_peered":"2023-10-08T00:24:52.980687+0000","last_unstale":"2023-10-08T00:24:52.984774+0000","last_undegraded":"2023-10-08T00:24:52.984774+0000","last_fullsized":"2023-10-08T00:24:52.984774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976476+0000","last_change":"2023-10-08T00:24:51.970567+0000","last_active":"2023-10-08T00:24:52.976476+0000","last_peered":"2023-10-08T00:24:52.976476+0000","last_clean":"2023-10-08T00:24:52.976476+0000","last_became_active":"2023-10-08T00:24:51.970311+0000","last_became_peered":"2023-10-08T00:24:51.970311+0000","last_unstale":"2023-10-08T00:24:52.976476+0000","last_undegraded":"2023-10-08T00:24:52.976476+0000","last_fullsized":"2023-10-08T00:24:52.976476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:43:53.665259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988302+0000","last_change":"2023-10-08T00:24:52.986368+0000","last_active":"2023-10-08T00:24:52.988302+0000","last_peered":"2023-10-08T00:24:52.988302+0000","last_clean":"2023-10-08T00:24:52.988302+0000","last_became_active":"2023-10-08T00:24:52.986130+0000","last_became_peered":"2023-10-08T00:24:52.986130+0000","last_unstale":"2023-10-08T00:24:52.988302+0000","last_undegraded":"2023-10-08T00:24:52.988302+0000","last_fullsized":"2023-10-08T00:24:52.988302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993145+0000","last_change":"2023-10-08T00:24:51.973262+0000","last_active":"2023-10-08T00:24:52.993145+0000","last_peered":"2023-10-08T00:24:52.993145+0000","last_clean":"2023-10-08T00:24:52.993145+0000","last_became_active":"2023-10-08T00:24:51.972999+0000","last_became_peered":"2023-10-08T00:24:51.972999+0000","last_unstale":"2023-10-08T00:24:52.993145+0000","last_undegraded":"2023-10-08T00:24:52.993145+0000","last_fullsized":"2023-10-08T00:24:52.993145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989532+0000","last_change":"2023-10-08T00:24:52.982031+0000","last_active":"2023-10-08T00:24:52.989532+0000","last_peered":"2023-10-08T00:24:52.989532+0000","last_clean":"2023-10-08T00:24:52.989532+0000","last_became_active":"2023-10-08T00:24:52.980819+0000","last_became_peered":"2023-10-08T00:24:52.980819+0000","last_unstale":"2023-10-08T00:24:52.989532+0000","last_undegraded":"2023-10-08T00:24:52.989532+0000","last_fullsized":"2023-10-08T00:24:52.989532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.997915+0000","last_change":"2023-10-08T00:24:51.968287+0000","last_active":"2023-10-08T00:24:52.997915+0000","last_peered":"2023-10-08T00:24:52.997915+0000","last_clean":"2023-10-08T00:24:52.997915+0000","last_became_active":"2023-10-08T00:24:51.967698+0000","last_became_peered":"2023-10-08T00:24:51.967698+0000","last_unstale":"2023-10-08T00:24:52.997915+0000","last_undegraded":"2023-10-08T00:24:52.997915+0000","last_fullsized":"2023-10-08T00:24:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990585+0000","last_change":"2023-10-08T00:24:52.983840+0000","last_active":"2023-10-08T00:24:52.990585+0000","last_peered":"2023-10-08T00:24:52.990585+0000","last_clean":"2023-10-08T00:24:52.990585+0000","last_became_active":"2023-10-08T00:24:52.983567+0000","last_became_peered":"2023-10-08T00:24:52.983567+0000","last_unstale":"2023-10-08T00:24:52.990585+0000","last_undegraded":"2023-10-08T00:24:52.990585+0000","last_fullsized":"2023-10-08T00:24:52.990585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:34:31.254296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990688+0000","last_change":"2023-10-08T00:24:51.971465+0000","last_active":"2023-10-08T00:24:52.990688+0000","last_peered":"2023-10-08T00:24:52.990688+0000","last_clean":"2023-10-08T00:24:52.990688+0000","last_became_active":"2023-10-08T00:24:51.971212+0000","last_became_peered":"2023-10-08T00:24:51.971212+0000","last_unstale":"2023-10-08T00:24:52.990688+0000","last_undegraded":"2023-10-08T00:24:52.990688+0000","last_fullsized":"2023-10-08T00:24:52.990688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:19.468028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986877+0000","last_change":"2023-10-08T00:24:52.981698+0000","last_active":"2023-10-08T00:24:52.986877+0000","last_peered":"2023-10-08T00:24:52.986877+0000","last_clean":"2023-10-08T00:24:52.986877+0000","last_became_active":"2023-10-08T00:24:52.981431+0000","last_became_peered":"2023-10-08T00:24:52.981431+0000","last_unstale":"2023-10-08T00:24:52.986877+0000","last_undegraded":"2023-10-08T00:24:52.986877+0000","last_fullsized":"2023-10-08T00:24:52.986877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970306+0000","last_change":"2023-10-08T00:24:51.972585+0000","last_active":"2023-10-08T00:24:52.970306+0000","last_peered":"2023-10-08T00:24:52.970306+0000","last_clean":"2023-10-08T00:24:52.970306+0000","last_became_active":"2023-10-08T00:24:51.972285+0000","last_became_peered":"2023-10-08T00:24:51.972285+0000","last_unstale":"2023-10-08T00:24:52.970306+0000","last_undegraded":"2023-10-08T00:24:52.970306+0000","last_fullsized":"2023-10-08T00:24:52.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991943+0000","last_change":"2023-10-08T00:24:52.990394+0000","last_active":"2023-10-08T00:24:52.991943+0000","last_peered":"2023-10-08T00:24:52.991943+0000","last_clean":"2023-10-08T00:24:52.991943+0000","last_became_active":"2023-10-08T00:24:52.990088+0000","last_became_peered":"2023-10-08T00:24:52.990088+0000","last_unstale":"2023-10-08T00:24:52.991943+0000","last_undegraded":"2023-10-08T00:24:52.991943+0000","last_fullsized":"2023-10-08T00:24:52.991943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968176+0000","last_change":"2023-10-08T00:24:51.965511+0000","last_active":"2023-10-08T00:24:52.968176+0000","last_peered":"2023-10-08T00:24:52.968176+0000","last_clean":"2023-10-08T00:24:52.968176+0000","last_became_active":"2023-10-08T00:24:51.965135+0000","last_became_peered":"2023-10-08T00:24:51.965135+0000","last_unstale":"2023-10-08T00:24:52.968176+0000","last_undegraded":"2023-10-08T00:24:52.968176+0000","last_fullsized":"2023-10-08T00:24:52.968176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989987+0000","last_change":"2023-10-08T00:24:52.979423+0000","last_active":"2023-10-08T00:24:52.989987+0000","last_peered":"2023-10-08T00:24:52.989987+0000","last_clean":"2023-10-08T00:24:52.989987+0000","last_became_active":"2023-10-08T00:24:52.979088+0000","last_became_peered":"2023-10-08T00:24:52.979088+0000","last_unstale":"2023-10-08T00:24:52.989987+0000","last_undegraded":"2023-10-08T00:24:52.989987+0000","last_fullsized":"2023-10-08T00:24:52.989987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992031+0000","last_change":"2023-10-08T00:24:51.971820+0000","last_active":"2023-10-08T00:24:52.992031+0000","last_peered":"2023-10-08T00:24:52.992031+0000","last_clean":"2023-10-08T00:24:52.992031+0000","last_became_active":"2023-10-08T00:24:51.971563+0000","last_became_peered":"2023-10-08T00:24:51.971563+0000","last_unstale":"2023-10-08T00:24:52.992031+0000","last_undegraded":"2023-10-08T00:24:52.992031+0000","last_fullsized":"2023-10-08T00:24:52.992031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991999+0000","last_change":"2023-10-08T00:24:52.990737+0000","last_active":"2023-10-08T00:24:52.991999+0000","last_peered":"2023-10-08T00:24:52.991999+0000","last_clean":"2023-10-08T00:24:52.991999+0000","last_became_active":"2023-10-08T00:24:52.990032+0000","last_became_peered":"2023-10-08T00:24:52.990032+0000","last_unstale":"2023-10-08T00:24:52.991999+0000","last_undegraded":"2023-10-08T00:24:52.991999+0000","last_fullsized":"2023-10-08T00:24:52.991999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991333+0000","last_change":"2023-10-08T00:24:51.964547+0000","last_active":"2023-10-08T00:24:52.991333+0000","last_peered":"2023-10-08T00:24:52.991333+0000","last_clean":"2023-10-08T00:24:52.991333+0000","last_became_active":"2023-10-08T00:24:51.963951+0000","last_became_peered":"2023-10-08T00:24:51.963951+0000","last_unstale":"2023-10-08T00:24:52.991333+0000","last_undegraded":"2023-10-08T00:24:52.991333+0000","last_fullsized":"2023-10-08T00:24:52.991333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:24.358934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991658+0000","last_change":"2023-10-08T00:24:52.987475+0000","last_active":"2023-10-08T00:24:52.991658+0000","last_peered":"2023-10-08T00:24:52.991658+0000","last_clean":"2023-10-08T00:24:52.991658+0000","last_became_active":"2023-10-08T00:24:52.987054+0000","last_became_peered":"2023-10-08T00:24:52.987054+0000","last_unstale":"2023-10-08T00:24:52.991658+0000","last_undegraded":"2023-10-08T00:24:52.991658+0000","last_fullsized":"2023-10-08T00:24:52.991658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970458+0000","last_change":"2023-10-08T00:24:51.971914+0000","last_active":"2023-10-08T00:24:52.970458+0000","last_peered":"2023-10-08T00:24:52.970458+0000","last_clean":"2023-10-08T00:24:52.970458+0000","last_became_active":"2023-10-08T00:24:51.971486+0000","last_became_peered":"2023-10-08T00:24:51.971486+0000","last_unstale":"2023-10-08T00:24:52.970458+0000","last_undegraded":"2023-10-08T00:24:52.970458+0000","last_fullsized":"2023-10-08T00:24:52.970458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996934+0000","last_change":"2023-10-08T00:24:52.995174+0000","last_active":"2023-10-08T00:24:52.996934+0000","last_peered":"2023-10-08T00:24:52.996934+0000","last_clean":"2023-10-08T00:24:52.996934+0000","last_became_active":"2023-10-08T00:24:52.994900+0000","last_became_peered":"2023-10-08T00:24:52.994900+0000","last_unstale":"2023-10-08T00:24:52.996934+0000","last_undegraded":"2023-10-08T00:24:52.996934+0000","last_fullsized":"2023-10-08T00:24:52.996934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970200+0000","last_change":"2023-10-08T00:24:51.969965+0000","last_active":"2023-10-08T00:24:52.970200+0000","last_peered":"2023-10-08T00:24:52.970200+0000","last_clean":"2023-10-08T00:24:52.970200+0000","last_became_active":"2023-10-08T00:24:51.969745+0000","last_became_peered":"2023-10-08T00:24:51.969745+0000","last_unstale":"2023-10-08T00:24:52.970200+0000","last_undegraded":"2023-10-08T00:24:52.970200+0000","last_fullsized":"2023-10-08T00:24:52.970200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.980067+0000","last_change":"2023-10-08T00:24:52.971665+0000","last_active":"2023-10-08T00:24:52.980067+0000","last_peered":"2023-10-08T00:24:52.980067+0000","last_clean":"2023-10-08T00:24:52.980067+0000","last_became_active":"2023-10-08T00:24:52.971399+0000","last_became_peered":"2023-10-08T00:24:52.971399+0000","last_unstale":"2023-10-08T00:24:52.980067+0000","last_undegraded":"2023-10-08T00:24:52.980067+0000","last_fullsized":"2023-10-08T00:24:52.980067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:40.259676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976303+0000","last_change":"2023-10-08T00:24:52.975047+0000","last_active":"2023-10-08T00:24:52.976303+0000","last_peered":"2023-10-08T00:24:52.976303+0000","last_clean":"2023-10-08T00:24:52.976303+0000","last_became_active":"2023-10-08T00:24:52.974783+0000","last_became_peered":"2023-10-08T00:24:52.974783+0000","last_unstale":"2023-10-08T00:24:52.976303+0000","last_undegraded":"2023-10-08T00:24:52.976303+0000","last_fullsized":"2023-10-08T00:24:52.976303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968751+0000","last_change":"2023-10-08T00:24:51.970680+0000","last_active":"2023-10-08T00:24:52.968751+0000","last_peered":"2023-10-08T00:24:52.968751+0000","last_clean":"2023-10-08T00:24:52.968751+0000","last_became_active":"2023-10-08T00:24:51.970251+0000","last_became_peered":"2023-10-08T00:24:51.970251+0000","last_unstale":"2023-10-08T00:24:52.968751+0000","last_undegraded":"2023-10-08T00:24:52.968751+0000","last_fullsized":"2023-10-08T00:24:52.968751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992113+0000","last_change":"2023-10-08T00:24:52.987527+0000","last_active":"2023-10-08T00:24:52.992113+0000","last_peered":"2023-10-08T00:24:52.992113+0000","last_clean":"2023-10-08T00:24:52.992113+0000","last_became_active":"2023-10-08T00:24:52.987201+0000","last_became_peered":"2023-10-08T00:24:52.987201+0000","last_unstale":"2023-10-08T00:24:52.992113+0000","last_undegraded":"2023-10-08T00:24:52.992113+0000","last_fullsized":"2023-10-08T00:24:52.992113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969155+0000","last_change":"2023-10-08T00:24:51.966501+0000","last_active":"2023-10-08T00:24:52.969155+0000","last_peered":"2023-10-08T00:24:52.969155+0000","last_clean":"2023-10-08T00:24:52.969155+0000","last_became_active":"2023-10-08T00:24:51.966163+0000","last_became_peered":"2023-10-08T00:24:51.966163+0000","last_unstale":"2023-10-08T00:24:52.969155+0000","last_undegraded":"2023-10-08T00:24:52.969155+0000","last_fullsized":"2023-10-08T00:24:52.969155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972967+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:24:52.972967+0000","last_peered":"2023-10-08T00:24:52.972967+0000","last_clean":"2023-10-08T00:24:52.972967+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:24:52.972967+0000","last_undegraded":"2023-10-08T00:24:52.972967+0000","last_fullsized":"2023-10-08T00:24:52.972967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987231+0000","last_change":"2023-10-08T00:24:52.977356+0000","last_active":"2023-10-08T00:24:52.987231+0000","last_peered":"2023-10-08T00:24:52.987231+0000","last_clean":"2023-10-08T00:24:52.987231+0000","last_became_active":"2023-10-08T00:24:52.977065+0000","last_became_peered":"2023-10-08T00:24:52.977065+0000","last_unstale":"2023-10-08T00:24:52.987231+0000","last_undegraded":"2023-10-08T00:24:52.987231+0000","last_fullsized":"2023-10-08T00:24:52.987231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971755+0000","last_change":"2023-10-08T00:24:51.972788+0000","last_active":"2023-10-08T00:24:52.971755+0000","last_peered":"2023-10-08T00:24:52.971755+0000","last_clean":"2023-10-08T00:24:52.971755+0000","last_became_active":"2023-10-08T00:24:51.972199+0000","last_became_peered":"2023-10-08T00:24:51.972199+0000","last_unstale":"2023-10-08T00:24:52.971755+0000","last_undegraded":"2023-10-08T00:24:52.971755+0000","last_fullsized":"2023-10-08T00:24:52.971755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972287+0000","last_change":"2023-10-08T00:24:51.975555+0000","last_active":"2023-10-08T00:24:52.972287+0000","last_peered":"2023-10-08T00:24:52.972287+0000","last_clean":"2023-10-08T00:24:52.972287+0000","last_became_active":"2023-10-08T00:24:51.975251+0000","last_became_peered":"2023-10-08T00:24:51.975251+0000","last_unstale":"2023-10-08T00:24:52.972287+0000","last_undegraded":"2023-10-08T00:24:52.972287+0000","last_fullsized":"2023-10-08T00:24:52.972287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984419+0000","last_change":"2023-10-08T00:24:52.978989+0000","last_active":"2023-10-08T00:24:52.984419+0000","last_peered":"2023-10-08T00:24:52.984419+0000","last_clean":"2023-10-08T00:24:52.984419+0000","last_became_active":"2023-10-08T00:24:52.978749+0000","last_became_peered":"2023-10-08T00:24:52.978749+0000","last_unstale":"2023-10-08T00:24:52.984419+0000","last_undegraded":"2023-10-08T00:24:52.984419+0000","last_fullsized":"2023-10-08T00:24:52.984419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971543+0000","last_change":"2023-10-08T00:24:51.972820+0000","last_active":"2023-10-08T00:24:52.971543+0000","last_peered":"2023-10-08T00:24:52.971543+0000","last_clean":"2023-10-08T00:24:52.971543+0000","last_became_active":"2023-10-08T00:24:51.972559+0000","last_became_peered":"2023-10-08T00:24:51.972559+0000","last_unstale":"2023-10-08T00:24:52.971543+0000","last_undegraded":"2023-10-08T00:24:52.971543+0000","last_fullsized":"2023-10-08T00:24:52.971543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992662+0000","last_change":"2023-10-08T00:24:52.989566+0000","last_active":"2023-10-08T00:24:52.992662+0000","last_peered":"2023-10-08T00:24:52.992662+0000","last_clean":"2023-10-08T00:24:52.992662+0000","last_became_active":"2023-10-08T00:24:52.989274+0000","last_became_peered":"2023-10-08T00:24:52.989274+0000","last_unstale":"2023-10-08T00:24:52.992662+0000","last_undegraded":"2023-10-08T00:24:52.992662+0000","last_fullsized":"2023-10-08T00:24:52.992662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992104+0000","last_change":"2023-10-08T00:24:51.968679+0000","last_active":"2023-10-08T00:24:52.992104+0000","last_peered":"2023-10-08T00:24:52.992104+0000","last_clean":"2023-10-08T00:24:52.992104+0000","last_became_active":"2023-10-08T00:24:51.967961+0000","last_became_peered":"2023-10-08T00:24:51.967961+0000","last_unstale":"2023-10-08T00:24:52.992104+0000","last_undegraded":"2023-10-08T00:24:52.992104+0000","last_fullsized":"2023-10-08T00:24:52.992104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985358+0000","last_change":"2023-10-08T00:24:52.977980+0000","last_active":"2023-10-08T00:24:52.985358+0000","last_peered":"2023-10-08T00:24:52.985358+0000","last_clean":"2023-10-08T00:24:52.985358+0000","last_became_active":"2023-10-08T00:24:52.977672+0000","last_became_peered":"2023-10-08T00:24:52.977672+0000","last_unstale":"2023-10-08T00:24:52.985358+0000","last_undegraded":"2023-10-08T00:24:52.985358+0000","last_fullsized":"2023-10-08T00:24:52.985358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970997+0000","last_change":"2023-10-08T00:24:51.972959+0000","last_active":"2023-10-08T00:24:52.970997+0000","last_peered":"2023-10-08T00:24:52.970997+0000","last_clean":"2023-10-08T00:24:52.970997+0000","last_became_active":"2023-10-08T00:24:51.972532+0000","last_became_peered":"2023-10-08T00:24:51.972532+0000","last_unstale":"2023-10-08T00:24:52.970997+0000","last_undegraded":"2023-10-08T00:24:52.970997+0000","last_fullsized":"2023-10-08T00:24:52.970997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.385304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.973482+0000","last_change":"2023-10-08T00:24:52.971403+0000","last_active":"2023-10-08T00:24:52.973482+0000","last_peered":"2023-10-08T00:24:52.973482+0000","last_clean":"2023-10-08T00:24:52.973482+0000","last_became_active":"2023-10-08T00:24:52.971015+0000","last_became_peered":"2023-10-08T00:24:52.971015+0000","last_unstale":"2023-10-08T00:24:52.973482+0000","last_undegraded":"2023-10-08T00:24:52.973482+0000","last_fullsized":"2023-10-08T00:24:52.973482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:39.620318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970036+0000","last_change":"2023-10-08T00:24:51.972990+0000","last_active":"2023-10-08T00:24:52.970036+0000","last_peered":"2023-10-08T00:24:52.970036+0000","last_clean":"2023-10-08T00:24:52.970036+0000","last_became_active":"2023-10-08T00:24:51.972120+0000","last_became_peered":"2023-10-08T00:24:51.972120+0000","last_unstale":"2023-10-08T00:24:52.970036+0000","last_undegraded":"2023-10-08T00:24:52.970036+0000","last_fullsized":"2023-10-08T00:24:52.970036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992020+0000","last_change":"2023-10-08T00:24:52.986965+0000","last_active":"2023-10-08T00:24:52.992020+0000","last_peered":"2023-10-08T00:24:52.992020+0000","last_clean":"2023-10-08T00:24:52.992020+0000","last_became_active":"2023-10-08T00:24:52.981949+0000","last_became_peered":"2023-10-08T00:24:52.981949+0000","last_unstale":"2023-10-08T00:24:52.992020+0000","last_undegraded":"2023-10-08T00:24:52.992020+0000","last_fullsized":"2023-10-08T00:24:52.992020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971126+0000","last_change":"2023-10-08T00:24:51.970488+0000","last_active":"2023-10-08T00:24:52.971126+0000","last_peered":"2023-10-08T00:24:52.971126+0000","last_clean":"2023-10-08T00:24:52.971126+0000","last_became_active":"2023-10-08T00:24:51.970231+0000","last_became_peered":"2023-10-08T00:24:51.970231+0000","last_unstale":"2023-10-08T00:24:52.971126+0000","last_undegraded":"2023-10-08T00:24:52.971126+0000","last_fullsized":"2023-10-08T00:24:52.971126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979310+0000","last_change":"2023-10-08T00:24:52.975874+0000","last_active":"2023-10-08T00:24:52.979310+0000","last_peered":"2023-10-08T00:24:52.979310+0000","last_clean":"2023-10-08T00:24:52.979310+0000","last_became_active":"2023-10-08T00:24:52.975494+0000","last_became_peered":"2023-10-08T00:24:52.975494+0000","last_unstale":"2023-10-08T00:24:52.979310+0000","last_undegraded":"2023-10-08T00:24:52.979310+0000","last_fullsized":"2023-10-08T00:24:52.979310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991514+0000","last_change":"2023-10-08T00:24:51.973894+0000","last_active":"2023-10-08T00:24:52.991514+0000","last_peered":"2023-10-08T00:24:52.991514+0000","last_clean":"2023-10-08T00:24:52.991514+0000","last_became_active":"2023-10-08T00:24:51.973619+0000","last_became_peered":"2023-10-08T00:24:51.973619+0000","last_unstale":"2023-10-08T00:24:52.991514+0000","last_undegraded":"2023-10-08T00:24:52.991514+0000","last_fullsized":"2023-10-08T00:24:52.991514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979160+0000","last_change":"2023-10-08T00:24:52.975531+0000","last_active":"2023-10-08T00:24:52.979160+0000","last_peered":"2023-10-08T00:24:52.979160+0000","last_clean":"2023-10-08T00:24:52.979160+0000","last_became_active":"2023-10-08T00:24:52.974442+0000","last_became_peered":"2023-10-08T00:24:52.974442+0000","last_unstale":"2023-10-08T00:24:52.979160+0000","last_undegraded":"2023-10-08T00:24:52.979160+0000","last_fullsized":"2023-10-08T00:24:52.979160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969018+0000","last_change":"2023-10-08T00:24:51.972849+0000","last_active":"2023-10-08T00:24:52.969018+0000","last_peered":"2023-10-08T00:24:52.969018+0000","last_clean":"2023-10-08T00:24:52.969018+0000","last_became_active":"2023-10-08T00:24:51.972584+0000","last_became_peered":"2023-10-08T00:24:51.972584+0000","last_unstale":"2023-10-08T00:24:52.969018+0000","last_undegraded":"2023-10-08T00:24:52.969018+0000","last_fullsized":"2023-10-08T00:24:52.969018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991780+0000","last_change":"2023-10-08T00:24:52.987901+0000","last_active":"2023-10-08T00:24:52.991780+0000","last_peered":"2023-10-08T00:24:52.991780+0000","last_clean":"2023-10-08T00:24:52.991780+0000","last_became_active":"2023-10-08T00:24:52.987650+0000","last_became_peered":"2023-10-08T00:24:52.987650+0000","last_unstale":"2023-10-08T00:24:52.991780+0000","last_undegraded":"2023-10-08T00:24:52.991780+0000","last_fullsized":"2023-10-08T00:24:52.991780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992854+0000","last_change":"2023-10-08T00:24:51.970706+0000","last_active":"2023-10-08T00:24:52.992854+0000","last_peered":"2023-10-08T00:24:52.992854+0000","last_clean":"2023-10-08T00:24:52.992854+0000","last_became_active":"2023-10-08T00:24:51.969854+0000","last_became_peered":"2023-10-08T00:24:51.969854+0000","last_unstale":"2023-10-08T00:24:52.992854+0000","last_undegraded":"2023-10-08T00:24:52.992854+0000","last_fullsized":"2023-10-08T00:24:52.992854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990618+0000","last_change":"2023-10-08T00:24:52.983945+0000","last_active":"2023-10-08T00:24:52.990618+0000","last_peered":"2023-10-08T00:24:52.990618+0000","last_clean":"2023-10-08T00:24:52.990618+0000","last_became_active":"2023-10-08T00:24:52.983668+0000","last_became_peered":"2023-10-08T00:24:52.983668+0000","last_unstale":"2023-10-08T00:24:52.990618+0000","last_undegraded":"2023-10-08T00:24:52.990618+0000","last_fullsized":"2023-10-08T00:24:52.990618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993949+0000","last_change":"2023-10-08T00:24:51.970895+0000","last_active":"2023-10-08T00:24:52.993949+0000","last_peered":"2023-10-08T00:24:52.993949+0000","last_clean":"2023-10-08T00:24:52.993949+0000","last_became_active":"2023-10-08T00:24:51.970245+0000","last_became_peered":"2023-10-08T00:24:51.970245+0000","last_unstale":"2023-10-08T00:24:52.993949+0000","last_undegraded":"2023-10-08T00:24:52.993949+0000","last_fullsized":"2023-10-08T00:24:52.993949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993961+0000","last_change":"2023-10-08T00:24:52.991574+0000","last_active":"2023-10-08T00:24:52.993961+0000","last_peered":"2023-10-08T00:24:52.993961+0000","last_clean":"2023-10-08T00:24:52.993961+0000","last_became_active":"2023-10-08T00:24:52.990396+0000","last_became_peered":"2023-10-08T00:24:52.990396+0000","last_unstale":"2023-10-08T00:24:52.993961+0000","last_undegraded":"2023-10-08T00:24:52.993961+0000","last_fullsized":"2023-10-08T00:24:52.993961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989966+0000","last_change":"2023-10-08T00:24:52.979422+0000","last_active":"2023-10-08T00:24:52.989966+0000","last_peered":"2023-10-08T00:24:52.989966+0000","last_clean":"2023-10-08T00:24:52.989966+0000","last_became_active":"2023-10-08T00:24:52.979146+0000","last_became_peered":"2023-10-08T00:24:52.979146+0000","last_unstale":"2023-10-08T00:24:52.989966+0000","last_undegraded":"2023-10-08T00:24:52.989966+0000","last_fullsized":"2023-10-08T00:24:52.989966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986972+0000","last_change":"2023-10-08T00:24:52.986197+0000","last_active":"2023-10-08T00:24:52.986972+0000","last_peered":"2023-10-08T00:24:52.986972+0000","last_clean":"2023-10-08T00:24:52.986972+0000","last_became_active":"2023-10-08T00:24:52.985947+0000","last_became_peered":"2023-10-08T00:24:52.985947+0000","last_unstale":"2023-10-08T00:24:52.986972+0000","last_undegraded":"2023-10-08T00:24:52.986972+0000","last_fullsized":"2023-10-08T00:24:52.986972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:47.389930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984505+0000","last_change":"2023-10-08T00:24:52.980865+0000","last_active":"2023-10-08T00:24:52.984505+0000","last_peered":"2023-10-08T00:24:52.984505+0000","last_clean":"2023-10-08T00:24:52.984505+0000","last_became_active":"2023-10-08T00:24:52.980251+0000","last_became_peered":"2023-10-08T00:24:52.980251+0000","last_unstale":"2023-10-08T00:24:52.984505+0000","last_undegraded":"2023-10-08T00:24:52.984505+0000","last_fullsized":"2023-10-08T00:24:52.984505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986453+0000","last_change":"2023-10-08T00:24:52.985277+0000","last_active":"2023-10-08T00:24:52.986453+0000","last_peered":"2023-10-08T00:24:52.986453+0000","last_clean":"2023-10-08T00:24:52.986453+0000","last_became_active":"2023-10-08T00:24:52.981814+0000","last_became_peered":"2023-10-08T00:24:52.981814+0000","last_unstale":"2023-10-08T00:24:52.986453+0000","last_undegraded":"2023-10-08T00:24:52.986453+0000","last_fullsized":"2023-10-08T00:24:52.986453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981430+0000","last_change":"2023-10-08T00:24:52.975549+0000","last_active":"2023-10-08T00:24:52.981430+0000","last_peered":"2023-10-08T00:24:52.981430+0000","last_clean":"2023-10-08T00:24:52.981430+0000","last_became_active":"2023-10-08T00:24:52.975298+0000","last_became_peered":"2023-10-08T00:24:52.975298+0000","last_unstale":"2023-10-08T00:24:52.981430+0000","last_undegraded":"2023-10-08T00:24:52.981430+0000","last_fullsized":"2023-10-08T00:24:52.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984523+0000","last_change":"2023-10-08T00:24:52.978921+0000","last_active":"2023-10-08T00:24:52.984523+0000","last_peered":"2023-10-08T00:24:52.984523+0000","last_clean":"2023-10-08T00:24:52.984523+0000","last_became_active":"2023-10-08T00:24:52.978633+0000","last_became_peered":"2023-10-08T00:24:52.978633+0000","last_unstale":"2023-10-08T00:24:52.984523+0000","last_undegraded":"2023-10-08T00:24:52.984523+0000","last_fullsized":"2023-10-08T00:24:52.984523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990230+0000","last_change":"2023-10-08T00:24:52.985282+0000","last_active":"2023-10-08T00:24:52.990230+0000","last_peered":"2023-10-08T00:24:52.990230+0000","last_clean":"2023-10-08T00:24:52.990230+0000","last_became_active":"2023-10-08T00:24:52.985016+0000","last_became_peered":"2023-10-08T00:24:52.985016+0000","last_unstale":"2023-10-08T00:24:52.990230+0000","last_undegraded":"2023-10-08T00:24:52.990230+0000","last_fullsized":"2023-10-08T00:24:52.990230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977747+0000","last_change":"2023-10-08T00:24:52.974937+0000","last_active":"2023-10-08T00:24:52.977747+0000","last_peered":"2023-10-08T00:24:52.977747+0000","last_clean":"2023-10-08T00:24:52.977747+0000","last_became_active":"2023-10-08T00:24:52.974647+0000","last_became_peered":"2023-10-08T00:24:52.974647+0000","last_unstale":"2023-10-08T00:24:52.977747+0000","last_undegraded":"2023-10-08T00:24:52.977747+0000","last_fullsized":"2023-10-08T00:24:52.977747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996943+0000","last_change":"2023-10-08T00:24:52.995257+0000","last_active":"2023-10-08T00:24:52.996943+0000","last_peered":"2023-10-08T00:24:52.996943+0000","last_clean":"2023-10-08T00:24:52.996943+0000","last_became_active":"2023-10-08T00:24:52.994863+0000","last_became_peered":"2023-10-08T00:24:52.994863+0000","last_unstale":"2023-10-08T00:24:52.996943+0000","last_undegraded":"2023-10-08T00:24:52.996943+0000","last_fullsized":"2023-10-08T00:24:52.996943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981376+0000","last_change":"2023-10-08T00:24:52.976107+0000","last_active":"2023-10-08T00:24:52.981376+0000","last_peered":"2023-10-08T00:24:52.981376+0000","last_clean":"2023-10-08T00:24:52.981376+0000","last_became_active":"2023-10-08T00:24:52.975835+0000","last_became_peered":"2023-10-08T00:24:52.975835+0000","last_unstale":"2023-10-08T00:24:52.981376+0000","last_undegraded":"2023-10-08T00:24:52.981376+0000","last_fullsized":"2023-10-08T00:24:52.981376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985392+0000","last_change":"2023-10-08T00:24:52.982480+0000","last_active":"2023-10-08T00:24:52.985392+0000","last_peered":"2023-10-08T00:24:52.985392+0000","last_clean":"2023-10-08T00:24:52.985392+0000","last_became_active":"2023-10-08T00:24:52.981391+0000","last_became_peered":"2023-10-08T00:24:52.981391+0000","last_unstale":"2023-10-08T00:24:52.985392+0000","last_undegraded":"2023-10-08T00:24:52.985392+0000","last_fullsized":"2023-10-08T00:24:52.985392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986425+0000","last_change":"2023-10-08T00:24:52.982575+0000","last_active":"2023-10-08T00:24:52.986425+0000","last_peered":"2023-10-08T00:24:52.986425+0000","last_clean":"2023-10-08T00:24:52.986425+0000","last_became_active":"2023-10-08T00:24:52.982206+0000","last_became_peered":"2023-10-08T00:24:52.982206+0000","last_unstale":"2023-10-08T00:24:52.986425+0000","last_undegraded":"2023-10-08T00:24:52.986425+0000","last_fullsized":"2023-10-08T00:24:52.986425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.975941+0000","last_change":"2023-10-08T00:24:52.975079+0000","last_active":"2023-10-08T00:24:52.975941+0000","last_peered":"2023-10-08T00:24:52.975941+0000","last_clean":"2023-10-08T00:24:52.975941+0000","last_became_active":"2023-10-08T00:24:52.974531+0000","last_became_peered":"2023-10-08T00:24:52.974531+0000","last_unstale":"2023-10-08T00:24:52.975941+0000","last_undegraded":"2023-10-08T00:24:52.975941+0000","last_fullsized":"2023-10-08T00:24:52.975941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:24:57.471 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:24:57.471 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T00:24:57.471 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T00:24:57.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T00:24:57.472 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T00:24:57.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.623+0000 7efebc9f9700 1 Processor -- start 2023-10-08T00:24:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.623+0000 7efebc9f9700 1 -- start start 2023-10-08T00:24:57.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efebc9f9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efeb81597f0 0x7efeb80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efebc9f9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80b11d0 con 0x7efeb8159420 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efebc9f9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80b14b0 con 0x7efeb815d230 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efebc9f9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80b1790 con 0x7efeb81597f0 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efeb77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efeb8159420 0x7efeb80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59790/0 (socket says 172.21.15.22:59790) 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efeb77fe700 1 -- 172.21.15.22:0/1096240910 learned_addr learned my addr 172.21.15.22:0/1096240910 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/1096240910 >> v2:172.21.15.192:3300/0 conn(0x7efeb81597f0 0x7efeb80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990287403 0 0) 0x7efeb80b11d0 con 0x7efeb8159420 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea0003570 con 0x7efeb8159420 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.624+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 271211182 0 0) 0x7efea0003570 con 0x7efeb8159420 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 >> v2:172.21.15.192:3300/0 conn(0x7efeb81597f0 msgr2=0x7efeb80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 --2- 172.21.15.22:0/1096240910 >> v2:172.21.15.192:3300/0 conn(0x7efeb81597f0 0x7efeb80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 >> v1:172.21.15.192:6789/0 conn(0x7efeb815d230 legacy=0x7efeb815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80b1a70 con 0x7efeb8159420 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7efea8001470 con 0x7efeb8159420 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 >> v1:172.21.15.22:6789/0 conn(0x7efeb8159420 legacy=0x7efeb80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0003a60 0x7efea0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efea0004810 0x7efea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efea00051c0 0x7efea000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80b1790 con 0x7efea0004810 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea000c0d0 con 0x7efea0003a60 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea000c290 con 0x7efea00051c0 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/1096240910 >> v2:172.21.15.192:3300/0 conn(0x7efeb81597f0 0x7efeb80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb77fe700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0003a60 0x7efea0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efea0004810 0x7efea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb7fff700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efea00051c0 0x7efea000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 -- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efea00051c0 msgr2=0x7efea000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efea00051c0 0x7efea000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 -- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0003a60 msgr2=0x7efea0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0003a60 0x7efea0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 -- 172.21.15.22:0/1096240910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0003570 con 0x7efea0004810 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb7fff700 1 -- 172.21.15.22:0/1096240910 reap_dead start 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efea0004810 0x7efea0004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efeb8159c70 tx=0x7efeac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205392b81c3d35a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac009740 con 0x7efea0004810 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00e920 con 0x7efea0004810 2023-10-08T00:24:57.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.625+0000 7efeb67fc700 1 -- 172.21.15.22:0/1096240910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00ecc0 con 0x7efea0004810 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 -- 172.21.15.22:0/1096240910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efea0004810 msgr2=0x7efea0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efea0004810 0x7efea0004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efeb8159c70 tx=0x7efeac0091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 -- 172.21.15.22:0/1096240910 shutdown_connections 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 --2- 172.21.15.22:0/1096240910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efea0004810 0x7efea0004c80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 -- 172.21.15.22:0/1096240910 >> 172.21.15.22:0/1096240910 conn(0x7efeb80d0660 msgr2=0x7efeb80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 -- 172.21.15.22:0/1096240910 shutdown_connections 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.626+0000 7efebc9f9700 1 -- 172.21.15.22:0/1096240910 wait complete. 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.627+0000 7efebc9f9700 1 Processor -- start 2023-10-08T00:24:57.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.627+0000 7efebc9f9700 1 -- start start 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efebc9f9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0004810 0x7efeb815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efebc9f9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 0x7efeb8156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efebc9f9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb8154b40 0x7efeb816cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efebc9f9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8152830 con 0x7efeb81520c0 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efebc9f9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb8152550 con 0x7efea0004810 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efebc9f9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb815a510 con 0x7efeb8154b40 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efeb6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 0x7efeb8156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efeb6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 0x7efeb8156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60118/0 (socket says 172.21.15.22:60118) 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efeb6ffd700 1 -- 172.21.15.22:0/3061134677 learned_addr learned my addr 172.21.15.22:0/3061134677 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:57.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efeb77fe700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0004810 0x7efeb815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.628+0000 7efeb7fff700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb8154b40 0x7efeb816cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efeb6ffd700 1 -- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb8154b40 msgr2=0x7efeb816cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb8154b40 0x7efeb816cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efeb6ffd700 1 -- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0004810 msgr2=0x7efeb815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0004810 0x7efeb815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efeb6ffd700 1 -- 172.21.15.22:0/3061134677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb815a7f0 con 0x7efeb81520c0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efeb6ffd700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 0x7efeb8156910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efea000c0a0 tx=0x7efeac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac009740 con 0x7efeb81520c0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac021040 con 0x7efeb81520c0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb815ce20 con 0x7efeb81520c0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac01b830 con 0x7efeb81520c0 2023-10-08T00:24:57.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.629+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb8154fc0 con 0x7efeb81520c0 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.630+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb815a370 con 0x7efeb81520c0 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.630+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efeac01bba0 con 0x7efeb81520c0 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.631+0000 7efe9f7fe700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efea4066f30 0x7efea40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.631+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efeac085f00 con 0x7efeb81520c0 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.631+0000 7efeb77fe700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efea4066f30 0x7efea40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.631+0000 7efeb77fe700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efea4066f30 0x7efea40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efea8001050 tx=0x7efea8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:57.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.635+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efeb815a370 con 0x7efeb81520c0 2023-10-08T00:24:57.690 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-10-08T00:24:57.689+0000 7f65a512a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:24:57.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.887+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7efeb815a370 con 0x7efeb81520c0 2023-10-08T00:24:57.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.890+0000 7efe9f7fe700 1 -- 172.21.15.22:0/3061134677 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163704 (secure 0 0 0) 0x7efeb815a370 con 0x7efeb81520c0 2023-10-08T00:24:57.893 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efea4066f30 msgr2=0x7efea40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efea4066f30 0x7efea40693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efea8001050 tx=0x7efea8009040 comp rx=0 tx=0).stop 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 msgr2=0x7efeb8156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 0x7efeb8156910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efea000c0a0 tx=0x7efeac019000 comp rx=0 tx=0).stop 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 shutdown_connections 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efea4066f30 0x7efea40693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efeb8154b40 0x7efeb816cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efea0004810 0x7efeb815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 --2- 172.21.15.22:0/3061134677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efeb81520c0 0x7efeb8156910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 >> 172.21.15.22:0/3061134677 conn(0x7efeb80d0660 msgr2=0x7efeb8068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 shutdown_connections 2023-10-08T00:24:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:57.893+0000 7efebc9f9700 1 -- 172.21.15.22:0/3061134677 wait complete. 2023-10-08T00:24:57.906 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":90533},{"type":"v1","addr":"172.21.15.192:6833","nonce":90533}]},"active_addr":"172.21.15.192:6833/90533","active_change":"2023-10-08T00:24:40.373894+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":628953021}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":792471447}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":2445319709}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1545832470}]}]} 2023-10-08T00:24:57.910 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T00:24:57.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T00:24:57.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:58.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.029+0000 7f00e3ef3700 1 Processor -- start 2023-10-08T00:24:58.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e3ef3700 1 -- start start 2023-10-08T00:24:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e3ef3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159890 0x7f00dc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e3ef3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f00dc159c60 0x7f00dc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e3ef3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc15a160 con 0x7f00dc15db10 2023-10-08T00:24:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e3ef3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc0d13a0 con 0x7f00dc159c60 2023-10-08T00:24:58.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e3ef3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc15e140 con 0x7f00dc159890 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e148e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f00dc159c60 0x7f00dc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e2490700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f00dc15db10 0x7f00dc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59792/0 (socket says 172.21.15.22:59792) 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.030+0000 7f00e2490700 1 -- 172.21.15.22:0/694417005 learned_addr learned my addr 172.21.15.22:0/694417005 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e1c8f700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159890 0x7f00dc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e148e700 1 -- 172.21.15.22:0/694417005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159890 msgr2=0x7f00dc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e148e700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159890 0x7f00dc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e148e700 1 -- 172.21.15.22:0/694417005 >> v1:172.21.15.22:6789/0 conn(0x7f00dc15db10 legacy=0x7f00dc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e148e700 1 -- 172.21.15.22:0/694417005 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc15a3d0 con 0x7f00dc159c60 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e1c8f700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159890 0x7f00dc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e0c8d700 1 -- 172.21.15.22:0/694417005 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943408086 0 0) 0x7f00dc15a160 con 0x7f00dc15db10 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e148e700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159c60 0x7f00dc15d5d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00d00098e0 tx=0x7f00d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18642afa4f26c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e0c8d700 1 -- 172.21.15.22:0/694417005 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0009e80 con 0x7f00dc159c60 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e0c8d700 1 -- 172.21.15.22:0/694417005 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d000b860 con 0x7f00dc159c60 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.031+0000 7f00e0c8d700 1 -- 172.21.15.22:0/694417005 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d000bbe0 con 0x7f00dc159c60 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 -- 172.21.15.22:0/694417005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159c60 msgr2=0x7f00dc15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159c60 0x7f00dc15d5d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f00d00098e0 tx=0x7f00d00091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 -- 172.21.15.22:0/694417005 shutdown_connections 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159890 0x7f00dc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/694417005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159c60 0x7f00dc15d5d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 -- 172.21.15.22:0/694417005 >> 172.21.15.22:0/694417005 conn(0x7f00dc068e20 msgr2=0x7f00dc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 -- 172.21.15.22:0/694417005 shutdown_connections 2023-10-08T00:24:58.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.032+0000 7f00e3ef3700 1 -- 172.21.15.22:0/694417005 wait complete. 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.033+0000 7f00e3ef3700 1 Processor -- start 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.033+0000 7f00e3ef3700 1 -- start start 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.033+0000 7f00e3ef3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 0x7f00dc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159c60 0x7f00dc169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00dc15db10 0x7f00dc0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0cf060 con 0x7f00dc159890 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0ce140 con 0x7f00dc15db10 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0ce3e0 con 0x7f00dc159c60 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 0x7f00dc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 0x7f00dc0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60136/0 (socket says 172.21.15.22:60136) 2023-10-08T00:24:58.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 -- 172.21.15.22:0/2196249542 learned_addr learned my addr 172.21.15.22:0/2196249542 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 -- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159c60 msgr2=0x7f00dc169af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159c60 0x7f00dc169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 -- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00dc15db10 msgr2=0x7f00dc0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00dc15db10 0x7f00dc0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 -- 172.21.15.22:0/2196249542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0009420 con 0x7f00dc159890 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e1c8f700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 0x7f00dc0cdc00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00d1d0 tx=0x7f00cc009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00de70 con 0x7f00dc159890 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00f040 con 0x7f00dc159890 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc0ce6c0 con 0x7f00dc159890 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc015670 con 0x7f00dc159890 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.034+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc0cec80 con 0x7f00dc159890 2023-10-08T00:24:58.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.035+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc0cf2d0 con 0x7f00dc159890 2023-10-08T00:24:58.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.036+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00cc015a60 con 0x7f00dc159890 2023-10-08T00:24:58.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.036+0000 7f00d9ffb700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.036+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00cc084a00 con 0x7f00dc159890 2023-10-08T00:24:58.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.036+0000 7f00e148e700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.037+0000 7f00e148e700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f00c8066f30 0x7f00c80693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00dc15a090 tx=0x7f00d0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.040+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00cc04e5a0 con 0x7f00dc159890 2023-10-08T00:24:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.233+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00dc04c3c0 con 0x7f00dc159890 2023-10-08T00:24:58.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.234+0000 7f00d9ffb700 1 -- 172.21.15.22:0/2196249542 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f00cc01a090 con 0x7f00dc159890 2023-10-08T00:24:58.234 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:58.235 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f00c8066f30 msgr2=0x7f00c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f00c8066f30 0x7f00c80693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00dc15a090 tx=0x7f00d0017000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 msgr2=0x7f00dc0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 0x7f00dc0cdc00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00d1d0 tx=0x7f00cc009a90 comp rx=0 tx=0).stop 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 shutdown_connections 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00dc15db10 0x7f00dc0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00dc159890 0x7f00dc0cdc00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f00c8066f30 0x7f00c80693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 --2- 172.21.15.22:0/2196249542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00dc159c60 0x7f00dc169af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 >> 172.21.15.22:0/2196249542 conn(0x7f00dc068e20 msgr2=0x7f00dc155170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 shutdown_connections 2023-10-08T00:24:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.236+0000 7f00e3ef3700 1 -- 172.21.15.22:0/2196249542 wait complete. 2023-10-08T00:24:58.249 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T00:24:58.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:24:58.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.367+0000 7fe0d924d700 1 Processor -- start 2023-10-08T00:24:58.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.367+0000 7fe0d924d700 1 -- start start 2023-10-08T00:24:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d924d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 0x7fe0d40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d924d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d4069ee0 con 0x7fe0d4159c60 2023-10-08T00:24:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d924d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d415a160 con 0x7fe0d4159890 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d924d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40d13a0 con 0x7fe0d4069560 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d259c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe0d4159c60 0x7fe0d415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59808/0 (socket says 172.21.15.22:59808) 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d259c700 1 -- 172.21.15.22:0/1366050540 learned_addr learned my addr 172.21.15.22:0/1366050540 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d359e700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 0x7fe0d40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347694096 0 0) 0x7fe0d4069ee0 con 0x7fe0d4159c60 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0bc003570 con 0x7fe0d4159c60 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004681447 0 0) 0x7fe0bc003570 con 0x7fe0d4159c60 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 msgr2=0x7fe0d40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 0x7fe0d40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 >> v1:172.21.15.192:6789/0 conn(0x7fe0d4159890 legacy=0x7fe0d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d415e140 con 0x7fe0d4159c60 2023-10-08T00:24:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fe0c8001470 con 0x7fe0d4159c60 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 >> v1:172.21.15.22:6789/0 conn(0x7fe0d4159c60 legacy=0x7fe0d415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0bc003a90 0x7fe0bc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 0x7fe0bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40d13a0 con 0x7fe0bc004810 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc00bb40 con 0x7fe0bc003a90 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc00bd00 con 0x7fe0d4069560 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.368+0000 7fe0d259c700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d2d9d700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0bc003a90 0x7fe0bc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d359e700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 0x7fe0bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d259c700 1 -- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 msgr2=0x7fe0bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d259c700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d4069560 0x7fe0bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d259c700 1 -- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0bc003a90 msgr2=0x7fe0bc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d259c700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0bc003a90 0x7fe0bc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d259c700 1 -- 172.21.15.22:0/1366050540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc003570 con 0x7fe0bc004810 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d259c700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0bc004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c3c0 tx=0x7fe0c8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7433acd6886378f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c800cc90 con 0x7fe0bc004810 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c800cdf0 con 0x7fe0bc004810 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d1d9b700 1 -- 172.21.15.22:0/1366050540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8005b70 con 0x7fe0bc004810 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d924d700 1 -- 172.21.15.22:0/1366050540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 msgr2=0x7fe0bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d924d700 1 --2- 172.21.15.22:0/1366050540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0bc004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c3c0 tx=0x7fe0c8001e70 comp rx=0 tx=0).stop 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.369+0000 7fe0d359e700 1 -- 172.21.15.22:0/1366050540 reap_dead start 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.370+0000 7fe0d924d700 1 -- 172.21.15.22:0/1366050540 shutdown_connections 2023-10-08T00:24:58.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.370+0000 7fe0d924d700 1 -- 172.21.15.22:0/1366050540 >> 172.21.15.22:0/1366050540 conn(0x7fe0d4068e20 msgr2=0x7fe0d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.370+0000 7fe0d924d700 1 -- 172.21.15.22:0/1366050540 shutdown_connections 2023-10-08T00:24:58.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.370+0000 7fe0d924d700 1 -- 172.21.15.22:0/1366050540 wait complete. 2023-10-08T00:24:58.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.371+0000 7fe0d924d700 1 Processor -- start 2023-10-08T00:24:58.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.371+0000 7fe0d924d700 1 -- start start 2023-10-08T00:24:58.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0d4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0d40cf430 0x7fe0d40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d40cd4f0 0x7fe0d40cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d416abd0 con 0x7fe0bc004810 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41521e0 con 0x7fe0d40cf430 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4169fc0 con 0x7fe0d40cd4f0 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0d4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0d4151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60156/0 (socket says 172.21.15.22:60156) 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 -- 172.21.15.22:0/310489983 learned_addr learned my addr 172.21.15.22:0/310489983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d359e700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d40cd4f0 0x7fe0d40cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d259c700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0d40cf430 0x7fe0d40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 -- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d40cd4f0 msgr2=0x7fe0d40cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d40cd4f0 0x7fe0d40cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 -- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0d40cf430 msgr2=0x7fe0d40cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0d40cf430 0x7fe0d40cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 -- 172.21.15.22:0/310489983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d416a2a0 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d2d9d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0d4151ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4007a80 tx=0x7fe0c4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400fee0 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400d7d0 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400db90 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d416a580 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.372+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d40cfde0 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.373+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d404c3c0 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.374+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0c4014470 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.374+0000 7fe0baffd700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0c0066f30 0x7fe0c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.374+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0c4084d30 con 0x7fe0bc004810 2023-10-08T00:24:58.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.374+0000 7fe0d259c700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0c0066f30 0x7fe0c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.375+0000 7fe0d259c700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0c0066f30 0x7fe0c00693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0d416af80 tx=0x7fe0c8015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.378+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0c4051fa0 con 0x7fe0bc004810 2023-10-08T00:24:58.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.573+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0d406a5b0 con 0x7fe0bc004810 2023-10-08T00:24:58.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.574+0000 7fe0baffd700 1 -- 172.21.15.22:0/310489983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe0c40555c0 con 0x7fe0bc004810 2023-10-08T00:24:58.574 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:24:58.575 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:24:58.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.575+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0c0066f30 msgr2=0x7fe0c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.575+0000 7fe0d924d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0c0066f30 0x7fe0c00693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0d416af80 tx=0x7fe0c8015000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.575+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 msgr2=0x7fe0d4151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.575+0000 7fe0d924d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0d4151ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4007a80 tx=0x7fe0c4007d30 comp rx=0 tx=0).stop 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 shutdown_connections 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0c0066f30 0x7fe0c00693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0d40cd4f0 0x7fe0d40cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0bc004810 0x7fe0d4151ca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 --2- 172.21.15.22:0/310489983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0d40cf430 0x7fe0d40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 >> 172.21.15.22:0/310489983 conn(0x7fe0d4068e20 msgr2=0x7fe0d4156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 shutdown_connections 2023-10-08T00:24:58.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.576+0000 7fe0d924d700 1 -- 172.21.15.22:0/310489983 wait complete. 2023-10-08T00:24:58.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T00:24:58.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T00:24:58.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T00:24:58.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T00:24:58.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T00:24:58.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T00:24:58.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T00:24:58.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T00:24:58.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.799+0000 7f2f5341a700 1 Processor -- start 2023-10-08T00:24:58.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.800+0000 7f2f5341a700 1 -- start start 2023-10-08T00:24:58.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.800+0000 7f814b6e2700 1 Processor -- start 2023-10-08T00:24:58.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.800+0000 7fe413f54700 1 Processor -- start 2023-10-08T00:24:58.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.800+0000 7f6a4bc0d700 1 Processor -- start 2023-10-08T00:24:58.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7fd00a0cb700 1 Processor -- start 2023-10-08T00:24:58.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f5341a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 0x7f2f4c0ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f5341a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2f4c068aa0 0x7f2f4c068f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f5341a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c069440 con 0x7f2f4c0b1f40 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f5341a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0accf0 con 0x7f2f4c068aa0 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f5341a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c15a440 con 0x7f2f4c159fb0 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f509b5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 0x7f2f4c0ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f509b5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 0x7f2f4c0ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60436/0 (socket says 172.21.15.22:60436) 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f2f509b5700 1 -- 172.21.15.22:0/1343107657 learned_addr learned my addr 172.21.15.22:0/1343107657 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f2f509b5700 1 -- 172.21.15.22:0/1343107657 >> v2:172.21.15.22:3300/0 conn(0x7f2f4c068aa0 msgr2=0x7f2f4c068f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f2f509b5700 1 --2- 172.21.15.22:0/1343107657 >> v2:172.21.15.22:3300/0 conn(0x7f2f4c068aa0 0x7f2f4c068f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f2f509b5700 1 -- 172.21.15.22:0/1343107657 >> v1:172.21.15.192:6789/0 conn(0x7f2f4c0b1f40 legacy=0x7f2f4c0aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f2f509b5700 1 -- 172.21.15.22:0/1343107657 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c15a720 con 0x7f2f4c159fb0 2023-10-08T00:24:58.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f2f509b5700 1 --2- 172.21.15.22:0/1343107657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 0x7f2f4c0ac7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009f20 tx=0x7f2f44009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62de67b06394ecc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7fd00a0cb700 1 -- start start 2023-10-08T00:24:58.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fd00a0cb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 0x7fd0040ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fd00a0cb700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0040b2490 con 0x7fd004156760 2023-10-08T00:24:58.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fd00a0cb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0040ac4e0 con 0x7fd004068aa0 2023-10-08T00:24:58.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fd00a0cb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040aceb0 con 0x7fd0040cba20 2023-10-08T00:24:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f814b6e2700 1 -- start start 2023-10-08T00:24:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f814b6e2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f814406aa40 0x7f81440cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f814b6e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406bac0 0x7f814406ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f814b6e2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81440cc210 con 0x7f814406b350 2023-10-08T00:24:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f814b6e2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81440cc4f0 con 0x7f814406aa40 2023-10-08T00:24:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f814b6e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81440cc7d0 con 0x7f814406bac0 2023-10-08T00:24:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f2f43fff700 1 -- 172.21.15.22:0/1343107657 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400e070 con 0x7f2f4c159fb0 2023-10-08T00:24:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.801+0000 7f6a4bc0d700 1 -- start start 2023-10-08T00:24:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f6a4bc0d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a440ae010 0x7f6a44156820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f6a4bc0d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4415a490 con 0x7f6a4406ab40 2023-10-08T00:24:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f6a4bc0d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4415a730 con 0x7f6a4406af10 2023-10-08T00:24:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7f6a4bc0d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4415a2a0 con 0x7f6a440ae010 2023-10-08T00:24:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f2f43fff700 1 -- 172.21.15.22:0/1343107657 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4400ba80 con 0x7f2f4c159fb0 2023-10-08T00:24:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f2f43fff700 1 -- 172.21.15.22:0/1343107657 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f440092e0 con 0x7f2f4c159fb0 2023-10-08T00:24:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0037fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 0x7fd0040ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f814406aa40 0x7f81440cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f814406aa40 0x7f81440cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60178/0 (socket says 172.21.15.22:60178) 2023-10-08T00:24:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 -- 172.21.15.22:0/4006882920 learned_addr learned my addr 172.21.15.22:0/4006882920 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f8148c7d700 1 --2- 172.21.15.22:0/4006882920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406bac0 0x7f814406ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0037fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 0x7fd0040ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60444/0 (socket says 172.21.15.22:60444) 2023-10-08T00:24:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0037fe700 1 -- 172.21.15.22:0/3531845957 learned_addr learned my addr 172.21.15.22:0/3531845957 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f6a4a1aa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a440ae010 0x7f6a44156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f6a4a1aa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a440ae010 0x7f6a44156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60170/0 (socket says 172.21.15.22:60170) 2023-10-08T00:24:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f6a4a1aa700 1 -- 172.21.15.22:0/1177029481 learned_addr learned my addr 172.21.15.22:0/1177029481 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.800+0000 7fe413f54700 1 -- start start 2023-10-08T00:24:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe413f54700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0691b0 0x7fe40c0b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe413f54700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe40c0b1fe0 0x7fe40c0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe413f54700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40c15f260 con 0x7fe40c158440 2023-10-08T00:24:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe413f54700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c0aef20 con 0x7fe40c0b1fe0 2023-10-08T00:24:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe413f54700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c0b2460 con 0x7fe40c0691b0 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe411cf0700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe40c158440 0x7fe40c068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34408/0 (socket says 172.21.15.22:34408) 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe411cf0700 1 -- 172.21.15.22:0/832016242 learned_addr learned my addr 172.21.15.22:0/832016242 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe4114ef700 1 --2- 172.21.15.22:0/832016242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0691b0 0x7fe40c0b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.802+0000 7fe4124f1700 1 --2- 172.21.15.22:0/832016242 >> v2:172.21.15.192:3300/0 conn(0x7fe40c0b1fe0 0x7fe40c0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fe4114ef700 1 -- 172.21.15.22:0/832016242 >> v2:172.21.15.192:3300/0 conn(0x7fe40c0b1fe0 msgr2=0x7fe40c0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fe4114ef700 1 --2- 172.21.15.22:0/832016242 >> v2:172.21.15.192:3300/0 conn(0x7fe40c0b1fe0 0x7fe40c0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fe4114ef700 1 -- 172.21.15.22:0/832016242 >> v1:172.21.15.192:6789/0 conn(0x7fe40c158440 legacy=0x7fe40c068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fe4114ef700 1 -- 172.21.15.22:0/832016242 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c15e380 con 0x7fe40c0691b0 2023-10-08T00:24:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fe4114ef700 1 --2- 172.21.15.22:0/832016242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0691b0 0x7fe40c0b1aa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4000098e0 tx=0x7fe4000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9333181fb417a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0027fc700 1 -- 172.21.15.22:0/3531845957 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485016271 0 0) 0x7fd0040ac4e0 con 0x7fd004068aa0 2023-10-08T00:24:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0027fc700 1 -- 172.21.15.22:0/3531845957 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfec003570 con 0x7fd004068aa0 2023-10-08T00:24:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f6a4a1aa700 1 -- 172.21.15.22:0/1177029481 >> v1:172.21.15.192:6789/0 conn(0x7f6a4406af10 legacy=0x7f6a44156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f6a4a1aa700 1 -- 172.21.15.22:0/1177029481 >> v1:172.21.15.22:6789/0 conn(0x7f6a4406ab40 legacy=0x7f6a440c93c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:24:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f6a4a1aa700 1 -- 172.21.15.22:0/1177029481 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4415aa10 con 0x7f6a440ae010 2023-10-08T00:24:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 -- 172.21.15.22:0/4006882920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406bac0 msgr2=0x7f814406ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 --2- 172.21.15.22:0/4006882920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406bac0 0x7f814406ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 -- 172.21.15.22:0/4006882920 >> v1:172.21.15.22:6789/0 conn(0x7f814406b350 legacy=0x7f81440c81d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:24:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f814947e700 1 -- 172.21.15.22:0/4006882920 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81440ccab0 con 0x7f814406aa40 2023-10-08T00:24:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0037fe700 1 -- 172.21.15.22:0/3531845957 >> v1:172.21.15.192:6789/0 conn(0x7fd004068aa0 legacy=0x7fd004156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0037fe700 1 -- 172.21.15.22:0/3531845957 >> v1:172.21.15.22:6789/0 conn(0x7fd004156760 legacy=0x7fd0040ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7fd0037fe700 1 -- 172.21.15.22:0/3531845957 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd004156cd0 con 0x7fd0040cba20 2023-10-08T00:24:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f2f5341a700 1 -- 172.21.15.22:0/1343107657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 msgr2=0x7f2f4c0ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.803+0000 7f2f5341a700 1 --2- 172.21.15.22:0/1343107657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 0x7f2f4c0ac7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009f20 tx=0x7f2f44009840 comp rx=0 tx=0).stop 2023-10-08T00:24:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fd0037fe700 1 --2- 172.21.15.22:0/3531845957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 0x7fd0040ac970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009d40 tx=0x7fcffc009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58523cd09ce5a6f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f6a4a1aa700 1 --2- 172.21.15.22:0/1177029481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 0x7f6a44156820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000bc50 tx=0x7f6a4000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507396dde79e8f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe410cee700 1 -- 172.21.15.22:0/832016242 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400009e80 con 0x7fe40c0691b0 2023-10-08T00:24:58.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f2f5341a700 1 -- 172.21.15.22:0/1343107657 shutdown_connections 2023-10-08T00:24:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe410cee700 1 -- 172.21.15.22:0/832016242 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40000b820 con 0x7fe40c0691b0 2023-10-08T00:24:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe410cee700 1 -- 172.21.15.22:0/832016242 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000bbc0 con 0x7fe40c0691b0 2023-10-08T00:24:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f2f5341a700 1 --2- 172.21.15.22:0/1343107657 >> v2:172.21.15.22:3300/0 conn(0x7f2f4c068aa0 0x7f2f4c068f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f2f5341a700 1 --2- 172.21.15.22:0/1343107657 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c159fb0 0x7f2f4c0ac7b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f2f5341a700 1 -- 172.21.15.22:0/1343107657 >> 172.21.15.22:0/1343107657 conn(0x7f2f4c0cd000 msgr2=0x7f2f4c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fd0027fc700 1 -- 172.21.15.22:0/3531845957 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc0092e0 con 0x7fd0040cba20 2023-10-08T00:24:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fd0027fc700 1 -- 172.21.15.22:0/3531845957 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcffc00ba00 con 0x7fd0040cba20 2023-10-08T00:24:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fd0027fc700 1 -- 172.21.15.22:0/3531845957 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcffc00bda0 con 0x7fd0040cba20 2023-10-08T00:24:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f2f5341a700 1 -- 172.21.15.22:0/1343107657 shutdown_connections 2023-10-08T00:24:58.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7f2f5341a700 1 -- 172.21.15.22:0/1343107657 wait complete. 2023-10-08T00:24:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe413f54700 1 -- 172.21.15.22:0/832016242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0691b0 msgr2=0x7fe40c0b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe413f54700 1 --2- 172.21.15.22:0/832016242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0691b0 0x7fe40c0b1aa0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe4000098e0 tx=0x7fe4000091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe413f54700 1 -- 172.21.15.22:0/832016242 shutdown_connections 2023-10-08T00:24:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe413f54700 1 --2- 172.21.15.22:0/832016242 >> v2:172.21.15.192:3300/0 conn(0x7fe40c0b1fe0 0x7fe40c0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe413f54700 1 --2- 172.21.15.22:0/832016242 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0691b0 0x7fe40c0b1aa0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.804+0000 7fe413f54700 1 -- 172.21.15.22:0/832016242 >> 172.21.15.22:0/832016242 conn(0x7fe40c0cd000 msgr2=0x7fe40c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f814947e700 1 --2- 172.21.15.22:0/4006882920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440cbc00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f814000bc30 tx=0x7f814000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6534f95bdceb9701 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f6fe258a700 1 Processor -- start 2023-10-08T00:24:58.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f6fe258a700 1 -- start start 2023-10-08T00:24:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fd00a0cb700 1 -- 172.21.15.22:0/3531845957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 msgr2=0x7fd0040ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fd00a0cb700 1 --2- 172.21.15.22:0/3531845957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 0x7fd0040ac970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009d40 tx=0x7fcffc009f90 comp rx=0 tx=0).stop 2023-10-08T00:24:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f6a489a7700 1 -- 172.21.15.22:0/1177029481 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000be60 con 0x7f6a440ae010 2023-10-08T00:24:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f6a489a7700 1 -- 172.21.15.22:0/1177029481 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000dd80 con 0x7f6a440ae010 2023-10-08T00:24:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f6a489a7700 1 -- 172.21.15.22:0/1177029481 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a400106a0 con 0x7f6a440ae010 2023-10-08T00:24:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fd00a0cb700 1 -- 172.21.15.22:0/3531845957 shutdown_connections 2023-10-08T00:24:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fd00a0cb700 1 --2- 172.21.15.22:0/3531845957 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0040cba20 0x7fd0040ac970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fd00a0cb700 1 -- 172.21.15.22:0/3531845957 >> 172.21.15.22:0/3531845957 conn(0x7fd0040cd000 msgr2=0x7fd004068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f813bfff700 1 -- 172.21.15.22:0/4006882920 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140005c10 con 0x7f814406aa40 2023-10-08T00:24:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f813bfff700 1 -- 172.21.15.22:0/4006882920 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140005d70 con 0x7f814406aa40 2023-10-08T00:24:58.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7f813bfff700 1 -- 172.21.15.22:0/4006882920 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000db80 con 0x7f814406aa40 2023-10-08T00:24:58.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f2f5341a700 1 Processor -- start 2023-10-08T00:24:58.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe258a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6fdc158440 0x7f6fdc068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe258a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc068fe0 0x7f6fdc0b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe258a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc15f260 con 0x7f6fdc0b1fe0 2023-10-08T00:24:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe258a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0aef20 con 0x7f6fdc158440 2023-10-08T00:24:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe258a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc069430 con 0x7f6fdc068fe0 2023-10-08T00:24:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1177029481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 msgr2=0x7f6a44156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6a4bc0d700 1 --2- 172.21.15.22:0/1177029481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 0x7f6a44156820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000bc50 tx=0x7f6a4000b4f0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe0b27700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6fdc0b1fe0 0x7f6fdc1619d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59830/0 (socket says 172.21.15.22:59830) 2023-10-08T00:24:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fe0b27700 1 -- 172.21.15.22:0/48208164 learned_addr learned my addr 172.21.15.22:0/48208164 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 -- 172.21.15.22:0/4006882920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 msgr2=0x7f81440cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 --2- 172.21.15.22:0/4006882920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440cbc00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f814000bc30 tx=0x7f814000b4c0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fdbfff700 1 --2- 172.21.15.22:0/48208164 >> v2:172.21.15.192:3300/0 conn(0x7f6fdc158440 0x7f6fdc068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1177029481 shutdown_connections 2023-10-08T00:24:58.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6a4bc0d700 1 --2- 172.21.15.22:0/1177029481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 0x7f6a44156820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1177029481 >> 172.21.15.22:0/1177029481 conn(0x7f6a440cd640 msgr2=0x7f6a440cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7fd00a0cb700 1 -- 172.21.15.22:0/3531845957 shutdown_connections 2023-10-08T00:24:58.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f6fdb7fe700 1 --2- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc068fe0 0x7f6fdc0b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 -- 172.21.15.22:0/4006882920 shutdown_connections 2023-10-08T00:24:58.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 --2- 172.21.15.22:0/4006882920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440cbc00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 --2- 172.21.15.22:0/4006882920 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406bac0 0x7f814406ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 -- 172.21.15.22:0/4006882920 >> 172.21.15.22:0/4006882920 conn(0x7f81440cd670 msgr2=0x7f81440cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 -- 172.21.15.22:0/4006882920 shutdown_connections 2023-10-08T00:24:58.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f814b6e2700 1 -- 172.21.15.22:0/4006882920 wait complete. 2023-10-08T00:24:58.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f6fdbfff700 1 -- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc068fe0 msgr2=0x7f6fdc0b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f6fdbfff700 1 --2- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc068fe0 0x7f6fdc0b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f6fdbfff700 1 -- 172.21.15.22:0/48208164 >> v1:172.21.15.22:6789/0 conn(0x7f6fdc0b1fe0 legacy=0x7f6fdc1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f6fdbfff700 1 -- 172.21.15.22:0/48208164 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0b2440 con 0x7f6fdc158440 2023-10-08T00:24:58.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f6fdbfff700 1 --2- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 0x7f6fdc068aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00098e0 tx=0x7f6fd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f067e3c2a7a8900 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fd00a0cb700 1 -- 172.21.15.22:0/3531845957 wait complete. 2023-10-08T00:24:58.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1177029481 shutdown_connections 2023-10-08T00:24:58.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fe413f54700 1 -- 172.21.15.22:0/832016242 shutdown_connections 2023-10-08T00:24:58.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.805+0000 7fe413f54700 1 -- 172.21.15.22:0/832016242 wait complete. 2023-10-08T00:24:58.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7fe413f54700 1 Processor -- start 2023-10-08T00:24:58.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7fe413f54700 1 -- start start 2023-10-08T00:24:58.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f6fdaffd700 1 -- 172.21.15.22:0/48208164 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011630 con 0x7f6fdc158440 2023-10-08T00:24:58.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f6fdaffd700 1 -- 172.21.15.22:0/48208164 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd00117b0 con 0x7f6fdc158440 2023-10-08T00:24:58.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f6fdaffd700 1 -- 172.21.15.22:0/48208164 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011b70 con 0x7f6fdc158440 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe413f54700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c0691b0 0x7fe40c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe413f54700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0b1fe0 0x7fe40c1275a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe413f54700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe40c158440 0x7fe40c127ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe413f54700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c15b800 con 0x7fe40c0691b0 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe413f54700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c15aff0 con 0x7fe40c158440 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe413f54700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c1595e0 con 0x7fe40c0b1fe0 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe411cf0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c0691b0 0x7fe40c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe411cf0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c0691b0 0x7fe40c06e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60196/0 (socket says 172.21.15.22:60196) 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7fe411cf0700 1 -- 172.21.15.22:0/4160727470 learned_addr learned my addr 172.21.15.22:0/4160727470 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7fe411cf0700 1 -- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0b1fe0 msgr2=0x7fe40c1275a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T00:24:58.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7fe411cf0700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe40c0b1fe0 0x7fe40c1275a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f814b6e2700 1 Processor -- start 2023-10-08T00:24:58.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7fe411cf0700 1 -- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe40c158440 msgr2=0x7fe40c127ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7fe411cf0700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe40c158440 0x7fe40c127ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7fe411cf0700 1 -- 172.21.15.22:0/4160727470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009420 con 0x7fe40c0691b0 2023-10-08T00:24:58.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7fe411cf0700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c0691b0 0x7fe40c06e960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b5e0 tx=0x7fe408009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f95d3d45700 1 Processor -- start 2023-10-08T00:24:58.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1177029481 wait complete. 2023-10-08T00:24:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6a4bc0d700 1 Processor -- start 2023-10-08T00:24:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6fe258a700 1 -- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 msgr2=0x7f6fdc068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6fe258a700 1 --2- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 0x7f6fdc068aa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00098e0 tx=0x7f6fd00091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7fd00a0cb700 1 Processor -- start 2023-10-08T00:24:58.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7fd00a0cb700 1 -- start start 2023-10-08T00:24:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f95d3d45700 1 -- start start 2023-10-08T00:24:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6fe258a700 1 -- 172.21.15.22:0/48208164 shutdown_connections 2023-10-08T00:24:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6fe258a700 1 --2- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 0x7f6fdc068aa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6fe258a700 1 --2- 172.21.15.22:0/48208164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc068fe0 0x7f6fdc0b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6fe258a700 1 -- 172.21.15.22:0/48208164 >> 172.21.15.22:0/48208164 conn(0x7f6fdc0cd000 msgr2=0x7f6fdc068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.806+0000 7f2f5341a700 1 -- start start 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f5341a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4c068aa0 0x7f2f4c1605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f5341a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c0b1f40 0x7f2f4c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f5341a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f4c159fb0 0x7f2f4c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f5341a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c160160 con 0x7f2f4c159fb0 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f5341a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0c91d0 con 0x7f2f4c068aa0 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f5341a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c15f550 con 0x7f2f4c0b1f40 2023-10-08T00:24:58.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f519b7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f4c159fb0 0x7f2f4c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f511b6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4c068aa0 0x7f2f4c1605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f519b7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f4c159fb0 0x7f2f4c06b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60182/0 (socket says 172.21.15.22:60182) 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.807+0000 7f2f519b7700 1 -- 172.21.15.22:0/1285145777 learned_addr learned my addr 172.21.15.22:0/1285145777 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f519b7700 1 -- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c0b1f40 msgr2=0x7f2f4c06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f519b7700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f4c0b1f40 0x7f2f4c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f519b7700 1 -- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4c068aa0 msgr2=0x7f2f4c1605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f519b7700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4c068aa0 0x7f2f4c1605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f519b7700 1 -- 172.21.15.22:0/1285145777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44009ae0 con 0x7f2f4c159fb0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f511b6700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f4c068aa0 0x7f2f4c1605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f519b7700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f4c159fb0 0x7f2f4c06b960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009fa0 tx=0x7f2f48009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48031520 con 0x7f2f4c159fb0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f480316c0 con 0x7f2f4c159fb0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c15f830 con 0x7f2f4c159fb0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48031a80 con 0x7f2f4c159fb0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.808+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c15fdf0 con 0x7f2f4c159fb0 2023-10-08T00:24:58.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f4c04c3c0 con 0x7f2f4c159fb0 2023-10-08T00:24:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408011630 con 0x7fe40c0691b0 2023-10-08T00:24:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f95d3d45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc0b0010 0x7f95cc15d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f95d3d45700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f95cc15dd90 0x7f95cc0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f95d3d45700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0b0750 con 0x7f95cc0afc40 2023-10-08T00:24:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f95d3d45700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0aca70 con 0x7f95cc15dd90 2023-10-08T00:24:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f95d3d45700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0acd50 con 0x7f95cc0b0010 2023-10-08T00:24:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408011790 con 0x7fe40c0691b0 2023-10-08T00:24:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c06e460 con 0x7fe40c0691b0 2023-10-08T00:24:58.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408011b50 con 0x7fe40c0691b0 2023-10-08T00:24:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c15b520 con 0x7fe40c0691b0 2023-10-08T00:24:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f6a4bc0d700 1 -- start start 2023-10-08T00:24:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f6a4bc0d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4406ab40 0x7f6a441543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f6a4bc0d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4406af10 0x7f6a44154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f6a4bc0d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 0x7f6a440cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7f6a4bc0d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4415a150 con 0x7f6a440ae010 2023-10-08T00:24:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6a4bc0d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44155150 con 0x7f6a4406af10 2023-10-08T00:24:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6a4bc0d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b0570 con 0x7f6a4406ab40 2023-10-08T00:24:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f95cc15dd90 0x7f95cc0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f95cc15dd90 0x7f95cc0adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57636/0 (socket says 172.21.15.22:57636) 2023-10-08T00:24:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 -- 172.21.15.22:0/2051452442 learned_addr learned my addr 172.21.15.22:0/2051452442 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.809+0000 7f814b6e2700 1 -- start start 2023-10-08T00:24:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814b6e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814b6e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406b350 0x7f81440c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fd00a0cb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd004068aa0 0x7fd00415de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814b6e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f814406bac0 0x7f8144151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814b6e2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81440c7410 con 0x7f814406aa40 2023-10-08T00:24:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814b6e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81440c76f0 con 0x7f814406bac0 2023-10-08T00:24:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814b6e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814416e480 con 0x7f814406b350 2023-10-08T00:24:58.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fd00a0cb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0040cba20 0x7fd00415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.810+0000 7fd00a0cb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd004156760 0x7fd0041766d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd00a0cb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00415f560 con 0x7fd004156760 2023-10-08T00:24:58.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd00a0cb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00415e9e0 con 0x7fd0040cba20 2023-10-08T00:24:58.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd00a0cb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00415ecc0 con 0x7fd004068aa0 2023-10-08T00:24:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d12e0700 1 --2- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc0b0010 0x7f95cc15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0040cba20 0x7fd00415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0040cba20 0x7fd00415e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57646/0 (socket says 172.21.15.22:57646) 2023-10-08T00:24:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 -- 172.21.15.22:0/509743679 learned_addr learned my addr 172.21.15.22:0/509743679 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 -- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd004068aa0 msgr2=0x7fd00415de20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd004068aa0 0x7fd00415de20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 -- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd004156760 msgr2=0x7fd0041766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd004156760 0x7fd0041766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7fd002ffd700 1 -- 172.21.15.22:0/509743679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc009850 con 0x7fd0040cba20 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6a491a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4406af10 0x7f6a44154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6a491a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4406af10 0x7f6a44154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57652/0 (socket says 172.21.15.22:57652) 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6a491a8700 1 -- 172.21.15.22:0/1386379431 learned_addr learned my addr 172.21.15.22:0/1386379431 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6a499a9700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4406ab40 0x7f6a441543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 -- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc0b0010 msgr2=0x7f95cc15d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 --2- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc0b0010 0x7f95cc15d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 -- 172.21.15.22:0/2051452442 >> v1:172.21.15.22:6789/0 conn(0x7f95cc0afc40 legacy=0x7f95cc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f95d22e2700 1 -- 172.21.15.22:0/2051452442 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0ad030 con 0x7f95cc15dd90 2023-10-08T00:24:58.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f6fe258a700 1 -- 172.21.15.22:0/48208164 shutdown_connections 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f8149c7f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f814406bac0 0x7f8144151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60218/0 (socket says 172.21.15.22:60218) 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 -- 172.21.15.22:0/3119686022 learned_addr learned my addr 172.21.15.22:0/3119686022 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f8148c7d700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406b350 0x7f81440c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 -- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406b350 msgr2=0x7f81440c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814406b350 0x7f81440c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 -- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f814406bac0 msgr2=0x7f8144151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f814406bac0 0x7f8144151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f814947e700 1 -- 172.21.15.22:0/3119686022 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814000b720 con 0x7f814406aa40 2023-10-08T00:24:58.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f48046430 con 0x7f2f4c159fb0 2023-10-08T00:24:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7fd002ffd700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0040cba20 0x7fd00415e360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c580 tx=0x7fcff4007e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6a491a8700 1 -- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4406ab40 msgr2=0x7f6a441543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6a491a8700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4406ab40 0x7f6a441543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6a491a8700 1 -- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 msgr2=0x7f6a440cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6a491a8700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a440ae010 0x7f6a440cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6a491a8700 1 -- 172.21.15.22:0/1386379431 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4000b790 con 0x7f6a4406af10 2023-10-08T00:24:58.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f95d22e2700 1 --2- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc15dd90 0x7f95cc0adb10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0099b0 tx=0x7f95bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5f7cec248a9674 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f814947e700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440c6e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8140002000 tx=0x7f8140019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6a491a8700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4406af10 0x7f6a44154920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c950 tx=0x7f6a3c002760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f95d0adf700 1 -- 172.21.15.22:0/2051452442 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc009ea0 con 0x7f95cc15dd90 2023-10-08T00:24:58.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f95d0adf700 1 -- 172.21.15.22:0/2051452442 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc00b820 con 0x7f95cc15dd90 2023-10-08T00:24:58.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f6fe258a700 1 -- 172.21.15.22:0/48208164 wait complete. 2023-10-08T00:24:58.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f95d0adf700 1 -- 172.21.15.22:0/2051452442 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc00bbc0 con 0x7f95cc15dd90 2023-10-08T00:24:58.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f417fa700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f30066f00 0x7f2f300693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f480a6910 con 0x7f2f4c159fb0 2023-10-08T00:24:58.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f417fa700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f2f3006f110 0x7f2f30071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 --> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f30071bd0 con 0x7f2f3006f110 2023-10-08T00:24:58.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f480a6ce0 con 0x7f2f4c159fb0 2023-10-08T00:24:58.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4010510 con 0x7fd0040cba20 2023-10-08T00:24:58.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff4010670 con 0x7fd0040cba20 2023-10-08T00:24:58.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4010a10 con 0x7fd0040cba20 2023-10-08T00:24:58.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f511b6700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f30066f00 0x7f2f300693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f655b7ae700 1 Processor -- start 2023-10-08T00:24:58.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.811+0000 7f655b7ae700 1 -- start start 2023-10-08T00:24:58.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7f2f509b5700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f2f3006f110 0x7f2f30071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.812+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3ec000fd0 con 0x7fe40c0691b0 2023-10-08T00:24:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00415efa0 con 0x7fd0040cba20 2023-10-08T00:24:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00415ba30 con 0x7fd0040cba20 2023-10-08T00:24:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfe4000fd0 con 0x7fd0040cba20 2023-10-08T00:24:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c012630 con 0x7f6a4406af10 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0127b0 con 0x7f6a4406af10 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c012b70 con 0x7f6a4406af10 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a440b0850 con 0x7f6a4406af10 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a44154e60 con 0x7f6a4406af10 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 -- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc15dd90 msgr2=0x7f95cc0adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 --2- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc15dd90 0x7f95cc0adb10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0099b0 tx=0x7f95bc009250 comp rx=0 tx=0).stop 2023-10-08T00:24:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 -- 172.21.15.22:0/2051452442 shutdown_connections 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 --2- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc15dd90 0x7f95cc0adb10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 --2- 172.21.15.22:0/2051452442 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc0b0010 0x7f95cc15d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 -- 172.21.15.22:0/2051452442 >> 172.21.15.22:0/2051452442 conn(0x7f95cc06a320 msgr2=0x7f95cc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 -- 172.21.15.22:0/2051452442 shutdown_connections 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f95d3d45700 1 -- 172.21.15.22:0/2051452442 wait complete. 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655b7ae700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65540656e0 0x7f655406da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655b7ae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f655406dfd0 0x7f65540c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655b7ae700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655406a2a0 con 0x7f655406a730 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655b7ae700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6554156e70 con 0x7f65540656e0 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655b7ae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655406e3c0 con 0x7f655406dfd0 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655954a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65540656e0 0x7f655406da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655954a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65540656e0 0x7f655406da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60232/0 (socket says 172.21.15.22:60232) 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f655954a700 1 -- 172.21.15.22:0/2485399577 learned_addr learned my addr 172.21.15.22:0/2485399577 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f655954a700 1 -- 172.21.15.22:0/2485399577 >> v2:172.21.15.192:3300/0 conn(0x7f655406dfd0 msgr2=0x7f65540c96e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f655954a700 1 --2- 172.21.15.22:0/2485399577 >> v2:172.21.15.192:3300/0 conn(0x7f655406dfd0 0x7f65540c96e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f655954a700 1 -- 172.21.15.22:0/2485399577 >> v1:172.21.15.22:6789/0 conn(0x7f655406a730 legacy=0x7f65540c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:58.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f655954a700 1 -- 172.21.15.22:0/2485399577 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6554156b90 con 0x7f65540656e0 2023-10-08T00:24:58.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f655954a700 1 --2- 172.21.15.22:0/2485399577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65540656e0 0x7f655406da90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f655406eab0 tx=0x7f654c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc6ba906cea9186 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f6fe258a700 1 Processor -- start 2023-10-08T00:24:58.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7f6fe258a700 1 -- start start 2023-10-08T00:24:58.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe40801a400 con 0x7fe40c0691b0 2023-10-08T00:24:58.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fe3fdffb700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3f0066fb0 0x7fe3f0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe4080845f0 con 0x7fe40c0691b0 2023-10-08T00:24:58.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fe3fdffb700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7fe3f006f140 0x7fe3f0071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 --> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3f0071c00 con 0x7fe3f006f140 2023-10-08T00:24:58.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.813+0000 7f2f509b5700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f2f3006f110 0x7f2f30071520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fe4124f1700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7fe3f006f140 0x7fe3f0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.814+0000 7fe4114ef700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3f0066fb0 0x7fe3f0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7fe4124f1700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7fe3f006f140 0x7fe3f0071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7fe4114ef700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3f0066fb0 0x7fe3f0069460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0ad5d0 tx=0x7fe400016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe258a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fdc068fe0 0x7f6fdc14aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe258a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc0b1fe0 0x7f6fdc06d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe258a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 0x7f6fdc06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe258a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc06f0f0 con 0x7f6fdc068fe0 2023-10-08T00:24:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe258a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc14c8a0 con 0x7f6fdc158440 2023-10-08T00:24:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe258a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc06e470 con 0x7f6fdc0b1fe0 2023-10-08T00:24:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fdbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fdc068fe0 0x7f6fdc14aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f95d3d45700 1 Processor -- start 2023-10-08T00:24:58.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f2f511b6700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f30066f00 0x7f2f300693b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c001dc0 tx=0x7f2f3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fdbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fdc068fe0 0x7f6fdc14aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60248/0 (socket says 172.21.15.22:60248) 2023-10-08T00:24:58.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fdbfff700 1 -- 172.21.15.22:0/3679018515 learned_addr learned my addr 172.21.15.22:0/3679018515 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6fe0b27700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 0x7f6fdc06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== osd.7 v2:172.21.15.192:6800/91120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2f30071bd0 con 0x7f2f3006f110 2023-10-08T00:24:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a24000fd0 con 0x7f6a4406af10 2023-10-08T00:24:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcff401b400 con 0x7fd0040cba20 2023-10-08T00:24:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.815+0000 7f95d3d45700 1 -- start start 2023-10-08T00:24:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== osd.6 v2:172.21.15.192:6802/91119 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe3f0071c00 con 0x7fe3f006f140 2023-10-08T00:24:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3c00a420 con 0x7f6a4406af10 2023-10-08T00:24:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6fdbfff700 1 -- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc0b1fe0 msgr2=0x7f6fdc06d890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T00:24:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6fdbfff700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6fdc0b1fe0 0x7f6fdc06d890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6fdbfff700 1 -- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 msgr2=0x7f6fdc06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6fdbfff700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6fdc158440 0x7f6fdc06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6fdbfff700 1 -- 172.21.15.22:0/3679018515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009420 con 0x7f6fdc068fe0 2023-10-08T00:24:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcff4084200 con 0x7fd0040cba20 2023-10-08T00:24:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fd0037fe700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcff0066f30 0x7fcff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7fcff006f140 0x7fcff0071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 --> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcff0071c00 con 0x7fcff006f140 2023-10-08T00:24:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcff4086760 con 0x7fd0040cba20 2023-10-08T00:24:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6a39ffb700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28067000 0x7f6a280694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7fd003fff700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7fcff006f140 0x7fcff0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a3c084890 con 0x7f6a4406af10 2023-10-08T00:24:58.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6a499a9700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28067000 0x7f6a280694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f6a39ffb700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f6a2806f190 0x7f6a280715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 --> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a28071c50 con 0x7f6a2806f190 2023-10-08T00:24:58.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7fd0037fe700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcff0066f30 0x7fcff00693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009c90 tx=0x7fcffc01b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7fd003fff700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7fcff006f140 0x7fcff0071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f6a4a1aa700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f6a2806f190 0x7f6a280715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f6a499a9700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28067000 0x7f6a280694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a34006fd0 tx=0x7f6a34009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d3d45700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc0afc40 0x7f95cc14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d3d45700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95cc0b0010 0x7f95cc15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d3d45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc15dd90 0x7f95cc15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d3d45700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc15fdb0 con 0x7f95cc0b0010 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d3d45700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc162b60 con 0x7f95cc0afc40 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d3d45700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc151a50 con 0x7f95cc15dd90 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d1ae1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc0afc40 0x7f95cc14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95cc0b0010 0x7f95cc15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d1ae1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc0afc40 0x7f95cc14e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57682/0 (socket says 172.21.15.22:57682) 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d1ae1700 1 -- 172.21.15.22:0/1919822628 learned_addr learned my addr 172.21.15.22:0/1919822628 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d22e2700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc15dd90 0x7f95cc15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 -- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc15dd90 msgr2=0x7f95cc15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95cc15dd90 0x7f95cc15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 -- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc0afc40 msgr2=0x7f95cc14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc0afc40 0x7f95cc14e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 -- 172.21.15.22:0/1919822628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0094f0 con 0x7f95cc0b0010 2023-10-08T00:24:58.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d1ae1700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95cc0afc40 0x7f95cc14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:58.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f6a4a1aa700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f6a2806f190 0x7f6a280715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.817+0000 7f95d12e0700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95cc0b0010 0x7f95cc15bc00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f95c800ea50 tx=0x7f95c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f654bfff700 1 -- 172.21.15.22:0/2485399577 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c00e070 con 0x7f65540656e0 2023-10-08T00:24:58.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f654bfff700 1 -- 172.21.15.22:0/2485399577 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c00ba10 con 0x7f65540656e0 2023-10-08T00:24:58.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f654bfff700 1 -- 172.21.15.22:0/2485399577 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0092e0 con 0x7f65540656e0 2023-10-08T00:24:58.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800eee0 con 0x7f95cc0b0010 2023-10-08T00:24:58.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== osd.0 v2:172.21.15.22:6800/90833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcff0071c00 con 0x7fcff006f140 2023-10-08T00:24:58.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.819+0000 7f655b7ae700 1 -- 172.21.15.22:0/2485399577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65540656e0 msgr2=0x7f655406da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.819+0000 7f655b7ae700 1 --2- 172.21.15.22:0/2485399577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65540656e0 0x7f655406da90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f655406eab0 tx=0x7f654c009840 comp rx=0 tx=0).stop 2023-10-08T00:24:58.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.819+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4080517d0 con 0x7fe40c0691b0 2023-10-08T00:24:58.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc14ee40 con 0x7f95cc0b0010 2023-10-08T00:24:58.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c800c7f0 con 0x7f95cc0b0010 2023-10-08T00:24:58.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c800cb90 con 0x7f95cc0b0010 2023-10-08T00:24:58.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc151400 con 0x7f95cc0b0010 2023-10-08T00:24:58.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.819+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95cc04c3c0 con 0x7f95cc0b0010 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.816+0000 7f6fdbfff700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fdc068fe0 0x7f6fdc14aa60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0002000 tx=0x7f6fd0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011b30 con 0x7f6fdc068fe0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0000cc0 con 0x7f6fdc068fe0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00266d0 con 0x7f6fdc068fe0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc06e750 con 0x7f6fdc068fe0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.818+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc06ed10 con 0x7f6fdc068fe0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.819+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fdc04c3c0 con 0x7f6fdc068fe0 2023-10-08T00:24:58.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fd001a420 con 0x7f6fdc068fe0 2023-10-08T00:24:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.819+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== osd.1 v2:172.21.15.22:6808/90842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6a28071c50 con 0x7f6a2806f190 2023-10-08T00:24:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.820+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a3c051b80 con 0x7f6a4406af10 2023-10-08T00:24:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fc3fff700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6fc8067000 0x7f6fc80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95c8013470 con 0x7f95cc0b0010 2023-10-08T00:24:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6fd0086100 con 0x7f6fdc068fe0 2023-10-08T00:24:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fdb7fe700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6fc8067000 0x7f6fc80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fc3fff700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f6fc806f210 0x7f6fc8071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 --> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fc8071cd0 con 0x7f6fc806f210 2023-10-08T00:24:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.821+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fd00886e0 con 0x7f6fdc068fe0 2023-10-08T00:24:58.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95c1ffb700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95b0067000 0x7f95b00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95c80849b0 con 0x7f95cc0b0010 2023-10-08T00:24:58.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95d1ae1700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95b0067000 0x7f95b00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95c1ffb700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f95b006f210 0x7f95b0071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 --> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b0071cd0 con 0x7f95b006f210 2023-10-08T00:24:58.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c8084d80 con 0x7f95cc0b0010 2023-10-08T00:24:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f6fdb7fe700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6fc8067000 0x7f6fc80694b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc171bc0 tx=0x7f6fd400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95d22e2700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f95b006f210 0x7f95b0071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.822+0000 7f95d1ae1700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95b0067000 0x7f95b00694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95c40076e0 tx=0x7f95c4009840 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f95d22e2700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f95b006f210 0x7f95b0071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f655b7ae700 1 -- 172.21.15.22:0/2485399577 shutdown_connections 2023-10-08T00:24:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f655b7ae700 1 --2- 172.21.15.22:0/2485399577 >> v2:172.21.15.192:3300/0 conn(0x7f655406dfd0 0x7f65540c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f655b7ae700 1 --2- 172.21.15.22:0/2485399577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65540656e0 0x7f655406da90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f655b7ae700 1 -- 172.21.15.22:0/2485399577 >> 172.21.15.22:0/2485399577 conn(0x7f6554068390 msgr2=0x7f6554068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f655b7ae700 1 -- 172.21.15.22:0/2485399577 shutdown_connections 2023-10-08T00:24:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.823+0000 7f655b7ae700 1 -- 172.21.15.22:0/2485399577 wait complete. 2023-10-08T00:24:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.824+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== osd.2 v2:172.21.15.22:6824/90850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f95b0071cd0 con 0x7f95b006f210 2023-10-08T00:24:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.824+0000 7f655b7ae700 1 Processor -- start 2023-10-08T00:24:58.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.824+0000 7f655b7ae700 1 -- start start 2023-10-08T00:24:58.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f6fe0b27700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f6fc806f210 0x7f6fc8071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655b7ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540656e0 0x7f655414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655b7ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655406a730 0x7f6554169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655b7ae700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655406dfd0 0x7f65540c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655b7ae700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655414f1a0 con 0x7f655406dfd0 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655b7ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655416a2f0 con 0x7f655406a730 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655b7ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655416adb0 con 0x7f65540656e0 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655954a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540656e0 0x7f655414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655954a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540656e0 0x7f655414ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60538/0 (socket says 172.21.15.22:60538) 2023-10-08T00:24:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f655954a700 1 -- 172.21.15.22:0/940875909 learned_addr learned my addr 172.21.15.22:0/940875909 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:58.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f6558d49700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655406a730 0x7f6554169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.825+0000 7f6fe0b27700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f6fc806f210 0x7f6fc8071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f6559d4b700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655406dfd0 0x7f65540c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f655954a700 1 -- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655406a730 msgr2=0x7f6554169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f655954a700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655406a730 0x7f6554169db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f655954a700 1 -- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655406dfd0 msgr2=0x7f65540c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f655954a700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655406dfd0 0x7f65540c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f655954a700 1 -- 172.21.15.22:0/940875909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009ae0 con 0x7f65540656e0 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f6558d49700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f655406a730 0x7f6554169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f6559d4b700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655406dfd0 0x7f65540c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f655954a700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540656e0 0x7f655414ec60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f654c009fd0 tx=0x7f654c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.826+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== osd.4 v2:172.21.15.192:6814/91118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6fc8071cd0 con 0x7f6fc806f210 2023-10-08T00:24:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814001f070 con 0x7f814406aa40 2023-10-08T00:24:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8140010470 con 0x7f814406aa40 2023-10-08T00:24:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140010830 con 0x7f814406aa40 2023-10-08T00:24:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814416e760 con 0x7f814406aa40 2023-10-08T00:24:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81440c57f0 con 0x7f814406aa40 2023-10-08T00:24:58.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c012950 con 0x7f65540656e0 2023-10-08T00:24:58.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c012ab0 con 0x7f65540656e0 2023-10-08T00:24:58.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.827+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c012e70 con 0x7f65540656e0 2023-10-08T00:24:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.828+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6554157170 con 0x7f65540656e0 2023-10-08T00:24:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.828+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655416a510 con 0x7f65540656e0 2023-10-08T00:24:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.829+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f655404c3c0 con 0x7f65540656e0 2023-10-08T00:24:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.829+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81440c7860 con 0x7f814406aa40 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.831+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f654c01d630 con 0x7f65540656e0 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.831+0000 7f65497fa700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6538067000 0x7f65380694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.831+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f654c086030 con 0x7f65540656e0 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.832+0000 7f65497fa700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f653806f210 0x7f6538071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.832+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 --> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6538071cd0 con 0x7f653806f210 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.832+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f654c086400 con 0x7f65540656e0 2023-10-08T00:24:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.834+0000 7f6559d4b700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f653806f210 0x7f6538071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.834+0000 7f6559d4b700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f653806f210 0x7f6538071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.835+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== osd.3 v2:172.21.15.22:6816/90849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6538071cd0 con 0x7f653806f210 2023-10-08T00:24:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.838+0000 7f6558d49700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6538067000 0x7f65380694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8140016030 con 0x7f814406aa40 2023-10-08T00:24:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f81397fa700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128066f30 0x7f81280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8140014070 con 0x7f814406aa40 2023-10-08T00:24:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f81397fa700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f812806f140 0x7f8128071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 --> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8128071c00 con 0x7f812806f140 2023-10-08T00:24:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8140085d50 con 0x7f814406aa40 2023-10-08T00:24:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.840+0000 7f8148c7d700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128066f30 0x7f81280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7f6558d49700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6538067000 0x7f65380694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6554156270 tx=0x7f65440090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7f8149c7f700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f812806f140 0x7f8128071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 --> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfe4002d30 con 0x7fcff006f140 2023-10-08T00:24:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 --> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f4c0aa9b0 con 0x7f2f3006f110 2023-10-08T00:24:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7f8148c7d700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128066f30 0x7f81280693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81440c4c10 tx=0x7f81340091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7f8149c7f700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f812806f140 0x7f8128071550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.841+0000 7f2f417fa700 1 -- 172.21.15.22:0/1285145777 <== osd.7 v2:172.21.15.192:6800/91120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f4c0aa9b0 con 0x7f2f3006f110 2023-10-08T00:24:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.842+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f2f3006f110 msgr2=0x7f2f30071520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.842+0000 7f2f5341a700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f2f3006f110 0x7f2f30071520 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.842+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== osd.5 v2:172.21.15.192:6824/91131 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8128071c00 con 0x7f812806f140 2023-10-08T00:24:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.845+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 --> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3ec002cf0 con 0x7fe3f006f140 2023-10-08T00:24:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/509743679 <== osd.0 v2:172.21.15.22:6800/90833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfe4002d30 con 0x7fcff006f140 2023-10-08T00:24:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7fcff006f140 msgr2=0x7fcff0071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd00a0cb700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7fcff006f140 0x7fcff0071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcff0066f30 msgr2=0x7fcff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd00a0cb700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcff0066f30 0x7fcff00693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009c90 tx=0x7fcffc01b000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0040cba20 msgr2=0x7fd00415e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd00a0cb700 1 --2- 172.21.15.22:0/509743679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0040cba20 0x7fd00415e360 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcff400c580 tx=0x7fcff4007e10 comp rx=0 tx=0).stop 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.846+0000 7fd003fff700 1 -- 172.21.15.22:0/509743679 reap_dead start 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.847+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 shutdown_connections 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.847+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 >> 172.21.15.22:0/509743679 conn(0x7fd0040cd000 msgr2=0x7fd004157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.847+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 shutdown_connections 2023-10-08T00:24:58.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7fe3fdffb700 1 -- 172.21.15.22:0/4160727470 <== osd.6 v2:172.21.15.192:6802/91119 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3ec002cf0 con 0x7fe3f006f140 2023-10-08T00:24:58.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f30066f00 msgr2=0x7f2f300693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7f2f5341a700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f30066f00 0x7f2f300693b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c001dc0 tx=0x7f2f3c009040 comp rx=0 tx=0).stop 2023-10-08T00:24:58.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f4c159fb0 msgr2=0x7f2f4c06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7f2f5341a700 1 --2- 172.21.15.22:0/1285145777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f4c159fb0 0x7f2f4c06b960 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009fa0 tx=0x7f2f48009120 comp rx=0 tx=0).stop 2023-10-08T00:24:58.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7fe3f006f140 msgr2=0x7fe3f0071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.848+0000 7fe413f54700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7fe3f006f140 0x7fe3f0071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fd00a0cb700 1 -- 172.21.15.22:0/509743679 wait complete. 2023-10-08T00:24:58.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3f0066fb0 msgr2=0x7fe3f0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe413f54700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3f0066fb0 0x7fe3f0069460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0ad5d0 tx=0x7fe400016000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c0691b0 msgr2=0x7fe40c06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe413f54700 1 --2- 172.21.15.22:0/4160727470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe40c0691b0 0x7fe40c06e960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b5e0 tx=0x7fe408009120 comp rx=0 tx=0).stop 2023-10-08T00:24:58.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe4124f1700 1 -- 172.21.15.22:0/4160727470 reap_dead start 2023-10-08T00:24:58.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 shutdown_connections 2023-10-08T00:24:58.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.850+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 >> 172.21.15.22:0/4160727470 conn(0x7fe40c0cd000 msgr2=0x7fe40c06b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.854+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 shutdown_connections 2023-10-08T00:24:58.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.855+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 --> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fdc0678d0 con 0x7f6fc806f210 2023-10-08T00:24:58.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.855+0000 7f6fc3fff700 1 -- 172.21.15.22:0/3679018515 <== osd.4 v2:172.21.15.192:6814/91118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fdc0678d0 con 0x7f6fc806f210 2023-10-08T00:24:58.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 --> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6554069c50 con 0x7f653806f210 2023-10-08T00:24:58.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f65497fa700 1 -- 172.21.15.22:0/940875909 <== osd.3 v2:172.21.15.22:6816/90849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6554069c50 con 0x7f653806f210 2023-10-08T00:24:58.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 --> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a24002d30 con 0x7f6a2806f190 2023-10-08T00:24:58.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f6fc806f210 msgr2=0x7f6fc8071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f6fc806f210 0x7f6fc8071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6a39ffb700 1 -- 172.21.15.22:0/1386379431 <== osd.1 v2:172.21.15.22:6808/90842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a24002d30 con 0x7f6a2806f190 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6fc8067000 msgr2=0x7f6fc80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6fc8067000 0x7f6fc80694b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc171bc0 tx=0x7f6fd400b040 comp rx=0 tx=0).stop 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fdc068fe0 msgr2=0x7f6fdc14aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 --2- 172.21.15.22:0/3679018515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6fdc068fe0 0x7f6fdc14aa60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0002000 tx=0x7f6fd0016000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe0b27700 1 -- 172.21.15.22:0/3679018515 reap_dead start 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 shutdown_connections 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.856+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 >> 172.21.15.22:0/3679018515 conn(0x7f6fdc0cd000 msgr2=0x7f6fdc14d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 shutdown_connections 2023-10-08T00:24:58.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f2f519b7700 1 -- 172.21.15.22:0/1285145777 reap_dead start 2023-10-08T00:24:58.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f6fe258a700 1 -- 172.21.15.22:0/3679018515 wait complete. 2023-10-08T00:24:58.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 shutdown_connections 2023-10-08T00:24:58.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 >> 172.21.15.22:0/1285145777 conn(0x7f2f4c0cd000 msgr2=0x7f2f4c141f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f653806f210 msgr2=0x7f6538071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f655b7ae700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f653806f210 0x7f6538071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6538067000 msgr2=0x7f65380694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f655b7ae700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6538067000 0x7f65380694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6554156270 tx=0x7f65440090f0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540656e0 msgr2=0x7f655414ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f655b7ae700 1 --2- 172.21.15.22:0/940875909 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65540656e0 0x7f655414ec60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f654c009fd0 tx=0x7f654c017000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f6559d4b700 1 -- 172.21.15.22:0/940875909 reap_dead start 2023-10-08T00:24:58.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f6a2806f190 msgr2=0x7f6a280715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f6a4bc0d700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f6a2806f190 0x7f6a280715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.857+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 --> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95cc0ad310 con 0x7f95b006f210 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28067000 msgr2=0x7f6a280694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28067000 0x7f6a280694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a34006fd0 tx=0x7f6a34009060 comp rx=0 tx=0).stop 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4406af10 msgr2=0x7f6a44154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 --2- 172.21.15.22:0/1386379431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4406af10 0x7f6a44154920 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c950 tx=0x7f6a3c002760 comp rx=0 tx=0).stop 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4a1aa700 1 -- 172.21.15.22:0/1386379431 reap_dead start 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 shutdown_connections 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 >> 172.21.15.22:0/1386379431 conn(0x7f6a440cd640 msgr2=0x7f6a4414ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 shutdown_connections 2023-10-08T00:24:58.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f6a4bc0d700 1 -- 172.21.15.22:0/1386379431 wait complete. 2023-10-08T00:24:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 shutdown_connections 2023-10-08T00:24:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 >> 172.21.15.22:0/940875909 conn(0x7f6554068390 msgr2=0x7f65540b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f95c1ffb700 1 -- 172.21.15.22:0/1919822628 <== osd.2 v2:172.21.15.22:6824/90850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95cc0ad310 con 0x7f95b006f210 2023-10-08T00:24:58.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 shutdown_connections 2023-10-08T00:24:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.858+0000 7f655b7ae700 1 -- 172.21.15.22:0/940875909 wait complete. 2023-10-08T00:24:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.860+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 --> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f814404c3c0 con 0x7f812806f140 2023-10-08T00:24:58.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.860+0000 7fe413f54700 1 -- 172.21.15.22:0/4160727470 wait complete. 2023-10-08T00:24:58.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.860+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f95b006f210 msgr2=0x7f95b0071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.860+0000 7f95d3d45700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f95b006f210 0x7f95b0071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.860+0000 7f81397fa700 1 -- 172.21.15.22:0/3119686022 <== osd.5 v2:172.21.15.192:6824/91131 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f814404c3c0 con 0x7f812806f140 2023-10-08T00:24:58.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f812806f140 msgr2=0x7f8128071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f814b6e2700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f812806f140 0x7f8128071550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128066f30 msgr2=0x7f81280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f814b6e2700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128066f30 0x7f81280693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81440c4c10 tx=0x7f81340091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 msgr2=0x7f81440c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f814b6e2700 1 --2- 172.21.15.22:0/3119686022 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814406aa40 0x7f81440c6e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8140002000 tx=0x7f8140019000 comp rx=0 tx=0).stop 2023-10-08T00:24:58.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.861+0000 7f8149c7f700 1 -- 172.21.15.22:0/3119686022 reap_dead start 2023-10-08T00:24:58.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.862+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 shutdown_connections 2023-10-08T00:24:58.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.865+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 shutdown_connections 2023-10-08T00:24:58.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.865+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 >> 172.21.15.22:0/3119686022 conn(0x7f81440cd670 msgr2=0x7f81440c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.866+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95b0067000 msgr2=0x7f95b00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.866+0000 7f95d3d45700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95b0067000 0x7f95b00694b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95c40076e0 tx=0x7f95c4009840 comp rx=0 tx=0).stop 2023-10-08T00:24:58.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.866+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95cc0b0010 msgr2=0x7f95cc15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:58.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.866+0000 7f95d3d45700 1 --2- 172.21.15.22:0/1919822628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95cc0b0010 0x7f95cc15bc00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f95c800ea50 tx=0x7f95c80091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:58.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.866+0000 7f2f5341a700 1 -- 172.21.15.22:0/1285145777 wait complete. 2023-10-08T00:24:58.930 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:24:58.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T00:24:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.868+0000 7f95d22e2700 1 -- 172.21.15.22:0/1919822628 reap_dead start 2023-10-08T00:24:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.868+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 shutdown_connections 2023-10-08T00:24:58.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.868+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 >> 172.21.15.22:0/1919822628 conn(0x7f95cc06a320 msgr2=0x7f95cc1506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:58.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.869+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 shutdown_connections 2023-10-08T00:24:58.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.869+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 shutdown_connections 2023-10-08T00:24:58.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.869+0000 7f814b6e2700 1 -- 172.21.15.22:0/3119686022 wait complete. 2023-10-08T00:24:58.933 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-08T00:24:58.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T00:24:58.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:58.877+0000 7f95d3d45700 1 -- 172.21.15.22:0/1919822628 wait complete. 2023-10-08T00:24:58.935 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2023-10-08T00:24:58.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T00:24:58.936 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:24:58.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T00:24:58.937 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-08T00:24:58.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T00:24:58.938 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-08T00:24:58.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T00:24:58.939 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-08T00:24:58.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T00:24:58.940 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:24:58.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T00:24:59.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.181+0000 7f3694db3700 1 Processor -- start 2023-10-08T00:24:59.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.181+0000 7f3694db3700 1 -- start start 2023-10-08T00:24:59.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.181+0000 7fe6f6ecf700 1 Processor -- start 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.181+0000 7efc31ca1700 1 Processor -- start 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.181+0000 7efc31ca1700 1 -- start start 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7efc31ca1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc2c155740 0x7efc2c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7efc31ca1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc2c0b0480 0x7efc2c0ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7efc31ca1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0aeec0 con 0x7efc2c0b1f40 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7efc31ca1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0b23b0 con 0x7efc2c0b0480 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7efc31ca1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c1567e0 con 0x7efc2c155740 2023-10-08T00:24:59.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7f3694db3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f36900b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7f3694db3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36900b0010 0x7f369015df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7f3694db3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900b0750 con 0x7f36900b2140 2023-10-08T00:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7f3694db3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900aca70 con 0x7f36900b0010 2023-10-08T00:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.182+0000 7f3694db3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900acd50 con 0x7f36900afc40 2023-10-08T00:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fd7423aa700 1 Processor -- start 2023-10-08T00:24:59.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7efc2affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc2c0b1f40 0x7efc2c0afd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59854/0 (socket says 172.21.15.22:59854) 2023-10-08T00:24:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7efc2affd700 1 -- 172.21.15.22:0/2617785392 learned_addr learned my addr 172.21.15.22:0/2617785392 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f36900b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f36900b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60552/0 (socket says 172.21.15.22:60552) 2023-10-08T00:24:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 -- 172.21.15.22:0/3841237128 learned_addr learned my addr 172.21.15.22:0/3841237128 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.181+0000 7fe6f6ecf700 1 -- start start 2023-10-08T00:24:59.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6f6ecf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe6f00691b0 0x7fe6f00ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368ed9d700 1 --2- 172.21.15.22:0/3841237128 >> v2:172.21.15.192:3300/0 conn(0x7f36900b0010 0x7f369015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6f6ecf700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00b2490 con 0x7fe6f0156050 2023-10-08T00:24:59.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6f6ecf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00ac4e0 con 0x7fe6f00cba20 2023-10-08T00:24:59.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6f6ecf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00aceb0 con 0x7fe6f00691b0 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6f4c6b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe6f00cba20 0x7fe6f0068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34438/0 (socket says 172.21.15.22:34438) 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6f4c6b700 1 -- 172.21.15.22:0/3524021798 learned_addr learned my addr 172.21.15.22:0/3524021798 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fe6e7fff700 1 --2- 172.21.15.22:0/3524021798 >> v2:172.21.15.192:3300/0 conn(0x7fe6f00691b0 0x7fe6f00ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 -- 172.21.15.22:0/3841237128 >> v2:172.21.15.192:3300/0 conn(0x7f36900b0010 msgr2=0x7f369015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 --2- 172.21.15.22:0/3841237128 >> v2:172.21.15.192:3300/0 conn(0x7f36900b0010 0x7f369015df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 -- 172.21.15.22:0/3841237128 >> v1:172.21.15.192:6789/0 conn(0x7f36900b2140 legacy=0x7f369015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f368e59c700 1 -- 172.21.15.22:0/3841237128 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900ad030 con 0x7f36900afc40 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946789183 0 0) 0x7efc2c0aeec0 con 0x7efc2c0b1f40 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc14003570 con 0x7efc2c0b1f40 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e77fe700 1 -- 172.21.15.22:0/3524021798 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664807227 0 0) 0x7fe6f00ac4e0 con 0x7fe6f00cba20 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e77fe700 1 -- 172.21.15.22:0/3524021798 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d8003570 con 0x7fe6f00cba20 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e7fff700 1 -- 172.21.15.22:0/3524021798 >> v1:172.21.15.192:6789/0 conn(0x7fe6f00cba20 legacy=0x7fe6f0068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e7fff700 1 -- 172.21.15.22:0/3524021798 >> v1:172.21.15.22:6789/0 conn(0x7fe6f0156050 legacy=0x7fe6f01564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e7fff700 1 -- 172.21.15.22:0/3524021798 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0156cd0 con 0x7fe6f00691b0 2023-10-08T00:24:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7f368e59c700 1 --2- 172.21.15.22:0/3841237128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f36900b1c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36840099b0 tx=0x7f3684009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5359e20117f73e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e7fff700 1 --2- 172.21.15.22:0/3524021798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 0x7fe6f00ac970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0010c80 tx=0x7fe6e000a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd19692eca2e95cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3234514041 0 0) 0x7efc14003570 con 0x7efc2c0b1f40 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 >> v2:172.21.15.192:3300/0 conn(0x7efc2c155740 msgr2=0x7efc2c155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 --2- 172.21.15.22:0/2617785392 >> v2:172.21.15.192:3300/0 conn(0x7efc2c155740 0x7efc2c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 >> v2:172.21.15.22:3300/0 conn(0x7efc2c0b0480 msgr2=0x7efc2c0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 --2- 172.21.15.22:0/2617785392 >> v2:172.21.15.22:3300/0 conn(0x7efc2c0b0480 0x7efc2c0ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0cc2a0 con 0x7efc2c0b1f40 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7efc240017f0 con 0x7efc2c0b1f40 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 >> v1:172.21.15.22:6789/0 conn(0x7efc2c0b1f40 legacy=0x7efc2c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003b30 0x7efc14003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14004810 0x7efc14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc14005410 0x7efc1400bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b23b0 con 0x7efc14003b30 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1567e0 con 0x7efc14004810 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1400c3c0 con 0x7efc14005410 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7f368d59a700 1 -- 172.21.15.22:0/3841237128 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684009ea0 con 0x7f36900afc40 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7f368d59a700 1 -- 172.21.15.22:0/3841237128 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368400b860 con 0x7f36900afc40 2023-10-08T00:24:59.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7f368d59a700 1 -- 172.21.15.22:0/3841237128 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368400bc00 con 0x7f36900afc40 2023-10-08T00:24:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f323c11b700 1 Processor -- start 2023-10-08T00:24:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7f323c11b700 1 -- start start 2023-10-08T00:24:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7efc2bfff700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc14005410 0x7efc1400bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2affd700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14004810 0x7efc14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.183+0000 7fd7423aa700 1 -- start start 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd7423aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c0691b0 0x7fd73c0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd7423aa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd73c156050 0x7fd73c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd7423aa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c0b2490 con 0x7fd73c0cba20 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd7423aa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c0aceb0 con 0x7fd73c156050 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd7423aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0ac4e0 con 0x7fd73c0691b0 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd73bfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd73c0cba20 0x7fd73c068aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34452/0 (socket says 172.21.15.22:34452) 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd73bfff700 1 -- 172.21.15.22:0/2247804830 learned_addr learned my addr 172.21.15.22:0/2247804830 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fd73b7fe700 1 --2- 172.21.15.22:0/2247804830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c0691b0 0x7fd73c0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2b7fe700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003b30 0x7efc14003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323c11b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234158440 0x7f3234068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323c11b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32340b21b0 0x7f32340ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323c11b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3234069450 con 0x7f3234068fe0 2023-10-08T00:24:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323c11b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32340aef20 con 0x7f32340b21b0 2023-10-08T00:24:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323c11b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323415f260 con 0x7f3234158440 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f32396b6700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3234068fe0 0x7f32340b1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34466/0 (socket says 172.21.15.22:34466) 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f32396b6700 1 -- 172.21.15.22:0/2682639048 learned_addr learned my addr 172.21.15.22:0/2682639048 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 -- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14004810 msgr2=0x7efc14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14004810 0x7efc14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 -- 172.21.15.22:0/2617785392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003b30 msgr2=0x7efc14003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc14003b30 0x7efc14003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 -- 172.21.15.22:0/2617785392 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14003570 con 0x7efc14005410 2023-10-08T00:24:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323a6b8700 1 --2- 172.21.15.22:0/2682639048 >> v2:172.21.15.22:3300/0 conn(0x7f32340b21b0 0x7f32340ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 -- 172.21.15.22:0/2617785392 reap_dead start 2023-10-08T00:24:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f3694db3700 1 -- 172.21.15.22:0/3841237128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 msgr2=0x7f36900b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f3694db3700 1 --2- 172.21.15.22:0/3841237128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f36900b1c00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36840099b0 tx=0x7f3684009250 comp rx=0 tx=0).stop 2023-10-08T00:24:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7efc2bfff700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc14005410 0x7efc1400bb00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0b0880 tx=0x7efc20009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ff524f2eedf710 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323a6b8700 1 -- 172.21.15.22:0/2682639048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234158440 msgr2=0x7f3234068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323a6b8700 1 --2- 172.21.15.22:0/2682639048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234158440 0x7f3234068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323a6b8700 1 -- 172.21.15.22:0/2682639048 >> v1:172.21.15.192:6789/0 conn(0x7f3234068fe0 legacy=0x7f32340b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7f323a6b8700 1 -- 172.21.15.22:0/2682639048 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323415e380 con 0x7f32340b21b0 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3694db3700 1 -- 172.21.15.22:0/3841237128 shutdown_connections 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3694db3700 1 --2- 172.21.15.22:0/3841237128 >> v2:172.21.15.192:3300/0 conn(0x7f36900b0010 0x7f369015df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3694db3700 1 --2- 172.21.15.22:0/3841237128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f36900b1c00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3694db3700 1 -- 172.21.15.22:0/3841237128 >> 172.21.15.22:0/3841237128 conn(0x7f369006a320 msgr2=0x7f36900cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2247804830 >> v2:172.21.15.192:3300/0 conn(0x7fd73c156050 msgr2=0x7fd73c1564d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7fd73b7fe700 1 --2- 172.21.15.22:0/2247804830 >> v2:172.21.15.192:3300/0 conn(0x7fd73c156050 0x7fd73c1564d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2247804830 >> v1:172.21.15.192:6789/0 conn(0x7fd73c0cba20 legacy=0x7fd73c068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.185+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2247804830 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c156a10 con 0x7fd73c0691b0 2023-10-08T00:24:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20012480 con 0x7efc14005410 2023-10-08T00:24:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20012620 con 0x7efc14005410 2023-10-08T00:24:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7efc2a7fc700 1 -- 172.21.15.22:0/2617785392 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200129e0 con 0x7efc14005410 2023-10-08T00:24:59.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7fd73b7fe700 1 --2- 172.21.15.22:0/2247804830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c0691b0 0x7fd73c0ac970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd734009d50 tx=0x7fd734009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4605f3e4c987bbf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f323a6b8700 1 --2- 172.21.15.22:0/2682639048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f32340ab8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f322c009e60 tx=0x7f322c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c1780eb45ccabe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3694db3700 1 -- 172.21.15.22:0/3841237128 shutdown_connections 2023-10-08T00:24:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e77fe700 1 -- 172.21.15.22:0/3524021798 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000bc70 con 0x7fe6f00691b0 2023-10-08T00:24:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e77fe700 1 -- 172.21.15.22:0/3524021798 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e000bdd0 con 0x7fe6f00691b0 2023-10-08T00:24:59.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.184+0000 7fe6e77fe700 1 -- 172.21.15.22:0/3524021798 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0018650 con 0x7fe6f00691b0 2023-10-08T00:24:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/3524021798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 msgr2=0x7fe6f00ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/3524021798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 0x7fe6f00ac970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0010c80 tx=0x7fe6e000a0f0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7fd73affd700 1 -- 172.21.15.22:0/2247804830 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400cc70 con 0x7fd73c0691b0 2023-10-08T00:24:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7fd73affd700 1 -- 172.21.15.22:0/2247804830 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400cdd0 con 0x7fd73c0691b0 2023-10-08T00:24:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7fd73affd700 1 -- 172.21.15.22:0/2247804830 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734011650 con 0x7fd73c0691b0 2023-10-08T00:24:59.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7ff41117b700 1 Processor -- start 2023-10-08T00:24:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7ff41117b700 1 -- start start 2023-10-08T00:24:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3238eb5700 1 -- 172.21.15.22:0/2682639048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00e070 con 0x7f32340b21b0 2023-10-08T00:24:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3238eb5700 1 -- 172.21.15.22:0/2682639048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c00bbf0 con 0x7f32340b21b0 2023-10-08T00:24:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3238eb5700 1 -- 172.21.15.22:0/2682639048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c012430 con 0x7f32340b21b0 2023-10-08T00:24:59.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.186+0000 7f3694db3700 1 -- 172.21.15.22:0/3841237128 wait complete. 2023-10-08T00:24:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 -- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc14005410 msgr2=0x7efc1400bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc14005410 0x7efc1400bb00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0b0880 tx=0x7efc20009060 comp rx=0 tx=0).stop 2023-10-08T00:24:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7f233f6d6700 1 Processor -- start 2023-10-08T00:24:59.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 -- 172.21.15.22:0/2617785392 shutdown_connections 2023-10-08T00:24:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2617785392 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc14005410 0x7efc1400bb00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 -- 172.21.15.22:0/2617785392 >> 172.21.15.22:0/2617785392 conn(0x7efc2c06a320 msgr2=0x7efc2c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7f233f6d6700 1 -- start start 2023-10-08T00:24:59.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 -- 172.21.15.22:0/2617785392 shutdown_connections 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 -- 172.21.15.22:0/2247804830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c0691b0 msgr2=0x7fd73c0ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2247804830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c0691b0 0x7fd73c0ac970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd734009d50 tx=0x7fd734009780 comp rx=0 tx=0).stop 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 -- 172.21.15.22:0/2247804830 shutdown_connections 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2247804830 >> v2:172.21.15.192:3300/0 conn(0x7fd73c156050 0x7fd73c1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2247804830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c0691b0 0x7fd73c0ac970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 -- 172.21.15.22:0/2247804830 >> 172.21.15.22:0/2247804830 conn(0x7fd73c0cd000 msgr2=0x7fd73c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 -- 172.21.15.22:0/2247804830 shutdown_connections 2023-10-08T00:24:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff41117b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff40c15d600 0x7ff40c068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f3694db3700 1 Processor -- start 2023-10-08T00:24:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff41117b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c0ad530 con 0x7ff40c068fe0 2023-10-08T00:24:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff41117b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c15b1d0 con 0x7ff40c0b1d30 2023-10-08T00:24:59.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff41117b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0693f0 con 0x7ff40c15d600 2023-10-08T00:24:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/3524021798 shutdown_connections 2023-10-08T00:24:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/3524021798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 0x7fe6f00ac970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/3524021798 >> 172.21.15.22:0/3524021798 conn(0x7fe6f00cd000 msgr2=0x7fe6f0068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f3694db3700 1 -- start start 2023-10-08T00:24:59.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff40ad9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff40c0b1d30 0x7ff40c15aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34472/0 (socket says 172.21.15.22:34472) 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff40ad9d700 1 -- 172.21.15.22:0/2234451919 learned_addr learned my addr 172.21.15.22:0/2234451919 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7f323c11b700 1 -- 172.21.15.22:0/2682639048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 msgr2=0x7f32340ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7f323c11b700 1 --2- 172.21.15.22:0/2682639048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f32340ab8a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f322c009e60 tx=0x7f322c009780 comp rx=0 tx=0).stop 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f323c11b700 1 -- 172.21.15.22:0/2682639048 shutdown_connections 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f323c11b700 1 --2- 172.21.15.22:0/2682639048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f32340ab8a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f323c11b700 1 --2- 172.21.15.22:0/2682639048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234158440 0x7f3234068aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f323c11b700 1 -- 172.21.15.22:0/2682639048 >> 172.21.15.22:0/2682639048 conn(0x7f32340cd000 msgr2=0x7f3234068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f323c11b700 1 -- 172.21.15.22:0/2682639048 shutdown_connections 2023-10-08T00:24:59.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f323c11b700 1 -- 172.21.15.22:0/2682639048 wait complete. 2023-10-08T00:24:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f233f6d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f23380ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f233f6d6700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380b2490 con 0x7f23380cb7d0 2023-10-08T00:24:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f233f6d6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380ac4e0 con 0x7f23380691b0 2023-10-08T00:24:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7f233f6d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380aceb0 con 0x7f233806f8a0 2023-10-08T00:24:59.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff40a59c700 1 --2- 172.21.15.22:0/2234451919 >> v2:172.21.15.22:3300/0 conn(0x7ff40c15d600 0x7ff40c068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.188+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491879388 0 0) 0x7ff40c15b1d0 con 0x7ff40c0b1d30 2023-10-08T00:24:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f4003570 con 0x7ff40c0b1d30 2023-10-08T00:24:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383384969 0 0) 0x7ff40c0ad530 con 0x7ff40c068fe0 2023-10-08T00:24:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40c15b1d0 con 0x7ff40c068fe0 2023-10-08T00:24:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7efc31ca1700 1 -- 172.21.15.22:0/2617785392 wait complete. 2023-10-08T00:24:59.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7efc31ca1700 1 Processor -- start 2023-10-08T00:24:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f233dc73700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f23380691b0 0x7f2338156050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34484/0 (socket says 172.21.15.22:34484) 2023-10-08T00:24:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f233dc73700 1 -- 172.21.15.22:0/4070403869 learned_addr learned my addr 172.21.15.22:0/4070403869 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/3524021798 shutdown_connections 2023-10-08T00:24:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/3524021798 wait complete. 2023-10-08T00:24:59.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f233d472700 1 --2- 172.21.15.22:0/4070403869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f23380ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.187+0000 7fd7423aa700 1 -- 172.21.15.22:0/2247804830 wait complete. 2023-10-08T00:24:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7fd7423aa700 1 Processor -- start 2023-10-08T00:24:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f493d663700 1 Processor -- start 2023-10-08T00:24:59.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f493d663700 1 -- start start 2023-10-08T00:24:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f232ffff700 1 -- 172.21.15.22:0/4070403869 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310084781 0 0) 0x7f23380ac4e0 con 0x7f23380691b0 2023-10-08T00:24:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f232ffff700 1 -- 172.21.15.22:0/4070403869 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2324003570 con 0x7f23380691b0 2023-10-08T00:24:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f233d472700 1 -- 172.21.15.22:0/4070403869 >> v1:172.21.15.192:6789/0 conn(0x7f23380691b0 legacy=0x7f2338156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f233d472700 1 -- 172.21.15.22:0/4070403869 >> v1:172.21.15.22:6789/0 conn(0x7f23380cb7d0 legacy=0x7f2338068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f233d472700 1 -- 172.21.15.22:0/4070403869 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380abe90 con 0x7f233806f8a0 2023-10-08T00:24:59.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7fd7423aa700 1 -- start start 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f323c11b700 1 Processor -- start 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7efc31ca1700 1 -- start start 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7efc31ca1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14005410 0x7efc2c138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7efc31ca1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 0x7efc2c14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7efc31ca1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc2c1583f0 0x7efc2c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7efc31ca1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c14d360 con 0x7efc2c14c9b0 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7efc31ca1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c152630 con 0x7efc14005410 2023-10-08T00:24:59.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7efc31ca1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c151a20 con 0x7efc2c1583f0 2023-10-08T00:24:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f493d663700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49380691b0 0x7f49380b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f493d663700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493815f260 con 0x7f4938158440 2023-10-08T00:24:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f493d663700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493815e380 con 0x7f49380b1fe0 2023-10-08T00:24:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f493d663700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49380aef20 con 0x7f49380691b0 2023-10-08T00:24:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 0x7efc2c14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f3694db3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f369013de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f3694db3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 0x7f36900adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f3694db3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36900b2140 0x7f36900ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f3694db3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690160ac0 con 0x7f36900b0010 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f3694db3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690151d20 con 0x7f36900b2140 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7f3694db3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369015feb0 con 0x7f36900afc40 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 0x7f36900adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 0x7f36900adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60294/0 (socket says 172.21.15.22:60294) 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 -- 172.21.15.22:0/3440145701 learned_addr learned my addr 172.21.15.22:0/3440145701 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368e59c700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f369013de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 -- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 msgr2=0x7f369013de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 873437691 0 0) 0x7ff3f4003570 con 0x7ff40c0b1d30 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff40a59c700 1 -- 172.21.15.22:0/2234451919 >> v1:172.21.15.192:6789/0 conn(0x7ff40c0b1d30 legacy=0x7ff40c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff40a59c700 1 -- 172.21.15.22:0/2234451919 >> v1:172.21.15.22:6789/0 conn(0x7ff40c068fe0 legacy=0x7ff40c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff40a59c700 1 -- 172.21.15.22:0/2234451919 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c15db00 con 0x7ff40c15d600 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.189+0000 7ff40a59c700 1 --2- 172.21.15.22:0/2234451919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c068aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff400009860 tx=0x7ff4000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf230ec330b32043 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc001470 con 0x7ff40c15d600 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff400011420 con 0x7ff40c15d600 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7ff409d9b700 1 -- 172.21.15.22:0/2234451919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000117c0 con 0x7ff40c15d600 2023-10-08T00:24:59.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fe6f6ecf700 1 Processor -- start 2023-10-08T00:24:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f369013de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 -- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36900b2140 msgr2=0x7f36900ae230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T00:24:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36900b2140 0x7f36900ae230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f368dd9b700 1 -- 172.21.15.22:0/3440145701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840094f0 con 0x7f36900b0010 2023-10-08T00:24:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f233d472700 1 --2- 172.21.15.22:0/4070403869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f23380ac970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2334009910 tx=0x7f23340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e47bbad75c8768d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 0x7efc2c14ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60310/0 (socket says 172.21.15.22:60310) 2023-10-08T00:24:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 -- 172.21.15.22:0/2776256970 learned_addr learned my addr 172.21.15.22:0/2776256970 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7ff41117b700 1 -- 172.21.15.22:0/2234451919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 msgr2=0x7ff40c068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7ff41117b700 1 --2- 172.21.15.22:0/2234451919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c068aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff400009860 tx=0x7ff4000091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f49367fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49380691b0 0x7f49380b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f49377fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f49380b1fe0 0x7f49380ab8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34490/0 (socket says 172.21.15.22:34490) 2023-10-08T00:24:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f49377fe700 1 -- 172.21.15.22:0/2386857810 learned_addr learned my addr 172.21.15.22:0/2386857810 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:24:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2b7fe700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14005410 0x7efc2c138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd7423aa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd73c0691b0 0x7fd73c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd7423aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 0x7fd73c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd7423aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c156050 0x7fd73c15a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd7423aa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0a5e20 con 0x7fd73c0691b0 2023-10-08T00:24:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd7423aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0a5560 con 0x7fd73c0cba20 2023-10-08T00:24:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd7423aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0a57d0 con 0x7fd73c156050 2023-10-08T00:24:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2bfff700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc2c1583f0 0x7efc2c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd73b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 0x7fd73c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd73b7fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 0x7fd73c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57758/0 (socket says 172.21.15.22:57758) 2023-10-08T00:24:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2679305127 learned_addr learned my addr 172.21.15.22:0/2679305127 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f232ffff700 1 -- 172.21.15.22:0/4070403869 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400b6d0 con 0x7f233806f8a0 2023-10-08T00:24:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f232ffff700 1 -- 172.21.15.22:0/4070403869 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233400b830 con 0x7f233806f8a0 2023-10-08T00:24:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f232ffff700 1 -- 172.21.15.22:0/4070403869 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400bbf0 con 0x7f233806f8a0 2023-10-08T00:24:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 -- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc2c1583f0 msgr2=0x7efc2c158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc2c1583f0 0x7efc2c158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 -- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14005410 msgr2=0x7efc2c138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f4935ffb700 1 -- 172.21.15.22:0/2386857810 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205052444 0 0) 0x7f493815e380 con 0x7f49380b1fe0 2023-10-08T00:24:59.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f4935ffb700 1 -- 172.21.15.22:0/2386857810 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4920003570 con 0x7f49380b1fe0 2023-10-08T00:24:59.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14005410 0x7efc2c138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7efc2affd700 1 -- 172.21.15.22:0/2776256970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c151d00 con 0x7efc2c14c9b0 2023-10-08T00:24:59.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd73bfff700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd73c0691b0 0x7fd73c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f49367fc700 1 -- 172.21.15.22:0/2386857810 >> v1:172.21.15.192:6789/0 conn(0x7f49380b1fe0 legacy=0x7f49380ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f49367fc700 1 -- 172.21.15.22:0/2386857810 >> v1:172.21.15.22:6789/0 conn(0x7f4938158440 legacy=0x7f4938068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:24:59.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f49367fc700 1 -- 172.21.15.22:0/2386857810 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493815e650 con 0x7f49380691b0 2023-10-08T00:24:59.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fd740947700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c156050 0x7fd73c15a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7fe6f6ecf700 1 -- start start 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c156050 msgr2=0x7fd73c15a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73b7fe700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c156050 0x7fd73c15a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2679305127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd73c0691b0 msgr2=0x7fd73c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73b7fe700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd73c0691b0 0x7fd73c0ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73b7fe700 1 -- 172.21.15.22:0/2679305127 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73400d040 con 0x7fd73c0cba20 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.190+0000 7f323c11b700 1 -- start start 2023-10-08T00:24:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f323c11b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234068fe0 0x7f323406d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.191+0000 7f323c11b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f323414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f323c11b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234158440 0x7f323414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f323c11b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323414ffc0 con 0x7f32340b21b0 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f323c11b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323406eba0 con 0x7f3234158440 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f323c11b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323406df90 con 0x7f3234068fe0 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f49367fc700 1 --2- 172.21.15.22:0/2386857810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f49380b1aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49280098e0 tx=0x7f49280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4e984904a665fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73bfff700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd73c0691b0 0x7fd73c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7ff41117b700 1 -- 172.21.15.22:0/2234451919 shutdown_connections 2023-10-08T00:24:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7ff41117b700 1 --2- 172.21.15.22:0/2234451919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c068aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7ff41117b700 1 -- 172.21.15.22:0/2234451919 >> 172.21.15.22:0/2234451919 conn(0x7ff40c0cd000 msgr2=0x7ff40c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f3239eb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234068fe0 0x7f323406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f3239eb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234068fe0 0x7f323406d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60634/0 (socket says 172.21.15.22:60634) 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f323a6b8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234158440 0x7f323414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f3239eb7700 1 -- 172.21.15.22:0/3523943329 learned_addr learned my addr 172.21.15.22:0/3523943329 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f32396b6700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f323414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7efc2affd700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 0x7efc2c14ce20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc2400ed70 tx=0x7efc2c156920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7efc2bfff700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc2c1583f0 0x7efc2c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:24:59.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd73b7fe700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 0x7fd73c1511c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0acff0 tx=0x7fd73401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f4935ffb700 1 -- 172.21.15.22:0/2386857810 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928011630 con 0x7f49380691b0 2023-10-08T00:24:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f233f6d6700 1 -- 172.21.15.22:0/4070403869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 msgr2=0x7f23380ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f233f6d6700 1 --2- 172.21.15.22:0/4070403869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f23380ac970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2334009910 tx=0x7f23340091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f4935ffb700 1 -- 172.21.15.22:0/2386857810 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928011790 con 0x7f49380691b0 2023-10-08T00:24:59.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f4935ffb700 1 -- 172.21.15.22:0/2386857810 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928011b30 con 0x7f49380691b0 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fe6f6ecf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 0x7fe6f00a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fe6f6ecf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6f00cba20 0x7fe6f0152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fe6f6ecf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 0x7fe6f015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fe6f6ecf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00a54c0 con 0x7fe6f00cba20 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fe6f6ecf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f015a800 con 0x7fe6f00691b0 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fe6f6ecf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f00a5710 con 0x7fe6f0156050 2023-10-08T00:24:59.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f368dd9b700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 0x7f36900adcf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f368000c510 tx=0x7f368000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011590 con 0x7f36900b0010 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3680011710 con 0x7f36900b0010 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680011ad0 con 0x7f36900b0010 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3690160190 con 0x7f36900b0010 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690160750 con 0x7f36900b0010 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f32396b6700 1 -- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234068fe0 msgr2=0x7f323406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f32396b6700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234068fe0 0x7f323406d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f32396b6700 1 -- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234158440 msgr2=0x7f323414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f32396b6700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234158440 0x7f323414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7f32396b6700 1 -- 172.21.15.22:0/3523943329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009a20 con 0x7f32340b21b0 2023-10-08T00:24:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734020070 con 0x7fd73c0cba20 2023-10-08T00:24:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd734011e70 con 0x7fd73c0cba20 2023-10-08T00:24:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73401a890 con 0x7fd73c0cba20 2023-10-08T00:24:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7f32396b6700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f323414fa80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f323000c530 tx=0x7f3230007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 0x7fe6f015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 0x7fe6f015b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60650/0 (socket says 172.21.15.22:60650) 2023-10-08T00:24:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 -- 172.21.15.22:0/1693187267 learned_addr learned my addr 172.21.15.22:0/1693187267 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7f493d663700 1 -- 172.21.15.22:0/2386857810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 msgr2=0x7f49380b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7f493d663700 1 --2- 172.21.15.22:0/2386857810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f49380b1aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49280098e0 tx=0x7f49280091a0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 -- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 msgr2=0x7fe6f00a8a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T00:24:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 0x7fe6f00a8a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 -- 172.21.15.22:0/1693187267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6f00cba20 msgr2=0x7fe6f0152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6f00cba20 0x7fe6f0152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 -- 172.21.15.22:0/1693187267 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00107c0 con 0x7fe6f0156050 2023-10-08T00:24:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c0a5ab0 con 0x7fd73c0cba20 2023-10-08T00:24:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c06f7f0 con 0x7fd73c0cba20 2023-10-08T00:24:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7f493d663700 1 -- 172.21.15.22:0/2386857810 shutdown_connections 2023-10-08T00:24:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7f493d663700 1 --2- 172.21.15.22:0/2386857810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f49380b1aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7f493d663700 1 -- 172.21.15.22:0/2386857810 >> 172.21.15.22:0/2386857810 conn(0x7f49380cd000 msgr2=0x7f4938068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7fe6f546c700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 0x7fe6f015b440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800bbb0 tx=0x7fe6e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400cb00 con 0x7efc2c14c9b0 2023-10-08T00:24:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400cc60 con 0x7efc2c14c9b0 2023-10-08T00:24:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.192+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24014470 con 0x7efc2c14c9b0 2023-10-08T00:24:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c151fe0 con 0x7efc2c14c9b0 2023-10-08T00:24:59.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.193+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c1393d0 con 0x7efc2c14c9b0 2023-10-08T00:24:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7ff41117b700 1 -- 172.21.15.22:0/2234451919 shutdown_connections 2023-10-08T00:24:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7ff41117b700 1 -- 172.21.15.22:0/2234451919 wait complete. 2023-10-08T00:24:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f233f6d6700 1 -- 172.21.15.22:0/4070403869 shutdown_connections 2023-10-08T00:24:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f233f6d6700 1 --2- 172.21.15.22:0/4070403869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f23380ac970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f233f6d6700 1 -- 172.21.15.22:0/4070403869 >> 172.21.15.22:0/4070403869 conn(0x7f23380cd000 msgr2=0x7f2338068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c0a5c70 con 0x7fd73c0cba20 2023-10-08T00:24:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f233f6d6700 1 -- 172.21.15.22:0/4070403869 shutdown_connections 2023-10-08T00:24:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c1527a0 con 0x7efc2c14c9b0 2023-10-08T00:24:59.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f493d663700 1 -- 172.21.15.22:0/2386857810 shutdown_connections 2023-10-08T00:24:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f493d663700 1 -- 172.21.15.22:0/2386857810 wait complete. 2023-10-08T00:24:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f233f6d6700 1 -- 172.21.15.22:0/4070403869 wait complete. 2023-10-08T00:24:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e80092e0 con 0x7fe6f0156050 2023-10-08T00:24:59.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800c7a0 con 0x7fe6f0156050 2023-10-08T00:24:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800cb40 con 0x7fe6f0156050 2023-10-08T00:24:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.195+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230005b30 con 0x7f32340b21b0 2023-10-08T00:24:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.195+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230005c90 con 0x7f32340b21b0 2023-10-08T00:24:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.195+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230007320 con 0x7f32340b21b0 2023-10-08T00:24:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.195+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323406e270 con 0x7f32340b21b0 2023-10-08T00:24:59.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.195+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323406e830 con 0x7f32340b21b0 2023-10-08T00:24:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.194+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36740052b0 con 0x7f36900b0010 2023-10-08T00:24:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7f233f6d6700 1 Processor -- start 2023-10-08T00:24:59.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc2401e440 con 0x7efc2c14c9b0 2023-10-08T00:24:59.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7f493d663700 1 Processor -- start 2023-10-08T00:24:59.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd73401ac00 con 0x7fd73c0cba20 2023-10-08T00:24:59.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7fd723fff700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd728067080 0x7fd728069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd734086750 con 0x7fd73c0cba20 2023-10-08T00:24:59.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7fd73bfff700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd728067080 0x7fd728069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7efc137fe700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc18067030 0x7efc180694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc24084400 con 0x7efc2c14c9b0 2023-10-08T00:24:59.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7f493d663700 1 -- start start 2023-10-08T00:24:59.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32140052b0 con 0x7f32340b21b0 2023-10-08T00:24:59.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f00a59f0 con 0x7fe6f0156050 2023-10-08T00:24:59.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f00a5fb0 con 0x7fe6f0156050 2023-10-08T00:24:59.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7ff41117b700 1 Processor -- start 2023-10-08T00:24:59.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7efc2b7fe700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc18067030 0x7efc180694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f493d663700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f493816ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f493d663700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49380b1fe0 0x7f4938154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f493d663700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4938158440 0x7f493815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f493d663700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493816e840 con 0x7f49380b1fe0 2023-10-08T00:24:59.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f493d663700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493816e230 con 0x7f49380691b0 2023-10-08T00:24:59.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f493d663700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493815ab70 con 0x7f4938158440 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7fd73bfff700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd728067080 0x7fd728069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd730006160 tx=0x7fd73000a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.196+0000 7f233f6d6700 1 -- start start 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233f6d6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23380691b0 0x7f2338148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233f6d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f2338144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233f6d6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 0x7f233816ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233f6d6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2338146b60 con 0x7f23380691b0 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233f6d6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2338144f70 con 0x7f23380cb7d0 2023-10-08T00:24:59.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233f6d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2338145d90 con 0x7f233806f8a0 2023-10-08T00:24:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f49377fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4938158440 0x7f493815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233dc73700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 0x7f233816ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233dc73700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 0x7f233816ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57784/0 (socket says 172.21.15.22:57784) 2023-10-08T00:24:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233dc73700 1 -- 172.21.15.22:0/379669203 learned_addr learned my addr 172.21.15.22:0/379669203 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f233cc71700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f2338144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f4936ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f493816ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f49377fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4938158440 0x7f493815a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60666/0 (socket says 172.21.15.22:60666) 2023-10-08T00:24:59.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f49377fe700 1 -- 172.21.15.22:0/1055525879 learned_addr learned my addr 172.21.15.22:0/1055525879 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f233dc73700 1 -- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 msgr2=0x7f2338144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f233dc73700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f2338144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f233dc73700 1 -- 172.21.15.22:0/379669203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23380691b0 msgr2=0x7f2338148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f233dc73700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23380691b0 0x7f2338148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f233dc73700 1 -- 172.21.15.22:0/379669203 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009420 con 0x7f23380cb7d0 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f4936ffd700 1 -- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4938158440 msgr2=0x7f493815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f4936ffd700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4938158440 0x7f493815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f4936ffd700 1 -- 172.21.15.22:0/1055525879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49380b1fe0 msgr2=0x7f4938154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f4936ffd700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49380b1fe0 0x7f4938154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f4936ffd700 1 -- 172.21.15.22:0/1055525879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009420 con 0x7f49380691b0 2023-10-08T00:24:59.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7efc2b7fe700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc18067030 0x7efc180694e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0665c0 tx=0x7efc1c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f233dc73700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 0x7f233816ddd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f233000cb90 tx=0x7f2330001950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f4936ffd700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f493816ecd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f492c00b510 tx=0x7f492c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7ff41117b700 1 -- start start 2023-10-08T00:24:59.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff41117b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff40c068fe0 0x7ff40c154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff41117b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c0b1d30 0x7ff40c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff41117b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c0c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff41117b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c155c40 con 0x7ff40c15d600 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff41117b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c1560d0 con 0x7ff40c0b1d30 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff41117b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c155030 con 0x7ff40c068fe0 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff40ad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff40c068fe0 0x7ff40c154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff40ad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff40c068fe0 0x7ff40c154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60672/0 (socket says 172.21.15.22:60672) 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7ff40ad9d700 1 -- 172.21.15.22:0/4071775102 learned_addr learned my addr 172.21.15.22:0/4071775102 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f368001b3b0 con 0x7f36900b0010 2023-10-08T00:24:59.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f367e7fc700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3670066f30 0x7f36700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.197+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36800839b0 con 0x7f36900b0010 2023-10-08T00:24:59.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f368e59c700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3670066f30 0x7f36700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.198+0000 7f368e59c700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3670066f30 0x7f36700693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36840099b0 tx=0x7f3684017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c0c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40a59c700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c0b1d30 0x7ff40c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f004c3c0 con 0x7fe6f0156050 2023-10-08T00:24:59.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6e8012070 con 0x7fe6f0156050 2023-10-08T00:24:59.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 -- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff40c068fe0 msgr2=0x7ff40c154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff40c068fe0 0x7ff40c154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 -- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c0b1d30 msgr2=0x7ff40c151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c0b1d30 0x7ff40c151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 -- 172.21.15.22:0/4071775102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009420 con 0x7ff40c15d600 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40a59c700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c0b1d30 0x7ff40c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7ff40b59e700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c0c9910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c8e0 tx=0x7ff4040026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7fe6e4ff9700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe6dc067000 0x7fe6dc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f323001b3b0 con 0x7f32340b21b0 2023-10-08T00:24:59.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.199+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6e8084250 con 0x7fe6f0156050 2023-10-08T00:24:59.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.200+0000 7fe6f4c6b700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe6dc067000 0x7fe6dc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.200+0000 7f3229ffb700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3218067000 0x7f32180694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.200+0000 7f3239eb7700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3218067000 0x7f32180694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.200+0000 7fe6f4c6b700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe6dc067000 0x7fe6dc0694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec006160 tx=0x7fe6ec005cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.200+0000 7f3239eb7700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3218067000 0x7f32180694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3224009c00 tx=0x7f32240091d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233000a8b0 con 0x7f23380cb7d0 2023-10-08T00:24:59.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00f510 con 0x7f49380691b0 2023-10-08T00:24:59.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233000aa10 con 0x7f23380cb7d0 2023-10-08T00:24:59.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2338145180 con 0x7f23380cb7d0 2023-10-08T00:24:59.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233000ad90 con 0x7f23380cb7d0 2023-10-08T00:24:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd734053920 con 0x7fd73c0cba20 2023-10-08T00:24:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00f690 con 0x7f49380691b0 2023-10-08T00:24:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00fa50 con 0x7f49380691b0 2023-10-08T00:24:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.201+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2338145740 con 0x7f23380cb7d0 2023-10-08T00:24:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.202+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493816e4d0 con 0x7f49380691b0 2023-10-08T00:24:59.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.202+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233804c3c0 con 0x7f23380cb7d0 2023-10-08T00:24:59.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.202+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4938154f40 con 0x7f49380691b0 2023-10-08T00:24:59.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.203+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc240516f0 con 0x7efc2c14c9b0 2023-10-08T00:24:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.202+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404012630 con 0x7ff40c15d600 2023-10-08T00:24:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.203+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c155310 con 0x7ff40c15d600 2023-10-08T00:24:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.203+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c1558d0 con 0x7ff40c15d600 2023-10-08T00:24:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.202+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3230054cb0 con 0x7f32340b21b0 2023-10-08T00:24:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.203+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2330007300 con 0x7f23380cb7d0 2023-10-08T00:24:59.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.203+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493816eb20 con 0x7f49380691b0 2023-10-08T00:24:59.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.203+0000 7f232d7fa700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f231c066f30 0x7f231c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.204+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c155db0 con 0x7ff40c15d600 2023-10-08T00:24:59.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.204+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2330084810 con 0x7f23380cb7d0 2023-10-08T00:24:59.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.204+0000 7f233d472700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f231c066f30 0x7f231c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.204+0000 7f233d472700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f231c066f30 0x7f231c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23340091e0 tx=0x7f2334016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.207+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6e8051540 con 0x7fe6f0156050 2023-10-08T00:24:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.207+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f492c01a400 con 0x7f49380691b0 2023-10-08T00:24:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.207+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3680050c20 con 0x7f36900b0010 2023-10-08T00:24:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.208+0000 7f491effd700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.208+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f492c083ed0 con 0x7f49380691b0 2023-10-08T00:24:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.208+0000 7f49367fc700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.208+0000 7f49367fc700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4924066f30 0x7f49240693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49380aa650 tx=0x7f4928016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.209+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2330051b00 con 0x7f23380cb7d0 2023-10-08T00:24:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.214+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f492c0511c0 con 0x7f49380691b0 2023-10-08T00:24:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.217+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3230050ff0 con 0x7f32340b21b0 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.217+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4040129a0 con 0x7ff40c15d600 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.217+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404012b50 con 0x7ff40c15d600 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.218+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff404024420 con 0x7ff40c15d600 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.218+0000 7ff3f2ffd700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff3f8066f30 0x7ff3f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.218+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff404084af0 con 0x7ff40c15d600 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.219+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4040af620 con 0x7ff40c15d600 2023-10-08T00:24:59.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.227+0000 7ff40ad9d700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff3f8066f30 0x7ff3f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:24:59.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.259+0000 7ff40ad9d700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff3f8066f30 0x7ff3f80693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc004e30 tx=0x7ff3fc001ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:24:59.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.604+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd73c04c3c0 con 0x7fd73c0cba20 2023-10-08T00:24:59.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.607+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3674005830 con 0x7f36900b0010 2023-10-08T00:24:59.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.607+0000 7fd723fff700 1 -- 172.21.15.22:0/2679305127 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd734010360 con 0x7fd73c0cba20 2023-10-08T00:24:59.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.607+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc2c04c3c0 con 0x7efc2c14c9b0 2023-10-08T00:24:59.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.607+0000 7f367e7fc700 1 -- 172.21.15.22:0/3440145701 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3680017070 con 0x7f36900b0010 2023-10-08T00:24:59.608 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-08T00:24:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.610+0000 7efc137fe700 1 -- 172.21.15.22:0/2776256970 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc24019020 con 0x7efc2c14c9b0 2023-10-08T00:24:59.611 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2023-10-08T00:24:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.609+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2338157150 con 0x7f23380cb7d0 2023-10-08T00:24:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.609+0000 7f232d7fa700 1 -- 172.21.15.22:0/379669203 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2338157150 con 0x7f23380cb7d0 2023-10-08T00:24:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.610+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3670066f30 msgr2=0x7f36700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.610+0000 7f3694db3700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3670066f30 0x7f36700693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f36840099b0 tx=0x7f3684017000 comp rx=0 tx=0).stop 2023-10-08T00:24:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.610+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 msgr2=0x7f36900adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.610+0000 7f3694db3700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 0x7f36900adcf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f368000c510 tx=0x7f368000c8d0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.612 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2023-10-08T00:24:59.612 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2023-10-08T00:24:59.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc18067030 msgr2=0x7efc180694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc18067030 0x7efc180694e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0665c0 tx=0x7efc1c009060 comp rx=0 tx=0).stop 2023-10-08T00:24:59.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 msgr2=0x7efc2c14ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 0x7efc2c14ce20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc2400ed70 tx=0x7efc2c156920 comp rx=0 tx=0).stop 2023-10-08T00:24:59.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 shutdown_connections 2023-10-08T00:24:59.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36900b2140 0x7f36900ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3670066f30 0x7f36700693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36900afc40 0x7f369013de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 --2- 172.21.15.22:0/3440145701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36900b0010 0x7f36900adcf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 >> 172.21.15.22:0/3440145701 conn(0x7f369006a320 msgr2=0x7f3690153210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd728067080 msgr2=0x7fd728069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd728067080 0x7fd728069530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd730006160 tx=0x7fd73000a250 comp rx=0 tx=0).stop 2023-10-08T00:24:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 msgr2=0x7fd73c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 0x7fd73c1511c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0acff0 tx=0x7fd73401a000 comp rx=0 tx=0).stop 2023-10-08T00:24:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f231c066f30 msgr2=0x7f231c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f231c066f30 0x7f231c0693e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23340091e0 tx=0x7f2334016000 comp rx=0 tx=0).stop 2023-10-08T00:24:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 msgr2=0x7f233816ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 0x7f233816ddd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f233000cb90 tx=0x7f2330001950 comp rx=0 tx=0).stop 2023-10-08T00:24:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 shutdown_connections 2023-10-08T00:24:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd728067080 0x7fd728069530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd73c156050 0x7fd73c15a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd73c0691b0 0x7fd73c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 --2- 172.21.15.22:0/2679305127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73c0cba20 0x7fd73c1511c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 >> 172.21.15.22:0/2679305127 conn(0x7fd73c0cd000 msgr2=0x7fd73c154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f493804c3c0 con 0x7f49380691b0 2023-10-08T00:24:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 shutdown_connections 2023-10-08T00:24:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23380cb7d0 0x7f233816ddd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23380691b0 0x7f2338148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f231c066f30 0x7f231c0693e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 --2- 172.21.15.22:0/379669203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f233806f8a0 0x7f2338144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 >> 172.21.15.22:0/379669203 conn(0x7f23380cd000 msgr2=0x7f233806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 shutdown_connections 2023-10-08T00:24:59.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 shutdown_connections 2023-10-08T00:24:59.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.614+0000 7f233f6d6700 1 -- 172.21.15.22:0/379669203 wait complete. 2023-10-08T00:24:59.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 shutdown_connections 2023-10-08T00:24:59.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7f3694db3700 1 -- 172.21.15.22:0/3440145701 wait complete. 2023-10-08T00:24:59.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 shutdown_connections 2023-10-08T00:24:59.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc18067030 0x7efc180694e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc2c1583f0 0x7efc2c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc14005410 0x7efc2c138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 --2- 172.21.15.22:0/2776256970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc2c14c9b0 0x7efc2c14ce20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 >> 172.21.15.22:0/2776256970 conn(0x7efc2c06a320 msgr2=0x7efc2c156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7fd7423aa700 1 -- 172.21.15.22:0/2679305127 wait complete. 2023-10-08T00:24:59.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 shutdown_connections 2023-10-08T00:24:59.625 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:24:59.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7f491effd700 1 -- 172.21.15.22:0/1055525879 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f492c0547e0 con 0x7f49380691b0 2023-10-08T00:24:59.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.615+0000 7efc31ca1700 1 -- 172.21.15.22:0/2776256970 wait complete. 2023-10-08T00:24:59.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.617+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4924066f30 msgr2=0x7f49240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.617+0000 7f493d663700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4924066f30 0x7f49240693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49380aa650 tx=0x7f4928016000 comp rx=0 tx=0).stop 2023-10-08T00:24:59.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.617+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 msgr2=0x7f493816ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.617+0000 7f493d663700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f493816ecd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f492c00b510 tx=0x7f492c009060 comp rx=0 tx=0).stop 2023-10-08T00:24:59.627 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:24:59.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.624+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff40c04c3c0 con 0x7ff40c15d600 2023-10-08T00:24:59.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.625+0000 7ff3f2ffd700 1 -- 172.21.15.22:0/4071775102 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff404016020 con 0x7ff40c15d600 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.628+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff3f8066f30 msgr2=0x7ff3f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.628+0000 7ff41117b700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff3f8066f30 0x7ff3f80693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc004e30 tx=0x7ff3fc001ab0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.628+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 msgr2=0x7ff40c0c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.628+0000 7ff41117b700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c0c9910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c8e0 tx=0x7ff4040026f0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 shutdown_connections 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7ff41117b700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff40c15d600 0x7ff40c0c9910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7ff41117b700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff3f8066f30 0x7ff3f80693e0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc004e30 tx=0x7ff3fc001ab0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7ff41117b700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff40c068fe0 0x7ff40c154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7ff41117b700 1 --2- 172.21.15.22:0/4071775102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c0b1d30 0x7ff40c151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 >> 172.21.15.22:0/4071775102 conn(0x7ff40c0cd000 msgr2=0x7ff40c159420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe6f00ad410 con 0x7fe6f0156050 2023-10-08T00:24:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 shutdown_connections 2023-10-08T00:24:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7f493d663700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4924066f30 0x7f49240693e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7f493d663700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4938158440 0x7f493815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7f493d663700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49380691b0 0x7f493816ecd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7f493d663700 1 --2- 172.21.15.22:0/1055525879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49380b1fe0 0x7f4938154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.629+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 >> 172.21.15.22:0/1055525879 conn(0x7f49380cd000 msgr2=0x7f4938156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.630+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 shutdown_connections 2023-10-08T00:24:59.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.630+0000 7f493d663700 1 -- 172.21.15.22:0/1055525879 wait complete. 2023-10-08T00:24:59.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.630+0000 7fe6e4ff9700 1 -- 172.21.15.22:0/1693187267 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6e8054b60 con 0x7fe6f0156050 2023-10-08T00:24:59.632 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-08T00:24:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.633+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 shutdown_connections 2023-10-08T00:24:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.633+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3214005830 con 0x7f32340b21b0 2023-10-08T00:24:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.633+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe6dc067000 msgr2=0x7fe6dc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.633+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe6dc067000 0x7fe6dc0694b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec006160 tx=0x7fe6ec005cb0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.633+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 msgr2=0x7fe6f015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.633+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 0x7fe6f015b440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800bbb0 tx=0x7fe6e8009840 comp rx=0 tx=0).stop 2023-10-08T00:24:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7f3229ffb700 1 -- 172.21.15.22:0/3523943329 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3230017020 con 0x7f32340b21b0 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 shutdown_connections 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe6dc067000 0x7fe6dc0694b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6f0156050 0x7fe6f015b440 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6f00691b0 0x7fe6f00a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 --2- 172.21.15.22:0/1693187267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6f00cba20 0x7fe6f0152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 >> 172.21.15.22:0/1693187267 conn(0x7fe6f00cd000 msgr2=0x7fe6f00ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.635 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-08T00:24:59.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 shutdown_connections 2023-10-08T00:24:59.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.634+0000 7fe6f6ecf700 1 -- 172.21.15.22:0/1693187267 wait complete. 2023-10-08T00:24:59.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-08T00:24:59.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-10-08T00:24:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7ff41117b700 1 -- 172.21.15.22:0/4071775102 wait complete. 2023-10-08T00:24:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3218067000 msgr2=0x7f32180694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3218067000 0x7f32180694b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3224009c00 tx=0x7f32240091d0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 msgr2=0x7f323414fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:24:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f323414fa80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f323000c530 tx=0x7f3230007f90 comp rx=0 tx=0).stop 2023-10-08T00:24:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 shutdown_connections 2023-10-08T00:24:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3234158440 0x7f323414b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3218067000 0x7f32180694b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3234068fe0 0x7f323406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 --2- 172.21.15.22:0/3523943329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32340b21b0 0x7f323414fa80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:24:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 >> 172.21.15.22:0/3523943329 conn(0x7f32340cd000 msgr2=0x7f323415f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:24:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 shutdown_connections 2023-10-08T00:24:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:24:59.639+0000 7f323c11b700 1 -- 172.21.15.22:0/3523943329 wait complete. 2023-10-08T00:24:59.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2023-10-08T00:24:59.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2023-10-08T00:24:59.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-08T00:24:59.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-10-08T00:24:59.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-10-08T00:24:59.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-08T00:25:00.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:25:00.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:25:00.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T00:25:00.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T00:25:00.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T00:25:00.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T00:25:00.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T00:25:00.654 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T00:25:00.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T00:25:00.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T00:25:00.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.836+0000 7f54cb319700 1 Processor -- start 2023-10-08T00:25:00.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.838+0000 7f1a85760700 1 Processor -- start 2023-10-08T00:25:00.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.836+0000 7f54cb319700 1 -- start start 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.837+0000 7f54cb319700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 0x7f54c40ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.837+0000 7f54cb319700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40b2490 con 0x7f54c40691b0 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.837+0000 7f54cb319700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c40ac4e0 con 0x7f54c40cba20 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.837+0000 7f54cb319700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c40aceb0 con 0x7f54c4156760 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.838+0000 7f54c98b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 0x7f54c40ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.838+0000 7f54c98b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 0x7f54c40ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60678/0 (socket says 172.21.15.22:60678) 2023-10-08T00:25:00.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.838+0000 7f54c98b6700 1 -- 172.21.15.22:0/2887030158 learned_addr learned my addr 172.21.15.22:0/2887030158 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f54bbfff700 1 -- 172.21.15.22:0/2887030158 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906903143 0 0) 0x7f54c40ac4e0 con 0x7f54c40cba20 2023-10-08T00:25:00.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f54bbfff700 1 -- 172.21.15.22:0/2887030158 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b0003570 con 0x7f54c40cba20 2023-10-08T00:25:00.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f54c98b6700 1 -- 172.21.15.22:0/2887030158 >> v1:172.21.15.192:6789/0 conn(0x7f54c40cba20 legacy=0x7f54c4068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f54c98b6700 1 -- 172.21.15.22:0/2887030158 >> v1:172.21.15.22:6789/0 conn(0x7f54c40691b0 legacy=0x7f54c4156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f54c98b6700 1 -- 172.21.15.22:0/2887030158 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4156cd0 con 0x7f54c4156760 2023-10-08T00:25:00.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.838+0000 7f1a85760700 1 -- start start 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a85760700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a800691b0 0x7f1a800ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a85760700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a80156050 0x7f1a801564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a85760700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a800b2490 con 0x7f1a800cba20 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a85760700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800aceb0 con 0x7f1a800691b0 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a85760700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800ac4e0 con 0x7f1a80156050 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f54c98b6700 1 --2- 172.21.15.22:0/2887030158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 0x7f54c40ac970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d050 tx=0x7f54b40082d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d4f3bd804894157 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a7e7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a800691b0 0x7f1a800ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a7e7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a800691b0 0x7f1a800ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57814/0 (socket says 172.21.15.22:57814) 2023-10-08T00:25:00.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.839+0000 7f1a7e7fc700 1 -- 172.21.15.22:0/3930377486 learned_addr learned my addr 172.21.15.22:0/3930377486 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.840+0000 7f1a7f7fe700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a80156050 0x7f1a801564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.840+0000 7f54bbfff700 1 -- 172.21.15.22:0/2887030158 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010070 con 0x7f54c4156760 2023-10-08T00:25:00.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.840+0000 7f54bbfff700 1 -- 172.21.15.22:0/2887030158 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b400da70 con 0x7f54c4156760 2023-10-08T00:25:00.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.840+0000 7f54bbfff700 1 -- 172.21.15.22:0/2887030158 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400de10 con 0x7f54c4156760 2023-10-08T00:25:00.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 -- 172.21.15.22:0/2887030158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 msgr2=0x7f54c40ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 --2- 172.21.15.22:0/2887030158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 0x7f54c40ac970 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d050 tx=0x7f54b40082d0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336052713 0 0) 0x7f1a78001490 con 0x7f1a800cba20 2023-10-08T00:25:00.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a68003570 con 0x7f1a800cba20 2023-10-08T00:25:00.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 -- 172.21.15.22:0/2887030158 shutdown_connections 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 --2- 172.21.15.22:0/2887030158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c4156760 0x7f54c40ac970 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 -- 172.21.15.22:0/2887030158 >> 172.21.15.22:0/2887030158 conn(0x7f54c40cd000 msgr2=0x7f54c4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 -- 172.21.15.22:0/2887030158 shutdown_connections 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 727397750 0 0) 0x7f1a68003570 con 0x7f1a800cba20 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a80156050 msgr2=0x7f1a801564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a80156050 0x7f1a801564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 >> v2:172.21.15.192:3300/0 conn(0x7f1a800691b0 msgr2=0x7f1a800ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 --2- 172.21.15.22:0/3930377486 >> v2:172.21.15.192:3300/0 conn(0x7f1a800691b0 0x7f1a800ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80156cd0 con 0x7f1a800cba20 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f1a78001980 con 0x7f1a800cba20 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 >> v1:172.21.15.192:6789/0 conn(0x7f1a800cba20 legacy=0x7f1a80068aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68003ae0 0x7f1a68003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68004810 0x7f1a68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a68009a50 0x7f1a680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800aceb0 con 0x7f1a68009a50 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800ac4e0 con 0x7f1a68003ae0 2023-10-08T00:25:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68014790 con 0x7f1a68004810 2023-10-08T00:25:00.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.841+0000 7f54cb319700 1 -- 172.21.15.22:0/2887030158 wait complete. 2023-10-08T00:25:00.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.842+0000 7f1a7f7fe700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a68009a50 0x7f1a680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f1a7f7fe700 1 -- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68004810 msgr2=0x7f1a68004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T00:25:00.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f1a7f7fe700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68004810 0x7f1a68004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f1a7f7fe700 1 -- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68003ae0 msgr2=0x7f1a68003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f1a7f7fe700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a68003ae0 0x7f1a68003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f1a7f7fe700 1 -- 172.21.15.22:0/3930377486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a80156cd0 con 0x7f1a68009a50 2023-10-08T00:25:00.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f1a7f7fe700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a68009a50 0x7f1a680051c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a80156420 tx=0x7f1a700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fef87308d963d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f54cb319700 1 Processor -- start 2023-10-08T00:25:00.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.843+0000 7f54cb319700 1 -- start start 2023-10-08T00:25:00.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.844+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000e640 con 0x7f1a68009a50 2023-10-08T00:25:00.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.844+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000e7a0 con 0x7f1a68009a50 2023-10-08T00:25:00.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.844+0000 7f1a7dffb700 1 -- 172.21.15.22:0/3930377486 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000eb60 con 0x7f1a68009a50 2023-10-08T00:25:00.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54cb319700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c40691b0 0x7f54c414bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54cb319700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 0x7f54c4145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54cb319700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54c4156760 0x7f54c4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54cb319700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4146470 con 0x7f54c4156760 2023-10-08T00:25:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54cb319700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c416f730 con 0x7f54c40cba20 2023-10-08T00:25:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54cb319700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c4170590 con 0x7f54c40691b0 2023-10-08T00:25:00.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54c88b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 0x7f54c4145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54c88b4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 0x7f54c4145f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57820/0 (socket says 172.21.15.22:57820) 2023-10-08T00:25:00.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54c88b4700 1 -- 172.21.15.22:0/833841821 learned_addr learned my addr 172.21.15.22:0/833841821 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a85760700 1 -- 172.21.15.22:0/3930377486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a68009a50 msgr2=0x7f1a680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a85760700 1 --2- 172.21.15.22:0/3930377486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a68009a50 0x7f1a680051c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a80156420 tx=0x7f1a700091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a7f7fe700 1 -- 172.21.15.22:0/3930377486 reap_dead start 2023-10-08T00:25:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a85760700 1 -- 172.21.15.22:0/3930377486 shutdown_connections 2023-10-08T00:25:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a85760700 1 -- 172.21.15.22:0/3930377486 >> 172.21.15.22:0/3930377486 conn(0x7f1a800cd000 msgr2=0x7f1a80068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a85760700 1 -- 172.21.15.22:0/3930377486 shutdown_connections 2023-10-08T00:25:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f54c90b5700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c40691b0 0x7f54c414bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.846+0000 7f54c98b6700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54c4156760 0x7f54c4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.846+0000 7f54c88b4700 1 -- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c40691b0 msgr2=0x7f54c414bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.846+0000 7f54c88b4700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c40691b0 0x7f54c414bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.846+0000 7f54c88b4700 1 -- 172.21.15.22:0/833841821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54c4156760 msgr2=0x7f54c4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.846+0000 7f54c88b4700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54c4156760 0x7f54c4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.846+0000 7f54c88b4700 1 -- 172.21.15.22:0/833841821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4008570 con 0x7f54c40cba20 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.847+0000 7f54c88b4700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 0x7f54c4145f30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00bbe0 tx=0x7f54bc009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.847+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc0092e0 con 0x7f54c40cba20 2023-10-08T00:25:00.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.847+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00c6f0 con 0x7f54c40cba20 2023-10-08T00:25:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.847+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00cab0 con 0x7f54c40cba20 2023-10-08T00:25:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.845+0000 7f1a85760700 1 -- 172.21.15.22:0/3930377486 wait complete. 2023-10-08T00:25:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.847+0000 7f1a85760700 1 Processor -- start 2023-10-08T00:25:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c416f980 con 0x7f54c40cba20 2023-10-08T00:25:00.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c416ff40 con 0x7f54c40cba20 2023-10-08T00:25:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.847+0000 7f1a85760700 1 -- start start 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f1a85760700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68009a50 0x7f1a8014a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f1a85760700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 0x7f1a80150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f1a85760700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a800afc80 0x7f1a800b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f1a85760700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801511c0 con 0x7f1a80150700 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f1a85760700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8014b720 con 0x7f1a800afc80 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.848+0000 7f1a85760700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800b0600 con 0x7f1a68009a50 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.849+0000 7f1a7e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 0x7f1a80150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.849+0000 7f1a7e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 0x7f1a80150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60390/0 (socket says 172.21.15.22:60390) 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.849+0000 7f1a7e7fc700 1 -- 172.21.15.22:0/1809021813 learned_addr learned my addr 172.21.15.22:0/1809021813 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a7e7fc700 1 -- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68009a50 msgr2=0x7f1a8014a3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T00:25:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a7e7fc700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68009a50 0x7f1a8014a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a7e7fc700 1 -- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a800afc80 msgr2=0x7f1a800b00c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a7e7fc700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a800afc80 0x7f1a800b00c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a7e7fc700 1 -- 172.21.15.22:0/1809021813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8014adf0 con 0x7f1a80150700 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a7e7fc700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 0x7f1a80150b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b6e0 tx=0x7f1a740082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.850+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74010040 con 0x7f1a80150700 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.851+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74009330 con 0x7f1a80150700 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.851+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74002600 con 0x7f1a80150700 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.851+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54bc012070 con 0x7f54c40cba20 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.851+0000 7f54b97fa700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f54a8067080 0x7f54a8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.851+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f54bc084100 con 0x7f54c40cba20 2023-10-08T00:25:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.852+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8014b0d0 con 0x7f1a80150700 2023-10-08T00:25:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.852+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8016a490 con 0x7f1a80150700 2023-10-08T00:25:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.852+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c404c3c0 con 0x7f54c40cba20 2023-10-08T00:25:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.852+0000 7f54c90b5700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f54a8067080 0x7f54a8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.854+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8004c3c0 con 0x7f1a80150700 2023-10-08T00:25:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.854+0000 7f54c90b5700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f54a8067080 0x7f54a8069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54c0007fd0 tx=0x7f54c0007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.854+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a74002a30 con 0x7f1a80150700 2023-10-08T00:25:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.855+0000 7f1a66ffd700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a68071020 0x7f1a680734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.855+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a74084380 con 0x7f1a80150700 2023-10-08T00:25:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.855+0000 7f1a7effd700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a68071020 0x7f1a680734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.856+0000 7f1a7effd700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a68071020 0x7f1a680734d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a78001390 tx=0x7f1a78001520 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.857+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54bc051350 con 0x7f54c40cba20 2023-10-08T00:25:00.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.863+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a74051670 con 0x7f1a80150700 2023-10-08T00:25:00.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.880+0000 7f29a3f4e700 1 Processor -- start 2023-10-08T00:25:00.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.880+0000 7f29a3f4e700 1 -- start start 2023-10-08T00:25:00.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a3f4e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f299c0875d0 0x7f299c0879a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a3f4e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c068f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a3f4e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c0acdf0 con 0x7f299c0b1c50 2023-10-08T00:25:00.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a3f4e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c069480 con 0x7f299c0875d0 2023-10-08T00:25:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a3f4e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0abfd0 con 0x7f299c068aa0 2023-10-08T00:25:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a24eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a24eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c068f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60728/0 (socket says 172.21.15.22:60728) 2023-10-08T00:25:00.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a24eb700 1 -- 172.21.15.22:0/1968171944 learned_addr learned my addr 172.21.15.22:0/1968171944 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.882+0000 7f29a1cea700 1 --2- 172.21.15.22:0/1968171944 >> v2:172.21.15.192:3300/0 conn(0x7f299c0875d0 0x7f299c0879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.883+0000 7f29a24eb700 1 -- 172.21.15.22:0/1968171944 >> v2:172.21.15.192:3300/0 conn(0x7f299c0875d0 msgr2=0x7f299c0879a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.883+0000 7f29a24eb700 1 --2- 172.21.15.22:0/1968171944 >> v2:172.21.15.192:3300/0 conn(0x7f299c0875d0 0x7f299c0879a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.883+0000 7f29a24eb700 1 -- 172.21.15.22:0/1968171944 >> v1:172.21.15.192:6789/0 conn(0x7f299c0b1c50 legacy=0x7f299c0ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.883+0000 7f29a24eb700 1 -- 172.21.15.22:0/1968171944 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0ac1e0 con 0x7f299c068aa0 2023-10-08T00:25:00.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.883+0000 7f29a24eb700 1 --2- 172.21.15.22:0/1968171944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c068f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2998009a40 tx=0x7f2998007230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92044291e34e5586 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.886+0000 7f29a0ce8700 1 -- 172.21.15.22:0/1968171944 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998009280 con 0x7f299c068aa0 2023-10-08T00:25:00.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.886+0000 7f29a0ce8700 1 -- 172.21.15.22:0/1968171944 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299800f8d0 con 0x7f299c068aa0 2023-10-08T00:25:00.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.886+0000 7f29a0ce8700 1 -- 172.21.15.22:0/1968171944 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299800fc90 con 0x7f299c068aa0 2023-10-08T00:25:00.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 -- 172.21.15.22:0/1968171944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 msgr2=0x7f299c068f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/1968171944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c068f40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2998009a40 tx=0x7f2998007230 comp rx=0 tx=0).stop 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 -- 172.21.15.22:0/1968171944 shutdown_connections 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/1968171944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c068f40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/1968171944 >> v2:172.21.15.192:3300/0 conn(0x7f299c0875d0 0x7f299c0879a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 -- 172.21.15.22:0/1968171944 >> 172.21.15.22:0/1968171944 conn(0x7f299c0cd000 msgr2=0x7f299c068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 -- 172.21.15.22:0/1968171944 shutdown_connections 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.887+0000 7f29a3f4e700 1 -- 172.21.15.22:0/1968171944 wait complete. 2023-10-08T00:25:00.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.889+0000 7f29a3f4e700 1 Processor -- start 2023-10-08T00:25:00.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.889+0000 7f29a3f4e700 1 -- start start 2023-10-08T00:25:00.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.890+0000 7f29a3f4e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.890+0000 7f29a3f4e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f299c0875d0 0x7f299c17d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.890+0000 7f29a3f4e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c0b1c50 0x7f299c188540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.890+0000 7f29a3f4e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c189bf0 con 0x7f299c0b1c50 2023-10-08T00:25:00.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.890+0000 7f29a3f4e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c188fe0 con 0x7f299c0875d0 2023-10-08T00:25:00.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.890+0000 7f29a3f4e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1892c0 con 0x7f299c068aa0 2023-10-08T00:25:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a14e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f299c0875d0 0x7f299c17d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a14e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f299c0875d0 0x7f299c17d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57832/0 (socket says 172.21.15.22:57832) 2023-10-08T00:25:00.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a14e9700 1 -- 172.21.15.22:0/2321208631 learned_addr learned my addr 172.21.15.22:0/2321208631 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 -- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f299c0875d0 msgr2=0x7f299c17d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f299c0875d0 0x7f299c17d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 -- 172.21.15.22:0/2321208631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c0b1c50 msgr2=0x7f299c188540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c0b1c50 0x7f299c188540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 -- 172.21.15.22:0/2321208631 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998009580 con 0x7f299c068aa0 2023-10-08T00:25:00.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.892+0000 7f29a1cea700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c0a6250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f299400fec0 tx=0x7f299400b200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.893+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994019400 con 0x7f299c068aa0 2023-10-08T00:25:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.893+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2994019560 con 0x7f299c068aa0 2023-10-08T00:25:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.893+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994019920 con 0x7f299c068aa0 2023-10-08T00:25:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.894+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c1895a0 con 0x7f299c068aa0 2023-10-08T00:25:00.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.894+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c17e2a0 con 0x7f299c068aa0 2023-10-08T00:25:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.896+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f299400c3e0 con 0x7f299c068aa0 2023-10-08T00:25:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.897+0000 7f2991ffb700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2980067080 0x7f2980069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.897+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29940854c0 con 0x7f299c068aa0 2023-10-08T00:25:00.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.898+0000 7f29a14e9700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2980067080 0x7f2980069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.899+0000 7f91b8c1e700 1 Processor -- start 2023-10-08T00:25:00.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.900+0000 7f91b8c1e700 1 -- start start 2023-10-08T00:25:00.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.900+0000 7f29a14e9700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2980067080 0x7f2980069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f299c0ab4f0 tx=0x7f298c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0b2360 con 0x7f299c068aa0 2023-10-08T00:25:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f91b8c1e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91b4069d60 0x7f91b40ac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f91b8c1e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91b406aba0 0x7f91b40c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f91b8c1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 0x7f91b40c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f91b8c1e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40acd70 con 0x7f91b4069d60 2023-10-08T00:25:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f91b8c1e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b406bdb0 con 0x7f91b406aba0 2023-10-08T00:25:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f91b8c1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40cb370 con 0x7f91b412a660 2023-10-08T00:25:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7fd71d9d9700 1 Processor -- start 2023-10-08T00:25:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7fd71d9d9700 1 -- start start 2023-10-08T00:25:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f8c311c5700 1 Processor -- start 2023-10-08T00:25:00.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.901+0000 7f8c311c5700 1 -- start start 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 0x7f91b40c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 0x7f91b40c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60756/0 (socket says 172.21.15.22:60756) 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 -- 172.21.15.22:0/4165684743 learned_addr learned my addr 172.21.15.22:0/4165684743 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b259c700 1 --2- 172.21.15.22:0/4165684743 >> v2:172.21.15.22:3300/0 conn(0x7f91b4069d60 0x7f91b40ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 -- 172.21.15.22:0/4165684743 >> v2:172.21.15.192:3300/0 conn(0x7f91b406aba0 msgr2=0x7f91b40c7cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 --2- 172.21.15.22:0/4165684743 >> v2:172.21.15.192:3300/0 conn(0x7f91b406aba0 0x7f91b40c7cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 -- 172.21.15.22:0/4165684743 >> v2:172.21.15.22:3300/0 conn(0x7f91b4069d60 msgr2=0x7f91b40ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 --2- 172.21.15.22:0/4165684743 >> v2:172.21.15.22:3300/0 conn(0x7f91b4069d60 0x7f91b40ac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 -- 172.21.15.22:0/4165684743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b406b510 con 0x7f91b412a660 2023-10-08T00:25:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f8c311c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 0x7f8c2c168ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f8c311c5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c0c74b0 con 0x7f8c2c0c8f50 2023-10-08T00:25:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f8c311c5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c06bc00 con 0x7f8c2c06b830 2023-10-08T00:25:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f8c311c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c93d0 con 0x7f8c2c162250 2023-10-08T00:25:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7fd71d9d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb9f0 0x7fd7180c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7fd71d9d9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd718069d30 con 0x7fd7180cb5a0 2023-10-08T00:25:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7fd71d9d9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180c8110 con 0x7fd718156fb0 2023-10-08T00:25:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7fd71d9d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181568e0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.902+0000 7f91b2d9d700 1 --2- 172.21.15.22:0/4165684743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 0x7f91b40c81f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91b406a130 tx=0x7f91ac009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3899ba9f06f00c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd716ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd718156fb0 0x7fd71806a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34524/0 (socket says 172.21.15.22:34524) 2023-10-08T00:25:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd716ffd700 1 -- 172.21.15.22:0/1177739448 learned_addr learned my addr 172.21.15.22:0/1177739448 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c2ad9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8c2c06b830 0x7f8c2c0cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34536/0 (socket says 172.21.15.22:34536) 2023-10-08T00:25:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c2ad9d700 1 -- 172.21.15.22:0/2751434418 learned_addr learned my addr 172.21.15.22:0/2751434418 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:00.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd7177fe700 1 --2- 172.21.15.22:0/1177739448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb9f0 0x7fd7180c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd715ffb700 1 -- 172.21.15.22:0/1177739448 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569843319 0 0) 0x7fd7180c8110 con 0x7fd718156fb0 2023-10-08T00:25:00.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd715ffb700 1 -- 172.21.15.22:0/1177739448 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd700003570 con 0x7fd718156fb0 2023-10-08T00:25:00.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c2b59e700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 0x7f8c2c168ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fb46d35f700 1 Processor -- start 2023-10-08T00:25:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd7177fe700 1 -- 172.21.15.22:0/1177739448 >> v1:172.21.15.192:6789/0 conn(0x7fd718156fb0 legacy=0x7fd71806a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd7177fe700 1 -- 172.21.15.22:0/1177739448 >> v1:172.21.15.22:6789/0 conn(0x7fd7180cb5a0 legacy=0x7fd7180c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd7177fe700 1 -- 172.21.15.22:0/1177739448 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7180c7e00 con 0x7fd7180cb9f0 2023-10-08T00:25:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236806968 0 0) 0x7f8c2c06bc00 con 0x7f8c2c06b830 2023-10-08T00:25:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c14003570 con 0x7f8c2c06b830 2023-10-08T00:25:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fb46d35f700 1 -- start start 2023-10-08T00:25:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7fd7177fe700 1 --2- 172.21.15.22:0/1177739448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb9f0 0x7fd7180c8cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00aac0 tx=0x7fd70c00a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59e89159ffc6833 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064890614 0 0) 0x7f8c2c0c74b0 con 0x7f8c2c0c8f50 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c06bc00 con 0x7f8c2c0c8f50 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047418409 0 0) 0x7f8c14003570 con 0x7f8c2c06b830 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 msgr2=0x7f8c2c168ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 0x7f8c2c168ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 >> v1:172.21.15.22:6789/0 conn(0x7f8c2c0c8f50 legacy=0x7f8c2c161b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c158a30 con 0x7f8c2c06b830 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.903+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f8c240017f0 con 0x7f8c2c06b830 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 >> v1:172.21.15.192:6789/0 conn(0x7f8c2c06b830 legacy=0x7f8c2c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c14003bf0 0x7f8c14003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 0x7f8c14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14004d50 0x7f8c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c93d0 con 0x7f8c14004d50 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1400bb10 con 0x7f8c14003bf0 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1400bcd0 con 0x7f8c2c162250 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c14003bf0 0x7f8c14003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2a59c700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 0x7f8c14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 -- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 msgr2=0x7f8c14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c162250 0x7f8c14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 -- 172.21.15.22:0/2751434418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14004d50 msgr2=0x7f8c140051c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14004d50 0x7f8c140051c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 -- 172.21.15.22:0/2751434418 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14003570 con 0x7f8c14003bf0 2023-10-08T00:25:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb46d35f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb46d35f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46815a160 con 0x7fb46815db10 2023-10-08T00:25:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb46d35f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4680d13a0 con 0x7fb468159890 2023-10-08T00:25:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb46d35f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46815e140 con 0x7fb468159c60 2023-10-08T00:25:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c14003bf0 0x7f8c14003fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400a800 tx=0x7f8c240020a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52673e0e269a752b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb466ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb468159890 0x7fb46815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34550/0 (socket says 172.21.15.22:34550) 2023-10-08T00:25:00.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb4667fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.904+0000 7fb466ffd700 1 -- 172.21.15.22:0/323838939 learned_addr learned my addr 172.21.15.22:0/323838939 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:00.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240071a0 con 0x7f8c14003bf0 2023-10-08T00:25:00.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24007300 con 0x7f8c14003bf0 2023-10-08T00:25:00.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c29d9b700 1 -- 172.21.15.22:0/2751434418 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c240076c0 con 0x7f8c14003bf0 2023-10-08T00:25:00.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7fb465ffb700 1 -- 172.21.15.22:0/323838939 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937425566 0 0) 0x7fb4680d13a0 con 0x7fb468159890 2023-10-08T00:25:00.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7fb4667fc700 1 -- 172.21.15.22:0/323838939 >> v1:172.21.15.192:6789/0 conn(0x7fb468159890 legacy=0x7fb46815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7fb4667fc700 1 -- 172.21.15.22:0/323838939 >> v1:172.21.15.22:6789/0 conn(0x7fb46815db10 legacy=0x7fb468069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7fb4667fc700 1 -- 172.21.15.22:0/323838939 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46815a3d0 con 0x7fb468159c60 2023-10-08T00:25:00.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7fb4667fc700 1 --2- 172.21.15.22:0/323838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009910 tx=0x7fb45c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df518584c4e71d01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c311c5700 1 -- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c14003bf0 msgr2=0x7f8c14003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c311c5700 1 --2- 172.21.15.22:0/2751434418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c14003bf0 0x7f8c14003fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400a800 tx=0x7f8c240020a0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c2b59e700 1 -- 172.21.15.22:0/2751434418 reap_dead start 2023-10-08T00:25:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c311c5700 1 -- 172.21.15.22:0/2751434418 shutdown_connections 2023-10-08T00:25:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c311c5700 1 -- 172.21.15.22:0/2751434418 >> 172.21.15.22:0/2751434418 conn(0x7f8c2c0c9870 msgr2=0x7f8c2c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.905+0000 7f8c311c5700 1 -- 172.21.15.22:0/2751434418 shutdown_connections 2023-10-08T00:25:00.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7f8c311c5700 1 -- 172.21.15.22:0/2751434418 wait complete. 2023-10-08T00:25:00.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7f91b159a700 1 -- 172.21.15.22:0/4165684743 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00e070 con 0x7f91b412a660 2023-10-08T00:25:00.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7f91b159a700 1 -- 172.21.15.22:0/4165684743 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00ba20 con 0x7f91b412a660 2023-10-08T00:25:00.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7fd715ffb700 1 -- 172.21.15.22:0/1177739448 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00c970 con 0x7fd7180cb9f0 2023-10-08T00:25:00.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7f91b159a700 1 -- 172.21.15.22:0/4165684743 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0092e0 con 0x7f91b412a660 2023-10-08T00:25:00.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7fd715ffb700 1 -- 172.21.15.22:0/1177739448 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c00cad0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2994052710 con 0x7f299c068aa0 2023-10-08T00:25:00.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7f8c311c5700 1 Processor -- start 2023-10-08T00:25:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7f8c311c5700 1 -- start start 2023-10-08T00:25:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.906+0000 7fd715ffb700 1 -- 172.21.15.22:0/1177739448 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c00ce70 con 0x7fd7180cb9f0 2023-10-08T00:25:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fd71d9d9700 1 -- 172.21.15.22:0/1177739448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb9f0 msgr2=0x7fd7180c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/1177739448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb9f0 0x7fd7180c8cb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd70c00aac0 tx=0x7fd70c00a330 comp rx=0 tx=0).stop 2023-10-08T00:25:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fb465ffb700 1 -- 172.21.15.22:0/323838939 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00b860 con 0x7fb468159c60 2023-10-08T00:25:00.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fb465ffb700 1 -- 172.21.15.22:0/323838939 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c00b9c0 con 0x7fb468159c60 2023-10-08T00:25:00.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fb465ffb700 1 -- 172.21.15.22:0/323838939 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c00bd60 con 0x7fb468159c60 2023-10-08T00:25:00.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fd71d9d9700 1 -- 172.21.15.22:0/1177739448 shutdown_connections 2023-10-08T00:25:00.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/1177739448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb9f0 0x7fd7180c8cb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fd71d9d9700 1 -- 172.21.15.22:0/1177739448 >> 172.21.15.22:0/1177739448 conn(0x7fd7180c9870 msgr2=0x7fd7180c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7fd71d9d9700 1 -- 172.21.15.22:0/1177739448 shutdown_connections 2023-10-08T00:25:00.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7f91b8c1e700 1 -- 172.21.15.22:0/4165684743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 msgr2=0x7f91b40c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.907+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/4165684743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 0x7f91b40c81f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f91b406a130 tx=0x7f91ac009840 comp rx=0 tx=0).stop 2023-10-08T00:25:00.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7fb46d35f700 1 -- 172.21.15.22:0/323838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 msgr2=0x7fb46815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7fb46d35f700 1 --2- 172.21.15.22:0/323838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009910 tx=0x7fb45c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7fb46d35f700 1 -- 172.21.15.22:0/323838939 shutdown_connections 2023-10-08T00:25:00.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7fb46d35f700 1 --2- 172.21.15.22:0/323838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d5d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7fb46d35f700 1 -- 172.21.15.22:0/323838939 >> 172.21.15.22:0/323838939 conn(0x7fb468068e20 msgr2=0x7fb4680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f91b8c1e700 1 -- 172.21.15.22:0/4165684743 shutdown_connections 2023-10-08T00:25:00.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/4165684743 >> v2:172.21.15.22:3300/0 conn(0x7f91b4069d60 0x7f91b40ac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/4165684743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b412a660 0x7f91b40c81f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/4165684743 >> v2:172.21.15.192:3300/0 conn(0x7f91b406aba0 0x7f91b40c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f91b8c1e700 1 -- 172.21.15.22:0/4165684743 >> 172.21.15.22:0/4165684743 conn(0x7f91b40cd670 msgr2=0x7f91b40cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c311c5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 0x7f8c2c0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c311c5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c2c171f40 0x7f8c2c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c311c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c06a210 0x7f8c2c06a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c311c5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c15e870 con 0x7f8c14003bf0 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c311c5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c06abc0 con 0x7f8c2c171f40 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c311c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0c4980 con 0x7f8c2c06a210 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7f8c2ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 0x7f8c2c0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c2c171f40 0x7f8c2c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 0x7f8c2c0b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60420/0 (socket says 172.21.15.22:60420) 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2ad9d700 1 -- 172.21.15.22:0/4162209943 learned_addr learned my addr 172.21.15.22:0/4162209943 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 -- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c06a210 msgr2=0x7f8c2c06a680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c06a210 0x7f8c2c06a680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 -- 172.21.15.22:0/4162209943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 msgr2=0x7f8c2c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 0x7f8c2c0b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 -- 172.21.15.22:0/4162209943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c1485a0 con 0x7f8c2c171f40 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 0x7f8c2c0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.909+0000 7f8c2a59c700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c2c171f40 0x7f8c2c148060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00f880 tx=0x7f8c1c007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c013600 con 0x7f8c2c171f40 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c013760 con 0x7f8c2c171f40 2023-10-08T00:25:00.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c013b20 con 0x7f8c2c171f40 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c1723b0 con 0x7f8c2c171f40 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0c4330 con 0x7f8c2c171f40 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2c04c3c0 con 0x7f8c2c171f40 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c1c01c400 con 0x7f8c2c171f40 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7f8c12ffd700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c14068730 0x7f8c1406abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8c1c084850 con 0x7f8c2c171f40 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c14068730 0x7f8c1406abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7f8c2ad9d700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c14068730 0x7f8c1406abe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c24000f80 tx=0x7f8c24016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.908+0000 7fd71d9d9700 1 -- 172.21.15.22:0/1177739448 wait complete. 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7fd71d9d9700 1 Processor -- start 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.910+0000 7fd71d9d9700 1 -- start start 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd71d9d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb5a0 0x7fd718159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd71d9d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180cb9f0 0x7fd71813da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd71d9d9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd718156fb0 0x7fd7181884c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd71d9d9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815aaa0 con 0x7fd718156fb0 2023-10-08T00:25:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd71d9d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815a300 con 0x7fd7180cb9f0 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd71d9d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815a4e0 con 0x7fd7180cb5a0 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd716ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb5a0 0x7fd718159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd716ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb5a0 0x7fd718159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60812/0 (socket says 172.21.15.22:60812) 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd716ffd700 1 -- 172.21.15.22:0/526072070 learned_addr learned my addr 172.21.15.22:0/526072070 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd7167fc700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180cb9f0 0x7fd71813da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.911+0000 7fd7177fe700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd718156fb0 0x7fd7181884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7fd7167fc700 1 -- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb5a0 msgr2=0x7fd718159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7fd7167fc700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb5a0 0x7fd718159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7fd7167fc700 1 -- 172.21.15.22:0/526072070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd718156fb0 msgr2=0x7fd7181884c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7fd7167fc700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd718156fb0 0x7fd7181884c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7fd7167fc700 1 -- 172.21.15.22:0/526072070 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c00a5d0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.914+0000 7f91b8c1e700 1 -- 172.21.15.22:0/4165684743 shutdown_connections 2023-10-08T00:25:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.912+0000 7fd7167fc700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180cb9f0 0x7fd71813da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c590 tx=0x7fd708007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.914+0000 7fb46d35f700 1 -- 172.21.15.22:0/323838939 shutdown_connections 2023-10-08T00:25:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.914+0000 7fb46d35f700 1 -- 172.21.15.22:0/323838939 wait complete. 2023-10-08T00:25:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.914+0000 7f91b8c1e700 1 -- 172.21.15.22:0/4165684743 wait complete. 2023-10-08T00:25:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.915+0000 7f91b8c1e700 1 Processor -- start 2023-10-08T00:25:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.915+0000 7f91b8c1e700 1 -- start start 2023-10-08T00:25:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7fb46d35f700 1 Processor -- start 2023-10-08T00:25:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b8c1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b4069d60 0x7f91b4153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b8c1e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b406aba0 0x7f91b40ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b8c1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b412a660 0x7f91b414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b8c1e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40aa840 con 0x7f91b406aba0 2023-10-08T00:25:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b8c1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b4152b90 con 0x7f91b412a660 2023-10-08T00:25:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b8c1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40ab8d0 con 0x7f91b4069d60 2023-10-08T00:25:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b406aba0 0x7f91b40ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b406aba0 0x7f91b40ab390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60442/0 (socket says 172.21.15.22:60442) 2023-10-08T00:25:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b1d9b700 1 -- 172.21.15.22:0/2331717651 learned_addr learned my addr 172.21.15.22:0/2331717651 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b259c700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b4069d60 0x7f91b4153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b2d9d700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b412a660 0x7f91b414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c1c051aa0 con 0x7f8c2c171f40 2023-10-08T00:25:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b259c700 1 -- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b412a660 msgr2=0x7f91b414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b259c700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b412a660 0x7f91b414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b259c700 1 -- 172.21.15.22:0/2331717651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b406aba0 msgr2=0x7f91b40ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b259c700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b406aba0 0x7f91b40ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7f91b259c700 1 -- 172.21.15.22:0/2331717651 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac009ae0 con 0x7f91b4069d60 2023-10-08T00:25:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7f91b259c700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b4069d60 0x7f91b4153020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f919c00e980 tx=0x7f919c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.916+0000 7fb46d35f700 1 -- start start 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb46d35f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb468159890 0x7fb4680b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb46d35f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb46d35f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb46815db10 0x7fb46815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb46d35f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680b5d60 con 0x7fb468159890 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb46d35f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680b6040 con 0x7fb46815db10 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb46d35f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4680b6320 con 0x7fb468159c60 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb466ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb468159890 0x7fb4680b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb466ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb468159890 0x7fb4680b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60448/0 (socket says 172.21.15.22:60448) 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb466ffd700 1 -- 172.21.15.22:0/2810542371 learned_addr learned my addr 172.21.15.22:0/2810542371 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb4667fc700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7fb4677fe700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb46815db10 0x7fb46815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb4677fe700 1 -- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 msgr2=0x7fb46815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb4677fe700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb4677fe700 1 -- 172.21.15.22:0/2810542371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb468159890 msgr2=0x7fb4680b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb4677fe700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb468159890 0x7fb4680b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb4677fe700 1 -- 172.21.15.22:0/2810542371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c009420 con 0x7fb46815db10 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb4677fe700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb46815db10 0x7fb46815c6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb45800c3c0 tx=0x7fb458007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45800ce20 con 0x7fb46815db10 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00c850 con 0x7f91b4069d60 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00c9b0 con 0x7f91b4069d60 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.917+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00cd50 con 0x7f91b4069d60 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b40aa560 con 0x7f91b4069d60 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b4152820 con 0x7f91b4069d60 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb458011590 con 0x7fb46815db10 2023-10-08T00:25:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.918+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458011950 con 0x7fb46815db10 2023-10-08T00:25:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.919+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4680cd0e0 con 0x7fb46815db10 2023-10-08T00:25:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.919+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46815d830 con 0x7fb46815db10 2023-10-08T00:25:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.920+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b41523a0 con 0x7f91b4069d60 2023-10-08T00:25:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.921+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f919c013680 con 0x7f91b4069d60 2023-10-08T00:25:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.921+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb458011d00 con 0x7fb46815db10 2023-10-08T00:25:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.921+0000 7f91aa7fc700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9194067000 0x7f91940694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.922+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f919c084b70 con 0x7f91b4069d60 2023-10-08T00:25:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.922+0000 7fb44effd700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb454066f30 0x7fb4540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.922+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb458083820 con 0x7fb46815db10 2023-10-08T00:25:00.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.922+0000 7fb466ffd700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb454066f30 0x7fb4540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.922+0000 7f91b1d9b700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9194067000 0x7f91940694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.923+0000 7fb466ffd700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb454066f30 0x7fb4540693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e280 tx=0x7fb460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.923+0000 7f91b1d9b700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9194067000 0x7f91940694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91b4157940 tx=0x7f91a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.925+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011590 con 0x7fd7180cb9f0 2023-10-08T00:25:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.925+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7080116f0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.925+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71815a7c0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.925+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7180b0ff0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.925+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4680cd600 con 0x7fb46815db10 2023-10-08T00:25:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.925+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011ab0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.927+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd708012420 con 0x7fd7180cb9f0 2023-10-08T00:25:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.928+0000 7fd6feffd700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd704067000 0x7fd7040694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.928+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd7080837b0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.928+0000 7fd716ffd700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd704067000 0x7fd7040694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.928+0000 7fd716ffd700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd704067000 0x7fd7040694b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd71000e230 tx=0x7fd710009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.930+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f80052b0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.930+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91b41523a0 con 0x7f91b4069d60 2023-10-08T00:25:00.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.930+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4680cd600 con 0x7fb46815db10 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.934+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd70804b5a0 con 0x7fd7180cb9f0 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.941+0000 7f4794eb3700 1 Processor -- start 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.941+0000 7f4794eb3700 1 -- start start 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.942+0000 7f4794eb3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4790155780 0x7f479006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.942+0000 7f4794eb3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479006e430 con 0x7f479006a730 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.942+0000 7f4794eb3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479006a2a0 con 0x7f479006dfd0 2023-10-08T00:25:00.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.942+0000 7f4794eb3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4790156e70 con 0x7f4790155780 2023-10-08T00:25:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.943+0000 7f478dd9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f479006a730 0x7f47900c8fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59934/0 (socket says 172.21.15.22:59934) 2023-10-08T00:25:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.943+0000 7f478dd9b700 1 -- 172.21.15.22:0/968188948 learned_addr learned my addr 172.21.15.22:0/968188948 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.943+0000 7f478e59c700 1 --2- 172.21.15.22:0/968188948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4790155780 0x7f479006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.944+0000 7f478e59c700 1 -- 172.21.15.22:0/968188948 >> v1:172.21.15.192:6789/0 conn(0x7f479006dfd0 legacy=0x7f47900c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.944+0000 7f478e59c700 1 -- 172.21.15.22:0/968188948 >> v1:172.21.15.22:6789/0 conn(0x7f479006a730 legacy=0x7f47900c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.944+0000 7f478e59c700 1 -- 172.21.15.22:0/968188948 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790156b90 con 0x7f4790155780 2023-10-08T00:25:00.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.945+0000 7f478e59c700 1 --2- 172.21.15.22:0/968188948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4790155780 0x7f479006da90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f478400aac0 tx=0x7f478400a330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0117cdbb80b2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.949+0000 7f478d59a700 1 -- 172.21.15.22:0/968188948 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400c870 con 0x7f4790155780 2023-10-08T00:25:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.949+0000 7f478d59a700 1 -- 172.21.15.22:0/968188948 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400c9d0 con 0x7f4790155780 2023-10-08T00:25:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.949+0000 7f478d59a700 1 -- 172.21.15.22:0/968188948 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400cd90 con 0x7f4790155780 2023-10-08T00:25:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 -- 172.21.15.22:0/968188948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4790155780 msgr2=0x7f479006da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 --2- 172.21.15.22:0/968188948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4790155780 0x7f479006da90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f478400aac0 tx=0x7f478400a330 comp rx=0 tx=0).stop 2023-10-08T00:25:00.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 -- 172.21.15.22:0/968188948 shutdown_connections 2023-10-08T00:25:00.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 --2- 172.21.15.22:0/968188948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4790155780 0x7f479006da90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 -- 172.21.15.22:0/968188948 >> 172.21.15.22:0/968188948 conn(0x7f4790068390 msgr2=0x7f4790068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:00.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 -- 172.21.15.22:0/968188948 shutdown_connections 2023-10-08T00:25:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.950+0000 7f4794eb3700 1 -- 172.21.15.22:0/968188948 wait complete. 2023-10-08T00:25:00.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.952+0000 7f4794eb3700 1 Processor -- start 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.952+0000 7f4794eb3700 1 -- start start 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f4794eb3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f479006a730 0x7f47900c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f4794eb3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f479006dfd0 0x7f4790177180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f4794eb3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790155780 0x7f4790158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f4794eb3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790178120 con 0x7f479006dfd0 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f4794eb3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790177b60 con 0x7f4790155780 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f4794eb3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4790177e40 con 0x7f479006a730 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f478dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f479006dfd0 0x7f4790177180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f478dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f479006dfd0 0x7f4790177180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60462/0 (socket says 172.21.15.22:60462) 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f478dd9b700 1 -- 172.21.15.22:0/1047971223 learned_addr learned my addr 172.21.15.22:0/1047971223 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:00.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f478ed9d700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790155780 0x7f4790158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.954+0000 7f478e59c700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f479006a730 0x7f47900c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.955+0000 7f478e59c700 1 -- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790155780 msgr2=0x7f4790158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.955+0000 7f478e59c700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790155780 0x7f4790158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.955+0000 7f478e59c700 1 -- 172.21.15.22:0/1047971223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f479006dfd0 msgr2=0x7f4790177180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.955+0000 7f478e59c700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f479006dfd0 0x7f4790177180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.955+0000 7f478e59c700 1 -- 172.21.15.22:0/1047971223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478400a5d0 con 0x7f479006a730 2023-10-08T00:25:00.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.956+0000 7f478e59c700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f479006a730 0x7f47900c2950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4784017000 tx=0x7f4784018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.956+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784024070 con 0x7f479006a730 2023-10-08T00:25:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.956+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4790178480 con 0x7f479006a730 2023-10-08T00:25:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.956+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47900c2e90 con 0x7f479006a730 2023-10-08T00:25:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.956+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784017c30 con 0x7f479006a730 2023-10-08T00:25:00.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.956+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840203f0 con 0x7f479006a730 2023-10-08T00:25:00.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.959+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4784029410 con 0x7f479006a730 2023-10-08T00:25:00.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.959+0000 7f477e7fc700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4778067130 0x7f47780695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:00.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.959+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4784013070 con 0x7f479006a730 2023-10-08T00:25:00.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.960+0000 7f478dd9b700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4778067130 0x7f47780695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.960+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47740052b0 con 0x7f479006a730 2023-10-08T00:25:00.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.961+0000 7f478dd9b700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4778067130 0x7f47780695e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4790069f40 tx=0x7f4780000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:00.965+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4784052480 con 0x7f479006a730 2023-10-08T00:25:01.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.265+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54c41706d0 con 0x7f54c40cba20 2023-10-08T00:25:01.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.266+0000 7f54b97fa700 1 -- 172.21.15.22:0/833841821 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54bc054970 con 0x7f54c40cba20 2023-10-08T00:25:01.269 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2023-10-08T00:25:01.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.269+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f54a8067080 msgr2=0x7f54a8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.269+0000 7f54cb319700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f54a8067080 0x7f54a8069530 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54c0007fd0 tx=0x7f54c0007d50 comp rx=0 tx=0).stop 2023-10-08T00:25:01.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.269+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 msgr2=0x7f54c4145f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.269+0000 7f54cb319700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 0x7f54c4145f30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00bbe0 tx=0x7f54bc009840 comp rx=0 tx=0).stop 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 shutdown_connections 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54c4156760 0x7f54c4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f54a8067080 0x7f54a8069530 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f54c40691b0 0x7f54c414bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 --2- 172.21.15.22:0/833841821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54c40cba20 0x7f54c4145f30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 >> 172.21.15.22:0/833841821 conn(0x7f54c40cd000 msgr2=0x7f54c40afba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 shutdown_connections 2023-10-08T00:25:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f54cb319700 1 -- 172.21.15.22:0/833841821 wait complete. 2023-10-08T00:25:01.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.270+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a800aba90 con 0x7f1a80150700 2023-10-08T00:25:01.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.271+0000 7f1a66ffd700 1 -- 172.21.15.22:0/1809021813 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a74054c90 con 0x7f1a80150700 2023-10-08T00:25:01.274 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.274+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a68071020 msgr2=0x7f1a680734d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.274+0000 7f1a85760700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a68071020 0x7f1a680734d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a78001390 tx=0x7f1a78001520 comp rx=0 tx=0).stop 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.274+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 msgr2=0x7f1a80150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.274+0000 7f1a85760700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 0x7f1a80150b70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b6e0 tx=0x7f1a740082d0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.275+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 shutdown_connections 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.275+0000 7f1a85760700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a800afc80 0x7f1a800b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.275+0000 7f1a85760700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a68071020 0x7f1a680734d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.275+0000 7f1a85760700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1a68009a50 0x7f1a8014a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.275+0000 7f1a85760700 1 --2- 172.21.15.22:0/1809021813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a80150700 0x7f1a80150b70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.275+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 >> 172.21.15.22:0/1809021813 conn(0x7f1a800cd000 msgr2=0x7f1a80154880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.278+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 shutdown_connections 2023-10-08T00:25:01.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.278+0000 7f1a85760700 1 -- 172.21.15.22:0/1809021813 wait complete. 2023-10-08T00:25:01.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-08T00:25:01.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.287+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f299c04c3c0 con 0x7f299c068aa0 2023-10-08T00:25:01.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.290+0000 7f2991ffb700 1 -- 172.21.15.22:0/2321208631 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2994055d30 con 0x7f299c068aa0 2023-10-08T00:25:01.291 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.291 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:25:01.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2023-10-08T00:25:01.297 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.298+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2980067080 msgr2=0x7f2980069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.298+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2980067080 0x7f2980069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f299c0ab4f0 tx=0x7f298c009040 comp rx=0 tx=0).stop 2023-10-08T00:25:01.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.298+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 msgr2=0x7f299c0a6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.298+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c0a6250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f299400fec0 tx=0x7f299400b200 comp rx=0 tx=0).stop 2023-10-08T00:25:01.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 shutdown_connections 2023-10-08T00:25:01.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c0b1c50 0x7f299c188540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2980067080 0x7f2980069530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f299c068aa0 0x7f299c0a6250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 --2- 172.21.15.22:0/2321208631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f299c0875d0 0x7f299c17d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 >> 172.21.15.22:0/2321208631 conn(0x7f299c0cd000 msgr2=0x7f299c1638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 shutdown_connections 2023-10-08T00:25:01.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.302+0000 7f29a3f4e700 1 -- 172.21.15.22:0/2321208631 wait complete. 2023-10-08T00:25:01.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.317+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f91b41523a0 con 0x7f91b4069d60 2023-10-08T00:25:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.317+0000 7f91aa7fc700 1 -- 172.21.15.22:0/2331717651 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91b41523a0 con 0x7f91b4069d60 2023-10-08T00:25:01.318 INFO:teuthology.orchestra.run.smithi022.stdout:55834574852 2023-10-08T00:25:01.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2023-10-08T00:25:01.320 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.320+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9194067000 msgr2=0x7f91940694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.320+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9194067000 0x7f91940694b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91b4157940 tx=0x7f91a4008040 comp rx=0 tx=0).stop 2023-10-08T00:25:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.320+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b4069d60 msgr2=0x7f91b4153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.320+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b4069d60 0x7f91b4153020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f919c00e980 tx=0x7f919c009120 comp rx=0 tx=0).stop 2023-10-08T00:25:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.321+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb4680cd600 con 0x7fb46815db10 2023-10-08T00:25:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 shutdown_connections 2023-10-08T00:25:01.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b412a660 0x7f91b414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9194067000 0x7f91940694b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91b4069d60 0x7f91b4153020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 --2- 172.21.15.22:0/2331717651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91b406aba0 0x7f91b40ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 >> 172.21.15.22:0/2331717651 conn(0x7f91b40cd670 msgr2=0x7f91b406a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 shutdown_connections 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7f91b8c1e700 1 -- 172.21.15.22:0/2331717651 wait complete. 2023-10-08T00:25:01.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.322+0000 7fb44effd700 1 -- 172.21.15.22:0/2810542371 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4680cd600 con 0x7fb46815db10 2023-10-08T00:25:01.324 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-08T00:25:01.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8c2c0c4ac0 con 0x7f8c2c171f40 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb454066f30 msgr2=0x7fb4540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb454066f30 0x7fb4540693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb46000e280 tx=0x7fb460009040 comp rx=0 tx=0).stop 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb46815db10 msgr2=0x7fb46815c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb46815db10 0x7fb46815c6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb45800c3c0 tx=0x7fb458007ec0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 shutdown_connections 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb46815db10 0x7fb46815c6f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb468159890 0x7fb4680b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb454066f30 0x7fb4540693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 --2- 172.21.15.22:0/2810542371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb468159c60 0x7fb46815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 >> 172.21.15.22:0/2810542371 conn(0x7fb468068e20 msgr2=0x7fb468153280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 shutdown_connections 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7fb46d35f700 1 -- 172.21.15.22:0/2810542371 wait complete. 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.324+0000 7f8c12ffd700 1 -- 172.21.15.22:0/4162209943 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c1c017020 con 0x7f8c2c171f40 2023-10-08T00:25:01.326 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-08T00:25:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.326+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c14068730 msgr2=0x7f8c1406abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.326+0000 7f8c311c5700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c14068730 0x7f8c1406abe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c24000f80 tx=0x7f8c24016000 comp rx=0 tx=0).stop 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.326+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c2c171f40 msgr2=0x7f8c2c148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.326+0000 7f8c311c5700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c2c171f40 0x7f8c2c148060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00f880 tx=0x7f8c1c007d30 comp rx=0 tx=0).stop 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 shutdown_connections 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c14068730 0x7f8c1406abe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c2c06a210 0x7f8c2c06a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c14003bf0 0x7f8c2c0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 --2- 172.21.15.22:0/4162209943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c2c171f40 0x7f8c2c148060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 >> 172.21.15.22:0/4162209943 conn(0x7f8c2c0c9870 msgr2=0x7f8c2c06ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 shutdown_connections 2023-10-08T00:25:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.327+0000 7f8c311c5700 1 -- 172.21.15.22:0/4162209943 wait complete. 2023-10-08T00:25:01.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.332+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4774005560 con 0x7f479006a730 2023-10-08T00:25:01.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.332+0000 7f477e7fc700 1 -- 172.21.15.22:0/1047971223 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4784055aa0 con 0x7f479006a730 2023-10-08T00:25:01.333 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-08T00:25:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.334+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd6f8005830 con 0x7fd7180cb9f0 2023-10-08T00:25:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4778067130 msgr2=0x7f47780695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4778067130 0x7f47780695e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4790069f40 tx=0x7f4780000bc0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f479006a730 msgr2=0x7f47900c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f479006a730 0x7f47900c2950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4784017000 tx=0x7f4784018000 comp rx=0 tx=0).stop 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 shutdown_connections 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4790155780 0x7f4790158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4778067130 0x7f47780695e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f479006a730 0x7f47900c2950 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 --2- 172.21.15.22:0/1047971223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f479006dfd0 0x7f4790177180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 >> 172.21.15.22:0/1047971223 conn(0x7f4790068390 msgr2=0x7f4790068760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7fd6feffd700 1 -- 172.21.15.22:0/526072070 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd708017020 con 0x7fd7180cb9f0 2023-10-08T00:25:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 shutdown_connections 2023-10-08T00:25:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.335+0000 7f4794eb3700 1 -- 172.21.15.22:0/1047971223 wait complete. 2023-10-08T00:25:01.337 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-08T00:25:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.337+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd704067000 msgr2=0x7fd7040694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.337+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd704067000 0x7fd7040694b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd71000e230 tx=0x7fd710009040 comp rx=0 tx=0).stop 2023-10-08T00:25:01.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.337+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180cb9f0 msgr2=0x7fd71813da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.337+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180cb9f0 0x7fd71813da60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c590 tx=0x7fd708007ec0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 shutdown_connections 2023-10-08T00:25:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd718156fb0 0x7fd7181884c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd704067000 0x7fd7040694b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7180cb5a0 0x7fd718159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 --2- 172.21.15.22:0/526072070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7180cb9f0 0x7fd71813da60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 >> 172.21.15.22:0/526072070 conn(0x7fd7180c9870 msgr2=0x7fd71806eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 shutdown_connections 2023-10-08T00:25:01.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.339+0000 7fd71d9d9700 1 -- 172.21.15.22:0/526072070 wait complete. 2023-10-08T00:25:01.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-08T00:25:01.343 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-10-08T00:25:01.348 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-08T00:25:01.348 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-10-08T00:25:01.356 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-10-08T00:25:01.357 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:01.358 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T00:25:01.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.516+0000 7f8e61676700 1 Processor -- start 2023-10-08T00:25:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.516+0000 7f8e61676700 1 -- start start 2023-10-08T00:25:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e61676700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8e5c159b10 0x7f8e5c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e61676700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0c74b0 con 0x7f8e5c06b420 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e61676700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0c8700 con 0x7f8e5c15d730 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e61676700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0c9070 con 0x7f8e5c159b10 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e5affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8e5c159b10 0x7f8e5c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e5b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8e5c06b420 0x7f8e5c15a5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59940/0 (socket says 172.21.15.22:59940) 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.517+0000 7f8e5b7fe700 1 -- 172.21.15.22:0/1594937090 learned_addr learned my addr 172.21.15.22:0/1594937090 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e5affd700 1 -- 172.21.15.22:0/1594937090 >> v1:172.21.15.192:6789/0 conn(0x7f8e5c15d730 legacy=0x7f8e5c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e5affd700 1 -- 172.21.15.22:0/1594937090 >> v1:172.21.15.22:6789/0 conn(0x7f8e5c06b420 legacy=0x7f8e5c15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e5affd700 1 -- 172.21.15.22:0/1594937090 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0c80f0 con 0x7f8e5c159b10 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e59ffb700 1 -- 172.21.15.22:0/1594937090 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776728533 0 0) 0x7f8e5c0c74b0 con 0x7f8e5c06b420 2023-10-08T00:25:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e5affd700 1 --2- 172.21.15.22:0/1594937090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c159b10 0x7f8e5c0cb3e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e540098e0 tx=0x7f8e540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c7ffe1cdc1aae2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e59ffb700 1 -- 172.21.15.22:0/1594937090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e54009e80 con 0x7f8e5c159b10 2023-10-08T00:25:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e59ffb700 1 -- 172.21.15.22:0/1594937090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5400b8f0 con 0x7f8e5c159b10 2023-10-08T00:25:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e59ffb700 1 -- 172.21.15.22:0/1594937090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400bc70 con 0x7f8e5c159b10 2023-10-08T00:25:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e61676700 1 -- 172.21.15.22:0/1594937090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c159b10 msgr2=0x7f8e5c0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.518+0000 7f8e61676700 1 --2- 172.21.15.22:0/1594937090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c159b10 0x7f8e5c0cb3e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e540098e0 tx=0x7f8e540091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.519+0000 7f8e61676700 1 -- 172.21.15.22:0/1594937090 shutdown_connections 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.519+0000 7f8e61676700 1 --2- 172.21.15.22:0/1594937090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c159b10 0x7f8e5c0cb3e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.519+0000 7f8e61676700 1 -- 172.21.15.22:0/1594937090 >> 172.21.15.22:0/1594937090 conn(0x7f8e5c0c9870 msgr2=0x7f8e5c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.519+0000 7f8e61676700 1 -- 172.21.15.22:0/1594937090 shutdown_connections 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.519+0000 7f8e61676700 1 -- 172.21.15.22:0/1594937090 wait complete. 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.520+0000 7f8e61676700 1 Processor -- start 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.520+0000 7f8e61676700 1 -- start start 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.520+0000 7f8e61676700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e5c06b420 0x7f8e5c152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.520+0000 7f8e61676700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e5c159b10 0x7f8e5c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e61676700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 0x7f8e5c14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e61676700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c15abd0 con 0x7f8e5c15d730 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e61676700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c15a420 con 0x7f8e5c06b420 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e61676700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c14e440 con 0x7f8e5c159b10 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 0x7f8e5c14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 0x7f8e5c14df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60486/0 (socket says 172.21.15.22:60486) 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 -- 172.21.15.22:0/2655635778 learned_addr learned my addr 172.21.15.22:0/2655635778 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5a7fc700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e5c159b10 0x7f8e5c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5affd700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e5c06b420 0x7f8e5c152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 -- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e5c159b10 msgr2=0x7f8e5c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e5c159b10 0x7f8e5c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 -- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e5c06b420 msgr2=0x7f8e5c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e5c06b420 0x7f8e5c152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 -- 172.21.15.22:0/2655635778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e54009420 con 0x7f8e5c15d730 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5a7fc700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e5c159b10 0x7f8e5c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e5b7fe700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 0x7f8e5c14df00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00cbf0 tx=0x7f8e4c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00a910 con 0x7f8e5c15d730 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00aa70 con 0x7f8e5c15d730 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c0b0ed0 con 0x7f8e5c15d730 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00ae30 con 0x7f8e5c15d730 2023-10-08T00:25:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.521+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c15a8f0 con 0x7f8e5c15d730 2023-10-08T00:25:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.522+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c0b1060 con 0x7f8e5c15d730 2023-10-08T00:25:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.523+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e4c007300 con 0x7f8e5c15d730 2023-10-08T00:25:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.523+0000 7f8e52ffd700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e3c066f30 0x7f8e3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.523+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e4c084880 con 0x7f8e5c15d730 2023-10-08T00:25:01.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.523+0000 7f8e5affd700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e3c066f30 0x7f8e3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.524+0000 7f8e5affd700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e3c066f30 0x7f8e3c0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e540093f0 tx=0x7f8e54017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:01.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.527+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e4c051b70 con 0x7f8e5c15d730 2023-10-08T00:25:01.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.720+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e5c04c3c0 con 0x7f8e3c066f30 2023-10-08T00:25:01.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.728+0000 7f8e52ffd700 1 -- 172.21.15.22:0/2655635778 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264525 (secure 0 0 0) 0x7f8e5c04c3c0 con 0x7f8e3c066f30 2023-10-08T00:25:01.731 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e3c066f30 msgr2=0x7f8e3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e3c066f30 0x7f8e3c0693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8e540093f0 tx=0x7f8e54017000 comp rx=0 tx=0).stop 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 msgr2=0x7f8e5c14df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 0x7f8e5c14df00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00cbf0 tx=0x7f8e4c0019b0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 shutdown_connections 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e5c15d730 0x7f8e5c14df00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e5c06b420 0x7f8e5c152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e3c066f30 0x7f8e3c0693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 --2- 172.21.15.22:0/2655635778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e5c159b10 0x7f8e5c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 >> 172.21.15.22:0/2655635778 conn(0x7f8e5c0c9870 msgr2=0x7f8e5c14ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 shutdown_connections 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.731+0000 7f8e61676700 1 -- 172.21.15.22:0/2655635778 wait complete. 2023-10-08T00:25:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T00:25:00.384633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001874"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987593+0000","last_change":"2023-10-08T00:24:52.980100+0000","last_active":"2023-10-08T00:24:52.987593+0000","last_peered":"2023-10-08T00:24:52.987593+0000","last_clean":"2023-10-08T00:24:52.987593+0000","last_became_active":"2023-10-08T00:24:52.979488+0000","last_became_peered":"2023-10-08T00:24:52.979488+0000","last_unstale":"2023-10-08T00:24:52.987593+0000","last_undegraded":"2023-10-08T00:24:52.987593+0000","last_fullsized":"2023-10-08T00:24:52.987593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984472+0000","last_change":"2023-10-08T00:24:52.980140+0000","last_active":"2023-10-08T00:24:52.984472+0000","last_peered":"2023-10-08T00:24:52.984472+0000","last_clean":"2023-10-08T00:24:52.984472+0000","last_became_active":"2023-10-08T00:24:52.979888+0000","last_became_peered":"2023-10-08T00:24:52.979888+0000","last_unstale":"2023-10-08T00:24:52.984472+0000","last_undegraded":"2023-10-08T00:24:52.984472+0000","last_fullsized":"2023-10-08T00:24:52.984472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977786+0000","last_change":"2023-10-08T00:24:52.970748+0000","last_active":"2023-10-08T00:24:52.977786+0000","last_peered":"2023-10-08T00:24:52.977786+0000","last_clean":"2023-10-08T00:24:52.977786+0000","last_became_active":"2023-10-08T00:24:52.970491+0000","last_became_peered":"2023-10-08T00:24:52.970491+0000","last_unstale":"2023-10-08T00:24:52.977786+0000","last_undegraded":"2023-10-08T00:24:52.977786+0000","last_fullsized":"2023-10-08T00:24:52.977786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:58:54.945526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988272+0000","last_change":"2023-10-08T00:24:52.983186+0000","last_active":"2023-10-08T00:24:52.988272+0000","last_peered":"2023-10-08T00:24:52.988272+0000","last_clean":"2023-10-08T00:24:52.988272+0000","last_became_active":"2023-10-08T00:24:52.982126+0000","last_became_peered":"2023-10-08T00:24:52.982126+0000","last_unstale":"2023-10-08T00:24:52.988272+0000","last_undegraded":"2023-10-08T00:24:52.988272+0000","last_fullsized":"2023-10-08T00:24:52.988272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985965+0000","last_change":"2023-10-08T00:24:52.979734+0000","last_active":"2023-10-08T00:24:52.985965+0000","last_peered":"2023-10-08T00:24:52.985965+0000","last_clean":"2023-10-08T00:24:52.985965+0000","last_became_active":"2023-10-08T00:24:52.979268+0000","last_became_peered":"2023-10-08T00:24:52.979268+0000","last_unstale":"2023-10-08T00:24:52.985965+0000","last_undegraded":"2023-10-08T00:24:52.985965+0000","last_fullsized":"2023-10-08T00:24:52.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:36:19.519679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985000+0000","last_change":"2023-10-08T00:24:52.981418+0000","last_active":"2023-10-08T00:24:52.985000+0000","last_peered":"2023-10-08T00:24:52.985000+0000","last_clean":"2023-10-08T00:24:52.985000+0000","last_became_active":"2023-10-08T00:24:52.980593+0000","last_became_peered":"2023-10-08T00:24:52.980593+0000","last_unstale":"2023-10-08T00:24:52.985000+0000","last_undegraded":"2023-10-08T00:24:52.985000+0000","last_fullsized":"2023-10-08T00:24:52.985000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985828+0000","last_change":"2023-10-08T00:24:52.981519+0000","last_active":"2023-10-08T00:24:52.985828+0000","last_peered":"2023-10-08T00:24:52.985828+0000","last_clean":"2023-10-08T00:24:52.985828+0000","last_became_active":"2023-10-08T00:24:52.981233+0000","last_became_peered":"2023-10-08T00:24:52.981233+0000","last_unstale":"2023-10-08T00:24:52.985828+0000","last_undegraded":"2023-10-08T00:24:52.985828+0000","last_fullsized":"2023-10-08T00:24:52.985828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992041+0000","last_change":"2023-10-08T00:24:52.987504+0000","last_active":"2023-10-08T00:24:52.992041+0000","last_peered":"2023-10-08T00:24:52.992041+0000","last_clean":"2023-10-08T00:24:52.992041+0000","last_became_active":"2023-10-08T00:24:52.987271+0000","last_became_peered":"2023-10-08T00:24:52.987271+0000","last_unstale":"2023-10-08T00:24:52.992041+0000","last_undegraded":"2023-10-08T00:24:52.992041+0000","last_fullsized":"2023-10-08T00:24:52.992041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991414+0000","last_change":"2023-10-08T00:24:52.984830+0000","last_active":"2023-10-08T00:24:52.991414+0000","last_peered":"2023-10-08T00:24:52.991414+0000","last_clean":"2023-10-08T00:24:52.991414+0000","last_became_active":"2023-10-08T00:24:52.984399+0000","last_became_peered":"2023-10-08T00:24:52.984399+0000","last_unstale":"2023-10-08T00:24:52.991414+0000","last_undegraded":"2023-10-08T00:24:52.991414+0000","last_fullsized":"2023-10-08T00:24:52.991414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990097+0000","last_change":"2023-10-08T00:24:52.982279+0000","last_active":"2023-10-08T00:24:52.990097+0000","last_peered":"2023-10-08T00:24:52.990097+0000","last_clean":"2023-10-08T00:24:52.990097+0000","last_became_active":"2023-10-08T00:24:52.981839+0000","last_became_peered":"2023-10-08T00:24:52.981839+0000","last_unstale":"2023-10-08T00:24:52.990097+0000","last_undegraded":"2023-10-08T00:24:52.990097+0000","last_fullsized":"2023-10-08T00:24:52.990097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990366+0000","last_change":"2023-10-08T00:24:52.985741+0000","last_active":"2023-10-08T00:24:52.990366+0000","last_peered":"2023-10-08T00:24:52.990366+0000","last_clean":"2023-10-08T00:24:52.990366+0000","last_became_active":"2023-10-08T00:24:52.985429+0000","last_became_peered":"2023-10-08T00:24:52.985429+0000","last_unstale":"2023-10-08T00:24:52.990366+0000","last_undegraded":"2023-10-08T00:24:52.990366+0000","last_fullsized":"2023-10-08T00:24:52.990366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988968+0000","last_change":"2023-10-08T00:24:52.978519+0000","last_active":"2023-10-08T00:24:52.988968+0000","last_peered":"2023-10-08T00:24:52.988968+0000","last_clean":"2023-10-08T00:24:52.988968+0000","last_became_active":"2023-10-08T00:24:52.977483+0000","last_became_peered":"2023-10-08T00:24:52.977483+0000","last_unstale":"2023-10-08T00:24:52.988968+0000","last_undegraded":"2023-10-08T00:24:52.988968+0000","last_fullsized":"2023-10-08T00:24:52.988968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:54.276268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992137+0000","last_change":"2023-10-08T00:24:52.987977+0000","last_active":"2023-10-08T00:24:52.992137+0000","last_peered":"2023-10-08T00:24:52.992137+0000","last_clean":"2023-10-08T00:24:52.992137+0000","last_became_active":"2023-10-08T00:24:52.987722+0000","last_became_peered":"2023-10-08T00:24:52.987722+0000","last_unstale":"2023-10-08T00:24:52.992137+0000","last_undegraded":"2023-10-08T00:24:52.992137+0000","last_fullsized":"2023-10-08T00:24:52.992137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986854+0000","last_change":"2023-10-08T00:24:52.978011+0000","last_active":"2023-10-08T00:24:52.986854+0000","last_peered":"2023-10-08T00:24:52.986854+0000","last_clean":"2023-10-08T00:24:52.986854+0000","last_became_active":"2023-10-08T00:24:52.977718+0000","last_became_peered":"2023-10-08T00:24:52.977718+0000","last_unstale":"2023-10-08T00:24:52.986854+0000","last_undegraded":"2023-10-08T00:24:52.986854+0000","last_fullsized":"2023-10-08T00:24:52.986854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983827+0000","last_change":"2023-10-08T00:24:52.977428+0000","last_active":"2023-10-08T00:24:52.983827+0000","last_peered":"2023-10-08T00:24:52.983827+0000","last_clean":"2023-10-08T00:24:52.983827+0000","last_became_active":"2023-10-08T00:24:52.977116+0000","last_became_peered":"2023-10-08T00:24:52.977116+0000","last_unstale":"2023-10-08T00:24:52.983827+0000","last_undegraded":"2023-10-08T00:24:52.983827+0000","last_fullsized":"2023-10-08T00:24:52.983827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991223+0000","last_change":"2023-10-08T00:24:52.988555+0000","last_active":"2023-10-08T00:24:52.991223+0000","last_peered":"2023-10-08T00:24:52.991223+0000","last_clean":"2023-10-08T00:24:52.991223+0000","last_became_active":"2023-10-08T00:24:52.988256+0000","last_became_peered":"2023-10-08T00:24:52.988256+0000","last_unstale":"2023-10-08T00:24:52.991223+0000","last_undegraded":"2023-10-08T00:24:52.991223+0000","last_fullsized":"2023-10-08T00:24:52.991223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984667+0000","last_change":"2023-10-08T00:24:52.980846+0000","last_active":"2023-10-08T00:24:52.984667+0000","last_peered":"2023-10-08T00:24:52.984667+0000","last_clean":"2023-10-08T00:24:52.984667+0000","last_became_active":"2023-10-08T00:24:52.980566+0000","last_became_peered":"2023-10-08T00:24:52.980566+0000","last_unstale":"2023-10-08T00:24:52.984667+0000","last_undegraded":"2023-10-08T00:24:52.984667+0000","last_fullsized":"2023-10-08T00:24:52.984667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983078+0000","last_change":"2023-10-08T00:24:52.976521+0000","last_active":"2023-10-08T00:24:52.983078+0000","last_peered":"2023-10-08T00:24:52.983078+0000","last_clean":"2023-10-08T00:24:52.983078+0000","last_became_active":"2023-10-08T00:24:52.976306+0000","last_became_peered":"2023-10-08T00:24:52.976306+0000","last_unstale":"2023-10-08T00:24:52.983078+0000","last_undegraded":"2023-10-08T00:24:52.983078+0000","last_fullsized":"2023-10-08T00:24:52.983078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987877+0000","last_change":"2023-10-08T00:24:52.980143+0000","last_active":"2023-10-08T00:24:52.987877+0000","last_peered":"2023-10-08T00:24:52.987877+0000","last_clean":"2023-10-08T00:24:52.987877+0000","last_became_active":"2023-10-08T00:24:52.979863+0000","last_became_peered":"2023-10-08T00:24:52.979863+0000","last_unstale":"2023-10-08T00:24:52.987877+0000","last_undegraded":"2023-10-08T00:24:52.987877+0000","last_fullsized":"2023-10-08T00:24:52.987877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:29.094765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992779+0000","last_change":"2023-10-08T00:24:51.970340+0000","last_active":"2023-10-08T00:24:52.992779+0000","last_peered":"2023-10-08T00:24:52.992779+0000","last_clean":"2023-10-08T00:24:52.992779+0000","last_became_active":"2023-10-08T00:24:51.970091+0000","last_became_peered":"2023-10-08T00:24:51.970091+0000","last_unstale":"2023-10-08T00:24:52.992779+0000","last_undegraded":"2023-10-08T00:24:52.992779+0000","last_fullsized":"2023-10-08T00:24:52.992779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:35.474566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991838+0000","last_change":"2023-10-08T00:24:52.978891+0000","last_active":"2023-10-08T00:24:52.991838+0000","last_peered":"2023-10-08T00:24:52.991838+0000","last_clean":"2023-10-08T00:24:52.991838+0000","last_became_active":"2023-10-08T00:24:52.978193+0000","last_became_peered":"2023-10-08T00:24:52.978193+0000","last_unstale":"2023-10-08T00:24:52.991838+0000","last_undegraded":"2023-10-08T00:24:52.991838+0000","last_fullsized":"2023-10-08T00:24:52.991838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992750+0000","last_change":"2023-10-08T00:24:51.975777+0000","last_active":"2023-10-08T00:24:52.992750+0000","last_peered":"2023-10-08T00:24:52.992750+0000","last_clean":"2023-10-08T00:24:52.992750+0000","last_became_active":"2023-10-08T00:24:51.975506+0000","last_became_peered":"2023-10-08T00:24:51.975506+0000","last_unstale":"2023-10-08T00:24:52.992750+0000","last_undegraded":"2023-10-08T00:24:52.992750+0000","last_fullsized":"2023-10-08T00:24:52.992750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987295+0000","last_change":"2023-10-08T00:24:52.980914+0000","last_active":"2023-10-08T00:24:52.987295+0000","last_peered":"2023-10-08T00:24:52.987295+0000","last_clean":"2023-10-08T00:24:52.987295+0000","last_became_active":"2023-10-08T00:24:52.980619+0000","last_became_peered":"2023-10-08T00:24:52.980619+0000","last_unstale":"2023-10-08T00:24:52.987295+0000","last_undegraded":"2023-10-08T00:24:52.987295+0000","last_fullsized":"2023-10-08T00:24:52.987295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991737+0000","last_change":"2023-10-08T00:24:51.971927+0000","last_active":"2023-10-08T00:24:52.991737+0000","last_peered":"2023-10-08T00:24:52.991737+0000","last_clean":"2023-10-08T00:24:52.991737+0000","last_became_active":"2023-10-08T00:24:51.971651+0000","last_became_peered":"2023-10-08T00:24:51.971651+0000","last_unstale":"2023-10-08T00:24:52.991737+0000","last_undegraded":"2023-10-08T00:24:52.991737+0000","last_fullsized":"2023-10-08T00:24:52.991737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:16.625598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984785+0000","last_change":"2023-10-08T00:24:52.981876+0000","last_active":"2023-10-08T00:24:52.984785+0000","last_peered":"2023-10-08T00:24:52.984785+0000","last_clean":"2023-10-08T00:24:52.984785+0000","last_became_active":"2023-10-08T00:24:52.981627+0000","last_became_peered":"2023-10-08T00:24:52.981627+0000","last_unstale":"2023-10-08T00:24:52.984785+0000","last_undegraded":"2023-10-08T00:24:52.984785+0000","last_fullsized":"2023-10-08T00:24:52.984785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991526+0000","last_change":"2023-10-08T00:24:51.974282+0000","last_active":"2023-10-08T00:24:52.991526+0000","last_peered":"2023-10-08T00:24:52.991526+0000","last_clean":"2023-10-08T00:24:52.991526+0000","last_became_active":"2023-10-08T00:24:51.973653+0000","last_became_peered":"2023-10-08T00:24:51.973653+0000","last_unstale":"2023-10-08T00:24:52.991526+0000","last_undegraded":"2023-10-08T00:24:52.991526+0000","last_fullsized":"2023-10-08T00:24:52.991526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989925+0000","last_change":"2023-10-08T00:24:52.984614+0000","last_active":"2023-10-08T00:24:52.989925+0000","last_peered":"2023-10-08T00:24:52.989925+0000","last_clean":"2023-10-08T00:24:52.989925+0000","last_became_active":"2023-10-08T00:24:52.984295+0000","last_became_peered":"2023-10-08T00:24:52.984295+0000","last_unstale":"2023-10-08T00:24:52.989925+0000","last_undegraded":"2023-10-08T00:24:52.989925+0000","last_fullsized":"2023-10-08T00:24:52.989925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.994140+0000","last_change":"2023-10-08T00:24:51.973991+0000","last_active":"2023-10-08T00:24:52.994140+0000","last_peered":"2023-10-08T00:24:52.994140+0000","last_clean":"2023-10-08T00:24:52.994140+0000","last_became_active":"2023-10-08T00:24:51.973771+0000","last_became_peered":"2023-10-08T00:24:51.973771+0000","last_unstale":"2023-10-08T00:24:52.994140+0000","last_undegraded":"2023-10-08T00:24:52.994140+0000","last_fullsized":"2023-10-08T00:24:52.994140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986683+0000","last_change":"2023-10-08T00:24:52.977312+0000","last_active":"2023-10-08T00:24:52.986683+0000","last_peered":"2023-10-08T00:24:52.986683+0000","last_clean":"2023-10-08T00:24:52.986683+0000","last_became_active":"2023-10-08T00:24:52.977056+0000","last_became_peered":"2023-10-08T00:24:52.977056+0000","last_unstale":"2023-10-08T00:24:52.986683+0000","last_undegraded":"2023-10-08T00:24:52.986683+0000","last_fullsized":"2023-10-08T00:24:52.986683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:42.211488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990236+0000","last_change":"2023-10-08T00:24:51.967116+0000","last_active":"2023-10-08T00:24:52.990236+0000","last_peered":"2023-10-08T00:24:52.990236+0000","last_clean":"2023-10-08T00:24:52.990236+0000","last_became_active":"2023-10-08T00:24:51.966840+0000","last_became_peered":"2023-10-08T00:24:51.966840+0000","last_unstale":"2023-10-08T00:24:52.990236+0000","last_undegraded":"2023-10-08T00:24:52.990236+0000","last_fullsized":"2023-10-08T00:24:52.990236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985387+0000","last_change":"2023-10-08T00:24:52.977803+0000","last_active":"2023-10-08T00:24:52.985387+0000","last_peered":"2023-10-08T00:24:52.985387+0000","last_clean":"2023-10-08T00:24:52.985387+0000","last_became_active":"2023-10-08T00:24:52.977087+0000","last_became_peered":"2023-10-08T00:24:52.977087+0000","last_unstale":"2023-10-08T00:24:52.985387+0000","last_undegraded":"2023-10-08T00:24:52.985387+0000","last_fullsized":"2023-10-08T00:24:52.985387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:57.537199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.966959+0000","last_change":"2023-10-08T00:24:51.969025+0000","last_active":"2023-10-08T00:24:52.966959+0000","last_peered":"2023-10-08T00:24:52.966959+0000","last_clean":"2023-10-08T00:24:52.966959+0000","last_became_active":"2023-10-08T00:24:51.968702+0000","last_became_peered":"2023-10-08T00:24:51.968702+0000","last_unstale":"2023-10-08T00:24:52.966959+0000","last_undegraded":"2023-10-08T00:24:52.966959+0000","last_fullsized":"2023-10-08T00:24:52.966959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.978409+0000","last_change":"2023-10-08T00:24:52.976159+0000","last_active":"2023-10-08T00:24:52.978409+0000","last_peered":"2023-10-08T00:24:52.978409+0000","last_clean":"2023-10-08T00:24:52.978409+0000","last_became_active":"2023-10-08T00:24:52.975536+0000","last_became_peered":"2023-10-08T00:24:52.975536+0000","last_unstale":"2023-10-08T00:24:52.978409+0000","last_undegraded":"2023-10-08T00:24:52.978409+0000","last_fullsized":"2023-10-08T00:24:52.978409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976877+0000","last_change":"2023-10-08T00:24:51.969405+0000","last_active":"2023-10-08T00:24:52.976877+0000","last_peered":"2023-10-08T00:24:52.976877+0000","last_clean":"2023-10-08T00:24:52.976877+0000","last_became_active":"2023-10-08T00:24:51.968440+0000","last_became_peered":"2023-10-08T00:24:51.968440+0000","last_unstale":"2023-10-08T00:24:52.976877+0000","last_undegraded":"2023-10-08T00:24:52.976877+0000","last_fullsized":"2023-10-08T00:24:52.976877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984498+0000","last_change":"2023-10-08T00:24:52.982102+0000","last_active":"2023-10-08T00:24:52.984498+0000","last_peered":"2023-10-08T00:24:52.984498+0000","last_clean":"2023-10-08T00:24:52.984498+0000","last_became_active":"2023-10-08T00:24:52.981842+0000","last_became_peered":"2023-10-08T00:24:52.981842+0000","last_unstale":"2023-10-08T00:24:52.984498+0000","last_undegraded":"2023-10-08T00:24:52.984498+0000","last_fullsized":"2023-10-08T00:24:52.984498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969031+0000","last_change":"2023-10-08T00:24:51.968433+0000","last_active":"2023-10-08T00:24:52.969031+0000","last_peered":"2023-10-08T00:24:52.969031+0000","last_clean":"2023-10-08T00:24:52.969031+0000","last_became_active":"2023-10-08T00:24:51.967679+0000","last_became_peered":"2023-10-08T00:24:51.967679+0000","last_unstale":"2023-10-08T00:24:52.969031+0000","last_undegraded":"2023-10-08T00:24:52.969031+0000","last_fullsized":"2023-10-08T00:24:52.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984774+0000","last_change":"2023-10-08T00:24:52.980963+0000","last_active":"2023-10-08T00:24:52.984774+0000","last_peered":"2023-10-08T00:24:52.984774+0000","last_clean":"2023-10-08T00:24:52.984774+0000","last_became_active":"2023-10-08T00:24:52.980687+0000","last_became_peered":"2023-10-08T00:24:52.980687+0000","last_unstale":"2023-10-08T00:24:52.984774+0000","last_undegraded":"2023-10-08T00:24:52.984774+0000","last_fullsized":"2023-10-08T00:24:52.984774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976476+0000","last_change":"2023-10-08T00:24:51.970567+0000","last_active":"2023-10-08T00:24:52.976476+0000","last_peered":"2023-10-08T00:24:52.976476+0000","last_clean":"2023-10-08T00:24:52.976476+0000","last_became_active":"2023-10-08T00:24:51.970311+0000","last_became_peered":"2023-10-08T00:24:51.970311+0000","last_unstale":"2023-10-08T00:24:52.976476+0000","last_undegraded":"2023-10-08T00:24:52.976476+0000","last_fullsized":"2023-10-08T00:24:52.976476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:43:53.665259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988302+0000","last_change":"2023-10-08T00:24:52.986368+0000","last_active":"2023-10-08T00:24:52.988302+0000","last_peered":"2023-10-08T00:24:52.988302+0000","last_clean":"2023-10-08T00:24:52.988302+0000","last_became_active":"2023-10-08T00:24:52.986130+0000","last_became_peered":"2023-10-08T00:24:52.986130+0000","last_unstale":"2023-10-08T00:24:52.988302+0000","last_undegraded":"2023-10-08T00:24:52.988302+0000","last_fullsized":"2023-10-08T00:24:52.988302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993145+0000","last_change":"2023-10-08T00:24:51.973262+0000","last_active":"2023-10-08T00:24:52.993145+0000","last_peered":"2023-10-08T00:24:52.993145+0000","last_clean":"2023-10-08T00:24:52.993145+0000","last_became_active":"2023-10-08T00:24:51.972999+0000","last_became_peered":"2023-10-08T00:24:51.972999+0000","last_unstale":"2023-10-08T00:24:52.993145+0000","last_undegraded":"2023-10-08T00:24:52.993145+0000","last_fullsized":"2023-10-08T00:24:52.993145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989532+0000","last_change":"2023-10-08T00:24:52.982031+0000","last_active":"2023-10-08T00:24:52.989532+0000","last_peered":"2023-10-08T00:24:52.989532+0000","last_clean":"2023-10-08T00:24:52.989532+0000","last_became_active":"2023-10-08T00:24:52.980819+0000","last_became_peered":"2023-10-08T00:24:52.980819+0000","last_unstale":"2023-10-08T00:24:52.989532+0000","last_undegraded":"2023-10-08T00:24:52.989532+0000","last_fullsized":"2023-10-08T00:24:52.989532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.997915+0000","last_change":"2023-10-08T00:24:51.968287+0000","last_active":"2023-10-08T00:24:52.997915+0000","last_peered":"2023-10-08T00:24:52.997915+0000","last_clean":"2023-10-08T00:24:52.997915+0000","last_became_active":"2023-10-08T00:24:51.967698+0000","last_became_peered":"2023-10-08T00:24:51.967698+0000","last_unstale":"2023-10-08T00:24:52.997915+0000","last_undegraded":"2023-10-08T00:24:52.997915+0000","last_fullsized":"2023-10-08T00:24:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990585+0000","last_change":"2023-10-08T00:24:52.983840+0000","last_active":"2023-10-08T00:24:52.990585+0000","last_peered":"2023-10-08T00:24:52.990585+0000","last_clean":"2023-10-08T00:24:52.990585+0000","last_became_active":"2023-10-08T00:24:52.983567+0000","last_became_peered":"2023-10-08T00:24:52.983567+0000","last_unstale":"2023-10-08T00:24:52.990585+0000","last_undegraded":"2023-10-08T00:24:52.990585+0000","last_fullsized":"2023-10-08T00:24:52.990585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:34:31.254296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990688+0000","last_change":"2023-10-08T00:24:51.971465+0000","last_active":"2023-10-08T00:24:52.990688+0000","last_peered":"2023-10-08T00:24:52.990688+0000","last_clean":"2023-10-08T00:24:52.990688+0000","last_became_active":"2023-10-08T00:24:51.971212+0000","last_became_peered":"2023-10-08T00:24:51.971212+0000","last_unstale":"2023-10-08T00:24:52.990688+0000","last_undegraded":"2023-10-08T00:24:52.990688+0000","last_fullsized":"2023-10-08T00:24:52.990688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:19.468028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986877+0000","last_change":"2023-10-08T00:24:52.981698+0000","last_active":"2023-10-08T00:24:52.986877+0000","last_peered":"2023-10-08T00:24:52.986877+0000","last_clean":"2023-10-08T00:24:52.986877+0000","last_became_active":"2023-10-08T00:24:52.981431+0000","last_became_peered":"2023-10-08T00:24:52.981431+0000","last_unstale":"2023-10-08T00:24:52.986877+0000","last_undegraded":"2023-10-08T00:24:52.986877+0000","last_fullsized":"2023-10-08T00:24:52.986877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970306+0000","last_change":"2023-10-08T00:24:51.972585+0000","last_active":"2023-10-08T00:24:52.970306+0000","last_peered":"2023-10-08T00:24:52.970306+0000","last_clean":"2023-10-08T00:24:52.970306+0000","last_became_active":"2023-10-08T00:24:51.972285+0000","last_became_peered":"2023-10-08T00:24:51.972285+0000","last_unstale":"2023-10-08T00:24:52.970306+0000","last_undegraded":"2023-10-08T00:24:52.970306+0000","last_fullsized":"2023-10-08T00:24:52.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991943+0000","last_change":"2023-10-08T00:24:52.990394+0000","last_active":"2023-10-08T00:24:52.991943+0000","last_peered":"2023-10-08T00:24:52.991943+0000","last_clean":"2023-10-08T00:24:52.991943+0000","last_became_active":"2023-10-08T00:24:52.990088+0000","last_became_peered":"2023-10-08T00:24:52.990088+0000","last_unstale":"2023-10-08T00:24:52.991943+0000","last_undegraded":"2023-10-08T00:24:52.991943+0000","last_fullsized":"2023-10-08T00:24:52.991943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968176+0000","last_change":"2023-10-08T00:24:51.965511+0000","last_active":"2023-10-08T00:24:52.968176+0000","last_peered":"2023-10-08T00:24:52.968176+0000","last_clean":"2023-10-08T00:24:52.968176+0000","last_became_active":"2023-10-08T00:24:51.965135+0000","last_became_peered":"2023-10-08T00:24:51.965135+0000","last_unstale":"2023-10-08T00:24:52.968176+0000","last_undegraded":"2023-10-08T00:24:52.968176+0000","last_fullsized":"2023-10-08T00:24:52.968176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989987+0000","last_change":"2023-10-08T00:24:52.979423+0000","last_active":"2023-10-08T00:24:52.989987+0000","last_peered":"2023-10-08T00:24:52.989987+0000","last_clean":"2023-10-08T00:24:52.989987+0000","last_became_active":"2023-10-08T00:24:52.979088+0000","last_became_peered":"2023-10-08T00:24:52.979088+0000","last_unstale":"2023-10-08T00:24:52.989987+0000","last_undegraded":"2023-10-08T00:24:52.989987+0000","last_fullsized":"2023-10-08T00:24:52.989987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992031+0000","last_change":"2023-10-08T00:24:51.971820+0000","last_active":"2023-10-08T00:24:52.992031+0000","last_peered":"2023-10-08T00:24:52.992031+0000","last_clean":"2023-10-08T00:24:52.992031+0000","last_became_active":"2023-10-08T00:24:51.971563+0000","last_became_peered":"2023-10-08T00:24:51.971563+0000","last_unstale":"2023-10-08T00:24:52.992031+0000","last_undegraded":"2023-10-08T00:24:52.992031+0000","last_fullsized":"2023-10-08T00:24:52.992031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991999+0000","last_change":"2023-10-08T00:24:52.990737+0000","last_active":"2023-10-08T00:24:52.991999+0000","last_peered":"2023-10-08T00:24:52.991999+0000","last_clean":"2023-10-08T00:24:52.991999+0000","last_became_active":"2023-10-08T00:24:52.990032+0000","last_became_peered":"2023-10-08T00:24:52.990032+0000","last_unstale":"2023-10-08T00:24:52.991999+0000","last_undegraded":"2023-10-08T00:24:52.991999+0000","last_fullsized":"2023-10-08T00:24:52.991999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991333+0000","last_change":"2023-10-08T00:24:51.964547+0000","last_active":"2023-10-08T00:24:52.991333+0000","last_peered":"2023-10-08T00:24:52.991333+0000","last_clean":"2023-10-08T00:24:52.991333+0000","last_became_active":"2023-10-08T00:24:51.963951+0000","last_became_peered":"2023-10-08T00:24:51.963951+0000","last_unstale":"2023-10-08T00:24:52.991333+0000","last_undegraded":"2023-10-08T00:24:52.991333+0000","last_fullsized":"2023-10-08T00:24:52.991333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:24.358934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991658+0000","last_change":"2023-10-08T00:24:52.987475+0000","last_active":"2023-10-08T00:24:52.991658+0000","last_peered":"2023-10-08T00:24:52.991658+0000","last_clean":"2023-10-08T00:24:52.991658+0000","last_became_active":"2023-10-08T00:24:52.987054+0000","last_became_peered":"2023-10-08T00:24:52.987054+0000","last_unstale":"2023-10-08T00:24:52.991658+0000","last_undegraded":"2023-10-08T00:24:52.991658+0000","last_fullsized":"2023-10-08T00:24:52.991658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970458+0000","last_change":"2023-10-08T00:24:51.971914+0000","last_active":"2023-10-08T00:24:52.970458+0000","last_peered":"2023-10-08T00:24:52.970458+0000","last_clean":"2023-10-08T00:24:52.970458+0000","last_became_active":"2023-10-08T00:24:51.971486+0000","last_became_peered":"2023-10-08T00:24:51.971486+0000","last_unstale":"2023-10-08T00:24:52.970458+0000","last_undegraded":"2023-10-08T00:24:52.970458+0000","last_fullsized":"2023-10-08T00:24:52.970458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996934+0000","last_change":"2023-10-08T00:24:52.995174+0000","last_active":"2023-10-08T00:24:52.996934+0000","last_peered":"2023-10-08T00:24:52.996934+0000","last_clean":"2023-10-08T00:24:52.996934+0000","last_became_active":"2023-10-08T00:24:52.994900+0000","last_became_peered":"2023-10-08T00:24:52.994900+0000","last_unstale":"2023-10-08T00:24:52.996934+0000","last_undegraded":"2023-10-08T00:24:52.996934+0000","last_fullsized":"2023-10-08T00:24:52.996934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970200+0000","last_change":"2023-10-08T00:24:51.969965+0000","last_active":"2023-10-08T00:24:52.970200+0000","last_peered":"2023-10-08T00:24:52.970200+0000","last_clean":"2023-10-08T00:24:52.970200+0000","last_became_active":"2023-10-08T00:24:51.969745+0000","last_became_peered":"2023-10-08T00:24:51.969745+0000","last_unstale":"2023-10-08T00:24:52.970200+0000","last_undegraded":"2023-10-08T00:24:52.970200+0000","last_fullsized":"2023-10-08T00:24:52.970200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.980067+0000","last_change":"2023-10-08T00:24:52.971665+0000","last_active":"2023-10-08T00:24:52.980067+0000","last_peered":"2023-10-08T00:24:52.980067+0000","last_clean":"2023-10-08T00:24:52.980067+0000","last_became_active":"2023-10-08T00:24:52.971399+0000","last_became_peered":"2023-10-08T00:24:52.971399+0000","last_unstale":"2023-10-08T00:24:52.980067+0000","last_undegraded":"2023-10-08T00:24:52.980067+0000","last_fullsized":"2023-10-08T00:24:52.980067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:40.259676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976303+0000","last_change":"2023-10-08T00:24:52.975047+0000","last_active":"2023-10-08T00:24:52.976303+0000","last_peered":"2023-10-08T00:24:52.976303+0000","last_clean":"2023-10-08T00:24:52.976303+0000","last_became_active":"2023-10-08T00:24:52.974783+0000","last_became_peered":"2023-10-08T00:24:52.974783+0000","last_unstale":"2023-10-08T00:24:52.976303+0000","last_undegraded":"2023-10-08T00:24:52.976303+0000","last_fullsized":"2023-10-08T00:24:52.976303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968751+0000","last_change":"2023-10-08T00:24:51.970680+0000","last_active":"2023-10-08T00:24:52.968751+0000","last_peered":"2023-10-08T00:24:52.968751+0000","last_clean":"2023-10-08T00:24:52.968751+0000","last_became_active":"2023-10-08T00:24:51.970251+0000","last_became_peered":"2023-10-08T00:24:51.970251+0000","last_unstale":"2023-10-08T00:24:52.968751+0000","last_undegraded":"2023-10-08T00:24:52.968751+0000","last_fullsized":"2023-10-08T00:24:52.968751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992113+0000","last_change":"2023-10-08T00:24:52.987527+0000","last_active":"2023-10-08T00:24:52.992113+0000","last_peered":"2023-10-08T00:24:52.992113+0000","last_clean":"2023-10-08T00:24:52.992113+0000","last_became_active":"2023-10-08T00:24:52.987201+0000","last_became_peered":"2023-10-08T00:24:52.987201+0000","last_unstale":"2023-10-08T00:24:52.992113+0000","last_undegraded":"2023-10-08T00:24:52.992113+0000","last_fullsized":"2023-10-08T00:24:52.992113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969155+0000","last_change":"2023-10-08T00:24:51.966501+0000","last_active":"2023-10-08T00:24:52.969155+0000","last_peered":"2023-10-08T00:24:52.969155+0000","last_clean":"2023-10-08T00:24:52.969155+0000","last_became_active":"2023-10-08T00:24:51.966163+0000","last_became_peered":"2023-10-08T00:24:51.966163+0000","last_unstale":"2023-10-08T00:24:52.969155+0000","last_undegraded":"2023-10-08T00:24:52.969155+0000","last_fullsized":"2023-10-08T00:24:52.969155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972967+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:24:52.972967+0000","last_peered":"2023-10-08T00:24:52.972967+0000","last_clean":"2023-10-08T00:24:52.972967+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:24:52.972967+0000","last_undegraded":"2023-10-08T00:24:52.972967+0000","last_fullsized":"2023-10-08T00:24:52.972967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987231+0000","last_change":"2023-10-08T00:24:52.977356+0000","last_active":"2023-10-08T00:24:52.987231+0000","last_peered":"2023-10-08T00:24:52.987231+0000","last_clean":"2023-10-08T00:24:52.987231+0000","last_became_active":"2023-10-08T00:24:52.977065+0000","last_became_peered":"2023-10-08T00:24:52.977065+0000","last_unstale":"2023-10-08T00:24:52.987231+0000","last_undegraded":"2023-10-08T00:24:52.987231+0000","last_fullsized":"2023-10-08T00:24:52.987231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971755+0000","last_change":"2023-10-08T00:24:51.972788+0000","last_active":"2023-10-08T00:24:52.971755+0000","last_peered":"2023-10-08T00:24:52.971755+0000","last_clean":"2023-10-08T00:24:52.971755+0000","last_became_active":"2023-10-08T00:24:51.972199+0000","last_became_peered":"2023-10-08T00:24:51.972199+0000","last_unstale":"2023-10-08T00:24:52.971755+0000","last_undegraded":"2023-10-08T00:24:52.971755+0000","last_fullsized":"2023-10-08T00:24:52.971755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972287+0000","last_change":"2023-10-08T00:24:51.975555+0000","last_active":"2023-10-08T00:24:52.972287+0000","last_peered":"2023-10-08T00:24:52.972287+0000","last_clean":"2023-10-08T00:24:52.972287+0000","last_became_active":"2023-10-08T00:24:51.975251+0000","last_became_peered":"2023-10-08T00:24:51.975251+0000","last_unstale":"2023-10-08T00:24:52.972287+0000","last_undegraded":"2023-10-08T00:24:52.972287+0000","last_fullsized":"2023-10-08T00:24:52.972287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984419+0000","last_change":"2023-10-08T00:24:52.978989+0000","last_active":"2023-10-08T00:24:52.984419+0000","last_peered":"2023-10-08T00:24:52.984419+0000","last_clean":"2023-10-08T00:24:52.984419+0000","last_became_active":"2023-10-08T00:24:52.978749+0000","last_became_peered":"2023-10-08T00:24:52.978749+0000","last_unstale":"2023-10-08T00:24:52.984419+0000","last_undegraded":"2023-10-08T00:24:52.984419+0000","last_fullsized":"2023-10-08T00:24:52.984419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T00:24:53.971248+0000","last_change":"2023-10-08T00:24:51.972820+0000","last_active":"2023-10-08T00:24:53.971248+0000","last_peered":"2023-10-08T00:24:53.971248+0000","last_clean":"2023-10-08T00:24:53.971248+0000","last_became_active":"2023-10-08T00:24:51.972559+0000","last_became_peered":"2023-10-08T00:24:51.972559+0000","last_unstale":"2023-10-08T00:24:53.971248+0000","last_undegraded":"2023-10-08T00:24:53.971248+0000","last_fullsized":"2023-10-08T00:24:53.971248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992662+0000","last_change":"2023-10-08T00:24:52.989566+0000","last_active":"2023-10-08T00:24:52.992662+0000","last_peered":"2023-10-08T00:24:52.992662+0000","last_clean":"2023-10-08T00:24:52.992662+0000","last_became_active":"2023-10-08T00:24:52.989274+0000","last_became_peered":"2023-10-08T00:24:52.989274+0000","last_unstale":"2023-10-08T00:24:52.992662+0000","last_undegraded":"2023-10-08T00:24:52.992662+0000","last_fullsized":"2023-10-08T00:24:52.992662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992104+0000","last_change":"2023-10-08T00:24:51.968679+0000","last_active":"2023-10-08T00:24:52.992104+0000","last_peered":"2023-10-08T00:24:52.992104+0000","last_clean":"2023-10-08T00:24:52.992104+0000","last_became_active":"2023-10-08T00:24:51.967961+0000","last_became_peered":"2023-10-08T00:24:51.967961+0000","last_unstale":"2023-10-08T00:24:52.992104+0000","last_undegraded":"2023-10-08T00:24:52.992104+0000","last_fullsized":"2023-10-08T00:24:52.992104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985358+0000","last_change":"2023-10-08T00:24:52.977980+0000","last_active":"2023-10-08T00:24:52.985358+0000","last_peered":"2023-10-08T00:24:52.985358+0000","last_clean":"2023-10-08T00:24:52.985358+0000","last_became_active":"2023-10-08T00:24:52.977672+0000","last_became_peered":"2023-10-08T00:24:52.977672+0000","last_unstale":"2023-10-08T00:24:52.985358+0000","last_undegraded":"2023-10-08T00:24:52.985358+0000","last_fullsized":"2023-10-08T00:24:52.985358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970997+0000","last_change":"2023-10-08T00:24:51.972959+0000","last_active":"2023-10-08T00:24:52.970997+0000","last_peered":"2023-10-08T00:24:52.970997+0000","last_clean":"2023-10-08T00:24:52.970997+0000","last_became_active":"2023-10-08T00:24:51.972532+0000","last_became_peered":"2023-10-08T00:24:51.972532+0000","last_unstale":"2023-10-08T00:24:52.970997+0000","last_undegraded":"2023-10-08T00:24:52.970997+0000","last_fullsized":"2023-10-08T00:24:52.970997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.385304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.973482+0000","last_change":"2023-10-08T00:24:52.971403+0000","last_active":"2023-10-08T00:24:52.973482+0000","last_peered":"2023-10-08T00:24:52.973482+0000","last_clean":"2023-10-08T00:24:52.973482+0000","last_became_active":"2023-10-08T00:24:52.971015+0000","last_became_peered":"2023-10-08T00:24:52.971015+0000","last_unstale":"2023-10-08T00:24:52.973482+0000","last_undegraded":"2023-10-08T00:24:52.973482+0000","last_fullsized":"2023-10-08T00:24:52.973482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:39.620318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970036+0000","last_change":"2023-10-08T00:24:51.972990+0000","last_active":"2023-10-08T00:24:52.970036+0000","last_peered":"2023-10-08T00:24:52.970036+0000","last_clean":"2023-10-08T00:24:52.970036+0000","last_became_active":"2023-10-08T00:24:51.972120+0000","last_became_peered":"2023-10-08T00:24:51.972120+0000","last_unstale":"2023-10-08T00:24:52.970036+0000","last_undegraded":"2023-10-08T00:24:52.970036+0000","last_fullsized":"2023-10-08T00:24:52.970036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992020+0000","last_change":"2023-10-08T00:24:52.986965+0000","last_active":"2023-10-08T00:24:52.992020+0000","last_peered":"2023-10-08T00:24:52.992020+0000","last_clean":"2023-10-08T00:24:52.992020+0000","last_became_active":"2023-10-08T00:24:52.981949+0000","last_became_peered":"2023-10-08T00:24:52.981949+0000","last_unstale":"2023-10-08T00:24:52.992020+0000","last_undegraded":"2023-10-08T00:24:52.992020+0000","last_fullsized":"2023-10-08T00:24:52.992020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971126+0000","last_change":"2023-10-08T00:24:51.970488+0000","last_active":"2023-10-08T00:24:52.971126+0000","last_peered":"2023-10-08T00:24:52.971126+0000","last_clean":"2023-10-08T00:24:52.971126+0000","last_became_active":"2023-10-08T00:24:51.970231+0000","last_became_peered":"2023-10-08T00:24:51.970231+0000","last_unstale":"2023-10-08T00:24:52.971126+0000","last_undegraded":"2023-10-08T00:24:52.971126+0000","last_fullsized":"2023-10-08T00:24:52.971126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979310+0000","last_change":"2023-10-08T00:24:52.975874+0000","last_active":"2023-10-08T00:24:52.979310+0000","last_peered":"2023-10-08T00:24:52.979310+0000","last_clean":"2023-10-08T00:24:52.979310+0000","last_became_active":"2023-10-08T00:24:52.975494+0000","last_became_peered":"2023-10-08T00:24:52.975494+0000","last_unstale":"2023-10-08T00:24:52.979310+0000","last_undegraded":"2023-10-08T00:24:52.979310+0000","last_fullsized":"2023-10-08T00:24:52.979310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991514+0000","last_change":"2023-10-08T00:24:51.973894+0000","last_active":"2023-10-08T00:24:52.991514+0000","last_peered":"2023-10-08T00:24:52.991514+0000","last_clean":"2023-10-08T00:24:52.991514+0000","last_became_active":"2023-10-08T00:24:51.973619+0000","last_became_peered":"2023-10-08T00:24:51.973619+0000","last_unstale":"2023-10-08T00:24:52.991514+0000","last_undegraded":"2023-10-08T00:24:52.991514+0000","last_fullsized":"2023-10-08T00:24:52.991514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979160+0000","last_change":"2023-10-08T00:24:52.975531+0000","last_active":"2023-10-08T00:24:52.979160+0000","last_peered":"2023-10-08T00:24:52.979160+0000","last_clean":"2023-10-08T00:24:52.979160+0000","last_became_active":"2023-10-08T00:24:52.974442+0000","last_became_peered":"2023-10-08T00:24:52.974442+0000","last_unstale":"2023-10-08T00:24:52.979160+0000","last_undegraded":"2023-10-08T00:24:52.979160+0000","last_fullsized":"2023-10-08T00:24:52.979160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969018+0000","last_change":"2023-10-08T00:24:51.972849+0000","last_active":"2023-10-08T00:24:52.969018+0000","last_peered":"2023-10-08T00:24:52.969018+0000","last_clean":"2023-10-08T00:24:52.969018+0000","last_became_active":"2023-10-08T00:24:51.972584+0000","last_became_peered":"2023-10-08T00:24:51.972584+0000","last_unstale":"2023-10-08T00:24:52.969018+0000","last_undegraded":"2023-10-08T00:24:52.969018+0000","last_fullsized":"2023-10-08T00:24:52.969018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991780+0000","last_change":"2023-10-08T00:24:52.987901+0000","last_active":"2023-10-08T00:24:52.991780+0000","last_peered":"2023-10-08T00:24:52.991780+0000","last_clean":"2023-10-08T00:24:52.991780+0000","last_became_active":"2023-10-08T00:24:52.987650+0000","last_became_peered":"2023-10-08T00:24:52.987650+0000","last_unstale":"2023-10-08T00:24:52.991780+0000","last_undegraded":"2023-10-08T00:24:52.991780+0000","last_fullsized":"2023-10-08T00:24:52.991780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992854+0000","last_change":"2023-10-08T00:24:51.970706+0000","last_active":"2023-10-08T00:24:52.992854+0000","last_peered":"2023-10-08T00:24:52.992854+0000","last_clean":"2023-10-08T00:24:52.992854+0000","last_became_active":"2023-10-08T00:24:51.969854+0000","last_became_peered":"2023-10-08T00:24:51.969854+0000","last_unstale":"2023-10-08T00:24:52.992854+0000","last_undegraded":"2023-10-08T00:24:52.992854+0000","last_fullsized":"2023-10-08T00:24:52.992854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990618+0000","last_change":"2023-10-08T00:24:52.983945+0000","last_active":"2023-10-08T00:24:52.990618+0000","last_peered":"2023-10-08T00:24:52.990618+0000","last_clean":"2023-10-08T00:24:52.990618+0000","last_became_active":"2023-10-08T00:24:52.983668+0000","last_became_peered":"2023-10-08T00:24:52.983668+0000","last_unstale":"2023-10-08T00:24:52.990618+0000","last_undegraded":"2023-10-08T00:24:52.990618+0000","last_fullsized":"2023-10-08T00:24:52.990618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993949+0000","last_change":"2023-10-08T00:24:51.970895+0000","last_active":"2023-10-08T00:24:52.993949+0000","last_peered":"2023-10-08T00:24:52.993949+0000","last_clean":"2023-10-08T00:24:52.993949+0000","last_became_active":"2023-10-08T00:24:51.970245+0000","last_became_peered":"2023-10-08T00:24:51.970245+0000","last_unstale":"2023-10-08T00:24:52.993949+0000","last_undegraded":"2023-10-08T00:24:52.993949+0000","last_fullsized":"2023-10-08T00:24:52.993949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993961+0000","last_change":"2023-10-08T00:24:52.991574+0000","last_active":"2023-10-08T00:24:52.993961+0000","last_peered":"2023-10-08T00:24:52.993961+0000","last_clean":"2023-10-08T00:24:52.993961+0000","last_became_active":"2023-10-08T00:24:52.990396+0000","last_became_peered":"2023-10-08T00:24:52.990396+0000","last_unstale":"2023-10-08T00:24:52.993961+0000","last_undegraded":"2023-10-08T00:24:52.993961+0000","last_fullsized":"2023-10-08T00:24:52.993961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989966+0000","last_change":"2023-10-08T00:24:52.979422+0000","last_active":"2023-10-08T00:24:52.989966+0000","last_peered":"2023-10-08T00:24:52.989966+0000","last_clean":"2023-10-08T00:24:52.989966+0000","last_became_active":"2023-10-08T00:24:52.979146+0000","last_became_peered":"2023-10-08T00:24:52.979146+0000","last_unstale":"2023-10-08T00:24:52.989966+0000","last_undegraded":"2023-10-08T00:24:52.989966+0000","last_fullsized":"2023-10-08T00:24:52.989966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986972+0000","last_change":"2023-10-08T00:24:52.986197+0000","last_active":"2023-10-08T00:24:52.986972+0000","last_peered":"2023-10-08T00:24:52.986972+0000","last_clean":"2023-10-08T00:24:52.986972+0000","last_became_active":"2023-10-08T00:24:52.985947+0000","last_became_peered":"2023-10-08T00:24:52.985947+0000","last_unstale":"2023-10-08T00:24:52.986972+0000","last_undegraded":"2023-10-08T00:24:52.986972+0000","last_fullsized":"2023-10-08T00:24:52.986972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:47.389930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984505+0000","last_change":"2023-10-08T00:24:52.980865+0000","last_active":"2023-10-08T00:24:52.984505+0000","last_peered":"2023-10-08T00:24:52.984505+0000","last_clean":"2023-10-08T00:24:52.984505+0000","last_became_active":"2023-10-08T00:24:52.980251+0000","last_became_peered":"2023-10-08T00:24:52.980251+0000","last_unstale":"2023-10-08T00:24:52.984505+0000","last_undegraded":"2023-10-08T00:24:52.984505+0000","last_fullsized":"2023-10-08T00:24:52.984505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986453+0000","last_change":"2023-10-08T00:24:52.985277+0000","last_active":"2023-10-08T00:24:52.986453+0000","last_peered":"2023-10-08T00:24:52.986453+0000","last_clean":"2023-10-08T00:24:52.986453+0000","last_became_active":"2023-10-08T00:24:52.981814+0000","last_became_peered":"2023-10-08T00:24:52.981814+0000","last_unstale":"2023-10-08T00:24:52.986453+0000","last_undegraded":"2023-10-08T00:24:52.986453+0000","last_fullsized":"2023-10-08T00:24:52.986453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981430+0000","last_change":"2023-10-08T00:24:52.975549+0000","last_active":"2023-10-08T00:24:52.981430+0000","last_peered":"2023-10-08T00:24:52.981430+0000","last_clean":"2023-10-08T00:24:52.981430+0000","last_became_active":"2023-10-08T00:24:52.975298+0000","last_became_peered":"2023-10-08T00:24:52.975298+0000","last_unstale":"2023-10-08T00:24:52.981430+0000","last_undegraded":"2023-10-08T00:24:52.981430+0000","last_fullsized":"2023-10-08T00:24:52.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984523+0000","last_change":"2023-10-08T00:24:52.978921+0000","last_active":"2023-10-08T00:24:52.984523+0000","last_peered":"2023-10-08T00:24:52.984523+0000","last_clean":"2023-10-08T00:24:52.984523+0000","last_became_active":"2023-10-08T00:24:52.978633+0000","last_became_peered":"2023-10-08T00:24:52.978633+0000","last_unstale":"2023-10-08T00:24:52.984523+0000","last_undegraded":"2023-10-08T00:24:52.984523+0000","last_fullsized":"2023-10-08T00:24:52.984523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990230+0000","last_change":"2023-10-08T00:24:52.985282+0000","last_active":"2023-10-08T00:24:52.990230+0000","last_peered":"2023-10-08T00:24:52.990230+0000","last_clean":"2023-10-08T00:24:52.990230+0000","last_became_active":"2023-10-08T00:24:52.985016+0000","last_became_peered":"2023-10-08T00:24:52.985016+0000","last_unstale":"2023-10-08T00:24:52.990230+0000","last_undegraded":"2023-10-08T00:24:52.990230+0000","last_fullsized":"2023-10-08T00:24:52.990230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977747+0000","last_change":"2023-10-08T00:24:52.974937+0000","last_active":"2023-10-08T00:24:52.977747+0000","last_peered":"2023-10-08T00:24:52.977747+0000","last_clean":"2023-10-08T00:24:52.977747+0000","last_became_active":"2023-10-08T00:24:52.974647+0000","last_became_peered":"2023-10-08T00:24:52.974647+0000","last_unstale":"2023-10-08T00:24:52.977747+0000","last_undegraded":"2023-10-08T00:24:52.977747+0000","last_fullsized":"2023-10-08T00:24:52.977747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996943+0000","last_change":"2023-10-08T00:24:52.995257+0000","last_active":"2023-10-08T00:24:52.996943+0000","last_peered":"2023-10-08T00:24:52.996943+0000","last_clean":"2023-10-08T00:24:52.996943+0000","last_became_active":"2023-10-08T00:24:52.994863+0000","last_became_peered":"2023-10-08T00:24:52.994863+0000","last_unstale":"2023-10-08T00:24:52.996943+0000","last_undegraded":"2023-10-08T00:24:52.996943+0000","last_fullsized":"2023-10-08T00:24:52.996943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981376+0000","last_change":"2023-10-08T00:24:52.976107+0000","last_active":"2023-10-08T00:24:52.981376+0000","last_peered":"2023-10-08T00:24:52.981376+0000","last_clean":"2023-10-08T00:24:52.981376+0000","last_became_active":"2023-10-08T00:24:52.975835+0000","last_became_peered":"2023-10-08T00:24:52.975835+0000","last_unstale":"2023-10-08T00:24:52.981376+0000","last_undegraded":"2023-10-08T00:24:52.981376+0000","last_fullsized":"2023-10-08T00:24:52.981376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985392+0000","last_change":"2023-10-08T00:24:52.982480+0000","last_active":"2023-10-08T00:24:52.985392+0000","last_peered":"2023-10-08T00:24:52.985392+0000","last_clean":"2023-10-08T00:24:52.985392+0000","last_became_active":"2023-10-08T00:24:52.981391+0000","last_became_peered":"2023-10-08T00:24:52.981391+0000","last_unstale":"2023-10-08T00:24:52.985392+0000","last_undegraded":"2023-10-08T00:24:52.985392+0000","last_fullsized":"2023-10-08T00:24:52.985392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986425+0000","last_change":"2023-10-08T00:24:52.982575+0000","last_active":"2023-10-08T00:24:52.986425+0000","last_peered":"2023-10-08T00:24:52.986425+0000","last_clean":"2023-10-08T00:24:52.986425+0000","last_became_active":"2023-10-08T00:24:52.982206+0000","last_became_peered":"2023-10-08T00:24:52.982206+0000","last_unstale":"2023-10-08T00:24:52.986425+0000","last_undegraded":"2023-10-08T00:24:52.986425+0000","last_fullsized":"2023-10-08T00:24:52.986425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.975941+0000","last_change":"2023-10-08T00:24:52.975079+0000","last_active":"2023-10-08T00:24:52.975941+0000","last_peered":"2023-10-08T00:24:52.975941+0000","last_clean":"2023-10-08T00:24:52.975941+0000","last_became_active":"2023-10-08T00:24:52.974531+0000","last_became_peered":"2023-10-08T00:24:52.974531+0000","last_unstale":"2023-10-08T00:24:52.975941+0000","last_undegraded":"2023-10-08T00:24:52.975941+0000","last_fullsized":"2023-10-08T00:24:52.975941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:01.750 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:01.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.902+0000 7fd230905700 1 Processor -- start 2023-10-08T00:25:01.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.902+0000 7fd230905700 1 -- start start 2023-10-08T00:25:01.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.903+0000 7fd230905700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.903+0000 7fd230905700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd22c06b420 0x7fd22c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.903+0000 7fd230905700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0c74b0 con 0x7fd22c15d730 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.903+0000 7fd230905700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0c8700 con 0x7fd22c06b420 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.903+0000 7fd230905700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0c9070 con 0x7fd22c159b10 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd22c06b420 0x7fd22c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd229d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd22c15d730 0x7fd22c159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59950/0 (socket says 172.21.15.22:59950) 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd229d9b700 1 -- 172.21.15.22:0/398752737 learned_addr learned my addr 172.21.15.22:0/398752737 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22a59c700 1 --2- 172.21.15.22:0/398752737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22ad9d700 1 -- 172.21.15.22:0/398752737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 msgr2=0x7fd22c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22ad9d700 1 --2- 172.21.15.22:0/398752737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22ad9d700 1 -- 172.21.15.22:0/398752737 >> v1:172.21.15.22:6789/0 conn(0x7fd22c15d730 legacy=0x7fd22c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22959a700 1 -- 172.21.15.22:0/398752737 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763575802 0 0) 0x7fd22c0c74b0 con 0x7fd22c15d730 2023-10-08T00:25:01.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22ad9d700 1 -- 172.21.15.22:0/398752737 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c15e0e0 con 0x7fd22c06b420 2023-10-08T00:25:01.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22ad9d700 1 --2- 172.21.15.22:0/398752737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c15dba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009e60 tx=0x7fd21c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124623e92ca6f0bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:01.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22959a700 1 -- 172.21.15.22:0/398752737 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00e070 con 0x7fd22c06b420 2023-10-08T00:25:01.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22959a700 1 -- 172.21.15.22:0/398752737 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c00bbf0 con 0x7fd22c06b420 2023-10-08T00:25:01.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.904+0000 7fd22959a700 1 -- 172.21.15.22:0/398752737 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c012430 con 0x7fd22c06b420 2023-10-08T00:25:01.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 -- 172.21.15.22:0/398752737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 msgr2=0x7fd22c15dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 --2- 172.21.15.22:0/398752737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c15dba0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009e60 tx=0x7fd21c009780 comp rx=0 tx=0).stop 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 -- 172.21.15.22:0/398752737 shutdown_connections 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 --2- 172.21.15.22:0/398752737 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c15dba0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 --2- 172.21.15.22:0/398752737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 -- 172.21.15.22:0/398752737 >> 172.21.15.22:0/398752737 conn(0x7fd22c0c9870 msgr2=0x7fd22c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 -- 172.21.15.22:0/398752737 shutdown_connections 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.905+0000 7fd230905700 1 -- 172.21.15.22:0/398752737 wait complete. 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.906+0000 7fd230905700 1 Processor -- start 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.906+0000 7fd230905700 1 -- start start 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd230905700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c169800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd230905700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd230905700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd22c15d730 0x7fd22c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd230905700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c169e30 con 0x7fd22c06b420 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd230905700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c16a110 con 0x7fd22c15d730 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd230905700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c16a3f0 con 0x7fd22c159b10 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c169800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c169800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60494/0 (socket says 172.21.15.22:60494) 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 -- 172.21.15.22:0/800282576 learned_addr learned my addr 172.21.15.22:0/800282576 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd229d9b700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22ad9d700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd22c15d730 0x7fd22c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 -- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 msgr2=0x7fd22c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 -- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd22c15d730 msgr2=0x7fd22c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:01.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd22c15d730 0x7fd22c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 -- 172.21.15.22:0/800282576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c009a20 con 0x7fd22c06b420 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd22a59c700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c169800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd22400ec80 tx=0x7fd2240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400c850 con 0x7fd22c06b420 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.907+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22400c9b0 con 0x7fd22c06b420 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.908+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c16a6d0 con 0x7fd22c06b420 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.908+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400cd50 con 0x7fd22c06b420 2023-10-08T00:25:01.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.908+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c148db0 con 0x7fd22c06b420 2023-10-08T00:25:01.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.908+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c0afe60 con 0x7fd22c06b420 2023-10-08T00:25:01.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.909+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd224013680 con 0x7fd22c06b420 2023-10-08T00:25:01.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.909+0000 7fd2227fc700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd20c066f30 0x7fd20c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:01.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.909+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd2240847b0 con 0x7fd22c06b420 2023-10-08T00:25:01.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.909+0000 7fd229d9b700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd20c066f30 0x7fd20c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:01.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.910+0000 7fd229d9b700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd20c066f30 0x7fd20c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd22c158db0 tx=0x7fd214007f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:01.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:01.913+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd224051a20 con 0x7fd22c06b420 2023-10-08T00:25:02.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.102+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd22c04c3c0 con 0x7fd20c066f30 2023-10-08T00:25:02.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.110+0000 7fd2227fc700 1 -- 172.21.15.22:0/800282576 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264525 (secure 0 0 0) 0x7fd22c04c3c0 con 0x7fd20c066f30 2023-10-08T00:25:02.113 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd20c066f30 msgr2=0x7fd20c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd20c066f30 0x7fd20c0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd22c158db0 tx=0x7fd214007f50 comp rx=0 tx=0).stop 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 msgr2=0x7fd22c169800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c169800 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd22400ec80 tx=0x7fd2240091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 shutdown_connections 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd22c15d730 0x7fd22c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd22c06b420 0x7fd22c169800 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd20c066f30 0x7fd20c0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 --2- 172.21.15.22:0/800282576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd22c159b10 0x7fd22c148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 >> 172.21.15.22:0/800282576 conn(0x7fd22c0c9870 msgr2=0x7fd22c0caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 shutdown_connections 2023-10-08T00:25:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.113+0000 7fd230905700 1 -- 172.21.15.22:0/800282576 wait complete. 2023-10-08T00:25:02.117 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:02.126 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T00:25:00.384633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381224,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593496,"statfs":{"total":773094113280,"available":770655739904,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001874"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987593+0000","last_change":"2023-10-08T00:24:52.980100+0000","last_active":"2023-10-08T00:24:52.987593+0000","last_peered":"2023-10-08T00:24:52.987593+0000","last_clean":"2023-10-08T00:24:52.987593+0000","last_became_active":"2023-10-08T00:24:52.979488+0000","last_became_peered":"2023-10-08T00:24:52.979488+0000","last_unstale":"2023-10-08T00:24:52.987593+0000","last_undegraded":"2023-10-08T00:24:52.987593+0000","last_fullsized":"2023-10-08T00:24:52.987593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984472+0000","last_change":"2023-10-08T00:24:52.980140+0000","last_active":"2023-10-08T00:24:52.984472+0000","last_peered":"2023-10-08T00:24:52.984472+0000","last_clean":"2023-10-08T00:24:52.984472+0000","last_became_active":"2023-10-08T00:24:52.979888+0000","last_became_peered":"2023-10-08T00:24:52.979888+0000","last_unstale":"2023-10-08T00:24:52.984472+0000","last_undegraded":"2023-10-08T00:24:52.984472+0000","last_fullsized":"2023-10-08T00:24:52.984472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977786+0000","last_change":"2023-10-08T00:24:52.970748+0000","last_active":"2023-10-08T00:24:52.977786+0000","last_peered":"2023-10-08T00:24:52.977786+0000","last_clean":"2023-10-08T00:24:52.977786+0000","last_became_active":"2023-10-08T00:24:52.970491+0000","last_became_peered":"2023-10-08T00:24:52.970491+0000","last_unstale":"2023-10-08T00:24:52.977786+0000","last_undegraded":"2023-10-08T00:24:52.977786+0000","last_fullsized":"2023-10-08T00:24:52.977786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:58:54.945526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988272+0000","last_change":"2023-10-08T00:24:52.983186+0000","last_active":"2023-10-08T00:24:52.988272+0000","last_peered":"2023-10-08T00:24:52.988272+0000","last_clean":"2023-10-08T00:24:52.988272+0000","last_became_active":"2023-10-08T00:24:52.982126+0000","last_became_peered":"2023-10-08T00:24:52.982126+0000","last_unstale":"2023-10-08T00:24:52.988272+0000","last_undegraded":"2023-10-08T00:24:52.988272+0000","last_fullsized":"2023-10-08T00:24:52.988272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985965+0000","last_change":"2023-10-08T00:24:52.979734+0000","last_active":"2023-10-08T00:24:52.985965+0000","last_peered":"2023-10-08T00:24:52.985965+0000","last_clean":"2023-10-08T00:24:52.985965+0000","last_became_active":"2023-10-08T00:24:52.979268+0000","last_became_peered":"2023-10-08T00:24:52.979268+0000","last_unstale":"2023-10-08T00:24:52.985965+0000","last_undegraded":"2023-10-08T00:24:52.985965+0000","last_fullsized":"2023-10-08T00:24:52.985965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:36:19.519679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985000+0000","last_change":"2023-10-08T00:24:52.981418+0000","last_active":"2023-10-08T00:24:52.985000+0000","last_peered":"2023-10-08T00:24:52.985000+0000","last_clean":"2023-10-08T00:24:52.985000+0000","last_became_active":"2023-10-08T00:24:52.980593+0000","last_became_peered":"2023-10-08T00:24:52.980593+0000","last_unstale":"2023-10-08T00:24:52.985000+0000","last_undegraded":"2023-10-08T00:24:52.985000+0000","last_fullsized":"2023-10-08T00:24:52.985000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985828+0000","last_change":"2023-10-08T00:24:52.981519+0000","last_active":"2023-10-08T00:24:52.985828+0000","last_peered":"2023-10-08T00:24:52.985828+0000","last_clean":"2023-10-08T00:24:52.985828+0000","last_became_active":"2023-10-08T00:24:52.981233+0000","last_became_peered":"2023-10-08T00:24:52.981233+0000","last_unstale":"2023-10-08T00:24:52.985828+0000","last_undegraded":"2023-10-08T00:24:52.985828+0000","last_fullsized":"2023-10-08T00:24:52.985828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992041+0000","last_change":"2023-10-08T00:24:52.987504+0000","last_active":"2023-10-08T00:24:52.992041+0000","last_peered":"2023-10-08T00:24:52.992041+0000","last_clean":"2023-10-08T00:24:52.992041+0000","last_became_active":"2023-10-08T00:24:52.987271+0000","last_became_peered":"2023-10-08T00:24:52.987271+0000","last_unstale":"2023-10-08T00:24:52.992041+0000","last_undegraded":"2023-10-08T00:24:52.992041+0000","last_fullsized":"2023-10-08T00:24:52.992041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991414+0000","last_change":"2023-10-08T00:24:52.984830+0000","last_active":"2023-10-08T00:24:52.991414+0000","last_peered":"2023-10-08T00:24:52.991414+0000","last_clean":"2023-10-08T00:24:52.991414+0000","last_became_active":"2023-10-08T00:24:52.984399+0000","last_became_peered":"2023-10-08T00:24:52.984399+0000","last_unstale":"2023-10-08T00:24:52.991414+0000","last_undegraded":"2023-10-08T00:24:52.991414+0000","last_fullsized":"2023-10-08T00:24:52.991414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990097+0000","last_change":"2023-10-08T00:24:52.982279+0000","last_active":"2023-10-08T00:24:52.990097+0000","last_peered":"2023-10-08T00:24:52.990097+0000","last_clean":"2023-10-08T00:24:52.990097+0000","last_became_active":"2023-10-08T00:24:52.981839+0000","last_became_peered":"2023-10-08T00:24:52.981839+0000","last_unstale":"2023-10-08T00:24:52.990097+0000","last_undegraded":"2023-10-08T00:24:52.990097+0000","last_fullsized":"2023-10-08T00:24:52.990097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990366+0000","last_change":"2023-10-08T00:24:52.985741+0000","last_active":"2023-10-08T00:24:52.990366+0000","last_peered":"2023-10-08T00:24:52.990366+0000","last_clean":"2023-10-08T00:24:52.990366+0000","last_became_active":"2023-10-08T00:24:52.985429+0000","last_became_peered":"2023-10-08T00:24:52.985429+0000","last_unstale":"2023-10-08T00:24:52.990366+0000","last_undegraded":"2023-10-08T00:24:52.990366+0000","last_fullsized":"2023-10-08T00:24:52.990366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988968+0000","last_change":"2023-10-08T00:24:52.978519+0000","last_active":"2023-10-08T00:24:52.988968+0000","last_peered":"2023-10-08T00:24:52.988968+0000","last_clean":"2023-10-08T00:24:52.988968+0000","last_became_active":"2023-10-08T00:24:52.977483+0000","last_became_peered":"2023-10-08T00:24:52.977483+0000","last_unstale":"2023-10-08T00:24:52.988968+0000","last_undegraded":"2023-10-08T00:24:52.988968+0000","last_fullsized":"2023-10-08T00:24:52.988968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:54.276268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992137+0000","last_change":"2023-10-08T00:24:52.987977+0000","last_active":"2023-10-08T00:24:52.992137+0000","last_peered":"2023-10-08T00:24:52.992137+0000","last_clean":"2023-10-08T00:24:52.992137+0000","last_became_active":"2023-10-08T00:24:52.987722+0000","last_became_peered":"2023-10-08T00:24:52.987722+0000","last_unstale":"2023-10-08T00:24:52.992137+0000","last_undegraded":"2023-10-08T00:24:52.992137+0000","last_fullsized":"2023-10-08T00:24:52.992137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986854+0000","last_change":"2023-10-08T00:24:52.978011+0000","last_active":"2023-10-08T00:24:52.986854+0000","last_peered":"2023-10-08T00:24:52.986854+0000","last_clean":"2023-10-08T00:24:52.986854+0000","last_became_active":"2023-10-08T00:24:52.977718+0000","last_became_peered":"2023-10-08T00:24:52.977718+0000","last_unstale":"2023-10-08T00:24:52.986854+0000","last_undegraded":"2023-10-08T00:24:52.986854+0000","last_fullsized":"2023-10-08T00:24:52.986854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983827+0000","last_change":"2023-10-08T00:24:52.977428+0000","last_active":"2023-10-08T00:24:52.983827+0000","last_peered":"2023-10-08T00:24:52.983827+0000","last_clean":"2023-10-08T00:24:52.983827+0000","last_became_active":"2023-10-08T00:24:52.977116+0000","last_became_peered":"2023-10-08T00:24:52.977116+0000","last_unstale":"2023-10-08T00:24:52.983827+0000","last_undegraded":"2023-10-08T00:24:52.983827+0000","last_fullsized":"2023-10-08T00:24:52.983827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991223+0000","last_change":"2023-10-08T00:24:52.988555+0000","last_active":"2023-10-08T00:24:52.991223+0000","last_peered":"2023-10-08T00:24:52.991223+0000","last_clean":"2023-10-08T00:24:52.991223+0000","last_became_active":"2023-10-08T00:24:52.988256+0000","last_became_peered":"2023-10-08T00:24:52.988256+0000","last_unstale":"2023-10-08T00:24:52.991223+0000","last_undegraded":"2023-10-08T00:24:52.991223+0000","last_fullsized":"2023-10-08T00:24:52.991223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:19.266841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984667+0000","last_change":"2023-10-08T00:24:52.980846+0000","last_active":"2023-10-08T00:24:52.984667+0000","last_peered":"2023-10-08T00:24:52.984667+0000","last_clean":"2023-10-08T00:24:52.984667+0000","last_became_active":"2023-10-08T00:24:52.980566+0000","last_became_peered":"2023-10-08T00:24:52.980566+0000","last_unstale":"2023-10-08T00:24:52.984667+0000","last_undegraded":"2023-10-08T00:24:52.984667+0000","last_fullsized":"2023-10-08T00:24:52.984667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.983078+0000","last_change":"2023-10-08T00:24:52.976521+0000","last_active":"2023-10-08T00:24:52.983078+0000","last_peered":"2023-10-08T00:24:52.983078+0000","last_clean":"2023-10-08T00:24:52.983078+0000","last_became_active":"2023-10-08T00:24:52.976306+0000","last_became_peered":"2023-10-08T00:24:52.976306+0000","last_unstale":"2023-10-08T00:24:52.983078+0000","last_undegraded":"2023-10-08T00:24:52.983078+0000","last_fullsized":"2023-10-08T00:24:52.983078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987877+0000","last_change":"2023-10-08T00:24:52.980143+0000","last_active":"2023-10-08T00:24:52.987877+0000","last_peered":"2023-10-08T00:24:52.987877+0000","last_clean":"2023-10-08T00:24:52.987877+0000","last_became_active":"2023-10-08T00:24:52.979863+0000","last_became_peered":"2023-10-08T00:24:52.979863+0000","last_unstale":"2023-10-08T00:24:52.987877+0000","last_undegraded":"2023-10-08T00:24:52.987877+0000","last_fullsized":"2023-10-08T00:24:52.987877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:29.094765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992779+0000","last_change":"2023-10-08T00:24:51.970340+0000","last_active":"2023-10-08T00:24:52.992779+0000","last_peered":"2023-10-08T00:24:52.992779+0000","last_clean":"2023-10-08T00:24:52.992779+0000","last_became_active":"2023-10-08T00:24:51.970091+0000","last_became_peered":"2023-10-08T00:24:51.970091+0000","last_unstale":"2023-10-08T00:24:52.992779+0000","last_undegraded":"2023-10-08T00:24:52.992779+0000","last_fullsized":"2023-10-08T00:24:52.992779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:11:35.474566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991838+0000","last_change":"2023-10-08T00:24:52.978891+0000","last_active":"2023-10-08T00:24:52.991838+0000","last_peered":"2023-10-08T00:24:52.991838+0000","last_clean":"2023-10-08T00:24:52.991838+0000","last_became_active":"2023-10-08T00:24:52.978193+0000","last_became_peered":"2023-10-08T00:24:52.978193+0000","last_unstale":"2023-10-08T00:24:52.991838+0000","last_undegraded":"2023-10-08T00:24:52.991838+0000","last_fullsized":"2023-10-08T00:24:52.991838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992750+0000","last_change":"2023-10-08T00:24:51.975777+0000","last_active":"2023-10-08T00:24:52.992750+0000","last_peered":"2023-10-08T00:24:52.992750+0000","last_clean":"2023-10-08T00:24:52.992750+0000","last_became_active":"2023-10-08T00:24:51.975506+0000","last_became_peered":"2023-10-08T00:24:51.975506+0000","last_unstale":"2023-10-08T00:24:52.992750+0000","last_undegraded":"2023-10-08T00:24:52.992750+0000","last_fullsized":"2023-10-08T00:24:52.992750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987295+0000","last_change":"2023-10-08T00:24:52.980914+0000","last_active":"2023-10-08T00:24:52.987295+0000","last_peered":"2023-10-08T00:24:52.987295+0000","last_clean":"2023-10-08T00:24:52.987295+0000","last_became_active":"2023-10-08T00:24:52.980619+0000","last_became_peered":"2023-10-08T00:24:52.980619+0000","last_unstale":"2023-10-08T00:24:52.987295+0000","last_undegraded":"2023-10-08T00:24:52.987295+0000","last_fullsized":"2023-10-08T00:24:52.987295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991737+0000","last_change":"2023-10-08T00:24:51.971927+0000","last_active":"2023-10-08T00:24:52.991737+0000","last_peered":"2023-10-08T00:24:52.991737+0000","last_clean":"2023-10-08T00:24:52.991737+0000","last_became_active":"2023-10-08T00:24:51.971651+0000","last_became_peered":"2023-10-08T00:24:51.971651+0000","last_unstale":"2023-10-08T00:24:52.991737+0000","last_undegraded":"2023-10-08T00:24:52.991737+0000","last_fullsized":"2023-10-08T00:24:52.991737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:16.625598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984785+0000","last_change":"2023-10-08T00:24:52.981876+0000","last_active":"2023-10-08T00:24:52.984785+0000","last_peered":"2023-10-08T00:24:52.984785+0000","last_clean":"2023-10-08T00:24:52.984785+0000","last_became_active":"2023-10-08T00:24:52.981627+0000","last_became_peered":"2023-10-08T00:24:52.981627+0000","last_unstale":"2023-10-08T00:24:52.984785+0000","last_undegraded":"2023-10-08T00:24:52.984785+0000","last_fullsized":"2023-10-08T00:24:52.984785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991526+0000","last_change":"2023-10-08T00:24:51.974282+0000","last_active":"2023-10-08T00:24:52.991526+0000","last_peered":"2023-10-08T00:24:52.991526+0000","last_clean":"2023-10-08T00:24:52.991526+0000","last_became_active":"2023-10-08T00:24:51.973653+0000","last_became_peered":"2023-10-08T00:24:51.973653+0000","last_unstale":"2023-10-08T00:24:52.991526+0000","last_undegraded":"2023-10-08T00:24:52.991526+0000","last_fullsized":"2023-10-08T00:24:52.991526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989925+0000","last_change":"2023-10-08T00:24:52.984614+0000","last_active":"2023-10-08T00:24:52.989925+0000","last_peered":"2023-10-08T00:24:52.989925+0000","last_clean":"2023-10-08T00:24:52.989925+0000","last_became_active":"2023-10-08T00:24:52.984295+0000","last_became_peered":"2023-10-08T00:24:52.984295+0000","last_unstale":"2023-10-08T00:24:52.989925+0000","last_undegraded":"2023-10-08T00:24:52.989925+0000","last_fullsized":"2023-10-08T00:24:52.989925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.994140+0000","last_change":"2023-10-08T00:24:51.973991+0000","last_active":"2023-10-08T00:24:52.994140+0000","last_peered":"2023-10-08T00:24:52.994140+0000","last_clean":"2023-10-08T00:24:52.994140+0000","last_became_active":"2023-10-08T00:24:51.973771+0000","last_became_peered":"2023-10-08T00:24:51.973771+0000","last_unstale":"2023-10-08T00:24:52.994140+0000","last_undegraded":"2023-10-08T00:24:52.994140+0000","last_fullsized":"2023-10-08T00:24:52.994140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986683+0000","last_change":"2023-10-08T00:24:52.977312+0000","last_active":"2023-10-08T00:24:52.986683+0000","last_peered":"2023-10-08T00:24:52.986683+0000","last_clean":"2023-10-08T00:24:52.986683+0000","last_became_active":"2023-10-08T00:24:52.977056+0000","last_became_peered":"2023-10-08T00:24:52.977056+0000","last_unstale":"2023-10-08T00:24:52.986683+0000","last_undegraded":"2023-10-08T00:24:52.986683+0000","last_fullsized":"2023-10-08T00:24:52.986683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:42.211488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990236+0000","last_change":"2023-10-08T00:24:51.967116+0000","last_active":"2023-10-08T00:24:52.990236+0000","last_peered":"2023-10-08T00:24:52.990236+0000","last_clean":"2023-10-08T00:24:52.990236+0000","last_became_active":"2023-10-08T00:24:51.966840+0000","last_became_peered":"2023-10-08T00:24:51.966840+0000","last_unstale":"2023-10-08T00:24:52.990236+0000","last_undegraded":"2023-10-08T00:24:52.990236+0000","last_fullsized":"2023-10-08T00:24:52.990236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985387+0000","last_change":"2023-10-08T00:24:52.977803+0000","last_active":"2023-10-08T00:24:52.985387+0000","last_peered":"2023-10-08T00:24:52.985387+0000","last_clean":"2023-10-08T00:24:52.985387+0000","last_became_active":"2023-10-08T00:24:52.977087+0000","last_became_peered":"2023-10-08T00:24:52.977087+0000","last_unstale":"2023-10-08T00:24:52.985387+0000","last_undegraded":"2023-10-08T00:24:52.985387+0000","last_fullsized":"2023-10-08T00:24:52.985387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:57.537199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.966959+0000","last_change":"2023-10-08T00:24:51.969025+0000","last_active":"2023-10-08T00:24:52.966959+0000","last_peered":"2023-10-08T00:24:52.966959+0000","last_clean":"2023-10-08T00:24:52.966959+0000","last_became_active":"2023-10-08T00:24:51.968702+0000","last_became_peered":"2023-10-08T00:24:51.968702+0000","last_unstale":"2023-10-08T00:24:52.966959+0000","last_undegraded":"2023-10-08T00:24:52.966959+0000","last_fullsized":"2023-10-08T00:24:52.966959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.978409+0000","last_change":"2023-10-08T00:24:52.976159+0000","last_active":"2023-10-08T00:24:52.978409+0000","last_peered":"2023-10-08T00:24:52.978409+0000","last_clean":"2023-10-08T00:24:52.978409+0000","last_became_active":"2023-10-08T00:24:52.975536+0000","last_became_peered":"2023-10-08T00:24:52.975536+0000","last_unstale":"2023-10-08T00:24:52.978409+0000","last_undegraded":"2023-10-08T00:24:52.978409+0000","last_fullsized":"2023-10-08T00:24:52.978409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976877+0000","last_change":"2023-10-08T00:24:51.969405+0000","last_active":"2023-10-08T00:24:52.976877+0000","last_peered":"2023-10-08T00:24:52.976877+0000","last_clean":"2023-10-08T00:24:52.976877+0000","last_became_active":"2023-10-08T00:24:51.968440+0000","last_became_peered":"2023-10-08T00:24:51.968440+0000","last_unstale":"2023-10-08T00:24:52.976877+0000","last_undegraded":"2023-10-08T00:24:52.976877+0000","last_fullsized":"2023-10-08T00:24:52.976877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984498+0000","last_change":"2023-10-08T00:24:52.982102+0000","last_active":"2023-10-08T00:24:52.984498+0000","last_peered":"2023-10-08T00:24:52.984498+0000","last_clean":"2023-10-08T00:24:52.984498+0000","last_became_active":"2023-10-08T00:24:52.981842+0000","last_became_peered":"2023-10-08T00:24:52.981842+0000","last_unstale":"2023-10-08T00:24:52.984498+0000","last_undegraded":"2023-10-08T00:24:52.984498+0000","last_fullsized":"2023-10-08T00:24:52.984498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969031+0000","last_change":"2023-10-08T00:24:51.968433+0000","last_active":"2023-10-08T00:24:52.969031+0000","last_peered":"2023-10-08T00:24:52.969031+0000","last_clean":"2023-10-08T00:24:52.969031+0000","last_became_active":"2023-10-08T00:24:51.967679+0000","last_became_peered":"2023-10-08T00:24:51.967679+0000","last_unstale":"2023-10-08T00:24:52.969031+0000","last_undegraded":"2023-10-08T00:24:52.969031+0000","last_fullsized":"2023-10-08T00:24:52.969031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984774+0000","last_change":"2023-10-08T00:24:52.980963+0000","last_active":"2023-10-08T00:24:52.984774+0000","last_peered":"2023-10-08T00:24:52.984774+0000","last_clean":"2023-10-08T00:24:52.984774+0000","last_became_active":"2023-10-08T00:24:52.980687+0000","last_became_peered":"2023-10-08T00:24:52.980687+0000","last_unstale":"2023-10-08T00:24:52.984774+0000","last_undegraded":"2023-10-08T00:24:52.984774+0000","last_fullsized":"2023-10-08T00:24:52.984774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976476+0000","last_change":"2023-10-08T00:24:51.970567+0000","last_active":"2023-10-08T00:24:52.976476+0000","last_peered":"2023-10-08T00:24:52.976476+0000","last_clean":"2023-10-08T00:24:52.976476+0000","last_became_active":"2023-10-08T00:24:51.970311+0000","last_became_peered":"2023-10-08T00:24:51.970311+0000","last_unstale":"2023-10-08T00:24:52.976476+0000","last_undegraded":"2023-10-08T00:24:52.976476+0000","last_fullsized":"2023-10-08T00:24:52.976476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:43:53.665259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.988302+0000","last_change":"2023-10-08T00:24:52.986368+0000","last_active":"2023-10-08T00:24:52.988302+0000","last_peered":"2023-10-08T00:24:52.988302+0000","last_clean":"2023-10-08T00:24:52.988302+0000","last_became_active":"2023-10-08T00:24:52.986130+0000","last_became_peered":"2023-10-08T00:24:52.986130+0000","last_unstale":"2023-10-08T00:24:52.988302+0000","last_undegraded":"2023-10-08T00:24:52.988302+0000","last_fullsized":"2023-10-08T00:24:52.988302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993145+0000","last_change":"2023-10-08T00:24:51.973262+0000","last_active":"2023-10-08T00:24:52.993145+0000","last_peered":"2023-10-08T00:24:52.993145+0000","last_clean":"2023-10-08T00:24:52.993145+0000","last_became_active":"2023-10-08T00:24:51.972999+0000","last_became_peered":"2023-10-08T00:24:51.972999+0000","last_unstale":"2023-10-08T00:24:52.993145+0000","last_undegraded":"2023-10-08T00:24:52.993145+0000","last_fullsized":"2023-10-08T00:24:52.993145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:39.255050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989532+0000","last_change":"2023-10-08T00:24:52.982031+0000","last_active":"2023-10-08T00:24:52.989532+0000","last_peered":"2023-10-08T00:24:52.989532+0000","last_clean":"2023-10-08T00:24:52.989532+0000","last_became_active":"2023-10-08T00:24:52.980819+0000","last_became_peered":"2023-10-08T00:24:52.980819+0000","last_unstale":"2023-10-08T00:24:52.989532+0000","last_undegraded":"2023-10-08T00:24:52.989532+0000","last_fullsized":"2023-10-08T00:24:52.989532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:32:17.630224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.997915+0000","last_change":"2023-10-08T00:24:51.968287+0000","last_active":"2023-10-08T00:24:52.997915+0000","last_peered":"2023-10-08T00:24:52.997915+0000","last_clean":"2023-10-08T00:24:52.997915+0000","last_became_active":"2023-10-08T00:24:51.967698+0000","last_became_peered":"2023-10-08T00:24:51.967698+0000","last_unstale":"2023-10-08T00:24:52.997915+0000","last_undegraded":"2023-10-08T00:24:52.997915+0000","last_fullsized":"2023-10-08T00:24:52.997915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990585+0000","last_change":"2023-10-08T00:24:52.983840+0000","last_active":"2023-10-08T00:24:52.990585+0000","last_peered":"2023-10-08T00:24:52.990585+0000","last_clean":"2023-10-08T00:24:52.990585+0000","last_became_active":"2023-10-08T00:24:52.983567+0000","last_became_peered":"2023-10-08T00:24:52.983567+0000","last_unstale":"2023-10-08T00:24:52.990585+0000","last_undegraded":"2023-10-08T00:24:52.990585+0000","last_fullsized":"2023-10-08T00:24:52.990585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:34:31.254296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990688+0000","last_change":"2023-10-08T00:24:51.971465+0000","last_active":"2023-10-08T00:24:52.990688+0000","last_peered":"2023-10-08T00:24:52.990688+0000","last_clean":"2023-10-08T00:24:52.990688+0000","last_became_active":"2023-10-08T00:24:51.971212+0000","last_became_peered":"2023-10-08T00:24:51.971212+0000","last_unstale":"2023-10-08T00:24:52.990688+0000","last_undegraded":"2023-10-08T00:24:52.990688+0000","last_fullsized":"2023-10-08T00:24:52.990688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:19.468028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986877+0000","last_change":"2023-10-08T00:24:52.981698+0000","last_active":"2023-10-08T00:24:52.986877+0000","last_peered":"2023-10-08T00:24:52.986877+0000","last_clean":"2023-10-08T00:24:52.986877+0000","last_became_active":"2023-10-08T00:24:52.981431+0000","last_became_peered":"2023-10-08T00:24:52.981431+0000","last_unstale":"2023-10-08T00:24:52.986877+0000","last_undegraded":"2023-10-08T00:24:52.986877+0000","last_fullsized":"2023-10-08T00:24:52.986877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:25:49.858274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970306+0000","last_change":"2023-10-08T00:24:51.972585+0000","last_active":"2023-10-08T00:24:52.970306+0000","last_peered":"2023-10-08T00:24:52.970306+0000","last_clean":"2023-10-08T00:24:52.970306+0000","last_became_active":"2023-10-08T00:24:51.972285+0000","last_became_peered":"2023-10-08T00:24:51.972285+0000","last_unstale":"2023-10-08T00:24:52.970306+0000","last_undegraded":"2023-10-08T00:24:52.970306+0000","last_fullsized":"2023-10-08T00:24:52.970306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991943+0000","last_change":"2023-10-08T00:24:52.990394+0000","last_active":"2023-10-08T00:24:52.991943+0000","last_peered":"2023-10-08T00:24:52.991943+0000","last_clean":"2023-10-08T00:24:52.991943+0000","last_became_active":"2023-10-08T00:24:52.990088+0000","last_became_peered":"2023-10-08T00:24:52.990088+0000","last_unstale":"2023-10-08T00:24:52.991943+0000","last_undegraded":"2023-10-08T00:24:52.991943+0000","last_fullsized":"2023-10-08T00:24:52.991943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:34.737736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968176+0000","last_change":"2023-10-08T00:24:51.965511+0000","last_active":"2023-10-08T00:24:52.968176+0000","last_peered":"2023-10-08T00:24:52.968176+0000","last_clean":"2023-10-08T00:24:52.968176+0000","last_became_active":"2023-10-08T00:24:51.965135+0000","last_became_peered":"2023-10-08T00:24:51.965135+0000","last_unstale":"2023-10-08T00:24:52.968176+0000","last_undegraded":"2023-10-08T00:24:52.968176+0000","last_fullsized":"2023-10-08T00:24:52.968176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989987+0000","last_change":"2023-10-08T00:24:52.979423+0000","last_active":"2023-10-08T00:24:52.989987+0000","last_peered":"2023-10-08T00:24:52.989987+0000","last_clean":"2023-10-08T00:24:52.989987+0000","last_became_active":"2023-10-08T00:24:52.979088+0000","last_became_peered":"2023-10-08T00:24:52.979088+0000","last_unstale":"2023-10-08T00:24:52.989987+0000","last_undegraded":"2023-10-08T00:24:52.989987+0000","last_fullsized":"2023-10-08T00:24:52.989987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992031+0000","last_change":"2023-10-08T00:24:51.971820+0000","last_active":"2023-10-08T00:24:52.992031+0000","last_peered":"2023-10-08T00:24:52.992031+0000","last_clean":"2023-10-08T00:24:52.992031+0000","last_became_active":"2023-10-08T00:24:51.971563+0000","last_became_peered":"2023-10-08T00:24:51.971563+0000","last_unstale":"2023-10-08T00:24:52.992031+0000","last_undegraded":"2023-10-08T00:24:52.992031+0000","last_fullsized":"2023-10-08T00:24:52.992031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991999+0000","last_change":"2023-10-08T00:24:52.990737+0000","last_active":"2023-10-08T00:24:52.991999+0000","last_peered":"2023-10-08T00:24:52.991999+0000","last_clean":"2023-10-08T00:24:52.991999+0000","last_became_active":"2023-10-08T00:24:52.990032+0000","last_became_peered":"2023-10-08T00:24:52.990032+0000","last_unstale":"2023-10-08T00:24:52.991999+0000","last_undegraded":"2023-10-08T00:24:52.991999+0000","last_fullsized":"2023-10-08T00:24:52.991999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991333+0000","last_change":"2023-10-08T00:24:51.964547+0000","last_active":"2023-10-08T00:24:52.991333+0000","last_peered":"2023-10-08T00:24:52.991333+0000","last_clean":"2023-10-08T00:24:52.991333+0000","last_became_active":"2023-10-08T00:24:51.963951+0000","last_became_peered":"2023-10-08T00:24:51.963951+0000","last_unstale":"2023-10-08T00:24:52.991333+0000","last_undegraded":"2023-10-08T00:24:52.991333+0000","last_fullsized":"2023-10-08T00:24:52.991333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:24.358934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991658+0000","last_change":"2023-10-08T00:24:52.987475+0000","last_active":"2023-10-08T00:24:52.991658+0000","last_peered":"2023-10-08T00:24:52.991658+0000","last_clean":"2023-10-08T00:24:52.991658+0000","last_became_active":"2023-10-08T00:24:52.987054+0000","last_became_peered":"2023-10-08T00:24:52.987054+0000","last_unstale":"2023-10-08T00:24:52.991658+0000","last_undegraded":"2023-10-08T00:24:52.991658+0000","last_fullsized":"2023-10-08T00:24:52.991658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970458+0000","last_change":"2023-10-08T00:24:51.971914+0000","last_active":"2023-10-08T00:24:52.970458+0000","last_peered":"2023-10-08T00:24:52.970458+0000","last_clean":"2023-10-08T00:24:52.970458+0000","last_became_active":"2023-10-08T00:24:51.971486+0000","last_became_peered":"2023-10-08T00:24:51.971486+0000","last_unstale":"2023-10-08T00:24:52.970458+0000","last_undegraded":"2023-10-08T00:24:52.970458+0000","last_fullsized":"2023-10-08T00:24:52.970458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996934+0000","last_change":"2023-10-08T00:24:52.995174+0000","last_active":"2023-10-08T00:24:52.996934+0000","last_peered":"2023-10-08T00:24:52.996934+0000","last_clean":"2023-10-08T00:24:52.996934+0000","last_became_active":"2023-10-08T00:24:52.994900+0000","last_became_peered":"2023-10-08T00:24:52.994900+0000","last_unstale":"2023-10-08T00:24:52.996934+0000","last_undegraded":"2023-10-08T00:24:52.996934+0000","last_fullsized":"2023-10-08T00:24:52.996934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970200+0000","last_change":"2023-10-08T00:24:51.969965+0000","last_active":"2023-10-08T00:24:52.970200+0000","last_peered":"2023-10-08T00:24:52.970200+0000","last_clean":"2023-10-08T00:24:52.970200+0000","last_became_active":"2023-10-08T00:24:51.969745+0000","last_became_peered":"2023-10-08T00:24:51.969745+0000","last_unstale":"2023-10-08T00:24:52.970200+0000","last_undegraded":"2023-10-08T00:24:52.970200+0000","last_fullsized":"2023-10-08T00:24:52.970200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:37:02.932917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.980067+0000","last_change":"2023-10-08T00:24:52.971665+0000","last_active":"2023-10-08T00:24:52.980067+0000","last_peered":"2023-10-08T00:24:52.980067+0000","last_clean":"2023-10-08T00:24:52.980067+0000","last_became_active":"2023-10-08T00:24:52.971399+0000","last_became_peered":"2023-10-08T00:24:52.971399+0000","last_unstale":"2023-10-08T00:24:52.980067+0000","last_undegraded":"2023-10-08T00:24:52.980067+0000","last_fullsized":"2023-10-08T00:24:52.980067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:33:40.259676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.976303+0000","last_change":"2023-10-08T00:24:52.975047+0000","last_active":"2023-10-08T00:24:52.976303+0000","last_peered":"2023-10-08T00:24:52.976303+0000","last_clean":"2023-10-08T00:24:52.976303+0000","last_became_active":"2023-10-08T00:24:52.974783+0000","last_became_peered":"2023-10-08T00:24:52.974783+0000","last_unstale":"2023-10-08T00:24:52.976303+0000","last_undegraded":"2023-10-08T00:24:52.976303+0000","last_fullsized":"2023-10-08T00:24:52.976303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.968751+0000","last_change":"2023-10-08T00:24:51.970680+0000","last_active":"2023-10-08T00:24:52.968751+0000","last_peered":"2023-10-08T00:24:52.968751+0000","last_clean":"2023-10-08T00:24:52.968751+0000","last_became_active":"2023-10-08T00:24:51.970251+0000","last_became_peered":"2023-10-08T00:24:51.970251+0000","last_unstale":"2023-10-08T00:24:52.968751+0000","last_undegraded":"2023-10-08T00:24:52.968751+0000","last_fullsized":"2023-10-08T00:24:52.968751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:25.023060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992113+0000","last_change":"2023-10-08T00:24:52.987527+0000","last_active":"2023-10-08T00:24:52.992113+0000","last_peered":"2023-10-08T00:24:52.992113+0000","last_clean":"2023-10-08T00:24:52.992113+0000","last_became_active":"2023-10-08T00:24:52.987201+0000","last_became_peered":"2023-10-08T00:24:52.987201+0000","last_unstale":"2023-10-08T00:24:52.992113+0000","last_undegraded":"2023-10-08T00:24:52.992113+0000","last_fullsized":"2023-10-08T00:24:52.992113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:53.027721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969155+0000","last_change":"2023-10-08T00:24:51.966501+0000","last_active":"2023-10-08T00:24:52.969155+0000","last_peered":"2023-10-08T00:24:52.969155+0000","last_clean":"2023-10-08T00:24:52.969155+0000","last_became_active":"2023-10-08T00:24:51.966163+0000","last_became_peered":"2023-10-08T00:24:51.966163+0000","last_unstale":"2023-10-08T00:24:52.969155+0000","last_undegraded":"2023-10-08T00:24:52.969155+0000","last_fullsized":"2023-10-08T00:24:52.969155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972967+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:24:52.972967+0000","last_peered":"2023-10-08T00:24:52.972967+0000","last_clean":"2023-10-08T00:24:52.972967+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:24:52.972967+0000","last_undegraded":"2023-10-08T00:24:52.972967+0000","last_fullsized":"2023-10-08T00:24:52.972967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.987231+0000","last_change":"2023-10-08T00:24:52.977356+0000","last_active":"2023-10-08T00:24:52.987231+0000","last_peered":"2023-10-08T00:24:52.987231+0000","last_clean":"2023-10-08T00:24:52.987231+0000","last_became_active":"2023-10-08T00:24:52.977065+0000","last_became_peered":"2023-10-08T00:24:52.977065+0000","last_unstale":"2023-10-08T00:24:52.987231+0000","last_undegraded":"2023-10-08T00:24:52.987231+0000","last_fullsized":"2023-10-08T00:24:52.987231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:29.839154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971755+0000","last_change":"2023-10-08T00:24:51.972788+0000","last_active":"2023-10-08T00:24:52.971755+0000","last_peered":"2023-10-08T00:24:52.971755+0000","last_clean":"2023-10-08T00:24:52.971755+0000","last_became_active":"2023-10-08T00:24:51.972199+0000","last_became_peered":"2023-10-08T00:24:51.972199+0000","last_unstale":"2023-10-08T00:24:52.971755+0000","last_undegraded":"2023-10-08T00:24:52.971755+0000","last_fullsized":"2023-10-08T00:24:52.971755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.972287+0000","last_change":"2023-10-08T00:24:51.975555+0000","last_active":"2023-10-08T00:24:52.972287+0000","last_peered":"2023-10-08T00:24:52.972287+0000","last_clean":"2023-10-08T00:24:52.972287+0000","last_became_active":"2023-10-08T00:24:51.975251+0000","last_became_peered":"2023-10-08T00:24:51.975251+0000","last_unstale":"2023-10-08T00:24:52.972287+0000","last_undegraded":"2023-10-08T00:24:52.972287+0000","last_fullsized":"2023-10-08T00:24:52.972287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984419+0000","last_change":"2023-10-08T00:24:52.978989+0000","last_active":"2023-10-08T00:24:52.984419+0000","last_peered":"2023-10-08T00:24:52.984419+0000","last_clean":"2023-10-08T00:24:52.984419+0000","last_became_active":"2023-10-08T00:24:52.978749+0000","last_became_peered":"2023-10-08T00:24:52.978749+0000","last_unstale":"2023-10-08T00:24:52.984419+0000","last_undegraded":"2023-10-08T00:24:52.984419+0000","last_fullsized":"2023-10-08T00:24:52.984419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T00:24:53.971248+0000","last_change":"2023-10-08T00:24:51.972820+0000","last_active":"2023-10-08T00:24:53.971248+0000","last_peered":"2023-10-08T00:24:53.971248+0000","last_clean":"2023-10-08T00:24:53.971248+0000","last_became_active":"2023-10-08T00:24:51.972559+0000","last_became_peered":"2023-10-08T00:24:51.972559+0000","last_unstale":"2023-10-08T00:24:53.971248+0000","last_undegraded":"2023-10-08T00:24:53.971248+0000","last_fullsized":"2023-10-08T00:24:53.971248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:26:53.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992662+0000","last_change":"2023-10-08T00:24:52.989566+0000","last_active":"2023-10-08T00:24:52.992662+0000","last_peered":"2023-10-08T00:24:52.992662+0000","last_clean":"2023-10-08T00:24:52.992662+0000","last_became_active":"2023-10-08T00:24:52.989274+0000","last_became_peered":"2023-10-08T00:24:52.989274+0000","last_unstale":"2023-10-08T00:24:52.992662+0000","last_undegraded":"2023-10-08T00:24:52.992662+0000","last_fullsized":"2023-10-08T00:24:52.992662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992104+0000","last_change":"2023-10-08T00:24:51.968679+0000","last_active":"2023-10-08T00:24:52.992104+0000","last_peered":"2023-10-08T00:24:52.992104+0000","last_clean":"2023-10-08T00:24:52.992104+0000","last_became_active":"2023-10-08T00:24:51.967961+0000","last_became_peered":"2023-10-08T00:24:51.967961+0000","last_unstale":"2023-10-08T00:24:52.992104+0000","last_undegraded":"2023-10-08T00:24:52.992104+0000","last_fullsized":"2023-10-08T00:24:52.992104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985358+0000","last_change":"2023-10-08T00:24:52.977980+0000","last_active":"2023-10-08T00:24:52.985358+0000","last_peered":"2023-10-08T00:24:52.985358+0000","last_clean":"2023-10-08T00:24:52.985358+0000","last_became_active":"2023-10-08T00:24:52.977672+0000","last_became_peered":"2023-10-08T00:24:52.977672+0000","last_unstale":"2023-10-08T00:24:52.985358+0000","last_undegraded":"2023-10-08T00:24:52.985358+0000","last_fullsized":"2023-10-08T00:24:52.985358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970997+0000","last_change":"2023-10-08T00:24:51.972959+0000","last_active":"2023-10-08T00:24:52.970997+0000","last_peered":"2023-10-08T00:24:52.970997+0000","last_clean":"2023-10-08T00:24:52.970997+0000","last_became_active":"2023-10-08T00:24:51.972532+0000","last_became_peered":"2023-10-08T00:24:51.972532+0000","last_unstale":"2023-10-08T00:24:52.970997+0000","last_undegraded":"2023-10-08T00:24:52.970997+0000","last_fullsized":"2023-10-08T00:24:52.970997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.385304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.973482+0000","last_change":"2023-10-08T00:24:52.971403+0000","last_active":"2023-10-08T00:24:52.973482+0000","last_peered":"2023-10-08T00:24:52.973482+0000","last_clean":"2023-10-08T00:24:52.973482+0000","last_became_active":"2023-10-08T00:24:52.971015+0000","last_became_peered":"2023-10-08T00:24:52.971015+0000","last_unstale":"2023-10-08T00:24:52.973482+0000","last_undegraded":"2023-10-08T00:24:52.973482+0000","last_fullsized":"2023-10-08T00:24:52.973482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:39.620318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.970036+0000","last_change":"2023-10-08T00:24:51.972990+0000","last_active":"2023-10-08T00:24:52.970036+0000","last_peered":"2023-10-08T00:24:52.970036+0000","last_clean":"2023-10-08T00:24:52.970036+0000","last_became_active":"2023-10-08T00:24:51.972120+0000","last_became_peered":"2023-10-08T00:24:51.972120+0000","last_unstale":"2023-10-08T00:24:52.970036+0000","last_undegraded":"2023-10-08T00:24:52.970036+0000","last_fullsized":"2023-10-08T00:24:52.970036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992020+0000","last_change":"2023-10-08T00:24:52.986965+0000","last_active":"2023-10-08T00:24:52.992020+0000","last_peered":"2023-10-08T00:24:52.992020+0000","last_clean":"2023-10-08T00:24:52.992020+0000","last_became_active":"2023-10-08T00:24:52.981949+0000","last_became_peered":"2023-10-08T00:24:52.981949+0000","last_unstale":"2023-10-08T00:24:52.992020+0000","last_undegraded":"2023-10-08T00:24:52.992020+0000","last_fullsized":"2023-10-08T00:24:52.992020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:40.037532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.971126+0000","last_change":"2023-10-08T00:24:51.970488+0000","last_active":"2023-10-08T00:24:52.971126+0000","last_peered":"2023-10-08T00:24:52.971126+0000","last_clean":"2023-10-08T00:24:52.971126+0000","last_became_active":"2023-10-08T00:24:51.970231+0000","last_became_peered":"2023-10-08T00:24:51.970231+0000","last_unstale":"2023-10-08T00:24:52.971126+0000","last_undegraded":"2023-10-08T00:24:52.971126+0000","last_fullsized":"2023-10-08T00:24:52.971126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:41.206862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979310+0000","last_change":"2023-10-08T00:24:52.975874+0000","last_active":"2023-10-08T00:24:52.979310+0000","last_peered":"2023-10-08T00:24:52.979310+0000","last_clean":"2023-10-08T00:24:52.979310+0000","last_became_active":"2023-10-08T00:24:52.975494+0000","last_became_peered":"2023-10-08T00:24:52.975494+0000","last_unstale":"2023-10-08T00:24:52.979310+0000","last_undegraded":"2023-10-08T00:24:52.979310+0000","last_fullsized":"2023-10-08T00:24:52.979310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991514+0000","last_change":"2023-10-08T00:24:51.973894+0000","last_active":"2023-10-08T00:24:52.991514+0000","last_peered":"2023-10-08T00:24:52.991514+0000","last_clean":"2023-10-08T00:24:52.991514+0000","last_became_active":"2023-10-08T00:24:51.973619+0000","last_became_peered":"2023-10-08T00:24:51.973619+0000","last_unstale":"2023-10-08T00:24:52.991514+0000","last_undegraded":"2023-10-08T00:24:52.991514+0000","last_fullsized":"2023-10-08T00:24:52.991514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:38.615692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.979160+0000","last_change":"2023-10-08T00:24:52.975531+0000","last_active":"2023-10-08T00:24:52.979160+0000","last_peered":"2023-10-08T00:24:52.979160+0000","last_clean":"2023-10-08T00:24:52.979160+0000","last_became_active":"2023-10-08T00:24:52.974442+0000","last_became_peered":"2023-10-08T00:24:52.974442+0000","last_unstale":"2023-10-08T00:24:52.979160+0000","last_undegraded":"2023-10-08T00:24:52.979160+0000","last_fullsized":"2023-10-08T00:24:52.979160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:17.574438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.969018+0000","last_change":"2023-10-08T00:24:51.972849+0000","last_active":"2023-10-08T00:24:52.969018+0000","last_peered":"2023-10-08T00:24:52.969018+0000","last_clean":"2023-10-08T00:24:52.969018+0000","last_became_active":"2023-10-08T00:24:51.972584+0000","last_became_peered":"2023-10-08T00:24:51.972584+0000","last_unstale":"2023-10-08T00:24:52.969018+0000","last_undegraded":"2023-10-08T00:24:52.969018+0000","last_fullsized":"2023-10-08T00:24:52.969018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:21.174990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.991780+0000","last_change":"2023-10-08T00:24:52.987901+0000","last_active":"2023-10-08T00:24:52.991780+0000","last_peered":"2023-10-08T00:24:52.991780+0000","last_clean":"2023-10-08T00:24:52.991780+0000","last_became_active":"2023-10-08T00:24:52.987650+0000","last_became_peered":"2023-10-08T00:24:52.987650+0000","last_unstale":"2023-10-08T00:24:52.991780+0000","last_undegraded":"2023-10-08T00:24:52.991780+0000","last_fullsized":"2023-10-08T00:24:52.991780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:29:26.374967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.992854+0000","last_change":"2023-10-08T00:24:51.970706+0000","last_active":"2023-10-08T00:24:52.992854+0000","last_peered":"2023-10-08T00:24:52.992854+0000","last_clean":"2023-10-08T00:24:52.992854+0000","last_became_active":"2023-10-08T00:24:51.969854+0000","last_became_peered":"2023-10-08T00:24:51.969854+0000","last_unstale":"2023-10-08T00:24:52.992854+0000","last_undegraded":"2023-10-08T00:24:52.992854+0000","last_fullsized":"2023-10-08T00:24:52.992854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990618+0000","last_change":"2023-10-08T00:24:52.983945+0000","last_active":"2023-10-08T00:24:52.990618+0000","last_peered":"2023-10-08T00:24:52.990618+0000","last_clean":"2023-10-08T00:24:52.990618+0000","last_became_active":"2023-10-08T00:24:52.983668+0000","last_became_peered":"2023-10-08T00:24:52.983668+0000","last_unstale":"2023-10-08T00:24:52.990618+0000","last_undegraded":"2023-10-08T00:24:52.990618+0000","last_fullsized":"2023-10-08T00:24:52.990618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:56:45.442060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993949+0000","last_change":"2023-10-08T00:24:51.970895+0000","last_active":"2023-10-08T00:24:52.993949+0000","last_peered":"2023-10-08T00:24:52.993949+0000","last_clean":"2023-10-08T00:24:52.993949+0000","last_became_active":"2023-10-08T00:24:51.970245+0000","last_became_peered":"2023-10-08T00:24:51.970245+0000","last_unstale":"2023-10-08T00:24:52.993949+0000","last_undegraded":"2023-10-08T00:24:52.993949+0000","last_fullsized":"2023-10-08T00:24:52.993949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:50.945441+0000","last_clean_scrub_stamp":"2023-10-08T00:24:50.945441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:19:24.451904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.993961+0000","last_change":"2023-10-08T00:24:52.991574+0000","last_active":"2023-10-08T00:24:52.993961+0000","last_peered":"2023-10-08T00:24:52.993961+0000","last_clean":"2023-10-08T00:24:52.993961+0000","last_became_active":"2023-10-08T00:24:52.990396+0000","last_became_peered":"2023-10-08T00:24:52.990396+0000","last_unstale":"2023-10-08T00:24:52.993961+0000","last_undegraded":"2023-10-08T00:24:52.993961+0000","last_fullsized":"2023-10-08T00:24:52.993961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.989966+0000","last_change":"2023-10-08T00:24:52.979422+0000","last_active":"2023-10-08T00:24:52.989966+0000","last_peered":"2023-10-08T00:24:52.989966+0000","last_clean":"2023-10-08T00:24:52.989966+0000","last_became_active":"2023-10-08T00:24:52.979146+0000","last_became_peered":"2023-10-08T00:24:52.979146+0000","last_unstale":"2023-10-08T00:24:52.989966+0000","last_undegraded":"2023-10-08T00:24:52.989966+0000","last_fullsized":"2023-10-08T00:24:52.989966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:41.474846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986972+0000","last_change":"2023-10-08T00:24:52.986197+0000","last_active":"2023-10-08T00:24:52.986972+0000","last_peered":"2023-10-08T00:24:52.986972+0000","last_clean":"2023-10-08T00:24:52.986972+0000","last_became_active":"2023-10-08T00:24:52.985947+0000","last_became_peered":"2023-10-08T00:24:52.985947+0000","last_unstale":"2023-10-08T00:24:52.986972+0000","last_undegraded":"2023-10-08T00:24:52.986972+0000","last_fullsized":"2023-10-08T00:24:52.986972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:47.389930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984505+0000","last_change":"2023-10-08T00:24:52.980865+0000","last_active":"2023-10-08T00:24:52.984505+0000","last_peered":"2023-10-08T00:24:52.984505+0000","last_clean":"2023-10-08T00:24:52.984505+0000","last_became_active":"2023-10-08T00:24:52.980251+0000","last_became_peered":"2023-10-08T00:24:52.980251+0000","last_unstale":"2023-10-08T00:24:52.984505+0000","last_undegraded":"2023-10-08T00:24:52.984505+0000","last_fullsized":"2023-10-08T00:24:52.984505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986453+0000","last_change":"2023-10-08T00:24:52.985277+0000","last_active":"2023-10-08T00:24:52.986453+0000","last_peered":"2023-10-08T00:24:52.986453+0000","last_clean":"2023-10-08T00:24:52.986453+0000","last_became_active":"2023-10-08T00:24:52.981814+0000","last_became_peered":"2023-10-08T00:24:52.981814+0000","last_unstale":"2023-10-08T00:24:52.986453+0000","last_undegraded":"2023-10-08T00:24:52.986453+0000","last_fullsized":"2023-10-08T00:24:52.986453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981430+0000","last_change":"2023-10-08T00:24:52.975549+0000","last_active":"2023-10-08T00:24:52.981430+0000","last_peered":"2023-10-08T00:24:52.981430+0000","last_clean":"2023-10-08T00:24:52.981430+0000","last_became_active":"2023-10-08T00:24:52.975298+0000","last_became_peered":"2023-10-08T00:24:52.975298+0000","last_unstale":"2023-10-08T00:24:52.981430+0000","last_undegraded":"2023-10-08T00:24:52.981430+0000","last_fullsized":"2023-10-08T00:24:52.981430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:47:45.144415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.984523+0000","last_change":"2023-10-08T00:24:52.978921+0000","last_active":"2023-10-08T00:24:52.984523+0000","last_peered":"2023-10-08T00:24:52.984523+0000","last_clean":"2023-10-08T00:24:52.984523+0000","last_became_active":"2023-10-08T00:24:52.978633+0000","last_became_peered":"2023-10-08T00:24:52.978633+0000","last_unstale":"2023-10-08T00:24:52.984523+0000","last_undegraded":"2023-10-08T00:24:52.984523+0000","last_fullsized":"2023-10-08T00:24:52.984523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.990230+0000","last_change":"2023-10-08T00:24:52.985282+0000","last_active":"2023-10-08T00:24:52.990230+0000","last_peered":"2023-10-08T00:24:52.990230+0000","last_clean":"2023-10-08T00:24:52.990230+0000","last_became_active":"2023-10-08T00:24:52.985016+0000","last_became_peered":"2023-10-08T00:24:52.985016+0000","last_unstale":"2023-10-08T00:24:52.990230+0000","last_undegraded":"2023-10-08T00:24:52.990230+0000","last_fullsized":"2023-10-08T00:24:52.990230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.977747+0000","last_change":"2023-10-08T00:24:52.974937+0000","last_active":"2023-10-08T00:24:52.977747+0000","last_peered":"2023-10-08T00:24:52.977747+0000","last_clean":"2023-10-08T00:24:52.977747+0000","last_became_active":"2023-10-08T00:24:52.974647+0000","last_became_peered":"2023-10-08T00:24:52.974647+0000","last_unstale":"2023-10-08T00:24:52.977747+0000","last_undegraded":"2023-10-08T00:24:52.977747+0000","last_fullsized":"2023-10-08T00:24:52.977747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:16.919473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.996943+0000","last_change":"2023-10-08T00:24:52.995257+0000","last_active":"2023-10-08T00:24:52.996943+0000","last_peered":"2023-10-08T00:24:52.996943+0000","last_clean":"2023-10-08T00:24:52.996943+0000","last_became_active":"2023-10-08T00:24:52.994863+0000","last_became_peered":"2023-10-08T00:24:52.994863+0000","last_unstale":"2023-10-08T00:24:52.996943+0000","last_undegraded":"2023-10-08T00:24:52.996943+0000","last_fullsized":"2023-10-08T00:24:52.996943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:52.961474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.981376+0000","last_change":"2023-10-08T00:24:52.976107+0000","last_active":"2023-10-08T00:24:52.981376+0000","last_peered":"2023-10-08T00:24:52.981376+0000","last_clean":"2023-10-08T00:24:52.981376+0000","last_became_active":"2023-10-08T00:24:52.975835+0000","last_became_peered":"2023-10-08T00:24:52.975835+0000","last_unstale":"2023-10-08T00:24:52.981376+0000","last_undegraded":"2023-10-08T00:24:52.981376+0000","last_fullsized":"2023-10-08T00:24:52.981376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:12.226581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.985392+0000","last_change":"2023-10-08T00:24:52.982480+0000","last_active":"2023-10-08T00:24:52.985392+0000","last_peered":"2023-10-08T00:24:52.985392+0000","last_clean":"2023-10-08T00:24:52.985392+0000","last_became_active":"2023-10-08T00:24:52.981391+0000","last_became_peered":"2023-10-08T00:24:52.981391+0000","last_unstale":"2023-10-08T00:24:52.985392+0000","last_undegraded":"2023-10-08T00:24:52.985392+0000","last_fullsized":"2023-10-08T00:24:52.985392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:00.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.986425+0000","last_change":"2023-10-08T00:24:52.982575+0000","last_active":"2023-10-08T00:24:52.986425+0000","last_peered":"2023-10-08T00:24:52.986425+0000","last_clean":"2023-10-08T00:24:52.986425+0000","last_became_active":"2023-10-08T00:24:52.982206+0000","last_became_peered":"2023-10-08T00:24:52.982206+0000","last_unstale":"2023-10-08T00:24:52.986425+0000","last_undegraded":"2023-10-08T00:24:52.986425+0000","last_fullsized":"2023-10-08T00:24:52.986425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:11.523485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T00:24:52.975941+0000","last_change":"2023-10-08T00:24:52.975079+0000","last_active":"2023-10-08T00:24:52.975941+0000","last_peered":"2023-10-08T00:24:52.975941+0000","last_clean":"2023-10-08T00:24:52.975941+0000","last_became_active":"2023-10-08T00:24:52.974531+0000","last_became_peered":"2023-10-08T00:24:52.974531+0000","last_unstale":"2023-10-08T00:24:52.975941+0000","last_undegraded":"2023-10-08T00:24:52.975941+0000","last_fullsized":"2023-10-08T00:24:52.975941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:51.950067+0000","last_clean_scrub_stamp":"2023-10-08T00:24:51.950067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:59.692686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298084,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073756,"statfs":{"total":96636764160,"available":96331526144,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297504,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074336,"statfs":{"total":96636764160,"available":96332120064,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:02.131 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T00:25:02.132 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T00:25:02.132 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T00:25:02.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T00:25:02.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.284+0000 7f49c359e700 1 Processor -- start 2023-10-08T00:25:02.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.284+0000 7f49c359e700 1 -- start start 2023-10-08T00:25:02.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49c415c9a0 0x7f49c40cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49c40ce900 0x7f49c40cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40cfa60 con 0x7f49c415cd70 2023-10-08T00:25:02.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c359e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40cee50 con 0x7f49c40ce900 2023-10-08T00:25:02.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c40cf130 con 0x7f49c415c9a0 2023-10-08T00:25:02.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49c40ce900 0x7f49c40cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49c40ce900 0x7f49c40cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60510/0 (socket says 172.21.15.22:60510) 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 -- 172.21.15.22:0/1479975858 learned_addr learned my addr 172.21.15.22:0/1479975858 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c259c700 1 --2- 172.21.15.22:0/1479975858 >> v2:172.21.15.192:3300/0 conn(0x7f49c415c9a0 0x7f49c40cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 -- 172.21.15.22:0/1479975858 >> v2:172.21.15.192:3300/0 conn(0x7f49c415c9a0 msgr2=0x7f49c40cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 --2- 172.21.15.22:0/1479975858 >> v2:172.21.15.192:3300/0 conn(0x7f49c415c9a0 0x7f49c40cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 -- 172.21.15.22:0/1479975858 >> v1:172.21.15.192:6789/0 conn(0x7f49c415cd70 legacy=0x7f49c415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.285+0000 7f49c1d9b700 1 -- 172.21.15.22:0/1479975858 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40cf410 con 0x7f49c40ce900 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c1d9b700 1 --2- 172.21.15.22:0/1479975858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c40ce900 0x7f49c40cb750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f49c4088da0 tx=0x7f49ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732407f5387eabd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c159a700 1 -- 172.21.15.22:0/1479975858 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00b820 con 0x7f49c40ce900 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c159a700 1 -- 172.21.15.22:0/1479975858 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac00b980 con 0x7f49c40ce900 2023-10-08T00:25:02.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c159a700 1 -- 172.21.15.22:0/1479975858 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ac00bd20 con 0x7f49c40ce900 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 -- 172.21.15.22:0/1479975858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c40ce900 msgr2=0x7f49c40cb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 --2- 172.21.15.22:0/1479975858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c40ce900 0x7f49c40cb750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f49c4088da0 tx=0x7f49ac009250 comp rx=0 tx=0).stop 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 -- 172.21.15.22:0/1479975858 shutdown_connections 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 --2- 172.21.15.22:0/1479975858 >> v2:172.21.15.192:3300/0 conn(0x7f49c415c9a0 0x7f49c40cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 --2- 172.21.15.22:0/1479975858 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c40ce900 0x7f49c40cb750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 -- 172.21.15.22:0/1479975858 >> 172.21.15.22:0/1479975858 conn(0x7f49c40d05c0 msgr2=0x7f49c40d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 -- 172.21.15.22:0/1479975858 shutdown_connections 2023-10-08T00:25:02.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.286+0000 7f49c359e700 1 -- 172.21.15.22:0/1479975858 wait complete. 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.287+0000 7f49c359e700 1 Processor -- start 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.287+0000 7f49c359e700 1 -- start start 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c40ce900 0x7f49c4158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c415c9a0 0x7f49c41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 0x7f49c40af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c359e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40afe50 con 0x7f49c415cd70 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c415afe0 con 0x7f49c415c9a0 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c415b2c0 con 0x7f49c40ce900 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 0x7f49c40af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 0x7f49c40af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60516/0 (socket says 172.21.15.22:60516) 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c2d9d700 1 -- 172.21.15.22:0/3250753595 learned_addr learned my addr 172.21.15.22:0/3250753595 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c1d9b700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c415c9a0 0x7f49c41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.288+0000 7f49c259c700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c40ce900 0x7f49c4158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c2d9d700 1 -- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c40ce900 msgr2=0x7f49c4158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c2d9d700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c40ce900 0x7f49c4158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c2d9d700 1 -- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c415c9a0 msgr2=0x7f49c41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c2d9d700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c415c9a0 0x7f49c41551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c2d9d700 1 -- 172.21.15.22:0/3250753595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0094f0 con 0x7f49c415cd70 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c259c700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c40ce900 0x7f49c4158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c2d9d700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 0x7f49c40af910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49b400c930 tx=0x7f49b40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012630 con 0x7f49c415cd70 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40127d0 con 0x7f49c415cd70 2023-10-08T00:25:02.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c415b5a0 con 0x7f49c415cd70 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012b90 con 0x7f49c415cd70 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.289+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c415bb60 con 0x7f49c415cd70 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.290+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4088ea0 con 0x7f49c415cd70 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.290+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49b400a3b0 con 0x7f49c415cd70 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.291+0000 7f49ba7fc700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49a4066f30 0x7f49a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.291+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49b4084320 con 0x7f49c415cd70 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.291+0000 7f49c259c700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49a4066f30 0x7f49a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.291+0000 7f49c259c700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49a4066f30 0x7f49a40693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49bc006fd0 tx=0x7f49bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:02.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.295+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49b40514f0 con 0x7f49c415cd70 2023-10-08T00:25:02.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.531+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f49c4071920 con 0x7f49c415cd70 2023-10-08T00:25:02.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.531+0000 7f49ba7fc700 1 -- 172.21.15.22:0/3250753595 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f49b4054b10 con 0x7f49c415cd70 2023-10-08T00:25:02.532 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:02.532 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49a4066f30 msgr2=0x7f49a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49a4066f30 0x7f49a40693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f49bc006fd0 tx=0x7f49bc008040 comp rx=0 tx=0).stop 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 msgr2=0x7f49c40af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 0x7f49c40af910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f49b400c930 tx=0x7f49b40026e0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 shutdown_connections 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49c415cd70 0x7f49c40af910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49a4066f30 0x7f49a40693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49c40ce900 0x7f49c4158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 --2- 172.21.15.22:0/3250753595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49c415c9a0 0x7f49c41551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 >> 172.21.15.22:0/3250753595 conn(0x7f49c40d05c0 msgr2=0x7f49c40d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 shutdown_connections 2023-10-08T00:25:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.533+0000 7f49c359e700 1 -- 172.21.15.22:0/3250753595 wait complete. 2023-10-08T00:25:02.546 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T00:25:02.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.665+0000 7f13804e4700 1 Processor -- start 2023-10-08T00:25:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.665+0000 7f13804e4700 1 -- start start 2023-10-08T00:25:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f13804e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159890 0x7f137815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f13804e4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1378069560 0x7f13780699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f13804e4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137815a160 con 0x7f1378159c60 2023-10-08T00:25:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f13804e4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1378069f20 con 0x7f1378069560 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f13804e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780d13a0 con 0x7f1378159890 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f137ea81700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1378069560 0x7f13780699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f137da7f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1378159c60 0x7f137815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59962/0 (socket says 172.21.15.22:59962) 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f137da7f700 1 -- 172.21.15.22:0/1864140120 learned_addr learned my addr 172.21.15.22:0/1864140120 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f137e280700 1 --2- 172.21.15.22:0/1864140120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159890 0x7f137815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f137ea81700 1 -- 172.21.15.22:0/1864140120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159890 msgr2=0x7f137815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.666+0000 7f137ea81700 1 --2- 172.21.15.22:0/1864140120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159890 0x7f137815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137ea81700 1 -- 172.21.15.22:0/1864140120 >> v1:172.21.15.22:6789/0 conn(0x7f1378159c60 legacy=0x7f137815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137d27e700 1 -- 172.21.15.22:0/1864140120 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554623800 0 0) 0x7f137815a160 con 0x7f1378159c60 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137ea81700 1 -- 172.21.15.22:0/1864140120 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137815e140 con 0x7f1378069560 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137ea81700 1 --2- 172.21.15.22:0/1864140120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f13780699e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1368009e60 tx=0x7f1368009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae8b5d8fc55583a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:02.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137d27e700 1 -- 172.21.15.22:0/1864140120 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136800e070 con 0x7f1378069560 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137d27e700 1 -- 172.21.15.22:0/1864140120 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136800bc30 con 0x7f1378069560 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f137d27e700 1 -- 172.21.15.22:0/1864140120 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368012430 con 0x7f1378069560 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 -- 172.21.15.22:0/1864140120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 msgr2=0x7f13780699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 --2- 172.21.15.22:0/1864140120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f13780699e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1368009e60 tx=0x7f1368009780 comp rx=0 tx=0).stop 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 -- 172.21.15.22:0/1864140120 shutdown_connections 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 --2- 172.21.15.22:0/1864140120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f13780699e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 --2- 172.21.15.22:0/1864140120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159890 0x7f137815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 -- 172.21.15.22:0/1864140120 >> 172.21.15.22:0/1864140120 conn(0x7f1378068e20 msgr2=0x7f13780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 -- 172.21.15.22:0/1864140120 shutdown_connections 2023-10-08T00:25:02.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.667+0000 7f13804e4700 1 -- 172.21.15.22:0/1864140120 wait complete. 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.668+0000 7f13804e4700 1 Processor -- start 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 -- start start 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f137815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1378159890 0x7f13780b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159c60 0x7f1378154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1378155770 con 0x7f1378069560 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137815efc0 con 0x7f1378159890 2023-10-08T00:25:02.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f13804e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1378154cc0 con 0x7f1378159c60 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f137e280700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f137815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f137e280700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f137815d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60528/0 (socket says 172.21.15.22:60528) 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f137e280700 1 -- 172.21.15.22:0/3055543452 learned_addr learned my addr 172.21.15.22:0/3055543452 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f137ea81700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159c60 0x7f1378154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.669+0000 7f137da7f700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1378159890 0x7f13780b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137e280700 1 -- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159c60 msgr2=0x7f1378154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137e280700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159c60 0x7f1378154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137e280700 1 -- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1378159890 msgr2=0x7f13780b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137e280700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1378159890 0x7f13780b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137e280700 1 -- 172.21.15.22:0/3055543452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368009a20 con 0x7f1378069560 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137ea81700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159c60 0x7f1378154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:02.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137da7f700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1378159890 0x7f13780b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f137e280700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f137815d890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f137000d8c0 tx=0x7f1370008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000de60 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000b780 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000bb20 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13780b3fe0 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.670+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137815b8a0 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.671+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13780b4500 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.671+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f137001e460 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.672+0000 7f13767fc700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1364066f30 0x7f13640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.672+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1370084b70 con 0x7f1378069560 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.672+0000 7f137da7f700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1364066f30 0x7f13640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:02.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.672+0000 7f137da7f700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1364066f30 0x7f13640693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13780b5810 tx=0x7f136c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.676+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13780b4500 con 0x7f1378069560 2023-10-08T00:25:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.870+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f137815ed90 con 0x7f1378069560 2023-10-08T00:25:02.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.871+0000 7f13767fc700 1 -- 172.21.15.22:0/3055543452 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f137815ed90 con 0x7f1378069560 2023-10-08T00:25:02.871 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1364066f30 msgr2=0x7f13640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1364066f30 0x7f13640693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f13780b5810 tx=0x7f136c009040 comp rx=0 tx=0).stop 2023-10-08T00:25:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 msgr2=0x7f137815d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f137815d890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f137000d8c0 tx=0x7f1370008040 comp rx=0 tx=0).stop 2023-10-08T00:25:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 shutdown_connections 2023-10-08T00:25:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1364066f30 0x7f13640693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1378159c60 0x7f1378154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1378069560 0x7f137815d890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 --2- 172.21.15.22:0/3055543452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1378159890 0x7f13780b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 >> 172.21.15.22:0/3055543452 conn(0x7f1378068e20 msgr2=0x7f13781580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 shutdown_connections 2023-10-08T00:25:02.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:02.873+0000 7f13804e4700 1 -- 172.21.15.22:0/3055543452 wait complete. 2023-10-08T00:25:02.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:02.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:03.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.009+0000 7f1aae0c2700 1 Processor -- start 2023-10-08T00:25:03.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.009+0000 7f1aae0c2700 1 -- start start 2023-10-08T00:25:03.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aae0c2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1aa8159890 0x7f1aa815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aae0c2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1aa8069560 0x7f1aa80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aae0c2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa8069ee0 con 0x7f1aa8159c60 2023-10-08T00:25:03.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aae0c2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa815a160 con 0x7f1aa8069560 2023-10-08T00:25:03.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aae0c2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80d13a0 con 0x7f1aa8159890 2023-10-08T00:25:03.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1aa8069560 0x7f1aa80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1aa8069560 0x7f1aa80699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60534/0 (socket says 172.21.15.22:60534) 2023-10-08T00:25:03.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 -- 172.21.15.22:0/3014217378 learned_addr learned my addr 172.21.15.22:0/3014217378 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:03.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa77fe700 1 --2- 172.21.15.22:0/3014217378 >> v2:172.21.15.192:3300/0 conn(0x7f1aa8159890 0x7f1aa815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 -- 172.21.15.22:0/3014217378 >> v2:172.21.15.192:3300/0 conn(0x7f1aa8159890 msgr2=0x7f1aa815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:03.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 --2- 172.21.15.22:0/3014217378 >> v2:172.21.15.192:3300/0 conn(0x7f1aa8159890 0x7f1aa815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 -- 172.21.15.22:0/3014217378 >> v1:172.21.15.192:6789/0 conn(0x7f1aa8159c60 legacy=0x7f1aa815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 -- 172.21.15.22:0/3014217378 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa815e140 con 0x7f1aa8069560 2023-10-08T00:25:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa7fff700 1 --2- 172.21.15.22:0/3014217378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8069560 0x7f1aa80699a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80d1090 tx=0x7f1aa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3b435d1c9dd455 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa67fc700 1 -- 172.21.15.22:0/3014217378 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000e070 con 0x7f1aa8069560 2023-10-08T00:25:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa67fc700 1 -- 172.21.15.22:0/3014217378 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa000ba20 con 0x7f1aa8069560 2023-10-08T00:25:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.010+0000 7f1aa67fc700 1 -- 172.21.15.22:0/3014217378 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00092e0 con 0x7f1aa8069560 2023-10-08T00:25:03.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 -- 172.21.15.22:0/3014217378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8069560 msgr2=0x7f1aa80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/3014217378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8069560 0x7f1aa80699a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80d1090 tx=0x7f1aa0009840 comp rx=0 tx=0).stop 2023-10-08T00:25:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 -- 172.21.15.22:0/3014217378 shutdown_connections 2023-10-08T00:25:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/3014217378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8069560 0x7f1aa80699a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/3014217378 >> v2:172.21.15.192:3300/0 conn(0x7f1aa8159890 0x7f1aa815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 -- 172.21.15.22:0/3014217378 >> 172.21.15.22:0/3014217378 conn(0x7f1aa8068e20 msgr2=0x7f1aa80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:03.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 -- 172.21.15.22:0/3014217378 shutdown_connections 2023-10-08T00:25:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.011+0000 7f1aae0c2700 1 -- 172.21.15.22:0/3014217378 wait complete. 2023-10-08T00:25:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.012+0000 7f1aae0c2700 1 Processor -- start 2023-10-08T00:25:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.012+0000 7f1aae0c2700 1 -- start start 2023-10-08T00:25:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aae0c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa8069560 0x7f1aa8167bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aae0c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 0x7f1aa80ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aae0c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa8159c60 0x7f1aa80c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aae0c2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80ca9a0 con 0x7f1aa8159890 2023-10-08T00:25:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aae0c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80ce880 con 0x7f1aa8069560 2023-10-08T00:25:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aae0c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80ca6c0 con 0x7f1aa8159c60 2023-10-08T00:25:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 0x7f1aa80ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 0x7f1aa80ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60548/0 (socket says 172.21.15.22:60548) 2023-10-08T00:25:03.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 -- 172.21.15.22:0/2513649500 learned_addr learned my addr 172.21.15.22:0/2513649500 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:03.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa77fe700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa8069560 0x7f1aa8167bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa7fff700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa8159c60 0x7f1aa80c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 -- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa8159c60 msgr2=0x7f1aa80c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa8159c60 0x7f1aa80c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 -- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa8069560 msgr2=0x7f1aa8167bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa8069560 0x7f1aa8167bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa6ffd700 1 -- 172.21.15.22:0/2513649500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0009ae0 con 0x7f1aa8159890 2023-10-08T00:25:03.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.013+0000 7f1aa7fff700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa8159c60 0x7f1aa80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:03.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.014+0000 7f1aa6ffd700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 0x7f1aa80ca000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00c4e0 tx=0x7f1a9c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.014+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011590 con 0x7f1aa8159890 2023-10-08T00:25:03.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.014+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c011710 con 0x7f1aa8159890 2023-10-08T00:25:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.014+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa80ce230 con 0x7f1aa8159890 2023-10-08T00:25:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.014+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c011ad0 con 0x7f1aa8159890 2023-10-08T00:25:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.014+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa80c8080 con 0x7f1aa8159890 2023-10-08T00:25:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.015+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa80ce090 con 0x7f1aa8159890 2023-10-08T00:25:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.015+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a9c01b3b0 con 0x7f1aa8159890 2023-10-08T00:25:03.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.015+0000 7f1a8f7fe700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a94066f30 0x7f1a940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.016+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1a9c0839c0 con 0x7f1aa8159890 2023-10-08T00:25:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.016+0000 7f1aa77fe700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a94066f30 0x7f1a940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.016+0000 7f1aa77fe700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a94066f30 0x7f1a940693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009db0 tx=0x7f1a980091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.020+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aa80ce090 con 0x7f1aa8159890 2023-10-08T00:25:03.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.211+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1aa80ce090 con 0x7f1aa8159890 2023-10-08T00:25:03.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.211+0000 7f1a8f7fe700 1 -- 172.21.15.22:0/2513649500 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1aa80ce090 con 0x7f1aa8159890 2023-10-08T00:25:03.212 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a94066f30 msgr2=0x7f1a940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a94066f30 0x7f1a940693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009db0 tx=0x7f1a980091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 msgr2=0x7f1aa80ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 0x7f1aa80ca000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00c4e0 tx=0x7f1a9c00c7f0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 shutdown_connections 2023-10-08T00:25:03.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1a94066f30 0x7f1a940693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1aa8159c60 0x7f1aa80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1aa8069560 0x7f1aa8167bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 --2- 172.21.15.22:0/2513649500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa8159890 0x7f1aa80ca000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 >> 172.21.15.22:0/2513649500 conn(0x7f1aa8068e20 msgr2=0x7f1aa8152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:03.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.213+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 shutdown_connections 2023-10-08T00:25:03.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.214+0000 7f1aae0c2700 1 -- 172.21.15.22:0/2513649500 wait complete. 2023-10-08T00:25:03.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:03.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.348+0000 7f1b7ed55700 1 Processor -- start 2023-10-08T00:25:03.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.348+0000 7f1b7ed55700 1 -- start start 2023-10-08T00:25:03.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b7ed55700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78159890 0x7f1b7815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b7ed55700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7815a160 con 0x7f1b78159c60 2023-10-08T00:25:03.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b7ed55700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b780d13a0 con 0x7f1b78069560 2023-10-08T00:25:03.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b7ed55700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7815e140 con 0x7f1b78159890 2023-10-08T00:25:03.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b77fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1b78159c60 0x7f1b7815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59976/0 (socket says 172.21.15.22:59976) 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b77fff700 1 -- 172.21.15.22:0/715825434 learned_addr learned my addr 172.21.15.22:0/715825434 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.349+0000 7f1b7caf1700 1 --2- 172.21.15.22:0/715825434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78159890 0x7f1b7815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b777fe700 1 -- 172.21.15.22:0/715825434 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477526276 0 0) 0x7f1b7815a160 con 0x7f1b78159c60 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b777fe700 1 -- 172.21.15.22:0/715825434 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b64003570 con 0x7f1b78159c60 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b777fe700 1 -- 172.21.15.22:0/715825434 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1499612326 0 0) 0x7f1b64003570 con 0x7f1b78159c60 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b7caf1700 1 -- 172.21.15.22:0/715825434 >> v1:172.21.15.192:6789/0 conn(0x7f1b78069560 legacy=0x7f1b780ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b7caf1700 1 -- 172.21.15.22:0/715825434 >> v1:172.21.15.22:6789/0 conn(0x7f1b78159c60 legacy=0x7f1b7815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b7caf1700 1 -- 172.21.15.22:0/715825434 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7815a3d0 con 0x7f1b78159890 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b7caf1700 1 --2- 172.21.15.22:0/715825434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78159890 0x7f1b7815abd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009e90 tx=0x7f1b70009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a7067df89db8bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b777fe700 1 -- 172.21.15.22:0/715825434 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000e070 con 0x7f1b78159890 2023-10-08T00:25:03.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b777fe700 1 -- 172.21.15.22:0/715825434 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7000b920 con 0x7f1b78159890 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.350+0000 7f1b777fe700 1 -- 172.21.15.22:0/715825434 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68001470 con 0x7f1b78159890 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 -- 172.21.15.22:0/715825434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78159890 msgr2=0x7f1b7815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/715825434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78159890 0x7f1b7815abd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009e90 tx=0x7f1b70009780 comp rx=0 tx=0).stop 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 -- 172.21.15.22:0/715825434 shutdown_connections 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/715825434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78159890 0x7f1b7815abd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 -- 172.21.15.22:0/715825434 >> 172.21.15.22:0/715825434 conn(0x7f1b78068e20 msgr2=0x7f1b780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 -- 172.21.15.22:0/715825434 shutdown_connections 2023-10-08T00:25:03.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.351+0000 7f1b7ed55700 1 -- 172.21.15.22:0/715825434 wait complete. 2023-10-08T00:25:03.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.352+0000 7f1b7ed55700 1 Processor -- start 2023-10-08T00:25:03.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.352+0000 7f1b7ed55700 1 -- start start 2023-10-08T00:25:03.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7ed55700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78069560 0x7f1b780cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7ed55700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 0x7f1b780cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7ed55700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b78159c60 0x7f1b780c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7ed55700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780b3cb0 con 0x7f1b78159890 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7ed55700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780cdf30 con 0x7f1b78159c60 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7ed55700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780ce210 con 0x7f1b78069560 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 0x7f1b780cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 0x7f1b780cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60554/0 (socket says 172.21.15.22:60554) 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 -- 172.21.15.22:0/4112308530 learned_addr learned my addr 172.21.15.22:0/4112308530 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7caf1700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78069560 0x7f1b780cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b7d2f2700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b78159c60 0x7f1b780c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 -- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78069560 msgr2=0x7f1b780cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78069560 0x7f1b780cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 -- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b78159c60 msgr2=0x7f1b780c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b78159c60 0x7f1b780c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 -- 172.21.15.22:0/4112308530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70009a20 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b77fff700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 0x7f1b780cd900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800c7f0 tx=0x7f1b68001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.353+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68007360 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.354+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b680074c0 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.354+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b68004a40 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.354+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b780ce4f0 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.354+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b780ceab0 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.355+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b780cecd0 con 0x7f1b78159890 2023-10-08T00:25:03.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.355+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b6801c3b0 con 0x7f1b78159890 2023-10-08T00:25:03.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.355+0000 7f1b74ff9700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b58066f30 0x7f1b580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.356+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b68083d50 con 0x7f1b78159890 2023-10-08T00:25:03.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.356+0000 7f1b7caf1700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b58066f30 0x7f1b580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.356+0000 7f1b7caf1700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b58066f30 0x7f1b580693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b700097c0 tx=0x7f1b70017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.360+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b6804c5a0 con 0x7f1b78159890 2023-10-08T00:25:03.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.552+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b7804c3c0 con 0x7f1b78159890 2023-10-08T00:25:03.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.553+0000 7f1b74ff9700 1 -- 172.21.15.22:0/4112308530 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b68018020 con 0x7f1b78159890 2023-10-08T00:25:03.553 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:03.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b58066f30 msgr2=0x7f1b580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b58066f30 0x7f1b580693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b700097c0 tx=0x7f1b70017000 comp rx=0 tx=0).stop 2023-10-08T00:25:03.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 msgr2=0x7f1b780cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 0x7f1b780cd900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800c7f0 tx=0x7f1b68001a10 comp rx=0 tx=0).stop 2023-10-08T00:25:03.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 shutdown_connections 2023-10-08T00:25:03.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b78159c60 0x7f1b780c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b58066f30 0x7f1b580693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1b78069560 0x7f1b780cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 --2- 172.21.15.22:0/4112308530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1b78159890 0x7f1b780cd900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 >> 172.21.15.22:0/4112308530 conn(0x7f1b78068e20 msgr2=0x7f1b78152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:03.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 shutdown_connections 2023-10-08T00:25:03.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.555+0000 7f1b7ed55700 1 -- 172.21.15.22:0/4112308530 wait complete. 2023-10-08T00:25:03.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 Processor -- start 2023-10-08T00:25:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 -- start start 2023-10-08T00:25:03.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51b40aca80 0x7f51b406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40c83c0 0x7f51b40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b406bdb0 con 0x7f51b4069d60 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40cb370 con 0x7f51b40aca80 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.689+0000 7f51b952d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4159f60 con 0x7f51b40c83c0 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51b40aca80 0x7f51b406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b27fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f51b4069d60 0x7f51b40c7cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59984/0 (socket says 172.21.15.22:59984) 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b27fc700 1 -- 172.21.15.22:0/4123246890 learned_addr learned my addr 172.21.15.22:0/4123246890 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b37fe700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40c83c0 0x7f51b40cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b2ffd700 1 -- 172.21.15.22:0/4123246890 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40c83c0 msgr2=0x7f51b40cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b2ffd700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40c83c0 0x7f51b40cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b2ffd700 1 -- 172.21.15.22:0/4123246890 >> v1:172.21.15.22:6789/0 conn(0x7f51b4069d60 legacy=0x7f51b40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b2ffd700 1 -- 172.21.15.22:0/4123246890 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b406b510 con 0x7f51b40aca80 2023-10-08T00:25:03.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b1ffb700 1 -- 172.21.15.22:0/4123246890 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610998390 0 0) 0x7f51b406bdb0 con 0x7f51b4069d60 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b37fe700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40c83c0 0x7f51b40cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b2ffd700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40aca80 0x7f51b406aba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009eb0 tx=0x7f51a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8f93f33a37c46e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b1ffb700 1 -- 172.21.15.22:0/4123246890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400e070 con 0x7f51b40aca80 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b1ffb700 1 -- 172.21.15.22:0/4123246890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400bc30 con 0x7f51b40aca80 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.690+0000 7f51b1ffb700 1 -- 172.21.15.22:0/4123246890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4012430 con 0x7f51b40aca80 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 -- 172.21.15.22:0/4123246890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40aca80 msgr2=0x7f51b406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40aca80 0x7f51b406aba0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009eb0 tx=0x7f51a4009780 comp rx=0 tx=0).stop 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 -- 172.21.15.22:0/4123246890 shutdown_connections 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40c83c0 0x7f51b40cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 --2- 172.21.15.22:0/4123246890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40aca80 0x7f51b406aba0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 -- 172.21.15.22:0/4123246890 >> 172.21.15.22:0/4123246890 conn(0x7f51b40cd670 msgr2=0x7f51b40cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:03.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 -- 172.21.15.22:0/4123246890 shutdown_connections 2023-10-08T00:25:03.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.691+0000 7f51b952d700 1 -- 172.21.15.22:0/4123246890 wait complete. 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.692+0000 7f51b952d700 1 Processor -- start 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.692+0000 7f51b952d700 1 -- start start 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b952d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51b4069d60 0x7f51b40af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b952d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40aca80 0x7f51b40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b952d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 0x7f51b4154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b952d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40c80d0 con 0x7f51b40c83c0 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b952d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b416df30 con 0x7f51b4069d60 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b952d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b416d320 con 0x7f51b40aca80 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 0x7f51b4154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 0x7f51b4154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60570/0 (socket says 172.21.15.22:60570) 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 -- 172.21.15.22:0/3165474428 learned_addr learned my addr 172.21.15.22:0/3165474428 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b27fc700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40aca80 0x7f51b40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b2ffd700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51b4069d60 0x7f51b40af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 -- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40aca80 msgr2=0x7f51b40c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40aca80 0x7f51b40c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 -- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51b4069d60 msgr2=0x7f51b40af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51b4069d60 0x7f51b40af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 -- 172.21.15.22:0/3165474428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009a20 con 0x7f51b40c83c0 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.693+0000 7f51b37fe700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 0x7f51b4154cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00d860 tx=0x7f51ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.694+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0125f0 con 0x7f51b40c83c0 2023-10-08T00:25:03.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.694+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac012750 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.694+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b416d600 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.694+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac012ad0 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.694+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b416dbc0 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.695+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b416e0c0 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.695+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51ac013480 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.695+0000 7f51aaffd700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5194066f30 0x7f51940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.695+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51ac084670 con 0x7f51b40c83c0 2023-10-08T00:25:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.696+0000 7f51b2ffd700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5194066f30 0x7f51940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:03.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.696+0000 7f51b2ffd700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5194066f30 0x7f51940693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009eb0 tx=0x7f51a4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:03.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.700+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51ac0518e0 con 0x7f51b40c83c0 2023-10-08T00:25:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.893+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51b404c3c0 con 0x7f51b40c83c0 2023-10-08T00:25:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.893+0000 7f51aaffd700 1 -- 172.21.15.22:0/3165474428 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51ac054f00 con 0x7f51b40c83c0 2023-10-08T00:25:03.894 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:03.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5194066f30 msgr2=0x7f51940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5194066f30 0x7f51940693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009eb0 tx=0x7f51a4017000 comp rx=0 tx=0).stop 2023-10-08T00:25:03.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 msgr2=0x7f51b4154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 0x7f51b4154cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00d860 tx=0x7f51ac008040 comp rx=0 tx=0).stop 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 shutdown_connections 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40c83c0 0x7f51b4154cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51b4069d60 0x7f51b40af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5194066f30 0x7f51940693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 --2- 172.21.15.22:0/3165474428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f51b40aca80 0x7f51b40c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 >> 172.21.15.22:0/3165474428 conn(0x7f51b40cd670 msgr2=0x7f51b4068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 shutdown_connections 2023-10-08T00:25:03.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:03.895+0000 7f51b952d700 1 -- 172.21.15.22:0/3165474428 wait complete. 2023-10-08T00:25:03.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:04.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.026+0000 7fd68c858700 1 Processor -- start 2023-10-08T00:25:04.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.026+0000 7fd68c858700 1 -- start start 2023-10-08T00:25:04.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68c858700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd688159890 0x7fd68815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68c858700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd688159c60 0x7fd68815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68c858700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68815a160 con 0x7fd68815db10 2023-10-08T00:25:04.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68c858700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68815df50 con 0x7fd688159890 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68c858700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6880d13a0 con 0x7fd688159c60 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd688159890 0x7fd68815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd688159890 0x7fd68815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60580/0 (socket says 172.21.15.22:60580) 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd68659c700 1 -- 172.21.15.22:0/2420583746 learned_addr learned my addr 172.21.15.22:0/2420583746 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.027+0000 7fd685d9b700 1 --2- 172.21.15.22:0/2420583746 >> v2:172.21.15.192:3300/0 conn(0x7fd688159c60 0x7fd68815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68659c700 1 -- 172.21.15.22:0/2420583746 >> v2:172.21.15.192:3300/0 conn(0x7fd688159c60 msgr2=0x7fd68815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68659c700 1 --2- 172.21.15.22:0/2420583746 >> v2:172.21.15.192:3300/0 conn(0x7fd688159c60 0x7fd68815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68659c700 1 -- 172.21.15.22:0/2420583746 >> v1:172.21.15.192:6789/0 conn(0x7fd68815db10 legacy=0x7fd688069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68659c700 1 -- 172.21.15.22:0/2420583746 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68815e140 con 0x7fd688159890 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68659c700 1 --2- 172.21.15.22:0/2420583746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd68815abd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6880b67f0 tx=0x7fd680009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3ed139d939eae3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68559a700 1 -- 172.21.15.22:0/2420583746 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000e070 con 0x7fd688159890 2023-10-08T00:25:04.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68559a700 1 -- 172.21.15.22:0/2420583746 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68000ba20 con 0x7fd688159890 2023-10-08T00:25:04.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68559a700 1 -- 172.21.15.22:0/2420583746 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800092e0 con 0x7fd688159890 2023-10-08T00:25:04.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68c858700 1 -- 172.21.15.22:0/2420583746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 msgr2=0x7fd68815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68c858700 1 --2- 172.21.15.22:0/2420583746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd68815abd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6880b67f0 tx=0x7fd680009840 comp rx=0 tx=0).stop 2023-10-08T00:25:04.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68c858700 1 -- 172.21.15.22:0/2420583746 shutdown_connections 2023-10-08T00:25:04.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68c858700 1 --2- 172.21.15.22:0/2420583746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd68815abd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68c858700 1 --2- 172.21.15.22:0/2420583746 >> v2:172.21.15.192:3300/0 conn(0x7fd688159c60 0x7fd68815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.028+0000 7fd68c858700 1 -- 172.21.15.22:0/2420583746 >> 172.21.15.22:0/2420583746 conn(0x7fd688068e20 msgr2=0x7fd6880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.029+0000 7fd68c858700 1 -- 172.21.15.22:0/2420583746 shutdown_connections 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.029+0000 7fd68c858700 1 -- 172.21.15.22:0/2420583746 wait complete. 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 Processor -- start 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 -- start start 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd6880c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd688159c60 0x7fd688158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68815db10 0x7fd6880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880b41c0 con 0x7fd688159890 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880b4350 con 0x7fd688159c60 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68c858700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd688158bb0 con 0x7fd68815db10 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd6880c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd6880c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60596/0 (socket says 172.21.15.22:60596) 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.030+0000 7fd68659c700 1 -- 172.21.15.22:0/63510771 learned_addr learned my addr 172.21.15.22:0/63510771 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd685d9b700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd688159c60 0x7fd688158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd686d9d700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68815db10 0x7fd6880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68659c700 1 -- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68815db10 msgr2=0x7fd6880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68659c700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68815db10 0x7fd6880c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68659c700 1 -- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd688159c60 msgr2=0x7fd688158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68659c700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd688159c60 0x7fd688158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68659c700 1 -- 172.21.15.22:0/63510771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680009ae0 con 0x7fd688159890 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd686d9d700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68815db10 0x7fd6880c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68659c700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd6880c8260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b6c0 tx=0x7fd680018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680008a80 con 0x7fd688159890 2023-10-08T00:25:04.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680008c00 con 0x7fd688159890 2023-10-08T00:25:04.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6880c8890 con 0x7fd688159890 2023-10-08T00:25:04.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd680026460 con 0x7fd688159890 2023-10-08T00:25:04.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.031+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6880c8e50 con 0x7fd688159890 2023-10-08T00:25:04.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.032+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68804c3c0 con 0x7fd688159890 2023-10-08T00:25:04.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.032+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd680003040 con 0x7fd688159890 2023-10-08T00:25:04.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.033+0000 7fd67e7fc700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd668066f30 0x7fd6680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.033+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6800862e0 con 0x7fd688159890 2023-10-08T00:25:04.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.033+0000 7fd685d9b700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd668066f30 0x7fd6680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.033+0000 7fd685d9b700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd668066f30 0x7fd6680693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd688063ed0 tx=0x7fd670008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:04.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.037+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd680053600 con 0x7fd688159890 2023-10-08T00:25:04.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.272+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd68806a5b0 con 0x7fd688159890 2023-10-08T00:25:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.273+0000 7fd67e7fc700 1 -- 172.21.15.22:0/63510771 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd680056c20 con 0x7fd688159890 2023-10-08T00:25:04.742 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:04.742 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd668066f30 msgr2=0x7fd6680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd668066f30 0x7fd6680693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd688063ed0 tx=0x7fd670008040 comp rx=0 tx=0).stop 2023-10-08T00:25:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 msgr2=0x7fd6880c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd6880c8260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b6c0 tx=0x7fd680018000 comp rx=0 tx=0).stop 2023-10-08T00:25:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 shutdown_connections 2023-10-08T00:25:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd668066f30 0x7fd6680693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd68815db10 0x7fd6880c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd688159890 0x7fd6880c8260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 --2- 172.21.15.22:0/63510771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd688159c60 0x7fd688158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 >> 172.21.15.22:0/63510771 conn(0x7fd688068e20 msgr2=0x7fd6880c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 shutdown_connections 2023-10-08T00:25:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.275+0000 7fd68c858700 1 -- 172.21.15.22:0/63510771 wait complete. 2023-10-08T00:25:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:04.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.872+0000 7fe67377b700 1 Processor -- start 2023-10-08T00:25:04.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.872+0000 7fe67377b700 1 -- start start 2023-10-08T00:25:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe67377b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe66c069560 0x7fe66c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe67377b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66c069ee0 con 0x7fe66c159c60 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe67377b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66c15a160 con 0x7fe66c159890 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe67377b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c0d13a0 con 0x7fe66c069560 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe671d18700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe66c069560 0x7fe66c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe670d16700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe66c159c60 0x7fe66c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59988/0 (socket says 172.21.15.22:59988) 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe670d16700 1 -- 172.21.15.22:0/2235045001 learned_addr learned my addr 172.21.15.22:0/2235045001 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.873+0000 7fe671d18700 1 --2- 172.21.15.22:0/2235045001 >> v2:172.21.15.22:3300/0 conn(0x7fe66c069560 0x7fe66c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60610/0 (socket says 172.21.15.22:60610) 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe671d18700 1 -- 172.21.15.22:0/2235045001 >> v1:172.21.15.192:6789/0 conn(0x7fe66c159890 legacy=0x7fe66c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe671d18700 1 -- 172.21.15.22:0/2235045001 >> v1:172.21.15.22:6789/0 conn(0x7fe66c159c60 legacy=0x7fe66c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe671d18700 1 -- 172.21.15.22:0/2235045001 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c15e140 con 0x7fe66c069560 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe66bfff700 1 -- 172.21.15.22:0/2235045001 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236072486 0 0) 0x7fe66c069ee0 con 0x7fe66c159c60 2023-10-08T00:25:04.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe671d18700 1 --2- 172.21.15.22:0/2235045001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c0699a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6640098e0 tx=0x7fe6640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9d427214774195 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe66bfff700 1 -- 172.21.15.22:0/2235045001 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664009e80 con 0x7fe66c069560 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe66bfff700 1 -- 172.21.15.22:0/2235045001 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400b860 con 0x7fe66c069560 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe66bfff700 1 -- 172.21.15.22:0/2235045001 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400bbe0 con 0x7fe66c069560 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe67377b700 1 -- 172.21.15.22:0/2235045001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 msgr2=0x7fe66c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.874+0000 7fe67377b700 1 --2- 172.21.15.22:0/2235045001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c0699a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe6640098e0 tx=0x7fe6640091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.875+0000 7fe67377b700 1 -- 172.21.15.22:0/2235045001 shutdown_connections 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.875+0000 7fe67377b700 1 --2- 172.21.15.22:0/2235045001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c0699a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.875+0000 7fe67377b700 1 -- 172.21.15.22:0/2235045001 >> 172.21.15.22:0/2235045001 conn(0x7fe66c068e20 msgr2=0x7fe66c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.875+0000 7fe67377b700 1 -- 172.21.15.22:0/2235045001 shutdown_connections 2023-10-08T00:25:04.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.875+0000 7fe67377b700 1 -- 172.21.15.22:0/2235045001 wait complete. 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.876+0000 7fe67377b700 1 Processor -- start 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.876+0000 7fe67377b700 1 -- start start 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe66c159890 0x7fe66c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66c159c60 0x7fe66c15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c0ca2f0 con 0x7fe66c069560 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c15c240 con 0x7fe66c159c60 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c154920 con 0x7fe66c159890 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c1543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60612/0 (socket says 172.21.15.22:60612) 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 -- 172.21.15.22:0/3938887452 learned_addr learned my addr 172.21.15.22:0/3938887452 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe670d16700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe66c159890 0x7fe66c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671d18700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66c159c60 0x7fe66c15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 -- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe66c159890 msgr2=0x7fe66c15c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe66c159890 0x7fe66c15c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 -- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66c159c60 msgr2=0x7fe66c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66c159c60 0x7fe66c15d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 -- 172.21.15.22:0/3938887452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664009420 con 0x7fe66c069560 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671d18700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66c159c60 0x7fe66c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe671517700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c1543e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00cb40 tx=0x7fe65c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00a7a0 con 0x7fe66c069560 2023-10-08T00:25:04.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00a920 con 0x7fe66c069560 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c15b670 con 0x7fe66c069560 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00ace0 con 0x7fe66c069560 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.877+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c15bc70 con 0x7fe66c069560 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.878+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c15bff0 con 0x7fe66c069560 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.879+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe65c003030 con 0x7fe66c069560 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.879+0000 7fe6697fa700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe658066f30 0x7fe6580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:04.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.879+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe65c084660 con 0x7fe66c069560 2023-10-08T00:25:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.879+0000 7fe670d16700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe658066f30 0x7fe6580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:04.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.880+0000 7fe670d16700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe658066f30 0x7fe6580693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe660000c00 tx=0x7fe660009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:04.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:04.883+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe65c051980 con 0x7fe66c069560 2023-10-08T00:25:05.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.077+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe66c04c3c0 con 0x7fe66c069560 2023-10-08T00:25:05.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.078+0000 7fe6697fa700 1 -- 172.21.15.22:0/3938887452 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe65c054fa0 con 0x7fe66c069560 2023-10-08T00:25:05.078 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:05.078 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.079+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe658066f30 msgr2=0x7fe6580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.079+0000 7fe67377b700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe658066f30 0x7fe6580693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe660000c00 tx=0x7fe660009040 comp rx=0 tx=0).stop 2023-10-08T00:25:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.079+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 msgr2=0x7fe66c1543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.079+0000 7fe67377b700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c1543e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00cb40 tx=0x7fe65c0017b0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 shutdown_connections 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66c159c60 0x7fe66c15d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe66c069560 0x7fe66c1543e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe658066f30 0x7fe6580693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 --2- 172.21.15.22:0/3938887452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe66c159890 0x7fe66c15c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 >> 172.21.15.22:0/3938887452 conn(0x7fe66c068e20 msgr2=0x7fe66c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 shutdown_connections 2023-10-08T00:25:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.080+0000 7fe67377b700 1 -- 172.21.15.22:0/3938887452 wait complete. 2023-10-08T00:25:05.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:05.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:05.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.217+0000 7f9f35894700 1 Processor -- start 2023-10-08T00:25:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.217+0000 7f9f35894700 1 -- start start 2023-10-08T00:25:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f35894700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f300b4e70 0x7f9f300ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f35894700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b16d0 0x7f9f300b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f35894700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300b2080 con 0x7f9f3015d240 2023-10-08T00:25:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f35894700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f300cfb00 con 0x7f9f300b4e70 2023-10-08T00:25:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f35894700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300b5c40 con 0x7f9f300b16d0 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f300b4e70 0x7f9f300ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f300b4e70 0x7f9f300ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60622/0 (socket says 172.21.15.22:60622) 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 -- 172.21.15.22:0/880084671 learned_addr learned my addr 172.21.15.22:0/880084671 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f2ffff700 1 --2- 172.21.15.22:0/880084671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b16d0 0x7f9f300b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 -- 172.21.15.22:0/880084671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b16d0 msgr2=0x7f9f300b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 --2- 172.21.15.22:0/880084671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b16d0 0x7f9f300b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 -- 172.21.15.22:0/880084671 >> v1:172.21.15.192:6789/0 conn(0x7f9f3015d240 legacy=0x7f9f3015d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 -- 172.21.15.22:0/880084671 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300b5f20 con 0x7f9f300b4e70 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f34892700 1 --2- 172.21.15.22:0/880084671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b4e70 0x7f9f300ccff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9f240099b0 tx=0x7f9f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947fc41c4e4ba99b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.218+0000 7f9f2f7fe700 1 -- 172.21.15.22:0/880084671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400b860 con 0x7f9f300b4e70 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f2f7fe700 1 -- 172.21.15.22:0/880084671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2400b9c0 con 0x7f9f300b4e70 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f2f7fe700 1 -- 172.21.15.22:0/880084671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400bd60 con 0x7f9f300b4e70 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 -- 172.21.15.22:0/880084671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b4e70 msgr2=0x7f9f300ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 --2- 172.21.15.22:0/880084671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b4e70 0x7f9f300ccff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9f240099b0 tx=0x7f9f24009250 comp rx=0 tx=0).stop 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 -- 172.21.15.22:0/880084671 shutdown_connections 2023-10-08T00:25:05.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 --2- 172.21.15.22:0/880084671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b4e70 0x7f9f300ccff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 --2- 172.21.15.22:0/880084671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b16d0 0x7f9f300b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 -- 172.21.15.22:0/880084671 >> 172.21.15.22:0/880084671 conn(0x7f9f300d10c0 msgr2=0x7f9f300affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:05.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 -- 172.21.15.22:0/880084671 shutdown_connections 2023-10-08T00:25:05.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.219+0000 7f9f35894700 1 -- 172.21.15.22:0/880084671 wait complete. 2023-10-08T00:25:05.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.220+0000 7f9f35894700 1 Processor -- start 2023-10-08T00:25:05.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.220+0000 7f9f35894700 1 -- start start 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35894700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 0x7f9f30157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35894700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b4e70 0x7f9f30158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35894700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3015d240 0x7f9f300c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35894700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3016a0c0 con 0x7f9f300b16d0 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35894700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f30169ae0 con 0x7f9f3015d240 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35894700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c6c90 con 0x7f9f300b4e70 2023-10-08T00:25:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f34892700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 0x7f9f30157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f34892700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 0x7f9f30157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60624/0 (socket says 172.21.15.22:60624) 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f34892700 1 -- 172.21.15.22:0/2000367614 learned_addr learned my addr 172.21.15.22:0/2000367614 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f2ffff700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b4e70 0x7f9f30158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f35093700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3015d240 0x7f9f300c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.221+0000 7f9f34892700 1 -- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b4e70 msgr2=0x7f9f30158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f34892700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b4e70 0x7f9f30158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f34892700 1 -- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3015d240 msgr2=0x7f9f300c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f34892700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3015d240 0x7f9f300c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f34892700 1 -- 172.21.15.22:0/2000367614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240094f0 con 0x7f9f300b16d0 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f35093700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3015d240 0x7f9f300c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f34892700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 0x7f9f30157e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f24006fd0 tx=0x7f9f24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2401a420 con 0x7f9f300b16d0 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2401a5a0 con 0x7f9f300b16d0 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f300c6f70 con 0x7f9f300b16d0 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2401a960 con 0x7f9f300b16d0 2023-10-08T00:25:05.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.222+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f30169d50 con 0x7f9f300b16d0 2023-10-08T00:25:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.223+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f30088990 con 0x7f9f300b16d0 2023-10-08T00:25:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.223+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f2401ad10 con 0x7f9f300b16d0 2023-10-08T00:25:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.224+0000 7f9f2cff9700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f14066f30 0x7f9f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.224+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f24085f90 con 0x7f9f300b16d0 2023-10-08T00:25:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.224+0000 7f9f2ffff700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f14066f30 0x7f9f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.224+0000 7f9f2ffff700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f14066f30 0x7f9f140693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f3016d0a0 tx=0x7f9f1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.228+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f24053160 con 0x7f9f300b16d0 2023-10-08T00:25:05.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.419+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f3015cf60 con 0x7f9f300b16d0 2023-10-08T00:25:05.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.420+0000 7f9f2cff9700 1 -- 172.21.15.22:0/2000367614 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f24056780 con 0x7f9f300b16d0 2023-10-08T00:25:05.421 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f14066f30 msgr2=0x7f9f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f14066f30 0x7f9f140693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9f3016d0a0 tx=0x7f9f1c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 msgr2=0x7f9f30157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 0x7f9f30157e00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f24006fd0 tx=0x7f9f24017000 comp rx=0 tx=0).stop 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 shutdown_connections 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3015d240 0x7f9f300c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f300b16d0 0x7f9f30157e00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f14066f30 0x7f9f140693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 --2- 172.21.15.22:0/2000367614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f300b4e70 0x7f9f30158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 >> 172.21.15.22:0/2000367614 conn(0x7f9f300d10c0 msgr2=0x7f9f30158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 shutdown_connections 2023-10-08T00:25:05.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.422+0000 7f9f35894700 1 -- 172.21.15.22:0/2000367614 wait complete. 2023-10-08T00:25:05.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:05.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.557+0000 7f10a6db5700 1 Processor -- start 2023-10-08T00:25:05.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.557+0000 7f10a6db5700 1 -- start start 2023-10-08T00:25:05.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a6db5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a6db5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10a00b33b0 0x7f10a00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a6db5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00b2080 con 0x7f10a00b4e70 2023-10-08T00:25:05.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a6db5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00cfb00 con 0x7f10a00b33b0 2023-10-08T00:25:05.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a6db5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00b5c40 con 0x7f10a00b16d0 2023-10-08T00:25:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10a00b33b0 0x7f10a00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10a00b33b0 0x7f10a00b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60630/0 (socket says 172.21.15.22:60630) 2023-10-08T00:25:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 -- 172.21.15.22:0/2679911960 learned_addr learned my addr 172.21.15.22:0/2679911960 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a55b2700 1 --2- 172.21.15.22:0/2679911960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 -- 172.21.15.22:0/2679911960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 msgr2=0x7f10a00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 --2- 172.21.15.22:0/2679911960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 -- 172.21.15.22:0/2679911960 >> v1:172.21.15.192:6789/0 conn(0x7f10a00b4e70 legacy=0x7f10a00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.558+0000 7f10a65b4700 1 -- 172.21.15.22:0/2679911960 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00b5f20 con 0x7f10a00b33b0 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a65b4700 1 --2- 172.21.15.22:0/2679911960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a00b3830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1090009f20 tx=0x7f1090009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55917a90adc6ff49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a4db1700 1 -- 172.21.15.22:0/2679911960 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000e070 con 0x7f10a00b33b0 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a4db1700 1 -- 172.21.15.22:0/2679911960 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109000b9d0 con 0x7f10a00b33b0 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a4db1700 1 -- 172.21.15.22:0/2679911960 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10900092e0 con 0x7f10a00b33b0 2023-10-08T00:25:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 -- 172.21.15.22:0/2679911960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 msgr2=0x7f10a00b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 --2- 172.21.15.22:0/2679911960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a00b3830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1090009f20 tx=0x7f1090009840 comp rx=0 tx=0).stop 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 -- 172.21.15.22:0/2679911960 shutdown_connections 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 --2- 172.21.15.22:0/2679911960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a00b3830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 --2- 172.21.15.22:0/2679911960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 -- 172.21.15.22:0/2679911960 >> 172.21.15.22:0/2679911960 conn(0x7f10a00d10c0 msgr2=0x7f10a00affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 -- 172.21.15.22:0/2679911960 shutdown_connections 2023-10-08T00:25:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.559+0000 7f10a6db5700 1 -- 172.21.15.22:0/2679911960 wait complete. 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.560+0000 7f10a6db5700 1 Processor -- start 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 -- start start 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a015e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a016d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a00b4e70 0x7f10a016d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00c7e00 con 0x7f10a00b33b0 2023-10-08T00:25:05.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00c80e0 con 0x7f10a00b4e70 2023-10-08T00:25:05.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a6db5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00c83c0 con 0x7f10a00b16d0 2023-10-08T00:25:05.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a55b2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a016d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a55b2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a016d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60644/0 (socket says 172.21.15.22:60644) 2023-10-08T00:25:05.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a55b2700 1 -- 172.21.15.22:0/1085934051 learned_addr learned my addr 172.21.15.22:0/1085934051 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:05.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a5db3700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a015e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.561+0000 7f10a65b4700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a00b4e70 0x7f10a016d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a55b2700 1 -- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 msgr2=0x7f10a015e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a55b2700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a015e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a55b2700 1 -- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a00b4e70 msgr2=0x7f10a016d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a55b2700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a00b4e70 0x7f10a016d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a55b2700 1 -- 172.21.15.22:0/1085934051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090009ae0 con 0x7f10a00b33b0 2023-10-08T00:25:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a55b2700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a016d310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f109400ec80 tx=0x7f10940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400c850 con 0x7f10a00b33b0 2023-10-08T00:25:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109400c9b0 con 0x7f10a00b33b0 2023-10-08T00:25:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a00c86a0 con 0x7f10a00b33b0 2023-10-08T00:25:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400cd50 con 0x7f10a00b33b0 2023-10-08T00:25:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.562+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a015eb80 con 0x7f10a00b33b0 2023-10-08T00:25:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.563+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0088990 con 0x7f10a00b33b0 2023-10-08T00:25:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.564+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1094013680 con 0x7f10a00b33b0 2023-10-08T00:25:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.564+0000 7f109dffb700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f108c066f30 0x7f108c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.564+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10940847d0 con 0x7f10a00b33b0 2023-10-08T00:25:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.564+0000 7f10a5db3700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f108c066f30 0x7f108c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.565+0000 7f10a5db3700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f108c066f30 0x7f108c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10980039e0 tx=0x7f1098007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.569+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10940519a0 con 0x7f10a00b33b0 2023-10-08T00:25:05.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.761+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10a004bb80 con 0x7f10a00b33b0 2023-10-08T00:25:05.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.761+0000 7f109dffb700 1 -- 172.21.15.22:0/1085934051 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1094054fc0 con 0x7f10a00b33b0 2023-10-08T00:25:05.762 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:05.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f108c066f30 msgr2=0x7f108c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f108c066f30 0x7f108c0693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10980039e0 tx=0x7f1098007ec0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 msgr2=0x7f10a016d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a016d310 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f109400ec80 tx=0x7f10940091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 shutdown_connections 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a00b4e70 0x7f10a016d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f108c066f30 0x7f108c0693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10a00b16d0 0x7f10a015e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 --2- 172.21.15.22:0/1085934051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a00b33b0 0x7f10a016d310 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 >> 172.21.15.22:0/1085934051 conn(0x7f10a00d10c0 msgr2=0x7f10a0158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:05.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 shutdown_connections 2023-10-08T00:25:05.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.763+0000 7f10a6db5700 1 -- 172.21.15.22:0/1085934051 wait complete. 2023-10-08T00:25:05.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:05.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.900+0000 7f69661f4700 1 Processor -- start 2023-10-08T00:25:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.900+0000 7f69661f4700 1 -- start start 2023-10-08T00:25:05.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f69661f4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6960159890 0x7f696015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f69661f4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6960069560 0x7f69600699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f69661f4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6960069ee0 con 0x7f6960159c60 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f69661f4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696015a160 con 0x7f6960159890 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f69661f4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69600d13a0 con 0x7f6960069560 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6960159890 0x7f696015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6960159890 0x7f696015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60656/0 (socket says 172.21.15.22:60656) 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 -- 172.21.15.22:0/2291565766 learned_addr learned my addr 172.21.15.22:0/2291565766 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:05.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695ffff700 1 --2- 172.21.15.22:0/2291565766 >> v2:172.21.15.192:3300/0 conn(0x7f6960069560 0x7f69600699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 -- 172.21.15.22:0/2291565766 >> v2:172.21.15.192:3300/0 conn(0x7f6960069560 msgr2=0x7f69600699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 --2- 172.21.15.22:0/2291565766 >> v2:172.21.15.192:3300/0 conn(0x7f6960069560 0x7f69600699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 -- 172.21.15.22:0/2291565766 >> v1:172.21.15.192:6789/0 conn(0x7f6960159c60 legacy=0x7f696015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 -- 172.21.15.22:0/2291565766 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696015e140 con 0x7f6960159890 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.901+0000 7f695f7fe700 1 --2- 172.21.15.22:0/2291565766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159890 0x7f696015abd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f696006a890 tx=0x7f6950009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00e20849ec0100 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f695e7fc700 1 -- 172.21.15.22:0/2291565766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000b860 con 0x7f6960159890 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f695e7fc700 1 -- 172.21.15.22:0/2291565766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695000b9c0 con 0x7f6960159890 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f695e7fc700 1 -- 172.21.15.22:0/2291565766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695000bd60 con 0x7f6960159890 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 -- 172.21.15.22:0/2291565766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159890 msgr2=0x7f696015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 --2- 172.21.15.22:0/2291565766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159890 0x7f696015abd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f696006a890 tx=0x7f6950009250 comp rx=0 tx=0).stop 2023-10-08T00:25:05.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 -- 172.21.15.22:0/2291565766 shutdown_connections 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 --2- 172.21.15.22:0/2291565766 >> v2:172.21.15.192:3300/0 conn(0x7f6960069560 0x7f69600699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 --2- 172.21.15.22:0/2291565766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159890 0x7f696015abd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 -- 172.21.15.22:0/2291565766 >> 172.21.15.22:0/2291565766 conn(0x7f6960068e20 msgr2=0x7f69600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 -- 172.21.15.22:0/2291565766 shutdown_connections 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.902+0000 7f69661f4700 1 -- 172.21.15.22:0/2291565766 wait complete. 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.903+0000 7f69661f4700 1 Processor -- start 2023-10-08T00:25:05.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.903+0000 7f69661f4700 1 -- start start 2023-10-08T00:25:05.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f69661f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6960069560 0x7f69600b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f69661f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6960159890 0x7f69600c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f69661f4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 0x7f6960152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f69661f4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600b36c0 con 0x7f6960159c60 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f69661f4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600c87a0 con 0x7f6960069560 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f69661f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69600c8a70 con 0x7f6960159890 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f695ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 0x7f6960152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f695ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 0x7f6960152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60664/0 (socket says 172.21.15.22:60664) 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f695ffff700 1 -- 172.21.15.22:0/1466134668 learned_addr learned my addr 172.21.15.22:0/1466134668 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f695f7fe700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6960069560 0x7f69600b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.904+0000 7f695effd700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6960159890 0x7f69600c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f695ffff700 1 -- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6960159890 msgr2=0x7f69600c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f695ffff700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6960159890 0x7f69600c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f695ffff700 1 -- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6960069560 msgr2=0x7f69600b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f695ffff700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6960069560 0x7f69600b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f695ffff700 1 -- 172.21.15.22:0/1466134668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500094f0 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f695ffff700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 0x7f6960152430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6958009fa0 tx=0x7f6958009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695800ebc0 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695800ed20 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69600c8d50 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958014670 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.905+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69600c9310 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.906+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69600b3870 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.906+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69580149e0 con 0x7f6960159c60 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.907+0000 7f69477fe700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f694c066f30 0x7f694c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:05.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.907+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6958084ba0 con 0x7f6960159c60 2023-10-08T00:25:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.907+0000 7f695f7fe700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f694c066f30 0x7f694c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:05.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.907+0000 7f695f7fe700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f694c066f30 0x7f694c0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f696006a890 tx=0x7f6950017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:05.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:05.911+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6958051e10 con 0x7f6960159c60 2023-10-08T00:25:06.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.106+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f696004c3c0 con 0x7f6960159c60 2023-10-08T00:25:06.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.107+0000 7f69477fe700 1 -- 172.21.15.22:0/1466134668 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6958055430 con 0x7f6960159c60 2023-10-08T00:25:06.107 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f694c066f30 msgr2=0x7f694c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f694c066f30 0x7f694c0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f696006a890 tx=0x7f6950017000 comp rx=0 tx=0).stop 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 msgr2=0x7f6960152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 0x7f6960152430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6958009fa0 tx=0x7f6958009900 comp rx=0 tx=0).stop 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 shutdown_connections 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6960159c60 0x7f6960152430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6960069560 0x7f69600b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f694c066f30 0x7f694c0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 --2- 172.21.15.22:0/1466134668 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6960159890 0x7f69600c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 >> 172.21.15.22:0/1466134668 conn(0x7f6960068e20 msgr2=0x7f6960153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 shutdown_connections 2023-10-08T00:25:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.109+0000 7f69661f4700 1 -- 172.21.15.22:0/1466134668 wait complete. 2023-10-08T00:25:06.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.240+0000 7fd1cac3f700 1 Processor -- start 2023-10-08T00:25:06.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.240+0000 7fd1cac3f700 1 -- start start 2023-10-08T00:25:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.240+0000 7fd1cac3f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1c4159890 0x7fd1c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.240+0000 7fd1cac3f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c415a160 con 0x7fd1c4159c60 2023-10-08T00:25:06.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.240+0000 7fd1cac3f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40d13a0 con 0x7fd1c4069560 2023-10-08T00:25:06.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.240+0000 7fd1cac3f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c415e140 con 0x7fd1c4159890 2023-10-08T00:25:06.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c89db700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1c4159890 0x7fd1c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd1c4159c60 0x7fd1c415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59994/0 (socket says 172.21.15.22:59994) 2023-10-08T00:25:06.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c89db700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1c4159890 0x7fd1c415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60678/0 (socket says 172.21.15.22:60678) 2023-10-08T00:25:06.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c3fff700 1 -- 172.21.15.22:0/352371672 learned_addr learned my addr 172.21.15.22:0/352371672 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:06.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c89db700 1 -- 172.21.15.22:0/352371672 >> v1:172.21.15.192:6789/0 conn(0x7fd1c4069560 legacy=0x7fd1c40ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c89db700 1 -- 172.21.15.22:0/352371672 >> v1:172.21.15.22:6789/0 conn(0x7fd1c4159c60 legacy=0x7fd1c415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c89db700 1 -- 172.21.15.22:0/352371672 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c415a3d0 con 0x7fd1c4159890 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c89db700 1 --2- 172.21.15.22:0/352371672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159890 0x7fd1c415abd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009e60 tx=0x7fd1bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8348ee6d451904b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c37fe700 1 -- 172.21.15.22:0/352371672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00e070 con 0x7fd1c4159890 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c37fe700 1 -- 172.21.15.22:0/352371672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00bc30 con 0x7fd1c4159890 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.241+0000 7fd1c37fe700 1 -- 172.21.15.22:0/352371672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc012430 con 0x7fd1c4159890 2023-10-08T00:25:06.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 -- 172.21.15.22:0/352371672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159890 msgr2=0x7fd1c415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/352371672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159890 0x7fd1c415abd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009e60 tx=0x7fd1bc009780 comp rx=0 tx=0).stop 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 -- 172.21.15.22:0/352371672 shutdown_connections 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/352371672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159890 0x7fd1c415abd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 -- 172.21.15.22:0/352371672 >> 172.21.15.22:0/352371672 conn(0x7fd1c4068e20 msgr2=0x7fd1c40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 -- 172.21.15.22:0/352371672 shutdown_connections 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.242+0000 7fd1cac3f700 1 -- 172.21.15.22:0/352371672 wait complete. 2023-10-08T00:25:06.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.243+0000 7fd1cac3f700 1 Processor -- start 2023-10-08T00:25:06.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.243+0000 7fd1cac3f700 1 -- start start 2023-10-08T00:25:06.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1cac3f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1c4069560 0x7fd1c415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1cac3f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1c4159890 0x7fd1c40ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1cac3f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 0x7fd1c414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1cac3f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c415c820 con 0x7fd1c4159c60 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1cac3f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c415bc10 con 0x7fd1c4159890 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1cac3f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c415bef0 con 0x7fd1c4069560 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 0x7fd1c414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 0x7fd1c414cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60690/0 (socket says 172.21.15.22:60690) 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 -- 172.21.15.22:0/2047657173 learned_addr learned my addr 172.21.15.22:0/2047657173 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:06.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c3fff700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1c4159890 0x7fd1c40ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c89db700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1c4069560 0x7fd1c415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 -- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1c4069560 msgr2=0x7fd1c415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1c4069560 0x7fd1c415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 -- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1c4159890 msgr2=0x7fd1c40ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1c4159890 0x7fd1c40ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c91dc700 1 -- 172.21.15.22:0/2047657173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009a20 con 0x7fd1c4159c60 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.244+0000 7fd1c3fff700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1c4159890 0x7fd1c40ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:06.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.245+0000 7fd1c91dc700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 0x7fd1c414cd30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c560 tx=0x7fd1ac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.245+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011590 con 0x7fd1c4159c60 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.245+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0116f0 con 0x7fd1c4159c60 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.245+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c415c1d0 con 0x7fd1c4159c60 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.245+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac011ab0 con 0x7fd1c4159c60 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.245+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c415dcc0 con 0x7fd1c4159c60 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.246+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c415dee0 con 0x7fd1c4159c60 2023-10-08T00:25:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.246+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1ac01b3b0 con 0x7fd1c4159c60 2023-10-08T00:25:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.247+0000 7fd1c0ff9700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1a4066f30 0x7fd1a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.247+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1ac083a50 con 0x7fd1c4159c60 2023-10-08T00:25:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.247+0000 7fd1c89db700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1a4066f30 0x7fd1a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.247+0000 7fd1c89db700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1a4066f30 0x7fd1a40693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009e60 tx=0x7fd1bc019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.251+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1ac050cc0 con 0x7fd1c4159c60 2023-10-08T00:25:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.487+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1c404c3c0 con 0x7fd1c4159c60 2023-10-08T00:25:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.487+0000 7fd1c0ff9700 1 -- 172.21.15.22:0/2047657173 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd1ac017070 con 0x7fd1c4159c60 2023-10-08T00:25:06.488 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:06.488 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1a4066f30 msgr2=0x7fd1a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1a4066f30 0x7fd1a40693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009e60 tx=0x7fd1bc019000 comp rx=0 tx=0).stop 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 msgr2=0x7fd1c414cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 0x7fd1c414cd30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00c560 tx=0x7fd1ac007ef0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 shutdown_connections 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1c4159c60 0x7fd1c414cd30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1a4066f30 0x7fd1a40693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1c4069560 0x7fd1c415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 --2- 172.21.15.22:0/2047657173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1c4159890 0x7fd1c40ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 >> 172.21.15.22:0/2047657173 conn(0x7fd1c4068e20 msgr2=0x7fd1c40cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 shutdown_connections 2023-10-08T00:25:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.489+0000 7fd1cac3f700 1 -- 172.21.15.22:0/2047657173 wait complete. 2023-10-08T00:25:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:06.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:06.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.620+0000 7fbbc5f57700 1 Processor -- start 2023-10-08T00:25:06.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.620+0000 7fbbc5f57700 1 -- start start 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.621+0000 7fbbc5f57700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.621+0000 7fbbc5f57700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbbc0069560 0x7fbbc00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.621+0000 7fbbc5f57700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc015a160 con 0x7fbbc0159c60 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.621+0000 7fbbc5f57700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc0069f20 con 0x7fbbc0069560 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.621+0000 7fbbc5f57700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00d13a0 con 0x7fbbc0159890 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbbc0069560 0x7fbbc00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbf7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbeffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbbc0159c60 0x7fbbc015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34628/0 (socket says 172.21.15.22:34628) 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbeffd700 1 -- 172.21.15.22:0/1736381696 learned_addr learned my addr 172.21.15.22:0/1736381696 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:06.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbe7fc700 1 -- 172.21.15.22:0/1736381696 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887485904 0 0) 0x7fbbc015a160 con 0x7fbbc0159c60 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbe7fc700 1 -- 172.21.15.22:0/1736381696 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba8003570 con 0x7fbbc0159c60 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbffff700 1 -- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 msgr2=0x7fbbc015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbffff700 1 --2- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbffff700 1 -- 172.21.15.22:0/1736381696 >> v1:172.21.15.192:6789/0 conn(0x7fbbc0159c60 legacy=0x7fbbc015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbffff700 1 -- 172.21.15.22:0/1736381696 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc015e140 con 0x7fbbc0069560 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbf7fe700 1 --2- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbffff700 1 --2- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc00699e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009e60 tx=0x7fbbb8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1c0f5871f6ed823 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbe7fc700 1 -- 172.21.15.22:0/1736381696 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800e070 con 0x7fbbc0069560 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbe7fc700 1 -- 172.21.15.22:0/1736381696 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb800bab0 con 0x7fbbc0069560 2023-10-08T00:25:06.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.622+0000 7fbbbe7fc700 1 -- 172.21.15.22:0/1736381696 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800be70 con 0x7fbbc0069560 2023-10-08T00:25:06.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 msgr2=0x7fbbc00699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc00699e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009e60 tx=0x7fbbb8009780 comp rx=0 tx=0).stop 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1736381696 shutdown_connections 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc00699e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1736381696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1736381696 >> 172.21.15.22:0/1736381696 conn(0x7fbbc0068e20 msgr2=0x7fbbc00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1736381696 shutdown_connections 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.623+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1736381696 wait complete. 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.624+0000 7fbbc5f57700 1 Processor -- start 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.624+0000 7fbbc5f57700 1 -- start start 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbc5f57700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc015d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbc5f57700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbc5f57700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 0x7fbbc01697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbc5f57700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00cdba0 con 0x7fbbc0159c60 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbc5f57700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00b6380 con 0x7fbbc0069560 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbc5f57700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01558c0 con 0x7fbbc0159890 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 0x7fbbc01697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 0x7fbbc01697d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60706/0 (socket says 172.21.15.22:60706) 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 -- 172.21.15.22:0/1273076135 learned_addr learned my addr 172.21.15.22:0/1273076135 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbeffd700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbf7fe700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 -- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 msgr2=0x7fbbc00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 -- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 msgr2=0x7fbbc015d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc015d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 -- 172.21.15.22:0/1273076135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0009420 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.625+0000 7fbbbffff700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 0x7fbbc01697d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800b610 tx=0x7fbbb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.626+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8012dd0 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.626+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8027470 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.626+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb8009a20 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.626+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8027830 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.626+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc00b3f80 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.627+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc00cdd10 con 0x7fbbc0159c60 2023-10-08T00:25:06.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.627+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbb8024070 con 0x7fbbc0159c60 2023-10-08T00:25:06.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.627+0000 7fbba77fe700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.627+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbb8086e70 con 0x7fbbc0159c60 2023-10-08T00:25:06.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.627+0000 7fbbbf7fe700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.628+0000 7fbbbf7fe700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009f40 tx=0x7fbbb00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.631+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbc00cdd10 con 0x7fbbc0159c60 2023-10-08T00:25:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.828+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbc00cdd10 con 0x7fbbc0159c60 2023-10-08T00:25:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.828+0000 7fbba77fe700 1 -- 172.21.15.22:0/1273076135 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fbbc00cdd10 con 0x7fbbc0159c60 2023-10-08T00:25:06.829 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:06.829 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbbac066f30 msgr2=0x7fbbac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbbac066f30 0x7fbbac0693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0009f40 tx=0x7fbbb00091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 msgr2=0x7fbbc01697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 0x7fbbc01697d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800b610 tx=0x7fbbb8019000 comp rx=0 tx=0).stop 2023-10-08T00:25:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 shutdown_connections 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbbc0159c60 0x7fbbc01697d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbc0069560 0x7fbbc015d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbbac066f30 0x7fbbac0693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 --2- 172.21.15.22:0/1273076135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbbc0159890 0x7fbbc00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.830+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 >> 172.21.15.22:0/1273076135 conn(0x7fbbc0068e20 msgr2=0x7fbbc00b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.831+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 shutdown_connections 2023-10-08T00:25:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.831+0000 7fbbc5f57700 1 -- 172.21.15.22:0/1273076135 wait complete. 2023-10-08T00:25:06.843 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:06.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.961+0000 7f8d723fd700 1 Processor -- start 2023-10-08T00:25:06.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.961+0000 7f8d723fd700 1 -- start start 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d723fd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c159420 0x7f8d6c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d723fd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d6c1597f0 0x7f8d6c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d723fd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c0b11d0 con 0x7f8d6c15d230 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d723fd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0b14b0 con 0x7f8d6c159420 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d723fd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0b1790 con 0x7f8d6c1597f0 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d713fb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d6c159420 0x7f8d6c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d71bfc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8d6c15d230 0x7f8d6c15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37390/0 (socket says 172.21.15.22:37390) 2023-10-08T00:25:06.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d71bfc700 1 -- 172.21.15.22:0/3907328257 learned_addr learned my addr 172.21.15.22:0/3907328257 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d70bfa700 1 --2- 172.21.15.22:0/3907328257 >> v2:172.21.15.192:3300/0 conn(0x7f8d6c1597f0 0x7f8d6c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d713fb700 1 -- 172.21.15.22:0/3907328257 >> v2:172.21.15.192:3300/0 conn(0x7f8d6c1597f0 msgr2=0x7f8d6c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d713fb700 1 --2- 172.21.15.22:0/3907328257 >> v2:172.21.15.192:3300/0 conn(0x7f8d6c1597f0 0x7f8d6c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.962+0000 7f8d713fb700 1 -- 172.21.15.22:0/3907328257 >> v1:172.21.15.22:6789/0 conn(0x7f8d6c15d230 legacy=0x7f8d6c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d713fb700 1 -- 172.21.15.22:0/3907328257 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0b1a70 con 0x7f8d6c159420 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d6bfff700 1 -- 172.21.15.22:0/3907328257 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45435879 0 0) 0x7f8d6c0b11d0 con 0x7f8d6c15d230 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d70bfa700 1 --2- 172.21.15.22:0/3907328257 >> v2:172.21.15.192:3300/0 conn(0x7f8d6c1597f0 0x7f8d6c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d713fb700 1 --2- 172.21.15.22:0/3907328257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0b5f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c089750 tx=0x7f8d640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1925d8a5a2ffeef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d6bfff700 1 -- 172.21.15.22:0/3907328257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400b6b0 con 0x7f8d6c159420 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d6bfff700 1 -- 172.21.15.22:0/3907328257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400b810 con 0x7f8d6c159420 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d6bfff700 1 -- 172.21.15.22:0/3907328257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400bbb0 con 0x7f8d6c159420 2023-10-08T00:25:06.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d723fd700 1 -- 172.21.15.22:0/3907328257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 msgr2=0x7f8d6c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3907328257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0b5f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c089750 tx=0x7f8d640091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d723fd700 1 -- 172.21.15.22:0/3907328257 shutdown_connections 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3907328257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0b5f40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3907328257 >> v2:172.21.15.192:3300/0 conn(0x7f8d6c1597f0 0x7f8d6c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.963+0000 7f8d723fd700 1 -- 172.21.15.22:0/3907328257 >> 172.21.15.22:0/3907328257 conn(0x7f8d6c0d0660 msgr2=0x7f8d6c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.964+0000 7f8d723fd700 1 -- 172.21.15.22:0/3907328257 shutdown_connections 2023-10-08T00:25:06.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.964+0000 7f8d723fd700 1 -- 172.21.15.22:0/3907328257 wait complete. 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.965+0000 7f8d723fd700 1 Processor -- start 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.965+0000 7f8d723fd700 1 -- start start 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d6c1597f0 0x7f8d6c16a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c15d230 0x7f8d6c156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c16add0 con 0x7f8d6c159420 2023-10-08T00:25:06.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c156a50 con 0x7f8d6c15d230 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0c5cb0 con 0x7f8d6c1597f0 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49430/0 (socket says 172.21.15.22:49430) 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 -- 172.21.15.22:0/3188967548 learned_addr learned my addr 172.21.15.22:0/3188967548 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d70bfa700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d6c1597f0 0x7f8d6c16a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d71bfc700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c15d230 0x7f8d6c156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 -- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d6c1597f0 msgr2=0x7f8d6c16a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d6c1597f0 0x7f8d6c16a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 -- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c15d230 msgr2=0x7f8d6c156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c15d230 0x7f8d6c156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:06.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 -- 172.21.15.22:0/3188967548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009420 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d70bfa700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d6c1597f0 0x7f8d6c16a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d713fb700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0c56d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d640091e0 tx=0x7f8d64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400bb50 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64011630 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640119f0 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c0c5f90 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.966+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c0c6550 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.967+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c04c3c0 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.968+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d640253f0 con 0x7f8d6c159420 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.968+0000 7f8d697fa700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:06.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.968+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8d64086090 con 0x7f8d6c159420 2023-10-08T00:25:06.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.968+0000 7f8d70bfa700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:06.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.969+0000 7f8d70bfa700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d58066f30 0x7f8d580693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0c9e60 tx=0x7f8d60006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:06.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:06.972+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d64053300 con 0x7f8d6c159420 2023-10-08T00:25:07.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.210+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d6c0b1d50 con 0x7f8d6c159420 2023-10-08T00:25:07.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.210+0000 7f8d697fa700 1 -- 172.21.15.22:0/3188967548 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f8d64056920 con 0x7f8d6c159420 2023-10-08T00:25:07.211 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:07.211 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d58066f30 msgr2=0x7f8d580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d58066f30 0x7f8d580693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0c9e60 tx=0x7f8d60006f90 comp rx=0 tx=0).stop 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 msgr2=0x7f8d6c0c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0c56d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d640091e0 tx=0x7f8d64017000 comp rx=0 tx=0).stop 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 shutdown_connections 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c15d230 0x7f8d6c156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d6c159420 0x7f8d6c0c56d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d58066f30 0x7f8d580693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 --2- 172.21.15.22:0/3188967548 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d6c1597f0 0x7f8d6c16a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 >> 172.21.15.22:0/3188967548 conn(0x7f8d6c0d0660 msgr2=0x7f8d6c0cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 shutdown_connections 2023-10-08T00:25:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.212+0000 7f8d723fd700 1 -- 172.21.15.22:0/3188967548 wait complete. 2023-10-08T00:25:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:07.627 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:24:52.359859+0000', 'modified': '2023-10-08T00:24:55.987975+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6835/3859346332', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6833', 'nonce': 3859346332}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 3859346332}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:25:07.627 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:25:07.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T00:25:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.750+0000 7f9d926b0700 1 Processor -- start 2023-10-08T00:25:07.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.750+0000 7f9d926b0700 1 -- start start 2023-10-08T00:25:07.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d926b0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d926b0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9d8c159c60 0x7f9d8c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d926b0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c15a160 con 0x7f9d8c15db10 2023-10-08T00:25:07.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d926b0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c0d13a0 con 0x7f9d8c159c60 2023-10-08T00:25:07.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d926b0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c15e140 con 0x7f9d8c159890 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d8b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9d8c159c60 0x7f9d8c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d90c4d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9d8c15db10 0x7f9d8c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37402/0 (socket says 172.21.15.22:37402) 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d90c4d700 1 -- 172.21.15.22:0/49163116 learned_addr learned my addr 172.21.15.22:0/49163116 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.751+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/49163116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/49163116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 msgr2=0x7f9d8c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/49163116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/49163116 >> v1:172.21.15.22:6789/0 conn(0x7f9d8c15db10 legacy=0x7f9d8c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/49163116 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c15a3d0 con 0x7f9d8c159c60 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8affd700 1 -- 172.21.15.22:0/49163116 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374722346 0 0) 0x7f9d8c15a160 con 0x7f9d8c15db10 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/49163116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c15d5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d800098e0 tx=0x7f9d800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22152bd82f8edab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8affd700 1 -- 172.21.15.22:0/49163116 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000b640 con 0x7f9d8c159c60 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8affd700 1 -- 172.21.15.22:0/49163116 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8000b7a0 con 0x7f9d8c159c60 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d8affd700 1 -- 172.21.15.22:0/49163116 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000bb40 con 0x7f9d8c159c60 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.752+0000 7f9d926b0700 1 -- 172.21.15.22:0/49163116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 msgr2=0x7f9d8c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 --2- 172.21.15.22:0/49163116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c15d5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9d800098e0 tx=0x7f9d800091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 -- 172.21.15.22:0/49163116 shutdown_connections 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 --2- 172.21.15.22:0/49163116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 --2- 172.21.15.22:0/49163116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c15d5d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 -- 172.21.15.22:0/49163116 >> 172.21.15.22:0/49163116 conn(0x7f9d8c068e20 msgr2=0x7f9d8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 -- 172.21.15.22:0/49163116 shutdown_connections 2023-10-08T00:25:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.753+0000 7f9d926b0700 1 -- 172.21.15.22:0/49163116 wait complete. 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.754+0000 7f9d926b0700 1 Processor -- start 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.754+0000 7f9d926b0700 1 -- start start 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d8c15db10 0x7f9d8c148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c6160 con 0x7f9d8c159c60 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c6440 con 0x7f9d8c15db10 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0c6720 con 0x7f9d8c159890 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49442/0 (socket says 172.21.15.22:49442) 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/3121758550 learned_addr learned my addr 172.21.15.22:0/3121758550 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d8c15db10 0x7f9d8c148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 msgr2=0x7f9d8c0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c0c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d8c15db10 msgr2=0x7f9d8c148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d8c15db10 0x7f9d8c148fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 -- 172.21.15.22:0/3121758550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80009420 con 0x7f9d8c159c60 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c149ec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9d80013000 tx=0x7f9d80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d73fff700 1 -- 172.21.15.22:0/3121758550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000bb20 con 0x7f9d8c159c60 2023-10-08T00:25:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d73fff700 1 -- 172.21.15.22:0/3121758550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80011420 con 0x7f9d8c159c60 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c0c6a00 con 0x7f9d8c159c60 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d73fff700 1 -- 172.21.15.22:0/3121758550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d800117c0 con 0x7f9d8c159c60 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.755+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c0c5d70 con 0x7f9d8c159c60 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.757+0000 7f9d73fff700 1 -- 172.21.15.22:0/3121758550 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d80011b70 con 0x7f9d8c159c60 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.757+0000 7f9d73fff700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d78066f30 0x7f9d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.757+0000 7f9d73fff700 1 -- 172.21.15.22:0/3121758550 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d80085be0 con 0x7f9d8c159c60 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.757+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d78066f30 0x7f9d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.758+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d78066f30 0x7f9d780693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0093f0 tx=0x7f9d7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.759+0000 7f9d9b9a8b80 1 Processor -- start 2023-10-08T00:25:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.759+0000 7f9d9b9a8b80 1 -- start start 2023-10-08T00:25:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d279d00 0x560e9d258a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 0x560e9d22bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d186a70 con 0x560e9d258f60 2023-10-08T00:25:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d184270 con 0x560e9d279d00 2023-10-08T00:25:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e9d180060 con 0x560e9d22fa50 2023-10-08T00:25:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 0x560e9d22bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 0x560e9d22bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49450/0 (socket says 172.21.15.22:49450) 2023-10-08T00:25:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 -- 172.21.15.22:0/3449546137 learned_addr learned my addr 172.21.15.22:0/3449546137 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d279d00 0x560e9d258a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 -- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 msgr2=0x560e9d22fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 -- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d279d00 msgr2=0x560e9d258a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d279d00 0x560e9d258a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.760+0000 7f9d90c4d700 1 -- 172.21.15.22:0/3449546137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e9d01a270 con 0x560e9d258f60 2023-10-08T00:25:07.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 0x560e9d22bcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d84002180 tx=0x7f9d84009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca481edb60a69dee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d717fa700 1 -- 172.21.15.22:0/3449546137 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8400b070 con 0x560e9d258f60 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d717fa700 1 -- 172.21.15.22:0/3449546137 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400dc60 con 0x560e9d258f60 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d717fa700 1 -- 172.21.15.22:0/3449546137 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84013470 con 0x560e9d258f60 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/3449546137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 msgr2=0x560e9d22bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 0x560e9d22bcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d84002180 tx=0x7f9d84009040 comp rx=0 tx=0).stop 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/3449546137 shutdown_connections 2023-10-08T00:25:07.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d258f60 0x560e9d22bcf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/3449546137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d279d00 0x560e9d258a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.761+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/3449546137 >> 172.21.15.22:0/3449546137 conn(0x560e9d231370 msgr2=0x560e9d231740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.762+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/3449546137 shutdown_connections 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.762+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/3449546137 wait complete. 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.762+0000 7f9d9b9a8b80 1 -- start start 2023-10-08T00:25:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.762+0000 7f9d9b9a8b80 1 Processor -- start 2023-10-08T00:25:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d288ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d286aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d26fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d12b890 con 0x560e9d279d00 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d146ea0 con 0x560e9d258f60 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e9d002e30 con 0x560e9d22fa50 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d9b9a8b80 10 client.0 _ll_register_callbacks cb 0x560e9d1f3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d26fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d26fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49458/0 (socket says 172.21.15.22:49458) 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 -- 172.21.15.22:0/16538341 learned_addr learned my addr 172.21.15.22:0/16538341 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d288ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d286aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 -- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 msgr2=0x560e9d288ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d288ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 -- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 msgr2=0x560e9d286aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d286aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 -- 172.21.15.22:0/16538341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d84001cd0 con 0x560e9d279d00 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d26fe70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d84014d20 tx=0x7f9d84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc970ce24f55dfc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.763+0000 7f9d6a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/16538341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840015c0 con 0x560e9d279d00 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/16538341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d84004bb0 con 0x560e9d279d00 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e9d224b70 con 0x560e9d279d00 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/16538341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d84013470 con 0x560e9d279d00 2023-10-08T00:25:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 10 client.4638 fetch_fsmap learned FSMap version 8 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560e9cfbcfe0 con 0x560e9d279d00 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/16538341 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e9d224b70 con 0x560e9d279d00 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/16538341 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9d84025030 con 0x560e9d279d00 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 10 client.4638 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 20 client.4638 populate_metadata read hostname 'smithi022' 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d254e60 0x560e9d255230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 4 client.4638 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 --> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e9d201aa0 con 0x560e9d254e60 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d254e60 0x560e9d255230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d6a7fc700 10 client.4638 ms_handle_connect on v2:172.21.15.22:6833/3859346332 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.764+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d254e60 0x560e9d255230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa002cbfbaf5a96c server_cookie=913f36975537aed3 in_seq=0 out_seq=0 2023-10-08T00:25:07.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/16538341 <== mds.0 v2:172.21.15.22:6833/3859346332 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560e9d201aa0 con 0x560e9d254e60 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d6a7fc700 10 client.4638 handle_command_reply: tid=0 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 client.4638 shutdown 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 msgr2=0x560e9d26fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d26fe70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d84014d20 tx=0x7f9d84018000 comp rx=0 tx=0).stop 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 shutdown_connections 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d26fe70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d288ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d254e60 0x560e9d255230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/16538341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d286aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d6a7fc700 0 client.4638 ms_handle_reset on v2:172.21.15.22:6833/3859346332 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 >> 172.21.15.22:0/16538341 conn(0x560e9d231370 msgr2=0x560e9d22c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 shutdown_connections 2023-10-08T00:25:07.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/16538341 wait complete. 2023-10-08T00:25:07.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.765+0000 7f9d9b9a8b80 20 client.4638 trim_cache size 0 max 16384 2023-10-08T00:25:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.782+0000 7f9d9b9a8b80 1 Processor -- start 2023-10-08T00:25:07.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.782+0000 7f9d9b9a8b80 1 -- start start 2023-10-08T00:25:07.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d2581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d22c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d22ac20 con 0x560e9d279d00 2023-10-08T00:25:07.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d257fa0 con 0x560e9d258f60 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e9d228690 con 0x560e9d22fa50 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49472/0 (socket says 172.21.15.22:49472) 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1250080785 learned_addr learned my addr 172.21.15.22:0/1250080785 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d22c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 msgr2=0x560e9d2581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d2581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.783+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d2581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 msgr2=0x560e9d22c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d22c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1250080785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e9d14e780 con 0x560e9d279d00 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2d2330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001fc0 tx=0x7f9d84020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c998fdf5908b6c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d71ffb700 1 -- 172.21.15.22:0/1250080785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84004bb0 con 0x560e9d279d00 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d71ffb700 1 -- 172.21.15.22:0/1250080785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d84007120 con 0x560e9d279d00 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d71ffb700 1 -- 172.21.15.22:0/1250080785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84001480 con 0x560e9d279d00 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1250080785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 msgr2=0x560e9d2d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2d2330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001fc0 tx=0x7f9d84020000 comp rx=0 tx=0).stop 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1250080785 shutdown_connections 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2d2330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d2581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1250080785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d22c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1250080785 >> 172.21.15.22:0/1250080785 conn(0x560e9d231370 msgr2=0x560e9d22da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1250080785 shutdown_connections 2023-10-08T00:25:07.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.784+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1250080785 wait complete. 2023-10-08T00:25:07.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.785+0000 7f9d9b9a8b80 1 -- start start 2023-10-08T00:25:07.788 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.785+0000 7f9d9b9a8b80 1 Processor -- start 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d25f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d2cec90 con 0x560e9d279d00 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e9d279530 con 0x560e9d258f60 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e9d279770 con 0x560e9d22fa50 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d9b9a8b80 10 client.0 _ll_register_callbacks cb 0x560e9d1f3110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49476/0 (socket says 172.21.15.22:49476) 2023-10-08T00:25:07.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1688165090 learned_addr learned my addr 172.21.15.22:0/1688165090 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d8b7fe700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d25f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 msgr2=0x560e9d22b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 msgr2=0x560e9d25f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d25f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 -- 172.21.15.22:0/1688165090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e9cfbcfe0 con 0x560e9d279d00 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d90c4d700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2ce4d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001fc0 tx=0x7f9d84034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd9ae26850d7eae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d6a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.786+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/1688165090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84001080 con 0x560e9d279d00 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/1688165090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d84028ac0 con 0x560e9d279d00 2023-10-08T00:25:07.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d8400dc60 con 0x560e9d279d00 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/1688165090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d84028eb0 con 0x560e9d279d00 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 10 client.4644 fetch_fsmap learned FSMap version 8 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560e9d135470 con 0x560e9d279d00 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/1688165090 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8400dc60 con 0x560e9d279d00 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/1688165090 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9d84025070 con 0x560e9d279d00 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 10 client.4644 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 20 client.4644 populate_metadata read hostname 'smithi022' 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d22bd30 0x560e9d2cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 4 client.4644 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2023-10-08T00:25:07.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 --> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560e9d122e00 con 0x560e9d22bd30 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d22bd30 0x560e9d2cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d6a7fc700 10 client.4644 ms_handle_connect on v2:172.21.15.22:6833/3859346332 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d8bfff700 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d22bd30 0x560e9d2cc240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a0f98186357d326 server_cookie=1f2f8726d5e667ea in_seq=0 out_seq=0 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.787+0000 7f9d6a7fc700 1 -- 172.21.15.22:0/1688165090 <== mds.0 v2:172.21.15.22:6833/3859346332 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x560e9d122e00 con 0x560e9d22bd30 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d6a7fc700 10 client.4644 handle_command_reply: tid=0 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 client.4644 shutdown 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 msgr2=0x560e9d2ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2ce4d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001fc0 tx=0x7f9d84034040 comp rx=0 tx=0).stop 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 shutdown_connections 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560e9d279d00 0x560e9d2ce4d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x560e9d22fa50 0x560e9d22b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.22:6833/3859346332,v1:172.21.15.22:6835/3859346332] conn(0x560e9d22bd30 0x560e9d2cc240 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 --2- 172.21.15.22:0/1688165090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560e9d258f60 0x560e9d25f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d6a7fc700 0 client.4644 ms_handle_reset on v2:172.21.15.22:6833/3859346332 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 >> 172.21.15.22:0/1688165090 conn(0x560e9d231370 msgr2=0x560e9d258180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 shutdown_connections 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 1 -- 172.21.15.22:0/1688165090 wait complete. 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d9b9a8b80 20 client.4644 trim_cache size 0 max 16384 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:25:07.796 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4275, 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 14.820241920000001, 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 8, 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 21, 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 21, 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 22.110442292999998 2023-10-08T00:25:07.797 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:25:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d78066f30 msgr2=0x7f9d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d78066f30 0x7f9d780693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0093f0 tx=0x7f9d7c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 msgr2=0x7f9d8c149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:07.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c149ec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9d80013000 tx=0x7f9d80017000 comp rx=0 tx=0).stop 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 shutdown_connections 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d8c15db10 0x7f9d8c148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d78066f30 0x7f9d780693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d8c159890 0x7f9d8c0c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 --2- 172.21.15.22:0/3121758550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d8c159c60 0x7f9d8c149ec0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.788+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 >> 172.21.15.22:0/3121758550 conn(0x7f9d8c068e20 msgr2=0x7f9d8c15fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.789+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 shutdown_connections 2023-10-08T00:25:07.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:07.789+0000 7f9d926b0700 1 -- 172.21.15.22:0/3121758550 wait complete. 2023-10-08T00:25:07.801 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T00:25:07.830 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T00:25:07.831 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T00:25:07.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:07.831 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:25:07.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:07.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-10-08T00:25:07.914 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2023-10-08T00:25:07.915 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:25:07.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:07.916 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:25:07.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:07.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-10-08T00:25:08.038 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2023-10-08T00:25:08.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:25:08.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.040 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:25:08.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-08T00:25:08.125 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-10-08T00:25:08.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:25:08.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.127 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:25:08.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-08T00:25:08.250 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-10-08T00:25:08.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:25:08.252 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-08T00:25:08.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:25:08.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.373+0000 7f9e4d32c700 1 Processor -- start 2023-10-08T00:25:08.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.373+0000 7f9e4d32c700 1 -- start start 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4d32c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9e481597f0 0x7f9e480b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4d32c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e4815d230 0x7f9e4815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4d32c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4815db70 con 0x7f9e48159420 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4d32c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e480b11d0 con 0x7f9e4815d230 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4d32c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e480b14b0 con 0x7f9e481597f0 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4cb2b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e4815d230 0x7f9e4815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e47fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9e48159420 0x7f9e480b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37412/0 (socket says 172.21.15.22:37412) 2023-10-08T00:25:08.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e47fff700 1 -- 172.21.15.22:0/3828570258 learned_addr learned my addr 172.21.15.22:0/3828570258 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e477fe700 1 --2- 172.21.15.22:0/3828570258 >> v2:172.21.15.192:3300/0 conn(0x7f9e481597f0 0x7f9e480b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4cb2b700 1 -- 172.21.15.22:0/3828570258 >> v2:172.21.15.192:3300/0 conn(0x7f9e481597f0 msgr2=0x7f9e480b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4cb2b700 1 --2- 172.21.15.22:0/3828570258 >> v2:172.21.15.192:3300/0 conn(0x7f9e481597f0 0x7f9e480b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4cb2b700 1 -- 172.21.15.22:0/3828570258 >> v1:172.21.15.22:6789/0 conn(0x7f9e48159420 legacy=0x7f9e480b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4cb2b700 1 -- 172.21.15.22:0/3828570258 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e480b1790 con 0x7f9e4815d230 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e46ffd700 1 -- 172.21.15.22:0/3828570258 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250721437 0 0) 0x7f9e4815db70 con 0x7f9e48159420 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.374+0000 7f9e4cb2b700 1 --2- 172.21.15.22:0/3828570258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e4815d230 0x7f9e4815d630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e48089750 tx=0x7f9e40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd107815547466c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e46ffd700 1 -- 172.21.15.22:0/3828570258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000e070 con 0x7f9e4815d230 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e46ffd700 1 -- 172.21.15.22:0/3828570258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000bc30 con 0x7f9e4815d230 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e46ffd700 1 -- 172.21.15.22:0/3828570258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40012430 con 0x7f9e4815d230 2023-10-08T00:25:08.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 -- 172.21.15.22:0/3828570258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e4815d230 msgr2=0x7f9e4815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/3828570258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e4815d230 0x7f9e4815d630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e48089750 tx=0x7f9e40009780 comp rx=0 tx=0).stop 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 -- 172.21.15.22:0/3828570258 shutdown_connections 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/3828570258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e4815d230 0x7f9e4815d630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/3828570258 >> v2:172.21.15.192:3300/0 conn(0x7f9e481597f0 0x7f9e480b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 -- 172.21.15.22:0/3828570258 >> 172.21.15.22:0/3828570258 conn(0x7f9e480d0660 msgr2=0x7f9e480d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 -- 172.21.15.22:0/3828570258 shutdown_connections 2023-10-08T00:25:08.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.375+0000 7f9e4d32c700 1 -- 172.21.15.22:0/3828570258 wait complete. 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.376+0000 7f9e4d32c700 1 Processor -- start 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.376+0000 7f9e4d32c700 1 -- start start 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4d32c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 0x7f9e48155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4d32c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e481597f0 0x7f9e48168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4d32c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4815d230 0x7f9e480cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4d32c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e481564f0 con 0x7f9e48159420 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4d32c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4814fad0 con 0x7f9e4815d230 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4d32c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e48155970 con 0x7f9e481597f0 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e47fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 0x7f9e48155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:08.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e47fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 0x7f9e48155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49502/0 (socket says 172.21.15.22:49502) 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e47fff700 1 -- 172.21.15.22:0/2738358669 learned_addr learned my addr 172.21.15.22:0/2738358669 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e477fe700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e481597f0 0x7f9e48168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.377+0000 7f9e4cb2b700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4815d230 0x7f9e480cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e47fff700 1 -- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e481597f0 msgr2=0x7f9e48168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e47fff700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e481597f0 0x7f9e48168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e47fff700 1 -- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4815d230 msgr2=0x7f9e480cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e47fff700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4815d230 0x7f9e480cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e47fff700 1 -- 172.21.15.22:0/2738358669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40009a20 con 0x7f9e48159420 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e47fff700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 0x7f9e48155120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c7e0 tx=0x7f9e38007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38005b30 con 0x7f9e48159420 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e38005c90 con 0x7f9e48159420 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e48155c50 con 0x7f9e48159420 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38007300 con 0x7f9e48159420 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.378+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e48155fe0 con 0x7f9e48159420 2023-10-08T00:25:08.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.379+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e481556c0 con 0x7f9e48159420 2023-10-08T00:25:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.380+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e3801b3b0 con 0x7f9e48159420 2023-10-08T00:25:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.380+0000 7f9e3ffff700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e28066f30 0x7f9e280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.380+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e38083a50 con 0x7f9e48159420 2023-10-08T00:25:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.380+0000 7f9e477fe700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e28066f30 0x7f9e280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.381+0000 7f9e477fe700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e28066f30 0x7f9e280693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e481531d0 tx=0x7f9e30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:08.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.384+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e38050cc0 con 0x7f9e48159420 2023-10-08T00:25:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.626+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e4804c3c0 con 0x7f9e48159420 2023-10-08T00:25:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.627+0000 7f9e3ffff700 1 -- 172.21.15.22:0/2738358669 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e38017020 con 0x7f9e48159420 2023-10-08T00:25:08.627 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:25:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e28066f30 msgr2=0x7f9e280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e28066f30 0x7f9e280693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e481531d0 tx=0x7f9e30008040 comp rx=0 tx=0).stop 2023-10-08T00:25:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 msgr2=0x7f9e48155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 0x7f9e48155120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800c7e0 tx=0x7f9e38007df0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 shutdown_connections 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e4815d230 0x7f9e480cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e48159420 0x7f9e48155120 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e28066f30 0x7f9e280693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 --2- 172.21.15.22:0/2738358669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e481597f0 0x7f9e48168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 >> 172.21.15.22:0/2738358669 conn(0x7f9e480d0660 msgr2=0x7f9e481582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 shutdown_connections 2023-10-08T00:25:08.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:08.629+0000 7f9e4d32c700 1 -- 172.21.15.22:0/2738358669 wait complete. 2023-10-08T00:25:08.641 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T00:25:08.641 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:25:08.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:25:08.641 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:25:08.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:08.642 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T00:25:08.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T00:25:08.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:25:08.642 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:25:08.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.642 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:25:08.657 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:08.657 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:08.657 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:25:08.658 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42462sec preferred_lft 42462sec 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:08.659 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:25:08.660 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T00:25:08.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.660 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:08.660 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:08.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2023-10-08T00:25:08.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2023-10-08T00:25:08.660 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2023-10-08T00:25:08.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T00:25:08.661 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:08.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.823 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:25:08.866 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:25:08.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.867 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:25:08.901 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:25:08.901 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:25:08.902 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:25:08.902 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:25:08.902 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:25:08.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:08.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:08.902 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:08.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:25:08.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:25:08.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:25:08.903 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:09.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:09.152 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:25:09.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:09.168 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-10-08T00:25:09.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:09.222 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:09.222 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:09.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:25:09.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T00:25:09.223 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:09.313 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T00:25:09.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T00:25:09.314 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:09.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:09.522 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:09.522 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:09.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:25:09.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T00:25:09.522 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:09.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:09.616 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:09.631 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:25:09.632 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:09.632 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:09.686 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:25:09.686 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:25:09.686 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:09.777 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:09.778 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:09.869 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:09.869 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:09.869 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:09.869 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:09.870 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:09.870 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:09.870 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:09.870 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:09.891 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:25:09.892 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:25:09.893 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:25:09.894 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:25:09.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:09.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:09.920 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-08T00:25:09.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:25:10.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.079+0000 7fd839822700 1 Processor -- start 2023-10-08T00:25:10.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.079+0000 7fd839822700 1 -- start start 2023-10-08T00:25:10.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd839822700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd8340cbf30 0x7fd8340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:10.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd839822700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340cc300 con 0x7fd8340b1420 2023-10-08T00:25:10.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd839822700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340ad370 con 0x7fd8340ccf90 2023-10-08T00:25:10.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd839822700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd834156bf0 con 0x7fd8340cbf30 2023-10-08T00:25:10.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd8337fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd8340b1420 0x7fd8340c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37424/0 (socket says 172.21.15.22:37424) 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd8337fe700 1 -- 172.21.15.22:0/367127342 learned_addr learned my addr 172.21.15.22:0/367127342 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.080+0000 7fd832ffd700 1 --2- 172.21.15.22:0/367127342 >> v2:172.21.15.192:3300/0 conn(0x7fd8340cbf30 0x7fd8340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd831ffb700 1 -- 172.21.15.22:0/367127342 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242063039 0 0) 0x7fd8340cc300 con 0x7fd8340b1420 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd831ffb700 1 -- 172.21.15.22:0/367127342 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd820003570 con 0x7fd8340b1420 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd832ffd700 1 -- 172.21.15.22:0/367127342 >> v1:172.21.15.192:6789/0 conn(0x7fd8340ccf90 legacy=0x7fd8340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd831ffb700 1 -- 172.21.15.22:0/367127342 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504734115 0 0) 0x7fd8340ad370 con 0x7fd8340ccf90 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd832ffd700 1 -- 172.21.15.22:0/367127342 >> v1:172.21.15.22:6789/0 conn(0x7fd8340b1420 legacy=0x7fd8340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd832ffd700 1 -- 172.21.15.22:0/367127342 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340ad650 con 0x7fd8340cbf30 2023-10-08T00:25:10.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd832ffd700 1 --2- 172.21.15.22:0/367127342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340cbf30 0x7fd8340ae410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0098e0 tx=0x7fd82c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=458c22fc506a5ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd831ffb700 1 -- 172.21.15.22:0/367127342 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00b640 con 0x7fd8340cbf30 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd831ffb700 1 -- 172.21.15.22:0/367127342 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00b7a0 con 0x7fd8340cbf30 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.081+0000 7fd831ffb700 1 -- 172.21.15.22:0/367127342 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bb40 con 0x7fd8340cbf30 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 -- 172.21.15.22:0/367127342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340cbf30 msgr2=0x7fd8340ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 --2- 172.21.15.22:0/367127342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340cbf30 0x7fd8340ae410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0098e0 tx=0x7fd82c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 -- 172.21.15.22:0/367127342 shutdown_connections 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 --2- 172.21.15.22:0/367127342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340cbf30 0x7fd8340ae410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 -- 172.21.15.22:0/367127342 >> 172.21.15.22:0/367127342 conn(0x7fd83406a320 msgr2=0x7fd8340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:10.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 -- 172.21.15.22:0/367127342 shutdown_connections 2023-10-08T00:25:10.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.082+0000 7fd839822700 1 -- 172.21.15.22:0/367127342 wait complete. 2023-10-08T00:25:10.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.083+0000 7fd839822700 1 Processor -- start 2023-10-08T00:25:10.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.083+0000 7fd839822700 1 -- start start 2023-10-08T00:25:10.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd839822700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 0x7fd8340c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:10.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd839822700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8340cbf30 0x7fd834155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd839822700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340ccf90 0x7fd8340c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd839822700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340a9e60 con 0x7fd8340b1420 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd839822700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340aa140 con 0x7fd8340ccf90 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd839822700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340aa420 con 0x7fd8340cbf30 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd832ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 0x7fd8340c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd832ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 0x7fd8340c12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49508/0 (socket says 172.21.15.22:49508) 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd832ffd700 1 -- 172.21.15.22:0/58638145 learned_addr learned my addr 172.21.15.22:0/58638145 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd8337fe700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340ccf90 0x7fd8340c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd8327fc700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8340cbf30 0x7fd834155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd832ffd700 1 -- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8340cbf30 msgr2=0x7fd834155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.084+0000 7fd832ffd700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8340cbf30 0x7fd834155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd832ffd700 1 -- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340ccf90 msgr2=0x7fd8340c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd832ffd700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340ccf90 0x7fd8340c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd832ffd700 1 -- 172.21.15.22:0/58638145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009420 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd8337fe700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340ccf90 0x7fd8340c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd8327fc700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8340cbf30 0x7fd834155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd832ffd700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 0x7fd8340c12d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd834064290 tx=0x7fd82c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bb20 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c000c90 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340aa700 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c021720 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.085+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8340c1810 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.086+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83404c3c0 con 0x7fd8340b1420 2023-10-08T00:25:10.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.086+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd82c029030 con 0x7fd8340b1420 2023-10-08T00:25:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.087+0000 7fd82affd700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd814066f30 0x7fd8140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.087+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd82c027070 con 0x7fd8340b1420 2023-10-08T00:25:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.087+0000 7fd8327fc700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd814066f30 0x7fd8140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.088+0000 7fd8327fc700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd814066f30 0x7fd8140693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8340ca4d0 tx=0x7fd81c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:10.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.091+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd82c056f60 con 0x7fd8340b1420 2023-10-08T00:25:10.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.326+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd83406f8a0 con 0x7fd8340b1420 2023-10-08T00:25:10.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.326+0000 7fd82affd700 1 -- 172.21.15.22:0/58638145 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd82c05a580 con 0x7fd8340b1420 2023-10-08T00:25:10.327 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:25:10.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd814066f30 msgr2=0x7fd8140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd814066f30 0x7fd8140693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8340ca4d0 tx=0x7fd81c009040 comp rx=0 tx=0).stop 2023-10-08T00:25:10.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 msgr2=0x7fd8340c12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:10.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 0x7fd8340c12d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd834064290 tx=0x7fd82c017000 comp rx=0 tx=0).stop 2023-10-08T00:25:10.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 shutdown_connections 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340ccf90 0x7fd8340c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8340b1420 0x7fd8340c12d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd814066f30 0x7fd8140693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 --2- 172.21.15.22:0/58638145 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8340cbf30 0x7fd834155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 >> 172.21.15.22:0/58638145 conn(0x7fd83406a320 msgr2=0x7fd8340ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.328+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 shutdown_connections 2023-10-08T00:25:10.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:10.329+0000 7fd839822700 1 -- 172.21.15.22:0/58638145 wait complete. 2023-10-08T00:25:10.341 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T00:25:10.341 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:25:10.341 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:25:10.342 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T00:25:10.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T00:25:10.342 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T00:25:10.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T00:25:10.342 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:25:10.342 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T00:25:10.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.343 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:25:10.359 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:10.359 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:10.359 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:10.359 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.359 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:25:10.360 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42460sec preferred_lft 42460sec 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:10.361 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.362 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:25:10.363 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:25:10.363 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link tentative 2023-10-08T00:25:10.363 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.363 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:25:10.423 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:25:10.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.425 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:25:10.482 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:25:10.482 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:25:10.482 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:25:10.483 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:25:10.483 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:25:10.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.483 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:10.483 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:10.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:25:10.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:25:10.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:25:10.484 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:10.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.585 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:25:10.600 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:25:10.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.601 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2023-10-08T00:25:10.656 INFO:teuthology.orchestra.run.smithi022.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T00:25:10.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.657 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:10.657 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:10.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:25:10.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T00:25:10.657 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:10.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T00:25:10.783 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:10.783 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:10.783 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:10.783 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether c2:fc:66:98:d6:6f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::c0fc:66ff:fe98:d66f/64 scope link tentative 2023-10-08T00:25:10.784 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.873 INFO:teuthology.orchestra.run.smithi022.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:25:10.874 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether c2:fc:66:98:d6:6f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T00:25:10.874 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T00:25:10.874 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.874 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::c0fc:66ff:fe98:d66f/64 scope link tentative 2023-10-08T00:25:10.874 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:10.883 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T00:25:10.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T00:25:10.884 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:11.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:11.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:11.103 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:11.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.1 up 2023-10-08T00:25:11.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T00:25:11.103 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:11.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:11.185 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T00:25:11.202 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T00:25:11.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:11.202 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T00:25:11.257 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-08T00:25:11.257 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:25:11.257 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:11.339 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:11.339 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:11.357 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 2@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:11.358 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:11.380 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:11.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:11.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:11.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 2@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:11.380 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:11.381 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:11.381 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:11.381 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:11.381 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:25:11.381 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:25:11.381 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:25:11.382 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:25:11.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:11.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T00:25:11.449 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-08T00:25:11.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:25:11.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.608+0000 7fc950881700 1 Processor -- start 2023-10-08T00:25:11.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.608+0000 7fc950881700 1 -- start start 2023-10-08T00:25:11.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc950881700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc94c156a60 0x7fc94c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:11.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc950881700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c157e30 con 0x7fc94c156690 2023-10-08T00:25:11.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc950881700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c1578b0 con 0x7fc94c0af480 2023-10-08T00:25:11.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc950881700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c06aa00 con 0x7fc94c156a60 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94a59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc94c156690 0x7fc94c0c86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37436/0 (socket says 172.21.15.22:37436) 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc94c156a60 0x7fc94c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94a59c700 1 -- 172.21.15.22:0/3089454962 learned_addr learned my addr 172.21.15.22:0/3089454962 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94959a700 1 -- 172.21.15.22:0/3089454962 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983248618 0 0) 0x7fc94c157e30 con 0x7fc94c156690 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94959a700 1 -- 172.21.15.22:0/3089454962 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc934003570 con 0x7fc94c156690 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3089454962 >> v1:172.21.15.192:6789/0 conn(0x7fc94c0af480 legacy=0x7fc94c06ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3089454962 >> v1:172.21.15.22:6789/0 conn(0x7fc94c156690 legacy=0x7fc94c0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3089454962 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c157b50 con 0x7fc94c156a60 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.609+0000 7fc94ad9d700 1 --2- 172.21.15.22:0/3089454962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0ca9d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc944009e60 tx=0x7fc944009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7cc1469cf7f5e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc94959a700 1 -- 172.21.15.22:0/3089454962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94400e070 con 0x7fc94c156a60 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc94959a700 1 -- 172.21.15.22:0/3089454962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94400bb60 con 0x7fc94c156a60 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc94959a700 1 -- 172.21.15.22:0/3089454962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944012430 con 0x7fc94c156a60 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 -- 172.21.15.22:0/3089454962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 msgr2=0x7fc94c0ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 --2- 172.21.15.22:0/3089454962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0ca9d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc944009e60 tx=0x7fc944009780 comp rx=0 tx=0).stop 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 -- 172.21.15.22:0/3089454962 shutdown_connections 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 --2- 172.21.15.22:0/3089454962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0ca9d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 -- 172.21.15.22:0/3089454962 >> 172.21.15.22:0/3089454962 conn(0x7fc94c0c9870 msgr2=0x7fc94c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 -- 172.21.15.22:0/3089454962 shutdown_connections 2023-10-08T00:25:11.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.610+0000 7fc950881700 1 -- 172.21.15.22:0/3089454962 wait complete. 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.611+0000 7fc950881700 1 Processor -- start 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.611+0000 7fc950881700 1 -- start start 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc950881700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc94c0af480 0x7fc94c1451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc950881700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc94c156690 0x7fc94c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc950881700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc950881700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c5b80 con 0x7fc94c156a60 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc950881700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0b1380 con 0x7fc94c0af480 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc950881700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c0c5530 con 0x7fc94c156690 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc94ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:11.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc94ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49516/0 (socket says 172.21.15.22:49516) 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3082545709 learned_addr learned my addr 172.21.15.22:0/3082545709 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc94a59c700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc94c0af480 0x7fc94c1451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.612+0000 7fc949d9b700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc94c156690 0x7fc94c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc94c156690 msgr2=0x7fc94c158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc94ad9d700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc94c156690 0x7fc94c158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc94c0af480 msgr2=0x7fc94c1451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc94ad9d700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc94c0af480 0x7fc94c1451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc94ad9d700 1 -- 172.21.15.22:0/3082545709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009a20 con 0x7fc94c156a60 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc94ad9d700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0b09c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc94c06cc00 tx=0x7fc944019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9440032b0 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9440263f0 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c0c5810 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944026790 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.613+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c0b0f00 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.614+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c0b1150 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.614+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc944026b80 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.615+0000 7fc93a7fc700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.615+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc944086410 con 0x7fc94c156a60 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.615+0000 7fc94a59c700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.615+0000 7fc94a59c700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc92c066f30 0x7fc92c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc93c007fd0 tx=0x7fc93c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.619+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc944053680 con 0x7fc94c156a60 2023-10-08T00:25:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.858+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc94c04c3c0 con 0x7fc94c156a60 2023-10-08T00:25:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.858+0000 7fc93a7fc700 1 -- 172.21.15.22:0/3082545709 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc944056ca0 con 0x7fc94c156a60 2023-10-08T00:25:11.859 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:25:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc92c066f30 msgr2=0x7fc92c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc92c066f30 0x7fc92c0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc93c007fd0 tx=0x7fc93c009040 comp rx=0 tx=0).stop 2023-10-08T00:25:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 msgr2=0x7fc94c0b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0b09c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc94c06cc00 tx=0x7fc944019000 comp rx=0 tx=0).stop 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 shutdown_connections 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc94c156a60 0x7fc94c0b09c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc94c0af480 0x7fc94c1451e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc92c066f30 0x7fc92c0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 --2- 172.21.15.22:0/3082545709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc94c156690 0x7fc94c158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 >> 172.21.15.22:0/3082545709 conn(0x7fc94c0c9870 msgr2=0x7fc94c0c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 shutdown_connections 2023-10-08T00:25:11.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:11.860+0000 7fc950881700 1 -- 172.21.15.22:0/3082545709 wait complete. 2023-10-08T00:25:11.872 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T00:25:11.872 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:25:11.873 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:25:11.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:11.874 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:25:11.892 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:11.892 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:25:11.893 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:11.894 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:25:11.895 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42463sec preferred_lft 42463sec 2023-10-08T00:25:11.895 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:25:11.895 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:11.895 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T00:25:11.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:11.895 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:11.896 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:11.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2023-10-08T00:25:11.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2023-10-08T00:25:11.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2023-10-08T00:25:11.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T00:25:11.896 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:12.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.065 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:25:12.106 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:25:12.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.110 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:25:12.179 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:25:12.179 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:25:12.180 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:25:12.180 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:25:12.180 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:25:12.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.180 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:12.180 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:12.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:25:12.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:25:12.181 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:25:12.181 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:12.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.447 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:25:12.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.462 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-10-08T00:25:12.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.516 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:12.516 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:12.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:25:12.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T00:25:12.517 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:12.605 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T00:25:12.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.605 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:12.605 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:12.605 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T00:25:12.605 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T00:25:12.605 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T00:25:12.606 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T00:25:12.606 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T00:25:12.606 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:12.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:12.826 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:12.826 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:12.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:25:12.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T00:25:12.826 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:12.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:12.918 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:12.932 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:25:12.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:12.933 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:12.987 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:25:12.987 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:25:12.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:13.078 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:13.079 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:13.164 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:13.164 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:13.164 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:13.165 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:13.165 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:13.165 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:13.165 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:13.165 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:13.187 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:25:13.188 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:25:13.188 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:25:13.189 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:25:13.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:13.214 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-08T00:25:13.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:25:13.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.346+0000 7f4b11d65700 1 Processor -- start 2023-10-08T00:25:13.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.346+0000 7f4b11d65700 1 -- start start 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b11d65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b0c159420 0x7f4b0c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b11d65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c15d230 0x7f4b0c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b11d65700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c0b2980 con 0x7f4b0c1597f0 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b11d65700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0c15dbb0 con 0x7f4b0c159420 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b11d65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c0b11d0 con 0x7f4b0c15d230 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b0c159420 0x7f4b0c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b0c159420 0x7f4b0c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49532/0 (socket says 172.21.15.22:49532) 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 -- 172.21.15.22:0/1631041297 learned_addr learned my addr 172.21.15.22:0/1631041297 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:13.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 -- 172.21.15.22:0/1631041297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c15d230 msgr2=0x7f4b0c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 --2- 172.21.15.22:0/1631041297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c15d230 0x7f4b0c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 -- 172.21.15.22:0/1631041297 >> v1:172.21.15.192:6789/0 conn(0x7f4b0c1597f0 legacy=0x7f4b0c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.347+0000 7f4b10d63700 1 -- 172.21.15.22:0/1631041297 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0b14b0 con 0x7f4b0c159420 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b10d63700 1 --2- 172.21.15.22:0/1631041297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c159420 0x7f4b0c0b5f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5370cdaad7db509e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b0b7fe700 1 -- 172.21.15.22:0/1631041297 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000b820 con 0x7f4b0c159420 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b0b7fe700 1 -- 172.21.15.22:0/1631041297 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0000b980 con 0x7f4b0c159420 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b0b7fe700 1 -- 172.21.15.22:0/1631041297 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0000bd20 con 0x7f4b0c159420 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 -- 172.21.15.22:0/1631041297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c159420 msgr2=0x7f4b0c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 --2- 172.21.15.22:0/1631041297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c159420 0x7f4b0c0b5f40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00009250 comp rx=0 tx=0).stop 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 -- 172.21.15.22:0/1631041297 shutdown_connections 2023-10-08T00:25:13.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 --2- 172.21.15.22:0/1631041297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c15d230 0x7f4b0c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 --2- 172.21.15.22:0/1631041297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c159420 0x7f4b0c0b5f40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 -- 172.21.15.22:0/1631041297 >> 172.21.15.22:0/1631041297 conn(0x7f4b0c0d0660 msgr2=0x7f4b0c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 -- 172.21.15.22:0/1631041297 shutdown_connections 2023-10-08T00:25:13.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.348+0000 7f4b11d65700 1 -- 172.21.15.22:0/1631041297 wait complete. 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.349+0000 7f4b11d65700 1 Processor -- start 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 -- start start 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b0c159420 0x7f4b0c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c1597f0 0x7f4b0c0b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 0x7f4b0c0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c156000 con 0x7f4b0c15d230 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c16aa00 con 0x7f4b0c159420 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.350+0000 7f4b11d65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c169df0 con 0x7f4b0c1597f0 2023-10-08T00:25:13.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 0x7f4b0c0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 0x7f4b0c0b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49548/0 (socket says 172.21.15.22:49548) 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 -- 172.21.15.22:0/3004351216 learned_addr learned my addr 172.21.15.22:0/3004351216 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b10d63700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b0c159420 0x7f4b0c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b0bfff700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c1597f0 0x7f4b0c0b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 -- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c1597f0 msgr2=0x7f4b0c0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c1597f0 0x7f4b0c0b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 -- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b0c159420 msgr2=0x7f4b0c155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b0c159420 0x7f4b0c155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 -- 172.21.15.22:0/3004351216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b000094f0 con 0x7f4b0c15d230 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b0bfff700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c1597f0 0x7f4b0c0b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:13.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11564700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 0x7f4b0c0b59c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400bc30 tx=0x7f4b04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b040092e0 con 0x7f4b0c15d230 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0400c6f0 con 0x7f4b0c15d230 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c16a0d0 con 0x7f4b0c15d230 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0400cad0 con 0x7f4b0c15d230 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.351+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c16a690 con 0x7f4b0c15d230 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.352+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c16abb0 con 0x7f4b0c15d230 2023-10-08T00:25:13.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.353+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b04012070 con 0x7f4b0c15d230 2023-10-08T00:25:13.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.353+0000 7f4b08ff9700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4af0066f60 0x7f4af0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:13.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.353+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b0400ce40 con 0x7f4b0c15d230 2023-10-08T00:25:13.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.353+0000 7f4b10d63700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4af0066f60 0x7f4af0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:13.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.354+0000 7f4b10d63700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4af0066f60 0x7f4af0069410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:13.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.357+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b0c16abb0 con 0x7f4b0c15d230 2023-10-08T00:25:13.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.600+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b0c16ab70 con 0x7f4b0c15d230 2023-10-08T00:25:13.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.600+0000 7f4b08ff9700 1 -- 172.21.15.22:0/3004351216 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4b04054c30 con 0x7f4b0c15d230 2023-10-08T00:25:13.601 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:25:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4af0066f60 msgr2=0x7f4af0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4af0066f60 0x7f4af0069410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b000099b0 tx=0x7f4b00016000 comp rx=0 tx=0).stop 2023-10-08T00:25:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 msgr2=0x7f4b0c0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 0x7f4b0c0b59c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400bc30 tx=0x7f4b04009840 comp rx=0 tx=0).stop 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 shutdown_connections 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b0c15d230 0x7f4b0c0b59c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b0c159420 0x7f4b0c155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4af0066f60 0x7f4af0069410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 --2- 172.21.15.22:0/3004351216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b0c1597f0 0x7f4b0c0b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 >> 172.21.15.22:0/3004351216 conn(0x7f4b0c0d0660 msgr2=0x7f4b0c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 shutdown_connections 2023-10-08T00:25:13.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:13.603+0000 7f4b11d65700 1 -- 172.21.15.22:0/3004351216 wait complete. 2023-10-08T00:25:13.615 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T00:25:13.615 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:25:13.615 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:25:13.615 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T00:25:13.616 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T00:25:13.616 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T00:25:13.616 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T00:25:13.616 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:25:13.616 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T00:25:13.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.616 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:25:13.632 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:13.632 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:13.632 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:13.632 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:13.632 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:13.633 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42461sec preferred_lft 42461sec 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:25:13.634 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:13.635 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:25:13.635 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:25:13.635 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link tentative 2023-10-08T00:25:13.635 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:13.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.635 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:25:13.697 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:25:13.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.698 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:25:13.755 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:25:13.755 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:25:13.755 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:25:13.755 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:25:13.755 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:25:13.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.756 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:13.756 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:13.756 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:25:13.756 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:25:13.756 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:25:13.756 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:13.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.855 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:25:13.869 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:25:13.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.870 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2023-10-08T00:25:13.924 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T00:25:13.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:13.924 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:13.924 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:13.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:25:13.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T00:25:13.925 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:14.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:14.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T00:25:14.042 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:21:7a:03:e1:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.043 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a021:7aff:fe03:e1f4/64 scope link tentative 2023-10-08T00:25:14.044 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:14.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:25:14.132 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether a2:21:7a:03:e1:f4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T00:25:14.133 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T00:25:14.133 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.133 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a021:7aff:fe03:e1f4/64 scope link tentative 2023-10-08T00:25:14.133 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:14.146 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T00:25:14.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:14.147 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:14.147 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:14.147 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T00:25:14.147 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T00:25:14.147 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T00:25:14.147 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T00:25:14.148 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T00:25:14.148 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:14.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:14.366 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:14.366 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:14.366 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2023-10-08T00:25:14.366 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T00:25:14.367 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:14.445 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:14.446 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T00:25:14.460 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T00:25:14.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:14.460 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T00:25:14.514 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-08T00:25:14.514 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:25:14.514 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:14.594 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:14.594 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:14.613 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:14.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:14.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:14.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 3@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:14.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:14.614 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:14.614 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:14.614 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:14.636 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:14.636 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:14.636 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 3@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:25:14.637 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:25:14.639 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:25:14.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:14.639 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T00:25:14.703 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T00:25:14.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:14.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.853+0000 7fafb4e65700 1 Processor -- start 2023-10-08T00:25:14.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.853+0000 7fafb4e65700 1 -- start start 2023-10-08T00:25:14.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.854+0000 7fafb4e65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00aca80 0x7fafb006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:14.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.854+0000 7fafb4e65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fafb0069d60 0x7fafb00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:14.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.854+0000 7fafb4e65700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb006bdb0 con 0x7fafb00c81f0 2023-10-08T00:25:14.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.854+0000 7fafb4e65700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb00c8670 con 0x7fafb0069d60 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.854+0000 7fafb4e65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00cb370 con 0x7fafb00aca80 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fafb0069d60 0x7fafb00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafaed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fafb00c81f0 0x7fafb0068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37448/0 (socket says 172.21.15.22:37448) 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafaed9d700 1 -- 172.21.15.22:0/3398604579 learned_addr learned my addr 172.21.15.22:0/3398604579 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fafb0069d60 0x7fafb00c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49562/0 (socket says 172.21.15.22:49562) 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafae59c700 1 --2- 172.21.15.22:0/3398604579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00aca80 0x7fafb006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 -- 172.21.15.22:0/3398604579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00aca80 msgr2=0x7fafb006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 --2- 172.21.15.22:0/3398604579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00aca80 0x7fafb006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 -- 172.21.15.22:0/3398604579 >> v1:172.21.15.22:6789/0 conn(0x7fafb00c81f0 legacy=0x7fafb0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 -- 172.21.15.22:0/3398604579 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0159f60 con 0x7fafb0069d60 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafad59a700 1 -- 172.21.15.22:0/3398604579 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873808136 0 0) 0x7fafb006bdb0 con 0x7fafb00c81f0 2023-10-08T00:25:14.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafadd9b700 1 --2- 172.21.15.22:0/3398604579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00c7cb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf980098e0 tx=0x7faf980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4572f1e6e5042df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafad59a700 1 -- 172.21.15.22:0/3398604579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800b640 con 0x7fafb0069d60 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafad59a700 1 -- 172.21.15.22:0/3398604579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9800b7a0 con 0x7fafb0069d60 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.855+0000 7fafad59a700 1 -- 172.21.15.22:0/3398604579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800bb40 con 0x7fafb0069d60 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 -- 172.21.15.22:0/3398604579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 msgr2=0x7fafb00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 --2- 172.21.15.22:0/3398604579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00c7cb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf980098e0 tx=0x7faf980091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 -- 172.21.15.22:0/3398604579 shutdown_connections 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 --2- 172.21.15.22:0/3398604579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00aca80 0x7fafb006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 --2- 172.21.15.22:0/3398604579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00c7cb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 -- 172.21.15.22:0/3398604579 >> 172.21.15.22:0/3398604579 conn(0x7fafb00cd670 msgr2=0x7fafb00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 -- 172.21.15.22:0/3398604579 shutdown_connections 2023-10-08T00:25:14.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.856+0000 7fafb4e65700 1 -- 172.21.15.22:0/3398604579 wait complete. 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.857+0000 7fafb4e65700 1 Processor -- start 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.857+0000 7fafb4e65700 1 -- start start 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafb4e65700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafb4e65700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb00aca80 0x7fafb00af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafb4e65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00c81f0 0x7fafb015f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafb4e65700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0152e70 con 0x7fafb0069d60 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafb4e65700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb016e4f0 con 0x7fafb00aca80 2023-10-08T00:25:14.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafb4e65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00afc50 con 0x7fafb00c81f0 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00adc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49564/0 (socket says 172.21.15.22:49564) 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 -- 172.21.15.22:0/1421621918 learned_addr learned my addr 172.21.15.22:0/1421621918 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 -- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00c81f0 msgr2=0x7fafb015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00c81f0 0x7fafb015f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafadd9b700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb00aca80 0x7fafb00af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 -- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb00aca80 msgr2=0x7fafb00af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb00aca80 0x7fafb00af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 -- 172.21.15.22:0/1421621918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98009420 con 0x7fafb0069d60 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafadd9b700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb00aca80 0x7fafb00af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.858+0000 7fafae59c700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00adc20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fafa800ec80 tx=0x7fafa8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.859+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa800c9d0 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.859+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa800cb30 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.859+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb016d600 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.859+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8013470 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.859+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb016dbc0 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.860+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb004c3c0 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.860+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafa8013860 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.860+0000 7fafa67fc700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf90066f30 0x7faf900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.861+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafa8084ce0 con 0x7fafb0069d60 2023-10-08T00:25:14.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.861+0000 7fafadd9b700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf90066f30 0x7faf900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:14.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.861+0000 7fafadd9b700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf90066f30 0x7faf900693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafb006a130 tx=0x7faf98017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:14.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:14.865+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafa8051f50 con 0x7fafb0069d60 2023-10-08T00:25:15.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.058+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb006b510 con 0x7fafb0069d60 2023-10-08T00:25:15.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.059+0000 7fafa67fc700 1 -- 172.21.15.22:0/1421621918 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fafa8055570 con 0x7fafb0069d60 2023-10-08T00:25:15.060 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:15.060 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:15.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf90066f30 msgr2=0x7faf900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf90066f30 0x7faf900693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafb006a130 tx=0x7faf98017000 comp rx=0 tx=0).stop 2023-10-08T00:25:15.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 msgr2=0x7fafb00adc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00adc20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fafa800ec80 tx=0x7fafa8009120 comp rx=0 tx=0).stop 2023-10-08T00:25:15.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 shutdown_connections 2023-10-08T00:25:15.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf90066f30 0x7faf900693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafb00c81f0 0x7fafb015f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafb0069d60 0x7fafb00adc20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 --2- 172.21.15.22:0/1421621918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafb00aca80 0x7fafb00af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 >> 172.21.15.22:0/1421621918 conn(0x7fafb00cd670 msgr2=0x7fafb00c2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 shutdown_connections 2023-10-08T00:25:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.061+0000 7fafb4e65700 1 -- 172.21.15.22:0/1421621918 wait complete. 2023-10-08T00:25:15.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:15.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:15.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.196+0000 7f4390e82700 1 Processor -- start 2023-10-08T00:25:15.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.196+0000 7f4390e82700 1 -- start start 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f4390e82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f438c0b1b40 0x7f438c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f4390e82700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0cfb00 con 0x7f438c0b16d0 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f4390e82700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0b5c40 con 0x7f438c0b4e70 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f4390e82700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c0b5f20 con 0x7f438c0b1b40 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f438affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f438c0b16d0 0x7f438c0b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37464/0 (socket says 172.21.15.22:37464) 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f438affd700 1 -- 172.21.15.22:0/1963396446 learned_addr learned my addr 172.21.15.22:0/1963396446 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f438bfff700 1 --2- 172.21.15.22:0/1963396446 >> v2:172.21.15.192:3300/0 conn(0x7f438c0b1b40 0x7f438c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f438a7fc700 1 -- 172.21.15.22:0/1963396446 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679403252 0 0) 0x7f438c0cfb00 con 0x7f438c0b16d0 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.197+0000 7f438a7fc700 1 -- 172.21.15.22:0/1963396446 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4378003570 con 0x7f438c0b16d0 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438bfff700 1 -- 172.21.15.22:0/1963396446 >> v1:172.21.15.192:6789/0 conn(0x7f438c0b4e70 legacy=0x7f438c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438a7fc700 1 -- 172.21.15.22:0/1963396446 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240039153 0 0) 0x7f438c0b5c40 con 0x7f438c0b4e70 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438bfff700 1 -- 172.21.15.22:0/1963396446 >> v1:172.21.15.22:6789/0 conn(0x7f438c0b16d0 legacy=0x7f438c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438bfff700 1 -- 172.21.15.22:0/1963396446 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0b6200 con 0x7f438c0b1b40 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438bfff700 1 --2- 172.21.15.22:0/1963396446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b1b40 0x7f438c0b3ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4384009e60 tx=0x7f4384009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6b6ad7e2ba1d5a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438a7fc700 1 -- 172.21.15.22:0/1963396446 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438400e070 con 0x7f438c0b1b40 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438a7fc700 1 -- 172.21.15.22:0/1963396446 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438400bb60 con 0x7f438c0b1b40 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f438a7fc700 1 -- 172.21.15.22:0/1963396446 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384012430 con 0x7f438c0b1b40 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 -- 172.21.15.22:0/1963396446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b1b40 msgr2=0x7f438c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 --2- 172.21.15.22:0/1963396446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b1b40 0x7f438c0b3ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4384009e60 tx=0x7f4384009780 comp rx=0 tx=0).stop 2023-10-08T00:25:15.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 -- 172.21.15.22:0/1963396446 shutdown_connections 2023-10-08T00:25:15.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 --2- 172.21.15.22:0/1963396446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b1b40 0x7f438c0b3ac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 -- 172.21.15.22:0/1963396446 >> 172.21.15.22:0/1963396446 conn(0x7f438c0d10c0 msgr2=0x7f438c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:15.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 -- 172.21.15.22:0/1963396446 shutdown_connections 2023-10-08T00:25:15.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.198+0000 7f4390e82700 1 -- 172.21.15.22:0/1963396446 wait complete. 2023-10-08T00:25:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 Processor -- start 2023-10-08T00:25:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 -- start start 2023-10-08T00:25:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f438c0b16d0 0x7f438c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 0x7f438c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b4e70 0x7f438c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0c6760 con 0x7f438c0b1b40 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c158050 con 0x7f438c0b4e70 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f4390e82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0c9460 con 0x7f438c0b16d0 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.200+0000 7f438affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 0x7f438c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 0x7f438c0c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49572/0 (socket says 172.21.15.22:49572) 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 -- 172.21.15.22:0/1953345107 learned_addr learned my addr 172.21.15.22:0/1953345107 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438bfff700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b4e70 0x7f438c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438b7fe700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f438c0b16d0 0x7f438c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 -- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f438c0b16d0 msgr2=0x7f438c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f438c0b16d0 0x7f438c157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 -- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b4e70 msgr2=0x7f438c15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b4e70 0x7f438c15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 -- 172.21.15.22:0/1953345107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4384009a20 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f438affd700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 0x7f438c0c5390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f437400c790 tx=0x7f4374007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374005b30 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c0c5be0 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4374005c90 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374007320 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.201+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c0c61a0 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.202+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c0c95a0 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.203+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4374007690 con 0x7f438c0b1b40 2023-10-08T00:25:15.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.203+0000 7f43837fe700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.203+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43740839d0 con 0x7f438c0b1b40 2023-10-08T00:25:15.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.203+0000 7f438b7fe700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.204+0000 7f438b7fe700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f436c066f30 0x7f436c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f437c003a40 tx=0x7f437c007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.207+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4374050c40 con 0x7f438c0b1b40 2023-10-08T00:25:15.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.401+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f438c0cd820 con 0x7f438c0b1b40 2023-10-08T00:25:15.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.401+0000 7f43837fe700 1 -- 172.21.15.22:0/1953345107 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4374017020 con 0x7f438c0b1b40 2023-10-08T00:25:15.402 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f436c066f30 msgr2=0x7f436c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f436c066f30 0x7f436c0693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f437c003a40 tx=0x7f437c007ec0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 msgr2=0x7f438c0c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 0x7f438c0c5390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f437400c790 tx=0x7f4374007df0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 shutdown_connections 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f438c0b4e70 0x7f438c15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f436c066f30 0x7f436c0693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f438c0b16d0 0x7f438c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 --2- 172.21.15.22:0/1953345107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f438c0b1b40 0x7f438c0c5390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 >> 172.21.15.22:0/1953345107 conn(0x7f438c0d10c0 msgr2=0x7f438c0b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:15.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 shutdown_connections 2023-10-08T00:25:15.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.403+0000 7f4390e82700 1 -- 172.21.15.22:0/1953345107 wait complete. 2023-10-08T00:25:15.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:15.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.537+0000 7fa0a7775700 1 Processor -- start 2023-10-08T00:25:15.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.537+0000 7fa0a7775700 1 -- start start 2023-10-08T00:25:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a7775700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a7775700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa0a0159c60 0x7fa0a015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a7775700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa0a015db10 0x7fa0a0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a7775700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a015a160 con 0x7fa0a015db10 2023-10-08T00:25:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a7775700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a00d13a0 con 0x7fa0a0159c60 2023-10-08T00:25:15.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a7775700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a015e140 con 0x7fa0a0159890 2023-10-08T00:25:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a5d12700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa0a015db10 0x7fa0a0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a5d12700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa0a015db10 0x7fa0a0069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49584/0 (socket says 172.21.15.22:49584) 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a5d12700 1 -- 172.21.15.22:0/707550211 learned_addr learned my addr 172.21.15.22:0/707550211 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a4d10700 1 --2- 172.21.15.22:0/707550211 >> v2:172.21.15.192:3300/0 conn(0x7fa0a0159c60 0x7fa0a015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.538+0000 7fa0a5511700 1 --2- 172.21.15.22:0/707550211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a5d12700 1 -- 172.21.15.22:0/707550211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 msgr2=0x7fa0a015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a5d12700 1 --2- 172.21.15.22:0/707550211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a5d12700 1 -- 172.21.15.22:0/707550211 >> v2:172.21.15.192:3300/0 conn(0x7fa0a0159c60 msgr2=0x7fa0a015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a5d12700 1 --2- 172.21.15.22:0/707550211 >> v2:172.21.15.192:3300/0 conn(0x7fa0a0159c60 0x7fa0a015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a5d12700 1 -- 172.21.15.22:0/707550211 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a015a3d0 con 0x7fa0a015db10 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a5d12700 1 --2- 172.21.15.22:0/707550211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a015db10 0x7fa0a0069560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00650f0 tx=0x7fa098009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66246608a6bd88f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa097fff700 1 -- 172.21.15.22:0/707550211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09800e070 con 0x7fa0a015db10 2023-10-08T00:25:15.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa097fff700 1 -- 172.21.15.22:0/707550211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09800b970 con 0x7fa0a015db10 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa097fff700 1 -- 172.21.15.22:0/707550211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0980092e0 con 0x7fa0a015db10 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 -- 172.21.15.22:0/707550211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a015db10 msgr2=0x7fa0a0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 --2- 172.21.15.22:0/707550211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a015db10 0x7fa0a0069560 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00650f0 tx=0x7fa098009840 comp rx=0 tx=0).stop 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 -- 172.21.15.22:0/707550211 shutdown_connections 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 --2- 172.21.15.22:0/707550211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a015db10 0x7fa0a0069560 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 --2- 172.21.15.22:0/707550211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 --2- 172.21.15.22:0/707550211 >> v2:172.21.15.192:3300/0 conn(0x7fa0a0159c60 0x7fa0a015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.539+0000 7fa0a7775700 1 -- 172.21.15.22:0/707550211 >> 172.21.15.22:0/707550211 conn(0x7fa0a0068e20 msgr2=0x7fa0a00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.540+0000 7fa0a7775700 1 -- 172.21.15.22:0/707550211 shutdown_connections 2023-10-08T00:25:15.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.540+0000 7fa0a7775700 1 -- 172.21.15.22:0/707550211 wait complete. 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.541+0000 7fa0a7775700 1 Processor -- start 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.541+0000 7fa0a7775700 1 -- start start 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.541+0000 7fa0a7775700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a0151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 0x7fa0a00c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a015db10 0x7fa0a00b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00ce820 con 0x7fa0a0159c60 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00cdc50 con 0x7fa0a015db10 2023-10-08T00:25:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00cdef0 con 0x7fa0a0159890 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 0x7fa0a00c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 0x7fa0a00c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49592/0 (socket says 172.21.15.22:49592) 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 -- 172.21.15.22:0/3676707160 learned_addr learned my addr 172.21.15.22:0/3676707160 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a5d12700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a015db10 0x7fa0a00b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a5511700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a0151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 -- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 msgr2=0x7fa0a0151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a0151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 -- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a015db10 msgr2=0x7fa0a00b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a015db10 0x7fa0a00b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 -- 172.21.15.22:0/3676707160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098009ae0 con 0x7fa0a0159c60 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a4d10700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 0x7fa0a00c78a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa09000ec50 tx=0x7fa0900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000c850 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09000c9b0 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09000cd70 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a00ce1d0 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.542+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a0152290 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.543+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a004c3c0 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.544+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa090013680 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.544+0000 7fa0957fa700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa084066f30 0x7fa0840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.544+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0900847b0 con 0x7fa0a0159c60 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.544+0000 7fa0a5511700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa084066f30 0x7fa0840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.545+0000 7fa0a5511700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa084066f30 0x7fa0840693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009db0 tx=0x7fa09c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.548+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa090051a20 con 0x7fa0a0159c60 2023-10-08T00:25:15.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.741+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0a00ce960 con 0x7fa0a0159c60 2023-10-08T00:25:15.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.742+0000 7fa0957fa700 1 -- 172.21.15.22:0/3676707160 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa090055040 con 0x7fa0a0159c60 2023-10-08T00:25:15.742 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa084066f30 msgr2=0x7fa0840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa084066f30 0x7fa0840693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009db0 tx=0x7fa09c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 msgr2=0x7fa0a00c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 0x7fa0a00c78a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa09000ec50 tx=0x7fa0900091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 shutdown_connections 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0a015db10 0x7fa0a00b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa084066f30 0x7fa0840693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa0a0159890 0x7fa0a0151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 --2- 172.21.15.22:0/3676707160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0a0159c60 0x7fa0a00c78a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 >> 172.21.15.22:0/3676707160 conn(0x7fa0a0068e20 msgr2=0x7fa0a015b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 shutdown_connections 2023-10-08T00:25:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.744+0000 7fa0a7775700 1 -- 172.21.15.22:0/3676707160 wait complete. 2023-10-08T00:25:15.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:15.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.878+0000 7f952f591700 1 Processor -- start 2023-10-08T00:25:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.878+0000 7f952f591700 1 -- start start 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952f591700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 0x7f952815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952f591700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952815a160 con 0x7f9528159890 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952f591700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280d13a0 con 0x7f952815db10 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952f591700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952815e140 con 0x7f9528159c60 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952d32d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9528159890 0x7f952815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37470/0 (socket says 172.21.15.22:37470) 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952d32d700 1 -- 172.21.15.22:0/2797483294 learned_addr learned my addr 172.21.15.22:0/2797483294 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877647391 0 0) 0x7f952815a160 con 0x7f9528159890 2023-10-08T00:25:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9510003570 con 0x7f9528159890 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.879+0000 7f952cb2c700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 0x7f952815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2924461942 0 0) 0x7f9510003570 con 0x7f9528159890 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 msgr2=0x7f952815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 0x7f952815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 >> v1:172.21.15.192:6789/0 conn(0x7f952815db10 legacy=0x7f9528069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952815a3d0 con 0x7f9528159890 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f9520001470 con 0x7f9528159890 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 >> v1:172.21.15.22:6789/0 conn(0x7f9528159890 legacy=0x7f952815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510004810 0x7f9510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 0x7f95100051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952815e140 con 0x7f9510003a90 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951000bb60 con 0x7f9510004810 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951000bd20 con 0x7f9528159c60 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952cb2c700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510004810 0x7f9510004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952db2e700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 0x7f95100051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 -- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 msgr2=0x7f95100051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9528159c60 0x7f95100051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 -- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510004810 msgr2=0x7f9510004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510004810 0x7f9510004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 -- 172.21.15.22:0/2797483294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510003570 con 0x7f9510003a90 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.880+0000 7f952d32d700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f952000c3c0 tx=0x7f9520001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117f1c941a5e5261 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000cc90 con 0x7f9510003a90 2023-10-08T00:25:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000cdf0 con 0x7f9510003a90 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f9527fff700 1 -- 172.21.15.22:0/2797483294 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520005b50 con 0x7f9510003a90 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952f591700 1 -- 172.21.15.22:0/2797483294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9510003a90 msgr2=0x7f9510003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952f591700 1 --2- 172.21.15.22:0/2797483294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9510003a90 0x7f9510003ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f952000c3c0 tx=0x7f9520001e50 comp rx=0 tx=0).stop 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952db2e700 1 -- 172.21.15.22:0/2797483294 reap_dead start 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952f591700 1 -- 172.21.15.22:0/2797483294 shutdown_connections 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952f591700 1 -- 172.21.15.22:0/2797483294 >> 172.21.15.22:0/2797483294 conn(0x7f9528068e20 msgr2=0x7f95280d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952f591700 1 -- 172.21.15.22:0/2797483294 shutdown_connections 2023-10-08T00:25:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.881+0000 7f952f591700 1 -- 172.21.15.22:0/2797483294 wait complete. 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.882+0000 7f952f591700 1 Processor -- start 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.882+0000 7f952f591700 1 -- start start 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952f591700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510003a90 0x7f95280cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952f591700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 0x7f95280b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952f591700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f952816d440 0x7f952816d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952f591700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952815c1b0 con 0x7f95281587d0 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952f591700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952816ddd0 con 0x7f9510003a90 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952f591700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280cf3d0 con 0x7f952816d440 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952cb2c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 0x7f95280b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952cb2c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 0x7f95280b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49614/0 (socket says 172.21.15.22:49614) 2023-10-08T00:25:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952cb2c700 1 -- 172.21.15.22:0/401326510 learned_addr learned my addr 172.21.15.22:0/401326510 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952d32d700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510003a90 0x7f95280cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.883+0000 7f952db2e700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f952816d440 0x7f952816d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952cb2c700 1 -- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f952816d440 msgr2=0x7f952816d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952cb2c700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f952816d440 0x7f952816d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952cb2c700 1 -- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510003a90 msgr2=0x7f95280cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952cb2c700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510003a90 0x7f95280cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952cb2c700 1 -- 172.21.15.22:0/401326510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280cf6b0 con 0x7f95281587d0 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952db2e700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f952816d440 0x7f952816d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952cb2c700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 0x7f95280b5e70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f951c011b40 tx=0x7f951c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c00fa10 con 0x7f95281587d0 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c00fb70 con 0x7f95281587d0 2023-10-08T00:25:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c014440 con 0x7f95281587d0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952815bb60 con 0x7f95281587d0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.884+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95280b63b0 con 0x7f95281587d0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.885+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952804c3c0 con 0x7f95281587d0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.885+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f951c014870 con 0x7f95281587d0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.886+0000 7f95257fa700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.886+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f951c018030 con 0x7f95281587d0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.886+0000 7f952d32d700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.886+0000 7f952d32d700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9514066f30 0x7f95140693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9520007cd0 tx=0x7f9520015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:15.890+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f951c052160 con 0x7f95281587d0 2023-10-08T00:25:16.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.084+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f952806a5b0 con 0x7f95281587d0 2023-10-08T00:25:16.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.085+0000 7f95257fa700 1 -- 172.21.15.22:0/401326510 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f951c0220a0 con 0x7f95281587d0 2023-10-08T00:25:16.085 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9514066f30 msgr2=0x7f95140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9514066f30 0x7f95140693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9520007cd0 tx=0x7f9520015000 comp rx=0 tx=0).stop 2023-10-08T00:25:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 msgr2=0x7f95280b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 0x7f95280b5e70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f951c011b40 tx=0x7f951c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 shutdown_connections 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9514066f30 0x7f95140693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f952816d440 0x7f952816d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9510003a90 0x7f95280cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 --2- 172.21.15.22:0/401326510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95281587d0 0x7f95280b5e70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 >> 172.21.15.22:0/401326510 conn(0x7f9528068e20 msgr2=0x7f952815a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 shutdown_connections 2023-10-08T00:25:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.087+0000 7f952f591700 1 -- 172.21.15.22:0/401326510 wait complete. 2023-10-08T00:25:16.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.217+0000 7fc02349d700 1 Processor -- start 2023-10-08T00:25:16.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc02349d700 1 -- start start 2023-10-08T00:25:16.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc02349d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c141500 0x7fc01c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc02349d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc01c06c0a0 0x7fc01c0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc02349d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c15c2a0 con 0x7fc01c06bcd0 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc02349d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0c9880 con 0x7fc01c06c0a0 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc02349d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15b690 con 0x7fc01c141500 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc021a3a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc01c06c0a0 0x7fc01c0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc021239700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc01c06bcd0 0x7fc01c140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37484/0 (socket says 172.21.15.22:37484) 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.218+0000 7fc021239700 1 -- 172.21.15.22:0/656331263 learned_addr learned my addr 172.21.15.22:0/656331263 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc020a38700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c141500 0x7fc01c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc021a3a700 1 -- 172.21.15.22:0/656331263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c141500 msgr2=0x7fc01c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc021a3a700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c141500 0x7fc01c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc021a3a700 1 -- 172.21.15.22:0/656331263 >> v1:172.21.15.22:6789/0 conn(0x7fc01c06bcd0 legacy=0x7fc01c140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc021a3a700 1 -- 172.21.15.22:0/656331263 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c15b970 con 0x7fc01c06c0a0 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc020a38700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c141500 0x7fc01c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc021a3a700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c06c0a0 0x7fc01c0c9340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009e60 tx=0x7fc00c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66134f0563061764 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc01bfff700 1 -- 172.21.15.22:0/656331263 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c00e070 con 0x7fc01c06c0a0 2023-10-08T00:25:16.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc01bfff700 1 -- 172.21.15.22:0/656331263 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c00bc30 con 0x7fc01c06c0a0 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.219+0000 7fc01bfff700 1 -- 172.21.15.22:0/656331263 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c012430 con 0x7fc01c06c0a0 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 -- 172.21.15.22:0/656331263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c06c0a0 msgr2=0x7fc01c0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c06c0a0 0x7fc01c0c9340 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc00c009e60 tx=0x7fc00c009780 comp rx=0 tx=0).stop 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 -- 172.21.15.22:0/656331263 shutdown_connections 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c06c0a0 0x7fc01c0c9340 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 --2- 172.21.15.22:0/656331263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c141500 0x7fc01c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 -- 172.21.15.22:0/656331263 >> 172.21.15.22:0/656331263 conn(0x7fc01c0ce600 msgr2=0x7fc01c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 -- 172.21.15.22:0/656331263 shutdown_connections 2023-10-08T00:25:16.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.220+0000 7fc02349d700 1 -- 172.21.15.22:0/656331263 wait complete. 2023-10-08T00:25:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.221+0000 7fc02349d700 1 Processor -- start 2023-10-08T00:25:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.221+0000 7fc02349d700 1 -- start start 2023-10-08T00:25:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01c06bcd0 0x7fc01c13cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c06c0a0 0x7fc01c0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 0x7fc01c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0b4240 con 0x7fc01c141500 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0c6590 con 0x7fc01c06bcd0 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c069f50 con 0x7fc01c06c0a0 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 0x7fc01c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 0x7fc01c0c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49632/0 (socket says 172.21.15.22:49632) 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 -- 172.21.15.22:0/4106324081 learned_addr learned my addr 172.21.15.22:0/4106324081 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021239700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01c06bcd0 0x7fc01c13cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc020a38700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c06c0a0 0x7fc01c0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 -- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c06c0a0 msgr2=0x7fc01c0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c06c0a0 0x7fc01c0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 -- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01c06bcd0 msgr2=0x7fc01c13cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01c06bcd0 0x7fc01c13cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 -- 172.21.15.22:0/4106324081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c009a20 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021239700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01c06bcd0 0x7fc01c13cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc020a38700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c06c0a0 0x7fc01c0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc021a3a700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 0x7fc01c0c7b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc00c013000 tx=0x7fc00c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c01e630 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c01e7b0 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c06a230 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.222+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c01eb70 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.223+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c06a7f0 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.223+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c06aa10 con 0x7fc01c141500 2023-10-08T00:25:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.224+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc00c024070 con 0x7fc01c141500 2023-10-08T00:25:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.224+0000 7fc0197fa700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc008066f30 0x7fc0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.224+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc00c086f80 con 0x7fc01c141500 2023-10-08T00:25:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.224+0000 7fc021239700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc008066f30 0x7fc0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.225+0000 7fc021239700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc008066f30 0x7fc0080693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0140058d0 tx=0x7fc014009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.229+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc00c0b85a0 con 0x7fc01c141500 2023-10-08T00:25:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.424+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc01c04c3c0 con 0x7fc01c141500 2023-10-08T00:25:16.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.425+0000 7fc0197fa700 1 -- 172.21.15.22:0/4106324081 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc00c0541f0 con 0x7fc01c141500 2023-10-08T00:25:16.426 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:16.426 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc008066f30 msgr2=0x7fc0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc008066f30 0x7fc0080693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0140058d0 tx=0x7fc014009040 comp rx=0 tx=0).stop 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 msgr2=0x7fc01c0c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 0x7fc01c0c7b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc00c013000 tx=0x7fc00c019000 comp rx=0 tx=0).stop 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 shutdown_connections 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc01c141500 0x7fc01c0c7b20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc01c06bcd0 0x7fc01c13cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc008066f30 0x7fc0080693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 --2- 172.21.15.22:0/4106324081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc01c06c0a0 0x7fc01c0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 >> 172.21.15.22:0/4106324081 conn(0x7fc01c0ce600 msgr2=0x7fc01c0c4730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 shutdown_connections 2023-10-08T00:25:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.427+0000 7fc02349d700 1 -- 172.21.15.22:0/4106324081 wait complete. 2023-10-08T00:25:16.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:16.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:16.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.563+0000 7ff968f27700 1 Processor -- start 2023-10-08T00:25:16.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.563+0000 7ff968f27700 1 -- start start 2023-10-08T00:25:16.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff968f27700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff964159c10 0x7ff96415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff968f27700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96415c480 con 0x7ff9640b5ea0 2023-10-08T00:25:16.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff968f27700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96415b5d0 con 0x7ff96415c910 2023-10-08T00:25:16.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff968f27700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9640b2a40 con 0x7ff964159c10 2023-10-08T00:25:16.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff961d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9640b5ea0 0x7ff964068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37500/0 (socket says 172.21.15.22:37500) 2023-10-08T00:25:16.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff961d9b700 1 -- 172.21.15.22:0/3097279927 learned_addr learned my addr 172.21.15.22:0/3097279927 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96259c700 1 --2- 172.21.15.22:0/3097279927 >> v2:172.21.15.192:3300/0 conn(0x7ff964159c10 0x7ff96415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96159a700 1 -- 172.21.15.22:0/3097279927 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229421476 0 0) 0x7ff96415c480 con 0x7ff9640b5ea0 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96159a700 1 -- 172.21.15.22:0/3097279927 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff950003570 con 0x7ff9640b5ea0 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96259c700 1 -- 172.21.15.22:0/3097279927 >> v1:172.21.15.192:6789/0 conn(0x7ff96415c910 legacy=0x7ff964159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96159a700 1 -- 172.21.15.22:0/3097279927 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754547203 0 0) 0x7ff96415b5d0 con 0x7ff96415c910 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96259c700 1 -- 172.21.15.22:0/3097279927 >> v1:172.21.15.22:6789/0 conn(0x7ff9640b5ea0 legacy=0x7ff964068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.564+0000 7ff96259c700 1 -- 172.21.15.22:0/3097279927 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96415b870 con 0x7ff964159c10 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff96259c700 1 --2- 172.21.15.22:0/3097279927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96415b090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0098e0 tx=0x7ff95c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304212bec2b1dd03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff96159a700 1 -- 172.21.15.22:0/3097279927 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00b640 con 0x7ff964159c10 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff96159a700 1 -- 172.21.15.22:0/3097279927 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00b7a0 con 0x7ff964159c10 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff96159a700 1 -- 172.21.15.22:0/3097279927 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00bb40 con 0x7ff964159c10 2023-10-08T00:25:16.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 -- 172.21.15.22:0/3097279927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 msgr2=0x7ff96415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 --2- 172.21.15.22:0/3097279927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96415b090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff95c0098e0 tx=0x7ff95c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 -- 172.21.15.22:0/3097279927 shutdown_connections 2023-10-08T00:25:16.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 --2- 172.21.15.22:0/3097279927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96415b090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 -- 172.21.15.22:0/3097279927 >> 172.21.15.22:0/3097279927 conn(0x7ff964099a20 msgr2=0x7ff9640af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:16.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 -- 172.21.15.22:0/3097279927 shutdown_connections 2023-10-08T00:25:16.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.565+0000 7ff968f27700 1 -- 172.21.15.22:0/3097279927 wait complete. 2023-10-08T00:25:16.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.566+0000 7ff968f27700 1 Processor -- start 2023-10-08T00:25:16.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 -- start start 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 0x7ff96409a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff96415c910 0x7ff9641697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640c57e0 con 0x7ff9640b5ea0 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96416a3e0 con 0x7ff964159c10 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff968f27700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96416a6c0 con 0x7ff96415c910 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff96259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 0x7ff96409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff96259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 0x7ff96409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49642/0 (socket says 172.21.15.22:49642) 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff96259c700 1 -- 172.21.15.22:0/4036854245 learned_addr learned my addr 172.21.15.22:0/4036854245 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:16.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff961d9b700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.567+0000 7ff962d9d700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff96415c910 0x7ff9641697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff96259c700 1 -- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff96415c910 msgr2=0x7ff9641697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff96259c700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff96415c910 0x7ff9641697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff96259c700 1 -- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 msgr2=0x7ff96409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff96259c700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96409a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff96259c700 1 -- 172.21.15.22:0/4036854245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009420 con 0x7ff9640b5ea0 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff96259c700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 0x7ff96409a490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff964063db0 tx=0x7ff95c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c01f070 con 0x7ff9640b5ea0 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c002f70 con 0x7ff9640b5ea0 2023-10-08T00:25:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9640afcd0 con 0x7ff9640b5ea0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00bb40 con 0x7ff9640b5ea0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.568+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9640b0290 con 0x7ff9640b5ea0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.569+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9640b0480 con 0x7ff9640b5ea0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.569+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff95c011630 con 0x7ff9640b5ea0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.570+0000 7ff95a7fc700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff944066f30 0x7ff9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.570+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff95c085800 con 0x7ff9640b5ea0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.570+0000 7ff961d9b700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff944066f30 0x7ff9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.570+0000 7ff961d9b700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff944066f30 0x7ff9440693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff964158d20 tx=0x7ff94c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.574+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff95c052a70 con 0x7ff9640b5ea0 2023-10-08T00:25:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.773+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff96404c3c0 con 0x7ff9640b5ea0 2023-10-08T00:25:16.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.774+0000 7ff95a7fc700 1 -- 172.21.15.22:0/4036854245 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff95c056090 con 0x7ff9640b5ea0 2023-10-08T00:25:16.774 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff944066f30 msgr2=0x7ff9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff944066f30 0x7ff9440693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff964158d20 tx=0x7ff94c009040 comp rx=0 tx=0).stop 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 msgr2=0x7ff96409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 0x7ff96409a490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff964063db0 tx=0x7ff95c017000 comp rx=0 tx=0).stop 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 shutdown_connections 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff944066f30 0x7ff9440693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff96415c910 0x7ff9641697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9640b5ea0 0x7ff96409a490 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 --2- 172.21.15.22:0/4036854245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff964159c10 0x7ff96409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 >> 172.21.15.22:0/4036854245 conn(0x7ff964099a20 msgr2=0x7ff96415cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 shutdown_connections 2023-10-08T00:25:16.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.776+0000 7ff968f27700 1 -- 172.21.15.22:0/4036854245 wait complete. 2023-10-08T00:25:16.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.909+0000 7f2da8104700 1 Processor -- start 2023-10-08T00:25:16.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.910+0000 7f2da8104700 1 -- start start 2023-10-08T00:25:16.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.910+0000 7f2da8104700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2da0159c60 0x7f2da015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.910+0000 7f2da8104700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2da015db10 0x7f2da0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.910+0000 7f2da8104700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da015a160 con 0x7f2da0159890 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.910+0000 7f2da8104700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da015df50 con 0x7f2da0159c60 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.910+0000 7f2da8104700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da00d13a0 con 0x7f2da015db10 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2da0159c60 0x7f2da015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2da0159c60 0x7f2da015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40640/0 (socket says 172.21.15.22:40640) 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 -- 172.21.15.22:0/2527473147 learned_addr learned my addr 172.21.15.22:0/2527473147 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da66a1700 1 --2- 172.21.15.22:0/2527473147 >> v2:172.21.15.192:3300/0 conn(0x7f2da015db10 0x7f2da0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 -- 172.21.15.22:0/2527473147 >> v2:172.21.15.192:3300/0 conn(0x7f2da015db10 msgr2=0x7f2da0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 --2- 172.21.15.22:0/2527473147 >> v2:172.21.15.192:3300/0 conn(0x7f2da015db10 0x7f2da0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 -- 172.21.15.22:0/2527473147 >> v1:172.21.15.192:6789/0 conn(0x7f2da0159890 legacy=0x7f2da015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 -- 172.21.15.22:0/2527473147 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da015e140 con 0x7f2da0159c60 2023-10-08T00:25:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da569f700 1 --2- 172.21.15.22:0/2527473147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159c60 0x7f2da015d5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2da006a890 tx=0x7f2d94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af7cc7619442842 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da4e9e700 1 -- 172.21.15.22:0/2527473147 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400b860 con 0x7f2da0159c60 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da4e9e700 1 -- 172.21.15.22:0/2527473147 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9400b9c0 con 0x7f2da0159c60 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.911+0000 7f2da4e9e700 1 -- 172.21.15.22:0/2527473147 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400bd60 con 0x7f2da0159c60 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 -- 172.21.15.22:0/2527473147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159c60 msgr2=0x7f2da015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 --2- 172.21.15.22:0/2527473147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159c60 0x7f2da015d5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2da006a890 tx=0x7f2d94009250 comp rx=0 tx=0).stop 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 -- 172.21.15.22:0/2527473147 shutdown_connections 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 --2- 172.21.15.22:0/2527473147 >> v2:172.21.15.192:3300/0 conn(0x7f2da015db10 0x7f2da0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 --2- 172.21.15.22:0/2527473147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159c60 0x7f2da015d5d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 -- 172.21.15.22:0/2527473147 >> 172.21.15.22:0/2527473147 conn(0x7f2da0068e20 msgr2=0x7f2da00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 -- 172.21.15.22:0/2527473147 shutdown_connections 2023-10-08T00:25:16.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.912+0000 7f2da8104700 1 -- 172.21.15.22:0/2527473147 wait complete. 2023-10-08T00:25:16.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.913+0000 7f2da8104700 1 Processor -- start 2023-10-08T00:25:16.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.913+0000 7f2da8104700 1 -- start start 2023-10-08T00:25:16.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 0x7f2da0149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da0159c60 0x7f2da014afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da015db10 0x7f2da016d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da016ddf0 con 0x7f2da0159890 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da016e0d0 con 0x7f2da0159c60 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00b0540 con 0x7f2da015db10 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 0x7f2da0149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 0x7f2da0149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40648/0 (socket says 172.21.15.22:40648) 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 -- 172.21.15.22:0/143922074 learned_addr learned my addr 172.21.15.22:0/143922074 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da569f700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da0159c60 0x7f2da014afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da66a1700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da015db10 0x7f2da016d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 -- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da015db10 msgr2=0x7f2da016d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da015db10 0x7f2da016d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 -- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da0159c60 msgr2=0x7f2da014afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da0159c60 0x7f2da014afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 -- 172.21.15.22:0/143922074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d940094f0 con 0x7f2da0159890 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da569f700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da0159c60 0x7f2da014afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da5ea0700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 0x7f2da0149ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000cb10 tx=0x7f2d900017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000a760 con 0x7f2da0159890 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000a8e0 con 0x7f2da0159890 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.914+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00b0820 con 0x7f2da0159890 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.915+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000aca0 con 0x7f2da0159890 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.915+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da014a430 con 0x7f2da0159890 2023-10-08T00:25:16.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.916+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da004c3c0 con 0x7f2da0159890 2023-10-08T00:25:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.916+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d90003030 con 0x7f2da0159890 2023-10-08T00:25:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.916+0000 7f2d9dffb700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d8c066f30 0x7f2d8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.917+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d90084660 con 0x7f2da0159890 2023-10-08T00:25:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.917+0000 7f2da569f700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d8c066f30 0x7f2d8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:16.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.917+0000 7f2da569f700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d8c066f30 0x7f2d8c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2da006a890 tx=0x7f2d94017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:16.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:16.921+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d90051980 con 0x7f2da0159890 2023-10-08T00:25:17.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.115+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2da006a5b0 con 0x7f2da0159890 2023-10-08T00:25:17.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.115+0000 7f2d9dffb700 1 -- 172.21.15.22:0/143922074 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d90054fa0 con 0x7f2da0159890 2023-10-08T00:25:17.116 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:17.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.117+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d8c066f30 msgr2=0x7f2d8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.117+0000 7f2da8104700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d8c066f30 0x7f2d8c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2da006a890 tx=0x7f2d94017000 comp rx=0 tx=0).stop 2023-10-08T00:25:17.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 msgr2=0x7f2da0149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 0x7f2da0149ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000cb10 tx=0x7f2d900017b0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 shutdown_connections 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d8c066f30 0x7f2d8c0693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2da015db10 0x7f2da016d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da0159890 0x7f2da0149ef0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 --2- 172.21.15.22:0/143922074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2da0159c60 0x7f2da014afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 >> 172.21.15.22:0/143922074 conn(0x7f2da0068e20 msgr2=0x7f2da014d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 shutdown_connections 2023-10-08T00:25:17.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.118+0000 7f2da8104700 1 -- 172.21.15.22:0/143922074 wait complete. 2023-10-08T00:25:17.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.251+0000 7fd71736b700 1 Processor -- start 2023-10-08T00:25:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.251+0000 7fd71736b700 1 -- start start 2023-10-08T00:25:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd71736b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7100b4e70 0x7fd7100ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd71736b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7100b16d0 0x7fd7100b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd71736b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100b2080 con 0x7fd71015d240 2023-10-08T00:25:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd71736b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7100cfb00 con 0x7fd7100b16d0 2023-10-08T00:25:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd71736b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7100b5c40 con 0x7fd7100b4e70 2023-10-08T00:25:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd715b68700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7100b16d0 0x7fd7100b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd716b6a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd71015d240 0x7fd71015d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37468/0 (socket says 172.21.15.22:37468) 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd716b6a700 1 -- 172.21.15.22:0/1181678919 learned_addr learned my addr 172.21.15.22:0/1181678919 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd716369700 1 --2- 172.21.15.22:0/1181678919 >> v2:172.21.15.192:3300/0 conn(0x7fd7100b4e70 0x7fd7100ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd715b68700 1 -- 172.21.15.22:0/1181678919 >> v2:172.21.15.192:3300/0 conn(0x7fd7100b4e70 msgr2=0x7fd7100ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd715b68700 1 --2- 172.21.15.22:0/1181678919 >> v2:172.21.15.192:3300/0 conn(0x7fd7100b4e70 0x7fd7100ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd715b68700 1 -- 172.21.15.22:0/1181678919 >> v1:172.21.15.22:6789/0 conn(0x7fd71015d240 legacy=0x7fd71015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd715367700 1 -- 172.21.15.22:0/1181678919 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69859827 0 0) 0x7fd7100b2080 con 0x7fd71015d240 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.252+0000 7fd715b68700 1 -- 172.21.15.22:0/1181678919 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100b5f20 con 0x7fd7100b16d0 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd715b68700 1 --2- 172.21.15.22:0/1181678919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7100b16d0 0x7fd7100b1b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd710064910 tx=0x7fd7040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51b1c745968f033 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd715367700 1 -- 172.21.15.22:0/1181678919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400b6b0 con 0x7fd7100b16d0 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd715367700 1 -- 172.21.15.22:0/1181678919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400b810 con 0x7fd7100b16d0 2023-10-08T00:25:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd715367700 1 -- 172.21.15.22:0/1181678919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400bbb0 con 0x7fd7100b16d0 2023-10-08T00:25:17.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 -- 172.21.15.22:0/1181678919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7100b16d0 msgr2=0x7fd7100b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 --2- 172.21.15.22:0/1181678919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7100b16d0 0x7fd7100b1b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd710064910 tx=0x7fd7040091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 -- 172.21.15.22:0/1181678919 shutdown_connections 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 --2- 172.21.15.22:0/1181678919 >> v2:172.21.15.192:3300/0 conn(0x7fd7100b4e70 0x7fd7100ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 --2- 172.21.15.22:0/1181678919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7100b16d0 0x7fd7100b1b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 -- 172.21.15.22:0/1181678919 >> 172.21.15.22:0/1181678919 conn(0x7fd7100d10c0 msgr2=0x7fd7100affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 -- 172.21.15.22:0/1181678919 shutdown_connections 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.253+0000 7fd71736b700 1 -- 172.21.15.22:0/1181678919 wait complete. 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.254+0000 7fd71736b700 1 Processor -- start 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 -- start start 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7100b16d0 0x7fd7100c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7100b4e70 0x7fd710169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 0x7fd71015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016ac80 con 0x7fd71015d240 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016d750 con 0x7fd7100b4e70 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd71736b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71016a6c0 con 0x7fd7100b16d0 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd716b6a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 0x7fd71015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd716b6a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 0x7fd71015e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40664/0 (socket says 172.21.15.22:40664) 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd716b6a700 1 -- 172.21.15.22:0/70515460 learned_addr learned my addr 172.21.15.22:0/70515460 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd715b68700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7100b4e70 0x7fd710169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.255+0000 7fd716369700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7100b16d0 0x7fd7100c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd716b6a700 1 -- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7100b16d0 msgr2=0x7fd7100c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd716b6a700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7100b16d0 0x7fd7100c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd716b6a700 1 -- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7100b4e70 msgr2=0x7fd710169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd716b6a700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7100b4e70 0x7fd710169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd716b6a700 1 -- 172.21.15.22:0/70515460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704009420 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd716b6a700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 0x7fd71015e630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd70000cbf0 tx=0x7fd7000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000a8b0 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000aa10 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71016a9a0 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000add0 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.256+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7100c86f0 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.257+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71016d240 con 0x7fd71015d240 2023-10-08T00:25:17.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.257+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd700007300 con 0x7fd71015d240 2023-10-08T00:25:17.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.258+0000 7fd70e7fc700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6fc066f30 0x7fd6fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.258+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd700084830 con 0x7fd71015d240 2023-10-08T00:25:17.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.258+0000 7fd716369700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6fc066f30 0x7fd6fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.259+0000 7fd716369700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6fc066f30 0x7fd6fc0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd708006fd0 tx=0x7fd708008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.262+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd71016d240 con 0x7fd71015d240 2023-10-08T00:25:17.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.454+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd71016d240 con 0x7fd71015d240 2023-10-08T00:25:17.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.454+0000 7fd70e7fc700 1 -- 172.21.15.22:0/70515460 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd71016d240 con 0x7fd71015d240 2023-10-08T00:25:17.455 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:17.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6fc066f30 msgr2=0x7fd6fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6fc066f30 0x7fd6fc0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd708006fd0 tx=0x7fd708008040 comp rx=0 tx=0).stop 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 msgr2=0x7fd71015e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 0x7fd71015e630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd70000cbf0 tx=0x7fd7000019b0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 shutdown_connections 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd71015d240 0x7fd71015e630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6fc066f30 0x7fd6fc0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7100b16d0 0x7fd7100c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 --2- 172.21.15.22:0/70515460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7100b4e70 0x7fd710169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 >> 172.21.15.22:0/70515460 conn(0x7fd7100d10c0 msgr2=0x7fd7100b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 shutdown_connections 2023-10-08T00:25:17.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.456+0000 7fd71736b700 1 -- 172.21.15.22:0/70515460 wait complete. 2023-10-08T00:25:17.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:17.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.587+0000 7f96171a1700 1 Processor -- start 2023-10-08T00:25:17.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.587+0000 7f96171a1700 1 -- start start 2023-10-08T00:25:17.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96171a1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9610159420 0x7f96100b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96171a1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f961015d230 0x7f961015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96171a1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100b2980 con 0x7f96101597f0 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96171a1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961015db70 con 0x7f961015d230 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96171a1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100b11d0 con 0x7f9610159420 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f961015d230 0x7f961015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f961015d230 0x7f961015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40666/0 (socket says 172.21.15.22:40666) 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 -- 172.21.15.22:0/1001763766 learned_addr learned my addr 172.21.15.22:0/1001763766 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f961619f700 1 --2- 172.21.15.22:0/1001763766 >> v2:172.21.15.192:3300/0 conn(0x7f9610159420 0x7f96100b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 -- 172.21.15.22:0/1001763766 >> v2:172.21.15.192:3300/0 conn(0x7f9610159420 msgr2=0x7f96100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 --2- 172.21.15.22:0/1001763766 >> v2:172.21.15.192:3300/0 conn(0x7f9610159420 0x7f96100b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 -- 172.21.15.22:0/1001763766 >> v1:172.21.15.192:6789/0 conn(0x7f96101597f0 legacy=0x7f96100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 -- 172.21.15.22:0/1001763766 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100b14b0 con 0x7f961015d230 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.588+0000 7f96169a0700 1 --2- 172.21.15.22:0/1001763766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f961015d230 0x7f961015d630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96100b2f20 tx=0x7f9608009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a561e3a8e5cdbf09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f961519d700 1 -- 172.21.15.22:0/1001763766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e070 con 0x7f961015d230 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f961519d700 1 -- 172.21.15.22:0/1001763766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800ba10 con 0x7f961015d230 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f961519d700 1 -- 172.21.15.22:0/1001763766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080092e0 con 0x7f961015d230 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 -- 172.21.15.22:0/1001763766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f961015d230 msgr2=0x7f961015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 --2- 172.21.15.22:0/1001763766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f961015d230 0x7f961015d630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96100b2f20 tx=0x7f9608009840 comp rx=0 tx=0).stop 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 -- 172.21.15.22:0/1001763766 shutdown_connections 2023-10-08T00:25:17.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 --2- 172.21.15.22:0/1001763766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f961015d230 0x7f961015d630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 --2- 172.21.15.22:0/1001763766 >> v2:172.21.15.192:3300/0 conn(0x7f9610159420 0x7f96100b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 -- 172.21.15.22:0/1001763766 >> 172.21.15.22:0/1001763766 conn(0x7f96100d0660 msgr2=0x7f96100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:17.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 -- 172.21.15.22:0/1001763766 shutdown_connections 2023-10-08T00:25:17.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.589+0000 7f96171a1700 1 -- 172.21.15.22:0/1001763766 wait complete. 2023-10-08T00:25:17.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.590+0000 7f96171a1700 1 Processor -- start 2023-10-08T00:25:17.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.590+0000 7f96171a1700 1 -- start start 2023-10-08T00:25:17.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96171a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159420 0x7f96100c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96171a1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 0x7f9610168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96171a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f961015d230 0x7f96100b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96171a1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961016b3b0 con 0x7f96101597f0 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96171a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100c5f70 con 0x7f961015d230 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96171a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961016a4c0 con 0x7f9610159420 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f961599e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 0x7f9610168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f961599e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 0x7f9610168b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40678/0 (socket says 172.21.15.22:40678) 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f961599e700 1 -- 172.21.15.22:0/3517810027 learned_addr learned my addr 172.21.15.22:0/3517810027 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f961619f700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159420 0x7f96100c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.591+0000 7f96169a0700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f961015d230 0x7f96100b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f961599e700 1 -- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159420 msgr2=0x7f96100c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f961599e700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159420 0x7f96100c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f961599e700 1 -- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f961015d230 msgr2=0x7f96100b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f961599e700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f961015d230 0x7f96100b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f961599e700 1 -- 172.21.15.22:0/3517810027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009ae0 con 0x7f96101597f0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f961599e700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 0x7f9610168b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f960000c590 tx=0x7f9600007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011590 con 0x7f96101597f0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96000116f0 con 0x7f96101597f0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961016a7a0 con 0x7f96101597f0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011ab0 con 0x7f96101597f0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.592+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961016ad60 con 0x7f96101597f0 2023-10-08T00:25:17.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.593+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961016b560 con 0x7f96101597f0 2023-10-08T00:25:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.593+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f960001c460 con 0x7f96101597f0 2023-10-08T00:25:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.594+0000 7f96067fc700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.594+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9600084140 con 0x7f96101597f0 2023-10-08T00:25:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.594+0000 7f961619f700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.594+0000 7f961619f700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f960c006fd0 tx=0x7f960c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.598+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f961016b560 con 0x7f96101597f0 2023-10-08T00:25:17.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.799+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f961016b4f0 con 0x7f96101597f0 2023-10-08T00:25:17.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.800+0000 7f96067fc700 1 -- 172.21.15.22:0/3517810027 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f96000513b0 con 0x7f96101597f0 2023-10-08T00:25:17.800 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:17.800 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95f4066f30 msgr2=0x7f95f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f960c006fd0 tx=0x7f960c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 msgr2=0x7f9610168b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 0x7f9610168b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f960000c590 tx=0x7f9600007f30 comp rx=0 tx=0).stop 2023-10-08T00:25:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 shutdown_connections 2023-10-08T00:25:17.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f961015d230 0x7f96100b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159420 0x7f96100c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 --2- 172.21.15.22:0/3517810027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96101597f0 0x7f9610168b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.801+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 >> 172.21.15.22:0/3517810027 conn(0x7f96100d0660 msgr2=0x7f9610156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.802+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 shutdown_connections 2023-10-08T00:25:17.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.802+0000 7f96171a1700 1 -- 172.21.15.22:0/3517810027 wait complete. 2023-10-08T00:25:17.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:17.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:17.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.936+0000 7f4e2e8de700 1 Processor -- start 2023-10-08T00:25:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.936+0000 7f4e2e8de700 1 -- start start 2023-10-08T00:25:17.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e2e8de700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e28159c10 0x7f4e2815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e2e8de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 0x7f4e2815cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e2e8de700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2815c480 con 0x7f4e280b5ea0 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e2e8de700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e280b2a40 con 0x7f4e28159c10 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e2e8de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2815d290 con 0x7f4e2815c910 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e277fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4e280b5ea0 0x7f4e28068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37478/0 (socket says 172.21.15.22:37478) 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e277fe700 1 -- 172.21.15.22:0/2450388428 learned_addr learned my addr 172.21.15.22:0/2450388428 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e27fff700 1 --2- 172.21.15.22:0/2450388428 >> v2:172.21.15.192:3300/0 conn(0x7f4e28159c10 0x7f4e2815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594639982 0 0) 0x7f4e2815c480 con 0x7f4e280b5ea0 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e2ce7b700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 0x7f4e2815cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e14003570 con 0x7f4e280b5ea0 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209247432 0 0) 0x7f4e14003570 con 0x7f4e280b5ea0 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 msgr2=0x7f4e2815cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 0x7f4e2815cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 >> v2:172.21.15.192:3300/0 conn(0x7f4e28159c10 msgr2=0x7f4e2815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 --2- 172.21.15.22:0/2450388428 >> v2:172.21.15.192:3300/0 conn(0x7f4e28159c10 0x7f4e2815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2815b5d0 con 0x7f4e280b5ea0 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f4e18001470 con 0x7f4e280b5ea0 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 >> v1:172.21.15.22:6789/0 conn(0x7f4e280b5ea0 legacy=0x7f4e28068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14003a60 0x7f4e14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e14004810 0x7f4e14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 0x7f4e140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.937+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2815d290 con 0x7f4e14004810 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1400ba60 con 0x7f4e14003a60 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1400bba0 con 0x7f4e2815c910 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e14004810 0x7f4e14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e27fff700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14003a60 0x7f4e14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e2ce7b700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 0x7f4e140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 -- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 msgr2=0x7f4e140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815c910 0x7f4e140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 -- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14003a60 msgr2=0x7f4e14003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14003a60 0x7f4e14003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 -- 172.21.15.22:0/2450388428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14003570 con 0x7f4e14004810 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e14004810 0x7f4e14004c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800c3f0 tx=0x7f4e2815b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275a54941964da72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800cc80 con 0x7f4e14004810 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800cde0 con 0x7f4e14004810 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.938+0000 7f4e26ffd700 1 -- 172.21.15.22:0/2450388428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18005b70 con 0x7f4e14004810 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2450388428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e14004810 msgr2=0x7f4e14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2450388428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e14004810 0x7f4e14004c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800c3f0 tx=0x7f4e2815b760 comp rx=0 tx=0).stop 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2ce7b700 1 -- 172.21.15.22:0/2450388428 reap_dead start 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2450388428 shutdown_connections 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2450388428 >> 172.21.15.22:0/2450388428 conn(0x7f4e28099a20 msgr2=0x7f4e280af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2450388428 shutdown_connections 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.939+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2450388428 wait complete. 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.940+0000 7f4e2e8de700 1 Processor -- start 2023-10-08T00:25:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.940+0000 7f4e2e8de700 1 -- start start 2023-10-08T00:25:17.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2e8de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14004810 0x7f4e280af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2e8de700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 0x7f4e280b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2e8de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815f840 0x7f4e2815fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2e8de700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e281601f0 con 0x7f4e28169ea0 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2e8de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2816b5e0 con 0x7f4e14004810 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2e8de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2816a9d0 con 0x7f4e2815f840 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 0x7f4e280b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 0x7f4e280b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40704/0 (socket says 172.21.15.22:40704) 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 -- 172.21.15.22:0/2428181959 learned_addr learned my addr 172.21.15.22:0/2428181959 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e27fff700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14004810 0x7f4e280af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e2ce7b700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815f840 0x7f4e2815fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 -- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815f840 msgr2=0x7f4e2815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815f840 0x7f4e2815fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 -- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14004810 msgr2=0x7f4e280af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14004810 0x7f4e280af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 -- 172.21.15.22:0/2428181959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2816acb0 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e277fe700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 0x7f4e280b0f60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e140046d0 tx=0x7f4e18015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.941+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18000fe0 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.942+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e180072e0 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.942+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18007680 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.942+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2816af90 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.942+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2816a310 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.942+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2816b770 con 0x7f4e28169ea0 2023-10-08T00:25:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.943+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e18019030 con 0x7f4e28169ea0 2023-10-08T00:25:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.943+0000 7f4e1ffff700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.943+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e180855e0 con 0x7f4e28169ea0 2023-10-08T00:25:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.944+0000 7f4e27fff700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.944+0000 7f4e27fff700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e08066f30 0x7f4e080693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e10006f00 tx=0x7f4e10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:17.948+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e18052850 con 0x7f4e28169ea0 2023-10-08T00:25:18.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.138+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e281601f0 con 0x7f4e28169ea0 2023-10-08T00:25:18.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.139+0000 7f4e1ffff700 1 -- 172.21.15.22:0/2428181959 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e18055e70 con 0x7f4e28169ea0 2023-10-08T00:25:18.140 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e08066f30 msgr2=0x7f4e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e08066f30 0x7f4e080693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e10006f00 tx=0x7f4e10008040 comp rx=0 tx=0).stop 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 msgr2=0x7f4e280b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 0x7f4e280b0f60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e140046d0 tx=0x7f4e18015000 comp rx=0 tx=0).stop 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 shutdown_connections 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e08066f30 0x7f4e080693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e2815f840 0x7f4e2815fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e14004810 0x7f4e280af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 --2- 172.21.15.22:0/2428181959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e28169ea0 0x7f4e280b0f60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 >> 172.21.15.22:0/2428181959 conn(0x7f4e28099a20 msgr2=0x7f4e2809d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:18.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 shutdown_connections 2023-10-08T00:25:18.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.141+0000 7f4e2e8de700 1 -- 172.21.15.22:0/2428181959 wait complete. 2023-10-08T00:25:18.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:18.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.275+0000 7f0bfd7a2700 1 Processor -- start 2023-10-08T00:25:18.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.275+0000 7f0bfd7a2700 1 -- start start 2023-10-08T00:25:18.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfd7a2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0bf80b4e70 0x7f0bf80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfd7a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfd7a2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf80b2080 con 0x7f0bf815d240 2023-10-08T00:25:18.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfd7a2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf80cfb00 con 0x7f0bf80b4e70 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfd7a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80b5c40 con 0x7f0bf80b16d0 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf7fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0bf80b4e70 0x7f0bf80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfcfa1700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0bf815d240 0x7f0bf815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:48092/0 (socket says 172.21.15.22:48092) 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf7fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0bf80b4e70 0x7f0bf80ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:37038/0 (socket says 172.21.15.22:37038) 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bfcfa1700 1 -- 172.21.15.22:0/830714889 learned_addr learned my addr 172.21.15.22:0/830714889 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf7fff700 1 -- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 msgr2=0x7f0bf80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf7fff700 1 --2- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf7fff700 1 -- 172.21.15.22:0/830714889 >> v1:172.21.15.192:6789/0 conn(0x7f0bf815d240 legacy=0x7f0bf815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.276+0000 7f0bf7fff700 1 -- 172.21.15.22:0/830714889 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80b5f20 con 0x7f0bf80b4e70 2023-10-08T00:25:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bf7fff700 1 --2- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf80ccff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0be80098e0 tx=0x7f0be80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3294630e8dd28b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bf6ffd700 1 -- 172.21.15.22:0/830714889 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8011630 con 0x7f0bf80b4e70 2023-10-08T00:25:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bf6ffd700 1 -- 172.21.15.22:0/830714889 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8011790 con 0x7f0bf80b4e70 2023-10-08T00:25:18.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bf6ffd700 1 -- 172.21.15.22:0/830714889 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8011b30 con 0x7f0bf80b4e70 2023-10-08T00:25:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 msgr2=0x7f0bf80ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf80ccff0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0be80098e0 tx=0x7f0be80091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/830714889 shutdown_connections 2023-10-08T00:25:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf80ccff0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/830714889 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/830714889 >> 172.21.15.22:0/830714889 conn(0x7f0bf80d10c0 msgr2=0x7f0bf80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/830714889 shutdown_connections 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.277+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/830714889 wait complete. 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.278+0000 7f0bfd7a2700 1 Processor -- start 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 -- start start 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf8158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 0x7f0bf80c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80c6e10 con 0x7f0bf815d240 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80c72a0 con 0x7f0bf80b4e70 2023-10-08T00:25:18.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfd7a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf80c64e0 con 0x7f0bf80b16d0 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.279+0000 7f0bfcfa1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 0x7f0bf80c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bf77fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bf7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf8158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 0x7f0bf80c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40706/0 (socket says 172.21.15.22:40706) 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 -- 172.21.15.22:0/93195903 learned_addr learned my addr 172.21.15.22:0/93195903 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 -- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 msgr2=0x7f0bf8158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf8158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 -- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 msgr2=0x7f0bf814c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf814c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 -- 172.21.15.22:0/93195903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8009420 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bf77fe700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfcfa1700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 0x7f0bf80c7500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000cd50 tx=0x7f0bf0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000ce50 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf000aac0 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf80c67c0 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000ae80 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.280+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf80c7a40 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.281+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf8088990 con 0x7f0bf815d240 2023-10-08T00:25:18.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.282+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bf0007300 con 0x7f0bf815d240 2023-10-08T00:25:18.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.282+0000 7f0beffff700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.282+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bf00848a0 con 0x7f0bf815d240 2023-10-08T00:25:18.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.282+0000 7f0bf7fff700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.283+0000 7f0bf7fff700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bd8066f30 0x7f0bd80693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0be80030c0 tx=0x7f0be8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.286+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bf0051b90 con 0x7f0bf815d240 2023-10-08T00:25:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.476+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bf80c6f50 con 0x7f0bf815d240 2023-10-08T00:25:18.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.476+0000 7f0beffff700 1 -- 172.21.15.22:0/93195903 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bf00551b0 con 0x7f0bf815d240 2023-10-08T00:25:18.479 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bd8066f30 msgr2=0x7f0bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bd8066f30 0x7f0bd80693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0be80030c0 tx=0x7f0be8016000 comp rx=0 tx=0).stop 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 msgr2=0x7f0bf80c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 0x7f0bf80c7500 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000cd50 tx=0x7f0bf0001ab0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 shutdown_connections 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bf815d240 0x7f0bf80c7500 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bd8066f30 0x7f0bd80693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bf80b16d0 0x7f0bf8158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 --2- 172.21.15.22:0/93195903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bf80b4e70 0x7f0bf814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 >> 172.21.15.22:0/93195903 conn(0x7f0bf80d10c0 msgr2=0x7f0bf80b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:18.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 shutdown_connections 2023-10-08T00:25:18.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.478+0000 7f0bfd7a2700 1 -- 172.21.15.22:0/93195903 wait complete. 2023-10-08T00:25:18.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:18.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.612+0000 7f6b84d6a700 1 Processor -- start 2023-10-08T00:25:18.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.612+0000 7f6b84d6a700 1 -- start start 2023-10-08T00:25:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b84d6a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b84d6a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6b80159c60 0x7f6b8015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b84d6a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6b8015db10 0x7f6b80069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b84d6a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8015a160 con 0x7f6b8015db10 2023-10-08T00:25:18.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b84d6a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b800d13a0 con 0x7f6b80159c60 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b84d6a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8015e140 con 0x7f6b80159890 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b7ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6b8015db10 0x7f6b80069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b7ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6b8015db10 0x7f6b80069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40714/0 (socket says 172.21.15.22:40714) 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b7ed9d700 1 -- 172.21.15.22:0/2425321379 learned_addr learned my addr 172.21.15.22:0/2425321379 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b7dd9b700 1 --2- 172.21.15.22:0/2425321379 >> v2:172.21.15.192:3300/0 conn(0x7f6b80159c60 0x7f6b8015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b7ed9d700 1 -- 172.21.15.22:0/2425321379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 msgr2=0x7f6b8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.613+0000 7f6b7e59c700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7ed9d700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7ed9d700 1 -- 172.21.15.22:0/2425321379 >> v2:172.21.15.192:3300/0 conn(0x7f6b80159c60 msgr2=0x7f6b8015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7ed9d700 1 --2- 172.21.15.22:0/2425321379 >> v2:172.21.15.192:3300/0 conn(0x7f6b80159c60 0x7f6b8015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7ed9d700 1 -- 172.21.15.22:0/2425321379 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8015a3d0 con 0x7f6b8015db10 2023-10-08T00:25:18.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7e59c700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7ed9d700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8015db10 0x7f6b80069560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b800650f0 tx=0x7f6b78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9068a1bd490518f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7d59a700 1 -- 172.21.15.22:0/2425321379 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800b860 con 0x7f6b8015db10 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7d59a700 1 -- 172.21.15.22:0/2425321379 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7800b9c0 con 0x7f6b8015db10 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b7d59a700 1 -- 172.21.15.22:0/2425321379 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7800bd60 con 0x7f6b8015db10 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 -- 172.21.15.22:0/2425321379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8015db10 msgr2=0x7f6b80069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8015db10 0x7f6b80069560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6b800650f0 tx=0x7f6b78009250 comp rx=0 tx=0).stop 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 -- 172.21.15.22:0/2425321379 shutdown_connections 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b8015db10 0x7f6b80069560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/2425321379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/2425321379 >> v2:172.21.15.192:3300/0 conn(0x7f6b80159c60 0x7f6b8015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.614+0000 7f6b84d6a700 1 -- 172.21.15.22:0/2425321379 >> 172.21.15.22:0/2425321379 conn(0x7f6b80068e20 msgr2=0x7f6b800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:18.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.615+0000 7f6b84d6a700 1 -- 172.21.15.22:0/2425321379 shutdown_connections 2023-10-08T00:25:18.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.615+0000 7f6b84d6a700 1 -- 172.21.15.22:0/2425321379 wait complete. 2023-10-08T00:25:18.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 Processor -- start 2023-10-08T00:25:18.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 -- start start 2023-10-08T00:25:18.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 0x7f6b800cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b8015db10 0x7f6b80151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800b3750 con 0x7f6b80159c60 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800cff10 con 0x7f6b8015db10 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b84d6a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800cf670 con 0x7f6b80159890 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b7dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 0x7f6b800cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b7dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 0x7f6b800cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40716/0 (socket says 172.21.15.22:40716) 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.616+0000 7f6b7dd9b700 1 -- 172.21.15.22:0/1586950329 learned_addr learned my addr 172.21.15.22:0/1586950329 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7ed9d700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b8015db10 0x7f6b80151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7e59c700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7dd9b700 1 -- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 msgr2=0x7f6b8014d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7dd9b700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8014d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7dd9b700 1 -- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b8015db10 msgr2=0x7f6b80151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7dd9b700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b8015db10 0x7f6b80151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7dd9b700 1 -- 172.21.15.22:0/1586950329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780094f0 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7e59c700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8014d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b7dd9b700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 0x7f6b800cebc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800d860 tx=0x7f6b68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680125f0 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68012750 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b800cf950 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68012af0 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.617+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8014d890 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.618+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b800b38c0 con 0x7f6b80159c60 2023-10-08T00:25:18.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.618+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b6801e460 con 0x7f6b80159c60 2023-10-08T00:25:18.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.619+0000 7f6b767fc700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b60066f30 0x7f6b600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.619+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b68084b10 con 0x7f6b80159c60 2023-10-08T00:25:18.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.619+0000 7f6b7e59c700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b60066f30 0x7f6b600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.620+0000 7f6b7e59c700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b60066f30 0x7f6b600693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b70007fd0 tx=0x7f6b700077a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.623+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b800b38c0 con 0x7f6b80159c60 2023-10-08T00:25:18.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.819+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b800b38c0 con 0x7f6b80159c60 2023-10-08T00:25:18.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.820+0000 7f6b767fc700 1 -- 172.21.15.22:0/1586950329 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b800b38c0 con 0x7f6b80159c60 2023-10-08T00:25:18.820 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:18.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b60066f30 msgr2=0x7f6b600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b60066f30 0x7f6b600693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6b70007fd0 tx=0x7f6b700077a0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 msgr2=0x7f6b800cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 0x7f6b800cebc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800d860 tx=0x7f6b68008040 comp rx=0 tx=0).stop 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 shutdown_connections 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b8015db10 0x7f6b80151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b60066f30 0x7f6b600693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b80159890 0x7f6b8014d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 --2- 172.21.15.22:0/1586950329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b80159c60 0x7f6b800cebc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 >> 172.21.15.22:0/1586950329 conn(0x7f6b80068e20 msgr2=0x7f6b80069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 shutdown_connections 2023-10-08T00:25:18.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.822+0000 7f6b84d6a700 1 -- 172.21.15.22:0/1586950329 wait complete. 2023-10-08T00:25:18.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:18.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.952+0000 7fb85fc95700 1 Processor -- start 2023-10-08T00:25:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.953+0000 7fb85fc95700 1 -- start start 2023-10-08T00:25:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.953+0000 7fb85fc95700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb858159890 0x7fb85815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.953+0000 7fb85fc95700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb858159c60 0x7fb85815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85fc95700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85815a160 con 0x7fb85815db10 2023-10-08T00:25:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85fc95700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85815df50 con 0x7fb858159c60 2023-10-08T00:25:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85fc95700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580d13a0 con 0x7fb858159890 2023-10-08T00:25:18.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85d230700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb858159c60 0x7fb85815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85e232700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb85815db10 0x7fb858069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37484/0 (socket says 172.21.15.22:37484) 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85e232700 1 -- 172.21.15.22:0/4180791642 learned_addr learned my addr 172.21.15.22:0/4180791642 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85da31700 1 --2- 172.21.15.22:0/4180791642 >> v2:172.21.15.192:3300/0 conn(0x7fb858159890 0x7fb85815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85d230700 1 -- 172.21.15.22:0/4180791642 >> v2:172.21.15.192:3300/0 conn(0x7fb858159890 msgr2=0x7fb85815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85d230700 1 --2- 172.21.15.22:0/4180791642 >> v2:172.21.15.192:3300/0 conn(0x7fb858159890 0x7fb85815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85d230700 1 -- 172.21.15.22:0/4180791642 >> v1:172.21.15.22:6789/0 conn(0x7fb85815db10 legacy=0x7fb858069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85d230700 1 -- 172.21.15.22:0/4180791642 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85815e140 con 0x7fb858159c60 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85ca2f700 1 -- 172.21.15.22:0/4180791642 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449545511 0 0) 0x7fb85815a160 con 0x7fb85815db10 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85da31700 1 --2- 172.21.15.22:0/4180791642 >> v2:172.21.15.192:3300/0 conn(0x7fb858159890 0x7fb85815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85d230700 1 --2- 172.21.15.22:0/4180791642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159c60 0x7fb85815d5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8580d1090 tx=0x7fb84c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfea9c57c7f9132 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85ca2f700 1 -- 172.21.15.22:0/4180791642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00b6b0 con 0x7fb858159c60 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85ca2f700 1 -- 172.21.15.22:0/4180791642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c00b810 con 0x7fb858159c60 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.954+0000 7fb85ca2f700 1 -- 172.21.15.22:0/4180791642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00bbb0 con 0x7fb858159c60 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 -- 172.21.15.22:0/4180791642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159c60 msgr2=0x7fb85815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 --2- 172.21.15.22:0/4180791642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159c60 0x7fb85815d5d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8580d1090 tx=0x7fb84c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 -- 172.21.15.22:0/4180791642 shutdown_connections 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 --2- 172.21.15.22:0/4180791642 >> v2:172.21.15.192:3300/0 conn(0x7fb858159890 0x7fb85815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 --2- 172.21.15.22:0/4180791642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159c60 0x7fb85815d5d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 -- 172.21.15.22:0/4180791642 >> 172.21.15.22:0/4180791642 conn(0x7fb858068e20 msgr2=0x7fb8580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 -- 172.21.15.22:0/4180791642 shutdown_connections 2023-10-08T00:25:18.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.955+0000 7fb85fc95700 1 -- 172.21.15.22:0/4180791642 wait complete. 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.956+0000 7fb85fc95700 1 Processor -- start 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 -- start start 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 0x7fb85814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb858159c60 0x7fb858151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85815db10 0x7fb85814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c7140 con 0x7fb858159890 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c6530 con 0x7fb85815db10 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85fc95700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580c6810 con 0x7fb858159c60 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85da31700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 0x7fb85814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85da31700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 0x7fb85814a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40738/0 (socket says 172.21.15.22:40738) 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.957+0000 7fb85da31700 1 -- 172.21.15.22:0/3423146607 learned_addr learned my addr 172.21.15.22:0/3423146607 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:18.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85d230700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb858159c60 0x7fb858151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85e232700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85815db10 0x7fb85814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85da31700 1 -- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb858159c60 msgr2=0x7fb858151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85da31700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb858159c60 0x7fb858151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85da31700 1 -- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85815db10 msgr2=0x7fb85814b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85da31700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85815db10 0x7fb85814b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85da31700 1 -- 172.21.15.22:0/3423146607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c009420 con 0x7fb858159890 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85d230700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb858159c60 0x7fb858151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85e232700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85815db10 0x7fb85814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85da31700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 0x7fb85814a550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb84800a400 tx=0x7fb848007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800d650 con 0x7fb858159890 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800d7b0 con 0x7fb858159890 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800db50 con 0x7fb858159890 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8580c6af0 con 0x7fb858159890 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.958+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85814aa90 con 0x7fb858159890 2023-10-08T00:25:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.959+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85814b240 con 0x7fb858159890 2023-10-08T00:25:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.960+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb848015440 con 0x7fb858159890 2023-10-08T00:25:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.960+0000 7fb855ffb700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb844066f30 0x7fb8440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.961+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb848084e80 con 0x7fb858159890 2023-10-08T00:25:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.961+0000 7fb85d230700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb844066f30 0x7fb8440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.961+0000 7fb85d230700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb844066f30 0x7fb8440693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb858153720 tx=0x7fb84c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:18.965+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb84804e5a0 con 0x7fb858159890 2023-10-08T00:25:19.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.159+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb85804c3c0 con 0x7fb858159890 2023-10-08T00:25:19.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.160+0000 7fb855ffb700 1 -- 172.21.15.22:0/3423146607 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb84801a090 con 0x7fb858159890 2023-10-08T00:25:19.161 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:19.161 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb844066f30 msgr2=0x7fb8440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb844066f30 0x7fb8440693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb858153720 tx=0x7fb84c017000 comp rx=0 tx=0).stop 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 msgr2=0x7fb85814a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 0x7fb85814a550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb84800a400 tx=0x7fb848007910 comp rx=0 tx=0).stop 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 shutdown_connections 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85815db10 0x7fb85814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858159890 0x7fb85814a550 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb844066f30 0x7fb8440693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 --2- 172.21.15.22:0/3423146607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb858159c60 0x7fb858151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 >> 172.21.15.22:0/3423146607 conn(0x7fb858068e20 msgr2=0x7fb85814d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 shutdown_connections 2023-10-08T00:25:19.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.163+0000 7fb85fc95700 1 -- 172.21.15.22:0/3423146607 wait complete. 2023-10-08T00:25:19.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:19.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.298+0000 7f11927f3700 1 Processor -- start 2023-10-08T00:25:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.298+0000 7f11927f3700 1 -- start start 2023-10-08T00:25:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f11927f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c159890 0x7f118c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f11927f3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c15a160 con 0x7f118c069560 2023-10-08T00:25:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f11927f3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c0d13a0 con 0x7f118c159c60 2023-10-08T00:25:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f11927f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c15e140 con 0x7f118c159890 2023-10-08T00:25:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f1190d90700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f118c069560 0x7f118c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37496/0 (socket says 172.21.15.22:37496) 2023-10-08T00:25:19.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f1190d90700 1 -- 172.21.15.22:0/304508582 learned_addr learned my addr 172.21.15.22:0/304508582 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:19.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118bfff700 1 --2- 172.21.15.22:0/304508582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c159890 0x7f118c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383046064 0 0) 0x7f118c15a160 con 0x7f118c069560 2023-10-08T00:25:19.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1174003570 con 0x7f118c069560 2023-10-08T00:25:19.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762618870 0 0) 0x7f118c0d13a0 con 0x7f118c159c60 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f118c15a160 con 0x7f118c159c60 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118bfff700 1 -- 172.21.15.22:0/304508582 >> v1:172.21.15.192:6789/0 conn(0x7f118c159c60 legacy=0x7f118c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118bfff700 1 -- 172.21.15.22:0/304508582 >> v1:172.21.15.22:6789/0 conn(0x7f118c069560 legacy=0x7f118c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118bfff700 1 -- 172.21.15.22:0/304508582 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c15a3d0 con 0x7f118c159890 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.299+0000 7f118bfff700 1 --2- 172.21.15.22:0/304508582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c159890 0x7f118c15abd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f117c009910 tx=0x7f117c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c87f0cef785ba9e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011630 con 0x7f118c159890 2023-10-08T00:25:19.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c011790 con 0x7f118c159890 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f118affd700 1 -- 172.21.15.22:0/304508582 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c011b30 con 0x7f118c159890 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 -- 172.21.15.22:0/304508582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c159890 msgr2=0x7f118c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 --2- 172.21.15.22:0/304508582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c159890 0x7f118c15abd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f117c009910 tx=0x7f117c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 -- 172.21.15.22:0/304508582 shutdown_connections 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 --2- 172.21.15.22:0/304508582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c159890 0x7f118c15abd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 -- 172.21.15.22:0/304508582 >> 172.21.15.22:0/304508582 conn(0x7f118c068e20 msgr2=0x7f118c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 -- 172.21.15.22:0/304508582 shutdown_connections 2023-10-08T00:25:19.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.300+0000 7f11927f3700 1 -- 172.21.15.22:0/304508582 wait complete. 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.301+0000 7f11927f3700 1 Processor -- start 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.301+0000 7f11927f3700 1 -- start start 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f11927f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c069560 0x7f118c169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f11927f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118c159890 0x7f118c16a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f11927f3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 0x7f118c0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f11927f3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c16ae30 con 0x7f118c159c60 2023-10-08T00:25:19.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f11927f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0b3fe0 con 0x7f118c159890 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f11927f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0b42c0 con 0x7f118c069560 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f1190d90700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 0x7f118c0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f1190d90700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 0x7f118c0b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40754/0 (socket says 172.21.15.22:40754) 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f1190d90700 1 -- 172.21.15.22:0/1507645306 learned_addr learned my addr 172.21.15.22:0/1507645306 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f118bfff700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c069560 0x7f118c169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.302+0000 7f118b7fe700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118c159890 0x7f118c16a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1190d90700 1 -- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c069560 msgr2=0x7f118c169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1190d90700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c069560 0x7f118c169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1190d90700 1 -- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118c159890 msgr2=0x7f118c16a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1190d90700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118c159890 0x7f118c16a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1190d90700 1 -- 172.21.15.22:0/1507645306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c009420 con 0x7f118c159c60 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1190d90700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 0x7f118c0b3760 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f118400cc60 tx=0x7f1184001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400a8b0 con 0x7f118c159c60 2023-10-08T00:25:19.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400aa30 con 0x7f118c159c60 2023-10-08T00:25:19.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0b45a0 con 0x7f118c159c60 2023-10-08T00:25:19.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400adf0 con 0x7f118c159c60 2023-10-08T00:25:19.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.303+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0b3ca0 con 0x7f118c159c60 2023-10-08T00:25:19.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.304+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c04c3c0 con 0x7f118c159c60 2023-10-08T00:25:19.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.304+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1184007300 con 0x7f118c159c60 2023-10-08T00:25:19.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.305+0000 7f1173fff700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.305+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f11840847d0 con 0x7f118c159c60 2023-10-08T00:25:19.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.305+0000 7f118bfff700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.305+0000 7f118bfff700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1178066f30 0x7f11780693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f118c15e070 tx=0x7f117c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.309+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1184051ac0 con 0x7f118c159c60 2023-10-08T00:25:19.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.499+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f118c06a5b0 con 0x7f118c159c60 2023-10-08T00:25:19.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.500+0000 7f1173fff700 1 -- 172.21.15.22:0/1507645306 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11840550e0 con 0x7f118c159c60 2023-10-08T00:25:19.502 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1178066f30 msgr2=0x7f11780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1178066f30 0x7f11780693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f118c15e070 tx=0x7f117c017000 comp rx=0 tx=0).stop 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 msgr2=0x7f118c0b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 0x7f118c0b3760 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f118400cc60 tx=0x7f1184001ae0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 shutdown_connections 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c159c60 0x7f118c0b3760 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1178066f30 0x7f11780693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f118c069560 0x7f118c169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 --2- 172.21.15.22:0/1507645306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118c159890 0x7f118c16a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 >> 172.21.15.22:0/1507645306 conn(0x7f118c068e20 msgr2=0x7f118c15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:19.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 shutdown_connections 2023-10-08T00:25:19.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.502+0000 7f11927f3700 1 -- 172.21.15.22:0/1507645306 wait complete. 2023-10-08T00:25:19.514 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:19.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.636+0000 7f348f425700 1 Processor -- start 2023-10-08T00:25:19.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.636+0000 7f348f425700 1 -- start start 2023-10-08T00:25:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348f425700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f348806bcd0 0x7f3488140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348f425700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f3488141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348f425700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348815c2a0 con 0x7f34880c8e00 2023-10-08T00:25:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348f425700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348815b690 con 0x7f348806bcd0 2023-10-08T00:25:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348f425700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348815b970 con 0x7f348806c0a0 2023-10-08T00:25:19.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348d1c1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f348806bcd0 0x7f3488140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348d9c2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f34880c8e00 0x7f34880c9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37500/0 (socket says 172.21.15.22:37500) 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348d9c2700 1 -- 172.21.15.22:0/3214185359 learned_addr learned my addr 172.21.15.22:0/3214185359 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348d1c1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f348806bcd0 0x7f3488140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40770/0 (socket says 172.21.15.22:40770) 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f348c9c0700 1 --2- 172.21.15.22:0/3214185359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f3488141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f3487fff700 1 -- 172.21.15.22:0/3214185359 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264059915 0 0) 0x7f348815c2a0 con 0x7f34880c8e00 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.637+0000 7f3487fff700 1 -- 172.21.15.22:0/3214185359 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003570 con 0x7f34880c8e00 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348d1c1700 1 -- 172.21.15.22:0/3214185359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 msgr2=0x7f3488141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348d1c1700 1 --2- 172.21.15.22:0/3214185359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f3488141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348d1c1700 1 -- 172.21.15.22:0/3214185359 >> v1:172.21.15.22:6789/0 conn(0x7f34880c8e00 legacy=0x7f34880c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348d1c1700 1 -- 172.21.15.22:0/3214185359 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348815bc50 con 0x7f348806bcd0 2023-10-08T00:25:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348d1c1700 1 --2- 172.21.15.22:0/3214185359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f348806bcd0 0x7f3488140df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34780098e0 tx=0x7f34780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eba1b693de7199 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f3487fff700 1 -- 172.21.15.22:0/3214185359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478011630 con 0x7f348806bcd0 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f3487fff700 1 -- 172.21.15.22:0/3214185359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478011790 con 0x7f348806bcd0 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f3487fff700 1 -- 172.21.15.22:0/3214185359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478011b30 con 0x7f348806bcd0 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348f425700 1 -- 172.21.15.22:0/3214185359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f348806bcd0 msgr2=0x7f3488140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348f425700 1 --2- 172.21.15.22:0/3214185359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f348806bcd0 0x7f3488140df0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34780098e0 tx=0x7f34780091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348f425700 1 -- 172.21.15.22:0/3214185359 shutdown_connections 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348f425700 1 --2- 172.21.15.22:0/3214185359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f348806bcd0 0x7f3488140df0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348f425700 1 --2- 172.21.15.22:0/3214185359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f3488141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.638+0000 7f348f425700 1 -- 172.21.15.22:0/3214185359 >> 172.21.15.22:0/3214185359 conn(0x7f34880ce600 msgr2=0x7f34880cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.639+0000 7f348f425700 1 -- 172.21.15.22:0/3214185359 shutdown_connections 2023-10-08T00:25:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.639+0000 7f348f425700 1 -- 172.21.15.22:0/3214185359 wait complete. 2023-10-08T00:25:19.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 Processor -- start 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 -- start start 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348806bcd0 0x7f348813bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f34880b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 0x7f3488157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c7590 con 0x7f34880c8e00 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348813c420 con 0x7f348806bcd0 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.640+0000 7f348f425700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34880c7240 con 0x7f348806c0a0 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 0x7f3488157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 0x7f3488157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40786/0 (socket says 172.21.15.22:40786) 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 -- 172.21.15.22:0/3108855622 learned_addr learned my addr 172.21.15.22:0/3108855622 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:19.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d1c1700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348806bcd0 0x7f348813bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348c9c0700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f34880b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 -- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 msgr2=0x7f34880b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f34880b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 -- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348806bcd0 msgr2=0x7f348813bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348806bcd0 0x7f348813bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 -- 172.21.15.22:0/3108855622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3478009420 con 0x7f34880c8e00 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348d9c2700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 0x7f3488157dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3480001460 tx=0x7f3480001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348000ce80 con 0x7f34880c8e00 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348000ac00 con 0x7f34880c8e00 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34800070f0 con 0x7f34880c8e00 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34880c6630 con 0x7f34880c8e00 2023-10-08T00:25:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.641+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34880c6c70 con 0x7f34880c8e00 2023-10-08T00:25:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.643+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348804c3c0 con 0x7f34880c8e00 2023-10-08T00:25:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.643+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3480007520 con 0x7f34880c8e00 2023-10-08T00:25:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.643+0000 7f34857fa700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3474066f30 0x7f34740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.643+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3480084ac0 con 0x7f34880c8e00 2023-10-08T00:25:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.643+0000 7f348d1c1700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3474066f30 0x7f34740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.644+0000 7f348d1c1700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3474066f30 0x7f34740693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34780091e0 tx=0x7f3478017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.648+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3480051d20 con 0x7f34880c8e00 2023-10-08T00:25:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.840+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34880c7380 con 0x7f34880c8e00 2023-10-08T00:25:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.841+0000 7f34857fa700 1 -- 172.21.15.22:0/3108855622 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3480084e60 con 0x7f34880c8e00 2023-10-08T00:25:19.841 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.842+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3474066f30 msgr2=0x7f34740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.842+0000 7f348f425700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3474066f30 0x7f34740693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f34780091e0 tx=0x7f3478017000 comp rx=0 tx=0).stop 2023-10-08T00:25:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 msgr2=0x7f3488157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 0x7f3488157dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3480001460 tx=0x7f3480001ae0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 shutdown_connections 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34880c8e00 0x7f3488157dd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348806bcd0 0x7f348813bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3474066f30 0x7f34740693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 --2- 172.21.15.22:0/3108855622 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f348806c0a0 0x7f34880b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 >> 172.21.15.22:0/3108855622 conn(0x7f34880ce600 msgr2=0x7f34880cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 shutdown_connections 2023-10-08T00:25:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.843+0000 7f348f425700 1 -- 172.21.15.22:0/3108855622 wait complete. 2023-10-08T00:25:19.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.977+0000 7f123c641700 1 Processor -- start 2023-10-08T00:25:19.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.977+0000 7f123c641700 1 -- start start 2023-10-08T00:25:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f123c641700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1234159c60 0x7f123415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f123c641700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415a160 con 0x7f123415db10 2023-10-08T00:25:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f123c641700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340d13a0 con 0x7f1234159890 2023-10-08T00:25:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f123c641700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123415df50 con 0x7f1234159c60 2023-10-08T00:25:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f123abde700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f123415db10 0x7f1234069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37514/0 (socket says 172.21.15.22:37514) 2023-10-08T00:25:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f123abde700 1 -- 172.21.15.22:0/4265714418 learned_addr learned my addr 172.21.15.22:0/4265714418 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f1239bdc700 1 --2- 172.21.15.22:0/4265714418 >> v2:172.21.15.192:3300/0 conn(0x7f1234159c60 0x7f123415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137154892 0 0) 0x7f123415a160 con 0x7f123415db10 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003570 con 0x7f123415db10 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599976042 0 0) 0x7f12340d13a0 con 0x7f1234159890 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f123415a160 con 0x7f1234159890 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f1239bdc700 1 -- 172.21.15.22:0/4265714418 >> v1:172.21.15.192:6789/0 conn(0x7f1234159890 legacy=0x7f123415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f1239bdc700 1 -- 172.21.15.22:0/4265714418 >> v1:172.21.15.22:6789/0 conn(0x7f123415db10 legacy=0x7f1234069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f1239bdc700 1 -- 172.21.15.22:0/4265714418 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123415e140 con 0x7f1234159c60 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.978+0000 7f1239bdc700 1 --2- 172.21.15.22:0/4265714418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f123415d5d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12240098e0 tx=0x7f12240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96d557a2c5862461 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011630 con 0x7f1234159c60 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224011790 con 0x7f1234159c60 2023-10-08T00:25:19.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f12393db700 1 -- 172.21.15.22:0/4265714418 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011b30 con 0x7f1234159c60 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 -- 172.21.15.22:0/4265714418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 msgr2=0x7f123415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 --2- 172.21.15.22:0/4265714418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f123415d5d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12240098e0 tx=0x7f12240091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 -- 172.21.15.22:0/4265714418 shutdown_connections 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 --2- 172.21.15.22:0/4265714418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f123415d5d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 -- 172.21.15.22:0/4265714418 >> 172.21.15.22:0/4265714418 conn(0x7f1234068e20 msgr2=0x7f12340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 -- 172.21.15.22:0/4265714418 shutdown_connections 2023-10-08T00:25:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.979+0000 7f123c641700 1 -- 172.21.15.22:0/4265714418 wait complete. 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.980+0000 7f123c641700 1 Processor -- start 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.980+0000 7f123c641700 1 -- start start 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123c641700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 0x7f12340c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123c641700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f1234153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123c641700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f123415db10 0x7f12340cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123c641700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c8990 con 0x7f1234159890 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123c641700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234169a50 con 0x7f1234159c60 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123c641700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234169d30 con 0x7f123415db10 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123a3dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 0x7f12340c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123a3dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 0x7f12340c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40790/0 (socket says 172.21.15.22:40790) 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123a3dd700 1 -- 172.21.15.22:0/4017531335 learned_addr learned my addr 172.21.15.22:0/4017531335 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:19.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f1239bdc700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f1234153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.981+0000 7f123abde700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f123415db10 0x7f12340cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123a3dd700 1 -- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f123415db10 msgr2=0x7f12340cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123a3dd700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f123415db10 0x7f12340cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123a3dd700 1 -- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 msgr2=0x7f1234153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123a3dd700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f1234153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123a3dd700 1 -- 172.21.15.22:0/4017531335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009420 con 0x7f1234159890 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123a3dd700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 0x7f12340c78a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f123000c7c0 tx=0x7f1230007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230010510 con 0x7f1234159890 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230010670 con 0x7f1234159890 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340c80f0 con 0x7f1234159890 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230010a10 con 0x7f1234159890 2023-10-08T00:25:19.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.982+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12340c7de0 con 0x7f1234159890 2023-10-08T00:25:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.983+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404c3c0 con 0x7f1234159890 2023-10-08T00:25:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.983+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f123001b3b0 con 0x7f1234159890 2023-10-08T00:25:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.984+0000 7f122a7fc700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1218066f30 0x7f12180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.984+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1230083e80 con 0x7f1234159890 2023-10-08T00:25:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.984+0000 7f1239bdc700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1218066f30 0x7f12180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.984+0000 7f1239bdc700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1218066f30 0x7f12180693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12240093f0 tx=0x7f1224017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:19.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:19.988+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1230051050 con 0x7f1234159890 2023-10-08T00:25:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.183+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12340c6d70 con 0x7f1234159890 2023-10-08T00:25:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.184+0000 7f122a7fc700 1 -- 172.21.15.22:0/4017531335 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1230017020 con 0x7f1234159890 2023-10-08T00:25:20.184 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:20.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1218066f30 msgr2=0x7f12180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:20.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1218066f30 0x7f12180693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12240093f0 tx=0x7f1224017000 comp rx=0 tx=0).stop 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 msgr2=0x7f12340c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 0x7f12340c78a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f123000c7c0 tx=0x7f1230007e10 comp rx=0 tx=0).stop 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 shutdown_connections 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1218066f30 0x7f12180693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f123415db10 0x7f12340cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1234159890 0x7f12340c78a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 --2- 172.21.15.22:0/4017531335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1234159c60 0x7f1234153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 >> 172.21.15.22:0/4017531335 conn(0x7f1234068e20 msgr2=0x7f1234158370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 shutdown_connections 2023-10-08T00:25:20.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.186+0000 7f123c641700 1 -- 172.21.15.22:0/4017531335 wait complete. 2023-10-08T00:25:20.264 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-10-08T00:25:20.264 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:25:20.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-08T00:25:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.384+0000 7fc93ba7d700 1 Processor -- start 2023-10-08T00:25:20.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.384+0000 7fc93ba7d700 1 -- start start 2023-10-08T00:25:20.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93ba7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93406bcd0 0x7fc9340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93ba7d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc93415df50 0x7fc93415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93ba7d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93415d7e0 con 0x7fc93406c0a0 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93ba7d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93415dac0 con 0x7fc93415df50 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93ba7d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93415aa30 con 0x7fc93406bcd0 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc93415df50 0x7fc93415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc939018700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc93406c0a0 0x7fc93415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37528/0 (socket says 172.21.15.22:37528) 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc939018700 1 -- 172.21.15.22:0/1925725187 learned_addr learned my addr 172.21.15.22:0/1925725187 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc93415df50 0x7fc93415e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40796/0 (socket says 172.21.15.22:40796) 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc939819700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93406bcd0 0x7fc9340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 -- 172.21.15.22:0/1925725187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93406bcd0 msgr2=0x7fc9340caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:20.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93406bcd0 0x7fc9340caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 -- 172.21.15.22:0/1925725187 >> v1:172.21.15.22:6789/0 conn(0x7fc93406c0a0 legacy=0x7fc93415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 -- 172.21.15.22:0/1925725187 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93415ad10 con 0x7fc93415df50 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc938817700 1 -- 172.21.15.22:0/1925725187 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950058915 0 0) 0x7fc93415d7e0 con 0x7fc93406c0a0 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc939819700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93406bcd0 0x7fc9340caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc93a01a700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93415df50 0x7fc93415e3b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009e60 tx=0x7fc92c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5fbc4d2f088926 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc938817700 1 -- 172.21.15.22:0/1925725187 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c00e070 con 0x7fc93415df50 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc938817700 1 -- 172.21.15.22:0/1925725187 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c00bc30 con 0x7fc93415df50 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.385+0000 7fc938817700 1 -- 172.21.15.22:0/1925725187 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c012430 con 0x7fc93415df50 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 -- 172.21.15.22:0/1925725187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93415df50 msgr2=0x7fc93415e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93415df50 0x7fc93415e3b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009e60 tx=0x7fc92c009780 comp rx=0 tx=0).stop 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 -- 172.21.15.22:0/1925725187 shutdown_connections 2023-10-08T00:25:20.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93415df50 0x7fc93415e3b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/1925725187 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93406bcd0 0x7fc9340caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 -- 172.21.15.22:0/1925725187 >> 172.21.15.22:0/1925725187 conn(0x7fc9340ce600 msgr2=0x7fc9340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 -- 172.21.15.22:0/1925725187 shutdown_connections 2023-10-08T00:25:20.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.386+0000 7fc93ba7d700 1 -- 172.21.15.22:0/1925725187 wait complete. 2023-10-08T00:25:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.387+0000 7fc93ba7d700 1 Processor -- start 2023-10-08T00:25:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.387+0000 7fc93ba7d700 1 -- start start 2023-10-08T00:25:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc93ba7d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 0x7fc93416cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc93ba7d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc93406c0a0 0x7fc9340c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc93ba7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93415df50 0x7fc9341580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:20.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc93ba7d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93415eb30 con 0x7fc93406bcd0 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc93ba7d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340c8350 con 0x7fc93406c0a0 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc93ba7d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93416d410 con 0x7fc93415df50 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 0x7fc93416cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 0x7fc93416cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40802/0 (socket says 172.21.15.22:40802) 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 -- 172.21.15.22:0/2395323983 learned_addr learned my addr 172.21.15.22:0/2395323983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 -- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93415df50 msgr2=0x7fc9341580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93415df50 0x7fc9341580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 -- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc93406c0a0 msgr2=0x7fc9340c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc93406c0a0 0x7fc9340c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 -- 172.21.15.22:0/2395323983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c009a20 con 0x7fc93406bcd0 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.388+0000 7fc939819700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 0x7fc93416cd50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c850 tx=0x7fc930008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:20.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.389+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930011600 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.389+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc930011760 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.389+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93416d6f0 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.389+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930011b00 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.389+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9341585f0 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.390+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93404c3c0 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.390+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9300073b0 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.390+0000 7fc929ffb700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc918066f30 0x7fc9180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.391+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc9300844b0 con 0x7fc93406bcd0 2023-10-08T00:25:20.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.391+0000 7fc939018700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc918066f30 0x7fc9180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:20.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.391+0000 7fc939018700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc918066f30 0x7fc9180693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc934155630 tx=0x7fc924007bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:20.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.395+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9300551b0 con 0x7fc93406bcd0 2023-10-08T00:25:20.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:20.669+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fc93415aff0 con 0x7fc93406bcd0 2023-10-08T00:25:21.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.641+0000 7fc929ffb700 1 -- 172.21.15.22:0/2395323983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc930054d40 con 0x7fc93406bcd0 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc918066f30 msgr2=0x7fc9180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc918066f30 0x7fc9180693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc934155630 tx=0x7fc924007bd0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 msgr2=0x7fc93416cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 0x7fc93416cd50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc93000c850 tx=0x7fc930008040 comp rx=0 tx=0).stop 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 shutdown_connections 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc918066f30 0x7fc9180693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc93415df50 0x7fc9341580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93406bcd0 0x7fc93416cd50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 --2- 172.21.15.22:0/2395323983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc93406c0a0 0x7fc9340c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 >> 172.21.15.22:0/2395323983 conn(0x7fc9340ce600 msgr2=0x7fc934069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:21.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 shutdown_connections 2023-10-08T00:25:21.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.644+0000 7fc93ba7d700 1 -- 172.21.15.22:0/2395323983 wait complete. 2023-10-08T00:25:21.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:25:21.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 Processor -- start 2023-10-08T00:25:21.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 -- start start 2023-10-08T00:25:21.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55a406c0a0 0x7f55a40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:21.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55a415df50 0x7f55a415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:21.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a415d7e0 con 0x7f55a406bcd0 2023-10-08T00:25:21.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a415dac0 con 0x7f55a406c0a0 2023-10-08T00:25:21.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.789+0000 7f55a9c41700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a415aa30 con 0x7f55a415df50 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55a406c0a0 0x7f55a40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55a406c0a0 0x7f55a40caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40814/0 (socket says 172.21.15.22:40814) 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 -- 172.21.15.22:0/3715927553 learned_addr learned my addr 172.21.15.22:0/3715927553 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a3fff700 1 --2- 172.21.15.22:0/3715927553 >> v2:172.21.15.192:3300/0 conn(0x7f55a415df50 0x7f55a415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 -- 172.21.15.22:0/3715927553 >> v2:172.21.15.192:3300/0 conn(0x7f55a415df50 msgr2=0x7f55a415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 --2- 172.21.15.22:0/3715927553 >> v2:172.21.15.192:3300/0 conn(0x7f55a415df50 0x7f55a415e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 -- 172.21.15.22:0/3715927553 >> v1:172.21.15.192:6789/0 conn(0x7f55a406bcd0 legacy=0x7f55a415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 -- 172.21.15.22:0/3715927553 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a415ad10 con 0x7f55a406c0a0 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a2ffd700 1 --2- 172.21.15.22:0/3715927553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406c0a0 0x7f55a40caa90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55a415d720 tx=0x7f5598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e61fb6e2bfd3e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a27fc700 1 -- 172.21.15.22:0/3715927553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800b820 con 0x7f55a406c0a0 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a27fc700 1 -- 172.21.15.22:0/3715927553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800b980 con 0x7f55a406c0a0 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.790+0000 7f55a27fc700 1 -- 172.21.15.22:0/3715927553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800bd40 con 0x7f55a406c0a0 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 -- 172.21.15.22:0/3715927553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406c0a0 msgr2=0x7f55a40caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 --2- 172.21.15.22:0/3715927553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406c0a0 0x7f55a40caa90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55a415d720 tx=0x7f5598009250 comp rx=0 tx=0).stop 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 -- 172.21.15.22:0/3715927553 shutdown_connections 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 --2- 172.21.15.22:0/3715927553 >> v2:172.21.15.192:3300/0 conn(0x7f55a415df50 0x7f55a415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 --2- 172.21.15.22:0/3715927553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406c0a0 0x7f55a40caa90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 -- 172.21.15.22:0/3715927553 >> 172.21.15.22:0/3715927553 conn(0x7f55a40ce600 msgr2=0x7f55a40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 -- 172.21.15.22:0/3715927553 shutdown_connections 2023-10-08T00:25:21.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.791+0000 7f55a9c41700 1 -- 172.21.15.22:0/3715927553 wait complete. 2023-10-08T00:25:21.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.792+0000 7f55a9c41700 1 Processor -- start 2023-10-08T00:25:21.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.792+0000 7f55a9c41700 1 -- start start 2023-10-08T00:25:21.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a9c41700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 0x7f55a4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:21.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a9c41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a406c0a0 0x7f55a4152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:21.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a9c41700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a415df50 0x7f55a4158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a9c41700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a416a650 con 0x7f55a406bcd0 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a9c41700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a416a930 con 0x7f55a415df50 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a9c41700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a416ac10 con 0x7f55a406c0a0 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 0x7f55a4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 0x7f55a4155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40820/0 (socket says 172.21.15.22:40820) 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 -- 172.21.15.22:0/1917968833 learned_addr learned my addr 172.21.15.22:0/1917968833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a3fff700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a415df50 0x7f55a4158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a2ffd700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a406c0a0 0x7f55a4152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:21.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 -- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a406c0a0 msgr2=0x7f55a4152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a406c0a0 0x7f55a4152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 -- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a415df50 msgr2=0x7f55a4158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a415df50 0x7f55a4158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a37fe700 1 -- 172.21.15.22:0/1917968833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55980094f0 con 0x7f55a406bcd0 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.793+0000 7f55a2ffd700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a406c0a0 0x7f55a4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.794+0000 7f55a37fe700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 0x7f55a4155870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f559400b5e0 tx=0x7f5594009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.794+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400f510 con 0x7f55a406bcd0 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.794+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400f670 con 0x7f55a406bcd0 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.794+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a416aef0 con 0x7f55a406bcd0 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.794+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400fa30 con 0x7f55a406bcd0 2023-10-08T00:25:21.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.794+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4152da0 con 0x7f55a406bcd0 2023-10-08T00:25:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.795+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a4152ff0 con 0x7f55a406bcd0 2023-10-08T00:25:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.795+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f559401a400 con 0x7f55a406bcd0 2023-10-08T00:25:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.795+0000 7f558b7fe700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5590066f30 0x7f55900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.796+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5594083fd0 con 0x7f55a406bcd0 2023-10-08T00:25:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.796+0000 7f55a2ffd700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5590066f30 0x7f55900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:21.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.796+0000 7f55a2ffd700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5590066f30 0x7f55900693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55a415d720 tx=0x7f5598016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:21.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.800+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55940512c0 con 0x7f55a406bcd0 2023-10-08T00:25:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.991+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f55a404c3c0 con 0x7f55a406bcd0 2023-10-08T00:25:21.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.995+0000 7f558b7fe700 1 -- 172.21.15.22:0/1917968833 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55940548e0 con 0x7f55a406bcd0 2023-10-08T00:25:21.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5590066f30 msgr2=0x7f55900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5590066f30 0x7f55900693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f55a415d720 tx=0x7f5598016000 comp rx=0 tx=0).stop 2023-10-08T00:25:21.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 msgr2=0x7f55a4155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 0x7f55a4155870 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f559400b5e0 tx=0x7f5594009120 comp rx=0 tx=0).stop 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 shutdown_connections 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a415df50 0x7f55a4158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a406bcd0 0x7f55a4155870 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5590066f30 0x7f55900693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 --2- 172.21.15.22:0/1917968833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a406c0a0 0x7f55a4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 >> 172.21.15.22:0/1917968833 conn(0x7f55a40ce600 msgr2=0x7f55a415c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 shutdown_connections 2023-10-08T00:25:21.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:21.997+0000 7f55a9c41700 1 -- 172.21.15.22:0/1917968833 wait complete. 2023-10-08T00:25:22.009 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:25:22.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:25:22.056 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:25:22.102 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:25:22.102 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:25:22.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:25:22.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-08T00:25:22.139 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:25:22.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:22.139 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:25:22.195 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:25:22.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:25:22.195 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-08T00:25:22.236 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:25:22.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:22.237 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:25:22.294 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-08T00:25:22.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:25:22.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-08T00:25:22.334 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:25:22.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:22.334 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T00:25:22.390 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-08T00:25:22.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:25:22.390 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-08T00:25:22.435 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:25:22.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:22.436 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T00:25:22.452 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:25:22.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.571+0000 7efc0df65700 1 Processor -- start 2023-10-08T00:25:22.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.571+0000 7efc0df65700 1 -- start start 2023-10-08T00:25:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.571+0000 7efc0df65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc08159890 0x7efc0815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc0df65700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0815a160 con 0x7efc08069560 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc0df65700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc080d13a0 con 0x7efc08159c60 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc0df65700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0815e140 con 0x7efc08159890 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc077fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efc08159890 0x7efc0815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc07fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc08069560 0x7efc080ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37542/0 (socket says 172.21.15.22:37542) 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc07fff700 1 -- 172.21.15.22:0/1319057330 learned_addr learned my addr 172.21.15.22:0/1319057330 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc077fe700 1 -- 172.21.15.22:0/1319057330 >> v1:172.21.15.192:6789/0 conn(0x7efc08159c60 legacy=0x7efc0815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc077fe700 1 -- 172.21.15.22:0/1319057330 >> v1:172.21.15.22:6789/0 conn(0x7efc08069560 legacy=0x7efc080ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc077fe700 1 -- 172.21.15.22:0/1319057330 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0815a3d0 con 0x7efc08159890 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc077fe700 1 --2- 172.21.15.22:0/1319057330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159890 0x7efc0815abd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efbf80098e0 tx=0x7efbf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a76e6ae3ea0937 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc067fc700 1 -- 172.21.15.22:0/1319057330 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8009e80 con 0x7efc08159890 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc067fc700 1 -- 172.21.15.22:0/1319057330 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800b820 con 0x7efc08159890 2023-10-08T00:25:22.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.572+0000 7efc067fc700 1 -- 172.21.15.22:0/1319057330 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800bba0 con 0x7efc08159890 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 -- 172.21.15.22:0/1319057330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159890 msgr2=0x7efc0815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 --2- 172.21.15.22:0/1319057330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159890 0x7efc0815abd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efbf80098e0 tx=0x7efbf80091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 -- 172.21.15.22:0/1319057330 shutdown_connections 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 --2- 172.21.15.22:0/1319057330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159890 0x7efc0815abd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 -- 172.21.15.22:0/1319057330 >> 172.21.15.22:0/1319057330 conn(0x7efc08068e20 msgr2=0x7efc080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 -- 172.21.15.22:0/1319057330 shutdown_connections 2023-10-08T00:25:22.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.573+0000 7efc0df65700 1 -- 172.21.15.22:0/1319057330 wait complete. 2023-10-08T00:25:22.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.574+0000 7efc0df65700 1 Processor -- start 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.574+0000 7efc0df65700 1 -- start start 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc0df65700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08069560 0x7efc081460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc0df65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc08159890 0x7efc080c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc0df65700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 0x7efc080ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc0df65700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080b4f20 con 0x7efc08159c60 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc0df65700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c8020 con 0x7efc08069560 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc0df65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc080b4c40 con 0x7efc08159890 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 0x7efc080ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 0x7efc080ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40844/0 (socket says 172.21.15.22:40844) 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 -- 172.21.15.22:0/2684130705 learned_addr learned my addr 172.21.15.22:0/2684130705 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:22.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc077fe700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08069560 0x7efc081460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 -- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc08159890 msgr2=0x7efc080c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc06ffd700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc08159890 0x7efc080c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc08159890 0x7efc080c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 -- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08069560 msgr2=0x7efc081460b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08069560 0x7efc081460b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc07fff700 1 -- 172.21.15.22:0/2684130705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009420 con 0x7efc08159c60 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc077fe700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08069560 0x7efc081460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.575+0000 7efc06ffd700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc08159890 0x7efc080c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.576+0000 7efc07fff700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 0x7efc080ca090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc0000cbc0 tx=0x7efc000019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.576+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000a940 con 0x7efc08159c60 2023-10-08T00:25:22.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.576+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000aaa0 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.576+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc080c79d0 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.576+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ae20 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.576+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc081465f0 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.577+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc080c81b0 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.577+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc00007300 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.577+0000 7efbef7fe700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efbf4066f30 0x7efbf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.578+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc000848a0 con 0x7efc08159c60 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.578+0000 7efc077fe700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efbf4066f30 0x7efbf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.578+0000 7efc077fe700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efbf4066f30 0x7efbf40693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf80030c0 tx=0x7efbf8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:22.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.582+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc00051b90 con 0x7efc08159c60 2023-10-08T00:25:22.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.821+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc0804c3c0 con 0x7efc08159c60 2023-10-08T00:25:22.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.822+0000 7efbef7fe700 1 -- 172.21.15.22:0/2684130705 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7efc000551b0 con 0x7efc08159c60 2023-10-08T00:25:22.822 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:22.822 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efbf4066f30 msgr2=0x7efbf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efbf4066f30 0x7efbf40693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf80030c0 tx=0x7efbf8016000 comp rx=0 tx=0).stop 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 msgr2=0x7efc080ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 0x7efc080ca090 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc0000cbc0 tx=0x7efc000019c0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 shutdown_connections 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc08159c60 0x7efc080ca090 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc08069560 0x7efc081460b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efbf4066f30 0x7efbf40693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 --2- 172.21.15.22:0/2684130705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc08159890 0x7efc080c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 >> 172.21.15.22:0/2684130705 conn(0x7efc08068e20 msgr2=0x7efc080b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:22.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 shutdown_connections 2023-10-08T00:25:22.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.824+0000 7efc0df65700 1 -- 172.21.15.22:0/2684130705 wait complete. 2023-10-08T00:25:22.826 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:22.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:22.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.955+0000 7f5fcb817700 1 Processor -- start 2023-10-08T00:25:22.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.955+0000 7f5fcb817700 1 -- start start 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fcb817700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fc4159890 0x7f5fc415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fcb817700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4069560 0x7f5fc40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fcb817700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc4069ee0 con 0x7f5fc4159c60 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fcb817700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc415a160 con 0x7f5fc4159890 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fcb817700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40d13a0 con 0x7f5fc4069560 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fc4159890 0x7f5fc415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fc4159890 0x7f5fc415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40860/0 (socket says 172.21.15.22:40860) 2023-10-08T00:25:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 -- 172.21.15.22:0/1643619566 learned_addr learned my addr 172.21.15.22:0/1643619566 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc9db4700 1 --2- 172.21.15.22:0/1643619566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4069560 0x7f5fc40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 -- 172.21.15.22:0/1643619566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4069560 msgr2=0x7f5fc40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 --2- 172.21.15.22:0/1643619566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4069560 0x7f5fc40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 -- 172.21.15.22:0/1643619566 >> v1:172.21.15.192:6789/0 conn(0x7f5fc4159c60 legacy=0x7f5fc415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 -- 172.21.15.22:0/1643619566 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc415e140 con 0x7f5fc4159890 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.956+0000 7f5fc95b3700 1 --2- 172.21.15.22:0/1643619566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159890 0x7f5fc415abd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099b0 tx=0x7f5fb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b14b1946b14212 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fc3fff700 1 -- 172.21.15.22:0/1643619566 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400b860 con 0x7f5fc4159890 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fc3fff700 1 -- 172.21.15.22:0/1643619566 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb400b9c0 con 0x7f5fc4159890 2023-10-08T00:25:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fc3fff700 1 -- 172.21.15.22:0/1643619566 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400bd60 con 0x7f5fc4159890 2023-10-08T00:25:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 -- 172.21.15.22:0/1643619566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159890 msgr2=0x7f5fc415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 --2- 172.21.15.22:0/1643619566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159890 0x7f5fc415abd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099b0 tx=0x7f5fb4009250 comp rx=0 tx=0).stop 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 -- 172.21.15.22:0/1643619566 shutdown_connections 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 --2- 172.21.15.22:0/1643619566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4069560 0x7f5fc40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 --2- 172.21.15.22:0/1643619566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159890 0x7f5fc415abd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 -- 172.21.15.22:0/1643619566 >> 172.21.15.22:0/1643619566 conn(0x7f5fc4068e20 msgr2=0x7f5fc40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 -- 172.21.15.22:0/1643619566 shutdown_connections 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.957+0000 7f5fcb817700 1 -- 172.21.15.22:0/1643619566 wait complete. 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.958+0000 7f5fcb817700 1 Processor -- start 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.958+0000 7f5fcb817700 1 -- start start 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fcb817700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc4069560 0x7f5fc41501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fcb817700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4159890 0x7f5fc40b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fcb817700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 0x7f5fc41523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fcb817700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc416a020 con 0x7f5fc4159c60 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fcb817700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc416a300 con 0x7f5fc4069560 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fcb817700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc416a5e0 con 0x7f5fc4159890 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fc9db4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 0x7f5fc41523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fc9db4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 0x7f5fc41523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40866/0 (socket says 172.21.15.22:40866) 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fc9db4700 1 -- 172.21.15.22:0/857728273 learned_addr learned my addr 172.21.15.22:0/857728273 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fc8db2700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4159890 0x7f5fc40b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.959+0000 7f5fc95b3700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc4069560 0x7f5fc41501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc9db4700 1 -- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4159890 msgr2=0x7f5fc40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc9db4700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4159890 0x7f5fc40b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc9db4700 1 -- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc4069560 msgr2=0x7f5fc41501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc9db4700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc4069560 0x7f5fc41501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc9db4700 1 -- 172.21.15.22:0/857728273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40094f0 con 0x7f5fc4159c60 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc9db4700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 0x7f5fc41523f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007f20 tx=0x7f5fbc009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc00eb90 con 0x7f5fc4159c60 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc00ed10 con 0x7f5fc4159c60 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc014670 con 0x7f5fc4159c60 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc416a8c0 con 0x7f5fc4159c60 2023-10-08T00:25:22.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.960+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc4169db0 con 0x7f5fc4159c60 2023-10-08T00:25:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.961+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc404c3c0 con 0x7f5fc4159c60 2023-10-08T00:25:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.962+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fbc0149e0 con 0x7f5fc4159c60 2023-10-08T00:25:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.962+0000 7f5fc17fa700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0066f30 0x7f5fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.962+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fbc084ae0 con 0x7f5fc4159c60 2023-10-08T00:25:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.962+0000 7f5fc95b3700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0066f30 0x7f5fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.963+0000 7f5fc95b3700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0066f30 0x7f5fb00693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099b0 tx=0x7f5fb4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:22.966+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fbc051d50 con 0x7f5fc4159c60 2023-10-08T00:25:23.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.164+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc406a5b0 con 0x7f5fc4159c60 2023-10-08T00:25:23.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.165+0000 7f5fc17fa700 1 -- 172.21.15.22:0/857728273 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f5fbc055370 con 0x7f5fc4159c60 2023-10-08T00:25:23.165 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:23.166 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:23.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0066f30 msgr2=0x7f5fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0066f30 0x7f5fb00693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099b0 tx=0x7f5fb4017000 comp rx=0 tx=0).stop 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 msgr2=0x7f5fc41523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 0x7f5fc41523f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007f20 tx=0x7f5fbc009860 comp rx=0 tx=0).stop 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 shutdown_connections 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4159c60 0x7f5fc41523f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc4069560 0x7f5fc41501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0066f30 0x7f5fb00693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 --2- 172.21.15.22:0/857728273 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc4159890 0x7f5fc40b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 >> 172.21.15.22:0/857728273 conn(0x7f5fc4068e20 msgr2=0x7f5fc4150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 shutdown_connections 2023-10-08T00:25:23.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.167+0000 7f5fcb817700 1 -- 172.21.15.22:0/857728273 wait complete. 2023-10-08T00:25:23.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:24:50.124994+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:24:51.343211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:25:23.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:23.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.301+0000 7f9170c8a700 1 Processor -- start 2023-10-08T00:25:23.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f9170c8a700 1 -- start start 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f9170c8a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f916c0b1b40 0x7f916c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f9170c8a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0cfb00 con 0x7f916c0b16d0 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f9170c8a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0b5c40 con 0x7f916c0b4e70 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f9170c8a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c0b5f20 con 0x7f916c0b1b40 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f916affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f916c0b16d0 0x7f916c0b33b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37544/0 (socket says 172.21.15.22:37544) 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.302+0000 7f916affd700 1 -- 172.21.15.22:0/2033047372 learned_addr learned my addr 172.21.15.22:0/2033047372 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:23.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916bfff700 1 --2- 172.21.15.22:0/2033047372 >> v2:172.21.15.192:3300/0 conn(0x7f916c0b1b40 0x7f916c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801888229 0 0) 0x7f916c0cfb00 con 0x7f916c0b16d0 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9154003570 con 0x7f916c0b16d0 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320764043 0 0) 0x7f9154003570 con 0x7f916c0b16d0 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 >> v2:172.21.15.192:3300/0 conn(0x7f916c0b1b40 msgr2=0x7f916c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 --2- 172.21.15.22:0/2033047372 >> v2:172.21.15.192:3300/0 conn(0x7f916c0b1b40 0x7f916c0b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 >> v1:172.21.15.192:6789/0 conn(0x7f916c0b4e70 legacy=0x7f916c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c0b6200 con 0x7f916c0b16d0 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f9160001470 con 0x7f916c0b16d0 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 >> v1:172.21.15.22:6789/0 conn(0x7f916c0b16d0 legacy=0x7f916c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9154003a60 0x7f9154003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9154004810 0x7f9154004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91540052e0 0x7f915400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0b5f20 con 0x7f91540052e0 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915400c2a0 con 0x7f9154004810 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915400c460 con 0x7f9154003a60 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916bfff700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91540052e0 0x7f915400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916b7fe700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9154003a60 0x7f9154003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.303+0000 7f916affd700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9154004810 0x7f9154004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 -- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9154003a60 msgr2=0x7f9154003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9154003a60 0x7f9154003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 -- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9154004810 msgr2=0x7f9154004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9154004810 0x7f9154004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 -- 172.21.15.22:0/2033047372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154003570 con 0x7f91540052e0 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916affd700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9154004810 0x7f9154004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916b7fe700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9154003a60 0x7f9154003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 -- 172.21.15.22:0/2033047372 reap_dead start 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916bfff700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91540052e0 0x7f915400ba60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f916400e210 tx=0x7f916400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f475fe488b3e6759 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400eac0 con 0x7f91540052e0 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916400f040 con 0x7f91540052e0 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f916a7fc700 1 -- 172.21.15.22:0/2033047372 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400ee70 con 0x7f91540052e0 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 -- 172.21.15.22:0/2033047372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91540052e0 msgr2=0x7f915400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91540052e0 0x7f915400ba60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f916400e210 tx=0x7f916400b040 comp rx=0 tx=0).stop 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 -- 172.21.15.22:0/2033047372 shutdown_connections 2023-10-08T00:25:23.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2033047372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91540052e0 0x7f915400ba60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 -- 172.21.15.22:0/2033047372 >> 172.21.15.22:0/2033047372 conn(0x7f916c0d10c0 msgr2=0x7f916c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:23.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 -- 172.21.15.22:0/2033047372 shutdown_connections 2023-10-08T00:25:23.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.304+0000 7f9170c8a700 1 -- 172.21.15.22:0/2033047372 wait complete. 2023-10-08T00:25:23.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 Processor -- start 2023-10-08T00:25:23.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 -- start start 2023-10-08T00:25:23.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91540052e0 0x7f916c0cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 0x7f916c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c0c9910 0x7f916c16d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c16af30 con 0x7f916c0c6a20 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c158830 con 0x7f916c0c9910 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.306+0000 7f9170c8a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0c9d80 con 0x7f91540052e0 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 0x7f916c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 0x7f916c0c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40892/0 (socket says 172.21.15.22:40892) 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 -- 172.21.15.22:0/2247588448 learned_addr learned my addr 172.21.15.22:0/2247588448 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916b7fe700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91540052e0 0x7f916c0cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916bfff700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c0c9910 0x7f916c16d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 -- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91540052e0 msgr2=0x7f916c0cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91540052e0 0x7f916c0cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 -- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c0c9910 msgr2=0x7f916c16d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c0c9910 0x7f916c16d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 -- 172.21.15.22:0/2247588448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c16a2b0 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f916affd700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 0x7f916c0c93d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9160000fd0 tx=0x7f9160000cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160005e30 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160010040 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000a780 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c16a590 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.307+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c16ab50 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.308+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c088990 con 0x7f916c0c6a20 2023-10-08T00:25:23.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.309+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f916000ad00 con 0x7f916c0c6a20 2023-10-08T00:25:23.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.309+0000 7f91537fe700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9158066f30 0x7f91580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.309+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9160083960 con 0x7f916c0c6a20 2023-10-08T00:25:23.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.309+0000 7f916b7fe700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9158066f30 0x7f91580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.310+0000 7f916b7fe700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9158066f30 0x7f91580693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f915c007fd0 tx=0x7f915c00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.313+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f916004d5a0 con 0x7f916c0c6a20 2023-10-08T00:25:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.504+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f916c0c91b0 con 0x7f916c0c6a20 2023-10-08T00:25:23.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.505+0000 7f91537fe700 1 -- 172.21.15.22:0/2247588448 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91600190a0 con 0x7f916c0c6a20 2023-10-08T00:25:23.506 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:23.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9158066f30 msgr2=0x7f91580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9158066f30 0x7f91580693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f915c007fd0 tx=0x7f915c00c040 comp rx=0 tx=0).stop 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 msgr2=0x7f916c0c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 0x7f916c0c93d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9160000fd0 tx=0x7f9160000cf0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 shutdown_connections 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c0c9910 0x7f916c16d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9158066f30 0x7f91580693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91540052e0 0x7f916c0cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 --2- 172.21.15.22:0/2247588448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f916c0c6a20 0x7f916c0c93d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 >> 172.21.15.22:0/2247588448 conn(0x7f916c0d10c0 msgr2=0x7f916c0c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 shutdown_connections 2023-10-08T00:25:23.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.507+0000 7f9170c8a700 1 -- 172.21.15.22:0/2247588448 wait complete. 2023-10-08T00:25:23.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:25:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.641+0000 7f7bf2b7e700 1 Processor -- start 2023-10-08T00:25:23.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.641+0000 7f7bf2b7e700 1 -- start start 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf2b7e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7bec141500 0x7f7bec0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf2b7e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7bec06c0a0 0x7f7bec0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf2b7e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec15c2a0 con 0x7f7bec06bcd0 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf2b7e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec0c9880 con 0x7f7bec141500 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf2b7e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec15b690 con 0x7f7bec06c0a0 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7bec141500 0x7f7bec0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7bec141500 0x7f7bec0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40904/0 (socket says 172.21.15.22:40904) 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 -- 172.21.15.22:0/1423561714 learned_addr learned my addr 172.21.15.22:0/1423561714 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf111b700 1 --2- 172.21.15.22:0/1423561714 >> v2:172.21.15.192:3300/0 conn(0x7f7bec06c0a0 0x7f7bec0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 -- 172.21.15.22:0/1423561714 >> v2:172.21.15.192:3300/0 conn(0x7f7bec06c0a0 msgr2=0x7f7bec0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:23.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 --2- 172.21.15.22:0/1423561714 >> v2:172.21.15.192:3300/0 conn(0x7f7bec06c0a0 0x7f7bec0c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 -- 172.21.15.22:0/1423561714 >> v1:172.21.15.192:6789/0 conn(0x7f7bec06bcd0 legacy=0x7f7bec140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 -- 172.21.15.22:0/1423561714 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec15b970 con 0x7f7bec141500 2023-10-08T00:25:23.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bf111b700 1 --2- 172.21.15.22:0/1423561714 >> v2:172.21.15.192:3300/0 conn(0x7f7bec06c0a0 0x7f7bec0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:23.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.642+0000 7f7bebfff700 1 --2- 172.21.15.22:0/1423561714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec141500 0x7f7bec0c8e00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0cf210 tx=0x7f7bd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6599ad8d823d43dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.643+0000 7f7beb7fe700 1 -- 172.21.15.22:0/1423561714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400b860 con 0x7f7bec141500 2023-10-08T00:25:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.643+0000 7f7beb7fe700 1 -- 172.21.15.22:0/1423561714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd400b9c0 con 0x7f7bec141500 2023-10-08T00:25:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.643+0000 7f7beb7fe700 1 -- 172.21.15.22:0/1423561714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400bd60 con 0x7f7bec141500 2023-10-08T00:25:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/1423561714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec141500 msgr2=0x7f7bec0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/1423561714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec141500 0x7f7bec0c8e00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0cf210 tx=0x7f7bd4009250 comp rx=0 tx=0).stop 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/1423561714 shutdown_connections 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/1423561714 >> v2:172.21.15.192:3300/0 conn(0x7f7bec06c0a0 0x7f7bec0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/1423561714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec141500 0x7f7bec0c8e00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/1423561714 >> 172.21.15.22:0/1423561714 conn(0x7f7bec0ce600 msgr2=0x7f7bec0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/1423561714 shutdown_connections 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.644+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/1423561714 wait complete. 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.645+0000 7f7bf2b7e700 1 Processor -- start 2023-10-08T00:25:23.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.645+0000 7f7bf2b7e700 1 -- start start 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf2b7e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bec06bcd0 0x7f7bec0aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf2b7e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bec06c0a0 0x7f7bec13e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf2b7e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 0x7f7bec06aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf2b7e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec13d0e0 con 0x7f7bec0b13a0 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf2b7e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec13f3e0 con 0x7f7bec06c0a0 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf2b7e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec13ca90 con 0x7f7bec06bcd0 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 0x7f7bec06aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 0x7f7bec06aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40920/0 (socket says 172.21.15.22:40920) 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 -- 172.21.15.22:0/259298577 learned_addr learned my addr 172.21.15.22:0/259298577 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf091a700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bec06bcd0 0x7f7bec0aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bebfff700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bec06c0a0 0x7f7bec13e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 -- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bec06bcd0 msgr2=0x7f7bec0aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bec06bcd0 0x7f7bec0aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 -- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bec06c0a0 msgr2=0x7f7bec13e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bec06c0a0 0x7f7bec13e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 -- 172.21.15.22:0/259298577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40094f0 con 0x7f7bec0b13a0 2023-10-08T00:25:23.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7bf111b700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 0x7f7bec06aa80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009fc0 tx=0x7f7be40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.646+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be400dbe0 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.647+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be400f040 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.647+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec13cd70 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.647+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4015440 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.647+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec0b4030 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.647+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec13d470 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.648+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7be401e3b0 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.648+0000 7f7be8ff9700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.648+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7be4084910 con 0x7f7bec0b13a0 2023-10-08T00:25:23.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.648+0000 7f7bf091a700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.649+0000 7f7bf091a700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bcc066f30 0x7f7bcc0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc003ac0 tx=0x7f7bdc000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.652+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7be4051b80 con 0x7f7bec0b13a0 2023-10-08T00:25:23.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.846+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bec04c3c0 con 0x7f7bec0b13a0 2023-10-08T00:25:23.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.846+0000 7f7be8ff9700 1 -- 172.21.15.22:0/259298577 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7be401a020 con 0x7f7bec0b13a0 2023-10-08T00:25:23.847 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bcc066f30 msgr2=0x7f7bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bcc066f30 0x7f7bcc0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc003ac0 tx=0x7f7bdc000bc0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 msgr2=0x7f7bec06aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 0x7f7bec06aa80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009fc0 tx=0x7f7be40099b0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 shutdown_connections 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bec0b13a0 0x7f7bec06aa80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bec06bcd0 0x7f7bec0aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 --2- 172.21.15.22:0/259298577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bec06c0a0 0x7f7bec13e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 >> 172.21.15.22:0/259298577 conn(0x7f7bec0ce600 msgr2=0x7f7bec0c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:23.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 shutdown_connections 2023-10-08T00:25:23.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.848+0000 7f7bf2b7e700 1 -- 172.21.15.22:0/259298577 wait complete. 2023-10-08T00:25:23.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:25:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.983+0000 7f308682a700 1 Processor -- start 2023-10-08T00:25:23.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.983+0000 7f308682a700 1 -- start start 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f308682a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159a60 0x7f30800c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f308682a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30800ccc00 0x7f3080069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f308682a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f308006a020 0x7f30800cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f308682a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308006dfc0 con 0x7f30800ccc00 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f308682a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800c9cb0 con 0x7f308006a020 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f308682a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c9f30 con 0x7f3080159a60 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30800ccc00 0x7f3080069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30800ccc00 0x7f3080069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40926/0 (socket says 172.21.15.22:40926) 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 -- 172.21.15.22:0/3717233586 learned_addr learned my addr 172.21.15.22:0/3717233586 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3086029700 1 --2- 172.21.15.22:0/3717233586 >> v2:172.21.15.192:3300/0 conn(0x7f308006a020 0x7f30800cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085828700 1 --2- 172.21.15.22:0/3717233586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159a60 0x7f30800c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 -- 172.21.15.22:0/3717233586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159a60 msgr2=0x7f30800c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 --2- 172.21.15.22:0/3717233586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159a60 0x7f30800c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 -- 172.21.15.22:0/3717233586 >> v2:172.21.15.192:3300/0 conn(0x7f308006a020 msgr2=0x7f30800cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 --2- 172.21.15.22:0/3717233586 >> v2:172.21.15.192:3300/0 conn(0x7f308006a020 0x7f30800cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 -- 172.21.15.22:0/3717233586 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800ca470 con 0x7f30800ccc00 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3085027700 1 --2- 172.21.15.22:0/3717233586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30800ccc00 0x7f3080069ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f30800cf6a0 tx=0x7f3074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f306b2812d4b67b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3084826700 1 -- 172.21.15.22:0/3717233586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400b8f0 con 0x7f30800ccc00 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3084826700 1 -- 172.21.15.22:0/3717233586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400ba50 con 0x7f30800ccc00 2023-10-08T00:25:23.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.984+0000 7f3084826700 1 -- 172.21.15.22:0/3717233586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400bdf0 con 0x7f30800ccc00 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 -- 172.21.15.22:0/3717233586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30800ccc00 msgr2=0x7f3080069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 --2- 172.21.15.22:0/3717233586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30800ccc00 0x7f3080069ae0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f30800cf6a0 tx=0x7f3074009250 comp rx=0 tx=0).stop 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 -- 172.21.15.22:0/3717233586 shutdown_connections 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 --2- 172.21.15.22:0/3717233586 >> v2:172.21.15.192:3300/0 conn(0x7f308006a020 0x7f30800cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 --2- 172.21.15.22:0/3717233586 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159a60 0x7f30800c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 --2- 172.21.15.22:0/3717233586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30800ccc00 0x7f3080069ae0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 -- 172.21.15.22:0/3717233586 >> 172.21.15.22:0/3717233586 conn(0x7f308006baa0 msgr2=0x7f308006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 -- 172.21.15.22:0/3717233586 shutdown_connections 2023-10-08T00:25:23.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.985+0000 7f308682a700 1 -- 172.21.15.22:0/3717233586 wait complete. 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.986+0000 7f308682a700 1 Processor -- start 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.986+0000 7f308682a700 1 -- start start 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f308682a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f308006a020 0x7f30800c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f308682a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30800ccc00 0x7f30801555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f308682a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 0x7f30800a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f308682a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3080155b20 con 0x7f3080159a60 2023-10-08T00:25:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f308682a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c8150 con 0x7f30800ccc00 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f308682a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c7540 con 0x7f308006a020 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 0x7f30800a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 0x7f30800a99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40942/0 (socket says 172.21.15.22:40942) 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 -- 172.21.15.22:0/861801230 learned_addr learned my addr 172.21.15.22:0/861801230 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3085828700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f308006a020 0x7f30800c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3085027700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30800ccc00 0x7f30801555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 -- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f308006a020 msgr2=0x7f30800c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f308006a020 0x7f30800c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 -- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30800ccc00 msgr2=0x7f30801555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30800ccc00 0x7f30801555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 -- 172.21.15.22:0/861801230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30740094f0 con 0x7f3080159a60 2023-10-08T00:25:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.987+0000 7f3086029700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 0x7f30800a99d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f307800ceb0 tx=0x7f3078007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.988+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307800ad90 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.988+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078016430 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.988+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30800c7820 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.988+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780167d0 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.988+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30800c7de0 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.989+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30800c82e0 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.989+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3078003020 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.989+0000 7f307dffb700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c066f30 0x7f306c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.990+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3078012070 con 0x7f3080159a60 2023-10-08T00:25:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.990+0000 7f3085828700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c066f30 0x7f306c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:23.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.990+0000 7f3085828700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c066f30 0x7f306c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3070006fd0 tx=0x7f3070008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:23.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:23.994+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30780525a0 con 0x7f3080159a60 2023-10-08T00:25:24.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.187+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30800ca750 con 0x7f3080159a60 2023-10-08T00:25:24.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.188+0000 7f307dffb700 1 -- 172.21.15.22:0/861801230 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3078055bc0 con 0x7f3080159a60 2023-10-08T00:25:24.188 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:25:24.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c066f30 msgr2=0x7f306c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c066f30 0x7f306c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3070006fd0 tx=0x7f3070008040 comp rx=0 tx=0).stop 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 msgr2=0x7f30800a99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 0x7f30800a99d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f307800ceb0 tx=0x7f3078007870 comp rx=0 tx=0).stop 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 shutdown_connections 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159a60 0x7f30800a99d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c066f30 0x7f306c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f308006a020 0x7f30800c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 --2- 172.21.15.22:0/861801230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30800ccc00 0x7f30801555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 >> 172.21.15.22:0/861801230 conn(0x7f308006baa0 msgr2=0x7f3080158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:24.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 shutdown_connections 2023-10-08T00:25:24.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.190+0000 7f308682a700 1 -- 172.21.15.22:0/861801230 wait complete. 2023-10-08T00:25:24.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.321+0000 7f83466c8700 1 Processor -- start 2023-10-08T00:25:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.321+0000 7f83466c8700 1 -- start start 2023-10-08T00:25:24.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f83466c8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8340159c10 0x7f834015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f83466c8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83400b5ea0 0x7f8340068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f83466c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340068bb0 0x7f834015c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f83466c8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400b2a40 con 0x7f8340159c10 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f83466c8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834015c480 con 0x7f83400b5ea0 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f83466c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834015b5d0 con 0x7f8340068bb0 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.322+0000 7f833ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8340159c10 0x7f834015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8340159c10 0x7f834015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40944/0 (socket says 172.21.15.22:40944) 2023-10-08T00:25:24.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 -- 172.21.15.22:0/3597842389 learned_addr learned my addr 172.21.15.22:0/3597842389 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f8344c65700 1 --2- 172.21.15.22:0/3597842389 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340068bb0 0x7f834015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833f7fe700 1 --2- 172.21.15.22:0/3597842389 >> v2:172.21.15.192:3300/0 conn(0x7f83400b5ea0 0x7f8340068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 -- 172.21.15.22:0/3597842389 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340068bb0 msgr2=0x7f834015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 --2- 172.21.15.22:0/3597842389 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340068bb0 0x7f834015c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 -- 172.21.15.22:0/3597842389 >> v2:172.21.15.192:3300/0 conn(0x7f83400b5ea0 msgr2=0x7f8340068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 --2- 172.21.15.22:0/3597842389 >> v2:172.21.15.192:3300/0 conn(0x7f83400b5ea0 0x7f8340068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 -- 172.21.15.22:0/3597842389 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834015b870 con 0x7f8340159c10 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833ffff700 1 --2- 172.21.15.22:0/3597842389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340159c10 0x7f834015b090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f834009a150 tx=0x7f8330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40955c7b1980f566 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833effd700 1 -- 172.21.15.22:0/3597842389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833000b640 con 0x7f8340159c10 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833effd700 1 -- 172.21.15.22:0/3597842389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833000b7a0 con 0x7f8340159c10 2023-10-08T00:25:24.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.323+0000 7f833effd700 1 -- 172.21.15.22:0/3597842389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833000bb60 con 0x7f8340159c10 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 -- 172.21.15.22:0/3597842389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340159c10 msgr2=0x7f834015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 --2- 172.21.15.22:0/3597842389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340159c10 0x7f834015b090 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f834009a150 tx=0x7f8330009250 comp rx=0 tx=0).stop 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 -- 172.21.15.22:0/3597842389 shutdown_connections 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 --2- 172.21.15.22:0/3597842389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340159c10 0x7f834015b090 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 --2- 172.21.15.22:0/3597842389 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340068bb0 0x7f834015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 --2- 172.21.15.22:0/3597842389 >> v2:172.21.15.192:3300/0 conn(0x7f83400b5ea0 0x7f8340068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 -- 172.21.15.22:0/3597842389 >> 172.21.15.22:0/3597842389 conn(0x7f8340099a20 msgr2=0x7f83400af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 -- 172.21.15.22:0/3597842389 shutdown_connections 2023-10-08T00:25:24.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.324+0000 7f83466c8700 1 -- 172.21.15.22:0/3597842389 wait complete. 2023-10-08T00:25:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.325+0000 7f83466c8700 1 Processor -- start 2023-10-08T00:25:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.325+0000 7f83466c8700 1 -- start start 2023-10-08T00:25:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f83466c8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 0x7f834014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f83466c8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83400b5ea0 0x7f83400b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f83466c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340159c10 0x7f83400b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f83466c8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834016c2f0 con 0x7f8340068bb0 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f83466c8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834016c5d0 con 0x7f83400b5ea0 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f83466c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834016c8b0 con 0x7f8340159c10 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 0x7f834014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 0x7f834014c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40952/0 (socket says 172.21.15.22:40952) 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 -- 172.21.15.22:0/3948625940 learned_addr learned my addr 172.21.15.22:0/3948625940 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833f7fe700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83400b5ea0 0x7f83400b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f8344c65700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340159c10 0x7f83400b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 -- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340159c10 msgr2=0x7f83400b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340159c10 0x7f83400b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 -- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83400b5ea0 msgr2=0x7f83400b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83400b5ea0 0x7f83400b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f833ffff700 1 -- 172.21.15.22:0/3948625940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83300094f0 con 0x7f8340068bb0 2023-10-08T00:25:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.326+0000 7f8344c65700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340159c10 0x7f83400b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.327+0000 7f833ffff700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 0x7f834014c260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8340063db0 tx=0x7f8330017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.327+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330000c40 con 0x7f8340068bb0 2023-10-08T00:25:24.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.327+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833000b910 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.327+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330025420 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.327+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834016cb90 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.327+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834014c7a0 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.328+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834004c3c0 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.328+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8330023070 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.328+0000 7f8337fff700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.328+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8330085710 con 0x7f8340068bb0 2023-10-08T00:25:24.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.329+0000 7f833f7fe700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.329+0000 7f833f7fe700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8320066f30 0x7f83200693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8328009db0 tx=0x7f83280091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:24.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.333+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8330052980 con 0x7f8340068bb0 2023-10-08T00:25:24.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.575+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f834015bb50 con 0x7f8340068bb0 2023-10-08T00:25:24.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.576+0000 7f8337fff700 1 -- 172.21.15.22:0/3948625940 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f8330055fa0 con 0x7f8340068bb0 2023-10-08T00:25:24.576 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:24.577 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8320066f30 msgr2=0x7f83200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8320066f30 0x7f83200693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8328009db0 tx=0x7f83280091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 msgr2=0x7f834014c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 0x7f834014c260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8340063db0 tx=0x7f8330017000 comp rx=0 tx=0).stop 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 shutdown_connections 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8340159c10 0x7f83400b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8340068bb0 0x7f834014c260 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 --2- 172.21.15.22:0/3948625940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83400b5ea0 0x7f83400b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 >> 172.21.15.22:0/3948625940 conn(0x7f8340099a20 msgr2=0x7f834009b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:24.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 shutdown_connections 2023-10-08T00:25:24.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.578+0000 7f83466c8700 1 -- 172.21.15.22:0/3948625940 wait complete. 2023-10-08T00:25:24.580 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:24.591 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:24.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 Processor -- start 2023-10-08T00:25:24.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 -- start start 2023-10-08T00:25:24.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4180159890 0x7f418015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180069560 0x7f41800699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180069ee0 con 0x7f4180159c60 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418015a160 con 0x7f4180159890 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.710+0000 7f4185434700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800d13a0 con 0x7f4180069560 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4180159890 0x7f418015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417e7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4180159c60 0x7f418015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37558/0 (socket says 172.21.15.22:37558) 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417e7fc700 1 -- 172.21.15.22:0/1421602455 learned_addr learned my addr 172.21.15.22:0/1421602455 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417f7fe700 1 --2- 172.21.15.22:0/1421602455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180069560 0x7f41800699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417dffb700 1 -- 172.21.15.22:0/1421602455 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583652252 0 0) 0x7f4180069ee0 con 0x7f4180159c60 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417dffb700 1 -- 172.21.15.22:0/1421602455 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003570 con 0x7f4180159c60 2023-10-08T00:25:24.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417effd700 1 -- 172.21.15.22:0/1421602455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180069560 msgr2=0x7f41800699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417effd700 1 --2- 172.21.15.22:0/1421602455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180069560 0x7f41800699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417effd700 1 -- 172.21.15.22:0/1421602455 >> v1:172.21.15.22:6789/0 conn(0x7f4180159c60 legacy=0x7f418015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417effd700 1 -- 172.21.15.22:0/1421602455 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418015e140 con 0x7f4180159890 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417effd700 1 --2- 172.21.15.22:0/1421602455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159890 0x7f418015abd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4178009e60 tx=0x7f4178009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0d52beb7330e42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417dffb700 1 -- 172.21.15.22:0/1421602455 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417800e070 con 0x7f4180159890 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417dffb700 1 -- 172.21.15.22:0/1421602455 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417800bb60 con 0x7f4180159890 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.711+0000 7f417dffb700 1 -- 172.21.15.22:0/1421602455 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178012430 con 0x7f4180159890 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 -- 172.21.15.22:0/1421602455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159890 msgr2=0x7f418015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 --2- 172.21.15.22:0/1421602455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159890 0x7f418015abd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4178009e60 tx=0x7f4178009780 comp rx=0 tx=0).stop 2023-10-08T00:25:24.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 -- 172.21.15.22:0/1421602455 shutdown_connections 2023-10-08T00:25:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 --2- 172.21.15.22:0/1421602455 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180069560 0x7f41800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 --2- 172.21.15.22:0/1421602455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159890 0x7f418015abd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 -- 172.21.15.22:0/1421602455 >> 172.21.15.22:0/1421602455 conn(0x7f4180068e20 msgr2=0x7f41800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 -- 172.21.15.22:0/1421602455 shutdown_connections 2023-10-08T00:25:24.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.712+0000 7f4185434700 1 -- 172.21.15.22:0/1421602455 wait complete. 2023-10-08T00:25:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.713+0000 7f4185434700 1 Processor -- start 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.713+0000 7f4185434700 1 -- start start 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f4185434700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4180069560 0x7f4180152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f4185434700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180159890 0x7f41800cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f4185434700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 0x7f418014ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f4185434700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801532d0 con 0x7f4180159c60 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f4185434700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180152bb0 con 0x7f4180069560 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f4185434700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41801518c0 con 0x7f4180159890 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 0x7f418014ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f417f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 0x7f418014ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40970/0 (socket says 172.21.15.22:40970) 2023-10-08T00:25:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f417f7fe700 1 -- 172.21.15.22:0/1619821082 learned_addr learned my addr 172.21.15.22:0/1619821082 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f417e7fc700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180159890 0x7f41800cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.714+0000 7f417effd700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4180069560 0x7f4180152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f417f7fe700 1 -- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180159890 msgr2=0x7f41800cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f417f7fe700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180159890 0x7f41800cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f417f7fe700 1 -- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4180069560 msgr2=0x7f4180152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f417f7fe700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4180069560 0x7f4180152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f417f7fe700 1 -- 172.21.15.22:0/1619821082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009a20 con 0x7f4180159c60 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f417f7fe700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 0x7f418014ae20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f417000d860 tx=0x7f4170008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700125f0 con 0x7f4180159c60 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170012790 con 0x7f4180159c60 2023-10-08T00:25:24.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41800cfa20 con 0x7f4180159c60 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170012b50 con 0x7f4180159c60 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.715+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41800cd600 con 0x7f4180159c60 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.716+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004c3c0 con 0x7f4180159c60 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.716+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4170013480 con 0x7f4180159c60 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.717+0000 7f4176ffd700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4160066f30 0x7f41600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.717+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4170084800 con 0x7f4180159c60 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.717+0000 7f417effd700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4160066f30 0x7f41600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:24.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.717+0000 7f417effd700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4160066f30 0x7f41600693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f41780097c0 tx=0x7f4178019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:24.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.721+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4170051a70 con 0x7f4180159c60 2023-10-08T00:25:24.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.916+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f418006a5b0 con 0x7f4180159c60 2023-10-08T00:25:24.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.917+0000 7f4176ffd700 1 -- 172.21.15.22:0/1619821082 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4170055090 con 0x7f4180159c60 2023-10-08T00:25:24.917 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:24.918 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:24.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4160066f30 msgr2=0x7f41600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4160066f30 0x7f41600693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f41780097c0 tx=0x7f4178019000 comp rx=0 tx=0).stop 2023-10-08T00:25:24.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 msgr2=0x7f418014ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:24.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 0x7f418014ae20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f417000d860 tx=0x7f4170008040 comp rx=0 tx=0).stop 2023-10-08T00:25:24.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 shutdown_connections 2023-10-08T00:25:24.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4180159c60 0x7f418014ae20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4180069560 0x7f4180152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4160066f30 0x7f41600693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 --2- 172.21.15.22:0/1619821082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4180159890 0x7f41800cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 >> 172.21.15.22:0/1619821082 conn(0x7f4180068e20 msgr2=0x7f418014d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 shutdown_connections 2023-10-08T00:25:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:24.919+0000 7f4185434700 1 -- 172.21.15.22:0/1619821082 wait complete. 2023-10-08T00:25:24.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:25:24.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.053+0000 7f859b12a700 1 Processor -- start 2023-10-08T00:25:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.053+0000 7f859b12a700 1 -- start start 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859b12a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f859415d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859b12a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85940b2980 con 0x7f8594159420 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859b12a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859415dbb0 con 0x7f85941597f0 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859b12a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940b11d0 con 0x7f859415d230 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859a128700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8594159420 0x7f85940b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37574/0 (socket says 172.21.15.22:37574) 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859a128700 1 -- 172.21.15.22:0/1396310429 learned_addr learned my addr 172.21.15.22:0/1396310429 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499533193 0 0) 0x7f85940b2980 con 0x7f8594159420 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f859a929700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f859415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857c003570 con 0x7f8594159420 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700467951 0 0) 0x7f857c003570 con 0x7f8594159420 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 msgr2=0x7f859415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f859415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 >> v1:172.21.15.192:6789/0 conn(0x7f85941597f0 legacy=0x7f85940b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940b14b0 con 0x7f8594159420 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.054+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f858c001470 con 0x7f8594159420 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 >> v1:172.21.15.22:6789/0 conn(0x7f8594159420 legacy=0x7f85940b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c003a90 0x7f857c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c004810 0x7f857c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f857c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940b11d0 con 0x7f857c003a90 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c00bb60 con 0x7f857c004810 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c00bd20 con 0x7f859415d230 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c003a90 0x7f857c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599927700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c004810 0x7f857c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a929700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f857c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 -- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 msgr2=0x7f857c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f857c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 -- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c004810 msgr2=0x7f857c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c004810 0x7f857c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 -- 172.21.15.22:0/1396310429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c003570 con 0x7f857c003a90 2023-10-08T00:25:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a929700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f859415d230 0x7f857c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f859a128700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c003a90 0x7f857c003ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c3c0 tx=0x7f858c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f7d94645d6a59f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00cc90 con 0x7f857c003a90 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00cdf0 con 0x7f857c003a90 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.055+0000 7f8599126700 1 -- 172.21.15.22:0/1396310429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c005b70 con 0x7f857c003a90 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859b12a700 1 -- 172.21.15.22:0/1396310429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c003a90 msgr2=0x7f857c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859b12a700 1 --2- 172.21.15.22:0/1396310429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c003a90 0x7f857c003ea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c3c0 tx=0x7f858c001e50 comp rx=0 tx=0).stop 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859a929700 1 -- 172.21.15.22:0/1396310429 reap_dead start 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859b12a700 1 -- 172.21.15.22:0/1396310429 shutdown_connections 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859b12a700 1 -- 172.21.15.22:0/1396310429 >> 172.21.15.22:0/1396310429 conn(0x7f85940d0660 msgr2=0x7f85940d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859b12a700 1 -- 172.21.15.22:0/1396310429 shutdown_connections 2023-10-08T00:25:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.056+0000 7f859b12a700 1 -- 172.21.15.22:0/1396310429 wait complete. 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.057+0000 7f859b12a700 1 Processor -- start 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.057+0000 7f859b12a700 1 -- start start 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859b12a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c003a90 0x7f85941550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859b12a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 0x7f85940cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859b12a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940c5470 0x7f85940c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859b12a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940d02e0 con 0x7f85940cf950 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859b12a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c6d20 con 0x7f857c003a90 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859b12a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c61a0 con 0x7f85940c5470 2023-10-08T00:25:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 0x7f85940cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 0x7f85940cfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40990/0 (socket says 172.21.15.22:40990) 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 -- 172.21.15.22:0/1741187174 learned_addr learned my addr 172.21.15.22:0/1741187174 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859a128700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c003a90 0x7f85941550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859a929700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940c5470 0x7f85940c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 -- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940c5470 msgr2=0x7f85940c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940c5470 0x7f85940c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 -- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c003a90 msgr2=0x7f85941550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c003a90 0x7f85941550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 -- 172.21.15.22:0/1741187174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85940c6480 con 0x7f85940cf950 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f859a128700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c003a90 0x7f85941550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f8599927700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 0x7f85940cfda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f85880029d0 tx=0x7f8588007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.058+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800f7f0 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.059+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858800f950 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.059+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800fd10 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.059+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940c6760 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.059+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940c5e30 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.059+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859404c3c0 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.060+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8588013600 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.060+0000 7f85927fc700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8580066f30 0x7f85800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.060+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85880849f0 con 0x7f85940cf950 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.060+0000 7f859a128700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8580066f30 0x7f85800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.061+0000 7f859a128700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8580066f30 0x7f85800693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f858c001e90 tx=0x7f858c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.064+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8588051c60 con 0x7f85940cf950 2023-10-08T00:25:25.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.303+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85940b1790 con 0x7f85940cf950 2023-10-08T00:25:25.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.304+0000 7f85927fc700 1 -- 172.21.15.22:0/1741187174 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f8588055280 con 0x7f85940cf950 2023-10-08T00:25:25.305 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:25.305 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8580066f30 msgr2=0x7f85800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8580066f30 0x7f85800693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f858c001e90 tx=0x7f858c015000 comp rx=0 tx=0).stop 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 msgr2=0x7f85940cfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 0x7f85940cfda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f85880029d0 tx=0x7f8588007d30 comp rx=0 tx=0).stop 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 shutdown_connections 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8580066f30 0x7f85800693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f85940c5470 0x7f85940c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c003a90 0x7f85941550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 --2- 172.21.15.22:0/1741187174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85940cf950 0x7f85940cfda0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 >> 172.21.15.22:0/1741187174 conn(0x7f85940d0660 msgr2=0x7f8594068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:25.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 shutdown_connections 2023-10-08T00:25:25.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.306+0000 7f859b12a700 1 -- 172.21.15.22:0/1741187174 wait complete. 2023-10-08T00:25:25.308 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:25.319 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:25.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.437+0000 7fed62325700 1 Processor -- start 2023-10-08T00:25:25.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.437+0000 7fed62325700 1 -- start start 2023-10-08T00:25:25.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed62325700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fed5c159890 0x7fed5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed62325700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fed5c069560 0x7fed5c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed62325700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c069ee0 con 0x7fed5c159c60 2023-10-08T00:25:25.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed62325700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c15a160 con 0x7fed5c069560 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed62325700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0d13a0 con 0x7fed5c159890 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed5b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fed5c159c60 0x7fed5c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37586/0 (socket says 172.21.15.22:37586) 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed5b7fe700 1 -- 172.21.15.22:0/3667331833 learned_addr learned my addr 172.21.15.22:0/3667331833 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed608c2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fed5c069560 0x7fed5c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed5affd700 1 -- 172.21.15.22:0/3667331833 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728910894 0 0) 0x7fed5c069ee0 con 0x7fed5c159c60 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed5affd700 1 -- 172.21.15.22:0/3667331833 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed48003570 con 0x7fed5c159c60 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed5bfff700 1 --2- 172.21.15.22:0/3667331833 >> v2:172.21.15.192:3300/0 conn(0x7fed5c159890 0x7fed5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed608c2700 1 -- 172.21.15.22:0/3667331833 >> v2:172.21.15.192:3300/0 conn(0x7fed5c159890 msgr2=0x7fed5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed608c2700 1 --2- 172.21.15.22:0/3667331833 >> v2:172.21.15.192:3300/0 conn(0x7fed5c159890 0x7fed5c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.438+0000 7fed608c2700 1 -- 172.21.15.22:0/3667331833 >> v1:172.21.15.22:6789/0 conn(0x7fed5c159c60 legacy=0x7fed5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed608c2700 1 -- 172.21.15.22:0/3667331833 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c15e140 con 0x7fed5c069560 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed608c2700 1 --2- 172.21.15.22:0/3667331833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c069560 0x7fed5c0699a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0d1090 tx=0x7fed54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49adb819b16d960b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed5affd700 1 -- 172.21.15.22:0/3667331833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400e070 con 0x7fed5c069560 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed5affd700 1 -- 172.21.15.22:0/3667331833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400bb60 con 0x7fed5c069560 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed5affd700 1 -- 172.21.15.22:0/3667331833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54012430 con 0x7fed5c069560 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 -- 172.21.15.22:0/3667331833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c069560 msgr2=0x7fed5c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 --2- 172.21.15.22:0/3667331833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c069560 0x7fed5c0699a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0d1090 tx=0x7fed54009780 comp rx=0 tx=0).stop 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 -- 172.21.15.22:0/3667331833 shutdown_connections 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 --2- 172.21.15.22:0/3667331833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c069560 0x7fed5c0699a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 --2- 172.21.15.22:0/3667331833 >> v2:172.21.15.192:3300/0 conn(0x7fed5c159890 0x7fed5c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 -- 172.21.15.22:0/3667331833 >> 172.21.15.22:0/3667331833 conn(0x7fed5c068e20 msgr2=0x7fed5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 -- 172.21.15.22:0/3667331833 shutdown_connections 2023-10-08T00:25:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.439+0000 7fed62325700 1 -- 172.21.15.22:0/3667331833 wait complete. 2023-10-08T00:25:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.440+0000 7fed62325700 1 Processor -- start 2023-10-08T00:25:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 -- start start 2023-10-08T00:25:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed5c069560 0x7fed5c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 0x7fed5c15c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed5c159c60 0x7fed5c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0ce4b0 con 0x7fed5c159890 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0cdb60 con 0x7fed5c069560 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.441+0000 7fed62325700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0cde40 con 0x7fed5c159c60 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 0x7fed5c15c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 0x7fed5c15c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41006/0 (socket says 172.21.15.22:41006) 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 -- 172.21.15.22:0/4157500343 learned_addr learned my addr 172.21.15.22:0/4157500343 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5bfff700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed5c069560 0x7fed5c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed608c2700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed5c159c60 0x7fed5c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 -- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed5c159c60 msgr2=0x7fed5c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed5c159c60 0x7fed5c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 -- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed5c069560 msgr2=0x7fed5c0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed5c069560 0x7fed5c0b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 -- 172.21.15.22:0/4157500343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009a20 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed5b7fe700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 0x7fed5c15c6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c590 tx=0x7fed44007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44005b30 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44005cb0 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0ce750 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44007320 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.442+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c16d650 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.443+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c0ce990 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.444+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed4401b3b0 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.444+0000 7fed53fff700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed3c066f30 0x7fed3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.444+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed440839b0 con 0x7fed5c159890 2023-10-08T00:25:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.444+0000 7fed5bfff700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed3c066f30 0x7fed3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.445+0000 7fed5bfff700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed3c066f30 0x7fed3c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00acb0 tx=0x7fed4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.448+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed5c0ce990 con 0x7fed5c159890 2023-10-08T00:25:25.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.690+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed5c0ce990 con 0x7fed5c159890 2023-10-08T00:25:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.690+0000 7fed53fff700 1 -- 172.21.15.22:0/4157500343 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fed5c0ce990 con 0x7fed5c159890 2023-10-08T00:25:25.691 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:25.691 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/607403885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":607403885},{"type":"v1","addr":"172.21.15.192:6836","nonce":607403885}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3998807557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3998807557},{"type":"v1","addr":"172.21.15.192:6837","nonce":3998807557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3362906903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3362906903},{"type":"v1","addr":"172.21.15.22:6834","nonce":3362906903}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:24:52.359859+0000","modified":"2023-10-08T00:24:55.987975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3859346332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3859346332},{"type":"v1","addr":"172.21.15.22:6835","nonce":3859346332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed3c066f30 msgr2=0x7fed3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed3c066f30 0x7fed3c0693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00acb0 tx=0x7fed4c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 msgr2=0x7fed5c15c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 0x7fed5c15c6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c590 tx=0x7fed44007e00 comp rx=0 tx=0).stop 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 shutdown_connections 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed3c066f30 0x7fed3c0693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed5c159c60 0x7fed5c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed5c069560 0x7fed5c0b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 --2- 172.21.15.22:0/4157500343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5c159890 0x7fed5c15c6d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 >> 172.21.15.22:0/4157500343 conn(0x7fed5c068e20 msgr2=0x7fed5c149b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:25.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 shutdown_connections 2023-10-08T00:25:25.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.693+0000 7fed62325700 1 -- 172.21.15.22:0/4157500343 wait complete. 2023-10-08T00:25:25.695 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2023-10-08T00:25:25.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:25.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.824+0000 7f5567026700 1 Processor -- start 2023-10-08T00:25:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.824+0000 7f5567026700 1 -- start start 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5567026700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55600b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5567026700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f556015d230 0x7f556015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5567026700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556015dbd0 con 0x7f5560159420 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5567026700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600b11d0 con 0x7f556015d230 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5567026700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600b14b0 con 0x7f55601597f0 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5566024700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5560159420 0x7f55600b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37588/0 (socket says 172.21.15.22:37588) 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5566024700 1 -- 172.21.15.22:0/936334497 learned_addr learned my addr 172.21.15.22:0/936334497 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:25.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371035097 0 0) 0x7f5550001490 con 0x7f5560159420 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5548003570 con 0x7f5560159420 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5566825700 1 --2- 172.21.15.22:0/936334497 >> v2:172.21.15.192:3300/0 conn(0x7f556015d230 0x7f556015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.825+0000 7f5565823700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55600b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888143362 0 0) 0x7f5548003570 con 0x7f5560159420 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 msgr2=0x7f55600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55600b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 >> v2:172.21.15.192:3300/0 conn(0x7f556015d230 msgr2=0x7f556015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 --2- 172.21.15.22:0/936334497 >> v2:172.21.15.192:3300/0 conn(0x7f556015d230 0x7f556015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600b1790 con 0x7f5560159420 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5550001980 con 0x7f5560159420 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 >> v1:172.21.15.22:6789/0 conn(0x7f5560159420 legacy=0x7f55600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5548003a60 0x7f5548003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548004810 0x7f5548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600b11d0 con 0x7f5548003a60 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600b14b0 con 0x7f5548004810 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554800ba60 con 0x7f55601597f0 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5548003a60 0x7f5548003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565823700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548004810 0x7f5548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566825700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 -- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 msgr2=0x7f55480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 -- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548004810 msgr2=0x7f5548004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548004810 0x7f5548004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 -- 172.21.15.22:0/936334497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548003570 con 0x7f5548003a60 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566825700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55601597f0 0x7f55480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5566024700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5548003a60 0x7f5548003e70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f555000ab30 tx=0x7f555000a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac278d1b00a65895 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.826+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000a490 con 0x7f5548003a60 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555000c590 con 0x7f5548003a60 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5565022700 1 -- 172.21.15.22:0/936334497 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000c930 con 0x7f5548003a60 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5567026700 1 -- 172.21.15.22:0/936334497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5548003a60 msgr2=0x7f5548003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5567026700 1 --2- 172.21.15.22:0/936334497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5548003a60 0x7f5548003e70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f555000ab30 tx=0x7f555000a1a0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5566825700 1 -- 172.21.15.22:0/936334497 reap_dead start 2023-10-08T00:25:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5567026700 1 -- 172.21.15.22:0/936334497 shutdown_connections 2023-10-08T00:25:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5567026700 1 -- 172.21.15.22:0/936334497 >> 172.21.15.22:0/936334497 conn(0x7f55600d0660 msgr2=0x7f55600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5567026700 1 -- 172.21.15.22:0/936334497 shutdown_connections 2023-10-08T00:25:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.827+0000 7f5567026700 1 -- 172.21.15.22:0/936334497 wait complete. 2023-10-08T00:25:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.828+0000 7f5567026700 1 Processor -- start 2023-10-08T00:25:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.828+0000 7f5567026700 1 -- start start 2023-10-08T00:25:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5567026700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548003a60 0x7f556016a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5567026700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 0x7f55600c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5567026700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55600ce980 0x7f55600cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5567026700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c8720 con 0x7f55600c7d90 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5567026700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556016a9f0 con 0x7f5548003a60 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5567026700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600cf690 con 0x7f55600ce980 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 0x7f55600c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 0x7f55600c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41024/0 (socket says 172.21.15.22:41024) 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 -- 172.21.15.22:0/1668162569 learned_addr learned my addr 172.21.15.22:0/1668162569 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5566024700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548003a60 0x7f556016a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5566825700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55600ce980 0x7f55600cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 -- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55600ce980 msgr2=0x7f55600cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55600ce980 0x7f55600cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 -- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548003a60 msgr2=0x7f556016a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548003a60 0x7f556016a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.829+0000 7f5565823700 1 -- 172.21.15.22:0/1668162569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600cf970 con 0x7f55600c7d90 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.830+0000 7f5565823700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 0x7f55600c81e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5554011d40 tx=0x7f55540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.830+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555400fa10 con 0x7f55600c7d90 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.830+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555400fb70 con 0x7f55600c7d90 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.830+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600cfc50 con 0x7f55600c7d90 2023-10-08T00:25:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.830+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5554014440 con 0x7f55600c7d90 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.830+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55600d0210 con 0x7f55600c7d90 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.831+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600c5400 con 0x7f55600c7d90 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.831+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5554014870 con 0x7f55600c7d90 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.832+0000 7f555e7fc700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f554c067030 0x7f554c0694e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.832+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5554018030 con 0x7f55600c7d90 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.832+0000 7f5566024700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f554c067030 0x7f554c0694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.832+0000 7f5566024700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f554c067030 0x7f554c0694e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f555000aa50 tx=0x7f5550016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:25.836+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55600c5400 con 0x7f55600c7d90 2023-10-08T00:25:26.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.029+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55600c5400 con 0x7f55600c7d90 2023-10-08T00:25:26.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.030+0000 7f555e7fc700 1 -- 172.21.15.22:0/1668162569 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f55600c5400 con 0x7f55600c7d90 2023-10-08T00:25:26.031 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:26.031 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:24:53.967799+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:24:50.124994+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T00:24:51.343211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f554c067030 msgr2=0x7f554c0694e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f554c067030 0x7f554c0694e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f555000aa50 tx=0x7f5550016000 comp rx=0 tx=0).stop 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 msgr2=0x7f55600c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 0x7f55600c81e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5554011d40 tx=0x7f55540091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 shutdown_connections 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f554c067030 0x7f554c0694e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55600ce980 0x7f55600cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5548003a60 0x7f556016a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 --2- 172.21.15.22:0/1668162569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55600c7d90 0x7f55600c81e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 >> 172.21.15.22:0/1668162569 conn(0x7f55600d0660 msgr2=0x7f55600b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 shutdown_connections 2023-10-08T00:25:26.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.032+0000 7f5567026700 1 -- 172.21.15.22:0/1668162569 wait complete. 2023-10-08T00:25:26.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:25:26.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 Processor -- start 2023-10-08T00:25:26.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 -- start start 2023-10-08T00:25:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b18159c60 0x7f5b1815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b1815db10 0x7f5b18069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1815a160 con 0x7f5b18159890 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1815df50 con 0x7f5b18159c60 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.164+0000 7f5b1d2a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180d13a0 con 0x7f5b1815db10 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b167fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b18159c60 0x7f5b1815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b16ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5b18159890 0x7f5b1815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37600/0 (socket says 172.21.15.22:37600) 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b16ffd700 1 -- 172.21.15.22:0/4037050088 learned_addr learned my addr 172.21.15.22:0/4037050088 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b177fe700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b1815db10 0x7f5b18069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b167fc700 1 -- 172.21.15.22:0/4037050088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b1815db10 msgr2=0x7f5b18069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b167fc700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b1815db10 0x7f5b18069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b167fc700 1 -- 172.21.15.22:0/4037050088 >> v1:172.21.15.22:6789/0 conn(0x7f5b18159890 legacy=0x7f5b1815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b167fc700 1 -- 172.21.15.22:0/4037050088 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1815e140 con 0x7f5b18159c60 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b15ffb700 1 -- 172.21.15.22:0/4037050088 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035461156 0 0) 0x7f5b1815a160 con 0x7f5b18159890 2023-10-08T00:25:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b177fe700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b1815db10 0x7f5b18069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b167fc700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b18159c60 0x7f5b1815d5d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0098e0 tx=0x7f5b0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbdc20a1f25d4a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b15ffb700 1 -- 172.21.15.22:0/4037050088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c009e80 con 0x7f5b18159c60 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b15ffb700 1 -- 172.21.15.22:0/4037050088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00b860 con 0x7f5b18159c60 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.165+0000 7f5b15ffb700 1 -- 172.21.15.22:0/4037050088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00bbe0 con 0x7f5b18159c60 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/4037050088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b18159c60 msgr2=0x7f5b1815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b18159c60 0x7f5b1815d5d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0098e0 tx=0x7f5b0c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/4037050088 shutdown_connections 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b1815db10 0x7f5b18069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/4037050088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b18159c60 0x7f5b1815d5d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/4037050088 >> 172.21.15.22:0/4037050088 conn(0x7f5b18068e20 msgr2=0x7f5b180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/4037050088 shutdown_connections 2023-10-08T00:25:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.166+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/4037050088 wait complete. 2023-10-08T00:25:26.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.167+0000 7f5b1d2a7700 1 Processor -- start 2023-10-08T00:25:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.167+0000 7f5b1d2a7700 1 -- start start 2023-10-08T00:25:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b1d2a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18159890 0x7f5b180cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b1d2a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b18159c60 0x7f5b180b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b1d2a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 0x7f5b181524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b1d2a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180b6460 con 0x7f5b1815db10 2023-10-08T00:25:26.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b1d2a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1816aa70 con 0x7f5b18159890 2023-10-08T00:25:26.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b1d2a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18152a10 con 0x7f5b18159c60 2023-10-08T00:25:26.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 0x7f5b181524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 0x7f5b181524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41042/0 (socket says 172.21.15.22:41042) 2023-10-08T00:25:26.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 -- 172.21.15.22:0/416421305 learned_addr learned my addr 172.21.15.22:0/416421305 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:26.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b16ffd700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18159890 0x7f5b180cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b167fc700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b18159c60 0x7f5b180b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 -- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b18159c60 msgr2=0x7f5b180b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b18159c60 0x7f5b180b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 -- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18159890 msgr2=0x7f5b180cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18159890 0x7f5b180cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 -- 172.21.15.22:0/416421305 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c009420 con 0x7f5b1815db10 2023-10-08T00:25:26.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.168+0000 7f5b177fe700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 0x7f5b181524d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000d100 tx=0x7f5b100099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.169+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000dda0 con 0x7f5b1815db10 2023-10-08T00:25:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.169+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000f040 con 0x7f5b1815db10 2023-10-08T00:25:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.169+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10015690 con 0x7f5b1815db10 2023-10-08T00:25:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.169+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b180cd750 con 0x7f5b1815db10 2023-10-08T00:25:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.169+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1816a420 con 0x7f5b1815db10 2023-10-08T00:25:26.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.169+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1804c3c0 con 0x7f5b1815db10 2023-10-08T00:25:26.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.170+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5b1001e3b0 con 0x7f5b1815db10 2023-10-08T00:25:26.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.170+0000 7f5afeffd700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b04066f30 0x7f5b040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.171+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b10084ab0 con 0x7f5b1815db10 2023-10-08T00:25:26.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.171+0000 7f5b16ffd700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b04066f30 0x7f5b040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.171+0000 7f5b16ffd700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b04066f30 0x7f5b040693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b080011e0 tx=0x7f5b08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:26.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.175+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b10051d20 con 0x7f5b1815db10 2023-10-08T00:25:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.416+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5b1816abb0 con 0x7f5b1815db10 2023-10-08T00:25:26.417 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:25:26.417+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:25:26.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.421+0000 7f5afeffd700 1 -- 172.21.15.22:0/416421305 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5b1001a090 con 0x7f5b1815db10 2023-10-08T00:25:26.423 INFO:tasks.ceph.mds.c.smithi022.stderr: -1655> 2023-10-08T00:24:57.689+0000 7f65a512a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:25:26.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b04066f30 msgr2=0x7f5b040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b04066f30 0x7f5b040693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b080011e0 tx=0x7f5b08009040 comp rx=0 tx=0).stop 2023-10-08T00:25:26.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 msgr2=0x7f5b181524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 0x7f5b181524d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000d100 tx=0x7f5b100099b0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 shutdown_connections 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b1815db10 0x7f5b181524d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18159890 0x7f5b180cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b04066f30 0x7f5b040693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 --2- 172.21.15.22:0/416421305 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b18159c60 0x7f5b180b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 >> 172.21.15.22:0/416421305 conn(0x7f5b18068e20 msgr2=0x7f5b18154fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 shutdown_connections 2023-10-08T00:25:26.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.424+0000 7f5b1d2a7700 1 -- 172.21.15.22:0/416421305 wait complete. 2023-10-08T00:25:26.426 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:25:26.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:25:26.446 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:25:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.558+0000 7fa9e5c3a700 1 Processor -- start 2023-10-08T00:25:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.558+0000 7fa9e5c3a700 1 -- start start 2023-10-08T00:25:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9e5c3a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa9e006aa40 0x7fa9e00cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9e5c3a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9e006bac0 0x7fa9e006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9e5c3a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e00cc210 con 0x7fa9e006b350 2023-10-08T00:25:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9e5c3a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00cc4f0 con 0x7fa9e006bac0 2023-10-08T00:25:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9e5c3a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e00cc7d0 con 0x7fa9e006aa40 2023-10-08T00:25:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9e006bac0 0x7fa9e006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9e006bac0 0x7fa9e006ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41070/0 (socket says 172.21.15.22:41070) 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.559+0000 7fa9deffd700 1 -- 172.21.15.22:0/1978589803 learned_addr learned my addr 172.21.15.22:0/1978589803 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1978589803 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006aa40 0x7fa9e00cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9deffd700 1 -- 172.21.15.22:0/1978589803 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006aa40 msgr2=0x7fa9e00cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9deffd700 1 --2- 172.21.15.22:0/1978589803 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006aa40 0x7fa9e00cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9deffd700 1 -- 172.21.15.22:0/1978589803 >> v1:172.21.15.192:6789/0 conn(0x7fa9e006b350 legacy=0x7fa9e00c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9deffd700 1 -- 172.21.15.22:0/1978589803 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e00ccab0 con 0x7fa9e006bac0 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1978589803 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006aa40 0x7fa9e00cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9deffd700 1 --2- 172.21.15.22:0/1978589803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bac0 0x7fa9e006ae10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa9e006e570 tx=0x7fa9d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436dcbd42d0bb30b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9de7fc700 1 -- 172.21.15.22:0/1978589803 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400b860 con 0x7fa9e006bac0 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9de7fc700 1 -- 172.21.15.22:0/1978589803 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d400b9c0 con 0x7fa9e006bac0 2023-10-08T00:25:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.560+0000 7fa9de7fc700 1 -- 172.21.15.22:0/1978589803 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400bd60 con 0x7fa9e006bac0 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/1978589803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bac0 msgr2=0x7fa9e006ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/1978589803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bac0 0x7fa9e006ae10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa9e006e570 tx=0x7fa9d4009250 comp rx=0 tx=0).stop 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/1978589803 shutdown_connections 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/1978589803 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006aa40 0x7fa9e00cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/1978589803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bac0 0x7fa9e006ae10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/1978589803 >> 172.21.15.22:0/1978589803 conn(0x7fa9e00cd670 msgr2=0x7fa9e00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/1978589803 shutdown_connections 2023-10-08T00:25:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.561+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/1978589803 wait complete. 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.562+0000 7fa9e5c3a700 1 Processor -- start 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.562+0000 7fa9e5c3a700 1 -- start start 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e006aa40 0x7fa9e00b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 0x7fa9e014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006bac0 0x7fa9e0161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00c6c40 con 0x7fa9e006b350 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e014ff70 con 0x7fa9e006aa40 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00c6310 con 0x7fa9e006bac0 2023-10-08T00:25:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 0x7fa9e014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 0x7fa9e014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41084/0 (socket says 172.21.15.22:41084) 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 -- 172.21.15.22:0/2215277772 learned_addr learned my addr 172.21.15.22:0/2215277772 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e006aa40 0x7fa9e00b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9dffff700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006bac0 0x7fa9e0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 -- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006bac0 msgr2=0x7fa9e0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006bac0 0x7fa9e0161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 -- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e006aa40 msgr2=0x7fa9e00b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e006aa40 0x7fa9e00b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 -- 172.21.15.22:0/2215277772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d40094f0 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e006aa40 0x7fa9e00b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9deffd700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 0x7fa9e014ee80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009290 tx=0x7fa9d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4011e60 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d401f070 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e00c65f0 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.563+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d401a870 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.564+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e00b31f0 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.564+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e00c6df0 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.565+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9d401abe0 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.565+0000 7fa9c77fe700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.565+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fa9d4021070 con 0x7fa9e006b350 2023-10-08T00:25:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.565+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.566+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc066f30 0x7fa9cc0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0006ea0 tx=0x7fa9d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.570+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9e00c6df0 con 0x7fa9e006b350 2023-10-08T00:25:26.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:26.811+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa9e004c3c0 con 0x7fa9e006b350 2023-10-08T00:25:27.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.421+0000 7fa9c77fe700 1 -- 172.21.15.22:0/2215277772 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa9d40536d0 con 0x7fa9e006b350 2023-10-08T00:25:27.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc066f30 msgr2=0x7fa9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:27.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc066f30 0x7fa9cc0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0006ea0 tx=0x7fa9d0008040 comp rx=0 tx=0).stop 2023-10-08T00:25:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 msgr2=0x7fa9e014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 0x7fa9e014ee80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009290 tx=0x7fa9d4017000 comp rx=0 tx=0).stop 2023-10-08T00:25:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 shutdown_connections 2023-10-08T00:25:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc066f30 0x7fa9cc0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006bac0 0x7fa9e0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e006aa40 0x7fa9e00b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 --2- 172.21.15.22:0/2215277772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006b350 0x7fa9e014ee80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 >> 172.21.15.22:0/2215277772 conn(0x7fa9e00cd670 msgr2=0x7fa9e00cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:27.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 shutdown_connections 2023-10-08T00:25:27.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.424+0000 7fa9e5c3a700 1 -- 172.21.15.22:0/2215277772 wait complete. 2023-10-08T00:25:27.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:25:27.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.609+0000 7f0db925a700 1 Processor -- start 2023-10-08T00:25:27.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.609+0000 7f0db925a700 1 -- start start 2023-10-08T00:25:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db925a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0db4155360 0x7f0db40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db925a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db925a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40b4560 con 0x7f0db40ceb60 2023-10-08T00:25:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db925a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db415c320 con 0x7f0db4155360 2023-10-08T00:25:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db925a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40cef90 con 0x7f0db40b40f0 2023-10-08T00:25:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db2d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0db4155360 0x7f0db40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db359e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0db40ceb60 0x7f0db406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42384/0 (socket says 172.21.15.22:42384) 2023-10-08T00:25:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.610+0000 7f0db359e700 1 -- 172.21.15.22:0/1294678752 learned_addr learned my addr 172.21.15.22:0/1294678752 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db259c700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db2d9d700 1 -- 172.21.15.22:0/1294678752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 msgr2=0x7f0db40ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db2d9d700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db2d9d700 1 -- 172.21.15.22:0/1294678752 >> v1:172.21.15.22:6789/0 conn(0x7f0db40ceb60 legacy=0x7f0db406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db2d9d700 1 -- 172.21.15.22:0/1294678752 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db415b710 con 0x7f0db4155360 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db1d9b700 1 -- 172.21.15.22:0/1294678752 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841033124 0 0) 0x7f0db40b4560 con 0x7f0db40ceb60 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db259c700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db2d9d700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db40b3bb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0da40098e0 tx=0x7f0da40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578bc8bbd6219abe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db1d9b700 1 -- 172.21.15.22:0/1294678752 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4009e80 con 0x7f0db4155360 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db1d9b700 1 -- 172.21.15.22:0/1294678752 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400b860 con 0x7f0db4155360 2023-10-08T00:25:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.611+0000 7f0db1d9b700 1 -- 172.21.15.22:0/1294678752 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400bbe0 con 0x7f0db4155360 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 -- 172.21.15.22:0/1294678752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 msgr2=0x7f0db40b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db40b3bb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0da40098e0 tx=0x7f0da40091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 -- 172.21.15.22:0/1294678752 shutdown_connections 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db40b3bb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 --2- 172.21.15.22:0/1294678752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 -- 172.21.15.22:0/1294678752 >> 172.21.15.22:0/1294678752 conn(0x7f0db406baf0 msgr2=0x7f0db406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 -- 172.21.15.22:0/1294678752 shutdown_connections 2023-10-08T00:25:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.612+0000 7f0db925a700 1 -- 172.21.15.22:0/1294678752 wait complete. 2023-10-08T00:25:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.613+0000 7f0db925a700 1 Processor -- start 2023-10-08T00:25:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.613+0000 7f0db925a700 1 -- start start 2023-10-08T00:25:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0db40ceb60 0x7f0db4150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40b0830 con 0x7f0db4155360 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40afc20 con 0x7f0db40ceb60 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40aff00 con 0x7f0db40b40f0 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db414dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47424/0 (socket says 172.21.15.22:47424) 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 -- 172.21.15.22:0/2694632998 learned_addr learned my addr 172.21.15.22:0/2694632998 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db2d9d700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db259c700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0db40ceb60 0x7f0db4150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 -- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 msgr2=0x7f0db40af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 -- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0db40ceb60 msgr2=0x7f0db4150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0db40ceb60 0x7f0db4150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 -- 172.21.15.22:0/2694632998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009420 con 0x7f0db4155360 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db359e700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db414dc40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00cc90 tx=0x7f0dac001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:27.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00a8b0 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00aa10 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.614+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db40b01e0 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.615+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00add0 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.615+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db40b0cc0 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.616+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db40b09e0 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.616+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dac007300 con 0x7f0db4155360 2023-10-08T00:25:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.616+0000 7f0daaffd700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d94066f30 0x7f0d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.616+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0dac0848a0 con 0x7f0db4155360 2023-10-08T00:25:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.616+0000 7f0db2d9d700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d94066f30 0x7f0d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.617+0000 7f0db2d9d700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d94066f30 0x7f0d940693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0da40091e0 tx=0x7f0da4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.620+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0db40b09e0 con 0x7f0db4155360 2023-10-08T00:25:27.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:27.814+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0db40b09e0 con 0x7f0db4155360 2023-10-08T00:25:28.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.660+0000 7f0daaffd700 1 -- 172.21.15.22:0/2694632998 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0db40b09e0 con 0x7f0db4155360 2023-10-08T00:25:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d94066f30 msgr2=0x7f0d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d94066f30 0x7f0d940693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0da40091e0 tx=0x7f0da4017000 comp rx=0 tx=0).stop 2023-10-08T00:25:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 msgr2=0x7f0db414dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db414dc40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00cc90 tx=0x7f0dac001a80 comp rx=0 tx=0).stop 2023-10-08T00:25:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 shutdown_connections 2023-10-08T00:25:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0db4155360 0x7f0db414dc40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d94066f30 0x7f0d940693e0 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0da40091e0 tx=0x7f0da4017000 comp rx=0 tx=0).stop 2023-10-08T00:25:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0db40b40f0 0x7f0db40af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 --2- 172.21.15.22:0/2694632998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0db40ceb60 0x7f0db4150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.664+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 >> 172.21.15.22:0/2694632998 conn(0x7f0db406baf0 msgr2=0x7f0db40cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:28.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.665+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 shutdown_connections 2023-10-08T00:25:28.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.666+0000 7f0db925a700 1 -- 172.21.15.22:0/2694632998 wait complete. 2023-10-08T00:25:28.672 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:25:28.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:25:28.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.812+0000 7fd9cb7f2700 1 Processor -- start 2023-10-08T00:25:28.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.813+0000 7fd9cb7f2700 1 -- start start 2023-10-08T00:25:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.813+0000 7fd9cb7f2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9c40cd910 0x7fd9c40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.813+0000 7fd9cb7f2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c40b5b00 con 0x7fd9c40b55a0 2023-10-08T00:25:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.813+0000 7fd9cb7f2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c40b5da0 con 0x7fd9c4159ec0 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.813+0000 7fd9cb7f2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c40b6080 con 0x7fd9c40cd910 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c8d8d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9c40cd910 0x7fd9c40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c9d8f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd9c40b55a0 0x7fd9c40ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42386/0 (socket says 172.21.15.22:42386) 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c9d8f700 1 -- 172.21.15.22:0/4281080580 learned_addr learned my addr 172.21.15.22:0/4281080580 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/4281080580 >> v1:172.21.15.192:6789/0 conn(0x7fd9c4159ec0 legacy=0x7fd9c40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/4281080580 >> v1:172.21.15.22:6789/0 conn(0x7fd9c40b55a0 legacy=0x7fd9c40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/4281080580 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c40cc100 con 0x7fd9c40cd910 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c3fff700 1 -- 172.21.15.22:0/4281080580 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129355103 0 0) 0x7fd9c40b5b00 con 0x7fd9c40b55a0 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c8d8d700 1 --2- 172.21.15.22:0/4281080580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c40cd910 0x7fd9c40ce340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009910 tx=0x7fd9b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3758add2e095f410 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c3fff700 1 -- 172.21.15.22:0/4281080580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800b7e0 con 0x7fd9c40cd910 2023-10-08T00:25:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c3fff700 1 -- 172.21.15.22:0/4281080580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b800b940 con 0x7fd9c40cd910 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.814+0000 7fd9c3fff700 1 -- 172.21.15.22:0/4281080580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800bce0 con 0x7fd9c40cd910 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/4281080580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c40cd910 msgr2=0x7fd9c40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/4281080580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c40cd910 0x7fd9c40ce340 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009910 tx=0x7fd9b80091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/4281080580 shutdown_connections 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/4281080580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c40cd910 0x7fd9c40ce340 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/4281080580 >> 172.21.15.22:0/4281080580 conn(0x7fd9c40999f0 msgr2=0x7fd9c40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/4281080580 shutdown_connections 2023-10-08T00:25:28.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.815+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/4281080580 wait complete. 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.816+0000 7fd9cb7f2700 1 Processor -- start 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.816+0000 7fd9cb7f2700 1 -- start start 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9cb7f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9c40b55a0 0x7fd9c406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9cb7f2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 0x7fd9c4150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9cb7f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9c416cf90 0x7fd9c4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9cb7f2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4152d20 con 0x7fd9c4159ec0 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9cb7f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c406afe0 con 0x7fd9c40b55a0 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9cb7f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c416d500 con 0x7fd9c416cf90 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 0x7fd9c4150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:28.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 0x7fd9c4150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47432/0 (socket says 172.21.15.22:47432) 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/3660520025 learned_addr learned my addr 172.21.15.22:0/3660520025 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c958e700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9c40b55a0 0x7fd9c406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c9d8f700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9c416cf90 0x7fd9c4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9c416cf90 msgr2=0x7fd9c4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9c416cf90 0x7fd9c4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9c40b55a0 msgr2=0x7fd9c406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9c40b55a0 0x7fd9c406aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 -- 172.21.15.22:0/3660520025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009420 con 0x7fd9c4159ec0 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c9d8f700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9c416cf90 0x7fd9c4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c8d8d700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 0x7fd9c4150160 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80093f0 tx=0x7fd9b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:28.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.817+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8011dd0 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.818+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8020070 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.818+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c416d7e0 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.818+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b801b6a0 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.818+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c416dda0 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.819+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c4063c90 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.819+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9b8022030 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.819+0000 7fd9c17fa700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9b0066f30 0x7fd9b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.819+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fd9b80863f0 con 0x7fd9c4159ec0 2023-10-08T00:25:28.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.820+0000 7fd9c958e700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9b0066f30 0x7fd9b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:28.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.820+0000 7fd9c958e700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9b0066f30 0x7fd9b00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41544e0 tx=0x7fd9b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:28.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:28.824+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9b80537c0 con 0x7fd9c4159ec0 2023-10-08T00:25:29.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.019+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9c4063c90 con 0x7fd9c4159ec0 2023-10-08T00:25:29.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.661+0000 7fd9c17fa700 1 -- 172.21.15.22:0/3660520025 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd9b8056de0 con 0x7fd9c4159ec0 2023-10-08T00:25:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9b0066f30 msgr2=0x7fd9b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9b0066f30 0x7fd9b00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41544e0 tx=0x7fd9b4008040 comp rx=0 tx=0).stop 2023-10-08T00:25:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 msgr2=0x7fd9c4150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 0x7fd9c4150160 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80093f0 tx=0x7fd9b8016000 comp rx=0 tx=0).stop 2023-10-08T00:25:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 shutdown_connections 2023-10-08T00:25:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9b0066f30 0x7fd9b00693e0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41544e0 tx=0x7fd9b4008040 comp rx=0 tx=0).stop 2023-10-08T00:25:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9c416cf90 0x7fd9c4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9c40b55a0 0x7fd9c406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 --2- 172.21.15.22:0/3660520025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9c4159ec0 0x7fd9c4150160 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.666+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 >> 172.21.15.22:0/3660520025 conn(0x7fd9c40999f0 msgr2=0x7fd9c4152150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.667+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 shutdown_connections 2023-10-08T00:25:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.667+0000 7fd9cb7f2700 1 -- 172.21.15.22:0/3660520025 wait complete. 2023-10-08T00:25:29.674 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:25:29.684 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:25:29.684 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:25:29.684 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:25:29.685 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:25:29.685 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:25:29.685 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:25:29.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:25:29.685 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:25:29.685 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:25:29.685 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:25:29.686 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:25:29.686 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:25:29.686 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:25:29.686 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:25:29.686 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:25:29.686 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:25:29.695 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:25:29.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:25:29.696 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:25:29.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:25:29.697 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:25:29.697 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:25:29.698 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:25:29.698 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:25:29.738 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:25:29.739 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:25:29.739 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:29.740 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:29.740 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:25:29.741 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:25:29.741 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:29.742 DEBUG:teuthology.parallel:result is None 2023-10-08T00:25:29.742 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:25:29.816 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:25:29.816 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:25:29.819 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:25:29.820 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:25:29.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.870+0000 7ffadb04f700 1 Processor -- start 2023-10-08T00:25:29.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.870+0000 7ffadb04f700 1 -- start start 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffadb04f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffad41578b0 0x7ffad4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffadb04f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffad40af2f0 0x7ffad40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffadb04f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad40ad930 con 0x7ffad4155c10 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffadb04f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad40b0c80 con 0x7ffad40af2f0 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffadb04f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad40acd20 con 0x7ffad41578b0 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffad40af2f0 0x7ffad40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffad40af2f0 0x7ffad40af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47472/0 (socket says 172.21.15.22:47472) 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 -- 172.21.15.22:0/3455342068 learned_addr learned my addr 172.21.15.22:0/3455342068 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffacbfff700 1 --2- 172.21.15.22:0/3455342068 >> v2:172.21.15.192:3300/0 conn(0x7ffad41578b0 0x7ffad4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 -- 172.21.15.22:0/3455342068 >> v2:172.21.15.192:3300/0 conn(0x7ffad41578b0 msgr2=0x7ffad4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 --2- 172.21.15.22:0/3455342068 >> v2:172.21.15.192:3300/0 conn(0x7ffad41578b0 0x7ffad4155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 -- 172.21.15.22:0/3455342068 >> v1:172.21.15.192:6789/0 conn(0x7ffad4155c10 legacy=0x7ffad40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 -- 172.21.15.22:0/3455342068 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40ad000 con 0x7ffad40af2f0 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffad95ec700 1 --2- 172.21.15.22:0/3455342068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad40af730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffad40c8c60 tx=0x7ffacc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8047ba4749107ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffacb7fe700 1 -- 172.21.15.22:0/3455342068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc010070 con 0x7ffad40af2f0 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffacb7fe700 1 -- 172.21.15.22:0/3455342068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc00de50 con 0x7ffad40af2f0 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.871+0000 7ffacb7fe700 1 -- 172.21.15.22:0/3455342068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00b320 con 0x7ffad40af2f0 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 -- 172.21.15.22:0/3455342068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 msgr2=0x7ffad40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 --2- 172.21.15.22:0/3455342068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad40af730 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffad40c8c60 tx=0x7ffacc00ba50 comp rx=0 tx=0).stop 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 -- 172.21.15.22:0/3455342068 shutdown_connections 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 --2- 172.21.15.22:0/3455342068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad40af730 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 --2- 172.21.15.22:0/3455342068 >> v2:172.21.15.192:3300/0 conn(0x7ffad41578b0 0x7ffad4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 -- 172.21.15.22:0/3455342068 >> 172.21.15.22:0/3455342068 conn(0x7ffad406a320 msgr2=0x7ffad40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:29.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 -- 172.21.15.22:0/3455342068 shutdown_connections 2023-10-08T00:25:29.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.872+0000 7ffadb04f700 1 -- 172.21.15.22:0/3455342068 wait complete. 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.873+0000 7ffadb04f700 1 Processor -- start 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.873+0000 7ffadb04f700 1 -- start start 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffadb04f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad4068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffadb04f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffad4155c10 0x7ffad4142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffadb04f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffad41578b0 0x7ffad40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffadb04f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad4157d30 con 0x7ffad40af2f0 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffadb04f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ccfa0 con 0x7ffad4155c10 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffadb04f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40c9b70 con 0x7ffad41578b0 2023-10-08T00:25:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad4068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad4068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47482/0 (socket says 172.21.15.22:47482) 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 -- 172.21.15.22:0/2916574776 learned_addr learned my addr 172.21.15.22:0/2916574776 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffacbfff700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffad4155c10 0x7ffad4142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad95ec700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffad41578b0 0x7ffad40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 -- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffad41578b0 msgr2=0x7ffad40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffad41578b0 0x7ffad40cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 -- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffad4155c10 msgr2=0x7ffad4142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffad4155c10 0x7ffad4142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.874+0000 7ffad8deb700 1 -- 172.21.15.22:0/2916574776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc00bcf0 con 0x7ffad40af2f0 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.875+0000 7ffad8deb700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad4068bb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c600 tx=0x7ffad0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.875+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0011590 con 0x7ffad40af2f0 2023-10-08T00:25:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.875+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0011710 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.875+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad40c9e50 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.875+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0011ad0 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.875+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad4143490 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.876+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad404c3c0 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.876+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffad001c460 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.876+0000 7ffac8ff9700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffac0066f30 0x7ffac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.877+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ffad0084010 con 0x7ffad40af2f0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.877+0000 7ffacbfff700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffac0066f30 0x7ffac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:29.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.877+0000 7ffacbfff700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffac0066f30 0x7ffac00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffad4151ce0 tx=0x7ffac4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:29.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:29.881+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffad0051580 con 0x7ffad40af2f0 2023-10-08T00:25:30.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.089+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffad40ad2e0 con 0x7ffad40af2f0 2023-10-08T00:25:30.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:25:30.603 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:25:30.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.678+0000 7ffac8ff9700 1 -- 172.21.15.22:0/2916574776 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffad0054ba0 con 0x7ffad40af2f0 2023-10-08T00:25:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffac0066f30 msgr2=0x7ffac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffac0066f30 0x7ffac00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffad4151ce0 tx=0x7ffac4008040 comp rx=0 tx=0).stop 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 msgr2=0x7ffad4068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad4068bb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c600 tx=0x7ffad0007f60 comp rx=0 tx=0).stop 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 shutdown_connections 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffac0066f30 0x7ffac00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffad41578b0 0x7ffad40cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffad40af2f0 0x7ffad4068bb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 --2- 172.21.15.22:0/2916574776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffad4155c10 0x7ffad4142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 >> 172.21.15.22:0/2916574776 conn(0x7ffad406a320 msgr2=0x7ffad40c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:30.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 shutdown_connections 2023-10-08T00:25:30.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.681+0000 7ffadb04f700 1 -- 172.21.15.22:0/2916574776 wait complete. 2023-10-08T00:25:30.683 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:25:30.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:25:30.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.862+0000 7f1d405d1700 1 Processor -- start 2023-10-08T00:25:30.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.862+0000 7f1d405d1700 1 -- start start 2023-10-08T00:25:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.863+0000 7f1d405d1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d38069560 0x7f1d380699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.863+0000 7f1d405d1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d38069ee0 con 0x7f1d38159c60 2023-10-08T00:25:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.863+0000 7f1d405d1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3815a160 con 0x7f1d38159890 2023-10-08T00:25:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.863+0000 7f1d405d1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d380d13a0 con 0x7f1d38069560 2023-10-08T00:25:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.863+0000 7f1d3db6c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1d38159c60 0x7f1d3815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42394/0 (socket says 172.21.15.22:42394) 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.863+0000 7f1d3db6c700 1 -- 172.21.15.22:0/1090350328 learned_addr learned my addr 172.21.15.22:0/1090350328 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3eb6e700 1 --2- 172.21.15.22:0/1090350328 >> v2:172.21.15.192:3300/0 conn(0x7f1d38069560 0x7f1d380699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985441063 0 0) 0x7f1d38069ee0 con 0x7f1d38159c60 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d20003570 con 0x7f1d38159c60 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922403460 0 0) 0x7f1d3815a160 con 0x7f1d38159890 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d38069ee0 con 0x7f1d38159890 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586709466 0 0) 0x7f1d20003570 con 0x7f1d38159c60 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 >> v2:172.21.15.192:3300/0 conn(0x7f1d38069560 msgr2=0x7f1d380699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 --2- 172.21.15.22:0/1090350328 >> v2:172.21.15.192:3300/0 conn(0x7f1d38069560 0x7f1d380699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 >> v1:172.21.15.192:6789/0 conn(0x7f1d38159890 legacy=0x7f1d3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3815e140 con 0x7f1d38159c60 2023-10-08T00:25:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f1d2c0013f0 con 0x7f1d38159c60 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 >> v1:172.21.15.22:6789/0 conn(0x7f1d38159c60 legacy=0x7f1d3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d20004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d20004810 0x7f1d20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d20005210 0x7f1d2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380d13a0 con 0x7f1d20003c40 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2000c130 con 0x7f1d20004810 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2000c2c0 con 0x7f1d20005210 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d20004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3db6c700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d20004810 0x7f1d20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3eb6e700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d20005210 0x7f1d2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3e36d700 1 -- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d20005210 msgr2=0x7f1d2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d20005210 0x7f1d2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3e36d700 1 -- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d20004810 msgr2=0x7f1d20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d20004810 0x7f1d20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.864+0000 7f1d3e36d700 1 -- 172.21.15.22:0/1090350328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20003570 con 0x7f1d20003c40 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d3eb6e700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d20005210 0x7f1d2000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d3eb6e700 1 -- 172.21.15.22:0/1090350328 reap_dead start 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d20004030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d28002150 tx=0x7f1d280017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ef476e8abae5c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28001ab0 con 0x7f1d20003c40 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2800c940 con 0x7f1d20003c40 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d3d36b700 1 -- 172.21.15.22:0/1090350328 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800caf0 con 0x7f1d20003c40 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 -- 172.21.15.22:0/1090350328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 msgr2=0x7f1d20004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d20004030 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d28002150 tx=0x7f1d280017a0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 -- 172.21.15.22:0/1090350328 shutdown_connections 2023-10-08T00:25:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 --2- 172.21.15.22:0/1090350328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d20004030 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 -- 172.21.15.22:0/1090350328 >> 172.21.15.22:0/1090350328 conn(0x7f1d38068e20 msgr2=0x7f1d380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 -- 172.21.15.22:0/1090350328 shutdown_connections 2023-10-08T00:25:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.865+0000 7f1d405d1700 1 -- 172.21.15.22:0/1090350328 wait complete. 2023-10-08T00:25:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 Processor -- start 2023-10-08T00:25:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 -- start start 2023-10-08T00:25:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d381524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d380cd690 0x7f1d380cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d3814c200 0x7f1d3814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3816b2f0 con 0x7f1d20003c40 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380ce110 con 0x7f1d380cd690 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d405d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380ce3f0 con 0x7f1d3814c200 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d3e36d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d381524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d3e36d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d381524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47498/0 (socket says 172.21.15.22:47498) 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d3e36d700 1 -- 172.21.15.22:0/2348170861 learned_addr learned my addr 172.21.15.22:0/2348170861 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.867+0000 7f1d3eb6e700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d3814c200 0x7f1d3814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3db6c700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d380cd690 0x7f1d380cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3e36d700 1 -- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d3814c200 msgr2=0x7f1d3814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d3814c200 0x7f1d3814c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3e36d700 1 -- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d380cd690 msgr2=0x7f1d380cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d380cd690 0x7f1d380cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3e36d700 1 -- 172.21.15.22:0/2348170861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3816b580 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d3e36d700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d381524f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c6a0 tx=0x7f1d28015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800cea0 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2800cab0 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3816b860 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28006dd0 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.868+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3814cb90 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.869+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d38069cf0 con 0x7f1d20003c40 2023-10-08T00:25:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.869+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d28019070 con 0x7f1d20003c40 2023-10-08T00:25:30.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.870+0000 7f1d367fc700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:30.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.870+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1d28085f60 con 0x7f1d20003c40 2023-10-08T00:25:30.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.870+0000 7f1d3db6c700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:30.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.871+0000 7f1d3db6c700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d24066f30 0x7f1d240693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d381553b0 tx=0x7f1d2c001ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:30.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:30.874+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d28053520 con 0x7f1d20003c40 2023-10-08T00:25:31.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.146+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1d38158ee0 con 0x7f1d20003c40 2023-10-08T00:25:31.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.146+0000 7f1d367fc700 1 -- 172.21.15.22:0/2348170861 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v3) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1d28022020 con 0x7f1d20003c40 2023-10-08T00:25:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:31.147 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:25:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:25:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.147 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:25:31.148 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.149 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:25:31.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.152 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:25:31.153 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.155 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:25:31.156 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:25:31.157 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:25:31.158 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.159 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.160 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mds", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQDC9iFleyXtLRAAwMQWNaC6sb9lq3SeCBUGtA==", 2023-10-08T00:25:31.161 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQDC9iFlLTHtLRAAcAKGdWsjEn27lvirhgM+Lw==", 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.162 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-osd", 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQDC9iFlYTntLRAAlWZ8ju57ITFHKsfWY7t6ig==", 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQDC9iFlKkHtLRAA4k9y9kwfBDJSqksEgW6GCA==", 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQDC9iFlBUrtLRAACN8Yrq0Mjb5nYCTOwq7rGQ==", 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQDC9iFl/FHtLRAAotuW2yMVNill5rMZ/zTa/A==", 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T00:25:31.164 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:31.165 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:25:31.166 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d24066f30 msgr2=0x7f1d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d24066f30 0x7f1d240693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d381553b0 tx=0x7f1d2c001ca0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 msgr2=0x7f1d381524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d381524f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c6a0 tx=0x7f1d28015000 comp rx=0 tx=0).stop 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 shutdown_connections 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d24066f30 0x7f1d240693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d3814c200 0x7f1d3814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d20003c40 0x7f1d381524f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 --2- 172.21.15.22:0/2348170861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d380cd690 0x7f1d380cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 >> 172.21.15.22:0/2348170861 conn(0x7f1d38068e20 msgr2=0x7f1d3814d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:31.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 shutdown_connections 2023-10-08T00:25:31.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.148+0000 7f1d405d1700 1 -- 172.21.15.22:0/2348170861 wait complete. 2023-10-08T00:25:31.169 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T00:25:31.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.288+0000 7fed28100700 1 Processor -- start 2023-10-08T00:25:31.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.288+0000 7fed28100700 1 -- start start 2023-10-08T00:25:31.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed28100700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fed20159c60 0x7fed2015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed28100700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed2015a160 con 0x7fed2015db10 2023-10-08T00:25:31.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed28100700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200d13a0 con 0x7fed20159890 2023-10-08T00:25:31.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed28100700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed2015df50 con 0x7fed20159c60 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed2669d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fed2015db10 0x7fed20069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42398/0 (socket says 172.21.15.22:42398) 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed2669d700 1 -- 172.21.15.22:0/2625461415 learned_addr learned my addr 172.21.15.22:0/2625461415 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed2569b700 1 --2- 172.21.15.22:0/2625461415 >> v2:172.21.15.192:3300/0 conn(0x7fed20159c60 0x7fed2015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767888902 0 0) 0x7fed2015a160 con 0x7fed2015db10 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed0c003570 con 0x7fed2015db10 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359832493 0 0) 0x7fed200d13a0 con 0x7fed20159890 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed2015a160 con 0x7fed20159890 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed2569b700 1 -- 172.21.15.22:0/2625461415 >> v1:172.21.15.192:6789/0 conn(0x7fed20159890 legacy=0x7fed2015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed2569b700 1 -- 172.21.15.22:0/2625461415 >> v1:172.21.15.22:6789/0 conn(0x7fed2015db10 legacy=0x7fed20069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.289+0000 7fed2569b700 1 -- 172.21.15.22:0/2625461415 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2015e140 con 0x7fed20159c60 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed2569b700 1 --2- 172.21.15.22:0/2625461415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed20159c60 0x7fed2015d5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed100098e0 tx=0x7fed100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad04aa9d66af04c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10011630 con 0x7fed20159c60 2023-10-08T00:25:31.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10011790 con 0x7fed20159c60 2023-10-08T00:25:31.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed24e9a700 1 -- 172.21.15.22:0/2625461415 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10011b30 con 0x7fed20159c60 2023-10-08T00:25:31.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 -- 172.21.15.22:0/2625461415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed20159c60 msgr2=0x7fed2015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 --2- 172.21.15.22:0/2625461415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed20159c60 0x7fed2015d5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fed100098e0 tx=0x7fed100091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 -- 172.21.15.22:0/2625461415 shutdown_connections 2023-10-08T00:25:31.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 --2- 172.21.15.22:0/2625461415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed20159c60 0x7fed2015d5d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 -- 172.21.15.22:0/2625461415 >> 172.21.15.22:0/2625461415 conn(0x7fed20068e20 msgr2=0x7fed200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 -- 172.21.15.22:0/2625461415 shutdown_connections 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.290+0000 7fed28100700 1 -- 172.21.15.22:0/2625461415 wait complete. 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.291+0000 7fed28100700 1 Processor -- start 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.291+0000 7fed28100700 1 -- start start 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed28100700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 0x7fed20158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed28100700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed20159c60 0x7fed200b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed28100700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed2015db10 0x7fed200b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed28100700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200b41a0 con 0x7fed20159890 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed28100700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed200b3590 con 0x7fed2015db10 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed28100700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed200b3870 con 0x7fed20159c60 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed25e9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 0x7fed20158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed25e9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 0x7fed20158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47512/0 (socket says 172.21.15.22:47512) 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed25e9c700 1 -- 172.21.15.22:0/22089415 learned_addr learned my addr 172.21.15.22:0/22089415 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed2569b700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed20159c60 0x7fed200b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.292+0000 7fed2669d700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed2015db10 0x7fed200b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed25e9c700 1 -- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed20159c60 msgr2=0x7fed200b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed25e9c700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed20159c60 0x7fed200b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed25e9c700 1 -- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed2015db10 msgr2=0x7fed200b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed25e9c700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed2015db10 0x7fed200b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed25e9c700 1 -- 172.21.15.22:0/22089415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009420 con 0x7fed20159890 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed25e9c700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 0x7fed20158830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c790 tx=0x7fed1c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c010510 con 0x7fed20159890 2023-10-08T00:25:31.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c010670 con 0x7fed20159890 2023-10-08T00:25:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed200b3b50 con 0x7fed20159890 2023-10-08T00:25:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c010a10 con 0x7fed20159890 2023-10-08T00:25:31.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.293+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed20158d70 con 0x7fed20159890 2023-10-08T00:25:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.294+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2004c3c0 con 0x7fed20159890 2023-10-08T00:25:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.294+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed1c01b400 con 0x7fed20159890 2023-10-08T00:25:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.295+0000 7fed15ffb700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed04066f30 0x7fed040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.295+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fed1c084030 con 0x7fed20159890 2023-10-08T00:25:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.295+0000 7fed2569b700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed04066f30 0x7fed040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.295+0000 7fed2569b700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed04066f30 0x7fed040693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed100093f0 tx=0x7fed10017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:31.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.299+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed1c0515f0 con 0x7fed20159890 2023-10-08T00:25:31.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.571+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fed2015b0c0 con 0x7fed20159890 2023-10-08T00:25:31.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.574+0000 7fed15ffb700 1 -- 172.21.15.22:0/22089415 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7fed1c054c10 con 0x7fed20159890 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed04066f30 msgr2=0x7fed040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed04066f30 0x7fed040693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fed100093f0 tx=0x7fed10017000 comp rx=0 tx=0).stop 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 msgr2=0x7fed20158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 0x7fed20158830 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00c790 tx=0x7fed1c007e10 comp rx=0 tx=0).stop 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 shutdown_connections 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed2015db10 0x7fed200b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed20159890 0x7fed20158830 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fed04066f30 0x7fed040693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 --2- 172.21.15.22:0/22089415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fed20159c60 0x7fed200b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 >> 172.21.15.22:0/22089415 conn(0x7fed20068e20 msgr2=0x7fed200b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 shutdown_connections 2023-10-08T00:25:31.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.576+0000 7fed28100700 1 -- 172.21.15.22:0/22089415 wait complete. 2023-10-08T00:25:31.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T00:25:31.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.708+0000 7fbf8b8ad700 1 Processor -- start 2023-10-08T00:25:31.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.709+0000 7fbf8b8ad700 1 -- start start 2023-10-08T00:25:31.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.709+0000 7fbf8b8ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.709+0000 7fbf8b8ad700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8415a160 con 0x7fbf8415db10 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.709+0000 7fbf8b8ad700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840d13a0 con 0x7fbf84159890 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.709+0000 7fbf8b8ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8415e140 con 0x7fbf84159c60 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf89e4a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbf8415db10 0x7fbf84069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42402/0 (socket says 172.21.15.22:42402) 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf89e4a700 1 -- 172.21.15.22:0/632547602 learned_addr learned my addr 172.21.15.22:0/632547602 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf88e48700 1 --2- 172.21.15.22:0/632547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850858826 0 0) 0x7fbf8415a160 con 0x7fbf8415db10 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf6c003570 con 0x7fbf8415db10 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127392325 0 0) 0x7fbf840d13a0 con 0x7fbf84159890 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf8415a160 con 0x7fbf84159890 2023-10-08T00:25:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf88e48700 1 -- 172.21.15.22:0/632547602 >> v1:172.21.15.192:6789/0 conn(0x7fbf84159890 legacy=0x7fbf8415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf88e48700 1 -- 172.21.15.22:0/632547602 >> v1:172.21.15.22:6789/0 conn(0x7fbf8415db10 legacy=0x7fbf84069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf88e48700 1 -- 172.21.15.22:0/632547602 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8415a3d0 con 0x7fbf84159c60 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf88e48700 1 --2- 172.21.15.22:0/632547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8415d5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009910 tx=0x7fbf780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224333174a923017 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011630 con 0x7fbf84159c60 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.710+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78011790 con 0x7fbf84159c60 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf83fff700 1 -- 172.21.15.22:0/632547602 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011b30 con 0x7fbf84159c60 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/632547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 msgr2=0x7fbf8415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/632547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8415d5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009910 tx=0x7fbf780091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/632547602 shutdown_connections 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/632547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8415d5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/632547602 >> 172.21.15.22:0/632547602 conn(0x7fbf84068e20 msgr2=0x7fbf840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:31.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/632547602 shutdown_connections 2023-10-08T00:25:31.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.711+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/632547602 wait complete. 2023-10-08T00:25:31.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.712+0000 7fbf8b8ad700 1 Processor -- start 2023-10-08T00:25:31.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.712+0000 7fbf8b8ad700 1 -- start start 2023-10-08T00:25:31.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf8b8ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84159890 0x7fbf8413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf8b8ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8416a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf8b8ad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 0x7fbf8416aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf8b8ad700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8413f7b0 con 0x7fbf8415db10 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf8b8ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8414c260 con 0x7fbf84159890 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf8b8ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8416d440 con 0x7fbf84159c60 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 0x7fbf8416aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 0x7fbf8416aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47524/0 (socket says 172.21.15.22:47524) 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 -- 172.21.15.22:0/3552640593 learned_addr learned my addr 172.21.15.22:0/3552640593 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf88e48700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8416a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89649700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84159890 0x7fbf8413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 -- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 msgr2=0x7fbf8416a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8416a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 -- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84159890 msgr2=0x7fbf8413f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84159890 0x7fbf8413f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:31.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.713+0000 7fbf89e4a700 1 -- 172.21.15.22:0/3552640593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf78009420 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.714+0000 7fbf89e4a700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 0x7fbf8416aa10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c560 tx=0x7fbf7c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.714+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c005b30 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.714+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c005c90 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.714+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8416d720 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.714+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c007320 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.714+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8416dce0 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.715+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8404c3c0 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.715+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf7c007690 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.716+0000 7fbf817fa700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf70066f30 0x7fbf700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.716+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbf7c083630 con 0x7fbf8415db10 2023-10-08T00:25:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.716+0000 7fbf89649700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf70066f30 0x7fbf700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:31.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.716+0000 7fbf89649700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf70066f30 0x7fbf700693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf840b6630 tx=0x7fbf74007f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:31.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.720+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf7c050b50 con 0x7fbf8415db10 2023-10-08T00:25:31.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.993+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbf8406a5b0 con 0x7fbf8415db10 2023-10-08T00:25:31.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.997+0000 7fbf817fa700 1 -- 172.21.15.22:0/3552640593 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbf7c0170a0 con 0x7fbf8415db10 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf70066f30 msgr2=0x7fbf700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf70066f30 0x7fbf700693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbf840b6630 tx=0x7fbf74007f90 comp rx=0 tx=0).stop 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 msgr2=0x7fbf8416aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 0x7fbf8416aa10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c00c560 tx=0x7fbf7c007dd0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 shutdown_connections 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf8415db10 0x7fbf8416aa10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf84159890 0x7fbf8413f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf70066f30 0x7fbf700693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 --2- 172.21.15.22:0/3552640593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf84159c60 0x7fbf8416a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 >> 172.21.15.22:0/3552640593 conn(0x7fbf84068e20 msgr2=0x7fbf8415c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:32.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 shutdown_connections 2023-10-08T00:25:32.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:31.999+0000 7fbf8b8ad700 1 -- 172.21.15.22:0/3552640593 wait complete. 2023-10-08T00:25:32.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T00:25:32.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.131+0000 7f604a8ba700 1 Processor -- start 2023-10-08T00:25:32.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.131+0000 7f604a8ba700 1 -- start start 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f604a8ba700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6044155c10 0x7f6044155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f604a8ba700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f60440ac6d0 0x7f60440b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f604a8ba700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60440acac0 con 0x7f60440ac230 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f604a8ba700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60440ad930 con 0x7f6044155c10 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f604a8ba700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60440acd20 con 0x7f60440ac6d0 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6043fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6044155c10 0x7f6044155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f60437fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f60440ac230 0x7f60441568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42410/0 (socket says 172.21.15.22:42410) 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f60437fe700 1 -- 172.21.15.22:0/4198531824 learned_addr learned my addr 172.21.15.22:0/4198531824 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6048e57700 1 --2- 172.21.15.22:0/4198531824 >> v2:172.21.15.192:3300/0 conn(0x7f60440ac6d0 0x7f60440b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6043fff700 1 -- 172.21.15.22:0/4198531824 >> v2:172.21.15.192:3300/0 conn(0x7f60440ac6d0 msgr2=0x7f60440b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6043fff700 1 --2- 172.21.15.22:0/4198531824 >> v2:172.21.15.192:3300/0 conn(0x7f60440ac6d0 0x7f60440b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6043fff700 1 -- 172.21.15.22:0/4198531824 >> v1:172.21.15.22:6789/0 conn(0x7f60440ac230 legacy=0x7f60441568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6042ffd700 1 -- 172.21.15.22:0/4198531824 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835827461 0 0) 0x7f60440acac0 con 0x7f60440ac230 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6043fff700 1 -- 172.21.15.22:0/4198531824 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60440ad000 con 0x7f6044155c10 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.132+0000 7f6043fff700 1 --2- 172.21.15.22:0/4198531824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044155fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60440ae0c0 tx=0x7f603400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d692b351184a6da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f6042ffd700 1 -- 172.21.15.22:0/4198531824 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400c970 con 0x7f6044155c10 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f6042ffd700 1 -- 172.21.15.22:0/4198531824 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603400cad0 con 0x7f6044155c10 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f6042ffd700 1 -- 172.21.15.22:0/4198531824 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603400ce70 con 0x7f6044155c10 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 -- 172.21.15.22:0/4198531824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 msgr2=0x7f6044155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 --2- 172.21.15.22:0/4198531824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044155fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60440ae0c0 tx=0x7f603400a330 comp rx=0 tx=0).stop 2023-10-08T00:25:32.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 -- 172.21.15.22:0/4198531824 shutdown_connections 2023-10-08T00:25:32.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 --2- 172.21.15.22:0/4198531824 >> v2:172.21.15.192:3300/0 conn(0x7f60440ac6d0 0x7f60440b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 --2- 172.21.15.22:0/4198531824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044155fe0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 -- 172.21.15.22:0/4198531824 >> 172.21.15.22:0/4198531824 conn(0x7f604406a320 msgr2=0x7f60440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:32.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 -- 172.21.15.22:0/4198531824 shutdown_connections 2023-10-08T00:25:32.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.133+0000 7f604a8ba700 1 -- 172.21.15.22:0/4198531824 wait complete. 2023-10-08T00:25:32.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.134+0000 7f604a8ba700 1 Processor -- start 2023-10-08T00:25:32.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.134+0000 7f604a8ba700 1 -- start start 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f604a8ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60440ac230 0x7f604414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f604a8ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60440ac6d0 0x7f6044152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f604a8ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f604a8ba700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60440cbd70 con 0x7f6044155c10 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f604a8ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6044157270 con 0x7f60440ac230 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f604a8ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604414d860 con 0x7f60440ac6d0 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f6048e57700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f6048e57700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47530/0 (socket says 172.21.15.22:47530) 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f6048e57700 1 -- 172.21.15.22:0/1282475638 learned_addr learned my addr 172.21.15.22:0/1282475638 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f6043fff700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60440ac230 0x7f604414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.135+0000 7f60437fe700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60440ac6d0 0x7f6044152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f6048e57700 1 -- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60440ac6d0 msgr2=0x7f6044152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f6048e57700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60440ac6d0 0x7f6044152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f6048e57700 1 -- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60440ac230 msgr2=0x7f604414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f6048e57700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60440ac230 0x7f604414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f6048e57700 1 -- 172.21.15.22:0/1282475638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603400a5d0 con 0x7f6044155c10 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f60437fe700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60440ac6d0 0x7f6044152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f6048e57700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044153050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f603c009fd0 tx=0x7f603c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00eca0 con 0x7f6044155c10 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c00ee00 con 0x7f6044155c10 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6044156940 con 0x7f6044155c10 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c014670 con 0x7f6044155c10 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.136+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6044156f00 con 0x7f6044155c10 2023-10-08T00:25:32.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.137+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60441573e0 con 0x7f6044155c10 2023-10-08T00:25:32.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.137+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f603c0149e0 con 0x7f6044155c10 2023-10-08T00:25:32.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.138+0000 7f603bfff700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6024066f30 0x7f60240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.138+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f603c0848c0 con 0x7f6044155c10 2023-10-08T00:25:32.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.138+0000 7f6043fff700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6024066f30 0x7f60240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.139+0000 7f6043fff700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6024066f30 0x7f60240693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f603400a5a0 tx=0x7f603401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.142+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f603c051e80 con 0x7f6044155c10 2023-10-08T00:25:32.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.416+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f604404c3c0 con 0x7f6044155c10 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.419+0000 7f603bfff700 1 -- 172.21.15.22:0/1282475638 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f603c0554a0 con 0x7f6044155c10 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6024066f30 msgr2=0x7f60240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6024066f30 0x7f60240693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f603400a5a0 tx=0x7f603401a000 comp rx=0 tx=0).stop 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 msgr2=0x7f6044153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044153050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f603c009fd0 tx=0x7f603c009900 comp rx=0 tx=0).stop 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 shutdown_connections 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6044155c10 0x7f6044153050 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60440ac230 0x7f604414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6024066f30 0x7f60240693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 --2- 172.21.15.22:0/1282475638 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60440ac6d0 0x7f6044152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 >> 172.21.15.22:0/1282475638 conn(0x7f604406a320 msgr2=0x7f604415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 shutdown_connections 2023-10-08T00:25:32.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.421+0000 7f604a8ba700 1 -- 172.21.15.22:0/1282475638 wait complete. 2023-10-08T00:25:32.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T00:25:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.553+0000 7f886b59e700 1 Processor -- start 2023-10-08T00:25:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.553+0000 7f886b59e700 1 -- start start 2023-10-08T00:25:32.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886b59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f886c159420 0x7f886c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886b59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0b2980 con 0x7f886c1597f0 2023-10-08T00:25:32.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886b59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c15dbb0 con 0x7f886c159420 2023-10-08T00:25:32.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0b11d0 con 0x7f886c15d230 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f8869d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f886c1597f0 0x7f886c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42416/0 (socket says 172.21.15.22:42416) 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f8869d9b700 1 -- 172.21.15.22:0/3885380035 learned_addr learned my addr 172.21.15.22:0/3885380035 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886a59c700 1 --2- 172.21.15.22:0/3885380035 >> v2:172.21.15.192:3300/0 conn(0x7f886c159420 0x7f886c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886ad9d700 1 --2- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886959a700 1 -- 172.21.15.22:0/3885380035 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933637422 0 0) 0x7f886c0b2980 con 0x7f886c1597f0 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.554+0000 7f886959a700 1 -- 172.21.15.22:0/3885380035 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8858003570 con 0x7f886c1597f0 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886a59c700 1 -- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 msgr2=0x7f886c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886a59c700 1 --2- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886a59c700 1 -- 172.21.15.22:0/3885380035 >> v1:172.21.15.22:6789/0 conn(0x7f886c1597f0 legacy=0x7f886c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886959a700 1 -- 172.21.15.22:0/3885380035 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823632769 0 0) 0x7f8858003570 con 0x7f886c1597f0 2023-10-08T00:25:32.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886a59c700 1 -- 172.21.15.22:0/3885380035 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0b14b0 con 0x7f886c159420 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886a59c700 1 --2- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c0b5f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f885c009e60 tx=0x7f885c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddc5e9e261e7f6f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886959a700 1 -- 172.21.15.22:0/3885380035 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00e070 con 0x7f886c159420 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886959a700 1 -- 172.21.15.22:0/3885380035 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00b7a0 con 0x7f886c159420 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886959a700 1 -- 172.21.15.22:0/3885380035 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854001470 con 0x7f886c159420 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886b59e700 1 -- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 msgr2=0x7f886c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.555+0000 7f886b59e700 1 --2- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c0b5f40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f885c009e60 tx=0x7f885c009780 comp rx=0 tx=0).stop 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.556+0000 7f886b59e700 1 -- 172.21.15.22:0/3885380035 shutdown_connections 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.556+0000 7f886b59e700 1 --2- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.556+0000 7f886b59e700 1 --2- 172.21.15.22:0/3885380035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c0b5f40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.556+0000 7f886b59e700 1 -- 172.21.15.22:0/3885380035 >> 172.21.15.22:0/3885380035 conn(0x7f886c0d0660 msgr2=0x7f886c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.556+0000 7f886b59e700 1 -- 172.21.15.22:0/3885380035 shutdown_connections 2023-10-08T00:25:32.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.556+0000 7f886b59e700 1 -- 172.21.15.22:0/3885380035 wait complete. 2023-10-08T00:25:32.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.557+0000 7f886b59e700 1 Processor -- start 2023-10-08T00:25:32.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.557+0000 7f886b59e700 1 -- start start 2023-10-08T00:25:32.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.557+0000 7f886b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 0x7f886c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c15a8b0 con 0x7f886c1597f0 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c159ca0 con 0x7f886c159420 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c159f80 con 0x7f886c15d230 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 0x7f886c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 0x7f886c0c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47544/0 (socket says 172.21.15.22:47544) 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 -- 172.21.15.22:0/1899805639 learned_addr learned my addr 172.21.15.22:0/1899805639 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886a59c700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886ad9d700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 -- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 msgr2=0x7f886c15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 -- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 msgr2=0x7f886c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 -- 172.21.15.22:0/1899805639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009a20 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886a59c700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f8869d9b700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 0x7f886c0c62f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f885400cb90 tx=0x7f8854001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854005b30 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854005cb0 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c15a260 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854007340 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.558+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c157860 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.559+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c15aa60 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.560+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f885400a5d0 con 0x7f886c1597f0 2023-10-08T00:25:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.560+0000 7f88627fc700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f884c066f30 0x7f884c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.560+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8854083fb0 con 0x7f886c1597f0 2023-10-08T00:25:32.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.560+0000 7f886a59c700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f884c066f30 0x7f884c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.561+0000 7f886a59c700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f884c066f30 0x7f884c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f885c0097c0 tx=0x7f885c018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.564+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f886c15aa60 con 0x7f886c1597f0 2023-10-08T00:25:32.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.838+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f886c04c3c0 con 0x7f886c1597f0 2023-10-08T00:25:32.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.841+0000 7f88627fc700 1 -- 172.21.15.22:0/1899805639 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f88540515f0 con 0x7f886c1597f0 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f884c066f30 msgr2=0x7f884c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f884c066f30 0x7f884c0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f885c0097c0 tx=0x7f885c018000 comp rx=0 tx=0).stop 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 msgr2=0x7f886c0c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 0x7f886c0c62f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f885400cb90 tx=0x7f8854001aa0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 shutdown_connections 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f884c066f30 0x7f884c0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f886c15d230 0x7f886c15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f886c159420 0x7f886c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 --2- 172.21.15.22:0/1899805639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f886c1597f0 0x7f886c0c62f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 >> 172.21.15.22:0/1899805639 conn(0x7f886c0d0660 msgr2=0x7f886c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 shutdown_connections 2023-10-08T00:25:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.843+0000 7f886b59e700 1 -- 172.21.15.22:0/1899805639 wait complete. 2023-10-08T00:25:32.855 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T00:25:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.974+0000 7f5452e50700 1 Processor -- start 2023-10-08T00:25:32.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.975+0000 7f5452e50700 1 -- start start 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.975+0000 7f5452e50700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 0x7f544c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.975+0000 7f5452e50700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 0x7f544c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.975+0000 7f5452e50700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c15d7e0 con 0x7f544c06bcd0 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.975+0000 7f5452e50700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c15dac0 con 0x7f544c06c0a0 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.975+0000 7f5452e50700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c15aa30 con 0x7f544c15df50 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 0x7f544c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f544bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 0x7f544c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f5450bec700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f544c06bcd0 0x7f544c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:45574/0 (socket says 172.21.15.22:45574) 2023-10-08T00:25:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 0x7f544c15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:53712/0 (socket says 172.21.15.22:53712) 2023-10-08T00:25:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f5450bec700 1 -- 172.21.15.22:0/426449984 learned_addr learned my addr 172.21.15.22:0/426449984 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:32.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f544bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 0x7f544c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:43604/0 (socket says 172.21.15.22:43604) 2023-10-08T00:25:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 -- 172.21.15.22:0/426449984 >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 msgr2=0x7f544c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 --2- 172.21.15.22:0/426449984 >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 0x7f544c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 -- 172.21.15.22:0/426449984 >> v1:172.21.15.192:6789/0 conn(0x7f544c06bcd0 legacy=0x7f544c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 -- 172.21.15.22:0/426449984 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c15ad10 con 0x7f544c15df50 2023-10-08T00:25:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f544bfff700 1 --2- 172.21.15.22:0/426449984 >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 0x7f544c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:32.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.976+0000 7f54513ed700 1 --2- 172.21.15.22:0/426449984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 0x7f544c15e3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54440098e0 tx=0x7f54440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd79a87bc6659b83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f544b7fe700 1 -- 172.21.15.22:0/426449984 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400b640 con 0x7f544c15df50 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f544b7fe700 1 -- 172.21.15.22:0/426449984 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400b7a0 con 0x7f544c15df50 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f544b7fe700 1 -- 172.21.15.22:0/426449984 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400bb40 con 0x7f544c15df50 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 -- 172.21.15.22:0/426449984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 msgr2=0x7f544c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 --2- 172.21.15.22:0/426449984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 0x7f544c15e3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54440098e0 tx=0x7f54440091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 -- 172.21.15.22:0/426449984 shutdown_connections 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 --2- 172.21.15.22:0/426449984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c15df50 0x7f544c15e3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 --2- 172.21.15.22:0/426449984 >> v2:172.21.15.192:3300/0 conn(0x7f544c06c0a0 0x7f544c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 -- 172.21.15.22:0/426449984 >> 172.21.15.22:0/426449984 conn(0x7f544c0ce600 msgr2=0x7f544c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 -- 172.21.15.22:0/426449984 shutdown_connections 2023-10-08T00:25:32.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.977+0000 7f5452e50700 1 -- 172.21.15.22:0/426449984 wait complete. 2023-10-08T00:25:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.978+0000 7f5452e50700 1 Processor -- start 2023-10-08T00:25:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.978+0000 7f5452e50700 1 -- start start 2023-10-08T00:25:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5452e50700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06bcd0 0x7f544c143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5452e50700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06c0a0 0x7f544c16af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5452e50700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 0x7f544c16d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5452e50700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c16d230 con 0x7f544c15df50 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5452e50700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0c79f0 con 0x7f544c06bcd0 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5452e50700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0c7420 con 0x7f544c06c0a0 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f54513ed700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 0x7f544c16d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f54513ed700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 0x7f544c16d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47548/0 (socket says 172.21.15.22:47548) 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f54513ed700 1 -- 172.21.15.22:0/2633474093 learned_addr learned my addr 172.21.15.22:0/2633474093 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f5450bec700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06bcd0 0x7f544c143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.979+0000 7f544bfff700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06c0a0 0x7f544c16af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f54513ed700 1 -- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06c0a0 msgr2=0x7f544c16af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f54513ed700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06c0a0 0x7f544c16af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f54513ed700 1 -- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06bcd0 msgr2=0x7f544c143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f54513ed700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06bcd0 0x7f544c143e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f54513ed700 1 -- 172.21.15.22:0/2633474093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c009a20 con 0x7f544c15df50 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f54513ed700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 0x7f544c16d410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f54440093f0 tx=0x7f5444017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544400b640 con 0x7f544c15df50 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5444011420 con 0x7f544c15df50 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5444009420 con 0x7f544c15df50 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5444011800 con 0x7f544c15df50 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.980+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c16ddf0 con 0x7f544c15df50 2023-10-08T00:25:32.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.981+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c0c7b80 con 0x7f544c15df50 2023-10-08T00:25:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.982+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5444011c30 con 0x7f544c15df50 2023-10-08T00:25:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.982+0000 7f5448ff9700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.982+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5444085c90 con 0x7f544c15df50 2023-10-08T00:25:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.982+0000 7f5450bec700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.983+0000 7f5450bec700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f542c066f30 0x7f542c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f544c0c4b30 tx=0x7f5434009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:32.986+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5444053250 con 0x7f544c15df50 2023-10-08T00:25:33.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.257+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f544c04c3c0 con 0x7f544c15df50 2023-10-08T00:25:33.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.261+0000 7f5448ff9700 1 -- 172.21.15.22:0/2633474093 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5444056870 con 0x7f544c15df50 2023-10-08T00:25:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f542c066f30 msgr2=0x7f542c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f542c066f30 0x7f542c0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f544c0c4b30 tx=0x7f5434009040 comp rx=0 tx=0).stop 2023-10-08T00:25:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 msgr2=0x7f544c16d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 0x7f544c16d410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f54440093f0 tx=0x7f5444017000 comp rx=0 tx=0).stop 2023-10-08T00:25:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 shutdown_connections 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f544c15df50 0x7f544c16d410 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f544c06bcd0 0x7f544c143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 --2- 172.21.15.22:0/2633474093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f544c06c0a0 0x7f544c16af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.263+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 >> 172.21.15.22:0/2633474093 conn(0x7f544c0ce600 msgr2=0x7f544c0c37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.264+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 shutdown_connections 2023-10-08T00:25:33.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.264+0000 7f5452e50700 1 -- 172.21.15.22:0/2633474093 wait complete. 2023-10-08T00:25:33.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T00:25:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.396+0000 7f7a589bf700 1 Processor -- start 2023-10-08T00:25:33.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.396+0000 7f7a589bf700 1 -- start start 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a589bf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a54159c60 0x7f7a5415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a589bf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7a5415db10 0x7f7a54069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a589bf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5415a160 con 0x7f7a54159890 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a589bf700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5415df50 con 0x7f7a54159c60 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a589bf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a540d13a0 con 0x7f7a5415db10 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a54159c60 0x7f7a5415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a54159c60 0x7f7a5415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47560/0 (socket says 172.21.15.22:47560) 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 -- 172.21.15.22:0/38485229 learned_addr learned my addr 172.21.15.22:0/38485229 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a52d9d700 1 --2- 172.21.15.22:0/38485229 >> v2:172.21.15.192:3300/0 conn(0x7f7a5415db10 0x7f7a54069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 -- 172.21.15.22:0/38485229 >> v2:172.21.15.192:3300/0 conn(0x7f7a5415db10 msgr2=0x7f7a54069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 --2- 172.21.15.22:0/38485229 >> v2:172.21.15.192:3300/0 conn(0x7f7a5415db10 0x7f7a54069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 -- 172.21.15.22:0/38485229 >> v1:172.21.15.192:6789/0 conn(0x7f7a54159890 legacy=0x7f7a5415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 -- 172.21.15.22:0/38485229 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5415e140 con 0x7f7a54159c60 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a52d9d700 1 --2- 172.21.15.22:0/38485229 >> v2:172.21.15.192:3300/0 conn(0x7f7a5415db10 0x7f7a54069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a51d9b700 1 --2- 172.21.15.22:0/38485229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159c60 0x7f7a5415d5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a5406a890 tx=0x7f7a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16ccacab53ba557 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.397+0000 7f7a5159a700 1 -- 172.21.15.22:0/38485229 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00b860 con 0x7f7a54159c60 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a5159a700 1 -- 172.21.15.22:0/38485229 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3c00b9c0 con 0x7f7a54159c60 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a5159a700 1 -- 172.21.15.22:0/38485229 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c00bd60 con 0x7f7a54159c60 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 -- 172.21.15.22:0/38485229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159c60 msgr2=0x7f7a5415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 --2- 172.21.15.22:0/38485229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159c60 0x7f7a5415d5d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a5406a890 tx=0x7f7a3c009250 comp rx=0 tx=0).stop 2023-10-08T00:25:33.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 -- 172.21.15.22:0/38485229 shutdown_connections 2023-10-08T00:25:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 --2- 172.21.15.22:0/38485229 >> v2:172.21.15.192:3300/0 conn(0x7f7a5415db10 0x7f7a54069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 --2- 172.21.15.22:0/38485229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159c60 0x7f7a5415d5d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 -- 172.21.15.22:0/38485229 >> 172.21.15.22:0/38485229 conn(0x7f7a54068e20 msgr2=0x7f7a540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 -- 172.21.15.22:0/38485229 shutdown_connections 2023-10-08T00:25:33.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.398+0000 7f7a589bf700 1 -- 172.21.15.22:0/38485229 wait complete. 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.399+0000 7f7a589bf700 1 Processor -- start 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.399+0000 7f7a589bf700 1 -- start start 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a589bf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 0x7f7a5414caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a589bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a54159c60 0x7f7a540cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a589bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a5415db10 0x7f7a5415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a589bf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5416bde0 con 0x7f7a54159890 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a589bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5416b1d0 con 0x7f7a5415db10 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a589bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5416b4b0 con 0x7f7a54159c60 2023-10-08T00:25:33.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 0x7f7a5414caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 0x7f7a5414caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47570/0 (socket says 172.21.15.22:47570) 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 -- 172.21.15.22:0/1912701226 learned_addr learned my addr 172.21.15.22:0/1912701226 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a52d9d700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a5415db10 0x7f7a5415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a51d9b700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a54159c60 0x7f7a540cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 -- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a54159c60 msgr2=0x7f7a540cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a54159c60 0x7f7a540cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 -- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a5415db10 msgr2=0x7f7a5415caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a5415db10 0x7f7a5415caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.400+0000 7f7a5259c700 1 -- 172.21.15.22:0/1912701226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c0094f0 con 0x7f7a54159890 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.401+0000 7f7a5259c700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 0x7f7a5414caf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c590 tx=0x7f7a4400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.401+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44011590 con 0x7f7a54159890 2023-10-08T00:25:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.401+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a440116f0 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.401+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5416b790 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.401+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a44011ab0 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.401+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a540b3590 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.402+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5404c3c0 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.402+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a4401b3b0 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.403+0000 7f7a4a7fc700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a34066f30 0x7f7a340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.403+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7a44083820 con 0x7f7a54159890 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.403+0000 7f7a51d9b700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a34066f30 0x7f7a340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.403+0000 7f7a51d9b700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a34066f30 0x7f7a340693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a5406a890 tx=0x7f7a3c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:33.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.407+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a44050de0 con 0x7f7a54159890 2023-10-08T00:25:33.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.681+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f7a540b1aa0 con 0x7f7a54159890 2023-10-08T00:25:33.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.683+0000 7f7a4a7fc700 1 -- 172.21.15.22:0/1912701226 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7a44017070 con 0x7f7a54159890 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a34066f30 msgr2=0x7f7a340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a34066f30 0x7f7a340693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a5406a890 tx=0x7f7a3c017000 comp rx=0 tx=0).stop 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 msgr2=0x7f7a5414caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 0x7f7a5414caf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c590 tx=0x7f7a4400c950 comp rx=0 tx=0).stop 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 shutdown_connections 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a5415db10 0x7f7a5415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a54159890 0x7f7a5414caf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a34066f30 0x7f7a340693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 --2- 172.21.15.22:0/1912701226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a54159c60 0x7f7a540cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 >> 172.21.15.22:0/1912701226 conn(0x7f7a54068e20 msgr2=0x7f7a540c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:33.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 shutdown_connections 2023-10-08T00:25:33.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.685+0000 7f7a589bf700 1 -- 172.21.15.22:0/1912701226 wait complete. 2023-10-08T00:25:33.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.817+0000 7f6a4b25c700 1 Processor -- start 2023-10-08T00:25:33.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.817+0000 7f6a4b25c700 1 -- start start 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a4b25c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a4415c910 0x7f6a4415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a4b25c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4415c480 con 0x7f6a440b5ea0 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a4b25c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4415d290 con 0x7f6a44159c10 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a4b25c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440b2a40 con 0x7f6a4415c910 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a4415c910 0x7f6a4415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a4415c910 0x7f6a4415cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47578/0 (socket says 172.21.15.22:47578) 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a43fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a440b5ea0 0x7f6a44068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42432/0 (socket says 172.21.15.22:42432) 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 -- 172.21.15.22:0/1589887835 learned_addr learned my addr 172.21.15.22:0/1589887835 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 -- 172.21.15.22:0/1589887835 >> v1:172.21.15.192:6789/0 conn(0x7f6a44159c10 legacy=0x7f6a4415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 -- 172.21.15.22:0/1589887835 >> v1:172.21.15.22:6789/0 conn(0x7f6a440b5ea0 legacy=0x7f6a44068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 -- 172.21.15.22:0/1589887835 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4415b870 con 0x7f6a4415c910 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a437fe700 1 -- 172.21.15.22:0/1589887835 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641665553 0 0) 0x7f6a4415c480 con 0x7f6a440b5ea0 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.818+0000 7f6a497f9700 1 --2- 172.21.15.22:0/1589887835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4415c910 0x7f6a4415cd50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009f20 tx=0x7f6a3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec93252fae93d308 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a437fe700 1 -- 172.21.15.22:0/1589887835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00e070 con 0x7f6a4415c910 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a437fe700 1 -- 172.21.15.22:0/1589887835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00ba80 con 0x7f6a4415c910 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a437fe700 1 -- 172.21.15.22:0/1589887835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0092e0 con 0x7f6a4415c910 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 -- 172.21.15.22:0/1589887835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4415c910 msgr2=0x7f6a4415cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/1589887835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4415c910 0x7f6a4415cd50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009f20 tx=0x7f6a3c009840 comp rx=0 tx=0).stop 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 -- 172.21.15.22:0/1589887835 shutdown_connections 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/1589887835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a4415c910 0x7f6a4415cd50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 -- 172.21.15.22:0/1589887835 >> 172.21.15.22:0/1589887835 conn(0x7f6a44099a20 msgr2=0x7f6a440af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 -- 172.21.15.22:0/1589887835 shutdown_connections 2023-10-08T00:25:33.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.819+0000 7f6a4b25c700 1 -- 172.21.15.22:0/1589887835 wait complete. 2023-10-08T00:25:33.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.820+0000 7f6a4b25c700 1 Processor -- start 2023-10-08T00:25:33.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 -- start start 2023-10-08T00:25:33.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b5ea0 0x7f6a440c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 0x7f6a440c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4415c910 0x7f6a440ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440afcf0 con 0x7f6a44159c10 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b0170 con 0x7f6a440b5ea0 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a4b25c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440c5a60 con 0x7f6a4415c910 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a43fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 0x7f6a440c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a43fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 0x7f6a440c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47590/0 (socket says 172.21.15.22:47590) 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a43fff700 1 -- 172.21.15.22:0/661270739 learned_addr learned my addr 172.21.15.22:0/661270739 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.821+0000 7f6a48ff8700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b5ea0 0x7f6a440c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a497f9700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4415c910 0x7f6a440ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a43fff700 1 -- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4415c910 msgr2=0x7f6a440ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a43fff700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4415c910 0x7f6a440ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a43fff700 1 -- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b5ea0 msgr2=0x7f6a440c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a43fff700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b5ea0 0x7f6a440c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a43fff700 1 -- 172.21.15.22:0/661270739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009ae0 con 0x7f6a44159c10 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a497f9700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4415c910 0x7f6a440ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a43fff700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 0x7f6a440c5520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c810 tx=0x7f6a30007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30005b40 con 0x7f6a44159c10 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30005cc0 con 0x7f6a44159c10 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a440af770 con 0x7f6a44159c10 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30007320 con 0x7f6a44159c10 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.822+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a440afa10 con 0x7f6a44159c10 2023-10-08T00:25:33.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.823+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a440afe30 con 0x7f6a44159c10 2023-10-08T00:25:33.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.824+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3001b3b0 con 0x7f6a44159c10 2023-10-08T00:25:33.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.824+0000 7f6a40ff9700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:33.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.824+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6a300836f0 con 0x7f6a44159c10 2023-10-08T00:25:33.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.824+0000 7f6a48ff8700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:33.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.825+0000 7f6a48ff8700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a38003ac0 tx=0x7f6a38007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:33.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:33.828+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a30050cb0 con 0x7f6a44159c10 2023-10-08T00:25:34.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.023+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a4404c3c0 con 0x7f6a44159c10 2023-10-08T00:25:34.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.024+0000 7f6a40ff9700 1 -- 172.21.15.22:0/661270739 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f6a30017090 con 0x7f6a44159c10 2023-10-08T00:25:34.025 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:34.025 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:30.683858+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:34.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 msgr2=0x7f6a280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a38003ac0 tx=0x7f6a38007ea0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 msgr2=0x7f6a440c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 0x7f6a440c5520 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c810 tx=0x7f6a30007d90 comp rx=0 tx=0).stop 2023-10-08T00:25:34.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 shutdown_connections 2023-10-08T00:25:34.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a4415c910 0x7f6a440ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b5ea0 0x7f6a440c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 --2- 172.21.15.22:0/661270739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a44159c10 0x7f6a440c5520 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 >> 172.21.15.22:0/661270739 conn(0x7f6a44099a20 msgr2=0x7f6a4415d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:34.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 shutdown_connections 2023-10-08T00:25:34.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.026+0000 7f6a4b25c700 1 -- 172.21.15.22:0/661270739 wait complete. 2023-10-08T00:25:34.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:25:34.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:25:34.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.161+0000 7fbf479fc700 1 Processor -- start 2023-10-08T00:25:34.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.161+0000 7fbf479fc700 1 -- start start 2023-10-08T00:25:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.161+0000 7fbf479fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf4015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf479fc700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4015a160 con 0x7fbf40159c60 2023-10-08T00:25:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf479fc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400d13a0 con 0x7fbf40069560 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf479fc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4015e140 con 0x7fbf40159890 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf44f97700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbf40159c60 0x7fbf4015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42446/0 (socket says 172.21.15.22:42446) 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf44f97700 1 -- 172.21.15.22:0/4127871971 learned_addr learned my addr 172.21.15.22:0/4127871971 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf45798700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf4015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767263783 0 0) 0x7fbf4015a160 con 0x7fbf40159c60 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf28003570 con 0x7fbf40159c60 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3917182142 0 0) 0x7fbf28003570 con 0x7fbf40159c60 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 msgr2=0x7fbf4015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf4015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 >> v1:172.21.15.192:6789/0 conn(0x7fbf40069560 legacy=0x7fbf400ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4015a3d0 con 0x7fbf40159c60 2023-10-08T00:25:34.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fbf34001470 con 0x7fbf40159c60 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 >> v1:172.21.15.22:6789/0 conn(0x7fbf40159c60 legacy=0x7fbf4015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf28003a90 0x7fbf28003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf28004d50 0x7fbf280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4015e140 con 0x7fbf28004d50 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2800bb10 con 0x7fbf28003a90 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.162+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2800bcd0 con 0x7fbf40159890 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf28004d50 0x7fbf280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45798700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf28003a90 0x7fbf28003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf44f97700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 -- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 msgr2=0x7fbf28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 -- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf28003a90 msgr2=0x7fbf28003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf28003a90 0x7fbf28003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 -- 172.21.15.22:0/4127871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28003570 con 0x7fbf28004d50 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf44f97700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf40159890 0x7fbf28004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf45f99700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf28004d50 0x7fbf280051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbf380020a0 tx=0x7fbf380016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495fabea2aa1c180 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380019e0 con 0x7fbf28004d50 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3800c8b0 con 0x7fbf28004d50 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf3ffff700 1 -- 172.21.15.22:0/4127871971 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800cc50 con 0x7fbf28004d50 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf479fc700 1 -- 172.21.15.22:0/4127871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf28004d50 msgr2=0x7fbf280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.163+0000 7fbf479fc700 1 --2- 172.21.15.22:0/4127871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf28004d50 0x7fbf280051c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbf380020a0 tx=0x7fbf380016d0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.164+0000 7fbf45f99700 1 -- 172.21.15.22:0/4127871971 reap_dead start 2023-10-08T00:25:34.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.164+0000 7fbf479fc700 1 -- 172.21.15.22:0/4127871971 shutdown_connections 2023-10-08T00:25:34.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.164+0000 7fbf479fc700 1 -- 172.21.15.22:0/4127871971 >> 172.21.15.22:0/4127871971 conn(0x7fbf40068e20 msgr2=0x7fbf400d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:34.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.164+0000 7fbf479fc700 1 -- 172.21.15.22:0/4127871971 shutdown_connections 2023-10-08T00:25:34.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.164+0000 7fbf479fc700 1 -- 172.21.15.22:0/4127871971 wait complete. 2023-10-08T00:25:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.165+0000 7fbf479fc700 1 Processor -- start 2023-10-08T00:25:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.165+0000 7fbf479fc700 1 -- start start 2023-10-08T00:25:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 0x7fbf400cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4016d140 0x7fbf400cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400b2780 0x7fbf400cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400b3730 con 0x7fbf400b23b0 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400cffa0 con 0x7fbf400b2780 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400cf710 con 0x7fbf4016d140 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 0x7fbf400cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 0x7fbf400cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47612/0 (socket says 172.21.15.22:47612) 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 -- 172.21.15.22:0/2873471846 learned_addr learned my addr 172.21.15.22:0/2873471846 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf44f97700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4016d140 0x7fbf400cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45f99700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400b2780 0x7fbf400cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 -- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4016d140 msgr2=0x7fbf400cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4016d140 0x7fbf400cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 -- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400b2780 msgr2=0x7fbf400cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400b2780 0x7fbf400cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 -- 172.21.15.22:0/2873471846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4016d6b0 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf44f97700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4016d140 0x7fbf400cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45f99700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400b2780 0x7fbf400cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf45798700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 0x7fbf400cfa60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006ac0 tx=0x7fbf300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000fa10 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000fb70 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4016d990 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30014440 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.166+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4015ca60 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.167+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4004c3c0 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.168+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf30014830 con 0x7fbf400b23b0 2023-10-08T00:25:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.168+0000 7fbf3d7fa700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf2c066f30 0x7fbf2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.168+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbf30018030 con 0x7fbf400b23b0 2023-10-08T00:25:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.168+0000 7fbf44f97700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf2c066f30 0x7fbf2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.169+0000 7fbf44f97700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf2c066f30 0x7fbf2c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbf34001d00 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.172+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf30086e60 con 0x7fbf400b23b0 2023-10-08T00:25:34.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.365+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf400c6460 con 0x7fbf400b23b0 2023-10-08T00:25:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.365+0000 7fbf3d7fa700 1 -- 172.21.15.22:0/2873471846 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf30052240 con 0x7fbf400b23b0 2023-10-08T00:25:34.366 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:25:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf2c066f30 msgr2=0x7fbf2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf2c066f30 0x7fbf2c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbf34001d00 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2023-10-08T00:25:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 msgr2=0x7fbf400cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 0x7fbf400cfa60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbf30006ac0 tx=0x7fbf300091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 shutdown_connections 2023-10-08T00:25:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf400b2780 0x7fbf400cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf400b23b0 0x7fbf400cfa60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf2c066f30 0x7fbf2c0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 --2- 172.21.15.22:0/2873471846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4016d140 0x7fbf400cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 >> 172.21.15.22:0/2873471846 conn(0x7fbf40068e20 msgr2=0x7fbf40154620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:34.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 shutdown_connections 2023-10-08T00:25:34.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.367+0000 7fbf479fc700 1 -- 172.21.15.22:0/2873471846 wait complete. 2023-10-08T00:25:34.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:25:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.498+0000 7f3e8152f700 1 Processor -- start 2023-10-08T00:25:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.498+0000 7f3e8152f700 1 -- start start 2023-10-08T00:25:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e8152f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c1593b0 0x7f3e7c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e8152f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e7c0ceaa0 0x7f3e7c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e8152f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c0b6570 con 0x7f3e7c0b1740 2023-10-08T00:25:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e8152f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c0cfe20 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e8152f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c0cf210 con 0x7f3e7c1593b0 2023-10-08T00:25:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e7c0ceaa0 0x7f3e7c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e80d2e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3e7c0b1740 0x7f3e7c15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42456/0 (socket says 172.21.15.22:42456) 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e80d2e700 1 -- 172.21.15.22:0/2084612033 learned_addr learned my addr 172.21.15.22:0/2084612033 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7bfff700 1 --2- 172.21.15.22:0/2084612033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c1593b0 0x7f3e7c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2084612033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c1593b0 msgr2=0x7f3e7c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7b7fe700 1 --2- 172.21.15.22:0/2084612033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c1593b0 0x7f3e7c159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2084612033 >> v1:172.21.15.22:6789/0 conn(0x7f3e7c0b1740 legacy=0x7f3e7c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2084612033 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c0cf4f0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.499+0000 7f3e7affd700 1 -- 172.21.15.22:0/2084612033 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326427411 0 0) 0x7f3e74001490 con 0x7f3e7c0b1740 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e7b7fe700 1 --2- 172.21.15.22:0/2084612033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c0b6030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3e640098e0 tx=0x7f3e640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d7bc9cffe342a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e7affd700 1 -- 172.21.15.22:0/2084612033 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64009e80 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e7affd700 1 -- 172.21.15.22:0/2084612033 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6400b860 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e7affd700 1 -- 172.21.15.22:0/2084612033 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400bbe0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 -- 172.21.15.22:0/2084612033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 msgr2=0x7f3e7c0b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2084612033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c0b6030 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3e640098e0 tx=0x7f3e640091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 -- 172.21.15.22:0/2084612033 shutdown_connections 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2084612033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c1593b0 0x7f3e7c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2084612033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c0b6030 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 -- 172.21.15.22:0/2084612033 >> 172.21.15.22:0/2084612033 conn(0x7f3e7c0d1130 msgr2=0x7f3e7c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 -- 172.21.15.22:0/2084612033 shutdown_connections 2023-10-08T00:25:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.500+0000 7f3e8152f700 1 -- 172.21.15.22:0/2084612033 wait complete. 2023-10-08T00:25:34.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.501+0000 7f3e8152f700 1 Processor -- start 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 -- start start 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c0b1740 0x7f3e7c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c14e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e7c1593b0 0x7f3e7c150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14feb0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14f000 con 0x7f3e7c1593b0 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e8152f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14f2a0 con 0x7f3e7c0b1740 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e7b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c14e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e7b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c14e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47616/0 (socket says 172.21.15.22:47616) 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.502+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2723296452 learned_addr learned my addr 172.21.15.22:0/2723296452 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:34.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e80d2e700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e7c1593b0 0x7f3e7c150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7bfff700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c0b1740 0x7f3e7c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c0b1740 msgr2=0x7f3e7c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7b7fe700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c0b1740 0x7f3e7c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e7c1593b0 msgr2=0x7f3e7c150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7b7fe700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e7c1593b0 0x7f3e7c150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7b7fe700 1 -- 172.21.15.22:0/2723296452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009420 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e7b7fe700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c14e1d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c06fe00 tx=0x7f3e64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6400bbe0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64011420 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c14f580 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640117c0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.503+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c14fb40 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.504+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c04c3c0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.504+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e64011bb0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.505+0000 7f3e73fff700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.505+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e64085ba0 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.505+0000 7f3e7bfff700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.506+0000 7f3e7bfff700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c006fd0 tx=0x7f3e6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.509+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e64053160 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.708+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3e7c158b70 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.709+0000 7f3e73fff700 1 -- 172.21.15.22:0/2723296452 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3e64011e60 con 0x7f3e7c0ceaa0 2023-10-08T00:25:34.709 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:34.710 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:25:34.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:34.710 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:25:34.710 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:25:34.710 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:34.710 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e5c066f30 msgr2=0x7f3e5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e5c066f30 0x7f3e5c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c006fd0 tx=0x7f3e6c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 msgr2=0x7f3e7c14e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c14e1d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c06fe00 tx=0x7f3e64017000 comp rx=0 tx=0).stop 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 shutdown_connections 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e7c1593b0 0x7f3e7c150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e5c066f30 0x7f3e5c0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e7c0b1740 0x7f3e7c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 --2- 172.21.15.22:0/2723296452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e7c0ceaa0 0x7f3e7c14e1d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 >> 172.21.15.22:0/2723296452 conn(0x7f3e7c0d1130 msgr2=0x7f3e7c0af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 shutdown_connections 2023-10-08T00:25:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.711+0000 7f3e8152f700 1 -- 172.21.15.22:0/2723296452 wait complete. 2023-10-08T00:25:34.723 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:25:34.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:25:34.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.847+0000 7fa5bfe8c700 1 Processor -- start 2023-10-08T00:25:34.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.847+0000 7fa5bfe8c700 1 -- start start 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bfe8c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 0x7fa5b80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bfe8c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b80b5b00 con 0x7fa5b80b53d0 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bfe8c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b80b5da0 con 0x7fa5b80cf350 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bfe8c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80b6080 con 0x7fa5b8159ec0 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bd427700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa5b80b53d0 0x7fa5b80cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42464/0 (socket says 172.21.15.22:42464) 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bd427700 1 -- 172.21.15.22:0/2600845831 learned_addr learned my addr 172.21.15.22:0/2600845831 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 0x7fa5b80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942640555 0 0) 0x7fa5b80b5b00 con 0x7fa5b80b53d0 2023-10-08T00:25:34.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a0003570 con 0x7fa5b80b53d0 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3548304623 0 0) 0x7fa5a0003570 con 0x7fa5b80b53d0 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 msgr2=0x7fa5b80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 0x7fa5b80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 >> v1:172.21.15.192:6789/0 conn(0x7fa5b80cf350 legacy=0x7fa5b80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80cc100 con 0x7fa5b80b53d0 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fa5ac001470 con 0x7fa5b80b53d0 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 >> v1:172.21.15.22:6789/0 conn(0x7fa5b80b53d0 legacy=0x7fa5b80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a0003a90 0x7fa5a0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5a0004810 0x7fa5a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 0x7fa5a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80b6080 con 0x7fa5a0003a90 2023-10-08T00:25:34.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000bb10 con 0x7fa5a0004810 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.848+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000bcd0 con 0x7fa5b8159ec0 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a0003a90 0x7fa5a0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bd427700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5a0004810 0x7fa5a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5be429700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 0x7fa5a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 -- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 msgr2=0x7fa5a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5b8159ec0 0x7fa5a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 -- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5a0004810 msgr2=0x7fa5a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5a0004810 0x7fa5a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 -- 172.21.15.22:0/2600845831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0003570 con 0x7fa5a0003a90 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a0003a90 0x7fa5a0003e60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800e2d0 tx=0x7fa5a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608ef6ea11aec8ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800eb20 con 0x7fa5a0003a90 2023-10-08T00:25:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800f040 con 0x7fa5a0003a90 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.849+0000 7fa5bcc26700 1 -- 172.21.15.22:0/2600845831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800eed0 con 0x7fa5a0003a90 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2600845831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a0003a90 msgr2=0x7fa5a0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2600845831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a0003a90 0x7fa5a0003e60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800e2d0 tx=0x7fa5a800b040 comp rx=0 tx=0).stop 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5be429700 1 -- 172.21.15.22:0/2600845831 reap_dead start 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2600845831 shutdown_connections 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2600845831 >> 172.21.15.22:0/2600845831 conn(0x7fa5b80999f0 msgr2=0x7fa5b80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2600845831 shutdown_connections 2023-10-08T00:25:34.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.850+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2600845831 wait complete. 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.851+0000 7fa5bfe8c700 1 Processor -- start 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.851+0000 7fa5bfe8c700 1 -- start start 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5a0003a90 0x7fa5b80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 0x7fa5b8169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5b816a020 0x7fa5b816a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8144ab0 con 0x7fa5b8068d50 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b816a9e0 con 0x7fa5b816a020 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8069210 con 0x7fa5a0003a90 2023-10-08T00:25:34.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 0x7fa5b8169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 0x7fa5b8169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47638/0 (socket says 172.21.15.22:47638) 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 -- 172.21.15.22:0/2244335320 learned_addr learned my addr 172.21.15.22:0/2244335320 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5a0003a90 0x7fa5b80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5be429700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5b816a020 0x7fa5b816a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 -- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5a0003a90 msgr2=0x7fa5b80b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5a0003a90 0x7fa5b80b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 -- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5b816a020 msgr2=0x7fa5b816a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:34.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5b816a020 0x7fa5b816a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 -- 172.21.15.22:0/2244335320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80694f0 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5a0003a90 0x7fa5b80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5be429700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5b816a020 0x7fa5b816a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bd427700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 0x7fa5b8169ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac007390 tx=0x7fa5ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac018030 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00f870 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b80697d0 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.852+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00fc10 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.853+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b81574d0 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.854+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b8063c90 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.854+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5ac01b070 con 0x7fa5b8068d50 2023-10-08T00:25:34.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.854+0000 7fa5b5ffb700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:34.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.854+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa5ac019070 con 0x7fa5b8068d50 2023-10-08T00:25:34.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.855+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:34.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.855+0000 7fa5bdc28700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5a4066f30 0x7fa5a40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5b814b380 tx=0x7fa5a801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:34.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:34.859+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5ac051780 con 0x7fa5b8068d50 2023-10-08T00:25:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.054+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa5b80718b0 con 0x7fa5b8068d50 2023-10-08T00:25:35.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.692+0000 7fa5b5ffb700 1 -- 172.21.15.22:0/2244335320 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa5ac054da0 con 0x7fa5b8068d50 2023-10-08T00:25:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.698+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5a4066f30 msgr2=0x7fa5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.698+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5a4066f30 0x7fa5a40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5b814b380 tx=0x7fa5a801a000 comp rx=0 tx=0).stop 2023-10-08T00:25:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.698+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 msgr2=0x7fa5b8169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.698+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 0x7fa5b8169ae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac007390 tx=0x7fa5ac001e70 comp rx=0 tx=0).stop 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 shutdown_connections 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5b816a020 0x7fa5b816a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5a0003a90 0x7fa5b80b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 --2- 172.21.15.22:0/2244335320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5b8068d50 0x7fa5b8169ae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 >> 172.21.15.22:0/2244335320 conn(0x7fa5b80999f0 msgr2=0x7fa5b8158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 shutdown_connections 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.699+0000 7fa5bfe8c700 1 -- 172.21.15.22:0/2244335320 wait complete. 2023-10-08T00:25:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:25:35.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:25:35.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.846+0000 7fd0d3695700 1 Processor -- start 2023-10-08T00:25:35.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.846+0000 7fd0d3695700 1 -- start start 2023-10-08T00:25:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d3695700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 0x7fd0cc0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d3695700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc157c50 con 0x7fd0cc15df40 2023-10-08T00:25:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d3695700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc15d7d0 con 0x7fd0cc0cce20 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d3695700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc15aa20 con 0x7fd0cc0cca50 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d1c32700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd0cc15df40 0x7fd0cc06ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42478/0 (socket says 172.21.15.22:42478) 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d1c32700 1 -- 172.21.15.22:0/4027057986 learned_addr learned my addr 172.21.15.22:0/4027057986 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0d1431700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 0x7fd0cc0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515124637 0 0) 0x7fd0c4001110 con 0x7fd0cc15df40 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0b4003570 con 0x7fd0cc15df40 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 451676454 0 0) 0x7fd0b4003570 con 0x7fd0cc15df40 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 msgr2=0x7fd0cc0caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 0x7fd0cc0caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 >> v1:172.21.15.192:6789/0 conn(0x7fd0cc0cce20 legacy=0x7fd0cc15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc15ad00 con 0x7fd0cc15df40 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fd0c4001600 con 0x7fd0cc15df40 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 >> v1:172.21.15.22:6789/0 conn(0x7fd0cc15df40 legacy=0x7fd0cc06ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b4003a90 0x7fd0b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4004810 0x7fd0b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 0x7fd0b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc15aa20 con 0x7fd0b4003a90 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b400bb10 con 0x7fd0b4004810 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.847+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b400bcd0 con 0x7fd0cc0cca50 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b4003a90 0x7fd0b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d0c30700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4004810 0x7fd0b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1c32700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 0x7fd0b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 -- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 msgr2=0x7fd0b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0cca50 0x7fd0b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 -- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4004810 msgr2=0x7fd0b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4004810 0x7fd0b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 -- 172.21.15.22:0/4027057986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b4003570 con 0x7fd0b4003a90 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0d1431700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b4003a90 0x7fd0b4003e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00e210 tx=0x7fd0bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f254ac0b609d765 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00eac0 con 0x7fd0b4003a90 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc00f040 con 0x7fd0b4003a90 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.848+0000 7fd0cbfff700 1 -- 172.21.15.22:0/4027057986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc00ee70 con 0x7fd0b4003a90 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d3695700 1 -- 172.21.15.22:0/4027057986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b4003a90 msgr2=0x7fd0b4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d3695700 1 --2- 172.21.15.22:0/4027057986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0b4003a90 0x7fd0b4003e60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00e210 tx=0x7fd0bc00b040 comp rx=0 tx=0).stop 2023-10-08T00:25:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d1c32700 1 -- 172.21.15.22:0/4027057986 reap_dead start 2023-10-08T00:25:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d3695700 1 -- 172.21.15.22:0/4027057986 shutdown_connections 2023-10-08T00:25:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d3695700 1 -- 172.21.15.22:0/4027057986 >> 172.21.15.22:0/4027057986 conn(0x7fd0cc0ce5c0 msgr2=0x7fd0cc0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d3695700 1 -- 172.21.15.22:0/4027057986 shutdown_connections 2023-10-08T00:25:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.849+0000 7fd0d3695700 1 -- 172.21.15.22:0/4027057986 wait complete. 2023-10-08T00:25:35.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.850+0000 7fd0d3695700 1 Processor -- start 2023-10-08T00:25:35.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.850+0000 7fd0d3695700 1 -- start start 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4003a90 0x7fd0cc0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0b2b60 0x7fd0cc155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 0x7fd0cc06ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0b4260 con 0x7fd0cc0c6370 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc155fa0 con 0x7fd0b4003a90 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0b3890 con 0x7fd0cc0b2b60 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 0x7fd0cc06ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 0x7fd0cc06ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47662/0 (socket says 172.21.15.22:47662) 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 -- 172.21.15.22:0/3694475795 learned_addr learned my addr 172.21.15.22:0/3694475795 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d0c30700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0b2b60 0x7fd0cc155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1431700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4003a90 0x7fd0cc0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 -- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0b2b60 msgr2=0x7fd0cc155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0b2b60 0x7fd0cc155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 -- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4003a90 msgr2=0x7fd0cc0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4003a90 0x7fd0cc0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 -- 172.21.15.22:0/3694475795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc0c6bc0 con 0x7fd0cc0c6370 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d1c32700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 0x7fd0cc06ba80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc15e310 tx=0x7fd0c4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4018030 con 0x7fd0cc0c6370 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400f910 con 0x7fd0cc0c6370 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc0b3240 con 0x7fd0cc0c6370 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.851+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400fcf0 con 0x7fd0cc0c6370 2023-10-08T00:25:35.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.852+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc0c6ea0 con 0x7fd0cc0c6370 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.853+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc0b3090 con 0x7fd0cc0c6370 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.853+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0c401b070 con 0x7fd0cc0c6370 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.853+0000 7fd0c97fa700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd0b8066f30 0x7fd0b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.853+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fd0c4019070 con 0x7fd0cc0c6370 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.853+0000 7fd0d1431700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd0b8066f30 0x7fd0b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.854+0000 7fd0d1431700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd0b8066f30 0x7fd0b80693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00afd0 tx=0x7fd0bc01a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:35.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:35.858+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0c4051430 con 0x7fd0cc0c6370 2023-10-08T00:25:36.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.049+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd0cc157c50 con 0x7fd0cc0c6370 2023-10-08T00:25:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.697+0000 7fd0c97fa700 1 -- 172.21.15.22:0/3694475795 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd0cc157c50 con 0x7fd0cc0c6370 2023-10-08T00:25:36.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.703+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd0b8066f30 msgr2=0x7fd0b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:36.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.703+0000 7fd0d3695700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd0b8066f30 0x7fd0b80693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00afd0 tx=0x7fd0bc01a000 comp rx=0 tx=0).stop 2023-10-08T00:25:36.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.703+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 msgr2=0x7fd0cc06ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:36.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.703+0000 7fd0d3695700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 0x7fd0cc06ba80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc15e310 tx=0x7fd0c4007a50 comp rx=0 tx=0).stop 2023-10-08T00:25:36.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 shutdown_connections 2023-10-08T00:25:36.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0c6370 0x7fd0cc06ba80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd0b4003a90 0x7fd0cc0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd0b8066f30 0x7fd0b80693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 --2- 172.21.15.22:0/3694475795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd0cc0b2b60 0x7fd0cc155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 >> 172.21.15.22:0/3694475795 conn(0x7fd0cc0ce5c0 msgr2=0x7fd0cc0c4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:36.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.708+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 shutdown_connections 2023-10-08T00:25:36.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.709+0000 7fd0d3695700 1 -- 172.21.15.22:0/3694475795 wait complete. 2023-10-08T00:25:36.719 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:25:36.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:25:36.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.857+0000 7f2b5b617700 1 Processor -- start 2023-10-08T00:25:36.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.857+0000 7f2b5b617700 1 -- start start 2023-10-08T00:25:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b5b617700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b54069d60 0x7f2b540c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b5b617700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b5b617700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540c8650 con 0x7f2b540aca80 2023-10-08T00:25:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b5b617700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5406bdb0 con 0x7f2b54069d60 2023-10-08T00:25:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b5b617700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540cb370 con 0x7f2b540c81f0 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b59bb4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b58bb2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b54069d60 0x7f2b540c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b593b3700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2b540aca80 0x7f2b5406aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49862/0 (socket says 172.21.15.22:49862) 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.858+0000 7f2b593b3700 1 -- 172.21.15.22:0/1010169033 learned_addr learned my addr 172.21.15.22:0/1010169033 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b58bb2700 1 -- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 msgr2=0x7f2b540cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b58bb2700 1 --2- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b58bb2700 1 -- 172.21.15.22:0/1010169033 >> v1:172.21.15.192:6789/0 conn(0x7f2b540aca80 legacy=0x7f2b5406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b58bb2700 1 -- 172.21.15.22:0/1010169033 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b54159f60 con 0x7f2b54069d60 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b47fff700 1 -- 172.21.15.22:0/1010169033 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789120249 0 0) 0x7f2b48001160 con 0x7f2b540aca80 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b59bb4700 1 --2- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b58bb2700 1 --2- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b540c7cb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b500098e0 tx=0x7f2b500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f413a4251ab02e31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b47fff700 1 -- 172.21.15.22:0/1010169033 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000b640 con 0x7f2b54069d60 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b47fff700 1 -- 172.21.15.22:0/1010169033 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000b7a0 con 0x7f2b54069d60 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b47fff700 1 -- 172.21.15.22:0/1010169033 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000bb40 con 0x7f2b54069d60 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b5b617700 1 -- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 msgr2=0x7f2b540c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b5b617700 1 --2- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b540c7cb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b500098e0 tx=0x7f2b500091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b5b617700 1 -- 172.21.15.22:0/1010169033 shutdown_connections 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b5b617700 1 --2- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b5b617700 1 --2- 172.21.15.22:0/1010169033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b540c7cb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.859+0000 7f2b5b617700 1 -- 172.21.15.22:0/1010169033 >> 172.21.15.22:0/1010169033 conn(0x7f2b540cd670 msgr2=0x7f2b540cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:36.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.860+0000 7f2b5b617700 1 -- 172.21.15.22:0/1010169033 shutdown_connections 2023-10-08T00:25:36.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.860+0000 7f2b5b617700 1 -- 172.21.15.22:0/1010169033 wait complete. 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 Processor -- start 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 -- start start 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b54157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 0x7f2b540cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540afa30 con 0x7f2b540aca80 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5416e3b0 con 0x7f2b54069d60 2023-10-08T00:25:36.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.861+0000 7f2b5b617700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540b0ee0 con 0x7f2b540c81f0 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 0x7f2b540cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 0x7f2b540cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59640/0 (socket says 172.21.15.22:59640) 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 -- 172.21.15.22:0/2304111751 learned_addr learned my addr 172.21.15.22:0/2304111751 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b59bb4700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b593b3700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b54157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 -- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 msgr2=0x7f2b540cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 -- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 msgr2=0x7f2b54157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b54157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 -- 172.21.15.22:0/2304111751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c009a20 con 0x7f2b540aca80 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b58bb2700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 0x7f2b540cc510 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2b50013000 tx=0x7f2b50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:36.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000bb20 con 0x7f2b540aca80 2023-10-08T00:25:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50011420 con 0x7f2b540aca80 2023-10-08T00:25:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b50009420 con 0x7f2b540aca80 2023-10-08T00:25:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500117a0 con 0x7f2b540aca80 2023-10-08T00:25:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.862+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b540b05b0 con 0x7f2b540aca80 2023-10-08T00:25:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.863+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5404c3c0 con 0x7f2b540aca80 2023-10-08T00:25:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.864+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b50011b50 con 0x7f2b540aca80 2023-10-08T00:25:36.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.864+0000 7f2b457fa700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b38066f30 0x7f2b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:36.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.864+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2b50085c00 con 0x7f2b540aca80 2023-10-08T00:25:36.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.864+0000 7f2b593b3700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b38066f30 0x7f2b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:36.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.865+0000 7f2b593b3700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b38066f30 0x7f2b380693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b480018d0 tx=0x7f2b48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:36.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:36.869+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b5008c080 con 0x7f2b540aca80 2023-10-08T00:25:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.105+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2b540b1020 con 0x7f2b540aca80 2023-10-08T00:25:37.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.700+0000 7f2b457fa700 1 -- 172.21.15.22:0/2304111751 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2b50052ed0 con 0x7f2b540aca80 2023-10-08T00:25:37.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.708+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b38066f30 msgr2=0x7f2b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:37.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.708+0000 7f2b5b617700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b38066f30 0x7f2b380693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b480018d0 tx=0x7f2b48009040 comp rx=0 tx=0).stop 2023-10-08T00:25:37.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.708+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 msgr2=0x7f2b540cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:37.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.708+0000 7f2b5b617700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 0x7f2b540cc510 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2b50013000 tx=0x7f2b50017000 comp rx=0 tx=0).stop 2023-10-08T00:25:37.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.712+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 shutdown_connections 2023-10-08T00:25:37.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.712+0000 7f2b5b617700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b38066f30 0x7f2b380693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.712+0000 7f2b5b617700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b540c81f0 0x7f2b540cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.712+0000 7f2b5b617700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b54069d60 0x7f2b54157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.712+0000 7f2b5b617700 1 --2- 172.21.15.22:0/2304111751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b540aca80 0x7f2b540cc510 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.712+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 >> 172.21.15.22:0/2304111751 conn(0x7f2b540cd670 msgr2=0x7f2b540c25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:37.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.713+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 shutdown_connections 2023-10-08T00:25:37.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.713+0000 7f2b5b617700 1 -- 172.21.15.22:0/2304111751 wait complete. 2023-10-08T00:25:37.725 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T00:25:37.737 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 Processor -- start 2023-10-08T00:25:37.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 -- start start 2023-10-08T00:25:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c15a160 con 0x7f2d2c15db10 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c15df50 con 0x7f2d2c159c60 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.858+0000 7f2d330f1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c0d13a0 con 0x7f2d2c159890 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59642/0 (socket says 172.21.15.22:59642) 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d3168e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2d2c15db10 0x7f2d2c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50274/0 (socket says 172.21.15.22:50274) 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 -- 172.21.15.22:0/3815016048 learned_addr learned my addr 172.21.15.22:0/3815016048 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d30e8d700 1 --2- 172.21.15.22:0/3815016048 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:37.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 -- 172.21.15.22:0/3815016048 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 msgr2=0x7f2d2c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 --2- 172.21.15.22:0/3815016048 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 -- 172.21.15.22:0/3815016048 >> v1:172.21.15.22:6789/0 conn(0x7f2d2c15db10 legacy=0x7f2d2c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 -- 172.21.15.22:0/3815016048 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c15e140 con 0x7f2d2c159c60 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2b7fe700 1 -- 172.21.15.22:0/3815016048 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137239539 0 0) 0x7f2d2c15a160 con 0x7f2d2c15db10 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2bfff700 1 --2- 172.21.15.22:0/3815016048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0d1090 tx=0x7f2d14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676a270936aa95ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2b7fe700 1 -- 172.21.15.22:0/3815016048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400b860 con 0x7f2d2c159c60 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2b7fe700 1 -- 172.21.15.22:0/3815016048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400b9c0 con 0x7f2d2c159c60 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.859+0000 7f2d2b7fe700 1 -- 172.21.15.22:0/3815016048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400bd60 con 0x7f2d2c159c60 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 -- 172.21.15.22:0/3815016048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159c60 msgr2=0x7f2d2c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3815016048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0d1090 tx=0x7f2d14009250 comp rx=0 tx=0).stop 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 -- 172.21.15.22:0/3815016048 shutdown_connections 2023-10-08T00:25:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3815016048 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3815016048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 -- 172.21.15.22:0/3815016048 >> 172.21.15.22:0/3815016048 conn(0x7f2d2c068e20 msgr2=0x7f2d2c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 -- 172.21.15.22:0/3815016048 shutdown_connections 2023-10-08T00:25:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.860+0000 7f2d330f1700 1 -- 172.21.15.22:0/3815016048 wait complete. 2023-10-08T00:25:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.861+0000 7f2d330f1700 1 Processor -- start 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.861+0000 7f2d330f1700 1 -- start start 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d330f1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159890 0x7f2d2c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d330f1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d330f1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 0x7f2d2c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d330f1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c151ff0 con 0x7f2d2c15db10 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d330f1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0cdc20 con 0x7f2d2c159c60 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d330f1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c0cdec0 con 0x7f2d2c159890 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 0x7f2d2c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 0x7f2d2c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59644/0 (socket says 172.21.15.22:59644) 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 -- 172.21.15.22:0/3402780207 learned_addr learned my addr 172.21.15.22:0/3402780207 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d2bfff700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d30e8d700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159890 0x7f2d2c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 -- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159890 msgr2=0x7f2d2c0cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159890 0x7f2d2c0cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 -- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 msgr2=0x7f2d2c14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 -- 172.21.15.22:0/3402780207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140094f0 con 0x7f2d2c15db10 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d30e8d700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159890 0x7f2d2c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.862+0000 7f2d3168e700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 0x7f2d2c152300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400ccc0 tx=0x7f2d24001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.863+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24005df0 con 0x7f2d2c15db10 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.863+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400a6b0 con 0x7f2d2c15db10 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.863+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c152e50 con 0x7f2d2c15db10 2023-10-08T00:25:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.863+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400aa70 con 0x7f2d2c15db10 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.863+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c0ce720 con 0x7f2d2c15db10 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.864+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c0ce080 con 0x7f2d2c15db10 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.864+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d240070f0 con 0x7f2d2c15db10 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.864+0000 7f2d28ff9700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.864+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d240846a0 con 0x7f2d2c15db10 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.865+0000 7f2d30e8d700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.865+0000 7f2d30e8d700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c066f30 0x7f2d0c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c006fd0 tx=0x7f2d1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:37.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:37.869+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d240519a0 con 0x7f2d2c15db10 2023-10-08T00:25:38.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.061+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d2c152130 con 0x7f2d2c15db10 2023-10-08T00:25:38.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.062+0000 7f2d28ff9700 1 -- 172.21.15.22:0/3402780207 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f2d24054fc0 con 0x7f2d2c15db10 2023-10-08T00:25:38.062 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:38.062 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:37.106122+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:38.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c066f30 msgr2=0x7f2d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c066f30 0x7f2d0c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c006fd0 tx=0x7f2d1c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 msgr2=0x7f2d2c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 0x7f2d2c152300 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400ccc0 tx=0x7f2d24001a70 comp rx=0 tx=0).stop 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 shutdown_connections 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c15db10 0x7f2d2c152300 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c066f30 0x7f2d0c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159890 0x7f2d2c0cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 --2- 172.21.15.22:0/3402780207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 >> 172.21.15.22:0/3402780207 conn(0x7f2d2c068e20 msgr2=0x7f2d2c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 shutdown_connections 2023-10-08T00:25:38.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.064+0000 7f2d330f1700 1 -- 172.21.15.22:0/3402780207 wait complete. 2023-10-08T00:25:38.077 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:38.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.195+0000 7f7df6eb3700 1 Processor -- start 2023-10-08T00:25:38.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.195+0000 7f7df6eb3700 1 -- start start 2023-10-08T00:25:38.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.195+0000 7f7df6eb3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7df0159890 0x7f7df015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.195+0000 7f7df6eb3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df015a160 con 0x7f7df0069560 2023-10-08T00:25:38.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.195+0000 7f7df6eb3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00d13a0 con 0x7f7df0159c60 2023-10-08T00:25:38.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.195+0000 7f7df6eb3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df015e140 con 0x7f7df0159890 2023-10-08T00:25:38.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7df5450700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7df0069560 0x7f7df00ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50278/0 (socket says 172.21.15.22:50278) 2023-10-08T00:25:38.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7df5450700 1 -- 172.21.15.22:0/3817300408 learned_addr learned my addr 172.21.15.22:0/3817300408 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7df4c4f700 1 --2- 172.21.15.22:0/3817300408 >> v2:172.21.15.192:3300/0 conn(0x7f7df0159890 0x7f7df015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223358822 0 0) 0x7f7df015a160 con 0x7f7df0069560 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ddc003570 con 0x7f7df0069560 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3758533316 0 0) 0x7f7ddc003570 con 0x7f7df0069560 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 >> v2:172.21.15.192:3300/0 conn(0x7f7df0159890 msgr2=0x7f7df015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 --2- 172.21.15.22:0/3817300408 >> v2:172.21.15.192:3300/0 conn(0x7f7df0159890 0x7f7df015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 >> v1:172.21.15.192:6789/0 conn(0x7f7df0159c60 legacy=0x7f7df015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df015a3d0 con 0x7f7df0069560 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f7de0001470 con 0x7f7df0069560 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 >> v1:172.21.15.22:6789/0 conn(0x7f7df0069560 legacy=0x7f7df00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc003a60 0x7f7ddc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc004810 0x7f7ddc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7ddc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df015e140 con 0x7f7ddc0051c0 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc00c0d0 con 0x7f7ddc004810 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc00c290 con 0x7f7ddc003a60 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7df5450700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7ddc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7df4c4f700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc003a60 0x7f7ddc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.196+0000 7f7deffff700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc004810 0x7f7ddc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 -- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc003a60 msgr2=0x7f7ddc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ddc003a60 0x7f7ddc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 -- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc004810 msgr2=0x7f7ddc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ddc004810 0x7f7ddc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 -- 172.21.15.22:0/3817300408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc003570 con 0x7f7ddc0051c0 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 -- 172.21.15.22:0/3817300408 reap_dead start 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7df5450700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7ddc00ba60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7de000c3c0 tx=0x7f7de0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97976f1452f883 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de000cc90 con 0x7f7ddc0051c0 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de000ce10 con 0x7f7ddc0051c0 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.197+0000 7f7def7fe700 1 -- 172.21.15.22:0/3817300408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0005b70 con 0x7f7ddc0051c0 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 -- 172.21.15.22:0/3817300408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 msgr2=0x7f7ddc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7ddc00ba60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7de000c3c0 tx=0x7f7de0001e50 comp rx=0 tx=0).stop 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 -- 172.21.15.22:0/3817300408 shutdown_connections 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/3817300408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7ddc00ba60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 -- 172.21.15.22:0/3817300408 >> 172.21.15.22:0/3817300408 conn(0x7f7df0068e20 msgr2=0x7f7df00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 -- 172.21.15.22:0/3817300408 shutdown_connections 2023-10-08T00:25:38.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.198+0000 7f7df6eb3700 1 -- 172.21.15.22:0/3817300408 wait complete. 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.199+0000 7f7df6eb3700 1 Processor -- start 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.199+0000 7f7df6eb3700 1 -- start start 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7df013c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df00b3590 0x7f7df00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7df00b2100 0x7f7df00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00b25a0 con 0x7f7ddc0051c0 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df01560e0 con 0x7f7df00b3590 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00cf260 con 0x7f7df00b2100 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7df013c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7df013c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59662/0 (socket says 172.21.15.22:59662) 2023-10-08T00:25:38.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 -- 172.21.15.22:0/838406078 learned_addr learned my addr 172.21.15.22:0/838406078 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7deffff700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df00b3590 0x7f7df00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df5450700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7df00b2100 0x7f7df00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 -- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7df00b2100 msgr2=0x7f7df00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7df00b2100 0x7f7df00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 -- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df00b3590 msgr2=0x7f7df00b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df00b3590 0x7f7df00b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 -- 172.21.15.22:0/838406078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00cf540 con 0x7f7ddc0051c0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df4c4f700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7df013c370 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009fd0 tx=0x7f7de800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800e040 con 0x7f7ddc0051c0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de800f040 con 0x7f7ddc0051c0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df0155d70 con 0x7f7ddc0051c0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de800fda0 con 0x7f7ddc0051c0 2023-10-08T00:25:38.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.200+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df00cea50 con 0x7f7ddc0051c0 2023-10-08T00:25:38.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.201+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df0155bd0 con 0x7f7ddc0051c0 2023-10-08T00:25:38.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.202+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7de8015640 con 0x7f7ddc0051c0 2023-10-08T00:25:38.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.202+0000 7f7decff9700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dd0066f60 0x7f7dd0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.202+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7de8085060 con 0x7f7ddc0051c0 2023-10-08T00:25:38.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.202+0000 7f7deffff700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dd0066f60 0x7f7dd0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.203+0000 7f7deffff700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dd0066f60 0x7f7dd0069410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7df015d0a0 tx=0x7f7dd8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:38.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.206+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7df0155bd0 con 0x7f7ddc0051c0 2023-10-08T00:25:38.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.402+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7df0155bd0 con 0x7f7ddc0051c0 2023-10-08T00:25:38.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.403+0000 7f7decff9700 1 -- 172.21.15.22:0/838406078 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f7df0155bd0 con 0x7f7ddc0051c0 2023-10-08T00:25:38.403 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:38.403 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:37.106122+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.404+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dd0066f60 msgr2=0x7f7dd0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.404+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dd0066f60 0x7f7dd0069410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7df015d0a0 tx=0x7f7dd8007d30 comp rx=0 tx=0).stop 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.404+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 msgr2=0x7f7df013c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.404+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7df013c370 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7de8009fd0 tx=0x7f7de800b040 comp rx=0 tx=0).stop 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 shutdown_connections 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7dd0066f60 0x7f7dd0069410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7df00b2100 0x7f7df00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ddc0051c0 0x7f7df013c370 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 --2- 172.21.15.22:0/838406078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df00b3590 0x7f7df00b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 >> 172.21.15.22:0/838406078 conn(0x7f7df0068e20 msgr2=0x7f7df015d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:38.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 shutdown_connections 2023-10-08T00:25:38.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.405+0000 7f7df6eb3700 1 -- 172.21.15.22:0/838406078 wait complete. 2023-10-08T00:25:38.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:25:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.538+0000 7f815a0a7700 1 Processor -- start 2023-10-08T00:25:38.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.538+0000 7f815a0a7700 1 -- start start 2023-10-08T00:25:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f815a0a7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8154159890 0x7f815415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f815a0a7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8154159c60 0x7f815415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f815a0a7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815415a160 con 0x7f815415db10 2023-10-08T00:25:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f815a0a7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815415df50 con 0x7f8154159890 2023-10-08T00:25:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f815a0a7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540d13a0 con 0x7f8154159c60 2023-10-08T00:25:38.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f81537fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8154159890 0x7f815415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f8153fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f815415db10 0x7f8154069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50286/0 (socket says 172.21.15.22:50286) 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.539+0000 7f8153fff700 1 -- 172.21.15.22:0/500743026 learned_addr learned my addr 172.21.15.22:0/500743026 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f8152ffd700 1 --2- 172.21.15.22:0/500743026 >> v2:172.21.15.192:3300/0 conn(0x7f8154159c60 0x7f815415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81537fe700 1 -- 172.21.15.22:0/500743026 >> v2:172.21.15.192:3300/0 conn(0x7f8154159c60 msgr2=0x7f815415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81537fe700 1 --2- 172.21.15.22:0/500743026 >> v2:172.21.15.192:3300/0 conn(0x7f8154159c60 0x7f815415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81537fe700 1 -- 172.21.15.22:0/500743026 >> v1:172.21.15.22:6789/0 conn(0x7f815415db10 legacy=0x7f8154069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81527fc700 1 -- 172.21.15.22:0/500743026 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241086049 0 0) 0x7f815415a160 con 0x7f815415db10 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81537fe700 1 -- 172.21.15.22:0/500743026 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815415e140 con 0x7f8154159890 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81537fe700 1 --2- 172.21.15.22:0/500743026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8154159890 0x7f815415abd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f81540b67f0 tx=0x7f81440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e9ed92ec34b0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81527fc700 1 -- 172.21.15.22:0/500743026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400b6b0 con 0x7f8154159890 2023-10-08T00:25:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81527fc700 1 -- 172.21.15.22:0/500743026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814400b810 con 0x7f8154159890 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.540+0000 7f81527fc700 1 -- 172.21.15.22:0/500743026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400bbb0 con 0x7f8154159890 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 -- 172.21.15.22:0/500743026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8154159890 msgr2=0x7f815415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 --2- 172.21.15.22:0/500743026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8154159890 0x7f815415abd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f81540b67f0 tx=0x7f81440091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 -- 172.21.15.22:0/500743026 shutdown_connections 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 --2- 172.21.15.22:0/500743026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8154159890 0x7f815415abd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 --2- 172.21.15.22:0/500743026 >> v2:172.21.15.192:3300/0 conn(0x7f8154159c60 0x7f815415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 -- 172.21.15.22:0/500743026 >> 172.21.15.22:0/500743026 conn(0x7f8154068e20 msgr2=0x7f81540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 -- 172.21.15.22:0/500743026 shutdown_connections 2023-10-08T00:25:38.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.541+0000 7f815a0a7700 1 -- 172.21.15.22:0/500743026 wait complete. 2023-10-08T00:25:38.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.542+0000 7f815a0a7700 1 Processor -- start 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.542+0000 7f815a0a7700 1 -- start start 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154159890 0x7f8154151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8154159c60 0x7f81540b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 0x7f81540b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154152d50 con 0x7f815415db10 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540b4010 con 0x7f8154159890 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8154152270 con 0x7f8154159c60 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 0x7f81540b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 0x7f81540b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59680/0 (socket says 172.21.15.22:59680) 2023-10-08T00:25:38.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 -- 172.21.15.22:0/1497221311 learned_addr learned my addr 172.21.15.22:0/1497221311 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f81537fe700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154159890 0x7f8154151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8152ffd700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8154159c60 0x7f81540b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 -- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8154159c60 msgr2=0x7f81540b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8154159c60 0x7f81540b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 -- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154159890 msgr2=0x7f8154151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154159890 0x7f8154151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 -- 172.21.15.22:0/1497221311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144009420 con 0x7f815415db10 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f81537fe700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154159890 0x7f8154151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f8153fff700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 0x7f81540b3ad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f814c00cbf0 tx=0x7f814c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00a960 con 0x7f815415db10 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c00aac0 con 0x7f815415db10 2023-10-08T00:25:38.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00ae80 con 0x7f815415db10 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.543+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815416b380 con 0x7f815415db10 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.544+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154152a70 con 0x7f815415db10 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.545+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815416b510 con 0x7f815415db10 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.545+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f814c007300 con 0x7f815415db10 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.545+0000 7f813b7fe700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8140066f30 0x7f81400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.545+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f814c0848f0 con 0x7f815415db10 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.546+0000 7f81537fe700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8140066f30 0x7f81400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:38.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.546+0000 7f81537fe700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8140066f30 0x7f81400693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8144003080 tx=0x7f8144017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:38.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.550+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f814c051be0 con 0x7f815415db10 2023-10-08T00:25:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:38.794+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f815416b150 con 0x7f815415db10 2023-10-08T00:25:39.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.729+0000 7f813b7fe700 1 -- 172.21.15.22:0/1497221311 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f815416b150 con 0x7f815415db10 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8140066f30 msgr2=0x7f81400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8140066f30 0x7f81400693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8144003080 tx=0x7f8144017000 comp rx=0 tx=0).stop 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 msgr2=0x7f81540b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 0x7f81540b3ad0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f814c00cbf0 tx=0x7f814c0019b0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 shutdown_connections 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815415db10 0x7f81540b3ad0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8154159890 0x7f8154151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8140066f30 0x7f81400693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 --2- 172.21.15.22:0/1497221311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8154159c60 0x7f81540b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 >> 172.21.15.22:0/1497221311 conn(0x7f8154068e20 msgr2=0x7f81540b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 shutdown_connections 2023-10-08T00:25:39.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.732+0000 7f815a0a7700 1 -- 172.21.15.22:0/1497221311 wait complete. 2023-10-08T00:25:39.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:25:39.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.878+0000 7fdb26927700 1 Processor -- start 2023-10-08T00:25:39.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.878+0000 7fdb26927700 1 -- start start 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.879+0000 7fdb26927700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdb20159890 0x7fdb2015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.879+0000 7fdb26927700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb20159c60 0x7fdb2015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.879+0000 7fdb26927700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2015a160 con 0x7fdb2015db10 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.879+0000 7fdb26927700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb200d13a0 con 0x7fdb20159890 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.879+0000 7fdb26927700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2015e140 con 0x7fdb20159c60 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.879+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb20159c60 0x7fdb2015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdb20159890 0x7fdb2015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb24ec4700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdb2015db10 0x7fdb20069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49884/0 (socket says 172.21.15.22:49884) 2023-10-08T00:25:39.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdb20159890 0x7fdb2015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:57896/0 (socket says 172.21.15.22:57896) 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb24ec4700 1 -- 172.21.15.22:0/2469392946 learned_addr learned my addr 172.21.15.22:0/2469392946 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 -- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb20159c60 msgr2=0x7fdb2015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 --2- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb20159c60 0x7fdb2015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 -- 172.21.15.22:0/2469392946 >> v1:172.21.15.192:6789/0 conn(0x7fdb2015db10 legacy=0x7fdb20069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 -- 172.21.15.22:0/2469392946 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2015a3d0 con 0x7fdb20159890 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1f7fe700 1 --2- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb20159c60 0x7fdb2015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1effd700 1 -- 172.21.15.22:0/2469392946 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421839079 0 0) 0x7fdb2015a160 con 0x7fdb2015db10 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1ffff700 1 --2- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159890 0x7fdb2015abd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdb080098e0 tx=0x7fdb080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f610ce71bdfe6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1effd700 1 -- 172.21.15.22:0/2469392946 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800b640 con 0x7fdb20159890 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1effd700 1 -- 172.21.15.22:0/2469392946 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800b7a0 con 0x7fdb20159890 2023-10-08T00:25:39.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.880+0000 7fdb1effd700 1 -- 172.21.15.22:0/2469392946 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800bb40 con 0x7fdb20159890 2023-10-08T00:25:39.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 -- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159890 msgr2=0x7fdb2015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:39.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 --2- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159890 0x7fdb2015abd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdb080098e0 tx=0x7fdb080091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 -- 172.21.15.22:0/2469392946 shutdown_connections 2023-10-08T00:25:39.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 --2- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159890 0x7fdb2015abd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 --2- 172.21.15.22:0/2469392946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb20159c60 0x7fdb2015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 -- 172.21.15.22:0/2469392946 >> 172.21.15.22:0/2469392946 conn(0x7fdb20068e20 msgr2=0x7fdb200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 -- 172.21.15.22:0/2469392946 shutdown_connections 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.881+0000 7fdb26927700 1 -- 172.21.15.22:0/2469392946 wait complete. 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.882+0000 7fdb26927700 1 Processor -- start 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.882+0000 7fdb26927700 1 -- start start 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb26927700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 0x7fdb200b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb26927700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159c60 0x7fdb200b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb26927700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb2015db10 0x7fdb2016f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb26927700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201713f0 con 0x7fdb20159890 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb26927700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb200c9340 con 0x7fdb20159c60 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb26927700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb200c8a10 con 0x7fdb2015db10 2023-10-08T00:25:39.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 0x7fdb200b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 0x7fdb200b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59682/0 (socket says 172.21.15.22:59682) 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 -- 172.21.15.22:0/117768778 learned_addr learned my addr 172.21.15.22:0/117768778 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1f7fe700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159c60 0x7fdb200b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb24ec4700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb2015db10 0x7fdb2016f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 -- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb2015db10 msgr2=0x7fdb2016f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb2015db10 0x7fdb2016f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 -- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159c60 msgr2=0x7fdb200b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159c60 0x7fdb200b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb1ffff700 1 -- 172.21.15.22:0/117768778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10009420 con 0x7fdb20159890 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.883+0000 7fdb24ec4700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb2015db10 0x7fdb2016f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.884+0000 7fdb1ffff700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 0x7fdb200b3910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdb200899c0 tx=0x7fdb08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:39.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.884+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08000d10 con 0x7fdb20159890 2023-10-08T00:25:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.884+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800bb20 con 0x7fdb20159890 2023-10-08T00:25:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.884+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08011650 con 0x7fdb20159890 2023-10-08T00:25:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.884+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb08009420 con 0x7fdb20159890 2023-10-08T00:25:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.884+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb200c8fd0 con 0x7fdb20159890 2023-10-08T00:25:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.885+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2004c3c0 con 0x7fdb20159890 2023-10-08T00:25:39.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.885+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb08011a00 con 0x7fdb20159890 2023-10-08T00:25:39.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.886+0000 7fdb17fff700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:39.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.886+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb08085c00 con 0x7fdb20159890 2023-10-08T00:25:39.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.886+0000 7fdb1f7fe700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:39.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.886+0000 7fdb1f7fe700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb2016bbd0 tx=0x7fdb100091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:39.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:39.890+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb08052dd0 con 0x7fdb20159890 2023-10-08T00:25:40.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.130+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdb2006a5b0 con 0x7fdb20159890 2023-10-08T00:25:40.680 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:25:40.680+0000 7f72b0d7d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:25:40.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.734+0000 7fdb17fff700 1 -- 172.21.15.22:0/117768778 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb080150c0 con 0x7fdb20159890 2023-10-08T00:25:40.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb00066f30 msgr2=0x7fdb000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb2016bbd0 tx=0x7fdb100091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 msgr2=0x7fdb200b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 0x7fdb200b3910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdb200899c0 tx=0x7fdb08017000 comp rx=0 tx=0).stop 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 shutdown_connections 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb2015db10 0x7fdb2016f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb20159890 0x7fdb200b3910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 --2- 172.21.15.22:0/117768778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb20159c60 0x7fdb200b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 >> 172.21.15.22:0/117768778 conn(0x7fdb20068e20 msgr2=0x7fdb200b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 shutdown_connections 2023-10-08T00:25:40.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.737+0000 7fdb26927700 1 -- 172.21.15.22:0/117768778 wait complete. 2023-10-08T00:25:40.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.873+0000 7fb42dfd9700 1 Processor -- start 2023-10-08T00:25:40.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.873+0000 7fb42dfd9700 1 -- start start 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb42dfd9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb42806c0a0 0x7fb4280caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb42dfd9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42815df50 0x7fb42815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb42dfd9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42815d7e0 con 0x7fb42806bcd0 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb42dfd9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42815dac0 con 0x7fb42806c0a0 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb42dfd9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42815aa30 con 0x7fb42815df50 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb42806c0a0 0x7fb4280caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb42806c0a0 0x7fb4280caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59684/0 (socket says 172.21.15.22:59684) 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 -- 172.21.15.22:0/3209126685 learned_addr learned my addr 172.21.15.22:0/3209126685 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb427fff700 1 --2- 172.21.15.22:0/3209126685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42815df50 0x7fb42815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 -- 172.21.15.22:0/3209126685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42815df50 msgr2=0x7fb42815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 --2- 172.21.15.22:0/3209126685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42815df50 0x7fb42815e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 -- 172.21.15.22:0/3209126685 >> v1:172.21.15.192:6789/0 conn(0x7fb42806bcd0 legacy=0x7fb42815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 -- 172.21.15.22:0/3209126685 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42815ad10 con 0x7fb42806c0a0 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.874+0000 7fb426ffd700 1 --2- 172.21.15.22:0/3209126685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42806c0a0 0x7fb4280caa90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0099b0 tx=0x7fb41c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4615ecd57c320 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb4267fc700 1 -- 172.21.15.22:0/3209126685 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c00b820 con 0x7fb42806c0a0 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb4267fc700 1 -- 172.21.15.22:0/3209126685 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c00b980 con 0x7fb42806c0a0 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb4267fc700 1 -- 172.21.15.22:0/3209126685 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c00bd40 con 0x7fb42806c0a0 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3209126685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42806c0a0 msgr2=0x7fb4280caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3209126685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42806c0a0 0x7fb4280caa90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0099b0 tx=0x7fb41c009250 comp rx=0 tx=0).stop 2023-10-08T00:25:40.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3209126685 shutdown_connections 2023-10-08T00:25:40.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3209126685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42815df50 0x7fb42815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3209126685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42806c0a0 0x7fb4280caa90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3209126685 >> 172.21.15.22:0/3209126685 conn(0x7fb4280ce600 msgr2=0x7fb4280cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:40.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3209126685 shutdown_connections 2023-10-08T00:25:40.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.875+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3209126685 wait complete. 2023-10-08T00:25:40.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.876+0000 7fb42dfd9700 1 Processor -- start 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.876+0000 7fb42dfd9700 1 -- start start 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb42dfd9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42806bcd0 0x7fb4280c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb42dfd9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42806c0a0 0x7fb428154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb42dfd9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 0x7fb42816a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb42dfd9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281559c0 con 0x7fb42815df50 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb42dfd9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280c5bf0 con 0x7fb42806c0a0 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb42dfd9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280b2830 con 0x7fb42806bcd0 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb427fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 0x7fb42816a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb427fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 0x7fb42816a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59686/0 (socket says 172.21.15.22:59686) 2023-10-08T00:25:40.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb427fff700 1 -- 172.21.15.22:0/3113902995 learned_addr learned my addr 172.21.15.22:0/3113902995 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb426ffd700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42806c0a0 0x7fb428154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.877+0000 7fb4277fe700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42806bcd0 0x7fb4280c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb427fff700 1 -- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42806bcd0 msgr2=0x7fb4280c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb427fff700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42806bcd0 0x7fb4280c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb427fff700 1 -- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42806c0a0 msgr2=0x7fb428154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb427fff700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42806c0a0 0x7fb428154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb427fff700 1 -- 172.21.15.22:0/3113902995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c0094f0 con 0x7fb42815df50 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb427fff700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 0x7fb42816a960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb42000cee0 tx=0x7fb420007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000ad50 con 0x7fb42815df50 2023-10-08T00:25:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb420016430 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4280c5e20 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4200167d0 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.878+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4280b24c0 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.879+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4280c6440 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.879+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb420003020 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.880+0000 7fb40f7fe700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb414066f30 0x7fb4140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.880+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb420012070 con 0x7fb42815df50 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.880+0000 7fb4277fe700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb414066f30 0x7fb4140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.880+0000 7fb4277fe700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb414066f30 0x7fb4140693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4280c4c90 tx=0x7fb418009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:40.884+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb420052570 con 0x7fb42815df50 2023-10-08T00:25:41.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.120+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb42804c3c0 con 0x7fb42815df50 2023-10-08T00:25:41.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.120+0000 7fb40f7fe700 1 -- 172.21.15.22:0/3113902995 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fb420055b90 con 0x7fb42815df50 2023-10-08T00:25:41.121 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:41.121 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1890171180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1890171180},{"type":"v1","addr":"172.21.15.192:6836","nonce":1890171180}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:37.106452+0000","modified":"2023-10-08T00:25:40.729415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/685646696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":685646696},{"type":"v1","addr":"172.21.15.22:6834","nonce":685646696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb414066f30 msgr2=0x7fb4140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb414066f30 0x7fb4140693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4280c4c90 tx=0x7fb418009060 comp rx=0 tx=0).stop 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 msgr2=0x7fb42816a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 0x7fb42816a960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb42000cee0 tx=0x7fb420007870 comp rx=0 tx=0).stop 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 shutdown_connections 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb42815df50 0x7fb42816a960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb414066f30 0x7fb4140693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb42806bcd0 0x7fb4280c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 --2- 172.21.15.22:0/3113902995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb42806c0a0 0x7fb428154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 >> 172.21.15.22:0/3113902995 conn(0x7fb4280ce600 msgr2=0x7fb4280c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 shutdown_connections 2023-10-08T00:25:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.122+0000 7fb42dfd9700 1 -- 172.21.15.22:0/3113902995 wait complete. 2023-10-08T00:25:41.124 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2023-10-08T00:25:41.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:25:41.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.253+0000 7f48f6378700 1 Processor -- start 2023-10-08T00:25:41.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.253+0000 7f48f6378700 1 -- start start 2023-10-08T00:25:41.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48f6378700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f48f006c0a0 0x7f48f00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48f6378700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f015e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48f6378700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f015d7e0 con 0x7f48f006bcd0 2023-10-08T00:25:41.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48f6378700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f015dac0 con 0x7f48f006c0a0 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48f6378700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f015aa30 con 0x7f48f015df50 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48ef7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f48f006c0a0 0x7f48f00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48effff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f48f006bcd0 0x7f48f015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50294/0 (socket says 172.21.15.22:50294) 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.254+0000 7f48effff700 1 -- 172.21.15.22:0/3406973923 learned_addr learned my addr 172.21.15.22:0/3406973923 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48ef7fe700 1 -- 172.21.15.22:0/3406973923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 msgr2=0x7f48f015e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48f4915700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f015e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48ef7fe700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f015e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48ef7fe700 1 -- 172.21.15.22:0/3406973923 >> v1:172.21.15.22:6789/0 conn(0x7f48f006bcd0 legacy=0x7f48f015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48eeffd700 1 -- 172.21.15.22:0/3406973923 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825330016 0 0) 0x7f48f015d7e0 con 0x7f48f006bcd0 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48ef7fe700 1 -- 172.21.15.22:0/3406973923 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f015ad10 con 0x7f48f006c0a0 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48f4915700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48ef7fe700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f00caa90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f48e00098e0 tx=0x7f48e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a9768692a6e066 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48eeffd700 1 -- 172.21.15.22:0/3406973923 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0009e80 con 0x7f48f006c0a0 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48eeffd700 1 -- 172.21.15.22:0/3406973923 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e000b860 con 0x7f48f006c0a0 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.255+0000 7f48eeffd700 1 -- 172.21.15.22:0/3406973923 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e000bbe0 con 0x7f48f006c0a0 2023-10-08T00:25:41.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 -- 172.21.15.22:0/3406973923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 msgr2=0x7f48f00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f00caa90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f48e00098e0 tx=0x7f48e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 -- 172.21.15.22:0/3406973923 shutdown_connections 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f015e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 --2- 172.21.15.22:0/3406973923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f00caa90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 -- 172.21.15.22:0/3406973923 >> 172.21.15.22:0/3406973923 conn(0x7f48f00ce600 msgr2=0x7f48f00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 -- 172.21.15.22:0/3406973923 shutdown_connections 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.256+0000 7f48f6378700 1 -- 172.21.15.22:0/3406973923 wait complete. 2023-10-08T00:25:41.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.257+0000 7f48f6378700 1 Processor -- start 2023-10-08T00:25:41.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.257+0000 7f48f6378700 1 -- start start 2023-10-08T00:25:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48f006bcd0 0x7f48f0155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f0069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f00699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00b1840 con 0x7f48f006c0a0 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c6190 con 0x7f48f006bcd0 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f00c6470 con 0x7f48f015df50 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f0069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f0069480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59706/0 (socket says 172.21.15.22:59706) 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 -- 172.21.15.22:0/520631875 learned_addr learned my addr 172.21.15.22:0/520631875 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f4915700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f00699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48effff700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48f006bcd0 0x7f48f0155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 -- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 msgr2=0x7f48f00699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f00699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 -- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48f006bcd0 msgr2=0x7f48f0155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48f006bcd0 0x7f48f0155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 -- 172.21.15.22:0/520631875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e0009420 con 0x7f48f006c0a0 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48ef7fe700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f0069480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b3c0 tx=0x7f48e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0011420 con 0x7f48f006c0a0 2023-10-08T00:25:41.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e00115c0 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00b14d0 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.258+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0011980 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.259+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f00b4170 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.259+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f00b19b0 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.260+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48e00253f0 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.260+0000 7f48d7fff700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48dc066f30 0x7f48dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.260+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48e0085e20 con 0x7f48f006c0a0 2023-10-08T00:25:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.260+0000 7f48effff700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48dc066f30 0x7f48dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.261+0000 7f48effff700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48dc066f30 0x7f48dc0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f48e400c8f0 tx=0x7f48e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.264+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48e0053090 con 0x7f48f006c0a0 2023-10-08T00:25:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.459+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48f004c3c0 con 0x7f48f006c0a0 2023-10-08T00:25:41.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.460+0000 7f48d7fff700 1 -- 172.21.15.22:0/520631875 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f48e00566b0 con 0x7f48f006c0a0 2023-10-08T00:25:41.460 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:41.460 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":32,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:38.697078+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48dc066f30 msgr2=0x7f48dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48dc066f30 0x7f48dc0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f48e400c8f0 tx=0x7f48e4009040 comp rx=0 tx=0).stop 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 msgr2=0x7f48f0069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f0069480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f48e000b3c0 tx=0x7f48e0017000 comp rx=0 tx=0).stop 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 shutdown_connections 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48dc066f30 0x7f48dc0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f48f015df50 0x7f48f00699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48f006bcd0 0x7f48f0155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 --2- 172.21.15.22:0/520631875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f006c0a0 0x7f48f0069480 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 >> 172.21.15.22:0/520631875 conn(0x7f48f00ce600 msgr2=0x7f48f015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 shutdown_connections 2023-10-08T00:25:41.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.462+0000 7f48f6378700 1 -- 172.21.15.22:0/520631875 wait complete. 2023-10-08T00:25:41.475 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:25:41.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.593+0000 7ff4b8ac2700 1 Processor -- start 2023-10-08T00:25:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.593+0000 7ff4b8ac2700 1 -- start start 2023-10-08T00:25:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.594+0000 7ff4b8ac2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4b4159c10 0x7ff4b415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.594+0000 7ff4b8ac2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4b40b5ea0 0x7ff4b4068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.594+0000 7ff4b8ac2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b415c480 con 0x7ff4b4068bb0 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.594+0000 7ff4b8ac2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40b2a40 con 0x7ff4b4159c10 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.594+0000 7ff4b8ac2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b415b5d0 con 0x7ff4b40b5ea0 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4b4159c10 0x7ff4b415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4b4159c10 0x7ff4b415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59712/0 (socket says 172.21.15.22:59712) 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 -- 172.21.15.22:0/1509930683 learned_addr learned my addr 172.21.15.22:0/1509930683 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b1d9b700 1 --2- 172.21.15.22:0/1509930683 >> v2:172.21.15.192:3300/0 conn(0x7ff4b40b5ea0 0x7ff4b4068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 -- 172.21.15.22:0/1509930683 >> v2:172.21.15.192:3300/0 conn(0x7ff4b40b5ea0 msgr2=0x7ff4b4068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 --2- 172.21.15.22:0/1509930683 >> v2:172.21.15.192:3300/0 conn(0x7ff4b40b5ea0 0x7ff4b4068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 -- 172.21.15.22:0/1509930683 >> v1:172.21.15.192:6789/0 conn(0x7ff4b4068bb0 legacy=0x7ff4b415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 -- 172.21.15.22:0/1509930683 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b415b870 con 0x7ff4b4159c10 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b1d9b700 1 --2- 172.21.15.22:0/1509930683 >> v2:172.21.15.192:3300/0 conn(0x7ff4b40b5ea0 0x7ff4b4068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b259c700 1 --2- 172.21.15.22:0/1509930683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b415b090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4b409a150 tx=0x7ff4a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4567fc18c610b65f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b159a700 1 -- 172.21.15.22:0/1509930683 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400e070 con 0x7ff4b4159c10 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b159a700 1 -- 172.21.15.22:0/1509930683 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400ba50 con 0x7ff4b4159c10 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.595+0000 7ff4b159a700 1 -- 172.21.15.22:0/1509930683 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40092e0 con 0x7ff4b4159c10 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/1509930683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 msgr2=0x7ff4b415b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/1509930683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b415b090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff4b409a150 tx=0x7ff4a4009840 comp rx=0 tx=0).stop 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/1509930683 shutdown_connections 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/1509930683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b415b090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/1509930683 >> v2:172.21.15.192:3300/0 conn(0x7ff4b40b5ea0 0x7ff4b4068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/1509930683 >> 172.21.15.22:0/1509930683 conn(0x7ff4b4099a20 msgr2=0x7ff4b40af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/1509930683 shutdown_connections 2023-10-08T00:25:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.596+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/1509930683 wait complete. 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.597+0000 7ff4b8ac2700 1 Processor -- start 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.597+0000 7ff4b8ac2700 1 -- start start 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b8ac2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b4068bb0 0x7ff4b415ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b8ac2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4b40b5ea0 0x7ff4b409cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b8ac2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b4143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b8ac2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40b15b0 con 0x7ff4b4159c10 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b8ac2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41548b0 con 0x7ff4b4068bb0 2023-10-08T00:25:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b8ac2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40b0930 con 0x7ff4b40b5ea0 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b4143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b4143420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59720/0 (socket says 172.21.15.22:59720) 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 -- 172.21.15.22:0/3574117947 learned_addr learned my addr 172.21.15.22:0/3574117947 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b1d9b700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4b40b5ea0 0x7ff4b409cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b259c700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b4068bb0 0x7ff4b415ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 -- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4b40b5ea0 msgr2=0x7ff4b409cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4b40b5ea0 0x7ff4b409cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 -- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b4068bb0 msgr2=0x7ff4b415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b4068bb0 0x7ff4b415ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 -- 172.21.15.22:0/3574117947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009ae0 con 0x7ff4b4159c10 2023-10-08T00:25:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4b2d9d700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b4143420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c560 tx=0x7ff4ac007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.598+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011590 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.599+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0116f0 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.599+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac011ab0 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.599+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b40b0c10 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.599+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40b11d0 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.600+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b40b16f0 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.600+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4ac01b3b0 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.600+0000 7ff4aa7fc700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.601+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4ac083a30 con 0x7ff4b4159c10 2023-10-08T00:25:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.601+0000 7ff4b259c700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.601+0000 7ff4b259c700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff494066f30 0x7ff4940693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009880 tx=0x7ff4a4018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.605+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4ac050ca0 con 0x7ff4b4159c10 2023-10-08T00:25:41.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.792+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4b404c3c0 con 0x7ff494066f30 2023-10-08T00:25:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.799+0000 7ff4aa7fc700 1 -- 172.21.15.22:0/3574117947 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249921 (secure 0 0 0) 0x7ff4b404c3c0 con 0x7ff494066f30 2023-10-08T00:25:41.803 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.802+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff494066f30 msgr2=0x7ff4940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.802+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff494066f30 0x7ff4940693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009880 tx=0x7ff4a4018000 comp rx=0 tx=0).stop 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.802+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 msgr2=0x7ff4b4143420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.802+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b4143420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c560 tx=0x7ff4ac007ef0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.802+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 shutdown_connections 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.802+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4b4159c10 0x7ff4b4143420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.803+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b4068bb0 0x7ff4b415ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.803+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.803+0000 7ff4b8ac2700 1 --2- 172.21.15.22:0/3574117947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff4b40b5ea0 0x7ff4b409cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.803+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 >> 172.21.15.22:0/3574117947 conn(0x7ff4b4099a20 msgr2=0x7ff4b4158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:41.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.803+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 shutdown_connections 2023-10-08T00:25:41.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.803+0000 7ff4b8ac2700 1 -- 172.21.15.22:0/3574117947 wait complete. 2023-10-08T00:25:41.806 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:41.815 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-08T00:25:40.393965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381896,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592824,"statfs":{"total":773094113280,"available":770655051776,"internally_reserved":0,"allocated":3678208,"data_stored":2086832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.702561"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-08T00:25:28.746572+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:25:28.746572+0000","last_peered":"2023-10-08T00:25:28.746572+0000","last_clean":"2023-10-08T00:25:28.746572+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:25:28.746572+0000","last_undegraded":"2023-10-08T00:25:28.746572+0000","last_fullsized":"2023-10-08T00:25:28.746572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":703630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":703630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:41.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:41.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.975+0000 7f6f0a25b700 1 Processor -- start 2023-10-08T00:25:41.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.975+0000 7f6f0a25b700 1 -- start start 2023-10-08T00:25:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f0a25b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 0x7f6f04068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f0a25b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6f04068bb0 0x7f6f0415c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f0a25b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0415c480 con 0x7f6f04159c10 2023-10-08T00:25:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f0a25b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f040b2a40 con 0x7f6f04068bb0 2023-10-08T00:25:41.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f0a25b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0415b870 con 0x7f6f040b5ea0 2023-10-08T00:25:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f02ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 0x7f6f04068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f03fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6f04068bb0 0x7f6f0415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f02ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 0x7f6f04068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:37386/0 (socket says 172.21.15.22:37386) 2023-10-08T00:25:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f02ffd700 1 -- 172.21.15.22:0/3400119019 learned_addr learned my addr 172.21.15.22:0/3400119019 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.976+0000 7f6f037fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6f04159c10 0x7f6f0415b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49918/0 (socket says 172.21.15.22:49918) 2023-10-08T00:25:41.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f027fc700 1 -- 172.21.15.22:0/3400119019 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859143887 0 0) 0x7f6f0415c480 con 0x7f6f04159c10 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f02ffd700 1 -- 172.21.15.22:0/3400119019 >> v2:172.21.15.192:3300/0 conn(0x7f6f04068bb0 msgr2=0x7f6f0415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f02ffd700 1 --2- 172.21.15.22:0/3400119019 >> v2:172.21.15.192:3300/0 conn(0x7f6f04068bb0 0x7f6f0415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f02ffd700 1 -- 172.21.15.22:0/3400119019 >> v1:172.21.15.192:6789/0 conn(0x7f6f04159c10 legacy=0x7f6f0415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f02ffd700 1 -- 172.21.15.22:0/3400119019 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0415bb50 con 0x7f6f040b5ea0 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f02ffd700 1 --2- 172.21.15.22:0/3400119019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 0x7f6f04068670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0099e0 tx=0x7f6eec009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4513c4039505c0f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f027fc700 1 -- 172.21.15.22:0/3400119019 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00b820 con 0x7f6f040b5ea0 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f027fc700 1 -- 172.21.15.22:0/3400119019 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00b980 con 0x7f6f040b5ea0 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.977+0000 7f6f027fc700 1 -- 172.21.15.22:0/3400119019 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00bd20 con 0x7f6f040b5ea0 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 -- 172.21.15.22:0/3400119019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 msgr2=0x7f6f04068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/3400119019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 0x7f6f04068670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0099e0 tx=0x7f6eec009250 comp rx=0 tx=0).stop 2023-10-08T00:25:41.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 -- 172.21.15.22:0/3400119019 shutdown_connections 2023-10-08T00:25:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/3400119019 >> v2:172.21.15.192:3300/0 conn(0x7f6f04068bb0 0x7f6f0415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/3400119019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f040b5ea0 0x7f6f04068670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 -- 172.21.15.22:0/3400119019 >> 172.21.15.22:0/3400119019 conn(0x7f6f04099a20 msgr2=0x7f6f040af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 -- 172.21.15.22:0/3400119019 shutdown_connections 2023-10-08T00:25:41.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.978+0000 7f6f0a25b700 1 -- 172.21.15.22:0/3400119019 wait complete. 2023-10-08T00:25:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.979+0000 7f6f0a25b700 1 Processor -- start 2023-10-08T00:25:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.979+0000 7f6f0a25b700 1 -- start start 2023-10-08T00:25:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f0a25b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f04068bb0 0x7f6f040af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f0a25b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 0x7f6f0415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f0a25b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f04159c10 0x7f6f041405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f0a25b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0416af80 con 0x7f6f040b5ea0 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f0a25b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0416b220 con 0x7f6f04068bb0 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f0a25b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0416b500 con 0x7f6f04159c10 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 0x7f6f0415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 0x7f6f0415d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59722/0 (socket says 172.21.15.22:59722) 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 -- 172.21.15.22:0/733891075 learned_addr learned my addr 172.21.15.22:0/733891075 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f037fe700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f04068bb0 0x7f6f040af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f03fff700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f04159c10 0x7f6f041405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 -- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f04159c10 msgr2=0x7f6f041405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f04159c10 0x7f6f041405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 -- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f04068bb0 msgr2=0x7f6f040af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:41.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f04068bb0 0x7f6f040af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 -- 172.21.15.22:0/733891075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0094f0 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6f02ffd700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 0x7f6f0415d320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6f0415b9b0 tx=0x7f6eec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.980+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec011d70 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.981+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec024440 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.981+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec024800 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.981+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0416b7e0 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.981+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0416bda0 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.982+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0416bf90 con 0x7f6f040b5ea0 2023-10-08T00:25:41.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.982+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eec02d440 con 0x7f6f040b5ea0 2023-10-08T00:25:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.982+0000 7f6efb7fe700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ee4066f30 0x7f6ee40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.982+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6eec085dc0 con 0x7f6f040b5ea0 2023-10-08T00:25:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.983+0000 7f6f037fe700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ee4066f30 0x7f6ee40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:41.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.983+0000 7f6f037fe700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ee4066f30 0x7f6ee40693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f0409e050 tx=0x7f6ef4007ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:41.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:41.987+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eec053030 con 0x7f6f040b5ea0 2023-10-08T00:25:42.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.178+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f0404c3c0 con 0x7f6ee4066f30 2023-10-08T00:25:42.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.185+0000 7f6efb7fe700 1 -- 172.21.15.22:0/733891075 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249921 (secure 0 0 0) 0x7f6f0404c3c0 con 0x7f6ee4066f30 2023-10-08T00:25:42.188 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:42.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ee4066f30 msgr2=0x7f6ee40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ee4066f30 0x7f6ee40693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f0409e050 tx=0x7f6ef4007ef0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 msgr2=0x7f6f0415d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 0x7f6f0415d320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6f0415b9b0 tx=0x7f6eec017000 comp rx=0 tx=0).stop 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 shutdown_connections 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ee4066f30 0x7f6ee40693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f04159c10 0x7f6f041405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f04068bb0 0x7f6f040af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 --2- 172.21.15.22:0/733891075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f040b5ea0 0x7f6f0415d320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 >> 172.21.15.22:0/733891075 conn(0x7f6f04099a20 msgr2=0x7f6f040b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 shutdown_connections 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.188+0000 7f6f0a25b700 1 -- 172.21.15.22:0/733891075 wait complete. 2023-10-08T00:25:42.191 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:42.201 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-10-08T00:25:40.393965+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2381896,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592824,"statfs":{"total":773094113280,"available":770655051776,"internally_reserved":0,"allocated":3678208,"data_stored":2086832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.702561"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:36.691278+0000","last_change":"2023-10-08T00:25:36.691278+0000","last_active":"2023-10-08T00:25:36.691278+0000","last_peered":"2023-10-08T00:25:36.691278+0000","last_clean":"2023-10-08T00:25:36.691278+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:36.691278+0000","last_undegraded":"2023-10-08T00:25:36.691278+0000","last_fullsized":"2023-10-08T00:25:36.691278+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:25:35.684969+0000","last_change":"2023-10-08T00:25:35.684969+0000","last_active":"2023-10-08T00:25:35.684969+0000","last_peered":"2023-10-08T00:25:35.684969+0000","last_clean":"2023-10-08T00:25:35.684969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:25:35.684969+0000","last_undegraded":"2023-10-08T00:25:35.684969+0000","last_fullsized":"2023-10-08T00:25:35.684969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-08T00:25:28.746572+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:25:28.746572+0000","last_peered":"2023-10-08T00:25:28.746572+0000","last_clean":"2023-10-08T00:25:28.746572+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:25:28.746572+0000","last_undegraded":"2023-10-08T00:25:28.746572+0000","last_fullsized":"2023-10-08T00:25:28.746572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":703630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":703630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:42.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:42.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.360+0000 7f47772b8700 1 Processor -- start 2023-10-08T00:25:42.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.360+0000 7f47772b8700 1 -- start start 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47772b8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4770142ea0 0x7f47700b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47772b8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47700ad870 0x7f477006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47772b8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700b40f0 con 0x7f47700b3b70 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47772b8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4770069640 con 0x7f47700ad870 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47772b8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4770069920 con 0x7f4770142ea0 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4775ab5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47700ad870 0x7f477006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4776ab7700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f47700b3b70 0x7f477006cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50302/0 (socket says 172.21.15.22:50302) 2023-10-08T00:25:42.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4776ab7700 1 -- 172.21.15.22:0/1611486028 learned_addr learned my addr 172.21.15.22:0/1611486028 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4775ab5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47700ad870 0x7f477006b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59726/0 (socket says 172.21.15.22:59726) 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47762b6700 1 --2- 172.21.15.22:0/1611486028 >> v2:172.21.15.192:3300/0 conn(0x7f4770142ea0 0x7f47700b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4775ab5700 1 -- 172.21.15.22:0/1611486028 >> v2:172.21.15.192:3300/0 conn(0x7f4770142ea0 msgr2=0x7f47700b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4775ab5700 1 --2- 172.21.15.22:0/1611486028 >> v2:172.21.15.192:3300/0 conn(0x7f4770142ea0 0x7f47700b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4775ab5700 1 -- 172.21.15.22:0/1611486028 >> v1:172.21.15.22:6789/0 conn(0x7f47700b3b70 legacy=0x7f477006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f47752b4700 1 -- 172.21.15.22:0/1611486028 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462605853 0 0) 0x7f47700b40f0 con 0x7f47700b3b70 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.361+0000 7f4775ab5700 1 -- 172.21.15.22:0/1611486028 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4770069c00 con 0x7f47700ad870 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f4775ab5700 1 --2- 172.21.15.22:0/1611486028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47700ad870 0x7f477006b9e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4770071240 tx=0x7f47600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab69604a78c4980 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47752b4700 1 -- 172.21.15.22:0/1611486028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000b6b0 con 0x7f47700ad870 2023-10-08T00:25:42.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47752b4700 1 -- 172.21.15.22:0/1611486028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476000b810 con 0x7f47700ad870 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47752b4700 1 -- 172.21.15.22:0/1611486028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000bbb0 con 0x7f47700ad870 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 -- 172.21.15.22:0/1611486028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47700ad870 msgr2=0x7f477006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 --2- 172.21.15.22:0/1611486028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47700ad870 0x7f477006b9e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4770071240 tx=0x7f47600091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 -- 172.21.15.22:0/1611486028 shutdown_connections 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 --2- 172.21.15.22:0/1611486028 >> v2:172.21.15.192:3300/0 conn(0x7f4770142ea0 0x7f47700b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 --2- 172.21.15.22:0/1611486028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47700ad870 0x7f477006b9e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 -- 172.21.15.22:0/1611486028 >> 172.21.15.22:0/1611486028 conn(0x7f47700ce430 msgr2=0x7f47700ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 -- 172.21.15.22:0/1611486028 shutdown_connections 2023-10-08T00:25:42.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.362+0000 7f47772b8700 1 -- 172.21.15.22:0/1611486028 wait complete. 2023-10-08T00:25:42.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 Processor -- start 2023-10-08T00:25:42.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 -- start start 2023-10-08T00:25:42.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47700b3b70 0x7f4770169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 0x7f47700c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47700cc590 0x7f47700cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770169550 con 0x7f4770142ea0 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4770169ab0 con 0x7f47700cc590 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f47772b8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47700ccf50 con 0x7f47700b3b70 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f4775ab5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 0x7f47700c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f4775ab5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 0x7f47700c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59732/0 (socket says 172.21.15.22:59732) 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.364+0000 7f4775ab5700 1 -- 172.21.15.22:0/1238808482 learned_addr learned my addr 172.21.15.22:0/1238808482 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4776ab7700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47700cc590 0x7f47700cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f47762b6700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47700b3b70 0x7f4770169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4775ab5700 1 -- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47700b3b70 msgr2=0x7f4770169f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4775ab5700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47700b3b70 0x7f4770169f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4775ab5700 1 -- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47700cc590 msgr2=0x7f47700cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4775ab5700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47700cc590 0x7f47700cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4775ab5700 1 -- 172.21.15.22:0/1238808482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760009420 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f4775ab5700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 0x7f47700c75e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f477006f0d0 tx=0x7f4760017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760011420 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4760011580 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477016a480 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760011940 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.365+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47700c7eb0 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.366+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4770169c40 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.366+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4760011d30 con 0x7f4770142ea0 2023-10-08T00:25:42.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.367+0000 7f47667fc700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4754066f30 0x7f47540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.367+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4760085f50 con 0x7f4770142ea0 2023-10-08T00:25:42.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.367+0000 7f47762b6700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4754066f30 0x7f47540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.368+0000 7f47762b6700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4754066f30 0x7f47540693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f476c006fd0 tx=0x7f476c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:42.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.371+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47600531c0 con 0x7f4770142ea0 2023-10-08T00:25:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.562+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f477004c3c0 con 0x7f4754066f30 2023-10-08T00:25:42.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.570+0000 7f47667fc700 1 -- 172.21.15.22:0/1238808482 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264593 (secure 0 0 0) 0x7f477004c3c0 con 0x7f4754066f30 2023-10-08T00:25:42.573 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:42.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4754066f30 msgr2=0x7f47540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4754066f30 0x7f47540693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f476c006fd0 tx=0x7f476c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 msgr2=0x7f47700c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 0x7f47700c75e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f477006f0d0 tx=0x7f4760017000 comp rx=0 tx=0).stop 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 shutdown_connections 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47700cc590 0x7f47700cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4754066f30 0x7f47540693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47700b3b70 0x7f4770169f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 --2- 172.21.15.22:0/1238808482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4770142ea0 0x7f47700c75e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 >> 172.21.15.22:0/1238808482 conn(0x7f47700ce430 msgr2=0x7f4770141f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 shutdown_connections 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.573+0000 7f47772b8700 1 -- 172.21.15.22:0/1238808482 wait complete. 2023-10-08T00:25:42.576 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:42.585 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-08T00:25:42.394331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382332,"kb_used_data":4028,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592388,"statfs":{"total":773094113280,"available":770654605312,"internally_reserved":0,"allocated":4124672,"data_stored":2286044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724742+0000","last_change":"2023-10-08T00:25:37.720558+0000","last_active":"2023-10-08T00:25:37.724742+0000","last_peered":"2023-10-08T00:25:37.724742+0000","last_clean":"2023-10-08T00:25:37.724742+0000","last_became_active":"2023-10-08T00:25:37.720097+0000","last_became_peered":"2023-10-08T00:25:37.720097+0000","last_unstale":"2023-10-08T00:25:37.724742+0000","last_undegraded":"2023-10-08T00:25:37.724742+0000","last_fullsized":"2023-10-08T00:25:37.724742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:28.929571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726161+0000","last_change":"2023-10-08T00:25:37.716993+0000","last_active":"2023-10-08T00:25:37.726161+0000","last_peered":"2023-10-08T00:25:37.726161+0000","last_clean":"2023-10-08T00:25:37.726161+0000","last_became_active":"2023-10-08T00:25:37.716701+0000","last_became_peered":"2023-10-08T00:25:37.716701+0000","last_unstale":"2023-10-08T00:25:37.726161+0000","last_undegraded":"2023-10-08T00:25:37.726161+0000","last_fullsized":"2023-10-08T00:25:37.726161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728107+0000","last_change":"2023-10-08T00:25:37.719808+0000","last_active":"2023-10-08T00:25:37.728107+0000","last_peered":"2023-10-08T00:25:37.728107+0000","last_clean":"2023-10-08T00:25:37.728107+0000","last_became_active":"2023-10-08T00:25:37.719535+0000","last_became_peered":"2023-10-08T00:25:37.719535+0000","last_unstale":"2023-10-08T00:25:37.728107+0000","last_undegraded":"2023-10-08T00:25:37.728107+0000","last_fullsized":"2023-10-08T00:25:37.728107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.716079+0000","last_change":"2023-10-08T00:25:37.706709+0000","last_active":"2023-10-08T00:25:37.716079+0000","last_peered":"2023-10-08T00:25:37.716079+0000","last_clean":"2023-10-08T00:25:37.716079+0000","last_became_active":"2023-10-08T00:25:37.706370+0000","last_became_peered":"2023-10-08T00:25:37.706370+0000","last_unstale":"2023-10-08T00:25:37.716079+0000","last_undegraded":"2023-10-08T00:25:37.716079+0000","last_fullsized":"2023-10-08T00:25:37.716079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725605+0000","last_change":"2023-10-08T00:25:37.724898+0000","last_active":"2023-10-08T00:25:37.725605+0000","last_peered":"2023-10-08T00:25:37.725605+0000","last_clean":"2023-10-08T00:25:37.725605+0000","last_became_active":"2023-10-08T00:25:37.724611+0000","last_became_peered":"2023-10-08T00:25:37.724611+0000","last_unstale":"2023-10-08T00:25:37.725605+0000","last_undegraded":"2023-10-08T00:25:37.725605+0000","last_fullsized":"2023-10-08T00:25:37.725605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:40.085288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726377+0000","last_change":"2023-10-08T00:25:37.717245+0000","last_active":"2023-10-08T00:25:37.726377+0000","last_peered":"2023-10-08T00:25:37.726377+0000","last_clean":"2023-10-08T00:25:37.726377+0000","last_became_active":"2023-10-08T00:25:37.716986+0000","last_became_peered":"2023-10-08T00:25:37.716986+0000","last_unstale":"2023-10-08T00:25:37.726377+0000","last_undegraded":"2023-10-08T00:25:37.726377+0000","last_fullsized":"2023-10-08T00:25:37.726377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:46:12.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726265+0000","last_change":"2023-10-08T00:25:37.722639+0000","last_active":"2023-10-08T00:25:37.726265+0000","last_peered":"2023-10-08T00:25:37.726265+0000","last_clean":"2023-10-08T00:25:37.726265+0000","last_became_active":"2023-10-08T00:25:37.722366+0000","last_became_peered":"2023-10-08T00:25:37.722366+0000","last_unstale":"2023-10-08T00:25:37.726265+0000","last_undegraded":"2023-10-08T00:25:37.726265+0000","last_fullsized":"2023-10-08T00:25:37.726265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725543+0000","last_change":"2023-10-08T00:25:37.723182+0000","last_active":"2023-10-08T00:25:37.725543+0000","last_peered":"2023-10-08T00:25:37.725543+0000","last_clean":"2023-10-08T00:25:37.725543+0000","last_became_active":"2023-10-08T00:25:37.721984+0000","last_became_peered":"2023-10-08T00:25:37.721984+0000","last_unstale":"2023-10-08T00:25:37.725543+0000","last_undegraded":"2023-10-08T00:25:37.725543+0000","last_fullsized":"2023-10-08T00:25:37.725543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:54.865104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721615+0000","last_change":"2023-10-08T00:25:37.717020+0000","last_active":"2023-10-08T00:25:37.721615+0000","last_peered":"2023-10-08T00:25:37.721615+0000","last_clean":"2023-10-08T00:25:37.721615+0000","last_became_active":"2023-10-08T00:25:37.716714+0000","last_became_peered":"2023-10-08T00:25:37.716714+0000","last_unstale":"2023-10-08T00:25:37.721615+0000","last_undegraded":"2023-10-08T00:25:37.721615+0000","last_fullsized":"2023-10-08T00:25:37.721615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:19.623379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719332+0000","last_change":"2023-10-08T00:25:37.717681+0000","last_active":"2023-10-08T00:25:37.719332+0000","last_peered":"2023-10-08T00:25:37.719332+0000","last_clean":"2023-10-08T00:25:37.719332+0000","last_became_active":"2023-10-08T00:25:37.717431+0000","last_became_peered":"2023-10-08T00:25:37.717431+0000","last_unstale":"2023-10-08T00:25:37.719332+0000","last_undegraded":"2023-10-08T00:25:37.719332+0000","last_fullsized":"2023-10-08T00:25:37.719332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726177+0000","last_change":"2023-10-08T00:25:37.723217+0000","last_active":"2023-10-08T00:25:37.726177+0000","last_peered":"2023-10-08T00:25:37.726177+0000","last_clean":"2023-10-08T00:25:37.726177+0000","last_became_active":"2023-10-08T00:25:37.722930+0000","last_became_peered":"2023-10-08T00:25:37.722930+0000","last_unstale":"2023-10-08T00:25:37.726177+0000","last_undegraded":"2023-10-08T00:25:37.726177+0000","last_fullsized":"2023-10-08T00:25:37.726177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:46:12.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728178+0000","last_change":"2023-10-08T00:25:37.724229+0000","last_active":"2023-10-08T00:25:37.728178+0000","last_peered":"2023-10-08T00:25:37.728178+0000","last_clean":"2023-10-08T00:25:37.728178+0000","last_became_active":"2023-10-08T00:25:37.723929+0000","last_became_peered":"2023-10-08T00:25:37.723929+0000","last_unstale":"2023-10-08T00:25:37.728178+0000","last_undegraded":"2023-10-08T00:25:37.728178+0000","last_fullsized":"2023-10-08T00:25:37.728178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:54.865104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.720727+0000","last_change":"2023-10-08T00:25:37.717836+0000","last_active":"2023-10-08T00:25:37.720727+0000","last_peered":"2023-10-08T00:25:37.720727+0000","last_clean":"2023-10-08T00:25:37.720727+0000","last_became_active":"2023-10-08T00:25:37.717573+0000","last_became_peered":"2023-10-08T00:25:37.717573+0000","last_unstale":"2023-10-08T00:25:37.720727+0000","last_undegraded":"2023-10-08T00:25:37.720727+0000","last_fullsized":"2023-10-08T00:25:37.720727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:45.717834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731192+0000","last_change":"2023-10-08T00:25:37.729358+0000","last_active":"2023-10-08T00:25:37.731192+0000","last_peered":"2023-10-08T00:25:37.731192+0000","last_clean":"2023-10-08T00:25:37.731192+0000","last_became_active":"2023-10-08T00:25:37.729096+0000","last_became_peered":"2023-10-08T00:25:37.729096+0000","last_unstale":"2023-10-08T00:25:37.731192+0000","last_undegraded":"2023-10-08T00:25:37.731192+0000","last_fullsized":"2023-10-08T00:25:37.731192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:05:10.905563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725710+0000","last_change":"2023-10-08T00:25:37.714420+0000","last_active":"2023-10-08T00:25:37.725710+0000","last_peered":"2023-10-08T00:25:37.725710+0000","last_clean":"2023-10-08T00:25:37.725710+0000","last_became_active":"2023-10-08T00:25:37.714173+0000","last_became_peered":"2023-10-08T00:25:37.714173+0000","last_unstale":"2023-10-08T00:25:37.725710+0000","last_undegraded":"2023-10-08T00:25:37.725710+0000","last_fullsized":"2023-10-08T00:25:37.725710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732614+0000","last_change":"2023-10-08T00:25:37.731177+0000","last_active":"2023-10-08T00:25:37.732614+0000","last_peered":"2023-10-08T00:25:37.732614+0000","last_clean":"2023-10-08T00:25:37.732614+0000","last_became_active":"2023-10-08T00:25:37.731002+0000","last_became_peered":"2023-10-08T00:25:37.731002+0000","last_unstale":"2023-10-08T00:25:37.732614+0000","last_undegraded":"2023-10-08T00:25:37.732614+0000","last_fullsized":"2023-10-08T00:25:37.732614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729794+0000","last_change":"2023-10-08T00:25:37.725720+0000","last_active":"2023-10-08T00:25:37.729794+0000","last_peered":"2023-10-08T00:25:37.729794+0000","last_clean":"2023-10-08T00:25:37.729794+0000","last_became_active":"2023-10-08T00:25:37.725426+0000","last_became_peered":"2023-10-08T00:25:37.725426+0000","last_unstale":"2023-10-08T00:25:37.729794+0000","last_undegraded":"2023-10-08T00:25:37.729794+0000","last_fullsized":"2023-10-08T00:25:37.729794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:16.755300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728825+0000","last_change":"2023-10-08T00:25:37.723052+0000","last_active":"2023-10-08T00:25:37.728825+0000","last_peered":"2023-10-08T00:25:37.728825+0000","last_clean":"2023-10-08T00:25:37.728825+0000","last_became_active":"2023-10-08T00:25:37.722528+0000","last_became_peered":"2023-10-08T00:25:37.722528+0000","last_unstale":"2023-10-08T00:25:37.728825+0000","last_undegraded":"2023-10-08T00:25:37.728825+0000","last_fullsized":"2023-10-08T00:25:37.728825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:50.117104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728731+0000","last_change":"2023-10-08T00:25:37.722724+0000","last_active":"2023-10-08T00:25:37.728731+0000","last_peered":"2023-10-08T00:25:37.728731+0000","last_clean":"2023-10-08T00:25:37.728731+0000","last_became_active":"2023-10-08T00:25:37.722401+0000","last_became_peered":"2023-10-08T00:25:37.722401+0000","last_unstale":"2023-10-08T00:25:37.728731+0000","last_undegraded":"2023-10-08T00:25:37.728731+0000","last_fullsized":"2023-10-08T00:25:37.728731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:05.235836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719749+0000","last_change":"2023-10-08T00:25:37.714600+0000","last_active":"2023-10-08T00:25:37.719749+0000","last_peered":"2023-10-08T00:25:37.719749+0000","last_clean":"2023-10-08T00:25:37.719749+0000","last_became_active":"2023-10-08T00:25:37.714377+0000","last_became_peered":"2023-10-08T00:25:37.714377+0000","last_unstale":"2023-10-08T00:25:37.719749+0000","last_undegraded":"2023-10-08T00:25:37.719749+0000","last_fullsized":"2023-10-08T00:25:37.719749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:40:15.902819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721892+0000","last_change":"2023-10-08T00:25:37.717470+0000","last_active":"2023-10-08T00:25:37.721892+0000","last_peered":"2023-10-08T00:25:37.721892+0000","last_clean":"2023-10-08T00:25:37.721892+0000","last_became_active":"2023-10-08T00:25:37.717051+0000","last_became_peered":"2023-10-08T00:25:37.717051+0000","last_unstale":"2023-10-08T00:25:37.721892+0000","last_undegraded":"2023-10-08T00:25:37.721892+0000","last_fullsized":"2023-10-08T00:25:37.721892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:31.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726044+0000","last_change":"2023-10-08T00:25:37.724278+0000","last_active":"2023-10-08T00:25:37.726044+0000","last_peered":"2023-10-08T00:25:37.726044+0000","last_clean":"2023-10-08T00:25:37.726044+0000","last_became_active":"2023-10-08T00:25:37.723991+0000","last_became_peered":"2023-10-08T00:25:37.723991+0000","last_unstale":"2023-10-08T00:25:37.726044+0000","last_undegraded":"2023-10-08T00:25:37.726044+0000","last_fullsized":"2023-10-08T00:25:37.726044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:57.571056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725709+0000","last_change":"2023-10-08T00:25:37.722900+0000","last_active":"2023-10-08T00:25:37.725709+0000","last_peered":"2023-10-08T00:25:37.725709+0000","last_clean":"2023-10-08T00:25:37.725709+0000","last_became_active":"2023-10-08T00:25:37.722596+0000","last_became_peered":"2023-10-08T00:25:37.722596+0000","last_unstale":"2023-10-08T00:25:37.725709+0000","last_undegraded":"2023-10-08T00:25:37.725709+0000","last_fullsized":"2023-10-08T00:25:37.725709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727378+0000","last_change":"2023-10-08T00:25:37.716470+0000","last_active":"2023-10-08T00:25:37.727378+0000","last_peered":"2023-10-08T00:25:37.727378+0000","last_clean":"2023-10-08T00:25:37.727378+0000","last_became_active":"2023-10-08T00:25:37.715209+0000","last_became_peered":"2023-10-08T00:25:37.715209+0000","last_unstale":"2023-10-08T00:25:37.727378+0000","last_undegraded":"2023-10-08T00:25:37.727378+0000","last_fullsized":"2023-10-08T00:25:37.727378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728337+0000","last_change":"2023-10-08T00:25:37.727689+0000","last_active":"2023-10-08T00:25:37.728337+0000","last_peered":"2023-10-08T00:25:37.728337+0000","last_clean":"2023-10-08T00:25:37.728337+0000","last_became_active":"2023-10-08T00:25:37.727312+0000","last_became_peered":"2023-10-08T00:25:37.727312+0000","last_unstale":"2023-10-08T00:25:37.728337+0000","last_undegraded":"2023-10-08T00:25:37.728337+0000","last_fullsized":"2023-10-08T00:25:37.728337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731468+0000","last_change":"2023-10-08T00:25:37.729710+0000","last_active":"2023-10-08T00:25:37.731468+0000","last_peered":"2023-10-08T00:25:37.731468+0000","last_clean":"2023-10-08T00:25:37.731468+0000","last_became_active":"2023-10-08T00:25:37.729416+0000","last_became_peered":"2023-10-08T00:25:37.729416+0000","last_unstale":"2023-10-08T00:25:37.731468+0000","last_undegraded":"2023-10-08T00:25:37.731468+0000","last_fullsized":"2023-10-08T00:25:37.731468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:05:56.209299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718369+0000","last_change":"2023-10-08T00:25:37.709339+0000","last_active":"2023-10-08T00:25:37.718369+0000","last_peered":"2023-10-08T00:25:37.718369+0000","last_clean":"2023-10-08T00:25:37.718369+0000","last_became_active":"2023-10-08T00:25:37.708668+0000","last_became_peered":"2023-10-08T00:25:37.708668+0000","last_unstale":"2023-10-08T00:25:37.718369+0000","last_undegraded":"2023-10-08T00:25:37.718369+0000","last_fullsized":"2023-10-08T00:25:37.718369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726672+0000","last_change":"2023-10-08T00:25:37.715556+0000","last_active":"2023-10-08T00:25:37.726672+0000","last_peered":"2023-10-08T00:25:37.726672+0000","last_clean":"2023-10-08T00:25:37.726672+0000","last_became_active":"2023-10-08T00:25:37.715157+0000","last_became_peered":"2023-10-08T00:25:37.715157+0000","last_unstale":"2023-10-08T00:25:37.726672+0000","last_undegraded":"2023-10-08T00:25:37.726672+0000","last_fullsized":"2023-10-08T00:25:37.726672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727585+0000","last_change":"2023-10-08T00:25:37.725428+0000","last_active":"2023-10-08T00:25:37.727585+0000","last_peered":"2023-10-08T00:25:37.727585+0000","last_clean":"2023-10-08T00:25:37.727585+0000","last_became_active":"2023-10-08T00:25:37.724949+0000","last_became_peered":"2023-10-08T00:25:37.724949+0000","last_unstale":"2023-10-08T00:25:37.727585+0000","last_undegraded":"2023-10-08T00:25:37.727585+0000","last_fullsized":"2023-10-08T00:25:37.727585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:23:35.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725201+0000","last_change":"2023-10-08T00:25:37.723122+0000","last_active":"2023-10-08T00:25:37.725201+0000","last_peered":"2023-10-08T00:25:37.725201+0000","last_clean":"2023-10-08T00:25:37.725201+0000","last_became_active":"2023-10-08T00:25:37.722828+0000","last_became_peered":"2023-10-08T00:25:37.722828+0000","last_unstale":"2023-10-08T00:25:37.725201+0000","last_undegraded":"2023-10-08T00:25:37.725201+0000","last_fullsized":"2023-10-08T00:25:37.725201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.722271+0000","last_change":"2023-10-08T00:25:37.718268+0000","last_active":"2023-10-08T00:25:37.722271+0000","last_peered":"2023-10-08T00:25:37.722271+0000","last_clean":"2023-10-08T00:25:37.722271+0000","last_became_active":"2023-10-08T00:25:37.717992+0000","last_became_peered":"2023-10-08T00:25:37.717992+0000","last_unstale":"2023-10-08T00:25:37.722271+0000","last_undegraded":"2023-10-08T00:25:37.722271+0000","last_fullsized":"2023-10-08T00:25:37.722271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:31.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732203+0000","last_change":"2023-10-08T00:25:37.727267+0000","last_active":"2023-10-08T00:25:37.732203+0000","last_peered":"2023-10-08T00:25:37.732203+0000","last_clean":"2023-10-08T00:25:37.732203+0000","last_became_active":"2023-10-08T00:25:37.726818+0000","last_became_peered":"2023-10-08T00:25:37.726818+0000","last_unstale":"2023-10-08T00:25:37.732203+0000","last_undegraded":"2023-10-08T00:25:37.732203+0000","last_fullsized":"2023-10-08T00:25:37.732203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725719+0000","last_change":"2023-10-08T00:25:37.723012+0000","last_active":"2023-10-08T00:25:37.725719+0000","last_peered":"2023-10-08T00:25:37.725719+0000","last_clean":"2023-10-08T00:25:37.725719+0000","last_became_active":"2023-10-08T00:25:37.722757+0000","last_became_peered":"2023-10-08T00:25:37.722757+0000","last_unstale":"2023-10-08T00:25:37.725719+0000","last_undegraded":"2023-10-08T00:25:37.725719+0000","last_fullsized":"2023-10-08T00:25:37.725719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:23:35.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728049+0000","last_change":"2023-10-08T00:25:36.709162+0000","last_active":"2023-10-08T00:25:37.728049+0000","last_peered":"2023-10-08T00:25:37.728049+0000","last_clean":"2023-10-08T00:25:37.728049+0000","last_became_active":"2023-10-08T00:25:36.708913+0000","last_became_peered":"2023-10-08T00:25:36.708913+0000","last_unstale":"2023-10-08T00:25:37.728049+0000","last_undegraded":"2023-10-08T00:25:37.728049+0000","last_fullsized":"2023-10-08T00:25:37.728049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:03.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724723+0000","last_change":"2023-10-08T00:25:37.720120+0000","last_active":"2023-10-08T00:25:37.724723+0000","last_peered":"2023-10-08T00:25:37.724723+0000","last_clean":"2023-10-08T00:25:37.724723+0000","last_became_active":"2023-10-08T00:25:37.719871+0000","last_became_peered":"2023-10-08T00:25:37.719871+0000","last_unstale":"2023-10-08T00:25:37.724723+0000","last_undegraded":"2023-10-08T00:25:37.724723+0000","last_fullsized":"2023-10-08T00:25:37.724723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:14.444743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714485+0000","last_change":"2023-10-08T00:25:36.711782+0000","last_active":"2023-10-08T00:25:37.714485+0000","last_peered":"2023-10-08T00:25:37.714485+0000","last_clean":"2023-10-08T00:25:37.714485+0000","last_became_active":"2023-10-08T00:25:36.711508+0000","last_became_peered":"2023-10-08T00:25:36.711508+0000","last_unstale":"2023-10-08T00:25:37.714485+0000","last_undegraded":"2023-10-08T00:25:37.714485+0000","last_fullsized":"2023-10-08T00:25:37.714485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:39.078979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726845+0000","last_change":"2023-10-08T00:25:37.724580+0000","last_active":"2023-10-08T00:25:37.726845+0000","last_peered":"2023-10-08T00:25:37.726845+0000","last_clean":"2023-10-08T00:25:37.726845+0000","last_became_active":"2023-10-08T00:25:37.724153+0000","last_became_peered":"2023-10-08T00:25:37.724153+0000","last_unstale":"2023-10-08T00:25:37.726845+0000","last_undegraded":"2023-10-08T00:25:37.726845+0000","last_fullsized":"2023-10-08T00:25:37.726845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:27:48.211667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728678+0000","last_change":"2023-10-08T00:25:36.718742+0000","last_active":"2023-10-08T00:25:37.728678+0000","last_peered":"2023-10-08T00:25:37.728678+0000","last_clean":"2023-10-08T00:25:37.728678+0000","last_became_active":"2023-10-08T00:25:36.718410+0000","last_became_peered":"2023-10-08T00:25:36.718410+0000","last_unstale":"2023-10-08T00:25:37.728678+0000","last_undegraded":"2023-10-08T00:25:37.728678+0000","last_fullsized":"2023-10-08T00:25:37.728678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:27.923263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718351+0000","last_change":"2023-10-08T00:25:37.708920+0000","last_active":"2023-10-08T00:25:37.718351+0000","last_peered":"2023-10-08T00:25:37.718351+0000","last_clean":"2023-10-08T00:25:37.718351+0000","last_became_active":"2023-10-08T00:25:37.708322+0000","last_became_peered":"2023-10-08T00:25:37.708322+0000","last_unstale":"2023-10-08T00:25:37.718351+0000","last_undegraded":"2023-10-08T00:25:37.718351+0000","last_fullsized":"2023-10-08T00:25:37.718351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:16.755300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718995+0000","last_change":"2023-10-08T00:25:36.718068+0000","last_active":"2023-10-08T00:25:37.718995+0000","last_peered":"2023-10-08T00:25:37.718995+0000","last_clean":"2023-10-08T00:25:37.718995+0000","last_became_active":"2023-10-08T00:25:36.714439+0000","last_became_peered":"2023-10-08T00:25:36.714439+0000","last_unstale":"2023-10-08T00:25:37.718995+0000","last_undegraded":"2023-10-08T00:25:37.718995+0000","last_fullsized":"2023-10-08T00:25:37.718995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:47:44.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729833+0000","last_change":"2023-10-08T00:25:37.726243+0000","last_active":"2023-10-08T00:25:37.729833+0000","last_peered":"2023-10-08T00:25:37.729833+0000","last_clean":"2023-10-08T00:25:37.729833+0000","last_became_active":"2023-10-08T00:25:37.725983+0000","last_became_peered":"2023-10-08T00:25:37.725983+0000","last_unstale":"2023-10-08T00:25:37.729833+0000","last_undegraded":"2023-10-08T00:25:37.729833+0000","last_fullsized":"2023-10-08T00:25:37.729833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729752+0000","last_change":"2023-10-08T00:25:36.714559+0000","last_active":"2023-10-08T00:25:37.729752+0000","last_peered":"2023-10-08T00:25:37.729752+0000","last_clean":"2023-10-08T00:25:37.729752+0000","last_became_active":"2023-10-08T00:25:36.714260+0000","last_became_peered":"2023-10-08T00:25:36.714260+0000","last_unstale":"2023-10-08T00:25:37.729752+0000","last_undegraded":"2023-10-08T00:25:37.729752+0000","last_fullsized":"2023-10-08T00:25:37.729752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:08:58.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726652+0000","last_change":"2023-10-08T00:25:37.716864+0000","last_active":"2023-10-08T00:25:37.726652+0000","last_peered":"2023-10-08T00:25:37.726652+0000","last_clean":"2023-10-08T00:25:37.726652+0000","last_became_active":"2023-10-08T00:25:37.716577+0000","last_became_peered":"2023-10-08T00:25:37.716577+0000","last_unstale":"2023-10-08T00:25:37.726652+0000","last_undegraded":"2023-10-08T00:25:37.726652+0000","last_fullsized":"2023-10-08T00:25:37.726652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729680+0000","last_change":"2023-10-08T00:25:36.714539+0000","last_active":"2023-10-08T00:25:37.729680+0000","last_peered":"2023-10-08T00:25:37.729680+0000","last_clean":"2023-10-08T00:25:37.729680+0000","last_became_active":"2023-10-08T00:25:36.714273+0000","last_became_peered":"2023-10-08T00:25:36.714273+0000","last_unstale":"2023-10-08T00:25:37.729680+0000","last_undegraded":"2023-10-08T00:25:37.729680+0000","last_fullsized":"2023-10-08T00:25:37.729680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:11.876222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718260+0000","last_change":"2023-10-08T00:25:37.713525+0000","last_active":"2023-10-08T00:25:37.718260+0000","last_peered":"2023-10-08T00:25:37.718260+0000","last_clean":"2023-10-08T00:25:37.718260+0000","last_became_active":"2023-10-08T00:25:37.713217+0000","last_became_peered":"2023-10-08T00:25:37.713217+0000","last_unstale":"2023-10-08T00:25:37.718260+0000","last_undegraded":"2023-10-08T00:25:37.718260+0000","last_fullsized":"2023-10-08T00:25:37.718260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:28.929571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709653+0000","last_change":"2023-10-08T00:25:36.717790+0000","last_active":"2023-10-08T00:25:37.709653+0000","last_peered":"2023-10-08T00:25:37.709653+0000","last_clean":"2023-10-08T00:25:37.709653+0000","last_became_active":"2023-10-08T00:25:36.717498+0000","last_became_peered":"2023-10-08T00:25:36.717498+0000","last_unstale":"2023-10-08T00:25:37.709653+0000","last_undegraded":"2023-10-08T00:25:37.709653+0000","last_fullsized":"2023-10-08T00:25:37.709653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:13.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718512+0000","last_change":"2023-10-08T00:25:37.713748+0000","last_active":"2023-10-08T00:25:37.718512+0000","last_peered":"2023-10-08T00:25:37.718512+0000","last_clean":"2023-10-08T00:25:37.718512+0000","last_became_active":"2023-10-08T00:25:37.713158+0000","last_became_peered":"2023-10-08T00:25:37.713158+0000","last_unstale":"2023-10-08T00:25:37.718512+0000","last_undegraded":"2023-10-08T00:25:37.718512+0000","last_fullsized":"2023-10-08T00:25:37.718512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705556+0000","last_change":"2023-10-08T00:25:36.708148+0000","last_active":"2023-10-08T00:25:37.705556+0000","last_peered":"2023-10-08T00:25:37.705556+0000","last_clean":"2023-10-08T00:25:37.705556+0000","last_became_active":"2023-10-08T00:25:36.707828+0000","last_became_peered":"2023-10-08T00:25:36.707828+0000","last_unstale":"2023-10-08T00:25:37.705556+0000","last_undegraded":"2023-10-08T00:25:37.705556+0000","last_fullsized":"2023-10-08T00:25:37.705556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:20:19.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727699+0000","last_change":"2023-10-08T00:25:37.717617+0000","last_active":"2023-10-08T00:25:37.727699+0000","last_peered":"2023-10-08T00:25:37.727699+0000","last_clean":"2023-10-08T00:25:37.727699+0000","last_became_active":"2023-10-08T00:25:37.717332+0000","last_became_peered":"2023-10-08T00:25:37.717332+0000","last_unstale":"2023-10-08T00:25:37.727699+0000","last_undegraded":"2023-10-08T00:25:37.727699+0000","last_fullsized":"2023-10-08T00:25:37.727699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.710766+0000","last_change":"2023-10-08T00:25:36.720319+0000","last_active":"2023-10-08T00:25:37.710766+0000","last_peered":"2023-10-08T00:25:37.710766+0000","last_clean":"2023-10-08T00:25:37.710766+0000","last_became_active":"2023-10-08T00:25:36.720021+0000","last_became_peered":"2023-10-08T00:25:36.720021+0000","last_unstale":"2023-10-08T00:25:37.710766+0000","last_undegraded":"2023-10-08T00:25:37.710766+0000","last_fullsized":"2023-10-08T00:25:37.710766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:30.610868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728871+0000","last_change":"2023-10-08T00:25:37.725571+0000","last_active":"2023-10-08T00:25:37.728871+0000","last_peered":"2023-10-08T00:25:37.728871+0000","last_clean":"2023-10-08T00:25:37.728871+0000","last_became_active":"2023-10-08T00:25:37.723042+0000","last_became_peered":"2023-10-08T00:25:37.723042+0000","last_unstale":"2023-10-08T00:25:37.728871+0000","last_undegraded":"2023-10-08T00:25:37.728871+0000","last_fullsized":"2023-10-08T00:25:37.728871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:49:37.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.704300+0000","last_change":"2023-10-08T00:25:36.715186+0000","last_active":"2023-10-08T00:25:37.704300+0000","last_peered":"2023-10-08T00:25:37.704300+0000","last_clean":"2023-10-08T00:25:37.704300+0000","last_became_active":"2023-10-08T00:25:36.714763+0000","last_became_peered":"2023-10-08T00:25:36.714763+0000","last_unstale":"2023-10-08T00:25:37.704300+0000","last_undegraded":"2023-10-08T00:25:37.704300+0000","last_fullsized":"2023-10-08T00:25:37.704300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:44.711526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732060+0000","last_change":"2023-10-08T00:25:37.731469+0000","last_active":"2023-10-08T00:25:37.732060+0000","last_peered":"2023-10-08T00:25:37.732060+0000","last_clean":"2023-10-08T00:25:37.732060+0000","last_became_active":"2023-10-08T00:25:37.731201+0000","last_became_peered":"2023-10-08T00:25:37.731201+0000","last_unstale":"2023-10-08T00:25:37.732060+0000","last_undegraded":"2023-10-08T00:25:37.732060+0000","last_fullsized":"2023-10-08T00:25:37.732060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:51.316017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721346+0000","last_change":"2023-10-08T00:25:36.711356+0000","last_active":"2023-10-08T00:25:37.721346+0000","last_peered":"2023-10-08T00:25:37.721346+0000","last_clean":"2023-10-08T00:25:37.721346+0000","last_became_active":"2023-10-08T00:25:36.711042+0000","last_became_peered":"2023-10-08T00:25:36.711042+0000","last_unstale":"2023-10-08T00:25:37.721346+0000","last_undegraded":"2023-10-08T00:25:37.721346+0000","last_fullsized":"2023-10-08T00:25:37.721346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728082+0000","last_change":"2023-10-08T00:25:37.719780+0000","last_active":"2023-10-08T00:25:37.728082+0000","last_peered":"2023-10-08T00:25:37.728082+0000","last_clean":"2023-10-08T00:25:37.728082+0000","last_became_active":"2023-10-08T00:25:37.719465+0000","last_became_peered":"2023-10-08T00:25:37.719465+0000","last_unstale":"2023-10-08T00:25:37.728082+0000","last_undegraded":"2023-10-08T00:25:37.728082+0000","last_fullsized":"2023-10-08T00:25:37.728082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732690+0000","last_change":"2023-10-08T00:25:36.720312+0000","last_active":"2023-10-08T00:25:37.732690+0000","last_peered":"2023-10-08T00:25:37.732690+0000","last_clean":"2023-10-08T00:25:37.732690+0000","last_became_active":"2023-10-08T00:25:36.720036+0000","last_became_peered":"2023-10-08T00:25:36.720036+0000","last_unstale":"2023-10-08T00:25:37.732690+0000","last_undegraded":"2023-10-08T00:25:37.732690+0000","last_fullsized":"2023-10-08T00:25:37.732690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:18.617071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718540+0000","last_change":"2023-10-08T00:25:37.713755+0000","last_active":"2023-10-08T00:25:37.718540+0000","last_peered":"2023-10-08T00:25:37.718540+0000","last_clean":"2023-10-08T00:25:37.718540+0000","last_became_active":"2023-10-08T00:25:37.713441+0000","last_became_peered":"2023-10-08T00:25:37.713441+0000","last_unstale":"2023-10-08T00:25:37.718540+0000","last_undegraded":"2023-10-08T00:25:37.718540+0000","last_fullsized":"2023-10-08T00:25:37.718540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725271+0000","last_change":"2023-10-08T00:25:36.711928+0000","last_active":"2023-10-08T00:25:37.725271+0000","last_peered":"2023-10-08T00:25:37.725271+0000","last_clean":"2023-10-08T00:25:37.725271+0000","last_became_active":"2023-10-08T00:25:36.711654+0000","last_became_peered":"2023-10-08T00:25:36.711654+0000","last_unstale":"2023-10-08T00:25:37.725271+0000","last_undegraded":"2023-10-08T00:25:37.725271+0000","last_fullsized":"2023-10-08T00:25:37.725271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:16:30.013733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726597+0000","last_change":"2023-10-08T00:25:37.718291+0000","last_active":"2023-10-08T00:25:37.726597+0000","last_peered":"2023-10-08T00:25:37.726597+0000","last_clean":"2023-10-08T00:25:37.726597+0000","last_became_active":"2023-10-08T00:25:37.718013+0000","last_became_peered":"2023-10-08T00:25:37.718013+0000","last_unstale":"2023-10-08T00:25:37.726597+0000","last_undegraded":"2023-10-08T00:25:37.726597+0000","last_fullsized":"2023-10-08T00:25:37.726597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.700027+0000","last_change":"2023-10-08T00:25:36.706721+0000","last_active":"2023-10-08T00:25:37.700027+0000","last_peered":"2023-10-08T00:25:37.700027+0000","last_clean":"2023-10-08T00:25:37.700027+0000","last_became_active":"2023-10-08T00:25:36.706450+0000","last_became_peered":"2023-10-08T00:25:36.706450+0000","last_unstale":"2023-10-08T00:25:37.700027+0000","last_undegraded":"2023-10-08T00:25:37.700027+0000","last_fullsized":"2023-10-08T00:25:37.700027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:39.078979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732186+0000","last_change":"2023-10-08T00:25:37.727079+0000","last_active":"2023-10-08T00:25:37.732186+0000","last_peered":"2023-10-08T00:25:37.732186+0000","last_clean":"2023-10-08T00:25:37.732186+0000","last_became_active":"2023-10-08T00:25:37.726505+0000","last_became_peered":"2023-10-08T00:25:37.726505+0000","last_unstale":"2023-10-08T00:25:37.732186+0000","last_undegraded":"2023-10-08T00:25:37.732186+0000","last_fullsized":"2023-10-08T00:25:37.732186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709769+0000","last_change":"2023-10-08T00:25:36.718814+0000","last_active":"2023-10-08T00:25:37.709769+0000","last_peered":"2023-10-08T00:25:37.709769+0000","last_clean":"2023-10-08T00:25:37.709769+0000","last_became_active":"2023-10-08T00:25:36.718506+0000","last_became_peered":"2023-10-08T00:25:36.718506+0000","last_unstale":"2023-10-08T00:25:37.709769+0000","last_undegraded":"2023-10-08T00:25:37.709769+0000","last_fullsized":"2023-10-08T00:25:37.709769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:51.104818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724511+0000","last_change":"2023-10-08T00:25:37.719223+0000","last_active":"2023-10-08T00:25:37.724511+0000","last_peered":"2023-10-08T00:25:37.724511+0000","last_clean":"2023-10-08T00:25:37.724511+0000","last_became_active":"2023-10-08T00:25:37.718939+0000","last_became_peered":"2023-10-08T00:25:37.718939+0000","last_unstale":"2023-10-08T00:25:37.724511+0000","last_undegraded":"2023-10-08T00:25:37.724511+0000","last_fullsized":"2023-10-08T00:25:37.724511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:19.623379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729366+0000","last_change":"2023-10-08T00:25:36.718647+0000","last_active":"2023-10-08T00:25:37.729366+0000","last_peered":"2023-10-08T00:25:37.729366+0000","last_clean":"2023-10-08T00:25:37.729366+0000","last_became_active":"2023-10-08T00:25:36.718381+0000","last_became_peered":"2023-10-08T00:25:36.718381+0000","last_unstale":"2023-10-08T00:25:37.729366+0000","last_undegraded":"2023-10-08T00:25:37.729366+0000","last_fullsized":"2023-10-08T00:25:37.729366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:56.564748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718169+0000","last_change":"2023-10-08T00:25:37.712092+0000","last_active":"2023-10-08T00:25:37.718169+0000","last_peered":"2023-10-08T00:25:37.718169+0000","last_clean":"2023-10-08T00:25:37.718169+0000","last_became_active":"2023-10-08T00:25:37.711818+0000","last_became_peered":"2023-10-08T00:25:37.711818+0000","last_unstale":"2023-10-08T00:25:37.718169+0000","last_undegraded":"2023-10-08T00:25:37.718169+0000","last_fullsized":"2023-10-08T00:25:37.718169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:14.444743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719236+0000","last_change":"2023-10-08T00:25:36.717177+0000","last_active":"2023-10-08T00:25:37.719236+0000","last_peered":"2023-10-08T00:25:37.719236+0000","last_clean":"2023-10-08T00:25:37.719236+0000","last_became_active":"2023-10-08T00:25:36.716873+0000","last_became_peered":"2023-10-08T00:25:36.716873+0000","last_unstale":"2023-10-08T00:25:37.719236+0000","last_undegraded":"2023-10-08T00:25:37.719236+0000","last_fullsized":"2023-10-08T00:25:37.719236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727726+0000","last_change":"2023-10-08T00:25:37.718915+0000","last_active":"2023-10-08T00:25:37.727726+0000","last_peered":"2023-10-08T00:25:37.727726+0000","last_clean":"2023-10-08T00:25:37.727726+0000","last_became_active":"2023-10-08T00:25:37.718659+0000","last_became_peered":"2023-10-08T00:25:37.718659+0000","last_unstale":"2023-10-08T00:25:37.727726+0000","last_undegraded":"2023-10-08T00:25:37.727726+0000","last_fullsized":"2023-10-08T00:25:37.727726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724875+0000","last_change":"2023-10-08T00:25:36.712041+0000","last_active":"2023-10-08T00:25:37.724875+0000","last_peered":"2023-10-08T00:25:37.724875+0000","last_clean":"2023-10-08T00:25:37.724875+0000","last_became_active":"2023-10-08T00:25:36.711765+0000","last_became_peered":"2023-10-08T00:25:36.711765+0000","last_unstale":"2023-10-08T00:25:37.724875+0000","last_undegraded":"2023-10-08T00:25:37.724875+0000","last_fullsized":"2023-10-08T00:25:37.724875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:56:16.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718299+0000","last_change":"2023-10-08T00:25:37.707908+0000","last_active":"2023-10-08T00:25:37.718299+0000","last_peered":"2023-10-08T00:25:37.718299+0000","last_clean":"2023-10-08T00:25:37.718299+0000","last_became_active":"2023-10-08T00:25:37.707495+0000","last_became_peered":"2023-10-08T00:25:37.707495+0000","last_unstale":"2023-10-08T00:25:37.718299+0000","last_undegraded":"2023-10-08T00:25:37.718299+0000","last_fullsized":"2023-10-08T00:25:37.718299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:08.137490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721693+0000","last_change":"2023-10-08T00:25:36.710619+0000","last_active":"2023-10-08T00:25:37.721693+0000","last_peered":"2023-10-08T00:25:37.721693+0000","last_clean":"2023-10-08T00:25:37.721693+0000","last_became_active":"2023-10-08T00:25:36.710333+0000","last_became_peered":"2023-10-08T00:25:36.710333+0000","last_unstale":"2023-10-08T00:25:37.721693+0000","last_undegraded":"2023-10-08T00:25:37.721693+0000","last_fullsized":"2023-10-08T00:25:37.721693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:51.725428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731077+0000","last_change":"2023-10-08T00:25:37.730380+0000","last_active":"2023-10-08T00:25:37.731077+0000","last_peered":"2023-10-08T00:25:37.731077+0000","last_clean":"2023-10-08T00:25:37.731077+0000","last_became_active":"2023-10-08T00:25:37.730118+0000","last_became_peered":"2023-10-08T00:25:37.730118+0000","last_unstale":"2023-10-08T00:25:37.731077+0000","last_undegraded":"2023-10-08T00:25:37.731077+0000","last_fullsized":"2023-10-08T00:25:37.731077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:22.917659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.706093+0000","last_change":"2023-10-08T00:25:36.714762+0000","last_active":"2023-10-08T00:25:37.706093+0000","last_peered":"2023-10-08T00:25:37.706093+0000","last_clean":"2023-10-08T00:25:37.706093+0000","last_became_active":"2023-10-08T00:25:36.714305+0000","last_became_peered":"2023-10-08T00:25:36.714305+0000","last_unstale":"2023-10-08T00:25:37.706093+0000","last_undegraded":"2023-10-08T00:25:37.706093+0000","last_fullsized":"2023-10-08T00:25:37.706093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:03:17.073658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712421+0000","last_change":"2023-10-08T00:25:37.710227+0000","last_active":"2023-10-08T00:25:37.712421+0000","last_peered":"2023-10-08T00:25:37.712421+0000","last_clean":"2023-10-08T00:25:37.712421+0000","last_became_active":"2023-10-08T00:25:37.709979+0000","last_became_peered":"2023-10-08T00:25:37.709979+0000","last_unstale":"2023-10-08T00:25:37.712421+0000","last_undegraded":"2023-10-08T00:25:37.712421+0000","last_fullsized":"2023-10-08T00:25:37.712421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:04.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.720952+0000","last_change":"2023-10-08T00:25:36.708660+0000","last_active":"2023-10-08T00:25:37.720952+0000","last_peered":"2023-10-08T00:25:37.720952+0000","last_clean":"2023-10-08T00:25:37.720952+0000","last_became_active":"2023-10-08T00:25:36.708372+0000","last_became_peered":"2023-10-08T00:25:36.708372+0000","last_unstale":"2023-10-08T00:25:37.720952+0000","last_undegraded":"2023-10-08T00:25:37.720952+0000","last_fullsized":"2023-10-08T00:25:37.720952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721638+0000","last_change":"2023-10-08T00:25:37.719923+0000","last_active":"2023-10-08T00:25:37.721638+0000","last_peered":"2023-10-08T00:25:37.721638+0000","last_clean":"2023-10-08T00:25:37.721638+0000","last_became_active":"2023-10-08T00:25:37.719248+0000","last_became_peered":"2023-10-08T00:25:37.719248+0000","last_unstale":"2023-10-08T00:25:37.721638+0000","last_undegraded":"2023-10-08T00:25:37.721638+0000","last_fullsized":"2023-10-08T00:25:37.721638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:52.731736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709660+0000","last_change":"2023-10-08T00:25:36.708895+0000","last_active":"2023-10-08T00:25:37.709660+0000","last_peered":"2023-10-08T00:25:37.709660+0000","last_clean":"2023-10-08T00:25:37.709660+0000","last_became_active":"2023-10-08T00:25:36.708462+0000","last_became_peered":"2023-10-08T00:25:36.708462+0000","last_unstale":"2023-10-08T00:25:37.709660+0000","last_undegraded":"2023-10-08T00:25:37.709660+0000","last_fullsized":"2023-10-08T00:25:37.709660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:51.725428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719629+0000","last_change":"2023-10-08T00:25:37.716451+0000","last_active":"2023-10-08T00:25:37.719629+0000","last_peered":"2023-10-08T00:25:37.719629+0000","last_clean":"2023-10-08T00:25:37.719629+0000","last_became_active":"2023-10-08T00:25:37.716170+0000","last_became_peered":"2023-10-08T00:25:37.716170+0000","last_unstale":"2023-10-08T00:25:37.719629+0000","last_undegraded":"2023-10-08T00:25:37.719629+0000","last_fullsized":"2023-10-08T00:25:37.719629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:08.187847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705859+0000","last_change":"2023-10-08T00:25:36.715360+0000","last_active":"2023-10-08T00:25:37.705859+0000","last_peered":"2023-10-08T00:25:37.705859+0000","last_clean":"2023-10-08T00:25:37.705859+0000","last_became_active":"2023-10-08T00:25:36.715091+0000","last_became_peered":"2023-10-08T00:25:36.715091+0000","last_unstale":"2023-10-08T00:25:37.705859+0000","last_undegraded":"2023-10-08T00:25:37.705859+0000","last_fullsized":"2023-10-08T00:25:37.705859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:03.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727324+0000","last_change":"2023-10-08T00:25:37.723622+0000","last_active":"2023-10-08T00:25:37.727324+0000","last_peered":"2023-10-08T00:25:37.727324+0000","last_clean":"2023-10-08T00:25:37.727324+0000","last_became_active":"2023-10-08T00:25:37.723092+0000","last_became_peered":"2023-10-08T00:25:37.723092+0000","last_unstale":"2023-10-08T00:25:37.727324+0000","last_undegraded":"2023-10-08T00:25:37.727324+0000","last_fullsized":"2023-10-08T00:25:37.727324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.706399+0000","last_change":"2023-10-08T00:25:36.711926+0000","last_active":"2023-10-08T00:25:37.706399+0000","last_peered":"2023-10-08T00:25:37.706399+0000","last_clean":"2023-10-08T00:25:37.706399+0000","last_became_active":"2023-10-08T00:25:36.711690+0000","last_became_peered":"2023-10-08T00:25:36.711690+0000","last_unstale":"2023-10-08T00:25:37.706399+0000","last_undegraded":"2023-10-08T00:25:37.706399+0000","last_fullsized":"2023-10-08T00:25:37.706399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714924+0000","last_change":"2023-10-08T00:25:37.712252+0000","last_active":"2023-10-08T00:25:37.714924+0000","last_peered":"2023-10-08T00:25:37.714924+0000","last_clean":"2023-10-08T00:25:37.714924+0000","last_became_active":"2023-10-08T00:25:37.711968+0000","last_became_peered":"2023-10-08T00:25:37.711968+0000","last_unstale":"2023-10-08T00:25:37.714924+0000","last_undegraded":"2023-10-08T00:25:37.714924+0000","last_fullsized":"2023-10-08T00:25:37.714924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:41:15.013916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721453+0000","last_change":"2023-10-08T00:25:36.711520+0000","last_active":"2023-10-08T00:25:37.721453+0000","last_peered":"2023-10-08T00:25:37.721453+0000","last_clean":"2023-10-08T00:25:37.721453+0000","last_became_active":"2023-10-08T00:25:36.710780+0000","last_became_peered":"2023-10-08T00:25:36.710780+0000","last_unstale":"2023-10-08T00:25:37.721453+0000","last_undegraded":"2023-10-08T00:25:37.721453+0000","last_fullsized":"2023-10-08T00:25:37.721453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728153+0000","last_change":"2023-10-08T00:25:37.720889+0000","last_active":"2023-10-08T00:25:37.728153+0000","last_peered":"2023-10-08T00:25:37.728153+0000","last_clean":"2023-10-08T00:25:37.728153+0000","last_became_active":"2023-10-08T00:25:37.720152+0000","last_became_peered":"2023-10-08T00:25:37.720152+0000","last_unstale":"2023-10-08T00:25:37.728153+0000","last_undegraded":"2023-10-08T00:25:37.728153+0000","last_fullsized":"2023-10-08T00:25:37.728153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T00:25:39.822657+0000","last_change":"2023-10-08T00:25:36.707046+0000","last_active":"2023-10-08T00:25:39.822657+0000","last_peered":"2023-10-08T00:25:39.822657+0000","last_clean":"2023-10-08T00:25:39.822657+0000","last_became_active":"2023-10-08T00:25:36.706778+0000","last_became_peered":"2023-10-08T00:25:36.706778+0000","last_unstale":"2023-10-08T00:25:39.822657+0000","last_undegraded":"2023-10-08T00:25:39.822657+0000","last_fullsized":"2023-10-08T00:25:39.822657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714206+0000","last_change":"2023-10-08T00:25:37.708046+0000","last_active":"2023-10-08T00:25:37.714206+0000","last_peered":"2023-10-08T00:25:37.714206+0000","last_clean":"2023-10-08T00:25:37.714206+0000","last_became_active":"2023-10-08T00:25:37.707776+0000","last_became_peered":"2023-10-08T00:25:37.707776+0000","last_unstale":"2023-10-08T00:25:37.714206+0000","last_undegraded":"2023-10-08T00:25:37.714206+0000","last_fullsized":"2023-10-08T00:25:37.714206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:57.571056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.700929+0000","last_change":"2023-10-08T00:25:36.709706+0000","last_active":"2023-10-08T00:25:37.700929+0000","last_peered":"2023-10-08T00:25:37.700929+0000","last_clean":"2023-10-08T00:25:37.700929+0000","last_became_active":"2023-10-08T00:25:36.709437+0000","last_became_peered":"2023-10-08T00:25:36.709437+0000","last_unstale":"2023-10-08T00:25:37.700929+0000","last_undegraded":"2023-10-08T00:25:37.700929+0000","last_fullsized":"2023-10-08T00:25:37.700929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:41:14.007608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721889+0000","last_change":"2023-10-08T00:25:37.716602+0000","last_active":"2023-10-08T00:25:37.721889+0000","last_peered":"2023-10-08T00:25:37.721889+0000","last_clean":"2023-10-08T00:25:37.721889+0000","last_became_active":"2023-10-08T00:25:37.716335+0000","last_became_peered":"2023-10-08T00:25:37.716335+0000","last_unstale":"2023-10-08T00:25:37.721889+0000","last_undegraded":"2023-10-08T00:25:37.721889+0000","last_fullsized":"2023-10-08T00:25:37.721889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:52.111126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.703539+0000","last_change":"2023-10-08T00:25:36.714743+0000","last_active":"2023-10-08T00:25:37.703539+0000","last_peered":"2023-10-08T00:25:37.703539+0000","last_clean":"2023-10-08T00:25:37.703539+0000","last_became_active":"2023-10-08T00:25:36.714312+0000","last_became_peered":"2023-10-08T00:25:36.714312+0000","last_unstale":"2023-10-08T00:25:37.703539+0000","last_undegraded":"2023-10-08T00:25:37.703539+0000","last_fullsized":"2023-10-08T00:25:37.703539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:21.911351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714941+0000","last_change":"2023-10-08T00:25:37.713570+0000","last_active":"2023-10-08T00:25:37.714941+0000","last_peered":"2023-10-08T00:25:37.714941+0000","last_clean":"2023-10-08T00:25:37.714941+0000","last_became_active":"2023-10-08T00:25:37.713320+0000","last_became_peered":"2023-10-08T00:25:37.713320+0000","last_unstale":"2023-10-08T00:25:37.714941+0000","last_undegraded":"2023-10-08T00:25:37.714941+0000","last_fullsized":"2023-10-08T00:25:37.714941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:27:48.211667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.699927+0000","last_change":"2023-10-08T00:25:36.709471+0000","last_active":"2023-10-08T00:25:37.699927+0000","last_peered":"2023-10-08T00:25:37.699927+0000","last_clean":"2023-10-08T00:25:37.699927+0000","last_became_active":"2023-10-08T00:25:36.709128+0000","last_became_peered":"2023-10-08T00:25:36.709128+0000","last_unstale":"2023-10-08T00:25:37.699927+0000","last_undegraded":"2023-10-08T00:25:37.699927+0000","last_fullsized":"2023-10-08T00:25:37.699927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:21.911351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729199+0000","last_change":"2023-10-08T00:25:37.725985+0000","last_active":"2023-10-08T00:25:37.729199+0000","last_peered":"2023-10-08T00:25:37.729199+0000","last_clean":"2023-10-08T00:25:37.729199+0000","last_became_active":"2023-10-08T00:25:37.722306+0000","last_became_peered":"2023-10-08T00:25:37.722306+0000","last_unstale":"2023-10-08T00:25:37.729199+0000","last_undegraded":"2023-10-08T00:25:37.729199+0000","last_fullsized":"2023-10-08T00:25:37.729199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:53.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705965+0000","last_change":"2023-10-08T00:25:36.708817+0000","last_active":"2023-10-08T00:25:37.705965+0000","last_peered":"2023-10-08T00:25:37.705965+0000","last_clean":"2023-10-08T00:25:37.705965+0000","last_became_active":"2023-10-08T00:25:36.708553+0000","last_became_peered":"2023-10-08T00:25:36.708553+0000","last_unstale":"2023-10-08T00:25:37.705965+0000","last_undegraded":"2023-10-08T00:25:37.705965+0000","last_fullsized":"2023-10-08T00:25:37.705965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:07.181539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726073+0000","last_change":"2023-10-08T00:25:37.724331+0000","last_active":"2023-10-08T00:25:37.726073+0000","last_peered":"2023-10-08T00:25:37.726073+0000","last_clean":"2023-10-08T00:25:37.726073+0000","last_became_active":"2023-10-08T00:25:37.724030+0000","last_became_peered":"2023-10-08T00:25:37.724030+0000","last_unstale":"2023-10-08T00:25:37.726073+0000","last_undegraded":"2023-10-08T00:25:37.726073+0000","last_fullsized":"2023-10-08T00:25:37.726073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712091+0000","last_change":"2023-10-08T00:25:36.720869+0000","last_active":"2023-10-08T00:25:37.712091+0000","last_peered":"2023-10-08T00:25:37.712091+0000","last_clean":"2023-10-08T00:25:37.712091+0000","last_became_active":"2023-10-08T00:25:36.720607+0000","last_became_peered":"2023-10-08T00:25:36.720607+0000","last_unstale":"2023-10-08T00:25:37.712091+0000","last_undegraded":"2023-10-08T00:25:37.712091+0000","last_fullsized":"2023-10-08T00:25:37.712091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:37.686348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725308+0000","last_change":"2023-10-08T00:25:37.722440+0000","last_active":"2023-10-08T00:25:37.725308+0000","last_peered":"2023-10-08T00:25:37.725308+0000","last_clean":"2023-10-08T00:25:37.725308+0000","last_became_active":"2023-10-08T00:25:37.722114+0000","last_became_peered":"2023-10-08T00:25:37.722114+0000","last_unstale":"2023-10-08T00:25:37.725308+0000","last_undegraded":"2023-10-08T00:25:37.725308+0000","last_fullsized":"2023-10-08T00:25:37.725308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709019+0000","last_change":"2023-10-08T00:25:36.710889+0000","last_active":"2023-10-08T00:25:37.709019+0000","last_peered":"2023-10-08T00:25:37.709019+0000","last_clean":"2023-10-08T00:25:37.709019+0000","last_became_active":"2023-10-08T00:25:36.710598+0000","last_became_peered":"2023-10-08T00:25:36.710598+0000","last_unstale":"2023-10-08T00:25:37.709019+0000","last_undegraded":"2023-10-08T00:25:37.709019+0000","last_fullsized":"2023-10-08T00:25:37.709019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:07.181539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712108+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:25:37.712108+0000","last_peered":"2023-10-08T00:25:37.712108+0000","last_clean":"2023-10-08T00:25:37.712108+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:25:37.712108+0000","last_undegraded":"2023-10-08T00:25:37.712108+0000","last_fullsized":"2023-10-08T00:25:37.712108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":132673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":139931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":139931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:42.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T00:25:42.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.745+0000 7fe5adb5b700 1 Processor -- start 2023-10-08T00:25:42.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.745+0000 7fe5adb5b700 1 -- start start 2023-10-08T00:25:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5adb5b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe5a8156770 0x7fe5a80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5adb5b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a80ad9b0 0x7fe5a80b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5adb5b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a80c9810 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5adb5b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a80c9680 con 0x7fe5a8156770 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5adb5b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80adf80 con 0x7fe5a80ad9b0 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe5a8156770 0x7fe5a80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe5a8156770 0x7fe5a80b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59744/0 (socket says 172.21.15.22:59744) 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 -- 172.21.15.22:0/523630986 learned_addr learned my addr 172.21.15.22:0/523630986 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a6ffd700 1 --2- 172.21.15.22:0/523630986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a80ad9b0 0x7fe5a80b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 -- 172.21.15.22:0/523630986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a80ad9b0 msgr2=0x7fe5a80b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 --2- 172.21.15.22:0/523630986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a80ad9b0 0x7fe5a80b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 -- 172.21.15.22:0/523630986 >> v1:172.21.15.192:6789/0 conn(0x7fe5a80c9ca0 legacy=0x7fe5a80ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 -- 172.21.15.22:0/523630986 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80ae260 con 0x7fe5a8156770 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.746+0000 7fe5a77fe700 1 --2- 172.21.15.22:0/523630986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a8156770 0x7fe5a80b0bd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe5980099b0 tx=0x7fe598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afa194ea73fcfb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5a67fc700 1 -- 172.21.15.22:0/523630986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800b860 con 0x7fe5a8156770 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5a67fc700 1 -- 172.21.15.22:0/523630986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59800b9c0 con 0x7fe5a8156770 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5a67fc700 1 -- 172.21.15.22:0/523630986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800bd60 con 0x7fe5a8156770 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 -- 172.21.15.22:0/523630986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a8156770 msgr2=0x7fe5a80b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/523630986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a8156770 0x7fe5a80b0bd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe5980099b0 tx=0x7fe598009250 comp rx=0 tx=0).stop 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 -- 172.21.15.22:0/523630986 shutdown_connections 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/523630986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a8156770 0x7fe5a80b0bd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/523630986 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a80ad9b0 0x7fe5a80b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 -- 172.21.15.22:0/523630986 >> 172.21.15.22:0/523630986 conn(0x7fe5a806a310 msgr2=0x7fe5a80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 -- 172.21.15.22:0/523630986 shutdown_connections 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.747+0000 7fe5adb5b700 1 -- 172.21.15.22:0/523630986 wait complete. 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.748+0000 7fe5adb5b700 1 Processor -- start 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.748+0000 7fe5adb5b700 1 -- start start 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5adb5b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a80ad9b0 0x7fe5a8152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5adb5b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 0x7fe5a81688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5adb5b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a8156770 0x7fe5a80c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5adb5b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80c8f60 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5adb5b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81543e0 con 0x7fe5a80ad9b0 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5adb5b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a8168450 con 0x7fe5a8156770 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5a6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 0x7fe5a81688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5a6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 0x7fe5a81688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59746/0 (socket says 172.21.15.22:59746) 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5a6ffd700 1 -- 172.21.15.22:0/2956273859 learned_addr learned my addr 172.21.15.22:0/2956273859 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5a77fe700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a80ad9b0 0x7fe5a8152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.749+0000 7fe5a7fff700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a8156770 0x7fe5a80c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5a6ffd700 1 -- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a8156770 msgr2=0x7fe5a80c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5a6ffd700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a8156770 0x7fe5a80c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5a6ffd700 1 -- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a80ad9b0 msgr2=0x7fe5a8152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5a6ffd700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a80ad9b0 0x7fe5a8152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5a6ffd700 1 -- 172.21.15.22:0/2956273859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980094f0 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5a6ffd700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 0x7fe5a81688e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00d890 tx=0x7fe59c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0125f0 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c012770 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a8154630 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c012b30 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.750+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a81680e0 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.751+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a804c3c0 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.751+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe59c01e460 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.752+0000 7fe58f7fe700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe594066f30 0x7fe5940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:42.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.752+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe59c084ab0 con 0x7fe5a80c9ca0 2023-10-08T00:25:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.752+0000 7fe5a77fe700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe594066f30 0x7fe5940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.752+0000 7fe5a77fe700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe594066f30 0x7fe5940693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe5980099b0 tx=0x7fe598017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:42.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:42.756+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe59c051d20 con 0x7fe5a80c9ca0 2023-10-08T00:25:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.027+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe5a80ae540 con 0x7fe5a80c9ca0 2023-10-08T00:25:43.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.028+0000 7fe58f7fe700 1 -- 172.21.15.22:0/2956273859 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2627 (secure 0 0 0) 0x7fe59c055340 con 0x7fe5a80c9ca0 2023-10-08T00:25:43.028 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:43.029 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1696724684,"num_in_osds":8,"osd_in_since":1696724677,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592674,"bytes_used":2439507968,"bytes_avail":770654605312,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4923}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-10-08T00:25:42.394678+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T00:25:43.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe594066f30 msgr2=0x7fe5940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe594066f30 0x7fe5940693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe5980099b0 tx=0x7fe598017000 comp rx=0 tx=0).stop 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 msgr2=0x7fe5a81688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 0x7fe5a81688e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe59c00d890 tx=0x7fe59c008040 comp rx=0 tx=0).stop 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 shutdown_connections 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe594066f30 0x7fe5940693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe5a8156770 0x7fe5a80c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5a80ad9b0 0x7fe5a8152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 --2- 172.21.15.22:0/2956273859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5a80c9ca0 0x7fe5a81688e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 >> 172.21.15.22:0/2956273859 conn(0x7fe5a806a310 msgr2=0x7fe5a8155560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 shutdown_connections 2023-10-08T00:25:43.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.030+0000 7fe5adb5b700 1 -- 172.21.15.22:0/2956273859 wait complete. 2023-10-08T00:25:43.042 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T00:25:43.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.161+0000 7fb40877a700 1 Processor -- start 2023-10-08T00:25:43.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.161+0000 7fb40877a700 1 -- start start 2023-10-08T00:25:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb40877a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159c60 0x7fb40015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb40877a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb40015db10 0x7fb400069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:43.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb40877a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40015a160 con 0x7fb400159890 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb40877a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000d13a0 con 0x7fb40015db10 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb40877a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40015e140 con 0x7fb400159c60 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb406d17700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb40015db10 0x7fb400069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb406516700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb400159890 0x7fb40015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50316/0 (socket says 172.21.15.22:50316) 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.162+0000 7fb406516700 1 -- 172.21.15.22:0/2919323677 learned_addr learned my addr 172.21.15.22:0/2919323677 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb405d15700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159c60 0x7fb40015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb406d17700 1 -- 172.21.15.22:0/2919323677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159c60 msgr2=0x7fb40015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb406d17700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159c60 0x7fb40015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb406d17700 1 -- 172.21.15.22:0/2919323677 >> v1:172.21.15.22:6789/0 conn(0x7fb400159890 legacy=0x7fb40015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb406d17700 1 -- 172.21.15.22:0/2919323677 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40015a3d0 con 0x7fb40015db10 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb405514700 1 -- 172.21.15.22:0/2919323677 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089467788 0 0) 0x7fb40015a160 con 0x7fb400159890 2023-10-08T00:25:43.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb405d15700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159c60 0x7fb40015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb406d17700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb400069560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009e60 tx=0x7fb3f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e562890a3a9f7851 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb405514700 1 -- 172.21.15.22:0/2919323677 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800e070 con 0x7fb40015db10 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb405514700 1 -- 172.21.15.22:0/2919323677 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800bc30 con 0x7fb40015db10 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.163+0000 7fb405514700 1 -- 172.21.15.22:0/2919323677 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8012430 con 0x7fb40015db10 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 -- 172.21.15.22:0/2919323677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 msgr2=0x7fb400069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb400069560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009e60 tx=0x7fb3f8009780 comp rx=0 tx=0).stop 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 -- 172.21.15.22:0/2919323677 shutdown_connections 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb400069560 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 --2- 172.21.15.22:0/2919323677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159c60 0x7fb40015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 -- 172.21.15.22:0/2919323677 >> 172.21.15.22:0/2919323677 conn(0x7fb400068e20 msgr2=0x7fb4000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:43.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 -- 172.21.15.22:0/2919323677 shutdown_connections 2023-10-08T00:25:43.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.164+0000 7fb40877a700 1 -- 172.21.15.22:0/2919323677 wait complete. 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.165+0000 7fb40877a700 1 Processor -- start 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.165+0000 7fb40877a700 1 -- start start 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159890 0x7fb400150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb400159c60 0x7fb4000cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb40014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4000cfec0 con 0x7fb40015db10 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40015b700 con 0x7fb400159c60 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb400150820 con 0x7fb400159890 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb40014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:43.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb40014eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59766/0 (socket says 172.21.15.22:59766) 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 -- 172.21.15.22:0/514355775 learned_addr learned my addr 172.21.15.22:0/514355775 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 -- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159890 msgr2=0x7fb400150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159890 0x7fb400150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 -- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb400159c60 msgr2=0x7fb4000cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb400159c60 0x7fb4000cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 -- 172.21.15.22:0/514355775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009a20 con 0x7fb40015db10 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb406d17700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb40014eeb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8013000 tx=0x7fb3f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f801e630 con 0x7fb40015db10 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f801e790 con 0x7fb40015db10 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb400150b00 con 0x7fb40015db10 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f801eb50 con 0x7fb40015db10 2023-10-08T00:25:43.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.166+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40014f3f0 con 0x7fb40015db10 2023-10-08T00:25:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.167+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb400151020 con 0x7fb40015db10 2023-10-08T00:25:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.168+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3f8024070 con 0x7fb40015db10 2023-10-08T00:25:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.168+0000 7fb3fe7fc700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb3ec066f30 0x7fb3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.168+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb3f8086f50 con 0x7fb40015db10 2023-10-08T00:25:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.168+0000 7fb406516700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb3ec066f30 0x7fb3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:43.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.169+0000 7fb406516700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb3ec066f30 0x7fb3ec0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00011e0 tx=0x7fb3f00079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:43.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.172+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb400151020 con 0x7fb40015db10 2023-10-08T00:25:43.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.363+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb40015b4d0 con 0x7fb3ec066f30 2023-10-08T00:25:43.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.371+0000 7fb3fe7fc700 1 -- 172.21.15.22:0/514355775 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264593 (secure 0 0 0) 0x7fb40015b4d0 con 0x7fb3ec066f30 2023-10-08T00:25:43.374 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.374+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb3ec066f30 msgr2=0x7fb3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.374+0000 7fb40877a700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb3ec066f30 0x7fb3ec0693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00011e0 tx=0x7fb3f00079d0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.374+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 msgr2=0x7fb40014eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb40014eeb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8013000 tx=0x7fb3f8019000 comp rx=0 tx=0).stop 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 shutdown_connections 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb40015db10 0x7fb40014eeb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb3ec066f30 0x7fb3ec0693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb400159890 0x7fb400150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 --2- 172.21.15.22:0/514355775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb400159c60 0x7fb4000cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 >> 172.21.15.22:0/514355775 conn(0x7fb400068e20 msgr2=0x7fb400157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 shutdown_connections 2023-10-08T00:25:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:43.375+0000 7fb40877a700 1 -- 172.21.15.22:0/514355775 wait complete. 2023-10-08T00:25:43.378 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:43.387 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-10-08T00:25:42.394331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382332,"kb_used_data":4028,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592388,"statfs":{"total":773094113280,"available":770654605312,"internally_reserved":0,"allocated":4124672,"data_stored":2286044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001040"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724742+0000","last_change":"2023-10-08T00:25:37.720558+0000","last_active":"2023-10-08T00:25:37.724742+0000","last_peered":"2023-10-08T00:25:37.724742+0000","last_clean":"2023-10-08T00:25:37.724742+0000","last_became_active":"2023-10-08T00:25:37.720097+0000","last_became_peered":"2023-10-08T00:25:37.720097+0000","last_unstale":"2023-10-08T00:25:37.724742+0000","last_undegraded":"2023-10-08T00:25:37.724742+0000","last_fullsized":"2023-10-08T00:25:37.724742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:28.929571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726161+0000","last_change":"2023-10-08T00:25:37.716993+0000","last_active":"2023-10-08T00:25:37.726161+0000","last_peered":"2023-10-08T00:25:37.726161+0000","last_clean":"2023-10-08T00:25:37.726161+0000","last_became_active":"2023-10-08T00:25:37.716701+0000","last_became_peered":"2023-10-08T00:25:37.716701+0000","last_unstale":"2023-10-08T00:25:37.726161+0000","last_undegraded":"2023-10-08T00:25:37.726161+0000","last_fullsized":"2023-10-08T00:25:37.726161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728107+0000","last_change":"2023-10-08T00:25:37.719808+0000","last_active":"2023-10-08T00:25:37.728107+0000","last_peered":"2023-10-08T00:25:37.728107+0000","last_clean":"2023-10-08T00:25:37.728107+0000","last_became_active":"2023-10-08T00:25:37.719535+0000","last_became_peered":"2023-10-08T00:25:37.719535+0000","last_unstale":"2023-10-08T00:25:37.728107+0000","last_undegraded":"2023-10-08T00:25:37.728107+0000","last_fullsized":"2023-10-08T00:25:37.728107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.716079+0000","last_change":"2023-10-08T00:25:37.706709+0000","last_active":"2023-10-08T00:25:37.716079+0000","last_peered":"2023-10-08T00:25:37.716079+0000","last_clean":"2023-10-08T00:25:37.716079+0000","last_became_active":"2023-10-08T00:25:37.706370+0000","last_became_peered":"2023-10-08T00:25:37.706370+0000","last_unstale":"2023-10-08T00:25:37.716079+0000","last_undegraded":"2023-10-08T00:25:37.716079+0000","last_fullsized":"2023-10-08T00:25:37.716079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725605+0000","last_change":"2023-10-08T00:25:37.724898+0000","last_active":"2023-10-08T00:25:37.725605+0000","last_peered":"2023-10-08T00:25:37.725605+0000","last_clean":"2023-10-08T00:25:37.725605+0000","last_became_active":"2023-10-08T00:25:37.724611+0000","last_became_peered":"2023-10-08T00:25:37.724611+0000","last_unstale":"2023-10-08T00:25:37.725605+0000","last_undegraded":"2023-10-08T00:25:37.725605+0000","last_fullsized":"2023-10-08T00:25:37.725605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:40.085288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726377+0000","last_change":"2023-10-08T00:25:37.717245+0000","last_active":"2023-10-08T00:25:37.726377+0000","last_peered":"2023-10-08T00:25:37.726377+0000","last_clean":"2023-10-08T00:25:37.726377+0000","last_became_active":"2023-10-08T00:25:37.716986+0000","last_became_peered":"2023-10-08T00:25:37.716986+0000","last_unstale":"2023-10-08T00:25:37.726377+0000","last_undegraded":"2023-10-08T00:25:37.726377+0000","last_fullsized":"2023-10-08T00:25:37.726377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:46:12.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726265+0000","last_change":"2023-10-08T00:25:37.722639+0000","last_active":"2023-10-08T00:25:37.726265+0000","last_peered":"2023-10-08T00:25:37.726265+0000","last_clean":"2023-10-08T00:25:37.726265+0000","last_became_active":"2023-10-08T00:25:37.722366+0000","last_became_peered":"2023-10-08T00:25:37.722366+0000","last_unstale":"2023-10-08T00:25:37.726265+0000","last_undegraded":"2023-10-08T00:25:37.726265+0000","last_fullsized":"2023-10-08T00:25:37.726265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725543+0000","last_change":"2023-10-08T00:25:37.723182+0000","last_active":"2023-10-08T00:25:37.725543+0000","last_peered":"2023-10-08T00:25:37.725543+0000","last_clean":"2023-10-08T00:25:37.725543+0000","last_became_active":"2023-10-08T00:25:37.721984+0000","last_became_peered":"2023-10-08T00:25:37.721984+0000","last_unstale":"2023-10-08T00:25:37.725543+0000","last_undegraded":"2023-10-08T00:25:37.725543+0000","last_fullsized":"2023-10-08T00:25:37.725543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:54.865104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721615+0000","last_change":"2023-10-08T00:25:37.717020+0000","last_active":"2023-10-08T00:25:37.721615+0000","last_peered":"2023-10-08T00:25:37.721615+0000","last_clean":"2023-10-08T00:25:37.721615+0000","last_became_active":"2023-10-08T00:25:37.716714+0000","last_became_peered":"2023-10-08T00:25:37.716714+0000","last_unstale":"2023-10-08T00:25:37.721615+0000","last_undegraded":"2023-10-08T00:25:37.721615+0000","last_fullsized":"2023-10-08T00:25:37.721615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:19.623379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719332+0000","last_change":"2023-10-08T00:25:37.717681+0000","last_active":"2023-10-08T00:25:37.719332+0000","last_peered":"2023-10-08T00:25:37.719332+0000","last_clean":"2023-10-08T00:25:37.719332+0000","last_became_active":"2023-10-08T00:25:37.717431+0000","last_became_peered":"2023-10-08T00:25:37.717431+0000","last_unstale":"2023-10-08T00:25:37.719332+0000","last_undegraded":"2023-10-08T00:25:37.719332+0000","last_fullsized":"2023-10-08T00:25:37.719332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726177+0000","last_change":"2023-10-08T00:25:37.723217+0000","last_active":"2023-10-08T00:25:37.726177+0000","last_peered":"2023-10-08T00:25:37.726177+0000","last_clean":"2023-10-08T00:25:37.726177+0000","last_became_active":"2023-10-08T00:25:37.722930+0000","last_became_peered":"2023-10-08T00:25:37.722930+0000","last_unstale":"2023-10-08T00:25:37.726177+0000","last_undegraded":"2023-10-08T00:25:37.726177+0000","last_fullsized":"2023-10-08T00:25:37.726177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:46:12.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728178+0000","last_change":"2023-10-08T00:25:37.724229+0000","last_active":"2023-10-08T00:25:37.728178+0000","last_peered":"2023-10-08T00:25:37.728178+0000","last_clean":"2023-10-08T00:25:37.728178+0000","last_became_active":"2023-10-08T00:25:37.723929+0000","last_became_peered":"2023-10-08T00:25:37.723929+0000","last_unstale":"2023-10-08T00:25:37.728178+0000","last_undegraded":"2023-10-08T00:25:37.728178+0000","last_fullsized":"2023-10-08T00:25:37.728178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:54.865104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.720727+0000","last_change":"2023-10-08T00:25:37.717836+0000","last_active":"2023-10-08T00:25:37.720727+0000","last_peered":"2023-10-08T00:25:37.720727+0000","last_clean":"2023-10-08T00:25:37.720727+0000","last_became_active":"2023-10-08T00:25:37.717573+0000","last_became_peered":"2023-10-08T00:25:37.717573+0000","last_unstale":"2023-10-08T00:25:37.720727+0000","last_undegraded":"2023-10-08T00:25:37.720727+0000","last_fullsized":"2023-10-08T00:25:37.720727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:45.717834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731192+0000","last_change":"2023-10-08T00:25:37.729358+0000","last_active":"2023-10-08T00:25:37.731192+0000","last_peered":"2023-10-08T00:25:37.731192+0000","last_clean":"2023-10-08T00:25:37.731192+0000","last_became_active":"2023-10-08T00:25:37.729096+0000","last_became_peered":"2023-10-08T00:25:37.729096+0000","last_unstale":"2023-10-08T00:25:37.731192+0000","last_undegraded":"2023-10-08T00:25:37.731192+0000","last_fullsized":"2023-10-08T00:25:37.731192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:05:10.905563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725710+0000","last_change":"2023-10-08T00:25:37.714420+0000","last_active":"2023-10-08T00:25:37.725710+0000","last_peered":"2023-10-08T00:25:37.725710+0000","last_clean":"2023-10-08T00:25:37.725710+0000","last_became_active":"2023-10-08T00:25:37.714173+0000","last_became_peered":"2023-10-08T00:25:37.714173+0000","last_unstale":"2023-10-08T00:25:37.725710+0000","last_undegraded":"2023-10-08T00:25:37.725710+0000","last_fullsized":"2023-10-08T00:25:37.725710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732614+0000","last_change":"2023-10-08T00:25:37.731177+0000","last_active":"2023-10-08T00:25:37.732614+0000","last_peered":"2023-10-08T00:25:37.732614+0000","last_clean":"2023-10-08T00:25:37.732614+0000","last_became_active":"2023-10-08T00:25:37.731002+0000","last_became_peered":"2023-10-08T00:25:37.731002+0000","last_unstale":"2023-10-08T00:25:37.732614+0000","last_undegraded":"2023-10-08T00:25:37.732614+0000","last_fullsized":"2023-10-08T00:25:37.732614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729794+0000","last_change":"2023-10-08T00:25:37.725720+0000","last_active":"2023-10-08T00:25:37.729794+0000","last_peered":"2023-10-08T00:25:37.729794+0000","last_clean":"2023-10-08T00:25:37.729794+0000","last_became_active":"2023-10-08T00:25:37.725426+0000","last_became_peered":"2023-10-08T00:25:37.725426+0000","last_unstale":"2023-10-08T00:25:37.729794+0000","last_undegraded":"2023-10-08T00:25:37.729794+0000","last_fullsized":"2023-10-08T00:25:37.729794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:16.755300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728825+0000","last_change":"2023-10-08T00:25:37.723052+0000","last_active":"2023-10-08T00:25:37.728825+0000","last_peered":"2023-10-08T00:25:37.728825+0000","last_clean":"2023-10-08T00:25:37.728825+0000","last_became_active":"2023-10-08T00:25:37.722528+0000","last_became_peered":"2023-10-08T00:25:37.722528+0000","last_unstale":"2023-10-08T00:25:37.728825+0000","last_undegraded":"2023-10-08T00:25:37.728825+0000","last_fullsized":"2023-10-08T00:25:37.728825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:50.117104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728731+0000","last_change":"2023-10-08T00:25:37.722724+0000","last_active":"2023-10-08T00:25:37.728731+0000","last_peered":"2023-10-08T00:25:37.728731+0000","last_clean":"2023-10-08T00:25:37.728731+0000","last_became_active":"2023-10-08T00:25:37.722401+0000","last_became_peered":"2023-10-08T00:25:37.722401+0000","last_unstale":"2023-10-08T00:25:37.728731+0000","last_undegraded":"2023-10-08T00:25:37.728731+0000","last_fullsized":"2023-10-08T00:25:37.728731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:05.235836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719749+0000","last_change":"2023-10-08T00:25:37.714600+0000","last_active":"2023-10-08T00:25:37.719749+0000","last_peered":"2023-10-08T00:25:37.719749+0000","last_clean":"2023-10-08T00:25:37.719749+0000","last_became_active":"2023-10-08T00:25:37.714377+0000","last_became_peered":"2023-10-08T00:25:37.714377+0000","last_unstale":"2023-10-08T00:25:37.719749+0000","last_undegraded":"2023-10-08T00:25:37.719749+0000","last_fullsized":"2023-10-08T00:25:37.719749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:40:15.902819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721892+0000","last_change":"2023-10-08T00:25:37.717470+0000","last_active":"2023-10-08T00:25:37.721892+0000","last_peered":"2023-10-08T00:25:37.721892+0000","last_clean":"2023-10-08T00:25:37.721892+0000","last_became_active":"2023-10-08T00:25:37.717051+0000","last_became_peered":"2023-10-08T00:25:37.717051+0000","last_unstale":"2023-10-08T00:25:37.721892+0000","last_undegraded":"2023-10-08T00:25:37.721892+0000","last_fullsized":"2023-10-08T00:25:37.721892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:31.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726044+0000","last_change":"2023-10-08T00:25:37.724278+0000","last_active":"2023-10-08T00:25:37.726044+0000","last_peered":"2023-10-08T00:25:37.726044+0000","last_clean":"2023-10-08T00:25:37.726044+0000","last_became_active":"2023-10-08T00:25:37.723991+0000","last_became_peered":"2023-10-08T00:25:37.723991+0000","last_unstale":"2023-10-08T00:25:37.726044+0000","last_undegraded":"2023-10-08T00:25:37.726044+0000","last_fullsized":"2023-10-08T00:25:37.726044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:57.571056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725709+0000","last_change":"2023-10-08T00:25:37.722900+0000","last_active":"2023-10-08T00:25:37.725709+0000","last_peered":"2023-10-08T00:25:37.725709+0000","last_clean":"2023-10-08T00:25:37.725709+0000","last_became_active":"2023-10-08T00:25:37.722596+0000","last_became_peered":"2023-10-08T00:25:37.722596+0000","last_unstale":"2023-10-08T00:25:37.725709+0000","last_undegraded":"2023-10-08T00:25:37.725709+0000","last_fullsized":"2023-10-08T00:25:37.725709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727378+0000","last_change":"2023-10-08T00:25:37.716470+0000","last_active":"2023-10-08T00:25:37.727378+0000","last_peered":"2023-10-08T00:25:37.727378+0000","last_clean":"2023-10-08T00:25:37.727378+0000","last_became_active":"2023-10-08T00:25:37.715209+0000","last_became_peered":"2023-10-08T00:25:37.715209+0000","last_unstale":"2023-10-08T00:25:37.727378+0000","last_undegraded":"2023-10-08T00:25:37.727378+0000","last_fullsized":"2023-10-08T00:25:37.727378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728337+0000","last_change":"2023-10-08T00:25:37.727689+0000","last_active":"2023-10-08T00:25:37.728337+0000","last_peered":"2023-10-08T00:25:37.728337+0000","last_clean":"2023-10-08T00:25:37.728337+0000","last_became_active":"2023-10-08T00:25:37.727312+0000","last_became_peered":"2023-10-08T00:25:37.727312+0000","last_unstale":"2023-10-08T00:25:37.728337+0000","last_undegraded":"2023-10-08T00:25:37.728337+0000","last_fullsized":"2023-10-08T00:25:37.728337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731468+0000","last_change":"2023-10-08T00:25:37.729710+0000","last_active":"2023-10-08T00:25:37.731468+0000","last_peered":"2023-10-08T00:25:37.731468+0000","last_clean":"2023-10-08T00:25:37.731468+0000","last_became_active":"2023-10-08T00:25:37.729416+0000","last_became_peered":"2023-10-08T00:25:37.729416+0000","last_unstale":"2023-10-08T00:25:37.731468+0000","last_undegraded":"2023-10-08T00:25:37.731468+0000","last_fullsized":"2023-10-08T00:25:37.731468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:05:56.209299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718369+0000","last_change":"2023-10-08T00:25:37.709339+0000","last_active":"2023-10-08T00:25:37.718369+0000","last_peered":"2023-10-08T00:25:37.718369+0000","last_clean":"2023-10-08T00:25:37.718369+0000","last_became_active":"2023-10-08T00:25:37.708668+0000","last_became_peered":"2023-10-08T00:25:37.708668+0000","last_unstale":"2023-10-08T00:25:37.718369+0000","last_undegraded":"2023-10-08T00:25:37.718369+0000","last_fullsized":"2023-10-08T00:25:37.718369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726672+0000","last_change":"2023-10-08T00:25:37.715556+0000","last_active":"2023-10-08T00:25:37.726672+0000","last_peered":"2023-10-08T00:25:37.726672+0000","last_clean":"2023-10-08T00:25:37.726672+0000","last_became_active":"2023-10-08T00:25:37.715157+0000","last_became_peered":"2023-10-08T00:25:37.715157+0000","last_unstale":"2023-10-08T00:25:37.726672+0000","last_undegraded":"2023-10-08T00:25:37.726672+0000","last_fullsized":"2023-10-08T00:25:37.726672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727585+0000","last_change":"2023-10-08T00:25:37.725428+0000","last_active":"2023-10-08T00:25:37.727585+0000","last_peered":"2023-10-08T00:25:37.727585+0000","last_clean":"2023-10-08T00:25:37.727585+0000","last_became_active":"2023-10-08T00:25:37.724949+0000","last_became_peered":"2023-10-08T00:25:37.724949+0000","last_unstale":"2023-10-08T00:25:37.727585+0000","last_undegraded":"2023-10-08T00:25:37.727585+0000","last_fullsized":"2023-10-08T00:25:37.727585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:23:35.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725201+0000","last_change":"2023-10-08T00:25:37.723122+0000","last_active":"2023-10-08T00:25:37.725201+0000","last_peered":"2023-10-08T00:25:37.725201+0000","last_clean":"2023-10-08T00:25:37.725201+0000","last_became_active":"2023-10-08T00:25:37.722828+0000","last_became_peered":"2023-10-08T00:25:37.722828+0000","last_unstale":"2023-10-08T00:25:37.725201+0000","last_undegraded":"2023-10-08T00:25:37.725201+0000","last_fullsized":"2023-10-08T00:25:37.725201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.722271+0000","last_change":"2023-10-08T00:25:37.718268+0000","last_active":"2023-10-08T00:25:37.722271+0000","last_peered":"2023-10-08T00:25:37.722271+0000","last_clean":"2023-10-08T00:25:37.722271+0000","last_became_active":"2023-10-08T00:25:37.717992+0000","last_became_peered":"2023-10-08T00:25:37.717992+0000","last_unstale":"2023-10-08T00:25:37.722271+0000","last_undegraded":"2023-10-08T00:25:37.722271+0000","last_fullsized":"2023-10-08T00:25:37.722271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:31.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732203+0000","last_change":"2023-10-08T00:25:37.727267+0000","last_active":"2023-10-08T00:25:37.732203+0000","last_peered":"2023-10-08T00:25:37.732203+0000","last_clean":"2023-10-08T00:25:37.732203+0000","last_became_active":"2023-10-08T00:25:37.726818+0000","last_became_peered":"2023-10-08T00:25:37.726818+0000","last_unstale":"2023-10-08T00:25:37.732203+0000","last_undegraded":"2023-10-08T00:25:37.732203+0000","last_fullsized":"2023-10-08T00:25:37.732203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725719+0000","last_change":"2023-10-08T00:25:37.723012+0000","last_active":"2023-10-08T00:25:37.725719+0000","last_peered":"2023-10-08T00:25:37.725719+0000","last_clean":"2023-10-08T00:25:37.725719+0000","last_became_active":"2023-10-08T00:25:37.722757+0000","last_became_peered":"2023-10-08T00:25:37.722757+0000","last_unstale":"2023-10-08T00:25:37.725719+0000","last_undegraded":"2023-10-08T00:25:37.725719+0000","last_fullsized":"2023-10-08T00:25:37.725719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:23:35.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728049+0000","last_change":"2023-10-08T00:25:36.709162+0000","last_active":"2023-10-08T00:25:37.728049+0000","last_peered":"2023-10-08T00:25:37.728049+0000","last_clean":"2023-10-08T00:25:37.728049+0000","last_became_active":"2023-10-08T00:25:36.708913+0000","last_became_peered":"2023-10-08T00:25:36.708913+0000","last_unstale":"2023-10-08T00:25:37.728049+0000","last_undegraded":"2023-10-08T00:25:37.728049+0000","last_fullsized":"2023-10-08T00:25:37.728049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:03.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724723+0000","last_change":"2023-10-08T00:25:37.720120+0000","last_active":"2023-10-08T00:25:37.724723+0000","last_peered":"2023-10-08T00:25:37.724723+0000","last_clean":"2023-10-08T00:25:37.724723+0000","last_became_active":"2023-10-08T00:25:37.719871+0000","last_became_peered":"2023-10-08T00:25:37.719871+0000","last_unstale":"2023-10-08T00:25:37.724723+0000","last_undegraded":"2023-10-08T00:25:37.724723+0000","last_fullsized":"2023-10-08T00:25:37.724723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:14.444743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714485+0000","last_change":"2023-10-08T00:25:36.711782+0000","last_active":"2023-10-08T00:25:37.714485+0000","last_peered":"2023-10-08T00:25:37.714485+0000","last_clean":"2023-10-08T00:25:37.714485+0000","last_became_active":"2023-10-08T00:25:36.711508+0000","last_became_peered":"2023-10-08T00:25:36.711508+0000","last_unstale":"2023-10-08T00:25:37.714485+0000","last_undegraded":"2023-10-08T00:25:37.714485+0000","last_fullsized":"2023-10-08T00:25:37.714485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:39.078979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726845+0000","last_change":"2023-10-08T00:25:37.724580+0000","last_active":"2023-10-08T00:25:37.726845+0000","last_peered":"2023-10-08T00:25:37.726845+0000","last_clean":"2023-10-08T00:25:37.726845+0000","last_became_active":"2023-10-08T00:25:37.724153+0000","last_became_peered":"2023-10-08T00:25:37.724153+0000","last_unstale":"2023-10-08T00:25:37.726845+0000","last_undegraded":"2023-10-08T00:25:37.726845+0000","last_fullsized":"2023-10-08T00:25:37.726845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:27:48.211667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728678+0000","last_change":"2023-10-08T00:25:36.718742+0000","last_active":"2023-10-08T00:25:37.728678+0000","last_peered":"2023-10-08T00:25:37.728678+0000","last_clean":"2023-10-08T00:25:37.728678+0000","last_became_active":"2023-10-08T00:25:36.718410+0000","last_became_peered":"2023-10-08T00:25:36.718410+0000","last_unstale":"2023-10-08T00:25:37.728678+0000","last_undegraded":"2023-10-08T00:25:37.728678+0000","last_fullsized":"2023-10-08T00:25:37.728678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:27.923263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718351+0000","last_change":"2023-10-08T00:25:37.708920+0000","last_active":"2023-10-08T00:25:37.718351+0000","last_peered":"2023-10-08T00:25:37.718351+0000","last_clean":"2023-10-08T00:25:37.718351+0000","last_became_active":"2023-10-08T00:25:37.708322+0000","last_became_peered":"2023-10-08T00:25:37.708322+0000","last_unstale":"2023-10-08T00:25:37.718351+0000","last_undegraded":"2023-10-08T00:25:37.718351+0000","last_fullsized":"2023-10-08T00:25:37.718351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:16.755300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718995+0000","last_change":"2023-10-08T00:25:36.718068+0000","last_active":"2023-10-08T00:25:37.718995+0000","last_peered":"2023-10-08T00:25:37.718995+0000","last_clean":"2023-10-08T00:25:37.718995+0000","last_became_active":"2023-10-08T00:25:36.714439+0000","last_became_peered":"2023-10-08T00:25:36.714439+0000","last_unstale":"2023-10-08T00:25:37.718995+0000","last_undegraded":"2023-10-08T00:25:37.718995+0000","last_fullsized":"2023-10-08T00:25:37.718995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:47:44.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729833+0000","last_change":"2023-10-08T00:25:37.726243+0000","last_active":"2023-10-08T00:25:37.729833+0000","last_peered":"2023-10-08T00:25:37.729833+0000","last_clean":"2023-10-08T00:25:37.729833+0000","last_became_active":"2023-10-08T00:25:37.725983+0000","last_became_peered":"2023-10-08T00:25:37.725983+0000","last_unstale":"2023-10-08T00:25:37.729833+0000","last_undegraded":"2023-10-08T00:25:37.729833+0000","last_fullsized":"2023-10-08T00:25:37.729833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729752+0000","last_change":"2023-10-08T00:25:36.714559+0000","last_active":"2023-10-08T00:25:37.729752+0000","last_peered":"2023-10-08T00:25:37.729752+0000","last_clean":"2023-10-08T00:25:37.729752+0000","last_became_active":"2023-10-08T00:25:36.714260+0000","last_became_peered":"2023-10-08T00:25:36.714260+0000","last_unstale":"2023-10-08T00:25:37.729752+0000","last_undegraded":"2023-10-08T00:25:37.729752+0000","last_fullsized":"2023-10-08T00:25:37.729752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:08:58.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726652+0000","last_change":"2023-10-08T00:25:37.716864+0000","last_active":"2023-10-08T00:25:37.726652+0000","last_peered":"2023-10-08T00:25:37.726652+0000","last_clean":"2023-10-08T00:25:37.726652+0000","last_became_active":"2023-10-08T00:25:37.716577+0000","last_became_peered":"2023-10-08T00:25:37.716577+0000","last_unstale":"2023-10-08T00:25:37.726652+0000","last_undegraded":"2023-10-08T00:25:37.726652+0000","last_fullsized":"2023-10-08T00:25:37.726652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729680+0000","last_change":"2023-10-08T00:25:36.714539+0000","last_active":"2023-10-08T00:25:37.729680+0000","last_peered":"2023-10-08T00:25:37.729680+0000","last_clean":"2023-10-08T00:25:37.729680+0000","last_became_active":"2023-10-08T00:25:36.714273+0000","last_became_peered":"2023-10-08T00:25:36.714273+0000","last_unstale":"2023-10-08T00:25:37.729680+0000","last_undegraded":"2023-10-08T00:25:37.729680+0000","last_fullsized":"2023-10-08T00:25:37.729680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:11.876222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718260+0000","last_change":"2023-10-08T00:25:37.713525+0000","last_active":"2023-10-08T00:25:37.718260+0000","last_peered":"2023-10-08T00:25:37.718260+0000","last_clean":"2023-10-08T00:25:37.718260+0000","last_became_active":"2023-10-08T00:25:37.713217+0000","last_became_peered":"2023-10-08T00:25:37.713217+0000","last_unstale":"2023-10-08T00:25:37.718260+0000","last_undegraded":"2023-10-08T00:25:37.718260+0000","last_fullsized":"2023-10-08T00:25:37.718260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:28.929571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709653+0000","last_change":"2023-10-08T00:25:36.717790+0000","last_active":"2023-10-08T00:25:37.709653+0000","last_peered":"2023-10-08T00:25:37.709653+0000","last_clean":"2023-10-08T00:25:37.709653+0000","last_became_active":"2023-10-08T00:25:36.717498+0000","last_became_peered":"2023-10-08T00:25:36.717498+0000","last_unstale":"2023-10-08T00:25:37.709653+0000","last_undegraded":"2023-10-08T00:25:37.709653+0000","last_fullsized":"2023-10-08T00:25:37.709653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:13.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718512+0000","last_change":"2023-10-08T00:25:37.713748+0000","last_active":"2023-10-08T00:25:37.718512+0000","last_peered":"2023-10-08T00:25:37.718512+0000","last_clean":"2023-10-08T00:25:37.718512+0000","last_became_active":"2023-10-08T00:25:37.713158+0000","last_became_peered":"2023-10-08T00:25:37.713158+0000","last_unstale":"2023-10-08T00:25:37.718512+0000","last_undegraded":"2023-10-08T00:25:37.718512+0000","last_fullsized":"2023-10-08T00:25:37.718512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705556+0000","last_change":"2023-10-08T00:25:36.708148+0000","last_active":"2023-10-08T00:25:37.705556+0000","last_peered":"2023-10-08T00:25:37.705556+0000","last_clean":"2023-10-08T00:25:37.705556+0000","last_became_active":"2023-10-08T00:25:36.707828+0000","last_became_peered":"2023-10-08T00:25:36.707828+0000","last_unstale":"2023-10-08T00:25:37.705556+0000","last_undegraded":"2023-10-08T00:25:37.705556+0000","last_fullsized":"2023-10-08T00:25:37.705556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:20:19.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727699+0000","last_change":"2023-10-08T00:25:37.717617+0000","last_active":"2023-10-08T00:25:37.727699+0000","last_peered":"2023-10-08T00:25:37.727699+0000","last_clean":"2023-10-08T00:25:37.727699+0000","last_became_active":"2023-10-08T00:25:37.717332+0000","last_became_peered":"2023-10-08T00:25:37.717332+0000","last_unstale":"2023-10-08T00:25:37.727699+0000","last_undegraded":"2023-10-08T00:25:37.727699+0000","last_fullsized":"2023-10-08T00:25:37.727699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.710766+0000","last_change":"2023-10-08T00:25:36.720319+0000","last_active":"2023-10-08T00:25:37.710766+0000","last_peered":"2023-10-08T00:25:37.710766+0000","last_clean":"2023-10-08T00:25:37.710766+0000","last_became_active":"2023-10-08T00:25:36.720021+0000","last_became_peered":"2023-10-08T00:25:36.720021+0000","last_unstale":"2023-10-08T00:25:37.710766+0000","last_undegraded":"2023-10-08T00:25:37.710766+0000","last_fullsized":"2023-10-08T00:25:37.710766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:30.610868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728871+0000","last_change":"2023-10-08T00:25:37.725571+0000","last_active":"2023-10-08T00:25:37.728871+0000","last_peered":"2023-10-08T00:25:37.728871+0000","last_clean":"2023-10-08T00:25:37.728871+0000","last_became_active":"2023-10-08T00:25:37.723042+0000","last_became_peered":"2023-10-08T00:25:37.723042+0000","last_unstale":"2023-10-08T00:25:37.728871+0000","last_undegraded":"2023-10-08T00:25:37.728871+0000","last_fullsized":"2023-10-08T00:25:37.728871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:49:37.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.704300+0000","last_change":"2023-10-08T00:25:36.715186+0000","last_active":"2023-10-08T00:25:37.704300+0000","last_peered":"2023-10-08T00:25:37.704300+0000","last_clean":"2023-10-08T00:25:37.704300+0000","last_became_active":"2023-10-08T00:25:36.714763+0000","last_became_peered":"2023-10-08T00:25:36.714763+0000","last_unstale":"2023-10-08T00:25:37.704300+0000","last_undegraded":"2023-10-08T00:25:37.704300+0000","last_fullsized":"2023-10-08T00:25:37.704300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:44.711526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732060+0000","last_change":"2023-10-08T00:25:37.731469+0000","last_active":"2023-10-08T00:25:37.732060+0000","last_peered":"2023-10-08T00:25:37.732060+0000","last_clean":"2023-10-08T00:25:37.732060+0000","last_became_active":"2023-10-08T00:25:37.731201+0000","last_became_peered":"2023-10-08T00:25:37.731201+0000","last_unstale":"2023-10-08T00:25:37.732060+0000","last_undegraded":"2023-10-08T00:25:37.732060+0000","last_fullsized":"2023-10-08T00:25:37.732060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:51.316017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721346+0000","last_change":"2023-10-08T00:25:36.711356+0000","last_active":"2023-10-08T00:25:37.721346+0000","last_peered":"2023-10-08T00:25:37.721346+0000","last_clean":"2023-10-08T00:25:37.721346+0000","last_became_active":"2023-10-08T00:25:36.711042+0000","last_became_peered":"2023-10-08T00:25:36.711042+0000","last_unstale":"2023-10-08T00:25:37.721346+0000","last_undegraded":"2023-10-08T00:25:37.721346+0000","last_fullsized":"2023-10-08T00:25:37.721346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728082+0000","last_change":"2023-10-08T00:25:37.719780+0000","last_active":"2023-10-08T00:25:37.728082+0000","last_peered":"2023-10-08T00:25:37.728082+0000","last_clean":"2023-10-08T00:25:37.728082+0000","last_became_active":"2023-10-08T00:25:37.719465+0000","last_became_peered":"2023-10-08T00:25:37.719465+0000","last_unstale":"2023-10-08T00:25:37.728082+0000","last_undegraded":"2023-10-08T00:25:37.728082+0000","last_fullsized":"2023-10-08T00:25:37.728082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732690+0000","last_change":"2023-10-08T00:25:36.720312+0000","last_active":"2023-10-08T00:25:37.732690+0000","last_peered":"2023-10-08T00:25:37.732690+0000","last_clean":"2023-10-08T00:25:37.732690+0000","last_became_active":"2023-10-08T00:25:36.720036+0000","last_became_peered":"2023-10-08T00:25:36.720036+0000","last_unstale":"2023-10-08T00:25:37.732690+0000","last_undegraded":"2023-10-08T00:25:37.732690+0000","last_fullsized":"2023-10-08T00:25:37.732690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:18.617071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718540+0000","last_change":"2023-10-08T00:25:37.713755+0000","last_active":"2023-10-08T00:25:37.718540+0000","last_peered":"2023-10-08T00:25:37.718540+0000","last_clean":"2023-10-08T00:25:37.718540+0000","last_became_active":"2023-10-08T00:25:37.713441+0000","last_became_peered":"2023-10-08T00:25:37.713441+0000","last_unstale":"2023-10-08T00:25:37.718540+0000","last_undegraded":"2023-10-08T00:25:37.718540+0000","last_fullsized":"2023-10-08T00:25:37.718540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725271+0000","last_change":"2023-10-08T00:25:36.711928+0000","last_active":"2023-10-08T00:25:37.725271+0000","last_peered":"2023-10-08T00:25:37.725271+0000","last_clean":"2023-10-08T00:25:37.725271+0000","last_became_active":"2023-10-08T00:25:36.711654+0000","last_became_peered":"2023-10-08T00:25:36.711654+0000","last_unstale":"2023-10-08T00:25:37.725271+0000","last_undegraded":"2023-10-08T00:25:37.725271+0000","last_fullsized":"2023-10-08T00:25:37.725271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:16:30.013733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726597+0000","last_change":"2023-10-08T00:25:37.718291+0000","last_active":"2023-10-08T00:25:37.726597+0000","last_peered":"2023-10-08T00:25:37.726597+0000","last_clean":"2023-10-08T00:25:37.726597+0000","last_became_active":"2023-10-08T00:25:37.718013+0000","last_became_peered":"2023-10-08T00:25:37.718013+0000","last_unstale":"2023-10-08T00:25:37.726597+0000","last_undegraded":"2023-10-08T00:25:37.726597+0000","last_fullsized":"2023-10-08T00:25:37.726597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.700027+0000","last_change":"2023-10-08T00:25:36.706721+0000","last_active":"2023-10-08T00:25:37.700027+0000","last_peered":"2023-10-08T00:25:37.700027+0000","last_clean":"2023-10-08T00:25:37.700027+0000","last_became_active":"2023-10-08T00:25:36.706450+0000","last_became_peered":"2023-10-08T00:25:36.706450+0000","last_unstale":"2023-10-08T00:25:37.700027+0000","last_undegraded":"2023-10-08T00:25:37.700027+0000","last_fullsized":"2023-10-08T00:25:37.700027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:39.078979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732186+0000","last_change":"2023-10-08T00:25:37.727079+0000","last_active":"2023-10-08T00:25:37.732186+0000","last_peered":"2023-10-08T00:25:37.732186+0000","last_clean":"2023-10-08T00:25:37.732186+0000","last_became_active":"2023-10-08T00:25:37.726505+0000","last_became_peered":"2023-10-08T00:25:37.726505+0000","last_unstale":"2023-10-08T00:25:37.732186+0000","last_undegraded":"2023-10-08T00:25:37.732186+0000","last_fullsized":"2023-10-08T00:25:37.732186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709769+0000","last_change":"2023-10-08T00:25:36.718814+0000","last_active":"2023-10-08T00:25:37.709769+0000","last_peered":"2023-10-08T00:25:37.709769+0000","last_clean":"2023-10-08T00:25:37.709769+0000","last_became_active":"2023-10-08T00:25:36.718506+0000","last_became_peered":"2023-10-08T00:25:36.718506+0000","last_unstale":"2023-10-08T00:25:37.709769+0000","last_undegraded":"2023-10-08T00:25:37.709769+0000","last_fullsized":"2023-10-08T00:25:37.709769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:51.104818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724511+0000","last_change":"2023-10-08T00:25:37.719223+0000","last_active":"2023-10-08T00:25:37.724511+0000","last_peered":"2023-10-08T00:25:37.724511+0000","last_clean":"2023-10-08T00:25:37.724511+0000","last_became_active":"2023-10-08T00:25:37.718939+0000","last_became_peered":"2023-10-08T00:25:37.718939+0000","last_unstale":"2023-10-08T00:25:37.724511+0000","last_undegraded":"2023-10-08T00:25:37.724511+0000","last_fullsized":"2023-10-08T00:25:37.724511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:19.623379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729366+0000","last_change":"2023-10-08T00:25:36.718647+0000","last_active":"2023-10-08T00:25:37.729366+0000","last_peered":"2023-10-08T00:25:37.729366+0000","last_clean":"2023-10-08T00:25:37.729366+0000","last_became_active":"2023-10-08T00:25:36.718381+0000","last_became_peered":"2023-10-08T00:25:36.718381+0000","last_unstale":"2023-10-08T00:25:37.729366+0000","last_undegraded":"2023-10-08T00:25:37.729366+0000","last_fullsized":"2023-10-08T00:25:37.729366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:56.564748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718169+0000","last_change":"2023-10-08T00:25:37.712092+0000","last_active":"2023-10-08T00:25:37.718169+0000","last_peered":"2023-10-08T00:25:37.718169+0000","last_clean":"2023-10-08T00:25:37.718169+0000","last_became_active":"2023-10-08T00:25:37.711818+0000","last_became_peered":"2023-10-08T00:25:37.711818+0000","last_unstale":"2023-10-08T00:25:37.718169+0000","last_undegraded":"2023-10-08T00:25:37.718169+0000","last_fullsized":"2023-10-08T00:25:37.718169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:14.444743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719236+0000","last_change":"2023-10-08T00:25:36.717177+0000","last_active":"2023-10-08T00:25:37.719236+0000","last_peered":"2023-10-08T00:25:37.719236+0000","last_clean":"2023-10-08T00:25:37.719236+0000","last_became_active":"2023-10-08T00:25:36.716873+0000","last_became_peered":"2023-10-08T00:25:36.716873+0000","last_unstale":"2023-10-08T00:25:37.719236+0000","last_undegraded":"2023-10-08T00:25:37.719236+0000","last_fullsized":"2023-10-08T00:25:37.719236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727726+0000","last_change":"2023-10-08T00:25:37.718915+0000","last_active":"2023-10-08T00:25:37.727726+0000","last_peered":"2023-10-08T00:25:37.727726+0000","last_clean":"2023-10-08T00:25:37.727726+0000","last_became_active":"2023-10-08T00:25:37.718659+0000","last_became_peered":"2023-10-08T00:25:37.718659+0000","last_unstale":"2023-10-08T00:25:37.727726+0000","last_undegraded":"2023-10-08T00:25:37.727726+0000","last_fullsized":"2023-10-08T00:25:37.727726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724875+0000","last_change":"2023-10-08T00:25:36.712041+0000","last_active":"2023-10-08T00:25:37.724875+0000","last_peered":"2023-10-08T00:25:37.724875+0000","last_clean":"2023-10-08T00:25:37.724875+0000","last_became_active":"2023-10-08T00:25:36.711765+0000","last_became_peered":"2023-10-08T00:25:36.711765+0000","last_unstale":"2023-10-08T00:25:37.724875+0000","last_undegraded":"2023-10-08T00:25:37.724875+0000","last_fullsized":"2023-10-08T00:25:37.724875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:56:16.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718299+0000","last_change":"2023-10-08T00:25:37.707908+0000","last_active":"2023-10-08T00:25:37.718299+0000","last_peered":"2023-10-08T00:25:37.718299+0000","last_clean":"2023-10-08T00:25:37.718299+0000","last_became_active":"2023-10-08T00:25:37.707495+0000","last_became_peered":"2023-10-08T00:25:37.707495+0000","last_unstale":"2023-10-08T00:25:37.718299+0000","last_undegraded":"2023-10-08T00:25:37.718299+0000","last_fullsized":"2023-10-08T00:25:37.718299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:08.137490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721693+0000","last_change":"2023-10-08T00:25:36.710619+0000","last_active":"2023-10-08T00:25:37.721693+0000","last_peered":"2023-10-08T00:25:37.721693+0000","last_clean":"2023-10-08T00:25:37.721693+0000","last_became_active":"2023-10-08T00:25:36.710333+0000","last_became_peered":"2023-10-08T00:25:36.710333+0000","last_unstale":"2023-10-08T00:25:37.721693+0000","last_undegraded":"2023-10-08T00:25:37.721693+0000","last_fullsized":"2023-10-08T00:25:37.721693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:51.725428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731077+0000","last_change":"2023-10-08T00:25:37.730380+0000","last_active":"2023-10-08T00:25:37.731077+0000","last_peered":"2023-10-08T00:25:37.731077+0000","last_clean":"2023-10-08T00:25:37.731077+0000","last_became_active":"2023-10-08T00:25:37.730118+0000","last_became_peered":"2023-10-08T00:25:37.730118+0000","last_unstale":"2023-10-08T00:25:37.731077+0000","last_undegraded":"2023-10-08T00:25:37.731077+0000","last_fullsized":"2023-10-08T00:25:37.731077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:22.917659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.706093+0000","last_change":"2023-10-08T00:25:36.714762+0000","last_active":"2023-10-08T00:25:37.706093+0000","last_peered":"2023-10-08T00:25:37.706093+0000","last_clean":"2023-10-08T00:25:37.706093+0000","last_became_active":"2023-10-08T00:25:36.714305+0000","last_became_peered":"2023-10-08T00:25:36.714305+0000","last_unstale":"2023-10-08T00:25:37.706093+0000","last_undegraded":"2023-10-08T00:25:37.706093+0000","last_fullsized":"2023-10-08T00:25:37.706093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:03:17.073658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712421+0000","last_change":"2023-10-08T00:25:37.710227+0000","last_active":"2023-10-08T00:25:37.712421+0000","last_peered":"2023-10-08T00:25:37.712421+0000","last_clean":"2023-10-08T00:25:37.712421+0000","last_became_active":"2023-10-08T00:25:37.709979+0000","last_became_peered":"2023-10-08T00:25:37.709979+0000","last_unstale":"2023-10-08T00:25:37.712421+0000","last_undegraded":"2023-10-08T00:25:37.712421+0000","last_fullsized":"2023-10-08T00:25:37.712421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:04.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.720952+0000","last_change":"2023-10-08T00:25:36.708660+0000","last_active":"2023-10-08T00:25:37.720952+0000","last_peered":"2023-10-08T00:25:37.720952+0000","last_clean":"2023-10-08T00:25:37.720952+0000","last_became_active":"2023-10-08T00:25:36.708372+0000","last_became_peered":"2023-10-08T00:25:36.708372+0000","last_unstale":"2023-10-08T00:25:37.720952+0000","last_undegraded":"2023-10-08T00:25:37.720952+0000","last_fullsized":"2023-10-08T00:25:37.720952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721638+0000","last_change":"2023-10-08T00:25:37.719923+0000","last_active":"2023-10-08T00:25:37.721638+0000","last_peered":"2023-10-08T00:25:37.721638+0000","last_clean":"2023-10-08T00:25:37.721638+0000","last_became_active":"2023-10-08T00:25:37.719248+0000","last_became_peered":"2023-10-08T00:25:37.719248+0000","last_unstale":"2023-10-08T00:25:37.721638+0000","last_undegraded":"2023-10-08T00:25:37.721638+0000","last_fullsized":"2023-10-08T00:25:37.721638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:52.731736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709660+0000","last_change":"2023-10-08T00:25:36.708895+0000","last_active":"2023-10-08T00:25:37.709660+0000","last_peered":"2023-10-08T00:25:37.709660+0000","last_clean":"2023-10-08T00:25:37.709660+0000","last_became_active":"2023-10-08T00:25:36.708462+0000","last_became_peered":"2023-10-08T00:25:36.708462+0000","last_unstale":"2023-10-08T00:25:37.709660+0000","last_undegraded":"2023-10-08T00:25:37.709660+0000","last_fullsized":"2023-10-08T00:25:37.709660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:51.725428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719629+0000","last_change":"2023-10-08T00:25:37.716451+0000","last_active":"2023-10-08T00:25:37.719629+0000","last_peered":"2023-10-08T00:25:37.719629+0000","last_clean":"2023-10-08T00:25:37.719629+0000","last_became_active":"2023-10-08T00:25:37.716170+0000","last_became_peered":"2023-10-08T00:25:37.716170+0000","last_unstale":"2023-10-08T00:25:37.719629+0000","last_undegraded":"2023-10-08T00:25:37.719629+0000","last_fullsized":"2023-10-08T00:25:37.719629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:08.187847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705859+0000","last_change":"2023-10-08T00:25:36.715360+0000","last_active":"2023-10-08T00:25:37.705859+0000","last_peered":"2023-10-08T00:25:37.705859+0000","last_clean":"2023-10-08T00:25:37.705859+0000","last_became_active":"2023-10-08T00:25:36.715091+0000","last_became_peered":"2023-10-08T00:25:36.715091+0000","last_unstale":"2023-10-08T00:25:37.705859+0000","last_undegraded":"2023-10-08T00:25:37.705859+0000","last_fullsized":"2023-10-08T00:25:37.705859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:03.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727324+0000","last_change":"2023-10-08T00:25:37.723622+0000","last_active":"2023-10-08T00:25:37.727324+0000","last_peered":"2023-10-08T00:25:37.727324+0000","last_clean":"2023-10-08T00:25:37.727324+0000","last_became_active":"2023-10-08T00:25:37.723092+0000","last_became_peered":"2023-10-08T00:25:37.723092+0000","last_unstale":"2023-10-08T00:25:37.727324+0000","last_undegraded":"2023-10-08T00:25:37.727324+0000","last_fullsized":"2023-10-08T00:25:37.727324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.706399+0000","last_change":"2023-10-08T00:25:36.711926+0000","last_active":"2023-10-08T00:25:37.706399+0000","last_peered":"2023-10-08T00:25:37.706399+0000","last_clean":"2023-10-08T00:25:37.706399+0000","last_became_active":"2023-10-08T00:25:36.711690+0000","last_became_peered":"2023-10-08T00:25:36.711690+0000","last_unstale":"2023-10-08T00:25:37.706399+0000","last_undegraded":"2023-10-08T00:25:37.706399+0000","last_fullsized":"2023-10-08T00:25:37.706399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714924+0000","last_change":"2023-10-08T00:25:37.712252+0000","last_active":"2023-10-08T00:25:37.714924+0000","last_peered":"2023-10-08T00:25:37.714924+0000","last_clean":"2023-10-08T00:25:37.714924+0000","last_became_active":"2023-10-08T00:25:37.711968+0000","last_became_peered":"2023-10-08T00:25:37.711968+0000","last_unstale":"2023-10-08T00:25:37.714924+0000","last_undegraded":"2023-10-08T00:25:37.714924+0000","last_fullsized":"2023-10-08T00:25:37.714924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:41:15.013916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721453+0000","last_change":"2023-10-08T00:25:36.711520+0000","last_active":"2023-10-08T00:25:37.721453+0000","last_peered":"2023-10-08T00:25:37.721453+0000","last_clean":"2023-10-08T00:25:37.721453+0000","last_became_active":"2023-10-08T00:25:36.710780+0000","last_became_peered":"2023-10-08T00:25:36.710780+0000","last_unstale":"2023-10-08T00:25:37.721453+0000","last_undegraded":"2023-10-08T00:25:37.721453+0000","last_fullsized":"2023-10-08T00:25:37.721453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728153+0000","last_change":"2023-10-08T00:25:37.720889+0000","last_active":"2023-10-08T00:25:37.728153+0000","last_peered":"2023-10-08T00:25:37.728153+0000","last_clean":"2023-10-08T00:25:37.728153+0000","last_became_active":"2023-10-08T00:25:37.720152+0000","last_became_peered":"2023-10-08T00:25:37.720152+0000","last_unstale":"2023-10-08T00:25:37.728153+0000","last_undegraded":"2023-10-08T00:25:37.728153+0000","last_fullsized":"2023-10-08T00:25:37.728153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T00:25:39.822657+0000","last_change":"2023-10-08T00:25:36.707046+0000","last_active":"2023-10-08T00:25:39.822657+0000","last_peered":"2023-10-08T00:25:39.822657+0000","last_clean":"2023-10-08T00:25:39.822657+0000","last_became_active":"2023-10-08T00:25:36.706778+0000","last_became_peered":"2023-10-08T00:25:36.706778+0000","last_unstale":"2023-10-08T00:25:39.822657+0000","last_undegraded":"2023-10-08T00:25:39.822657+0000","last_fullsized":"2023-10-08T00:25:39.822657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714206+0000","last_change":"2023-10-08T00:25:37.708046+0000","last_active":"2023-10-08T00:25:37.714206+0000","last_peered":"2023-10-08T00:25:37.714206+0000","last_clean":"2023-10-08T00:25:37.714206+0000","last_became_active":"2023-10-08T00:25:37.707776+0000","last_became_peered":"2023-10-08T00:25:37.707776+0000","last_unstale":"2023-10-08T00:25:37.714206+0000","last_undegraded":"2023-10-08T00:25:37.714206+0000","last_fullsized":"2023-10-08T00:25:37.714206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:57.571056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.700929+0000","last_change":"2023-10-08T00:25:36.709706+0000","last_active":"2023-10-08T00:25:37.700929+0000","last_peered":"2023-10-08T00:25:37.700929+0000","last_clean":"2023-10-08T00:25:37.700929+0000","last_became_active":"2023-10-08T00:25:36.709437+0000","last_became_peered":"2023-10-08T00:25:36.709437+0000","last_unstale":"2023-10-08T00:25:37.700929+0000","last_undegraded":"2023-10-08T00:25:37.700929+0000","last_fullsized":"2023-10-08T00:25:37.700929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:41:14.007608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721889+0000","last_change":"2023-10-08T00:25:37.716602+0000","last_active":"2023-10-08T00:25:37.721889+0000","last_peered":"2023-10-08T00:25:37.721889+0000","last_clean":"2023-10-08T00:25:37.721889+0000","last_became_active":"2023-10-08T00:25:37.716335+0000","last_became_peered":"2023-10-08T00:25:37.716335+0000","last_unstale":"2023-10-08T00:25:37.721889+0000","last_undegraded":"2023-10-08T00:25:37.721889+0000","last_fullsized":"2023-10-08T00:25:37.721889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:52.111126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.703539+0000","last_change":"2023-10-08T00:25:36.714743+0000","last_active":"2023-10-08T00:25:37.703539+0000","last_peered":"2023-10-08T00:25:37.703539+0000","last_clean":"2023-10-08T00:25:37.703539+0000","last_became_active":"2023-10-08T00:25:36.714312+0000","last_became_peered":"2023-10-08T00:25:36.714312+0000","last_unstale":"2023-10-08T00:25:37.703539+0000","last_undegraded":"2023-10-08T00:25:37.703539+0000","last_fullsized":"2023-10-08T00:25:37.703539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:21.911351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714941+0000","last_change":"2023-10-08T00:25:37.713570+0000","last_active":"2023-10-08T00:25:37.714941+0000","last_peered":"2023-10-08T00:25:37.714941+0000","last_clean":"2023-10-08T00:25:37.714941+0000","last_became_active":"2023-10-08T00:25:37.713320+0000","last_became_peered":"2023-10-08T00:25:37.713320+0000","last_unstale":"2023-10-08T00:25:37.714941+0000","last_undegraded":"2023-10-08T00:25:37.714941+0000","last_fullsized":"2023-10-08T00:25:37.714941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:27:48.211667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.699927+0000","last_change":"2023-10-08T00:25:36.709471+0000","last_active":"2023-10-08T00:25:37.699927+0000","last_peered":"2023-10-08T00:25:37.699927+0000","last_clean":"2023-10-08T00:25:37.699927+0000","last_became_active":"2023-10-08T00:25:36.709128+0000","last_became_peered":"2023-10-08T00:25:36.709128+0000","last_unstale":"2023-10-08T00:25:37.699927+0000","last_undegraded":"2023-10-08T00:25:37.699927+0000","last_fullsized":"2023-10-08T00:25:37.699927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:21.911351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729199+0000","last_change":"2023-10-08T00:25:37.725985+0000","last_active":"2023-10-08T00:25:37.729199+0000","last_peered":"2023-10-08T00:25:37.729199+0000","last_clean":"2023-10-08T00:25:37.729199+0000","last_became_active":"2023-10-08T00:25:37.722306+0000","last_became_peered":"2023-10-08T00:25:37.722306+0000","last_unstale":"2023-10-08T00:25:37.729199+0000","last_undegraded":"2023-10-08T00:25:37.729199+0000","last_fullsized":"2023-10-08T00:25:37.729199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:53.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705965+0000","last_change":"2023-10-08T00:25:36.708817+0000","last_active":"2023-10-08T00:25:37.705965+0000","last_peered":"2023-10-08T00:25:37.705965+0000","last_clean":"2023-10-08T00:25:37.705965+0000","last_became_active":"2023-10-08T00:25:36.708553+0000","last_became_peered":"2023-10-08T00:25:36.708553+0000","last_unstale":"2023-10-08T00:25:37.705965+0000","last_undegraded":"2023-10-08T00:25:37.705965+0000","last_fullsized":"2023-10-08T00:25:37.705965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:07.181539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726073+0000","last_change":"2023-10-08T00:25:37.724331+0000","last_active":"2023-10-08T00:25:37.726073+0000","last_peered":"2023-10-08T00:25:37.726073+0000","last_clean":"2023-10-08T00:25:37.726073+0000","last_became_active":"2023-10-08T00:25:37.724030+0000","last_became_peered":"2023-10-08T00:25:37.724030+0000","last_unstale":"2023-10-08T00:25:37.726073+0000","last_undegraded":"2023-10-08T00:25:37.726073+0000","last_fullsized":"2023-10-08T00:25:37.726073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712091+0000","last_change":"2023-10-08T00:25:36.720869+0000","last_active":"2023-10-08T00:25:37.712091+0000","last_peered":"2023-10-08T00:25:37.712091+0000","last_clean":"2023-10-08T00:25:37.712091+0000","last_became_active":"2023-10-08T00:25:36.720607+0000","last_became_peered":"2023-10-08T00:25:36.720607+0000","last_unstale":"2023-10-08T00:25:37.712091+0000","last_undegraded":"2023-10-08T00:25:37.712091+0000","last_fullsized":"2023-10-08T00:25:37.712091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:37.686348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725308+0000","last_change":"2023-10-08T00:25:37.722440+0000","last_active":"2023-10-08T00:25:37.725308+0000","last_peered":"2023-10-08T00:25:37.725308+0000","last_clean":"2023-10-08T00:25:37.725308+0000","last_became_active":"2023-10-08T00:25:37.722114+0000","last_became_peered":"2023-10-08T00:25:37.722114+0000","last_unstale":"2023-10-08T00:25:37.725308+0000","last_undegraded":"2023-10-08T00:25:37.725308+0000","last_fullsized":"2023-10-08T00:25:37.725308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709019+0000","last_change":"2023-10-08T00:25:36.710889+0000","last_active":"2023-10-08T00:25:37.709019+0000","last_peered":"2023-10-08T00:25:37.709019+0000","last_clean":"2023-10-08T00:25:37.709019+0000","last_became_active":"2023-10-08T00:25:36.710598+0000","last_became_peered":"2023-10-08T00:25:36.710598+0000","last_unstale":"2023-10-08T00:25:37.709019+0000","last_undegraded":"2023-10-08T00:25:37.709019+0000","last_fullsized":"2023-10-08T00:25:37.709019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:07.181539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712108+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:25:37.712108+0000","last_peered":"2023-10-08T00:25:37.712108+0000","last_clean":"2023-10-08T00:25:37.712108+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:25:37.712108+0000","last_undegraded":"2023-10-08T00:25:37.712108+0000","last_fullsized":"2023-10-08T00:25:37.712108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":132673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":139931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":139931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:46.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:25:46.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 Processor -- start 2023-10-08T00:25:46.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 -- start start 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d70159890 0x7f4d7015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70069560 0x7f4d700699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d70069ee0 con 0x7f4d70159c60 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7015a160 con 0x7f4d70159890 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.526+0000 7f4d75c9c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700d13a0 con 0x7f4d70069560 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d70159890 0x7f4d7015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d70159890 0x7f4d7015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59778/0 (socket says 172.21.15.22:59778) 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/11361980 learned_addr learned my addr 172.21.15.22:0/11361980 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6ffff700 1 --2- 172.21.15.22:0/11361980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70069560 0x7f4d700699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/11361980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70069560 msgr2=0x7f4d700699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:46.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 --2- 172.21.15.22:0/11361980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70069560 0x7f4d700699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/11361980 >> v1:172.21.15.192:6789/0 conn(0x7f4d70159c60 legacy=0x7f4d7015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/11361980 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7015e140 con 0x7f4d70159890 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6f7fe700 1 --2- 172.21.15.22:0/11361980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70159890 0x7f4d7015abd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d600099b0 tx=0x7f4d60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6223c9c0c9603 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6effd700 1 -- 172.21.15.22:0/11361980 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000b860 con 0x7f4d70159890 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6effd700 1 -- 172.21.15.22:0/11361980 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000b9c0 con 0x7f4d70159890 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.527+0000 7f4d6effd700 1 -- 172.21.15.22:0/11361980 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000bd60 con 0x7f4d70159890 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 -- 172.21.15.22:0/11361980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70159890 msgr2=0x7f4d7015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/11361980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70159890 0x7f4d7015abd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d600099b0 tx=0x7f4d60009250 comp rx=0 tx=0).stop 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 -- 172.21.15.22:0/11361980 shutdown_connections 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/11361980 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70069560 0x7f4d700699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/11361980 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70159890 0x7f4d7015abd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 -- 172.21.15.22:0/11361980 >> 172.21.15.22:0/11361980 conn(0x7f4d70068e20 msgr2=0x7f4d700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 -- 172.21.15.22:0/11361980 shutdown_connections 2023-10-08T00:25:46.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.528+0000 7f4d75c9c700 1 -- 172.21.15.22:0/11361980 wait complete. 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.529+0000 7f4d75c9c700 1 Processor -- start 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.529+0000 7f4d75c9c700 1 -- start start 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d75c9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 0x7f4d701501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d75c9c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70159890 0x7f4d700b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d75c9c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d70159c60 0x7f4d701523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d75c9c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7016a020 con 0x7f4d70069560 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d75c9c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7016a300 con 0x7f4d70159c60 2023-10-08T00:25:46.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d75c9c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7016a5e0 con 0x7f4d70159890 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 0x7f4d701501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 0x7f4d701501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59794/0 (socket says 172.21.15.22:59794) 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/2249409410 learned_addr learned my addr 172.21.15.22:0/2249409410 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d66ffd700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70159890 0x7f4d700b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6ffff700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d70159c60 0x7f4d701523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70159890 msgr2=0x7f4d700b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70159890 0x7f4d700b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d70159c60 msgr2=0x7f4d701523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d70159c60 0x7f4d701523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 -- 172.21.15.22:0/2249409410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600094f0 con 0x7f4d70069560 2023-10-08T00:25:46.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6ffff700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d70159c60 0x7f4d701523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.530+0000 7f4d6f7fe700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 0x7f4d701501e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d700899c0 tx=0x7f4d60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.531+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60024440 con 0x7f4d70069560 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.531+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600245c0 con 0x7f4d70069560 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.531+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7016a8c0 con 0x7f4d70069560 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.531+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60024980 con 0x7f4d70069560 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.531+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70169db0 con 0x7f4d70069560 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.532+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7004c3c0 con 0x7f4d70069560 2023-10-08T00:25:46.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.532+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d6001a420 con 0x7f4d70069560 2023-10-08T00:25:46.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.532+0000 7f4d67fff700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d50066f30 0x7f4d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.532+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d60086300 con 0x7f4d70069560 2023-10-08T00:25:46.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.533+0000 7f4d66ffd700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d50066f30 0x7f4d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.533+0000 7f4d66ffd700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d50066f30 0x7f4d500693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d700d00d0 tx=0x7f4d58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:46.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.537+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d60053570 con 0x7f4d70069560 2023-10-08T00:25:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.725+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d700cd0c0 con 0x7f4d50066f30 2023-10-08T00:25:46.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.734+0000 7f4d67fff700 1 -- 172.21.15.22:0/2249409410 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273834 (secure 0 0 0) 0x7f4d700cd0c0 con 0x7f4d50066f30 2023-10-08T00:25:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:46.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d50066f30 msgr2=0x7f4d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d50066f30 0x7f4d500693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d700d00d0 tx=0x7f4d58009040 comp rx=0 tx=0).stop 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 msgr2=0x7f4d701501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 0x7f4d701501e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d700899c0 tx=0x7f4d60017000 comp rx=0 tx=0).stop 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 shutdown_connections 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d70159c60 0x7f4d701523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d70069560 0x7f4d701501e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d50066f30 0x7f4d500693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 --2- 172.21.15.22:0/2249409410 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d70159890 0x7f4d700b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 >> 172.21.15.22:0/2249409410 conn(0x7f4d70068e20 msgr2=0x7f4d70150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 shutdown_connections 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.737+0000 7f4d75c9c700 1 -- 172.21.15.22:0/2249409410 wait complete. 2023-10-08T00:25:46.740 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:25:46.749 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-08T00:25:46.395402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382344,"kb_used_data":4040,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592376,"statfs":{"total":773094113280,"available":770654593024,"internally_reserved":0,"allocated":4136960,"data_stored":2292332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.692440"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724742+0000","last_change":"2023-10-08T00:25:37.720558+0000","last_active":"2023-10-08T00:25:37.724742+0000","last_peered":"2023-10-08T00:25:37.724742+0000","last_clean":"2023-10-08T00:25:37.724742+0000","last_became_active":"2023-10-08T00:25:37.720097+0000","last_became_peered":"2023-10-08T00:25:37.720097+0000","last_unstale":"2023-10-08T00:25:37.724742+0000","last_undegraded":"2023-10-08T00:25:37.724742+0000","last_fullsized":"2023-10-08T00:25:37.724742+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:28.929571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726161+0000","last_change":"2023-10-08T00:25:37.716993+0000","last_active":"2023-10-08T00:25:37.726161+0000","last_peered":"2023-10-08T00:25:37.726161+0000","last_clean":"2023-10-08T00:25:37.726161+0000","last_became_active":"2023-10-08T00:25:37.716701+0000","last_became_peered":"2023-10-08T00:25:37.716701+0000","last_unstale":"2023-10-08T00:25:37.726161+0000","last_undegraded":"2023-10-08T00:25:37.726161+0000","last_fullsized":"2023-10-08T00:25:37.726161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728107+0000","last_change":"2023-10-08T00:25:37.719808+0000","last_active":"2023-10-08T00:25:37.728107+0000","last_peered":"2023-10-08T00:25:37.728107+0000","last_clean":"2023-10-08T00:25:37.728107+0000","last_became_active":"2023-10-08T00:25:37.719535+0000","last_became_peered":"2023-10-08T00:25:37.719535+0000","last_unstale":"2023-10-08T00:25:37.728107+0000","last_undegraded":"2023-10-08T00:25:37.728107+0000","last_fullsized":"2023-10-08T00:25:37.728107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.716079+0000","last_change":"2023-10-08T00:25:37.706709+0000","last_active":"2023-10-08T00:25:37.716079+0000","last_peered":"2023-10-08T00:25:37.716079+0000","last_clean":"2023-10-08T00:25:37.716079+0000","last_became_active":"2023-10-08T00:25:37.706370+0000","last_became_peered":"2023-10-08T00:25:37.706370+0000","last_unstale":"2023-10-08T00:25:37.716079+0000","last_undegraded":"2023-10-08T00:25:37.716079+0000","last_fullsized":"2023-10-08T00:25:37.716079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725605+0000","last_change":"2023-10-08T00:25:37.724898+0000","last_active":"2023-10-08T00:25:37.725605+0000","last_peered":"2023-10-08T00:25:37.725605+0000","last_clean":"2023-10-08T00:25:37.725605+0000","last_became_active":"2023-10-08T00:25:37.724611+0000","last_became_peered":"2023-10-08T00:25:37.724611+0000","last_unstale":"2023-10-08T00:25:37.725605+0000","last_undegraded":"2023-10-08T00:25:37.725605+0000","last_fullsized":"2023-10-08T00:25:37.725605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:40.085288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726377+0000","last_change":"2023-10-08T00:25:37.717245+0000","last_active":"2023-10-08T00:25:37.726377+0000","last_peered":"2023-10-08T00:25:37.726377+0000","last_clean":"2023-10-08T00:25:37.726377+0000","last_became_active":"2023-10-08T00:25:37.716986+0000","last_became_peered":"2023-10-08T00:25:37.716986+0000","last_unstale":"2023-10-08T00:25:37.726377+0000","last_undegraded":"2023-10-08T00:25:37.726377+0000","last_fullsized":"2023-10-08T00:25:37.726377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:46:12.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726265+0000","last_change":"2023-10-08T00:25:37.722639+0000","last_active":"2023-10-08T00:25:37.726265+0000","last_peered":"2023-10-08T00:25:37.726265+0000","last_clean":"2023-10-08T00:25:37.726265+0000","last_became_active":"2023-10-08T00:25:37.722366+0000","last_became_peered":"2023-10-08T00:25:37.722366+0000","last_unstale":"2023-10-08T00:25:37.726265+0000","last_undegraded":"2023-10-08T00:25:37.726265+0000","last_fullsized":"2023-10-08T00:25:37.726265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725543+0000","last_change":"2023-10-08T00:25:37.723182+0000","last_active":"2023-10-08T00:25:37.725543+0000","last_peered":"2023-10-08T00:25:37.725543+0000","last_clean":"2023-10-08T00:25:37.725543+0000","last_became_active":"2023-10-08T00:25:37.721984+0000","last_became_peered":"2023-10-08T00:25:37.721984+0000","last_unstale":"2023-10-08T00:25:37.725543+0000","last_undegraded":"2023-10-08T00:25:37.725543+0000","last_fullsized":"2023-10-08T00:25:37.725543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:54.865104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721615+0000","last_change":"2023-10-08T00:25:37.717020+0000","last_active":"2023-10-08T00:25:37.721615+0000","last_peered":"2023-10-08T00:25:37.721615+0000","last_clean":"2023-10-08T00:25:37.721615+0000","last_became_active":"2023-10-08T00:25:37.716714+0000","last_became_peered":"2023-10-08T00:25:37.716714+0000","last_unstale":"2023-10-08T00:25:37.721615+0000","last_undegraded":"2023-10-08T00:25:37.721615+0000","last_fullsized":"2023-10-08T00:25:37.721615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:19.623379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719332+0000","last_change":"2023-10-08T00:25:37.717681+0000","last_active":"2023-10-08T00:25:37.719332+0000","last_peered":"2023-10-08T00:25:37.719332+0000","last_clean":"2023-10-08T00:25:37.719332+0000","last_became_active":"2023-10-08T00:25:37.717431+0000","last_became_peered":"2023-10-08T00:25:37.717431+0000","last_unstale":"2023-10-08T00:25:37.719332+0000","last_undegraded":"2023-10-08T00:25:37.719332+0000","last_fullsized":"2023-10-08T00:25:37.719332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726177+0000","last_change":"2023-10-08T00:25:37.723217+0000","last_active":"2023-10-08T00:25:37.726177+0000","last_peered":"2023-10-08T00:25:37.726177+0000","last_clean":"2023-10-08T00:25:37.726177+0000","last_became_active":"2023-10-08T00:25:37.722930+0000","last_became_peered":"2023-10-08T00:25:37.722930+0000","last_unstale":"2023-10-08T00:25:37.726177+0000","last_undegraded":"2023-10-08T00:25:37.726177+0000","last_fullsized":"2023-10-08T00:25:37.726177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:46:12.993399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728178+0000","last_change":"2023-10-08T00:25:37.724229+0000","last_active":"2023-10-08T00:25:37.728178+0000","last_peered":"2023-10-08T00:25:37.728178+0000","last_clean":"2023-10-08T00:25:37.728178+0000","last_became_active":"2023-10-08T00:25:37.723929+0000","last_became_peered":"2023-10-08T00:25:37.723929+0000","last_unstale":"2023-10-08T00:25:37.728178+0000","last_undegraded":"2023-10-08T00:25:37.728178+0000","last_fullsized":"2023-10-08T00:25:37.728178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:54.865104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.720727+0000","last_change":"2023-10-08T00:25:37.717836+0000","last_active":"2023-10-08T00:25:37.720727+0000","last_peered":"2023-10-08T00:25:37.720727+0000","last_clean":"2023-10-08T00:25:37.720727+0000","last_became_active":"2023-10-08T00:25:37.717573+0000","last_became_peered":"2023-10-08T00:25:37.717573+0000","last_unstale":"2023-10-08T00:25:37.720727+0000","last_undegraded":"2023-10-08T00:25:37.720727+0000","last_fullsized":"2023-10-08T00:25:37.720727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:45.717834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731192+0000","last_change":"2023-10-08T00:25:37.729358+0000","last_active":"2023-10-08T00:25:37.731192+0000","last_peered":"2023-10-08T00:25:37.731192+0000","last_clean":"2023-10-08T00:25:37.731192+0000","last_became_active":"2023-10-08T00:25:37.729096+0000","last_became_peered":"2023-10-08T00:25:37.729096+0000","last_unstale":"2023-10-08T00:25:37.731192+0000","last_undegraded":"2023-10-08T00:25:37.731192+0000","last_fullsized":"2023-10-08T00:25:37.731192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:05:10.905563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725710+0000","last_change":"2023-10-08T00:25:37.714420+0000","last_active":"2023-10-08T00:25:37.725710+0000","last_peered":"2023-10-08T00:25:37.725710+0000","last_clean":"2023-10-08T00:25:37.725710+0000","last_became_active":"2023-10-08T00:25:37.714173+0000","last_became_peered":"2023-10-08T00:25:37.714173+0000","last_unstale":"2023-10-08T00:25:37.725710+0000","last_undegraded":"2023-10-08T00:25:37.725710+0000","last_fullsized":"2023-10-08T00:25:37.725710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732614+0000","last_change":"2023-10-08T00:25:37.731177+0000","last_active":"2023-10-08T00:25:37.732614+0000","last_peered":"2023-10-08T00:25:37.732614+0000","last_clean":"2023-10-08T00:25:37.732614+0000","last_became_active":"2023-10-08T00:25:37.731002+0000","last_became_peered":"2023-10-08T00:25:37.731002+0000","last_unstale":"2023-10-08T00:25:37.732614+0000","last_undegraded":"2023-10-08T00:25:37.732614+0000","last_fullsized":"2023-10-08T00:25:37.732614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729794+0000","last_change":"2023-10-08T00:25:37.725720+0000","last_active":"2023-10-08T00:25:37.729794+0000","last_peered":"2023-10-08T00:25:37.729794+0000","last_clean":"2023-10-08T00:25:37.729794+0000","last_became_active":"2023-10-08T00:25:37.725426+0000","last_became_peered":"2023-10-08T00:25:37.725426+0000","last_unstale":"2023-10-08T00:25:37.729794+0000","last_undegraded":"2023-10-08T00:25:37.729794+0000","last_fullsized":"2023-10-08T00:25:37.729794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:16.755300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728825+0000","last_change":"2023-10-08T00:25:37.723052+0000","last_active":"2023-10-08T00:25:37.728825+0000","last_peered":"2023-10-08T00:25:37.728825+0000","last_clean":"2023-10-08T00:25:37.728825+0000","last_became_active":"2023-10-08T00:25:37.722528+0000","last_became_peered":"2023-10-08T00:25:37.722528+0000","last_unstale":"2023-10-08T00:25:37.728825+0000","last_undegraded":"2023-10-08T00:25:37.728825+0000","last_fullsized":"2023-10-08T00:25:37.728825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:50.117104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728731+0000","last_change":"2023-10-08T00:25:37.722724+0000","last_active":"2023-10-08T00:25:37.728731+0000","last_peered":"2023-10-08T00:25:37.728731+0000","last_clean":"2023-10-08T00:25:37.728731+0000","last_became_active":"2023-10-08T00:25:37.722401+0000","last_became_peered":"2023-10-08T00:25:37.722401+0000","last_unstale":"2023-10-08T00:25:37.728731+0000","last_undegraded":"2023-10-08T00:25:37.728731+0000","last_fullsized":"2023-10-08T00:25:37.728731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:05.235836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719749+0000","last_change":"2023-10-08T00:25:37.714600+0000","last_active":"2023-10-08T00:25:37.719749+0000","last_peered":"2023-10-08T00:25:37.719749+0000","last_clean":"2023-10-08T00:25:37.719749+0000","last_became_active":"2023-10-08T00:25:37.714377+0000","last_became_peered":"2023-10-08T00:25:37.714377+0000","last_unstale":"2023-10-08T00:25:37.719749+0000","last_undegraded":"2023-10-08T00:25:37.719749+0000","last_fullsized":"2023-10-08T00:25:37.719749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:40:15.902819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721892+0000","last_change":"2023-10-08T00:25:37.717470+0000","last_active":"2023-10-08T00:25:37.721892+0000","last_peered":"2023-10-08T00:25:37.721892+0000","last_clean":"2023-10-08T00:25:37.721892+0000","last_became_active":"2023-10-08T00:25:37.717051+0000","last_became_peered":"2023-10-08T00:25:37.717051+0000","last_unstale":"2023-10-08T00:25:37.721892+0000","last_undegraded":"2023-10-08T00:25:37.721892+0000","last_fullsized":"2023-10-08T00:25:37.721892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:31.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726044+0000","last_change":"2023-10-08T00:25:37.724278+0000","last_active":"2023-10-08T00:25:37.726044+0000","last_peered":"2023-10-08T00:25:37.726044+0000","last_clean":"2023-10-08T00:25:37.726044+0000","last_became_active":"2023-10-08T00:25:37.723991+0000","last_became_peered":"2023-10-08T00:25:37.723991+0000","last_unstale":"2023-10-08T00:25:37.726044+0000","last_undegraded":"2023-10-08T00:25:37.726044+0000","last_fullsized":"2023-10-08T00:25:37.726044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:57.571056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725709+0000","last_change":"2023-10-08T00:25:37.722900+0000","last_active":"2023-10-08T00:25:37.725709+0000","last_peered":"2023-10-08T00:25:37.725709+0000","last_clean":"2023-10-08T00:25:37.725709+0000","last_became_active":"2023-10-08T00:25:37.722596+0000","last_became_peered":"2023-10-08T00:25:37.722596+0000","last_unstale":"2023-10-08T00:25:37.725709+0000","last_undegraded":"2023-10-08T00:25:37.725709+0000","last_fullsized":"2023-10-08T00:25:37.725709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727378+0000","last_change":"2023-10-08T00:25:37.716470+0000","last_active":"2023-10-08T00:25:37.727378+0000","last_peered":"2023-10-08T00:25:37.727378+0000","last_clean":"2023-10-08T00:25:37.727378+0000","last_became_active":"2023-10-08T00:25:37.715209+0000","last_became_peered":"2023-10-08T00:25:37.715209+0000","last_unstale":"2023-10-08T00:25:37.727378+0000","last_undegraded":"2023-10-08T00:25:37.727378+0000","last_fullsized":"2023-10-08T00:25:37.727378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728337+0000","last_change":"2023-10-08T00:25:37.727689+0000","last_active":"2023-10-08T00:25:37.728337+0000","last_peered":"2023-10-08T00:25:37.728337+0000","last_clean":"2023-10-08T00:25:37.728337+0000","last_became_active":"2023-10-08T00:25:37.727312+0000","last_became_peered":"2023-10-08T00:25:37.727312+0000","last_unstale":"2023-10-08T00:25:37.728337+0000","last_undegraded":"2023-10-08T00:25:37.728337+0000","last_fullsized":"2023-10-08T00:25:37.728337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731468+0000","last_change":"2023-10-08T00:25:37.729710+0000","last_active":"2023-10-08T00:25:37.731468+0000","last_peered":"2023-10-08T00:25:37.731468+0000","last_clean":"2023-10-08T00:25:37.731468+0000","last_became_active":"2023-10-08T00:25:37.729416+0000","last_became_peered":"2023-10-08T00:25:37.729416+0000","last_unstale":"2023-10-08T00:25:37.731468+0000","last_undegraded":"2023-10-08T00:25:37.731468+0000","last_fullsized":"2023-10-08T00:25:37.731468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:05:56.209299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718369+0000","last_change":"2023-10-08T00:25:37.709339+0000","last_active":"2023-10-08T00:25:37.718369+0000","last_peered":"2023-10-08T00:25:37.718369+0000","last_clean":"2023-10-08T00:25:37.718369+0000","last_became_active":"2023-10-08T00:25:37.708668+0000","last_became_peered":"2023-10-08T00:25:37.708668+0000","last_unstale":"2023-10-08T00:25:37.718369+0000","last_undegraded":"2023-10-08T00:25:37.718369+0000","last_fullsized":"2023-10-08T00:25:37.718369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:10:14.840611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726672+0000","last_change":"2023-10-08T00:25:37.715556+0000","last_active":"2023-10-08T00:25:37.726672+0000","last_peered":"2023-10-08T00:25:37.726672+0000","last_clean":"2023-10-08T00:25:37.726672+0000","last_became_active":"2023-10-08T00:25:37.715157+0000","last_became_peered":"2023-10-08T00:25:37.715157+0000","last_unstale":"2023-10-08T00:25:37.726672+0000","last_undegraded":"2023-10-08T00:25:37.726672+0000","last_fullsized":"2023-10-08T00:25:37.726672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727585+0000","last_change":"2023-10-08T00:25:37.725428+0000","last_active":"2023-10-08T00:25:37.727585+0000","last_peered":"2023-10-08T00:25:37.727585+0000","last_clean":"2023-10-08T00:25:37.727585+0000","last_became_active":"2023-10-08T00:25:37.724949+0000","last_became_peered":"2023-10-08T00:25:37.724949+0000","last_unstale":"2023-10-08T00:25:37.727585+0000","last_undegraded":"2023-10-08T00:25:37.727585+0000","last_fullsized":"2023-10-08T00:25:37.727585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:23:35.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725201+0000","last_change":"2023-10-08T00:25:37.723122+0000","last_active":"2023-10-08T00:25:37.725201+0000","last_peered":"2023-10-08T00:25:37.725201+0000","last_clean":"2023-10-08T00:25:37.725201+0000","last_became_active":"2023-10-08T00:25:37.722828+0000","last_became_peered":"2023-10-08T00:25:37.722828+0000","last_unstale":"2023-10-08T00:25:37.725201+0000","last_undegraded":"2023-10-08T00:25:37.725201+0000","last_fullsized":"2023-10-08T00:25:37.725201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.722271+0000","last_change":"2023-10-08T00:25:37.718268+0000","last_active":"2023-10-08T00:25:37.722271+0000","last_peered":"2023-10-08T00:25:37.722271+0000","last_clean":"2023-10-08T00:25:37.722271+0000","last_became_active":"2023-10-08T00:25:37.717992+0000","last_became_peered":"2023-10-08T00:25:37.717992+0000","last_unstale":"2023-10-08T00:25:37.722271+0000","last_undegraded":"2023-10-08T00:25:37.722271+0000","last_fullsized":"2023-10-08T00:25:37.722271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:31.617176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732203+0000","last_change":"2023-10-08T00:25:37.727267+0000","last_active":"2023-10-08T00:25:37.732203+0000","last_peered":"2023-10-08T00:25:37.732203+0000","last_clean":"2023-10-08T00:25:37.732203+0000","last_became_active":"2023-10-08T00:25:37.726818+0000","last_became_peered":"2023-10-08T00:25:37.726818+0000","last_unstale":"2023-10-08T00:25:37.732203+0000","last_undegraded":"2023-10-08T00:25:37.732203+0000","last_fullsized":"2023-10-08T00:25:37.732203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:57.252950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725719+0000","last_change":"2023-10-08T00:25:37.723012+0000","last_active":"2023-10-08T00:25:37.725719+0000","last_peered":"2023-10-08T00:25:37.725719+0000","last_clean":"2023-10-08T00:25:37.725719+0000","last_became_active":"2023-10-08T00:25:37.722757+0000","last_became_peered":"2023-10-08T00:25:37.722757+0000","last_unstale":"2023-10-08T00:25:37.725719+0000","last_undegraded":"2023-10-08T00:25:37.725719+0000","last_fullsized":"2023-10-08T00:25:37.725719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:23:35.741887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728049+0000","last_change":"2023-10-08T00:25:36.709162+0000","last_active":"2023-10-08T00:25:37.728049+0000","last_peered":"2023-10-08T00:25:37.728049+0000","last_clean":"2023-10-08T00:25:37.728049+0000","last_became_active":"2023-10-08T00:25:36.708913+0000","last_became_peered":"2023-10-08T00:25:36.708913+0000","last_unstale":"2023-10-08T00:25:37.728049+0000","last_undegraded":"2023-10-08T00:25:37.728049+0000","last_fullsized":"2023-10-08T00:25:37.728049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:03.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724723+0000","last_change":"2023-10-08T00:25:37.720120+0000","last_active":"2023-10-08T00:25:37.724723+0000","last_peered":"2023-10-08T00:25:37.724723+0000","last_clean":"2023-10-08T00:25:37.724723+0000","last_became_active":"2023-10-08T00:25:37.719871+0000","last_became_peered":"2023-10-08T00:25:37.719871+0000","last_unstale":"2023-10-08T00:25:37.724723+0000","last_undegraded":"2023-10-08T00:25:37.724723+0000","last_fullsized":"2023-10-08T00:25:37.724723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:14.444743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714485+0000","last_change":"2023-10-08T00:25:36.711782+0000","last_active":"2023-10-08T00:25:37.714485+0000","last_peered":"2023-10-08T00:25:37.714485+0000","last_clean":"2023-10-08T00:25:37.714485+0000","last_became_active":"2023-10-08T00:25:36.711508+0000","last_became_peered":"2023-10-08T00:25:36.711508+0000","last_unstale":"2023-10-08T00:25:37.714485+0000","last_undegraded":"2023-10-08T00:25:37.714485+0000","last_fullsized":"2023-10-08T00:25:37.714485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:39.078979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726845+0000","last_change":"2023-10-08T00:25:37.724580+0000","last_active":"2023-10-08T00:25:37.726845+0000","last_peered":"2023-10-08T00:25:37.726845+0000","last_clean":"2023-10-08T00:25:37.726845+0000","last_became_active":"2023-10-08T00:25:37.724153+0000","last_became_peered":"2023-10-08T00:25:37.724153+0000","last_unstale":"2023-10-08T00:25:37.726845+0000","last_undegraded":"2023-10-08T00:25:37.726845+0000","last_fullsized":"2023-10-08T00:25:37.726845+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:27:48.211667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728678+0000","last_change":"2023-10-08T00:25:36.718742+0000","last_active":"2023-10-08T00:25:37.728678+0000","last_peered":"2023-10-08T00:25:37.728678+0000","last_clean":"2023-10-08T00:25:37.728678+0000","last_became_active":"2023-10-08T00:25:36.718410+0000","last_became_peered":"2023-10-08T00:25:36.718410+0000","last_unstale":"2023-10-08T00:25:37.728678+0000","last_undegraded":"2023-10-08T00:25:37.728678+0000","last_fullsized":"2023-10-08T00:25:37.728678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:27.923263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718351+0000","last_change":"2023-10-08T00:25:37.708920+0000","last_active":"2023-10-08T00:25:37.718351+0000","last_peered":"2023-10-08T00:25:37.718351+0000","last_clean":"2023-10-08T00:25:37.718351+0000","last_became_active":"2023-10-08T00:25:37.708322+0000","last_became_peered":"2023-10-08T00:25:37.708322+0000","last_unstale":"2023-10-08T00:25:37.718351+0000","last_undegraded":"2023-10-08T00:25:37.718351+0000","last_fullsized":"2023-10-08T00:25:37.718351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:16.755300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718995+0000","last_change":"2023-10-08T00:25:36.718068+0000","last_active":"2023-10-08T00:25:37.718995+0000","last_peered":"2023-10-08T00:25:37.718995+0000","last_clean":"2023-10-08T00:25:37.718995+0000","last_became_active":"2023-10-08T00:25:36.714439+0000","last_became_peered":"2023-10-08T00:25:36.714439+0000","last_unstale":"2023-10-08T00:25:37.718995+0000","last_undegraded":"2023-10-08T00:25:37.718995+0000","last_fullsized":"2023-10-08T00:25:37.718995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:47:44.567853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729833+0000","last_change":"2023-10-08T00:25:37.726243+0000","last_active":"2023-10-08T00:25:37.729833+0000","last_peered":"2023-10-08T00:25:37.729833+0000","last_clean":"2023-10-08T00:25:37.729833+0000","last_became_active":"2023-10-08T00:25:37.725983+0000","last_became_peered":"2023-10-08T00:25:37.725983+0000","last_unstale":"2023-10-08T00:25:37.729833+0000","last_undegraded":"2023-10-08T00:25:37.729833+0000","last_fullsized":"2023-10-08T00:25:37.729833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729752+0000","last_change":"2023-10-08T00:25:36.714559+0000","last_active":"2023-10-08T00:25:37.729752+0000","last_peered":"2023-10-08T00:25:37.729752+0000","last_clean":"2023-10-08T00:25:37.729752+0000","last_became_active":"2023-10-08T00:25:36.714260+0000","last_became_peered":"2023-10-08T00:25:36.714260+0000","last_unstale":"2023-10-08T00:25:37.729752+0000","last_undegraded":"2023-10-08T00:25:37.729752+0000","last_fullsized":"2023-10-08T00:25:37.729752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:08:58.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726652+0000","last_change":"2023-10-08T00:25:37.716864+0000","last_active":"2023-10-08T00:25:37.726652+0000","last_peered":"2023-10-08T00:25:37.726652+0000","last_clean":"2023-10-08T00:25:37.726652+0000","last_became_active":"2023-10-08T00:25:37.716577+0000","last_became_peered":"2023-10-08T00:25:37.716577+0000","last_unstale":"2023-10-08T00:25:37.726652+0000","last_undegraded":"2023-10-08T00:25:37.726652+0000","last_fullsized":"2023-10-08T00:25:37.726652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:46:13.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729680+0000","last_change":"2023-10-08T00:25:36.714539+0000","last_active":"2023-10-08T00:25:37.729680+0000","last_peered":"2023-10-08T00:25:37.729680+0000","last_clean":"2023-10-08T00:25:37.729680+0000","last_became_active":"2023-10-08T00:25:36.714273+0000","last_became_peered":"2023-10-08T00:25:36.714273+0000","last_unstale":"2023-10-08T00:25:37.729680+0000","last_undegraded":"2023-10-08T00:25:37.729680+0000","last_fullsized":"2023-10-08T00:25:37.729680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:11.876222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718260+0000","last_change":"2023-10-08T00:25:37.713525+0000","last_active":"2023-10-08T00:25:37.718260+0000","last_peered":"2023-10-08T00:25:37.718260+0000","last_clean":"2023-10-08T00:25:37.718260+0000","last_became_active":"2023-10-08T00:25:37.713217+0000","last_became_peered":"2023-10-08T00:25:37.713217+0000","last_unstale":"2023-10-08T00:25:37.718260+0000","last_undegraded":"2023-10-08T00:25:37.718260+0000","last_fullsized":"2023-10-08T00:25:37.718260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:28.929571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709653+0000","last_change":"2023-10-08T00:25:36.717790+0000","last_active":"2023-10-08T00:25:37.709653+0000","last_peered":"2023-10-08T00:25:37.709653+0000","last_clean":"2023-10-08T00:25:37.709653+0000","last_became_active":"2023-10-08T00:25:36.717498+0000","last_became_peered":"2023-10-08T00:25:36.717498+0000","last_unstale":"2023-10-08T00:25:37.709653+0000","last_undegraded":"2023-10-08T00:25:37.709653+0000","last_fullsized":"2023-10-08T00:25:37.709653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:13.438434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718512+0000","last_change":"2023-10-08T00:25:37.713748+0000","last_active":"2023-10-08T00:25:37.718512+0000","last_peered":"2023-10-08T00:25:37.718512+0000","last_clean":"2023-10-08T00:25:37.718512+0000","last_became_active":"2023-10-08T00:25:37.713158+0000","last_became_peered":"2023-10-08T00:25:37.713158+0000","last_unstale":"2023-10-08T00:25:37.718512+0000","last_undegraded":"2023-10-08T00:25:37.718512+0000","last_fullsized":"2023-10-08T00:25:37.718512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705556+0000","last_change":"2023-10-08T00:25:36.708148+0000","last_active":"2023-10-08T00:25:37.705556+0000","last_peered":"2023-10-08T00:25:37.705556+0000","last_clean":"2023-10-08T00:25:37.705556+0000","last_became_active":"2023-10-08T00:25:36.707828+0000","last_became_peered":"2023-10-08T00:25:36.707828+0000","last_unstale":"2023-10-08T00:25:37.705556+0000","last_undegraded":"2023-10-08T00:25:37.705556+0000","last_fullsized":"2023-10-08T00:25:37.705556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:20:19.928868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727699+0000","last_change":"2023-10-08T00:25:37.717617+0000","last_active":"2023-10-08T00:25:37.727699+0000","last_peered":"2023-10-08T00:25:37.727699+0000","last_clean":"2023-10-08T00:25:37.727699+0000","last_became_active":"2023-10-08T00:25:37.717332+0000","last_became_peered":"2023-10-08T00:25:37.717332+0000","last_unstale":"2023-10-08T00:25:37.727699+0000","last_undegraded":"2023-10-08T00:25:37.727699+0000","last_fullsized":"2023-10-08T00:25:37.727699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:28.663986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.710766+0000","last_change":"2023-10-08T00:25:36.720319+0000","last_active":"2023-10-08T00:25:37.710766+0000","last_peered":"2023-10-08T00:25:37.710766+0000","last_clean":"2023-10-08T00:25:37.710766+0000","last_became_active":"2023-10-08T00:25:36.720021+0000","last_became_peered":"2023-10-08T00:25:36.720021+0000","last_unstale":"2023-10-08T00:25:37.710766+0000","last_undegraded":"2023-10-08T00:25:37.710766+0000","last_fullsized":"2023-10-08T00:25:37.710766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:36:30.610868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728871+0000","last_change":"2023-10-08T00:25:37.725571+0000","last_active":"2023-10-08T00:25:37.728871+0000","last_peered":"2023-10-08T00:25:37.728871+0000","last_clean":"2023-10-08T00:25:37.728871+0000","last_became_active":"2023-10-08T00:25:37.723042+0000","last_became_peered":"2023-10-08T00:25:37.723042+0000","last_unstale":"2023-10-08T00:25:37.728871+0000","last_undegraded":"2023-10-08T00:25:37.728871+0000","last_fullsized":"2023-10-08T00:25:37.728871+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:49:37.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.704300+0000","last_change":"2023-10-08T00:25:36.715186+0000","last_active":"2023-10-08T00:25:37.704300+0000","last_peered":"2023-10-08T00:25:37.704300+0000","last_clean":"2023-10-08T00:25:37.704300+0000","last_became_active":"2023-10-08T00:25:36.714763+0000","last_became_peered":"2023-10-08T00:25:36.714763+0000","last_unstale":"2023-10-08T00:25:37.704300+0000","last_undegraded":"2023-10-08T00:25:37.704300+0000","last_fullsized":"2023-10-08T00:25:37.704300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:18:44.711526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732060+0000","last_change":"2023-10-08T00:25:37.731469+0000","last_active":"2023-10-08T00:25:37.732060+0000","last_peered":"2023-10-08T00:25:37.732060+0000","last_clean":"2023-10-08T00:25:37.732060+0000","last_became_active":"2023-10-08T00:25:37.731201+0000","last_became_peered":"2023-10-08T00:25:37.731201+0000","last_unstale":"2023-10-08T00:25:37.732060+0000","last_undegraded":"2023-10-08T00:25:37.732060+0000","last_fullsized":"2023-10-08T00:25:37.732060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:51.316017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721346+0000","last_change":"2023-10-08T00:25:36.711356+0000","last_active":"2023-10-08T00:25:37.721346+0000","last_peered":"2023-10-08T00:25:37.721346+0000","last_clean":"2023-10-08T00:25:37.721346+0000","last_became_active":"2023-10-08T00:25:36.711042+0000","last_became_peered":"2023-10-08T00:25:36.711042+0000","last_unstale":"2023-10-08T00:25:37.721346+0000","last_undegraded":"2023-10-08T00:25:37.721346+0000","last_fullsized":"2023-10-08T00:25:37.721346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728082+0000","last_change":"2023-10-08T00:25:37.719780+0000","last_active":"2023-10-08T00:25:37.728082+0000","last_peered":"2023-10-08T00:25:37.728082+0000","last_clean":"2023-10-08T00:25:37.728082+0000","last_became_active":"2023-10-08T00:25:37.719465+0000","last_became_peered":"2023-10-08T00:25:37.719465+0000","last_unstale":"2023-10-08T00:25:37.728082+0000","last_undegraded":"2023-10-08T00:25:37.728082+0000","last_fullsized":"2023-10-08T00:25:37.728082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:39:52.946553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732690+0000","last_change":"2023-10-08T00:25:36.720312+0000","last_active":"2023-10-08T00:25:37.732690+0000","last_peered":"2023-10-08T00:25:37.732690+0000","last_clean":"2023-10-08T00:25:37.732690+0000","last_became_active":"2023-10-08T00:25:36.720036+0000","last_became_peered":"2023-10-08T00:25:36.720036+0000","last_unstale":"2023-10-08T00:25:37.732690+0000","last_undegraded":"2023-10-08T00:25:37.732690+0000","last_fullsized":"2023-10-08T00:25:37.732690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:18.617071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718540+0000","last_change":"2023-10-08T00:25:37.713755+0000","last_active":"2023-10-08T00:25:37.718540+0000","last_peered":"2023-10-08T00:25:37.718540+0000","last_clean":"2023-10-08T00:25:37.718540+0000","last_became_active":"2023-10-08T00:25:37.713441+0000","last_became_peered":"2023-10-08T00:25:37.713441+0000","last_unstale":"2023-10-08T00:25:37.718540+0000","last_undegraded":"2023-10-08T00:25:37.718540+0000","last_fullsized":"2023-10-08T00:25:37.718540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725271+0000","last_change":"2023-10-08T00:25:36.711928+0000","last_active":"2023-10-08T00:25:37.725271+0000","last_peered":"2023-10-08T00:25:37.725271+0000","last_clean":"2023-10-08T00:25:37.725271+0000","last_became_active":"2023-10-08T00:25:36.711654+0000","last_became_peered":"2023-10-08T00:25:36.711654+0000","last_unstale":"2023-10-08T00:25:37.725271+0000","last_undegraded":"2023-10-08T00:25:37.725271+0000","last_fullsized":"2023-10-08T00:25:37.725271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:16:30.013733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726597+0000","last_change":"2023-10-08T00:25:37.718291+0000","last_active":"2023-10-08T00:25:37.726597+0000","last_peered":"2023-10-08T00:25:37.726597+0000","last_clean":"2023-10-08T00:25:37.726597+0000","last_became_active":"2023-10-08T00:25:37.718013+0000","last_became_peered":"2023-10-08T00:25:37.718013+0000","last_unstale":"2023-10-08T00:25:37.726597+0000","last_undegraded":"2023-10-08T00:25:37.726597+0000","last_fullsized":"2023-10-08T00:25:37.726597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.700027+0000","last_change":"2023-10-08T00:25:36.706721+0000","last_active":"2023-10-08T00:25:37.700027+0000","last_peered":"2023-10-08T00:25:37.700027+0000","last_clean":"2023-10-08T00:25:37.700027+0000","last_became_active":"2023-10-08T00:25:36.706450+0000","last_became_peered":"2023-10-08T00:25:36.706450+0000","last_unstale":"2023-10-08T00:25:37.700027+0000","last_undegraded":"2023-10-08T00:25:37.700027+0000","last_fullsized":"2023-10-08T00:25:37.700027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:39.078979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.732186+0000","last_change":"2023-10-08T00:25:37.727079+0000","last_active":"2023-10-08T00:25:37.732186+0000","last_peered":"2023-10-08T00:25:37.732186+0000","last_clean":"2023-10-08T00:25:37.732186+0000","last_became_active":"2023-10-08T00:25:37.726505+0000","last_became_peered":"2023-10-08T00:25:37.726505+0000","last_unstale":"2023-10-08T00:25:37.732186+0000","last_undegraded":"2023-10-08T00:25:37.732186+0000","last_fullsized":"2023-10-08T00:25:37.732186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709769+0000","last_change":"2023-10-08T00:25:36.718814+0000","last_active":"2023-10-08T00:25:37.709769+0000","last_peered":"2023-10-08T00:25:37.709769+0000","last_clean":"2023-10-08T00:25:37.709769+0000","last_became_active":"2023-10-08T00:25:36.718506+0000","last_became_peered":"2023-10-08T00:25:36.718506+0000","last_unstale":"2023-10-08T00:25:37.709769+0000","last_undegraded":"2023-10-08T00:25:37.709769+0000","last_fullsized":"2023-10-08T00:25:37.709769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:51.104818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724511+0000","last_change":"2023-10-08T00:25:37.719223+0000","last_active":"2023-10-08T00:25:37.724511+0000","last_peered":"2023-10-08T00:25:37.724511+0000","last_clean":"2023-10-08T00:25:37.724511+0000","last_became_active":"2023-10-08T00:25:37.718939+0000","last_became_peered":"2023-10-08T00:25:37.718939+0000","last_unstale":"2023-10-08T00:25:37.724511+0000","last_undegraded":"2023-10-08T00:25:37.724511+0000","last_fullsized":"2023-10-08T00:25:37.724511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:19.623379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729366+0000","last_change":"2023-10-08T00:25:36.718647+0000","last_active":"2023-10-08T00:25:37.729366+0000","last_peered":"2023-10-08T00:25:37.729366+0000","last_clean":"2023-10-08T00:25:37.729366+0000","last_became_active":"2023-10-08T00:25:36.718381+0000","last_became_peered":"2023-10-08T00:25:36.718381+0000","last_unstale":"2023-10-08T00:25:37.729366+0000","last_undegraded":"2023-10-08T00:25:37.729366+0000","last_fullsized":"2023-10-08T00:25:37.729366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:56.564748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718169+0000","last_change":"2023-10-08T00:25:37.712092+0000","last_active":"2023-10-08T00:25:37.718169+0000","last_peered":"2023-10-08T00:25:37.718169+0000","last_clean":"2023-10-08T00:25:37.718169+0000","last_became_active":"2023-10-08T00:25:37.711818+0000","last_became_peered":"2023-10-08T00:25:37.711818+0000","last_unstale":"2023-10-08T00:25:37.718169+0000","last_undegraded":"2023-10-08T00:25:37.718169+0000","last_fullsized":"2023-10-08T00:25:37.718169+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:14.444743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719236+0000","last_change":"2023-10-08T00:25:36.717177+0000","last_active":"2023-10-08T00:25:37.719236+0000","last_peered":"2023-10-08T00:25:37.719236+0000","last_clean":"2023-10-08T00:25:37.719236+0000","last_became_active":"2023-10-08T00:25:36.716873+0000","last_became_peered":"2023-10-08T00:25:36.716873+0000","last_unstale":"2023-10-08T00:25:37.719236+0000","last_undegraded":"2023-10-08T00:25:37.719236+0000","last_fullsized":"2023-10-08T00:25:37.719236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727726+0000","last_change":"2023-10-08T00:25:37.718915+0000","last_active":"2023-10-08T00:25:37.727726+0000","last_peered":"2023-10-08T00:25:37.727726+0000","last_clean":"2023-10-08T00:25:37.727726+0000","last_became_active":"2023-10-08T00:25:37.718659+0000","last_became_peered":"2023-10-08T00:25:37.718659+0000","last_unstale":"2023-10-08T00:25:37.727726+0000","last_undegraded":"2023-10-08T00:25:37.727726+0000","last_fullsized":"2023-10-08T00:25:37.727726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.724875+0000","last_change":"2023-10-08T00:25:36.712041+0000","last_active":"2023-10-08T00:25:37.724875+0000","last_peered":"2023-10-08T00:25:37.724875+0000","last_clean":"2023-10-08T00:25:37.724875+0000","last_became_active":"2023-10-08T00:25:36.711765+0000","last_became_peered":"2023-10-08T00:25:36.711765+0000","last_unstale":"2023-10-08T00:25:37.724875+0000","last_undegraded":"2023-10-08T00:25:37.724875+0000","last_fullsized":"2023-10-08T00:25:37.724875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:56:16.641851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.718299+0000","last_change":"2023-10-08T00:25:37.707908+0000","last_active":"2023-10-08T00:25:37.718299+0000","last_peered":"2023-10-08T00:25:37.718299+0000","last_clean":"2023-10-08T00:25:37.718299+0000","last_became_active":"2023-10-08T00:25:37.707495+0000","last_became_peered":"2023-10-08T00:25:37.707495+0000","last_unstale":"2023-10-08T00:25:37.718299+0000","last_undegraded":"2023-10-08T00:25:37.718299+0000","last_fullsized":"2023-10-08T00:25:37.718299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:08.137490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721693+0000","last_change":"2023-10-08T00:25:36.710619+0000","last_active":"2023-10-08T00:25:37.721693+0000","last_peered":"2023-10-08T00:25:37.721693+0000","last_clean":"2023-10-08T00:25:37.721693+0000","last_became_active":"2023-10-08T00:25:36.710333+0000","last_became_peered":"2023-10-08T00:25:36.710333+0000","last_unstale":"2023-10-08T00:25:37.721693+0000","last_undegraded":"2023-10-08T00:25:37.721693+0000","last_fullsized":"2023-10-08T00:25:37.721693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:51.725428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.731077+0000","last_change":"2023-10-08T00:25:37.730380+0000","last_active":"2023-10-08T00:25:37.731077+0000","last_peered":"2023-10-08T00:25:37.731077+0000","last_clean":"2023-10-08T00:25:37.731077+0000","last_became_active":"2023-10-08T00:25:37.730118+0000","last_became_peered":"2023-10-08T00:25:37.730118+0000","last_unstale":"2023-10-08T00:25:37.731077+0000","last_undegraded":"2023-10-08T00:25:37.731077+0000","last_fullsized":"2023-10-08T00:25:37.731077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:22.917659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.706093+0000","last_change":"2023-10-08T00:25:36.714762+0000","last_active":"2023-10-08T00:25:37.706093+0000","last_peered":"2023-10-08T00:25:37.706093+0000","last_clean":"2023-10-08T00:25:37.706093+0000","last_became_active":"2023-10-08T00:25:36.714305+0000","last_became_peered":"2023-10-08T00:25:36.714305+0000","last_unstale":"2023-10-08T00:25:37.706093+0000","last_undegraded":"2023-10-08T00:25:37.706093+0000","last_fullsized":"2023-10-08T00:25:37.706093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:03:17.073658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712421+0000","last_change":"2023-10-08T00:25:37.710227+0000","last_active":"2023-10-08T00:25:37.712421+0000","last_peered":"2023-10-08T00:25:37.712421+0000","last_clean":"2023-10-08T00:25:37.712421+0000","last_became_active":"2023-10-08T00:25:37.709979+0000","last_became_peered":"2023-10-08T00:25:37.709979+0000","last_unstale":"2023-10-08T00:25:37.712421+0000","last_undegraded":"2023-10-08T00:25:37.712421+0000","last_fullsized":"2023-10-08T00:25:37.712421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:04.236591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.720952+0000","last_change":"2023-10-08T00:25:36.708660+0000","last_active":"2023-10-08T00:25:37.720952+0000","last_peered":"2023-10-08T00:25:37.720952+0000","last_clean":"2023-10-08T00:25:37.720952+0000","last_became_active":"2023-10-08T00:25:36.708372+0000","last_became_peered":"2023-10-08T00:25:36.708372+0000","last_unstale":"2023-10-08T00:25:37.720952+0000","last_undegraded":"2023-10-08T00:25:37.720952+0000","last_fullsized":"2023-10-08T00:25:37.720952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721638+0000","last_change":"2023-10-08T00:25:37.719923+0000","last_active":"2023-10-08T00:25:37.721638+0000","last_peered":"2023-10-08T00:25:37.721638+0000","last_clean":"2023-10-08T00:25:37.721638+0000","last_became_active":"2023-10-08T00:25:37.719248+0000","last_became_peered":"2023-10-08T00:25:37.719248+0000","last_unstale":"2023-10-08T00:25:37.721638+0000","last_undegraded":"2023-10-08T00:25:37.721638+0000","last_fullsized":"2023-10-08T00:25:37.721638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:52.731736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709660+0000","last_change":"2023-10-08T00:25:36.708895+0000","last_active":"2023-10-08T00:25:37.709660+0000","last_peered":"2023-10-08T00:25:37.709660+0000","last_clean":"2023-10-08T00:25:37.709660+0000","last_became_active":"2023-10-08T00:25:36.708462+0000","last_became_peered":"2023-10-08T00:25:36.708462+0000","last_unstale":"2023-10-08T00:25:37.709660+0000","last_undegraded":"2023-10-08T00:25:37.709660+0000","last_fullsized":"2023-10-08T00:25:37.709660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:51.725428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.719629+0000","last_change":"2023-10-08T00:25:37.716451+0000","last_active":"2023-10-08T00:25:37.719629+0000","last_peered":"2023-10-08T00:25:37.719629+0000","last_clean":"2023-10-08T00:25:37.719629+0000","last_became_active":"2023-10-08T00:25:37.716170+0000","last_became_peered":"2023-10-08T00:25:37.716170+0000","last_unstale":"2023-10-08T00:25:37.719629+0000","last_undegraded":"2023-10-08T00:25:37.719629+0000","last_fullsized":"2023-10-08T00:25:37.719629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:08.187847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705859+0000","last_change":"2023-10-08T00:25:36.715360+0000","last_active":"2023-10-08T00:25:37.705859+0000","last_peered":"2023-10-08T00:25:37.705859+0000","last_clean":"2023-10-08T00:25:37.705859+0000","last_became_active":"2023-10-08T00:25:36.715091+0000","last_became_peered":"2023-10-08T00:25:36.715091+0000","last_unstale":"2023-10-08T00:25:37.705859+0000","last_undegraded":"2023-10-08T00:25:37.705859+0000","last_fullsized":"2023-10-08T00:25:37.705859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:03.230282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.727324+0000","last_change":"2023-10-08T00:25:37.723622+0000","last_active":"2023-10-08T00:25:37.727324+0000","last_peered":"2023-10-08T00:25:37.727324+0000","last_clean":"2023-10-08T00:25:37.727324+0000","last_became_active":"2023-10-08T00:25:37.723092+0000","last_became_peered":"2023-10-08T00:25:37.723092+0000","last_unstale":"2023-10-08T00:25:37.727324+0000","last_undegraded":"2023-10-08T00:25:37.727324+0000","last_fullsized":"2023-10-08T00:25:37.727324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:34.637351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.706399+0000","last_change":"2023-10-08T00:25:36.711926+0000","last_active":"2023-10-08T00:25:37.706399+0000","last_peered":"2023-10-08T00:25:37.706399+0000","last_clean":"2023-10-08T00:25:37.706399+0000","last_became_active":"2023-10-08T00:25:36.711690+0000","last_became_peered":"2023-10-08T00:25:36.711690+0000","last_unstale":"2023-10-08T00:25:37.706399+0000","last_undegraded":"2023-10-08T00:25:37.706399+0000","last_fullsized":"2023-10-08T00:25:37.706399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:49:51.162176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714924+0000","last_change":"2023-10-08T00:25:37.712252+0000","last_active":"2023-10-08T00:25:37.714924+0000","last_peered":"2023-10-08T00:25:37.714924+0000","last_clean":"2023-10-08T00:25:37.714924+0000","last_became_active":"2023-10-08T00:25:37.711968+0000","last_became_peered":"2023-10-08T00:25:37.711968+0000","last_unstale":"2023-10-08T00:25:37.714924+0000","last_undegraded":"2023-10-08T00:25:37.714924+0000","last_fullsized":"2023-10-08T00:25:37.714924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:41:15.013916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721453+0000","last_change":"2023-10-08T00:25:36.711520+0000","last_active":"2023-10-08T00:25:37.721453+0000","last_peered":"2023-10-08T00:25:37.721453+0000","last_clean":"2023-10-08T00:25:37.721453+0000","last_became_active":"2023-10-08T00:25:36.710780+0000","last_became_peered":"2023-10-08T00:25:36.710780+0000","last_unstale":"2023-10-08T00:25:37.721453+0000","last_undegraded":"2023-10-08T00:25:37.721453+0000","last_fullsized":"2023-10-08T00:25:37.721453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.728153+0000","last_change":"2023-10-08T00:25:37.720889+0000","last_active":"2023-10-08T00:25:37.728153+0000","last_peered":"2023-10-08T00:25:37.728153+0000","last_clean":"2023-10-08T00:25:37.728153+0000","last_became_active":"2023-10-08T00:25:37.720152+0000","last_became_peered":"2023-10-08T00:25:37.720152+0000","last_unstale":"2023-10-08T00:25:37.728153+0000","last_undegraded":"2023-10-08T00:25:37.728153+0000","last_fullsized":"2023-10-08T00:25:37.728153+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:41.496829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T00:25:39.822657+0000","last_change":"2023-10-08T00:25:36.707046+0000","last_active":"2023-10-08T00:25:39.822657+0000","last_peered":"2023-10-08T00:25:39.822657+0000","last_clean":"2023-10-08T00:25:39.822657+0000","last_became_active":"2023-10-08T00:25:36.706778+0000","last_became_peered":"2023-10-08T00:25:36.706778+0000","last_unstale":"2023-10-08T00:25:39.822657+0000","last_undegraded":"2023-10-08T00:25:39.822657+0000","last_fullsized":"2023-10-08T00:25:39.822657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:56:12.602722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714206+0000","last_change":"2023-10-08T00:25:37.708046+0000","last_active":"2023-10-08T00:25:37.714206+0000","last_peered":"2023-10-08T00:25:37.714206+0000","last_clean":"2023-10-08T00:25:37.714206+0000","last_became_active":"2023-10-08T00:25:37.707776+0000","last_became_peered":"2023-10-08T00:25:37.707776+0000","last_unstale":"2023-10-08T00:25:37.714206+0000","last_undegraded":"2023-10-08T00:25:37.714206+0000","last_fullsized":"2023-10-08T00:25:37.714206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:26:57.571056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.700929+0000","last_change":"2023-10-08T00:25:36.709706+0000","last_active":"2023-10-08T00:25:37.700929+0000","last_peered":"2023-10-08T00:25:37.700929+0000","last_clean":"2023-10-08T00:25:37.700929+0000","last_became_active":"2023-10-08T00:25:36.709437+0000","last_became_peered":"2023-10-08T00:25:36.709437+0000","last_unstale":"2023-10-08T00:25:37.700929+0000","last_undegraded":"2023-10-08T00:25:37.700929+0000","last_fullsized":"2023-10-08T00:25:37.700929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:41:14.007608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.721889+0000","last_change":"2023-10-08T00:25:37.716602+0000","last_active":"2023-10-08T00:25:37.721889+0000","last_peered":"2023-10-08T00:25:37.721889+0000","last_clean":"2023-10-08T00:25:37.721889+0000","last_became_active":"2023-10-08T00:25:37.716335+0000","last_became_peered":"2023-10-08T00:25:37.716335+0000","last_unstale":"2023-10-08T00:25:37.721889+0000","last_undegraded":"2023-10-08T00:25:37.721889+0000","last_fullsized":"2023-10-08T00:25:37.721889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:52.111126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.703539+0000","last_change":"2023-10-08T00:25:36.714743+0000","last_active":"2023-10-08T00:25:37.703539+0000","last_peered":"2023-10-08T00:25:37.703539+0000","last_clean":"2023-10-08T00:25:37.703539+0000","last_became_active":"2023-10-08T00:25:36.714312+0000","last_became_peered":"2023-10-08T00:25:36.714312+0000","last_unstale":"2023-10-08T00:25:37.703539+0000","last_undegraded":"2023-10-08T00:25:37.703539+0000","last_fullsized":"2023-10-08T00:25:37.703539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:21.911351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.714941+0000","last_change":"2023-10-08T00:25:37.713570+0000","last_active":"2023-10-08T00:25:37.714941+0000","last_peered":"2023-10-08T00:25:37.714941+0000","last_clean":"2023-10-08T00:25:37.714941+0000","last_became_active":"2023-10-08T00:25:37.713320+0000","last_became_peered":"2023-10-08T00:25:37.713320+0000","last_unstale":"2023-10-08T00:25:37.714941+0000","last_undegraded":"2023-10-08T00:25:37.714941+0000","last_fullsized":"2023-10-08T00:25:37.714941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:27:48.211667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.699927+0000","last_change":"2023-10-08T00:25:36.709471+0000","last_active":"2023-10-08T00:25:37.699927+0000","last_peered":"2023-10-08T00:25:37.699927+0000","last_clean":"2023-10-08T00:25:37.699927+0000","last_became_active":"2023-10-08T00:25:36.709128+0000","last_became_peered":"2023-10-08T00:25:36.709128+0000","last_unstale":"2023-10-08T00:25:37.699927+0000","last_undegraded":"2023-10-08T00:25:37.699927+0000","last_fullsized":"2023-10-08T00:25:37.699927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:21.911351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.729199+0000","last_change":"2023-10-08T00:25:37.725985+0000","last_active":"2023-10-08T00:25:37.729199+0000","last_peered":"2023-10-08T00:25:37.729199+0000","last_clean":"2023-10-08T00:25:37.729199+0000","last_became_active":"2023-10-08T00:25:37.722306+0000","last_became_peered":"2023-10-08T00:25:37.722306+0000","last_unstale":"2023-10-08T00:25:37.729199+0000","last_undegraded":"2023-10-08T00:25:37.729199+0000","last_fullsized":"2023-10-08T00:25:37.729199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:29:53.511114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.705965+0000","last_change":"2023-10-08T00:25:36.708817+0000","last_active":"2023-10-08T00:25:37.705965+0000","last_peered":"2023-10-08T00:25:37.705965+0000","last_clean":"2023-10-08T00:25:37.705965+0000","last_became_active":"2023-10-08T00:25:36.708553+0000","last_became_peered":"2023-10-08T00:25:36.708553+0000","last_unstale":"2023-10-08T00:25:37.705965+0000","last_undegraded":"2023-10-08T00:25:37.705965+0000","last_fullsized":"2023-10-08T00:25:37.705965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:07.181539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.726073+0000","last_change":"2023-10-08T00:25:37.724331+0000","last_active":"2023-10-08T00:25:37.726073+0000","last_peered":"2023-10-08T00:25:37.726073+0000","last_clean":"2023-10-08T00:25:37.726073+0000","last_became_active":"2023-10-08T00:25:37.724030+0000","last_became_peered":"2023-10-08T00:25:37.724030+0000","last_unstale":"2023-10-08T00:25:37.726073+0000","last_undegraded":"2023-10-08T00:25:37.726073+0000","last_fullsized":"2023-10-08T00:25:37.726073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:07.872416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712091+0000","last_change":"2023-10-08T00:25:36.720869+0000","last_active":"2023-10-08T00:25:37.712091+0000","last_peered":"2023-10-08T00:25:37.712091+0000","last_clean":"2023-10-08T00:25:37.712091+0000","last_became_active":"2023-10-08T00:25:36.720607+0000","last_became_peered":"2023-10-08T00:25:36.720607+0000","last_unstale":"2023-10-08T00:25:37.712091+0000","last_undegraded":"2023-10-08T00:25:37.712091+0000","last_fullsized":"2023-10-08T00:25:37.712091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:37.686348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.725308+0000","last_change":"2023-10-08T00:25:37.722440+0000","last_active":"2023-10-08T00:25:37.725308+0000","last_peered":"2023-10-08T00:25:37.725308+0000","last_clean":"2023-10-08T00:25:37.725308+0000","last_became_active":"2023-10-08T00:25:37.722114+0000","last_became_peered":"2023-10-08T00:25:37.722114+0000","last_unstale":"2023-10-08T00:25:37.725308+0000","last_undegraded":"2023-10-08T00:25:37.725308+0000","last_fullsized":"2023-10-08T00:25:37.725308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:36.691278+0000","last_clean_scrub_stamp":"2023-10-08T00:25:36.691278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:34.335222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.709019+0000","last_change":"2023-10-08T00:25:36.710889+0000","last_active":"2023-10-08T00:25:37.709019+0000","last_peered":"2023-10-08T00:25:37.709019+0000","last_clean":"2023-10-08T00:25:37.709019+0000","last_became_active":"2023-10-08T00:25:36.710598+0000","last_became_peered":"2023-10-08T00:25:36.710598+0000","last_unstale":"2023-10-08T00:25:37.709019+0000","last_undegraded":"2023-10-08T00:25:37.709019+0000","last_fullsized":"2023-10-08T00:25:37.709019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:25:35.684969+0000","last_clean_scrub_stamp":"2023-10-08T00:25:35.684969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:07.181539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-08T00:25:37.712108+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:25:37.712108+0000","last_peered":"2023-10-08T00:25:37.712108+0000","last_clean":"2023-10-08T00:25:37.712108+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:25:37.712108+0000","last_undegraded":"2023-10-08T00:25:37.712108+0000","last_fullsized":"2023-10-08T00:25:37.712108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":728831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":138961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":139931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.49299999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63200000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73399999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.755}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.748},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298220,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073620,"statfs":{"total":96636764160,"available":96331386880,"internally_reserved":0,"allocated":954368,"data_stored":728741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":138443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":139931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.66100000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":138477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.77100000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.84199999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.69999999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61799999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.81599999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.751}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:25:46.755 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:25:46.756 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:25:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.915+0000 7f4aebfc2700 1 Processor -- start 2023-10-08T00:25:46.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.915+0000 7f4aebfc2700 1 -- start start 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.916+0000 7f4aebfc2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.916+0000 7f4aebfc2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ae4156af0 0x7f4ae40cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.916+0000 7f4aebfc2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae4157ca0 con 0x7f4ae4156720 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.916+0000 7f4aebfc2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae4157090 con 0x7f4ae4156af0 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.916+0000 7f4aebfc2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4157370 con 0x7f4ae406fa50 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae955d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4aea55f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ae4156af0 0x7f4ae40cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae9d5e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4ae4156720 0x7f4ae406f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:50572/0 (socket says 172.21.15.22:50572) 2023-10-08T00:25:46.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae9d5e700 1 -- 172.21.15.22:0/39903788 learned_addr learned my addr 172.21.15.22:0/39903788 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4aea55f700 1 -- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 msgr2=0x7f4ae40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4aea55f700 1 --2- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4aea55f700 1 -- 172.21.15.22:0/39903788 >> v1:172.21.15.192:6789/0 conn(0x7f4ae4156720 legacy=0x7f4ae406f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4aea55f700 1 -- 172.21.15.22:0/39903788 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4157650 con 0x7f4ae4156af0 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae955d700 1 --2- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4aea55f700 1 --2- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40cd5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0098e0 tx=0x7f4adc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05d91937c8da34c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae8d5c700 1 -- 172.21.15.22:0/39903788 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00b640 con 0x7f4ae4156af0 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae8d5c700 1 -- 172.21.15.22:0/39903788 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc00b7a0 con 0x7f4ae4156af0 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.917+0000 7f4ae8d5c700 1 -- 172.21.15.22:0/39903788 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00bb40 con 0x7f4ae4156af0 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 -- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 msgr2=0x7f4ae40cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40cd5e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0098e0 tx=0x7f4adc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 -- 172.21.15.22:0/39903788 shutdown_connections 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40cd5e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/39903788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 -- 172.21.15.22:0/39903788 >> 172.21.15.22:0/39903788 conn(0x7f4ae40694a0 msgr2=0x7f4ae40698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:46.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 -- 172.21.15.22:0/39903788 shutdown_connections 2023-10-08T00:25:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.918+0000 7f4aebfc2700 1 -- 172.21.15.22:0/39903788 wait complete. 2023-10-08T00:25:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.919+0000 7f4aebfc2700 1 Processor -- start 2023-10-08T00:25:46.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.919+0000 7f4aebfc2700 1 -- start start 2023-10-08T00:25:46.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aebfc2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae41529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aebfc2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 0x7f4ae4166620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aebfc2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aebfc2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40b1480 con 0x7f4ae4156720 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aebfc2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40c2890 con 0x7f4ae4156af0 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aebfc2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4166c90 con 0x7f4ae406fa50 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 0x7f4ae4166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 0x7f4ae4166620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41492/0 (socket says 172.21.15.22:41492) 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 -- 172.21.15.22:0/3791754137 learned_addr learned my addr 172.21.15.22:0/3791754137 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4aea55f700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae9d5e700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae41529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 -- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 msgr2=0x7f4ae41529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae41529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 -- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 msgr2=0x7f4ae40b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.920+0000 7f4ae955d700 1 -- 172.21.15.22:0/3791754137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8009420 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.921+0000 7f4ae955d700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 0x7f4ae4166620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800ec80 tx=0x7f4ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.921+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800c970 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.921+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad800cad0 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.921+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc009420 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.921+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800ce50 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.921+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae40b1990 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.922+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae40718b0 con 0x7f4ae4156720 2023-10-08T00:25:46.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.922+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ad8013680 con 0x7f4ae4156720 2023-10-08T00:25:46.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.923+0000 7f4ae1ffb700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad0066f30 0x7f4ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:46.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.923+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ad8084c30 con 0x7f4ae4156720 2023-10-08T00:25:46.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.923+0000 7f4ae9d5e700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad0066f30 0x7f4ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:46.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.923+0000 7f4ae9d5e700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad0066f30 0x7f4ad00693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4158ec0 tx=0x7f4ad4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:46.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:46.927+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ad8051ea0 con 0x7f4ae4156720 2023-10-08T00:25:47.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.199+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4ae406eaf0 con 0x7f4ae4156720 2023-10-08T00:25:47.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.203+0000 7f4ae1ffb700 1 -- 172.21.15.22:0/3791754137 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4ad80170e0 con 0x7f4ae4156720 2023-10-08T00:25:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad0066f30 msgr2=0x7f4ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad0066f30 0x7f4ad00693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4158ec0 tx=0x7f4ad4009040 comp rx=0 tx=0).stop 2023-10-08T00:25:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 msgr2=0x7f4ae4166620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 0x7f4ae4166620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800ec80 tx=0x7f4ad80091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 shutdown_connections 2023-10-08T00:25:47.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ae4156af0 0x7f4ae40b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad0066f30 0x7f4ad00693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4ae406fa50 0x7f4ae41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 --2- 172.21.15.22:0/3791754137 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ae4156720 0x7f4ae4166620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 >> 172.21.15.22:0/3791754137 conn(0x7f4ae40694a0 msgr2=0x7f4ae4153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 shutdown_connections 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.205+0000 7f4aebfc2700 1 -- 172.21.15.22:0/3791754137 wait complete. 2023-10-08T00:25:47.207 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:25:47.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.337+0000 7f65594ce700 1 Processor -- start 2023-10-08T00:25:47.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.337+0000 7f65594ce700 1 -- start start 2023-10-08T00:25:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.337+0000 7f65594ce700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6554159c60 0x7f655415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:47.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.337+0000 7f65594ce700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655415a160 con 0x7f6554159890 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.337+0000 7f65594ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65540d13a0 con 0x7f655415db10 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.337+0000 7f65594ce700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655415df50 con 0x7f6554159c60 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f6552ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6554159890 0x7f655415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35182/0 (socket says 172.21.15.22:35182) 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f6552ffd700 1 -- 172.21.15.22:0/140848240 learned_addr learned my addr 172.21.15.22:0/140848240 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f65527fc700 1 --2- 172.21.15.22:0/140848240 >> v2:172.21.15.22:3300/0 conn(0x7f6554159c60 0x7f655415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f65527fc700 1 -- 172.21.15.22:0/140848240 >> v1:172.21.15.192:6789/0 conn(0x7f655415db10 legacy=0x7f6554069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f65527fc700 1 -- 172.21.15.22:0/140848240 >> v1:172.21.15.22:6789/0 conn(0x7f6554159890 legacy=0x7f655415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f65527fc700 1 -- 172.21.15.22:0/140848240 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655415e140 con 0x7f6554159c60 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f6551ffb700 1 -- 172.21.15.22:0/140848240 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530626517 0 0) 0x7f655415a160 con 0x7f6554159890 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f65527fc700 1 --2- 172.21.15.22:0/140848240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159c60 0x7f655415d5d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f653c0098e0 tx=0x7f653c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ab8102ee9b648 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f6551ffb700 1 -- 172.21.15.22:0/140848240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c009e80 con 0x7f6554159c60 2023-10-08T00:25:47.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f6551ffb700 1 -- 172.21.15.22:0/140848240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c00b820 con 0x7f6554159c60 2023-10-08T00:25:47.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.338+0000 7f6551ffb700 1 -- 172.21.15.22:0/140848240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00bba0 con 0x7f6554159c60 2023-10-08T00:25:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 -- 172.21.15.22:0/140848240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159c60 msgr2=0x7f655415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 --2- 172.21.15.22:0/140848240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159c60 0x7f655415d5d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f653c0098e0 tx=0x7f653c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 -- 172.21.15.22:0/140848240 shutdown_connections 2023-10-08T00:25:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 --2- 172.21.15.22:0/140848240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159c60 0x7f655415d5d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 -- 172.21.15.22:0/140848240 >> 172.21.15.22:0/140848240 conn(0x7f6554068e20 msgr2=0x7f65540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:47.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 -- 172.21.15.22:0/140848240 shutdown_connections 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.339+0000 7f65594ce700 1 -- 172.21.15.22:0/140848240 wait complete. 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.340+0000 7f65594ce700 1 Processor -- start 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.340+0000 7f65594ce700 1 -- start start 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 0x7f65540b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6554159c60 0x7f65540b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655415db10 0x7f65540b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65540cd410 con 0x7f6554159890 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65540b6230 con 0x7f6554159c60 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65540cd6d0 con 0x7f655415db10 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 0x7f65540b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 0x7f65540b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41506/0 (socket says 172.21.15.22:41506) 2023-10-08T00:25:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 -- 172.21.15.22:0/118820285 learned_addr learned my addr 172.21.15.22:0/118820285 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65537fe700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655415db10 0x7f65540b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65527fc700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6554159c60 0x7f65540b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 -- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655415db10 msgr2=0x7f65540b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655415db10 0x7f65540b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 -- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6554159c60 msgr2=0x7f65540b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6554159c60 0x7f65540b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 -- 172.21.15.22:0/118820285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c009420 con 0x7f6554159890 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f6552ffd700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 0x7f65540b3590 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f654400c5b0 tx=0x7f6544001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544005b30 con 0x7f6554159890 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544005c90 con 0x7f6554159890 2023-10-08T00:25:47.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65540cd9b0 con 0x7f6554159890 2023-10-08T00:25:47.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544007300 con 0x7f6554159890 2023-10-08T00:25:47.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.341+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65540b5ec0 con 0x7f6554159890 2023-10-08T00:25:47.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.342+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655404c3c0 con 0x7f6554159890 2023-10-08T00:25:47.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.343+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f654401b3b0 con 0x7f6554159890 2023-10-08T00:25:47.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.343+0000 7f654affd700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6534066f30 0x7f65340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:47.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.343+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6544083a60 con 0x7f6554159890 2023-10-08T00:25:47.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.343+0000 7f65527fc700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6534066f30 0x7f65340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:47.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.344+0000 7f65527fc700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6534066f30 0x7f65340693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f653c0030c0 tx=0x7f653c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:47.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.347+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6544050cd0 con 0x7f6554159890 2023-10-08T00:25:47.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.584+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65540b0120 con 0x7f6554159890 2023-10-08T00:25:47.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.585+0000 7f654affd700 1 -- 172.21.15.22:0/118820285 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f6544017090 con 0x7f6554159890 2023-10-08T00:25:47.585 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:47.585 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4804,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1890171180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1890171180},{"type":"v1","addr":"172.21.15.192:6836","nonce":1890171180}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:37.106452+0000","modified":"2023-10-08T00:25:40.729415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/685646696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":685646696},{"type":"v1","addr":"172.21.15.22:6834","nonce":685646696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T00:25:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6534066f30 msgr2=0x7f65340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6534066f30 0x7f65340693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f653c0030c0 tx=0x7f653c016000 comp rx=0 tx=0).stop 2023-10-08T00:25:47.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 msgr2=0x7f65540b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 0x7f65540b3590 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f654400c5b0 tx=0x7f6544001070 comp rx=0 tx=0).stop 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 shutdown_connections 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6534066f30 0x7f65340693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f655415db10 0x7f65540b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6554159890 0x7f65540b3590 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 --2- 172.21.15.22:0/118820285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6554159c60 0x7f65540b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:47.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 >> 172.21.15.22:0/118820285 conn(0x7f6554068e20 msgr2=0x7f65541532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:47.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 shutdown_connections 2023-10-08T00:25:47.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:47.587+0000 7f65594ce700 1 -- 172.21.15.22:0/118820285 wait complete. 2023-10-08T00:25:47.590 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2023-10-08T00:25:48.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:25:37.106452+0000', 'modified': '2023-10-08T00:25:40.729415+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4923}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4923': {'gid': 4923, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6834/685646696', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6832', 'nonce': 685646696}, {'type': 'v1', 'addr': '172.21.15.22:6834', 'nonce': 685646696}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:25:48.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:25:48.001 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T00:25:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.123+0000 7f0984277700 1 Processor -- start 2023-10-08T00:25:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.123+0000 7f0984277700 1 -- start start 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0984277700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f097c06bcd0 0x7f097c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0984277700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c15d7e0 con 0x7f097c15df50 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0984277700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c15dac0 con 0x7f097c06c0a0 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0984277700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097c15aa30 con 0x7f097c06bcd0 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0982013700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f097c06bcd0 0x7f097c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0982013700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f097c06bcd0 0x7f097c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41508/0 (socket says 172.21.15.22:41508) 2023-10-08T00:25:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0982814700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f097c15df50 0x7f097c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35192/0 (socket says 172.21.15.22:35192) 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.124+0000 7f0982013700 1 -- 172.21.15.22:0/2556092557 learned_addr learned my addr 172.21.15.22:0/2556092557 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0982013700 1 -- 172.21.15.22:0/2556092557 >> v1:172.21.15.192:6789/0 conn(0x7f097c06c0a0 legacy=0x7f097c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0982013700 1 -- 172.21.15.22:0/2556092557 >> v1:172.21.15.22:6789/0 conn(0x7f097c15df50 legacy=0x7f097c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0982013700 1 -- 172.21.15.22:0/2556092557 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c15ad10 con 0x7f097c06bcd0 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0981011700 1 -- 172.21.15.22:0/2556092557 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895158308 0 0) 0x7f097c15d7e0 con 0x7f097c15df50 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0982013700 1 --2- 172.21.15.22:0/2556092557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c06bcd0 0x7f097c0caa90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f096c009f20 tx=0x7f096c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b12d73df7995c88 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0981011700 1 -- 172.21.15.22:0/2556092557 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00e070 con 0x7f097c06bcd0 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0981011700 1 -- 172.21.15.22:0/2556092557 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00ba40 con 0x7f097c06bcd0 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0981011700 1 -- 172.21.15.22:0/2556092557 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0092e0 con 0x7f097c06bcd0 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0984277700 1 -- 172.21.15.22:0/2556092557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c06bcd0 msgr2=0x7f097c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.125+0000 7f0984277700 1 --2- 172.21.15.22:0/2556092557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c06bcd0 0x7f097c0caa90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f096c009f20 tx=0x7f096c009840 comp rx=0 tx=0).stop 2023-10-08T00:25:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.126+0000 7f0984277700 1 -- 172.21.15.22:0/2556092557 shutdown_connections 2023-10-08T00:25:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.126+0000 7f0984277700 1 --2- 172.21.15.22:0/2556092557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c06bcd0 0x7f097c0caa90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.126+0000 7f0984277700 1 -- 172.21.15.22:0/2556092557 >> 172.21.15.22:0/2556092557 conn(0x7f097c0ce600 msgr2=0x7f097c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.126+0000 7f0984277700 1 -- 172.21.15.22:0/2556092557 shutdown_connections 2023-10-08T00:25:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.126+0000 7f0984277700 1 -- 172.21.15.22:0/2556092557 wait complete. 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 Processor -- start 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 -- start start 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c06bcd0 0x7f097c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c06c0a0 0x7f097c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 0x7f097c0c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0b4230 con 0x7f097c15df50 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c8c00 con 0x7f097c06c0a0 2023-10-08T00:25:48.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0984277700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c85f0 con 0x7f097c06bcd0 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.127+0000 7f0982814700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 0x7f097c0c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 0x7f097c0c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41520/0 (socket says 172.21.15.22:41520) 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 -- 172.21.15.22:0/1103456181 learned_addr learned my addr 172.21.15.22:0/1103456181 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0981812700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c06c0a0 0x7f097c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 -- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c06bcd0 msgr2=0x7f097c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c06bcd0 0x7f097c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 -- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c06c0a0 msgr2=0x7f097c155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c06c0a0 0x7f097c155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 -- 172.21.15.22:0/1103456181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c009ae0 con 0x7f097c15df50 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0982814700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 0x7f097c0c5d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f097400c530 tx=0x7f0974007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f097a7fc700 1 -- 172.21.15.22:0/1103456181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974005a70 con 0x7f097c15df50 2023-10-08T00:25:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f097a7fc700 1 -- 172.21.15.22:0/1103456181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974005bd0 con 0x7f097c15df50 2023-10-08T00:25:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c0b3c70 con 0x7f097c15df50 2023-10-08T00:25:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f097a7fc700 1 -- 172.21.15.22:0/1103456181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740070d0 con 0x7f097c15df50 2023-10-08T00:25:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.128+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c0c8890 con 0x7f097c15df50 2023-10-08T00:25:48.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.130+0000 7f097a7fc700 1 -- 172.21.15.22:0/1103456181 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09740074c0 con 0x7f097c15df50 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.130+0000 7f097a7fc700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0968066f30 0x7f09680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.130+0000 7f097a7fc700 1 -- 172.21.15.22:0/1103456181 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09740839c0 con 0x7f097c15df50 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.130+0000 7f0982013700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0968066f30 0x7f09680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.131+0000 7f0982013700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0968066f30 0x7f09680693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f096c009f20 tx=0x7f096c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.132+0000 7f098d56fb80 1 Processor -- start 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.132+0000 7f098d56fb80 1 -- start start 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f098d56fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a01fda70 con 0x5573a02cff60 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a01fb270 con 0x5573a02f0d00 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a01f7060 con 0x5573a02a6a50 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02a2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41526/0 (socket says 172.21.15.22:41526) 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 -- 172.21.15.22:0/2201009198 learned_addr learned my addr 172.21.15.22:0/2201009198 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0981812700 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982013700 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 -- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 msgr2=0x5573a02a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 -- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 msgr2=0x5573a02cfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02cfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 -- 172.21.15.22:0/2201009198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573a0091270 con 0x5573a02cff60 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.133+0000 7f0982814700 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02a2cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f09740547c0 tx=0x7f0974081e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5454a5a3b4885e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f09637fe700 1 -- 172.21.15.22:0/2201009198 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974054250 con 0x5573a02cff60 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f09637fe700 1 -- 172.21.15.22:0/2201009198 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974068070 con 0x5573a02cff60 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f09637fe700 1 -- 172.21.15.22:0/2201009198 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974054ff0 con 0x5573a02cff60 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 -- 172.21.15.22:0/2201009198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 msgr2=0x5573a02a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02a2cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f09740547c0 tx=0x7f0974081e40 comp rx=0 tx=0).stop 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 -- 172.21.15.22:0/2201009198 shutdown_connections 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02a2cf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 --2- 172.21.15.22:0/2201009198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02cfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 -- 172.21.15.22:0/2201009198 >> 172.21.15.22:0/2201009198 conn(0x5573a02a8370 msgr2=0x5573a02a8740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 -- 172.21.15.22:0/2201009198 shutdown_connections 2023-10-08T00:25:48.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.134+0000 7f098d56fb80 1 -- 172.21.15.22:0/2201009198 wait complete. 2023-10-08T00:25:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.135+0000 7f098d56fb80 1 -- start start 2023-10-08T00:25:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.135+0000 7f098d56fb80 1 Processor -- start 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02d2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a01a2890 con 0x5573a02cff60 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a01bdea0 con 0x5573a02f0d00 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a0079e30 con 0x5573a02a6a50 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f098d56fb80 10 client.0 _ll_register_callbacks cb 0x5573a026a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02e8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41532/0 (socket says 172.21.15.22:41532) 2023-10-08T00:25:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 -- 172.21.15.22:0/4019444499 learned_addr learned my addr 172.21.15.22:0/4019444499 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0982814700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0982013700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 -- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 msgr2=0x5573a02a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 -- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 msgr2=0x5573a02d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02d2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0981812700 1 -- 172.21.15.22:0/4019444499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c0c8890 con 0x5573a02cff60 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0982013700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.136+0000 7f0982814700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0981812700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02e8b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0970010300 tx=0x7f0970008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9ab24cf9f6a6da server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0960ff9700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:25:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0960ff9700 1 -- 172.21.15.22:0/4019444499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970014470 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0960ff9700 1 -- 172.21.15.22:0/4019444499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09700145d0 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5573a029bb70 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0960ff9700 1 -- 172.21.15.22:0/4019444499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09700149a0 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 10 client.5127 fetch_fsmap learned FSMap version 17 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5573a0033fe0 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0960ff9700 1 -- 172.21.15.22:0/4019444499 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5573a029bb70 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0960ff9700 1 -- 172.21.15.22:0/4019444499 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0970014b00 con 0x5573a02cff60 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 10 client.5127 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 10 client.5127 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 20 client.5127 populate_metadata read hostname 'smithi022' 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e6420 0x5573a02e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 4 client.5127 mds_command: new command op to 4923 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 --> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5573a0278aa0 con 0x5573a02e6420 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.137+0000 7f0982013700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e6420 0x5573a02e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f0960ff9700 10 client.5127 ms_handle_connect on v2:172.21.15.22:6832/685646696 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f0982013700 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e6420 0x5573a02e67f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89835f2e79b0a78a server_cookie=1c388c97984aca8a in_seq=0 out_seq=0 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f0960ff9700 1 -- 172.21.15.22:0/4019444499 <== mds.0 v2:172.21.15.22:6832/685646696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5573a0278aa0 con 0x5573a02e6420 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f0960ff9700 10 client.5127 handle_command_reply: tid=0 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 client.5127 shutdown 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 msgr2=0x5573a02e8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02e8b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0970010300 tx=0x7f0970008040 comp rx=0 tx=0).stop 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 shutdown_connections 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02d2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e6420 0x5573a02e67f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a02a2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 --2- 172.21.15.22:0/4019444499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02e8b50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f0960ff9700 0 client.5127 ms_handle_reset on v2:172.21.15.22:6832/685646696 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.138+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 >> 172.21.15.22:0/4019444499 conn(0x5573a02a8370 msgr2=0x5573a02a7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.139+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 shutdown_connections 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.139+0000 7f098d56fb80 1 -- 172.21.15.22:0/4019444499 wait complete. 2023-10-08T00:25:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.139+0000 7f098d56fb80 20 client.5127 trim_cache size 0 max 16384 2023-10-08T00:25:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 Processor -- start 2023-10-08T00:25:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 -- start start 2023-10-08T00:25:48.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 0x5573a02cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02cff60 0x5573a02ec240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a02aa660 con 0x5573a02a6a50 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a02eb600 con 0x5573a02f0d00 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a02e5ea0 con 0x5573a02cff60 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f0982013700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 0x5573a02cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f0982013700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 0x5573a02cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41548/0 (socket says 172.21.15.22:41548) 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.156+0000 7f0982013700 1 -- 172.21.15.22:0/1432599941 learned_addr learned my addr 172.21.15.22:0/1432599941 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0981812700 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02cff60 0x5573a02ec240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982814700 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982013700 1 -- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02cff60 msgr2=0x5573a02ec240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982013700 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02cff60 0x5573a02ec240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982013700 1 -- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 msgr2=0x5573a02ec780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982013700 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982013700 1 -- 172.21.15.22:0/1432599941 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5573a01c5780 con 0x5573a02a6a50 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0982013700 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 0x5573a02cee60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c010 tx=0x7f096c032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a490c17724da8764 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0963fff700 1 -- 172.21.15.22:0/1432599941 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c012c40 con 0x5573a02a6a50 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0963fff700 1 -- 172.21.15.22:0/1432599941 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c031040 con 0x5573a02a6a50 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.157+0000 7f0963fff700 1 -- 172.21.15.22:0/1432599941 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c012de0 con 0x5573a02a6a50 2023-10-08T00:25:48.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 -- 172.21.15.22:0/1432599941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 msgr2=0x5573a02cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 0x5573a02cee60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f096c00c010 tx=0x7f096c032250 comp rx=0 tx=0).stop 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 -- 172.21.15.22:0/1432599941 shutdown_connections 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02a6a50 0x5573a02cee60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 --2- 172.21.15.22:0/1432599941 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02cff60 0x5573a02ec240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 -- 172.21.15.22:0/1432599941 >> 172.21.15.22:0/1432599941 conn(0x5573a02a8370 msgr2=0x5573a029f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 -- 172.21.15.22:0/1432599941 shutdown_connections 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 -- 172.21.15.22:0/1432599941 wait complete. 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 -- start start 2023-10-08T00:25:48.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.158+0000 7f098d56fb80 1 Processor -- start 2023-10-08T00:25:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a03523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a030b060 con 0x5573a02cff60 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573a0354170 con 0x5573a02f0d00 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5573a030ae10 con 0x5573a02a6a50 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f098d56fb80 10 client.0 _ll_register_callbacks cb 0x5573a026a110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f0981812700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f0981812700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02ec0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41562/0 (socket says 172.21.15.22:41562) 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f0981812700 1 -- 172.21.15.22:0/516008697 learned_addr learned my addr 172.21.15.22:0/516008697 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f0982814700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.159+0000 7f0982013700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a03523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0981812700 1 -- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 msgr2=0x5573a03523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0981812700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a03523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0981812700 1 -- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 msgr2=0x5573a02ec5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0981812700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0981812700 1 -- 172.21.15.22:0/516008697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c15ad10 con 0x5573a02cff60 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0981812700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02ec0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f09700102d0 tx=0x7f0970020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43de73ec73cdb49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0960ff9700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0960ff9700 1 -- 172.21.15.22:0/516008697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097002b070 con 0x5573a02cff60 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0960ff9700 1 -- 172.21.15.22:0/516008697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09700149a0 con 0x5573a02cff60 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0974068070 con 0x5573a02cff60 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0960ff9700 1 -- 172.21.15.22:0/516008697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0970005900 con 0x5573a02cff60 2023-10-08T00:25:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 10 client.5133 fetch_fsmap learned FSMap version 17 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5573a01ac470 con 0x5573a02cff60 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0960ff9700 1 -- 172.21.15.22:0/516008697 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970037070 con 0x5573a02cff60 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0960ff9700 1 -- 172.21.15.22:0/516008697 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0970005a60 con 0x5573a02cff60 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 10 client.5133 fetch_fsmap finished waiting for FSMap version 17 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 20 client.5133 populate_metadata read hostname 'smithi022' 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e3a20 0x5573a02e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 4 client.5133 mds_command: new command op to 4923 tid=0[{"prefix": "status"}] 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 --> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5573a0199e00 con 0x5573a02e3a20 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.160+0000 7f0982013700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e3a20 0x5573a02e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f0960ff9700 10 client.5133 ms_handle_connect on v2:172.21.15.22:6832/685646696 2023-10-08T00:25:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f0982013700 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e3a20 0x5573a02e3df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54776f6508883f6f server_cookie=3b71e9bbf989849e in_seq=0 out_seq=0 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f0960ff9700 1 -- 172.21.15.22:0/516008697 <== mds.0 v2:172.21.15.22:6832/685646696 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5573a0199e00 con 0x5573a02e3a20 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f0960ff9700 10 client.5133 handle_command_reply: tid=0 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 client.5133 shutdown 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 msgr2=0x5573a02ec0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02ec0a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f09700102d0 tx=0x7f0970020000 comp rx=0 tx=0).stop 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 shutdown_connections 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5573a02f0d00 0x5573a02ec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:6832/685646696,v1:172.21.15.22:6834/685646696] conn(0x5573a02e3a20 0x5573a02e3df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5573a02a6a50 0x5573a03523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f0960ff9700 0 client.5133 ms_handle_reset on v2:172.21.15.22:6832/685646696 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 --2- 172.21.15.22:0/516008697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5573a02cff60 0x5573a02ec0a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 >> 172.21.15.22:0/516008697 conn(0x5573a02a8370 msgr2=0x5573a02a2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 shutdown_connections 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 1 -- 172.21.15.22:0/516008697 wait complete. 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.161+0000 7f098d56fb80 20 client.5133 trim_cache size 0 max 16384 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4923, 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:25:48.170 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.464627504999999, 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 17, 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 32, 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 32, 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 18.343691725999999 2023-10-08T00:25:48.171 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0968066f30 msgr2=0x7f09680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0968066f30 0x7f09680693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f096c009f20 tx=0x7f096c017000 comp rx=0 tx=0).stop 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 msgr2=0x7f097c0c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 0x7f097c0c5d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f097400c530 tx=0x7f0974007f90 comp rx=0 tx=0).stop 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 shutdown_connections 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f097c15df50 0x7f097c0c5d90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0968066f30 0x7f09680693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f097c06bcd0 0x7f097c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 --2- 172.21.15.22:0/1103456181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f097c06c0a0 0x7f097c155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 >> 172.21.15.22:0/1103456181 conn(0x7f097c0ce600 msgr2=0x7f097c157530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 shutdown_connections 2023-10-08T00:25:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.162+0000 7f0984277700 1 -- 172.21.15.22:0/1103456181 wait complete. 2023-10-08T00:25:48.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:25:48.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.293+0000 7f9887564700 1 Processor -- start 2023-10-08T00:25:48.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.293+0000 7f9887564700 1 -- start start 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9887564700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9880159840 0x7f98800cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9887564700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9880069bb0 0x7f98800b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9887564700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98800cfb30 con 0x7f98800cba70 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9887564700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800cbf10 con 0x7f9880159840 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9887564700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800cf4e0 con 0x7f9880069bb0 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9880159840 0x7f98800cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9880159840 0x7f98800cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41572/0 (socket says 172.21.15.22:41572) 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 -- 172.21.15.22:0/845515321 learned_addr learned my addr 172.21.15.22:0/845515321 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9884aff700 1 --1- 172.21.15.22:0/845515321 >> v1:172.21.15.22:6789/0 conn(0x7f98800cba70 0x7f98800694a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35204/0 (socket says 172.21.15.22:35204) 2023-10-08T00:25:48.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885b01700 1 --2- 172.21.15.22:0/845515321 >> v2:172.21.15.192:3300/0 conn(0x7f9880069bb0 0x7f98800b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 -- 172.21.15.22:0/845515321 >> v2:172.21.15.192:3300/0 conn(0x7f9880069bb0 msgr2=0x7f98800b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 --2- 172.21.15.22:0/845515321 >> v2:172.21.15.192:3300/0 conn(0x7f9880069bb0 0x7f98800b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 -- 172.21.15.22:0/845515321 >> v1:172.21.15.22:6789/0 conn(0x7f98800cba70 legacy=0x7f98800694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 -- 172.21.15.22:0/845515321 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800cf7c0 con 0x7f9880159840 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.294+0000 7f9885300700 1 --2- 172.21.15.22:0/845515321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9880159840 0x7f98800cb530 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f98780099b0 tx=0x7f9878009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23381f8a665d6350 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f987ffff700 1 -- 172.21.15.22:0/845515321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987800b820 con 0x7f9880159840 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f987ffff700 1 -- 172.21.15.22:0/845515321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987800b980 con 0x7f9880159840 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f987ffff700 1 -- 172.21.15.22:0/845515321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987800bd40 con 0x7f9880159840 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 -- 172.21.15.22:0/845515321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9880159840 msgr2=0x7f98800cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 --2- 172.21.15.22:0/845515321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9880159840 0x7f98800cb530 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f98780099b0 tx=0x7f9878009250 comp rx=0 tx=0).stop 2023-10-08T00:25:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 -- 172.21.15.22:0/845515321 shutdown_connections 2023-10-08T00:25:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 --2- 172.21.15.22:0/845515321 >> v2:172.21.15.192:3300/0 conn(0x7f9880069bb0 0x7f98800b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 --2- 172.21.15.22:0/845515321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9880159840 0x7f98800cb530 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 -- 172.21.15.22:0/845515321 >> 172.21.15.22:0/845515321 conn(0x7f9880068e10 msgr2=0x7f98800d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 -- 172.21.15.22:0/845515321 shutdown_connections 2023-10-08T00:25:48.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.295+0000 7f9887564700 1 -- 172.21.15.22:0/845515321 wait complete. 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.296+0000 7f9887564700 1 Processor -- start 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.296+0000 7f9887564700 1 -- start start 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9887564700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9880069bb0 0x7f98800c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9887564700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 0x7f98801562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9887564700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9880159840 0x7f988015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9887564700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988015e010 con 0x7f98800cba70 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9887564700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800c8260 con 0x7f9880159840 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9887564700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988015d6e0 con 0x7f9880069bb0 2023-10-08T00:25:48.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9884aff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 0x7f98801562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9884aff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 0x7f98801562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41576/0 (socket says 172.21.15.22:41576) 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.297+0000 7f9884aff700 1 -- 172.21.15.22:0/2744969394 learned_addr learned my addr 172.21.15.22:0/2744969394 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9885b01700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9880159840 0x7f988015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9885300700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9880069bb0 0x7f98800c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9884aff700 1 -- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9880069bb0 msgr2=0x7f98800c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9884aff700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9880069bb0 0x7f98800c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9884aff700 1 -- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9880159840 msgr2=0x7f988015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9884aff700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9880159840 0x7f988015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9884aff700 1 -- 172.21.15.22:0/2744969394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780094f0 con 0x7f98800cba70 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9885b01700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9880159840 0x7f988015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9884aff700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 0x7f98801562e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f987400c7c0 tx=0x7f9874007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874005a70 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874005bd0 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988015d9c0 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740070f0 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.298+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9880156820 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.299+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9880064550 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.299+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9874007460 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.300+0000 7f987d7fa700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.300+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9874083f10 con 0x7f98800cba70 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.300+0000 7f9885300700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.301+0000 7f9885300700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f986c066f30 0x7f986c0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98780099b0 tx=0x7f9878017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:48.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.304+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9874051200 con 0x7f98800cba70 2023-10-08T00:25:48.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.541+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f988004c3c0 con 0x7f98800cba70 2023-10-08T00:25:48.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.542+0000 7f987d7fa700 1 -- 172.21.15.22:0/2744969394 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9874054820 con 0x7f98800cba70 2023-10-08T00:25:48.542 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:25:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.543+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f986c066f30 msgr2=0x7f986c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.543+0000 7f9887564700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f986c066f30 0x7f986c0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f98780099b0 tx=0x7f9878017000 comp rx=0 tx=0).stop 2023-10-08T00:25:48.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.543+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 msgr2=0x7f98801562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.543+0000 7f9887564700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 0x7f98801562e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f987400c7c0 tx=0x7f9874007f70 comp rx=0 tx=0).stop 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 shutdown_connections 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9880159840 0x7f988015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9880069bb0 0x7f98800c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 --2- 172.21.15.22:0/2744969394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f98800cba70 0x7f98801562e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 >> 172.21.15.22:0/2744969394 conn(0x7f9880068e10 msgr2=0x7f98800d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 shutdown_connections 2023-10-08T00:25:48.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:48.544+0000 7f9887564700 1 -- 172.21.15.22:0/2744969394 wait complete. 2023-10-08T00:25:48.556 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:25:48.556 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:25:48.557 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:25:48.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:48.557 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:25:48.573 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:48.573 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:48.573 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42422sec preferred_lft 42422sec 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:25:48.575 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:25:48.576 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:25:48.577 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:48.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:48.577 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:25:48.637 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:25:48.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:48.638 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:25:48.694 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:25:48.694 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:25:48.694 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:25:48.694 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:25:48.694 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:25:48.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:48.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:25:48.695 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:25:48.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:25:48.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:25:48.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:25:48.695 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:25:48.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:48.797 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:25:48.812 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:25:48.812 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:25:48.813 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:25:48.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:48.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:25:48.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:48.877 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:48.932 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:25:48.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:48.932 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:48.987 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:25:48.987 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:25:48.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:49.068 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:49.068 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:49.086 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:49.087 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:49.109 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:25:49.110 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:25:49.112 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:25:49.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:49.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:25:49.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.336+0000 7f790b59d700 1 Processor -- start 2023-10-08T00:25:49.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.336+0000 7f790b59d700 1 -- start start 2023-10-08T00:25:49.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790b59d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7904159420 0x7f79040b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790b59d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f79040b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790b59d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79040b11d0 con 0x7f790415d230 2023-10-08T00:25:49.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790b59d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040b14b0 con 0x7f7904159420 2023-10-08T00:25:49.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790b59d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040b1790 con 0x7f79041597f0 2023-10-08T00:25:49.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790ad9c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f790415d230 0x7f79040b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35206/0 (socket says 172.21.15.22:35206) 2023-10-08T00:25:49.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790ad9c700 1 -- 172.21.15.22:0/1881309581 learned_addr learned my addr 172.21.15.22:0/1881309581 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:49.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f790a59b700 1 --2- 172.21.15.22:0/1881309581 >> v2:172.21.15.192:3300/0 conn(0x7f7904159420 0x7f79040b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276607823 0 0) 0x7f79040b11d0 con 0x7f790415d230 2023-10-08T00:25:49.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec003570 con 0x7f790415d230 2023-10-08T00:25:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.337+0000 7f7909d9a700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f79040b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920096172 0 0) 0x7f78ec003570 con 0x7f790415d230 2023-10-08T00:25:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 msgr2=0x7f79040b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f79040b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 >> v2:172.21.15.192:3300/0 conn(0x7f7904159420 msgr2=0x7f79040b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 --2- 172.21.15.22:0/1881309581 >> v2:172.21.15.192:3300/0 conn(0x7f7904159420 0x7f79040b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040b1a70 con 0x7f790415d230 2023-10-08T00:25:49.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f78fc0017f0 con 0x7f790415d230 2023-10-08T00:25:49.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909d9a700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f79040b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:49.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 >> v1:172.21.15.22:6789/0 conn(0x7f790415d230 legacy=0x7f79040b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:49.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec003ae0 0x7f78ec003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f78ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f78ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79040b14b0 con 0x7f78ec004d50 2023-10-08T00:25:49.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79040b1790 con 0x7f78ec003ae0 2023-10-08T00:25:49.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec00bb90 con 0x7f79041597f0 2023-10-08T00:25:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f78ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790a59b700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec003ae0 0x7f78ec003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909d9a700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f78ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 -- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 msgr2=0x7f78ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f79041597f0 0x7f78ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 -- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec003ae0 msgr2=0x7f78ec003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec003ae0 0x7f78ec003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 -- 172.21.15.22:0/1881309581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec003570 con 0x7f78ec004d50 2023-10-08T00:25:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f790ad9c700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f78ec0051c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00a8a0 tx=0x7f78fc002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93401d1a5face76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0070f0 con 0x7f78ec004d50 2023-10-08T00:25:49.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc007250 con 0x7f78ec004d50 2023-10-08T00:25:49.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.338+0000 7f7909599700 1 -- 172.21.15.22:0/1881309581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc007610 con 0x7f78ec004d50 2023-10-08T00:25:49.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790b59d700 1 -- 172.21.15.22:0/1881309581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 msgr2=0x7f78ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:49.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790b59d700 1 --2- 172.21.15.22:0/1881309581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f78ec0051c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00a8a0 tx=0x7f78fc002140 comp rx=0 tx=0).stop 2023-10-08T00:25:49.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790ad9c700 1 -- 172.21.15.22:0/1881309581 reap_dead start 2023-10-08T00:25:49.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790b59d700 1 -- 172.21.15.22:0/1881309581 shutdown_connections 2023-10-08T00:25:49.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790b59d700 1 -- 172.21.15.22:0/1881309581 >> 172.21.15.22:0/1881309581 conn(0x7f79040d0660 msgr2=0x7f79040d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:49.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790b59d700 1 -- 172.21.15.22:0/1881309581 shutdown_connections 2023-10-08T00:25:49.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.339+0000 7f790b59d700 1 -- 172.21.15.22:0/1881309581 wait complete. 2023-10-08T00:25:49.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.340+0000 7f790b59d700 1 Processor -- start 2023-10-08T00:25:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.340+0000 7f790b59d700 1 -- start start 2023-10-08T00:25:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790b59d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f79040c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790b59d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79040c6320 0x7f7904156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790b59d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7904157360 0x7f79041577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790b59d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790415b9a0 con 0x7f78ec004d50 2023-10-08T00:25:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790b59d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790415adb0 con 0x7f79040c6320 2023-10-08T00:25:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790b59d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790415b070 con 0x7f7904157360 2023-10-08T00:25:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f79040c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f79040c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41582/0 (socket says 172.21.15.22:41582) 2023-10-08T00:25:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 -- 172.21.15.22:0/1741331582 learned_addr learned my addr 172.21.15.22:0/1741331582 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790ad9c700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7904157360 0x7f79041577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f7909d9a700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79040c6320 0x7f7904156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 -- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7904157360 msgr2=0x7f79041577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7904157360 0x7f79041577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 -- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79040c6320 msgr2=0x7f7904156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79040c6320 0x7f7904156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 -- 172.21.15.22:0/1741331582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790415b350 con 0x7f78ec004d50 2023-10-08T00:25:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.341+0000 7f790a59b700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f79040c5de0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f78f4006ac0 tx=0x7f78f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.342+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f400fa10 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.342+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f400fb70 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.342+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790415b630 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.342+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4014440 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.342+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79041448f0 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.343+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78f4014830 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.343+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790415bc80 con 0x7f78ec004d50 2023-10-08T00:25:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.343+0000 7f79027fc700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78f0066f30 0x7f78f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.344+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78f4018030 con 0x7f78ec004d50 2023-10-08T00:25:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.344+0000 7f7909d9a700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78f0066f30 0x7f78f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.344+0000 7f7909d9a700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78f0066f30 0x7f78f00693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009310 tx=0x7f78f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.348+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78f40521e0 con 0x7f78ec004d50 2023-10-08T00:25:49.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.592+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f790404c3c0 con 0x7f78ec004d50 2023-10-08T00:25:49.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.593+0000 7f79027fc700 1 -- 172.21.15.22:0/1741331582 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f78f4055800 con 0x7f78ec004d50 2023-10-08T00:25:49.593 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:25:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78f0066f30 msgr2=0x7f78f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78f0066f30 0x7f78f00693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009310 tx=0x7f78f8008040 comp rx=0 tx=0).stop 2023-10-08T00:25:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 msgr2=0x7f79040c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f79040c5de0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f78f4006ac0 tx=0x7f78f40091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 shutdown_connections 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78f0066f30 0x7f78f00693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7904157360 0x7f79041577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78ec004d50 0x7f79040c5de0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 --2- 172.21.15.22:0/1741331582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79040c6320 0x7f7904156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 >> 172.21.15.22:0/1741331582 conn(0x7f79040d0660 msgr2=0x7f790415d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 shutdown_connections 2023-10-08T00:25:49.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:49.595+0000 7f790b59d700 1 -- 172.21.15.22:0/1741331582 wait complete. 2023-10-08T00:25:49.607 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:25:49.607 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:25:49.607 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:25:49.607 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:25:49.607 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:49.607 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:25:49.608 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:25:49.608 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:25:49.608 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:25:49.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.608 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:25:49.627 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:25:49.627 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:25:49.627 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:25:49.627 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:25:49.628 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42425sec preferred_lft 42425sec 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:25:49.629 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:25:49.630 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.630 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:25:49.630 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:25:49.630 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:25:49.630 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:25:49.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.630 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:25:49.697 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:25:49.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.699 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:25:49.757 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:25:49.757 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:25:49.757 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:25:49.757 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:25:49.757 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:25:49.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.757 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:25:49.758 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:25:49.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:25:49.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:25:49.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:25:49.758 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:25:49.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.865 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:25:49.880 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:25:49.880 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:25:49.880 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:25:49.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:49.880 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:25:49.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:49.944 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:49.998 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:25:49.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:25:49.999 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:50.054 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:25:50.054 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:25:50.054 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:50.133 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:50.133 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:50.152 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:50.174 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:25:50.174 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:25:50.174 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:25:50.174 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:25:50.174 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:25:50.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:25:50.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:25:50.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:25:50.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:25:50.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:25:50.175 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:25:50.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:25:50.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:50.176 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:50.240 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:25:50.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.368+0000 7f96180a1700 1 Processor -- start 2023-10-08T00:25:50.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.368+0000 7f96180a1700 1 -- start start 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f96180a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159ec0 0x7f96100b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f96180a1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96100b53d0 0x7f96100cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f96180a1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100b5b00 con 0x7f96100cce40 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f96180a1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100b5da0 con 0x7f96100b53d0 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f96180a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100b6080 con 0x7f9610159ec0 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96100b53d0 0x7f96100cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96100b53d0 0x7f96100cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41588/0 (socket says 172.21.15.22:41588) 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 -- 172.21.15.22:0/2444261833 learned_addr learned my addr 172.21.15.22:0/2444261833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f9615e3d700 1 --2- 172.21.15.22:0/2444261833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159ec0 0x7f96100b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 -- 172.21.15.22:0/2444261833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159ec0 msgr2=0x7f96100b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 --2- 172.21.15.22:0/2444261833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159ec0 0x7f96100b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 -- 172.21.15.22:0/2444261833 >> v1:172.21.15.192:6789/0 conn(0x7f96100cce40 legacy=0x7f96100cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 -- 172.21.15.22:0/2444261833 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100cc100 con 0x7f96100b53d0 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f961563c700 1 --2- 172.21.15.22:0/2444261833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f96100cc900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f96040099b0 tx=0x7f9604009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43639eaa74fe6882 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f9614e3b700 1 -- 172.21.15.22:0/2444261833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604009ea0 con 0x7f96100b53d0 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f9614e3b700 1 -- 172.21.15.22:0/2444261833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400b860 con 0x7f96100b53d0 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.369+0000 7f9614e3b700 1 -- 172.21.15.22:0/2444261833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960400bc00 con 0x7f96100b53d0 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 -- 172.21.15.22:0/2444261833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 msgr2=0x7f96100cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 --2- 172.21.15.22:0/2444261833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f96100cc900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f96040099b0 tx=0x7f9604009250 comp rx=0 tx=0).stop 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 -- 172.21.15.22:0/2444261833 shutdown_connections 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 --2- 172.21.15.22:0/2444261833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9610159ec0 0x7f96100b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 --2- 172.21.15.22:0/2444261833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f96100cc900 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 -- 172.21.15.22:0/2444261833 >> 172.21.15.22:0/2444261833 conn(0x7f96100999f0 msgr2=0x7f96100b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 -- 172.21.15.22:0/2444261833 shutdown_connections 2023-10-08T00:25:50.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.370+0000 7f96180a1700 1 -- 172.21.15.22:0/2444261833 wait complete. 2023-10-08T00:25:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.371+0000 7f96180a1700 1 Processor -- start 2023-10-08T00:25:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.371+0000 7f96180a1700 1 -- start start 2023-10-08T00:25:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f96180a1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f961009c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f96180a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96100cce40 0x7f96101515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f96180a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9610159ec0 0x7f96100c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f96180a1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961009ca00 con 0x7f96100b53d0 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f96180a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961009cce0 con 0x7f9610159ec0 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f96180a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961009cfc0 con 0x7f96100cce40 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f961009c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f961009c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41596/0 (socket says 172.21.15.22:41596) 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 -- 172.21.15.22:0/3261829382 learned_addr learned my addr 172.21.15.22:0/3261829382 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f961563c700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96100cce40 0x7f96101515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f961663e700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9610159ec0 0x7f96100c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 -- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96100cce40 msgr2=0x7f96101515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96100cce40 0x7f96101515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 -- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9610159ec0 msgr2=0x7f96100c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9610159ec0 0x7f96100c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 -- 172.21.15.22:0/3261829382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040094f0 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f961663e700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9610159ec0 0x7f96100c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.372+0000 7f9615e3d700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f961009c100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f960000ea00 tx=0x7f9600009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.373+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000c850 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.373+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000c9b0 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.373+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961009d2a0 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.373+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000cd30 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.373+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961009c640 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.374+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96100c9fd0 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.374+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9600013680 con 0x7f96100b53d0 2023-10-08T00:25:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.375+0000 7f960dffb700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95fc066f30 0x7f95fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.375+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9600084b10 con 0x7f96100b53d0 2023-10-08T00:25:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.375+0000 7f961563c700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95fc066f30 0x7f95fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.375+0000 7f961563c700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95fc066f30 0x7f95fc0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f96040099b0 tx=0x7f9604017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.379+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9600051d80 con 0x7f96100b53d0 2023-10-08T00:25:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.620+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9610063c90 con 0x7f96100b53d0 2023-10-08T00:25:50.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.763+0000 7f960dffb700 1 -- 172.21.15.22:0/3261829382 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f96000170c0 con 0x7f96100b53d0 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95fc066f30 msgr2=0x7f95fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95fc066f30 0x7f95fc0693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f96040099b0 tx=0x7f9604017000 comp rx=0 tx=0).stop 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 msgr2=0x7f961009c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f961009c100 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f960000ea00 tx=0x7f9600009120 comp rx=0 tx=0).stop 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 shutdown_connections 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9610159ec0 0x7f96100c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96100b53d0 0x7f961009c100 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f95fc066f30 0x7f95fc0693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 --2- 172.21.15.22:0/3261829382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96100cce40 0x7f96101515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 >> 172.21.15.22:0/3261829382 conn(0x7f96100999f0 msgr2=0x7f96100c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 shutdown_connections 2023-10-08T00:25:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.765+0000 7f96180a1700 1 -- 172.21.15.22:0/3261829382 wait complete. 2023-10-08T00:25:50.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:25:50.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.896+0000 7ff9d5991700 1 Processor -- start 2023-10-08T00:25:50.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.896+0000 7ff9d5991700 1 -- start start 2023-10-08T00:25:50.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9d5991700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9d006bcd0 0x7ff9d0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9d5991700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9d006c0a0 0x7ff9d0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9d5991700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015c2a0 con 0x7ff9d00c8e00 2023-10-08T00:25:50.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9d5991700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d00c9900 con 0x7ff9d006c0a0 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9d5991700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d015b690 con 0x7ff9d006bcd0 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9ce7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9d006c0a0 0x7ff9d0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9cf7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9d00c8e00 0x7ff9d00c91f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35220/0 (socket says 172.21.15.22:35220) 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9ce7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9d006c0a0 0x7ff9d0141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41602/0 (socket says 172.21.15.22:41602) 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.897+0000 7ff9cf7fe700 1 -- 172.21.15.22:0/2959954741 learned_addr learned my addr 172.21.15.22:0/2959954741 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/2959954741 >> v2:172.21.15.192:3300/0 conn(0x7ff9d006bcd0 0x7ff9d0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/2959954741 >> v2:172.21.15.192:3300/0 conn(0x7ff9d006bcd0 msgr2=0x7ff9d0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9ce7fc700 1 --2- 172.21.15.22:0/2959954741 >> v2:172.21.15.192:3300/0 conn(0x7ff9d006bcd0 0x7ff9d0140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/2959954741 >> v1:172.21.15.22:6789/0 conn(0x7ff9d00c8e00 legacy=0x7ff9d00c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9cdffb700 1 -- 172.21.15.22:0/2959954741 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916542273 0 0) 0x7ff9d015c2a0 con 0x7ff9d00c8e00 2023-10-08T00:25:50.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/2959954741 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d015b970 con 0x7ff9d006c0a0 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9ce7fc700 1 --2- 172.21.15.22:0/2959954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d0141330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00cafd0 tx=0x7ff9b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca75275679262b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9cdffb700 1 -- 172.21.15.22:0/2959954741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800b6b0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9cdffb700 1 -- 172.21.15.22:0/2959954741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800b810 con 0x7ff9d006c0a0 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.898+0000 7ff9cdffb700 1 -- 172.21.15.22:0/2959954741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800bbb0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 -- 172.21.15.22:0/2959954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 msgr2=0x7ff9d0141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 --2- 172.21.15.22:0/2959954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d0141330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00cafd0 tx=0x7ff9b80091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 -- 172.21.15.22:0/2959954741 shutdown_connections 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 --2- 172.21.15.22:0/2959954741 >> v2:172.21.15.192:3300/0 conn(0x7ff9d006bcd0 0x7ff9d0140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 --2- 172.21.15.22:0/2959954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d0141330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 -- 172.21.15.22:0/2959954741 >> 172.21.15.22:0/2959954741 conn(0x7ff9d00ce600 msgr2=0x7ff9d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 -- 172.21.15.22:0/2959954741 shutdown_connections 2023-10-08T00:25:50.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.899+0000 7ff9d5991700 1 -- 172.21.15.22:0/2959954741 wait complete. 2023-10-08T00:25:50.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.900+0000 7ff9d5991700 1 Processor -- start 2023-10-08T00:25:50.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.900+0000 7ff9d5991700 1 -- start start 2023-10-08T00:25:50.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9d5991700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d006bcd0 0x7ff9d00c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9d5991700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9d5991700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d00c8e00 0x7ff9d00cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9d5991700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00c5f80 con 0x7ff9d006c0a0 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9d5991700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b1440 con 0x7ff9d006bcd0 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9d5991700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b1720 con 0x7ff9d00c8e00 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d013c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41618/0 (socket says 172.21.15.22:41618) 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/3578429265 learned_addr learned my addr 172.21.15.22:0/3578429265 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d006bcd0 0x7ff9d00c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9cf7fe700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d00c8e00 0x7ff9d00cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d00c8e00 msgr2=0x7ff9d00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d00c8e00 0x7ff9d00cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d006bcd0 msgr2=0x7ff9d00c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d006bcd0 0x7ff9d00c5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/3578429265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b8009420 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9cf7fe700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d00c8e00 0x7ff9d00cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9ce7fc700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d013c940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0069220 tx=0x7ff9b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800bb90 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.901+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8011420 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.902+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80117c0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.902+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d00b1a00 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.902+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d00b1fc0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.903+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d00b21b0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.903+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9b8011bf0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.903+0000 7ff9c6ffd700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9b0066f30 0x7ff9b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:50.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.903+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9b8085ed0 con 0x7ff9d006c0a0 2023-10-08T00:25:50.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.903+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9b0066f30 0x7ff9b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:50.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.904+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9b0066f30 0x7ff9b00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009fd0 tx=0x7ff9c0009880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:50.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:50.908+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9b8053140 con 0x7ff9d006c0a0 2023-10-08T00:25:51.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.128+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9d004c3c0 con 0x7ff9b0066f30 2023-10-08T00:25:51.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.130+0000 7ff9c6ffd700 1 -- 172.21.15.22:0/3578429265 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff9d004c3c0 con 0x7ff9b0066f30 2023-10-08T00:25:51.131 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:25:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:25:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:51.132 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9b0066f30 msgr2=0x7ff9b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9b0066f30 0x7ff9b00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009fd0 tx=0x7ff9c0009880 comp rx=0 tx=0).stop 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 msgr2=0x7ff9d013c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d013c940 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0069220 tx=0x7ff9b8017000 comp rx=0 tx=0).stop 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 shutdown_connections 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9b0066f30 0x7ff9b00693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d00c8e00 0x7ff9d00cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d006bcd0 0x7ff9d00c5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 --2- 172.21.15.22:0/3578429265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d006c0a0 0x7ff9d013c940 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 >> 172.21.15.22:0/3578429265 conn(0x7ff9d00ce600 msgr2=0x7ff9d01558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:51.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 shutdown_connections 2023-10-08T00:25:51.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.132+0000 7ff9d5991700 1 -- 172.21.15.22:0/3578429265 wait complete. 2023-10-08T00:25:51.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:25:51.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.266+0000 7ff37a1cd700 1 Processor -- start 2023-10-08T00:25:51.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.266+0000 7ff37a1cd700 1 -- start start 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff37a1cd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff37406bcd0 0x7ff3740caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff37a1cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff37415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff37a1cd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37415d7e0 con 0x7ff37406c0a0 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff37a1cd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37415dac0 con 0x7ff37406bcd0 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff37a1cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37415aa30 con 0x7ff37415df50 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff372ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff37406c0a0 0x7ff37415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35226/0 (socket says 172.21.15.22:35226) 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff372ffd700 1 -- 172.21.15.22:0/1214176777 learned_addr learned my addr 172.21.15.22:0/1214176777 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3737fe700 1 --2- 172.21.15.22:0/1214176777 >> v2:172.21.15.192:3300/0 conn(0x7ff37406bcd0 0x7ff3740caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff373fff700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff37415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3727fc700 1 -- 172.21.15.22:0/1214176777 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974026952 0 0) 0x7ff37415d7e0 con 0x7ff37406c0a0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3727fc700 1 -- 172.21.15.22:0/1214176777 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff35c003570 con 0x7ff37406c0a0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3737fe700 1 -- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 msgr2=0x7ff37415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3737fe700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff37415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3737fe700 1 -- 172.21.15.22:0/1214176777 >> v1:172.21.15.22:6789/0 conn(0x7ff37406c0a0 legacy=0x7ff37415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3737fe700 1 -- 172.21.15.22:0/1214176777 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37415ad10 con 0x7ff37406bcd0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff373fff700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff37415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.267+0000 7ff3737fe700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740caa90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff3640098e0 tx=0x7ff3640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37f3335d1f962c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff3727fc700 1 -- 172.21.15.22:0/1214176777 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364011630 con 0x7ff37406bcd0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff3727fc700 1 -- 172.21.15.22:0/1214176777 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff364011790 con 0x7ff37406bcd0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff3727fc700 1 -- 172.21.15.22:0/1214176777 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364011b30 con 0x7ff37406bcd0 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 -- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 msgr2=0x7ff3740caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740caa90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff3640098e0 tx=0x7ff3640091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 -- 172.21.15.22:0/1214176777 shutdown_connections 2023-10-08T00:25:51.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff37415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/1214176777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740caa90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 -- 172.21.15.22:0/1214176777 >> 172.21.15.22:0/1214176777 conn(0x7ff3740ce600 msgr2=0x7ff3740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:51.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 -- 172.21.15.22:0/1214176777 shutdown_connections 2023-10-08T00:25:51.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.268+0000 7ff37a1cd700 1 -- 172.21.15.22:0/1214176777 wait complete. 2023-10-08T00:25:51.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.269+0000 7ff37a1cd700 1 Processor -- start 2023-10-08T00:25:51.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.269+0000 7ff37a1cd700 1 -- start start 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff37a1cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff37a1cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 0x7ff37416bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff37a1cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff3740c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff37a1cd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740c5bf0 con 0x7ff37406c0a0 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff37a1cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740c5e00 con 0x7ff37406bcd0 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff37a1cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740c60e0 con 0x7ff37415df50 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff372ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 0x7ff37416bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff3737fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff372ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 0x7ff37416bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41628/0 (socket says 172.21.15.22:41628) 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff372ffd700 1 -- 172.21.15.22:0/2594885032 learned_addr learned my addr 172.21.15.22:0/2594885032 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:51.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.270+0000 7ff373fff700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff3740c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff372ffd700 1 -- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 msgr2=0x7ff3740c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff372ffd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff3740c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff372ffd700 1 -- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 msgr2=0x7ff3740b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff372ffd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff372ffd700 1 -- 172.21.15.22:0/2594885032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009a20 con 0x7ff37406c0a0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff3737fe700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff372ffd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 0x7ff37416bcf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c590 tx=0x7ff368007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368005cd0 con 0x7ff37406c0a0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368005e50 con 0x7ff37406c0a0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368007320 con 0x7ff37406c0a0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff364009420 con 0x7ff37406c0a0 2023-10-08T00:25:51.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.271+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3740c66a0 con 0x7ff37406c0a0 2023-10-08T00:25:51.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.272+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37404c3c0 con 0x7ff37406c0a0 2023-10-08T00:25:51.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.272+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff36801b3b0 con 0x7ff37406c0a0 2023-10-08T00:25:51.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.273+0000 7ff35b7fe700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff360066f30 0x7ff3600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.273+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff368083c00 con 0x7ff37406c0a0 2023-10-08T00:25:51.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.273+0000 7ff3737fe700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff360066f30 0x7ff3600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.274+0000 7ff3737fe700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff360066f30 0x7ff3600693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff3640093a0 tx=0x7ff364017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:51.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.277+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff368050e90 con 0x7ff37406c0a0 2023-10-08T00:25:51.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.473+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff37415aff0 con 0x7ff37406c0a0 2023-10-08T00:25:51.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.473+0000 7ff35b7fe700 1 -- 172.21.15.22:0/2594885032 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff368017070 con 0x7ff37406c0a0 2023-10-08T00:25:51.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff360066f30 msgr2=0x7ff3600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff360066f30 0x7ff3600693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff3640093a0 tx=0x7ff364017000 comp rx=0 tx=0).stop 2023-10-08T00:25:51.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 msgr2=0x7ff37416bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 0x7ff37416bcf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c590 tx=0x7ff368007e00 comp rx=0 tx=0).stop 2023-10-08T00:25:51.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 shutdown_connections 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff360066f30 0x7ff3600693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff37415df50 0x7ff3740c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff37406bcd0 0x7ff3740b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 --2- 172.21.15.22:0/2594885032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff37406c0a0 0x7ff37416bcf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 >> 172.21.15.22:0/2594885032 conn(0x7ff3740ce600 msgr2=0x7ff37406a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 shutdown_connections 2023-10-08T00:25:51.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.475+0000 7ff37a1cd700 1 -- 172.21.15.22:0/2594885032 wait complete. 2023-10-08T00:25:51.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000109451 2023-10-08T00:25:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.608+0000 7f6039fe1700 1 Processor -- start 2023-10-08T00:25:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.608+0000 7f6039fe1700 1 -- start start 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.609+0000 7f6039fe1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6034159890 0x7f603415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.609+0000 7f6039fe1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603415a160 con 0x7f6034069560 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.609+0000 7f6039fe1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340d13a0 con 0x7f6034159c60 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.609+0000 7f6039fe1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603415e140 con 0x7f6034159890 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.609+0000 7f6033fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6034069560 0x7f60340ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35238/0 (socket says 172.21.15.22:35238) 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.609+0000 7f6033fff700 1 -- 172.21.15.22:0/4040012703 learned_addr learned my addr 172.21.15.22:0/4040012703 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60337fe700 1 --2- 172.21.15.22:0/4040012703 >> v2:172.21.15.192:3300/0 conn(0x7f6034159890 0x7f603415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171855790 0 0) 0x7f603415a160 con 0x7f6034069560 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f601c003570 con 0x7f6034069560 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3905157318 0 0) 0x7f601c003570 con 0x7f6034069560 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 >> v2:172.21.15.192:3300/0 conn(0x7f6034159890 msgr2=0x7f603415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 --2- 172.21.15.22:0/4040012703 >> v2:172.21.15.192:3300/0 conn(0x7f6034159890 0x7f603415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 >> v1:172.21.15.192:6789/0 conn(0x7f6034159c60 legacy=0x7f603415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603415a3d0 con 0x7f6034069560 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f602c0017f0 con 0x7f6034069560 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 >> v1:172.21.15.22:6789/0 conn(0x7f6034069560 legacy=0x7f60340ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f601c003a60 0x7f601c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c004810 0x7f601c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f601c0051c0 0x7f601c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603415e140 con 0x7f601c0051c0 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c00c0d0 con 0x7f601c003a60 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c00c290 con 0x7f601c004810 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f601c0051c0 0x7f601c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f60337fe700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f601c003a60 0x7f601c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6032ffd700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c004810 0x7f601c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 -- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c004810 msgr2=0x7f601c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c004810 0x7f601c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 -- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f601c003a60 msgr2=0x7f601c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f601c003a60 0x7f601c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 -- 172.21.15.22:0/4040012703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c003570 con 0x7f601c0051c0 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.610+0000 7f6033fff700 1 -- 172.21.15.22:0/4040012703 reap_dead start 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6033fff700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f601c0051c0 0x7f601c00ba60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f602c00a930 tx=0x7f602c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3940663e837df2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0070d0 con 0x7f601c0051c0 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c007230 con 0x7f601c0051c0 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f60327fc700 1 -- 172.21.15.22:0/4040012703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0075d0 con 0x7f601c0051c0 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 -- 172.21.15.22:0/4040012703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f601c0051c0 msgr2=0x7f601c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f601c0051c0 0x7f601c00ba60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f602c00a930 tx=0x7f602c0021d0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 -- 172.21.15.22:0/4040012703 shutdown_connections 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 --2- 172.21.15.22:0/4040012703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f601c0051c0 0x7f601c00ba60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 -- 172.21.15.22:0/4040012703 >> 172.21.15.22:0/4040012703 conn(0x7f6034068e20 msgr2=0x7f60340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 -- 172.21.15.22:0/4040012703 shutdown_connections 2023-10-08T00:25:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.611+0000 7f6039fe1700 1 -- 172.21.15.22:0/4040012703 wait complete. 2023-10-08T00:25:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.612+0000 7f6039fe1700 1 Processor -- start 2023-10-08T00:25:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 -- start start 2023-10-08T00:25:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c0051c0 0x7f603413c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 0x7f60340cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603414db00 0x7f60340b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603413ca40 con 0x7f60340ce6a0 2023-10-08T00:25:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60340cdfc0 con 0x7f603414db00 2023-10-08T00:25:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6039fe1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60340cac10 con 0x7f601c0051c0 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6032ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 0x7f60340cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6032ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 0x7f60340cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41656/0 (socket says 172.21.15.22:41656) 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6032ffd700 1 -- 172.21.15.22:0/3984711992 learned_addr learned my addr 172.21.15.22:0/3984711992 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f60337fe700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c0051c0 0x7f603413c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.613+0000 7f6033fff700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603414db00 0x7f60340b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6032ffd700 1 -- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c0051c0 msgr2=0x7f603413c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6032ffd700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c0051c0 0x7f603413c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6032ffd700 1 -- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603414db00 msgr2=0x7f60340b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6032ffd700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603414db00 0x7f60340b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6032ffd700 1 -- 172.21.15.22:0/3984711992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340b3590 con 0x7f60340ce6a0 2023-10-08T00:25:51.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6032ffd700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 0x7f60340cda80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6024002980 tx=0x7f6024007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024013600 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024013760 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60340b3870 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024013b20 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.614+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60340b3e30 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.615+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60340b4480 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.615+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f602401c400 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.616+0000 7f601b7fe700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6020066f30 0x7f60200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.616+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6024084810 con 0x7f60340ce6a0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.616+0000 7f60337fe700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6020066f30 0x7f60200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.616+0000 7f60337fe700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6020066f30 0x7f60200693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6028006f00 tx=0x7f60280091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.620+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6024051a80 con 0x7f60340ce6a0 2023-10-08T00:25:51.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:51.843+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000109451", "target": ["mon-mgr", ""]}) v1 -- 0x7f603404c3c0 con 0x7f6020066f30 2023-10-08T00:25:54.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.789+0000 7f601b7fe700 1 -- 172.21.15.22:0/3984711992 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f603404c3c0 con 0x7f6020066f30 2023-10-08T00:25:54.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6020066f30 msgr2=0x7f60200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6020066f30 0x7f60200693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6028006f00 tx=0x7f60280091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 msgr2=0x7f60340cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 0x7f60340cda80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6024002980 tx=0x7f6024007d30 comp rx=0 tx=0).stop 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 shutdown_connections 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603414db00 0x7f60340b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6020066f30 0x7f60200693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f601c0051c0 0x7f603413c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 --2- 172.21.15.22:0/3984711992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60340ce6a0 0x7f60340cda80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 >> 172.21.15.22:0/3984711992 conn(0x7f6034068e20 msgr2=0x7f603415d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 shutdown_connections 2023-10-08T00:25:54.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.795+0000 7f6039fe1700 1 -- 172.21.15.22:0/3984711992 wait complete. 2023-10-08T00:25:54.798 INFO:teuthology.orchestra.run.smithi022.stderr:Volume created successfully (no MDS daemons created) 2023-10-08T00:25:54.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:25:54.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.938+0000 7f6d3fc1d700 1 Processor -- start 2023-10-08T00:25:54.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.938+0000 7f6d3fc1d700 1 -- start start 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3fc1d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6d38159c60 0x7f6d3815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3fc1d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d3815db10 0x7f6d38069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3fc1d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3815a160 con 0x7f6d38159890 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3fc1d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3815df50 con 0x7f6d38159c60 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3fc1d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380d13a0 con 0x7f6d3815db10 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6d38159c60 0x7f6d3815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6d38159c60 0x7f6d3815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41664/0 (socket says 172.21.15.22:41664) 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 -- 172.21.15.22:0/3538036672 learned_addr learned my addr 172.21.15.22:0/3538036672 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3e1ba700 1 --2- 172.21.15.22:0/3538036672 >> v2:172.21.15.192:3300/0 conn(0x7f6d3815db10 0x7f6d38069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 -- 172.21.15.22:0/3538036672 >> v2:172.21.15.192:3300/0 conn(0x7f6d3815db10 msgr2=0x7f6d38069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 --2- 172.21.15.22:0/3538036672 >> v2:172.21.15.192:3300/0 conn(0x7f6d3815db10 0x7f6d38069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 -- 172.21.15.22:0/3538036672 >> v1:172.21.15.192:6789/0 conn(0x7f6d38159890 legacy=0x7f6d3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 -- 172.21.15.22:0/3538036672 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3815e140 con 0x7f6d38159c60 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3d1b8700 1 --2- 172.21.15.22:0/3538036672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d38159c60 0x7f6d3815d5d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d3806a890 tx=0x7f6d2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5671222c613205a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.939+0000 7f6d3c9b7700 1 -- 172.21.15.22:0/3538036672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00b820 con 0x7f6d38159c60 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3c9b7700 1 -- 172.21.15.22:0/3538036672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00b980 con 0x7f6d38159c60 2023-10-08T00:25:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3c9b7700 1 -- 172.21.15.22:0/3538036672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00bd20 con 0x7f6d38159c60 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/3538036672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d38159c60 msgr2=0x7f6d3815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/3538036672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d38159c60 0x7f6d3815d5d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d3806a890 tx=0x7f6d2c009250 comp rx=0 tx=0).stop 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/3538036672 shutdown_connections 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/3538036672 >> v2:172.21.15.192:3300/0 conn(0x7f6d3815db10 0x7f6d38069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/3538036672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d38159c60 0x7f6d3815d5d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/3538036672 >> 172.21.15.22:0/3538036672 conn(0x7f6d38068e20 msgr2=0x7f6d380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/3538036672 shutdown_connections 2023-10-08T00:25:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.940+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/3538036672 wait complete. 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.941+0000 7f6d3fc1d700 1 Processor -- start 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.941+0000 7f6d3fc1d700 1 -- start start 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3fc1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d38159890 0x7f6d380b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3fc1d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d38159c60 0x7f6d380b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3fc1d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 0x7f6d380b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3fc1d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b0800 con 0x7f6d3815db10 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3fc1d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b0dc0 con 0x7f6d38159c60 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3fc1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b2210 con 0x7f6d38159890 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3e1ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 0x7f6d380b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3e1ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 0x7f6d380b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41670/0 (socket says 172.21.15.22:41670) 2023-10-08T00:25:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3e1ba700 1 -- 172.21.15.22:0/370966106 learned_addr learned my addr 172.21.15.22:0/370966106 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3d1b8700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d38159c60 0x7f6d380b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.942+0000 7f6d3d9b9700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d38159890 0x7f6d380b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3e1ba700 1 -- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d38159890 msgr2=0x7f6d380b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3e1ba700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d38159890 0x7f6d380b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3e1ba700 1 -- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d38159c60 msgr2=0x7f6d380b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3e1ba700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d38159c60 0x7f6d380b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3e1ba700 1 -- 172.21.15.22:0/370966106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0094f0 con 0x7f6d3815db10 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3e1ba700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 0x7f6d380b1cd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000d890 tx=0x7f6d30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d300125f0 con 0x7f6d3815db10 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d30012770 con 0x7f6d3815db10 2023-10-08T00:25:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3816a200 con 0x7f6d3815db10 2023-10-08T00:25:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30012b30 con 0x7f6d3815db10 2023-10-08T00:25:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.943+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d380cfd50 con 0x7f6d3815db10 2023-10-08T00:25:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.944+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d380b0f30 con 0x7f6d3815db10 2023-10-08T00:25:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.944+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d30013480 con 0x7f6d3815db10 2023-10-08T00:25:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.945+0000 7f6d35ffb700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.945+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6d30084b90 con 0x7f6d3815db10 2023-10-08T00:25:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.945+0000 7f6d3d9b9700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:54.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.945+0000 7f6d3d9b9700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d24066f30 0x7f6d240693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d28007fd0 tx=0x7f6d280026a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:54.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:54.949+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d30051a80 con 0x7f6d3815db10 2023-10-08T00:25:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.170+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d3804c3c0 con 0x7f6d24066f30 2023-10-08T00:25:55.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.171+0000 7f6d35ffb700 1 -- 172.21.15.22:0/370966106 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f6d3804c3c0 con 0x7f6d24066f30 2023-10-08T00:25:55.174 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:25:55.174 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:55.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:25:55.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:25:55.175 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:25:55.175 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volume_0000000000109451" 2023-10-08T00:25:55.175 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:25:55.175 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d24066f30 msgr2=0x7f6d240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d24066f30 0x7f6d240693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d28007fd0 tx=0x7f6d280026a0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 msgr2=0x7f6d380b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 0x7f6d380b1cd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000d890 tx=0x7f6d30008040 comp rx=0 tx=0).stop 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 shutdown_connections 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d3815db10 0x7f6d380b1cd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d24066f30 0x7f6d240693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d38159890 0x7f6d380b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 --2- 172.21.15.22:0/370966106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d38159c60 0x7f6d380b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 >> 172.21.15.22:0/370966106 conn(0x7f6d38068e20 msgr2=0x7f6d381571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:55.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.173+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 shutdown_connections 2023-10-08T00:25:55.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.174+0000 7f6d3fc1d700 1 -- 172.21.15.22:0/370966106 wait complete. 2023-10-08T00:25:55.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-10-08T00:25:55.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 Processor -- start 2023-10-08T00:25:55.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 -- start start 2023-10-08T00:25:55.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efd0406bcd0 0x7efd040caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd0406c0a0 0x7efd0415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0415d7e0 con 0x7efd0415df50 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0415dac0 con 0x7efd0406c0a0 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.307+0000 7efd0a4d9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0415aa30 con 0x7efd0406bcd0 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd0406c0a0 0x7efd0415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd08a76700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efd0415df50 0x7efd040c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35242/0 (socket says 172.21.15.22:35242) 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd0406c0a0 0x7efd0415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41672/0 (socket says 172.21.15.22:41672) 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd08a76700 1 -- 172.21.15.22:0/1877032066 learned_addr learned my addr 172.21.15.22:0/1877032066 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd03fff700 1 --2- 172.21.15.22:0/1877032066 >> v2:172.21.15.192:3300/0 conn(0x7efd0406bcd0 0x7efd040caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 -- 172.21.15.22:0/1877032066 >> v2:172.21.15.192:3300/0 conn(0x7efd0406bcd0 msgr2=0x7efd040caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 --2- 172.21.15.22:0/1877032066 >> v2:172.21.15.192:3300/0 conn(0x7efd0406bcd0 0x7efd040caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 -- 172.21.15.22:0/1877032066 >> v1:172.21.15.22:6789/0 conn(0x7efd0415df50 legacy=0x7efd040c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd02ffd700 1 -- 172.21.15.22:0/1877032066 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600329217 0 0) 0x7efd0415d7e0 con 0x7efd0415df50 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 -- 172.21.15.22:0/1877032066 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0415ad10 con 0x7efd0406c0a0 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd037fe700 1 --2- 172.21.15.22:0/1877032066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406c0a0 0x7efd0415a1e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd040691a0 tx=0x7efcf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7137445c01f692f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd02ffd700 1 -- 172.21.15.22:0/1877032066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8011630 con 0x7efd0406c0a0 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd02ffd700 1 -- 172.21.15.22:0/1877032066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8011790 con 0x7efd0406c0a0 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.308+0000 7efd02ffd700 1 -- 172.21.15.22:0/1877032066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8011b30 con 0x7efd0406c0a0 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1877032066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406c0a0 msgr2=0x7efd0415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1877032066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406c0a0 0x7efd0415a1e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd040691a0 tx=0x7efcf80091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1877032066 shutdown_connections 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1877032066 >> v2:172.21.15.192:3300/0 conn(0x7efd0406bcd0 0x7efd040caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1877032066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406c0a0 0x7efd0415a1e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1877032066 >> 172.21.15.22:0/1877032066 conn(0x7efd040ce600 msgr2=0x7efd040cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:55.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1877032066 shutdown_connections 2023-10-08T00:25:55.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.309+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1877032066 wait complete. 2023-10-08T00:25:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.310+0000 7efd0a4d9700 1 Processor -- start 2023-10-08T00:25:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.310+0000 7efd0a4d9700 1 -- start start 2023-10-08T00:25:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd0a4d9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 0x7efd040b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd0a4d9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd0406c0a0 0x7efd0416d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd0a4d9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd0415df50 0x7efd0416a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd0a4d9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd041541f0 con 0x7efd0406bcd0 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd0a4d9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0416e710 con 0x7efd0406c0a0 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd0a4d9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0416e150 con 0x7efd0415df50 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 0x7efd040b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 0x7efd040b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41674/0 (socket says 172.21.15.22:41674) 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 -- 172.21.15.22:0/1050394875 learned_addr learned my addr 172.21.15.22:0/1050394875 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd037fe700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd0406c0a0 0x7efd0416d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd08a76700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd0415df50 0x7efd0416a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 -- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd0415df50 msgr2=0x7efd0416a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd0415df50 0x7efd0416a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 -- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd0406c0a0 msgr2=0x7efd0416d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd0406c0a0 0x7efd0416d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd03fff700 1 -- 172.21.15.22:0/1050394875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009420 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.311+0000 7efd08a76700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd0415df50 0x7efd0416a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.312+0000 7efd03fff700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 0x7efd040b27d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efcf400e950 tx=0x7efcf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.312+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400c850 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.312+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf400c9b0 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.312+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0416e430 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.312+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf400cdb0 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.312+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd040b2d10 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.313+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0404c3c0 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.313+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcf4013680 con 0x7efd0406bcd0 2023-10-08T00:25:55.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.314+0000 7efcebfff700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efcf0066f30 0x7efcf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.314+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7efcf4084ae0 con 0x7efd0406bcd0 2023-10-08T00:25:55.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.314+0000 7efd037fe700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efcf0066f30 0x7efcf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.314+0000 7efd037fe700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efcf0066f30 0x7efcf00693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efcf80093f0 tx=0x7efcf8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:55.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.318+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcf40519d0 con 0x7efd0406bcd0 2023-10-08T00:25:55.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.510+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7efd0415aff0 con 0x7efd0406bcd0 2023-10-08T00:25:55.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.510+0000 7efcebfff700 1 -- 172.21.15.22:0/1050394875 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7efcf4054ff0 con 0x7efd0406bcd0 2023-10-08T00:25:55.512 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:55.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efcf0066f30 msgr2=0x7efcf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efcf0066f30 0x7efcf00693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efcf80093f0 tx=0x7efcf8017000 comp rx=0 tx=0).stop 2023-10-08T00:25:55.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 msgr2=0x7efd040b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 0x7efd040b27d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efcf400e950 tx=0x7efcf40091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 shutdown_connections 2023-10-08T00:25:55.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efcf0066f30 0x7efcf00693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd0415df50 0x7efd0416a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd0406bcd0 0x7efd040b27d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 --2- 172.21.15.22:0/1050394875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd0406c0a0 0x7efd0416d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 >> 172.21.15.22:0/1050394875 conn(0x7efd040ce600 msgr2=0x7efd0415b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 shutdown_connections 2023-10-08T00:25:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.512+0000 7efd0a4d9700 1 -- 172.21.15.22:0/1050394875 wait complete. 2023-10-08T00:25:55.526 INFO:teuthology.orchestra.run.smithi022.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000109451.meta","create_time":"2023-10-08T00:25:51.876234+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000109451"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000109451.data","create_time":"2023-10-08T00:25:52.810328+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000109451"}}}] 2023-10-08T00:25:55.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000109451 --format=json 2023-10-08T00:25:55.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.649+0000 7f47832c9700 1 Processor -- start 2023-10-08T00:25:55.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.649+0000 7f47832c9700 1 -- start start 2023-10-08T00:25:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f47832c9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 0x7f477c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f47832c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 0x7f477c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f47832c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c15a160 con 0x7f477c15db10 2023-10-08T00:25:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f47832c9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0d13a0 con 0x7f477c159890 2023-10-08T00:25:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f47832c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c15e140 con 0x7f477c159c60 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4780864700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 0x7f477c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4781065700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 0x7f477c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4781866700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f477c15db10 0x7f477c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:50622/0 (socket says 172.21.15.22:50622) 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4781065700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 0x7f477c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:51986/0 (socket says 172.21.15.22:51986) 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4780864700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 0x7f477c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:51044/0 (socket says 172.21.15.22:51044) 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4781866700 1 -- 172.21.15.22:0/2887884686 learned_addr learned my addr 172.21.15.22:0/2887884686 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4780864700 1 -- 172.21.15.22:0/2887884686 >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 msgr2=0x7f477c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4780864700 1 --2- 172.21.15.22:0/2887884686 >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 0x7f477c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4780864700 1 -- 172.21.15.22:0/2887884686 >> v1:172.21.15.192:6789/0 conn(0x7f477c15db10 legacy=0x7f477c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4780864700 1 -- 172.21.15.22:0/2887884686 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c15a3d0 con 0x7f477c159c60 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f4781065700 1 --2- 172.21.15.22:0/2887884686 >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 0x7f477c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.650+0000 7f477bfff700 1 -- 172.21.15.22:0/2887884686 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661099555 0 0) 0x7f477c15a160 con 0x7f477c15db10 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f4780864700 1 --2- 172.21.15.22:0/2887884686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 0x7f477c15d5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47700098e0 tx=0x7f47700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bcf81f2997d028d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f477bfff700 1 -- 172.21.15.22:0/2887884686 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000b640 con 0x7f477c159c60 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f477bfff700 1 -- 172.21.15.22:0/2887884686 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000b7a0 con 0x7f477c159c60 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f477bfff700 1 -- 172.21.15.22:0/2887884686 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000bb40 con 0x7f477c159c60 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 -- 172.21.15.22:0/2887884686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 msgr2=0x7f477c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 --2- 172.21.15.22:0/2887884686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 0x7f477c15d5d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47700098e0 tx=0x7f47700091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 -- 172.21.15.22:0/2887884686 shutdown_connections 2023-10-08T00:25:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 --2- 172.21.15.22:0/2887884686 >> v2:172.21.15.192:3300/0 conn(0x7f477c159890 0x7f477c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 --2- 172.21.15.22:0/2887884686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159c60 0x7f477c15d5d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 -- 172.21.15.22:0/2887884686 >> 172.21.15.22:0/2887884686 conn(0x7f477c068e20 msgr2=0x7f477c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 -- 172.21.15.22:0/2887884686 shutdown_connections 2023-10-08T00:25:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.651+0000 7f47832c9700 1 -- 172.21.15.22:0/2887884686 wait complete. 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.652+0000 7f47832c9700 1 Processor -- start 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 -- start start 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159890 0x7f477c140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f477c159c60 0x7f477c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c15db10 0x7f477c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1445f0 con 0x7f477c15db10 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0ceb50 con 0x7f477c159c60 2023-10-08T00:25:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.653+0000 7f47832c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0cdf40 con 0x7f477c159890 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781866700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c15db10 0x7f477c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159890 0x7f477c140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781866700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c15db10 0x7f477c157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41676/0 (socket says 172.21.15.22:41676) 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781866700 1 -- 172.21.15.22:0/1202308454 learned_addr learned my addr 172.21.15.22:0/1202308454 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4780864700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f477c159c60 0x7f477c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 -- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f477c159c60 msgr2=0x7f477c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f477c159c60 0x7f477c1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 -- 172.21.15.22:0/1202308454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c15db10 msgr2=0x7f477c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c15db10 0x7f477c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 -- 172.21.15.22:0/1202308454 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c009a20 con 0x7f477c159890 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f4781065700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159890 0x7f477c140dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f476c009fd0 tx=0x7f476c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:55.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00cbd0 con 0x7f477c159890 2023-10-08T00:25:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476c00f040 con 0x7f477c159890 2023-10-08T00:25:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c014480 con 0x7f477c159890 2023-10-08T00:25:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4770009420 con 0x7f477c159890 2023-10-08T00:25:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.654+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c0ce500 con 0x7f477c159890 2023-10-08T00:25:55.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.655+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c04c3c0 con 0x7f477c159890 2023-10-08T00:25:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.656+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f476c014870 con 0x7f477c159890 2023-10-08T00:25:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.656+0000 7f47797fa700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4768066f30 0x7f47680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.656+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f476c085960 con 0x7f477c159890 2023-10-08T00:25:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.657+0000 7f4780864700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4768066f30 0x7f47680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:55.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.657+0000 7f4780864700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4768066f30 0x7f47680693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f477c15a090 tx=0x7f4770017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:55.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.660+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f476c0528b0 con 0x7f477c159890 2023-10-08T00:25:55.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.902+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000109451", "format": "json"} v 0) v1 -- 0x7f477c06a5b0 con 0x7f477c159890 2023-10-08T00:25:55.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.903+0000 7f47797fa700 1 -- 172.21.15.22:0/1202308454 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000109451", "format": "json"}]=0 v21) v1 ==== 110+0+1847 (secure 0 0 0) 0x7f476c055ed0 con 0x7f477c159890 2023-10-08T00:25:55.904 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:55.904 INFO:teuthology.orchestra.run.smithi022.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:53.791766+0000","modified":"2023-10-08T00:25:55.783280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4804},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4804":{"gid":4804,"name":"b","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6836/1890171180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1890171180},{"type":"v1","addr":"172.21.15.192:6836","nonce":1890171180}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000109451","balancer":"","standby_count_wanted":1},"id":3} 2023-10-08T00:25:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4768066f30 msgr2=0x7f47680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4768066f30 0x7f47680693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f477c15a090 tx=0x7f4770017000 comp rx=0 tx=0).stop 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159890 msgr2=0x7f477c140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159890 0x7f477c140dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f476c009fd0 tx=0x7f476c00b040 comp rx=0 tx=0).stop 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 shutdown_connections 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c15db10 0x7f477c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4768066f30 0x7f47680693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f477c159890 0x7f477c140dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 --2- 172.21.15.22:0/1202308454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f477c159c60 0x7f477c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 >> 172.21.15.22:0/1202308454 conn(0x7f477c068e20 msgr2=0x7f477c153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 shutdown_connections 2023-10-08T00:25:55.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:55.905+0000 7f47832c9700 1 -- 172.21.15.22:0/1202308454 wait complete. 2023-10-08T00:25:55.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000109451 --yes-i-really-mean-it 2023-10-08T00:25:56.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.039+0000 7fc0458f5700 1 Processor -- start 2023-10-08T00:25:56.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.039+0000 7fc0458f5700 1 -- start start 2023-10-08T00:25:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc0458f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006c0a0 0x7fc0400caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc0458f5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc04015df50 0x7fc04015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc0458f5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04015d7e0 con 0x7fc04006bcd0 2023-10-08T00:25:56.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc0458f5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04015dac0 con 0x7fc04015df50 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc0458f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04015aa30 con 0x7fc04006c0a0 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc03effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc04006bcd0 0x7fc04015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:35256/0 (socket says 172.21.15.22:35256) 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc03effd700 1 -- 172.21.15.22:0/2254705833 learned_addr learned my addr 172.21.15.22:0/2254705833 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc03e7fc700 1 --2- 172.21.15.22:0/2254705833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006c0a0 0x7fc0400caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc03f7fe700 1 --2- 172.21.15.22:0/2254705833 >> v2:172.21.15.192:3300/0 conn(0x7fc04015df50 0x7fc04015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc03dffb700 1 -- 172.21.15.22:0/2254705833 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440738732 0 0) 0x7fc04015d7e0 con 0x7fc04006bcd0 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.040+0000 7fc03dffb700 1 -- 172.21.15.22:0/2254705833 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c003570 con 0x7fc04006bcd0 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03dffb700 1 -- 172.21.15.22:0/2254705833 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245023137 0 0) 0x7fc02c003570 con 0x7fc04006bcd0 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03e7fc700 1 -- 172.21.15.22:0/2254705833 >> v2:172.21.15.192:3300/0 conn(0x7fc04015df50 msgr2=0x7fc04015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03e7fc700 1 --2- 172.21.15.22:0/2254705833 >> v2:172.21.15.192:3300/0 conn(0x7fc04015df50 0x7fc04015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:56.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03e7fc700 1 -- 172.21.15.22:0/2254705833 >> v1:172.21.15.22:6789/0 conn(0x7fc04006bcd0 legacy=0x7fc04015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03e7fc700 1 -- 172.21.15.22:0/2254705833 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04015ad10 con 0x7fc04006c0a0 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03f7fe700 1 --2- 172.21.15.22:0/2254705833 >> v2:172.21.15.192:3300/0 conn(0x7fc04015df50 0x7fc04015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03e7fc700 1 --2- 172.21.15.22:0/2254705833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006c0a0 0x7fc0400caa90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098e0 tx=0x7fc0280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0708697359390e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03dffb700 1 -- 172.21.15.22:0/2254705833 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300017f0 con 0x7fc04006c0a0 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03dffb700 1 -- 172.21.15.22:0/2254705833 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028011420 con 0x7fc04006c0a0 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.041+0000 7fc03dffb700 1 -- 172.21.15.22:0/2254705833 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0280117a0 con 0x7fc04006c0a0 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 -- 172.21.15.22:0/2254705833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006c0a0 msgr2=0x7fc0400caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 --2- 172.21.15.22:0/2254705833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006c0a0 0x7fc0400caa90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098e0 tx=0x7fc0280091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 -- 172.21.15.22:0/2254705833 shutdown_connections 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 --2- 172.21.15.22:0/2254705833 >> v2:172.21.15.192:3300/0 conn(0x7fc04015df50 0x7fc04015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 --2- 172.21.15.22:0/2254705833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006c0a0 0x7fc0400caa90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:56.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 -- 172.21.15.22:0/2254705833 >> 172.21.15.22:0/2254705833 conn(0x7fc0400ce600 msgr2=0x7fc0400cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 -- 172.21.15.22:0/2254705833 shutdown_connections 2023-10-08T00:25:56.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.042+0000 7fc0458f5700 1 -- 172.21.15.22:0/2254705833 wait complete. 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.043+0000 7fc0458f5700 1 Processor -- start 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.043+0000 7fc0458f5700 1 -- start start 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006bcd0 0x7fc0400b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc04006c0a0 0x7fc0401483b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 0x7fc0400b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040158270 con 0x7fc04015df50 2023-10-08T00:25:56.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040158550 con 0x7fc04006c0a0 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040158830 con 0x7fc04006bcd0 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 0x7fc0400b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 0x7fc0400b2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41682/0 (socket says 172.21.15.22:41682) 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 -- 172.21.15.22:0/139384471 learned_addr learned my addr 172.21.15.22:0/139384471 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03e7fc700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc04006c0a0 0x7fc0401483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 -- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006bcd0 msgr2=0x7fc0400b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006bcd0 0x7fc0400b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 -- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc04006c0a0 msgr2=0x7fc0401483b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc04006c0a0 0x7fc0401483b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 -- 172.21.15.22:0/139384471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009420 con 0x7fc04015df50 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03e7fc700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc04006c0a0 0x7fc0401483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc03f7fe700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 0x7fc0400b2250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc03800ec80 tx=0x7fc0380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:56.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800c9d0 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800cb30 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc028009420 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.044+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038013470 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.045+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc040158df0 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.045+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04004c3c0 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.046+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc038013860 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.046+0000 7fc036ffd700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc020066f30 0x7fc0200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.046+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc038084a50 con 0x7fc04015df50 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.046+0000 7fc03effd700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc020066f30 0x7fc0200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:56.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.047+0000 7fc03effd700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc020066f30 0x7fc0200693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc04006a270 tx=0x7fc030007c70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:56.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.050+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc038051940 con 0x7fc04015df50 2023-10-08T00:25:56.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:56.269+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000109451", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fc04015aff0 con 0x7fc020066f30 2023-10-08T00:25:56.275 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:25:56.274+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:25:56.302 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:25:59.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.292+0000 7fc036ffd700 1 -- 172.21.15.22:0/139384471 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fc04015aff0 con 0x7fc020066f30 2023-10-08T00:25:59.294 INFO:teuthology.orchestra.run.smithi022.stdout:metadata pool: cephfs.volume_0000000000109451.meta data pool: ['cephfs.volume_0000000000109451.data'] removed 2023-10-08T00:25:59.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.296+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc020066f30 msgr2=0x7fc0200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.296+0000 7fc0458f5700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc020066f30 0x7fc0200693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc04006a270 tx=0x7fc030007c70 comp rx=0 tx=0).stop 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.296+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 msgr2=0x7fc0400b2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.296+0000 7fc0458f5700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 0x7fc0400b2250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc03800ec80 tx=0x7fc0380091a0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 shutdown_connections 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc04015df50 0x7fc0400b2250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc020066f30 0x7fc0200693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc04006bcd0 0x7fc0400b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 --2- 172.21.15.22:0/139384471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc04006c0a0 0x7fc0401483b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 >> 172.21.15.22:0/139384471 conn(0x7fc0400ce600 msgr2=0x7fc04015b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 shutdown_connections 2023-10-08T00:25:59.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.297+0000 7fc0458f5700 1 -- 172.21.15.22:0/139384471 wait complete. 2023-10-08T00:25:59.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:25:59.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:25:59.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:25:59.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:25:59.402 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:25:59.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:25:59.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:25:59.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:25:59.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:59.443 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:25:59.499 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:25:59.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:25:59.500 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:25:59.539 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:25:59.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:25:59.540 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:25:59.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:25:59.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.720+0000 7f834148c700 1 Processor -- start 2023-10-08T00:25:59.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.721+0000 7f834148c700 1 -- start start 2023-10-08T00:25:59.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.721+0000 7f834148c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f833c069560 0x7f833c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.721+0000 7f834148c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c069ee0 con 0x7f833c159c60 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.721+0000 7f834148c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c15a160 con 0x7f833c159890 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.721+0000 7f834148c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0d13a0 con 0x7f833c069560 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f833a7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f833c159c60 0x7f833c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38836/0 (socket says 172.21.15.22:38836) 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f833a7fc700 1 -- 172.21.15.22:0/2827977002 learned_addr learned my addr 172.21.15.22:0/2827977002 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f833b7fe700 1 --2- 172.21.15.22:0/2827977002 >> v2:172.21.15.192:3300/0 conn(0x7f833c069560 0x7f833c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089763347 0 0) 0x7f833c069ee0 con 0x7f833c159c60 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8328003570 con 0x7f833c159c60 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854215320 0 0) 0x7f833c15a160 con 0x7f833c159890 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f833c069ee0 con 0x7f833c159890 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2157525647 0 0) 0x7f8328003570 con 0x7f833c159c60 2023-10-08T00:25:59.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 >> v2:172.21.15.192:3300/0 conn(0x7f833c069560 msgr2=0x7f833c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 --2- 172.21.15.22:0/2827977002 >> v2:172.21.15.192:3300/0 conn(0x7f833c069560 0x7f833c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 >> v1:172.21.15.192:6789/0 conn(0x7f833c159890 legacy=0x7f833c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c15e140 con 0x7f833c159c60 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f8324001470 con 0x7f833c159c60 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 >> v1:172.21.15.22:6789/0 conn(0x7f833c159c60 legacy=0x7f833c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8328003bf0 0x7f8328003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8328004810 0x7f8328004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280051c0 0x7f832800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0d13a0 con 0x7f8328003bf0 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832800c0b0 con 0x7f83280051c0 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832800c270 con 0x7f8328004810 2023-10-08T00:25:59.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f833affd700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8328003bf0 0x7f8328003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.722+0000 7f833b7fe700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280051c0 0x7f832800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833a7fc700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8328004810 0x7f8328004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833affd700 1 -- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8328004810 msgr2=0x7f8328004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833affd700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8328004810 0x7f8328004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833affd700 1 -- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280051c0 msgr2=0x7f832800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833affd700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280051c0 0x7f832800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833affd700 1 -- 172.21.15.22:0/2827977002 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328003570 con 0x7f8328003bf0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833b7fe700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83280051c0 0x7f832800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833b7fe700 1 -- 172.21.15.22:0/2827977002 reap_dead start 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f833affd700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8328003bf0 0x7f8328003fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f832c002120 tx=0x7f832c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf828b89294dc02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c006ba0 con 0x7f8328003bf0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c006d00 con 0x7f8328003bf0 2023-10-08T00:25:59.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f8339ffb700 1 -- 172.21.15.22:0/2827977002 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00cae0 con 0x7f8328003bf0 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f834148c700 1 -- 172.21.15.22:0/2827977002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8328003bf0 msgr2=0x7f8328003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.723+0000 7f834148c700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8328003bf0 0x7f8328003fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f832c002120 tx=0x7f832c0017a0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.724+0000 7f834148c700 1 -- 172.21.15.22:0/2827977002 shutdown_connections 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.724+0000 7f834148c700 1 --2- 172.21.15.22:0/2827977002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8328003bf0 0x7f8328003fe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.724+0000 7f834148c700 1 -- 172.21.15.22:0/2827977002 >> 172.21.15.22:0/2827977002 conn(0x7f833c068e20 msgr2=0x7f833c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.724+0000 7f834148c700 1 -- 172.21.15.22:0/2827977002 shutdown_connections 2023-10-08T00:25:59.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.724+0000 7f834148c700 1 -- 172.21.15.22:0/2827977002 wait complete. 2023-10-08T00:25:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.725+0000 7f834148c700 1 Processor -- start 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.725+0000 7f834148c700 1 -- start start 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8328003bf0 0x7f833c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 0x7f833c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c150b60 0x7f833c152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0b1ca0 con 0x7f833c0b11d0 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c1566d0 con 0x7f8328003bf0 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c156c70 con 0x7f833c150b60 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 0x7f833c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 0x7f833c151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35164/0 (socket says 172.21.15.22:35164) 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 -- 172.21.15.22:0/1003125842 learned_addr learned my addr 172.21.15.22:0/1003125842 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833affd700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8328003bf0 0x7f833c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833b7fe700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c150b60 0x7f833c152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 -- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c150b60 msgr2=0x7f833c152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c150b60 0x7f833c152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 -- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8328003bf0 msgr2=0x7f833c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8328003bf0 0x7f833c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 -- 172.21.15.22:0/1003125842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0b16e0 con 0x7f833c0b11d0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833affd700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8328003bf0 0x7f833c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f833a7fc700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 0x7f833c151d10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f832400e830 tx=0x7f8324000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324012590 con 0x7f833c0b11d0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83240126f0 con 0x7f833c0b11d0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c0b19c0 con 0x7f833c0b11d0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.726+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324012ab0 con 0x7f833c0b11d0 2023-10-08T00:25:59.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.727+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c0b2eb0 con 0x7f833c0b11d0 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.727+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c156ac0 con 0x7f833c0b11d0 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.728+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f832401d460 con 0x7f833c0b11d0 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.728+0000 7f8332ffd700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f831c066f30 0x7f831c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.728+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f83240844b0 con 0x7f833c0b11d0 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.728+0000 7f833affd700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f831c066f30 0x7f831c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.729+0000 7f833affd700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f831c066f30 0x7f831c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f832c001be0 tx=0x7f832c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:25:59.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.733+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83240516d0 con 0x7f833c0b11d0 2023-10-08T00:25:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.971+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f833c0b30d0 con 0x7f833c0b11d0 2023-10-08T00:25:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.971+0000 7f8332ffd700 1 -- 172.21.15.22:0/1003125842 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f8324054cf0 con 0x7f833c0b11d0 2023-10-08T00:25:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:25:59.973 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4847,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3989004293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3989004293},{"type":"v1","addr":"172.21.15.192:6836","nonce":3989004293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:37.106452+0000","modified":"2023-10-08T00:25:40.729415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/685646696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":685646696},{"type":"v1","addr":"172.21.15.22:6834","nonce":685646696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T00:25:59.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.974+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f831c066f30 msgr2=0x7f831c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.974+0000 7f834148c700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f831c066f30 0x7f831c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f832c001be0 tx=0x7f832c015000 comp rx=0 tx=0).stop 2023-10-08T00:25:59.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.974+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 msgr2=0x7f833c151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:25:59.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.974+0000 7f834148c700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 0x7f833c151d10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f832400e830 tx=0x7f8324000bc0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 shutdown_connections 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f831c066f30 0x7f831c0693e0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f832c001be0 tx=0x7f832c015000 comp rx=0 tx=0).stop 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f833c150b60 0x7f833c152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8328003bf0 0x7f833c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 --2- 172.21.15.22:0/1003125842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f833c0b11d0 0x7f833c151d10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 >> 172.21.15.22:0/1003125842 conn(0x7f833c068e20 msgr2=0x7f833c1545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 shutdown_connections 2023-10-08T00:25:59.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:25:59.975+0000 7f834148c700 1 -- 172.21.15.22:0/1003125842 wait complete. 2023-10-08T00:25:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 23 2023-10-08T00:25:59.989 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.108+0000 7f2329548700 1 Processor -- start 2023-10-08T00:26:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2329548700 1 -- start start 2023-10-08T00:26:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2329548700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 0x7f232415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2329548700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f232415db10 0x7f2324069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2329548700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232415a160 con 0x7f2324159890 2023-10-08T00:26:00.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2329548700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23240d13a0 con 0x7f232415db10 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2329548700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232415e140 con 0x7f2324159c60 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2322ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2324159890 0x7f232415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38844/0 (socket says 172.21.15.22:38844) 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.109+0000 7f2322ffd700 1 -- 172.21.15.22:0/151943786 learned_addr learned my addr 172.21.15.22:0/151943786 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486625330 0 0) 0x7f232415a160 con 0x7f2324159890 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2310003570 con 0x7f2324159890 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f23237fe700 1 --2- 172.21.15.22:0/151943786 >> v2:172.21.15.192:3300/0 conn(0x7f232415db10 0x7f2324069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f23227fc700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 0x7f232415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889321765 0 0) 0x7f2310003570 con 0x7f2324159890 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 msgr2=0x7f232415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 0x7f232415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 >> v2:172.21.15.192:3300/0 conn(0x7f232415db10 msgr2=0x7f2324069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 --2- 172.21.15.22:0/151943786 >> v2:172.21.15.192:3300/0 conn(0x7f232415db10 0x7f2324069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232415a3d0 con 0x7f2324159890 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f23140017f0 con 0x7f2324159890 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 >> v1:172.21.15.22:6789/0 conn(0x7f2324159890 legacy=0x7f232415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2310003a60 0x7f2310003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2310004810 0x7f2310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 0x7f23100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240d13a0 con 0x7f2310003a60 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232415e140 con 0x7f2310004810 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231000ba60 con 0x7f2324159c60 2023-10-08T00:26:00.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f2322ffd700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2310003a60 0x7f2310003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f23227fc700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2310004810 0x7f2310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.110+0000 7f23237fe700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 0x7f23100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2322ffd700 1 -- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 msgr2=0x7f23100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2322ffd700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2324159c60 0x7f23100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2322ffd700 1 -- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2310004810 msgr2=0x7f2310004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2322ffd700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2310004810 0x7f2310004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2322ffd700 1 -- 172.21.15.22:0/151943786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310003570 con 0x7f2310003a60 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2322ffd700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2310003a60 0x7f2310003e70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f231400a9a0 tx=0x7f2314002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b890f14585699cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314012440 con 0x7f2310003a60 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23140125c0 con 0x7f2310003a60 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2321ffb700 1 -- 172.21.15.22:0/151943786 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2314012980 con 0x7f2310003a60 2023-10-08T00:26:00.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2329548700 1 -- 172.21.15.22:0/151943786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2310003a60 msgr2=0x7f2310003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f2329548700 1 --2- 172.21.15.22:0/151943786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2310003a60 0x7f2310003e70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f231400a9a0 tx=0x7f2314002210 comp rx=0 tx=0).stop 2023-10-08T00:26:00.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.111+0000 7f23237fe700 1 -- 172.21.15.22:0/151943786 reap_dead start 2023-10-08T00:26:00.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.112+0000 7f2329548700 1 -- 172.21.15.22:0/151943786 shutdown_connections 2023-10-08T00:26:00.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.112+0000 7f2329548700 1 -- 172.21.15.22:0/151943786 >> 172.21.15.22:0/151943786 conn(0x7f2324068e20 msgr2=0x7f23240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:00.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.112+0000 7f2329548700 1 -- 172.21.15.22:0/151943786 shutdown_connections 2023-10-08T00:26:00.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.112+0000 7f2329548700 1 -- 172.21.15.22:0/151943786 wait complete. 2023-10-08T00:26:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.113+0000 7f2329548700 1 Processor -- start 2023-10-08T00:26:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.113+0000 7f2329548700 1 -- start start 2023-10-08T00:26:00.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2310003a60 0x7f2324143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 0x7f23240c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23240b1b40 0x7f23240c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240b4930 con 0x7f23240b16d0 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23240ca0b0 con 0x7f23240b1b40 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23240b3d20 con 0x7f2310003a60 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 0x7f23240c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 0x7f23240c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35182/0 (socket says 172.21.15.22:35182) 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 -- 172.21.15.22:0/93697635 learned_addr learned my addr 172.21.15.22:0/93697635 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2322ffd700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2310003a60 0x7f2324143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23237fe700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23240b1b40 0x7f23240c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 -- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2310003a60 msgr2=0x7f2324143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2310003a60 0x7f2324143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 -- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23240b1b40 msgr2=0x7f23240c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23240b1b40 0x7f23240c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 -- 172.21.15.22:0/93697635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240b4000 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f23227fc700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 0x7f23240c9630 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f230c011b40 tx=0x7f230c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00f940 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c00faa0 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23240b42e0 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00fe20 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.114+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2324144330 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.115+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232404c3c0 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.116+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f230c014650 con 0x7f23240b16d0 2023-10-08T00:26:00.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.116+0000 7f231affd700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.116+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f230c018030 con 0x7f23240b16d0 2023-10-08T00:26:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.117+0000 7f2322ffd700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.117+0000 7f2322ffd700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304066f30 0x7f23040693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f231400a8c0 tx=0x7f2314015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.121+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f230c0521b0 con 0x7f23240b16d0 2023-10-08T00:26:00.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.315+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f232406a5b0 con 0x7f23240b16d0 2023-10-08T00:26:00.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.315+0000 7f231affd700 1 -- 172.21.15.22:0/93697635 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15481 (secure 0 0 0) 0x7f230c022090 con 0x7f23240b16d0 2023-10-08T00:26:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:00.317 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:59.283720+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6836/1890171180":"2023-10-09T00:25:56.275754+0000","172.21.15.192:6834/1890171180":"2023-10-09T00:25:56.275754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:00.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304066f30 msgr2=0x7f23040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304066f30 0x7f23040693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f231400a8c0 tx=0x7f2314015000 comp rx=0 tx=0).stop 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 msgr2=0x7f23240c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 0x7f23240c9630 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f230c011b40 tx=0x7f230c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 shutdown_connections 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23240b1b40 0x7f23240c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304066f30 0x7f23040693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2310003a60 0x7f2324143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 --2- 172.21.15.22:0/93697635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23240b16d0 0x7f23240c9630 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 >> 172.21.15.22:0/93697635 conn(0x7f2324068e20 msgr2=0x7f23241587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 shutdown_connections 2023-10-08T00:26:00.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.318+0000 7f2329548700 1 -- 172.21.15.22:0/93697635 wait complete. 2023-10-08T00:26:00.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:25:35.084666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:25:36.079099+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:26:00.332 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:26:00.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.452+0000 7f4425369700 1 Processor -- start 2023-10-08T00:26:00.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.452+0000 7f4425369700 1 -- start start 2023-10-08T00:26:00.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f4425369700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4420141500 0x7f44200c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f4425369700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f442006c0a0 0x7f44200c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f4425369700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442015c2a0 con 0x7f442006bcd0 2023-10-08T00:26:00.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f4425369700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44200c9880 con 0x7f4420141500 2023-10-08T00:26:00.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f4425369700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442015b690 con 0x7f442006c0a0 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f441e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4420141500 0x7f44200c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f441e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4420141500 0x7f44200c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35198/0 (socket says 172.21.15.22:35198) 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f441e7fc700 1 -- 172.21.15.22:0/103018504 learned_addr learned my addr 172.21.15.22:0/103018504 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f441f7fe700 1 --2- 172.21.15.22:0/103018504 >> v2:172.21.15.192:3300/0 conn(0x7f442006c0a0 0x7f44200c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f441e7fc700 1 -- 172.21.15.22:0/103018504 >> v2:172.21.15.192:3300/0 conn(0x7f442006c0a0 msgr2=0x7f44200c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.453+0000 7f441e7fc700 1 --2- 172.21.15.22:0/103018504 >> v2:172.21.15.192:3300/0 conn(0x7f442006c0a0 0x7f44200c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f441e7fc700 1 -- 172.21.15.22:0/103018504 >> v1:172.21.15.192:6789/0 conn(0x7f442006bcd0 legacy=0x7f4420140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f441e7fc700 1 -- 172.21.15.22:0/103018504 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442015b970 con 0x7f4420141500 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f441e7fc700 1 --2- 172.21.15.22:0/103018504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f44200c8e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f44200cf210 tx=0x7f4408009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41b87caa674a5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f441dffb700 1 -- 172.21.15.22:0/103018504 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440800b820 con 0x7f4420141500 2023-10-08T00:26:00.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f441dffb700 1 -- 172.21.15.22:0/103018504 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440800b980 con 0x7f4420141500 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f441dffb700 1 -- 172.21.15.22:0/103018504 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440800bd20 con 0x7f4420141500 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 -- 172.21.15.22:0/103018504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 msgr2=0x7f44200c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 --2- 172.21.15.22:0/103018504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f44200c8e00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f44200cf210 tx=0x7f4408009250 comp rx=0 tx=0).stop 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 -- 172.21.15.22:0/103018504 shutdown_connections 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 --2- 172.21.15.22:0/103018504 >> v2:172.21.15.192:3300/0 conn(0x7f442006c0a0 0x7f44200c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 --2- 172.21.15.22:0/103018504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f44200c8e00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 -- 172.21.15.22:0/103018504 >> 172.21.15.22:0/103018504 conn(0x7f44200ce600 msgr2=0x7f44200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 -- 172.21.15.22:0/103018504 shutdown_connections 2023-10-08T00:26:00.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.454+0000 7f4425369700 1 -- 172.21.15.22:0/103018504 wait complete. 2023-10-08T00:26:00.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 Processor -- start 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 -- start start 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442006bcd0 0x7f44200c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442006c0a0 0x7f442006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f442013c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442016b470 con 0x7f4420141500 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442016a860 con 0x7f442006bcd0 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.456+0000 7f4425369700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442016ab40 con 0x7f442006c0a0 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f442013c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f442013c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35208/0 (socket says 172.21.15.22:35208) 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 -- 172.21.15.22:0/849887443 learned_addr learned my addr 172.21.15.22:0/849887443 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:00.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441e7fc700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442006c0a0 0x7f442006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441effd700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442006bcd0 0x7f44200c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 -- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442006c0a0 msgr2=0x7f442006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442006c0a0 0x7f442006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 -- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442006bcd0 msgr2=0x7f44200c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442006bcd0 0x7f44200c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 -- 172.21.15.22:0/849887443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44080094f0 con 0x7f4420141500 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f441f7fe700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f442013c1f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f441000ceb0 tx=0x7f4410007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441000ad90 con 0x7f4420141500 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4410016420 con 0x7f4420141500 2023-10-08T00:26:00.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442016ae20 con 0x7f4420141500 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100167e0 con 0x7f4420141500 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.457+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442006b430 con 0x7f4420141500 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.458+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44200c8a40 con 0x7f4420141500 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.459+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4410009030 con 0x7f4420141500 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.459+0000 7f4416ffd700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4400066f30 0x7f44000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.459+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f4410012070 con 0x7f4420141500 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.459+0000 7f441effd700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4400066f30 0x7f44000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.460+0000 7f441effd700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4400066f30 0x7f44000693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f442016da20 tx=0x7f4418007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.463+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f441004e5a0 con 0x7f4420141500 2023-10-08T00:26:00.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.654+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f442004c3c0 con 0x7f4420141500 2023-10-08T00:26:00.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.654+0000 7f4416ffd700 1 -- 172.21.15.22:0/849887443 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4410051c90 con 0x7f4420141500 2023-10-08T00:26:00.656 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4400066f30 msgr2=0x7f44000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4400066f30 0x7f44000693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f442016da20 tx=0x7f4418007ea0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 msgr2=0x7f442013c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f442013c1f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f441000ceb0 tx=0x7f4410007870 comp rx=0 tx=0).stop 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 shutdown_connections 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4420141500 0x7f442013c1f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442006bcd0 0x7f44200c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4400066f30 0x7f44000693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 --2- 172.21.15.22:0/849887443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f442006c0a0 0x7f442006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 >> 172.21.15.22:0/849887443 conn(0x7f44200ce600 msgr2=0x7f44200cd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 shutdown_connections 2023-10-08T00:26:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.656+0000 7f4425369700 1 -- 172.21.15.22:0/849887443 wait complete. 2023-10-08T00:26:00.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:26:00.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:26:00.673 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:26:00.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.794+0000 7ffa5ba78700 1 Processor -- start 2023-10-08T00:26:00.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.794+0000 7ffa5ba78700 1 -- start start 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa5ba78700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa54159890 0x7ffa5415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa5ba78700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5415a160 con 0x7ffa54069560 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa5ba78700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540d13a0 con 0x7ffa54159c60 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa5ba78700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5415e140 con 0x7ffa54159890 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa54159890 0x7ffa5415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa54159890 0x7ffa5415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35212/0 (socket says 172.21.15.22:35212) 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa5a015700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ffa54069560 0x7ffa540ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38852/0 (socket says 172.21.15.22:38852) 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 -- 172.21.15.22:0/640839814 learned_addr learned my addr 172.21.15.22:0/640839814 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 -- 172.21.15.22:0/640839814 >> v1:172.21.15.192:6789/0 conn(0x7ffa54159c60 legacy=0x7ffa5415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 -- 172.21.15.22:0/640839814 >> v1:172.21.15.22:6789/0 conn(0x7ffa54069560 legacy=0x7ffa540ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 -- 172.21.15.22:0/640839814 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5415a3d0 con 0x7ffa54159890 2023-10-08T00:26:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa58812700 1 -- 172.21.15.22:0/640839814 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834003228 0 0) 0x7ffa5415a160 con 0x7ffa54069560 2023-10-08T00:26:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa59814700 1 --2- 172.21.15.22:0/640839814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159890 0x7ffa5415abd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffa500099b0 tx=0x7ffa50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483f33b5b9bc23ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa58812700 1 -- 172.21.15.22:0/640839814 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000b860 con 0x7ffa54159890 2023-10-08T00:26:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa58812700 1 -- 172.21.15.22:0/640839814 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000b9c0 con 0x7ffa54159890 2023-10-08T00:26:00.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.795+0000 7ffa58812700 1 -- 172.21.15.22:0/640839814 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000bd60 con 0x7ffa54159890 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 -- 172.21.15.22:0/640839814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159890 msgr2=0x7ffa5415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/640839814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159890 0x7ffa5415abd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffa500099b0 tx=0x7ffa50009250 comp rx=0 tx=0).stop 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 -- 172.21.15.22:0/640839814 shutdown_connections 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/640839814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159890 0x7ffa5415abd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 -- 172.21.15.22:0/640839814 >> 172.21.15.22:0/640839814 conn(0x7ffa54068e20 msgr2=0x7ffa540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 -- 172.21.15.22:0/640839814 shutdown_connections 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.796+0000 7ffa5ba78700 1 -- 172.21.15.22:0/640839814 wait complete. 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.797+0000 7ffa5ba78700 1 Processor -- start 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.797+0000 7ffa5ba78700 1 -- start start 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5ba78700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa54069560 0x7ffa540b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5ba78700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa54159890 0x7ffa540b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5ba78700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 0x7ffa541520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5ba78700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c8250 con 0x7ffa54159c60 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5ba78700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5414d550 con 0x7ffa54069560 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5ba78700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540b5e90 con 0x7ffa54159890 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 0x7ffa541520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 0x7ffa541520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35218/0 (socket says 172.21.15.22:35218) 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 -- 172.21.15.22:0/1190566345 learned_addr learned my addr 172.21.15.22:0/1190566345 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa59814700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa54069560 0x7ffa540b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa59013700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa54159890 0x7ffa540b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 -- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa54159890 msgr2=0x7ffa540b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa54159890 0x7ffa540b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 -- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa54069560 msgr2=0x7ffa540b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa54069560 0x7ffa540b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 -- 172.21.15.22:0/1190566345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500094f0 con 0x7ffa54159c60 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.798+0000 7ffa5a015700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 0x7ffa541520a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00cd80 tx=0x7ffa4c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.799+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c005df0 con 0x7ffa54159c60 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.799+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00a810 con 0x7ffa54159c60 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.799+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540c87c0 con 0x7ffa54159c60 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.799+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00abd0 con 0x7ffa54159c60 2023-10-08T00:26:00.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.799+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5415db00 con 0x7ffa54159c60 2023-10-08T00:26:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.800+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa540c8950 con 0x7ffa54159c60 2023-10-08T00:26:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.800+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa4c0070f0 con 0x7ffa54159c60 2023-10-08T00:26:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.801+0000 7ffa49ffb700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa38066f30 0x7ffa380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.801+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7ffa4c084640 con 0x7ffa54159c60 2023-10-08T00:26:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.801+0000 7ffa59814700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa38066f30 0x7ffa380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:00.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.801+0000 7ffa59814700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa38066f30 0x7ffa380693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa500099b0 tx=0x7ffa50017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:00.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.805+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa4c0518f0 con 0x7ffa54159c60 2023-10-08T00:26:00.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.996+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa5404c3c0 con 0x7ffa54159c60 2023-10-08T00:26:00.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.996+0000 7ffa49ffb700 1 -- 172.21.15.22:0/1190566345 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa4c054f10 con 0x7ffa54159c60 2023-10-08T00:26:00.998 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:26:01.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa38066f30 msgr2=0x7ffa380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa38066f30 0x7ffa380693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa500099b0 tx=0x7ffa50017000 comp rx=0 tx=0).stop 2023-10-08T00:26:01.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 msgr2=0x7ffa541520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 0x7ffa541520a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00cd80 tx=0x7ffa4c001b10 comp rx=0 tx=0).stop 2023-10-08T00:26:01.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 shutdown_connections 2023-10-08T00:26:01.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa54159c60 0x7ffa541520a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa54069560 0x7ffa540b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa38066f30 0x7ffa380693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 --2- 172.21.15.22:0/1190566345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa54159890 0x7ffa540b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 >> 172.21.15.22:0/1190566345 conn(0x7ffa54068e20 msgr2=0x7ffa540cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:01.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.998+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 shutdown_connections 2023-10-08T00:26:01.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:00.999+0000 7ffa5ba78700 1 -- 172.21.15.22:0/1190566345 wait complete. 2023-10-08T00:26:01.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:26:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.132+0000 7f000cd15700 1 Processor -- start 2023-10-08T00:26:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.132+0000 7f000cd15700 1 -- start start 2023-10-08T00:26:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f000cd15700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 0x7f00080ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f000cd15700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f00080b1b40 0x7f000815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f000cd15700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080cfb00 con 0x7f00080b16d0 2023-10-08T00:26:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f000cd15700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00080b5c40 con 0x7f00080b1b40 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f000cd15700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080b5f20 con 0x7f00080b4e70 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f0006ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f00080b16d0 0x7f000815d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38856/0 (socket says 172.21.15.22:38856) 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f0006ffd700 1 -- 172.21.15.22:0/3648865902 learned_addr learned my addr 172.21.15.22:0/3648865902 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f00077fe700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 0x7f00080ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f0007fff700 1 --2- 172.21.15.22:0/3648865902 >> v2:172.21.15.192:3300/0 conn(0x7f00080b1b40 0x7f000815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819518491 0 0) 0x7f00080cfb00 con 0x7f00080b16d0 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.133+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003570 con 0x7f00080b16d0 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1271547243 0 0) 0x7efff0003570 con 0x7f00080b16d0 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 msgr2=0x7f00080ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 0x7f00080ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 >> v2:172.21.15.192:3300/0 conn(0x7f00080b1b40 msgr2=0x7f000815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 --2- 172.21.15.22:0/3648865902 >> v2:172.21.15.192:3300/0 conn(0x7f00080b1b40 0x7f000815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080b6200 con 0x7f00080b16d0 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7efffc001470 con 0x7f00080b16d0 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 >> v1:172.21.15.22:6789/0 conn(0x7f00080b16d0 legacy=0x7f000815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efff0003a60 0x7efff0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 0x7efff0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7efff00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080b5c40 con 0x7efff0004d50 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080b5f20 con 0x7efff0003a60 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff000ba60 con 0x7f00080b4e70 2023-10-08T00:26:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7efff00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f00077fe700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efff0003a60 0x7efff0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0006ffd700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 0x7efff0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 -- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 msgr2=0x7efff0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080b4e70 0x7efff0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 -- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efff0003a60 msgr2=0x7efff0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efff0003a60 0x7efff0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 -- 172.21.15.22:0/3648865902 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0003570 con 0x7efff0004d50 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.134+0000 7f0007fff700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7efff00051c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f000000e210 tx=0x7f000000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fee6e24fd498a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000ea60 con 0x7efff0004d50 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000f040 con 0x7efff0004d50 2023-10-08T00:26:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f00067fc700 1 -- 172.21.15.22:0/3648865902 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000ee10 con 0x7efff0004d50 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f000cd15700 1 -- 172.21.15.22:0/3648865902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 msgr2=0x7efff00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f000cd15700 1 --2- 172.21.15.22:0/3648865902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7efff00051c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f000000e210 tx=0x7f000000b040 comp rx=0 tx=0).stop 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f0007fff700 1 -- 172.21.15.22:0/3648865902 reap_dead start 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f000cd15700 1 -- 172.21.15.22:0/3648865902 shutdown_connections 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f000cd15700 1 -- 172.21.15.22:0/3648865902 >> 172.21.15.22:0/3648865902 conn(0x7f00080d10c0 msgr2=0x7f00080affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f000cd15700 1 -- 172.21.15.22:0/3648865902 shutdown_connections 2023-10-08T00:26:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.135+0000 7f000cd15700 1 -- 172.21.15.22:0/3648865902 wait complete. 2023-10-08T00:26:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.136+0000 7f000cd15700 1 Processor -- start 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.136+0000 7f000cd15700 1 -- start start 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f000cd15700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7f000814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f000cd15700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f000815e1d0 0x7f000815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f000cd15700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080cbff0 0x7f00080cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f000cd15700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000815eb80 con 0x7efff0004d50 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f000cd15700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c77c0 con 0x7f000815e1d0 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f000cd15700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080ccd40 con 0x7f00080cbff0 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7f000814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7f000814af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35224/0 (socket says 172.21.15.22:35224) 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 -- 172.21.15.22:0/2610313604 learned_addr learned my addr 172.21.15.22:0/2610313604 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f0007fff700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080cbff0 0x7f00080cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f0006ffd700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f000815e1d0 0x7f000815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 -- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080cbff0 msgr2=0x7f00080cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080cbff0 0x7f00080cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 -- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f000815e1d0 msgr2=0x7f000815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f000815e1d0 0x7f000815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f00077fe700 1 -- 172.21.15.22:0/2610313604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080cd020 con 0x7efff0004d50 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.137+0000 7f0006ffd700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f000815e1d0 0x7f000815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.138+0000 7f00077fe700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7f000814af00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efff8006ac0 tx=0x7efff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.138+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800fa10 con 0x7efff0004d50 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.138+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff800fb70 con 0x7efff0004d50 2023-10-08T00:26:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.138+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00080c7450 con 0x7efff0004d50 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.138+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8014440 con 0x7efff0004d50 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.138+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00080cc9a0 con 0x7efff0004d50 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.139+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00080c72b0 con 0x7efff0004d50 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.139+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efff8014830 con 0x7efff0004d50 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.140+0000 7effef7fe700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efff4066f30 0x7efff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.140+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7efff8018030 con 0x7efff0004d50 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.140+0000 7f0006ffd700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efff4066f30 0x7efff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.141+0000 7f0006ffd700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efff4066f30 0x7efff40693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efffc0015a0 tx=0x7efffc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.144+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00080c72b0 con 0x7efff0004d50 2023-10-08T00:26:01.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.334+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00080c7aa0 con 0x7efff0004d50 2023-10-08T00:26:01.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.335+0000 7effef7fe700 1 -- 172.21.15.22:0/2610313604 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7efff80220a0 con 0x7efff0004d50 2023-10-08T00:26:01.336 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:26:01.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efff4066f30 msgr2=0x7efff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efff4066f30 0x7efff40693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efffc0015a0 tx=0x7efffc009040 comp rx=0 tx=0).stop 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 msgr2=0x7f000814af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7f000814af00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efff8006ac0 tx=0x7efff80091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 shutdown_connections 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efff4066f30 0x7efff40693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f00080cbff0 0x7f00080cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efff0004d50 0x7f000814af00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 --2- 172.21.15.22:0/2610313604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f000815e1d0 0x7f000815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 >> 172.21.15.22:0/2610313604 conn(0x7f00080d10c0 msgr2=0x7f0008157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 shutdown_connections 2023-10-08T00:26:01.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.337+0000 7f000cd15700 1 -- 172.21.15.22:0/2610313604 wait complete. 2023-10-08T00:26:01.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.468+0000 7f0402f9b700 1 Processor -- start 2023-10-08T00:26:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.468+0000 7f0402f9b700 1 -- start start 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0402f9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03fc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0402f9b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc0cfb30 con 0x7f03fc069bb0 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0402f9b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03fc0cbf10 con 0x7f03fc0cba70 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0402f9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0cf4e0 con 0x7f03fc159840 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0401538700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f03fc069bb0 0x7f03fc0b05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38858/0 (socket says 172.21.15.22:38858) 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0401538700 1 -- 172.21.15.22:0/1289859627 learned_addr learned my addr 172.21.15.22:0/1289859627 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:01.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f0400d37700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03fc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486790096 0 0) 0x7f03fc0cfb30 con 0x7f03fc069bb0 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.469+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e8003570 con 0x7f03fc069bb0 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167845557 0 0) 0x7f03fc0cbf10 con 0x7f03fc0cba70 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03fc0cfb30 con 0x7f03fc0cba70 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717776958 0 0) 0x7f03e8003570 con 0x7f03fc069bb0 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 msgr2=0x7f03fc0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03fc0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 >> v1:172.21.15.192:6789/0 conn(0x7f03fc0cba70 legacy=0x7f03fc0694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0cf7c0 con 0x7f03fc069bb0 2023-10-08T00:26:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f03e4001470 con 0x7f03fc069bb0 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 >> v1:172.21.15.22:6789/0 conn(0x7f03fc069bb0 legacy=0x7f03fc0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e8003c20 0x7f03e8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e8004d50 0x7f03e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0cf4e0 con 0x7f03e8004d50 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e800bbf0 con 0x7f03e8003c20 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e800bdb0 con 0x7f03fc159840 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e8004d50 0x7f03e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0400d37700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e8003c20 0x7f03e8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fbfff700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 -- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 msgr2=0x7f03e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 -- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e8003c20 msgr2=0x7f03e8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e8003c20 0x7f03e8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 -- 172.21.15.22:0/1289859627 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e8003570 con 0x7f03e8004d50 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0400d37700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03e8003c20 0x7f03e8004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fbfff700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc159840 0x7f03e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f0401538700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e8004d50 0x7f03e80051c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c2a0 tx=0x7f03e4001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efacd720ba0f98e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400cb70 con 0x7f03e8004d50 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400ccd0 con 0x7f03e8004d50 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.470+0000 7f03fb7fe700 1 -- 172.21.15.22:0/1289859627 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4005b70 con 0x7f03e8004d50 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0402f9b700 1 -- 172.21.15.22:0/1289859627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e8004d50 msgr2=0x7f03e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1289859627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03e8004d50 0x7f03e80051c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c2a0 tx=0x7f03e4001e10 comp rx=0 tx=0).stop 2023-10-08T00:26:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0401538700 1 -- 172.21.15.22:0/1289859627 reap_dead start 2023-10-08T00:26:01.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0402f9b700 1 -- 172.21.15.22:0/1289859627 shutdown_connections 2023-10-08T00:26:01.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0402f9b700 1 -- 172.21.15.22:0/1289859627 >> 172.21.15.22:0/1289859627 conn(0x7f03fc068e10 msgr2=0x7f03fc0d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:01.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0402f9b700 1 -- 172.21.15.22:0/1289859627 shutdown_connections 2023-10-08T00:26:01.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.471+0000 7f0402f9b700 1 -- 172.21.15.22:0/1289859627 wait complete. 2023-10-08T00:26:01.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.472+0000 7f0402f9b700 1 Processor -- start 2023-10-08T00:26:01.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.472+0000 7f0402f9b700 1 -- start start 2023-10-08T00:26:01.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0402f9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03fc144020 0x7f03fc16d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0402f9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc15a510 0x7f03fc16d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0402f9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 0x7f03fc0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0402f9b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc159da0 con 0x7f03fc16dd30 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0402f9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc15a080 con 0x7f03fc144020 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0402f9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03fc0c7990 con 0x7f03fc15a510 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0401538700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 0x7f03fc0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0401538700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 0x7f03fc0c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35256/0 (socket says 172.21.15.22:35256) 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0401538700 1 -- 172.21.15.22:0/1003359926 learned_addr learned my addr 172.21.15.22:0/1003359926 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0400d37700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03fc144020 0x7f03fc16d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f03fbfff700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc15a510 0x7f03fc16d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0401538700 1 -- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc15a510 msgr2=0x7f03fc16d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.473+0000 7f0401538700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc15a510 0x7f03fc16d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f0401538700 1 -- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03fc144020 msgr2=0x7f03fc16d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f0401538700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03fc144020 0x7f03fc16d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f0401538700 1 -- 172.21.15.22:0/1003359926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03fc0c7c70 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f0401538700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 0x7f03fc0c9300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f03e4000c00 tx=0x7f03e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400ce40 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4004b00 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4004e80 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03fc154740 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.474+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03fc154e40 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.475+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03fc154fd0 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.475+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03e40072e0 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.476+0000 7f03f8ff9700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03dc066f30 0x7f03dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.476+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f03e4085800 con 0x7f03fc16dd30 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.476+0000 7f0400d37700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03dc066f30 0x7f03dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.477+0000 7f0400d37700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03dc066f30 0x7f03dc0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03fc15c510 tx=0x7f03f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.480+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03e4052a20 con 0x7f03fc16dd30 2023-10-08T00:26:01.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.719+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03fc064550 con 0x7f03fc16dd30 2023-10-08T00:26:01.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.720+0000 7f03f8ff9700 1 -- 172.21.15.22:0/1003359926 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f03e4017070 con 0x7f03fc16dd30 2023-10-08T00:26:01.721 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:01.721 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4847,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3989004293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3989004293},{"type":"v1","addr":"172.21.15.192:6836","nonce":3989004293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:37.106452+0000","modified":"2023-10-08T00:25:40.729415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/685646696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":685646696},{"type":"v1","addr":"172.21.15.22:6834","nonce":685646696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T00:26:01.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03dc066f30 msgr2=0x7f03dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03dc066f30 0x7f03dc0693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f03fc15c510 tx=0x7f03f4008040 comp rx=0 tx=0).stop 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 msgr2=0x7f03fc0c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 0x7f03fc0c9300 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f03e4000c00 tx=0x7f03e4015000 comp rx=0 tx=0).stop 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 shutdown_connections 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03fc16dd30 0x7f03fc0c9300 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03fc144020 0x7f03fc16d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03dc066f30 0x7f03dc0693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 --2- 172.21.15.22:0/1003359926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03fc15a510 0x7f03fc16d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 >> 172.21.15.22:0/1003359926 conn(0x7f03fc068e10 msgr2=0x7f03fc0ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 shutdown_connections 2023-10-08T00:26:01.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.722+0000 7f0402f9b700 1 -- 172.21.15.22:0/1003359926 wait complete. 2023-10-08T00:26:01.725 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 23 2023-10-08T00:26:01.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.856+0000 7f2b62c14700 1 Processor -- start 2023-10-08T00:26:01.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b62c14700 1 -- start start 2023-10-08T00:26:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b62c14700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b5c0aca80 0x7f2b5c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b62c14700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2b5c069d60 0x7f2b5c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b62c14700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c06bdb0 con 0x7f2b5c0c81f0 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b62c14700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c0cb370 con 0x7f2b5c069d60 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b62c14700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c159f60 con 0x7f2b5c0aca80 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.857+0000 7f2b5bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2b5c069d60 0x7f2b5c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2b5c069d60 0x7f2b5c0c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35270/0 (socket says 172.21.15.22:35270) 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 -- 172.21.15.22:0/2707996761 learned_addr learned my addr 172.21.15.22:0/2707996761 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b611b1700 1 --1- 172.21.15.22:0/2707996761 >> v1:172.21.15.22:6789/0 conn(0x7f2b5c0c81f0 0x7f2b5c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38872/0 (socket says 172.21.15.22:38872) 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b609b0700 1 --2- 172.21.15.22:0/2707996761 >> v2:172.21.15.192:3300/0 conn(0x7f2b5c0aca80 0x7f2b5c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 -- 172.21.15.22:0/2707996761 >> v2:172.21.15.192:3300/0 conn(0x7f2b5c0aca80 msgr2=0x7f2b5c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 --2- 172.21.15.22:0/2707996761 >> v2:172.21.15.192:3300/0 conn(0x7f2b5c0aca80 0x7f2b5c06aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 -- 172.21.15.22:0/2707996761 >> v1:172.21.15.22:6789/0 conn(0x7f2b5c0c81f0 legacy=0x7f2b5c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 -- 172.21.15.22:0/2707996761 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c0c8610 con 0x7f2b5c069d60 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5b7fe700 1 -- 172.21.15.22:0/2707996761 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902821502 0 0) 0x7f2b5c06bdb0 con 0x7f2b5c0c81f0 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5bfff700 1 --2- 172.21.15.22:0/2707996761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c0c7cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c06e570 tx=0x7f2b50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b05d19f49f5a12a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5b7fe700 1 -- 172.21.15.22:0/2707996761 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000b860 con 0x7f2b5c069d60 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5b7fe700 1 -- 172.21.15.22:0/2707996761 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000b9c0 con 0x7f2b5c069d60 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.858+0000 7f2b5b7fe700 1 -- 172.21.15.22:0/2707996761 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000bd60 con 0x7f2b5c069d60 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 -- 172.21.15.22:0/2707996761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 msgr2=0x7f2b5c0c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 --2- 172.21.15.22:0/2707996761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c0c7cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c06e570 tx=0x7f2b50009250 comp rx=0 tx=0).stop 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 -- 172.21.15.22:0/2707996761 shutdown_connections 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 --2- 172.21.15.22:0/2707996761 >> v2:172.21.15.192:3300/0 conn(0x7f2b5c0aca80 0x7f2b5c06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 --2- 172.21.15.22:0/2707996761 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c0c7cb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 -- 172.21.15.22:0/2707996761 >> 172.21.15.22:0/2707996761 conn(0x7f2b5c0cd670 msgr2=0x7f2b5c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:01.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 -- 172.21.15.22:0/2707996761 shutdown_connections 2023-10-08T00:26:01.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.859+0000 7f2b62c14700 1 -- 172.21.15.22:0/2707996761 wait complete. 2023-10-08T00:26:01.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.860+0000 7f2b62c14700 1 Processor -- start 2023-10-08T00:26:01.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.860+0000 7f2b62c14700 1 -- start start 2023-10-08T00:26:01.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b5c0aca80 0x7f2b5c16d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b5c0c81f0 0x7f2b5c16d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0abf30 con 0x7f2b5c069d60 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0ad840 con 0x7f2b5c0c81f0 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0ab970 con 0x7f2b5c0aca80 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35284/0 (socket says 172.21.15.22:35284) 2023-10-08T00:26:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 -- 172.21.15.22:0/3895161105 learned_addr learned my addr 172.21.15.22:0/3895161105 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b5bfff700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b5c0aca80 0x7f2b5c16d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b611b1700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b5c0c81f0 0x7f2b5c16d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 -- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b5c0aca80 msgr2=0x7f2b5c16d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b5c0aca80 0x7f2b5c16d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 -- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b5c0c81f0 msgr2=0x7f2b5c16d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b5c0c81f0 0x7f2b5c16d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 -- 172.21.15.22:0/3895161105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500094f0 con 0x7f2b5c069d60 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b5bfff700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b5c0aca80 0x7f2b5c16d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b611b1700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b5c0c81f0 0x7f2b5c16d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b609b0700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c155d40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00d810 tx=0x7f2b4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0125f0 con 0x7f2b5c069d60 2023-10-08T00:26:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c012750 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c0abc50 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.861+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c012b10 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.862+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c0afce0 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.863+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c0ad330 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.863+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b4c01e460 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.863+0000 7f2b58ff9700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b48066f30 0x7f2b480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.864+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2b4c084c10 con 0x7f2b5c069d60 2023-10-08T00:26:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.864+0000 7f2b5bfff700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b48066f30 0x7f2b480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.864+0000 7f2b5bfff700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b48066f30 0x7f2b480693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c06e570 tx=0x7f2b50017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:01.867+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b5c0ad330 con 0x7f2b5c069d60 2023-10-08T00:26:02.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.064+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b5c0ad330 con 0x7f2b5c069d60 2023-10-08T00:26:02.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.065+0000 7f2b58ff9700 1 -- 172.21.15.22:0/3895161105 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15481 (secure 0 0 0) 0x7f2b5c0ad330 con 0x7f2b5c069d60 2023-10-08T00:26:02.067 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:02.067 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:59.283720+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6836/1890171180":"2023-10-09T00:25:56.275754+0000","172.21.15.192:6834/1890171180":"2023-10-09T00:25:56.275754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b48066f30 msgr2=0x7f2b480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b48066f30 0x7f2b480693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c06e570 tx=0x7f2b50017000 comp rx=0 tx=0).stop 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 msgr2=0x7f2b5c155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c155d40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00d810 tx=0x7f2b4c008040 comp rx=0 tx=0).stop 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 shutdown_connections 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b5c0c81f0 0x7f2b5c16d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b5c069d60 0x7f2b5c155d40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b48066f30 0x7f2b480693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 --2- 172.21.15.22:0/3895161105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b5c0aca80 0x7f2b5c16d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 >> 172.21.15.22:0/3895161105 conn(0x7f2b5c0cd670 msgr2=0x7f2b5c158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 shutdown_connections 2023-10-08T00:26:02.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.067+0000 7f2b62c14700 1 -- 172.21.15.22:0/3895161105 wait complete. 2023-10-08T00:26:02.081 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:26:02.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:02.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.198+0000 7fdfad960700 1 Processor -- start 2023-10-08T00:26:02.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.198+0000 7fdfad960700 1 -- start start 2023-10-08T00:26:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad960700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfa8159420 0x7fdfa80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad960700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfa81597f0 0x7fdfa80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad960700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa815d230 0x7fdfa815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad960700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa815dbb0 con 0x7fdfa8159420 2023-10-08T00:26:02.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad960700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa80b11d0 con 0x7fdfa81597f0 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad960700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80b14b0 con 0x7fdfa815d230 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfa8159420 0x7fdfa80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfa8159420 0x7fdfa80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35298/0 (socket says 172.21.15.22:35298) 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 -- 172.21.15.22:0/1710885582 learned_addr learned my addr 172.21.15.22:0/1710885582 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfa7fff700 1 --2- 172.21.15.22:0/1710885582 >> v2:172.21.15.192:3300/0 conn(0x7fdfa81597f0 0x7fdfa80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfad15f700 1 --2- 172.21.15.22:0/1710885582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa815d230 0x7fdfa815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 -- 172.21.15.22:0/1710885582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa815d230 msgr2=0x7fdfa815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 --2- 172.21.15.22:0/1710885582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa815d230 0x7fdfa815d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 -- 172.21.15.22:0/1710885582 >> v2:172.21.15.192:3300/0 conn(0x7fdfa81597f0 msgr2=0x7fdfa80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:02.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 --2- 172.21.15.22:0/1710885582 >> v2:172.21.15.192:3300/0 conn(0x7fdfa81597f0 0x7fdfa80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfac95e700 1 -- 172.21.15.22:0/1710885582 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80b1790 con 0x7fdfa8159420 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.199+0000 7fdfa7fff700 1 --2- 172.21.15.22:0/1710885582 >> v2:172.21.15.192:3300/0 conn(0x7fdfa81597f0 0x7fdfa80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfac95e700 1 --2- 172.21.15.22:0/1710885582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa8159420 0x7fdfa80b5f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8089750 tx=0x7fdfa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de51e2552a80a1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfa77fe700 1 -- 172.21.15.22:0/1710885582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa000e070 con 0x7fdfa8159420 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfa77fe700 1 -- 172.21.15.22:0/1710885582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa000ba50 con 0x7fdfa8159420 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfa77fe700 1 -- 172.21.15.22:0/1710885582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00092e0 con 0x7fdfa8159420 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 -- 172.21.15.22:0/1710885582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa8159420 msgr2=0x7fdfa80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 --2- 172.21.15.22:0/1710885582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa8159420 0x7fdfa80b5f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8089750 tx=0x7fdfa0009840 comp rx=0 tx=0).stop 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 -- 172.21.15.22:0/1710885582 shutdown_connections 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 --2- 172.21.15.22:0/1710885582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa8159420 0x7fdfa80b5f40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 --2- 172.21.15.22:0/1710885582 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa815d230 0x7fdfa815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 --2- 172.21.15.22:0/1710885582 >> v2:172.21.15.192:3300/0 conn(0x7fdfa81597f0 0x7fdfa80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 -- 172.21.15.22:0/1710885582 >> 172.21.15.22:0/1710885582 conn(0x7fdfa80d0660 msgr2=0x7fdfa80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:02.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 -- 172.21.15.22:0/1710885582 shutdown_connections 2023-10-08T00:26:02.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.200+0000 7fdfad960700 1 -- 172.21.15.22:0/1710885582 wait complete. 2023-10-08T00:26:02.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.201+0000 7fdfad960700 1 Processor -- start 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 -- start start 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfa8159420 0x7fdfa8169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa81597f0 0x7fdfa8157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 0x7fdfa80c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa816a450 con 0x7fdfa815d230 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81579d0 con 0x7fdfa8159420 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.202+0000 7fdfad960700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80c7100 con 0x7fdfa81597f0 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 0x7fdfa80c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 0x7fdfa80c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35312/0 (socket says 172.21.15.22:35312) 2023-10-08T00:26:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 -- 172.21.15.22:0/3587031325 learned_addr learned my addr 172.21.15.22:0/3587031325 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfac95e700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfa8159420 0x7fdfa8169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfa7fff700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa81597f0 0x7fdfa8157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 -- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa81597f0 msgr2=0x7fdfa8157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa81597f0 0x7fdfa8157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 -- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfa8159420 msgr2=0x7fdfa8169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfa8159420 0x7fdfa8169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 -- 172.21.15.22:0/3587031325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0009ae0 con 0x7fdfa815d230 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfac95e700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfa8159420 0x7fdfa8169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad15f700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 0x7fdfa80c5400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c880 tx=0x7fdf98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98011600 con 0x7fdfa815d230 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98011760 con 0x7fdfa815d230 2023-10-08T00:26:02.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa80c73e0 con 0x7fdfa815d230 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98011b00 con 0x7fdfa815d230 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.203+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa80c79a0 con 0x7fdfa815d230 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.204+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa804c3c0 con 0x7fdfa815d230 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.205+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf98018360 con 0x7fdfa815d230 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.205+0000 7fdfa4ff9700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.205+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdf98084280 con 0x7fdfa815d230 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.205+0000 7fdfac95e700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.206+0000 7fdfac95e700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf94066f30 0x7fdf940693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009880 tx=0x7fdfa0018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.209+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf98054f30 con 0x7fdfa815d230 2023-10-08T00:26:02.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.449+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfa80b1a70 con 0x7fdfa815d230 2023-10-08T00:26:02.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.449+0000 7fdfa4ff9700 1 -- 172.21.15.22:0/3587031325 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7fdf98054ac0 con 0x7fdfa815d230 2023-10-08T00:26:02.451 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:02.451 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4847,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3989004293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3989004293},{"type":"v1","addr":"172.21.15.192:6836","nonce":3989004293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:37.106452+0000","modified":"2023-10-08T00:25:40.729415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/685646696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":685646696},{"type":"v1","addr":"172.21.15.22:6834","nonce":685646696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T00:26:02.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.451+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf94066f30 msgr2=0x7fdf940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.451+0000 7fdfad960700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf94066f30 0x7fdf940693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009880 tx=0x7fdfa0018000 comp rx=0 tx=0).stop 2023-10-08T00:26:02.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.451+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 msgr2=0x7fdfa80c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.451+0000 7fdfad960700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 0x7fdfa80c5400 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c880 tx=0x7fdf98008040 comp rx=0 tx=0).stop 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 shutdown_connections 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfa815d230 0x7fdfa80c5400 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfa8159420 0x7fdfa8169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf94066f30 0x7fdf940693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 --2- 172.21.15.22:0/3587031325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfa81597f0 0x7fdfa8157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 >> 172.21.15.22:0/3587031325 conn(0x7fdfa80d0660 msgr2=0x7fdfa80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 shutdown_connections 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.452+0000 7fdfad960700 1 -- 172.21.15.22:0/3587031325 wait complete. 2023-10-08T00:26:02.454 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 23 2023-10-08T00:26:02.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.582+0000 7f6a41fd0700 1 Processor -- start 2023-10-08T00:26:02.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.583+0000 7f6a41fd0700 1 -- start start 2023-10-08T00:26:02.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.583+0000 7f6a41fd0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c069560 0x7f6a3c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.583+0000 7f6a41fd0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c069ee0 con 0x7f6a3c159890 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.583+0000 7f6a41fd0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3c15a160 con 0x7f6a3c159c60 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.583+0000 7f6a41fd0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0d13a0 con 0x7f6a3c069560 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.583+0000 7f6a3b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a3c159890 0x7f6a3c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38876/0 (socket says 172.21.15.22:38876) 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3b7fe700 1 -- 172.21.15.22:0/822245265 learned_addr learned my addr 172.21.15.22:0/822245265 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3bfff700 1 --2- 172.21.15.22:0/822245265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c069560 0x7f6a3c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630389553 0 0) 0x7f6a3c069ee0 con 0x7f6a3c159890 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a24003570 con 0x7f6a3c159890 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851847999 0 0) 0x7f6a3c15a160 con 0x7f6a3c159c60 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a3c069ee0 con 0x7f6a3c159c60 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790120016 0 0) 0x7f6a24003570 con 0x7f6a3c159890 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3bfff700 1 -- 172.21.15.22:0/822245265 >> v1:172.21.15.192:6789/0 conn(0x7f6a3c159c60 legacy=0x7f6a3c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3bfff700 1 -- 172.21.15.22:0/822245265 >> v1:172.21.15.22:6789/0 conn(0x7f6a3c159890 legacy=0x7f6a3c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3bfff700 1 -- 172.21.15.22:0/822245265 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c15e140 con 0x7f6a3c069560 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3bfff700 1 --2- 172.21.15.22:0/822245265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c069560 0x7f6a3c0699a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009e90 tx=0x7f6a34009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d1c7147f831fceb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.584+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400e070 con 0x7f6a3c069560 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400b870 con 0x7f6a3c069560 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a3a7fc700 1 -- 172.21.15.22:0/822245265 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c001470 con 0x7f6a3c069560 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 -- 172.21.15.22:0/822245265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c069560 msgr2=0x7f6a3c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/822245265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c069560 0x7f6a3c0699a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009e90 tx=0x7f6a34009780 comp rx=0 tx=0).stop 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 -- 172.21.15.22:0/822245265 shutdown_connections 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/822245265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c069560 0x7f6a3c0699a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 -- 172.21.15.22:0/822245265 >> 172.21.15.22:0/822245265 conn(0x7f6a3c068e20 msgr2=0x7f6a3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 -- 172.21.15.22:0/822245265 shutdown_connections 2023-10-08T00:26:02.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.585+0000 7f6a41fd0700 1 -- 172.21.15.22:0/822245265 wait complete. 2023-10-08T00:26:02.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.586+0000 7f6a41fd0700 1 Processor -- start 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.586+0000 7f6a41fd0700 1 -- start start 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a41fd0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3c069560 0x7f6a3c0b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a41fd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 0x7f6a3c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a41fd0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c159c60 0x7f6a3c154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a41fd0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0b4db0 con 0x7f6a3c159890 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a41fd0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c78a0 con 0x7f6a3c069560 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a41fd0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0c7b80 con 0x7f6a3c159c60 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 0x7f6a3c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 0x7f6a3c0c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35328/0 (socket says 172.21.15.22:35328) 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3affd700 1 -- 172.21.15.22:0/3934220567 learned_addr learned my addr 172.21.15.22:0/3934220567 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:02.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3bfff700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c159c60 0x7f6a3c154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3b7fe700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3c069560 0x7f6a3c0b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3affd700 1 -- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c159c60 msgr2=0x7f6a3c154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3affd700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c159c60 0x7f6a3c154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.587+0000 7f6a3affd700 1 -- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3c069560 msgr2=0x7f6a3c0b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a3affd700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3c069560 0x7f6a3c0b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a3affd700 1 -- 172.21.15.22:0/3934220567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009a20 con 0x7f6a3c159890 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a3affd700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 0x7f6a3c0c97f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c7c0 tx=0x7f6a30007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30010510 con 0x7f6a3c159890 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30010690 con 0x7f6a3c159890 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c0b6400 con 0x7f6a3c159890 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30010a50 con 0x7f6a3c159890 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.588+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c0b5280 con 0x7f6a3c159890 2023-10-08T00:26:02.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.589+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c0c7cf0 con 0x7f6a3c159890 2023-10-08T00:26:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.589+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3001b3b0 con 0x7f6a3c159890 2023-10-08T00:26:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.590+0000 7f6a237fe700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.590+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6a30083d60 con 0x7f6a3c159890 2023-10-08T00:26:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.590+0000 7f6a3b7fe700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.591+0000 7f6a3b7fe700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c004de0 tx=0x7f6a2c000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.594+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a30050f80 con 0x7f6a3c159890 2023-10-08T00:26:02.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.831+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a3c04c3c0 con 0x7f6a3c159890 2023-10-08T00:26:02.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.831+0000 7f6a237fe700 1 -- 172.21.15.22:0/3934220567 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4600 (secure 0 0 0) 0x7f6a30017020 con 0x7f6a3c159890 2023-10-08T00:26:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:02.833 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":23,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4847,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3989004293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3989004293},{"type":"v1","addr":"172.21.15.192:6836","nonce":3989004293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:25:37.106452+0000","modified":"2023-10-08T00:25:40.729415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4923},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4923":{"gid":4923,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/685646696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":685646696},{"type":"v1","addr":"172.21.15.22:6834","nonce":685646696}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T00:26:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 msgr2=0x7f6a280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c004de0 tx=0x7f6a2c000bc0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 msgr2=0x7f6a3c0c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 0x7f6a3c0c97f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c7c0 tx=0x7f6a30007de0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 shutdown_connections 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a28066f30 0x7f6a280693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a3c159c60 0x7f6a3c154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3c069560 0x7f6a3c0b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 --2- 172.21.15.22:0/3934220567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a3c159890 0x7f6a3c0c97f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 >> 172.21.15.22:0/3934220567 conn(0x7f6a3c068e20 msgr2=0x7f6a3c1553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 shutdown_connections 2023-10-08T00:26:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.834+0000 7f6a41fd0700 1 -- 172.21.15.22:0/3934220567 wait complete. 2023-10-08T00:26:02.837 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 23 2023-10-08T00:26:02.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.964+0000 7f674f649700 1 Processor -- start 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.964+0000 7f674f649700 1 -- start start 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674f649700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f674806bcd0 0x7f67480caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674f649700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f674815e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674f649700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674815d7e0 con 0x7f674806c0a0 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674f649700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674815dac0 con 0x7f674806bcd0 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674f649700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674815aa30 con 0x7f674815df50 2023-10-08T00:26:02.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674d3e5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f674806bcd0 0x7f67480caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674cbe4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f674806c0a0 0x7f674815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38886/0 (socket says 172.21.15.22:38886) 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.965+0000 7f674cbe4700 1 -- 172.21.15.22:0/647251083 learned_addr learned my addr 172.21.15.22:0/647251083 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f674dbe6700 1 --2- 172.21.15.22:0/647251083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f674815e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f674d3e5700 1 -- 172.21.15.22:0/647251083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 msgr2=0x7f674815e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f674d3e5700 1 --2- 172.21.15.22:0/647251083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f674815e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f674d3e5700 1 -- 172.21.15.22:0/647251083 >> v1:172.21.15.22:6789/0 conn(0x7f674806c0a0 legacy=0x7f674815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f674d3e5700 1 -- 172.21.15.22:0/647251083 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674815ad10 con 0x7f674806bcd0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f6747fff700 1 -- 172.21.15.22:0/647251083 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222477835 0 0) 0x7f674815d7e0 con 0x7f674806c0a0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f674d3e5700 1 --2- 172.21.15.22:0/647251083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806bcd0 0x7f67480caa90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f67380098e0 tx=0x7f67380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257c31f3e376b4a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f6747fff700 1 -- 172.21.15.22:0/647251083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738009e80 con 0x7f674806bcd0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f6747fff700 1 -- 172.21.15.22:0/647251083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673800b860 con 0x7f674806bcd0 2023-10-08T00:26:02.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.966+0000 7f6747fff700 1 -- 172.21.15.22:0/647251083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800bbe0 con 0x7f674806bcd0 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 -- 172.21.15.22:0/647251083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806bcd0 msgr2=0x7f67480caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 --2- 172.21.15.22:0/647251083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806bcd0 0x7f67480caa90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f67380098e0 tx=0x7f67380091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 -- 172.21.15.22:0/647251083 shutdown_connections 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 --2- 172.21.15.22:0/647251083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f674815e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 --2- 172.21.15.22:0/647251083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806bcd0 0x7f67480caa90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 -- 172.21.15.22:0/647251083 >> 172.21.15.22:0/647251083 conn(0x7f67480ce600 msgr2=0x7f67480cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 -- 172.21.15.22:0/647251083 shutdown_connections 2023-10-08T00:26:02.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.967+0000 7f674f649700 1 -- 172.21.15.22:0/647251083 wait complete. 2023-10-08T00:26:02.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.968+0000 7f674f649700 1 Processor -- start 2023-10-08T00:26:02.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.968+0000 7f674f649700 1 -- start start 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674f649700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806bcd0 0x7f674814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674f649700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 0x7f674816dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674f649700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f67480b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674f649700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674814c9f0 con 0x7f674806c0a0 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674f649700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480c5ac0 con 0x7f674806bcd0 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674f649700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674816e680 con 0x7f674815df50 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 0x7f674816dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 0x7f674816dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35352/0 (socket says 172.21.15.22:35352) 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 -- 172.21.15.22:0/1866544285 learned_addr learned my addr 172.21.15.22:0/1866544285 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 -- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 msgr2=0x7f67480b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674d3e5700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806bcd0 0x7f674814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674dbe6700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f67480b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f67480b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 -- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806bcd0 msgr2=0x7f674814c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806bcd0 0x7f674814c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 -- 172.21.15.22:0/1866544285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738009420 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.969+0000 7f674cbe4700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 0x7f674816dda0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c5b0 tx=0x7f673c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.970+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c005b30 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.970+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c005c90 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.970+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674816e960 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.970+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c007300 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.970+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674816e2e0 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.971+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67480c5c70 con 0x7f674806c0a0 2023-10-08T00:26:02.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.971+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f673c01b3b0 con 0x7f674806c0a0 2023-10-08T00:26:02.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.971+0000 7f67457fa700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6734066f30 0x7f67340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:02.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.971+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f673c083ac0 con 0x7f674806c0a0 2023-10-08T00:26:02.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.972+0000 7f674d3e5700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6734066f30 0x7f67340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:02.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.972+0000 7f674d3e5700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6734066f30 0x7f67340693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6738003080 tx=0x7f6738017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:02.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:02.975+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67480c5c70 con 0x7f674806c0a0 2023-10-08T00:26:03.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.170+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67480c5c30 con 0x7f674806c0a0 2023-10-08T00:26:03.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.171+0000 7f67457fa700 1 -- 172.21.15.22:0/1866544285 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15481 (secure 0 0 0) 0x7f673c017090 con 0x7f674806c0a0 2023-10-08T00:26:03.172 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:03.172 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:25:59.283720+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:25:35.084666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T00:25:36.079099+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6836/1890171180":"2023-10-09T00:25:56.275754+0000","172.21.15.192:6834/1890171180":"2023-10-09T00:25:56.275754+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:03.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6734066f30 msgr2=0x7f67340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6734066f30 0x7f67340693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6738003080 tx=0x7f6738017000 comp rx=0 tx=0).stop 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 msgr2=0x7f674816dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 0x7f674816dda0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c5b0 tx=0x7f673c001070 comp rx=0 tx=0).stop 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 shutdown_connections 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6734066f30 0x7f67340693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f674815df50 0x7f67480b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f674806bcd0 0x7f674814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 --2- 172.21.15.22:0/1866544285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f674806c0a0 0x7f674816dda0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 >> 172.21.15.22:0/1866544285 conn(0x7f67480ce600 msgr2=0x7f674815ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 shutdown_connections 2023-10-08T00:26:03.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.173+0000 7f674f649700 1 -- 172.21.15.22:0/1866544285 wait complete. 2023-10-08T00:26:03.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:26:03.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 Processor -- start 2023-10-08T00:26:03.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 -- start start 2023-10-08T00:26:03.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f765406e570 0x7f7654156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f76540c90e0 0x7f7654156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765406f6f0 con 0x7f76540c8d10 2023-10-08T00:26:03.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7654156ca0 con 0x7f765406e570 2023-10-08T00:26:03.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.306+0000 7f76593aa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765406eae0 con 0x7f76540c90e0 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f765406e570 0x7f7654156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f765406e570 0x7f7654156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35368/0 (socket says 172.21.15.22:35368) 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 -- 172.21.15.22:0/740042911 learned_addr learned my addr 172.21.15.22:0/740042911 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f7658ba9700 1 --2- 172.21.15.22:0/740042911 >> v2:172.21.15.192:3300/0 conn(0x7f76540c90e0 0x7f7654156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 -- 172.21.15.22:0/740042911 >> v2:172.21.15.192:3300/0 conn(0x7f76540c90e0 msgr2=0x7f7654156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 --2- 172.21.15.22:0/740042911 >> v2:172.21.15.192:3300/0 conn(0x7f76540c90e0 0x7f7654156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 -- 172.21.15.22:0/740042911 >> v1:172.21.15.192:6789/0 conn(0x7f76540c8d10 legacy=0x7f765406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 -- 172.21.15.22:0/740042911 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765406edc0 con 0x7f765406e570 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f76537fe700 1 --2- 172.21.15.22:0/740042911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f7654156220 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f76540c42a0 tx=0x7f764800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d6cf1ada136c68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:03.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f7652ffd700 1 -- 172.21.15.22:0/740042911 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648005c10 con 0x7f765406e570 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f7652ffd700 1 -- 172.21.15.22:0/740042911 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648005d70 con 0x7f765406e570 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.307+0000 7f7652ffd700 1 -- 172.21.15.22:0/740042911 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800dbf0 con 0x7f765406e570 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 -- 172.21.15.22:0/740042911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 msgr2=0x7f7654156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 --2- 172.21.15.22:0/740042911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f7654156220 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f76540c42a0 tx=0x7f764800b4c0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 -- 172.21.15.22:0/740042911 shutdown_connections 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 --2- 172.21.15.22:0/740042911 >> v2:172.21.15.192:3300/0 conn(0x7f76540c90e0 0x7f7654156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 --2- 172.21.15.22:0/740042911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f7654156220 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 -- 172.21.15.22:0/740042911 >> 172.21.15.22:0/740042911 conn(0x7f765406b450 msgr2=0x7f76540cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 -- 172.21.15.22:0/740042911 shutdown_connections 2023-10-08T00:26:03.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.308+0000 7f76593aa700 1 -- 172.21.15.22:0/740042911 wait complete. 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.309+0000 7f76593aa700 1 Processor -- start 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.309+0000 7f76593aa700 1 -- start start 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76593aa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f76540c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76593aa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76540c8d10 0x7f7654153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76593aa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76540c90e0 0x7f76540c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76593aa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c4100 con 0x7f765406e570 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76593aa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c3880 con 0x7f76540c8d10 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76593aa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c2140 con 0x7f76540c90e0 2023-10-08T00:26:03.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f76540c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f76540c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35370/0 (socket says 172.21.15.22:35370) 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 -- 172.21.15.22:0/1343961398 learned_addr learned my addr 172.21.15.22:0/1343961398 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7658ba9700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76540c90e0 0x7f76540c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f76537fe700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76540c8d10 0x7f7654153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 -- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76540c90e0 msgr2=0x7f76540c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76540c90e0 0x7f76540c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 -- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76540c8d10 msgr2=0x7f7654153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76540c8d10 0x7f7654153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 -- 172.21.15.22:0/1343961398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764800b720 con 0x7f765406e570 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.310+0000 7f7653fff700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f76540c3230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f764400c600 tx=0x7f7644007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:03.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.311+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644011590 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.311+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644011710 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.311+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76540c1810 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.311+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644011ad0 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.311+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76540c1dd0 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.311+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765404c3c0 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.312+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f764401c460 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.312+0000 7f763bfff700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7640066f30 0x7f76400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.313+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7644084390 con 0x7f765406e570 2023-10-08T00:26:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.313+0000 7f76537fe700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7640066f30 0x7f76400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.313+0000 7f76537fe700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7640066f30 0x7f76400693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76540c42a0 tx=0x7f7648019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:03.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.317+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76440515b0 con 0x7f765406e570 2023-10-08T00:26:03.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.553+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f76540ac5d0 con 0x7f765406e570 2023-10-08T00:26:03.555 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:26:03.554+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:26:03.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.558+0000 7f763bfff700 1 -- 172.21.15.22:0/1343961398 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7644054bd0 con 0x7f765406e570 2023-10-08T00:26:03.560 INFO:tasks.ceph.mds.a.smithi022.stderr: -1210> 2023-10-08T00:25:40.680+0000 7f72b0d7d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7640066f30 msgr2=0x7f76400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7640066f30 0x7f76400693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76540c42a0 tx=0x7f7648019000 comp rx=0 tx=0).stop 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 msgr2=0x7f76540c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f76540c3230 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f764400c600 tx=0x7f7644007f60 comp rx=0 tx=0).stop 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 shutdown_connections 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7640066f30 0x7f76400693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f76540c90e0 0x7f76540c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f765406e570 0x7f76540c3230 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 --2- 172.21.15.22:0/1343961398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76540c8d10 0x7f7654153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 >> 172.21.15.22:0/1343961398 conn(0x7f765406b450 msgr2=0x7f76540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:03.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 shutdown_connections 2023-10-08T00:26:03.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.560+0000 7f76593aa700 1 -- 172.21.15.22:0/1343961398 wait complete. 2023-10-08T00:26:03.563 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:26:03.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:26:03.582 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:26:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.696+0000 7ff5a4ce1700 1 Processor -- start 2023-10-08T00:26:03.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.696+0000 7ff5a4ce1700 1 -- start start 2023-10-08T00:26:03.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff5a4ce1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a015d730 0x7ff5a015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff5a4ce1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff5a006a410 0x7ff5a006a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff5a4ce1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00c74b0 con 0x7ff5a0159b10 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff5a4ce1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a00c8700 con 0x7ff5a006a410 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff5a4ce1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00c9070 con 0x7ff5a015d730 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff59e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5a0159b10 0x7ff5a00cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38898/0 (socket says 172.21.15.22:38898) 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff59e59c700 1 -- 172.21.15.22:0/3320247993 learned_addr learned my addr 172.21.15.22:0/3320247993 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.697+0000 7ff59ed9d700 1 --2- 172.21.15.22:0/3320247993 >> v2:172.21.15.192:3300/0 conn(0x7ff5a006a410 0x7ff5a006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59dd9b700 1 --2- 172.21.15.22:0/3320247993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a015d730 0x7ff5a015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59d59a700 1 -- 172.21.15.22:0/3320247993 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377324381 0 0) 0x7ff5a00c74b0 con 0x7ff5a0159b10 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59d59a700 1 -- 172.21.15.22:0/3320247993 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff58c003570 con 0x7ff5a0159b10 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3320247993 >> v2:172.21.15.192:3300/0 conn(0x7ff5a006a410 msgr2=0x7ff5a006a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59dd9b700 1 --2- 172.21.15.22:0/3320247993 >> v2:172.21.15.192:3300/0 conn(0x7ff5a006a410 0x7ff5a006a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3320247993 >> v1:172.21.15.22:6789/0 conn(0x7ff5a0159b10 legacy=0x7ff5a00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3320247993 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a015e0e0 con 0x7ff5a015d730 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59ed9d700 1 --2- 172.21.15.22:0/3320247993 >> v2:172.21.15.192:3300/0 conn(0x7ff5a006a410 0x7ff5a006a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59dd9b700 1 --2- 172.21.15.22:0/3320247993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a015d730 0x7ff5a015dba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5880098e0 tx=0x7ff5880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=873c081dcf83c749 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59d59a700 1 -- 172.21.15.22:0/3320247993 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588011630 con 0x7ff5a015d730 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59d59a700 1 -- 172.21.15.22:0/3320247993 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff588011790 con 0x7ff5a015d730 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.698+0000 7ff59d59a700 1 -- 172.21.15.22:0/3320247993 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588011b30 con 0x7ff5a015d730 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3320247993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a015d730 msgr2=0x7ff5a015dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3320247993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a015d730 0x7ff5a015dba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5880098e0 tx=0x7ff5880091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3320247993 shutdown_connections 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3320247993 >> v2:172.21.15.192:3300/0 conn(0x7ff5a006a410 0x7ff5a006a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3320247993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a015d730 0x7ff5a015dba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3320247993 >> 172.21.15.22:0/3320247993 conn(0x7ff5a00c9870 msgr2=0x7ff5a00c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3320247993 shutdown_connections 2023-10-08T00:26:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.699+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3320247993 wait complete. 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.700+0000 7ff5a4ce1700 1 Processor -- start 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.700+0000 7ff5a4ce1700 1 -- start start 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff5a4ce1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a006a410 0x7ff5a00c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff5a4ce1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 0x7ff5a0157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff5a4ce1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5a015d730 0x7ff5a0158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff5a4ce1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a016b6b0 con 0x7ff5a0159b10 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff5a4ce1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00c7dd0 con 0x7ff5a015d730 2023-10-08T00:26:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff5a4ce1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b1830 con 0x7ff5a006a410 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 0x7ff5a0157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 0x7ff5a0157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35388/0 (socket says 172.21.15.22:35388) 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3625757477 learned_addr learned my addr 172.21.15.22:0/3625757477 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59ed9d700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5a015d730 0x7ff5a0158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59e59c700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a006a410 0x7ff5a00c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a006a410 msgr2=0x7ff5a00c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a006a410 0x7ff5a00c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5a015d730 msgr2=0x7ff5a0158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5a015d730 0x7ff5a0158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 -- 172.21.15.22:0/3625757477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009420 con 0x7ff5a0159b10 2023-10-08T00:26:03.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59ed9d700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5a015d730 0x7ff5a0158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.701+0000 7ff59dd9b700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 0x7ff5a0157e20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00ca860 tx=0x7ff588017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.702+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588011b10 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.702+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5880253f0 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.702+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff588009420 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.702+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880257b0 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.702+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a016b060 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.703+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a004c3c0 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.703+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff588025ba0 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.703+0000 7ff5967fc700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff580066f30 0x7ff5800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.704+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5877+0+0 (secure 0 0 0) 0x7ff588085f10 con 0x7ff5a0159b10 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.704+0000 7ff59e59c700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff580066f30 0x7ff5800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.704+0000 7ff59e59c700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff580066f30 0x7ff5800693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff598005c50 tx=0x7ff598009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:03.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.708+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5880530d0 con 0x7ff5a0159b10 2023-10-08T00:26:03.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:03.945+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff5a016b7f0 con 0x7ff5a0159b10 2023-10-08T00:26:04.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.558+0000 7ff5967fc700 1 -- 172.21.15.22:0/3625757477 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff5880566f0 con 0x7ff5a0159b10 2023-10-08T00:26:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff580066f30 msgr2=0x7ff5800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff580066f30 0x7ff5800693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff598005c50 tx=0x7ff598009040 comp rx=0 tx=0).stop 2023-10-08T00:26:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 msgr2=0x7ff5a0157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 0x7ff5a0157e20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00ca860 tx=0x7ff588017000 comp rx=0 tx=0).stop 2023-10-08T00:26:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 shutdown_connections 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5a015d730 0x7ff5a0158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff580066f30 0x7ff5800693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5a006a410 0x7ff5a00c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 --2- 172.21.15.22:0/3625757477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5a0159b10 0x7ff5a0157e20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 >> 172.21.15.22:0/3625757477 conn(0x7ff5a00c9870 msgr2=0x7ff5a0154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.561+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 shutdown_connections 2023-10-08T00:26:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.562+0000 7ff5a4ce1700 1 -- 172.21.15.22:0/3625757477 wait complete. 2023-10-08T00:26:04.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:26:04.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.743+0000 7fb6807c4700 1 Processor -- start 2023-10-08T00:26:04.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.743+0000 7fb6807c4700 1 -- start start 2023-10-08T00:26:04.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.744+0000 7fb6807c4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb67806ab40 0x7fb6780699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.744+0000 7fb6807c4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb678068390 0x7fb6780c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.744+0000 7fb6807c4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6780af8c0 0x7fb6780c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.744+0000 7fb6807c4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780c1b40 con 0x7fb67806ab40 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.744+0000 7fb6807c4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb678068900 con 0x7fb678068390 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.744+0000 7fb6807c4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb678068be0 con 0x7fb6780af8c0 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb67806ab40 0x7fb6780699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb67806ab40 0x7fb6780699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35400/0 (socket says 172.21.15.22:35400) 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 -- 172.21.15.22:0/2853643055 learned_addr learned my addr 172.21.15.22:0/2853643055 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67ed61700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6780af8c0 0x7fb6780c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67dd5f700 1 --2- 172.21.15.22:0/2853643055 >> v2:172.21.15.192:3300/0 conn(0x7fb678068390 0x7fb6780c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 -- 172.21.15.22:0/2853643055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6780af8c0 msgr2=0x7fb6780c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6780af8c0 0x7fb6780c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 -- 172.21.15.22:0/2853643055 >> v2:172.21.15.192:3300/0 conn(0x7fb678068390 msgr2=0x7fb6780c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:04.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 --2- 172.21.15.22:0/2853643055 >> v2:172.21.15.192:3300/0 conn(0x7fb678068390 0x7fb6780c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 -- 172.21.15.22:0/2853643055 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb678068ec0 con 0x7fb67806ab40 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67ed61700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6780af8c0 0x7fb6780c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67dd5f700 1 --2- 172.21.15.22:0/2853643055 >> v2:172.21.15.192:3300/0 conn(0x7fb678068390 0x7fb6780c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67e560700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb67806ab40 0x7fb6780699a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb67806a5e0 tx=0x7fb668009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d201a0dc09cc7b7f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67d55e700 1 -- 172.21.15.22:0/2853643055 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66800e070 con 0x7fb67806ab40 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67d55e700 1 -- 172.21.15.22:0/2853643055 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66800bae0 con 0x7fb67806ab40 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.745+0000 7fb67d55e700 1 -- 172.21.15.22:0/2853643055 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680092e0 con 0x7fb67806ab40 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 -- 172.21.15.22:0/2853643055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb67806ab40 msgr2=0x7fb6780699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb67806ab40 0x7fb6780699a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb67806a5e0 tx=0x7fb668009840 comp rx=0 tx=0).stop 2023-10-08T00:26:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 -- 172.21.15.22:0/2853643055 shutdown_connections 2023-10-08T00:26:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb67806ab40 0x7fb6780699a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 --2- 172.21.15.22:0/2853643055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6780af8c0 0x7fb6780c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 --2- 172.21.15.22:0/2853643055 >> v2:172.21.15.192:3300/0 conn(0x7fb678068390 0x7fb6780c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 -- 172.21.15.22:0/2853643055 >> 172.21.15.22:0/2853643055 conn(0x7fb6780cd640 msgr2=0x7fb6780cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 -- 172.21.15.22:0/2853643055 shutdown_connections 2023-10-08T00:26:04.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.746+0000 7fb6807c4700 1 -- 172.21.15.22:0/2853643055 wait complete. 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.747+0000 7fb6807c4700 1 Processor -- start 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.747+0000 7fb6807c4700 1 -- start start 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb678068390 0x7fb678147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb67806ab40 0x7fb67815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 0x7fb6781593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678148030 con 0x7fb6780af8c0 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6781600e0 con 0x7fb67806ab40 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb678160570 con 0x7fb678068390 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 0x7fb6781593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 0x7fb6781593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35408/0 (socket says 172.21.15.22:35408) 2023-10-08T00:26:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 -- 172.21.15.22:0/1055881805 learned_addr learned my addr 172.21.15.22:0/1055881805 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67e560700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb678068390 0x7fb678147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67dd5f700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb67806ab40 0x7fb67815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 -- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb678068390 msgr2=0x7fb678147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb678068390 0x7fb678147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 -- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb67806ab40 msgr2=0x7fb67815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb67806ab40 0x7fb67815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 -- 172.21.15.22:0/1055881805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb668009ae0 con 0x7fb6780af8c0 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb67ed61700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 0x7fb6781593f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb67000d8c0 tx=0x7fb670008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700095b0 con 0x7fb6780af8c0 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb670009710 con 0x7fb6780af8c0 2023-10-08T00:26:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67815f4d0 con 0x7fb6780af8c0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.748+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb670009ab0 con 0x7fb6780af8c0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.749+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67815fa90 con 0x7fb6780af8c0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.749+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb678160270 con 0x7fb6780af8c0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.750+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb670014430 con 0x7fb6780af8c0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.750+0000 7fb6767fc700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb664066f30 0x7fb6640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.750+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fb6700849e0 con 0x7fb6780af8c0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.750+0000 7fb67e560700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb664066f30 0x7fb6640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.751+0000 7fb67e560700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb664066f30 0x7fb6640693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb668009ab0 tx=0x7fb668018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:04.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.755+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb670051b00 con 0x7fb6780af8c0 2023-10-08T00:26:04.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:04.948+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6780718b0 con 0x7fb6780af8c0 2023-10-08T00:26:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.564+0000 7fb6767fc700 1 -- 172.21.15.22:0/1055881805 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb670055120 con 0x7fb6780af8c0 2023-10-08T00:26:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.569+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb664066f30 msgr2=0x7fb6640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.569+0000 7fb6807c4700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb664066f30 0x7fb6640693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb668009ab0 tx=0x7fb668018000 comp rx=0 tx=0).stop 2023-10-08T00:26:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.569+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 msgr2=0x7fb6781593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.569+0000 7fb6807c4700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 0x7fb6781593f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb67000d8c0 tx=0x7fb670008040 comp rx=0 tx=0).stop 2023-10-08T00:26:05.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 shutdown_connections 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6780af8c0 0x7fb6781593f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb664066f30 0x7fb6640693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb678068390 0x7fb678147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 --2- 172.21.15.22:0/1055881805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb67806ab40 0x7fb67815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 >> 172.21.15.22:0/1055881805 conn(0x7fb6780cd640 msgr2=0x7fb6780c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 shutdown_connections 2023-10-08T00:26:05.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.570+0000 7fb6807c4700 1 -- 172.21.15.22:0/1055881805 wait complete. 2023-10-08T00:26:05.573 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:26:05.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:26:05.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.712+0000 7f0ff8ec2700 1 Processor -- start 2023-10-08T00:26:05.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.712+0000 7f0ff8ec2700 1 -- start start 2023-10-08T00:26:05.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff8ec2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff41597b0 0x7f0ff40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff8ec2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0ff4159b80 0x7f0ff406a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff8ec2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0ff406a7f0 0x7f0ff4068d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff8ec2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff4068390 con 0x7f0ff4159b80 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff8ec2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff40ac530 con 0x7f0ff406a7f0 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff8ec2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff406ac30 con 0x7f0ff41597b0 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0ff4159b80 0x7f0ff406a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.713+0000 7f0ff1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0ff4159b80 0x7f0ff406a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35416/0 (socket says 172.21.15.22:35416) 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/961225832 learned_addr learned my addr 172.21.15.22:0/961225832 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff2d9d700 1 --2- 172.21.15.22:0/961225832 >> v2:172.21.15.192:3300/0 conn(0x7f0ff406a7f0 0x7f0ff4068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff259c700 1 --2- 172.21.15.22:0/961225832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff41597b0 0x7f0ff40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/961225832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff41597b0 msgr2=0x7f0ff40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 --2- 172.21.15.22:0/961225832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff41597b0 0x7f0ff40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/961225832 >> v2:172.21.15.192:3300/0 conn(0x7f0ff406a7f0 msgr2=0x7f0ff4068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 --2- 172.21.15.22:0/961225832 >> v2:172.21.15.192:3300/0 conn(0x7f0ff406a7f0 0x7f0ff4068d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/961225832 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40aa680 con 0x7f0ff4159b80 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff1d9b700 1 --2- 172.21.15.22:0/961225832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff4159b80 0x7f0ff406a2b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40aad50 tx=0x7f0fdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9600d501c96840d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff159a700 1 -- 172.21.15.22:0/961225832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00b820 con 0x7f0ff4159b80 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff159a700 1 -- 172.21.15.22:0/961225832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc00b980 con 0x7f0ff4159b80 2023-10-08T00:26:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.714+0000 7f0ff159a700 1 -- 172.21.15.22:0/961225832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc00bd20 con 0x7f0ff4159b80 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/961225832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff4159b80 msgr2=0x7f0ff406a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/961225832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff4159b80 0x7f0ff406a2b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40aad50 tx=0x7f0fdc009250 comp rx=0 tx=0).stop 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/961225832 shutdown_connections 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/961225832 >> v2:172.21.15.192:3300/0 conn(0x7f0ff406a7f0 0x7f0ff4068d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/961225832 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff41597b0 0x7f0ff40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/961225832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff4159b80 0x7f0ff406a2b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/961225832 >> 172.21.15.22:0/961225832 conn(0x7f0ff40cd880 msgr2=0x7f0ff40ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/961225832 shutdown_connections 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.715+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/961225832 wait complete. 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.716+0000 7f0ff8ec2700 1 Processor -- start 2023-10-08T00:26:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.716+0000 7f0ff8ec2700 1 -- start start 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff406a7f0 0x7f0ff4155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 0x7f0ff415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ff4159b80 0x7f0ff415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4155990 con 0x7f0ff41597b0 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40b1190 con 0x7f0ff4159b80 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40b1470 con 0x7f0ff406a7f0 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 0x7f0ff415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 0x7f0ff415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35426/0 (socket says 172.21.15.22:35426) 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/4106148448 learned_addr learned my addr 172.21.15.22:0/4106148448 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff259c700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff406a7f0 0x7f0ff4155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff2d9d700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ff4159b80 0x7f0ff415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff406a7f0 msgr2=0x7f0ff4155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff406a7f0 0x7f0ff4155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ff4159b80 msgr2=0x7f0ff415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ff4159b80 0x7f0ff415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 -- 172.21.15.22:0/4106148448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0094f0 con 0x7f0ff41597b0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff1d9b700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 0x7f0ff415a1b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0094c0 tx=0x7f0fdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc01a450 con 0x7f0ff41597b0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc01a5d0 con 0x7f0ff41597b0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff40b1750 con 0x7f0ff41597b0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc01a990 con 0x7f0ff41597b0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.717+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff4169b10 con 0x7f0ff41597b0 2023-10-08T00:26:05.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.718+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff4169d80 con 0x7f0ff41597b0 2023-10-08T00:26:05.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.719+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fdc025440 con 0x7f0ff41597b0 2023-10-08T00:26:05.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.719+0000 7f0fea7fc700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0fd4066f30 0x7f0fd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:05.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.719+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5439+0+0 (secure 0 0 0) 0x7f0fdc085fc0 con 0x7f0ff41597b0 2023-10-08T00:26:05.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.720+0000 7f0ff259c700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0fd4066f30 0x7f0fd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.720+0000 7f0ff259c700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0fd4066f30 0x7f0fd40693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40075a0 tx=0x7f0fe40097a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.724+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0fdc0b75a0 con 0x7f0ff41597b0 2023-10-08T00:26:05.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:05.918+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ff40718b0 con 0x7f0ff41597b0 2023-10-08T00:26:06.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.569+0000 7f0fea7fc700 1 -- 172.21.15.22:0/4106148448 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ff4169d80 con 0x7f0ff41597b0 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0fd4066f30 msgr2=0x7f0fd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0fd4066f30 0x7f0fd40693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40075a0 tx=0x7f0fe40097a0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 msgr2=0x7f0ff415a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 0x7f0ff415a1b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc0094c0 tx=0x7f0fdc017000 comp rx=0 tx=0).stop 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 shutdown_connections 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ff4159b80 0x7f0ff415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0fd4066f30 0x7f0fd40693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0ff406a7f0 0x7f0ff4155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 --2- 172.21.15.22:0/4106148448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ff41597b0 0x7f0ff415a1b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 >> 172.21.15.22:0/4106148448 conn(0x7f0ff40cd880 msgr2=0x7f0ff4157220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 shutdown_connections 2023-10-08T00:26:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.577+0000 7f0ff8ec2700 1 -- 172.21.15.22:0/4106148448 wait complete. 2023-10-08T00:26:06.580 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:26:06.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:26:06.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.713+0000 7ff14f59e700 1 Processor -- start 2023-10-08T00:26:06.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.713+0000 7ff14f59e700 1 -- start start 2023-10-08T00:26:06.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 0x7ff1500ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff1500b1b40 0x7ff15015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14f59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1500cfb00 con 0x7ff1500b16d0 2023-10-08T00:26:06.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1500b5c40 con 0x7ff1500b1b40 2023-10-08T00:26:06.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b5f20 con 0x7ff1500b4e70 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14dd9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff1500b16d0 0x7ff15015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59298/0 (socket says 172.21.15.22:59298) 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14dd9b700 1 -- 172.21.15.22:0/364838939 learned_addr learned my addr 172.21.15.22:0/364838939 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406669672 0 0) 0x7ff1500cfb00 con 0x7ff1500b16d0 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14e59c700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 0x7ff1500ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff13c003570 con 0x7ff1500b16d0 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/364838939 >> v2:172.21.15.192:3300/0 conn(0x7ff1500b1b40 0x7ff15015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.714+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752482750 0 0) 0x7ff13c003570 con 0x7ff1500b16d0 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 msgr2=0x7ff1500ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 0x7ff1500ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 >> v2:172.21.15.192:3300/0 conn(0x7ff1500b1b40 msgr2=0x7ff15015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 --2- 172.21.15.22:0/364838939 >> v2:172.21.15.192:3300/0 conn(0x7ff1500b1b40 0x7ff15015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500b6200 con 0x7ff1500b16d0 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7ff138001470 con 0x7ff1500b16d0 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 >> v1:172.21.15.22:6789/0 conn(0x7ff1500b16d0 legacy=0x7ff15015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 0x7ff13c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff13c003fe0 0x7ff13c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b5c40 con 0x7ff13c004d50 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b5f20 con 0x7ff13c003fe0 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c00ba90 con 0x7ff1500b4e70 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14e59c700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 0x7ff13c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14dd9b700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff13c003fe0 0x7ff13c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 -- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 msgr2=0x7ff13c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1500b4e70 0x7ff13c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 -- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff13c003fe0 msgr2=0x7ff13c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff13c003fe0 0x7ff13c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 -- 172.21.15.22:0/364838939 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c003570 con 0x7ff13c004d50 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff148009c00 tx=0x7ff1480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46619b8a4b04330 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800e6b0 con 0x7ff13c004d50 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14800e810 con 0x7ff13c004d50 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.715+0000 7ff14d59a700 1 -- 172.21.15.22:0/364838939 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800ebd0 con 0x7ff13c004d50 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14f59e700 1 -- 172.21.15.22:0/364838939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 msgr2=0x7ff13c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14f59e700 1 --2- 172.21.15.22:0/364838939 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff13c0051c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff148009c00 tx=0x7ff1480091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14ed9d700 1 -- 172.21.15.22:0/364838939 reap_dead start 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14f59e700 1 -- 172.21.15.22:0/364838939 shutdown_connections 2023-10-08T00:26:06.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14f59e700 1 -- 172.21.15.22:0/364838939 >> 172.21.15.22:0/364838939 conn(0x7ff1500d10c0 msgr2=0x7ff1500affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:06.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14f59e700 1 -- 172.21.15.22:0/364838939 shutdown_connections 2023-10-08T00:26:06.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.716+0000 7ff14f59e700 1 -- 172.21.15.22:0/364838939 wait complete. 2023-10-08T00:26:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.717+0000 7ff14f59e700 1 Processor -- start 2023-10-08T00:26:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.717+0000 7ff14f59e700 1 -- start start 2023-10-08T00:26:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff150151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150069710 0x7ff15016cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff150069b80 0x7ff15016d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14f59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150068420 con 0x7ff13c004d50 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150069280 con 0x7ff150069710 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff150068670 con 0x7ff150069b80 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff150151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff150151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37478/0 (socket says 172.21.15.22:37478) 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 -- 172.21.15.22:0/589188904 learned_addr learned my addr 172.21.15.22:0/589188904 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14dd9b700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150069710 0x7ff15016cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff150069b80 0x7ff15016d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 -- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff150069b80 msgr2=0x7ff15016d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff150069b80 0x7ff15016d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 -- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150069710 msgr2=0x7ff15016cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150069710 0x7ff15016cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14e59c700 1 -- 172.21.15.22:0/589188904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150068950 con 0x7ff13c004d50 2023-10-08T00:26:06.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.718+0000 7ff14ed9d700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff150069b80 0x7ff15016d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.719+0000 7ff14e59c700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff150151c70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff140011f00 tx=0x7ff14000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.719+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000e040 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.719+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14000f040 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.719+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff150068c30 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.719+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140015430 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.719+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1500af960 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.720+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff150088990 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.720+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff140015860 con 0x7ff13c004d50 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.721+0000 7ff1467fc700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff130066f30 0x7ff1300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:06.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.721+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff140084ed0 con 0x7ff13c004d50 2023-10-08T00:26:06.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.721+0000 7ff14dd9b700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff130066f30 0x7ff1300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:06.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.721+0000 7ff14dd9b700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff130066f30 0x7ff1300693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff138001d20 tx=0x7ff138001e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:06.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.725+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1400523e0 con 0x7ff13c004d50 2023-10-08T00:26:06.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.918+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff15004bb80 con 0x7ff13c004d50 2023-10-08T00:26:06.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.921+0000 7ff1467fc700 1 -- 172.21.15.22:0/589188904 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff140055a00 con 0x7ff13c004d50 2023-10-08T00:26:06.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff130066f30 msgr2=0x7ff1300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff130066f30 0x7ff1300693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff138001d20 tx=0x7ff138001e90 comp rx=0 tx=0).stop 2023-10-08T00:26:06.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 msgr2=0x7ff150151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:06.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff150151c70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff140011f00 tx=0x7ff14000b040 comp rx=0 tx=0).stop 2023-10-08T00:26:06.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 shutdown_connections 2023-10-08T00:26:06.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff130066f30 0x7ff1300693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff150069b80 0x7ff15016d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff13c004d50 0x7ff150151c70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 --2- 172.21.15.22:0/589188904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150069710 0x7ff15016cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:06.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.923+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 >> 172.21.15.22:0/589188904 conn(0x7ff1500d10c0 msgr2=0x7ff150159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:06.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.924+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 shutdown_connections 2023-10-08T00:26:06.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:06.924+0000 7ff14f59e700 1 -- 172.21.15.22:0/589188904 wait complete. 2023-10-08T00:26:06.937 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-08T00:26:07.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.056+0000 7f098959c700 1 Processor -- start 2023-10-08T00:26:07.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.056+0000 7f098959c700 1 -- start start 2023-10-08T00:26:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f098959c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f09841597f0 0x7f09840b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f098959c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f098415d230 0x7f098415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f098959c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098415db70 con 0x7f0984159420 2023-10-08T00:26:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f098959c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840b11d0 con 0x7f09841597f0 2023-10-08T00:26:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f098959c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840b14b0 con 0x7f098415d230 2023-10-08T00:26:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f09837fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f09841597f0 0x7f09840b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f0983fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0984159420 0x7f09840b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59312/0 (socket says 172.21.15.22:59312) 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f09837fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f09841597f0 0x7f09840b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37490/0 (socket says 172.21.15.22:37490) 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.057+0000 7f0983fff700 1 -- 172.21.15.22:0/2491929890 learned_addr learned my addr 172.21.15.22:0/2491929890 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f09837fe700 1 -- 172.21.15.22:0/2491929890 >> v2:172.21.15.192:3300/0 conn(0x7f098415d230 msgr2=0x7f098415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f09837fe700 1 --2- 172.21.15.22:0/2491929890 >> v2:172.21.15.192:3300/0 conn(0x7f098415d230 0x7f098415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f09837fe700 1 -- 172.21.15.22:0/2491929890 >> v1:172.21.15.22:6789/0 conn(0x7f0984159420 legacy=0x7f09840b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f09837fe700 1 -- 172.21.15.22:0/2491929890 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840b1790 con 0x7f09841597f0 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f0982ffd700 1 -- 172.21.15.22:0/2491929890 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416458882 0 0) 0x7f098415db70 con 0x7f0984159420 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f09837fe700 1 --2- 172.21.15.22:0/2491929890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f09841597f0 0x7f09840b2270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f098415d170 tx=0x7f096c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46467e1a631c59f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f0982ffd700 1 -- 172.21.15.22:0/2491929890 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00b6b0 con 0x7f09841597f0 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f0982ffd700 1 -- 172.21.15.22:0/2491929890 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00b810 con 0x7f09841597f0 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f0982ffd700 1 -- 172.21.15.22:0/2491929890 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00bbb0 con 0x7f09841597f0 2023-10-08T00:26:07.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f098959c700 1 -- 172.21.15.22:0/2491929890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f09841597f0 msgr2=0x7f09840b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.058+0000 7f098959c700 1 --2- 172.21.15.22:0/2491929890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f09841597f0 0x7f09840b2270 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f098415d170 tx=0x7f096c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.059+0000 7f098959c700 1 -- 172.21.15.22:0/2491929890 shutdown_connections 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.059+0000 7f098959c700 1 --2- 172.21.15.22:0/2491929890 >> v2:172.21.15.192:3300/0 conn(0x7f098415d230 0x7f098415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.059+0000 7f098959c700 1 --2- 172.21.15.22:0/2491929890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f09841597f0 0x7f09840b2270 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.059+0000 7f098959c700 1 -- 172.21.15.22:0/2491929890 >> 172.21.15.22:0/2491929890 conn(0x7f09840d0660 msgr2=0x7f09840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.059+0000 7f098959c700 1 -- 172.21.15.22:0/2491929890 shutdown_connections 2023-10-08T00:26:07.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.059+0000 7f098959c700 1 -- 172.21.15.22:0/2491929890 wait complete. 2023-10-08T00:26:07.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.060+0000 7f098959c700 1 Processor -- start 2023-10-08T00:26:07.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.060+0000 7f098959c700 1 -- start start 2023-10-08T00:26:07.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0984159420 0x7f098415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09841597f0 0x7f0984158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 0x7f09840c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098415bbc0 con 0x7f098415d230 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c6bc0 con 0x7f0984159420 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c6ea0 con 0x7f09841597f0 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 0x7f09840c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 0x7f09840c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37506/0 (socket says 172.21.15.22:37506) 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 -- 172.21.15.22:0/705667791 learned_addr learned my addr 172.21.15.22:0/705667791 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0983fff700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0984159420 0x7f098415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f09837fe700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09841597f0 0x7f0984158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 -- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09841597f0 msgr2=0x7f0984158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09841597f0 0x7f0984158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 -- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0984159420 msgr2=0x7f098415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0984159420 0x7f098415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 -- 172.21.15.22:0/705667791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c009420 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f0988d9b700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 0x7f09840c5400 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bc30 tx=0x7f097c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0092e0 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00c7a0 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00cb80 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09840c7180 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.061+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09840c7740 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.062+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098404c3c0 con 0x7f098415d230 2023-10-08T00:26:07.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.063+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f097c012070 con 0x7f098415d230 2023-10-08T00:26:07.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.063+0000 7f097bfff700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.063+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f097c083ff0 con 0x7f098415d230 2023-10-08T00:26:07.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.063+0000 7f0983fff700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.064+0000 7f0983fff700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0964066f30 0x7f09640693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09740011e0 tx=0x7f0974009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:07.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.067+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f097c051460 con 0x7f098415d230 2023-10-08T00:26:07.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.339+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f09840b1a70 con 0x7f098415d230 2023-10-08T00:26:07.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.570+0000 7f097bfff700 1 -- 172.21.15.22:0/705667791 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v88) v1 ==== 135+0+0 (secure 0 0 0) 0x7f097c054a80 con 0x7f098415d230 2023-10-08T00:26:07.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0964066f30 msgr2=0x7f09640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0964066f30 0x7f09640693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09740011e0 tx=0x7f0974009040 comp rx=0 tx=0).stop 2023-10-08T00:26:07.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 msgr2=0x7f09840c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 0x7f09840c5400 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f097c00bc30 tx=0x7f097c009840 comp rx=0 tx=0).stop 2023-10-08T00:26:07.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 shutdown_connections 2023-10-08T00:26:07.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f098415d230 0x7f09840c5400 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0984159420 0x7f098415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 --2- 172.21.15.22:0/705667791 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f09841597f0 0x7f0984158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 >> 172.21.15.22:0/705667791 conn(0x7f09840d0660 msgr2=0x7f0984155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 shutdown_connections 2023-10-08T00:26:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.572+0000 7f098959c700 1 -- 172.21.15.22:0/705667791 wait complete. 2023-10-08T00:26:07.587 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-10-08T00:26:07.587 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-10-08T00:26:07.587 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:26:07.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-08T00:26:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.710+0000 7fc140b14700 1 Processor -- start 2023-10-08T00:26:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.710+0000 7fc140b14700 1 -- start start 2023-10-08T00:26:07.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc140b14700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc13c06e8c0 0x7fc13c0c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc140b14700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c15aa30 con 0x7fc13c0c8660 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc140b14700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13c0c8a60 con 0x7fc13c153df0 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc140b14700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13c15a100 con 0x7fc13c06e8c0 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc13affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc13c06e8c0 0x7fc13c0c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc13bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc13c0c8660 0x7fc13c0b0bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59328/0 (socket says 172.21.15.22:59328) 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.711+0000 7fc13bfff700 1 -- 172.21.15.22:0/100314221 learned_addr learned my addr 172.21.15.22:0/100314221 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13affd700 1 -- 172.21.15.22:0/100314221 >> v1:172.21.15.192:6789/0 conn(0x7fc13c153df0 legacy=0x7fc13c063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13affd700 1 -- 172.21.15.22:0/100314221 >> v1:172.21.15.22:6789/0 conn(0x7fc13c0c8660 legacy=0x7fc13c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13affd700 1 -- 172.21.15.22:0/100314221 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c15a3e0 con 0x7fc13c06e8c0 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13a7fc700 1 -- 172.21.15.22:0/100314221 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972889907 0 0) 0x7fc13c15aa30 con 0x7fc13c0c8660 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13affd700 1 --2- 172.21.15.22:0/100314221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c06e8c0 0x7fc13c0c8120 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098e0 tx=0x7fc1300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefdf277c87ee380 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13a7fc700 1 -- 172.21.15.22:0/100314221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc130009e80 con 0x7fc13c06e8c0 2023-10-08T00:26:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13a7fc700 1 -- 172.21.15.22:0/100314221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13000b820 con 0x7fc13c06e8c0 2023-10-08T00:26:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.712+0000 7fc13a7fc700 1 -- 172.21.15.22:0/100314221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000bba0 con 0x7fc13c06e8c0 2023-10-08T00:26:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 -- 172.21.15.22:0/100314221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c06e8c0 msgr2=0x7fc13c0c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 --2- 172.21.15.22:0/100314221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c06e8c0 0x7fc13c0c8120 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc1300098e0 tx=0x7fc1300091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 -- 172.21.15.22:0/100314221 shutdown_connections 2023-10-08T00:26:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 --2- 172.21.15.22:0/100314221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c06e8c0 0x7fc13c0c8120 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 -- 172.21.15.22:0/100314221 >> 172.21.15.22:0/100314221 conn(0x7fc13c06ddb0 msgr2=0x7fc13c06e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 -- 172.21.15.22:0/100314221 shutdown_connections 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.713+0000 7fc140b14700 1 -- 172.21.15.22:0/100314221 wait complete. 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.714+0000 7fc140b14700 1 Processor -- start 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.714+0000 7fc140b14700 1 -- start start 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc13c06e8c0 0x7fc13c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 0x7fc13c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc13c153df0 0x7fc13c1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c157800 con 0x7fc13c0c8660 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c1566b0 con 0x7fc13c06e8c0 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c156990 con 0x7fc13c153df0 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 0x7fc13c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 0x7fc13c15bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37526/0 (socket says 172.21.15.22:37526) 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 -- 172.21.15.22:0/4158779234 learned_addr learned my addr 172.21.15.22:0/4158779234 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 -- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc13c153df0 msgr2=0x7fc13c1541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13b7fe700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc13c06e8c0 0x7fc13c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13bfff700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc13c153df0 0x7fc13c1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc13c153df0 0x7fc13c1541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 -- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc13c06e8c0 msgr2=0x7fc13c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc13c06e8c0 0x7fc13c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 -- 172.21.15.22:0/4158779234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc130009420 con 0x7fc13c0c8660 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13b7fe700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc13c06e8c0 0x7fc13c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13bfff700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc13c153df0 0x7fc13c1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc13affd700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 0x7fc13c15bd40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc1300030c0 tx=0x7fc130016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:07.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13000ba10 con 0x7fc13c0c8660 2023-10-08T00:26:07.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc130020070 con 0x7fc13c0c8660 2023-10-08T00:26:07.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c156c70 con 0x7fc13c0c8660 2023-10-08T00:26:07.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.715+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13001b6a0 con 0x7fc13c0c8660 2023-10-08T00:26:07.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.716+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c157230 con 0x7fc13c0c8660 2023-10-08T00:26:07.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.716+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c04c3c0 con 0x7fc13c0c8660 2023-10-08T00:26:07.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.717+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc130022030 con 0x7fc13c0c8660 2023-10-08T00:26:07.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.717+0000 7fc1237fe700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc128066f30 0x7fc1280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:07.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.717+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc1300862b0 con 0x7fc13c0c8660 2023-10-08T00:26:07.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.718+0000 7fc13b7fe700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc128066f30 0x7fc1280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:07.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.718+0000 7fc13b7fe700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc128066f30 0x7fc1280693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006fd0 tx=0x7fc12c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:07.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.722+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1300537c0 con 0x7fc13c0c8660 2023-10-08T00:26:07.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:07.993+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7fc13c04c3c0 con 0x7fc13c0c8660 2023-10-08T00:26:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.574+0000 7fc1237fe700 1 -- 172.21.15.22:0/4158779234 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v89) v1 ==== 136+0+0 (secure 0 0 0) 0x7fc130023e60 con 0x7fc13c0c8660 2023-10-08T00:26:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.576+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc128066f30 msgr2=0x7fc1280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.576+0000 7fc140b14700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc128066f30 0x7fc1280693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006fd0 tx=0x7fc12c008040 comp rx=0 tx=0).stop 2023-10-08T00:26:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.576+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 msgr2=0x7fc13c15bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.576+0000 7fc140b14700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 0x7fc13c15bd40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc1300030c0 tx=0x7fc130016000 comp rx=0 tx=0).stop 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.576+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 shutdown_connections 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc128066f30 0x7fc1280693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc13c153df0 0x7fc13c1541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc13c06e8c0 0x7fc13c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 --2- 172.21.15.22:0/4158779234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc13c0c8660 0x7fc13c15bd40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 >> 172.21.15.22:0/4158779234 conn(0x7fc13c06ddb0 msgr2=0x7fc13c0c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 shutdown_connections 2023-10-08T00:26:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.577+0000 7fc140b14700 1 -- 172.21.15.22:0/4158779234 wait complete. 2023-10-08T00:26:08.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:26:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.715+0000 7f2717e70700 1 Processor -- start 2023-10-08T00:26:08.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.716+0000 7f2717e70700 1 -- start start 2023-10-08T00:26:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.716+0000 7f2717e70700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 0x7f271006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.716+0000 7f2717e70700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 0x7f27100c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.716+0000 7f2717e70700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271006bdb0 con 0x7f27100c81f0 2023-10-08T00:26:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.716+0000 7f2717e70700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27100c8670 con 0x7f2710069d60 2023-10-08T00:26:08.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.716+0000 7f2717e70700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27100cb370 con 0x7f27100aca80 2023-10-08T00:26:08.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f271540b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 0x7f27100c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:08.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 0x7f271006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 0x7f271006aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:53610/0 (socket says 172.21.15.22:53610) 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f271540b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 0x7f27100c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:32784/0 (socket says 172.21.15.22:32784) 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f271640d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f27100c81f0 0x7f2710068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:37946/0 (socket says 172.21.15.22:37946) 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 -- 172.21.15.22:0/1324474087 learned_addr learned my addr 172.21.15.22:0/1324474087 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 -- 172.21.15.22:0/1324474087 >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 msgr2=0x7f27100c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 --2- 172.21.15.22:0/1324474087 >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 0x7f27100c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 -- 172.21.15.22:0/1324474087 >> v1:172.21.15.192:6789/0 conn(0x7f27100c81f0 legacy=0x7f2710068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f2715c0c700 1 -- 172.21.15.22:0/1324474087 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710159f60 con 0x7f27100aca80 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.717+0000 7f271540b700 1 --2- 172.21.15.22:0/1324474087 >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 0x7f27100c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2715c0c700 1 --2- 172.21.15.22:0/1324474087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 0x7f271006aba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f270c009990 tx=0x7f270c009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b2551ce51cd98e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2714c0a700 1 -- 172.21.15.22:0/1324474087 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c009e80 con 0x7f27100aca80 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2714c0a700 1 -- 172.21.15.22:0/1324474087 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c005c10 con 0x7f27100aca80 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2714c0a700 1 -- 172.21.15.22:0/1324474087 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00b650 con 0x7f27100aca80 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 -- 172.21.15.22:0/1324474087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 msgr2=0x7f271006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 --2- 172.21.15.22:0/1324474087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 0x7f271006aba0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f270c009990 tx=0x7f270c009220 comp rx=0 tx=0).stop 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 -- 172.21.15.22:0/1324474087 shutdown_connections 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 --2- 172.21.15.22:0/1324474087 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27100aca80 0x7f271006aba0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 --2- 172.21.15.22:0/1324474087 >> v2:172.21.15.192:3300/0 conn(0x7f2710069d60 0x7f27100c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 -- 172.21.15.22:0/1324474087 >> 172.21.15.22:0/1324474087 conn(0x7f27100cd670 msgr2=0x7f27100cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:08.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 -- 172.21.15.22:0/1324474087 shutdown_connections 2023-10-08T00:26:08.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.718+0000 7f2717e70700 1 -- 172.21.15.22:0/1324474087 wait complete. 2023-10-08T00:26:08.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.719+0000 7f2717e70700 1 Processor -- start 2023-10-08T00:26:08.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 -- start start 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2710069d60 0x7f2710156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27100aca80 0x7f27100af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 0x7f27100b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710157b50 con 0x7f27100c81f0 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27100c63a0 con 0x7f27100aca80 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2717e70700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27100afda0 con 0x7f2710069d60 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f271640d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 0x7f27100b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f271640d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 0x7f27100b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37530/0 (socket says 172.21.15.22:37530) 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f271640d700 1 -- 172.21.15.22:0/3630437607 learned_addr learned my addr 172.21.15.22:0/3630437607 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.720+0000 7f2715c0c700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2710069d60 0x7f2710156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271540b700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27100aca80 0x7f27100af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271640d700 1 -- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2710069d60 msgr2=0x7f2710156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271640d700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2710069d60 0x7f2710156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271640d700 1 -- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27100aca80 msgr2=0x7f27100af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271640d700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27100aca80 0x7f27100af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271640d700 1 -- 172.21.15.22:0/3630437607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700009420 con 0x7f27100c81f0 2023-10-08T00:26:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f271640d700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 0x7f27100b0410 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f270800cc70 tx=0x7f2708001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2708005df0 con 0x7f27100c81f0 2023-10-08T00:26:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270800a5b0 con 0x7f27100c81f0 2023-10-08T00:26:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c009480 con 0x7f27100c81f0 2023-10-08T00:26:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270800a930 con 0x7f27100c81f0 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.721+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27100c5a50 con 0x7f27100c81f0 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.722+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27100c6510 con 0x7f27100c81f0 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.723+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f270800ace0 con 0x7f27100c81f0 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.723+0000 7f2705ffb700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f26f4066f30 0x7f26f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.723+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2708084220 con 0x7f27100c81f0 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.723+0000 7f2715c0c700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f26f4066f30 0x7f26f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.724+0000 7f2715c0c700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f26f4066f30 0x7f26f40693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f270c009260 tx=0x7f270c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:08.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.727+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27080517b0 con 0x7f27100c81f0 2023-10-08T00:26:08.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.920+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f271004c430 con 0x7f27100c81f0 2023-10-08T00:26:08.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.923+0000 7f2705ffb700 1 -- 172.21.15.22:0/3630437607 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f271004c430 con 0x7f27100c81f0 2023-10-08T00:26:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f26f4066f30 msgr2=0x7f26f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f26f4066f30 0x7f26f40693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f270c009260 tx=0x7f270c016000 comp rx=0 tx=0).stop 2023-10-08T00:26:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 msgr2=0x7f27100b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 0x7f27100b0410 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f270800cc70 tx=0x7f2708001a70 comp rx=0 tx=0).stop 2023-10-08T00:26:08.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 shutdown_connections 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27100c81f0 0x7f27100b0410 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f26f4066f30 0x7f26f40693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2710069d60 0x7f2710156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 --2- 172.21.15.22:0/3630437607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27100aca80 0x7f27100af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 >> 172.21.15.22:0/3630437607 conn(0x7f27100cd670 msgr2=0x7f2710068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 shutdown_connections 2023-10-08T00:26:08.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:08.925+0000 7f2717e70700 1 -- 172.21.15.22:0/3630437607 wait complete. 2023-10-08T00:26:08.939 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:26:08.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:26:08.982 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:26:09.025 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:26:09.025 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:26:09.025 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:09.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.142+0000 7feca0ba8700 1 Processor -- start 2023-10-08T00:26:09.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.142+0000 7feca0ba8700 1 -- start start 2023-10-08T00:26:09.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.143+0000 7feca0ba8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:09.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.143+0000 7feca0ba8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec9c069560 0x7fec9c0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:09.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.143+0000 7feca0ba8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c15a160 con 0x7fec9c159c60 2023-10-08T00:26:09.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.143+0000 7feca0ba8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c069f20 con 0x7fec9c069560 2023-10-08T00:26:09.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.143+0000 7feca0ba8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0d13a0 con 0x7fec9c159890 2023-10-08T00:26:09.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9a59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:09.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9ad9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec9c069560 0x7fec9c0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec99d9b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fec9c159c60 0x7fec9c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:37950/0 (socket says 172.21.15.22:37950) 2023-10-08T00:26:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec99d9b700 1 -- 172.21.15.22:0/1491401412 learned_addr learned my addr 172.21.15.22:0/1491401412 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9959a700 1 -- 172.21.15.22:0/1491401412 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696711910 0 0) 0x7fec9c15a160 con 0x7fec9c159c60 2023-10-08T00:26:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9959a700 1 -- 172.21.15.22:0/1491401412 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec88003570 con 0x7fec9c159c60 2023-10-08T00:26:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9a59c700 1 -- 172.21.15.22:0/1491401412 >> v2:172.21.15.192:3300/0 conn(0x7fec9c069560 msgr2=0x7fec9c0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:09.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9a59c700 1 --2- 172.21.15.22:0/1491401412 >> v2:172.21.15.192:3300/0 conn(0x7fec9c069560 0x7fec9c0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9a59c700 1 -- 172.21.15.22:0/1491401412 >> v1:172.21.15.192:6789/0 conn(0x7fec9c159c60 legacy=0x7fec9c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9a59c700 1 -- 172.21.15.22:0/1491401412 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c15e140 con 0x7fec9c159890 2023-10-08T00:26:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.144+0000 7fec9a59c700 1 --2- 172.21.15.22:0/1491401412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c15abd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec940098e0 tx=0x7fec940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc5567a964d5757 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7fec9959a700 1 -- 172.21.15.22:0/1491401412 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94011630 con 0x7fec9c159890 2023-10-08T00:26:09.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7fec9959a700 1 -- 172.21.15.22:0/1491401412 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec94011790 con 0x7fec9c159890 2023-10-08T00:26:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7fec9959a700 1 -- 172.21.15.22:0/1491401412 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94011b10 con 0x7fec9c159890 2023-10-08T00:26:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 -- 172.21.15.22:0/1491401412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 msgr2=0x7fec9c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 --2- 172.21.15.22:0/1491401412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c15abd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec940098e0 tx=0x7fec940091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 -- 172.21.15.22:0/1491401412 shutdown_connections 2023-10-08T00:26:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 --2- 172.21.15.22:0/1491401412 >> v2:172.21.15.192:3300/0 conn(0x7fec9c069560 0x7fec9c0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 --2- 172.21.15.22:0/1491401412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c15abd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 -- 172.21.15.22:0/1491401412 >> 172.21.15.22:0/1491401412 conn(0x7fec9c068e20 msgr2=0x7fec9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 -- 172.21.15.22:0/1491401412 shutdown_connections 2023-10-08T00:26:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.145+0000 7feca0ba8700 1 -- 172.21.15.22:0/1491401412 wait complete. 2023-10-08T00:26:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.146+0000 7feca0ba8700 1 Processor -- start 2023-10-08T00:26:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.146+0000 7feca0ba8700 1 -- start start 2023-10-08T00:26:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7feca0ba8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 0x7fec9c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7feca0ba8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7feca0ba8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c159c60 0x7fec9c0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7feca0ba8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0b2440 con 0x7fec9c069560 2023-10-08T00:26:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7feca0ba8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0b2670 con 0x7fec9c159c60 2023-10-08T00:26:09.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7feca0ba8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c15c7d0 con 0x7fec9c159890 2023-10-08T00:26:09.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7fec9a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 0x7fec9c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:09.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7fec9a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 0x7fec9c0b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37542/0 (socket says 172.21.15.22:37542) 2023-10-08T00:26:09.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7fec9a59c700 1 -- 172.21.15.22:0/2415337039 learned_addr learned my addr 172.21.15.22:0/2415337039 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:09.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7fec99d9b700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:09.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.147+0000 7fec9ad9d700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c159c60 0x7fec9c0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:09.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec9a59c700 1 -- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 msgr2=0x7fec9c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:09.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec9a59c700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec9a59c700 1 -- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c159c60 msgr2=0x7fec9c0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:09.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec9a59c700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c159c60 0x7fec9c0b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec9a59c700 1 -- 172.21.15.22:0/2415337039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94009420 con 0x7fec9c069560 2023-10-08T00:26:09.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec9a59c700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 0x7fec9c0b1770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec94009ed0 tx=0x7fec94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:09.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94011900 con 0x7fec9c069560 2023-10-08T00:26:09.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec94011a60 con 0x7fec9c069560 2023-10-08T00:26:09.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c15bea0 con 0x7fec9c069560 2023-10-08T00:26:09.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9401a680 con 0x7fec9c069560 2023-10-08T00:26:09.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.148+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c15c460 con 0x7fec9c069560 2023-10-08T00:26:09.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.149+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c04c3c0 con 0x7fec9c069560 2023-10-08T00:26:09.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.149+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec9401aa70 con 0x7fec9c069560 2023-10-08T00:26:09.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.150+0000 7fec927fc700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec7c066f30 0x7fec7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:09.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.150+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fec94085dd0 con 0x7fec9c069560 2023-10-08T00:26:09.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.150+0000 7fec99d9b700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec7c066f30 0x7fec7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:09.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.150+0000 7fec99d9b700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec7c066f30 0x7fec7c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0b0330 tx=0x7fec84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:09.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.154+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec940532e0 con 0x7fec9c069560 2023-10-08T00:26:09.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.393+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec9c06a5b0 con 0x7fec9c069560 2023-10-08T00:26:09.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.394+0000 7fec927fc700 1 -- 172.21.15.22:0/2415337039 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fec94015de0 con 0x7fec9c069560 2023-10-08T00:26:09.395 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:09.395 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4798,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2518845557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2518845557},{"type":"v1","addr":"172.21.15.22:6835","nonce":2518845557}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4801,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3489622582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3489622582},{"type":"v1","addr":"172.21.15.192:6837","nonce":3489622582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4847,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3989004293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3989004293},{"type":"v1","addr":"172.21.15.192:6836","nonce":3989004293}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":5292,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4211441773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4211441773},{"type":"v1","addr":"172.21.15.22:6834","nonce":4211441773}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-08T00:26:09.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec7c066f30 msgr2=0x7fec7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec7c066f30 0x7fec7c0693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0b0330 tx=0x7fec84009040 comp rx=0 tx=0).stop 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 msgr2=0x7fec9c0b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 0x7fec9c0b1770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec94009ed0 tx=0x7fec94017000 comp rx=0 tx=0).stop 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 shutdown_connections 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec9c159c60 0x7fec9c0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec9c069560 0x7fec9c0b1770 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec7c066f30 0x7fec7c0693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 --2- 172.21.15.22:0/2415337039 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec9c159890 0x7fec9c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:09.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 >> 172.21.15.22:0/2415337039 conn(0x7fec9c068e20 msgr2=0x7fec9c15d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 shutdown_connections 2023-10-08T00:26:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:09.396+0000 7feca0ba8700 1 -- 172.21.15.22:0/2415337039 wait complete. 2023-10-08T00:26:09.399 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 25 2023-10-08T00:26:09.410 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:26:09.410 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:26:09.410 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:26:09.410 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:09.410 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:26:09.410 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:26:09.411 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:26:09.411 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:09.411 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:26:09.411 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:26:09.411 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:26:09.411 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:09.411 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:26:09.412 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:26:09.412 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:26:09.412 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:09.421 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:26:09.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:26:09.422 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:26:09.423 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:26:09.426 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:26:09.426 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:26:09.464 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:26:09.465 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:09.465 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:26:09.466 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:09.468 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:26:09.469 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:09.539 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:26:09.540 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:26:09.548 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:26:13.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T00:26:15.426 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:26:15.427 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:26:15.429 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:26:15.429 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:15.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:26:15.510 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:26:15.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.564+0000 7f665499a700 1 Processor -- start 2023-10-08T00:26:15.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.564+0000 7f665499a700 1 -- start start 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f665499a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f66500caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f665499a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665015d7e0 con 0x7f665015df50 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f665499a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665015dac0 con 0x7f665006bcd0 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f665499a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665015aa30 con 0x7f665006c0a0 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f664ed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f665015df50 0x7f66500c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:59354/0 (socket says 172.21.15.22:59354) 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f664ed9d700 1 -- 172.21.15.22:0/1102955337 learned_addr learned my addr 172.21.15.22:0/1102955337 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f664e59c700 1 --1- 172.21.15.22:0/1102955337 >> v1:172.21.15.192:6789/0 conn(0x7f665006bcd0 0x7f665015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:37974/0 (socket says 172.21.15.22:37974) 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f664dd9b700 1 --2- 172.21.15.22:0/1102955337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f66500caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f664dd9b700 1 -- 172.21.15.22:0/1102955337 >> v1:172.21.15.192:6789/0 conn(0x7f665006bcd0 legacy=0x7f665015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.565+0000 7f664dd9b700 1 -- 172.21.15.22:0/1102955337 >> v1:172.21.15.22:6789/0 conn(0x7f665015df50 legacy=0x7f66500c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.566+0000 7f664dd9b700 1 -- 172.21.15.22:0/1102955337 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665015ad10 con 0x7f665006c0a0 2023-10-08T00:26:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.566+0000 7f664dd9b700 1 --2- 172.21.15.22:0/1102955337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f66500caa90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6644009910 tx=0x7f66440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7549ea68bdc086 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:15.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.571+0000 7f664d59a700 1 -- 172.21.15.22:0/1102955337 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400b860 con 0x7f665006c0a0 2023-10-08T00:26:15.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.571+0000 7f664d59a700 1 -- 172.21.15.22:0/1102955337 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664400b9c0 con 0x7f665006c0a0 2023-10-08T00:26:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.571+0000 7f664d59a700 1 -- 172.21.15.22:0/1102955337 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664400bd60 con 0x7f665006c0a0 2023-10-08T00:26:15.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 -- 172.21.15.22:0/1102955337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 msgr2=0x7f66500caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 --2- 172.21.15.22:0/1102955337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f66500caa90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6644009910 tx=0x7f66440091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 -- 172.21.15.22:0/1102955337 shutdown_connections 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 --2- 172.21.15.22:0/1102955337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f66500caa90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 -- 172.21.15.22:0/1102955337 >> 172.21.15.22:0/1102955337 conn(0x7f66500ce600 msgr2=0x7f66500cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 -- 172.21.15.22:0/1102955337 shutdown_connections 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.572+0000 7f665499a700 1 -- 172.21.15.22:0/1102955337 wait complete. 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.573+0000 7f665499a700 1 Processor -- start 2023-10-08T00:26:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.573+0000 7f665499a700 1 -- start start 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f665499a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 0x7f66500c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f665499a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f665016a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f665499a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f665015df50 0x7f6650159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f665499a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665016aef0 con 0x7f665006bcd0 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f665499a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500c8760 con 0x7f665015df50 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f665499a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665015a400 con 0x7f665006c0a0 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f664e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 0x7f66500c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f664e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 0x7f66500c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37566/0 (socket says 172.21.15.22:37566) 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f664e59c700 1 -- 172.21.15.22:0/4204230247 learned_addr learned my addr 172.21.15.22:0/4204230247 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f664ed9d700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f665015df50 0x7f6650159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.574+0000 7f664dd9b700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f665016a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664e59c700 1 -- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 msgr2=0x7f665016a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664e59c700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f665016a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664e59c700 1 -- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f665015df50 msgr2=0x7f6650159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664e59c700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f665015df50 0x7f6650159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664e59c700 1 -- 172.21.15.22:0/4204230247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644009420 con 0x7f665006bcd0 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664dd9b700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f665016a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f664e59c700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 0x7f66500c8bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f664000c540 tx=0x7f6640007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640005a70 con 0x7f665006bcd0 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6640005bd0 con 0x7f665006bcd0 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66500c5a90 con 0x7f665006bcd0 2023-10-08T00:26:15.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66400070d0 con 0x7f665006bcd0 2023-10-08T00:26:15.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.575+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500c83f0 con 0x7f665006bcd0 2023-10-08T00:26:15.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.576+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665004c3c0 con 0x7f665006bcd0 2023-10-08T00:26:15.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.576+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6640007480 con 0x7f665006bcd0 2023-10-08T00:26:15.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.577+0000 7f663e7fc700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:15.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.577+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f66400836e0 con 0x7f665006bcd0 2023-10-08T00:26:15.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.577+0000 7f664dd9b700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:15.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.578+0000 7f664dd9b700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6630066f30 0x7f66300693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66440093f0 tx=0x7f6644017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:15.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.582+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6640050bf0 con 0x7f665006bcd0 2023-10-08T00:26:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:15.788+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f66500c8a40 con 0x7f665006bcd0 2023-10-08T00:26:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.574+0000 7f663e7fc700 1 -- 172.21.15.22:0/4204230247 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6640017020 con 0x7f665006bcd0 2023-10-08T00:26:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.576+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6630066f30 msgr2=0x7f66300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.576+0000 7f665499a700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6630066f30 0x7f66300693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f66440093f0 tx=0x7f6644017000 comp rx=0 tx=0).stop 2023-10-08T00:26:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 msgr2=0x7f66500c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 0x7f66500c8bf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f664000c540 tx=0x7f6640007f70 comp rx=0 tx=0).stop 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 shutdown_connections 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f665015df50 0x7f6650159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f665006bcd0 0x7f66500c8bf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6630066f30 0x7f66300693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 --2- 172.21.15.22:0/4204230247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f665006c0a0 0x7f665016a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 >> 172.21.15.22:0/4204230247 conn(0x7f66500ce600 msgr2=0x7f665006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 shutdown_connections 2023-10-08T00:26:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.577+0000 7f665499a700 1 -- 172.21.15.22:0/4204230247 wait complete. 2023-10-08T00:26:16.579 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:26:16.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:26:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a7d3c0700 1 Processor -- start 2023-10-08T00:26:16.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a7d3c0700 1 -- start start 2023-10-08T00:26:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a7d3c0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a780c7bd0 0x7f6a7815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a7d3c0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7815af50 con 0x7f6a781598d0 2023-10-08T00:26:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a7d3c0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7806e980 con 0x7f6a7806bbe0 2023-10-08T00:26:16.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a7d3c0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780ce180 con 0x7f6a780c7bd0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.712+0000 7f6a777fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a780c7bd0 0x7f6a7815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a77fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a781598d0 0x7f6a7806ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46026/0 (socket says 172.21.15.22:46026) 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a77fff700 1 -- 172.21.15.22:0/258079472 learned_addr learned my addr 172.21.15.22:0/258079472 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a777fe700 1 -- 172.21.15.22:0/258079472 >> v1:172.21.15.192:6789/0 conn(0x7f6a7806bbe0 legacy=0x7f6a78068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a76ffd700 1 -- 172.21.15.22:0/258079472 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815106191 0 0) 0x7f6a68001110 con 0x7f6a781598d0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a777fe700 1 -- 172.21.15.22:0/258079472 >> v1:172.21.15.22:6789/0 conn(0x7f6a781598d0 legacy=0x7f6a7806ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a777fe700 1 -- 172.21.15.22:0/258079472 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780c80f0 con 0x7f6a780c7bd0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a777fe700 1 --2- 172.21.15.22:0/258079472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a780c7bd0 0x7f6a7815aa10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0098e0 tx=0x7f6a6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f91628de57785db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a76ffd700 1 -- 172.21.15.22:0/258079472 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c009e80 con 0x7f6a780c7bd0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a76ffd700 1 -- 172.21.15.22:0/258079472 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6c00b860 con 0x7f6a780c7bd0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.713+0000 7f6a76ffd700 1 -- 172.21.15.22:0/258079472 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00bbe0 con 0x7f6a780c7bd0 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/258079472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a780c7bd0 msgr2=0x7f6a7815aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:16.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/258079472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a780c7bd0 0x7f6a7815aa10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c0098e0 tx=0x7f6a6c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/258079472 shutdown_connections 2023-10-08T00:26:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/258079472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a780c7bd0 0x7f6a7815aa10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/258079472 >> 172.21.15.22:0/258079472 conn(0x7f6a7806b490 msgr2=0x7f6a780cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/258079472 shutdown_connections 2023-10-08T00:26:16.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.714+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/258079472 wait complete. 2023-10-08T00:26:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.715+0000 7f6a7d3c0700 1 Processor -- start 2023-10-08T00:26:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.715+0000 7f6a7d3c0700 1 -- start start 2023-10-08T00:26:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7d3c0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 0x7f6a7816b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:16.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7d3c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a780c7bd0 0x7f6a780cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7d3c0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a781598d0 0x7f6a781555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7d3c0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7815d250 con 0x7f6a7806bbe0 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7d3c0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7815cc20 con 0x7f6a781598d0 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7d3c0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780c5920 con 0x7f6a780c7bd0 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 0x7f6a7816b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 0x7f6a7816b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44726/0 (socket says 172.21.15.22:44726) 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 -- 172.21.15.22:0/30085271 learned_addr learned my addr 172.21.15.22:0/30085271 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 -- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a780c7bd0 msgr2=0x7f6a780cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a780c7bd0 0x7f6a780cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 -- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a781598d0 msgr2=0x7f6a781555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7cbbf700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a781598d0 0x7f6a781555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:16.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a781598d0 0x7f6a781555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 -- 172.21.15.22:0/30085271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c009420 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a7cbbf700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a781598d0 0x7f6a781555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.716+0000 7f6a77fff700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 0x7f6a7816b360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c5e0 tx=0x7f6a68001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.717+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68005b30 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.717+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a68005c90 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.717+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a780c5c00 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.717+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68007300 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.717+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a780cc770 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.718+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a780c7770 con 0x7f6a7806bbe0 2023-10-08T00:26:16.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.718+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a6801b3b0 con 0x7f6a7806bbe0 2023-10-08T00:26:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.718+0000 7f6a5ffff700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.719+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6a68083540 con 0x7f6a7806bbe0 2023-10-08T00:26:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.719+0000 7f6a777fe700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:16.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.719+0000 7f6a777fe700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a64066f30 0x7f6a640693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ccd80 tx=0x7f6a6c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:16.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.723+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a68050b00 con 0x7f6a7806bbe0 2023-10-08T00:26:16.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.995+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6a7806e1a0 con 0x7f6a7806bbe0 2023-10-08T00:26:16.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.996+0000 7f6a5ffff700 1 -- 172.21.15.22:0/30085271 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v10) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6a68054120 con 0x7f6a7806bbe0 2023-10-08T00:26:16.996 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:16.998 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:26:16.999 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.000 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:26:17.002 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.003 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:26:17.005 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:26:17.006 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:26:17.008 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.009 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:26:17.010 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:17.011 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:26:17.012 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a64066f30 msgr2=0x7f6a640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a64066f30 0x7f6a640693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6a780ccd80 tx=0x7f6a6c016000 comp rx=0 tx=0).stop 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 msgr2=0x7f6a7816b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 0x7f6a7816b360 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800c5e0 tx=0x7f6a68001070 comp rx=0 tx=0).stop 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 shutdown_connections 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a781598d0 0x7f6a781555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a7806bbe0 0x7f6a7816b360 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a64066f30 0x7f6a640693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 --2- 172.21.15.22:0/30085271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a780c7bd0 0x7f6a780cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 >> 172.21.15.22:0/30085271 conn(0x7f6a7806b490 msgr2=0x7f6a780c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:17.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 shutdown_connections 2023-10-08T00:26:17.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:16.998+0000 7f6a7d3c0700 1 -- 172.21.15.22:0/30085271 wait complete. 2023-10-08T00:26:17.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.132+0000 7f6d376c2700 1 Processor -- start 2023-10-08T00:26:17.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.132+0000 7f6d376c2700 1 -- start start 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.133+0000 7f6d376c2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d30159890 0x7f6d3015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.133+0000 7f6d376c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d3015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.133+0000 7f6d376c2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3015a160 con 0x7f6d3015db10 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.133+0000 7f6d376c2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d300d13a0 con 0x7f6d30159890 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.133+0000 7f6d376c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015e140 con 0x7f6d30159c60 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d30159890 0x7f6d3015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d34c5d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d3015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d30159890 0x7f6d3015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:54502/0 (socket says 172.21.15.22:54502) 2023-10-08T00:26:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d35c5f700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6d3015db10 0x7f6d30069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:48414/0 (socket says 172.21.15.22:48414) 2023-10-08T00:26:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 -- 172.21.15.22:0/2380150973 learned_addr learned my addr 172.21.15.22:0/2380150973 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d2ffff700 1 -- 172.21.15.22:0/2380150973 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909655105 0 0) 0x7f6d3015a160 con 0x7f6d3015db10 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d2ffff700 1 -- 172.21.15.22:0/2380150973 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d18003570 con 0x7f6d3015db10 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 -- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 msgr2=0x7f6d3015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 --2- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d3015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 -- 172.21.15.22:0/2380150973 >> v1:172.21.15.192:6789/0 conn(0x7f6d3015db10 legacy=0x7f6d30069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 -- 172.21.15.22:0/2380150973 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3015a3d0 con 0x7f6d30159890 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d34c5d700 1 --2- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d3015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.134+0000 7f6d3545e700 1 --2- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d30159890 0x7f6d3015abd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009f20 tx=0x7f6d28009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b84271b543678929 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d2ffff700 1 -- 172.21.15.22:0/2380150973 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800e070 con 0x7f6d30159890 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d2ffff700 1 -- 172.21.15.22:0/2380150973 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800b970 con 0x7f6d30159890 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d2ffff700 1 -- 172.21.15.22:0/2380150973 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280092e0 con 0x7f6d30159890 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 -- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d30159890 msgr2=0x7f6d3015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 --2- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d30159890 0x7f6d3015abd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009f20 tx=0x7f6d28009840 comp rx=0 tx=0).stop 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 -- 172.21.15.22:0/2380150973 shutdown_connections 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 --2- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d30159890 0x7f6d3015abd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 --2- 172.21.15.22:0/2380150973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d3015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 -- 172.21.15.22:0/2380150973 >> 172.21.15.22:0/2380150973 conn(0x7f6d30068e20 msgr2=0x7f6d300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 -- 172.21.15.22:0/2380150973 shutdown_connections 2023-10-08T00:26:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.135+0000 7f6d376c2700 1 -- 172.21.15.22:0/2380150973 wait complete. 2023-10-08T00:26:17.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.136+0000 7f6d376c2700 1 Processor -- start 2023-10-08T00:26:17.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.136+0000 7f6d376c2700 1 -- start start 2023-10-08T00:26:17.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d376c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 0x7f6d300b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d376c2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d30169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d376c2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d3015db10 0x7f6d3016a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d376c2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300b4710 con 0x7f6d30159890 2023-10-08T00:26:17.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d376c2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300b3a90 con 0x7f6d3015db10 2023-10-08T00:26:17.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d376c2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300b3d70 con 0x7f6d30159c60 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d3545e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 0x7f6d300b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d3545e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 0x7f6d300b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44740/0 (socket says 172.21.15.22:44740) 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d3545e700 1 -- 172.21.15.22:0/628901107 learned_addr learned my addr 172.21.15.22:0/628901107 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d34c5d700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d30169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.137+0000 7f6d35c5f700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d3015db10 0x7f6d3016a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d3545e700 1 -- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 msgr2=0x7f6d30169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d3545e700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d30169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d3545e700 1 -- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d3015db10 msgr2=0x7f6d3016a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d3545e700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d3015db10 0x7f6d3016a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d3545e700 1 -- 172.21.15.22:0/628901107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009420 con 0x7f6d30159890 2023-10-08T00:26:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d3545e700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 0x7f6d300b5a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800b610 tx=0x7f6d28018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28008870 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280089d0 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d28009ae0 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28008d90 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.138+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d300b4100 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.139+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d300b4850 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.139+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d28003040 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.140+0000 7f6d2d7fa700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.140+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6d28085d60 con 0x7f6d30159890 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.140+0000 7f6d34c5d700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.141+0000 7f6d34c5d700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d1c066f30 0x7f6d1c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d300cf100 tx=0x7f6d240091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.144+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d28053320 con 0x7f6d30159890 2023-10-08T00:26:17.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.337+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d3004c3c0 con 0x7f6d30159890 2023-10-08T00:26:17.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.338+0000 7f6d2d7fa700 1 -- 172.21.15.22:0/628901107 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f6d28009940 con 0x7f6d30159890 2023-10-08T00:26:17.338 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:17.338 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":48,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:16.572465+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d1c066f30 msgr2=0x7f6d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d1c066f30 0x7f6d1c0693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6d300cf100 tx=0x7f6d240091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 msgr2=0x7f6d300b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 0x7f6d300b5a00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800b610 tx=0x7f6d28018000 comp rx=0 tx=0).stop 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 shutdown_connections 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d3015db10 0x7f6d3016a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d30159890 0x7f6d300b5a00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 --2- 172.21.15.22:0/628901107 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6d30159c60 0x7f6d30169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 >> 172.21.15.22:0/628901107 conn(0x7f6d30068e20 msgr2=0x7f6d30152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:17.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 shutdown_connections 2023-10-08T00:26:17.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.340+0000 7f6d376c2700 1 -- 172.21.15.22:0/628901107 wait complete. 2023-10-08T00:26:17.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:26:17.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:26:17.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.475+0000 7fda039ae700 1 Processor -- start 2023-10-08T00:26:17.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.475+0000 7fda039ae700 1 -- start start 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda039ae700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9fc141500 0x7fd9fc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda039ae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9fc06c0a0 0x7fd9fc0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda039ae700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc15c2a0 con 0x7fd9fc06bcd0 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda039ae700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c9880 con 0x7fd9fc141500 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda039ae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9fc15b690 con 0x7fd9fc06c0a0 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda00f49700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9fc141500 0x7fd9fc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda00f49700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9fc141500 0x7fd9fc0c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44748/0 (socket says 172.21.15.22:44748) 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda00f49700 1 -- 172.21.15.22:0/4149961617 learned_addr learned my addr 172.21.15.22:0/4149961617 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.476+0000 7fda01f4b700 1 --2- 172.21.15.22:0/4149961617 >> v2:172.21.15.192:3300/0 conn(0x7fd9fc06c0a0 0x7fd9fc0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda00f49700 1 -- 172.21.15.22:0/4149961617 >> v2:172.21.15.192:3300/0 conn(0x7fd9fc06c0a0 msgr2=0x7fd9fc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda00f49700 1 --2- 172.21.15.22:0/4149961617 >> v2:172.21.15.192:3300/0 conn(0x7fd9fc06c0a0 0x7fd9fc0c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda00f49700 1 -- 172.21.15.22:0/4149961617 >> v1:172.21.15.192:6789/0 conn(0x7fd9fc06bcd0 legacy=0x7fd9fc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda00f49700 1 -- 172.21.15.22:0/4149961617 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc15b970 con 0x7fd9fc141500 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda00f49700 1 --2- 172.21.15.22:0/4149961617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0cf210 tx=0x7fd9f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d66b091cc1ec4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fd9fbfff700 1 -- 172.21.15.22:0/4149961617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0009e70 con 0x7fd9fc141500 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fd9fbfff700 1 -- 172.21.15.22:0/4149961617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f000b860 con 0x7fd9fc141500 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fd9fbfff700 1 -- 172.21.15.22:0/4149961617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000bc00 con 0x7fd9fc141500 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda039ae700 1 -- 172.21.15.22:0/4149961617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 msgr2=0x7fd9fc0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda039ae700 1 --2- 172.21.15.22:0/4149961617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8e00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0cf210 tx=0x7fd9f0009250 comp rx=0 tx=0).stop 2023-10-08T00:26:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda039ae700 1 -- 172.21.15.22:0/4149961617 shutdown_connections 2023-10-08T00:26:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda039ae700 1 --2- 172.21.15.22:0/4149961617 >> v2:172.21.15.192:3300/0 conn(0x7fd9fc06c0a0 0x7fd9fc0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda039ae700 1 --2- 172.21.15.22:0/4149961617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8e00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.477+0000 7fda039ae700 1 -- 172.21.15.22:0/4149961617 >> 172.21.15.22:0/4149961617 conn(0x7fd9fc0ce600 msgr2=0x7fd9fc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.478+0000 7fda039ae700 1 -- 172.21.15.22:0/4149961617 shutdown_connections 2023-10-08T00:26:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.478+0000 7fda039ae700 1 -- 172.21.15.22:0/4149961617 wait complete. 2023-10-08T00:26:17.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 Processor -- start 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 -- start start 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9fc06bcd0 0x7fd9fc13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9fc06c0a0 0x7fd9fc0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc13d490 con 0x7fd9fc141500 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.479+0000 7fda039ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc13dd30 con 0x7fd9fc06bcd0 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda039ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc0c89b0 con 0x7fd9fc06c0a0 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44750/0 (socket says 172.21.15.22:44750) 2023-10-08T00:26:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 -- 172.21.15.22:0/2955423377 learned_addr learned my addr 172.21.15.22:0/2955423377 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda0174a700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9fc06bcd0 0x7fd9fc13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 -- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9fc06c0a0 msgr2=0x7fd9fc0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda00f49700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9fc06c0a0 0x7fd9fc0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9fc06c0a0 0x7fd9fc0c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 -- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9fc06bcd0 msgr2=0x7fd9fc13fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9fc06bcd0 0x7fd9fc13fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 -- 172.21.15.22:0/2955423377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00094f0 con 0x7fd9fc141500 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda01f4b700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400ea80 tx=0x7fd9f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400c920 con 0x7fd9fc141500 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400ca80 con 0x7fd9fc141500 2023-10-08T00:26:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc13d6e0 con 0x7fd9fc141500 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400ce40 con 0x7fd9fc141500 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.480+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc0c5920 con 0x7fd9fc141500 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.481+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc04c3c0 con 0x7fd9fc141500 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.482+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9f4013680 con 0x7fd9fc141500 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.482+0000 7fd9f97fa700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9e8066f30 0x7fd9e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.482+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd9f40845a0 con 0x7fd9fc141500 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.482+0000 7fda0174a700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9e8066f30 0x7fd9e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.483+0000 7fda0174a700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9e8066f30 0x7fd9e80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec007fd0 tx=0x7fd9ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.486+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9f4051b60 con 0x7fd9fc141500 2023-10-08T00:26:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.681+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9fc15bc50 con 0x7fd9fc141500 2023-10-08T00:26:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.681+0000 7fd9f97fa700 1 -- 172.21.15.22:0/2955423377 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9f4055180 con 0x7fd9fc141500 2023-10-08T00:26:17.682 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:26:17.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9e8066f30 msgr2=0x7fd9e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9e8066f30 0x7fd9e80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec007fd0 tx=0x7fd9ec009040 comp rx=0 tx=0).stop 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 msgr2=0x7fd9fc0c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400ea80 tx=0x7fd9f40091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 shutdown_connections 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9fc141500 0x7fd9fc0c8390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9fc06bcd0 0x7fd9fc13fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd9e8066f30 0x7fd9e80693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 --2- 172.21.15.22:0/2955423377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9fc06c0a0 0x7fd9fc0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 >> 172.21.15.22:0/2955423377 conn(0x7fd9fc0ce600 msgr2=0x7fd9fc157810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 shutdown_connections 2023-10-08T00:26:17.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.684+0000 7fda039ae700 1 -- 172.21.15.22:0/2955423377 wait complete. 2023-10-08T00:26:17.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:26:17.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.814+0000 7f4ccc3d5700 1 Processor -- start 2023-10-08T00:26:17.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.814+0000 7f4ccc3d5700 1 -- start start 2023-10-08T00:26:17.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4ccc3d5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4cc4159890 0x7f4cc415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4ccc3d5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cc4159c60 0x7f4cc415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4ccc3d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc415db10 0x7f4cc4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4ccc3d5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc415df50 con 0x7f4cc4159890 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4ccc3d5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc415a160 con 0x7f4cc4159c60 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4ccc3d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40d13a0 con 0x7f4cc415db10 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4cca171700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4cc4159890 0x7f4cc415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4cca171700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4cc4159890 0x7f4cc415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44754/0 (socket says 172.21.15.22:44754) 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.815+0000 7f4cca171700 1 -- 172.21.15.22:0/3505143516 learned_addr learned my addr 172.21.15.22:0/3505143516 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cca171700 1 -- 172.21.15.22:0/3505143516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc415db10 msgr2=0x7f4cc4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cca171700 1 --2- 172.21.15.22:0/3505143516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc415db10 0x7f4cc4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cca171700 1 -- 172.21.15.22:0/3505143516 >> v2:172.21.15.192:3300/0 conn(0x7f4cc4159c60 msgr2=0x7f4cc415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cc9970700 1 --2- 172.21.15.22:0/3505143516 >> v2:172.21.15.192:3300/0 conn(0x7f4cc4159c60 0x7f4cc415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cca171700 1 --2- 172.21.15.22:0/3505143516 >> v2:172.21.15.192:3300/0 conn(0x7f4cc4159c60 0x7f4cc415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cca171700 1 -- 172.21.15.22:0/3505143516 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc415e140 con 0x7f4cc4159890 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cca171700 1 --2- 172.21.15.22:0/3505143516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc4159890 0x7f4cc415abd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40b67f0 tx=0x7f4cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd68b00572591547 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cc916f700 1 -- 172.21.15.22:0/3505143516 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400b860 con 0x7f4cc4159890 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cc916f700 1 -- 172.21.15.22:0/3505143516 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb400b9c0 con 0x7f4cc4159890 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.816+0000 7f4cc916f700 1 -- 172.21.15.22:0/3505143516 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400bd60 con 0x7f4cc4159890 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/3505143516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc4159890 msgr2=0x7f4cc415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/3505143516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc4159890 0x7f4cc415abd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40b67f0 tx=0x7f4cb4009250 comp rx=0 tx=0).stop 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/3505143516 shutdown_connections 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/3505143516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc4159890 0x7f4cc415abd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/3505143516 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc415db10 0x7f4cc4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/3505143516 >> v2:172.21.15.192:3300/0 conn(0x7f4cc4159c60 0x7f4cc415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/3505143516 >> 172.21.15.22:0/3505143516 conn(0x7f4cc4068e20 msgr2=0x7f4cc40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/3505143516 shutdown_connections 2023-10-08T00:26:17.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.817+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/3505143516 wait complete. 2023-10-08T00:26:17.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.818+0000 7f4ccc3d5700 1 Processor -- start 2023-10-08T00:26:17.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.818+0000 7f4ccc3d5700 1 -- start start 2023-10-08T00:26:17.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc4159890 0x7f4cc4148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc4159c60 0x7f4cc415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 0x7f4cc415bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c81d0 con 0x7f4cc415db10 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40b62c0 con 0x7f4cc4159c60 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c78a0 con 0x7f4cc4159890 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 0x7f4cc415bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 0x7f4cc415bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44760/0 (socket says 172.21.15.22:44760) 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 -- 172.21.15.22:0/1475242012 learned_addr learned my addr 172.21.15.22:0/1475242012 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca171700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc4159890 0x7f4cc4148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cc9970700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc4159c60 0x7f4cc415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 -- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc4159890 msgr2=0x7f4cc4148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc4159890 0x7f4cc4148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 -- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc4159c60 msgr2=0x7f4cc415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc4159c60 0x7f4cc415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 -- 172.21.15.22:0/1475242012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb40094f0 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cca972700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 0x7f4cc415bdf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00bc30 tx=0x7f4cbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0092e0 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc00c7a0 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc40c7b80 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00cb80 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.819+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc4148860 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.820+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc404c3c0 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.821+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cbc012070 con 0x7f4cc415db10 2023-10-08T00:26:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.821+0000 7f4cc27fc700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.821+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4cbc083f30 con 0x7f4cc415db10 2023-10-08T00:26:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.821+0000 7f4cca171700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.822+0000 7f4cca171700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4cb0066f30 0x7f4cb00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40b67f0 tx=0x7f4cb4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:17.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:17.826+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cbc051450 con 0x7f4cc415db10 2023-10-08T00:26:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.021+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4cc406a5b0 con 0x7f4cc415db10 2023-10-08T00:26:18.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.021+0000 7f4cc27fc700 1 -- 172.21.15.22:0/1475242012 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4cbc054a70 con 0x7f4cc415db10 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:18.022 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4cb0066f30 msgr2=0x7f4cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4cb0066f30 0x7f4cb00693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40b67f0 tx=0x7f4cb4017000 comp rx=0 tx=0).stop 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 msgr2=0x7f4cc415bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 0x7f4cc415bdf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00bc30 tx=0x7f4cbc009840 comp rx=0 tx=0).stop 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 shutdown_connections 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc415db10 0x7f4cc415bdf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4cb0066f30 0x7f4cb00693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4cc4159890 0x7f4cc4148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 --2- 172.21.15.22:0/1475242012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc4159c60 0x7f4cc415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 >> 172.21.15.22:0/1475242012 conn(0x7f4cc4068e20 msgr2=0x7f4cc40b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:18.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 shutdown_connections 2023-10-08T00:26:18.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.023+0000 7f4ccc3d5700 1 -- 172.21.15.22:0/1475242012 wait complete. 2023-10-08T00:26:18.035 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:26:18.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:26:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.158+0000 7f49ed8e2700 1 Processor -- start 2023-10-08T00:26:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.158+0000 7f49ed8e2700 1 -- start start 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49ed8e2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49e8159ec0 0x7f49e80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49ed8e2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49e80b53d0 0x7f49e80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49ed8e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80cce40 0x7f49e80cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49ed8e2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80b5b00 con 0x7f49e8159ec0 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49ed8e2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80b5850 con 0x7f49e80b53d0 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49ed8e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b5da0 con 0x7f49e80cce40 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49e8159ec0 0x7f49e80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f49e8159ec0 0x7f49e80b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44776/0 (socket says 172.21.15.22:44776) 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 -- 172.21.15.22:0/1389905255 learned_addr learned my addr 172.21.15.22:0/1389905255 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e77fe700 1 --2- 172.21.15.22:0/1389905255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80cce40 0x7f49e80cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 -- 172.21.15.22:0/1389905255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80cce40 msgr2=0x7f49e80cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e67fc700 1 --2- 172.21.15.22:0/1389905255 >> v2:172.21.15.192:3300/0 conn(0x7f49e80b53d0 0x7f49e80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1389905255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80cce40 0x7f49e80cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 -- 172.21.15.22:0/1389905255 >> v2:172.21.15.192:3300/0 conn(0x7f49e80b53d0 msgr2=0x7f49e80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1389905255 >> v2:172.21.15.192:3300/0 conn(0x7f49e80b53d0 0x7f49e80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 -- 172.21.15.22:0/1389905255 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80b6080 con 0x7f49e8159ec0 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e67fc700 1 --2- 172.21.15.22:0/1389905255 >> v2:172.21.15.192:3300/0 conn(0x7f49e80b53d0 0x7f49e80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1389905255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80b4e90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b64d0 tx=0x7f49d8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93833fbccdccc9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e5ffb700 1 -- 172.21.15.22:0/1389905255 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8005c10 con 0x7f49e8159ec0 2023-10-08T00:26:18.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e5ffb700 1 -- 172.21.15.22:0/1389905255 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d8005d70 con 0x7f49e8159ec0 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.159+0000 7f49e5ffb700 1 -- 172.21.15.22:0/1389905255 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b880 con 0x7f49e8159ec0 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1389905255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 msgr2=0x7f49e80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1389905255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80b4e90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b64d0 tx=0x7f49d8009220 comp rx=0 tx=0).stop 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1389905255 shutdown_connections 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1389905255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80b4e90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1389905255 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80cce40 0x7f49e80cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1389905255 >> v2:172.21.15.192:3300/0 conn(0x7f49e80b53d0 0x7f49e80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1389905255 >> 172.21.15.22:0/1389905255 conn(0x7f49e80999f0 msgr2=0x7f49e80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1389905255 shutdown_connections 2023-10-08T00:26:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.160+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1389905255 wait complete. 2023-10-08T00:26:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.161+0000 7f49ed8e2700 1 Processor -- start 2023-10-08T00:26:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.161+0000 7f49ed8e2700 1 -- start start 2023-10-08T00:26:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49ed8e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80b53d0 0x7f49e813eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49ed8e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e80cce40 0x7f49e8151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49ed8e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49ed8e2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80686f0 con 0x7f49e8159ec0 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49ed8e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e813f020 con 0x7f49e80cce40 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49ed8e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8154870 con 0x7f49e80b53d0 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80c6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44792/0 (socket says 172.21.15.22:44792) 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 -- 172.21.15.22:0/1006722287 learned_addr learned my addr 172.21.15.22:0/1006722287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80b53d0 0x7f49e813eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e67fc700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e80cce40 0x7f49e8151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 -- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80b53d0 msgr2=0x7f49e813eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80b53d0 0x7f49e813eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 -- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e80cce40 msgr2=0x7f49e8151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e80cce40 0x7f49e8151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e77fe700 1 -- 172.21.15.22:0/1006722287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009480 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80b53d0 0x7f49e813eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.162+0000 7f49e67fc700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e80cce40 0x7f49e8151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.163+0000 7f49e77fe700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80c6230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49e000ceb0 tx=0x7f49e0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.163+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000ae40 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.163+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e0016430 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.163+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e00167d0 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.163+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e8154b50 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.163+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e8155110 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.164+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e8063c90 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.164+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49e0003020 con 0x7f49e8159ec0 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.165+0000 7f49ceffd700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49d4066f30 0x7f49d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.165+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f49e0012070 con 0x7f49e8159ec0 2023-10-08T00:26:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.165+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49d4066f30 0x7f49d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.165+0000 7f49e6ffd700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49d4066f30 0x7f49d40693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b2bc0 tx=0x7f49d8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.169+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49e0056110 con 0x7f49e8159ec0 2023-10-08T00:26:18.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.362+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49e80718b0 con 0x7f49e8159ec0 2023-10-08T00:26:18.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.579+0000 7f49ceffd700 1 -- 172.21.15.22:0/1006722287 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f49e0055ca0 con 0x7f49e8159ec0 2023-10-08T00:26:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49d4066f30 msgr2=0x7f49d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49d4066f30 0x7f49d40693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f49e80b2bc0 tx=0x7f49d8016000 comp rx=0 tx=0).stop 2023-10-08T00:26:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 msgr2=0x7f49e80c6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80c6230 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49e000ceb0 tx=0x7f49e0007870 comp rx=0 tx=0).stop 2023-10-08T00:26:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 shutdown_connections 2023-10-08T00:26:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49e8159ec0 0x7f49e80c6230 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49d4066f30 0x7f49d40693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49e80b53d0 0x7f49e813eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 --2- 172.21.15.22:0/1006722287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49e80cce40 0x7f49e8151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.583+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 >> 172.21.15.22:0/1006722287 conn(0x7f49e80999f0 msgr2=0x7f49e80ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:18.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.584+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 shutdown_connections 2023-10-08T00:26:18.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.584+0000 7f49ed8e2700 1 -- 172.21.15.22:0/1006722287 wait complete. 2023-10-08T00:26:18.586 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:26:18.598 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:26:18.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.723+0000 7f74b6e21700 1 Processor -- start 2023-10-08T00:26:18.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.723+0000 7f74b6e21700 1 -- start start 2023-10-08T00:26:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b6e21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b6e21700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f74b00af320 0x7f74b00cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b6e21700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00ce380 con 0x7f74b0159950 2023-10-08T00:26:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b6e21700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b00cec20 con 0x7f74b00af320 2023-10-08T00:26:18.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b6e21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00afa90 con 0x7f74b0069c70 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b53be700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f74b00af320 0x7f74b00cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b4bbd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f74b0159950 0x7f74b0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46030/0 (socket says 172.21.15.22:46030) 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74b4bbd700 1 -- 172.21.15.22:0/3468865581 learned_addr learned my addr 172.21.15.22:0/3468865581 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.724+0000 7f74affff700 1 --2- 172.21.15.22:0/3468865581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b53be700 1 -- 172.21.15.22:0/3468865581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 msgr2=0x7f74b00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b53be700 1 --2- 172.21.15.22:0/3468865581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b53be700 1 -- 172.21.15.22:0/3468865581 >> v1:172.21.15.22:6789/0 conn(0x7f74b0159950 legacy=0x7f74b0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74af7fe700 1 -- 172.21.15.22:0/3468865581 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319059031 0 0) 0x7f74b00ce380 con 0x7f74b0159950 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b53be700 1 -- 172.21.15.22:0/3468865581 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00ce5d0 con 0x7f74b00af320 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b53be700 1 --2- 172.21.15.22:0/3468865581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b00af320 0x7f74b00cf0b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e60 tx=0x7f74a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13884a106376c1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74af7fe700 1 -- 172.21.15.22:0/3468865581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800e070 con 0x7f74b00af320 2023-10-08T00:26:18.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74af7fe700 1 -- 172.21.15.22:0/3468865581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800bc30 con 0x7f74b00af320 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74af7fe700 1 -- 172.21.15.22:0/3468865581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8012430 con 0x7f74b00af320 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b6e21700 1 -- 172.21.15.22:0/3468865581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b00af320 msgr2=0x7f74b00cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.725+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3468865581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b00af320 0x7f74b00cf0b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e60 tx=0x7f74a8009780 comp rx=0 tx=0).stop 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.726+0000 7f74b6e21700 1 -- 172.21.15.22:0/3468865581 shutdown_connections 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.726+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3468865581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b00af320 0x7f74b00cf0b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.726+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3468865581 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.726+0000 7f74b6e21700 1 -- 172.21.15.22:0/3468865581 >> 172.21.15.22:0/3468865581 conn(0x7f74b0068e00 msgr2=0x7f74b00d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.726+0000 7f74b6e21700 1 -- 172.21.15.22:0/3468865581 shutdown_connections 2023-10-08T00:26:18.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.726+0000 7f74b6e21700 1 -- 172.21.15.22:0/3468865581 wait complete. 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.727+0000 7f74b6e21700 1 Processor -- start 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.727+0000 7f74b6e21700 1 -- start start 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b6e21700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b6e21700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b00af320 0x7f74b00b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b6e21700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 0x7f74b015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b6e21700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015e000 con 0x7f74b0159950 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b6e21700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015d6d0 con 0x7f74b00af320 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b6e21700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015d9b0 con 0x7f74b0069c70 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 0x7f74b015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 0x7f74b015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44820/0 (socket says 172.21.15.22:44820) 2023-10-08T00:26:18.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 -- 172.21.15.22:0/3588676229 learned_addr learned my addr 172.21.15.22:0/3588676229 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b4bbd700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74affff700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b00af320 0x7f74b00b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 -- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 msgr2=0x7f74b00b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 -- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b00af320 msgr2=0x7f74b00b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b00af320 0x7f74b00b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 -- 172.21.15.22:0/3588676229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009a20 con 0x7f74b0159950 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.728+0000 7f74b53be700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 0x7f74b015b320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f74a8013000 tx=0x7f74a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.729+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8027470 con 0x7f74b0159950 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.729+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8027610 con 0x7f74b0159950 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.729+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b015dc90 con 0x7f74b0159950 2023-10-08T00:26:18.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.729+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80279d0 con 0x7f74b0159950 2023-10-08T00:26:18.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.729+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b0159d20 con 0x7f74b0159950 2023-10-08T00:26:18.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.730+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b015e1b0 con 0x7f74b0159950 2023-10-08T00:26:18.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.730+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a8024070 con 0x7f74b0159950 2023-10-08T00:26:18.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.731+0000 7f74acff9700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f749c066f30 0x7f749c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.731+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f74a8086cc0 con 0x7f74b0159950 2023-10-08T00:26:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.731+0000 7f74b4bbd700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f749c066f30 0x7f749c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:18.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.732+0000 7f74b4bbd700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f749c066f30 0x7f749c0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74a0007fd0 tx=0x7f74a0007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:18.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.736+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74a8054110 con 0x7f74b0159950 2023-10-08T00:26:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:18.929+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f74b00718b0 con 0x7f74b0159950 2023-10-08T00:26:19.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.587+0000 7f74acff9700 1 -- 172.21.15.22:0/3588676229 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7f74a8057730 con 0x7f74b0159950 2023-10-08T00:26:19.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.599+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f749c066f30 msgr2=0x7f749c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:19.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.599+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f749c066f30 0x7f749c0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f74a0007fd0 tx=0x7f74a0007d30 comp rx=0 tx=0).stop 2023-10-08T00:26:19.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.599+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 msgr2=0x7f74b015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:19.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.599+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 0x7f74b015b320 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f74a8013000 tx=0x7f74a8019000 comp rx=0 tx=0).stop 2023-10-08T00:26:19.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.603+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 shutdown_connections 2023-10-08T00:26:19.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.603+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74b0159950 0x7f74b015b320 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.603+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f749c066f30 0x7f749c0693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.603+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f74b0069c70 0x7f74b00b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.603+0000 7f74b6e21700 1 --2- 172.21.15.22:0/3588676229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b00af320 0x7f74b00b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.603+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 >> 172.21.15.22:0/3588676229 conn(0x7f74b0068e00 msgr2=0x7f74b0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.604+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 shutdown_connections 2023-10-08T00:26:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.604+0000 7f74b6e21700 1 -- 172.21.15.22:0/3588676229 wait complete. 2023-10-08T00:26:19.609 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:26:19.622 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:26:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.750+0000 7f2bdd538700 1 Processor -- start 2023-10-08T00:26:19.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.750+0000 7f2bdd538700 1 -- start start 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bdd538700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cca60 0x7f2bd815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bdd538700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2bd80cd0f0 0x7f2bd815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bdd538700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd8150b50 con 0x7f2bd80cc690 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bdd538700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80cede0 con 0x7f2bd80cd0f0 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bdd538700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80b2260 con 0x7f2bd80cca60 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2bd80cd0f0 0x7f2bd815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:19.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2bd80cc690 0x7f2bd80b1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46046/0 (socket says 172.21.15.22:46046) 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd6ffd700 1 -- 172.21.15.22:0/72494331 learned_addr learned my addr 172.21.15.22:0/72494331 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd77fe700 1 -- 172.21.15.22:0/72494331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cca60 msgr2=0x7f2bd815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd77fe700 1 --2- 172.21.15.22:0/72494331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cca60 0x7f2bd815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd77fe700 1 -- 172.21.15.22:0/72494331 >> v1:172.21.15.22:6789/0 conn(0x7f2bd80cc690 legacy=0x7f2bd80b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.751+0000 7f2bd5ffb700 1 -- 172.21.15.22:0/72494331 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162201175 0 0) 0x7f2bd8150b50 con 0x7f2bd80cc690 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bd77fe700 1 -- 172.21.15.22:0/72494331 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80b2540 con 0x7f2bd80cd0f0 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bd77fe700 1 --2- 172.21.15.22:0/72494331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cd0f0 0x7f2bd815d7c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009e60 tx=0x7f2bd0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867414b54428f0c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bd5ffb700 1 -- 172.21.15.22:0/72494331 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000e070 con 0x7f2bd80cd0f0 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bd5ffb700 1 -- 172.21.15.22:0/72494331 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd000bc30 con 0x7f2bd80cd0f0 2023-10-08T00:26:19.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bd5ffb700 1 -- 172.21.15.22:0/72494331 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0012430 con 0x7f2bd80cd0f0 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 -- 172.21.15.22:0/72494331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cd0f0 msgr2=0x7f2bd815d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 --2- 172.21.15.22:0/72494331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cd0f0 0x7f2bd815d7c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009e60 tx=0x7f2bd0009780 comp rx=0 tx=0).stop 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 -- 172.21.15.22:0/72494331 shutdown_connections 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 --2- 172.21.15.22:0/72494331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cd0f0 0x7f2bd815d7c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 --2- 172.21.15.22:0/72494331 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cca60 0x7f2bd815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 -- 172.21.15.22:0/72494331 >> 172.21.15.22:0/72494331 conn(0x7f2bd80d0630 msgr2=0x7f2bd80d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 -- 172.21.15.22:0/72494331 shutdown_connections 2023-10-08T00:26:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.752+0000 7f2bdd538700 1 -- 172.21.15.22:0/72494331 wait complete. 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 Processor -- start 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 -- start start 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd80cc690 0x7f2bd80b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 0x7f2bd81696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cd0f0 0x7f2bd80c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80c6950 con 0x7f2bd80cca60 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80c71f0 con 0x7f2bd80cc690 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bdd538700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80c9b30 con 0x7f2bd80cd0f0 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bd67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 0x7f2bd81696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bd67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 0x7f2bd81696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44850/0 (socket says 172.21.15.22:44850) 2023-10-08T00:26:19.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.754+0000 7f2bd67fc700 1 -- 172.21.15.22:0/3338353049 learned_addr learned my addr 172.21.15.22:0/3338353049 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd77fe700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cd0f0 0x7f2bd80c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd6ffd700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd80cc690 0x7f2bd80b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd67fc700 1 -- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cd0f0 msgr2=0x7f2bd80c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd67fc700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cd0f0 0x7f2bd80c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd67fc700 1 -- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd80cc690 msgr2=0x7f2bd80b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd67fc700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd80cc690 0x7f2bd80b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd67fc700 1 -- 172.21.15.22:0/3338353049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0009a20 con 0x7f2bd80cca60 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bd67fc700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 0x7f2bd81696a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00b810 tx=0x7f2bcc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00f5f0 con 0x7f2bd80cca60 2023-10-08T00:26:19.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00f750 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd80c6ba0 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00fb10 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.755+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd80b53b0 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.756+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd80c7040 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.757+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bcc010480 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.757+0000 7f2bbeffd700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2bc4066f30 0x7f2bc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.757+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2bcc0843e0 con 0x7f2bd80cca60 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.757+0000 7f2bd6ffd700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2bc4066f30 0x7f2bc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:19.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.758+0000 7f2bd6ffd700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2bc4066f30 0x7f2bc40693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80011e0 tx=0x7f2bc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:19.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.762+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bcc051730 con 0x7f2bd80cca60 2023-10-08T00:26:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:19.999+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2bd80c7360 con 0x7f2bd80cca60 2023-10-08T00:26:20.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T00:26:20.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.602+0000 7f2bbeffd700 1 -- 172.21.15.22:0/3338353049 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2bcc054d50 con 0x7f2bd80cca60 2023-10-08T00:26:20.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.617+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2bc4066f30 msgr2=0x7f2bc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.617+0000 7f2bdd538700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2bc4066f30 0x7f2bc40693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80011e0 tx=0x7f2bc8009040 comp rx=0 tx=0).stop 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.617+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 msgr2=0x7f2bd81696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.617+0000 7f2bdd538700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 0x7f2bd81696a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00b810 tx=0x7f2bcc009220 comp rx=0 tx=0).stop 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 shutdown_connections 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2bc4066f30 0x7f2bc40693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2bd80cd0f0 0x7f2bd80c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd80cc690 0x7f2bd80b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 --2- 172.21.15.22:0/3338353049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bd80cca60 0x7f2bd81696a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 >> 172.21.15.22:0/3338353049 conn(0x7f2bd80d0630 msgr2=0x7f2bd8069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:20.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 shutdown_connections 2023-10-08T00:26:20.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.618+0000 7f2bdd538700 1 -- 172.21.15.22:0/3338353049 wait complete. 2023-10-08T00:26:20.620 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 8 and data pool 9 2023-10-08T00:26:20.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.753+0000 7f57ec5c7700 1 Processor -- start 2023-10-08T00:26:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.753+0000 7f57ec5c7700 1 -- start start 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ec5c7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57e4159b10 0x7f57e40cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ec5c7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ec5c7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57e4159ee0 0x7f57e415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ec5c7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e40c74b0 con 0x7f57e4159ee0 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ec5c7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e415e0e0 con 0x7f57e4159b10 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ec5c7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40c8700 con 0x7f57e415d730 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57e4159ee0 0x7f57e415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57e4159ee0 0x7f57e415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44856/0 (socket says 172.21.15.22:44856) 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 -- 172.21.15.22:0/1896076714 learned_addr learned my addr 172.21.15.22:0/1896076714 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57e9b62700 1 --2- 172.21.15.22:0/1896076714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57ea363700 1 --2- 172.21.15.22:0/1896076714 >> v2:172.21.15.192:3300/0 conn(0x7f57e4159b10 0x7f57e40cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 -- 172.21.15.22:0/1896076714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 msgr2=0x7f57e415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 --2- 172.21.15.22:0/1896076714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 -- 172.21.15.22:0/1896076714 >> v2:172.21.15.192:3300/0 conn(0x7f57e4159b10 msgr2=0x7f57e40cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 --2- 172.21.15.22:0/1896076714 >> v2:172.21.15.192:3300/0 conn(0x7f57e4159b10 0x7f57e40cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 -- 172.21.15.22:0/1896076714 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40c9070 con 0x7f57e4159ee0 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57eab64700 1 --2- 172.21.15.22:0/1896076714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e415a360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f57e4063e90 tx=0x7f57dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ea54bb93192d5a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57e9361700 1 -- 172.21.15.22:0/1896076714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc00e070 con 0x7f57e4159ee0 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57e9361700 1 -- 172.21.15.22:0/1896076714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc00ba00 con 0x7f57e4159ee0 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.754+0000 7f57e9361700 1 -- 172.21.15.22:0/1896076714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0092e0 con 0x7f57e4159ee0 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 -- 172.21.15.22:0/1896076714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 msgr2=0x7f57e415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/1896076714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e415a360 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f57e4063e90 tx=0x7f57dc009840 comp rx=0 tx=0).stop 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 -- 172.21.15.22:0/1896076714 shutdown_connections 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/1896076714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e415a360 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/1896076714 >> v2:172.21.15.192:3300/0 conn(0x7f57e4159b10 0x7f57e40cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/1896076714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 -- 172.21.15.22:0/1896076714 >> 172.21.15.22:0/1896076714 conn(0x7f57e40c9870 msgr2=0x7f57e40c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 -- 172.21.15.22:0/1896076714 shutdown_connections 2023-10-08T00:26:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.755+0000 7f57ec5c7700 1 -- 172.21.15.22:0/1896076714 wait complete. 2023-10-08T00:26:20.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.756+0000 7f57ec5c7700 1 Processor -- start 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.756+0000 7f57ec5c7700 1 -- start start 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ec5c7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e4159b10 0x7f57e41533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ec5c7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e40b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ec5c7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e4068ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ec5c7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40b1280 con 0x7f57e4159ee0 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ec5c7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40b1b20 con 0x7f57e4159b10 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ec5c7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e415bc00 con 0x7f57e415d730 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e40b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e40b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44872/0 (socket says 172.21.15.22:44872) 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 -- 172.21.15.22:0/492342287 learned_addr learned my addr 172.21.15.22:0/492342287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57ea363700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e4159b10 0x7f57e41533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57eab64700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e4068ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 -- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 msgr2=0x7f57e4068ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e4068ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 -- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e4159b10 msgr2=0x7f57e41533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e4159b10 0x7f57e41533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.757+0000 7f57e9b62700 1 -- 172.21.15.22:0/492342287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc009ae0 con 0x7f57e4159ee0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.758+0000 7f57e9b62700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e40b1fb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f57d400e930 tx=0x7f57d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.758+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4013680 con 0x7f57e4159ee0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.758+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d40137e0 con 0x7f57e4159ee0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.758+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e40b14d0 con 0x7f57e4159ee0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.758+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4013ba0 con 0x7f57e4159ee0 2023-10-08T00:26:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.758+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e4153910 con 0x7f57e4159ee0 2023-10-08T00:26:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.759+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e406bb80 con 0x7f57e4159ee0 2023-10-08T00:26:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.759+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57d400c3e0 con 0x7f57e4159ee0 2023-10-08T00:26:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.760+0000 7f57da7fc700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c8066f30 0x7f57c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.760+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57d4084560 con 0x7f57e4159ee0 2023-10-08T00:26:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.760+0000 7f57ea363700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c8066f30 0x7f57c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.760+0000 7f57ea363700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c8066f30 0x7f57c80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009db0 tx=0x7f57e00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:20.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.764+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57d40517d0 con 0x7f57e4159ee0 2023-10-08T00:26:20.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.959+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57e40b1c90 con 0x7f57e4159ee0 2023-10-08T00:26:20.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.960+0000 7f57da7fc700 1 -- 172.21.15.22:0/492342287 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f57d4054df0 con 0x7f57e4159ee0 2023-10-08T00:26:20.961 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:20.961 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:20.001038+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:18.392931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:18.960391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:20.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c8066f30 msgr2=0x7f57c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c8066f30 0x7f57c80693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f57e0009db0 tx=0x7f57e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 msgr2=0x7f57e40b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e40b1fb0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f57d400e930 tx=0x7f57d40091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 shutdown_connections 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c8066f30 0x7f57c80693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57e415d730 0x7f57e4068ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57e4159b10 0x7f57e41533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 --2- 172.21.15.22:0/492342287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57e4159ee0 0x7f57e40b1fb0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 >> 172.21.15.22:0/492342287 conn(0x7f57e40c9870 msgr2=0x7f57e40c7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 shutdown_connections 2023-10-08T00:26:20.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:20.962+0000 7f57ec5c7700 1 -- 172.21.15.22:0/492342287 wait complete. 2023-10-08T00:26:20.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:21.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.093+0000 7fb0212a7700 1 Processor -- start 2023-10-08T00:26:21.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.093+0000 7fb0212a7700 1 -- start start 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb0212a7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb01c0cd0f0 0x7fb01c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb0212a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 0x7fb01c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb0212a7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0d01f0 con 0x7fb01c1594d0 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb0212a7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0cd540 con 0x7fb01c0cd0f0 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb0212a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0cf5e0 con 0x7fb01c159de0 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 0x7fb01c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01a7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb01c0cd0f0 0x7fb01c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01affd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb01c1594d0 0x7fb01c0b5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:48444/0 (socket says 172.21.15.22:48444) 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 0x7fb01c15a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47796/0 (socket says 172.21.15.22:47796) 2023-10-08T00:26:21.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01affd700 1 -- 172.21.15.22:0/3723674425 learned_addr learned my addr 172.21.15.22:0/3723674425 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01a7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb01c0cd0f0 0x7fb01c1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:54622/0 (socket says 172.21.15.22:54622) 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01b7fe700 1 -- 172.21.15.22:0/3723674425 >> v2:172.21.15.192:3300/0 conn(0x7fb01c0cd0f0 msgr2=0x7fb01c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01b7fe700 1 --2- 172.21.15.22:0/3723674425 >> v2:172.21.15.192:3300/0 conn(0x7fb01c0cd0f0 0x7fb01c1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb019ffb700 1 -- 172.21.15.22:0/3723674425 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203876361 0 0) 0x7fb01c0d01f0 con 0x7fb01c1594d0 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01b7fe700 1 -- 172.21.15.22:0/3723674425 >> v1:172.21.15.192:6789/0 conn(0x7fb01c1594d0 legacy=0x7fb01c0b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.094+0000 7fb01b7fe700 1 -- 172.21.15.22:0/3723674425 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0cf8c0 con 0x7fb01c159de0 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb01b7fe700 1 --2- 172.21.15.22:0/3723674425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 0x7fb01c15a220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb014009e60 tx=0x7fb014009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25116d2421e3a1ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb019ffb700 1 -- 172.21.15.22:0/3723674425 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400e070 con 0x7fb01c159de0 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb019ffb700 1 -- 172.21.15.22:0/3723674425 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400bb60 con 0x7fb01c159de0 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb019ffb700 1 -- 172.21.15.22:0/3723674425 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014012430 con 0x7fb01c159de0 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 -- 172.21.15.22:0/3723674425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 msgr2=0x7fb01c15a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 --2- 172.21.15.22:0/3723674425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 0x7fb01c15a220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb014009e60 tx=0x7fb014009780 comp rx=0 tx=0).stop 2023-10-08T00:26:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 -- 172.21.15.22:0/3723674425 shutdown_connections 2023-10-08T00:26:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 --2- 172.21.15.22:0/3723674425 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c159de0 0x7fb01c15a220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 --2- 172.21.15.22:0/3723674425 >> v2:172.21.15.192:3300/0 conn(0x7fb01c0cd0f0 0x7fb01c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 -- 172.21.15.22:0/3723674425 >> 172.21.15.22:0/3723674425 conn(0x7fb01c0d05f0 msgr2=0x7fb01c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 -- 172.21.15.22:0/3723674425 shutdown_connections 2023-10-08T00:26:21.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.095+0000 7fb0212a7700 1 -- 172.21.15.22:0/3723674425 wait complete. 2023-10-08T00:26:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 Processor -- start 2023-10-08T00:26:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 -- start start 2023-10-08T00:26:21.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb01c0cd0f0 0x7fb01c14b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c1594d0 0x7fb01c0696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 0x7fb01c069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c14bad0 con 0x7fb01c159de0 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c156640 con 0x7fb01c0cd0f0 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.097+0000 7fb0212a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c156920 con 0x7fb01c1594d0 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 0x7fb01c069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 0x7fb01c069c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44878/0 (socket says 172.21.15.22:44878) 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 -- 172.21.15.22:0/205035027 learned_addr learned my addr 172.21.15.22:0/205035027 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01affd700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb01c0cd0f0 0x7fb01c14b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01a7fc700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c1594d0 0x7fb01c0696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 -- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c1594d0 msgr2=0x7fb01c0696e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c1594d0 0x7fb01c0696e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 -- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb01c0cd0f0 msgr2=0x7fb01c14b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb01c0cd0f0 0x7fb01c14b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 -- 172.21.15.22:0/205035027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009a20 con 0x7fb01c159de0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01a7fc700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c1594d0 0x7fb01c0696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb01b7fe700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 0x7fb01c069c20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb01400b6c0 tx=0x7fb014019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014027470 con 0x7fb01c159de0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0140275d0 con 0x7fb01c159de0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c156c00 con 0x7fb01c159de0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014027970 con 0x7fb01c159de0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.098+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c169590 con 0x7fb01c159de0 2023-10-08T00:26:21.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.099+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c169800 con 0x7fb01c159de0 2023-10-08T00:26:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.100+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb014024070 con 0x7fb01c159de0 2023-10-08T00:26:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.100+0000 7fb002ffd700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.100+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb014086c80 con 0x7fb01c159de0 2023-10-08T00:26:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.100+0000 7fb01affd700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.101+0000 7fb01affd700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb008066f30 0x7fb0080693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb01c157950 tx=0x7fb00c007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:21.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.104+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb01c169800 con 0x7fb01c159de0 2023-10-08T00:26:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.299+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb01c169800 con 0x7fb01c159de0 2023-10-08T00:26:21.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.300+0000 7fb002ffd700 1 -- 172.21.15.22:0/205035027 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15363 (secure 0 0 0) 0x7fb01c169800 con 0x7fb01c159de0 2023-10-08T00:26:21.300 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:21.301 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:20.001038+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:18.392931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:18.960391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb008066f30 msgr2=0x7fb0080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb008066f30 0x7fb0080693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb01c157950 tx=0x7fb00c007d30 comp rx=0 tx=0).stop 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 msgr2=0x7fb01c069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 0x7fb01c069c20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb01400b6c0 tx=0x7fb014019000 comp rx=0 tx=0).stop 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 shutdown_connections 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb01c159de0 0x7fb01c069c20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb01c0cd0f0 0x7fb01c14b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb008066f30 0x7fb0080693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 --2- 172.21.15.22:0/205035027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb01c1594d0 0x7fb01c0696e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 >> 172.21.15.22:0/205035027 conn(0x7fb01c0d05f0 msgr2=0x7fb01c154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 shutdown_connections 2023-10-08T00:26:21.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.302+0000 7fb0212a7700 1 -- 172.21.15.22:0/205035027 wait complete. 2023-10-08T00:26:21.315 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:26:21.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.436+0000 7f3fcd173700 1 Processor -- start 2023-10-08T00:26:21.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.436+0000 7f3fcd173700 1 -- start start 2023-10-08T00:26:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fcd173700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 0x7f3fc80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fcd173700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3fc815df50 0x7f3fc815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fcd173700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc815d7e0 con 0x7f3fc806bcd0 2023-10-08T00:26:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fcd173700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc815dac0 con 0x7f3fc815df50 2023-10-08T00:26:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fcd173700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815aa30 con 0x7f3fc806c0a0 2023-10-08T00:26:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fc6d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3fc806bcd0 0x7f3fc815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46054/0 (socket says 172.21.15.22:46054) 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fc6d9d700 1 -- 172.21.15.22:0/1127752254 learned_addr learned my addr 172.21.15.22:0/1127752254 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643389037 0 0) 0x7f3fc815d7e0 con 0x7f3fc806bcd0 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb4003570 con 0x7f3fc806bcd0 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fc759e700 1 --2- 172.21.15.22:0/1127752254 >> v2:172.21.15.192:3300/0 conn(0x7f3fc815df50 0x7f3fc815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.437+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 0x7f3fc80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937692243 0 0) 0x7f3fb4003570 con 0x7f3fc806bcd0 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 msgr2=0x7f3fc80caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 0x7f3fc80caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 >> v2:172.21.15.192:3300/0 conn(0x7f3fc815df50 msgr2=0x7f3fc815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 --2- 172.21.15.22:0/1127752254 >> v2:172.21.15.192:3300/0 conn(0x7f3fc815df50 0x7f3fc815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc815ad10 con 0x7f3fc806bcd0 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f3fb8001470 con 0x7f3fc806bcd0 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 >> v1:172.21.15.22:6789/0 conn(0x7f3fc806bcd0 legacy=0x7f3fc815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 0x7f3fb4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4003fe0 0x7f3fb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815dac0 con 0x7f3fb4003fe0 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815aa30 con 0x7f3fb4004d50 2023-10-08T00:26:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb400bb40 con 0x7f3fc806c0a0 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4003fe0 0x7f3fb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc6d9d700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 0x7f3fb4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc759e700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 -- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 msgr2=0x7f3fb4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fc806c0a0 0x7f3fb4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 -- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb4004d50 msgr2=0x7f3fb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 -- 172.21.15.22:0/1127752254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4003570 con 0x7f3fb4003fe0 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc759e700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb4004d50 0x7f3fb40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4003fe0 0x7f3fb4004810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0006f00 tx=0x7f3fb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d9b2ea177dca7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000e710 con 0x7f3fb4003fe0 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000e870 con 0x7f3fb4003fe0 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.438+0000 7f3fc5d9b700 1 -- 172.21.15.22:0/1127752254 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000ec30 con 0x7f3fb4003fe0 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fcd173700 1 -- 172.21.15.22:0/1127752254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4003fe0 msgr2=0x7f3fb4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1127752254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4003fe0 0x7f3fb4004810 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0006f00 tx=0x7f3fb00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fc759e700 1 -- 172.21.15.22:0/1127752254 reap_dead start 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fcd173700 1 -- 172.21.15.22:0/1127752254 shutdown_connections 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fcd173700 1 -- 172.21.15.22:0/1127752254 >> 172.21.15.22:0/1127752254 conn(0x7f3fc80ce600 msgr2=0x7f3fc80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fcd173700 1 -- 172.21.15.22:0/1127752254 shutdown_connections 2023-10-08T00:26:21.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.439+0000 7f3fcd173700 1 -- 172.21.15.22:0/1127752254 wait complete. 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.440+0000 7f3fcd173700 1 Processor -- start 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.440+0000 7f3fcd173700 1 -- start start 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fcd173700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb4003fe0 0x7f3fc80b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fcd173700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 0x7f3fc806a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fcd173700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fc806ab40 0x7f3fc8169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fcd173700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc806afe0 con 0x7f3fc80c5c60 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fcd173700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc816abf0 con 0x7f3fc806ab40 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fcd173700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80c7a40 con 0x7f3fb4003fe0 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 0x7f3fc806a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 0x7f3fc806a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44892/0 (socket says 172.21.15.22:44892) 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 -- 172.21.15.22:0/1468431556 learned_addr learned my addr 172.21.15.22:0/1468431556 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc759e700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fc806ab40 0x7f3fc8169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc6d9d700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb4003fe0 0x7f3fc80b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 -- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb4003fe0 msgr2=0x7f3fc80b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb4003fe0 0x7f3fc80b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 -- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fc806ab40 msgr2=0x7f3fc8169e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fc806ab40 0x7f3fc8169e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.441+0000 7f3fc659c700 1 -- 172.21.15.22:0/1468431556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80c7d20 con 0x7f3fc80c5c60 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.442+0000 7f3fc659c700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 0x7f3fc806a600 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400ba90 tx=0x7f3fb001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.442+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0023070 con 0x7f3fc80c5c60 2023-10-08T00:26:21.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.442+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000e9e0 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.442+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc80c8000 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.442+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb001e030 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.442+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc80c7660 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.443+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc804c3c0 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.443+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fb0013470 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.444+0000 7f3fbeffd700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fa8066f30 0x7f3fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.444+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fb00859a0 con 0x7f3fc80c5c60 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.444+0000 7f3fc6d9d700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fa8066f30 0x7f3fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:21.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.444+0000 7f3fc6d9d700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fa8066f30 0x7f3fa80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8000fd0 tx=0x7f3fb8001e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:21.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.448+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fb0052cd0 con 0x7f3fc80c5c60 2023-10-08T00:26:21.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:21.688+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3fc815aff0 con 0x7f3fc80c5c60 2023-10-08T00:26:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.609+0000 7f3fbeffd700 1 -- 172.21.15.22:0/1468431556 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3fb0017020 con 0x7f3fc80c5c60 2023-10-08T00:26:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fa8066f30 msgr2=0x7f3fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fa8066f30 0x7f3fa80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8000fd0 tx=0x7f3fb8001e90 comp rx=0 tx=0).stop 2023-10-08T00:26:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 msgr2=0x7f3fc806a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 0x7f3fc806a600 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400ba90 tx=0x7f3fb001a000 comp rx=0 tx=0).stop 2023-10-08T00:26:22.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 shutdown_connections 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fc806ab40 0x7f3fc8169e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fa8066f30 0x7f3fa80693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fb4003fe0 0x7f3fc80b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 --2- 172.21.15.22:0/1468431556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc80c5c60 0x7f3fc806a600 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.611+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 >> 172.21.15.22:0/1468431556 conn(0x7f3fc80ce600 msgr2=0x7f3fc8157180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.612+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 shutdown_connections 2023-10-08T00:26:22.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.612+0000 7f3fcd173700 1 -- 172.21.15.22:0/1468431556 wait complete. 2023-10-08T00:26:22.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:26:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.754+0000 7f826003d700 1 Processor -- start 2023-10-08T00:26:22.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.754+0000 7f826003d700 1 -- start start 2023-10-08T00:26:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.755+0000 7f826003d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8258069560 0x7f82580699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.755+0000 7f826003d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8258069ee0 con 0x7f8258159890 2023-10-08T00:26:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.755+0000 7f826003d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825815a160 con 0x7f8258159c60 2023-10-08T00:26:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.755+0000 7f826003d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82580d13a0 con 0x7f8258069560 2023-10-08T00:26:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.755+0000 7f825ddd9700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8258159890 0x7f825815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46062/0 (socket says 172.21.15.22:46062) 2023-10-08T00:26:22.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.755+0000 7f825ddd9700 1 -- 172.21.15.22:0/2079114845 learned_addr learned my addr 172.21.15.22:0/2079114845 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251250645 0 0) 0x7f8258069ee0 con 0x7f8258159890 2023-10-08T00:26:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825e5da700 1 --2- 172.21.15.22:0/2079114845 >> v2:172.21.15.192:3300/0 conn(0x7f8258069560 0x7f82580699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8240003570 con 0x7f8258159890 2023-10-08T00:26:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1211240312 0 0) 0x7f8240003570 con 0x7f8258159890 2023-10-08T00:26:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 >> v2:172.21.15.192:3300/0 conn(0x7f8258069560 msgr2=0x7f82580699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:22.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 --2- 172.21.15.22:0/2079114845 >> v2:172.21.15.192:3300/0 conn(0x7f8258069560 0x7f82580699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 >> v1:172.21.15.192:6789/0 conn(0x7f8258159c60 legacy=0x7f825815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825815e140 con 0x7f8258159890 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f82480017f0 con 0x7f8258159890 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825e5da700 1 --2- 172.21.15.22:0/2079114845 >> v2:172.21.15.192:3300/0 conn(0x7f8258069560 0x7f82580699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 >> v1:172.21.15.22:6789/0 conn(0x7f8258159890 legacy=0x7f825815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f8240003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8240004810 0x7f8240004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8240005210 0x7f824000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580d13a0 con 0x7f8240003a60 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824000c100 con 0x7f8240004810 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824000c2c0 con 0x7f8240005210 2023-10-08T00:26:22.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825ddd9700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f8240003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825d5d8700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8240004810 0x7f8240004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825e5da700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8240005210 0x7f824000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825ddd9700 1 -- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8240005210 msgr2=0x7f824000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825ddd9700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8240005210 0x7f824000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825ddd9700 1 -- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8240004810 msgr2=0x7f8240004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.756+0000 7f825ddd9700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8240004810 0x7f8240004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f825e5da700 1 -- 172.21.15.22:0/2079114845 reap_dead start 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f825ddd9700 1 -- 172.21.15.22:0/2079114845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240003570 con 0x7f8240003a60 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f825ddd9700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f8240003e50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f824800a910 tx=0x7f82480021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0af4724045164b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480070d0 con 0x7f8240003a60 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248007230 con 0x7f8240003a60 2023-10-08T00:26:22.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f825cdd7700 1 -- 172.21.15.22:0/2079114845 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480075f0 con 0x7f8240003a60 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f826003d700 1 -- 172.21.15.22:0/2079114845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 msgr2=0x7f8240003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f826003d700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f8240003e50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f824800a910 tx=0x7f82480021b0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f826003d700 1 -- 172.21.15.22:0/2079114845 shutdown_connections 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f826003d700 1 --2- 172.21.15.22:0/2079114845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f8240003e50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f826003d700 1 -- 172.21.15.22:0/2079114845 >> 172.21.15.22:0/2079114845 conn(0x7f8258068e20 msgr2=0x7f82580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.757+0000 7f826003d700 1 -- 172.21.15.22:0/2079114845 shutdown_connections 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.758+0000 7f826003d700 1 -- 172.21.15.22:0/2079114845 wait complete. 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 Processor -- start 2023-10-08T00:26:22.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 -- start start 2023-10-08T00:26:22.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f82581492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82580cecb0 0x7f825815cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82580cf120 0x7f825815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b3970 con 0x7f8240003a60 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b3c50 con 0x7f82580cf120 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f826003d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82580b3f30 con 0x7f82580cecb0 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f825ddd9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f82581492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f825ddd9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f82581492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44912/0 (socket says 172.21.15.22:44912) 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.759+0000 7f825ddd9700 1 -- 172.21.15.22:0/3920211910 learned_addr learned my addr 172.21.15.22:0/3920211910 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825d5d8700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82580cecb0 0x7f825815cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825ddd9700 1 -- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82580cecb0 msgr2=0x7f825815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825e5da700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82580cf120 0x7f825815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825ddd9700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82580cecb0 0x7f825815cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825ddd9700 1 -- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82580cf120 msgr2=0x7f825815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825ddd9700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82580cf120 0x7f825815d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825ddd9700 1 -- 172.21.15.22:0/3920211910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82580b4210 con 0x7f8240003a60 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825d5d8700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82580cecb0 0x7f825815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825e5da700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82580cf120 0x7f825815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f825ddd9700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f82581492a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8248001cc0 tx=0x7f8248015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8248001900 con 0x7f8240003a60 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248012610 con 0x7f8240003a60 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82580b44f0 con 0x7f8240003a60 2023-10-08T00:26:22.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82480127e0 con 0x7f8240003a60 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.760+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82580b3590 con 0x7f8240003a60 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.761+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825804c3c0 con 0x7f8240003a60 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.762+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8248024020 con 0x7f8240003a60 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.762+0000 7f8255ffb700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8244066f30 0x7f82440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.762+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8248086330 con 0x7f8240003a60 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.762+0000 7f825d5d8700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8244066f30 0x7f82440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.763+0000 7f825d5d8700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8244066f30 0x7f82440693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f824c007bc0 tx=0x7f824c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:22.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:22.766+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82480535a0 con 0x7f8240003a60 2023-10-08T00:26:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.006+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f825806a5b0 con 0x7f8240003a60 2023-10-08T00:26:23.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.613+0000 7f8255ffb700 1 -- 172.21.15.22:0/3920211910 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8248056bc0 con 0x7f8240003a60 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8244066f30 msgr2=0x7f82440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8244066f30 0x7f82440693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f824c007bc0 tx=0x7f824c009040 comp rx=0 tx=0).stop 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 msgr2=0x7f82581492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f82581492a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8248001cc0 tx=0x7f8248015000 comp rx=0 tx=0).stop 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 shutdown_connections 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82580cf120 0x7f825815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8240003a60 0x7f82581492a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8244066f30 0x7f82440693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 --2- 172.21.15.22:0/3920211910 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82580cecb0 0x7f825815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 >> 172.21.15.22:0/3920211910 conn(0x7f8258068e20 msgr2=0x7f82580b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 shutdown_connections 2023-10-08T00:26:23.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.615+0000 7f826003d700 1 -- 172.21.15.22:0/3920211910 wait complete. 2023-10-08T00:26:23.629 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.751+0000 7f5f0554f700 1 Processor -- start 2023-10-08T00:26:23.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.751+0000 7f5f0554f700 1 -- start start 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5f0554f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f00141500 0x7f5f000c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5f0554f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0015c2a0 con 0x7f5f0006bcd0 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5f0554f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0015b690 con 0x7f5f0006c0a0 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5f0554f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0015b970 con 0x7f5f00141500 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5efeffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5f0006bcd0 0x7f5f00140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46066/0 (socket says 172.21.15.22:46066) 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5efeffd700 1 -- 172.21.15.22:0/3775409263 learned_addr learned my addr 172.21.15.22:0/3775409263 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:23.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5efe7fc700 1 --2- 172.21.15.22:0/3775409263 >> v2:172.21.15.192:3300/0 conn(0x7f5f00141500 0x7f5f000c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.752+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322618848 0 0) 0x7f5f0015c2a0 con 0x7f5f0006bcd0 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eec003570 con 0x7f5f0006bcd0 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697762009 0 0) 0x7f5eec003570 con 0x7f5f0006bcd0 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 >> v2:172.21.15.192:3300/0 conn(0x7f5f00141500 msgr2=0x7f5f000c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 --2- 172.21.15.22:0/3775409263 >> v2:172.21.15.192:3300/0 conn(0x7f5f00141500 0x7f5f000c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 >> v1:172.21.15.192:6789/0 conn(0x7f5f0006c0a0 legacy=0x7f5f000c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0015bc50 con 0x7f5f0006bcd0 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5ef0001470 con 0x7f5f0006bcd0 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 >> v1:172.21.15.22:6789/0 conn(0x7f5f0006bcd0 legacy=0x7f5f00140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5eec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eec0051c0 0x7f5eec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0015b970 con 0x7f5eec003a60 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec00c0d0 con 0x7f5eec0051c0 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec00c290 con 0x7f5eec004810 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efeffd700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5eec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5eff7fe700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eec0051c0 0x7f5eec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efe7fc700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efeffd700 1 -- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eec004810 msgr2=0x7f5eec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efeffd700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eec004810 0x7f5eec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efeffd700 1 -- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eec0051c0 msgr2=0x7f5eec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efeffd700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eec0051c0 0x7f5eec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5efeffd700 1 -- 172.21.15.22:0/3775409263 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec003570 con 0x7f5eec003a60 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.753+0000 7f5eff7fe700 1 -- 172.21.15.22:0/3775409263 reap_dead start 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5efeffd700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5eec003e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c390 tx=0x7f5f0015c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba16ff818f6e554 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000cc60 con 0x7f5eec003a60 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef000cdc0 con 0x7f5eec003a60 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5efdffb700 1 -- 172.21.15.22:0/3775409263 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0005b70 con 0x7f5eec003a60 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 -- 172.21.15.22:0/3775409263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 msgr2=0x7f5eec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5eec003e70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c390 tx=0x7f5f0015c210 comp rx=0 tx=0).stop 2023-10-08T00:26:23.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 -- 172.21.15.22:0/3775409263 shutdown_connections 2023-10-08T00:26:23.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 --2- 172.21.15.22:0/3775409263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5eec003e70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 -- 172.21.15.22:0/3775409263 >> 172.21.15.22:0/3775409263 conn(0x7f5f000ce600 msgr2=0x7f5f000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:23.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 -- 172.21.15.22:0/3775409263 shutdown_connections 2023-10-08T00:26:23.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.754+0000 7f5f0554f700 1 -- 172.21.15.22:0/3775409263 wait complete. 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.755+0000 7f5f0554f700 1 Processor -- start 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 -- start start 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5f00152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f000b3b70 0x7f5f001544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00154a10 0x7f5f000694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000b2800 con 0x7f5eec003a60 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0013cda0 con 0x7f5f00154a10 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5f0554f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00154eb0 con 0x7f5f000b3b70 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5efeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5f00152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5efeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5f00152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44922/0 (socket says 172.21.15.22:44922) 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.756+0000 7f5efeffd700 1 -- 172.21.15.22:0/2766784034 learned_addr learned my addr 172.21.15.22:0/2766784034 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efe7fc700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f000b3b70 0x7f5f001544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5eff7fe700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00154a10 0x7f5f000694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efeffd700 1 -- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f000b3b70 msgr2=0x7f5f001544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efeffd700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f000b3b70 0x7f5f001544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efeffd700 1 -- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00154a10 msgr2=0x7f5f000694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efeffd700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00154a10 0x7f5f000694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efeffd700 1 -- 172.21.15.22:0/2766784034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f000b3fe0 con 0x7f5eec003a60 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5eff7fe700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00154a10 0x7f5f000694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5efeffd700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5f00152e50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c0a0 tx=0x7f5ef0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:23.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0022070 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef0000bc0 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f000b1760 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0007300 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.757+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f000b1d20 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.758+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0004c3c0 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.758+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ef00076b0 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.759+0000 7f5ef6ffd700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.759+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ef00854e0 con 0x7f5eec003a60 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.759+0000 7f5efe7fc700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.759+0000 7f5efe7fc700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5ee0066f30 0x7f5ee00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f0016d630 tx=0x7f5ee8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.763+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ef0052750 con 0x7f5eec003a60 2023-10-08T00:26:23.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.999+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f0015bf30 con 0x7f5eec003a60 2023-10-08T00:26:24.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:23.999+0000 7f5ef6ffd700 1 -- 172.21.15.22:0/2766784034 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f5ef0017090 con 0x7f5eec003a60 2023-10-08T00:26:24.000 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:24.000 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:20.001353+0000","modified":"2023-10-08T00:26:23.607891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/1300992790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1300992790},{"type":"v1","addr":"172.21.15.22:6835","nonce":1300992790}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T00:26:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5ee0066f30 msgr2=0x7f5ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5ee0066f30 0x7f5ee00693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f0016d630 tx=0x7f5ee8008040 comp rx=0 tx=0).stop 2023-10-08T00:26:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 msgr2=0x7f5f00152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5f00152e50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c0a0 tx=0x7f5ef0015000 comp rx=0 tx=0).stop 2023-10-08T00:26:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 shutdown_connections 2023-10-08T00:26:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f00154a10 0x7f5f000694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eec003a60 0x7f5f00152e50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5ee0066f30 0x7f5ee00693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 --2- 172.21.15.22:0/2766784034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f000b3b70 0x7f5f001544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 >> 172.21.15.22:0/2766784034 conn(0x7f5f000ce600 msgr2=0x7f5f00156240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 shutdown_connections 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.001+0000 7f5f0554f700 1 -- 172.21.15.22:0/2766784034 wait complete. 2023-10-08T00:26:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 32 2023-10-08T00:26:24.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.132+0000 7f39c7c0c700 1 Processor -- start 2023-10-08T00:26:24.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.133+0000 7f39c7c0c700 1 -- start start 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.133+0000 7f39c7c0c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39c0159c60 0x7f39c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.133+0000 7f39c7c0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c015db10 0x7f39c0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.133+0000 7f39c7c0c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c015a160 con 0x7f39c0159890 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.133+0000 7f39c7c0c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c015df50 con 0x7f39c0159c60 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.133+0000 7f39c7c0c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00d13a0 con 0x7f39c015db10 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c59a8700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f39c0159890 0x7f39c015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46080/0 (socket says 172.21.15.22:46080) 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c59a8700 1 -- 172.21.15.22:0/236035925 learned_addr learned my addr 172.21.15.22:0/236035925 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c51a7700 1 --2- 172.21.15.22:0/236035925 >> v2:172.21.15.192:3300/0 conn(0x7f39c0159c60 0x7f39c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c61a9700 1 --2- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c015db10 0x7f39c0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c49a6700 1 -- 172.21.15.22:0/236035925 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268076518 0 0) 0x7f39c015a160 con 0x7f39c0159890 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c49a6700 1 -- 172.21.15.22:0/236035925 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a8003570 con 0x7f39c0159890 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c51a7700 1 -- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c015db10 msgr2=0x7f39c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c51a7700 1 --2- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c015db10 0x7f39c0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c51a7700 1 -- 172.21.15.22:0/236035925 >> v1:172.21.15.22:6789/0 conn(0x7f39c0159890 legacy=0x7f39c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c51a7700 1 -- 172.21.15.22:0/236035925 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c015e140 con 0x7f39c0159c60 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c51a7700 1 --2- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0159c60 0x7f39c015d5d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f39b40098e0 tx=0x7f39b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50cc117247ebfc13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.134+0000 7f39c49a6700 1 -- 172.21.15.22:0/236035925 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4011630 con 0x7f39c0159c60 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c49a6700 1 -- 172.21.15.22:0/236035925 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4011790 con 0x7f39c0159c60 2023-10-08T00:26:24.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c49a6700 1 -- 172.21.15.22:0/236035925 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4011b30 con 0x7f39c0159c60 2023-10-08T00:26:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 -- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0159c60 msgr2=0x7f39c015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0159c60 0x7f39c015d5d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f39b40098e0 tx=0x7f39b40091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 -- 172.21.15.22:0/236035925 shutdown_connections 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c015db10 0x7f39c0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/236035925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0159c60 0x7f39c015d5d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 -- 172.21.15.22:0/236035925 >> 172.21.15.22:0/236035925 conn(0x7f39c0068e20 msgr2=0x7f39c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 -- 172.21.15.22:0/236035925 shutdown_connections 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.135+0000 7f39c7c0c700 1 -- 172.21.15.22:0/236035925 wait complete. 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.136+0000 7f39c7c0c700 1 Processor -- start 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.136+0000 7f39c7c0c700 1 -- start start 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c7c0c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 0x7f39c013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c7c0c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c0159c60 0x7f39c00ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c7c0c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c015db10 0x7f39c00ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c7c0c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c013f0b0 con 0x7f39c0159890 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c7c0c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00cf290 con 0x7f39c015db10 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c7c0c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00cdcb0 con 0x7f39c0159c60 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 0x7f39c013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 0x7f39c013eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44928/0 (socket says 172.21.15.22:44928) 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 -- 172.21.15.22:0/3442790981 learned_addr learned my addr 172.21.15.22:0/3442790981 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c51a7700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c0159c60 0x7f39c00ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c61a9700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c015db10 0x7f39c00ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 -- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c0159c60 msgr2=0x7f39c00ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c0159c60 0x7f39c00ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 -- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c015db10 msgr2=0x7f39c00ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c015db10 0x7f39c00ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 -- 172.21.15.22:0/3442790981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4009420 con 0x7f39c0159890 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.137+0000 7f39c59a8700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 0x7f39c013eb70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c7c0 tx=0x7f39b8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.138+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8005b30 con 0x7f39c0159890 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.138+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b8005c90 con 0x7f39c0159890 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.138+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8007340 con 0x7f39c0159890 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.138+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c00cdf90 con 0x7f39c0159890 2023-10-08T00:26:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.138+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c00ce550 con 0x7f39c0159890 2023-10-08T00:26:24.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.139+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c004c3c0 con 0x7f39c0159890 2023-10-08T00:26:24.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.139+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39b801b400 con 0x7f39c0159890 2023-10-08T00:26:24.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.140+0000 7f39bdffb700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39ac066f30 0x7f39ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.140+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39b8083fd0 con 0x7f39c0159890 2023-10-08T00:26:24.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.140+0000 7f39c51a7700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39ac066f30 0x7f39ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.140+0000 7f39c51a7700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39ac066f30 0x7f39ac0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f39b40091e0 tx=0x7f39b4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.144+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39b80512c0 con 0x7f39c0159890 2023-10-08T00:26:24.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.340+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39c015b0c0 con 0x7f39c0159890 2023-10-08T00:26:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.341+0000 7f39bdffb700 1 -- 172.21.15.22:0/3442790981 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f39b80548e0 con 0x7f39c0159890 2023-10-08T00:26:24.341 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:24.342 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:21.596908+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:18.392931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:18.960391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:24.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39ac066f30 msgr2=0x7f39ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39ac066f30 0x7f39ac0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f39b40091e0 tx=0x7f39b4017000 comp rx=0 tx=0).stop 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 msgr2=0x7f39c013eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 0x7f39c013eb70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f39b800c7c0 tx=0x7f39b8007e00 comp rx=0 tx=0).stop 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 shutdown_connections 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c015db10 0x7f39c00ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39c0159890 0x7f39c013eb70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39ac066f30 0x7f39ac0693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 --2- 172.21.15.22:0/3442790981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39c0159c60 0x7f39c00ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 >> 172.21.15.22:0/3442790981 conn(0x7f39c0068e20 msgr2=0x7f39c00b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:24.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 shutdown_connections 2023-10-08T00:26:24.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.343+0000 7f39c7c0c700 1 -- 172.21.15.22:0/3442790981 wait complete. 2023-10-08T00:26:24.356 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:26:24.356 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:26:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.475+0000 7f4a232e6700 1 Processor -- start 2023-10-08T00:26:24.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.475+0000 7f4a232e6700 1 -- start start 2023-10-08T00:26:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a232e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 0x7f4a1c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a232e6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a1c15d230 0x7f4a1c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a232e6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c15dbd0 con 0x7f4a1c1597f0 2023-10-08T00:26:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a232e6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b2980 con 0x7f4a1c15d230 2023-10-08T00:26:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a232e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0b11d0 con 0x7f4a1c159420 2023-10-08T00:26:24.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a222e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 0x7f4a1c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a22ae5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a1c15d230 0x7f4a1c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a222e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 0x7f4a1c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47890/0 (socket says 172.21.15.22:47890) 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.476+0000 7f4a222e4700 1 -- 172.21.15.22:0/1563992808 learned_addr learned my addr 172.21.15.22:0/1563992808 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a222e4700 1 -- 172.21.15.22:0/1563992808 >> v2:172.21.15.192:3300/0 conn(0x7f4a1c15d230 msgr2=0x7f4a1c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a222e4700 1 --2- 172.21.15.22:0/1563992808 >> v2:172.21.15.192:3300/0 conn(0x7f4a1c15d230 0x7f4a1c15d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a222e4700 1 -- 172.21.15.22:0/1563992808 >> v1:172.21.15.192:6789/0 conn(0x7f4a1c1597f0 legacy=0x7f4a1c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a222e4700 1 -- 172.21.15.22:0/1563992808 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c0b14b0 con 0x7f4a1c159420 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a22ae5700 1 --2- 172.21.15.22:0/1563992808 >> v2:172.21.15.192:3300/0 conn(0x7f4a1c15d230 0x7f4a1c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a222e4700 1 --2- 172.21.15.22:0/1563992808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 0x7f4a1c0b5f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009f20 tx=0x7f4a0c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af87e75348c74d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a212e2700 1 -- 172.21.15.22:0/1563992808 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00e070 con 0x7f4a1c159420 2023-10-08T00:26:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a212e2700 1 -- 172.21.15.22:0/1563992808 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00b9d0 con 0x7f4a1c159420 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a212e2700 1 -- 172.21.15.22:0/1563992808 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0092e0 con 0x7f4a1c159420 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a232e6700 1 -- 172.21.15.22:0/1563992808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 msgr2=0x7f4a1c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.477+0000 7f4a232e6700 1 --2- 172.21.15.22:0/1563992808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 0x7f4a1c0b5f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009f20 tx=0x7f4a0c009840 comp rx=0 tx=0).stop 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.478+0000 7f4a232e6700 1 -- 172.21.15.22:0/1563992808 shutdown_connections 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.478+0000 7f4a232e6700 1 --2- 172.21.15.22:0/1563992808 >> v2:172.21.15.192:3300/0 conn(0x7f4a1c15d230 0x7f4a1c15d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.478+0000 7f4a232e6700 1 --2- 172.21.15.22:0/1563992808 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c159420 0x7f4a1c0b5f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.478+0000 7f4a232e6700 1 -- 172.21.15.22:0/1563992808 >> 172.21.15.22:0/1563992808 conn(0x7f4a1c0d0660 msgr2=0x7f4a1c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.478+0000 7f4a232e6700 1 -- 172.21.15.22:0/1563992808 shutdown_connections 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.478+0000 7f4a232e6700 1 -- 172.21.15.22:0/1563992808 wait complete. 2023-10-08T00:26:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 Processor -- start 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 -- start start 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a1c159420 0x7f4a1c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c1597f0 0x7f4a1c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 0x7f4a1c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c156180 con 0x7f4a1c15d230 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0ca950 con 0x7f4a1c159420 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.479+0000 7f4a232e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c0c6ef0 con 0x7f4a1c1597f0 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 0x7f4a1c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 0x7f4a1c069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44934/0 (socket says 172.21.15.22:44934) 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 -- 172.21.15.22:0/189717504 learned_addr learned my addr 172.21.15.22:0/189717504 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a222e4700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a1c159420 0x7f4a1c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a21ae3700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c1597f0 0x7f4a1c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 -- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c1597f0 msgr2=0x7f4a1c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c1597f0 0x7f4a1c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 -- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a1c159420 msgr2=0x7f4a1c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a1c159420 0x7f4a1c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 -- 172.21.15.22:0/189717504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a14009420 con 0x7f4a1c15d230 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a21ae3700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c1597f0 0x7f4a1c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a222e4700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a1c159420 0x7f4a1c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a22ae5700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 0x7f4a1c069520 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400ea50 tx=0x7f4a140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400c920 con 0x7f4a1c15d230 2023-10-08T00:26:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1400ca80 con 0x7f4a1c15d230 2023-10-08T00:26:24.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c009ae0 con 0x7f4a1c15d230 2023-10-08T00:26:24.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1400ce40 con 0x7f4a1c15d230 2023-10-08T00:26:24.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.480+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c0c7400 con 0x7f4a1c15d230 2023-10-08T00:26:24.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.481+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c0caae0 con 0x7f4a1c15d230 2023-10-08T00:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.482+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a14013680 con 0x7f4a1c15d230 2023-10-08T00:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.482+0000 7f4a1a7fc700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a08066f30 0x7f4a080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.482+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a14084670 con 0x7f4a1c15d230 2023-10-08T00:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.482+0000 7f4a222e4700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a08066f30 0x7f4a080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.483+0000 7f4a222e4700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a08066f30 0x7f4a080693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009880 tx=0x7f4a0c018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.486+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a1c0caae0 con 0x7f4a1c15d230 2023-10-08T00:26:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.675+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a1c0caa90 con 0x7f4a08066f30 2023-10-08T00:26:24.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.684+0000 7f4a1a7fc700 1 -- 172.21.15.22:0/189717504 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286182 (secure 0 0 0) 0x7f4a1c0caa90 con 0x7f4a08066f30 2023-10-08T00:26:24.688 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a08066f30 msgr2=0x7f4a080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a08066f30 0x7f4a080693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009880 tx=0x7f4a0c018000 comp rx=0 tx=0).stop 2023-10-08T00:26:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 msgr2=0x7f4a1c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 0x7f4a1c069520 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400ea50 tx=0x7f4a140091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 shutdown_connections 2023-10-08T00:26:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c15d230 0x7f4a1c069520 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a1c159420 0x7f4a1c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a08066f30 0x7f4a080693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 --2- 172.21.15.22:0/189717504 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1c1597f0 0x7f4a1c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 >> 172.21.15.22:0/189717504 conn(0x7f4a1c0d0660 msgr2=0x7f4a1c0b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 shutdown_connections 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.687+0000 7f4a232e6700 1 -- 172.21.15.22:0/189717504 wait complete. 2023-10-08T00:26:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:26:24.700 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-08T00:26:24.404187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3184976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824848"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599393+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:29:01.638624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590985+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:50.913174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594518+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599484+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.600095+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:53:38.314979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594634+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590031+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:57.883334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590472+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:19.048692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590274+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590516+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590284+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598424+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593850+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:17.839382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589464+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589050+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590081+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593989+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:11.734935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596099+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597568+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:41.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591474+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:12.028201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596104+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:43.603190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591486+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:36.046629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594750+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593181+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:02:41.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598414+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:33.154763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596889+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593641+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597453+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:23:28.943871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592897+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:29.770533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592857+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596685+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:33.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590614+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592903+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603655+0000","last_change":"2023-10-08T00:26:19.603655+0000","last_active":"2023-10-08T00:26:19.603655+0000","last_peered":"2023-10-08T00:26:19.603655+0000","last_clean":"2023-10-08T00:26:19.603655+0000","last_became_active":"2023-10-08T00:26:19.603377+0000","last_became_peered":"2023-10-08T00:26:19.603377+0000","last_unstale":"2023-10-08T00:26:19.603655+0000","last_undegraded":"2023-10-08T00:26:19.603655+0000","last_fullsized":"2023-10-08T00:26:19.603655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592238+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607378+0000","last_change":"2023-10-08T00:26:19.607378+0000","last_active":"2023-10-08T00:26:19.607378+0000","last_peered":"2023-10-08T00:26:19.607378+0000","last_clean":"2023-10-08T00:26:19.607378+0000","last_became_active":"2023-10-08T00:26:19.607064+0000","last_became_peered":"2023-10-08T00:26:19.607064+0000","last_unstale":"2023-10-08T00:26:19.607378+0000","last_undegraded":"2023-10-08T00:26:19.607378+0000","last_fullsized":"2023-10-08T00:26:19.607378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:10.458996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593732+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605020+0000","last_change":"2023-10-08T00:26:19.605020+0000","last_active":"2023-10-08T00:26:19.605020+0000","last_peered":"2023-10-08T00:26:19.605020+0000","last_clean":"2023-10-08T00:26:19.605020+0000","last_became_active":"2023-10-08T00:26:19.604701+0000","last_became_peered":"2023-10-08T00:26:19.604701+0000","last_unstale":"2023-10-08T00:26:19.605020+0000","last_undegraded":"2023-10-08T00:26:19.605020+0000","last_fullsized":"2023-10-08T00:26:19.605020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593165+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605625+0000","last_change":"2023-10-08T00:26:19.605625+0000","last_active":"2023-10-08T00:26:19.605625+0000","last_peered":"2023-10-08T00:26:19.605625+0000","last_clean":"2023-10-08T00:26:19.605625+0000","last_became_active":"2023-10-08T00:26:19.605342+0000","last_became_peered":"2023-10-08T00:26:19.605342+0000","last_unstale":"2023-10-08T00:26:19.605625+0000","last_undegraded":"2023-10-08T00:26:19.605625+0000","last_fullsized":"2023-10-08T00:26:19.605625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590705+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:33.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604952+0000","last_change":"2023-10-08T00:26:19.604952+0000","last_active":"2023-10-08T00:26:19.604952+0000","last_peered":"2023-10-08T00:26:19.604952+0000","last_clean":"2023-10-08T00:26:19.604952+0000","last_became_active":"2023-10-08T00:26:19.604683+0000","last_became_peered":"2023-10-08T00:26:19.604683+0000","last_unstale":"2023-10-08T00:26:19.604952+0000","last_undegraded":"2023-10-08T00:26:19.604952+0000","last_fullsized":"2023-10-08T00:26:19.604952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:08.235838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591591+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:11.214977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600569+0000","last_change":"2023-10-08T00:26:19.600569+0000","last_active":"2023-10-08T00:26:19.600569+0000","last_peered":"2023-10-08T00:26:19.600569+0000","last_clean":"2023-10-08T00:26:19.600569+0000","last_became_active":"2023-10-08T00:26:19.600309+0000","last_became_peered":"2023-10-08T00:26:19.600309+0000","last_unstale":"2023-10-08T00:26:19.600569+0000","last_undegraded":"2023-10-08T00:26:19.600569+0000","last_fullsized":"2023-10-08T00:26:19.600569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:56.879260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592653+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:41.374769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.599836+0000","last_change":"2023-10-08T00:26:19.599836+0000","last_active":"2023-10-08T00:26:19.599836+0000","last_peered":"2023-10-08T00:26:19.599836+0000","last_clean":"2023-10-08T00:26:19.599836+0000","last_became_active":"2023-10-08T00:26:19.599090+0000","last_became_peered":"2023-10-08T00:26:19.599090+0000","last_unstale":"2023-10-08T00:26:19.599836+0000","last_undegraded":"2023-10-08T00:26:19.599836+0000","last_fullsized":"2023-10-08T00:26:19.599836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593665+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:00.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602581+0000","last_change":"2023-10-08T00:26:19.602581+0000","last_active":"2023-10-08T00:26:19.602581+0000","last_peered":"2023-10-08T00:26:19.602581+0000","last_clean":"2023-10-08T00:26:19.602581+0000","last_became_active":"2023-10-08T00:26:19.602298+0000","last_became_peered":"2023-10-08T00:26:19.602298+0000","last_unstale":"2023-10-08T00:26:19.602581+0000","last_undegraded":"2023-10-08T00:26:19.602581+0000","last_fullsized":"2023-10-08T00:26:19.602581+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589461+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604715+0000","last_change":"2023-10-08T00:26:19.604715+0000","last_active":"2023-10-08T00:26:19.604715+0000","last_peered":"2023-10-08T00:26:19.604715+0000","last_clean":"2023-10-08T00:26:19.604715+0000","last_became_active":"2023-10-08T00:26:19.604361+0000","last_became_peered":"2023-10-08T00:26:19.604361+0000","last_unstale":"2023-10-08T00:26:19.604715+0000","last_undegraded":"2023-10-08T00:26:19.604715+0000","last_fullsized":"2023-10-08T00:26:19.604715+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:49.574894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593277+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608864+0000","last_change":"2023-10-08T00:26:19.608864+0000","last_active":"2023-10-08T00:26:19.608864+0000","last_peered":"2023-10-08T00:26:19.608864+0000","last_clean":"2023-10-08T00:26:19.608864+0000","last_became_active":"2023-10-08T00:26:19.607415+0000","last_became_peered":"2023-10-08T00:26:19.607415+0000","last_unstale":"2023-10-08T00:26:19.608864+0000","last_undegraded":"2023-10-08T00:26:19.608864+0000","last_fullsized":"2023-10-08T00:26:19.608864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:38.957091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593613+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.610582+0000","last_change":"2023-10-08T00:26:19.610582+0000","last_active":"2023-10-08T00:26:19.610582+0000","last_peered":"2023-10-08T00:26:19.610582+0000","last_clean":"2023-10-08T00:26:19.610582+0000","last_became_active":"2023-10-08T00:26:19.610280+0000","last_became_peered":"2023-10-08T00:26:19.610280+0000","last_unstale":"2023-10-08T00:26:19.610582+0000","last_undegraded":"2023-10-08T00:26:19.610582+0000","last_fullsized":"2023-10-08T00:26:19.610582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:07.605223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594020+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602544+0000","last_change":"2023-10-08T00:26:19.602544+0000","last_active":"2023-10-08T00:26:19.602544+0000","last_peered":"2023-10-08T00:26:19.602544+0000","last_clean":"2023-10-08T00:26:19.602544+0000","last_became_active":"2023-10-08T00:26:19.602253+0000","last_became_peered":"2023-10-08T00:26:19.602253+0000","last_unstale":"2023-10-08T00:26:19.602544+0000","last_undegraded":"2023-10-08T00:26:19.602544+0000","last_fullsized":"2023-10-08T00:26:19.602544+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591981+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607794+0000","last_change":"2023-10-08T00:26:19.607794+0000","last_active":"2023-10-08T00:26:19.607794+0000","last_peered":"2023-10-08T00:26:19.607794+0000","last_clean":"2023-10-08T00:26:19.607794+0000","last_became_active":"2023-10-08T00:26:19.607401+0000","last_became_peered":"2023-10-08T00:26:19.607401+0000","last_unstale":"2023-10-08T00:26:19.607794+0000","last_undegraded":"2023-10-08T00:26:19.607794+0000","last_fullsized":"2023-10-08T00:26:19.607794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.800417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595623+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602407+0000","last_change":"2023-10-08T00:26:19.602407+0000","last_active":"2023-10-08T00:26:19.602407+0000","last_peered":"2023-10-08T00:26:19.602407+0000","last_clean":"2023-10-08T00:26:19.602407+0000","last_became_active":"2023-10-08T00:26:19.602143+0000","last_became_peered":"2023-10-08T00:26:19.602143+0000","last_unstale":"2023-10-08T00:26:19.602407+0000","last_undegraded":"2023-10-08T00:26:19.602407+0000","last_fullsized":"2023-10-08T00:26:19.602407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:21:00.734187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589780+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601497+0000","last_change":"2023-10-08T00:26:19.601497+0000","last_active":"2023-10-08T00:26:19.601497+0000","last_peered":"2023-10-08T00:26:19.601497+0000","last_clean":"2023-10-08T00:26:19.601497+0000","last_became_active":"2023-10-08T00:26:19.601186+0000","last_became_peered":"2023-10-08T00:26:19.601186+0000","last_unstale":"2023-10-08T00:26:19.601497+0000","last_undegraded":"2023-10-08T00:26:19.601497+0000","last_fullsized":"2023-10-08T00:26:19.601497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594228+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606874+0000","last_change":"2023-10-08T00:26:19.606874+0000","last_active":"2023-10-08T00:26:19.606874+0000","last_peered":"2023-10-08T00:26:19.606874+0000","last_clean":"2023-10-08T00:26:19.606874+0000","last_became_active":"2023-10-08T00:26:19.606627+0000","last_became_peered":"2023-10-08T00:26:19.606627+0000","last_unstale":"2023-10-08T00:26:19.606874+0000","last_undegraded":"2023-10-08T00:26:19.606874+0000","last_fullsized":"2023-10-08T00:26:19.606874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:00.539100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595558+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608143+0000","last_change":"2023-10-08T00:26:19.608143+0000","last_active":"2023-10-08T00:26:19.608143+0000","last_peered":"2023-10-08T00:26:19.608143+0000","last_clean":"2023-10-08T00:26:19.608143+0000","last_became_active":"2023-10-08T00:26:19.607848+0000","last_became_peered":"2023-10-08T00:26:19.607848+0000","last_unstale":"2023-10-08T00:26:19.608143+0000","last_undegraded":"2023-10-08T00:26:19.608143+0000","last_fullsized":"2023-10-08T00:26:19.608143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:42.599116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591755+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604741+0000","last_change":"2023-10-08T00:26:19.604741+0000","last_active":"2023-10-08T00:26:19.604741+0000","last_peered":"2023-10-08T00:26:19.604741+0000","last_clean":"2023-10-08T00:26:19.604741+0000","last_became_active":"2023-10-08T00:26:19.604455+0000","last_became_peered":"2023-10-08T00:26:19.604455+0000","last_unstale":"2023-10-08T00:26:19.604741+0000","last_undegraded":"2023-10-08T00:26:19.604741+0000","last_fullsized":"2023-10-08T00:26:19.604741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590183+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:08.791091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601546+0000","last_change":"2023-10-08T00:26:19.601546+0000","last_active":"2023-10-08T00:26:19.601546+0000","last_peered":"2023-10-08T00:26:19.601546+0000","last_clean":"2023-10-08T00:26:19.601546+0000","last_became_active":"2023-10-08T00:26:19.601250+0000","last_became_peered":"2023-10-08T00:26:19.601250+0000","last_unstale":"2023-10-08T00:26:19.601546+0000","last_undegraded":"2023-10-08T00:26:19.601546+0000","last_fullsized":"2023-10-08T00:26:19.601546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593465+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602311+0000","last_change":"2023-10-08T00:26:19.602311+0000","last_active":"2023-10-08T00:26:19.602311+0000","last_peered":"2023-10-08T00:26:19.602311+0000","last_clean":"2023-10-08T00:26:19.602311+0000","last_became_active":"2023-10-08T00:26:19.602101+0000","last_became_peered":"2023-10-08T00:26:19.602101+0000","last_unstale":"2023-10-08T00:26:19.602311+0000","last_undegraded":"2023-10-08T00:26:19.602311+0000","last_fullsized":"2023-10-08T00:26:19.602311+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591378+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601160+0000","last_change":"2023-10-08T00:26:19.601160+0000","last_active":"2023-10-08T00:26:19.601160+0000","last_peered":"2023-10-08T00:26:19.601160+0000","last_clean":"2023-10-08T00:26:19.601160+0000","last_became_active":"2023-10-08T00:26:19.600877+0000","last_became_peered":"2023-10-08T00:26:19.600877+0000","last_unstale":"2023-10-08T00:26:19.601160+0000","last_undegraded":"2023-10-08T00:26:19.601160+0000","last_fullsized":"2023-10-08T00:26:19.601160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:39.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592969+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606732+0000","last_change":"2023-10-08T00:26:19.606732+0000","last_active":"2023-10-08T00:26:19.606732+0000","last_peered":"2023-10-08T00:26:19.606732+0000","last_clean":"2023-10-08T00:26:19.606732+0000","last_became_active":"2023-10-08T00:26:19.605988+0000","last_became_peered":"2023-10-08T00:26:19.605988+0000","last_unstale":"2023-10-08T00:26:19.606732+0000","last_undegraded":"2023-10-08T00:26:19.606732+0000","last_fullsized":"2023-10-08T00:26:19.606732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:54.101460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591757+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603665+0000","last_change":"2023-10-08T00:26:19.603665+0000","last_active":"2023-10-08T00:26:19.603665+0000","last_peered":"2023-10-08T00:26:19.603665+0000","last_clean":"2023-10-08T00:26:19.603665+0000","last_became_active":"2023-10-08T00:26:19.603462+0000","last_became_peered":"2023-10-08T00:26:19.603462+0000","last_unstale":"2023-10-08T00:26:19.603665+0000","last_undegraded":"2023-10-08T00:26:19.603665+0000","last_fullsized":"2023-10-08T00:26:19.603665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591677+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608522+0000","last_change":"2023-10-08T00:26:19.608522+0000","last_active":"2023-10-08T00:26:19.608522+0000","last_peered":"2023-10-08T00:26:19.608522+0000","last_clean":"2023-10-08T00:26:19.608522+0000","last_became_active":"2023-10-08T00:26:19.607944+0000","last_became_peered":"2023-10-08T00:26:19.607944+0000","last_unstale":"2023-10-08T00:26:19.608522+0000","last_undegraded":"2023-10-08T00:26:19.608522+0000","last_fullsized":"2023-10-08T00:26:19.608522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:36.450510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597082+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600540+0000","last_change":"2023-10-08T00:26:19.600540+0000","last_active":"2023-10-08T00:26:19.600540+0000","last_peered":"2023-10-08T00:26:19.600540+0000","last_clean":"2023-10-08T00:26:19.600540+0000","last_became_active":"2023-10-08T00:26:19.600250+0000","last_became_peered":"2023-10-08T00:26:19.600250+0000","last_unstale":"2023-10-08T00:26:19.600540+0000","last_undegraded":"2023-10-08T00:26:19.600540+0000","last_fullsized":"2023-10-08T00:26:19.600540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590178+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:02.956481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600255+0000","last_change":"2023-10-08T00:26:19.600255+0000","last_active":"2023-10-08T00:26:19.600255+0000","last_peered":"2023-10-08T00:26:19.600255+0000","last_clean":"2023-10-08T00:26:19.600255+0000","last_became_active":"2023-10-08T00:26:19.599956+0000","last_became_peered":"2023-10-08T00:26:19.599956+0000","last_unstale":"2023-10-08T00:26:19.600255+0000","last_undegraded":"2023-10-08T00:26:19.600255+0000","last_fullsized":"2023-10-08T00:26:19.600255+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:50.293350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592318+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600689+0000","last_change":"2023-10-08T00:26:19.600689+0000","last_active":"2023-10-08T00:26:19.600689+0000","last_peered":"2023-10-08T00:26:19.600689+0000","last_clean":"2023-10-08T00:26:19.600689+0000","last_became_active":"2023-10-08T00:26:19.600106+0000","last_became_peered":"2023-10-08T00:26:19.600106+0000","last_unstale":"2023-10-08T00:26:19.600689+0000","last_undegraded":"2023-10-08T00:26:19.600689+0000","last_fullsized":"2023-10-08T00:26:19.600689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:21.811829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590132+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:50.555024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606611+0000","last_change":"2023-10-08T00:26:19.606611+0000","last_active":"2023-10-08T00:26:19.606611+0000","last_peered":"2023-10-08T00:26:19.606611+0000","last_clean":"2023-10-08T00:26:19.606611+0000","last_became_active":"2023-10-08T00:26:19.606386+0000","last_became_peered":"2023-10-08T00:26:19.606386+0000","last_unstale":"2023-10-08T00:26:19.606611+0000","last_undegraded":"2023-10-08T00:26:19.606611+0000","last_fullsized":"2023-10-08T00:26:19.606611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:59.014269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595057+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.596506+0000","last_change":"2023-10-08T00:26:19.596506+0000","last_active":"2023-10-08T00:26:19.596506+0000","last_peered":"2023-10-08T00:26:19.596506+0000","last_clean":"2023-10-08T00:26:19.596506+0000","last_became_active":"2023-10-08T00:26:19.596208+0000","last_became_peered":"2023-10-08T00:26:19.596208+0000","last_unstale":"2023-10-08T00:26:19.596506+0000","last_undegraded":"2023-10-08T00:26:19.596506+0000","last_fullsized":"2023-10-08T00:26:19.596506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590207+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:22.815903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604610+0000","last_change":"2023-10-08T00:26:19.604610+0000","last_active":"2023-10-08T00:26:19.604610+0000","last_peered":"2023-10-08T00:26:19.604610+0000","last_clean":"2023-10-08T00:26:19.604610+0000","last_became_active":"2023-10-08T00:26:19.604289+0000","last_became_peered":"2023-10-08T00:26:19.604289+0000","last_unstale":"2023-10-08T00:26:19.604610+0000","last_undegraded":"2023-10-08T00:26:19.604610+0000","last_fullsized":"2023-10-08T00:26:19.604610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589674+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602199+0000","last_change":"2023-10-08T00:26:19.602199+0000","last_active":"2023-10-08T00:26:19.602199+0000","last_peered":"2023-10-08T00:26:19.602199+0000","last_clean":"2023-10-08T00:26:19.602199+0000","last_became_active":"2023-10-08T00:26:19.601934+0000","last_became_peered":"2023-10-08T00:26:19.601934+0000","last_unstale":"2023-10-08T00:26:19.602199+0000","last_undegraded":"2023-10-08T00:26:19.602199+0000","last_fullsized":"2023-10-08T00:26:19.602199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:37.185009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589922+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605412+0000","last_change":"2023-10-08T00:26:19.605412+0000","last_active":"2023-10-08T00:26:19.605412+0000","last_peered":"2023-10-08T00:26:19.605412+0000","last_clean":"2023-10-08T00:26:19.605412+0000","last_became_active":"2023-10-08T00:26:19.605141+0000","last_became_peered":"2023-10-08T00:26:19.605141+0000","last_unstale":"2023-10-08T00:26:19.605412+0000","last_undegraded":"2023-10-08T00:26:19.605412+0000","last_fullsized":"2023-10-08T00:26:19.605412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:06:37.248332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T00:26:18.584688+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:18.584688+0000","last_peered":"2023-10-08T00:26:18.584688+0000","last_clean":"2023-10-08T00:26:18.584688+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:18.584688+0000","last_undegraded":"2023-10-08T00:26:18.584688+0000","last_fullsized":"2023-10-08T00:26:18.584688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.499}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.437}]},{"osd":4,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.621},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76800000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.318},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.378}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.316}]},{"osd":2,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.80100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:26:24.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:26:24.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.860+0000 7fbf49419700 1 Processor -- start 2023-10-08T00:26:24.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.860+0000 7fbf49419700 1 -- start start 2023-10-08T00:26:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf49419700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf44159420 0x7fbf440b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf49419700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf440b2980 con 0x7fbf4415d230 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf49419700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf440b11d0 con 0x7fbf441597f0 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf49419700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440b14b0 con 0x7fbf44159420 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf43fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf44159420 0x7fbf440b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf48c18700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbf4415d230 0x7fbf4415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46092/0 (socket says 172.21.15.22:46092) 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf48c18700 1 -- 172.21.15.22:0/4246797320 learned_addr learned my addr 172.21.15.22:0/4246797320 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf43fff700 1 -- 172.21.15.22:0/4246797320 >> v1:172.21.15.192:6789/0 conn(0x7fbf441597f0 legacy=0x7fbf440b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf43fff700 1 -- 172.21.15.22:0/4246797320 >> v1:172.21.15.22:6789/0 conn(0x7fbf4415d230 legacy=0x7fbf4415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf43fff700 1 -- 172.21.15.22:0/4246797320 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440b1790 con 0x7fbf44159420 2023-10-08T00:26:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.861+0000 7fbf42ffd700 1 -- 172.21.15.22:0/4246797320 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074085415 0 0) 0x7fbf440b2980 con 0x7fbf4415d230 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf43fff700 1 --2- 172.21.15.22:0/4246797320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf44159420 0x7fbf440b5f40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf340098e0 tx=0x7fbf340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e676818344471d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf42ffd700 1 -- 172.21.15.22:0/4246797320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34009e80 con 0x7fbf44159420 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf42ffd700 1 -- 172.21.15.22:0/4246797320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400b820 con 0x7fbf44159420 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf42ffd700 1 -- 172.21.15.22:0/4246797320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400bba0 con 0x7fbf44159420 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 -- 172.21.15.22:0/4246797320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf44159420 msgr2=0x7fbf440b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 --2- 172.21.15.22:0/4246797320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf44159420 0x7fbf440b5f40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbf340098e0 tx=0x7fbf340091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 -- 172.21.15.22:0/4246797320 shutdown_connections 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 --2- 172.21.15.22:0/4246797320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf44159420 0x7fbf440b5f40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 -- 172.21.15.22:0/4246797320 >> 172.21.15.22:0/4246797320 conn(0x7fbf440d0660 msgr2=0x7fbf440d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 -- 172.21.15.22:0/4246797320 shutdown_connections 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.862+0000 7fbf49419700 1 -- 172.21.15.22:0/4246797320 wait complete. 2023-10-08T00:26:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.863+0000 7fbf49419700 1 Processor -- start 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 -- start start 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf44159420 0x7fbf440c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 0x7fbf44155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4415d230 0x7fbf441581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440c5bd0 con 0x7fbf441597f0 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4416a520 con 0x7fbf44159420 2023-10-08T00:26:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf49419700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440ca430 con 0x7fbf4415d230 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf437fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 0x7fbf44155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf437fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 0x7fbf44155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44948/0 (socket says 172.21.15.22:44948) 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf437fe700 1 -- 172.21.15.22:0/2691188580 learned_addr learned my addr 172.21.15.22:0/2691188580 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf43fff700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf44159420 0x7fbf440c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.864+0000 7fbf48c18700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4415d230 0x7fbf441581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf437fe700 1 -- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4415d230 msgr2=0x7fbf441581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf437fe700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4415d230 0x7fbf441581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf437fe700 1 -- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf44159420 msgr2=0x7fbf440c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf437fe700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf44159420 0x7fbf440c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf437fe700 1 -- 172.21.15.22:0/2691188580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34009420 con 0x7fbf441597f0 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf437fe700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 0x7fbf44155350 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c590 tx=0x7fbf38007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38011590 con 0x7fbf441597f0 2023-10-08T00:26:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf380116f0 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf440ca710 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38011ab0 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.865+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf440c6600 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.866+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf440ca290 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.866+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf3801c460 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.867+0000 7fbf2bfff700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf30066f30 0x7fbf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.867+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf38084180 con 0x7fbf441597f0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.867+0000 7fbf43fff700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf30066f30 0x7fbf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.868+0000 7fbf43fff700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf30066f30 0x7fbf300693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf340030c0 tx=0x7fbf34016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:24.871+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf440ca290 con 0x7fbf441597f0 2023-10-08T00:26:24.930 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:26:24.930+0000 7f6ba5c39700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:26:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.058+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf440ca290 con 0x7fbf30066f30 2023-10-08T00:26:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.067+0000 7fbf2bfff700 1 -- 172.21.15.22:0/2691188580 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286182 (secure 0 0 0) 0x7fbf440ca290 con 0x7fbf30066f30 2023-10-08T00:26:25.070 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf30066f30 msgr2=0x7fbf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf30066f30 0x7fbf300693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf340030c0 tx=0x7fbf34016000 comp rx=0 tx=0).stop 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 msgr2=0x7fbf44155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 0x7fbf44155350 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c590 tx=0x7fbf38007f30 comp rx=0 tx=0).stop 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 shutdown_connections 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf30066f30 0x7fbf300693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf4415d230 0x7fbf441581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf44159420 0x7fbf440c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 --2- 172.21.15.22:0/2691188580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf441597f0 0x7fbf44155350 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 >> 172.21.15.22:0/2691188580 conn(0x7fbf440d0660 msgr2=0x7fbf44156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:25.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 shutdown_connections 2023-10-08T00:26:25.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.070+0000 7fbf49419700 1 -- 172.21.15.22:0/2691188580 wait complete. 2023-10-08T00:26:25.074 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:26:25.082 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-08T00:26:24.404187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3184976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824848"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599393+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:29:01.638624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590985+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:50.913174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594518+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599484+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.600095+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:53:38.314979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594634+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590031+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:57.883334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590472+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:19.048692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590274+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590516+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590284+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598424+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593850+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:17.839382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589464+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589050+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590081+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593989+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:11.734935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596099+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597568+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:41.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591474+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:12.028201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596104+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:43.603190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591486+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:36.046629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594750+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593181+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:02:41.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598414+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:33.154763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596889+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593641+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597453+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:23:28.943871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592897+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:29.770533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592857+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596685+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:33.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590614+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592903+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603655+0000","last_change":"2023-10-08T00:26:19.603655+0000","last_active":"2023-10-08T00:26:19.603655+0000","last_peered":"2023-10-08T00:26:19.603655+0000","last_clean":"2023-10-08T00:26:19.603655+0000","last_became_active":"2023-10-08T00:26:19.603377+0000","last_became_peered":"2023-10-08T00:26:19.603377+0000","last_unstale":"2023-10-08T00:26:19.603655+0000","last_undegraded":"2023-10-08T00:26:19.603655+0000","last_fullsized":"2023-10-08T00:26:19.603655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592238+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607378+0000","last_change":"2023-10-08T00:26:19.607378+0000","last_active":"2023-10-08T00:26:19.607378+0000","last_peered":"2023-10-08T00:26:19.607378+0000","last_clean":"2023-10-08T00:26:19.607378+0000","last_became_active":"2023-10-08T00:26:19.607064+0000","last_became_peered":"2023-10-08T00:26:19.607064+0000","last_unstale":"2023-10-08T00:26:19.607378+0000","last_undegraded":"2023-10-08T00:26:19.607378+0000","last_fullsized":"2023-10-08T00:26:19.607378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:10.458996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593732+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605020+0000","last_change":"2023-10-08T00:26:19.605020+0000","last_active":"2023-10-08T00:26:19.605020+0000","last_peered":"2023-10-08T00:26:19.605020+0000","last_clean":"2023-10-08T00:26:19.605020+0000","last_became_active":"2023-10-08T00:26:19.604701+0000","last_became_peered":"2023-10-08T00:26:19.604701+0000","last_unstale":"2023-10-08T00:26:19.605020+0000","last_undegraded":"2023-10-08T00:26:19.605020+0000","last_fullsized":"2023-10-08T00:26:19.605020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593165+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605625+0000","last_change":"2023-10-08T00:26:19.605625+0000","last_active":"2023-10-08T00:26:19.605625+0000","last_peered":"2023-10-08T00:26:19.605625+0000","last_clean":"2023-10-08T00:26:19.605625+0000","last_became_active":"2023-10-08T00:26:19.605342+0000","last_became_peered":"2023-10-08T00:26:19.605342+0000","last_unstale":"2023-10-08T00:26:19.605625+0000","last_undegraded":"2023-10-08T00:26:19.605625+0000","last_fullsized":"2023-10-08T00:26:19.605625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590705+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:33.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604952+0000","last_change":"2023-10-08T00:26:19.604952+0000","last_active":"2023-10-08T00:26:19.604952+0000","last_peered":"2023-10-08T00:26:19.604952+0000","last_clean":"2023-10-08T00:26:19.604952+0000","last_became_active":"2023-10-08T00:26:19.604683+0000","last_became_peered":"2023-10-08T00:26:19.604683+0000","last_unstale":"2023-10-08T00:26:19.604952+0000","last_undegraded":"2023-10-08T00:26:19.604952+0000","last_fullsized":"2023-10-08T00:26:19.604952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:08.235838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591591+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:11.214977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600569+0000","last_change":"2023-10-08T00:26:19.600569+0000","last_active":"2023-10-08T00:26:19.600569+0000","last_peered":"2023-10-08T00:26:19.600569+0000","last_clean":"2023-10-08T00:26:19.600569+0000","last_became_active":"2023-10-08T00:26:19.600309+0000","last_became_peered":"2023-10-08T00:26:19.600309+0000","last_unstale":"2023-10-08T00:26:19.600569+0000","last_undegraded":"2023-10-08T00:26:19.600569+0000","last_fullsized":"2023-10-08T00:26:19.600569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:56.879260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592653+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:41.374769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.599836+0000","last_change":"2023-10-08T00:26:19.599836+0000","last_active":"2023-10-08T00:26:19.599836+0000","last_peered":"2023-10-08T00:26:19.599836+0000","last_clean":"2023-10-08T00:26:19.599836+0000","last_became_active":"2023-10-08T00:26:19.599090+0000","last_became_peered":"2023-10-08T00:26:19.599090+0000","last_unstale":"2023-10-08T00:26:19.599836+0000","last_undegraded":"2023-10-08T00:26:19.599836+0000","last_fullsized":"2023-10-08T00:26:19.599836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593665+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:00.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602581+0000","last_change":"2023-10-08T00:26:19.602581+0000","last_active":"2023-10-08T00:26:19.602581+0000","last_peered":"2023-10-08T00:26:19.602581+0000","last_clean":"2023-10-08T00:26:19.602581+0000","last_became_active":"2023-10-08T00:26:19.602298+0000","last_became_peered":"2023-10-08T00:26:19.602298+0000","last_unstale":"2023-10-08T00:26:19.602581+0000","last_undegraded":"2023-10-08T00:26:19.602581+0000","last_fullsized":"2023-10-08T00:26:19.602581+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589461+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604715+0000","last_change":"2023-10-08T00:26:19.604715+0000","last_active":"2023-10-08T00:26:19.604715+0000","last_peered":"2023-10-08T00:26:19.604715+0000","last_clean":"2023-10-08T00:26:19.604715+0000","last_became_active":"2023-10-08T00:26:19.604361+0000","last_became_peered":"2023-10-08T00:26:19.604361+0000","last_unstale":"2023-10-08T00:26:19.604715+0000","last_undegraded":"2023-10-08T00:26:19.604715+0000","last_fullsized":"2023-10-08T00:26:19.604715+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:49.574894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593277+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608864+0000","last_change":"2023-10-08T00:26:19.608864+0000","last_active":"2023-10-08T00:26:19.608864+0000","last_peered":"2023-10-08T00:26:19.608864+0000","last_clean":"2023-10-08T00:26:19.608864+0000","last_became_active":"2023-10-08T00:26:19.607415+0000","last_became_peered":"2023-10-08T00:26:19.607415+0000","last_unstale":"2023-10-08T00:26:19.608864+0000","last_undegraded":"2023-10-08T00:26:19.608864+0000","last_fullsized":"2023-10-08T00:26:19.608864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:38.957091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593613+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.610582+0000","last_change":"2023-10-08T00:26:19.610582+0000","last_active":"2023-10-08T00:26:19.610582+0000","last_peered":"2023-10-08T00:26:19.610582+0000","last_clean":"2023-10-08T00:26:19.610582+0000","last_became_active":"2023-10-08T00:26:19.610280+0000","last_became_peered":"2023-10-08T00:26:19.610280+0000","last_unstale":"2023-10-08T00:26:19.610582+0000","last_undegraded":"2023-10-08T00:26:19.610582+0000","last_fullsized":"2023-10-08T00:26:19.610582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:07.605223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594020+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602544+0000","last_change":"2023-10-08T00:26:19.602544+0000","last_active":"2023-10-08T00:26:19.602544+0000","last_peered":"2023-10-08T00:26:19.602544+0000","last_clean":"2023-10-08T00:26:19.602544+0000","last_became_active":"2023-10-08T00:26:19.602253+0000","last_became_peered":"2023-10-08T00:26:19.602253+0000","last_unstale":"2023-10-08T00:26:19.602544+0000","last_undegraded":"2023-10-08T00:26:19.602544+0000","last_fullsized":"2023-10-08T00:26:19.602544+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591981+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607794+0000","last_change":"2023-10-08T00:26:19.607794+0000","last_active":"2023-10-08T00:26:19.607794+0000","last_peered":"2023-10-08T00:26:19.607794+0000","last_clean":"2023-10-08T00:26:19.607794+0000","last_became_active":"2023-10-08T00:26:19.607401+0000","last_became_peered":"2023-10-08T00:26:19.607401+0000","last_unstale":"2023-10-08T00:26:19.607794+0000","last_undegraded":"2023-10-08T00:26:19.607794+0000","last_fullsized":"2023-10-08T00:26:19.607794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.800417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595623+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602407+0000","last_change":"2023-10-08T00:26:19.602407+0000","last_active":"2023-10-08T00:26:19.602407+0000","last_peered":"2023-10-08T00:26:19.602407+0000","last_clean":"2023-10-08T00:26:19.602407+0000","last_became_active":"2023-10-08T00:26:19.602143+0000","last_became_peered":"2023-10-08T00:26:19.602143+0000","last_unstale":"2023-10-08T00:26:19.602407+0000","last_undegraded":"2023-10-08T00:26:19.602407+0000","last_fullsized":"2023-10-08T00:26:19.602407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:21:00.734187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589780+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601497+0000","last_change":"2023-10-08T00:26:19.601497+0000","last_active":"2023-10-08T00:26:19.601497+0000","last_peered":"2023-10-08T00:26:19.601497+0000","last_clean":"2023-10-08T00:26:19.601497+0000","last_became_active":"2023-10-08T00:26:19.601186+0000","last_became_peered":"2023-10-08T00:26:19.601186+0000","last_unstale":"2023-10-08T00:26:19.601497+0000","last_undegraded":"2023-10-08T00:26:19.601497+0000","last_fullsized":"2023-10-08T00:26:19.601497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594228+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606874+0000","last_change":"2023-10-08T00:26:19.606874+0000","last_active":"2023-10-08T00:26:19.606874+0000","last_peered":"2023-10-08T00:26:19.606874+0000","last_clean":"2023-10-08T00:26:19.606874+0000","last_became_active":"2023-10-08T00:26:19.606627+0000","last_became_peered":"2023-10-08T00:26:19.606627+0000","last_unstale":"2023-10-08T00:26:19.606874+0000","last_undegraded":"2023-10-08T00:26:19.606874+0000","last_fullsized":"2023-10-08T00:26:19.606874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:00.539100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595558+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608143+0000","last_change":"2023-10-08T00:26:19.608143+0000","last_active":"2023-10-08T00:26:19.608143+0000","last_peered":"2023-10-08T00:26:19.608143+0000","last_clean":"2023-10-08T00:26:19.608143+0000","last_became_active":"2023-10-08T00:26:19.607848+0000","last_became_peered":"2023-10-08T00:26:19.607848+0000","last_unstale":"2023-10-08T00:26:19.608143+0000","last_undegraded":"2023-10-08T00:26:19.608143+0000","last_fullsized":"2023-10-08T00:26:19.608143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:42.599116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591755+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604741+0000","last_change":"2023-10-08T00:26:19.604741+0000","last_active":"2023-10-08T00:26:19.604741+0000","last_peered":"2023-10-08T00:26:19.604741+0000","last_clean":"2023-10-08T00:26:19.604741+0000","last_became_active":"2023-10-08T00:26:19.604455+0000","last_became_peered":"2023-10-08T00:26:19.604455+0000","last_unstale":"2023-10-08T00:26:19.604741+0000","last_undegraded":"2023-10-08T00:26:19.604741+0000","last_fullsized":"2023-10-08T00:26:19.604741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590183+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:08.791091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601546+0000","last_change":"2023-10-08T00:26:19.601546+0000","last_active":"2023-10-08T00:26:19.601546+0000","last_peered":"2023-10-08T00:26:19.601546+0000","last_clean":"2023-10-08T00:26:19.601546+0000","last_became_active":"2023-10-08T00:26:19.601250+0000","last_became_peered":"2023-10-08T00:26:19.601250+0000","last_unstale":"2023-10-08T00:26:19.601546+0000","last_undegraded":"2023-10-08T00:26:19.601546+0000","last_fullsized":"2023-10-08T00:26:19.601546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593465+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602311+0000","last_change":"2023-10-08T00:26:19.602311+0000","last_active":"2023-10-08T00:26:19.602311+0000","last_peered":"2023-10-08T00:26:19.602311+0000","last_clean":"2023-10-08T00:26:19.602311+0000","last_became_active":"2023-10-08T00:26:19.602101+0000","last_became_peered":"2023-10-08T00:26:19.602101+0000","last_unstale":"2023-10-08T00:26:19.602311+0000","last_undegraded":"2023-10-08T00:26:19.602311+0000","last_fullsized":"2023-10-08T00:26:19.602311+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591378+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601160+0000","last_change":"2023-10-08T00:26:19.601160+0000","last_active":"2023-10-08T00:26:19.601160+0000","last_peered":"2023-10-08T00:26:19.601160+0000","last_clean":"2023-10-08T00:26:19.601160+0000","last_became_active":"2023-10-08T00:26:19.600877+0000","last_became_peered":"2023-10-08T00:26:19.600877+0000","last_unstale":"2023-10-08T00:26:19.601160+0000","last_undegraded":"2023-10-08T00:26:19.601160+0000","last_fullsized":"2023-10-08T00:26:19.601160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:39.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592969+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606732+0000","last_change":"2023-10-08T00:26:19.606732+0000","last_active":"2023-10-08T00:26:19.606732+0000","last_peered":"2023-10-08T00:26:19.606732+0000","last_clean":"2023-10-08T00:26:19.606732+0000","last_became_active":"2023-10-08T00:26:19.605988+0000","last_became_peered":"2023-10-08T00:26:19.605988+0000","last_unstale":"2023-10-08T00:26:19.606732+0000","last_undegraded":"2023-10-08T00:26:19.606732+0000","last_fullsized":"2023-10-08T00:26:19.606732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:54.101460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591757+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603665+0000","last_change":"2023-10-08T00:26:19.603665+0000","last_active":"2023-10-08T00:26:19.603665+0000","last_peered":"2023-10-08T00:26:19.603665+0000","last_clean":"2023-10-08T00:26:19.603665+0000","last_became_active":"2023-10-08T00:26:19.603462+0000","last_became_peered":"2023-10-08T00:26:19.603462+0000","last_unstale":"2023-10-08T00:26:19.603665+0000","last_undegraded":"2023-10-08T00:26:19.603665+0000","last_fullsized":"2023-10-08T00:26:19.603665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591677+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608522+0000","last_change":"2023-10-08T00:26:19.608522+0000","last_active":"2023-10-08T00:26:19.608522+0000","last_peered":"2023-10-08T00:26:19.608522+0000","last_clean":"2023-10-08T00:26:19.608522+0000","last_became_active":"2023-10-08T00:26:19.607944+0000","last_became_peered":"2023-10-08T00:26:19.607944+0000","last_unstale":"2023-10-08T00:26:19.608522+0000","last_undegraded":"2023-10-08T00:26:19.608522+0000","last_fullsized":"2023-10-08T00:26:19.608522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:36.450510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597082+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600540+0000","last_change":"2023-10-08T00:26:19.600540+0000","last_active":"2023-10-08T00:26:19.600540+0000","last_peered":"2023-10-08T00:26:19.600540+0000","last_clean":"2023-10-08T00:26:19.600540+0000","last_became_active":"2023-10-08T00:26:19.600250+0000","last_became_peered":"2023-10-08T00:26:19.600250+0000","last_unstale":"2023-10-08T00:26:19.600540+0000","last_undegraded":"2023-10-08T00:26:19.600540+0000","last_fullsized":"2023-10-08T00:26:19.600540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590178+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:02.956481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600255+0000","last_change":"2023-10-08T00:26:19.600255+0000","last_active":"2023-10-08T00:26:19.600255+0000","last_peered":"2023-10-08T00:26:19.600255+0000","last_clean":"2023-10-08T00:26:19.600255+0000","last_became_active":"2023-10-08T00:26:19.599956+0000","last_became_peered":"2023-10-08T00:26:19.599956+0000","last_unstale":"2023-10-08T00:26:19.600255+0000","last_undegraded":"2023-10-08T00:26:19.600255+0000","last_fullsized":"2023-10-08T00:26:19.600255+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:50.293350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592318+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600689+0000","last_change":"2023-10-08T00:26:19.600689+0000","last_active":"2023-10-08T00:26:19.600689+0000","last_peered":"2023-10-08T00:26:19.600689+0000","last_clean":"2023-10-08T00:26:19.600689+0000","last_became_active":"2023-10-08T00:26:19.600106+0000","last_became_peered":"2023-10-08T00:26:19.600106+0000","last_unstale":"2023-10-08T00:26:19.600689+0000","last_undegraded":"2023-10-08T00:26:19.600689+0000","last_fullsized":"2023-10-08T00:26:19.600689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:21.811829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590132+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:50.555024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606611+0000","last_change":"2023-10-08T00:26:19.606611+0000","last_active":"2023-10-08T00:26:19.606611+0000","last_peered":"2023-10-08T00:26:19.606611+0000","last_clean":"2023-10-08T00:26:19.606611+0000","last_became_active":"2023-10-08T00:26:19.606386+0000","last_became_peered":"2023-10-08T00:26:19.606386+0000","last_unstale":"2023-10-08T00:26:19.606611+0000","last_undegraded":"2023-10-08T00:26:19.606611+0000","last_fullsized":"2023-10-08T00:26:19.606611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:59.014269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595057+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.596506+0000","last_change":"2023-10-08T00:26:19.596506+0000","last_active":"2023-10-08T00:26:19.596506+0000","last_peered":"2023-10-08T00:26:19.596506+0000","last_clean":"2023-10-08T00:26:19.596506+0000","last_became_active":"2023-10-08T00:26:19.596208+0000","last_became_peered":"2023-10-08T00:26:19.596208+0000","last_unstale":"2023-10-08T00:26:19.596506+0000","last_undegraded":"2023-10-08T00:26:19.596506+0000","last_fullsized":"2023-10-08T00:26:19.596506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590207+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:22.815903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604610+0000","last_change":"2023-10-08T00:26:19.604610+0000","last_active":"2023-10-08T00:26:19.604610+0000","last_peered":"2023-10-08T00:26:19.604610+0000","last_clean":"2023-10-08T00:26:19.604610+0000","last_became_active":"2023-10-08T00:26:19.604289+0000","last_became_peered":"2023-10-08T00:26:19.604289+0000","last_unstale":"2023-10-08T00:26:19.604610+0000","last_undegraded":"2023-10-08T00:26:19.604610+0000","last_fullsized":"2023-10-08T00:26:19.604610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589674+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602199+0000","last_change":"2023-10-08T00:26:19.602199+0000","last_active":"2023-10-08T00:26:19.602199+0000","last_peered":"2023-10-08T00:26:19.602199+0000","last_clean":"2023-10-08T00:26:19.602199+0000","last_became_active":"2023-10-08T00:26:19.601934+0000","last_became_peered":"2023-10-08T00:26:19.601934+0000","last_unstale":"2023-10-08T00:26:19.602199+0000","last_undegraded":"2023-10-08T00:26:19.602199+0000","last_fullsized":"2023-10-08T00:26:19.602199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:37.185009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589922+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605412+0000","last_change":"2023-10-08T00:26:19.605412+0000","last_active":"2023-10-08T00:26:19.605412+0000","last_peered":"2023-10-08T00:26:19.605412+0000","last_clean":"2023-10-08T00:26:19.605412+0000","last_became_active":"2023-10-08T00:26:19.605141+0000","last_became_peered":"2023-10-08T00:26:19.605141+0000","last_unstale":"2023-10-08T00:26:19.605412+0000","last_undegraded":"2023-10-08T00:26:19.605412+0000","last_fullsized":"2023-10-08T00:26:19.605412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:06:37.248332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T00:26:18.584688+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:18.584688+0000","last_peered":"2023-10-08T00:26:18.584688+0000","last_clean":"2023-10-08T00:26:18.584688+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:18.584688+0000","last_undegraded":"2023-10-08T00:26:18.584688+0000","last_fullsized":"2023-10-08T00:26:18.584688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.499}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.437}]},{"osd":4,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.621},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76800000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.318},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.378}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.316}]},{"osd":2,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.80100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:26:25.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:26:25.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.241+0000 7f6a00c62700 1 Processor -- start 2023-10-08T00:26:25.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.241+0000 7f6a00c62700 1 -- start start 2023-10-08T00:26:25.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f6a00c62700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f69fc159c60 0x7f69fc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f6a00c62700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 0x7f69fc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f6a00c62700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc15a160 con 0x7f69fc159890 2023-10-08T00:26:25.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f6a00c62700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc15df50 con 0x7f69fc159c60 2023-10-08T00:26:25.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f6a00c62700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0d13a0 con 0x7f69fc15db10 2023-10-08T00:26:25.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f69fad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 0x7f69fc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f69f9d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f69fc159c60 0x7f69fc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f69fad9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 0x7f69fc069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47908/0 (socket says 172.21.15.22:47908) 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.242+0000 7f69fad9d700 1 -- 172.21.15.22:0/1341337382 learned_addr learned my addr 172.21.15.22:0/1341337382 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69fad9d700 1 -- 172.21.15.22:0/1341337382 >> v2:172.21.15.192:3300/0 conn(0x7f69fc159c60 msgr2=0x7f69fc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69fad9d700 1 --2- 172.21.15.22:0/1341337382 >> v2:172.21.15.192:3300/0 conn(0x7f69fc159c60 0x7f69fc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69fad9d700 1 -- 172.21.15.22:0/1341337382 >> v1:172.21.15.192:6789/0 conn(0x7f69fc159890 legacy=0x7f69fc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69fad9d700 1 -- 172.21.15.22:0/1341337382 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc15e140 con 0x7f69fc15db10 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69fad9d700 1 --2- 172.21.15.22:0/1341337382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 0x7f69fc069560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009f20 tx=0x7f69f4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6206522f921913f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69f959a700 1 -- 172.21.15.22:0/1341337382 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400e070 con 0x7f69fc15db10 2023-10-08T00:26:25.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69f959a700 1 -- 172.21.15.22:0/1341337382 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400b9d0 con 0x7f69fc15db10 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.243+0000 7f69f959a700 1 -- 172.21.15.22:0/1341337382 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40092e0 con 0x7f69fc15db10 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 -- 172.21.15.22:0/1341337382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 msgr2=0x7f69fc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 --2- 172.21.15.22:0/1341337382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 0x7f69fc069560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009f20 tx=0x7f69f4009840 comp rx=0 tx=0).stop 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 -- 172.21.15.22:0/1341337382 shutdown_connections 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 --2- 172.21.15.22:0/1341337382 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc15db10 0x7f69fc069560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 --2- 172.21.15.22:0/1341337382 >> v2:172.21.15.192:3300/0 conn(0x7f69fc159c60 0x7f69fc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 -- 172.21.15.22:0/1341337382 >> 172.21.15.22:0/1341337382 conn(0x7f69fc068e20 msgr2=0x7f69fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 -- 172.21.15.22:0/1341337382 shutdown_connections 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.244+0000 7f6a00c62700 1 -- 172.21.15.22:0/1341337382 wait complete. 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.245+0000 7f6a00c62700 1 Processor -- start 2023-10-08T00:26:25.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.245+0000 7f6a00c62700 1 -- start start 2023-10-08T00:26:25.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f6a00c62700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 0x7f69fc151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f6a00c62700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc159c60 0x7f69fc150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f6a00c62700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69fc15db10 0x7f69fc16cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f6a00c62700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc151a40 con 0x7f69fc159890 2023-10-08T00:26:25.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f6a00c62700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0b5e60 con 0x7f69fc15db10 2023-10-08T00:26:25.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f6a00c62700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc16dcf0 con 0x7f69fc159c60 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 0x7f69fc151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 0x7f69fc151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44952/0 (socket says 172.21.15.22:44952) 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 -- 172.21.15.22:0/3074201010 learned_addr learned my addr 172.21.15.22:0/3074201010 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69f9d9b700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc159c60 0x7f69fc150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fad9d700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69fc15db10 0x7f69fc16cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 -- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc159c60 msgr2=0x7f69fc150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc159c60 0x7f69fc150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 -- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69fc15db10 msgr2=0x7f69fc16cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69fc15db10 0x7f69fc16cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 -- 172.21.15.22:0/3074201010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009ae0 con 0x7f69fc159890 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69f9d9b700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc159c60 0x7f69fc150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fad9d700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69fc15db10 0x7f69fc16cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69fa59c700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 0x7f69fc151c00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c590 tx=0x7f69ec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.246+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec011590 con 0x7f69fc159890 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.247+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec0116f0 con 0x7f69fc159890 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.247+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec011ab0 con 0x7f69fc159890 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.247+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc0b5b30 con 0x7f69fc159890 2023-10-08T00:26:25.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.247+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc151400 con 0x7f69fc159890 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.247+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc0b59a0 con 0x7f69fc159890 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.248+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69ec01b3b0 con 0x7f69fc159890 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.248+0000 7f69f27fc700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f69dc066f60 0x7f69dc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.248+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f69ec083b60 con 0x7f69fc159890 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.248+0000 7f69f9d9b700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f69dc066f60 0x7f69dc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.249+0000 7f69f9d9b700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f69dc066f60 0x7f69dc069410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69e4006f00 tx=0x7f69e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.253+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69ec050dd0 con 0x7f69fc159890 2023-10-08T00:26:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.440+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69fc04c3c0 con 0x7f69dc066f60 2023-10-08T00:26:25.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.449+0000 7f69f27fc700 1 -- 172.21.15.22:0/3074201010 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286182 (secure 0 0 0) 0x7f69fc04c3c0 con 0x7f69dc066f60 2023-10-08T00:26:25.452 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f69dc066f60 msgr2=0x7f69dc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f69dc066f60 0x7f69dc069410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69e4006f00 tx=0x7f69e4008040 comp rx=0 tx=0).stop 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 msgr2=0x7f69fc151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 0x7f69fc151c00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00c590 tx=0x7f69ec00c950 comp rx=0 tx=0).stop 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 shutdown_connections 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69fc15db10 0x7f69fc16cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69fc159890 0x7f69fc151c00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f69dc066f60 0x7f69dc069410 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 --2- 172.21.15.22:0/3074201010 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69fc159c60 0x7f69fc150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 >> 172.21.15.22:0/3074201010 conn(0x7f69fc068e20 msgr2=0x7f69fc15aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 shutdown_connections 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.452+0000 7f6a00c62700 1 -- 172.21.15.22:0/3074201010 wait complete. 2023-10-08T00:26:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:26:25.465 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-08T00:26:24.404187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3184976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824848"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599393+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:29:01.638624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590985+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:50.913174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594518+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599484+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.600095+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:53:38.314979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594634+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590031+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:57.883334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590472+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:19.048692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590274+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590516+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590284+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598424+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593850+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:17.839382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589464+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589050+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590081+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593989+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:11.734935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596099+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597568+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:41.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591474+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:12.028201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596104+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:43.603190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591486+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:36.046629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594750+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593181+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:02:41.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598414+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:33.154763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596889+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593641+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597453+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:23:28.943871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592897+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:29.770533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592857+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596685+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:33.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590614+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592903+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603655+0000","last_change":"2023-10-08T00:26:19.603655+0000","last_active":"2023-10-08T00:26:19.603655+0000","last_peered":"2023-10-08T00:26:19.603655+0000","last_clean":"2023-10-08T00:26:19.603655+0000","last_became_active":"2023-10-08T00:26:19.603377+0000","last_became_peered":"2023-10-08T00:26:19.603377+0000","last_unstale":"2023-10-08T00:26:19.603655+0000","last_undegraded":"2023-10-08T00:26:19.603655+0000","last_fullsized":"2023-10-08T00:26:19.603655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592238+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607378+0000","last_change":"2023-10-08T00:26:19.607378+0000","last_active":"2023-10-08T00:26:19.607378+0000","last_peered":"2023-10-08T00:26:19.607378+0000","last_clean":"2023-10-08T00:26:19.607378+0000","last_became_active":"2023-10-08T00:26:19.607064+0000","last_became_peered":"2023-10-08T00:26:19.607064+0000","last_unstale":"2023-10-08T00:26:19.607378+0000","last_undegraded":"2023-10-08T00:26:19.607378+0000","last_fullsized":"2023-10-08T00:26:19.607378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:10.458996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593732+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605020+0000","last_change":"2023-10-08T00:26:19.605020+0000","last_active":"2023-10-08T00:26:19.605020+0000","last_peered":"2023-10-08T00:26:19.605020+0000","last_clean":"2023-10-08T00:26:19.605020+0000","last_became_active":"2023-10-08T00:26:19.604701+0000","last_became_peered":"2023-10-08T00:26:19.604701+0000","last_unstale":"2023-10-08T00:26:19.605020+0000","last_undegraded":"2023-10-08T00:26:19.605020+0000","last_fullsized":"2023-10-08T00:26:19.605020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593165+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605625+0000","last_change":"2023-10-08T00:26:19.605625+0000","last_active":"2023-10-08T00:26:19.605625+0000","last_peered":"2023-10-08T00:26:19.605625+0000","last_clean":"2023-10-08T00:26:19.605625+0000","last_became_active":"2023-10-08T00:26:19.605342+0000","last_became_peered":"2023-10-08T00:26:19.605342+0000","last_unstale":"2023-10-08T00:26:19.605625+0000","last_undegraded":"2023-10-08T00:26:19.605625+0000","last_fullsized":"2023-10-08T00:26:19.605625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590705+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:33.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604952+0000","last_change":"2023-10-08T00:26:19.604952+0000","last_active":"2023-10-08T00:26:19.604952+0000","last_peered":"2023-10-08T00:26:19.604952+0000","last_clean":"2023-10-08T00:26:19.604952+0000","last_became_active":"2023-10-08T00:26:19.604683+0000","last_became_peered":"2023-10-08T00:26:19.604683+0000","last_unstale":"2023-10-08T00:26:19.604952+0000","last_undegraded":"2023-10-08T00:26:19.604952+0000","last_fullsized":"2023-10-08T00:26:19.604952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:08.235838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591591+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:11.214977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600569+0000","last_change":"2023-10-08T00:26:19.600569+0000","last_active":"2023-10-08T00:26:19.600569+0000","last_peered":"2023-10-08T00:26:19.600569+0000","last_clean":"2023-10-08T00:26:19.600569+0000","last_became_active":"2023-10-08T00:26:19.600309+0000","last_became_peered":"2023-10-08T00:26:19.600309+0000","last_unstale":"2023-10-08T00:26:19.600569+0000","last_undegraded":"2023-10-08T00:26:19.600569+0000","last_fullsized":"2023-10-08T00:26:19.600569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:56.879260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592653+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:41.374769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.599836+0000","last_change":"2023-10-08T00:26:19.599836+0000","last_active":"2023-10-08T00:26:19.599836+0000","last_peered":"2023-10-08T00:26:19.599836+0000","last_clean":"2023-10-08T00:26:19.599836+0000","last_became_active":"2023-10-08T00:26:19.599090+0000","last_became_peered":"2023-10-08T00:26:19.599090+0000","last_unstale":"2023-10-08T00:26:19.599836+0000","last_undegraded":"2023-10-08T00:26:19.599836+0000","last_fullsized":"2023-10-08T00:26:19.599836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593665+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:00.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602581+0000","last_change":"2023-10-08T00:26:19.602581+0000","last_active":"2023-10-08T00:26:19.602581+0000","last_peered":"2023-10-08T00:26:19.602581+0000","last_clean":"2023-10-08T00:26:19.602581+0000","last_became_active":"2023-10-08T00:26:19.602298+0000","last_became_peered":"2023-10-08T00:26:19.602298+0000","last_unstale":"2023-10-08T00:26:19.602581+0000","last_undegraded":"2023-10-08T00:26:19.602581+0000","last_fullsized":"2023-10-08T00:26:19.602581+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589461+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604715+0000","last_change":"2023-10-08T00:26:19.604715+0000","last_active":"2023-10-08T00:26:19.604715+0000","last_peered":"2023-10-08T00:26:19.604715+0000","last_clean":"2023-10-08T00:26:19.604715+0000","last_became_active":"2023-10-08T00:26:19.604361+0000","last_became_peered":"2023-10-08T00:26:19.604361+0000","last_unstale":"2023-10-08T00:26:19.604715+0000","last_undegraded":"2023-10-08T00:26:19.604715+0000","last_fullsized":"2023-10-08T00:26:19.604715+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:49.574894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593277+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608864+0000","last_change":"2023-10-08T00:26:19.608864+0000","last_active":"2023-10-08T00:26:19.608864+0000","last_peered":"2023-10-08T00:26:19.608864+0000","last_clean":"2023-10-08T00:26:19.608864+0000","last_became_active":"2023-10-08T00:26:19.607415+0000","last_became_peered":"2023-10-08T00:26:19.607415+0000","last_unstale":"2023-10-08T00:26:19.608864+0000","last_undegraded":"2023-10-08T00:26:19.608864+0000","last_fullsized":"2023-10-08T00:26:19.608864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:38.957091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593613+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.610582+0000","last_change":"2023-10-08T00:26:19.610582+0000","last_active":"2023-10-08T00:26:19.610582+0000","last_peered":"2023-10-08T00:26:19.610582+0000","last_clean":"2023-10-08T00:26:19.610582+0000","last_became_active":"2023-10-08T00:26:19.610280+0000","last_became_peered":"2023-10-08T00:26:19.610280+0000","last_unstale":"2023-10-08T00:26:19.610582+0000","last_undegraded":"2023-10-08T00:26:19.610582+0000","last_fullsized":"2023-10-08T00:26:19.610582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:07.605223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594020+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602544+0000","last_change":"2023-10-08T00:26:19.602544+0000","last_active":"2023-10-08T00:26:19.602544+0000","last_peered":"2023-10-08T00:26:19.602544+0000","last_clean":"2023-10-08T00:26:19.602544+0000","last_became_active":"2023-10-08T00:26:19.602253+0000","last_became_peered":"2023-10-08T00:26:19.602253+0000","last_unstale":"2023-10-08T00:26:19.602544+0000","last_undegraded":"2023-10-08T00:26:19.602544+0000","last_fullsized":"2023-10-08T00:26:19.602544+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591981+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607794+0000","last_change":"2023-10-08T00:26:19.607794+0000","last_active":"2023-10-08T00:26:19.607794+0000","last_peered":"2023-10-08T00:26:19.607794+0000","last_clean":"2023-10-08T00:26:19.607794+0000","last_became_active":"2023-10-08T00:26:19.607401+0000","last_became_peered":"2023-10-08T00:26:19.607401+0000","last_unstale":"2023-10-08T00:26:19.607794+0000","last_undegraded":"2023-10-08T00:26:19.607794+0000","last_fullsized":"2023-10-08T00:26:19.607794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.800417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595623+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602407+0000","last_change":"2023-10-08T00:26:19.602407+0000","last_active":"2023-10-08T00:26:19.602407+0000","last_peered":"2023-10-08T00:26:19.602407+0000","last_clean":"2023-10-08T00:26:19.602407+0000","last_became_active":"2023-10-08T00:26:19.602143+0000","last_became_peered":"2023-10-08T00:26:19.602143+0000","last_unstale":"2023-10-08T00:26:19.602407+0000","last_undegraded":"2023-10-08T00:26:19.602407+0000","last_fullsized":"2023-10-08T00:26:19.602407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:21:00.734187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589780+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601497+0000","last_change":"2023-10-08T00:26:19.601497+0000","last_active":"2023-10-08T00:26:19.601497+0000","last_peered":"2023-10-08T00:26:19.601497+0000","last_clean":"2023-10-08T00:26:19.601497+0000","last_became_active":"2023-10-08T00:26:19.601186+0000","last_became_peered":"2023-10-08T00:26:19.601186+0000","last_unstale":"2023-10-08T00:26:19.601497+0000","last_undegraded":"2023-10-08T00:26:19.601497+0000","last_fullsized":"2023-10-08T00:26:19.601497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594228+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606874+0000","last_change":"2023-10-08T00:26:19.606874+0000","last_active":"2023-10-08T00:26:19.606874+0000","last_peered":"2023-10-08T00:26:19.606874+0000","last_clean":"2023-10-08T00:26:19.606874+0000","last_became_active":"2023-10-08T00:26:19.606627+0000","last_became_peered":"2023-10-08T00:26:19.606627+0000","last_unstale":"2023-10-08T00:26:19.606874+0000","last_undegraded":"2023-10-08T00:26:19.606874+0000","last_fullsized":"2023-10-08T00:26:19.606874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:00.539100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595558+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608143+0000","last_change":"2023-10-08T00:26:19.608143+0000","last_active":"2023-10-08T00:26:19.608143+0000","last_peered":"2023-10-08T00:26:19.608143+0000","last_clean":"2023-10-08T00:26:19.608143+0000","last_became_active":"2023-10-08T00:26:19.607848+0000","last_became_peered":"2023-10-08T00:26:19.607848+0000","last_unstale":"2023-10-08T00:26:19.608143+0000","last_undegraded":"2023-10-08T00:26:19.608143+0000","last_fullsized":"2023-10-08T00:26:19.608143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:42.599116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591755+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604741+0000","last_change":"2023-10-08T00:26:19.604741+0000","last_active":"2023-10-08T00:26:19.604741+0000","last_peered":"2023-10-08T00:26:19.604741+0000","last_clean":"2023-10-08T00:26:19.604741+0000","last_became_active":"2023-10-08T00:26:19.604455+0000","last_became_peered":"2023-10-08T00:26:19.604455+0000","last_unstale":"2023-10-08T00:26:19.604741+0000","last_undegraded":"2023-10-08T00:26:19.604741+0000","last_fullsized":"2023-10-08T00:26:19.604741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590183+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:08.791091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601546+0000","last_change":"2023-10-08T00:26:19.601546+0000","last_active":"2023-10-08T00:26:19.601546+0000","last_peered":"2023-10-08T00:26:19.601546+0000","last_clean":"2023-10-08T00:26:19.601546+0000","last_became_active":"2023-10-08T00:26:19.601250+0000","last_became_peered":"2023-10-08T00:26:19.601250+0000","last_unstale":"2023-10-08T00:26:19.601546+0000","last_undegraded":"2023-10-08T00:26:19.601546+0000","last_fullsized":"2023-10-08T00:26:19.601546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593465+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602311+0000","last_change":"2023-10-08T00:26:19.602311+0000","last_active":"2023-10-08T00:26:19.602311+0000","last_peered":"2023-10-08T00:26:19.602311+0000","last_clean":"2023-10-08T00:26:19.602311+0000","last_became_active":"2023-10-08T00:26:19.602101+0000","last_became_peered":"2023-10-08T00:26:19.602101+0000","last_unstale":"2023-10-08T00:26:19.602311+0000","last_undegraded":"2023-10-08T00:26:19.602311+0000","last_fullsized":"2023-10-08T00:26:19.602311+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591378+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601160+0000","last_change":"2023-10-08T00:26:19.601160+0000","last_active":"2023-10-08T00:26:19.601160+0000","last_peered":"2023-10-08T00:26:19.601160+0000","last_clean":"2023-10-08T00:26:19.601160+0000","last_became_active":"2023-10-08T00:26:19.600877+0000","last_became_peered":"2023-10-08T00:26:19.600877+0000","last_unstale":"2023-10-08T00:26:19.601160+0000","last_undegraded":"2023-10-08T00:26:19.601160+0000","last_fullsized":"2023-10-08T00:26:19.601160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:39.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592969+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606732+0000","last_change":"2023-10-08T00:26:19.606732+0000","last_active":"2023-10-08T00:26:19.606732+0000","last_peered":"2023-10-08T00:26:19.606732+0000","last_clean":"2023-10-08T00:26:19.606732+0000","last_became_active":"2023-10-08T00:26:19.605988+0000","last_became_peered":"2023-10-08T00:26:19.605988+0000","last_unstale":"2023-10-08T00:26:19.606732+0000","last_undegraded":"2023-10-08T00:26:19.606732+0000","last_fullsized":"2023-10-08T00:26:19.606732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:54.101460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591757+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603665+0000","last_change":"2023-10-08T00:26:19.603665+0000","last_active":"2023-10-08T00:26:19.603665+0000","last_peered":"2023-10-08T00:26:19.603665+0000","last_clean":"2023-10-08T00:26:19.603665+0000","last_became_active":"2023-10-08T00:26:19.603462+0000","last_became_peered":"2023-10-08T00:26:19.603462+0000","last_unstale":"2023-10-08T00:26:19.603665+0000","last_undegraded":"2023-10-08T00:26:19.603665+0000","last_fullsized":"2023-10-08T00:26:19.603665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591677+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608522+0000","last_change":"2023-10-08T00:26:19.608522+0000","last_active":"2023-10-08T00:26:19.608522+0000","last_peered":"2023-10-08T00:26:19.608522+0000","last_clean":"2023-10-08T00:26:19.608522+0000","last_became_active":"2023-10-08T00:26:19.607944+0000","last_became_peered":"2023-10-08T00:26:19.607944+0000","last_unstale":"2023-10-08T00:26:19.608522+0000","last_undegraded":"2023-10-08T00:26:19.608522+0000","last_fullsized":"2023-10-08T00:26:19.608522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:36.450510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597082+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600540+0000","last_change":"2023-10-08T00:26:19.600540+0000","last_active":"2023-10-08T00:26:19.600540+0000","last_peered":"2023-10-08T00:26:19.600540+0000","last_clean":"2023-10-08T00:26:19.600540+0000","last_became_active":"2023-10-08T00:26:19.600250+0000","last_became_peered":"2023-10-08T00:26:19.600250+0000","last_unstale":"2023-10-08T00:26:19.600540+0000","last_undegraded":"2023-10-08T00:26:19.600540+0000","last_fullsized":"2023-10-08T00:26:19.600540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590178+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:02.956481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600255+0000","last_change":"2023-10-08T00:26:19.600255+0000","last_active":"2023-10-08T00:26:19.600255+0000","last_peered":"2023-10-08T00:26:19.600255+0000","last_clean":"2023-10-08T00:26:19.600255+0000","last_became_active":"2023-10-08T00:26:19.599956+0000","last_became_peered":"2023-10-08T00:26:19.599956+0000","last_unstale":"2023-10-08T00:26:19.600255+0000","last_undegraded":"2023-10-08T00:26:19.600255+0000","last_fullsized":"2023-10-08T00:26:19.600255+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:50.293350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592318+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600689+0000","last_change":"2023-10-08T00:26:19.600689+0000","last_active":"2023-10-08T00:26:19.600689+0000","last_peered":"2023-10-08T00:26:19.600689+0000","last_clean":"2023-10-08T00:26:19.600689+0000","last_became_active":"2023-10-08T00:26:19.600106+0000","last_became_peered":"2023-10-08T00:26:19.600106+0000","last_unstale":"2023-10-08T00:26:19.600689+0000","last_undegraded":"2023-10-08T00:26:19.600689+0000","last_fullsized":"2023-10-08T00:26:19.600689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:21.811829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590132+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:50.555024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606611+0000","last_change":"2023-10-08T00:26:19.606611+0000","last_active":"2023-10-08T00:26:19.606611+0000","last_peered":"2023-10-08T00:26:19.606611+0000","last_clean":"2023-10-08T00:26:19.606611+0000","last_became_active":"2023-10-08T00:26:19.606386+0000","last_became_peered":"2023-10-08T00:26:19.606386+0000","last_unstale":"2023-10-08T00:26:19.606611+0000","last_undegraded":"2023-10-08T00:26:19.606611+0000","last_fullsized":"2023-10-08T00:26:19.606611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:59.014269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595057+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.596506+0000","last_change":"2023-10-08T00:26:19.596506+0000","last_active":"2023-10-08T00:26:19.596506+0000","last_peered":"2023-10-08T00:26:19.596506+0000","last_clean":"2023-10-08T00:26:19.596506+0000","last_became_active":"2023-10-08T00:26:19.596208+0000","last_became_peered":"2023-10-08T00:26:19.596208+0000","last_unstale":"2023-10-08T00:26:19.596506+0000","last_undegraded":"2023-10-08T00:26:19.596506+0000","last_fullsized":"2023-10-08T00:26:19.596506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590207+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:22.815903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604610+0000","last_change":"2023-10-08T00:26:19.604610+0000","last_active":"2023-10-08T00:26:19.604610+0000","last_peered":"2023-10-08T00:26:19.604610+0000","last_clean":"2023-10-08T00:26:19.604610+0000","last_became_active":"2023-10-08T00:26:19.604289+0000","last_became_peered":"2023-10-08T00:26:19.604289+0000","last_unstale":"2023-10-08T00:26:19.604610+0000","last_undegraded":"2023-10-08T00:26:19.604610+0000","last_fullsized":"2023-10-08T00:26:19.604610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589674+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602199+0000","last_change":"2023-10-08T00:26:19.602199+0000","last_active":"2023-10-08T00:26:19.602199+0000","last_peered":"2023-10-08T00:26:19.602199+0000","last_clean":"2023-10-08T00:26:19.602199+0000","last_became_active":"2023-10-08T00:26:19.601934+0000","last_became_peered":"2023-10-08T00:26:19.601934+0000","last_unstale":"2023-10-08T00:26:19.602199+0000","last_undegraded":"2023-10-08T00:26:19.602199+0000","last_fullsized":"2023-10-08T00:26:19.602199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:37.185009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589922+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605412+0000","last_change":"2023-10-08T00:26:19.605412+0000","last_active":"2023-10-08T00:26:19.605412+0000","last_peered":"2023-10-08T00:26:19.605412+0000","last_clean":"2023-10-08T00:26:19.605412+0000","last_became_active":"2023-10-08T00:26:19.605141+0000","last_became_peered":"2023-10-08T00:26:19.605141+0000","last_unstale":"2023-10-08T00:26:19.605412+0000","last_undegraded":"2023-10-08T00:26:19.605412+0000","last_fullsized":"2023-10-08T00:26:19.605412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:06:37.248332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T00:26:18.584688+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:18.584688+0000","last_peered":"2023-10-08T00:26:18.584688+0000","last_clean":"2023-10-08T00:26:18.584688+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:18.584688+0000","last_undegraded":"2023-10-08T00:26:18.584688+0000","last_fullsized":"2023-10-08T00:26:18.584688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.499}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.437}]},{"osd":4,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.621},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76800000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.318},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.378}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.316}]},{"osd":2,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.80100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:26:25.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-10-08T00:26:25.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.599393+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:29:01.638624+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:26:25.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-10-08T00:26:25.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590985+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:13:50.913174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.594518+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.599484+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.600095+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:53:38.314979+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-10-08T00:26:25.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.594634+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590031+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:24:57.883334+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590472+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:54:19.048692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590274+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590516+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-10-08T00:26:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590284+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:26:25.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-10-08T00:26:25.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.598424+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-08T00:26:25.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593850+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:49:17.839382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:26:25.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-08T00:26:25.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.589464+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.589050+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590081+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593989+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:29:11.734935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-10-08T00:26:25.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.596099+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-10-08T00:26:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.597568+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:05:41.740339+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:26:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-10-08T00:26:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591474+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:43:12.028201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-10-08T00:26:25.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.596104+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T00:30:43.603190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591486+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:58:36.046629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.594750+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593181+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:02:41.556546+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:26:25.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.598414+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T12:25:33.154763+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.596889+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593641+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.597453+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:23:28.943871+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:26:25.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-10-08T00:26:25.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592897+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T00:42:29.770533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-10-08T00:26:25.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592857+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-10-08T00:26:25.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.596685+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:00:33.713170+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:26:25.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590614+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592903+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592238+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593732+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593165+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590705+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:16:33.932733+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591591+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:44:11.214977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592653+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:45:41.374769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-10-08T00:26:25.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593665+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:00:00.245502+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.589461+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593277+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593613+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.594020+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591981+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.595623+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.589780+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.594228+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-10-08T00:26:25.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.595558+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591755+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590183+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:48:08.791091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.593465+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591378+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592969+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591757+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.591677+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.597082+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-10-08T00:26:25.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590178+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:41:02.956481+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.592318+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590132+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:01:50.555024+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.595057+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.590207+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:21:22.815903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:26:25.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-10-08T00:26:25.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.589674+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-10-08T00:26:25.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:19.578772+0000', 'last_change': '2023-10-08T00:26:19.589922+0000', 'last_active': '2023-10-08T00:26:19.578772+0000', 'last_peered': '2023-10-08T00:26:19.578772+0000', 'last_clean': '2023-10-08T00:26:19.578772+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:19.578772+0000', 'last_undegraded': '2023-10-08T00:26:19.578772+0000', 'last_fullsized': '2023-10-08T00:26:19.578772+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:19.578772+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:26:25.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T00:26:25.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.623+0000 7ff245420700 1 Processor -- start 2023-10-08T00:26:25.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.623+0000 7ff245420700 1 -- start start 2023-10-08T00:26:25.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.623+0000 7ff245420700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 0x7ff2400b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff245420700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2400b5b00 con 0x7ff2400cf350 2023-10-08T00:26:25.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff245420700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2400b5da0 con 0x7ff2400b53d0 2023-10-08T00:26:25.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff245420700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400b6080 con 0x7ff240159ec0 2023-10-08T00:26:25.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff2400cf350 0x7ff2400cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46094/0 (socket says 172.21.15.22:46094) 2023-10-08T00:26:25.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23f7fe700 1 -- 172.21.15.22:0/1294281571 learned_addr learned my addr 172.21.15.22:0/1294281571 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23effd700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 0x7ff2400b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982023657 0 0) 0x7ff2400b5b00 con 0x7ff2400cf350 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff228003570 con 0x7ff2400cf350 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4114880369 0 0) 0x7ff228003570 con 0x7ff2400cf350 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 msgr2=0x7ff2400b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 0x7ff2400b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 >> v1:172.21.15.192:6789/0 conn(0x7ff2400b53d0 legacy=0x7ff2400cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400cc100 con 0x7ff2400cf350 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7ff2380017f0 con 0x7ff2400cf350 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 >> v1:172.21.15.22:6789/0 conn(0x7ff2400cf350 legacy=0x7ff2400cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff228003a90 0x7ff228003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 0x7ff228004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff228004d50 0x7ff2280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400b6080 con 0x7ff228004d50 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22800bb10 con 0x7ff228003a90 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22800bcd0 con 0x7ff240159ec0 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.624+0000 7ff23f7fe700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff228004d50 0x7ff2280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23e7fc700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 0x7ff228004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23effd700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff228003a90 0x7ff228003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23f7fe700 1 -- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 msgr2=0x7ff228004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23f7fe700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff240159ec0 0x7ff228004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23f7fe700 1 -- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff228003a90 msgr2=0x7ff228003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23f7fe700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff228003a90 0x7ff228003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23f7fe700 1 -- 172.21.15.22:0/1294281571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228003570 con 0x7ff228004d50 2023-10-08T00:26:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23f7fe700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff228004d50 0x7ff2280051c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff23800a950 tx=0x7ff2380021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6664fbd2c60f339f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2380070d0 con 0x7ff228004d50 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff238007230 con 0x7ff228004d50 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.625+0000 7ff23dffb700 1 -- 172.21.15.22:0/1294281571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2380075f0 con 0x7ff228004d50 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff245420700 1 -- 172.21.15.22:0/1294281571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff228004d50 msgr2=0x7ff2280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff245420700 1 --2- 172.21.15.22:0/1294281571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff228004d50 0x7ff2280051c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff23800a950 tx=0x7ff2380021f0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff23f7fe700 1 -- 172.21.15.22:0/1294281571 reap_dead start 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff245420700 1 -- 172.21.15.22:0/1294281571 shutdown_connections 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff245420700 1 -- 172.21.15.22:0/1294281571 >> 172.21.15.22:0/1294281571 conn(0x7ff2400999f0 msgr2=0x7ff2400b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff245420700 1 -- 172.21.15.22:0/1294281571 shutdown_connections 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.626+0000 7ff245420700 1 -- 172.21.15.22:0/1294281571 wait complete. 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.627+0000 7ff245420700 1 Processor -- start 2023-10-08T00:26:25.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.627+0000 7ff245420700 1 -- start start 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24013b690 0x7ff240154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 0x7ff2400c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2400c8fe0 0x7ff240141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240154dc0 con 0x7ff240152380 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400c9450 con 0x7ff24013b690 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24013f7c0 con 0x7ff2400c8fe0 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 0x7ff2400c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 0x7ff2400c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44972/0 (socket says 172.21.15.22:44972) 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 -- 172.21.15.22:0/3674223086 learned_addr learned my addr 172.21.15.22:0/3674223086 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23effd700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24013b690 0x7ff240154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23f7fe700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2400c8fe0 0x7ff240141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 -- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2400c8fe0 msgr2=0x7ff240141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2400c8fe0 0x7ff240141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 -- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24013b690 msgr2=0x7ff240154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24013b690 0x7ff240154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 -- 172.21.15.22:0/3674223086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24013f1b0 con 0x7ff240152380 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23effd700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24013b690 0x7ff240154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff23e7fc700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 0x7ff2400c8aa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff234002ae0 tx=0x7ff234007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400f9a0 con 0x7ff240152380 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23400fb00 con 0x7ff240152380 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff240154fd0 con 0x7ff240152380 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340133f0 con 0x7ff240152380 2023-10-08T00:26:25.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.628+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2401527f0 con 0x7ff240152380 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.629+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff240063700 con 0x7ff240152380 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.630+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff234013820 con 0x7ff240152380 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.630+0000 7ff226ffd700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff22c066f30 0x7ff22c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.630+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff234084530 con 0x7ff240152380 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.630+0000 7ff23effd700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff22c066f30 0x7ff22c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.631+0000 7ff23effd700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff22c066f30 0x7ff22c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff230006ea0 tx=0x7ff230008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:25.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.634+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2340517a0 con 0x7ff240152380 2023-10-08T00:26:25.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.908+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff240063c90 con 0x7ff240152380 2023-10-08T00:26:25.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.908+0000 7ff226ffd700 1 -- 172.21.15.22:0/3674223086 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1455 (secure 0 0 0) 0x7ff234054dc0 con 0x7ff240152380 2023-10-08T00:26:25.909 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:25.909 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":111,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1696724684,"num_in_osds":8,"osd_in_since":1696724677,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2449743872,"bytes_avail":770644369408,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5349}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-08T00:26:04.399860+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff22c066f30 msgr2=0x7ff22c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff22c066f30 0x7ff22c0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff230006ea0 tx=0x7ff230008040 comp rx=0 tx=0).stop 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 msgr2=0x7ff2400c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 0x7ff2400c8aa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff234002ae0 tx=0x7ff234007d10 comp rx=0 tx=0).stop 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 shutdown_connections 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff22c066f30 0x7ff22c0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2400c8fe0 0x7ff240141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff24013b690 0x7ff240154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 --2- 172.21.15.22:0/3674223086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff240152380 0x7ff2400c8aa0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:25.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 >> 172.21.15.22:0/3674223086 conn(0x7ff2400999f0 msgr2=0x7ff2400c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:25.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 shutdown_connections 2023-10-08T00:26:25.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:25.910+0000 7ff245420700 1 -- 172.21.15.22:0/3674223086 wait complete. 2023-10-08T00:26:25.923 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T00:26:25.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:26:26.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.041+0000 7fc52f3af700 1 Processor -- start 2023-10-08T00:26:26.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.041+0000 7fc52f3af700 1 -- start start 2023-10-08T00:26:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52f3af700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc5280b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52f3af700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc52815d230 0x7fc52815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52f3af700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52815dbd0 con 0x7fc528159420 2023-10-08T00:26:26.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52f3af700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5280b11d0 con 0x7fc52815d230 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52f3af700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280b14b0 con 0x7fc5281597f0 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52ebae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc52815d230 0x7fc52815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52dbac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc5280b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52ebae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc52815d230 0x7fc52815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:54824/0 (socket says 172.21.15.22:54824) 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52dbac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc5280b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47964/0 (socket says 172.21.15.22:47964) 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52ebae700 1 -- 172.21.15.22:0/103541665 learned_addr learned my addr 172.21.15.22:0/103541665 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.042+0000 7fc52e3ad700 1 --1- 172.21.15.22:0/103541665 >> v1:172.21.15.192:6789/0 conn(0x7fc528159420 0x7fc5280b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:48492/0 (socket says 172.21.15.22:48492) 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52ebae700 1 -- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 msgr2=0x7fc5280b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:26.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52ebae700 1 --2- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc5280b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52ebae700 1 -- 172.21.15.22:0/103541665 >> v1:172.21.15.192:6789/0 conn(0x7fc528159420 legacy=0x7fc5280b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52ebae700 1 -- 172.21.15.22:0/103541665 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280b1790 con 0x7fc52815d230 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52d3ab700 1 -- 172.21.15.22:0/103541665 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046480066 0 0) 0x7fc524001110 con 0x7fc528159420 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52ebae700 1 --2- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc52815d690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc520009f20 tx=0x7fc520009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20448c0267a0b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52d3ab700 1 -- 172.21.15.22:0/103541665 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000e070 con 0x7fc52815d230 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52d3ab700 1 -- 172.21.15.22:0/103541665 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000b9d0 con 0x7fc52815d230 2023-10-08T00:26:26.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52d3ab700 1 -- 172.21.15.22:0/103541665 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200092e0 con 0x7fc52815d230 2023-10-08T00:26:26.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52f3af700 1 -- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 msgr2=0x7fc52815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.043+0000 7fc52f3af700 1 --2- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc52815d690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc520009f20 tx=0x7fc520009840 comp rx=0 tx=0).stop 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.044+0000 7fc52f3af700 1 -- 172.21.15.22:0/103541665 shutdown_connections 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.044+0000 7fc52f3af700 1 --2- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc52815d690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.044+0000 7fc52f3af700 1 --2- 172.21.15.22:0/103541665 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc5280b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.044+0000 7fc52f3af700 1 -- 172.21.15.22:0/103541665 >> 172.21.15.22:0/103541665 conn(0x7fc5280d0660 msgr2=0x7fc5280d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.044+0000 7fc52f3af700 1 -- 172.21.15.22:0/103541665 shutdown_connections 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.044+0000 7fc52f3af700 1 -- 172.21.15.22:0/103541665 wait complete. 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 Processor -- start 2023-10-08T00:26:26.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 -- start start 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 0x7fc5280c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc52815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc528154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc528169cc0 con 0x7fc528159420 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52815c040 con 0x7fc52815d230 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.045+0000 7fc52f3af700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52815c320 con 0x7fc5281597f0 2023-10-08T00:26:26.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 0x7fc5280c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 0x7fc5280c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44974/0 (socket says 172.21.15.22:44974) 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 -- 172.21.15.22:0/3407803103 learned_addr learned my addr 172.21.15.22:0/3407803103 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52ebae700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc528154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 -- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 msgr2=0x7fc52815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc52815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 -- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 msgr2=0x7fc528154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc528154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 -- 172.21.15.22:0/3407803103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc520009ae0 con 0x7fc528159420 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52ebae700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc528154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52e3ad700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 0x7fc5280c6060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c810 tx=0x7fc524007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524007300 con 0x7fc528159420 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524007480 con 0x7fc528159420 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524004830 con 0x7fc528159420 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52815c600 con 0x7fc528159420 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.046+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5280c65a0 con 0x7fc528159420 2023-10-08T00:26:26.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.047+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc528169e30 con 0x7fc528159420 2023-10-08T00:26:26.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.048+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc524004be0 con 0x7fc528159420 2023-10-08T00:26:26.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.048+0000 7fc51e7fc700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc50c066f60 0x7fc50c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:26.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.048+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc524083560 con 0x7fc528159420 2023-10-08T00:26:26.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.048+0000 7fc52dbac700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc50c066f60 0x7fc50c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:26.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.049+0000 7fc52dbac700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc50c066f60 0x7fc50c069410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc5280b2cb0 tx=0x7fc5180091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:26.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.052+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5240507d0 con 0x7fc528159420 2023-10-08T00:26:26.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.241+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc52815dbd0 con 0x7fc50c066f60 2023-10-08T00:26:26.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.249+0000 7fc51e7fc700 1 -- 172.21.15.22:0/3407803103 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286182 (secure 0 0 0) 0x7fc52815dbd0 con 0x7fc50c066f60 2023-10-08T00:26:26.253 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:26.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc50c066f60 msgr2=0x7fc50c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc50c066f60 0x7fc50c069410 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc5280b2cb0 tx=0x7fc5180091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 msgr2=0x7fc5280c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 0x7fc5280c6060 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c810 tx=0x7fc524007c50 comp rx=0 tx=0).stop 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 shutdown_connections 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc52815d230 0x7fc528154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc528159420 0x7fc5280c6060 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc50c066f60 0x7fc50c069410 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 --2- 172.21.15.22:0/3407803103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc5281597f0 0x7fc52815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.252+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 >> 172.21.15.22:0/3407803103 conn(0x7fc5280d0660 msgr2=0x7fc528068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:26.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.253+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 shutdown_connections 2023-10-08T00:26:26.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:26.253+0000 7fc52f3af700 1 -- 172.21.15.22:0/3407803103 wait complete. 2023-10-08T00:26:26.257 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:26:26.265 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-08T00:26:24.404187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392328,"kb_used_data":5832,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582392,"statfs":{"total":773094113280,"available":770644369408,"internally_reserved":0,"allocated":5971968,"data_stored":3184976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.824848"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599393+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:29:01.638624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590985+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:50.913174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594518+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.599484+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.600095+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:53:38.314979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594634+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590031+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:57.883334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590472+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:19.048692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590274+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590516+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590284+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598424+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593850+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:17.839382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589464+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589050+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:51.443274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590081+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593989+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:11.734935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596099+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597568+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:41.740339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591474+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:12.028201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596104+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:43.603190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591486+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:36.046629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594750+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593181+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:02:41.556546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.598414+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:33.154763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596889+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593641+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597453+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:23:28.943871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592897+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:29.770533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592857+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.596685+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:33.713170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590614+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592903+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603655+0000","last_change":"2023-10-08T00:26:19.603655+0000","last_active":"2023-10-08T00:26:19.603655+0000","last_peered":"2023-10-08T00:26:19.603655+0000","last_clean":"2023-10-08T00:26:19.603655+0000","last_became_active":"2023-10-08T00:26:19.603377+0000","last_became_peered":"2023-10-08T00:26:19.603377+0000","last_unstale":"2023-10-08T00:26:19.603655+0000","last_undegraded":"2023-10-08T00:26:19.603655+0000","last_fullsized":"2023-10-08T00:26:19.603655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592238+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:18.765568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607378+0000","last_change":"2023-10-08T00:26:19.607378+0000","last_active":"2023-10-08T00:26:19.607378+0000","last_peered":"2023-10-08T00:26:19.607378+0000","last_clean":"2023-10-08T00:26:19.607378+0000","last_became_active":"2023-10-08T00:26:19.607064+0000","last_became_peered":"2023-10-08T00:26:19.607064+0000","last_unstale":"2023-10-08T00:26:19.607378+0000","last_undegraded":"2023-10-08T00:26:19.607378+0000","last_fullsized":"2023-10-08T00:26:19.607378+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:10.458996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593732+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605020+0000","last_change":"2023-10-08T00:26:19.605020+0000","last_active":"2023-10-08T00:26:19.605020+0000","last_peered":"2023-10-08T00:26:19.605020+0000","last_clean":"2023-10-08T00:26:19.605020+0000","last_became_active":"2023-10-08T00:26:19.604701+0000","last_became_peered":"2023-10-08T00:26:19.604701+0000","last_unstale":"2023-10-08T00:26:19.605020+0000","last_undegraded":"2023-10-08T00:26:19.605020+0000","last_fullsized":"2023-10-08T00:26:19.605020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593165+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605625+0000","last_change":"2023-10-08T00:26:19.605625+0000","last_active":"2023-10-08T00:26:19.605625+0000","last_peered":"2023-10-08T00:26:19.605625+0000","last_clean":"2023-10-08T00:26:19.605625+0000","last_became_active":"2023-10-08T00:26:19.605342+0000","last_became_peered":"2023-10-08T00:26:19.605342+0000","last_unstale":"2023-10-08T00:26:19.605625+0000","last_undegraded":"2023-10-08T00:26:19.605625+0000","last_fullsized":"2023-10-08T00:26:19.605625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590705+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:33.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604952+0000","last_change":"2023-10-08T00:26:19.604952+0000","last_active":"2023-10-08T00:26:19.604952+0000","last_peered":"2023-10-08T00:26:19.604952+0000","last_clean":"2023-10-08T00:26:19.604952+0000","last_became_active":"2023-10-08T00:26:19.604683+0000","last_became_peered":"2023-10-08T00:26:19.604683+0000","last_unstale":"2023-10-08T00:26:19.604952+0000","last_undegraded":"2023-10-08T00:26:19.604952+0000","last_fullsized":"2023-10-08T00:26:19.604952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:08.235838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591591+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:11.214977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600569+0000","last_change":"2023-10-08T00:26:19.600569+0000","last_active":"2023-10-08T00:26:19.600569+0000","last_peered":"2023-10-08T00:26:19.600569+0000","last_clean":"2023-10-08T00:26:19.600569+0000","last_became_active":"2023-10-08T00:26:19.600309+0000","last_became_peered":"2023-10-08T00:26:19.600309+0000","last_unstale":"2023-10-08T00:26:19.600569+0000","last_undegraded":"2023-10-08T00:26:19.600569+0000","last_fullsized":"2023-10-08T00:26:19.600569+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:56.879260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592653+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:45:41.374769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.599836+0000","last_change":"2023-10-08T00:26:19.599836+0000","last_active":"2023-10-08T00:26:19.599836+0000","last_peered":"2023-10-08T00:26:19.599836+0000","last_clean":"2023-10-08T00:26:19.599836+0000","last_became_active":"2023-10-08T00:26:19.599090+0000","last_became_peered":"2023-10-08T00:26:19.599090+0000","last_unstale":"2023-10-08T00:26:19.599836+0000","last_undegraded":"2023-10-08T00:26:19.599836+0000","last_fullsized":"2023-10-08T00:26:19.599836+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593665+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:00.245502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602581+0000","last_change":"2023-10-08T00:26:19.602581+0000","last_active":"2023-10-08T00:26:19.602581+0000","last_peered":"2023-10-08T00:26:19.602581+0000","last_clean":"2023-10-08T00:26:19.602581+0000","last_became_active":"2023-10-08T00:26:19.602298+0000","last_became_peered":"2023-10-08T00:26:19.602298+0000","last_unstale":"2023-10-08T00:26:19.602581+0000","last_undegraded":"2023-10-08T00:26:19.602581+0000","last_fullsized":"2023-10-08T00:26:19.602581+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589461+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:21.692688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604715+0000","last_change":"2023-10-08T00:26:19.604715+0000","last_active":"2023-10-08T00:26:19.604715+0000","last_peered":"2023-10-08T00:26:19.604715+0000","last_clean":"2023-10-08T00:26:19.604715+0000","last_became_active":"2023-10-08T00:26:19.604361+0000","last_became_peered":"2023-10-08T00:26:19.604361+0000","last_unstale":"2023-10-08T00:26:19.604715+0000","last_undegraded":"2023-10-08T00:26:19.604715+0000","last_fullsized":"2023-10-08T00:26:19.604715+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:49.574894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593277+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608864+0000","last_change":"2023-10-08T00:26:19.608864+0000","last_active":"2023-10-08T00:26:19.608864+0000","last_peered":"2023-10-08T00:26:19.608864+0000","last_clean":"2023-10-08T00:26:19.608864+0000","last_became_active":"2023-10-08T00:26:19.607415+0000","last_became_peered":"2023-10-08T00:26:19.607415+0000","last_unstale":"2023-10-08T00:26:19.608864+0000","last_undegraded":"2023-10-08T00:26:19.608864+0000","last_fullsized":"2023-10-08T00:26:19.608864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:38.957091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593613+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:58.436152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.610582+0000","last_change":"2023-10-08T00:26:19.610582+0000","last_active":"2023-10-08T00:26:19.610582+0000","last_peered":"2023-10-08T00:26:19.610582+0000","last_clean":"2023-10-08T00:26:19.610582+0000","last_became_active":"2023-10-08T00:26:19.610280+0000","last_became_peered":"2023-10-08T00:26:19.610280+0000","last_unstale":"2023-10-08T00:26:19.610582+0000","last_undegraded":"2023-10-08T00:26:19.610582+0000","last_fullsized":"2023-10-08T00:26:19.610582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:07.605223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594020+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602544+0000","last_change":"2023-10-08T00:26:19.602544+0000","last_active":"2023-10-08T00:26:19.602544+0000","last_peered":"2023-10-08T00:26:19.602544+0000","last_clean":"2023-10-08T00:26:19.602544+0000","last_became_active":"2023-10-08T00:26:19.602253+0000","last_became_peered":"2023-10-08T00:26:19.602253+0000","last_unstale":"2023-10-08T00:26:19.602544+0000","last_undegraded":"2023-10-08T00:26:19.602544+0000","last_fullsized":"2023-10-08T00:26:19.602544+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591981+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.607794+0000","last_change":"2023-10-08T00:26:19.607794+0000","last_active":"2023-10-08T00:26:19.607794+0000","last_peered":"2023-10-08T00:26:19.607794+0000","last_clean":"2023-10-08T00:26:19.607794+0000","last_became_active":"2023-10-08T00:26:19.607401+0000","last_became_peered":"2023-10-08T00:26:19.607401+0000","last_unstale":"2023-10-08T00:26:19.607794+0000","last_undegraded":"2023-10-08T00:26:19.607794+0000","last_fullsized":"2023-10-08T00:26:19.607794+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.800417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595623+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602407+0000","last_change":"2023-10-08T00:26:19.602407+0000","last_active":"2023-10-08T00:26:19.602407+0000","last_peered":"2023-10-08T00:26:19.602407+0000","last_clean":"2023-10-08T00:26:19.602407+0000","last_became_active":"2023-10-08T00:26:19.602143+0000","last_became_peered":"2023-10-08T00:26:19.602143+0000","last_unstale":"2023-10-08T00:26:19.602407+0000","last_undegraded":"2023-10-08T00:26:19.602407+0000","last_fullsized":"2023-10-08T00:26:19.602407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:21:00.734187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589780+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601497+0000","last_change":"2023-10-08T00:26:19.601497+0000","last_active":"2023-10-08T00:26:19.601497+0000","last_peered":"2023-10-08T00:26:19.601497+0000","last_clean":"2023-10-08T00:26:19.601497+0000","last_became_active":"2023-10-08T00:26:19.601186+0000","last_became_peered":"2023-10-08T00:26:19.601186+0000","last_unstale":"2023-10-08T00:26:19.601497+0000","last_undegraded":"2023-10-08T00:26:19.601497+0000","last_fullsized":"2023-10-08T00:26:19.601497+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.594228+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:41.847163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606874+0000","last_change":"2023-10-08T00:26:19.606874+0000","last_active":"2023-10-08T00:26:19.606874+0000","last_peered":"2023-10-08T00:26:19.606874+0000","last_clean":"2023-10-08T00:26:19.606874+0000","last_became_active":"2023-10-08T00:26:19.606627+0000","last_became_peered":"2023-10-08T00:26:19.606627+0000","last_unstale":"2023-10-08T00:26:19.606874+0000","last_undegraded":"2023-10-08T00:26:19.606874+0000","last_fullsized":"2023-10-08T00:26:19.606874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:00.539100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595558+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608143+0000","last_change":"2023-10-08T00:26:19.608143+0000","last_active":"2023-10-08T00:26:19.608143+0000","last_peered":"2023-10-08T00:26:19.608143+0000","last_clean":"2023-10-08T00:26:19.608143+0000","last_became_active":"2023-10-08T00:26:19.607848+0000","last_became_peered":"2023-10-08T00:26:19.607848+0000","last_unstale":"2023-10-08T00:26:19.608143+0000","last_undegraded":"2023-10-08T00:26:19.608143+0000","last_fullsized":"2023-10-08T00:26:19.608143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:42.599116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591755+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604741+0000","last_change":"2023-10-08T00:26:19.604741+0000","last_active":"2023-10-08T00:26:19.604741+0000","last_peered":"2023-10-08T00:26:19.604741+0000","last_clean":"2023-10-08T00:26:19.604741+0000","last_became_active":"2023-10-08T00:26:19.604455+0000","last_became_peered":"2023-10-08T00:26:19.604455+0000","last_unstale":"2023-10-08T00:26:19.604741+0000","last_undegraded":"2023-10-08T00:26:19.604741+0000","last_fullsized":"2023-10-08T00:26:19.604741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590183+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:08.791091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601546+0000","last_change":"2023-10-08T00:26:19.601546+0000","last_active":"2023-10-08T00:26:19.601546+0000","last_peered":"2023-10-08T00:26:19.601546+0000","last_clean":"2023-10-08T00:26:19.601546+0000","last_became_active":"2023-10-08T00:26:19.601250+0000","last_became_peered":"2023-10-08T00:26:19.601250+0000","last_unstale":"2023-10-08T00:26:19.601546+0000","last_undegraded":"2023-10-08T00:26:19.601546+0000","last_fullsized":"2023-10-08T00:26:19.601546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.593465+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602311+0000","last_change":"2023-10-08T00:26:19.602311+0000","last_active":"2023-10-08T00:26:19.602311+0000","last_peered":"2023-10-08T00:26:19.602311+0000","last_clean":"2023-10-08T00:26:19.602311+0000","last_became_active":"2023-10-08T00:26:19.602101+0000","last_became_peered":"2023-10-08T00:26:19.602101+0000","last_unstale":"2023-10-08T00:26:19.602311+0000","last_undegraded":"2023-10-08T00:26:19.602311+0000","last_fullsized":"2023-10-08T00:26:19.602311+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591378+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.601160+0000","last_change":"2023-10-08T00:26:19.601160+0000","last_active":"2023-10-08T00:26:19.601160+0000","last_peered":"2023-10-08T00:26:19.601160+0000","last_clean":"2023-10-08T00:26:19.601160+0000","last_became_active":"2023-10-08T00:26:19.600877+0000","last_became_peered":"2023-10-08T00:26:19.600877+0000","last_unstale":"2023-10-08T00:26:19.601160+0000","last_undegraded":"2023-10-08T00:26:19.601160+0000","last_fullsized":"2023-10-08T00:26:19.601160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:39.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592969+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:12.547014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606732+0000","last_change":"2023-10-08T00:26:19.606732+0000","last_active":"2023-10-08T00:26:19.606732+0000","last_peered":"2023-10-08T00:26:19.606732+0000","last_clean":"2023-10-08T00:26:19.606732+0000","last_became_active":"2023-10-08T00:26:19.605988+0000","last_became_peered":"2023-10-08T00:26:19.605988+0000","last_unstale":"2023-10-08T00:26:19.606732+0000","last_undegraded":"2023-10-08T00:26:19.606732+0000","last_fullsized":"2023-10-08T00:26:19.606732+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:54.101460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591757+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.603665+0000","last_change":"2023-10-08T00:26:19.603665+0000","last_active":"2023-10-08T00:26:19.603665+0000","last_peered":"2023-10-08T00:26:19.603665+0000","last_clean":"2023-10-08T00:26:19.603665+0000","last_became_active":"2023-10-08T00:26:19.603462+0000","last_became_peered":"2023-10-08T00:26:19.603462+0000","last_unstale":"2023-10-08T00:26:19.603665+0000","last_undegraded":"2023-10-08T00:26:19.603665+0000","last_fullsized":"2023-10-08T00:26:19.603665+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.591677+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.608522+0000","last_change":"2023-10-08T00:26:19.608522+0000","last_active":"2023-10-08T00:26:19.608522+0000","last_peered":"2023-10-08T00:26:19.608522+0000","last_clean":"2023-10-08T00:26:19.608522+0000","last_became_active":"2023-10-08T00:26:19.607944+0000","last_became_peered":"2023-10-08T00:26:19.607944+0000","last_unstale":"2023-10-08T00:26:19.608522+0000","last_undegraded":"2023-10-08T00:26:19.608522+0000","last_fullsized":"2023-10-08T00:26:19.608522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:36.450510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.597082+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600540+0000","last_change":"2023-10-08T00:26:19.600540+0000","last_active":"2023-10-08T00:26:19.600540+0000","last_peered":"2023-10-08T00:26:19.600540+0000","last_clean":"2023-10-08T00:26:19.600540+0000","last_became_active":"2023-10-08T00:26:19.600250+0000","last_became_peered":"2023-10-08T00:26:19.600250+0000","last_unstale":"2023-10-08T00:26:19.600540+0000","last_undegraded":"2023-10-08T00:26:19.600540+0000","last_fullsized":"2023-10-08T00:26:19.600540+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590178+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:02.956481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600255+0000","last_change":"2023-10-08T00:26:19.600255+0000","last_active":"2023-10-08T00:26:19.600255+0000","last_peered":"2023-10-08T00:26:19.600255+0000","last_clean":"2023-10-08T00:26:19.600255+0000","last_became_active":"2023-10-08T00:26:19.599956+0000","last_became_peered":"2023-10-08T00:26:19.599956+0000","last_unstale":"2023-10-08T00:26:19.600255+0000","last_undegraded":"2023-10-08T00:26:19.600255+0000","last_fullsized":"2023-10-08T00:26:19.600255+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:50.293350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.592318+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.600689+0000","last_change":"2023-10-08T00:26:19.600689+0000","last_active":"2023-10-08T00:26:19.600689+0000","last_peered":"2023-10-08T00:26:19.600689+0000","last_clean":"2023-10-08T00:26:19.600689+0000","last_became_active":"2023-10-08T00:26:19.600106+0000","last_became_peered":"2023-10-08T00:26:19.600106+0000","last_unstale":"2023-10-08T00:26:19.600689+0000","last_undegraded":"2023-10-08T00:26:19.600689+0000","last_fullsized":"2023-10-08T00:26:19.600689+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:21.811829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590132+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:50.555024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.606611+0000","last_change":"2023-10-08T00:26:19.606611+0000","last_active":"2023-10-08T00:26:19.606611+0000","last_peered":"2023-10-08T00:26:19.606611+0000","last_clean":"2023-10-08T00:26:19.606611+0000","last_became_active":"2023-10-08T00:26:19.606386+0000","last_became_peered":"2023-10-08T00:26:19.606386+0000","last_unstale":"2023-10-08T00:26:19.606611+0000","last_undegraded":"2023-10-08T00:26:19.606611+0000","last_fullsized":"2023-10-08T00:26:19.606611+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:59.014269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.595057+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.596506+0000","last_change":"2023-10-08T00:26:19.596506+0000","last_active":"2023-10-08T00:26:19.596506+0000","last_peered":"2023-10-08T00:26:19.596506+0000","last_clean":"2023-10-08T00:26:19.596506+0000","last_became_active":"2023-10-08T00:26:19.596208+0000","last_became_peered":"2023-10-08T00:26:19.596208+0000","last_unstale":"2023-10-08T00:26:19.596506+0000","last_undegraded":"2023-10-08T00:26:19.596506+0000","last_fullsized":"2023-10-08T00:26:19.596506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.590207+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:22.815903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.604610+0000","last_change":"2023-10-08T00:26:19.604610+0000","last_active":"2023-10-08T00:26:19.604610+0000","last_peered":"2023-10-08T00:26:19.604610+0000","last_clean":"2023-10-08T00:26:19.604610+0000","last_became_active":"2023-10-08T00:26:19.604289+0000","last_became_peered":"2023-10-08T00:26:19.604289+0000","last_unstale":"2023-10-08T00:26:19.604610+0000","last_undegraded":"2023-10-08T00:26:19.604610+0000","last_fullsized":"2023-10-08T00:26:19.604610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589674+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.602199+0000","last_change":"2023-10-08T00:26:19.602199+0000","last_active":"2023-10-08T00:26:19.602199+0000","last_peered":"2023-10-08T00:26:19.602199+0000","last_clean":"2023-10-08T00:26:19.602199+0000","last_became_active":"2023-10-08T00:26:19.601934+0000","last_became_peered":"2023-10-08T00:26:19.601934+0000","last_unstale":"2023-10-08T00:26:19.602199+0000","last_undegraded":"2023-10-08T00:26:19.602199+0000","last_fullsized":"2023-10-08T00:26:19.602199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:37.185009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:19.578772+0000","last_change":"2023-10-08T00:26:19.589922+0000","last_active":"2023-10-08T00:26:19.578772+0000","last_peered":"2023-10-08T00:26:19.578772+0000","last_clean":"2023-10-08T00:26:19.578772+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:19.578772+0000","last_undegraded":"2023-10-08T00:26:19.578772+0000","last_fullsized":"2023-10-08T00:26:19.578772+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-08T00:26:19.605412+0000","last_change":"2023-10-08T00:26:19.605412+0000","last_active":"2023-10-08T00:26:19.605412+0000","last_peered":"2023-10-08T00:26:19.605412+0000","last_clean":"2023-10-08T00:26:19.605412+0000","last_became_active":"2023-10-08T00:26:19.605141+0000","last_became_peered":"2023-10-08T00:26:19.605141+0000","last_unstale":"2023-10-08T00:26:19.605412+0000","last_undegraded":"2023-10-08T00:26:19.605412+0000","last_fullsized":"2023-10-08T00:26:19.605412+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:06:37.248332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":187,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-08T00:26:18.584688+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:18.584688+0000","last_peered":"2023-10-08T00:26:18.584688+0000","last_clean":"2023-10-08T00:26:18.584688+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:18.584688+0000","last_undegraded":"2023-10-08T00:26:18.584688+0000","last_fullsized":"2023-10-08T00:26:18.584688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298452,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073388,"statfs":{"total":96636764160,"available":96331149312,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.499}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.437}]},{"osd":4,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.39500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.621},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.76800000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.745}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302548,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069292,"statfs":{"total":96636764160,"available":96326955008,"internally_reserved":0,"allocated":1191936,"data_stored":840898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.318},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.378}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40600000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.746}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069872,"statfs":{"total":96636764160,"available":96327548928,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.316}]},{"osd":2,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.80100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.443},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41999999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.622},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.504},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":250530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.51400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.44700000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58099999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.499}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:26:29.272 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:26:29.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.404+0000 7f3f810f2700 1 Processor -- start 2023-10-08T00:26:29.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.404+0000 7f3f810f2700 1 -- start start 2023-10-08T00:26:29.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f810f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f810f2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3f7c069560 0x7f3f7c0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f810f2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c15a160 con 0x7f3f7c159c60 2023-10-08T00:26:29.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f810f2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c069f20 con 0x7f3f7c069560 2023-10-08T00:26:29.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f810f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0d13a0 con 0x7f3f7c159890 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f7a59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3f7c159c60 0x7f3f7c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50960/0 (socket says 172.21.15.22:50960) 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f7a59c700 1 -- 172.21.15.22:0/1428381835 learned_addr learned my addr 172.21.15.22:0/1428381835 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f7b59e700 1 --2- 172.21.15.22:0/1428381835 >> v2:172.21.15.192:3300/0 conn(0x7f3f7c069560 0x7f3f7c0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f7ad9d700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f79d9b700 1 -- 172.21.15.22:0/1428381835 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36474524 0 0) 0x7f3f7c15a160 con 0x7f3f7c159c60 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.405+0000 7f3f79d9b700 1 -- 172.21.15.22:0/1428381835 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f68003570 con 0x7f3f7c159c60 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f79d9b700 1 -- 172.21.15.22:0/1428381835 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1833780876 0 0) 0x7f3f68003570 con 0x7f3f7c159c60 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f7b59e700 1 -- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 msgr2=0x7f3f7c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f7b59e700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f7b59e700 1 -- 172.21.15.22:0/1428381835 >> v1:172.21.15.22:6789/0 conn(0x7f3f7c159c60 legacy=0x7f3f7c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f7b59e700 1 -- 172.21.15.22:0/1428381835 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c15e140 con 0x7f3f7c069560 2023-10-08T00:26:29.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f7ad9d700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:29.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f7b59e700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c069560 0x7f3f7c0699e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f740098e0 tx=0x7f3f740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab714120832b8e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:29.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f79d9b700 1 -- 172.21.15.22:0/1428381835 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f64001470 con 0x7f3f7c069560 2023-10-08T00:26:29.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f79d9b700 1 -- 172.21.15.22:0/1428381835 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74011420 con 0x7f3f7c069560 2023-10-08T00:26:29.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f79d9b700 1 -- 172.21.15.22:0/1428381835 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740117c0 con 0x7f3f7c069560 2023-10-08T00:26:29.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f810f2700 1 -- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c069560 msgr2=0x7f3f7c0699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.406+0000 7f3f810f2700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c069560 0x7f3f7c0699e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f740098e0 tx=0x7f3f740091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.407+0000 7f3f810f2700 1 -- 172.21.15.22:0/1428381835 shutdown_connections 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.407+0000 7f3f810f2700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c069560 0x7f3f7c0699e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.407+0000 7f3f810f2700 1 --2- 172.21.15.22:0/1428381835 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.407+0000 7f3f810f2700 1 -- 172.21.15.22:0/1428381835 >> 172.21.15.22:0/1428381835 conn(0x7f3f7c068e20 msgr2=0x7f3f7c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.407+0000 7f3f810f2700 1 -- 172.21.15.22:0/1428381835 shutdown_connections 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.407+0000 7f3f810f2700 1 -- 172.21.15.22:0/1428381835 wait complete. 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.408+0000 7f3f810f2700 1 Processor -- start 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.408+0000 7f3f810f2700 1 -- start start 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 0x7f3f7c15f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c159c60 0x7f3f7c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0b62e0 con 0x7f3f7c069560 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c15e940 con 0x7f3f7c159c60 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c15ec20 con 0x7f3f7c159890 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 0x7f3f7c15f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 0x7f3f7c15f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57014/0 (socket says 172.21.15.22:57014) 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 -- 172.21.15.22:0/732397689 learned_addr learned my addr 172.21.15.22:0/732397689 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7b59e700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c159c60 0x7f3f7c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7a59c700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 -- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 msgr2=0x7f3f7c0b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c0b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 -- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c159c60 msgr2=0x7f3f7c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c159c60 0x7f3f7c0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 -- 172.21.15.22:0/732397689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009a20 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f7ad9d700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 0x7f3f7c15f9e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c170 tx=0x7f3f6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00ccb0 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00f040 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f74009420 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c014480 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.409+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c15f1e0 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.410+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c04c3c0 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.411+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f6c0147f0 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.411+0000 7f3f72ffd700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f5c066f30 0x7f3f5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.411+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3f6c085320 con 0x7f3f7c069560 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.412+0000 7f3f7a59c700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f5c066f30 0x7f3f5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.412+0000 7f3f7a59c700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f5c066f30 0x7f3f5c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c15e070 tx=0x7f3f640011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:29.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.415+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f6c052590 con 0x7f3f7c069560 2023-10-08T00:26:29.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.607+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f7c06a5b0 con 0x7f3f5c066f30 2023-10-08T00:26:29.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.616+0000 7f3f72ffd700 1 -- 172.21.15.22:0/732397689 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289150 (secure 0 0 0) 0x7f3f7c06a5b0 con 0x7f3f5c066f30 2023-10-08T00:26:29.621 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:29.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f5c066f30 msgr2=0x7f3f5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f5c066f30 0x7f3f5c0693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c15e070 tx=0x7f3f640011a0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 msgr2=0x7f3f7c15f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 0x7f3f7c15f9e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c170 tx=0x7f3f6c00b040 comp rx=0 tx=0).stop 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 shutdown_connections 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f7c159c60 0x7f3f7c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f7c069560 0x7f3f7c15f9e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f5c066f30 0x7f3f5c0693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 --2- 172.21.15.22:0/732397689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f7c159890 0x7f3f7c0b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 >> 172.21.15.22:0/732397689 conn(0x7f3f7c068e20 msgr2=0x7f3f7c157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 shutdown_connections 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.619+0000 7f3f810f2700 1 -- 172.21.15.22:0/732397689 wait complete. 2023-10-08T00:26:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:26:29.631 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-10-08T00:26:28.405242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2392584,"kb_used_data":6088,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752582136,"statfs":{"total":773094113280,"available":770644107264,"internally_reserved":0,"allocated":6234112,"data_stored":3293996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002070"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610361+0000","last_change":"2023-10-08T00:26:20.600115+0000","last_active":"2023-10-08T00:26:20.610361+0000","last_peered":"2023-10-08T00:26:20.610361+0000","last_clean":"2023-10-08T00:26:20.610361+0000","last_became_active":"2023-10-08T00:26:20.599817+0000","last_became_peered":"2023-10-08T00:26:20.599817+0000","last_unstale":"2023-10-08T00:26:20.610361+0000","last_undegraded":"2023-10-08T00:26:20.610361+0000","last_fullsized":"2023-10-08T00:26:20.610361+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:32:15.528438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613545+0000","last_change":"2023-10-08T00:26:20.609967+0000","last_active":"2023-10-08T00:26:20.613545+0000","last_peered":"2023-10-08T00:26:20.613545+0000","last_clean":"2023-10-08T00:26:20.613545+0000","last_became_active":"2023-10-08T00:26:20.609690+0000","last_became_peered":"2023-10-08T00:26:20.609690+0000","last_unstale":"2023-10-08T00:26:20.613545+0000","last_undegraded":"2023-10-08T00:26:20.613545+0000","last_fullsized":"2023-10-08T00:26:20.613545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:22:27.348234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609799+0000","last_change":"2023-10-08T00:26:20.606557+0000","last_active":"2023-10-08T00:26:20.609799+0000","last_peered":"2023-10-08T00:26:20.609799+0000","last_clean":"2023-10-08T00:26:20.609799+0000","last_became_active":"2023-10-08T00:26:20.606262+0000","last_became_peered":"2023-10-08T00:26:20.606262+0000","last_unstale":"2023-10-08T00:26:20.609799+0000","last_undegraded":"2023-10-08T00:26:20.609799+0000","last_fullsized":"2023-10-08T00:26:20.609799+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.612636+0000","last_change":"2023-10-08T00:26:20.609805+0000","last_active":"2023-10-08T00:26:20.612636+0000","last_peered":"2023-10-08T00:26:20.612636+0000","last_clean":"2023-10-08T00:26:20.612636+0000","last_became_active":"2023-10-08T00:26:20.608851+0000","last_became_peered":"2023-10-08T00:26:20.608851+0000","last_unstale":"2023-10-08T00:26:20.612636+0000","last_undegraded":"2023-10-08T00:26:20.612636+0000","last_fullsized":"2023-10-08T00:26:20.612636+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.608751+0000","last_change":"2023-10-08T00:26:20.601581+0000","last_active":"2023-10-08T00:26:20.608751+0000","last_peered":"2023-10-08T00:26:20.608751+0000","last_clean":"2023-10-08T00:26:20.608751+0000","last_became_active":"2023-10-08T00:26:20.601337+0000","last_became_peered":"2023-10-08T00:26:20.601337+0000","last_unstale":"2023-10-08T00:26:20.608751+0000","last_undegraded":"2023-10-08T00:26:20.608751+0000","last_fullsized":"2023-10-08T00:26:20.608751+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:41:09.422521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618710+0000","last_change":"2023-10-08T00:26:20.615569+0000","last_active":"2023-10-08T00:26:20.618710+0000","last_peered":"2023-10-08T00:26:20.618710+0000","last_clean":"2023-10-08T00:26:20.618710+0000","last_became_active":"2023-10-08T00:26:20.614651+0000","last_became_peered":"2023-10-08T00:26:20.614651+0000","last_unstale":"2023-10-08T00:26:20.618710+0000","last_undegraded":"2023-10-08T00:26:20.618710+0000","last_fullsized":"2023-10-08T00:26:20.618710+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.604438+0000","last_change":"2023-10-08T00:26:20.599295+0000","last_active":"2023-10-08T00:26:20.604438+0000","last_peered":"2023-10-08T00:26:20.604438+0000","last_clean":"2023-10-08T00:26:20.604438+0000","last_became_active":"2023-10-08T00:26:20.599012+0000","last_became_peered":"2023-10-08T00:26:20.599012+0000","last_unstale":"2023-10-08T00:26:20.604438+0000","last_undegraded":"2023-10-08T00:26:20.604438+0000","last_fullsized":"2023-10-08T00:26:20.604438+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613615+0000","last_change":"2023-10-08T00:26:20.606813+0000","last_active":"2023-10-08T00:26:20.613615+0000","last_peered":"2023-10-08T00:26:20.613615+0000","last_clean":"2023-10-08T00:26:20.613615+0000","last_became_active":"2023-10-08T00:26:20.604147+0000","last_became_peered":"2023-10-08T00:26:20.604147+0000","last_unstale":"2023-10-08T00:26:20.613615+0000","last_undegraded":"2023-10-08T00:26:20.613615+0000","last_fullsized":"2023-10-08T00:26:20.613615+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:02:40.717006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610059+0000","last_change":"2023-10-08T00:26:20.605134+0000","last_active":"2023-10-08T00:26:20.610059+0000","last_peered":"2023-10-08T00:26:20.610059+0000","last_clean":"2023-10-08T00:26:20.610059+0000","last_became_active":"2023-10-08T00:26:20.604809+0000","last_became_peered":"2023-10-08T00:26:20.604809+0000","last_unstale":"2023-10-08T00:26:20.610059+0000","last_undegraded":"2023-10-08T00:26:20.610059+0000","last_fullsized":"2023-10-08T00:26:20.610059+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.607698+0000","last_change":"2023-10-08T00:26:20.600923+0000","last_active":"2023-10-08T00:26:20.607698+0000","last_peered":"2023-10-08T00:26:20.607698+0000","last_clean":"2023-10-08T00:26:20.607698+0000","last_became_active":"2023-10-08T00:26:20.600669+0000","last_became_peered":"2023-10-08T00:26:20.600669+0000","last_unstale":"2023-10-08T00:26:20.607698+0000","last_undegraded":"2023-10-08T00:26:20.607698+0000","last_fullsized":"2023-10-08T00:26:20.607698+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:08.609297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613047+0000","last_change":"2023-10-08T00:26:20.602756+0000","last_active":"2023-10-08T00:26:20.613047+0000","last_peered":"2023-10-08T00:26:20.613047+0000","last_clean":"2023-10-08T00:26:20.613047+0000","last_became_active":"2023-10-08T00:26:20.601457+0000","last_became_peered":"2023-10-08T00:26:20.601457+0000","last_unstale":"2023-10-08T00:26:20.613047+0000","last_undegraded":"2023-10-08T00:26:20.613047+0000","last_fullsized":"2023-10-08T00:26:20.613047+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.604152+0000","last_change":"2023-10-08T00:26:20.602872+0000","last_active":"2023-10-08T00:26:20.604152+0000","last_peered":"2023-10-08T00:26:20.604152+0000","last_clean":"2023-10-08T00:26:20.604152+0000","last_became_active":"2023-10-08T00:26:20.602615+0000","last_became_peered":"2023-10-08T00:26:20.602615+0000","last_unstale":"2023-10-08T00:26:20.604152+0000","last_undegraded":"2023-10-08T00:26:20.604152+0000","last_fullsized":"2023-10-08T00:26:20.604152+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:03:34.343011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610000+0000","last_change":"2023-10-08T00:26:20.605958+0000","last_active":"2023-10-08T00:26:20.610000+0000","last_peered":"2023-10-08T00:26:20.610000+0000","last_clean":"2023-10-08T00:26:20.610000+0000","last_became_active":"2023-10-08T00:26:20.605732+0000","last_became_peered":"2023-10-08T00:26:20.605732+0000","last_unstale":"2023-10-08T00:26:20.610000+0000","last_undegraded":"2023-10-08T00:26:20.610000+0000","last_fullsized":"2023-10-08T00:26:20.610000+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:04:57.676952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609582+0000","last_change":"2023-10-08T00:26:20.602885+0000","last_active":"2023-10-08T00:26:20.609582+0000","last_peered":"2023-10-08T00:26:20.609582+0000","last_clean":"2023-10-08T00:26:20.609582+0000","last_became_active":"2023-10-08T00:26:20.602651+0000","last_became_peered":"2023-10-08T00:26:20.602651+0000","last_unstale":"2023-10-08T00:26:20.609582+0000","last_undegraded":"2023-10-08T00:26:20.609582+0000","last_fullsized":"2023-10-08T00:26:20.609582+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:57.725722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609553+0000","last_change":"2023-10-08T00:26:20.602101+0000","last_active":"2023-10-08T00:26:20.609553+0000","last_peered":"2023-10-08T00:26:20.609553+0000","last_clean":"2023-10-08T00:26:20.609553+0000","last_became_active":"2023-10-08T00:26:20.601830+0000","last_became_peered":"2023-10-08T00:26:20.601830+0000","last_unstale":"2023-10-08T00:26:20.609553+0000","last_undegraded":"2023-10-08T00:26:20.609553+0000","last_fullsized":"2023-10-08T00:26:20.609553+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:47:23.793321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618845+0000","last_change":"2023-10-08T00:26:20.615223+0000","last_active":"2023-10-08T00:26:20.618845+0000","last_peered":"2023-10-08T00:26:20.618845+0000","last_clean":"2023-10-08T00:26:20.618845+0000","last_became_active":"2023-10-08T00:26:20.614887+0000","last_became_peered":"2023-10-08T00:26:20.614887+0000","last_unstale":"2023-10-08T00:26:20.618845+0000","last_undegraded":"2023-10-08T00:26:20.618845+0000","last_fullsized":"2023-10-08T00:26:20.618845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:43.603190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613644+0000","last_change":"2023-10-08T00:26:20.602997+0000","last_active":"2023-10-08T00:26:20.613644+0000","last_peered":"2023-10-08T00:26:20.613644+0000","last_clean":"2023-10-08T00:26:20.613644+0000","last_became_active":"2023-10-08T00:26:20.602700+0000","last_became_peered":"2023-10-08T00:26:20.602700+0000","last_unstale":"2023-10-08T00:26:20.613644+0000","last_undegraded":"2023-10-08T00:26:20.613644+0000","last_fullsized":"2023-10-08T00:26:20.613644+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:39:26.088989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609874+0000","last_change":"2023-10-08T00:26:20.607484+0000","last_active":"2023-10-08T00:26:20.609874+0000","last_peered":"2023-10-08T00:26:20.609874+0000","last_clean":"2023-10-08T00:26:20.609874+0000","last_became_active":"2023-10-08T00:26:20.607009+0000","last_became_peered":"2023-10-08T00:26:20.607009+0000","last_unstale":"2023-10-08T00:26:20.609874+0000","last_undegraded":"2023-10-08T00:26:20.609874+0000","last_fullsized":"2023-10-08T00:26:20.609874+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:33.932733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609431+0000","last_change":"2023-10-08T00:26:20.599528+0000","last_active":"2023-10-08T00:26:20.609431+0000","last_peered":"2023-10-08T00:26:20.609431+0000","last_clean":"2023-10-08T00:26:20.609431+0000","last_became_active":"2023-10-08T00:26:20.599247+0000","last_became_peered":"2023-10-08T00:26:20.599247+0000","last_unstale":"2023-10-08T00:26:20.609431+0000","last_undegraded":"2023-10-08T00:26:20.609431+0000","last_fullsized":"2023-10-08T00:26:20.609431+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:26.571650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613536+0000","last_change":"2023-10-08T00:26:20.605394+0000","last_active":"2023-10-08T00:26:20.613536+0000","last_peered":"2023-10-08T00:26:20.613536+0000","last_clean":"2023-10-08T00:26:20.613536+0000","last_became_active":"2023-10-08T00:26:20.605082+0000","last_became_peered":"2023-10-08T00:26:20.605082+0000","last_unstale":"2023-10-08T00:26:20.613536+0000","last_undegraded":"2023-10-08T00:26:20.613536+0000","last_fullsized":"2023-10-08T00:26:20.613536+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:07:32.984545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610172+0000","last_change":"2023-10-08T00:26:20.605776+0000","last_active":"2023-10-08T00:26:20.610172+0000","last_peered":"2023-10-08T00:26:20.610172+0000","last_clean":"2023-10-08T00:26:20.610172+0000","last_became_active":"2023-10-08T00:26:20.605384+0000","last_became_peered":"2023-10-08T00:26:20.605384+0000","last_unstale":"2023-10-08T00:26:20.610172+0000","last_undegraded":"2023-10-08T00:26:20.610172+0000","last_fullsized":"2023-10-08T00:26:20.610172+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:50.913174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613582+0000","last_change":"2023-10-08T00:26:20.610753+0000","last_active":"2023-10-08T00:26:20.613582+0000","last_peered":"2023-10-08T00:26:20.613582+0000","last_clean":"2023-10-08T00:26:20.613582+0000","last_became_active":"2023-10-08T00:26:20.610282+0000","last_became_peered":"2023-10-08T00:26:20.610282+0000","last_unstale":"2023-10-08T00:26:20.613582+0000","last_undegraded":"2023-10-08T00:26:20.613582+0000","last_fullsized":"2023-10-08T00:26:20.613582+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:49.616625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.615968+0000","last_change":"2023-10-08T00:26:20.614507+0000","last_active":"2023-10-08T00:26:20.615968+0000","last_peered":"2023-10-08T00:26:20.615968+0000","last_clean":"2023-10-08T00:26:20.615968+0000","last_became_active":"2023-10-08T00:26:20.614235+0000","last_became_peered":"2023-10-08T00:26:20.614235+0000","last_unstale":"2023-10-08T00:26:20.615968+0000","last_undegraded":"2023-10-08T00:26:20.615968+0000","last_fullsized":"2023-10-08T00:26:20.615968+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:12.028201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610107+0000","last_change":"2023-10-08T00:26:20.607487+0000","last_active":"2023-10-08T00:26:20.610107+0000","last_peered":"2023-10-08T00:26:20.610107+0000","last_clean":"2023-10-08T00:26:20.610107+0000","last_became_active":"2023-10-08T00:26:20.607181+0000","last_became_peered":"2023-10-08T00:26:20.607181+0000","last_unstale":"2023-10-08T00:26:20.610107+0000","last_undegraded":"2023-10-08T00:26:20.610107+0000","last_fullsized":"2023-10-08T00:26:20.610107+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:50.934069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610386+0000","last_change":"2023-10-08T00:26:20.602342+0000","last_active":"2023-10-08T00:26:20.610386+0000","last_peered":"2023-10-08T00:26:20.610386+0000","last_clean":"2023-10-08T00:26:20.610386+0000","last_became_active":"2023-10-08T00:26:20.602056+0000","last_became_peered":"2023-10-08T00:26:20.602056+0000","last_unstale":"2023-10-08T00:26:20.610386+0000","last_undegraded":"2023-10-08T00:26:20.610386+0000","last_fullsized":"2023-10-08T00:26:20.610386+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:44:22.685814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609447+0000","last_change":"2023-10-08T00:26:20.603551+0000","last_active":"2023-10-08T00:26:20.609447+0000","last_peered":"2023-10-08T00:26:20.609447+0000","last_clean":"2023-10-08T00:26:20.609447+0000","last_became_active":"2023-10-08T00:26:20.603288+0000","last_became_peered":"2023-10-08T00:26:20.603288+0000","last_unstale":"2023-10-08T00:26:20.609447+0000","last_undegraded":"2023-10-08T00:26:20.609447+0000","last_fullsized":"2023-10-08T00:26:20.609447+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:39.885211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.619039+0000","last_change":"2023-10-08T00:26:20.615171+0000","last_active":"2023-10-08T00:26:20.619039+0000","last_peered":"2023-10-08T00:26:20.619039+0000","last_clean":"2023-10-08T00:26:20.619039+0000","last_became_active":"2023-10-08T00:26:20.614852+0000","last_became_peered":"2023-10-08T00:26:20.614852+0000","last_unstale":"2023-10-08T00:26:20.619039+0000","last_undegraded":"2023-10-08T00:26:20.619039+0000","last_fullsized":"2023-10-08T00:26:20.619039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:11.463070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609176+0000","last_change":"2023-10-08T00:26:20.608186+0000","last_active":"2023-10-08T00:26:20.609176+0000","last_peered":"2023-10-08T00:26:20.609176+0000","last_clean":"2023-10-08T00:26:20.609176+0000","last_became_active":"2023-10-08T00:26:20.607909+0000","last_became_peered":"2023-10-08T00:26:20.607909+0000","last_unstale":"2023-10-08T00:26:20.609176+0000","last_undegraded":"2023-10-08T00:26:20.609176+0000","last_fullsized":"2023-10-08T00:26:20.609176+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:42:55.769418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.615212+0000","last_change":"2023-10-08T00:26:20.603672+0000","last_active":"2023-10-08T00:26:20.615212+0000","last_peered":"2023-10-08T00:26:20.615212+0000","last_clean":"2023-10-08T00:26:20.615212+0000","last_became_active":"2023-10-08T00:26:20.603326+0000","last_became_peered":"2023-10-08T00:26:20.603326+0000","last_unstale":"2023-10-08T00:26:20.615212+0000","last_undegraded":"2023-10-08T00:26:20.615212+0000","last_fullsized":"2023-10-08T00:26:20.615212+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:21:59.327317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609523+0000","last_change":"2023-10-08T00:26:20.605390+0000","last_active":"2023-10-08T00:26:20.609523+0000","last_peered":"2023-10-08T00:26:20.609523+0000","last_clean":"2023-10-08T00:26:20.609523+0000","last_became_active":"2023-10-08T00:26:20.605128+0000","last_became_peered":"2023-10-08T00:26:20.605128+0000","last_unstale":"2023-10-08T00:26:20.609523+0000","last_undegraded":"2023-10-08T00:26:20.609523+0000","last_fullsized":"2023-10-08T00:26:20.609523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.608677+0000","last_change":"2023-10-08T00:26:20.600793+0000","last_active":"2023-10-08T00:26:20.608677+0000","last_peered":"2023-10-08T00:26:20.608677+0000","last_clean":"2023-10-08T00:26:20.608677+0000","last_became_active":"2023-10-08T00:26:20.600532+0000","last_became_peered":"2023-10-08T00:26:20.600532+0000","last_unstale":"2023-10-08T00:26:20.608677+0000","last_undegraded":"2023-10-08T00:26:20.608677+0000","last_fullsized":"2023-10-08T00:26:20.608677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:30:12.274426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618861+0000","last_change":"2023-10-08T00:26:20.615849+0000","last_active":"2023-10-08T00:26:20.618861+0000","last_peered":"2023-10-08T00:26:20.618861+0000","last_clean":"2023-10-08T00:26:20.618861+0000","last_became_active":"2023-10-08T00:26:20.615411+0000","last_became_peered":"2023-10-08T00:26:20.615411+0000","last_unstale":"2023-10-08T00:26:20.618861+0000","last_undegraded":"2023-10-08T00:26:20.618861+0000","last_fullsized":"2023-10-08T00:26:20.618861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.605926+0000","last_change":"2023-10-08T00:26:20.604431+0000","last_active":"2023-10-08T00:26:20.605926+0000","last_peered":"2023-10-08T00:26:20.605926+0000","last_clean":"2023-10-08T00:26:20.605926+0000","last_became_active":"2023-10-08T00:26:20.604179+0000","last_became_peered":"2023-10-08T00:26:20.604179+0000","last_unstale":"2023-10-08T00:26:20.605926+0000","last_undegraded":"2023-10-08T00:26:20.605926+0000","last_fullsized":"2023-10-08T00:26:20.605926+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:29.338881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618828+0000","last_change":"2023-10-08T00:26:19.603655+0000","last_active":"2023-10-08T00:26:20.618828+0000","last_peered":"2023-10-08T00:26:20.618828+0000","last_clean":"2023-10-08T00:26:20.618828+0000","last_became_active":"2023-10-08T00:26:19.603377+0000","last_became_peered":"2023-10-08T00:26:19.603377+0000","last_unstale":"2023-10-08T00:26:20.618828+0000","last_undegraded":"2023-10-08T00:26:20.618828+0000","last_fullsized":"2023-10-08T00:26:20.618828+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.616144+0000","last_change":"2023-10-08T00:26:20.610084+0000","last_active":"2023-10-08T00:26:20.616144+0000","last_peered":"2023-10-08T00:26:20.616144+0000","last_clean":"2023-10-08T00:26:20.616144+0000","last_became_active":"2023-10-08T00:26:20.609759+0000","last_became_peered":"2023-10-08T00:26:20.609759+0000","last_unstale":"2023-10-08T00:26:20.616144+0000","last_undegraded":"2023-10-08T00:26:20.616144+0000","last_fullsized":"2023-10-08T00:26:20.616144+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.615516+0000","last_change":"2023-10-08T00:26:19.607378+0000","last_active":"2023-10-08T00:26:20.615516+0000","last_peered":"2023-10-08T00:26:20.615516+0000","last_clean":"2023-10-08T00:26:20.615516+0000","last_became_active":"2023-10-08T00:26:19.607064+0000","last_became_peered":"2023-10-08T00:26:19.607064+0000","last_unstale":"2023-10-08T00:26:20.615516+0000","last_undegraded":"2023-10-08T00:26:20.615516+0000","last_fullsized":"2023-10-08T00:26:20.615516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:10.458996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618350+0000","last_change":"2023-10-08T00:26:20.609263+0000","last_active":"2023-10-08T00:26:20.618350+0000","last_peered":"2023-10-08T00:26:20.618350+0000","last_clean":"2023-10-08T00:26:20.618350+0000","last_became_active":"2023-10-08T00:26:20.609006+0000","last_became_peered":"2023-10-08T00:26:20.609006+0000","last_unstale":"2023-10-08T00:26:20.618350+0000","last_undegraded":"2023-10-08T00:26:20.618350+0000","last_fullsized":"2023-10-08T00:26:20.618350+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:01.863005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618997+0000","last_change":"2023-10-08T00:26:19.605020+0000","last_active":"2023-10-08T00:26:20.618997+0000","last_peered":"2023-10-08T00:26:20.618997+0000","last_clean":"2023-10-08T00:26:20.618997+0000","last_became_active":"2023-10-08T00:26:19.604701+0000","last_became_peered":"2023-10-08T00:26:19.604701+0000","last_unstale":"2023-10-08T00:26:20.618997+0000","last_undegraded":"2023-10-08T00:26:20.618997+0000","last_fullsized":"2023-10-08T00:26:20.618997+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.607668+0000","last_change":"2023-10-08T00:26:20.605810+0000","last_active":"2023-10-08T00:26:20.607668+0000","last_peered":"2023-10-08T00:26:20.607668+0000","last_clean":"2023-10-08T00:26:20.607668+0000","last_became_active":"2023-10-08T00:26:20.605286+0000","last_became_peered":"2023-10-08T00:26:20.605286+0000","last_unstale":"2023-10-08T00:26:20.607668+0000","last_undegraded":"2023-10-08T00:26:20.607668+0000","last_fullsized":"2023-10-08T00:26:20.607668+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:29.244041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.617039+0000","last_change":"2023-10-08T00:26:19.605625+0000","last_active":"2023-10-08T00:26:20.617039+0000","last_peered":"2023-10-08T00:26:20.617039+0000","last_clean":"2023-10-08T00:26:20.617039+0000","last_became_active":"2023-10-08T00:26:19.605342+0000","last_became_peered":"2023-10-08T00:26:19.605342+0000","last_unstale":"2023-10-08T00:26:20.617039+0000","last_undegraded":"2023-10-08T00:26:20.617039+0000","last_fullsized":"2023-10-08T00:26:20.617039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:27:17.761494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.616459+0000","last_change":"2023-10-08T00:26:20.614568+0000","last_active":"2023-10-08T00:26:20.616459+0000","last_peered":"2023-10-08T00:26:20.616459+0000","last_clean":"2023-10-08T00:26:20.616459+0000","last_became_active":"2023-10-08T00:26:20.614293+0000","last_became_peered":"2023-10-08T00:26:20.614293+0000","last_unstale":"2023-10-08T00:26:20.616459+0000","last_undegraded":"2023-10-08T00:26:20.616459+0000","last_fullsized":"2023-10-08T00:26:20.616459+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:43.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.616774+0000","last_change":"2023-10-08T00:26:19.604952+0000","last_active":"2023-10-08T00:26:20.616774+0000","last_peered":"2023-10-08T00:26:20.616774+0000","last_clean":"2023-10-08T00:26:20.616774+0000","last_became_active":"2023-10-08T00:26:19.604683+0000","last_became_peered":"2023-10-08T00:26:19.604683+0000","last_unstale":"2023-10-08T00:26:20.616774+0000","last_undegraded":"2023-10-08T00:26:20.616774+0000","last_fullsized":"2023-10-08T00:26:20.616774+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:08.235838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.615232+0000","last_change":"2023-10-08T00:26:20.606089+0000","last_active":"2023-10-08T00:26:20.615232+0000","last_peered":"2023-10-08T00:26:20.615232+0000","last_clean":"2023-10-08T00:26:20.615232+0000","last_became_active":"2023-10-08T00:26:20.605811+0000","last_became_peered":"2023-10-08T00:26:20.605811+0000","last_unstale":"2023-10-08T00:26:20.615232+0000","last_undegraded":"2023-10-08T00:26:20.615232+0000","last_fullsized":"2023-10-08T00:26:20.615232+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:59:45.351386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618419+0000","last_change":"2023-10-08T00:26:19.600569+0000","last_active":"2023-10-08T00:26:20.618419+0000","last_peered":"2023-10-08T00:26:20.618419+0000","last_clean":"2023-10-08T00:26:20.618419+0000","last_became_active":"2023-10-08T00:26:19.600309+0000","last_became_peered":"2023-10-08T00:26:19.600309+0000","last_unstale":"2023-10-08T00:26:20.618419+0000","last_undegraded":"2023-10-08T00:26:20.618419+0000","last_fullsized":"2023-10-08T00:26:20.618419+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:56.879260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610398+0000","last_change":"2023-10-08T00:26:20.609327+0000","last_active":"2023-10-08T00:26:20.610398+0000","last_peered":"2023-10-08T00:26:20.610398+0000","last_clean":"2023-10-08T00:26:20.610398+0000","last_became_active":"2023-10-08T00:26:20.608984+0000","last_became_peered":"2023-10-08T00:26:20.608984+0000","last_unstale":"2023-10-08T00:26:20.610398+0000","last_undegraded":"2023-10-08T00:26:20.610398+0000","last_fullsized":"2023-10-08T00:26:20.610398+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:23.424844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.595404+0000","last_change":"2023-10-08T00:26:19.599836+0000","last_active":"2023-10-08T00:26:20.595404+0000","last_peered":"2023-10-08T00:26:20.595404+0000","last_clean":"2023-10-08T00:26:20.595404+0000","last_became_active":"2023-10-08T00:26:19.599090+0000","last_became_peered":"2023-10-08T00:26:19.599090+0000","last_unstale":"2023-10-08T00:26:20.595404+0000","last_undegraded":"2023-10-08T00:26:20.595404+0000","last_fullsized":"2023-10-08T00:26:20.595404+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613676+0000","last_change":"2023-10-08T00:26:20.603278+0000","last_active":"2023-10-08T00:26:20.613676+0000","last_peered":"2023-10-08T00:26:20.613676+0000","last_clean":"2023-10-08T00:26:20.613676+0000","last_became_active":"2023-10-08T00:26:20.602882+0000","last_became_peered":"2023-10-08T00:26:20.602882+0000","last_unstale":"2023-10-08T00:26:20.613676+0000","last_undegraded":"2023-10-08T00:26:20.613676+0000","last_fullsized":"2023-10-08T00:26:20.613676+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:10.145626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.592235+0000","last_change":"2023-10-08T00:26:19.602581+0000","last_active":"2023-10-08T00:26:20.592235+0000","last_peered":"2023-10-08T00:26:20.592235+0000","last_clean":"2023-10-08T00:26:20.592235+0000","last_became_active":"2023-10-08T00:26:19.602298+0000","last_became_peered":"2023-10-08T00:26:19.602298+0000","last_unstale":"2023-10-08T00:26:20.592235+0000","last_undegraded":"2023-10-08T00:26:20.592235+0000","last_fullsized":"2023-10-08T00:26:20.592235+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609905+0000","last_change":"2023-10-08T00:26:20.602282+0000","last_active":"2023-10-08T00:26:20.609905+0000","last_peered":"2023-10-08T00:26:20.609905+0000","last_clean":"2023-10-08T00:26:20.609905+0000","last_became_active":"2023-10-08T00:26:20.601449+0000","last_became_peered":"2023-10-08T00:26:20.601449+0000","last_unstale":"2023-10-08T00:26:20.609905+0000","last_undegraded":"2023-10-08T00:26:20.609905+0000","last_fullsized":"2023-10-08T00:26:20.609905+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.599864+0000","last_change":"2023-10-08T00:26:19.604715+0000","last_active":"2023-10-08T00:26:20.599864+0000","last_peered":"2023-10-08T00:26:20.599864+0000","last_clean":"2023-10-08T00:26:20.599864+0000","last_became_active":"2023-10-08T00:26:19.604361+0000","last_became_peered":"2023-10-08T00:26:19.604361+0000","last_unstale":"2023-10-08T00:26:20.599864+0000","last_undegraded":"2023-10-08T00:26:20.599864+0000","last_fullsized":"2023-10-08T00:26:20.599864+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:49.574894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.614049+0000","last_change":"2023-10-08T00:26:20.612818+0000","last_active":"2023-10-08T00:26:20.614049+0000","last_peered":"2023-10-08T00:26:20.614049+0000","last_clean":"2023-10-08T00:26:20.614049+0000","last_became_active":"2023-10-08T00:26:20.612388+0000","last_became_peered":"2023-10-08T00:26:20.612388+0000","last_unstale":"2023-10-08T00:26:20.614049+0000","last_undegraded":"2023-10-08T00:26:20.614049+0000","last_fullsized":"2023-10-08T00:26:20.614049+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:11.463070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.594273+0000","last_change":"2023-10-08T00:26:19.608864+0000","last_active":"2023-10-08T00:26:20.594273+0000","last_peered":"2023-10-08T00:26:20.594273+0000","last_clean":"2023-10-08T00:26:20.594273+0000","last_became_active":"2023-10-08T00:26:19.607415+0000","last_became_peered":"2023-10-08T00:26:19.607415+0000","last_unstale":"2023-10-08T00:26:20.594273+0000","last_undegraded":"2023-10-08T00:26:20.594273+0000","last_fullsized":"2023-10-08T00:26:20.594273+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:38.957091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.606305+0000","last_change":"2023-10-08T00:26:20.597133+0000","last_active":"2023-10-08T00:26:20.606305+0000","last_peered":"2023-10-08T00:26:20.606305+0000","last_clean":"2023-10-08T00:26:20.606305+0000","last_became_active":"2023-10-08T00:26:20.596875+0000","last_became_peered":"2023-10-08T00:26:20.596875+0000","last_unstale":"2023-10-08T00:26:20.606305+0000","last_undegraded":"2023-10-08T00:26:20.606305+0000","last_fullsized":"2023-10-08T00:26:20.606305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:28:50.578967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618282+0000","last_change":"2023-10-08T00:26:19.610582+0000","last_active":"2023-10-08T00:26:20.618282+0000","last_peered":"2023-10-08T00:26:20.618282+0000","last_clean":"2023-10-08T00:26:20.618282+0000","last_became_active":"2023-10-08T00:26:19.610280+0000","last_became_peered":"2023-10-08T00:26:19.610280+0000","last_unstale":"2023-10-08T00:26:20.618282+0000","last_undegraded":"2023-10-08T00:26:20.618282+0000","last_fullsized":"2023-10-08T00:26:20.618282+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:07.605223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.615867+0000","last_change":"2023-10-08T00:26:20.614055+0000","last_active":"2023-10-08T00:26:20.615867+0000","last_peered":"2023-10-08T00:26:20.615867+0000","last_clean":"2023-10-08T00:26:20.615867+0000","last_became_active":"2023-10-08T00:26:20.613723+0000","last_became_peered":"2023-10-08T00:26:20.613723+0000","last_unstale":"2023-10-08T00:26:20.615867+0000","last_undegraded":"2023-10-08T00:26:20.615867+0000","last_fullsized":"2023-10-08T00:26:20.615867+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:36.046629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.621188+0000","last_change":"2023-10-08T00:26:19.602544+0000","last_active":"2023-10-08T00:26:20.621188+0000","last_peered":"2023-10-08T00:26:20.621188+0000","last_clean":"2023-10-08T00:26:20.621188+0000","last_became_active":"2023-10-08T00:26:19.602253+0000","last_became_peered":"2023-10-08T00:26:19.602253+0000","last_unstale":"2023-10-08T00:26:20.621188+0000","last_undegraded":"2023-10-08T00:26:20.621188+0000","last_fullsized":"2023-10-08T00:26:20.621188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613585+0000","last_change":"2023-10-08T00:26:20.609528+0000","last_active":"2023-10-08T00:26:20.613585+0000","last_peered":"2023-10-08T00:26:20.613585+0000","last_clean":"2023-10-08T00:26:20.613585+0000","last_became_active":"2023-10-08T00:26:20.608053+0000","last_became_peered":"2023-10-08T00:26:20.608053+0000","last_unstale":"2023-10-08T00:26:20.613585+0000","last_undegraded":"2023-10-08T00:26:20.613585+0000","last_fullsized":"2023-10-08T00:26:20.613585+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:16:11.463070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.619414+0000","last_change":"2023-10-08T00:26:19.607794+0000","last_active":"2023-10-08T00:26:20.619414+0000","last_peered":"2023-10-08T00:26:20.619414+0000","last_clean":"2023-10-08T00:26:20.619414+0000","last_became_active":"2023-10-08T00:26:19.607401+0000","last_became_peered":"2023-10-08T00:26:19.607401+0000","last_unstale":"2023-10-08T00:26:20.619414+0000","last_undegraded":"2023-10-08T00:26:20.619414+0000","last_fullsized":"2023-10-08T00:26:20.619414+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.800417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610190+0000","last_change":"2023-10-08T00:26:20.606393+0000","last_active":"2023-10-08T00:26:20.610190+0000","last_peered":"2023-10-08T00:26:20.610190+0000","last_clean":"2023-10-08T00:26:20.610190+0000","last_became_active":"2023-10-08T00:26:20.606124+0000","last_became_peered":"2023-10-08T00:26:20.606124+0000","last_unstale":"2023-10-08T00:26:20.610190+0000","last_undegraded":"2023-10-08T00:26:20.610190+0000","last_fullsized":"2023-10-08T00:26:20.610190+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:08.791091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.596545+0000","last_change":"2023-10-08T00:26:19.602407+0000","last_active":"2023-10-08T00:26:20.596545+0000","last_peered":"2023-10-08T00:26:20.596545+0000","last_clean":"2023-10-08T00:26:20.596545+0000","last_became_active":"2023-10-08T00:26:19.602143+0000","last_became_peered":"2023-10-08T00:26:19.602143+0000","last_unstale":"2023-10-08T00:26:20.596545+0000","last_undegraded":"2023-10-08T00:26:20.596545+0000","last_fullsized":"2023-10-08T00:26:20.596545+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:21:00.734187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609678+0000","last_change":"2023-10-08T00:26:20.603072+0000","last_active":"2023-10-08T00:26:20.609678+0000","last_peered":"2023-10-08T00:26:20.609678+0000","last_clean":"2023-10-08T00:26:20.609678+0000","last_became_active":"2023-10-08T00:26:20.602786+0000","last_became_peered":"2023-10-08T00:26:20.602786+0000","last_unstale":"2023-10-08T00:26:20.609678+0000","last_undegraded":"2023-10-08T00:26:20.609678+0000","last_fullsized":"2023-10-08T00:26:20.609678+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:40.828383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.595506+0000","last_change":"2023-10-08T00:26:19.601497+0000","last_active":"2023-10-08T00:26:20.595506+0000","last_peered":"2023-10-08T00:26:20.595506+0000","last_clean":"2023-10-08T00:26:20.595506+0000","last_became_active":"2023-10-08T00:26:19.601186+0000","last_became_peered":"2023-10-08T00:26:19.601186+0000","last_unstale":"2023-10-08T00:26:20.595506+0000","last_undegraded":"2023-10-08T00:26:20.595506+0000","last_fullsized":"2023-10-08T00:26:20.595506+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.615987+0000","last_change":"2023-10-08T00:26:20.614564+0000","last_active":"2023-10-08T00:26:20.615987+0000","last_peered":"2023-10-08T00:26:20.615987+0000","last_clean":"2023-10-08T00:26:20.615987+0000","last_became_active":"2023-10-08T00:26:20.614299+0000","last_became_peered":"2023-10-08T00:26:20.614299+0000","last_unstale":"2023-10-08T00:26:20.615987+0000","last_undegraded":"2023-10-08T00:26:20.615987+0000","last_fullsized":"2023-10-08T00:26:20.615987+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:26:29.338881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618252+0000","last_change":"2023-10-08T00:26:19.606874+0000","last_active":"2023-10-08T00:26:20.618252+0000","last_peered":"2023-10-08T00:26:20.618252+0000","last_clean":"2023-10-08T00:26:20.618252+0000","last_became_active":"2023-10-08T00:26:19.606627+0000","last_became_peered":"2023-10-08T00:26:19.606627+0000","last_unstale":"2023-10-08T00:26:20.618252+0000","last_undegraded":"2023-10-08T00:26:20.618252+0000","last_fullsized":"2023-10-08T00:26:20.618252+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:00.539100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.609852+0000","last_change":"2023-10-08T00:26:20.607286+0000","last_active":"2023-10-08T00:26:20.609852+0000","last_peered":"2023-10-08T00:26:20.609852+0000","last_clean":"2023-10-08T00:26:20.609852+0000","last_became_active":"2023-10-08T00:26:20.606388+0000","last_became_peered":"2023-10-08T00:26:20.606388+0000","last_unstale":"2023-10-08T00:26:20.609852+0000","last_undegraded":"2023-10-08T00:26:20.609852+0000","last_fullsized":"2023-10-08T00:26:20.609852+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:50.555024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618982+0000","last_change":"2023-10-08T00:26:19.608143+0000","last_active":"2023-10-08T00:26:20.618982+0000","last_peered":"2023-10-08T00:26:20.618982+0000","last_clean":"2023-10-08T00:26:20.618982+0000","last_became_active":"2023-10-08T00:26:19.607848+0000","last_became_peered":"2023-10-08T00:26:19.607848+0000","last_unstale":"2023-10-08T00:26:20.618982+0000","last_undegraded":"2023-10-08T00:26:20.618982+0000","last_fullsized":"2023-10-08T00:26:20.618982+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:30:42.599116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613764+0000","last_change":"2023-10-08T00:26:20.611307+0000","last_active":"2023-10-08T00:26:20.613764+0000","last_peered":"2023-10-08T00:26:20.613764+0000","last_clean":"2023-10-08T00:26:20.613764+0000","last_became_active":"2023-10-08T00:26:20.611063+0000","last_became_peered":"2023-10-08T00:26:20.611063+0000","last_unstale":"2023-10-08T00:26:20.613764+0000","last_undegraded":"2023-10-08T00:26:20.613764+0000","last_fullsized":"2023-10-08T00:26:20.613764+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:00:39.961165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.619385+0000","last_change":"2023-10-08T00:26:19.604741+0000","last_active":"2023-10-08T00:26:20.619385+0000","last_peered":"2023-10-08T00:26:20.619385+0000","last_clean":"2023-10-08T00:26:20.619385+0000","last_became_active":"2023-10-08T00:26:19.604455+0000","last_became_peered":"2023-10-08T00:26:19.604455+0000","last_unstale":"2023-10-08T00:26:20.619385+0000","last_undegraded":"2023-10-08T00:26:20.619385+0000","last_fullsized":"2023-10-08T00:26:20.619385+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.597688+0000","last_change":"2023-10-08T00:26:20.596651+0000","last_active":"2023-10-08T00:26:20.597688+0000","last_peered":"2023-10-08T00:26:20.597688+0000","last_clean":"2023-10-08T00:26:20.597688+0000","last_became_active":"2023-10-08T00:26:20.596403+0000","last_became_peered":"2023-10-08T00:26:20.596403+0000","last_unstale":"2023-10-08T00:26:20.597688+0000","last_undegraded":"2023-10-08T00:26:20.597688+0000","last_fullsized":"2023-10-08T00:26:20.597688+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:14.351171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":11,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.616941+0000","last_change":"2023-10-08T00:26:19.601546+0000","last_active":"2023-10-08T00:26:20.616941+0000","last_peered":"2023-10-08T00:26:20.616941+0000","last_clean":"2023-10-08T00:26:20.616941+0000","last_became_active":"2023-10-08T00:26:19.601250+0000","last_became_peered":"2023-10-08T00:26:19.601250+0000","last_unstale":"2023-10-08T00:26:20.616941+0000","last_undegraded":"2023-10-08T00:26:20.616941+0000","last_fullsized":"2023-10-08T00:26:20.616941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:20.688614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.617209+0000","last_change":"2023-10-08T00:26:20.615735+0000","last_active":"2023-10-08T00:26:20.617209+0000","last_peered":"2023-10-08T00:26:20.617209+0000","last_clean":"2023-10-08T00:26:20.617209+0000","last_became_active":"2023-10-08T00:26:20.615397+0000","last_became_peered":"2023-10-08T00:26:20.615397+0000","last_unstale":"2023-10-08T00:26:20.617209+0000","last_undegraded":"2023-10-08T00:26:20.617209+0000","last_fullsized":"2023-10-08T00:26:20.617209+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:48.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.600961+0000","last_change":"2023-10-08T00:26:19.602311+0000","last_active":"2023-10-08T00:26:20.600961+0000","last_peered":"2023-10-08T00:26:20.600961+0000","last_clean":"2023-10-08T00:26:20.600961+0000","last_became_active":"2023-10-08T00:26:19.602101+0000","last_became_peered":"2023-10-08T00:26:19.602101+0000","last_unstale":"2023-10-08T00:26:20.600961+0000","last_undegraded":"2023-10-08T00:26:20.600961+0000","last_fullsized":"2023-10-08T00:26:20.600961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:50.439200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610968+0000","last_change":"2023-10-08T00:26:20.608574+0000","last_active":"2023-10-08T00:26:20.610968+0000","last_peered":"2023-10-08T00:26:20.610968+0000","last_clean":"2023-10-08T00:26:20.610968+0000","last_became_active":"2023-10-08T00:26:20.608310+0000","last_became_peered":"2023-10-08T00:26:20.608310+0000","last_unstale":"2023-10-08T00:26:20.610968+0000","last_undegraded":"2023-10-08T00:26:20.610968+0000","last_fullsized":"2023-10-08T00:26:20.610968+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:27:42.466955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618380+0000","last_change":"2023-10-08T00:26:19.601160+0000","last_active":"2023-10-08T00:26:20.618380+0000","last_peered":"2023-10-08T00:26:20.618380+0000","last_clean":"2023-10-08T00:26:20.618380+0000","last_became_active":"2023-10-08T00:26:19.600877+0000","last_became_peered":"2023-10-08T00:26:19.600877+0000","last_unstale":"2023-10-08T00:26:20.618380+0000","last_undegraded":"2023-10-08T00:26:20.618380+0000","last_fullsized":"2023-10-08T00:26:20.618380+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:39.103719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618673+0000","last_change":"2023-10-08T00:26:20.614972+0000","last_active":"2023-10-08T00:26:20.618673+0000","last_peered":"2023-10-08T00:26:20.618673+0000","last_clean":"2023-10-08T00:26:20.618673+0000","last_became_active":"2023-10-08T00:26:20.614505+0000","last_became_peered":"2023-10-08T00:26:20.614505+0000","last_unstale":"2023-10-08T00:26:20.618673+0000","last_undegraded":"2023-10-08T00:26:20.618673+0000","last_fullsized":"2023-10-08T00:26:20.618673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.589725+0000","last_change":"2023-10-08T00:26:19.606732+0000","last_active":"2023-10-08T00:26:20.589725+0000","last_peered":"2023-10-08T00:26:20.589725+0000","last_clean":"2023-10-08T00:26:20.589725+0000","last_became_active":"2023-10-08T00:26:19.605988+0000","last_became_peered":"2023-10-08T00:26:19.605988+0000","last_unstale":"2023-10-08T00:26:20.589725+0000","last_undegraded":"2023-10-08T00:26:20.589725+0000","last_fullsized":"2023-10-08T00:26:20.589725+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:54.101460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.605909+0000","last_change":"2023-10-08T00:26:20.603272+0000","last_active":"2023-10-08T00:26:20.605909+0000","last_peered":"2023-10-08T00:26:20.605909+0000","last_clean":"2023-10-08T00:26:20.605909+0000","last_became_active":"2023-10-08T00:26:20.602993+0000","last_became_peered":"2023-10-08T00:26:20.602993+0000","last_unstale":"2023-10-08T00:26:20.605909+0000","last_undegraded":"2023-10-08T00:26:20.605909+0000","last_fullsized":"2023-10-08T00:26:20.605909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:48.804490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.595232+0000","last_change":"2023-10-08T00:26:19.603665+0000","last_active":"2023-10-08T00:26:20.595232+0000","last_peered":"2023-10-08T00:26:20.595232+0000","last_clean":"2023-10-08T00:26:20.595232+0000","last_became_active":"2023-10-08T00:26:19.603462+0000","last_became_peered":"2023-10-08T00:26:19.603462+0000","last_unstale":"2023-10-08T00:26:20.595232+0000","last_undegraded":"2023-10-08T00:26:20.595232+0000","last_fullsized":"2023-10-08T00:26:20.595232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:08.379349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610853+0000","last_change":"2023-10-08T00:26:20.608396+0000","last_active":"2023-10-08T00:26:20.610853+0000","last_peered":"2023-10-08T00:26:20.610853+0000","last_clean":"2023-10-08T00:26:20.610853+0000","last_became_active":"2023-10-08T00:26:20.608021+0000","last_became_peered":"2023-10-08T00:26:20.608021+0000","last_unstale":"2023-10-08T00:26:20.610853+0000","last_undegraded":"2023-10-08T00:26:20.610853+0000","last_fullsized":"2023-10-08T00:26:20.610853+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.189083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.620019+0000","last_change":"2023-10-08T00:26:19.608522+0000","last_active":"2023-10-08T00:26:20.620019+0000","last_peered":"2023-10-08T00:26:20.620019+0000","last_clean":"2023-10-08T00:26:20.620019+0000","last_became_active":"2023-10-08T00:26:19.607944+0000","last_became_peered":"2023-10-08T00:26:19.607944+0000","last_unstale":"2023-10-08T00:26:20.620019+0000","last_undegraded":"2023-10-08T00:26:20.620019+0000","last_fullsized":"2023-10-08T00:26:20.620019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:36:36.450510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.610631+0000","last_change":"2023-10-08T00:26:20.604153+0000","last_active":"2023-10-08T00:26:20.610631+0000","last_peered":"2023-10-08T00:26:20.610631+0000","last_clean":"2023-10-08T00:26:20.610631+0000","last_became_active":"2023-10-08T00:26:20.603902+0000","last_became_peered":"2023-10-08T00:26:20.603902+0000","last_unstale":"2023-10-08T00:26:20.610631+0000","last_undegraded":"2023-10-08T00:26:20.610631+0000","last_fullsized":"2023-10-08T00:26:20.610631+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:40.107793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"52'1","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-10-08T00:26:21.603218+0000","last_change":"2023-10-08T00:26:19.600540+0000","last_active":"2023-10-08T00:26:21.603218+0000","last_peered":"2023-10-08T00:26:21.603218+0000","last_clean":"2023-10-08T00:26:21.603218+0000","last_became_active":"2023-10-08T00:26:19.600250+0000","last_became_peered":"2023-10-08T00:26:19.600250+0000","last_unstale":"2023-10-08T00:26:21.603218+0000","last_undegraded":"2023-10-08T00:26:21.603218+0000","last_fullsized":"2023-10-08T00:26:21.603218+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:54:57.432078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.606336+0000","last_change":"2023-10-08T00:26:20.599819+0000","last_active":"2023-10-08T00:26:20.606336+0000","last_peered":"2023-10-08T00:26:20.606336+0000","last_clean":"2023-10-08T00:26:20.606336+0000","last_became_active":"2023-10-08T00:26:20.596924+0000","last_became_peered":"2023-10-08T00:26:20.596924+0000","last_unstale":"2023-10-08T00:26:20.606336+0000","last_undegraded":"2023-10-08T00:26:20.606336+0000","last_fullsized":"2023-10-08T00:26:20.606336+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:01.543174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.596526+0000","last_change":"2023-10-08T00:26:19.600255+0000","last_active":"2023-10-08T00:26:20.596526+0000","last_peered":"2023-10-08T00:26:20.596526+0000","last_clean":"2023-10-08T00:26:20.596526+0000","last_became_active":"2023-10-08T00:26:19.599956+0000","last_became_peered":"2023-10-08T00:26:19.599956+0000","last_unstale":"2023-10-08T00:26:20.596526+0000","last_undegraded":"2023-10-08T00:26:20.596526+0000","last_fullsized":"2023-10-08T00:26:20.596526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:05:50.293350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.607649+0000","last_change":"2023-10-08T00:26:20.605595+0000","last_active":"2023-10-08T00:26:20.607649+0000","last_peered":"2023-10-08T00:26:20.607649+0000","last_clean":"2023-10-08T00:26:20.607649+0000","last_became_active":"2023-10-08T00:26:20.604911+0000","last_became_peered":"2023-10-08T00:26:20.604911+0000","last_unstale":"2023-10-08T00:26:20.607649+0000","last_undegraded":"2023-10-08T00:26:20.607649+0000","last_fullsized":"2023-10-08T00:26:20.607649+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:19.129971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.595933+0000","last_change":"2023-10-08T00:26:19.600689+0000","last_active":"2023-10-08T00:26:20.595933+0000","last_peered":"2023-10-08T00:26:20.595933+0000","last_clean":"2023-10-08T00:26:20.595933+0000","last_became_active":"2023-10-08T00:26:19.600106+0000","last_became_peered":"2023-10-08T00:26:19.600106+0000","last_unstale":"2023-10-08T00:26:20.595933+0000","last_undegraded":"2023-10-08T00:26:20.595933+0000","last_fullsized":"2023-10-08T00:26:20.595933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:21.811829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613564+0000","last_change":"2023-10-08T00:26:20.610566+0000","last_active":"2023-10-08T00:26:20.613564+0000","last_peered":"2023-10-08T00:26:20.613564+0000","last_clean":"2023-10-08T00:26:20.613564+0000","last_became_active":"2023-10-08T00:26:20.610027+0000","last_became_peered":"2023-10-08T00:26:20.610027+0000","last_unstale":"2023-10-08T00:26:20.613564+0000","last_undegraded":"2023-10-08T00:26:20.613564+0000","last_fullsized":"2023-10-08T00:26:20.613564+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:25:25.952767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.589726+0000","last_change":"2023-10-08T00:26:19.606611+0000","last_active":"2023-10-08T00:26:20.589726+0000","last_peered":"2023-10-08T00:26:20.589726+0000","last_clean":"2023-10-08T00:26:20.589726+0000","last_became_active":"2023-10-08T00:26:19.606386+0000","last_became_peered":"2023-10-08T00:26:19.606386+0000","last_unstale":"2023-10-08T00:26:20.589726+0000","last_undegraded":"2023-10-08T00:26:20.589726+0000","last_fullsized":"2023-10-08T00:26:20.589726+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:45:59.014269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.618597+0000","last_change":"2023-10-08T00:26:20.617429+0000","last_active":"2023-10-08T00:26:20.618597+0000","last_peered":"2023-10-08T00:26:20.618597+0000","last_clean":"2023-10-08T00:26:20.618597+0000","last_became_active":"2023-10-08T00:26:20.617151+0000","last_became_peered":"2023-10-08T00:26:20.617151+0000","last_unstale":"2023-10-08T00:26:20.618597+0000","last_undegraded":"2023-10-08T00:26:20.618597+0000","last_fullsized":"2023-10-08T00:26:20.618597+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:19.048692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.592560+0000","last_change":"2023-10-08T00:26:19.596506+0000","last_active":"2023-10-08T00:26:20.592560+0000","last_peered":"2023-10-08T00:26:20.592560+0000","last_clean":"2023-10-08T00:26:20.592560+0000","last_became_active":"2023-10-08T00:26:19.596208+0000","last_became_peered":"2023-10-08T00:26:19.596208+0000","last_unstale":"2023-10-08T00:26:20.592560+0000","last_undegraded":"2023-10-08T00:26:20.592560+0000","last_fullsized":"2023-10-08T00:26:20.592560+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:41:01.952407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.606176+0000","last_change":"2023-10-08T00:26:20.601155+0000","last_active":"2023-10-08T00:26:20.606176+0000","last_peered":"2023-10-08T00:26:20.606176+0000","last_clean":"2023-10-08T00:26:20.606176+0000","last_became_active":"2023-10-08T00:26:20.600903+0000","last_became_peered":"2023-10-08T00:26:20.600903+0000","last_unstale":"2023-10-08T00:26:20.606176+0000","last_undegraded":"2023-10-08T00:26:20.606176+0000","last_fullsized":"2023-10-08T00:26:20.606176+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:24:57.883334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.589715+0000","last_change":"2023-10-08T00:26:19.604610+0000","last_active":"2023-10-08T00:26:20.589715+0000","last_peered":"2023-10-08T00:26:20.589715+0000","last_clean":"2023-10-08T00:26:20.589715+0000","last_became_active":"2023-10-08T00:26:19.604289+0000","last_became_peered":"2023-10-08T00:26:19.604289+0000","last_unstale":"2023-10-08T00:26:20.589715+0000","last_undegraded":"2023-10-08T00:26:20.589715+0000","last_fullsized":"2023-10-08T00:26:20.589715+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:39.790861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613715+0000","last_change":"2023-10-08T00:26:20.603347+0000","last_active":"2023-10-08T00:26:20.613715+0000","last_peered":"2023-10-08T00:26:20.613715+0000","last_clean":"2023-10-08T00:26:20.613715+0000","last_became_active":"2023-10-08T00:26:20.603169+0000","last_became_peered":"2023-10-08T00:26:20.603169+0000","last_unstale":"2023-10-08T00:26:20.613715+0000","last_undegraded":"2023-10-08T00:26:20.613715+0000","last_fullsized":"2023-10-08T00:26:20.613715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:24:23.498337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.595043+0000","last_change":"2023-10-08T00:26:19.602199+0000","last_active":"2023-10-08T00:26:20.595043+0000","last_peered":"2023-10-08T00:26:20.595043+0000","last_clean":"2023-10-08T00:26:20.595043+0000","last_became_active":"2023-10-08T00:26:19.601934+0000","last_became_peered":"2023-10-08T00:26:19.601934+0000","last_unstale":"2023-10-08T00:26:20.595043+0000","last_undegraded":"2023-10-08T00:26:20.595043+0000","last_fullsized":"2023-10-08T00:26:20.595043+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:37.185009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.613595+0000","last_change":"2023-10-08T00:26:20.604321+0000","last_active":"2023-10-08T00:26:20.613595+0000","last_peered":"2023-10-08T00:26:20.613595+0000","last_clean":"2023-10-08T00:26:20.613595+0000","last_became_active":"2023-10-08T00:26:20.603784+0000","last_became_peered":"2023-10-08T00:26:20.603784+0000","last_unstale":"2023-10-08T00:26:20.613595+0000","last_undegraded":"2023-10-08T00:26:20.613595+0000","last_fullsized":"2023-10-08T00:26:20.613595+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:19.578772+0000","last_clean_scrub_stamp":"2023-10-08T00:26:19.578772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:21:04.460031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.595285+0000","last_change":"2023-10-08T00:26:19.605412+0000","last_active":"2023-10-08T00:26:20.595285+0000","last_peered":"2023-10-08T00:26:20.595285+0000","last_clean":"2023-10-08T00:26:20.595285+0000","last_became_active":"2023-10-08T00:26:19.605141+0000","last_became_peered":"2023-10-08T00:26:19.605141+0000","last_unstale":"2023-10-08T00:26:20.595285+0000","last_undegraded":"2023-10-08T00:26:20.595285+0000","last_fullsized":"2023-10-08T00:26:20.595285+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:18.574698+0000","last_clean_scrub_stamp":"2023-10-08T00:26:18.574698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:06:37.248332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":51,"state":"active+clean","last_fresh":"2023-10-08T00:26:20.597805+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:20.597805+0000","last_peered":"2023-10-08T00:26:20.597805+0000","last_clean":"2023-10-08T00:26:20.597805+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:20.597805+0000","last_undegraded":"2023-10-08T00:26:20.597805+0000","last_fullsized":"2023-10-08T00:26:20.597805+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298484,"kb_used_data":1196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073356,"statfs":{"total":96636764160,"available":96331116544,"internally_reserved":0,"allocated":1224704,"data_stored":854109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51900000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.68400000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.55800000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297896,"kb_used_data":608,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073944,"statfs":{"total":96636764160,"available":96331718656,"internally_reserved":0,"allocated":622592,"data_stored":263581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55900000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.626},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.65300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.72899999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.745},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297900,"kb_used_data":612,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073940,"statfs":{"total":96636764160,"available":96331714560,"internally_reserved":0,"allocated":626688,"data_stored":263671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.251},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32100000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.23499999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.43099999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.443},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.34200000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.40899999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":856039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.38700000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.499}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42099999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.44800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073936,"statfs":{"total":96636764160,"available":96331710464,"internally_reserved":0,"allocated":630784,"data_stored":263637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.374},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.39300000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.31}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66300000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.64000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302000,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069840,"statfs":{"total":96636764160,"available":96327516160,"internally_reserved":0,"allocated":630784,"data_stored":263637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.313}]},{"osd":2,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.375}]},{"osd":4,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.82399999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:25:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.78100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297908,"kb_used_data":620,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073932,"statfs":{"total":96636764160,"available":96331706368,"internally_reserved":0,"allocated":634880,"data_stored":265117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:25:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297904,"kb_used_data":616,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073936,"statfs":{"total":96636764160,"available":96331710464,"internally_reserved":0,"allocated":630784,"data_stored":264205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.379},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.36599999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.436}]},{"osd":3,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45200000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:25:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:26:29.638 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:26:29.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:26:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.797+0000 7f16e52e9700 1 Processor -- start 2023-10-08T00:26:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.797+0000 7f16e52e9700 1 -- start start 2023-10-08T00:26:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16e52e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16e52e9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e015a020 con 0x7f16e0153e80 2023-10-08T00:26:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16e52e9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e015a2e0 con 0x7f16e0154250 2023-10-08T00:26:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16e52e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e015a5c0 con 0x7f16e00c9930 2023-10-08T00:26:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16deffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f16e0153e80 0x7f16e00c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50972/0 (socket says 172.21.15.22:50972) 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16deffd700 1 -- 172.21.15.22:0/2911117721 learned_addr learned my addr 172.21.15.22:0/2911117721 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.798+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183267193 0 0) 0x7f16e015a020 con 0x7f16e0153e80 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16de7fc700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16cc003570 con 0x7f16e0153e80 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 426087551 0 0) 0x7f16cc003570 con 0x7f16e0153e80 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 msgr2=0x7f16e0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 >> v1:172.21.15.192:6789/0 conn(0x7f16e0154250 legacy=0x7f16e015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e015a8a0 con 0x7f16e0153e80 2023-10-08T00:26:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f16d8001470 con 0x7f16e0153e80 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 >> v1:172.21.15.22:6789/0 conn(0x7f16e0153e80 legacy=0x7f16e00c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16cc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16cc004010 0x7f16cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16cc004d50 0x7f16cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e015a5c0 con 0x7f16cc004d50 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc00bbf0 con 0x7f16cc004010 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16cc00bdb0 con 0x7f16e00c9930 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16df7fe700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16cc004d50 0x7f16cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16deffd700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16cc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16de7fc700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16cc004010 0x7f16cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16deffd700 1 -- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16cc004010 msgr2=0x7f16cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16deffd700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16cc004010 0x7f16cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16deffd700 1 -- 172.21.15.22:0/2911117721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16cc004d50 msgr2=0x7f16cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16deffd700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16cc004d50 0x7f16cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16deffd700 1 -- 172.21.15.22:0/2911117721 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc003570 con 0x7f16e00c9930 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.799+0000 7f16df7fe700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16cc004d50 0x7f16cc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16deffd700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16cc003a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16d800c390 tx=0x7f16d8001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a7b9d94297c440 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800cc60 con 0x7f16e00c9930 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d800cdc0 con 0x7f16e00c9930 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16ddffb700 1 -- 172.21.15.22:0/2911117721 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8005b50 con 0x7f16e00c9930 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16e52e9700 1 -- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 msgr2=0x7f16cc003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2911117721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16cc003a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16d800c390 tx=0x7f16d8001e50 comp rx=0 tx=0).stop 2023-10-08T00:26:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16df7fe700 1 -- 172.21.15.22:0/2911117721 reap_dead start 2023-10-08T00:26:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16e52e9700 1 -- 172.21.15.22:0/2911117721 shutdown_connections 2023-10-08T00:26:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16e52e9700 1 -- 172.21.15.22:0/2911117721 >> 172.21.15.22:0/2911117721 conn(0x7f16e00cdd80 msgr2=0x7f16e00c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16e52e9700 1 -- 172.21.15.22:0/2911117721 shutdown_connections 2023-10-08T00:26:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.800+0000 7f16e52e9700 1 -- 172.21.15.22:0/2911117721 wait complete. 2023-10-08T00:26:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 Processor -- start 2023-10-08T00:26:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 -- start start 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e014cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 0x7f16e00c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16e014c640 0x7f16e00c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00c5e60 con 0x7f16e014c1d0 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00c5530 con 0x7f16e014c640 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16e52e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00c5810 con 0x7f16e00c9930 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.802+0000 7f16de7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 0x7f16e00c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 0x7f16e00c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57032/0 (socket says 172.21.15.22:57032) 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 -- 172.21.15.22:0/2603216847 learned_addr learned my addr 172.21.15.22:0/2603216847 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16df7fe700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16e014c640 0x7f16e00c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16deffd700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e014cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 -- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 msgr2=0x7f16e014cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e014cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 -- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16e014c640 msgr2=0x7f16e00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16e014c640 0x7f16e00c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 -- 172.21.15.22:0/2603216847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00c5af0 con 0x7f16e014c1d0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16deffd700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16de7fc700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 0x7f16e00c6560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f16c8011d40 tx=0x7f16c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c800fac0 con 0x7f16e014c1d0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c800fc20 con 0x7f16e014c1d0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00c51f0 con 0x7f16e014c1d0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8014440 con 0x7f16e014c1d0 2023-10-08T00:26:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.803+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e00b1540 con 0x7f16e014c1d0 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.804+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e004c3c0 con 0x7f16e014c1d0 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.805+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16c8014a80 con 0x7f16e014c1d0 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.805+0000 7f16d6ffd700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f16c0066f30 0x7f16c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.805+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16c8018030 con 0x7f16e014c1d0 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.805+0000 7f16deffd700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f16c0066f30 0x7f16c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.806+0000 7f16deffd700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f16c0066f30 0x7f16c00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f16d8001ed0 tx=0x7f16d8015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:29.809+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16c8052900 con 0x7f16e014c1d0 2023-10-08T00:26:30.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.089+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f16e015ab80 con 0x7f16e014c1d0 2023-10-08T00:26:30.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.092+0000 7f16d6ffd700 1 -- 172.21.15.22:0/2603216847 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f16c8022020 con 0x7f16e014c1d0 2023-10-08T00:26:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.094+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f16c0066f30 msgr2=0x7f16c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.094+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f16c0066f30 0x7f16c00693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f16d8001ed0 tx=0x7f16d8015000 comp rx=0 tx=0).stop 2023-10-08T00:26:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.094+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 msgr2=0x7f16e00c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.094+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 0x7f16e00c6560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f16c8011d40 tx=0x7f16c80091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 shutdown_connections 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16e014c640 0x7f16e00c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f16c0066f30 0x7f16c00693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f16e00c9930 0x7f16e014cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 --2- 172.21.15.22:0/2603216847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16e014c1d0 0x7f16e00c6560 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 >> 172.21.15.22:0/2603216847 conn(0x7f16e00cdd80 msgr2=0x7f16e00c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 shutdown_connections 2023-10-08T00:26:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.095+0000 7f16e52e9700 1 -- 172.21.15.22:0/2603216847 wait complete. 2023-10-08T00:26:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:26:30.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:30.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.225+0000 7f3471dfd700 1 Processor -- start 2023-10-08T00:26:30.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.226+0000 7f3471dfd700 1 -- start start 2023-10-08T00:26:30.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.226+0000 7f3471dfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 0x7f346c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.226+0000 7f3471dfd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c15d7e0 con 0x7f346c06c0a0 2023-10-08T00:26:30.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.226+0000 7f3471dfd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c15dac0 con 0x7f346c06bcd0 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.226+0000 7f3471dfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0caf30 con 0x7f346c0caa90 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.226+0000 7f3462ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f346c06c0a0 0x7f346c15df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50988/0 (socket says 172.21.15.22:50988) 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f3462ffd700 1 -- 172.21.15.22:0/3982262549 learned_addr learned my addr 172.21.15.22:0/3982262549 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194948507 0 0) 0x7f346c15d7e0 con 0x7f346c06c0a0 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346bfff700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 0x7f346c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3458003570 con 0x7f346c06c0a0 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863612950 0 0) 0x7f3458003570 con 0x7f346c06c0a0 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 msgr2=0x7f346c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 0x7f346c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 >> v1:172.21.15.192:6789/0 conn(0x7f346c06bcd0 legacy=0x7f346c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c15aa30 con 0x7f346c06c0a0 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f3454001470 con 0x7f346c06c0a0 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 >> v1:172.21.15.22:6789/0 conn(0x7f346c06c0a0 legacy=0x7f346c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3458003a90 0x7f3458003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f3458004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 0x7f3458005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0caf30 con 0x7f3458004810 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345800bc20 con 0x7f3458003a90 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345800bde0 con 0x7f346c0caa90 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f3462ffd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f3458004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346b7fe700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3458003a90 0x7f3458003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.227+0000 7f346bfff700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 0x7f3458005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3462ffd700 1 -- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 msgr2=0x7f3458005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3462ffd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0caa90 0x7f3458005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3462ffd700 1 -- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3458003a90 msgr2=0x7f3458003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3462ffd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3458003a90 0x7f3458003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3462ffd700 1 -- 172.21.15.22:0/3982262549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458003570 con 0x7f3458004810 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f346b7fe700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3458003a90 0x7f3458003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3462ffd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f3458004c80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f345400c390 tx=0x7f3454001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d928d6562b7fa7bf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345400cc60 con 0x7f3458004810 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345400cdc0 con 0x7f3458004810 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f346affd700 1 -- 172.21.15.22:0/3982262549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454005b50 con 0x7f3458004810 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3471dfd700 1 -- 172.21.15.22:0/3982262549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 msgr2=0x7f3458004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3471dfd700 1 --2- 172.21.15.22:0/3982262549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f3458004c80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f345400c390 tx=0x7f3454001e50 comp rx=0 tx=0).stop 2023-10-08T00:26:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f346bfff700 1 -- 172.21.15.22:0/3982262549 reap_dead start 2023-10-08T00:26:30.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3471dfd700 1 -- 172.21.15.22:0/3982262549 shutdown_connections 2023-10-08T00:26:30.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3471dfd700 1 -- 172.21.15.22:0/3982262549 >> 172.21.15.22:0/3982262549 conn(0x7f346c0ce600 msgr2=0x7f346c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:30.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3471dfd700 1 -- 172.21.15.22:0/3982262549 shutdown_connections 2023-10-08T00:26:30.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.228+0000 7f3471dfd700 1 -- 172.21.15.22:0/3982262549 wait complete. 2023-10-08T00:26:30.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.230+0000 7f3471dfd700 1 Processor -- start 2023-10-08T00:26:30.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.230+0000 7f3471dfd700 1 -- start start 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.230+0000 7f3471dfd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f346c14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f346c0b13a0 0x7f346c0b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0c8aa0 0x7f346c0c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0b24d0 con 0x7f3458004810 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0c5b80 con 0x7f346c0b13a0 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c0c5850 con 0x7f346c0c8aa0 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f346c14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f346c14b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57060/0 (socket says 172.21.15.22:57060) 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 -- 172.21.15.22:0/4056950105 learned_addr learned my addr 172.21.15.22:0/4056950105 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346bfff700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0c8aa0 0x7f346c0c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3462ffd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f346c0b13a0 0x7f346c0b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 -- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0c8aa0 msgr2=0x7f346c0c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0c8aa0 0x7f346c0c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 -- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f346c0b13a0 msgr2=0x7f346c0b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f346c0b13a0 0x7f346c0b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 -- 172.21.15.22:0/4056950105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c1592e0 con 0x7f3458004810 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346bfff700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0c8aa0 0x7f346c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3462ffd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f346c0b13a0 0x7f346c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f346b7fe700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f346c14b170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e840 tx=0x7f345c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c017070 con 0x7f3458004810 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c006820 con 0x7f3458004810 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c0b1f10 con 0x7f3458004810 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c006bc0 con 0x7f3458004810 2023-10-08T00:26:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.231+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c0c9460 con 0x7f3458004810 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.232+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346c0648d0 con 0x7f3458004810 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.233+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f345c007020 con 0x7f3458004810 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.233+0000 7f3463fff700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f344c066f30 0x7f344c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.233+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f345c084130 con 0x7f3458004810 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.233+0000 7f3462ffd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f344c066f30 0x7f344c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.234+0000 7f3462ffd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f344c066f30 0x7f344c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f346c159cd0 tx=0x7f3454015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:30.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.238+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f345c0513a0 con 0x7f3458004810 2023-10-08T00:26:30.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.477+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f346c0c5690 con 0x7f3458004810 2023-10-08T00:26:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.477+0000 7f3463fff700 1 -- 172.21.15.22:0/4056950105 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f345c0549c0 con 0x7f3458004810 2023-10-08T00:26:30.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:30.479 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:20.001353+0000","modified":"2023-10-08T00:26:23.607891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/1300992790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1300992790},{"type":"v1","addr":"172.21.15.22:6835","nonce":1300992790}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T00:26:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.479+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f344c066f30 msgr2=0x7f344c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.479+0000 7f3471dfd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f344c066f30 0x7f344c0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f346c159cd0 tx=0x7f3454015000 comp rx=0 tx=0).stop 2023-10-08T00:26:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 msgr2=0x7f346c14b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f346c14b170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f345c00e840 tx=0x7f345c009040 comp rx=0 tx=0).stop 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 shutdown_connections 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f344c066f30 0x7f344c0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f346c0c8aa0 0x7f346c0c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458004810 0x7f346c14b170 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 --2- 172.21.15.22:0/4056950105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f346c0b13a0 0x7f346c0b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 >> 172.21.15.22:0/4056950105 conn(0x7f346c0ce600 msgr2=0x7f346c15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 shutdown_connections 2023-10-08T00:26:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:30.480+0000 7f3471dfd700 1 -- 172.21.15.22:0/4056950105 wait complete. 2023-10-08T00:26:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 32 2023-10-08T00:26:30.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:26:30.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:26:30.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:26:20.001353+0000', 'modified': '2023-10-08T00:26:23.607891+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5349}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5349': {'gid': 5349, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6835/1300992790', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6833', 'nonce': 1300992790}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 1300992790}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:26:30.894 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:26:30.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T00:26:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.016+0000 7f1d15b1d700 1 Processor -- start 2023-10-08T00:26:31.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.016+0000 7f1d15b1d700 1 -- start start 2023-10-08T00:26:31.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d15b1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10159890 0x7f1d1015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d15b1d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d10069560 0x7f1d100699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d15b1d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1015a160 con 0x7f1d10159c60 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d15b1d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d10069f20 con 0x7f1d10069560 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d15b1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100d13a0 con 0x7f1d10159890 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d0ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d10069560 0x7f1d100699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d0effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1d10159c60 0x7f1d1015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51000/0 (socket says 172.21.15.22:51000) 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.017+0000 7f1d0effd700 1 -- 172.21.15.22:0/1371888334 learned_addr learned my addr 172.21.15.22:0/1371888334 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/1371888334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10159890 0x7f1d1015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1371888334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10159890 msgr2=0x7f1d1015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/1371888334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10159890 0x7f1d1015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1371888334 >> v1:172.21.15.22:6789/0 conn(0x7f1d10159c60 legacy=0x7f1d1015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1371888334 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1015e140 con 0x7f1d10069560 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0e7fc700 1 -- 172.21.15.22:0/1371888334 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435007593 0 0) 0x7f1d1015a160 con 0x7f1d10159c60 2023-10-08T00:26:31.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/1371888334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10069560 0x7f1d100699e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009e60 tx=0x7f1d08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a91ecf2ba97e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0e7fc700 1 -- 172.21.15.22:0/1371888334 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800e070 con 0x7f1d10069560 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0e7fc700 1 -- 172.21.15.22:0/1371888334 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0800bb60 con 0x7f1d10069560 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.018+0000 7f1d0e7fc700 1 -- 172.21.15.22:0/1371888334 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08012430 con 0x7f1d10069560 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 -- 172.21.15.22:0/1371888334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10069560 msgr2=0x7f1d100699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/1371888334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10069560 0x7f1d100699e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009e60 tx=0x7f1d08009780 comp rx=0 tx=0).stop 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 -- 172.21.15.22:0/1371888334 shutdown_connections 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/1371888334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10069560 0x7f1d100699e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/1371888334 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10159890 0x7f1d1015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 -- 172.21.15.22:0/1371888334 >> 172.21.15.22:0/1371888334 conn(0x7f1d10068e20 msgr2=0x7f1d100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 -- 172.21.15.22:0/1371888334 shutdown_connections 2023-10-08T00:26:31.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.019+0000 7f1d15b1d700 1 -- 172.21.15.22:0/1371888334 wait complete. 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.020+0000 7f1d15b1d700 1 Processor -- start 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.020+0000 7f1d15b1d700 1 -- start start 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10069560 0x7f1d100b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d10159890 0x7f1d100c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 0x7f1d1015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100b4270 con 0x7f1d10159c60 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1015ce10 con 0x7f1d10159890 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100b3ad0 con 0x7f1d10069560 2023-10-08T00:26:31.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 0x7f1d1015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 0x7f1d1015d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57078/0 (socket says 172.21.15.22:57078) 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 -- 172.21.15.22:0/2874278241 learned_addr learned my addr 172.21.15.22:0/2874278241 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 -- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10069560 msgr2=0x7f1d100b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10069560 0x7f1d100b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0effd700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d10159890 0x7f1d100c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10069560 0x7f1d100b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 -- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d10159890 msgr2=0x7f1d100c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d10159890 0x7f1d100c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 -- 172.21.15.22:0/2874278241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08009a20 con 0x7f1d10159c60 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0effd700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d10159890 0x7f1d100c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 0x7f1d1015d2a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1d100899c0 tx=0x7f1d08019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1cf77fe700 1 -- 172.21.15.22:0/2874278241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08027470 con 0x7f1d10159c60 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1cf77fe700 1 -- 172.21.15.22:0/2874278241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d08027610 con 0x7f1d10159c60 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.021+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d100b16e0 con 0x7f1d10159c60 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.022+0000 7f1cf77fe700 1 -- 172.21.15.22:0/2874278241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d080279d0 con 0x7f1d10159c60 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.022+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1015caa0 con 0x7f1d10159c60 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.023+0000 7f1cf77fe700 1 -- 172.21.15.22:0/2874278241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d08024070 con 0x7f1d10159c60 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.024+0000 7f1cf77fe700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cfc066f30 0x7f1cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.024+0000 7f1cf77fe700 1 -- 172.21.15.22:0/2874278241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d08086ff0 con 0x7f1d10159c60 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.024+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cfc066f30 0x7f1cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.024+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cfc066f30 0x7f1cfc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d000093f0 tx=0x7f1d00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.025+0000 7f1d1ee15b80 1 Processor -- start 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 -- start start 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1efaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ecdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1e28a70 con 0x5574c1efaf60 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1e26270 con 0x5574c1ed1a50 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.026+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574c1e22060 con 0x5574c1f1bd00 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ecdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ecdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57094/0 (socket says 172.21.15.22:57094) 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 -- 172.21.15.22:0/3007746959 learned_addr learned my addr 172.21.15.22:0/3007746959 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1efaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 -- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 msgr2=0x5574c1efaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1efaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 -- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 msgr2=0x5574c1ed1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 -- 172.21.15.22:0/3007746959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574c1cbc270 con 0x5574c1efaf60 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ecdcf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800b740 tx=0x7f1d08020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8785db0caf26b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1cf4ff9700 1 -- 172.21.15.22:0/3007746959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800e040 con 0x5574c1efaf60 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1cf4ff9700 1 -- 172.21.15.22:0/3007746959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0805b1d0 con 0x5574c1efaf60 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.027+0000 7f1cf4ff9700 1 -- 172.21.15.22:0/3007746959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0805eec0 con 0x5574c1efaf60 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3007746959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 msgr2=0x5574c1ecdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ecdcf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800b740 tx=0x7f1d08020040 comp rx=0 tx=0).stop 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3007746959 shutdown_connections 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ecdcf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3007746959 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1efaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3007746959 >> 172.21.15.22:0/3007746959 conn(0x5574c1ed3370 msgr2=0x5574c1ed3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3007746959 shutdown_connections 2023-10-08T00:26:31.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3007746959 wait complete. 2023-10-08T00:26:31.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.028+0000 7f1d1ee15b80 1 -- start start 2023-10-08T00:26:31.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 Processor -- start 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f14950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1f131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ecd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1dcd890 con 0x5574c1efaf60 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1de8ea0 con 0x5574c1ed1a50 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574c1ca4e30 con 0x5574c1f1bd00 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d1ee15b80 10 client.0 _ll_register_callbacks cb 0x5574c1e95110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1f131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1f131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57106/0 (socket says 172.21.15.22:57106) 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.029+0000 7f1d0effd700 1 -- 172.21.15.22:0/3227011785 learned_addr learned my addr 172.21.15.22:0/3227011785 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ecd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f14950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0effd700 1 -- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 msgr2=0x5574c1ecd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ecd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0effd700 1 -- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 msgr2=0x5574c1f14950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f14950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0effd700 1 -- 172.21.15.22:0/3227011785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1015caa0 con 0x5574c1efaf60 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ecd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f14950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1f131d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1d10157a00 tx=0x7f1d04009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcccc054599eab5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1cedffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:26:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1cedffb700 1 -- 172.21.15.22:0/3227011785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04001d00 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1cedffb700 1 -- 172.21.15.22:0/3227011785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d04005ab0 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574c1ec6b70 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1cedffb700 1 -- 172.21.15.22:0/3227011785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d040070d0 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 10 client.5499 fetch_fsmap learned FSMap version 32 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5574c1c5efe0 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1cedffb700 1 -- 172.21.15.22:0/3227011785 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5574c1ec6b70 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1cedffb700 1 -- 172.21.15.22:0/3227011785 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1d04012070 con 0x5574c1efaf60 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 10 client.5499 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 10 client.5499 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 20 client.5499 populate_metadata read hostname 'smithi022' 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.030+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f15710 0x5574c1f15ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1d1ee15b80 4 client.5499 mds_command: new command op to 5349 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 --> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574c1ea3aa0 con 0x5574c1f15710 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f15710 0x5574c1f15ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1cedffb700 10 client.5499 ms_handle_connect on v2:172.21.15.22:6833/1300992790 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f15710 0x5574c1f15ae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=472bdaab839447ad server_cookie=707fd979713fc543 in_seq=0 out_seq=0 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1cedffb700 1 -- 172.21.15.22:0/3227011785 <== mds.0 v2:172.21.15.22:6833/1300992790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5574c1ea3aa0 con 0x5574c1f15710 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1cedffb700 10 client.5499 handle_command_reply: tid=0 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.031+0000 7f1d1ee15b80 1 client.5499 shutdown 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 msgr2=0x5574c1f131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1f131d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1d10157a00 tx=0x7f1d04009040 comp rx=0 tx=0).stop 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 shutdown_connections 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f15710 0x5574c1f15ae0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ecd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f14950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1cedffb700 0 client.5499 ms_handle_reset on v2:172.21.15.22:6833/1300992790 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3227011785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1f131d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 >> 172.21.15.22:0/3227011785 conn(0x5574c1ed3370 msgr2=0x5574c1ece6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 shutdown_connections 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3227011785 wait complete. 2023-10-08T00:26:31.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.032+0000 7f1d1ee15b80 20 client.5499 trim_cache size 0 max 16384 2023-10-08T00:26:31.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 Processor -- start 2023-10-08T00:26:31.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 -- start start 2023-10-08T00:26:31.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ed3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ed3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1f17780 con 0x5574c1efaf60 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1ed29c0 con 0x5574c1ed1a50 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574c1eaa410 con 0x5574c1f1bd00 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ed3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ed3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57118/0 (socket says 172.21.15.22:57118) 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.049+0000 7f1d0effd700 1 -- 172.21.15.22:0/3241998095 learned_addr learned my addr 172.21.15.22:0/3241998095 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ed3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0effd700 1 -- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 msgr2=0x5574c1ed3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ed3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0effd700 1 -- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 msgr2=0x5574c1ed2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0effd700 1 -- 172.21.15.22:0/3241998095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574c1df0780 con 0x5574c1efaf60 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d0effd700 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ed3740 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1d04006fc0 tx=0x7f1d0401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e09ee9483f5b75c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1cf57fa700 1 -- 172.21.15.22:0/3241998095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04001300 con 0x5574c1efaf60 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1cf57fa700 1 -- 172.21.15.22:0/3241998095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0400d070 con 0x5574c1efaf60 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1cf57fa700 1 -- 172.21.15.22:0/3241998095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04000c30 con 0x5574c1efaf60 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3241998095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 msgr2=0x5574c1ed3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.050+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ed3740 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1d04006fc0 tx=0x7f1d0401e000 comp rx=0 tx=0).stop 2023-10-08T00:26:31.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3241998095 shutdown_connections 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1f1bd00 0x5574c1ed3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1ed2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/3241998095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1efaf60 0x5574c1ed3740 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3241998095 >> 172.21.15.22:0/3241998095 conn(0x5574c1ed3370 msgr2=0x5574c1eca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3241998095 shutdown_connections 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/3241998095 wait complete. 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 -- start start 2023-10-08T00:26:31.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.051+0000 7f1d1ee15b80 1 Processor -- start 2023-10-08T00:26:31.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f1cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1efaf60 0x5574c1f7d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 0x5574c1f81f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1ecdbd0 con 0x5574c1f1bd00 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1f7dea0 con 0x5574c1ed1a50 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574c1f18af0 con 0x5574c1efaf60 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d1ee15b80 10 client.0 _ll_register_callbacks cb 0x5574c1e95110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 0x5574c1f81f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 0x5574c1f81f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57120/0 (socket says 172.21.15.22:57120) 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1801570611 learned_addr learned my addr 172.21.15.22:0/1801570611 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:31.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f1cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0effd700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1efaf60 0x5574c1f7d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1efaf60 msgr2=0x5574c1f7d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1efaf60 0x5574c1f7d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 msgr2=0x5574c1f1cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f1cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.052+0000 7f1d0ffff700 1 -- 172.21.15.22:0/1801570611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574c1c5efe0 con 0x5574c1f1bd00 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d0ffff700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 0x5574c1f81f60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1d080855f0 tx=0x7f1d0805a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2925a0b9261fcdfb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1cedffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1cedffb700 1 -- 172.21.15.22:0/1801570611 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800e040 con 0x5574c1f1bd00 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d0805b1d0 con 0x5574c1f1bd00 2023-10-08T00:26:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1cedffb700 1 -- 172.21.15.22:0/1801570611 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d0805eec0 con 0x5574c1f1bd00 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1cedffb700 1 -- 172.21.15.22:0/1801570611 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d0805d070 con 0x5574c1f1bd00 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 10 client.5505 fetch_fsmap learned FSMap version 32 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5574c1dd7470 con 0x5574c1f1bd00 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1cedffb700 1 -- 172.21.15.22:0/1801570611 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0805b1d0 con 0x5574c1f1bd00 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1cedffb700 1 -- 172.21.15.22:0/1801570611 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 32) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1d080574c0 con 0x5574c1f1bd00 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 10 client.5505 fetch_fsmap finished waiting for FSMap version 32 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 10 client.5505 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 20 client.5505 populate_metadata read hostname 'smithi022' 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f18180 0x5574c1ed3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 4 client.5505 mds_command: new command op to 5349 tid=0[{"prefix": "status"}] 2023-10-08T00:26:31.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 --> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5574c1dc4e00 con 0x5574c1f18180 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.053+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f18180 0x5574c1ed3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1cedffb700 10 client.5505 ms_handle_connect on v2:172.21.15.22:6833/1300992790 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d0f7fe700 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f18180 0x5574c1ed3740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c20fe13838ed13c server_cookie=120fb2bbc1003286 in_seq=0 out_seq=0 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1cedffb700 1 -- 172.21.15.22:0/1801570611 <== mds.0 v2:172.21.15.22:6833/1300992790 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5574c1dc4e00 con 0x5574c1f18180 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1cedffb700 10 client.5505 handle_command_reply: tid=0 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 client.5505 shutdown 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 msgr2=0x5574c1f81f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 0x5574c1f81f60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1d080855f0 tx=0x7f1d0805a000 comp rx=0 tx=0).stop 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 shutdown_connections 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:6833/1300992790,v1:172.21.15.22:6835/1300992790] conn(0x5574c1f18180 0x5574c1ed3740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5574c1f1bd00 0x5574c1f81f60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1cedffb700 0 client.5505 ms_handle_reset on v2:172.21.15.22:6833/1300992790 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5574c1ed1a50 0x5574c1f1cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 --2- 172.21.15.22:0/1801570611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5574c1efaf60 0x5574c1f7d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 >> 172.21.15.22:0/1801570611 conn(0x5574c1ed3370 msgr2=0x5574c1ecebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 shutdown_connections 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 1 -- 172.21.15.22:0/1801570611 wait complete. 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d1ee15b80 20 client.5505 trim_cache size 0 max 16384 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:26:31.062 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5349, 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.457059378, 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 32, 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 52, 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 52, 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 21.513390988000001 2023-10-08T00:26:31.063 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:26:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cfc066f30 msgr2=0x7f1cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cfc066f30 0x7f1cfc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d000093f0 tx=0x7f1d00008040 comp rx=0 tx=0).stop 2023-10-08T00:26:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 msgr2=0x7f1d1015d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 0x7f1d1015d2a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1d100899c0 tx=0x7f1d08019000 comp rx=0 tx=0).stop 2023-10-08T00:26:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 shutdown_connections 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.054+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d10159c60 0x7f1d1015d2a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.055+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cfc066f30 0x7f1cfc0693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.055+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d10069560 0x7f1d100b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.055+0000 7f1d15b1d700 1 --2- 172.21.15.22:0/2874278241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d10159890 0x7f1d100c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.055+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 >> 172.21.15.22:0/2874278241 conn(0x7f1d10068e20 msgr2=0x7f1d100c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.055+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 shutdown_connections 2023-10-08T00:26:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.055+0000 7f1d15b1d700 1 -- 172.21.15.22:0/2874278241 wait complete. 2023-10-08T00:26:31.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:26:31.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.185+0000 7f476ca90700 1 Processor -- start 2023-10-08T00:26:31.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.186+0000 7f476ca90700 1 -- start start 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.186+0000 7f476ca90700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768069560 0x7f47680699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.186+0000 7f476ca90700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4768069ee0 con 0x7f4768159890 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.186+0000 7f476ca90700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476815a160 con 0x7f4768159c60 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.186+0000 7f476ca90700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680d13a0 con 0x7f4768069560 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4768159890 0x7f476815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51004/0 (socket says 172.21.15.22:51004) 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476659c700 1 -- 172.21.15.22:0/2189602702 learned_addr learned my addr 172.21.15.22:0/2189602702 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:31.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f4766d9d700 1 --2- 172.21.15.22:0/2189602702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768069560 0x7f47680699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773554020 0 0) 0x7f4768069ee0 con 0x7f4768159890 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4754003570 con 0x7f4768159890 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540005499 0 0) 0x7f476815a160 con 0x7f4768159c60 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768069ee0 con 0x7f4768159c60 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663512987 0 0) 0x7f4754003570 con 0x7f4768159890 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f4766d9d700 1 -- 172.21.15.22:0/2189602702 >> v1:172.21.15.192:6789/0 conn(0x7f4768159c60 legacy=0x7f476815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f4766d9d700 1 -- 172.21.15.22:0/2189602702 >> v1:172.21.15.22:6789/0 conn(0x7f4768159890 legacy=0x7f476815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f4766d9d700 1 -- 172.21.15.22:0/2189602702 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476815e140 con 0x7f4768069560 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.187+0000 7f4766d9d700 1 --2- 172.21.15.22:0/2189602702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768069560 0x7f47680699a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4758009e90 tx=0x7f4758009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6fc3283d2ce68d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800e070 con 0x7f4768069560 2023-10-08T00:26:31.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800b870 con 0x7f4768069560 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476559a700 1 -- 172.21.15.22:0/2189602702 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760001470 con 0x7f4768069560 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 -- 172.21.15.22:0/2189602702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768069560 msgr2=0x7f47680699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 --2- 172.21.15.22:0/2189602702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768069560 0x7f47680699a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4758009e90 tx=0x7f4758009780 comp rx=0 tx=0).stop 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 -- 172.21.15.22:0/2189602702 shutdown_connections 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 --2- 172.21.15.22:0/2189602702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768069560 0x7f47680699a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 -- 172.21.15.22:0/2189602702 >> 172.21.15.22:0/2189602702 conn(0x7f4768068e20 msgr2=0x7f47680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 -- 172.21.15.22:0/2189602702 shutdown_connections 2023-10-08T00:26:31.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.188+0000 7f476ca90700 1 -- 172.21.15.22:0/2189602702 wait complete. 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.189+0000 7f476ca90700 1 Processor -- start 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.189+0000 7f476ca90700 1 -- start start 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476ca90700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768069560 0x7f476816a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476ca90700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 0x7f4768153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476ca90700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768159c60 0x7f47680cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476ca90700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476816a600 con 0x7f4768159890 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476ca90700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4768153d70 con 0x7f4768069560 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476ca90700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680cd4d0 con 0x7f4768159c60 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 0x7f4768153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 0x7f4768153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57132/0 (socket says 172.21.15.22:57132) 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 -- 172.21.15.22:0/3414914311 learned_addr learned my addr 172.21.15.22:0/3414914311 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4766d9d700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768159c60 0x7f47680cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f476659c700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768069560 0x7f476816a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 -- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768159c60 msgr2=0x7f47680cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768159c60 0x7f47680cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 -- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768069560 msgr2=0x7f476816a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768069560 0x7f476816a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.190+0000 7f4765d9b700 1 -- 172.21.15.22:0/3414914311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009a20 con 0x7f4768159890 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.191+0000 7f4765d9b700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 0x7f4768153830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f475000c560 tx=0x7f4750007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.191+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750010510 con 0x7f4768159890 2023-10-08T00:26:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.191+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47500106b0 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.191+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47680c9610 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.191+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750010a70 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.191+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47680c9bd0 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.192+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476804c3c0 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.192+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f475001b400 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.193+0000 7f475e7fc700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4748066f30 0x7f47480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.193+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47500841f0 con 0x7f4768159890 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.193+0000 7f476659c700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4748066f30 0x7f47480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.193+0000 7f476659c700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4748066f30 0x7f47480693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4760001660 tx=0x7f4760001940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:31.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.197+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4750051460 con 0x7f4768159890 2023-10-08T00:26:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.434+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f47680cd610 con 0x7f4768159890 2023-10-08T00:26:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.434+0000 7f475e7fc700 1 -- 172.21.15.22:0/3414914311 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4750054a80 con 0x7f4768159890 2023-10-08T00:26:31.435 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4748066f30 msgr2=0x7f47480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4748066f30 0x7f47480693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4760001660 tx=0x7f4760001940 comp rx=0 tx=0).stop 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 msgr2=0x7f4768153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 0x7f4768153830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f475000c560 tx=0x7f4750007de0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 shutdown_connections 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4748066f30 0x7f47480693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4768159c60 0x7f47680cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4768069560 0x7f476816a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 --2- 172.21.15.22:0/3414914311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768159890 0x7f4768153830 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:31.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 >> 172.21.15.22:0/3414914311 conn(0x7f4768068e20 msgr2=0x7f47680c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 shutdown_connections 2023-10-08T00:26:31.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:31.436+0000 7f476ca90700 1 -- 172.21.15.22:0/3414914311 wait complete. 2023-10-08T00:26:31.448 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:26:31.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:26:31.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:26:31.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:26:31.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:26:31.449 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:26:31.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:26:31.449 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:26:31.449 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:26:31.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:31.449 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:26:31.465 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:26:31.465 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:26:31.465 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:26:31.465 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.465 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:26:31.465 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42379sec preferred_lft 42379sec 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.466 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.467 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:31.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:31.468 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:26:31.529 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:26:31.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:31.531 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:26:31.588 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:26:31.589 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:26:31.589 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:26:31.589 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:26:31.589 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:26:31.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:31.589 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:26:31.589 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:26:31.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:26:31.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:26:31.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:26:31.590 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:26:31.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:31.691 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:26:31.706 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:26:31.706 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:26:31.706 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:26:31.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:31.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:26:31.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:26:31.772 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:26:31.827 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:26:31.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:26:31.827 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:26:31.882 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:26:31.882 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:26:31.882 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:31.963 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:31.963 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:26:31.982 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:26:32.004 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:26:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:26:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:26:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:26:32.005 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:26:32.006 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:26:32.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:26:32.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:26:32.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.231+0000 7fec60410700 1 Processor -- start 2023-10-08T00:26:32.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.232+0000 7fec60410700 1 -- start start 2023-10-08T00:26:32.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.232+0000 7fec60410700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec58159890 0x7fec5815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:32.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.232+0000 7fec60410700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec58069560 0x7fec580699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.232+0000 7fec60410700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec58069ee0 con 0x7fec58159c60 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.232+0000 7fec60410700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5815a160 con 0x7fec58159890 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.232+0000 7fec60410700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec580d13a0 con 0x7fec58069560 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e1ac700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec58159890 0x7fec5815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5d9ab700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fec58159c60 0x7fec5815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51014/0 (socket says 172.21.15.22:51014) 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5d9ab700 1 -- 172.21.15.22:0/1054044019 learned_addr learned my addr 172.21.15.22:0/1054044019 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e9ad700 1 --2- 172.21.15.22:0/1054044019 >> v2:172.21.15.192:3300/0 conn(0x7fec58069560 0x7fec580699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e1ac700 1 -- 172.21.15.22:0/1054044019 >> v2:172.21.15.192:3300/0 conn(0x7fec58069560 msgr2=0x7fec580699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e1ac700 1 --2- 172.21.15.22:0/1054044019 >> v2:172.21.15.192:3300/0 conn(0x7fec58069560 0x7fec580699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e1ac700 1 -- 172.21.15.22:0/1054044019 >> v1:172.21.15.22:6789/0 conn(0x7fec58159c60 legacy=0x7fec5815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5d1aa700 1 -- 172.21.15.22:0/1054044019 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639684289 0 0) 0x7fec58069ee0 con 0x7fec58159c60 2023-10-08T00:26:32.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e1ac700 1 -- 172.21.15.22:0/1054044019 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5815e140 con 0x7fec58159890 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5e1ac700 1 --2- 172.21.15.22:0/1054044019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159890 0x7fec5815abd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fec5806a890 tx=0x7fec48009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a64074dd0a97075 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5d1aa700 1 -- 172.21.15.22:0/1054044019 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800e070 con 0x7fec58159890 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5d1aa700 1 -- 172.21.15.22:0/1054044019 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800bc30 con 0x7fec58159890 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.233+0000 7fec5d1aa700 1 -- 172.21.15.22:0/1054044019 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48012430 con 0x7fec58159890 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 -- 172.21.15.22:0/1054044019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159890 msgr2=0x7fec5815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 --2- 172.21.15.22:0/1054044019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159890 0x7fec5815abd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fec5806a890 tx=0x7fec48009780 comp rx=0 tx=0).stop 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 -- 172.21.15.22:0/1054044019 shutdown_connections 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 --2- 172.21.15.22:0/1054044019 >> v2:172.21.15.192:3300/0 conn(0x7fec58069560 0x7fec580699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 --2- 172.21.15.22:0/1054044019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159890 0x7fec5815abd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 -- 172.21.15.22:0/1054044019 >> 172.21.15.22:0/1054044019 conn(0x7fec58068e20 msgr2=0x7fec580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:32.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 -- 172.21.15.22:0/1054044019 shutdown_connections 2023-10-08T00:26:32.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.234+0000 7fec60410700 1 -- 172.21.15.22:0/1054044019 wait complete. 2023-10-08T00:26:32.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.235+0000 7fec60410700 1 Processor -- start 2023-10-08T00:26:32.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.235+0000 7fec60410700 1 -- start start 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec58069560 0x7fec58153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec58159890 0x7fec580b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 0x7fec58157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58155c90 con 0x7fec58159c60 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58156810 con 0x7fec58159890 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec58154430 con 0x7fec58069560 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 0x7fec58157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 0x7fec58157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57158/0 (socket says 172.21.15.22:57158) 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 -- 172.21.15.22:0/2304318848 learned_addr learned my addr 172.21.15.22:0/2304318848 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:32.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5d9ab700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec58159890 0x7fec580b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e1ac700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec58069560 0x7fec58153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 -- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec58069560 msgr2=0x7fec58153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec58069560 0x7fec58153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 -- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec58159890 msgr2=0x7fec580b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec58159890 0x7fec580b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 -- 172.21.15.22:0/2304318848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec48009a20 con 0x7fec58159c60 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec5e9ad700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 0x7fec58157b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d890 tx=0x7fec50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec500125f0 con 0x7fec58159c60 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50012770 con 0x7fec58159c60 2023-10-08T00:26:32.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.236+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec58155ee0 con 0x7fec58159c60 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.237+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec50012b30 con 0x7fec58159c60 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.237+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec581564a0 con 0x7fec58159c60 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.238+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58156980 con 0x7fec58159c60 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.238+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec5001e460 con 0x7fec58159c60 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.238+0000 7fec567fc700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec44066f30 0x7fec440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.239+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec50084cc0 con 0x7fec58159c60 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.239+0000 7fec5e1ac700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec44066f30 0x7fec440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:32.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.239+0000 7fec5e1ac700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec44066f30 0x7fec440693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec5806a890 tx=0x7fec48019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:32.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.243+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec50051f30 con 0x7fec58159c60 2023-10-08T00:26:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.483+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fec5804c3c0 con 0x7fec58159c60 2023-10-08T00:26:32.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.483+0000 7fec567fc700 1 -- 172.21.15.22:0/2304318848 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fec50055550 con 0x7fec58159c60 2023-10-08T00:26:32.484 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:26:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.485+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec44066f30 msgr2=0x7fec440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.485+0000 7fec60410700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec44066f30 0x7fec440693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec5806a890 tx=0x7fec48019000 comp rx=0 tx=0).stop 2023-10-08T00:26:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.485+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 msgr2=0x7fec58157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.485+0000 7fec60410700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 0x7fec58157b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d890 tx=0x7fec50008040 comp rx=0 tx=0).stop 2023-10-08T00:26:32.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.485+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 shutdown_connections 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec58159c60 0x7fec58157b60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec44066f30 0x7fec440693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec58069560 0x7fec58153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 --2- 172.21.15.22:0/2304318848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec58159890 0x7fec580b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 >> 172.21.15.22:0/2304318848 conn(0x7fec58068e20 msgr2=0x7fec580b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 shutdown_connections 2023-10-08T00:26:32.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:32.486+0000 7fec60410700 1 -- 172.21.15.22:0/2304318848 wait complete. 2023-10-08T00:26:32.498 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:26:32.498 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:26:32.498 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:26:32.498 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:26:32.499 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:26:32.499 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:26:32.499 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:26:32.499 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:26:32.499 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:26:32.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.499 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:26:32.518 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:26:32.518 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:26:32.518 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:26:32.518 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.518 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:32.519 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42382sec preferred_lft 42382sec 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:26:32.520 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:26:32.521 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.521 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:26:32.521 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:26:32.521 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:26:32.521 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:26:32.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.521 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:26:32.585 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:26:32.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.586 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:26:32.644 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:26:32.645 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:26:32.645 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:26:32.645 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:26:32.645 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:26:32.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.645 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:26:32.646 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:26:32.646 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:26:32.646 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:26:32.646 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:26:32.646 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:26:32.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.751 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:26:32.767 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:26:32.767 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:26:32.767 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:26:32.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:32.767 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:26:32.832 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:26:32.832 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:26:32.888 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:26:32.888 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:26:32.888 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:26:32.942 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:26:32.943 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:26:32.943 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:33.023 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:33.023 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:26:33.042 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:26:33.043 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:26:33.066 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:26:33.066 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:26:33.066 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:26:33.066 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:26:33.067 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:26:33.068 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:26:33.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:33.069 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:26:33.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:26:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.263+0000 7ff93aec5700 1 Processor -- start 2023-10-08T00:26:33.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 -- start start 2023-10-08T00:26:33.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff934155360 0x7ff9340b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9340b40f0 0x7ff9340ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340ceb60 0x7ff93406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9340b4590 con 0x7ff9340b40f0 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93415c320 con 0x7ff934155360 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.264+0000 7ff93aec5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9340cefc0 con 0x7ff9340ceb60 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9340b40f0 0x7ff9340ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9340b40f0 0x7ff9340ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57170/0 (socket says 172.21.15.22:57170) 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 -- 172.21.15.22:0/3719721529 learned_addr learned my addr 172.21.15.22:0/3719721529 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff938c61700 1 --2- 172.21.15.22:0/3719721529 >> v2:172.21.15.192:3300/0 conn(0x7ff934155360 0x7ff9340b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 -- 172.21.15.22:0/3719721529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340ceb60 msgr2=0x7ff93406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 --2- 172.21.15.22:0/3719721529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340ceb60 0x7ff93406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 -- 172.21.15.22:0/3719721529 >> v2:172.21.15.192:3300/0 conn(0x7ff934155360 msgr2=0x7ff9340b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 --2- 172.21.15.22:0/3719721529 >> v2:172.21.15.192:3300/0 conn(0x7ff934155360 0x7ff9340b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 -- 172.21.15.22:0/3719721529 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93415b710 con 0x7ff9340b40f0 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff933fff700 1 --2- 172.21.15.22:0/3719721529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9340b40f0 0x7ff9340ce620 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff934070e00 tx=0x7ff928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0da3a4ccaee0a73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff9337fe700 1 -- 172.21.15.22:0/3719721529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800b860 con 0x7ff9340b40f0 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff9337fe700 1 -- 172.21.15.22:0/3719721529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92800b9c0 con 0x7ff9340b40f0 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.265+0000 7ff9337fe700 1 -- 172.21.15.22:0/3719721529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92800bd60 con 0x7ff9340b40f0 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 -- 172.21.15.22:0/3719721529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9340b40f0 msgr2=0x7ff9340ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 --2- 172.21.15.22:0/3719721529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9340b40f0 0x7ff9340ce620 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff934070e00 tx=0x7ff928009250 comp rx=0 tx=0).stop 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 -- 172.21.15.22:0/3719721529 shutdown_connections 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 --2- 172.21.15.22:0/3719721529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340ceb60 0x7ff93406d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 --2- 172.21.15.22:0/3719721529 >> v2:172.21.15.192:3300/0 conn(0x7ff934155360 0x7ff9340b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 --2- 172.21.15.22:0/3719721529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9340b40f0 0x7ff9340ce620 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 -- 172.21.15.22:0/3719721529 >> 172.21.15.22:0/3719721529 conn(0x7ff93406baf0 msgr2=0x7ff93406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:33.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 -- 172.21.15.22:0/3719721529 shutdown_connections 2023-10-08T00:26:33.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.266+0000 7ff93aec5700 1 -- 172.21.15.22:0/3719721529 wait complete. 2023-10-08T00:26:33.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.267+0000 7ff93aec5700 1 Processor -- start 2023-10-08T00:26:33.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.267+0000 7ff93aec5700 1 -- start start 2023-10-08T00:26:33.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff93aec5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340b40f0 0x7ff9341411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff93aec5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340ceb60 0x7ff934141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff93aec5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 0x7ff93406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff93aec5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff934143080 con 0x7ff934155360 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff93aec5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff934142470 con 0x7ff9340ceb60 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff93aec5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff934142750 con 0x7ff9340b40f0 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 0x7ff93406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 0x7ff93406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57178/0 (socket says 172.21.15.22:57178) 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff933fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340ceb60 0x7ff934141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff938c61700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340b40f0 0x7ff9341411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 -- 172.21.15.22:0/2376425543 learned_addr learned my addr 172.21.15.22:0/2376425543 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 -- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340b40f0 msgr2=0x7ff9341411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340b40f0 0x7ff9341411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 -- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340ceb60 msgr2=0x7ff934141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340ceb60 0x7ff934141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff939462700 1 -- 172.21.15.22:0/2376425543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280094f0 con 0x7ff934155360 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.268+0000 7ff933fff700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340ceb60 0x7ff934141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.269+0000 7ff939462700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 0x7ff93406d130 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00bc30 tx=0x7ff92c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.269+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0092e0 con 0x7ff934155360 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.269+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c00c630 con 0x7ff934155360 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.269+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff934142a30 con 0x7ff934155360 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.269+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c00ca10 con 0x7ff934155360 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.269+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff934141730 con 0x7ff934155360 2023-10-08T00:26:33.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.270+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9340caf40 con 0x7ff934155360 2023-10-08T00:26:33.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.270+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff92c012070 con 0x7ff934155360 2023-10-08T00:26:33.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.271+0000 7ff930ff9700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff920066f30 0x7ff9200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.271+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff92c084020 con 0x7ff934155360 2023-10-08T00:26:33.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.271+0000 7ff938c61700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff920066f30 0x7ff9200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.271+0000 7ff938c61700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff920066f30 0x7ff9200693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff924006fd0 tx=0x7ff924008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:33.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.275+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff92c051290 con 0x7ff934155360 2023-10-08T00:26:33.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.514+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9340718b0 con 0x7ff934155360 2023-10-08T00:26:33.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.632+0000 7ff930ff9700 1 -- 172.21.15.22:0/2376425543 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff92c0548b0 con 0x7ff934155360 2023-10-08T00:26:33.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff920066f30 msgr2=0x7ff9200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff920066f30 0x7ff9200693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff924006fd0 tx=0x7ff924008040 comp rx=0 tx=0).stop 2023-10-08T00:26:33.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 msgr2=0x7ff93406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 0x7ff93406d130 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00bc30 tx=0x7ff92c009840 comp rx=0 tx=0).stop 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 shutdown_connections 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff934155360 0x7ff93406d130 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff920066f30 0x7ff9200693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9340b40f0 0x7ff9341411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.635+0000 7ff93aec5700 1 --2- 172.21.15.22:0/2376425543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9340ceb60 0x7ff934141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.636+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 >> 172.21.15.22:0/2376425543 conn(0x7ff93406baf0 msgr2=0x7ff9340b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.636+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 shutdown_connections 2023-10-08T00:26:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.636+0000 7ff93aec5700 1 -- 172.21.15.22:0/2376425543 wait complete. 2023-10-08T00:26:33.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:26:33.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.768+0000 7fa29812f700 1 Processor -- start 2023-10-08T00:26:33.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.768+0000 7fa29812f700 1 -- start start 2023-10-08T00:26:33.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.768+0000 7fa29812f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2900caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa29812f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa29015df50 0x7fa29015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa29812f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29015d7e0 con 0x7fa29006c0a0 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa29812f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29015dac0 con 0x7fa29015df50 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa29812f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29015aa30 con 0x7fa29006bcd0 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa29015df50 0x7fa29015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa29015df50 0x7fa29015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57194/0 (socket says 172.21.15.22:57194) 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 -- 172.21.15.22:0/1935494004 learned_addr learned my addr 172.21.15.22:0/1935494004 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa295ecb700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2900caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 -- 172.21.15.22:0/1935494004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 msgr2=0x7fa2900caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:33.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2900caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 -- 172.21.15.22:0/1935494004 >> v1:172.21.15.192:6789/0 conn(0x7fa29006c0a0 legacy=0x7fa29015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 -- 172.21.15.22:0/1935494004 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29015ad10 con 0x7fa29015df50 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa295ecb700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2900caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa2966cc700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29015df50 0x7fa29015e3b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa2880099b0 tx=0x7fa288009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77709ddf2794425 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa294ec9700 1 -- 172.21.15.22:0/1935494004 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800b860 con 0x7fa29015df50 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa294ec9700 1 -- 172.21.15.22:0/1935494004 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800b9c0 con 0x7fa29015df50 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.769+0000 7fa294ec9700 1 -- 172.21.15.22:0/1935494004 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800bd80 con 0x7fa29015df50 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 -- 172.21.15.22:0/1935494004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29015df50 msgr2=0x7fa29015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29015df50 0x7fa29015e3b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa2880099b0 tx=0x7fa288009250 comp rx=0 tx=0).stop 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 -- 172.21.15.22:0/1935494004 shutdown_connections 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29015df50 0x7fa29015e3b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 --2- 172.21.15.22:0/1935494004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2900caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 -- 172.21.15.22:0/1935494004 >> 172.21.15.22:0/1935494004 conn(0x7fa2900ce600 msgr2=0x7fa2900cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:33.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 -- 172.21.15.22:0/1935494004 shutdown_connections 2023-10-08T00:26:33.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.770+0000 7fa29812f700 1 -- 172.21.15.22:0/1935494004 wait complete. 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.771+0000 7fa29812f700 1 Processor -- start 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.771+0000 7fa29812f700 1 -- start start 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa29812f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2901509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa29812f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 0x7fa290156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa29812f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa29015df50 0x7fa2900c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa29812f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa290155a30 con 0x7fa29006c0a0 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa29812f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c6fe0 con 0x7fa29015df50 2023-10-08T00:26:33.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa29812f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa290158bd0 con 0x7fa29006bcd0 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 0x7fa290156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 0x7fa290156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57208/0 (socket says 172.21.15.22:57208) 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 -- 172.21.15.22:0/2601087237 learned_addr learned my addr 172.21.15.22:0/2601087237 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa295ecb700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2901509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2966cc700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa29015df50 0x7fa2900c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 -- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 msgr2=0x7fa2901509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2901509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 -- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa29015df50 msgr2=0x7fa2900c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa29015df50 0x7fa2900c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 -- 172.21.15.22:0/2601087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880094f0 con 0x7fa29006c0a0 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.772+0000 7fa2956ca700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 0x7fa290156020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c4e0 tx=0x7fa28400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:33.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.773+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284011590 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.773+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa284011710 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.773+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa290158eb0 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.773+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284011ad0 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.773+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900c6c70 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.774+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2900c7190 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.774+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa28401b3b0 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.775+0000 7fa28dffb700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa27c066f30 0x7fa27c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.775+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa284083960 con 0x7fa29006c0a0 2023-10-08T00:26:33.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.775+0000 7fa295ecb700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa27c066f30 0x7fa27c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:33.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.775+0000 7fa295ecb700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa27c066f30 0x7fa27c0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa2800076a0 tx=0x7fa280009930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:33.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.779+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2900c7190 con 0x7fa29006c0a0 2023-10-08T00:26:33.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:33.999+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2900c7150 con 0x7fa27c066f30 2023-10-08T00:26:34.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.001+0000 7fa28dffb700 1 -- 172.21.15.22:0/2601087237 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa2900c7150 con 0x7fa27c066f30 2023-10-08T00:26:34.001 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:26:34.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:34.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:26:34.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:34.002 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:26:34.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa27c066f30 msgr2=0x7fa27c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa27c066f30 0x7fa27c0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa2800076a0 tx=0x7fa280009930 comp rx=0 tx=0).stop 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 msgr2=0x7fa290156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 0x7fa290156020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa28400c4e0 tx=0x7fa28400c7f0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 shutdown_connections 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa29015df50 0x7fa2900c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa27c066f30 0x7fa27c0693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa29006bcd0 0x7fa2901509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 --2- 172.21.15.22:0/2601087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa29006c0a0 0x7fa290156020 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 >> 172.21.15.22:0/2601087237 conn(0x7fa2900ce600 msgr2=0x7fa29006a500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:34.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 shutdown_connections 2023-10-08T00:26:34.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.003+0000 7fa29812f700 1 -- 172.21.15.22:0/2601087237 wait complete. 2023-10-08T00:26:34.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:26:34.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 Processor -- start 2023-10-08T00:26:34.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 -- start start 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22f8159c10 0x7f22f815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 0x7f22f8068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f815c480 con 0x7f22f8068bb0 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f80b2a40 con 0x7f22f8159c10 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.137+0000 7f22feb97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f815b5d0 con 0x7f22f80b5ea0 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 0x7f22f8068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22fc933700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22f8159c10 0x7f22f815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 0x7f22f8068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:33434/0 (socket says 172.21.15.22:33434) 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 -- 172.21.15.22:0/540781642 learned_addr learned my addr 172.21.15.22:0/540781642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22fd134700 1 --1- 172.21.15.22:0/540781642 >> v1:172.21.15.192:6789/0 conn(0x7f22f8068bb0 0x7f22f815c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:38444/0 (socket says 172.21.15.22:38444) 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 -- 172.21.15.22:0/540781642 >> v2:172.21.15.192:3300/0 conn(0x7f22f8159c10 msgr2=0x7f22f815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 --2- 172.21.15.22:0/540781642 >> v2:172.21.15.192:3300/0 conn(0x7f22f8159c10 0x7f22f815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 -- 172.21.15.22:0/540781642 >> v1:172.21.15.192:6789/0 conn(0x7f22f8068bb0 legacy=0x7f22f815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 -- 172.21.15.22:0/540781642 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f815b870 con 0x7f22f80b5ea0 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.138+0000 7f22f7fff700 1 --2- 172.21.15.22:0/540781642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 0x7f22f8068670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009f20 tx=0x7f22e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ad511dca9d3a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22f77fe700 1 -- 172.21.15.22:0/540781642 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800e070 con 0x7f22f80b5ea0 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22f77fe700 1 -- 172.21.15.22:0/540781642 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e800b9d0 con 0x7f22f80b5ea0 2023-10-08T00:26:34.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22f77fe700 1 -- 172.21.15.22:0/540781642 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80092e0 con 0x7f22f80b5ea0 2023-10-08T00:26:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 -- 172.21.15.22:0/540781642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 msgr2=0x7f22f8068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 --2- 172.21.15.22:0/540781642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 0x7f22f8068670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009f20 tx=0x7f22e8009840 comp rx=0 tx=0).stop 2023-10-08T00:26:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 -- 172.21.15.22:0/540781642 shutdown_connections 2023-10-08T00:26:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 --2- 172.21.15.22:0/540781642 >> v2:172.21.15.192:3300/0 conn(0x7f22f8159c10 0x7f22f815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 --2- 172.21.15.22:0/540781642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f80b5ea0 0x7f22f8068670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 -- 172.21.15.22:0/540781642 >> 172.21.15.22:0/540781642 conn(0x7f22f8099a20 msgr2=0x7f22f80af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 -- 172.21.15.22:0/540781642 shutdown_connections 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.139+0000 7f22feb97700 1 -- 172.21.15.22:0/540781642 wait complete. 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.140+0000 7f22feb97700 1 Processor -- start 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.140+0000 7f22feb97700 1 -- start start 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22feb97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f8068bb0 0x7f22f81677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22feb97700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22f80b5ea0 0x7f22f816a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22feb97700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 0x7f22f8169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22feb97700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c90c0 con 0x7f22f8159c10 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22feb97700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f816ab60 con 0x7f22f80b5ea0 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22feb97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f816b200 con 0x7f22f8068bb0 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22fd134700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 0x7f22f8169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22fd134700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 0x7f22f8169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57224/0 (socket says 172.21.15.22:57224) 2023-10-08T00:26:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22fd134700 1 -- 172.21.15.22:0/2413523226 learned_addr learned my addr 172.21.15.22:0/2413523226 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22f7fff700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22f80b5ea0 0x7f22f816a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.141+0000 7f22fc933700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f8068bb0 0x7f22f81677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22fd134700 1 -- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f8068bb0 msgr2=0x7f22f81677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22fd134700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f8068bb0 0x7f22f81677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22fd134700 1 -- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22f80b5ea0 msgr2=0x7f22f816a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22fd134700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22f80b5ea0 0x7f22f816a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22fd134700 1 -- 172.21.15.22:0/2413523226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009ae0 con 0x7f22f8159c10 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22f7fff700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22f80b5ea0 0x7f22f816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22fd134700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 0x7f22f8169490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c590 tx=0x7f22e0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0005a70 con 0x7f22f8159c10 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0005bf0 con 0x7f22f8159c10 2023-10-08T00:26:34.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00070d0 con 0x7f22f8159c10 2023-10-08T00:26:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f816b4e0 con 0x7f22f8159c10 2023-10-08T00:26:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.142+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f816baa0 con 0x7f22f8159c10 2023-10-08T00:26:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.143+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f804c3c0 con 0x7f22f8159c10 2023-10-08T00:26:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.144+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22e00074c0 con 0x7f22f8159c10 2023-10-08T00:26:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.144+0000 7f22f4ff9700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22d8066f30 0x7f22d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.144+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22e0083860 con 0x7f22f8159c10 2023-10-08T00:26:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.144+0000 7f22fc933700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22d8066f30 0x7f22d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.145+0000 7f22fc933700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22d8066f30 0x7f22d80693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009cf0 tx=0x7f22f00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.148+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22e0050ad0 con 0x7f22f8159c10 2023-10-08T00:26:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.343+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f22f815bb50 con 0x7f22f8159c10 2023-10-08T00:26:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.343+0000 7f22f4ff9700 1 -- 172.21.15.22:0/2413523226 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22e0017020 con 0x7f22f8159c10 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22d8066f30 msgr2=0x7f22d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22d8066f30 0x7f22d80693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009cf0 tx=0x7f22f00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 msgr2=0x7f22f8169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 0x7f22f8169490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f22e000c590 tx=0x7f22e0007ef0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 shutdown_connections 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22f8159c10 0x7f22f8169490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22d8066f30 0x7f22d80693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f22f8068bb0 0x7f22f81677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 --2- 172.21.15.22:0/2413523226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22f80b5ea0 0x7f22f816a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 >> 172.21.15.22:0/2413523226 conn(0x7f22f8099a20 msgr2=0x7f22f809a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 shutdown_connections 2023-10-08T00:26:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.345+0000 7f22feb97700 1 -- 172.21.15.22:0/2413523226 wait complete. 2023-10-08T00:26:34.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000509384 2023-10-08T00:26:34.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.479+0000 7f89b0e82700 1 Processor -- start 2023-10-08T00:26:34.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.479+0000 7f89b0e82700 1 -- start start 2023-10-08T00:26:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.480+0000 7f89b0e82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.480+0000 7f89b0e82700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f89ac06c0a0 0x7f89ac15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.480+0000 7f89b0e82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f89ac15df50 0x7f89ac15e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.480+0000 7f89b0e82700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac15d7e0 con 0x7f89ac06c0a0 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.480+0000 7f89b0e82700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac15dac0 con 0x7f89ac15df50 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.480+0000 7f89b0e82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15aa30 con 0x7f89ac06bcd0 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f89ac06c0a0 0x7f89ac15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f89ac06c0a0 0x7f89ac15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57238/0 (socket says 172.21.15.22:57238) 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 -- 172.21.15.22:0/1312989381 learned_addr learned my addr 172.21.15.22:0/1312989381 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89aad9d700 1 --2- 172.21.15.22:0/1312989381 >> v2:172.21.15.192:3300/0 conn(0x7f89ac15df50 0x7f89ac15e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89aa59c700 1 --2- 172.21.15.22:0/1312989381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 -- 172.21.15.22:0/1312989381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 msgr2=0x7f89ac0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 --2- 172.21.15.22:0/1312989381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 -- 172.21.15.22:0/1312989381 >> v2:172.21.15.192:3300/0 conn(0x7f89ac15df50 msgr2=0x7f89ac15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 --2- 172.21.15.22:0/1312989381 >> v2:172.21.15.192:3300/0 conn(0x7f89ac15df50 0x7f89ac15e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 -- 172.21.15.22:0/1312989381 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac15ad10 con 0x7f89ac06c0a0 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a9d9b700 1 --2- 172.21.15.22:0/1312989381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac06c0a0 0x7f89ac15a1e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f89ac06b620 tx=0x7f8994009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967a930838ae3fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a959a700 1 -- 172.21.15.22:0/1312989381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400b860 con 0x7f89ac06c0a0 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a959a700 1 -- 172.21.15.22:0/1312989381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400b9c0 con 0x7f89ac06c0a0 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.481+0000 7f89a959a700 1 -- 172.21.15.22:0/1312989381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400bd80 con 0x7f89ac06c0a0 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 -- 172.21.15.22:0/1312989381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac06c0a0 msgr2=0x7f89ac15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 --2- 172.21.15.22:0/1312989381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac06c0a0 0x7f89ac15a1e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f89ac06b620 tx=0x7f8994009250 comp rx=0 tx=0).stop 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 -- 172.21.15.22:0/1312989381 shutdown_connections 2023-10-08T00:26:34.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 --2- 172.21.15.22:0/1312989381 >> v2:172.21.15.192:3300/0 conn(0x7f89ac15df50 0x7f89ac15e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 --2- 172.21.15.22:0/1312989381 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 --2- 172.21.15.22:0/1312989381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac06c0a0 0x7f89ac15a1e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 -- 172.21.15.22:0/1312989381 >> 172.21.15.22:0/1312989381 conn(0x7f89ac0ce600 msgr2=0x7f89ac0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 -- 172.21.15.22:0/1312989381 shutdown_connections 2023-10-08T00:26:34.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.482+0000 7f89b0e82700 1 -- 172.21.15.22:0/1312989381 wait complete. 2023-10-08T00:26:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.483+0000 7f89b0e82700 1 Processor -- start 2023-10-08T00:26:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.483+0000 7f89b0e82700 1 -- start start 2023-10-08T00:26:34.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89b0e82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89b0e82700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89ac06c0a0 0x7f89ac0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89b0e82700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 0x7f89ac0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89b0e82700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac16a430 con 0x7f89ac15df50 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89b0e82700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac16a130 con 0x7f89ac06c0a0 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89b0e82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0c9490 con 0x7f89ac06bcd0 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 0x7f89ac0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 0x7f89ac0c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57254/0 (socket says 172.21.15.22:57254) 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 -- 172.21.15.22:0/2664110243 learned_addr learned my addr 172.21.15.22:0/2664110243 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89a9d9b700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89ac06c0a0 0x7f89ac0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aa59c700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 -- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 msgr2=0x7f89ac0b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 -- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89ac06c0a0 msgr2=0x7f89ac0c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89ac06c0a0 0x7f89ac0c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 -- 172.21.15.22:0/2664110243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940094f0 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89a9d9b700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89ac06c0a0 0x7f89ac0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.484+0000 7f89aad9d700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 0x7f89ac0c7570 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f89a400d8c0 tx=0x7f89a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.485+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400b5d0 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.485+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400b750 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.485+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac0c7ab0 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.485+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400bb10 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.485+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac0c9a10 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.486+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac16a5a0 con 0x7f89ac15df50 2023-10-08T00:26:34.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.486+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89a401e460 con 0x7f89ac15df50 2023-10-08T00:26:34.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.487+0000 7f89a27fc700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f898c066f30 0x7f898c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.487+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89a4084b70 con 0x7f89ac15df50 2023-10-08T00:26:34.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.487+0000 7f89aa59c700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f898c066f30 0x7f898c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.487+0000 7f89aa59c700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f898c066f30 0x7f898c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f899c00e420 tx=0x7f899c0075e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.491+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89a4051de0 con 0x7f89ac15df50 2023-10-08T00:26:34.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.712+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000509384", "target": ["mon-mgr", ""]}) v1 -- 0x7f89ac15aff0 con 0x7f898c066f30 2023-10-08T00:26:34.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:26:34.717+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:26:34.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:26:34.717+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:26:34.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:26:34.717+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:26:34.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:26:34.717+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:26:34.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:26:34.717+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:26:34.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.731+0000 7f89a27fc700 1 -- 172.21.15.22:0/2664110243 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f89ac15aff0 con 0x7f898c066f30 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f898c066f30 msgr2=0x7f898c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f898c066f30 0x7f898c0693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f899c00e420 tx=0x7f899c0075e0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 msgr2=0x7f89ac0c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 0x7f89ac0c7570 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f89a400d8c0 tx=0x7f89a4008040 comp rx=0 tx=0).stop 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 shutdown_connections 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f89ac15df50 0x7f89ac0c7570 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f898c066f30 0x7f898c0693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f89ac06bcd0 0x7f89ac0b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 --2- 172.21.15.22:0/2664110243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89ac06c0a0 0x7f89ac0c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 >> 172.21.15.22:0/2664110243 conn(0x7f89ac0ce600 msgr2=0x7f89ac156590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 shutdown_connections 2023-10-08T00:26:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.733+0000 7f89b0e82700 1 -- 172.21.15.22:0/2664110243 wait complete. 2023-10-08T00:26:34.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-08T00:26:34.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.867+0000 7fe103af4700 1 Processor -- start 2023-10-08T00:26:34.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.868+0000 7fe103af4700 1 -- start start 2023-10-08T00:26:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe103af4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0fc0b5ea0 0x7fe0fc068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe103af4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc068bb0 0x7fe0fc15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe103af4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc15c480 con 0x7fe0fc159c10 2023-10-08T00:26:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe103af4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b2a40 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe103af4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc15b870 con 0x7fe0fc068bb0 2023-10-08T00:26:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe102091700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc068bb0 0x7fe0fc15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0fc0b5ea0 0x7fe0fc068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe101890700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe0fc159c10 0x7fe0fc15b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:38452/0 (socket says 172.21.15.22:38452) 2023-10-08T00:26:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe101890700 1 -- 172.21.15.22:0/302266171 learned_addr learned my addr 172.21.15.22:0/302266171 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:34.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0fc0b5ea0 0x7fe0fc068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:44354/0 (socket says 172.21.15.22:44354) 2023-10-08T00:26:34.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 -- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc068bb0 msgr2=0x7fe0fc15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 --2- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc068bb0 0x7fe0fc15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 -- 172.21.15.22:0/302266171 >> v1:172.21.15.192:6789/0 conn(0x7fe0fc159c10 legacy=0x7fe0fc15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 -- 172.21.15.22:0/302266171 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc15bb50 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe102091700 1 --2- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc068bb0 0x7fe0fc15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.869+0000 7fe10108f700 1 --2- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc068670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00098e0 tx=0x7fe0f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c11d321843161983 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe10088e700 1 -- 172.21.15.22:0/302266171 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000b640 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe10088e700 1 -- 172.21.15.22:0/302266171 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f000b7a0 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe10088e700 1 -- 172.21.15.22:0/302266171 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000bb40 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 -- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc0b5ea0 msgr2=0x7fe0fc068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 --2- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc068670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00098e0 tx=0x7fe0f00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 -- 172.21.15.22:0/302266171 shutdown_connections 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 --2- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc068bb0 0x7fe0fc15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 --2- 172.21.15.22:0/302266171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc068670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 -- 172.21.15.22:0/302266171 >> 172.21.15.22:0/302266171 conn(0x7fe0fc099a20 msgr2=0x7fe0fc0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 -- 172.21.15.22:0/302266171 shutdown_connections 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.870+0000 7fe103af4700 1 -- 172.21.15.22:0/302266171 wait complete. 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.871+0000 7fe103af4700 1 Processor -- start 2023-10-08T00:26:34.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.871+0000 7fe103af4700 1 -- start start 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe103af4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc068bb0 0x7fe0fc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe103af4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc0b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe103af4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc159c10 0x7fe0fc144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe103af4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b0f50 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe103af4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b1920 con 0x7fe0fc068bb0 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe103af4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b0340 con 0x7fe0fc159c10 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe10108f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc0b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe10108f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc0b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57268/0 (socket says 172.21.15.22:57268) 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe10108f700 1 -- 172.21.15.22:0/3804285951 learned_addr learned my addr 172.21.15.22:0/3804285951 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe101890700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc068bb0 0x7fe0fc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.872+0000 7fe102091700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc159c10 0x7fe0fc144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe10108f700 1 -- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc159c10 msgr2=0x7fe0fc144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe10108f700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc159c10 0x7fe0fc144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe10108f700 1 -- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc068bb0 msgr2=0x7fe0fc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe10108f700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc068bb0 0x7fe0fc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe10108f700 1 -- 172.21.15.22:0/3804285951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f4009420 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe10108f700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc0b13e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc063db0 tx=0x7fe0f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f001bcf0 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f001be70 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f0009420 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0011650 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.873+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0b0900 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.874+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc0b10c0 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.875+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0f0011a00 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.875+0000 7fe0f9ffb700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0e8066f30 0x7fe0e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:34.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.875+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0f0085ae0 con 0x7fe0fc0b5ea0 2023-10-08T00:26:34.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.875+0000 7fe101890700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0e8066f30 0x7fe0e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:34.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.876+0000 7fe101890700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0e8066f30 0x7fe0e80693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00f380 tx=0x7fe0ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:34.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:34.879+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0f0052e10 con 0x7fe0fc0b5ea0 2023-10-08T00:26:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.102+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0fc04c3c0 con 0x7fe0e8066f30 2023-10-08T00:26:35.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.106+0000 7fe0f9ffb700 1 -- 172.21.15.22:0/3804285951 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+530 (secure 0 0 0) 0x7fe0fc04c3c0 con 0x7fe0e8066f30 2023-10-08T00:26:35.106 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:26:35.106 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_addrs": [ 2023-10-08T00:26:35.106 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6789", 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6789", 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6790" 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "pending_subvolume_deletions": 0, 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": { 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "data": [ 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": 365980286976, 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_data", 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: "used": 0 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:35.107 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": [ 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": 365980286976, 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_metadata", 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: "used": 65536 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout: "used_size": 0 2023-10-08T00:26:35.108 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:26:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0e8066f30 msgr2=0x7fe0e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0e8066f30 0x7fe0e80693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00f380 tx=0x7fe0ec009040 comp rx=0 tx=0).stop 2023-10-08T00:26:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 msgr2=0x7fe0fc0b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc0b13e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc063db0 tx=0x7fe0f0017000 comp rx=0 tx=0).stop 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 shutdown_connections 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe0e8066f30 0x7fe0e80693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0fc159c10 0x7fe0fc144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0fc068bb0 0x7fe0fc0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 --2- 172.21.15.22:0/3804285951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0fc0b5ea0 0x7fe0fc0b13e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 >> 172.21.15.22:0/3804285951 conn(0x7fe0fc099a20 msgr2=0x7fe0fc0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 shutdown_connections 2023-10-08T00:26:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.108+0000 7fe103af4700 1 -- 172.21.15.22:0/3804285951 wait complete. 2023-10-08T00:26:35.120 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:26:35.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:26:35.161 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:26:35.202 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:26:35.203 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:26:35.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:26:35.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:26:35.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:26:35.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:35.246 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:26:35.301 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:26:35.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:26:35.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:26:35.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:26:35.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:26:35.341 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:26:35.397 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.516+0000 7f1cd5f99700 1 Processor -- start 2023-10-08T00:26:35.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.516+0000 7f1cd5f99700 1 -- start start 2023-10-08T00:26:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.516+0000 7f1cd5f99700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cd0069560 0x7f1cd00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.516+0000 7f1cd5f99700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd0069ee0 con 0x7f1cd0159c60 2023-10-08T00:26:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.516+0000 7f1cd5f99700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd015a160 con 0x7f1cd0159890 2023-10-08T00:26:35.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.516+0000 7f1cd5f99700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00d13a0 con 0x7f1cd0069560 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1ccffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cd0069560 0x7f1cd00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1cceffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1cd0159c60 0x7f1cd015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51030/0 (socket says 172.21.15.22:51030) 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1cceffd700 1 -- 172.21.15.22:0/4172386859 learned_addr learned my addr 172.21.15.22:0/4172386859 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1ccffff700 1 -- 172.21.15.22:0/4172386859 >> v1:172.21.15.192:6789/0 conn(0x7f1cd0159890 legacy=0x7f1cd015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1ccffff700 1 -- 172.21.15.22:0/4172386859 >> v1:172.21.15.22:6789/0 conn(0x7f1cd0159c60 legacy=0x7f1cd015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1ccffff700 1 -- 172.21.15.22:0/4172386859 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd015e140 con 0x7f1cd0069560 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1cce7fc700 1 -- 172.21.15.22:0/4172386859 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403058625 0 0) 0x7f1cd0069ee0 con 0x7f1cd0159c60 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1ccffff700 1 --2- 172.21.15.22:0/4172386859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0069560 0x7f1cd00699a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009e60 tx=0x7f1cc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb11c03428804059 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1cce7fc700 1 -- 172.21.15.22:0/4172386859 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800e070 con 0x7f1cd0069560 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1cce7fc700 1 -- 172.21.15.22:0/4172386859 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800bbf0 con 0x7f1cd0069560 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.517+0000 7f1cce7fc700 1 -- 172.21.15.22:0/4172386859 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8012430 con 0x7f1cd0069560 2023-10-08T00:26:35.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 -- 172.21.15.22:0/4172386859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0069560 msgr2=0x7f1cd00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/4172386859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0069560 0x7f1cd00699a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8009e60 tx=0x7f1cc8009780 comp rx=0 tx=0).stop 2023-10-08T00:26:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 -- 172.21.15.22:0/4172386859 shutdown_connections 2023-10-08T00:26:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/4172386859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0069560 0x7f1cd00699a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 -- 172.21.15.22:0/4172386859 >> 172.21.15.22:0/4172386859 conn(0x7f1cd0068e20 msgr2=0x7f1cd00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 -- 172.21.15.22:0/4172386859 shutdown_connections 2023-10-08T00:26:35.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.518+0000 7f1cd5f99700 1 -- 172.21.15.22:0/4172386859 wait complete. 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.519+0000 7f1cd5f99700 1 Processor -- start 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.519+0000 7f1cd5f99700 1 -- start start 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cd5f99700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd0069560 0x7f1cd016af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cd5f99700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 0x7f1cd016dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cd5f99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd0159c60 0x7f1cd0140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cd5f99700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00cffc0 con 0x7f1cd0159890 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cd5f99700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd016ad80 con 0x7f1cd0069560 2023-10-08T00:26:35.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cd5f99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd016e280 con 0x7f1cd0159c60 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 0x7f1cd016dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 0x7f1cd016dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57282/0 (socket says 172.21.15.22:57282) 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 -- 172.21.15.22:0/3339116666 learned_addr learned my addr 172.21.15.22:0/3339116666 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1ccf7fe700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd0069560 0x7f1cd016af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 -- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd0159c60 msgr2=0x7f1cd0140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1ccffff700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd0159c60 0x7f1cd0140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd0159c60 0x7f1cd0140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 -- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd0069560 msgr2=0x7f1cd016af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd0069560 0x7f1cd016af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 -- 172.21.15.22:0/3339116666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc8009a20 con 0x7f1cd0159890 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1ccf7fe700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd0069560 0x7f1cd016af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:35.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1ccffff700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd0159c60 0x7f1cd0140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.520+0000 7f1cceffd700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 0x7f1cd016dd40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c5b0 tx=0x7f1cc4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.521+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4005b30 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.521+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4005c90 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.521+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4007300 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.521+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd016a170 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.521+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd016a730 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.522+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd004c3c0 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.522+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cc401b3b0 con 0x7f1cd0159890 2023-10-08T00:26:35.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.522+0000 7f1cb77fe700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cbc066f30 0x7f1cbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.523+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cc4083a70 con 0x7f1cd0159890 2023-10-08T00:26:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.523+0000 7f1ccf7fe700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cbc066f30 0x7f1cbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.523+0000 7f1ccf7fe700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cbc066f30 0x7f1cbc0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0002880 tx=0x7f1cc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:35.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.527+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cc4050ce0 con 0x7f1cd0159890 2023-10-08T00:26:35.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.645+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1cc40510b0 con 0x7f1cd0159890 2023-10-08T00:26:35.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.766+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd006a5b0 con 0x7f1cd0159890 2023-10-08T00:26:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.766+0000 7f1cb77fe700 1 -- 172.21.15.22:0/3339116666 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f1cc4054770 con 0x7f1cd0159890 2023-10-08T00:26:35.767 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:35.767 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:20.001353+0000","modified":"2023-10-08T00:26:23.607891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/1300992790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1300992790},{"type":"v1","addr":"172.21.15.22:6835","nonce":1300992790}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T00:26:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cbc066f30 msgr2=0x7f1cbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cbc066f30 0x7f1cbc0693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cc0002880 tx=0x7f1cc0009040 comp rx=0 tx=0).stop 2023-10-08T00:26:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 msgr2=0x7f1cd016dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 0x7f1cd016dd40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c5b0 tx=0x7f1cc4001070 comp rx=0 tx=0).stop 2023-10-08T00:26:35.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 shutdown_connections 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1cbc066f30 0x7f1cbc0693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cd0159c60 0x7f1cd0140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cd0069560 0x7f1cd016af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 --2- 172.21.15.22:0/3339116666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cd0159890 0x7f1cd016dd40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 >> 172.21.15.22:0/3339116666 conn(0x7f1cd0068e20 msgr2=0x7f1cd0152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 shutdown_connections 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.768+0000 7f1cd5f99700 1 -- 172.21.15.22:0/3339116666 wait complete. 2023-10-08T00:26:35.770 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2023-10-08T00:26:35.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:35.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.900+0000 7f4da5074700 1 Processor -- start 2023-10-08T00:26:35.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.900+0000 7f4da5074700 1 -- start start 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da5074700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4da015d230 0x7f4da015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da5074700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da00b2980 con 0x7f4da01597f0 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da5074700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da015db70 con 0x7f4da0159420 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da5074700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da00b11d0 con 0x7f4da015d230 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da4873700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4da015d230 0x7f4da015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4d9f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4da01597f0 0x7f4da00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51032/0 (socket says 172.21.15.22:51032) 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4d9f7fe700 1 -- 172.21.15.22:0/2006483040 learned_addr learned my addr 172.21.15.22:0/2006483040 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da4873700 1 -- 172.21.15.22:0/2006483040 >> v1:172.21.15.192:6789/0 conn(0x7f4da0159420 legacy=0x7f4da00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da4873700 1 -- 172.21.15.22:0/2006483040 >> v1:172.21.15.22:6789/0 conn(0x7f4da01597f0 legacy=0x7f4da00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4da4873700 1 -- 172.21.15.22:0/2006483040 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da00b14b0 con 0x7f4da015d230 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.901+0000 7f4d9effd700 1 -- 172.21.15.22:0/2006483040 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021751053 0 0) 0x7f4da00b2980 con 0x7f4da01597f0 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da4873700 1 --2- 172.21.15.22:0/2006483040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da015d630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009e60 tx=0x7f4d98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0cef64b840614c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4d9effd700 1 -- 172.21.15.22:0/2006483040 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800e070 con 0x7f4da015d230 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4d9effd700 1 -- 172.21.15.22:0/2006483040 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9800bc30 con 0x7f4da015d230 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4d9effd700 1 -- 172.21.15.22:0/2006483040 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98012430 con 0x7f4da015d230 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 -- 172.21.15.22:0/2006483040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 msgr2=0x7f4da015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 --2- 172.21.15.22:0/2006483040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da015d630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009e60 tx=0x7f4d98009780 comp rx=0 tx=0).stop 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 -- 172.21.15.22:0/2006483040 shutdown_connections 2023-10-08T00:26:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 --2- 172.21.15.22:0/2006483040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da015d630 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 -- 172.21.15.22:0/2006483040 >> 172.21.15.22:0/2006483040 conn(0x7f4da00d0660 msgr2=0x7f4da00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 -- 172.21.15.22:0/2006483040 shutdown_connections 2023-10-08T00:26:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.902+0000 7f4da5074700 1 -- 172.21.15.22:0/2006483040 wait complete. 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.903+0000 7f4da5074700 1 Processor -- start 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 -- start start 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4da0159420 0x7f4da00c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4da01597f0 0x7f4da015c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da015b600 con 0x7f4da015d230 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da015a9f0 con 0x7f4da0159420 2023-10-08T00:26:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.904+0000 7f4da5074700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da015acd0 con 0x7f4da01597f0 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da0155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57298/0 (socket says 172.21.15.22:57298) 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 -- 172.21.15.22:0/3546040487 learned_addr learned my addr 172.21.15.22:0/3546040487 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4d9ffff700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4da0159420 0x7f4da00c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4d9f7fe700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4da01597f0 0x7f4da015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 -- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4da01597f0 msgr2=0x7f4da015c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4da01597f0 0x7f4da015c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 -- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4da0159420 msgr2=0x7f4da00c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4da0159420 0x7f4da00c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 -- 172.21.15.22:0/3546040487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98009a20 con 0x7f4da015d230 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da4873700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da0155ce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4da0089340 tx=0x7f4d98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98012e50 con 0x7f4da015d230 2023-10-08T00:26:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9801b630 con 0x7f4da015d230 2023-10-08T00:26:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da015afb0 con 0x7f4da015d230 2023-10-08T00:26:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9801ba10 con 0x7f4da015d230 2023-10-08T00:26:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.905+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da015ba90 con 0x7f4da015d230 2023-10-08T00:26:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.906+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da004c3c0 con 0x7f4da015d230 2023-10-08T00:26:35.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.907+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4d9801c400 con 0x7f4da015d230 2023-10-08T00:26:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.907+0000 7f4d87fff700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d8c066fc0 0x7f4d8c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.907+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d980864b0 con 0x7f4da015d230 2023-10-08T00:26:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.907+0000 7f4d9ffff700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d8c066fc0 0x7f4d8c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:35.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.908+0000 7f4d9ffff700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d8c066fc0 0x7f4d8c069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d90003a80 tx=0x7f4d90007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:35.911+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d980536d0 con 0x7f4da015d230 2023-10-08T00:26:36.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.106+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4da015b740 con 0x7f4da015d230 2023-10-08T00:26:36.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.107+0000 7f4d87fff700 1 -- 172.21.15.22:0/3546040487 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f4d98056cf0 con 0x7f4da015d230 2023-10-08T00:26:36.108 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:36.108 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:21.596908+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:18.392931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:18.960391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d8c066fc0 msgr2=0x7f4d8c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d8c066fc0 0x7f4d8c069470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d90003a80 tx=0x7f4d90007ec0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 msgr2=0x7f4da0155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da0155ce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4da0089340 tx=0x7f4d98019000 comp rx=0 tx=0).stop 2023-10-08T00:26:36.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 shutdown_connections 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da015d230 0x7f4da0155ce0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4da0159420 0x7f4da00c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4d8c066fc0 0x7f4d8c069470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 --2- 172.21.15.22:0/3546040487 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4da01597f0 0x7f4da015c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 >> 172.21.15.22:0/3546040487 conn(0x7f4da00d0660 msgr2=0x7f4da00d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 shutdown_connections 2023-10-08T00:26:36.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.109+0000 7f4da5074700 1 -- 172.21.15.22:0/3546040487 wait complete. 2023-10-08T00:26:36.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:26:18.392931+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:26:18.960391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:26:36.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:26:36.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.243+0000 7f55b1e81700 1 Processor -- start 2023-10-08T00:26:36.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.243+0000 7f55b1e81700 1 -- start start 2023-10-08T00:26:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55b1e81700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac069e80 0x7f55ac0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55b1e81700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55ac0b0a70 0x7f55ac0c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55b1e81700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ac0af2f0 con 0x7f55ac15ac80 2023-10-08T00:26:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55b1e81700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0af5d0 con 0x7f55ac0b0a70 2023-10-08T00:26:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55b1e81700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0c8660 con 0x7f55ac069e80 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55abfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55ac0b0a70 0x7f55ac0c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55abfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f55ac0b0a70 0x7f55ac0c70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57312/0 (socket says 172.21.15.22:57312) 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.244+0000 7f55abfff700 1 -- 172.21.15.22:0/3271019865 learned_addr learned my addr 172.21.15.22:0/3271019865 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55aaffd700 1 --2- 172.21.15.22:0/3271019865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac069e80 0x7f55ac0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55abfff700 1 -- 172.21.15.22:0/3271019865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac069e80 msgr2=0x7f55ac0c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55abfff700 1 --2- 172.21.15.22:0/3271019865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac069e80 0x7f55ac0c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55abfff700 1 -- 172.21.15.22:0/3271019865 >> v1:172.21.15.192:6789/0 conn(0x7f55ac15ac80 legacy=0x7f55ac069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55abfff700 1 -- 172.21.15.22:0/3271019865 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0c8940 con 0x7f55ac0b0a70 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55abfff700 1 --2- 172.21.15.22:0/3271019865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac0b0a70 0x7f55ac0c70b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009f20 tx=0x7f55a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92dcd845768476c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55aa7fc700 1 -- 172.21.15.22:0/3271019865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a400e070 con 0x7f55ac0b0a70 2023-10-08T00:26:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55aa7fc700 1 -- 172.21.15.22:0/3271019865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a400b9d0 con 0x7f55ac0b0a70 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.245+0000 7f55aa7fc700 1 -- 172.21.15.22:0/3271019865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a40092e0 con 0x7f55ac0b0a70 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 -- 172.21.15.22:0/3271019865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac0b0a70 msgr2=0x7f55ac0c70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 --2- 172.21.15.22:0/3271019865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac0b0a70 0x7f55ac0c70b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009f20 tx=0x7f55a4009840 comp rx=0 tx=0).stop 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 -- 172.21.15.22:0/3271019865 shutdown_connections 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 --2- 172.21.15.22:0/3271019865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac0b0a70 0x7f55ac0c70b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 --2- 172.21.15.22:0/3271019865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac069e80 0x7f55ac0c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 -- 172.21.15.22:0/3271019865 >> 172.21.15.22:0/3271019865 conn(0x7f55ac068e10 msgr2=0x7f55ac0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 -- 172.21.15.22:0/3271019865 shutdown_connections 2023-10-08T00:26:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.246+0000 7f55b1e81700 1 -- 172.21.15.22:0/3271019865 wait complete. 2023-10-08T00:26:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.247+0000 7f55b1e81700 1 Processor -- start 2023-10-08T00:26:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.247+0000 7f55b1e81700 1 -- start start 2023-10-08T00:26:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 0x7f55ac0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ac0b0a70 0x7f55ac14af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac15ac80 0x7f55ac158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac15b050 con 0x7f55ac069e80 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0cb890 con 0x7f55ac0b0a70 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0ca6c0 con 0x7f55ac15ac80 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 0x7f55ac0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 0x7f55ac0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57314/0 (socket says 172.21.15.22:57314) 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 -- 172.21.15.22:0/1429363527 learned_addr learned my addr 172.21.15.22:0/1429363527 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55aaffd700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ac0b0a70 0x7f55ac14af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55abfff700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac15ac80 0x7f55ac158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 -- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac15ac80 msgr2=0x7f55ac158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac15ac80 0x7f55ac158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 -- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ac0b0a70 msgr2=0x7f55ac14af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ac0b0a70 0x7f55ac14af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 -- 172.21.15.22:0/1429363527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a4009ae0 con 0x7f55ac069e80 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55ab7fe700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 0x7f55ac0cb350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f559c00c4e0 tx=0x7f559c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c011590 con 0x7f55ac069e80 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c011710 con 0x7f55ac069e80 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac0ca9a0 con 0x7f55ac069e80 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.248+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559c011ad0 con 0x7f55ac069e80 2023-10-08T00:26:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.249+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac0caf60 con 0x7f55ac069e80 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.249+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac04c3c0 con 0x7f55ac069e80 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.250+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f559c01b3b0 con 0x7f55ac069e80 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.250+0000 7f55937fe700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5598066fc0 0x7f5598069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.250+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f559c083a50 con 0x7f55ac069e80 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.250+0000 7f55aaffd700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5598066fc0 0x7f5598069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.251+0000 7f55aaffd700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5598066fc0 0x7f5598069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55ac16e200 tx=0x7f55a00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.254+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f559c050bd0 con 0x7f55ac069e80 2023-10-08T00:26:36.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.446+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55ac0c8c20 con 0x7f55ac069e80 2023-10-08T00:26:36.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.446+0000 7f55937fe700 1 -- 172.21.15.22:0/1429363527 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f559c017020 con 0x7f55ac069e80 2023-10-08T00:26:36.447 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:26:36.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5598066fc0 msgr2=0x7f5598069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5598066fc0 0x7f5598069470 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55ac16e200 tx=0x7f55a00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 msgr2=0x7f55ac0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 0x7f55ac0cb350 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f559c00c4e0 tx=0x7f559c00c7f0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 shutdown_connections 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5598066fc0 0x7f5598069470 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55ac15ac80 0x7f55ac158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55ac069e80 0x7f55ac0cb350 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 --2- 172.21.15.22:0/1429363527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ac0b0a70 0x7f55ac14af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 >> 172.21.15.22:0/1429363527 conn(0x7f55ac068e10 msgr2=0x7f55ac156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 shutdown_connections 2023-10-08T00:26:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.448+0000 7f55b1e81700 1 -- 172.21.15.22:0/1429363527 wait complete. 2023-10-08T00:26:36.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:26:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.582+0000 7f39b63d2700 1 Processor -- start 2023-10-08T00:26:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.582+0000 7f39b63d2700 1 -- start start 2023-10-08T00:26:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b63d2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b0155eb0 0x7f39b006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b63d2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39b00c70b0 0x7f39b0069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b63d2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b006eb90 con 0x7f39b0069cb0 2023-10-08T00:26:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b63d2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b006a130 con 0x7f39b00c70b0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b63d2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00cd350 con 0x7f39b0155eb0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39af7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39b00c70b0 0x7f39b0069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b496f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f39b0069cb0 0x7f39b00ccc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51044/0 (socket says 172.21.15.22:51044) 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.583+0000 7f39b496f700 1 -- 172.21.15.22:0/946339144 learned_addr learned my addr 172.21.15.22:0/946339144 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39affff700 1 --2- 172.21.15.22:0/946339144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b0155eb0 0x7f39b006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39af7fe700 1 -- 172.21.15.22:0/946339144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b0155eb0 msgr2=0x7f39b006e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39af7fe700 1 --2- 172.21.15.22:0/946339144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b0155eb0 0x7f39b006e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39af7fe700 1 -- 172.21.15.22:0/946339144 >> v1:172.21.15.22:6789/0 conn(0x7f39b0069cb0 legacy=0x7f39b00ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39aeffd700 1 -- 172.21.15.22:0/946339144 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562832727 0 0) 0x7f39b006eb90 con 0x7f39b0069cb0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39af7fe700 1 -- 172.21.15.22:0/946339144 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b006ee70 con 0x7f39b00c70b0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39af7fe700 1 --2- 172.21.15.22:0/946339144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b00c70b0 0x7f39b0069770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3998009910 tx=0x7f39980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734080ed52a08b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39aeffd700 1 -- 172.21.15.22:0/946339144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800b640 con 0x7f39b00c70b0 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39aeffd700 1 -- 172.21.15.22:0/946339144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800b7a0 con 0x7f39b00c70b0 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.584+0000 7f39aeffd700 1 -- 172.21.15.22:0/946339144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800bb60 con 0x7f39b00c70b0 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 -- 172.21.15.22:0/946339144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b00c70b0 msgr2=0x7f39b0069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 --2- 172.21.15.22:0/946339144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b00c70b0 0x7f39b0069770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3998009910 tx=0x7f39980091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 -- 172.21.15.22:0/946339144 shutdown_connections 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 --2- 172.21.15.22:0/946339144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b0155eb0 0x7f39b006e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 --2- 172.21.15.22:0/946339144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b00c70b0 0x7f39b0069770 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 -- 172.21.15.22:0/946339144 >> 172.21.15.22:0/946339144 conn(0x7f39b0068e10 msgr2=0x7f39b00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 -- 172.21.15.22:0/946339144 shutdown_connections 2023-10-08T00:26:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.585+0000 7f39b63d2700 1 -- 172.21.15.22:0/946339144 wait complete. 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.586+0000 7f39b63d2700 1 Processor -- start 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.586+0000 7f39b63d2700 1 -- start start 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 0x7f39b015a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b00c70b0 0x7f39b015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39b0155eb0 0x7f39b00add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0142ad0 con 0x7f39b0069cb0 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b016a610 con 0x7f39b0155eb0 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b0169a20 con 0x7f39b00c70b0 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 0x7f39b015a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 0x7f39b015a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57332/0 (socket says 172.21.15.22:57332) 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 -- 172.21.15.22:0/492670202 learned_addr learned my addr 172.21.15.22:0/492670202 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39af7fe700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b00c70b0 0x7f39b015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b496f700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39b0155eb0 0x7f39b00add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 -- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b00c70b0 msgr2=0x7f39b015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b00c70b0 0x7f39b015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 -- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39b0155eb0 msgr2=0x7f39b00add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39b0155eb0 0x7f39b00add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 -- 172.21.15.22:0/492670202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998009420 con 0x7f39b0069cb0 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39affff700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 0x7f39b015a690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f39a000e950 tx=0x7f39a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a000c850 con 0x7f39b0069cb0 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a000c9b0 con 0x7f39b0069cb0 2023-10-08T00:26:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b0169ce0 con 0x7f39b0069cb0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a000cdb0 con 0x7f39b0069cb0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.587+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b016a2a0 con 0x7f39b0069cb0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.588+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b016a8f0 con 0x7f39b0069cb0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.589+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f39a0013680 con 0x7f39b0069cb0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.589+0000 7f39a7fff700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3990066fc0 0x7f3990069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.589+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39a0084780 con 0x7f39b0069cb0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.589+0000 7f39af7fe700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3990066fc0 0x7f3990069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.590+0000 7f39af7fe700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3990066fc0 0x7f3990069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3998009860 tx=0x7f3998017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.594+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39a0051a00 con 0x7f39b0069cb0 2023-10-08T00:26:36.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.793+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39b00c6e00 con 0x7f39b0069cb0 2023-10-08T00:26:36.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.794+0000 7f39a7fff700 1 -- 172.21.15.22:0/492670202 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39a0055020 con 0x7f39b0069cb0 2023-10-08T00:26:36.794 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:26:36.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3990066fc0 msgr2=0x7f3990069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3990066fc0 0x7f3990069470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3998009860 tx=0x7f3998017000 comp rx=0 tx=0).stop 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 msgr2=0x7f39b015a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 0x7f39b015a690 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f39a000e950 tx=0x7f39a00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 shutdown_connections 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39b0155eb0 0x7f39b00add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39b0069cb0 0x7f39b015a690 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3990066fc0 0x7f3990069470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 --2- 172.21.15.22:0/492670202 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39b00c70b0 0x7f39b015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 >> 172.21.15.22:0/492670202 conn(0x7f39b0068e10 msgr2=0x7f39b00c79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 shutdown_connections 2023-10-08T00:26:36.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.796+0000 7f39b63d2700 1 -- 172.21.15.22:0/492670202 wait complete. 2023-10-08T00:26:36.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:26:36.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.931+0000 7fc26de05700 1 Processor -- start 2023-10-08T00:26:36.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.931+0000 7fc26de05700 1 -- start start 2023-10-08T00:26:36.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc26de05700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159c60 0x7fc26815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc26de05700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc26815db10 0x7fc268069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc26de05700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26815a160 con 0x7fc268159890 2023-10-08T00:26:36.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc26de05700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2680d13a0 con 0x7fc26815db10 2023-10-08T00:26:36.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc26de05700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26815e140 con 0x7fc268159c60 2023-10-08T00:26:36.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc267fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc26815db10 0x7fc268069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc2677fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc268159890 0x7fc26815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55106/0 (socket says 172.21.15.22:55106) 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc2677fe700 1 -- 172.21.15.22:0/3451571572 learned_addr learned my addr 172.21.15.22:0/3451571572 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc266ffd700 1 --2- 172.21.15.22:0/3451571572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159c60 0x7fc26815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc267fff700 1 -- 172.21.15.22:0/3451571572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159c60 msgr2=0x7fc26815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc267fff700 1 --2- 172.21.15.22:0/3451571572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159c60 0x7fc26815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc267fff700 1 -- 172.21.15.22:0/3451571572 >> v1:172.21.15.22:6789/0 conn(0x7fc268159890 legacy=0x7fc26815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.932+0000 7fc2667fc700 1 -- 172.21.15.22:0/3451571572 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582378837 0 0) 0x7fc26815a160 con 0x7fc268159890 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc267fff700 1 -- 172.21.15.22:0/3451571572 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26815a3d0 con 0x7fc26815db10 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc267fff700 1 --2- 172.21.15.22:0/3451571572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26815db10 0x7fc268069560 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc260009e60 tx=0x7fc260009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53a4323d335ed8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc2667fc700 1 -- 172.21.15.22:0/3451571572 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000e070 con 0x7fc26815db10 2023-10-08T00:26:36.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc2667fc700 1 -- 172.21.15.22:0/3451571572 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000bc30 con 0x7fc26815db10 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc2667fc700 1 -- 172.21.15.22:0/3451571572 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260012430 con 0x7fc26815db10 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 -- 172.21.15.22:0/3451571572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26815db10 msgr2=0x7fc268069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 --2- 172.21.15.22:0/3451571572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26815db10 0x7fc268069560 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc260009e60 tx=0x7fc260009780 comp rx=0 tx=0).stop 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 -- 172.21.15.22:0/3451571572 shutdown_connections 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 --2- 172.21.15.22:0/3451571572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc26815db10 0x7fc268069560 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 --2- 172.21.15.22:0/3451571572 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159c60 0x7fc26815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 -- 172.21.15.22:0/3451571572 >> 172.21.15.22:0/3451571572 conn(0x7fc268068e20 msgr2=0x7fc2680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 -- 172.21.15.22:0/3451571572 shutdown_connections 2023-10-08T00:26:36.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.933+0000 7fc26de05700 1 -- 172.21.15.22:0/3451571572 wait complete. 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 Processor -- start 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 -- start start 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159890 0x7fc26815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 0x7fc268160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc26815db10 0x7fc268160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc268160fd0 con 0x7fc268159c60 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26815d2a0 con 0x7fc26815db10 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.935+0000 7fc26de05700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26815c690 con 0x7fc268159890 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 0x7fc268160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 0x7fc268160550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36242/0 (socket says 172.21.15.22:36242) 2023-10-08T00:26:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 -- 172.21.15.22:0/170260360 learned_addr learned my addr 172.21.15.22:0/170260360 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc2677fe700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159890 0x7fc26815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc267fff700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc26815db10 0x7fc268160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 -- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159890 msgr2=0x7fc26815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159890 0x7fc26815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 -- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc26815db10 msgr2=0x7fc268160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc26815db10 0x7fc268160a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 -- 172.21.15.22:0/170260360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260009a20 con 0x7fc268159c60 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc266ffd700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 0x7fc268160550 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00d890 tx=0x7fc25c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0125f0 con 0x7fc268159c60 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c012770 con 0x7fc268159c60 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26815c970 con 0x7fc268159c60 2023-10-08T00:26:36.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c012b30 con 0x7fc268159c60 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.936+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26815cf30 con 0x7fc268159c60 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.937+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26815d410 con 0x7fc268159c60 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.938+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc25c01e460 con 0x7fc268159c60 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.938+0000 7fc24f7fe700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc254066fc0 0x7fc254069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.938+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc25c084ba0 con 0x7fc268159c60 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.938+0000 7fc2677fe700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc254066fc0 0x7fc254069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:36.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.939+0000 7fc2677fe700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc254066fc0 0x7fc254069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2580011e0 tx=0x7fc258009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:36.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:36.942+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc25c0558b0 con 0x7fc268159c60 2023-10-08T00:26:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.136+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc26804c3c0 con 0x7fc268159c60 2023-10-08T00:26:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.136+0000 7fc24f7fe700 1 -- 172.21.15.22:0/170260360 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc25c055440 con 0x7fc268159c60 2023-10-08T00:26:37.137 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:26:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc254066fc0 msgr2=0x7fc254069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc254066fc0 0x7fc254069470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc2580011e0 tx=0x7fc258009040 comp rx=0 tx=0).stop 2023-10-08T00:26:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 msgr2=0x7fc268160550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 0x7fc268160550 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00d890 tx=0x7fc25c008040 comp rx=0 tx=0).stop 2023-10-08T00:26:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 shutdown_connections 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc26815db10 0x7fc268160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc254066fc0 0x7fc254069470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc268159890 0x7fc26815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 --2- 172.21.15.22:0/170260360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc268159c60 0x7fc268160550 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 >> 172.21.15.22:0/170260360 conn(0x7fc268068e20 msgr2=0x7fc268153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.138+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 shutdown_connections 2023-10-08T00:26:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.139+0000 7fc26de05700 1 -- 172.21.15.22:0/170260360 wait complete. 2023-10-08T00:26:37.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:37.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.269+0000 7f7ad0e48700 1 Processor -- start 2023-10-08T00:26:37.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.269+0000 7f7ad0e48700 1 -- start start 2023-10-08T00:26:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.270+0000 7f7ad0e48700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7acc159890 0x7f7acc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.270+0000 7f7ad0e48700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7acc069560 0x7f7acc0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.270+0000 7f7ad0e48700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc15a160 con 0x7f7acc159c60 2023-10-08T00:26:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.270+0000 7f7ad0e48700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc069f20 con 0x7f7acc069560 2023-10-08T00:26:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.270+0000 7f7ad0e48700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0d13a0 con 0x7f7acc159890 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac9d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7acc159c60 0x7f7acc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55122/0 (socket says 172.21.15.22:55122) 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac9d9b700 1 -- 172.21.15.22:0/3701566271 learned_addr learned my addr 172.21.15.22:0/3701566271 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7aca59c700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7acc159890 0x7f7acc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7acad9d700 1 --2- 172.21.15.22:0/3701566271 >> v2:172.21.15.192:3300/0 conn(0x7f7acc069560 0x7f7acc0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667660095 0 0) 0x7f7acc15a160 con 0x7f7acc159c60 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab8003570 con 0x7f7acc159c60 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 586563215 0 0) 0x7f7ab8003570 con 0x7f7acc159c60 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7acc159890 msgr2=0x7f7acc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7acc159890 0x7f7acc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 >> v2:172.21.15.192:3300/0 conn(0x7f7acc069560 msgr2=0x7f7acc0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 --2- 172.21.15.22:0/3701566271 >> v2:172.21.15.192:3300/0 conn(0x7f7acc069560 0x7f7acc0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc15e140 con 0x7f7acc159c60 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f7ab4001470 con 0x7f7acc159c60 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 >> v1:172.21.15.22:6789/0 conn(0x7f7acc159c60 legacy=0x7f7acc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ab8003a60 0x7f7ab8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8004810 0x7f7ab8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ab80051c0 0x7f7ab800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc069f20 con 0x7f7ab8003a60 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0d13a0 con 0x7f7ab80051c0 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab800bfa0 con 0x7f7ab8004810 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7acad9d700 1 --2- 172.21.15.22:0/3701566271 >> v2:172.21.15.192:3300/0 conn(0x7f7acc069560 0x7f7acc0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7aca59c700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7acc159890 0x7f7acc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7ac9d9b700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8004810 0x7f7ab8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.271+0000 7f7aca59c700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ab8003a60 0x7f7ab8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7acad9d700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ab80051c0 0x7f7ab800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7aca59c700 1 -- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8004810 msgr2=0x7f7ab8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7aca59c700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8004810 0x7f7ab8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7aca59c700 1 -- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ab80051c0 msgr2=0x7f7ab800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7aca59c700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ab80051c0 0x7f7ab800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7aca59c700 1 -- 172.21.15.22:0/3701566271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8003570 con 0x7f7ab8003a60 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7aca59c700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ab8003a60 0x7f7ab8003e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7acc065120 tx=0x7f7ac400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106319f672eef737 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400eaa0 con 0x7f7ab8003a60 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400f040 con 0x7f7ab8003a60 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7ac959a700 1 -- 172.21.15.22:0/3701566271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400ee30 con 0x7f7ab8003a60 2023-10-08T00:26:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7ad0e48700 1 -- 172.21.15.22:0/3701566271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ab8003a60 msgr2=0x7f7ab8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/3701566271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ab8003a60 0x7f7ab8003e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7acc065120 tx=0x7f7ac400b040 comp rx=0 tx=0).stop 2023-10-08T00:26:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.272+0000 7f7acad9d700 1 -- 172.21.15.22:0/3701566271 reap_dead start 2023-10-08T00:26:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.273+0000 7f7ad0e48700 1 -- 172.21.15.22:0/3701566271 shutdown_connections 2023-10-08T00:26:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.273+0000 7f7ad0e48700 1 -- 172.21.15.22:0/3701566271 >> 172.21.15.22:0/3701566271 conn(0x7f7acc068e20 msgr2=0x7f7acc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.273+0000 7f7ad0e48700 1 -- 172.21.15.22:0/3701566271 shutdown_connections 2023-10-08T00:26:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.273+0000 7f7ad0e48700 1 -- 172.21.15.22:0/3701566271 wait complete. 2023-10-08T00:26:37.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 Processor -- start 2023-10-08T00:26:37.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 -- start start 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8003a60 0x7f7acc13e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7acc0cd0c0 0x7f7acc0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 0x7f7acc153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0cda70 con 0x7f7acc153720 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc154f80 con 0x7f7acc0cd0c0 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.274+0000 7f7ad0e48700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc1540d0 con 0x7f7ab8003a60 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 0x7f7acc153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 0x7f7acc153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36262/0 (socket says 172.21.15.22:36262) 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 -- 172.21.15.22:0/1199169290 learned_addr learned my addr 172.21.15.22:0/1199169290 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7ac9d9b700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7acc0cd0c0 0x7f7acc0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7aca59c700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8003a60 0x7f7acc13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 -- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8003a60 msgr2=0x7f7acc13e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8003a60 0x7f7acc13e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 -- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7acc0cd0c0 msgr2=0x7f7acc0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7acc0cd0c0 0x7f7acc0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 -- 172.21.15.22:0/1199169290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc154370 con 0x7f7acc153720 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7acad9d700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 0x7f7acc153b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7acc06a890 tx=0x7f7abc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00f910 con 0x7f7acc153720 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc00fa90 con 0x7f7acc153720 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc154650 con 0x7f7acc153720 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00fe50 con 0x7f7acc153720 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.275+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc154c10 con 0x7f7acc153720 2023-10-08T00:26:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.276+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc155130 con 0x7f7acc153720 2023-10-08T00:26:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.277+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7abc014650 con 0x7f7acc153720 2023-10-08T00:26:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.277+0000 7f7ac27fc700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aac066fc0 0x7f7aac069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.277+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7abc084ac0 con 0x7f7acc153720 2023-10-08T00:26:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.277+0000 7f7aca59c700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aac066fc0 0x7f7aac069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.278+0000 7f7aca59c700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aac066fc0 0x7f7aac069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40099f0 tx=0x7f7ac4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.281+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7acc155130 con 0x7f7acc153720 2023-10-08T00:26:37.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.520+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7acc1550f0 con 0x7f7acc153720 2023-10-08T00:26:37.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.521+0000 7f7ac27fc700 1 -- 172.21.15.22:0/1199169290 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f7abc022090 con 0x7f7acc153720 2023-10-08T00:26:37.521 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:37.522 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:20.001353+0000","modified":"2023-10-08T00:26:23.607891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/1300992790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1300992790},{"type":"v1","addr":"172.21.15.22:6835","nonce":1300992790}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aac066fc0 msgr2=0x7f7aac069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aac066fc0 0x7f7aac069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40099f0 tx=0x7f7ac4016000 comp rx=0 tx=0).stop 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 msgr2=0x7f7acc153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 0x7f7acc153b90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7acc06a890 tx=0x7f7abc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 shutdown_connections 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7acc153720 0x7f7acc153b90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aac066fc0 0x7f7aac069470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ab8003a60 0x7f7acc13e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 --2- 172.21.15.22:0/1199169290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7acc0cd0c0 0x7f7acc0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 >> 172.21.15.22:0/1199169290 conn(0x7f7acc068e20 msgr2=0x7f7acc15d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 shutdown_connections 2023-10-08T00:26:37.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.523+0000 7f7ad0e48700 1 -- 172.21.15.22:0/1199169290 wait complete. 2023-10-08T00:26:37.525 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2023-10-08T00:26:37.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.654+0000 7fe152b46700 1 Processor -- start 2023-10-08T00:26:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.654+0000 7fe152b46700 1 -- start start 2023-10-08T00:26:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe152b46700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe14c156fb0 0x7fe14c06a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe152b46700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe14c06ab20 0x7fe14c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe152b46700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c069d30 con 0x7fe14c0cbae0 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe152b46700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c06af70 con 0x7fe14c156fb0 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe152b46700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0c8110 con 0x7fe14c06ab20 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe1508e2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe14c156fb0 0x7fe14c06a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe1508e2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe14c156fb0 0x7fe14c06a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36278/0 (socket says 172.21.15.22:36278) 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.655+0000 7fe1508e2700 1 -- 172.21.15.22:0/883722968 learned_addr learned my addr 172.21.15.22:0/883722968 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe14bfff700 1 --2- 172.21.15.22:0/883722968 >> v2:172.21.15.192:3300/0 conn(0x7fe14c06ab20 0x7fe14c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe1508e2700 1 -- 172.21.15.22:0/883722968 >> v2:172.21.15.192:3300/0 conn(0x7fe14c06ab20 msgr2=0x7fe14c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe1508e2700 1 --2- 172.21.15.22:0/883722968 >> v2:172.21.15.192:3300/0 conn(0x7fe14c06ab20 0x7fe14c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe1508e2700 1 -- 172.21.15.22:0/883722968 >> v1:172.21.15.192:6789/0 conn(0x7fe14c0cbae0 legacy=0x7fe14c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe1508e2700 1 -- 172.21.15.22:0/883722968 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0cbf20 con 0x7fe14c156fb0 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe14bfff700 1 --2- 172.21.15.22:0/883722968 >> v2:172.21.15.192:3300/0 conn(0x7fe14c06ab20 0x7fe14c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe1508e2700 1 --2- 172.21.15.22:0/883722968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c156fb0 0x7fe14c06a5e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0099b0 tx=0x7fe13c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57fdfe2068ab867 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe14b7fe700 1 -- 172.21.15.22:0/883722968 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00b7e0 con 0x7fe14c156fb0 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe14b7fe700 1 -- 172.21.15.22:0/883722968 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00b940 con 0x7fe14c156fb0 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe14b7fe700 1 -- 172.21.15.22:0/883722968 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00bce0 con 0x7fe14c156fb0 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe152b46700 1 -- 172.21.15.22:0/883722968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c156fb0 msgr2=0x7fe14c06a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.656+0000 7fe152b46700 1 --2- 172.21.15.22:0/883722968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c156fb0 0x7fe14c06a5e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0099b0 tx=0x7fe13c009250 comp rx=0 tx=0).stop 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.657+0000 7fe152b46700 1 -- 172.21.15.22:0/883722968 shutdown_connections 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.657+0000 7fe152b46700 1 --2- 172.21.15.22:0/883722968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c156fb0 0x7fe14c06a5e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.657+0000 7fe152b46700 1 --2- 172.21.15.22:0/883722968 >> v2:172.21.15.192:3300/0 conn(0x7fe14c06ab20 0x7fe14c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.657+0000 7fe152b46700 1 -- 172.21.15.22:0/883722968 >> 172.21.15.22:0/883722968 conn(0x7fe14c0c9870 msgr2=0x7fe14c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.657+0000 7fe152b46700 1 -- 172.21.15.22:0/883722968 shutdown_connections 2023-10-08T00:26:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.657+0000 7fe152b46700 1 -- 172.21.15.22:0/883722968 wait complete. 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.658+0000 7fe152b46700 1 Processor -- start 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.658+0000 7fe152b46700 1 -- start start 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 0x7fe14c14c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe14c0cbae0 0x7fe14c153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe14c156fb0 0x7fe14c0c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b2870 con 0x7fe14c06ab20 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c152ab0 con 0x7fe14c0cbae0 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c1524d0 con 0x7fe14c156fb0 2023-10-08T00:26:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 0x7fe14c14c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 0x7fe14c14c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36282/0 (socket says 172.21.15.22:36282) 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 -- 172.21.15.22:0/3554369973 learned_addr learned my addr 172.21.15.22:0/3554369973 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe14bfff700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe14c0cbae0 0x7fe14c153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 -- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe14c156fb0 msgr2=0x7fe14c0c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1510e3700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe14c156fb0 0x7fe14c0c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe14c156fb0 0x7fe14c0c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 -- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe14c0cbae0 msgr2=0x7fe14c153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe14c0cbae0 0x7fe14c153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 -- 172.21.15.22:0/3554369973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0094f0 con 0x7fe14c06ab20 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe14bfff700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe14c0cbae0 0x7fe14c153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1510e3700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe14c156fb0 0x7fe14c0c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe1508e2700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 0x7fe14c14c570 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06cc50 tx=0x7fe13c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011e60 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c020070 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c01b6a0 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c1576d0 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.659+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c157380 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.661+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c04c3c0 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.661+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe13c022030 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.661+0000 7fe148ff9700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe138066fc0 0x7fe138069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.661+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe13c0864f0 con 0x7fe14c06ab20 2023-10-08T00:26:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.661+0000 7fe14bfff700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe138066fc0 0x7fe138069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:37.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.662+0000 7fe14bfff700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe138066fc0 0x7fe138069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe14c14d020 tx=0x7fe140008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:37.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.666+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe13c053770 con 0x7fe14c06ab20 2023-10-08T00:26:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.859+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe14c04c3c0 con 0x7fe14c06ab20 2023-10-08T00:26:37.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.860+0000 7fe148ff9700 1 -- 172.21.15.22:0/3554369973 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fe13c056d90 con 0x7fe14c06ab20 2023-10-08T00:26:37.861 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:37.861 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:21.596908+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:18.392931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:18.960391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe138066fc0 msgr2=0x7fe138069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe138066fc0 0x7fe138069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe14c14d020 tx=0x7fe140008040 comp rx=0 tx=0).stop 2023-10-08T00:26:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 msgr2=0x7fe14c14c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 0x7fe14c14c570 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe14c06cc50 tx=0x7fe13c016000 comp rx=0 tx=0).stop 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 shutdown_connections 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe138066fc0 0x7fe138069470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.862+0000 7fe152b46700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe14c156fb0 0x7fe14c0c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.863+0000 7fe152b46700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe14c06ab20 0x7fe14c14c570 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.863+0000 7fe152b46700 1 --2- 172.21.15.22:0/3554369973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe14c0cbae0 0x7fe14c153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.863+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 >> 172.21.15.22:0/3554369973 conn(0x7fe14c0c9870 msgr2=0x7fe14c0c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.863+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 shutdown_connections 2023-10-08T00:26:37.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.863+0000 7fe152b46700 1 -- 172.21.15.22:0/3554369973 wait complete. 2023-10-08T00:26:37.875 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:26:37.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:37.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.994+0000 7f2e5f59e700 1 Processor -- start 2023-10-08T00:26:37.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.994+0000 7f2e5f59e700 1 -- start start 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2e601597f0 0x7f2e600b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5f59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e6015d230 0x7f2e6015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5f59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6015db70 con 0x7f2e60159420 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5f59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600b11d0 con 0x7f2e6015d230 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600b14b0 con 0x7f2e601597f0 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e6015d230 0x7f2e6015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e6015d230 0x7f2e6015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36284/0 (socket says 172.21.15.22:36284) 2023-10-08T00:26:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 -- 172.21.15.22:0/3387045468 learned_addr learned my addr 172.21.15.22:0/3387045468 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5dd9b700 1 --2- 172.21.15.22:0/3387045468 >> v2:172.21.15.192:3300/0 conn(0x7f2e601597f0 0x7f2e600b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 -- 172.21.15.22:0/3387045468 >> v2:172.21.15.192:3300/0 conn(0x7f2e601597f0 msgr2=0x7f2e600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 --2- 172.21.15.22:0/3387045468 >> v2:172.21.15.192:3300/0 conn(0x7f2e601597f0 0x7f2e600b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 -- 172.21.15.22:0/3387045468 >> v1:172.21.15.192:6789/0 conn(0x7f2e60159420 legacy=0x7f2e600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5ed9d700 1 -- 172.21.15.22:0/3387045468 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600b1790 con 0x7f2e6015d230 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.995+0000 7f2e5dd9b700 1 --2- 172.21.15.22:0/3387045468 >> v2:172.21.15.192:3300/0 conn(0x7f2e601597f0 0x7f2e600b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5ed9d700 1 --2- 172.21.15.22:0/3387045468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6015d230 0x7f2e6015d630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2e60089750 tx=0x7f2e58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551c33f708bfc84c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5d59a700 1 -- 172.21.15.22:0/3387045468 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800b820 con 0x7f2e6015d230 2023-10-08T00:26:38.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5d59a700 1 -- 172.21.15.22:0/3387045468 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800b980 con 0x7f2e6015d230 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5d59a700 1 -- 172.21.15.22:0/3387045468 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800bd20 con 0x7f2e6015d230 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 -- 172.21.15.22:0/3387045468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6015d230 msgr2=0x7f2e6015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/3387045468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6015d230 0x7f2e6015d630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2e60089750 tx=0x7f2e58009250 comp rx=0 tx=0).stop 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 -- 172.21.15.22:0/3387045468 shutdown_connections 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/3387045468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e6015d230 0x7f2e6015d630 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/3387045468 >> v2:172.21.15.192:3300/0 conn(0x7f2e601597f0 0x7f2e600b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 -- 172.21.15.22:0/3387045468 >> 172.21.15.22:0/3387045468 conn(0x7f2e600d0660 msgr2=0x7f2e600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.996+0000 7f2e5f59e700 1 -- 172.21.15.22:0/3387045468 shutdown_connections 2023-10-08T00:26:38.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.997+0000 7f2e5f59e700 1 -- 172.21.15.22:0/3387045468 wait complete. 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 Processor -- start 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 -- start start 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e60159420 0x7f2e60169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 0x7f2e601545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e6015d230 0x7f2e60154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6015b830 con 0x7f2e601597f0 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6016a350 con 0x7f2e60159420 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6015abb0 con 0x7f2e6015d230 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.998+0000 7f2e5dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 0x7f2e601545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 0x7f2e601545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36290/0 (socket says 172.21.15.22:36290) 2023-10-08T00:26:38.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 -- 172.21.15.22:0/1200212715 learned_addr learned my addr 172.21.15.22:0/1200212715 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5e59c700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e60159420 0x7f2e60169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5ed9d700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e6015d230 0x7f2e60154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 -- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e6015d230 msgr2=0x7f2e60154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e6015d230 0x7f2e60154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 -- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e60159420 msgr2=0x7f2e60169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e60159420 0x7f2e60169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 -- 172.21.15.22:0/1200212715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580094f0 con 0x7f2e601597f0 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5dd9b700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 0x7f2e601545b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800c8b0 tx=0x7f2e48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48011600 con 0x7f2e601597f0 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e48011760 con 0x7f2e601597f0 2023-10-08T00:26:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6015ae90 con 0x7f2e601597f0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e48011b00 con 0x7f2e601597f0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:37.999+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6015b450 con 0x7f2e601597f0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.000+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6004c3c0 con 0x7f2e601597f0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.000+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2e480193b0 con 0x7f2e601597f0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.001+0000 7f2e567fc700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e40066fc0 0x7f2e40069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.001+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e48084630 con 0x7f2e601597f0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.001+0000 7f2e5e59c700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e40066fc0 0x7f2e40069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.002+0000 7f2e5e59c700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e40066fc0 0x7f2e40069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2e500075c0 tx=0x7f2e50009780 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.005+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e480517a0 con 0x7f2e601597f0 2023-10-08T00:26:38.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.242+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e600b1a70 con 0x7f2e601597f0 2023-10-08T00:26:38.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.243+0000 7f2e567fc700 1 -- 172.21.15.22:0/1200212715 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f2e48054dc0 con 0x7f2e601597f0 2023-10-08T00:26:38.243 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:38.243 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:20.001353+0000","modified":"2023-10-08T00:26:23.607891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/1300992790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1300992790},{"type":"v1","addr":"172.21.15.22:6835","nonce":1300992790}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T00:26:38.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e40066fc0 msgr2=0x7f2e40069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e40066fc0 0x7f2e40069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2e500075c0 tx=0x7f2e50009780 comp rx=0 tx=0).stop 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 msgr2=0x7f2e601545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 0x7f2e601545b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800c8b0 tx=0x7f2e48008040 comp rx=0 tx=0).stop 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 shutdown_connections 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e40066fc0 0x7f2e40069470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e6015d230 0x7f2e60154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e60159420 0x7f2e60169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 --2- 172.21.15.22:0/1200212715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e601597f0 0x7f2e601545b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 >> 172.21.15.22:0/1200212715 conn(0x7f2e600d0660 msgr2=0x7f2e60069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:38.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 shutdown_connections 2023-10-08T00:26:38.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.245+0000 7f2e5f59e700 1 -- 172.21.15.22:0/1200212715 wait complete. 2023-10-08T00:26:38.247 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2023-10-08T00:26:38.257 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:38.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.375+0000 7f9cb2fa8700 1 Processor -- start 2023-10-08T00:26:38.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.375+0000 7f9cb2fa8700 1 -- start start 2023-10-08T00:26:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb2fa8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac159c60 0x7f9cac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb2fa8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9cac15db10 0x7f9cac069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb2fa8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cac15a160 con 0x7f9cac159890 2023-10-08T00:26:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb2fa8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0d13a0 con 0x7f9cac15db10 2023-10-08T00:26:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb2fa8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac15e140 con 0x7f9cac159c60 2023-10-08T00:26:38.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb1545700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9cac15db10 0x7f9cac069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb0d44700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9cac159890 0x7f9cac15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55132/0 (socket says 172.21.15.22:55132) 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.376+0000 7f9cb0d44700 1 -- 172.21.15.22:0/1133821391 learned_addr learned my addr 172.21.15.22:0/1133821391 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cabfff700 1 --2- 172.21.15.22:0/1133821391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac159c60 0x7f9cac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb1545700 1 -- 172.21.15.22:0/1133821391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac159c60 msgr2=0x7f9cac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb1545700 1 --2- 172.21.15.22:0/1133821391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac159c60 0x7f9cac15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb1545700 1 -- 172.21.15.22:0/1133821391 >> v1:172.21.15.22:6789/0 conn(0x7f9cac159890 legacy=0x7f9cac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cab7fe700 1 -- 172.21.15.22:0/1133821391 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724966992 0 0) 0x7f9cac15a160 con 0x7f9cac159890 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb1545700 1 -- 172.21.15.22:0/1133821391 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac15a3d0 con 0x7f9cac15db10 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb1545700 1 --2- 172.21.15.22:0/1133821391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac15db10 0x7f9cac069560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e60 tx=0x7f9ca4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d372e1a0ecacc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cab7fe700 1 -- 172.21.15.22:0/1133821391 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400e070 con 0x7f9cac15db10 2023-10-08T00:26:38.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cab7fe700 1 -- 172.21.15.22:0/1133821391 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca400bc30 con 0x7f9cac15db10 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cab7fe700 1 -- 172.21.15.22:0/1133821391 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4012430 con 0x7f9cac15db10 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/1133821391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac15db10 msgr2=0x7f9cac069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/1133821391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac15db10 0x7f9cac069560 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009e60 tx=0x7f9ca4009780 comp rx=0 tx=0).stop 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/1133821391 shutdown_connections 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/1133821391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac15db10 0x7f9cac069560 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/1133821391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac159c60 0x7f9cac15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/1133821391 >> 172.21.15.22:0/1133821391 conn(0x7f9cac068e20 msgr2=0x7f9cac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.377+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/1133821391 shutdown_connections 2023-10-08T00:26:38.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.378+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/1133821391 wait complete. 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 Processor -- start 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 -- start start 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac159890 0x7f9cac0b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 0x7f9cac14a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac15db10 0x7f9cac151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac14ad30 con 0x7f9cac159c60 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0b2340 con 0x7f9cac159890 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.379+0000 7f9cb2fa8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac1523e0 con 0x7f9cac15db10 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 0x7f9cac14a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 0x7f9cac14a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36308/0 (socket says 172.21.15.22:36308) 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 -- 172.21.15.22:0/410942012 learned_addr learned my addr 172.21.15.22:0/410942012 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cb1545700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac15db10 0x7f9cac151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cb0d44700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac159890 0x7f9cac0b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 -- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac15db10 msgr2=0x7f9cac151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac15db10 0x7f9cac151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 -- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac159890 msgr2=0x7f9cac0b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac159890 0x7f9cac0b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 -- 172.21.15.22:0/410942012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4009a20 con 0x7f9cac159c60 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cabfff700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 0x7f9cac14a7f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c8b0 tx=0x7f9ca0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011600 con 0x7f9cac159c60 2023-10-08T00:26:38.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0011760 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac14b060 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0011b00 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.380+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac0b1b20 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.381+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac04c3c0 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.382+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9ca0010350 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.382+0000 7f9ca8ff9700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c98066fc0 0x7f9c98069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.382+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ca00843e0 con 0x7f9cac159c60 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.382+0000 7f9cb0d44700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c98066fc0 0x7f9c98069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.383+0000 7f9cb0d44700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c98066fc0 0x7f9c98069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0011e0 tx=0x7f9c9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.386+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ca0051550 con 0x7f9cac159c60 2023-10-08T00:26:38.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.623+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cac06a5b0 con 0x7f9cac159c60 2023-10-08T00:26:38.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.624+0000 7f9ca8ff9700 1 -- 172.21.15.22:0/410942012 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4603 (secure 0 0 0) 0x7f9ca0054b70 con 0x7f9cac159c60 2023-10-08T00:26:38.624 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:38.624 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:20.001353+0000","modified":"2023-10-08T00:26:23.607891+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5349":{"gid":5349,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/1300992790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1300992790},{"type":"v1","addr":"172.21.15.22:6835","nonce":1300992790}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T00:26:38.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c98066fc0 msgr2=0x7f9c98069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c98066fc0 0x7f9c98069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c0011e0 tx=0x7f9c9c009040 comp rx=0 tx=0).stop 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 msgr2=0x7f9cac14a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 0x7f9cac14a7f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000c8b0 tx=0x7f9ca0008040 comp rx=0 tx=0).stop 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 shutdown_connections 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c98066fc0 0x7f9c98069470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9cac15db10 0x7f9cac151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cac159890 0x7f9cac0b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 --2- 172.21.15.22:0/410942012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9cac159c60 0x7f9cac14a7f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 >> 172.21.15.22:0/410942012 conn(0x7f9cac068e20 msgr2=0x7f9cac156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:38.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 shutdown_connections 2023-10-08T00:26:38.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.626+0000 7f9cb2fa8700 1 -- 172.21.15.22:0/410942012 wait complete. 2023-10-08T00:26:38.628 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2023-10-08T00:26:38.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:38.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 Processor -- start 2023-10-08T00:26:38.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 -- start start 2023-10-08T00:26:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0159890 0x7f61d015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61d0069560 0x7f61d00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d015a160 con 0x7f61d0159c60 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d0069f20 con 0x7f61d0069560 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.758+0000 7f61d6888700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00d13a0 con 0x7f61d0159890 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61d0069560 0x7f61d00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61cf7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f61d0159c60 0x7f61d015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55146/0 (socket says 172.21.15.22:55146) 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61cf7fe700 1 -- 172.21.15.22:0/691543837 learned_addr learned my addr 172.21.15.22:0/691543837 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f61d0069560 0x7f61d00699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36322/0 (socket says 172.21.15.22:36322) 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61cffff700 1 --2- 172.21.15.22:0/691543837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0159890 0x7f61d015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 -- 172.21.15.22:0/691543837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0159890 msgr2=0x7f61d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 --2- 172.21.15.22:0/691543837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0159890 0x7f61d015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 -- 172.21.15.22:0/691543837 >> v1:172.21.15.22:6789/0 conn(0x7f61d0159c60 legacy=0x7f61d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 -- 172.21.15.22:0/691543837 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d015e140 con 0x7f61d0069560 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61ceffd700 1 -- 172.21.15.22:0/691543837 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281513358 0 0) 0x7f61d015a160 con 0x7f61d0159c60 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61d4e25700 1 --2- 172.21.15.22:0/691543837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0069560 0x7f61d00699e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e60 tx=0x7f61c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadd56c6a7666bed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61ceffd700 1 -- 172.21.15.22:0/691543837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800e070 con 0x7f61d0069560 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61ceffd700 1 -- 172.21.15.22:0/691543837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800bc30 con 0x7f61d0069560 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.759+0000 7f61ceffd700 1 -- 172.21.15.22:0/691543837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8012430 con 0x7f61d0069560 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 -- 172.21.15.22:0/691543837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0069560 msgr2=0x7f61d00699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 --2- 172.21.15.22:0/691543837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0069560 0x7f61d00699e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e60 tx=0x7f61c8009780 comp rx=0 tx=0).stop 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 -- 172.21.15.22:0/691543837 shutdown_connections 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 --2- 172.21.15.22:0/691543837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0069560 0x7f61d00699e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 --2- 172.21.15.22:0/691543837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0159890 0x7f61d015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 -- 172.21.15.22:0/691543837 >> 172.21.15.22:0/691543837 conn(0x7f61d0068e20 msgr2=0x7f61d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:38.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 -- 172.21.15.22:0/691543837 shutdown_connections 2023-10-08T00:26:38.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.760+0000 7f61d6888700 1 -- 172.21.15.22:0/691543837 wait complete. 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.761+0000 7f61d6888700 1 Processor -- start 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.761+0000 7f61d6888700 1 -- start start 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d6888700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0069560 0x7f61d015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d6888700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 0x7f61d00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d6888700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61d0159c60 0x7f61d0154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d6888700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0155770 con 0x7f61d0159890 2023-10-08T00:26:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d6888700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d015efc0 con 0x7f61d0159c60 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d6888700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0154cc0 con 0x7f61d0069560 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 0x7f61d00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 0x7f61d00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36338/0 (socket says 172.21.15.22:36338) 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 -- 172.21.15.22:0/1562212420 learned_addr learned my addr 172.21.15.22:0/1562212420 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 -- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0069560 msgr2=0x7f61d015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cffff700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0069560 0x7f61d015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0069560 0x7f61d015d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61d4e25700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61d0159c60 0x7f61d0154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 -- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61d0159c60 msgr2=0x7f61d0154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61d0159c60 0x7f61d0154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 -- 172.21.15.22:0/1562212420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009a20 con 0x7f61d0159890 2023-10-08T00:26:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cffff700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0069560 0x7f61d015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.762+0000 7f61cf7fe700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 0x7f61d00b3590 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c840 tx=0x7f61c4007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.763+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4005c00 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.763+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4005d60 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.763+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40072e0 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.763+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00b3fe0 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.763+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d015b8a0 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.763+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d00b4500 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.764+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f61c4007690 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.764+0000 7f61b7fff700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61bc066fc0 0x7f61bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.764+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61c4083970 con 0x7f61d0159890 2023-10-08T00:26:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.765+0000 7f61cffff700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61bc066fc0 0x7f61bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.765+0000 7f61cffff700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61bc066fc0 0x7f61bc069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f61c0006fd0 tx=0x7f61c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.769+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61c404b5a0 con 0x7f61d0159890 2023-10-08T00:26:38.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.965+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d015ed90 con 0x7f61d0159890 2023-10-08T00:26:38.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.966+0000 7f61b7fff700 1 -- 172.21.15.22:0/1562212420 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f61d015ed90 con 0x7f61d0159890 2023-10-08T00:26:38.966 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:38.966 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:21.596908+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:18.392931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:18.960391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:38.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61bc066fc0 msgr2=0x7f61bc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61bc066fc0 0x7f61bc069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f61c0006fd0 tx=0x7f61c0008040 comp rx=0 tx=0).stop 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 msgr2=0x7f61d00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 0x7f61d00b3590 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c840 tx=0x7f61c4007db0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 shutdown_connections 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61d0159c60 0x7f61d0154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61bc066fc0 0x7f61bc069470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61d0069560 0x7f61d015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 --2- 172.21.15.22:0/1562212420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d0159890 0x7f61d00b3590 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 >> 172.21.15.22:0/1562212420 conn(0x7f61d0068e20 msgr2=0x7f61d01580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 shutdown_connections 2023-10-08T00:26:38.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:38.968+0000 7f61d6888700 1 -- 172.21.15.22:0/1562212420 wait complete. 2023-10-08T00:26:38.981 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:26:39.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.100+0000 7faf254cd700 1 Processor -- start 2023-10-08T00:26:39.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.100+0000 7faf254cd700 1 -- start start 2023-10-08T00:26:39.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.101+0000 7faf254cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 0x7faf2015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.101+0000 7faf254cd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2015a160 con 0x7faf20159c60 2023-10-08T00:26:39.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.101+0000 7faf254cd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf200d13a0 con 0x7faf20069560 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.101+0000 7faf254cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2015e140 con 0x7faf20159890 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.101+0000 7faf1e7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faf20159c60 0x7faf2015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55152/0 (socket says 172.21.15.22:55152) 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.101+0000 7faf1e7fc700 1 -- 172.21.15.22:0/1921464279 learned_addr learned my addr 172.21.15.22:0/1921464279 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 0x7faf2015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133511344 0 0) 0x7faf2015a160 con 0x7faf20159c60 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf0c003570 con 0x7faf20159c60 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109797771 0 0) 0x7faf200d13a0 con 0x7faf20069560 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2015a160 con 0x7faf20069560 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374445265 0 0) 0x7faf0c003570 con 0x7faf20159c60 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 msgr2=0x7faf2015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 0x7faf2015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 >> v1:172.21.15.192:6789/0 conn(0x7faf20069560 legacy=0x7faf200ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2015a3d0 con 0x7faf20159c60 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7faf08001470 con 0x7faf20159c60 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 >> v1:172.21.15.22:6789/0 conn(0x7faf20159c60 legacy=0x7faf2015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf0c003c20 0x7faf0c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 0x7faf0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf0c004d50 0x7faf0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2015e140 con 0x7faf0c003c20 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c00bbf0 con 0x7faf0c004d50 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c00bd60 con 0x7faf20159890 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf0c003c20 0x7faf0c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1e7fc700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 0x7faf0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1f7fe700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf0c004d50 0x7faf0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 -- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 msgr2=0x7faf0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf20159890 0x7faf0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 -- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf0c004d50 msgr2=0x7faf0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf0c004d50 0x7faf0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.102+0000 7faf1effd700 1 -- 172.21.15.22:0/1921464279 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c003570 con 0x7faf0c003c20 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf1effd700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf0c003c20 0x7faf0c004010 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faf10006f00 tx=0x7faf100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c4ee163ec4c675 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000e710 con 0x7faf0c003c20 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000e870 con 0x7faf0c003c20 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf1dffb700 1 -- 172.21.15.22:0/1921464279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000ec30 con 0x7faf0c003c20 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf254cd700 1 -- 172.21.15.22:0/1921464279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf0c003c20 msgr2=0x7faf0c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf254cd700 1 --2- 172.21.15.22:0/1921464279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf0c003c20 0x7faf0c004010 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faf10006f00 tx=0x7faf100091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf1f7fe700 1 -- 172.21.15.22:0/1921464279 reap_dead start 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf254cd700 1 -- 172.21.15.22:0/1921464279 shutdown_connections 2023-10-08T00:26:39.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf254cd700 1 -- 172.21.15.22:0/1921464279 >> 172.21.15.22:0/1921464279 conn(0x7faf20068e20 msgr2=0x7faf200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:39.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf254cd700 1 -- 172.21.15.22:0/1921464279 shutdown_connections 2023-10-08T00:26:39.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.103+0000 7faf254cd700 1 -- 172.21.15.22:0/1921464279 wait complete. 2023-10-08T00:26:39.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 Processor -- start 2023-10-08T00:26:39.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 -- start start 2023-10-08T00:26:39.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf0c003c20 0x7faf200ce090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf200cf710 0x7faf200c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 0x7faf200c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200c8250 con 0x7faf200c7de0 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200ce670 con 0x7faf200cf710 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf254cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf200ce950 con 0x7faf0c003c20 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf1f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 0x7faf200c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf1f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 0x7faf200c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36350/0 (socket says 172.21.15.22:36350) 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf1f7fe700 1 -- 172.21.15.22:0/758547602 learned_addr learned my addr 172.21.15.22:0/758547602 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf1effd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf0c003c20 0x7faf200ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.105+0000 7faf1e7fc700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf200cf710 0x7faf200c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf1f7fe700 1 -- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf0c003c20 msgr2=0x7faf200ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf1f7fe700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf0c003c20 0x7faf200ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf1f7fe700 1 -- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf200cf710 msgr2=0x7faf200c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf1f7fe700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf200cf710 0x7faf200c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf1f7fe700 1 -- 172.21.15.22:0/758547602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200cec30 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf1f7fe700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 0x7faf200c9fc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faf200b67f0 tx=0x7faf18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf180032e0 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf18003440 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf200cef10 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf18001910 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.106+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf200ca500 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.107+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf200cf430 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.107+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7faf18001cc0 con 0x7faf200c7de0 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.108+0000 7faf16ffd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf00066fc0 0x7faf00069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.108+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf18083ef0 con 0x7faf200c7de0 2023-10-08T00:26:39.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.108+0000 7faf1effd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf00066fc0 0x7faf00069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.108+0000 7faf1effd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf00066fc0 0x7faf00069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf100091e0 tx=0x7faf1001a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:39.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.112+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf200cf430 con 0x7faf200c7de0 2023-10-08T00:26:39.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.350+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf200cf430 con 0x7faf200c7de0 2023-10-08T00:26:39.350 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:26:39.350+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:26:39.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.353+0000 7faf16ffd700 1 -- 172.21.15.22:0/758547602 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf200cf430 con 0x7faf200c7de0 2023-10-08T00:26:39.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf00066fc0 msgr2=0x7faf00069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf00066fc0 0x7faf00069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faf100091e0 tx=0x7faf1001a000 comp rx=0 tx=0).stop 2023-10-08T00:26:39.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 msgr2=0x7faf200c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 0x7faf200c9fc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faf200b67f0 tx=0x7faf18009040 comp rx=0 tx=0).stop 2023-10-08T00:26:39.357 INFO:tasks.ceph.mds.a.smithi022.stderr: -1861> 2023-10-08T00:26:24.930+0000 7f6ba5c39700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:26:39.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 shutdown_connections 2023-10-08T00:26:39.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf200c7de0 0x7faf200c9fc0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf00066fc0 0x7faf00069470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf0c003c20 0x7faf200ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 --2- 172.21.15.22:0/758547602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf200cf710 0x7faf200c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 >> 172.21.15.22:0/758547602 conn(0x7faf20068e20 msgr2=0x7faf20152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 shutdown_connections 2023-10-08T00:26:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.356+0000 7faf254cd700 1 -- 172.21.15.22:0/758547602 wait complete. 2023-10-08T00:26:39.358 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:26:39.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:26:39.379 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:26:39.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 Processor -- start 2023-10-08T00:26:39.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 -- start start 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e7c159c60 0x7f2e7c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c15db10 0x7f2e7c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c15a160 con 0x7f2e7c159890 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c15df50 con 0x7f2e7c159c60 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.491+0000 7f2e81c56700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0d13a0 con 0x7f2e7c15db10 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e7c159c60 0x7f2e7c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e7c159c60 0x7f2e7c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36376/0 (socket says 172.21.15.22:36376) 2023-10-08T00:26:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 -- 172.21.15.22:0/308571953 learned_addr learned my addr 172.21.15.22:0/308571953 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7bfff700 1 --2- 172.21.15.22:0/308571953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c15db10 0x7f2e7c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 -- 172.21.15.22:0/308571953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c15db10 msgr2=0x7f2e7c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 --2- 172.21.15.22:0/308571953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c15db10 0x7f2e7c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 -- 172.21.15.22:0/308571953 >> v1:172.21.15.192:6789/0 conn(0x7f2e7c159890 legacy=0x7f2e7c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 -- 172.21.15.22:0/308571953 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c15e140 con 0x7f2e7c159c60 2023-10-08T00:26:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7affd700 1 --2- 172.21.15.22:0/308571953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159c60 0x7f2e7c15d5d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e700099b0 tx=0x7f2e70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffb4ba5d65d4639 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7a7fc700 1 -- 172.21.15.22:0/308571953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000b860 con 0x7f2e7c159c60 2023-10-08T00:26:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7a7fc700 1 -- 172.21.15.22:0/308571953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7000b9c0 con 0x7f2e7c159c60 2023-10-08T00:26:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.492+0000 7f2e7a7fc700 1 -- 172.21.15.22:0/308571953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000bd60 con 0x7f2e7c159c60 2023-10-08T00:26:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 -- 172.21.15.22:0/308571953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159c60 msgr2=0x7f2e7c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 --2- 172.21.15.22:0/308571953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159c60 0x7f2e7c15d5d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e700099b0 tx=0x7f2e70009250 comp rx=0 tx=0).stop 2023-10-08T00:26:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 -- 172.21.15.22:0/308571953 shutdown_connections 2023-10-08T00:26:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 --2- 172.21.15.22:0/308571953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c15db10 0x7f2e7c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 --2- 172.21.15.22:0/308571953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159c60 0x7f2e7c15d5d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 -- 172.21.15.22:0/308571953 >> 172.21.15.22:0/308571953 conn(0x7f2e7c068e20 msgr2=0x7f2e7c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 -- 172.21.15.22:0/308571953 shutdown_connections 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.493+0000 7f2e81c56700 1 -- 172.21.15.22:0/308571953 wait complete. 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.494+0000 7f2e81c56700 1 Processor -- start 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.494+0000 7f2e81c56700 1 -- start start 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e81c56700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 0x7f2e7c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e81c56700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c159c60 0x7f2e7c0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e81c56700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7c15db10 0x7f2e7c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e81c56700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c152900 con 0x7f2e7c159890 2023-10-08T00:26:39.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e81c56700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0b0d30 con 0x7f2e7c15db10 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e81c56700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0ca4c0 con 0x7f2e7c159c60 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 0x7f2e7c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 0x7f2e7c151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36382/0 (socket says 172.21.15.22:36382) 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 -- 172.21.15.22:0/2183375914 learned_addr learned my addr 172.21.15.22:0/2183375914 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7bfff700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7c15db10 0x7f2e7c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7affd700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c159c60 0x7f2e7c0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 -- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c159c60 msgr2=0x7f2e7c0b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c159c60 0x7f2e7c0b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 -- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7c15db10 msgr2=0x7f2e7c0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7c15db10 0x7f2e7c0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.495+0000 7f2e7b7fe700 1 -- 172.21.15.22:0/2183375914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700094f0 con 0x7f2e7c159890 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.496+0000 7f2e7b7fe700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 0x7f2e7c151df0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00c590 tx=0x7f2e6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.496+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c011590 con 0x7f2e7c159890 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.496+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0116f0 con 0x7f2e7c159890 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.496+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c0b06e0 con 0x7f2e7c159890 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.496+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c011ab0 con 0x7f2e7c159890 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.496+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c0b1700 con 0x7f2e7c159890 2023-10-08T00:26:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.497+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0b0540 con 0x7f2e7c159890 2023-10-08T00:26:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.497+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2e6c01b3b0 con 0x7f2e7c159890 2023-10-08T00:26:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.498+0000 7f2e637fe700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e68066fc0 0x7f2e68069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.498+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2e6c083af0 con 0x7f2e7c159890 2023-10-08T00:26:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.498+0000 7f2e7affd700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e68066fc0 0x7f2e68069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.498+0000 7f2e7affd700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e68066fc0 0x7f2e68069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e700099b0 tx=0x7f2e70017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.502+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e7c0b0540 con 0x7f2e7c159890 2023-10-08T00:26:39.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:39.743+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2e7c0b0540 con 0x7f2e7c159890 2023-10-08T00:26:40.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.355+0000 7f2e637fe700 1 -- 172.21.15.22:0/2183375914 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e7c0b0540 con 0x7f2e7c159890 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e68066fc0 msgr2=0x7f2e68069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e68066fc0 0x7f2e68069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e700099b0 tx=0x7f2e70017000 comp rx=0 tx=0).stop 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 msgr2=0x7f2e7c151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 0x7f2e7c151df0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00c590 tx=0x7f2e6c00c950 comp rx=0 tx=0).stop 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 shutdown_connections 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7c15db10 0x7f2e7c0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e7c159890 0x7f2e7c151df0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2e68066fc0 0x7f2e68069470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 --2- 172.21.15.22:0/2183375914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2e7c159c60 0x7f2e7c0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 >> 172.21.15.22:0/2183375914 conn(0x7f2e7c068e20 msgr2=0x7f2e7c0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 shutdown_connections 2023-10-08T00:26:40.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.358+0000 7f2e81c56700 1 -- 172.21.15.22:0/2183375914 wait complete. 2023-10-08T00:26:40.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:26:40.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.545+0000 7fae7aa65700 1 Processor -- start 2023-10-08T00:26:40.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.546+0000 7fae7aa65700 1 -- start start 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.546+0000 7fae7aa65700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae740b42c0 0x7fae740ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.546+0000 7fae7aa65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae740ceb60 0x7fae740cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.546+0000 7fae7aa65700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae740cefd0 con 0x7fae74155360 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.546+0000 7fae7aa65700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7415c320 con 0x7fae740ceb60 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.546+0000 7fae7aa65700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7415b710 con 0x7fae740b42c0 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae73fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae740b42c0 0x7fae740ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae79002700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae740ceb60 0x7fae740cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:40.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae73fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae740b42c0 0x7fae740ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:43588/0 (socket says 172.21.15.22:43588) 2023-10-08T00:26:40.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae73fff700 1 -- 172.21.15.22:0/100488035 learned_addr learned my addr 172.21.15.22:0/100488035 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae79002700 1 -- 172.21.15.22:0/100488035 >> v2:172.21.15.192:3300/0 conn(0x7fae740b42c0 msgr2=0x7fae740ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae79002700 1 --2- 172.21.15.22:0/100488035 >> v2:172.21.15.192:3300/0 conn(0x7fae740b42c0 0x7fae740ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae79002700 1 -- 172.21.15.22:0/100488035 >> v1:172.21.15.192:6789/0 conn(0x7fae74155360 legacy=0x7fae740b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae79002700 1 -- 172.21.15.22:0/100488035 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7415b9f0 con 0x7fae740ceb60 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae79002700 1 --2- 172.21.15.22:0/100488035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740cc9c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fae7406f6f0 tx=0x7fae640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a87d3112c70696 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae737fe700 1 -- 172.21.15.22:0/100488035 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64011630 con 0x7fae740ceb60 2023-10-08T00:26:40.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae737fe700 1 -- 172.21.15.22:0/100488035 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae64011790 con 0x7fae740ceb60 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.547+0000 7fae737fe700 1 -- 172.21.15.22:0/100488035 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64011b30 con 0x7fae740ceb60 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 -- 172.21.15.22:0/100488035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 msgr2=0x7fae740cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 --2- 172.21.15.22:0/100488035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740cc9c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fae7406f6f0 tx=0x7fae640091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 -- 172.21.15.22:0/100488035 shutdown_connections 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 --2- 172.21.15.22:0/100488035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740cc9c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 --2- 172.21.15.22:0/100488035 >> v2:172.21.15.192:3300/0 conn(0x7fae740b42c0 0x7fae740ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 -- 172.21.15.22:0/100488035 >> 172.21.15.22:0/100488035 conn(0x7fae7406baf0 msgr2=0x7fae7406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 -- 172.21.15.22:0/100488035 shutdown_connections 2023-10-08T00:26:40.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.548+0000 7fae7aa65700 1 -- 172.21.15.22:0/100488035 wait complete. 2023-10-08T00:26:40.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.549+0000 7fae7aa65700 1 Processor -- start 2023-10-08T00:26:40.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.549+0000 7fae7aa65700 1 -- start start 2023-10-08T00:26:40.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae7aa65700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae740b42c0 0x7fae74148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae7aa65700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae7aa65700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae74155360 0x7fae740c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae7aa65700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c3ef0 con 0x7fae740ceb60 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae7aa65700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c41d0 con 0x7fae74155360 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae7aa65700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c44b0 con 0x7fae740b42c0 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36400/0 (socket says 172.21.15.22:36400) 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 -- 172.21.15.22:0/659954914 learned_addr learned my addr 172.21.15.22:0/659954914 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae79002700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae74155360 0x7fae740c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae78801700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae740b42c0 0x7fae74148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 -- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae740b42c0 msgr2=0x7fae74148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:40.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae740b42c0 0x7fae74148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 -- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae74155360 msgr2=0x7fae740c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae74155360 0x7fae740c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.550+0000 7fae73fff700 1 -- 172.21.15.22:0/659954914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009420 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.551+0000 7fae73fff700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740c33c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fae6800ea20 tx=0x7fae68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.551+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800c640 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.551+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800c7a0 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.551+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae740c4790 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.551+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800cb60 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.551+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae741487a0 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.552+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7415b310 con 0x7fae740ceb60 2023-10-08T00:26:40.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.552+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fae68013470 con 0x7fae740ceb60 2023-10-08T00:26:40.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.553+0000 7fae70ff9700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae60066fc0 0x7fae60069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:40.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.553+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fae680849a0 con 0x7fae740ceb60 2023-10-08T00:26:40.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.553+0000 7fae78801700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae60066fc0 0x7fae60069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:40.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.553+0000 7fae78801700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae60066fc0 0x7fae60069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae6c007fd0 tx=0x7fae6c001650 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.557+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae68051bd0 con 0x7fae740ceb60 2023-10-08T00:26:40.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:40.752+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae740718b0 con 0x7fae740ceb60 2023-10-08T00:26:41.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.659+0000 7fae70ff9700 1 -- 172.21.15.22:0/659954914 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v54) v1 ==== 181+0+0 (secure 0 0 0) 0x7fae680551f0 con 0x7fae740ceb60 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae60066fc0 msgr2=0x7fae60069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae60066fc0 0x7fae60069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae6c007fd0 tx=0x7fae6c001650 comp rx=0 tx=0).stop 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 msgr2=0x7fae740c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740c33c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fae6800ea20 tx=0x7fae68009250 comp rx=0 tx=0).stop 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 shutdown_connections 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae74155360 0x7fae740c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae60066fc0 0x7fae60069470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae740b42c0 0x7fae74148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 --2- 172.21.15.22:0/659954914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae740ceb60 0x7fae740c33c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 >> 172.21.15.22:0/659954914 conn(0x7fae7406baf0 msgr2=0x7fae74154430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:41.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 shutdown_connections 2023-10-08T00:26:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.663+0000 7fae7aa65700 1 -- 172.21.15.22:0/659954914 wait complete. 2023-10-08T00:26:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:26:41.679 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:26:41.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.809+0000 7f202f59e700 1 Processor -- start 2023-10-08T00:26:41.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.809+0000 7f202f59e700 1 -- start start 2023-10-08T00:26:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202f59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f20300b03c0 0x7f20300cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20300b0790 0x7f20300b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20301591e0 0x7f2030159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202f59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300cfa00 con 0x7f20300b03c0 2023-10-08T00:26:41.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20300cb580 con 0x7f20301591e0 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20300b2de0 con 0x7f20300b0790 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f20300b03c0 0x7f20300cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f20300b03c0 0x7f20300cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36412/0 (socket says 172.21.15.22:36412) 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 -- 172.21.15.22:0/578157734 learned_addr learned my addr 172.21.15.22:0/578157734 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202dd9b700 1 --2- 172.21.15.22:0/578157734 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20300b0790 0x7f20300b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202ed9d700 1 --2- 172.21.15.22:0/578157734 >> v2:172.21.15.192:3300/0 conn(0x7f20301591e0 0x7f2030159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 -- 172.21.15.22:0/578157734 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20300b0790 msgr2=0x7f20300b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 --2- 172.21.15.22:0/578157734 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20300b0790 0x7f20300b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 -- 172.21.15.22:0/578157734 >> v2:172.21.15.192:3300/0 conn(0x7f20301591e0 msgr2=0x7f2030159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 --2- 172.21.15.22:0/578157734 >> v2:172.21.15.192:3300/0 conn(0x7f20301591e0 0x7f2030159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.810+0000 7f202e59c700 1 -- 172.21.15.22:0/578157734 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300cf160 con 0x7f20300b03c0 2023-10-08T00:26:41.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202e59c700 1 --2- 172.21.15.22:0/578157734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b03c0 0x7f20300cea70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb4f0 tx=0x7f2020009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb33cf209ffa8fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:41.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202d59a700 1 -- 172.21.15.22:0/578157734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000b860 con 0x7f20300b03c0 2023-10-08T00:26:41.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202d59a700 1 -- 172.21.15.22:0/578157734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202000b9c0 con 0x7f20300b03c0 2023-10-08T00:26:41.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202d59a700 1 -- 172.21.15.22:0/578157734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000bd60 con 0x7f20300b03c0 2023-10-08T00:26:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 -- 172.21.15.22:0/578157734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b03c0 msgr2=0x7f20300cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 --2- 172.21.15.22:0/578157734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b03c0 0x7f20300cea70 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb4f0 tx=0x7f2020009250 comp rx=0 tx=0).stop 2023-10-08T00:26:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 -- 172.21.15.22:0/578157734 shutdown_connections 2023-10-08T00:26:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 --2- 172.21.15.22:0/578157734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b03c0 0x7f20300cea70 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 --2- 172.21.15.22:0/578157734 >> v2:172.21.15.192:3300/0 conn(0x7f20301591e0 0x7f2030159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 --2- 172.21.15.22:0/578157734 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20300b0790 0x7f20300b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 -- 172.21.15.22:0/578157734 >> 172.21.15.22:0/578157734 conn(0x7f2030063230 msgr2=0x7f2030063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 -- 172.21.15.22:0/578157734 shutdown_connections 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.811+0000 7f202f59e700 1 -- 172.21.15.22:0/578157734 wait complete. 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 Processor -- start 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 -- start start 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20300b03c0 0x7f203014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 0x7f20300c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20301591e0 0x7f20300c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203015ad50 con 0x7f20300b0790 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203015cdb0 con 0x7f20300b03c0 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203015c1e0 con 0x7f20301591e0 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 0x7f20300c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 0x7f20300c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36422/0 (socket says 172.21.15.22:36422) 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202dd9b700 1 -- 172.21.15.22:0/2840191223 learned_addr learned my addr 172.21.15.22:0/2840191223 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.813+0000 7f202e59c700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20300b03c0 0x7f203014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202ed9d700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20301591e0 0x7f20300c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202dd9b700 1 -- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20301591e0 msgr2=0x7f20300c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202dd9b700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20301591e0 0x7f20300c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202dd9b700 1 -- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20300b03c0 msgr2=0x7f203014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202dd9b700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20300b03c0 0x7f203014b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202dd9b700 1 -- 172.21.15.22:0/2840191223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20200094f0 con 0x7f20300b0790 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202ed9d700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20301591e0 0x7f20300c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202dd9b700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 0x7f20300c8c80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f202400d890 tx=0x7f2024008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240125f0 con 0x7f20300b0790 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2024012770 con 0x7f20300b0790 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203015c480 con 0x7f20300b0790 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024012b30 con 0x7f20300b0790 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.814+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203015ca40 con 0x7f20300b0790 2023-10-08T00:26:41.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.815+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203015cf40 con 0x7f20300b0790 2023-10-08T00:26:41.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.815+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f202401e460 con 0x7f20300b0790 2023-10-08T00:26:41.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.816+0000 7f201e7fc700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2010066fc0 0x7f2010069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:41.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.816+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2024084a30 con 0x7f20300b0790 2023-10-08T00:26:41.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.816+0000 7f202e59c700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2010066fc0 0x7f2010069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:41.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.817+0000 7f202e59c700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2010066fc0 0x7f2010069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb4f0 tx=0x7f2020017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:41.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:41.820+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2024051e10 con 0x7f20300b0790 2023-10-08T00:26:42.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.011+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f203004c3c0 con 0x7f20300b0790 2023-10-08T00:26:42.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.664+0000 7f201e7fc700 1 -- 172.21.15.22:0/2840191223 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v55) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2024055430 con 0x7f20300b0790 2023-10-08T00:26:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2010066fc0 msgr2=0x7f2010069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2010066fc0 0x7f2010069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f20300cb4f0 tx=0x7f2020017000 comp rx=0 tx=0).stop 2023-10-08T00:26:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 msgr2=0x7f20300c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 0x7f20300c8c80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f202400d890 tx=0x7f2024008040 comp rx=0 tx=0).stop 2023-10-08T00:26:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 shutdown_connections 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2010066fc0 0x7f2010069470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20301591e0 0x7f20300c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20300b03c0 0x7f203014b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 --2- 172.21.15.22:0/2840191223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20300b0790 0x7f20300c8c80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 >> 172.21.15.22:0/2840191223 conn(0x7f2030063230 msgr2=0x7f20300b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.667+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 shutdown_connections 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.668+0000 7f202f59e700 1 -- 172.21.15.22:0/2840191223 wait complete. 2023-10-08T00:26:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:26:42.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:26:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.805+0000 7f0e80a89700 1 Processor -- start 2023-10-08T00:26:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.805+0000 7f0e80a89700 1 -- start start 2023-10-08T00:26:42.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.806+0000 7f0e80a89700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 0x7f0e7c068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.806+0000 7f0e80a89700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c15c480 con 0x7f0e7c068bb0 2023-10-08T00:26:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.806+0000 7f0e80a89700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c15b870 con 0x7f0e7c159c10 2023-10-08T00:26:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.806+0000 7f0e80a89700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0b2a40 con 0x7f0e7c0b5ea0 2023-10-08T00:26:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.806+0000 7f0e7ad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0e7c068bb0 0x7f0e7c15c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55166/0 (socket says 172.21.15.22:55166) 2023-10-08T00:26:42.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.806+0000 7f0e7ad9d700 1 -- 172.21.15.22:0/601215580 learned_addr learned my addr 172.21.15.22:0/601215580 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 0x7f0e7c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363735601 0 0) 0x7f0e7c15c480 con 0x7f0e7c068bb0 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e68003570 con 0x7f0e7c068bb0 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994635961 0 0) 0x7f0e68003570 con 0x7f0e7c068bb0 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 msgr2=0x7f0e7c068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 0x7f0e7c068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 >> v1:172.21.15.192:6789/0 conn(0x7f0e7c159c10 legacy=0x7f0e7c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c15bb50 con 0x7f0e7c068bb0 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f0e740017f0 con 0x7f0e7c068bb0 2023-10-08T00:26:42.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 >> v1:172.21.15.22:6789/0 conn(0x7f0e7c068bb0 legacy=0x7f0e7c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68003a90 0x7f0e68003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e68004810 0x7f0e68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 0x7f0e680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6800bb10 con 0x7f0e68004810 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6800bc50 con 0x7f0e68003a90 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6800be10 con 0x7f0e7c0b5ea0 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e68004810 0x7f0e68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7a59c700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68003a90 0x7f0e68003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7ad9d700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 0x7f0e680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 -- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 msgr2=0x7f0e680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c0b5ea0 0x7f0e680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 -- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68003a90 msgr2=0x7f0e68003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68003a90 0x7f0e68003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e79d9b700 1 -- 172.21.15.22:0/601215580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68003570 con 0x7f0e68004810 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.807+0000 7f0e7a59c700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68003a90 0x7f0e68003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e79d9b700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e68004810 0x7f0e68004c80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009c00 tx=0x7f0e640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde24d91311eb086 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400e710 con 0x7f0e68004810 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6400e870 con 0x7f0e68004810 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e7959a700 1 -- 172.21.15.22:0/601215580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6400ec30 con 0x7f0e68004810 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e80a89700 1 -- 172.21.15.22:0/601215580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e68004810 msgr2=0x7f0e68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e80a89700 1 --2- 172.21.15.22:0/601215580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e68004810 0x7f0e68004c80 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009c00 tx=0x7f0e640091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e7ad9d700 1 -- 172.21.15.22:0/601215580 reap_dead start 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e80a89700 1 -- 172.21.15.22:0/601215580 shutdown_connections 2023-10-08T00:26:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e80a89700 1 -- 172.21.15.22:0/601215580 >> 172.21.15.22:0/601215580 conn(0x7f0e7c099a20 msgr2=0x7f0e7c0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e80a89700 1 -- 172.21.15.22:0/601215580 shutdown_connections 2023-10-08T00:26:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.808+0000 7f0e80a89700 1 -- 172.21.15.22:0/601215580 wait complete. 2023-10-08T00:26:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.809+0000 7f0e80a89700 1 Processor -- start 2023-10-08T00:26:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.809+0000 7f0e80a89700 1 -- start start 2023-10-08T00:26:42.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e80a89700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68004810 0x7f0e7c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e80a89700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c14bca0 0x7f0e7c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e80a89700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 0x7f0e7c0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e80a89700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0b0d20 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e80a89700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c5930 con 0x7f0e68004810 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e80a89700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0c8120 con 0x7f0e7c14bca0 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e7ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 0x7f0e7c0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e7ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 0x7f0e7c0c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36438/0 (socket says 172.21.15.22:36438) 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e7ad9d700 1 -- 172.21.15.22:0/3223248064 learned_addr learned my addr 172.21.15.22:0/3223248064 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e79d9b700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c14bca0 0x7f0e7c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.810+0000 7f0e7a59c700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68004810 0x7f0e7c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e7ad9d700 1 -- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c14bca0 msgr2=0x7f0e7c0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e7ad9d700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c14bca0 0x7f0e7c0b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e7ad9d700 1 -- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68004810 msgr2=0x7f0e7c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e7ad9d700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68004810 0x7f0e7c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e7ad9d700 1 -- 172.21.15.22:0/3223248064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0c7b60 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e7ad9d700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 0x7f0e7c0c6ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c063d50 tx=0x7f0e74001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400eb10 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7400ec90 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74013420 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c0c7e40 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.811+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0c7400 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.812+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c04c3c0 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.812+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0e740137b0 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.813+0000 7f0e727fc700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e5c067040 0x7f0e5c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.813+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0e74084820 con 0x7f0e7c0b08b0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.813+0000 7f0e7a59c700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e5c067040 0x7f0e5c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.813+0000 7f0e7a59c700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e5c067040 0x7f0e5c0694f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c000c00 tx=0x7f0e6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:42.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:42.817+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e74051ca0 con 0x7f0e7c0b08b0 2023-10-08T00:26:43.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.011+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0e7c15be30 con 0x7f0e7c0b08b0 2023-10-08T00:26:43.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.014+0000 7f0e727fc700 1 -- 172.21.15.22:0/3223248064 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e740552c0 con 0x7f0e7c0b08b0 2023-10-08T00:26:43.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e5c067040 msgr2=0x7f0e5c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e5c067040 0x7f0e5c0694f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c000c00 tx=0x7f0e6c009040 comp rx=0 tx=0).stop 2023-10-08T00:26:43.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 msgr2=0x7f0e7c0c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 0x7f0e7c0c6ec0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c063d50 tx=0x7f0e74001330 comp rx=0 tx=0).stop 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 shutdown_connections 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e7c0b08b0 0x7f0e7c0c6ec0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e68004810 0x7f0e7c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e5c067040 0x7f0e5c0694f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 --2- 172.21.15.22:0/3223248064 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e7c14bca0 0x7f0e7c0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 >> 172.21.15.22:0/3223248064 conn(0x7f0e7c099a20 msgr2=0x7f0e7c0b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 shutdown_connections 2023-10-08T00:26:43.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.016+0000 7f0e80a89700 1 -- 172.21.15.22:0/3223248064 wait complete. 2023-10-08T00:26:43.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-08T00:26:43.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.148+0000 7f4489a4e700 1 Processor -- start 2023-10-08T00:26:43.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.148+0000 7f4489a4e700 1 -- start start 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4489a4e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4484159890 0x7f448415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4489a4e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f44840699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4489a4e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4484069ee0 con 0x7f4484159c60 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4489a4e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448415a160 con 0x7f4484159890 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4489a4e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44840d13a0 con 0x7f4484069560 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4484159890 0x7f448415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4484159890 0x7f448415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36446/0 (socket says 172.21.15.22:36446) 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 -- 172.21.15.22:0/3209194153 learned_addr learned my addr 172.21.15.22:0/3209194153 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:43.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f44837fe700 1 --2- 172.21.15.22:0/3209194153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f44840699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 -- 172.21.15.22:0/3209194153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 msgr2=0x7f44840699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 --2- 172.21.15.22:0/3209194153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f44840699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 -- 172.21.15.22:0/3209194153 >> v1:172.21.15.192:6789/0 conn(0x7f4484159c60 legacy=0x7f448415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 -- 172.21.15.22:0/3209194153 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448415e140 con 0x7f4484159890 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4482ffd700 1 --2- 172.21.15.22:0/3209194153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159890 0x7f448415abd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f44740099b0 tx=0x7f4474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1859b1996fcf3d80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4481ffb700 1 -- 172.21.15.22:0/3209194153 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400b860 con 0x7f4484159890 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4481ffb700 1 -- 172.21.15.22:0/3209194153 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447400b9c0 con 0x7f4484159890 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.149+0000 7f4481ffb700 1 -- 172.21.15.22:0/3209194153 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400bd60 con 0x7f4484159890 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 -- 172.21.15.22:0/3209194153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159890 msgr2=0x7f448415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 --2- 172.21.15.22:0/3209194153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159890 0x7f448415abd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f44740099b0 tx=0x7f4474009250 comp rx=0 tx=0).stop 2023-10-08T00:26:43.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 -- 172.21.15.22:0/3209194153 shutdown_connections 2023-10-08T00:26:43.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 --2- 172.21.15.22:0/3209194153 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f44840699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 --2- 172.21.15.22:0/3209194153 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159890 0x7f448415abd0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 -- 172.21.15.22:0/3209194153 >> 172.21.15.22:0/3209194153 conn(0x7f4484068e20 msgr2=0x7f44840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:43.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 -- 172.21.15.22:0/3209194153 shutdown_connections 2023-10-08T00:26:43.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.150+0000 7f4489a4e700 1 -- 172.21.15.22:0/3209194153 wait complete. 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.151+0000 7f4489a4e700 1 Processor -- start 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.151+0000 7f4489a4e700 1 -- start start 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4489a4e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f4484158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4489a4e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484159890 0x7f44840b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4489a4e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 0x7f44840b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4489a4e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840cd0c0 con 0x7f4484159c60 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4489a4e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44840cd360 con 0x7f4484159890 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4489a4e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44840b40d0 con 0x7f4484069560 2023-10-08T00:26:43.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f44837fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 0x7f44840b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f44837fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 0x7f44840b5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36450/0 (socket says 172.21.15.22:36450) 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f44837fe700 1 -- 172.21.15.22:0/2021985722 learned_addr learned my addr 172.21.15.22:0/2021985722 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f4482ffd700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f4484158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.152+0000 7f44827fc700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484159890 0x7f44840b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44837fe700 1 -- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 msgr2=0x7f4484158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44837fe700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f4484158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44837fe700 1 -- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484159890 msgr2=0x7f44840b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44837fe700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484159890 0x7f44840b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44837fe700 1 -- 172.21.15.22:0/2021985722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740094f0 con 0x7f4484159c60 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44827fc700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484159890 0x7f44840b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:43.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f44837fe700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 0x7f44840b5410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f447c007f20 tx=0x7f447c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c00ebf0 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c00ed70 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44840b43b0 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c014670 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.153+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44840cfb90 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.154+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44840cfd80 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.154+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f447c0149e0 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.155+0000 7f446affd700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4470066fc0 0x7f4470069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.155+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f447c084890 con 0x7f4484159c60 2023-10-08T00:26:43.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.155+0000 7f4482ffd700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4470066fc0 0x7f4470069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.155+0000 7f4482ffd700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4470066fc0 0x7f4470069470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f44740099b0 tx=0x7f4474017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:43.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.159+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44840cfd80 con 0x7f4484159c60 2023-10-08T00:26:43.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.431+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f44840cfd80 con 0x7f4484159c60 2023-10-08T00:26:43.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.665+0000 7f446affd700 1 -- 172.21.15.22:0/2021985722 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v120) v1 ==== 133+0+0 (secure 0 0 0) 0x7f44840cfd80 con 0x7f4484159c60 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4470066fc0 msgr2=0x7f4470069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4470066fc0 0x7f4470069470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f44740099b0 tx=0x7f4474017000 comp rx=0 tx=0).stop 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 msgr2=0x7f44840b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 0x7f44840b5410 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f447c007f20 tx=0x7f447c009860 comp rx=0 tx=0).stop 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 shutdown_connections 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4484159c60 0x7f44840b5410 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4470066fc0 0x7f4470069470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4484069560 0x7f4484158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 --2- 172.21.15.22:0/2021985722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484159890 0x7f44840b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 >> 172.21.15.22:0/2021985722 conn(0x7f4484068e20 msgr2=0x7f44840d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 shutdown_connections 2023-10-08T00:26:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.667+0000 7f4489a4e700 1 -- 172.21.15.22:0/2021985722 wait complete. 2023-10-08T00:26:43.680 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-10-08T00:26:43.680 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-10-08T00:26:43.680 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:26:43.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-08T00:26:43.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.799+0000 7f711fc83700 1 Processor -- start 2023-10-08T00:26:43.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711fc83700 1 -- start start 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711fc83700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7118159c60 0x7f711815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711fc83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 0x7f7118069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711fc83700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711815a160 con 0x7f7118159890 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711fc83700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711815df50 con 0x7f7118159c60 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711fc83700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180d13a0 con 0x7f711815db10 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711da1f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7118159890 0x7f711815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55182/0 (socket says 172.21.15.22:55182) 2023-10-08T00:26:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.800+0000 7f711da1f700 1 -- 172.21.15.22:0/1455534532 learned_addr learned my addr 172.21.15.22:0/1455534532 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839523589 0 0) 0x7f711815a160 con 0x7f7118159890 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711e220700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 0x7f7118069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711d21e700 1 --2- 172.21.15.22:0/1455534532 >> v2:172.21.15.192:3300/0 conn(0x7f7118159c60 0x7f711815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7100003570 con 0x7f7118159890 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536471680 0 0) 0x7f7100003570 con 0x7f7118159890 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 msgr2=0x7f7118069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 0x7f7118069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 >> v2:172.21.15.192:3300/0 conn(0x7f7118159c60 msgr2=0x7f711815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 --2- 172.21.15.22:0/1455534532 >> v2:172.21.15.192:3300/0 conn(0x7f7118159c60 0x7f711815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711815e140 con 0x7f7118159890 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f71080017f0 con 0x7f7118159890 2023-10-08T00:26:43.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 >> v1:172.21.15.22:6789/0 conn(0x7f7118159890 legacy=0x7f711815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7100003a60 0x7f7100003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 0x7f7100004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7100004d50 0x7f71000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180d13a0 con 0x7f7100003a60 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710000ba60 con 0x7f7100004d50 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710000bba0 con 0x7f711815db10 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711da1f700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7100003a60 0x7f7100003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711e220700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7100004d50 0x7f71000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711d21e700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 0x7f7100004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711da1f700 1 -- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 msgr2=0x7f7100004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711da1f700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f711815db10 0x7f7100004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711da1f700 1 -- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7100004d50 msgr2=0x7f71000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711da1f700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7100004d50 0x7f71000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711da1f700 1 -- 172.21.15.22:0/1455534532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100003570 con 0x7f7100003a60 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.801+0000 7f711e220700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7100004d50 0x7f71000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711da1f700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7100003a60 0x7f7100003e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f710800a970 tx=0x7f7108002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0af15ffaae0dcc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108012440 con 0x7f7100003a60 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71080125c0 con 0x7f7100003a60 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711ca1d700 1 -- 172.21.15.22:0/1455534532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7108012980 con 0x7f7100003a60 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711fc83700 1 -- 172.21.15.22:0/1455534532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7100003a60 msgr2=0x7f7100003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711fc83700 1 --2- 172.21.15.22:0/1455534532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7100003a60 0x7f7100003e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f710800a970 tx=0x7f7108002210 comp rx=0 tx=0).stop 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711e220700 1 -- 172.21.15.22:0/1455534532 reap_dead start 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711fc83700 1 -- 172.21.15.22:0/1455534532 shutdown_connections 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711fc83700 1 -- 172.21.15.22:0/1455534532 >> 172.21.15.22:0/1455534532 conn(0x7f7118068e20 msgr2=0x7f71180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:43.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711fc83700 1 -- 172.21.15.22:0/1455534532 shutdown_connections 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.802+0000 7f711fc83700 1 -- 172.21.15.22:0/1455534532 wait complete. 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.803+0000 7f711fc83700 1 Processor -- start 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.803+0000 7f711fc83700 1 -- start start 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711fc83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7100003a60 0x7f711814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711fc83700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71180cd8d0 0x7f71180cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711fc83700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 0x7f7118151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711fc83700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180ce280 con 0x7f7118151a50 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711fc83700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118153400 con 0x7f71180cd8d0 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711fc83700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71181527f0 con 0x7f7100003a60 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711e220700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 0x7f7118151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711e220700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 0x7f7118151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36464/0 (socket says 172.21.15.22:36464) 2023-10-08T00:26:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711e220700 1 -- 172.21.15.22:0/3235498205 learned_addr learned my addr 172.21.15.22:0/3235498205 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711d21e700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71180cd8d0 0x7f71180cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.804+0000 7f711da1f700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7100003a60 0x7f711814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711e220700 1 -- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7100003a60 msgr2=0x7f711814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711e220700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7100003a60 0x7f711814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711e220700 1 -- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71180cd8d0 msgr2=0x7f71180cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711e220700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71180cd8d0 0x7f71180cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711e220700 1 -- 172.21.15.22:0/3235498205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118152ad0 con 0x7f7118151a50 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711e220700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 0x7f7118151ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f71180cadc0 tx=0x7f7110008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110011e70 con 0x7f7118151a50 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7110015670 con 0x7f7118151a50 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7118152db0 con 0x7f7118151a50 2023-10-08T00:26:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110015a30 con 0x7f7118151a50 2023-10-08T00:26:43.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.805+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711814c910 con 0x7f7118151a50 2023-10-08T00:26:43.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.806+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711804c3c0 con 0x7f7118151a50 2023-10-08T00:26:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.806+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7110020460 con 0x7f7118151a50 2023-10-08T00:26:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.807+0000 7f7115ffb700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7104066fc0 0x7f7104069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.807+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7110084330 con 0x7f7118151a50 2023-10-08T00:26:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.807+0000 7f711da1f700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7104066fc0 0x7f7104069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.807+0000 7f711da1f700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7104066fc0 0x7f7104069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f710800afd0 tx=0x7f7108015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:43.811+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7110055240 con 0x7f7118151a50 2023-10-08T00:26:44.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.085+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f711815b0c0 con 0x7f7118151a50 2023-10-08T00:26:44.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.671+0000 7f7115ffb700 1 -- 172.21.15.22:0/3235498205 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v121) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7110054dd0 con 0x7f7118151a50 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7104066fc0 msgr2=0x7f7104069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7104066fc0 0x7f7104069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f710800afd0 tx=0x7f7108015000 comp rx=0 tx=0).stop 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 msgr2=0x7f7118151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 0x7f7118151ed0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f71180cadc0 tx=0x7f7110008040 comp rx=0 tx=0).stop 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 shutdown_connections 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7118151a50 0x7f7118151ed0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7104066fc0 0x7f7104069470 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7100003a60 0x7f711814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 --2- 172.21.15.22:0/3235498205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71180cd8d0 0x7f71180cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 >> 172.21.15.22:0/3235498205 conn(0x7f7118068e20 msgr2=0x7f7118154860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:44.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 shutdown_connections 2023-10-08T00:26:44.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.674+0000 7f711fc83700 1 -- 172.21.15.22:0/3235498205 wait complete. 2023-10-08T00:26:44.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:26:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.811+0000 7f1f56c9f700 1 Processor -- start 2023-10-08T00:26:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.811+0000 7f1f56c9f700 1 -- start start 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f56c9f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f500b4e70 0x7f1f500ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f56c9f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f500cfb00 con 0x7f1f500b1b40 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f56c9f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5015e060 con 0x7f1f500b16d0 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f56c9f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f500b5c40 con 0x7f1f500b4e70 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f55c9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f500b4e70 0x7f1f500ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f5649e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1f500b1b40 0x7f1f5015d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55184/0 (socket says 172.21.15.22:55184) 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f5649e700 1 -- 172.21.15.22:0/2336879180 learned_addr learned my addr 172.21.15.22:0/2336879180 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f55c9d700 1 -- 172.21.15.22:0/2336879180 >> v1:172.21.15.192:6789/0 conn(0x7f1f500b16d0 legacy=0x7f1f5015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f55c9d700 1 -- 172.21.15.22:0/2336879180 >> v1:172.21.15.22:6789/0 conn(0x7f1f500b1b40 legacy=0x7f1f5015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f55c9d700 1 -- 172.21.15.22:0/2336879180 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500b5f20 con 0x7f1f500b4e70 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.812+0000 7f1f54c9b700 1 -- 172.21.15.22:0/2336879180 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509127282 0 0) 0x7f1f500cfb00 con 0x7f1f500b1b40 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f55c9d700 1 --2- 172.21.15.22:0/2336879180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500ccff0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1f480098e0 tx=0x7f1f480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a57febdc74e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f54c9b700 1 -- 172.21.15.22:0/2336879180 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48009e80 con 0x7f1f500b4e70 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f54c9b700 1 -- 172.21.15.22:0/2336879180 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4800b820 con 0x7f1f500b4e70 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f54c9b700 1 -- 172.21.15.22:0/2336879180 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800bba0 con 0x7f1f500b4e70 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 -- 172.21.15.22:0/2336879180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 msgr2=0x7f1f500ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/2336879180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500ccff0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1f480098e0 tx=0x7f1f480091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 -- 172.21.15.22:0/2336879180 shutdown_connections 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/2336879180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500ccff0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 -- 172.21.15.22:0/2336879180 >> 172.21.15.22:0/2336879180 conn(0x7f1f500d10c0 msgr2=0x7f1f500affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 -- 172.21.15.22:0/2336879180 shutdown_connections 2023-10-08T00:26:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.813+0000 7f1f56c9f700 1 -- 172.21.15.22:0/2336879180 wait complete. 2023-10-08T00:26:44.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.814+0000 7f1f56c9f700 1 Processor -- start 2023-10-08T00:26:44.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.814+0000 7f1f56c9f700 1 -- start start 2023-10-08T00:26:44.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f56c9f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f500b16d0 0x7f1f5014c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:44.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f56c9f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f500b1b40 0x7f1f5016a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f56c9f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f56c9f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c94c0 con 0x7f1f500b4e70 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f56c9f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c88b0 con 0x7f1f500b16d0 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f56c9f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c8b90 con 0x7f1f500b1b40 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f5649e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f5649e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36486/0 (socket says 172.21.15.22:36486) 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.815+0000 7f1f5649e700 1 -- 172.21.15.22:0/480079428 learned_addr learned my addr 172.21.15.22:0/480079428 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f55c9d700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f500b16d0 0x7f1f5014c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5549c700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f500b1b40 0x7f1f5016a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5649e700 1 -- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f500b1b40 msgr2=0x7f1f5016a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:44.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5649e700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f500b1b40 0x7f1f5016a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5649e700 1 -- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f500b16d0 msgr2=0x7f1f5014c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5649e700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f500b16d0 0x7f1f5014c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5649e700 1 -- 172.21.15.22:0/480079428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009420 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f5649e700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500c6950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000cc90 tx=0x7f1f40001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000cea0 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4000ab70 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500c8e70 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f400070f0 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.816+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5014c580 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.817+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f50088990 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.817+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1f400074a0 con 0x7f1f500b4e70 2023-10-08T00:26:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.818+0000 7f1f4dffb700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f3c066fc0 0x7f1f3c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.818+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1f400846c0 con 0x7f1f500b4e70 2023-10-08T00:26:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.818+0000 7f1f55c9d700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f3c066fc0 0x7f1f3c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.819+0000 7f1f55c9d700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f3c066fc0 0x7f1f3c069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1f480091e0 tx=0x7f1f48016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:44.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:44.822+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f40051cc0 con 0x7f1f500b4e70 2023-10-08T00:26:45.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.016+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1f50157690 con 0x7f1f500b4e70 2023-10-08T00:26:45.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.019+0000 7f1f4dffb700 1 -- 172.21.15.22:0/480079428 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1f400552e0 con 0x7f1f500b4e70 2023-10-08T00:26:45.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f3c066fc0 msgr2=0x7f1f3c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f3c066fc0 0x7f1f3c069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1f480091e0 tx=0x7f1f48016000 comp rx=0 tx=0).stop 2023-10-08T00:26:45.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 msgr2=0x7f1f500c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500c6950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000cc90 tx=0x7f1f40001a80 comp rx=0 tx=0).stop 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 shutdown_connections 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f500b4e70 0x7f1f500c6950 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f500b16d0 0x7f1f5014c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f3c066fc0 0x7f1f3c069470 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 --2- 172.21.15.22:0/480079428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f500b1b40 0x7f1f5016a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 >> 172.21.15.22:0/480079428 conn(0x7f1f500d10c0 msgr2=0x7f1f500ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 shutdown_connections 2023-10-08T00:26:45.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.021+0000 7f1f56c9f700 1 -- 172.21.15.22:0/480079428 wait complete. 2023-10-08T00:26:45.034 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:26:45.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:26:45.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:26:45.124 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:26:45.125 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:26:45.125 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:45.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.243+0000 7fbce6fa1700 1 Processor -- start 2023-10-08T00:26:45.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 -- start start 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159420 0x7fbce00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbce01597f0 0x7fbce00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbce015d230 0x7fbce015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce015dbd0 con 0x7fbce01597f0 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00b11d0 con 0x7fbce015d230 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.244+0000 7fbce6fa1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00b14b0 con 0x7fbce0159420 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbce01597f0 0x7fbce00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbce01597f0 0x7fbce00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36488/0 (socket says 172.21.15.22:36488) 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 -- 172.21.15.22:0/1352378426 learned_addr learned my addr 172.21.15.22:0/1352378426 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:45.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce67a0700 1 --2- 172.21.15.22:0/1352378426 >> v2:172.21.15.192:3300/0 conn(0x7fbce015d230 0x7fbce015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce5f9f700 1 --2- 172.21.15.22:0/1352378426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159420 0x7fbce00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 -- 172.21.15.22:0/1352378426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159420 msgr2=0x7fbce00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 --2- 172.21.15.22:0/1352378426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159420 0x7fbce00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 -- 172.21.15.22:0/1352378426 >> v2:172.21.15.192:3300/0 conn(0x7fbce015d230 msgr2=0x7fbce015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 --2- 172.21.15.22:0/1352378426 >> v2:172.21.15.192:3300/0 conn(0x7fbce015d230 0x7fbce015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 -- 172.21.15.22:0/1352378426 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce00b1790 con 0x7fbce01597f0 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce579e700 1 --2- 172.21.15.22:0/1352378426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce00b2270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbce00d1720 tx=0x7fbcd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98b8473671f2595 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce4f9d700 1 -- 172.21.15.22:0/1352378426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400b860 con 0x7fbce01597f0 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce4f9d700 1 -- 172.21.15.22:0/1352378426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd400b9c0 con 0x7fbce01597f0 2023-10-08T00:26:45.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.245+0000 7fbce4f9d700 1 -- 172.21.15.22:0/1352378426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400bd60 con 0x7fbce01597f0 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 -- 172.21.15.22:0/1352378426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 msgr2=0x7fbce00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/1352378426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce00b2270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbce00d1720 tx=0x7fbcd4009250 comp rx=0 tx=0).stop 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 -- 172.21.15.22:0/1352378426 shutdown_connections 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/1352378426 >> v2:172.21.15.192:3300/0 conn(0x7fbce015d230 0x7fbce015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/1352378426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159420 0x7fbce00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/1352378426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce00b2270 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 -- 172.21.15.22:0/1352378426 >> 172.21.15.22:0/1352378426 conn(0x7fbce00d0660 msgr2=0x7fbce00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 -- 172.21.15.22:0/1352378426 shutdown_connections 2023-10-08T00:26:45.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.246+0000 7fbce6fa1700 1 -- 172.21.15.22:0/1352378426 wait complete. 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.247+0000 7fbce6fa1700 1 Processor -- start 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.247+0000 7fbce6fa1700 1 -- start start 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce6fa1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159420 0x7fbce014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce6fa1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce01540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce6fa1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce015d230 0x7fbce014d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce6fa1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce014e810 con 0x7fbce01597f0 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce6fa1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce014f670 con 0x7fbce0159420 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce6fa1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0150040 con 0x7fbce015d230 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce01540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce01540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36496/0 (socket says 172.21.15.22:36496) 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 -- 172.21.15.22:0/4059395319 learned_addr learned my addr 172.21.15.22:0/4059395319 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:45.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce5f9f700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159420 0x7fbce014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce67a0700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce015d230 0x7fbce014d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 -- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce015d230 msgr2=0x7fbce014d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce015d230 0x7fbce014d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 -- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159420 msgr2=0x7fbce014fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159420 0x7fbce014fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 -- 172.21.15.22:0/4059395319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40094f0 con 0x7fbce01597f0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.248+0000 7fbce579e700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce01540b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006fd0 tx=0x7fbcd4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.249+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011d80 con 0x7fbce01597f0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.249+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4024440 con 0x7fbce01597f0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.249+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce014ea60 con 0x7fbce01597f0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.249+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4024800 con 0x7fbce01597f0 2023-10-08T00:26:45.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.249+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce014f020 con 0x7fbce01597f0 2023-10-08T00:26:45.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.250+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce014f800 con 0x7fbce01597f0 2023-10-08T00:26:45.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.250+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fbcd401a420 con 0x7fbce01597f0 2023-10-08T00:26:45.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.251+0000 7fbcddffb700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbccc066fc0 0x7fbccc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:45.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.251+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fbcd4086160 con 0x7fbce01597f0 2023-10-08T00:26:45.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.251+0000 7fbce5f9f700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbccc066fc0 0x7fbccc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:45.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.251+0000 7fbce5f9f700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbccc066fc0 0x7fbccc069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006fd0 tx=0x7fbcd8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:45.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.255+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcd40536e0 con 0x7fbce01597f0 2023-10-08T00:26:45.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.494+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbce004c3c0 con 0x7fbce01597f0 2023-10-08T00:26:45.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.495+0000 7fbcddffb700 1 -- 172.21.15.22:0/4059395319 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fbcd4015de0 con 0x7fbce01597f0 2023-10-08T00:26:45.495 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:45.496 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1531483121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1531483121},{"type":"v1","addr":"172.21.15.192:6835","nonce":1531483121}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3177548768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3177548768},{"type":"v1","addr":"172.21.15.192:6837","nonce":3177548768}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5346,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1760591913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1760591913},{"type":"v1","addr":"172.21.15.22:6834","nonce":1760591913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":5643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/772040543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":772040543},{"type":"v1","addr":"172.21.15.22:6835","nonce":772040543}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbccc066fc0 msgr2=0x7fbccc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbccc066fc0 0x7fbccc069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8006fd0 tx=0x7fbcd8008040 comp rx=0 tx=0).stop 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 msgr2=0x7fbce01540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce01540b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4006fd0 tx=0x7fbcd4017000 comp rx=0 tx=0).stop 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 shutdown_connections 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbccc066fc0 0x7fbccc069470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce015d230 0x7fbce014d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159420 0x7fbce014fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 --2- 172.21.15.22:0/4059395319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce01597f0 0x7fbce01540b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:45.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 >> 172.21.15.22:0/4059395319 conn(0x7fbce00d0660 msgr2=0x7fbce00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:45.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 shutdown_connections 2023-10-08T00:26:45.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:45.497+0000 7fbce6fa1700 1 -- 172.21.15.22:0/4059395319 wait complete. 2023-10-08T00:26:45.499 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 35 2023-10-08T00:26:45.510 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:26:45.510 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:26:45.510 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:26:45.510 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:45.510 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:26:45.511 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:26:45.511 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:26:45.511 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:45.511 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:26:45.511 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:26:45.512 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:26:45.512 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:45.512 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:26:45.512 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:26:45.512 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:26:45.513 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:26:45.519 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:26:45.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:26:45.520 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:26:45.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:26:45.523 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:26:45.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:26:45.562 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:26:45.562 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:45.562 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:26:45.563 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:45.566 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:26:45.566 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:45.636 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:26:45.637 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:26:45.645 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:26:46.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-08T00:26:51.524 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:26:51.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:26:51.527 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:26:51.527 DEBUG:teuthology.parallel:result is None 2023-10-08T00:26:51.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:26:51.607 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:26:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.659+0000 7f4a200ab700 1 Processor -- start 2023-10-08T00:26:51.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.659+0000 7f4a200ab700 1 -- start start 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.660+0000 7f4a200ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 0x7f4a1815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.660+0000 7f4a200ab700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a18159c60 0x7f4a1815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.660+0000 7f4a200ab700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1815a160 con 0x7f4a1815db10 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.660+0000 7f4a200ab700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a180d13a0 con 0x7f4a18159c60 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.660+0000 7f4a200ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1815e140 con 0x7f4a18159890 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.660+0000 7f4a1de47700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 0x7f4a1815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1d646700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a18159c60 0x7f4a1815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1de47700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 0x7f4a1815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:32974/0 (socket says 172.21.15.22:32974) 2023-10-08T00:26:51.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1e648700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4a1815db10 0x7f4a18069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:35976/0 (socket says 172.21.15.22:35976) 2023-10-08T00:26:51.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1de47700 1 -- 172.21.15.22:0/2759888512 learned_addr learned my addr 172.21.15.22:0/2759888512 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:51.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1d646700 1 -- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 msgr2=0x7f4a1815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:51.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1d646700 1 --2- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 0x7f4a1815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:51.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1d646700 1 -- 172.21.15.22:0/2759888512 >> v1:172.21.15.192:6789/0 conn(0x7f4a1815db10 legacy=0x7f4a18069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1d646700 1 -- 172.21.15.22:0/2759888512 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1815a3d0 con 0x7f4a18159c60 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1de47700 1 --2- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 0x7f4a1815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1ce45700 1 -- 172.21.15.22:0/2759888512 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600715158 0 0) 0x7f4a1815a160 con 0x7f4a1815db10 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1d646700 1 --2- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159c60 0x7f4a1815d5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4a080098e0 tx=0x7f4a080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d217ae67d91b0a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1ce45700 1 -- 172.21.15.22:0/2759888512 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800b640 con 0x7f4a18159c60 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1ce45700 1 -- 172.21.15.22:0/2759888512 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0800b7a0 con 0x7f4a18159c60 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.661+0000 7f4a1ce45700 1 -- 172.21.15.22:0/2759888512 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800bb40 con 0x7f4a18159c60 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 -- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159c60 msgr2=0x7f4a1815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 --2- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159c60 0x7f4a1815d5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4a080098e0 tx=0x7f4a080091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:51.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 -- 172.21.15.22:0/2759888512 shutdown_connections 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 --2- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a18159890 0x7f4a1815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 --2- 172.21.15.22:0/2759888512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159c60 0x7f4a1815d5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 -- 172.21.15.22:0/2759888512 >> 172.21.15.22:0/2759888512 conn(0x7f4a18068e20 msgr2=0x7f4a180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 -- 172.21.15.22:0/2759888512 shutdown_connections 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.662+0000 7f4a200ab700 1 -- 172.21.15.22:0/2759888512 wait complete. 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.663+0000 7f4a200ab700 1 Processor -- start 2023-10-08T00:26:51.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.663+0000 7f4a200ab700 1 -- start start 2023-10-08T00:26:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a200ab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159890 0x7f4a180b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:51.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a200ab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 0x7f4a1814c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a200ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1815db10 0x7f4a180cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a200ab700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a181515a0 con 0x7f4a18159c60 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a200ab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18151840 con 0x7f4a18159890 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a200ab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18151b20 con 0x7f4a1815db10 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 0x7f4a1814c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 0x7f4a1814c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38342/0 (socket says 172.21.15.22:38342) 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 -- 172.21.15.22:0/1385301160 learned_addr learned my addr 172.21.15.22:0/1385301160 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1e648700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1815db10 0x7f4a180cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1de47700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159890 0x7f4a180b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 -- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1815db10 msgr2=0x7f4a180cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:51.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1815db10 0x7f4a180cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 -- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159890 msgr2=0x7f4a180b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159890 0x7f4a180b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 -- 172.21.15.22:0/1385301160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140094f0 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.664+0000 7f4a1d646700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 0x7f4a1814c600 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a08013000 tx=0x7f4a08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.665+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800bb20 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.665+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08011420 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.665+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080117a0 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.665+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a08009420 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.665+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a180cdf20 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.666+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1804c3c0 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.666+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4a08011b50 con 0x7f4a18159c60 2023-10-08T00:26:51.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.667+0000 7f4a0dffb700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49fc066fc0 0x7f49fc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.667+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4a080859f0 con 0x7f4a18159c60 2023-10-08T00:26:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.667+0000 7f4a1de47700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49fc066fc0 0x7f49fc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:51.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.667+0000 7f4a1de47700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49fc066fc0 0x7f49fc069470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a14006fd0 tx=0x7f4a14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:51.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.671+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a08087e60 con 0x7f4a18159c60 2023-10-08T00:26:51.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:51.882+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4a1806a5b0 con 0x7f4a18159c60 2023-10-08T00:26:52.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.694+0000 7f4a0dffb700 1 -- 172.21.15.22:0/1385301160 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4a08052f70 con 0x7f4a18159c60 2023-10-08T00:26:52.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49fc066fc0 msgr2=0x7f49fc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49fc066fc0 0x7f49fc069470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a14006fd0 tx=0x7f4a14008040 comp rx=0 tx=0).stop 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 msgr2=0x7f4a1814c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 0x7f4a1814c600 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4a08013000 tx=0x7f4a08017000 comp rx=0 tx=0).stop 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 shutdown_connections 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f49fc066fc0 0x7f49fc069470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a1815db10 0x7f4a180cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a18159890 0x7f4a180b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 --2- 172.21.15.22:0/1385301160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a18159c60 0x7f4a1814c600 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 >> 172.21.15.22:0/1385301160 conn(0x7f4a18068e20 msgr2=0x7f4a18154360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 shutdown_connections 2023-10-08T00:26:52.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.697+0000 7f4a200ab700 1 -- 172.21.15.22:0/1385301160 wait complete. 2023-10-08T00:26:52.699 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:26:52.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:26:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.838+0000 7fe593633700 1 Processor -- start 2023-10-08T00:26:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.838+0000 7fe593633700 1 -- start start 2023-10-08T00:26:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe593633700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe58c159c60 0x7fe58c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe593633700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe58c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe593633700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c15a160 con 0x7fe58c159890 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe593633700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c15df50 con 0x7fe58c159c60 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe593633700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c0d13a0 con 0x7fe58c15db10 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe5913cf700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe58c159890 0x7fe58c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36900/0 (socket says 172.21.15.22:36900) 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe5913cf700 1 -- 172.21.15.22:0/4018182216 learned_addr learned my addr 172.21.15.22:0/4018182216 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106954857 0 0) 0x7fe58c15a160 con 0x7fe58c159890 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe574003570 con 0x7fe58c159890 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe590bce700 1 --2- 172.21.15.22:0/4018182216 >> v2:172.21.15.192:3300/0 conn(0x7fe58c159c60 0x7fe58c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe591bd0700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe58c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2110653919 0 0) 0x7fe574003570 con 0x7fe58c159890 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 msgr2=0x7fe58c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe58c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 >> v2:172.21.15.192:3300/0 conn(0x7fe58c159c60 msgr2=0x7fe58c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 --2- 172.21.15.22:0/4018182216 >> v2:172.21.15.192:3300/0 conn(0x7fe58c159c60 0x7fe58c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c15e140 con 0x7fe58c159890 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fe57c001470 con 0x7fe58c159890 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe591bd0700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe58c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 >> v1:172.21.15.22:6789/0 conn(0x7fe58c159890 legacy=0x7fe58c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe574003a60 0x7fe574003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe574004810 0x7fe574004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe5740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c0d13a0 con 0x7fe574003a60 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57400ba60 con 0x7fe574004810 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57400bc20 con 0x7fe58c15db10 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.839+0000 7fe5913cf700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe574003a60 0x7fe574003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe590bce700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe574004810 0x7fe574004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe591bd0700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe5740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe5913cf700 1 -- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 msgr2=0x7fe5740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe5913cf700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe58c15db10 0x7fe5740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe5913cf700 1 -- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe574004810 msgr2=0x7fe574004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe5913cf700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe574004810 0x7fe574004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe5913cf700 1 -- 172.21.15.22:0/4018182216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574003570 con 0x7fe574003a60 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe5913cf700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe574003a60 0x7fe574003e70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c3c0 tx=0x7fe57c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dd503fd40a57ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00cc90 con 0x7fe574003a60 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00ce30 con 0x7fe574003a60 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.840+0000 7fe58bfff700 1 -- 172.21.15.22:0/4018182216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c005b70 con 0x7fe574003a60 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe593633700 1 -- 172.21.15.22:0/4018182216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe574003a60 msgr2=0x7fe574003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe593633700 1 --2- 172.21.15.22:0/4018182216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe574003a60 0x7fe574003e70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c3c0 tx=0x7fe57c001e90 comp rx=0 tx=0).stop 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe591bd0700 1 -- 172.21.15.22:0/4018182216 reap_dead start 2023-10-08T00:26:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe593633700 1 -- 172.21.15.22:0/4018182216 shutdown_connections 2023-10-08T00:26:52.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe593633700 1 -- 172.21.15.22:0/4018182216 >> 172.21.15.22:0/4018182216 conn(0x7fe58c068e20 msgr2=0x7fe58c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:52.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe593633700 1 -- 172.21.15.22:0/4018182216 shutdown_connections 2023-10-08T00:26:52.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.841+0000 7fe593633700 1 -- 172.21.15.22:0/4018182216 wait complete. 2023-10-08T00:26:52.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.842+0000 7fe593633700 1 Processor -- start 2023-10-08T00:26:52.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.842+0000 7fe593633700 1 -- start start 2023-10-08T00:26:52.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe593633700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe574003a60 0x7fe58c15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe593633700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 0x7fe58c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe593633700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe58c1526f0 0x7fe58c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe593633700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c14d9b0 con 0x7fe58c14d000 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe593633700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c0b3630 con 0x7fe58c1526f0 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe593633700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c0b3910 con 0x7fe574003a60 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 0x7fe58c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 0x7fe58c14d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38352/0 (socket says 172.21.15.22:38352) 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 -- 172.21.15.22:0/242133999 learned_addr learned my addr 172.21.15.22:0/242133999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe591bd0700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe58c1526f0 0x7fe58c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe5913cf700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe574003a60 0x7fe58c15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 -- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe574003a60 msgr2=0x7fe58c15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe574003a60 0x7fe58c15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 -- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe58c1526f0 msgr2=0x7fe58c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe58c1526f0 0x7fe58c152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 -- 172.21.15.22:0/242133999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c0b3bf0 con 0x7fe58c14d000 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe5913cf700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe574003a60 0x7fe58c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.843+0000 7fe590bce700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 0x7fe58c14d470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe580011d40 tx=0x7fe5800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.844+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58000fac0 con 0x7fe58c14d000 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.844+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58000fc20 con 0x7fe58c14d000 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.844+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580014440 con 0x7fe58c14d000 2023-10-08T00:26:52.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.844+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c0b3ed0 con 0x7fe58c14d000 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.844+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c1530b0 con 0x7fe58c14d000 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.845+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58c0b4520 con 0x7fe58c14d000 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.845+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe580014870 con 0x7fe58c14d000 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.845+0000 7fe5897fa700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe578066fc0 0x7fe578069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.846+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe580018030 con 0x7fe58c14d000 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.846+0000 7fe5913cf700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe578066fc0 0x7fe578069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:52.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.846+0000 7fe5913cf700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe578066fc0 0x7fe578069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c3c0 tx=0x7fe57c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:52.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:52.850+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe580052290 con 0x7fe58c14d000 2023-10-08T00:26:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.121+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe58c04c3c0 con 0x7fe58c14d000 2023-10-08T00:26:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.122+0000 7fe5897fa700 1 -- 172.21.15.22:0/242133999 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe5800558b0 con 0x7fe58c14d000 2023-10-08T00:26:53.122 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.123 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.124 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.126 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:26:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.128 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:26:53.129 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.130 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.131 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.132 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:26:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.135 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:26:53.136 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:26:53.137 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.138 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:53.139 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:26:53.139 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:26:53.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe578066fc0 msgr2=0x7fe578069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe578066fc0 0x7fe578069470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c3c0 tx=0x7fe57c015000 comp rx=0 tx=0).stop 2023-10-08T00:26:53.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 msgr2=0x7fe58c14d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 0x7fe58c14d470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe580011d40 tx=0x7fe5800091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 shutdown_connections 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe58c1526f0 0x7fe58c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe578066fc0 0x7fe578069470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe574003a60 0x7fe58c15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 --2- 172.21.15.22:0/242133999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe58c14d000 0x7fe58c14d470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 >> 172.21.15.22:0/242133999 conn(0x7fe58c068e20 msgr2=0x7fe58c0cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 shutdown_connections 2023-10-08T00:26:53.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.124+0000 7fe593633700 1 -- 172.21.15.22:0/242133999 wait complete. 2023-10-08T00:26:53.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:53.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.260+0000 7f14de918700 1 Processor -- start 2023-10-08T00:26:53.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.261+0000 7f14de918700 1 -- start start 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.261+0000 7f14de918700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.261+0000 7f14de918700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14d815d230 0x7f14d815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.261+0000 7f14de918700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d815dbd0 con 0x7f14d8159420 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.261+0000 7f14de918700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80b11d0 con 0x7f14d815d230 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.261+0000 7f14de918700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b14b0 con 0x7f14d81597f0 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14de117700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14d815d230 0x7f14d815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dd916700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f14d8159420 0x7f14d80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36906/0 (socket says 172.21.15.22:36906) 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dd916700 1 -- 172.21.15.22:0/613147982 learned_addr learned my addr 172.21.15.22:0/613147982 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dd115700 1 --2- 172.21.15.22:0/613147982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14de117700 1 -- 172.21.15.22:0/613147982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 msgr2=0x7f14d80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14de117700 1 --2- 172.21.15.22:0/613147982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14de117700 1 -- 172.21.15.22:0/613147982 >> v1:172.21.15.22:6789/0 conn(0x7f14d8159420 legacy=0x7f14d80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dc914700 1 -- 172.21.15.22:0/613147982 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140112180 0 0) 0x7f14c8001490 con 0x7f14d8159420 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14de117700 1 -- 172.21.15.22:0/613147982 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80b1790 con 0x7f14d815d230 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14de117700 1 --2- 172.21.15.22:0/613147982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d815d690 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f14d00098e0 tx=0x7f14d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cb70d1f38dce80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dc914700 1 -- 172.21.15.22:0/613147982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000b640 con 0x7f14d815d230 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dc914700 1 -- 172.21.15.22:0/613147982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d000b7a0 con 0x7f14d815d230 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.262+0000 7f14dc914700 1 -- 172.21.15.22:0/613147982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000bb40 con 0x7f14d815d230 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 -- 172.21.15.22:0/613147982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 msgr2=0x7f14d815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 --2- 172.21.15.22:0/613147982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d815d690 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f14d00098e0 tx=0x7f14d00091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 -- 172.21.15.22:0/613147982 shutdown_connections 2023-10-08T00:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 --2- 172.21.15.22:0/613147982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d815d690 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 --2- 172.21.15.22:0/613147982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 -- 172.21.15.22:0/613147982 >> 172.21.15.22:0/613147982 conn(0x7f14d80d0660 msgr2=0x7f14d80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 -- 172.21.15.22:0/613147982 shutdown_connections 2023-10-08T00:26:53.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.263+0000 7f14de918700 1 -- 172.21.15.22:0/613147982 wait complete. 2023-10-08T00:26:53.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.264+0000 7f14de918700 1 Processor -- start 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.264+0000 7f14de918700 1 -- start start 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de918700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14d8159420 0x7f14d8155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de918700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de918700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de918700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d815ac30 con 0x7f14d815d230 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de918700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d815b9b0 con 0x7f14d8159420 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de918700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d815b080 con 0x7f14d81597f0 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d80b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38366/0 (socket says 172.21.15.22:38366) 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 -- 172.21.15.22:0/1582135203 learned_addr learned my addr 172.21.15.22:0/1582135203 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:53.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14dd916700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14d8159420 0x7f14d8155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14dd115700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 -- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 msgr2=0x7f14d815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 -- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14d8159420 msgr2=0x7f14d8155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14d8159420 0x7f14d8155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 -- 172.21.15.22:0/1582135203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0009420 con 0x7f14d815d230 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14de117700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d80b4e20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f14d8089340 tx=0x7f14d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.265+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d000bb20 con 0x7f14d815d230 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.266+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0011420 con 0x7f14d815d230 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.266+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d815b360 con 0x7f14d815d230 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.266+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00117a0 con 0x7f14d815d230 2023-10-08T00:26:53.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.266+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d815c380 con 0x7f14d815d230 2023-10-08T00:26:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.267+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d815bb40 con 0x7f14d815d230 2023-10-08T00:26:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.267+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f14d0011b10 con 0x7f14d815d230 2023-10-08T00:26:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.267+0000 7f14d5ffb700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14c4066fc0 0x7f14c4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.268+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f14d0085c40 con 0x7f14d815d230 2023-10-08T00:26:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.268+0000 7f14dd916700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14c4066fc0 0x7f14c4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.268+0000 7f14dd916700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14c4066fc0 0x7f14c4069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14c80072e0 tx=0x7f14c8001a10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.272+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14d0053210 con 0x7f14d815d230 2023-10-08T00:26:53.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.465+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14d8155940 con 0x7f14d815d230 2023-10-08T00:26:53.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.466+0000 7f14d5ffb700 1 -- 172.21.15.22:0/1582135203 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+12134 (secure 0 0 0) 0x7f14d005ae60 con 0x7f14d815d230 2023-10-08T00:26:53.467 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:53.467 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":60,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:52.690302+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14c4066fc0 msgr2=0x7f14c4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14c4066fc0 0x7f14c4069470 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14c80072e0 tx=0x7f14c8001a10 comp rx=0 tx=0).stop 2023-10-08T00:26:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 msgr2=0x7f14d80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d80b4e20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f14d8089340 tx=0x7f14d0017000 comp rx=0 tx=0).stop 2023-10-08T00:26:53.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 shutdown_connections 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14d815d230 0x7f14d80b4e20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14d8159420 0x7f14d8155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14c4066fc0 0x7f14c4069470 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 --2- 172.21.15.22:0/1582135203 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14d81597f0 0x7f14d815be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 >> 172.21.15.22:0/1582135203 conn(0x7f14d80d0660 msgr2=0x7f14d8069740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.468+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 shutdown_connections 2023-10-08T00:26:53.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.469+0000 7f14de918700 1 -- 172.21.15.22:0/1582135203 wait complete. 2023-10-08T00:26:53.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:26:53.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:26:53.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-08T00:26:53.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.602+0000 7ffa63c6c700 1 Processor -- start 2023-10-08T00:26:53.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.603+0000 7ffa63c6c700 1 -- start start 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.603+0000 7ffa63c6c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa5c0caa90 0x7ffa5c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa63c6c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c15d7e0 con 0x7ffa5c06c0a0 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa63c6c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c15dac0 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa63c6c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0caef0 con 0x7ffa5c0caa90 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa61207700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ffa5c06c0a0 0x7ffa5c15df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36908/0 (socket says 172.21.15.22:36908) 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa61207700 1 -- 172.21.15.22:0/3124542504 learned_addr learned my addr 172.21.15.22:0/3124542504 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa62209700 1 --2- 172.21.15.22:0/3124542504 >> v2:172.21.15.192:3300/0 conn(0x7ffa5c0caa90 0x7ffa5c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036230602 0 0) 0x7ffa5c15d7e0 con 0x7ffa5c06c0a0 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa44003570 con 0x7ffa5c06c0a0 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918482803 0 0) 0x7ffa5c15dac0 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c15d7e0 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa62209700 1 -- 172.21.15.22:0/3124542504 >> v1:172.21.15.192:6789/0 conn(0x7ffa5c06bcd0 legacy=0x7ffa5c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa62209700 1 -- 172.21.15.22:0/3124542504 >> v1:172.21.15.22:6789/0 conn(0x7ffa5c06c0a0 legacy=0x7ffa5c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa62209700 1 -- 172.21.15.22:0/3124542504 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c15aa30 con 0x7ffa5c0caa90 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.604+0000 7ffa62209700 1 --2- 172.21.15.22:0/3124542504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c0caa90 0x7ffa5c0c8c40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa540098e0 tx=0x7ffa540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44079a6a0e382d05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54011630 con 0x7ffa5c0caa90 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54011790 con 0x7ffa5c0caa90 2023-10-08T00:26:53.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa60a06700 1 -- 172.21.15.22:0/3124542504 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54011b30 con 0x7ffa5c0caa90 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 -- 172.21.15.22:0/3124542504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c0caa90 msgr2=0x7ffa5c0c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/3124542504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c0caa90 0x7ffa5c0c8c40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa540098e0 tx=0x7ffa540091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 -- 172.21.15.22:0/3124542504 shutdown_connections 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/3124542504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c0caa90 0x7ffa5c0c8c40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 -- 172.21.15.22:0/3124542504 >> 172.21.15.22:0/3124542504 conn(0x7ffa5c0ce600 msgr2=0x7ffa5c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 -- 172.21.15.22:0/3124542504 shutdown_connections 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.605+0000 7ffa63c6c700 1 -- 172.21.15.22:0/3124542504 wait complete. 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.606+0000 7ffa63c6c700 1 Processor -- start 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.606+0000 7ffa63c6c700 1 -- start start 2023-10-08T00:26:53.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa63c6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 0x7ffa5c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa63c6c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c06c0a0 0x7ffa5c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa63c6c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa5c0caa90 0x7ffa5c0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa63c6c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c16af50 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa63c6c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0c6ab0 con 0x7ffa5c06c0a0 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa63c6c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c155970 con 0x7ffa5c0caa90 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 0x7ffa5c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 0x7ffa5c155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38382/0 (socket says 172.21.15.22:38382) 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 -- 172.21.15.22:0/1961434181 learned_addr learned my addr 172.21.15.22:0/1961434181 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa62209700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa5c0caa90 0x7ffa5c0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61207700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c06c0a0 0x7ffa5c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 -- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa5c0caa90 msgr2=0x7ffa5c0c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa5c0caa90 0x7ffa5c0c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 -- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c06c0a0 msgr2=0x7ffa5c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c06c0a0 0x7ffa5c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.607+0000 7ffa61a08700 1 -- 172.21.15.22:0/1961434181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54009420 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.608+0000 7ffa61a08700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 0x7ffa5c155430 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c930 tx=0x7ffa4c002780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.608+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c012630 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.608+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c012790 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.608+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c0c6f40 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.608+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c012b50 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.608+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0c6460 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.609+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c0c6d90 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.609+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ffa4c01b400 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.610+0000 7ffa59ffb700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa48066fc0 0x7ffa48069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.610+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffa4c084540 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.610+0000 7ffa61207700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa48066fc0 0x7ffa48069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.610+0000 7ffa61207700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa48066fc0 0x7ffa48069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa50007fd0 tx=0x7ffa50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.614+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa4c051bc0 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.807+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa5c04c3c0 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.808+0000 7ffa59ffb700 1 -- 172.21.15.22:0/1961434181 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa4c0551e0 con 0x7ffa5c06bcd0 2023-10-08T00:26:53.808 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:26:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.809+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa48066fc0 msgr2=0x7ffa48069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.809+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa48066fc0 0x7ffa48069470 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa50007fd0 tx=0x7ffa50009040 comp rx=0 tx=0).stop 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 msgr2=0x7ffa5c155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 0x7ffa5c155430 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c930 tx=0x7ffa4c002780 comp rx=0 tx=0).stop 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 shutdown_connections 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa48066fc0 0x7ffa48069470 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa5c0caa90 0x7ffa5c0c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa5c06bcd0 0x7ffa5c155430 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 --2- 172.21.15.22:0/1961434181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa5c06c0a0 0x7ffa5c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 >> 172.21.15.22:0/1961434181 conn(0x7ffa5c0ce600 msgr2=0x7ffa5c1561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 shutdown_connections 2023-10-08T00:26:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.810+0000 7ffa63c6c700 1 -- 172.21.15.22:0/1961434181 wait complete. 2023-10-08T00:26:53.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:26:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.941+0000 7f39fb051700 1 Processor -- start 2023-10-08T00:26:53.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.941+0000 7f39fb051700 1 -- start start 2023-10-08T00:26:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.941+0000 7f39fb051700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39fb051700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39f4069d60 0x7f39f40c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39fb051700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39f40c81f0 0x7f39f4068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39fb051700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40c8670 con 0x7f39f40c81f0 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39fb051700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f406bdb0 con 0x7f39f4069d60 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39fb051700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40cb370 con 0x7f39f40aca80 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39f40c81f0 0x7f39f4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39f40c81f0 0x7f39f4068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38398/0 (socket says 172.21.15.22:38398) 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 -- 172.21.15.22:0/4225990666 learned_addr learned my addr 172.21.15.22:0/4225990666 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f3fff700 1 --2- 172.21.15.22:0/4225990666 >> v2:172.21.15.192:3300/0 conn(0x7f39f4069d60 0x7f39f40c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f8ded700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 -- 172.21.15.22:0/4225990666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 msgr2=0x7f39f406aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f406aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 -- 172.21.15.22:0/4225990666 >> v2:172.21.15.192:3300/0 conn(0x7f39f4069d60 msgr2=0x7f39f40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:53.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 --2- 172.21.15.22:0/4225990666 >> v2:172.21.15.192:3300/0 conn(0x7f39f4069d60 0x7f39f40c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 -- 172.21.15.22:0/4225990666 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4159f60 con 0x7f39f40c81f0 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f8ded700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f95ee700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f4068390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f39f406e0a0 tx=0x7f39ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675770b31df3defd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f37fe700 1 -- 172.21.15.22:0/4225990666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00e070 con 0x7f39f40c81f0 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f37fe700 1 -- 172.21.15.22:0/4225990666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00ba50 con 0x7f39f40c81f0 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.942+0000 7f39f37fe700 1 -- 172.21.15.22:0/4225990666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0092e0 con 0x7f39f40c81f0 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 -- 172.21.15.22:0/4225990666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 msgr2=0x7f39f4068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f4068390 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f39f406e0a0 tx=0x7f39ec009840 comp rx=0 tx=0).stop 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 -- 172.21.15.22:0/4225990666 shutdown_connections 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f4068390 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 --2- 172.21.15.22:0/4225990666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f406aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 --2- 172.21.15.22:0/4225990666 >> v2:172.21.15.192:3300/0 conn(0x7f39f4069d60 0x7f39f40c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 -- 172.21.15.22:0/4225990666 >> 172.21.15.22:0/4225990666 conn(0x7f39f40cd670 msgr2=0x7f39f40cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:53.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 -- 172.21.15.22:0/4225990666 shutdown_connections 2023-10-08T00:26:53.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.943+0000 7f39fb051700 1 -- 172.21.15.22:0/4225990666 wait complete. 2023-10-08T00:26:53.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.944+0000 7f39fb051700 1 Processor -- start 2023-10-08T00:26:53.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.944+0000 7f39fb051700 1 -- start start 2023-10-08T00:26:53.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39fb051700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f4069d60 0x7f39f40c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39fb051700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f40c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39fb051700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f40af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39fb051700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c5000 con 0x7f39f40c81f0 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39fb051700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c52e0 con 0x7f39f4069d60 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39fb051700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c55c0 con 0x7f39f40aca80 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f40af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f40af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38404/0 (socket says 172.21.15.22:38404) 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 -- 172.21.15.22:0/3241233757 learned_addr learned my addr 172.21.15.22:0/3241233757 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f8ded700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f4069d60 0x7f39f40c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f3fff700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f40c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 -- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 msgr2=0x7f39f40c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f40c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 -- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f4069d60 msgr2=0x7f39f40c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f4069d60 0x7f39f40c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f95ee700 1 -- 172.21.15.22:0/3241233757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ec009ae0 con 0x7f39f40c81f0 2023-10-08T00:26:53.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f8ded700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f4069d60 0x7f39f40c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.945+0000 7f39f3fff700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f40c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.946+0000 7f39f95ee700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f40af100 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f39f406c6a0 tx=0x7f39ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.946+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0032f0 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.946+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec008e80 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.946+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f40c58a0 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.946+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0256b0 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.946+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f40c4c60 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.947+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f406ec80 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.947+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f39ec003040 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.948+0000 7f39f0ff9700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39e0066fc0 0x7f39e0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.948+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f39ec085a80 con 0x7f39f40c81f0 2023-10-08T00:26:53.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.948+0000 7f39f8ded700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39e0066fc0 0x7f39e0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:53.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.948+0000 7f39f8ded700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39e0066fc0 0x7f39e0069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f39e400ab90 tx=0x7f39e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:53.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:53.952+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39ec052ff0 con 0x7f39f40c81f0 2023-10-08T00:26:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.150+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f39f404c3c0 con 0x7f39f40c81f0 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.150+0000 7f39f0ff9700 1 -- 172.21.15.22:0/3241233757 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+65 (secure 0 0 0) 0x7f39ec009940 con 0x7f39f40c81f0 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:26:54.151 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:26:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39e0066fc0 msgr2=0x7f39e0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39e0066fc0 0x7f39e0069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f39e400ab90 tx=0x7f39e4008040 comp rx=0 tx=0).stop 2023-10-08T00:26:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 msgr2=0x7f39f40af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f40af100 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f39f406c6a0 tx=0x7f39ec018000 comp rx=0 tx=0).stop 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 shutdown_connections 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39f40c81f0 0x7f39f40af100 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f4069d60 0x7f39f40c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39e0066fc0 0x7f39e0069470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 --2- 172.21.15.22:0/3241233757 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39f40aca80 0x7f39f40c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 >> 172.21.15.22:0/3241233757 conn(0x7f39f40cd670 msgr2=0x7f39f41593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 shutdown_connections 2023-10-08T00:26:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.152+0000 7f39fb051700 1 -- 172.21.15.22:0/3241233757 wait complete. 2023-10-08T00:26:54.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:26:54.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:26:54.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.287+0000 7f41fc262700 1 Processor -- start 2023-10-08T00:26:54.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.288+0000 7f41fc262700 1 -- start start 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.288+0000 7f41fc262700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f40cd910 0x7f41f40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.288+0000 7f41fc262700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f40b5b00 con 0x7f41f4159ec0 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.288+0000 7f41fc262700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f40b5da0 con 0x7f41f40b55a0 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.288+0000 7f41fc262700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f40b6080 con 0x7f41f40cd910 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f9ffe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f41f4159ec0 0x7f41f40b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36922/0 (socket says 172.21.15.22:36922) 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f9ffe700 1 -- 172.21.15.22:0/2576820297 learned_addr learned my addr 172.21.15.22:0/2576820297 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f97fd700 1 --2- 172.21.15.22:0/2576820297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f40cd910 0x7f41f40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312401542 0 0) 0x7f41f40b5b00 con 0x7f41f4159ec0 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e0003570 con 0x7f41f4159ec0 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606615407 0 0) 0x7f41f40b5da0 con 0x7f41f40b55a0 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f40b5b00 con 0x7f41f40b55a0 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f97fd700 1 -- 172.21.15.22:0/2576820297 >> v1:172.21.15.192:6789/0 conn(0x7f41f40b55a0 legacy=0x7f41f40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f97fd700 1 -- 172.21.15.22:0/2576820297 >> v1:172.21.15.22:6789/0 conn(0x7f41f4159ec0 legacy=0x7f41f40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f97fd700 1 -- 172.21.15.22:0/2576820297 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40cc100 con 0x7f41f40cd910 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f97fd700 1 --2- 172.21.15.22:0/2576820297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f40cd910 0x7f41f40ce340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009910 tx=0x7f41e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73165d11361899db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.289+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4011630 con 0x7f41f40cd910 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e4011790 con 0x7f41f40cd910 2023-10-08T00:26:54.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41f8ffc700 1 -- 172.21.15.22:0/2576820297 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4011b30 con 0x7f41f40cd910 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 -- 172.21.15.22:0/2576820297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f40cd910 msgr2=0x7f41f40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 --2- 172.21.15.22:0/2576820297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f40cd910 0x7f41f40ce340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009910 tx=0x7f41e40091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 -- 172.21.15.22:0/2576820297 shutdown_connections 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 --2- 172.21.15.22:0/2576820297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f40cd910 0x7f41f40ce340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 -- 172.21.15.22:0/2576820297 >> 172.21.15.22:0/2576820297 conn(0x7f41f40999f0 msgr2=0x7f41f40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 -- 172.21.15.22:0/2576820297 shutdown_connections 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.290+0000 7f41fc262700 1 -- 172.21.15.22:0/2576820297 wait complete. 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.291+0000 7f41fc262700 1 Processor -- start 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.291+0000 7f41fc262700 1 -- start start 2023-10-08T00:26:54.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fc262700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 0x7f41f40c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fc262700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f4159ec0 0x7f41f40c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fc262700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41f4069510 0x7f41f4069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fc262700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4142b70 con 0x7f41f40b55a0 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fc262700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4141f60 con 0x7f41f4069510 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fc262700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f4142240 con 0x7f41f4159ec0 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41f9ffe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 0x7f41f40c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41f9ffe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 0x7f41f40c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38414/0 (socket says 172.21.15.22:38414) 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41f9ffe700 1 -- 172.21.15.22:0/2523103673 learned_addr learned my addr 172.21.15.22:0/2523103673 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41f97fd700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f4159ec0 0x7f41f40c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.292+0000 7f41fa7ff700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41f4069510 0x7f41f4069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41f9ffe700 1 -- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f4159ec0 msgr2=0x7f41f40c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41f9ffe700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f4159ec0 0x7f41f40c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41f9ffe700 1 -- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41f4069510 msgr2=0x7f41f4069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41f9ffe700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41f4069510 0x7f41f4069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41f9ffe700 1 -- 172.21.15.22:0/2523103673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e4009420 con 0x7f41f40b55a0 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41f9ffe700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 0x7f41f40c6870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f41f000c790 tx=0x7f41f0007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00072e0 con 0x7f41f40b55a0 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f0007440 con 0x7f41f40b55a0 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f4142520 con 0x7f41f40b55a0 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f00057f0 con 0x7f41f40b55a0 2023-10-08T00:26:54.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.293+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f4141bf0 con 0x7f41f40b55a0 2023-10-08T00:26:54.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.294+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f4063c90 con 0x7f41f40b55a0 2023-10-08T00:26:54.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.294+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f41f0005be0 con 0x7f41f40b55a0 2023-10-08T00:26:54.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.295+0000 7f41e9ffb700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41d8066fc0 0x7f41d8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.295+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f41f00836f0 con 0x7f41f40b55a0 2023-10-08T00:26:54.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.295+0000 7f41f97fd700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41d8066fc0 0x7f41d8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.296+0000 7f41f97fd700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41d8066fc0 0x7f41d8069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009860 tx=0x7f41e4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:54.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.299+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41f0050cc0 con 0x7f41f40b55a0 2023-10-08T00:26:54.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.491+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f41f40718b0 con 0x7f41f40b55a0 2023-10-08T00:26:54.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.701+0000 7f41e9ffb700 1 -- 172.21.15.22:0/2523103673 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7f41f0017020 con 0x7f41f40b55a0 2023-10-08T00:26:54.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41d8066fc0 msgr2=0x7f41d8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41d8066fc0 0x7f41d8069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009860 tx=0x7f41e4017000 comp rx=0 tx=0).stop 2023-10-08T00:26:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 msgr2=0x7f41f40c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 0x7f41f40c6870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f41f000c790 tx=0x7f41f0007ce0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 shutdown_connections 2023-10-08T00:26:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41f4069510 0x7f41f4069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f40b55a0 0x7f41f40c6870 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41d8066fc0 0x7f41d8069470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 --2- 172.21.15.22:0/2523103673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f41f4159ec0 0x7f41f40c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.704+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 >> 172.21.15.22:0/2523103673 conn(0x7f41f40999f0 msgr2=0x7f41f4152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.705+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 shutdown_connections 2023-10-08T00:26:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.705+0000 7f41fc262700 1 -- 172.21.15.22:0/2523103673 wait complete. 2023-10-08T00:26:54.707 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:26:54.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:26:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.844+0000 7f7eef96f700 1 Processor -- start 2023-10-08T00:26:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.845+0000 7f7eef96f700 1 -- start start 2023-10-08T00:26:54.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.845+0000 7f7eef96f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 0x7f7ee80cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.845+0000 7f7eef96f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ee8069c70 0x7f7ee80cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.845+0000 7f7eef96f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80ce380 con 0x7f7ee80af320 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.845+0000 7f7eef96f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee80cec20 con 0x7f7ee8069c70 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.845+0000 7f7eef96f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80afa90 con 0x7f7ee8159950 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7eecf0a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7ee80af320 0x7f7ee8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36932/0 (socket says 172.21.15.22:36932) 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7eecf0a700 1 -- 172.21.15.22:0/154304776 learned_addr learned my addr 172.21.15.22:0/154304776 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7eedf0c700 1 --2- 172.21.15.22:0/154304776 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8069c70 0x7f7ee80cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7eed70b700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 0x7f7ee80cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595573655 0 0) 0x7f7ee80ce380 con 0x7f7ee80af320 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0003570 con 0x7f7ee80af320 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981825454 0 0) 0x7f7ed0003570 con 0x7f7ee80af320 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 msgr2=0x7f7ee80cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 0x7f7ee80cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8069c70 msgr2=0x7f7ee80cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 --2- 172.21.15.22:0/154304776 >> v2:172.21.15.192:3300/0 conn(0x7f7ee8069c70 0x7f7ee80cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80ce5d0 con 0x7f7ee80af320 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f7edc001470 con 0x7f7ee80af320 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 >> v1:172.21.15.22:6789/0 conn(0x7f7ee80af320 legacy=0x7f7ee8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 0x7f7ed0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80cec20 con 0x7f7ed0003a60 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80afa90 con 0x7f7ed0004d50 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed000ba60 con 0x7f7ee8159950 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.846+0000 7f7eed70b700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eecf0a700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 0x7f7ed0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eedf0c700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eed70b700 1 -- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 msgr2=0x7f7ed0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eed70b700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee8159950 0x7f7ed0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eed70b700 1 -- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ed0004d50 msgr2=0x7f7ed00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eed70b700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eed70b700 1 -- 172.21.15.22:0/154304776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0003570 con 0x7f7ed0003a60 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7eed70b700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e210 tx=0x7f7ed800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d195ffc457b302 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800ea60 con 0x7f7ed0003a60 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed800f040 con 0x7f7ed0003a60 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.847+0000 7f7ee7fff700 1 -- 172.21.15.22:0/154304776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800ee10 con 0x7f7ed0003a60 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eef96f700 1 -- 172.21.15.22:0/154304776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 msgr2=0x7f7ed0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eef96f700 1 --2- 172.21.15.22:0/154304776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e210 tx=0x7f7ed800b040 comp rx=0 tx=0).stop 2023-10-08T00:26:54.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eedf0c700 1 -- 172.21.15.22:0/154304776 reap_dead start 2023-10-08T00:26:54.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eef96f700 1 -- 172.21.15.22:0/154304776 shutdown_connections 2023-10-08T00:26:54.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eef96f700 1 -- 172.21.15.22:0/154304776 >> 172.21.15.22:0/154304776 conn(0x7f7ee8068e00 msgr2=0x7f7ee80d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:54.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eef96f700 1 -- 172.21.15.22:0/154304776 shutdown_connections 2023-10-08T00:26:54.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.848+0000 7f7eef96f700 1 -- 172.21.15.22:0/154304776 wait complete. 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.849+0000 7f7eef96f700 1 Processor -- start 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.849+0000 7f7eef96f700 1 -- start start 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eef96f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ee80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eef96f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8148980 0x7f7ee816d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eef96f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee816d6a0 0x7f7ee80c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eef96f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80b3550 con 0x7f7ed0003a60 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eef96f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80b3ad0 con 0x7f7ee8148980 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eef96f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8158450 con 0x7f7ee816d6a0 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ee80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ee80b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38428/0 (socket says 172.21.15.22:38428) 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 -- 172.21.15.22:0/3070169774 learned_addr learned my addr 172.21.15.22:0/3070169774 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eecf0a700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8148980 0x7f7ee816d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eedf0c700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee816d6a0 0x7f7ee80c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 -- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee816d6a0 msgr2=0x7f7ee80c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee816d6a0 0x7f7ee80c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 -- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8148980 msgr2=0x7f7ee816d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8148980 0x7f7ee816d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 -- 172.21.15.22:0/3070169774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee816dbb0 con 0x7f7ed0003a60 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eecf0a700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8148980 0x7f7ee816d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.850+0000 7f7eed70b700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ee80b3f60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0004730 tx=0x7f7ed801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.851+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed801d420 con 0x7f7ed0003a60 2023-10-08T00:26:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.851+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed801d580 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.851+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee816de90 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.851+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed801d980 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.851+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8148df0 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.852+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee80718b0 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.852+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f7ed8003040 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.852+0000 7f7ee57fa700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed4066fc0 0x7f7ed4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.853+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f7ed8086a10 con 0x7f7ed0003a60 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.853+0000 7f7eecf0a700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed4066fc0 0x7f7ed4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:54.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.853+0000 7f7eecf0a700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed4066fc0 0x7f7ed4069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ee81591a0 tx=0x7f7edc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:54.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:54.857+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ed8053d60 con 0x7f7ed0003a60 2023-10-08T00:26:55.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.050+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ee816e020 con 0x7f7ed0003a60 2023-10-08T00:26:55.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.704+0000 7f7ee57fa700 1 -- 172.21.15.22:0/3070169774 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ed8018020 con 0x7f7ed0003a60 2023-10-08T00:26:55.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.710+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed4066fc0 msgr2=0x7f7ed4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:55.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.710+0000 7f7eef96f700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed4066fc0 0x7f7ed4069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ee81591a0 tx=0x7f7edc009040 comp rx=0 tx=0).stop 2023-10-08T00:26:55.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.710+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 msgr2=0x7f7ee80b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:55.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.710+0000 7f7eef96f700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ee80b3f60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0004730 tx=0x7f7ed801a000 comp rx=0 tx=0).stop 2023-10-08T00:26:55.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.712+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 shutdown_connections 2023-10-08T00:26:55.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.712+0000 7f7eef96f700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed4066fc0 0x7f7ed4069470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.712+0000 7f7eef96f700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ee816d6a0 0x7f7ee80c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.712+0000 7f7eef96f700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ed0003a60 0x7f7ee80b3f60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.712+0000 7f7eef96f700 1 --2- 172.21.15.22:0/3070169774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ee8148980 0x7f7ee816d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.712+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 >> 172.21.15.22:0/3070169774 conn(0x7f7ee8068e00 msgr2=0x7f7ee814a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.714+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 shutdown_connections 2023-10-08T00:26:55.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.714+0000 7f7eef96f700 1 -- 172.21.15.22:0/3070169774 wait complete. 2023-10-08T00:26:55.716 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:26:55.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:26:55.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.862+0000 7f667e449700 1 Processor -- start 2023-10-08T00:26:55.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.862+0000 7f667e449700 1 -- start start 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f667e449700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f667806c0a0 0x7f66780caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f667e449700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f667815df50 0x7f667815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f667e449700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667815d7e0 con 0x7f667806bcd0 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f667e449700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667815dac0 con 0x7f667806c0a0 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f667e449700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667815aa30 con 0x7f667815df50 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f667806c0a0 0x7f66780caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f6677fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f667806bcd0 0x7f667815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36934/0 (socket says 172.21.15.22:36934) 2023-10-08T00:26:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f667806c0a0 0x7f66780caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38432/0 (socket says 172.21.15.22:38432) 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f6677fff700 1 -- 172.21.15.22:0/2680328963 learned_addr learned my addr 172.21.15.22:0/2680328963 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f667c9e6700 1 --2- 172.21.15.22:0/2680328963 >> v2:172.21.15.192:3300/0 conn(0x7f667815df50 0x7f667815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 -- 172.21.15.22:0/2680328963 >> v2:172.21.15.192:3300/0 conn(0x7f667815df50 msgr2=0x7f667815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 --2- 172.21.15.22:0/2680328963 >> v2:172.21.15.192:3300/0 conn(0x7f667815df50 0x7f667815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 -- 172.21.15.22:0/2680328963 >> v1:172.21.15.22:6789/0 conn(0x7f667806bcd0 legacy=0x7f667815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 -- 172.21.15.22:0/2680328963 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667815ad10 con 0x7f667806c0a0 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f6676ffd700 1 -- 172.21.15.22:0/2680328963 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343714425 0 0) 0x7f667815d7e0 con 0x7f667806bcd0 2023-10-08T00:26:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f66777fe700 1 --2- 172.21.15.22:0/2680328963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780caa90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f667815d720 tx=0x7f66680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34969ce9c5d5d2e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f6676ffd700 1 -- 172.21.15.22:0/2680328963 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800b6b0 con 0x7f667806c0a0 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f6676ffd700 1 -- 172.21.15.22:0/2680328963 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666800b810 con 0x7f667806c0a0 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.863+0000 7f6676ffd700 1 -- 172.21.15.22:0/2680328963 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800bbb0 con 0x7f667806c0a0 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 -- 172.21.15.22:0/2680328963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 msgr2=0x7f66780caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 --2- 172.21.15.22:0/2680328963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780caa90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f667815d720 tx=0x7f66680091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 -- 172.21.15.22:0/2680328963 shutdown_connections 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 --2- 172.21.15.22:0/2680328963 >> v2:172.21.15.192:3300/0 conn(0x7f667815df50 0x7f667815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 --2- 172.21.15.22:0/2680328963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780caa90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 -- 172.21.15.22:0/2680328963 >> 172.21.15.22:0/2680328963 conn(0x7f66780ce600 msgr2=0x7f66780cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 -- 172.21.15.22:0/2680328963 shutdown_connections 2023-10-08T00:26:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.864+0000 7f667e449700 1 -- 172.21.15.22:0/2680328963 wait complete. 2023-10-08T00:26:55.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.865+0000 7f667e449700 1 Processor -- start 2023-10-08T00:26:55.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.865+0000 7f667e449700 1 -- start start 2023-10-08T00:26:55.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f667e449700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f667806bcd0 0x7f667814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f667e449700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f667e449700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667815df50 0x7f66780c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f667e449700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667816b440 con 0x7f667806c0a0 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f667e449700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66780c76a0 con 0x7f667806bcd0 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f667e449700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667814b840 con 0x7f667815df50 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38446/0 (socket says 172.21.15.22:38446) 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 -- 172.21.15.22:0/3551665248 learned_addr learned my addr 172.21.15.22:0/3551665248 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 -- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667815df50 msgr2=0x7f66780c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667815df50 0x7f66780c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 -- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f667806bcd0 msgr2=0x7f667814b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f6677fff700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f667806bcd0 0x7f667814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f667806bcd0 0x7f667814b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f66777fe700 1 -- 172.21.15.22:0/3551665248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009420 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.866+0000 7f6677fff700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f667806bcd0 0x7f667814b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.867+0000 7f66777fe700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780c33a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f666800b0e0 tx=0x7f6668017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.867+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800bb90 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.867+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668011420 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.867+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66780c6d70 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.867+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680117e0 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.867+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66780c7330 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.868+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66780c7830 con 0x7f667806c0a0 2023-10-08T00:26:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.868+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6668011c10 con 0x7f667806c0a0 2023-10-08T00:26:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.869+0000 7f665ffff700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6664066fc0 0x7f6664069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.869+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6668085d50 con 0x7f667806c0a0 2023-10-08T00:26:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.869+0000 7f6677fff700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6664066fc0 0x7f6664069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.869+0000 7f6677fff700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6664066fc0 0x7f6664069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f667806ae40 tx=0x7f666c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:55.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:55.873+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6668053030 con 0x7f667806c0a0 2023-10-08T00:26:56.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.110+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f667804c3c0 con 0x7f667806c0a0 2023-10-08T00:26:56.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.724+0000 7f665ffff700 1 -- 172.21.15.22:0/3551665248 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6668056650 con 0x7f667806c0a0 2023-10-08T00:26:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.728+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6664066fc0 msgr2=0x7f6664069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.728+0000 7f667e449700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6664066fc0 0x7f6664069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f667806ae40 tx=0x7f666c009040 comp rx=0 tx=0).stop 2023-10-08T00:26:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.728+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 msgr2=0x7f66780c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.728+0000 7f667e449700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780c33a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f666800b0e0 tx=0x7f6668017000 comp rx=0 tx=0).stop 2023-10-08T00:26:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.729+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 shutdown_connections 2023-10-08T00:26:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.729+0000 7f667e449700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6664066fc0 0x7f6664069470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.729+0000 7f667e449700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f667815df50 0x7f66780c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.729+0000 7f667e449700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f667806bcd0 0x7f667814b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.729+0000 7f667e449700 1 --2- 172.21.15.22:0/3551665248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667806c0a0 0x7f66780c33a0 secure :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f666800b0e0 tx=0x7f6668017000 comp rx=0 tx=0).stop 2023-10-08T00:26:56.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.729+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 >> 172.21.15.22:0/3551665248 conn(0x7f66780ce600 msgr2=0x7f667815a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:56.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.731+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 shutdown_connections 2023-10-08T00:26:56.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.734+0000 7f667e449700 1 -- 172.21.15.22:0/3551665248 wait complete. 2023-10-08T00:26:56.736 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 10 and data pool 11 2023-10-08T00:26:56.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.871+0000 7fa28b220700 1 Processor -- start 2023-10-08T00:26:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.871+0000 7fa28b220700 1 -- start start 2023-10-08T00:26:56.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa28b220700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa28415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa28b220700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28415a160 con 0x7fa284159890 2023-10-08T00:26:56.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa28b220700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2840d13a0 con 0x7fa28415db10 2023-10-08T00:26:56.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa28b220700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28415e140 con 0x7fa284159c60 2023-10-08T00:26:56.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa288fbc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa284159890 0x7fa28415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52986/0 (socket says 172.21.15.22:52986) 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa288fbc700 1 -- 172.21.15.22:0/3474407915 learned_addr learned my addr 172.21.15.22:0/3474407915 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101095983 0 0) 0x7fa28415a160 con 0x7fa284159890 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa283fff700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa28415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa270003570 con 0x7fa284159890 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791720167 0 0) 0x7fa2840d13a0 con 0x7fa28415db10 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28415a160 con 0x7fa28415db10 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2149337003 0 0) 0x7fa270003570 con 0x7fa284159890 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 msgr2=0x7fa28415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa28415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 >> v1:172.21.15.192:6789/0 conn(0x7fa28415db10 legacy=0x7fa284069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.872+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28415a3d0 con 0x7fa284159890 2023-10-08T00:26:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fa26c001470 con 0x7fa284159890 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 >> v1:172.21.15.22:6789/0 conn(0x7fa284159890 legacy=0x7fa28415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa270003c20 0x7fa270004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa270004810 0x7fa270004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28415e140 con 0x7fa270004810 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27000bb40 con 0x7fa270003c20 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27000bd00 con 0x7fa284159c60 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa270004810 0x7fa270004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa288fbc700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa270003c20 0x7fa270004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2897bd700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 -- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 msgr2=0x7fa2700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:56.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa2700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 -- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa270003c20 msgr2=0x7fa270004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa270003c20 0x7fa270004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 -- 172.21.15.22:0/3474407915 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa270003570 con 0x7fa270004810 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2897bd700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa284159c60 0x7fa2700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa283fff700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa270004810 0x7fa270004c80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa28415a090 tx=0x7fa2740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d895f1a5574af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400e710 con 0x7fa270004810 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27400e870 con 0x7fa270004810 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.873+0000 7fa2837fe700 1 -- 172.21.15.22:0/3474407915 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400ec30 con 0x7fa270004810 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa28b220700 1 -- 172.21.15.22:0/3474407915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa270004810 msgr2=0x7fa270004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa28b220700 1 --2- 172.21.15.22:0/3474407915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa270004810 0x7fa270004c80 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa28415a090 tx=0x7fa2740091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa2897bd700 1 -- 172.21.15.22:0/3474407915 reap_dead start 2023-10-08T00:26:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa28b220700 1 -- 172.21.15.22:0/3474407915 shutdown_connections 2023-10-08T00:26:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa28b220700 1 -- 172.21.15.22:0/3474407915 >> 172.21.15.22:0/3474407915 conn(0x7fa284068e20 msgr2=0x7fa2840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa28b220700 1 -- 172.21.15.22:0/3474407915 shutdown_connections 2023-10-08T00:26:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.874+0000 7fa28b220700 1 -- 172.21.15.22:0/3474407915 wait complete. 2023-10-08T00:26:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.875+0000 7fa28b220700 1 Processor -- start 2023-10-08T00:26:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.875+0000 7fa28b220700 1 -- start start 2023-10-08T00:26:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa28b220700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa270004810 0x7fa2840b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa28b220700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa284152990 0x7fa284169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa28b220700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 0x7fa2840b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa28b220700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28416ae80 con 0x7fa2840b5890 2023-10-08T00:26:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa28b220700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28416a3d0 con 0x7fa284152990 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa28b220700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b05d0 con 0x7fa270004810 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa2897bd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 0x7fa2840b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa2897bd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 0x7fa2840b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52850/0 (socket says 172.21.15.22:52850) 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa2897bd700 1 -- 172.21.15.22:0/1586754362 learned_addr learned my addr 172.21.15.22:0/1586754362 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa288fbc700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa270004810 0x7fa2840b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.876+0000 7fa283fff700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa284152990 0x7fa284169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa2897bd700 1 -- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa270004810 msgr2=0x7fa2840b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa2897bd700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa270004810 0x7fa2840b3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa2897bd700 1 -- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa284152990 msgr2=0x7fa284169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa2897bd700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa284152990 0x7fa284169e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:56.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa2897bd700 1 -- 172.21.15.22:0/1586754362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840cdbd0 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa2897bd700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 0x7fa2840b5d00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa28415dee0 tx=0x7fa27c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c017070 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c0032e0 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa284152e00 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c006ba0 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.877+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28416a8c0 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.878+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2840cdd60 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.878+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa27c001680 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.879+0000 7fa280ff9700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa264066fc0 0x7fa264069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.879+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa27c083f10 con 0x7fa2840b5890 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.879+0000 7fa288fbc700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa264066fc0 0x7fa264069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:56.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.879+0000 7fa288fbc700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa264066fc0 0x7fa264069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa26c000ff0 tx=0x7fa26c001e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:56.883+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa27c051190 con 0x7fa2840b5890 2023-10-08T00:26:57.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.076+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa28404c3c0 con 0x7fa2840b5890 2023-10-08T00:26:57.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.077+0000 7fa280ff9700 1 -- 172.21.15.22:0/1586754362 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15366 (secure 0 0 0) 0x7fa27c0547b0 con 0x7fa2840b5890 2023-10-08T00:26:57.077 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:57.077 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":63,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:56.111974+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:54.521604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:55.081427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:57.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.078+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa264066fc0 msgr2=0x7fa264069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.078+0000 7fa28b220700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa264066fc0 0x7fa264069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa26c000ff0 tx=0x7fa26c001e10 comp rx=0 tx=0).stop 2023-10-08T00:26:57.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.078+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 msgr2=0x7fa2840b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.078+0000 7fa28b220700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 0x7fa2840b5d00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa28415dee0 tx=0x7fa27c009040 comp rx=0 tx=0).stop 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 shutdown_connections 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2840b5890 0x7fa2840b5d00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa264066fc0 0x7fa264069470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa270004810 0x7fa2840b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 --2- 172.21.15.22:0/1586754362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa284152990 0x7fa284169e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 >> 172.21.15.22:0/1586754362 conn(0x7fa284068e20 msgr2=0x7fa2841530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 shutdown_connections 2023-10-08T00:26:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.079+0000 7fa28b220700 1 -- 172.21.15.22:0/1586754362 wait complete. 2023-10-08T00:26:57.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:26:57.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.210+0000 7f06ce3ac700 1 Processor -- start 2023-10-08T00:26:57.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.210+0000 7f06ce3ac700 1 -- start start 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06ce3ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 0x7f06c80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06ce3ac700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80b2980 con 0x7f06c81597f0 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06ce3ac700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80b11d0 con 0x7f06c815d230 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06ce3ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80b14b0 con 0x7f06c8159420 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06ccba9700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f06c81597f0 0x7f06c80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52988/0 (socket says 172.21.15.22:52988) 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06ccba9700 1 -- 172.21.15.22:0/2560766763 learned_addr learned my addr 172.21.15.22:0/2560766763 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06cd3aa700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 0x7f06c80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.211+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2037234895 0 0) 0x7f06c80b2980 con 0x7f06c81597f0 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06b0003570 con 0x7f06c81597f0 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516961043 0 0) 0x7f06c80b11d0 con 0x7f06c815d230 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c80b2980 con 0x7f06c815d230 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152304284 0 0) 0x7f06b0003570 con 0x7f06c81597f0 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 msgr2=0x7f06c80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 0x7f06c80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 >> v1:172.21.15.192:6789/0 conn(0x7f06c815d230 legacy=0x7f06c80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80b1790 con 0x7f06c81597f0 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f06bc001470 con 0x7f06c81597f0 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 >> v1:172.21.15.22:6789/0 conn(0x7f06c81597f0 legacy=0x7f06c80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b0003c20 0x7f06b0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 0x7f06b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b0004d50 0x7f06b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80b14b0 con 0x7f06b0004d50 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b000bbf0 con 0x7f06b0003c20 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b000bd60 con 0x7f06c8159420 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b0004d50 0x7f06b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cd3aa700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b0003c20 0x7f06b0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06ccba9700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 0x7f06b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 -- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 msgr2=0x7f06b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06c8159420 0x7f06b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 -- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b0003c20 msgr2=0x7f06b0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06b0003c20 0x7f06b0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 -- 172.21.15.22:0/2560766763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b0003570 con 0x7f06b0004d50 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.212+0000 7f06cdbab700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b0004d50 0x7f06b00051c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f06c00020f0 tx=0x7f06c00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15f631cf54df50c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0001ab0 con 0x7f06b0004d50 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000c8b0 con 0x7f06b0004d50 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06c7fff700 1 -- 172.21.15.22:0/2560766763 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000cc70 con 0x7f06b0004d50 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06ce3ac700 1 -- 172.21.15.22:0/2560766763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b0004d50 msgr2=0x7f06b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/2560766763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b0004d50 0x7f06b00051c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f06c00020f0 tx=0x7f06c00017a0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06cdbab700 1 -- 172.21.15.22:0/2560766763 reap_dead start 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06ce3ac700 1 -- 172.21.15.22:0/2560766763 shutdown_connections 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06ce3ac700 1 -- 172.21.15.22:0/2560766763 >> 172.21.15.22:0/2560766763 conn(0x7f06c80d0660 msgr2=0x7f06c80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06ce3ac700 1 -- 172.21.15.22:0/2560766763 shutdown_connections 2023-10-08T00:26:57.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.213+0000 7f06ce3ac700 1 -- 172.21.15.22:0/2560766763 wait complete. 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.214+0000 7f06ce3ac700 1 Processor -- start 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.214+0000 7f06ce3ac700 1 -- start start 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ce3ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b0004d50 0x7f06c81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ce3ac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c8154d00 0x7f06c81530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ce3ac700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 0x7f06c81575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ce3ac700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8154870 con 0x7f06c81535e0 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ce3ac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8153a10 con 0x7f06c8154d00 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ce3ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8153c60 con 0x7f06b0004d50 2023-10-08T00:26:57.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06cdbab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 0x7f06c81575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06cdbab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 0x7f06c81575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52856/0 (socket says 172.21.15.22:52856) 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06cdbab700 1 -- 172.21.15.22:0/1623779669 learned_addr learned my addr 172.21.15.22:0/1623779669 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06cd3aa700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b0004d50 0x7f06c81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.215+0000 7f06ccba9700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c8154d00 0x7f06c81530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06cdbab700 1 -- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b0004d50 msgr2=0x7f06c81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06cdbab700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b0004d50 0x7f06c81505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06cdbab700 1 -- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c8154d00 msgr2=0x7f06c81530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06cdbab700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c8154d00 0x7f06c81530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06cdbab700 1 -- 172.21.15.22:0/1623779669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8153f40 con 0x7f06c81535e0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06cdbab700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 0x7f06c81575d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f06b00057a0 tx=0x7f06c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000ca20 con 0x7f06c81535e0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000cb80 con 0x7f06c81535e0 2023-10-08T00:26:57.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c8154220 con 0x7f06c81535e0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0006df0 con 0x7f06c81535e0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.216+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c815e800 con 0x7f06c81535e0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.217+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c804c3c0 con 0x7f06c81535e0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.218+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f06c0003030 con 0x7f06c81535e0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.218+0000 7f06c57fa700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f06b4066fc0 0x7f06b4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.218+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06c00868c0 con 0x7f06c81535e0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.218+0000 7f06cd3aa700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f06b4066fc0 0x7f06b4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.219+0000 7f06cd3aa700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f06b4066fc0 0x7f06b4069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f06b8006f00 tx=0x7f06b80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:57.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.222+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06c0053b40 con 0x7f06c81535e0 2023-10-08T00:26:57.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.415+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06c81549b0 con 0x7f06c81535e0 2023-10-08T00:26:57.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.416+0000 7f06c57fa700 1 -- 172.21.15.22:0/1623779669 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f06c0057160 con 0x7f06c81535e0 2023-10-08T00:26:57.416 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:26:57.416 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":63,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:56.111974+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:54.521604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:55.081427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:26:57.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f06b4066fc0 msgr2=0x7f06b4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f06b4066fc0 0x7f06b4069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f06b8006f00 tx=0x7f06b80091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 msgr2=0x7f06c81575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 0x7f06c81575d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f06b00057a0 tx=0x7f06c0016000 comp rx=0 tx=0).stop 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 shutdown_connections 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06c81535e0 0x7f06c81575d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f06b4066fc0 0x7f06b4069470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06b0004d50 0x7f06c81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 --2- 172.21.15.22:0/1623779669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c8154d00 0x7f06c81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 >> 172.21.15.22:0/1623779669 conn(0x7f06c80d0660 msgr2=0x7f06c80b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 shutdown_connections 2023-10-08T00:26:57.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.418+0000 7f06ce3ac700 1 -- 172.21.15.22:0/1623779669 wait complete. 2023-10-08T00:26:57.431 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:26:57.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.552+0000 7fe0753a7700 1 Processor -- start 2023-10-08T00:26:57.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.552+0000 7fe0753a7700 1 -- start start 2023-10-08T00:26:57.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.552+0000 7fe0753a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe07015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.552+0000 7fe0753a7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe070159c60 0x7fe07015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.552+0000 7fe0753a7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07015a160 con 0x7fe07015db10 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe0753a7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0700d13a0 con 0x7fe070159c60 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe0753a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07015e140 con 0x7fe070159890 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe07015db10 0x7fe070069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53004/0 (socket says 172.21.15.22:53004) 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06f7fe700 1 -- 172.21.15.22:0/1542526515 learned_addr learned my addr 172.21.15.22:0/1542526515 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06e7fc700 1 --2- 172.21.15.22:0/1542526515 >> v2:172.21.15.192:3300/0 conn(0x7fe070159c60 0x7fe07015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06effd700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe07015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06dffb700 1 -- 172.21.15.22:0/1542526515 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009752941 0 0) 0x7fe07015a160 con 0x7fe07015db10 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06dffb700 1 -- 172.21.15.22:0/1542526515 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe05c003570 con 0x7fe07015db10 2023-10-08T00:26:57.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06e7fc700 1 -- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 msgr2=0x7fe07015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06e7fc700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe07015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06e7fc700 1 -- 172.21.15.22:0/1542526515 >> v1:172.21.15.22:6789/0 conn(0x7fe07015db10 legacy=0x7fe070069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06e7fc700 1 -- 172.21.15.22:0/1542526515 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07015a3d0 con 0x7fe070159c60 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06effd700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe07015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.553+0000 7fe06e7fc700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070159c60 0x7fe07015d5d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098e0 tx=0x7fe0580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823427ead382da62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe06dffb700 1 -- 172.21.15.22:0/1542526515 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011630 con 0x7fe070159c60 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe06dffb700 1 -- 172.21.15.22:0/1542526515 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058011790 con 0x7fe070159c60 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe06dffb700 1 -- 172.21.15.22:0/1542526515 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011b30 con 0x7fe070159c60 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 -- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070159c60 msgr2=0x7fe07015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070159c60 0x7fe07015d5d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe0580098e0 tx=0x7fe0580091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 -- 172.21.15.22:0/1542526515 shutdown_connections 2023-10-08T00:26:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe07015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 --2- 172.21.15.22:0/1542526515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe070159c60 0x7fe07015d5d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 -- 172.21.15.22:0/1542526515 >> 172.21.15.22:0/1542526515 conn(0x7fe070068e20 msgr2=0x7fe0700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:57.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 -- 172.21.15.22:0/1542526515 shutdown_connections 2023-10-08T00:26:57.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.554+0000 7fe0753a7700 1 -- 172.21.15.22:0/1542526515 wait complete. 2023-10-08T00:26:57.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.555+0000 7fe0753a7700 1 Processor -- start 2023-10-08T00:26:57.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.555+0000 7fe0753a7700 1 -- start start 2023-10-08T00:26:57.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe0753a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe070155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe0753a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 0x7fe0700b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe0753a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07015db10 0x7fe070150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe0753a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070154700 con 0x7fe070159c60 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe0753a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe070154950 con 0x7fe07015db10 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe0753a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe070154c30 con 0x7fe070159890 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 0x7fe0700b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 0x7fe0700b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52866/0 (socket says 172.21.15.22:52866) 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06e7fc700 1 -- 172.21.15.22:0/3351167250 learned_addr learned my addr 172.21.15.22:0/3351167250 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06effd700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe070155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06f7fe700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07015db10 0x7fe070150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06e7fc700 1 -- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 msgr2=0x7fe070155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.556+0000 7fe06e7fc700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe070155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe06e7fc700 1 -- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07015db10 msgr2=0x7fe070150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:57.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe06e7fc700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07015db10 0x7fe070150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe06e7fc700 1 -- 172.21.15.22:0/3351167250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068009420 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe06e7fc700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 0x7fe0700b1390 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe058013000 tx=0x7fe058017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058011900 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058011a60 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe058009420 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058025640 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.557+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0701551f0 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.558+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe070155410 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.558+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe058025a30 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.559+0000 7fe066ffd700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe050066fc0 0x7fe050069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.559+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe058085c60 con 0x7fe070159c60 2023-10-08T00:26:57.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.559+0000 7fe06effd700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe050066fc0 0x7fe050069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:57.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.559+0000 7fe06effd700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe050066fc0 0x7fe050069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe068009eb0 tx=0x7fe0680091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:57.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.563+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe058052ee0 con 0x7fe070159c60 2023-10-08T00:26:57.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:57.806+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe07004c3c0 con 0x7fe070159c60 2023-10-08T00:26:58.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.736+0000 7fe066ffd700 1 -- 172.21.15.22:0/3351167250 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe058056500 con 0x7fe070159c60 2023-10-08T00:26:58.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe050066fc0 msgr2=0x7fe050069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe050066fc0 0x7fe050069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe068009eb0 tx=0x7fe0680091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 msgr2=0x7fe0700b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 0x7fe0700b1390 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe058013000 tx=0x7fe058017000 comp rx=0 tx=0).stop 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 shutdown_connections 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07015db10 0x7fe070150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe050066fc0 0x7fe050069470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe070159890 0x7fe070155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 --2- 172.21.15.22:0/3351167250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe070159c60 0x7fe0700b1390 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 >> 172.21.15.22:0/3351167250 conn(0x7fe070068e20 msgr2=0x7fe0700cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 shutdown_connections 2023-10-08T00:26:58.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.739+0000 7fe0753a7700 1 -- 172.21.15.22:0/3351167250 wait complete. 2023-10-08T00:26:58.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:26:58.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.884+0000 7f61701a7700 1 Processor -- start 2023-10-08T00:26:58.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.884+0000 7f61701a7700 1 -- start start 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f61701a7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6168159890 0x7f616815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f61701a7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6168069560 0x7f61680699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f61701a7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6168069ee0 con 0x7f6168159c60 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f61701a7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616815a160 con 0x7f6168069560 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f61701a7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680d13a0 con 0x7f6168159890 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6168069560 0x7f61680699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6168069560 0x7f61680699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52868/0 (socket says 172.21.15.22:52868) 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 -- 172.21.15.22:0/1809785433 learned_addr learned my addr 172.21.15.22:0/1809785433 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:58.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616df43700 1 --2- 172.21.15.22:0/1809785433 >> v2:172.21.15.192:3300/0 conn(0x7f6168159890 0x7f616815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 -- 172.21.15.22:0/1809785433 >> v2:172.21.15.192:3300/0 conn(0x7f6168159890 msgr2=0x7f616815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 --2- 172.21.15.22:0/1809785433 >> v2:172.21.15.192:3300/0 conn(0x7f6168159890 0x7f616815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 -- 172.21.15.22:0/1809785433 >> v1:172.21.15.192:6789/0 conn(0x7f6168159c60 legacy=0x7f616815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 -- 172.21.15.22:0/1809785433 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616815e140 con 0x7f6168069560 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616df43700 1 --2- 172.21.15.22:0/1809785433 >> v2:172.21.15.192:3300/0 conn(0x7f6168159890 0x7f616815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.885+0000 7f616e744700 1 --2- 172.21.15.22:0/1809785433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f61680699a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61680d1090 tx=0x7f6160009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42eeb198fde1ec7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f616cf41700 1 -- 172.21.15.22:0/1809785433 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000b820 con 0x7f6168069560 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f616cf41700 1 -- 172.21.15.22:0/1809785433 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616000b980 con 0x7f6168069560 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f616cf41700 1 -- 172.21.15.22:0/1809785433 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000bd20 con 0x7f6168069560 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 -- 172.21.15.22:0/1809785433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 msgr2=0x7f61680699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 --2- 172.21.15.22:0/1809785433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f61680699a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f61680d1090 tx=0x7f6160009250 comp rx=0 tx=0).stop 2023-10-08T00:26:58.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 -- 172.21.15.22:0/1809785433 shutdown_connections 2023-10-08T00:26:58.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 --2- 172.21.15.22:0/1809785433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f61680699a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 --2- 172.21.15.22:0/1809785433 >> v2:172.21.15.192:3300/0 conn(0x7f6168159890 0x7f616815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 -- 172.21.15.22:0/1809785433 >> 172.21.15.22:0/1809785433 conn(0x7f6168068e20 msgr2=0x7f61680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:58.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 -- 172.21.15.22:0/1809785433 shutdown_connections 2023-10-08T00:26:58.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.886+0000 7f61701a7700 1 -- 172.21.15.22:0/1809785433 wait complete. 2023-10-08T00:26:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.887+0000 7f61701a7700 1 Processor -- start 2023-10-08T00:26:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.887+0000 7f61701a7700 1 -- start start 2023-10-08T00:26:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f61701a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f6168154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:58.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f61701a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168159890 0x7f61680c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f61701a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6168159c60 0x7f61680c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f61701a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680b1b20 con 0x7f6168069560 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f61701a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680ca700 con 0x7f6168159890 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f61701a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680c9e60 con 0x7f6168159c60 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f6168154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f6168154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52876/0 (socket says 172.21.15.22:52876) 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 -- 172.21.15.22:0/1491711025 learned_addr learned my addr 172.21.15.22:0/1491711025 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616d742700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168159890 0x7f61680c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616e744700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6168159c60 0x7f61680c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 -- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6168159c60 msgr2=0x7f61680c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6168159c60 0x7f61680c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 -- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168159890 msgr2=0x7f61680c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168159890 0x7f61680c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616df43700 1 -- 172.21.15.22:0/1491711025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61600094f0 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.888+0000 7f616d742700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168159890 0x7f61680c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.889+0000 7f616df43700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f6168154450 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f615800a430 tx=0x7f6158007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.889+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800d650 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.889+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800d7b0 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.889+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680ca140 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.889+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800db50 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.889+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61680b36a0 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.890+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680b38c0 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.890+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6158015440 con 0x7f6168069560 2023-10-08T00:26:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.891+0000 7f6165ffb700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6154066fc0 0x7f6154069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:58.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.891+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6158084e10 con 0x7f6168069560 2023-10-08T00:26:58.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.891+0000 7f616d742700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6154066fc0 0x7f6154069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:58.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.892+0000 7f616d742700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6154066fc0 0x7f6154069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fd0 tx=0x7f615c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:58.895+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f615804e5a0 con 0x7f6168069560 2023-10-08T00:26:59.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.133+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f616804c3c0 con 0x7f6168069560 2023-10-08T00:26:59.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.737+0000 7f6165ffb700 1 -- 172.21.15.22:0/1491711025 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f615801a0c0 con 0x7f6168069560 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6154066fc0 msgr2=0x7f6154069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6154066fc0 0x7f6154069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fd0 tx=0x7f615c008040 comp rx=0 tx=0).stop 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 msgr2=0x7f6168154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f6168154450 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f615800a430 tx=0x7f6158007910 comp rx=0 tx=0).stop 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 shutdown_connections 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6154066fc0 0x7f6154069470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6168159c60 0x7f61680c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6168069560 0x7f6168154450 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 --2- 172.21.15.22:0/1491711025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6168159890 0x7f61680c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 >> 172.21.15.22:0/1491711025 conn(0x7f6168068e20 msgr2=0x7f6168157250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 shutdown_connections 2023-10-08T00:26:59.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.740+0000 7f61701a7700 1 -- 172.21.15.22:0/1491711025 wait complete. 2023-10-08T00:26:59.754 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:26:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.877+0000 7f70d651b700 1 Processor -- start 2023-10-08T00:26:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.877+0000 7f70d651b700 1 -- start start 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70d651b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70d015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70d651b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d015a160 con 0x7f70d0159890 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70d651b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00d13a0 con 0x7f70d015db10 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70d651b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d015e140 con 0x7f70d0159c60 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70cffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f70d0159890 0x7f70d015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53016/0 (socket says 172.21.15.22:53016) 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70cffff700 1 -- 172.21.15.22:0/2852738709 learned_addr learned my addr 172.21.15.22:0/2852738709 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70d015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539039919 0 0) 0x7f70d015a160 con 0x7f70d0159890 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003570 con 0x7f70d0159890 2023-10-08T00:26:59.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 465215276 0 0) 0x7f70b8003570 con 0x7f70d0159890 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 msgr2=0x7f70d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70d015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 >> v1:172.21.15.192:6789/0 conn(0x7f70d015db10 legacy=0x7f70d0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d015a3d0 con 0x7f70d0159890 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.878+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f70c0001470 con 0x7f70d0159890 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 >> v1:172.21.15.22:6789/0 conn(0x7f70d0159890 legacy=0x7f70d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70b8003a90 0x7f70b8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d015e140 con 0x7f70b8004810 2023-10-08T00:26:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b800bb10 con 0x7f70b8003a90 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b800bcd0 con 0x7f70d0159c60 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cffff700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70b8003a90 0x7f70b8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70d4ab8700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 -- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 msgr2=0x7f70b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 -- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70b8003a90 msgr2=0x7f70b8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70b8003a90 0x7f70b8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 -- 172.21.15.22:0/2852738709 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b8003570 con 0x7f70b8004810 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70d4ab8700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d0159c60 0x7f70b80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70b8004c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f70d015a090 tx=0x7f70c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412dd0a549040826 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400e710 con 0x7f70b8004810 2023-10-08T00:26:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c400e870 con 0x7f70b8004810 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.879+0000 7f70ceffd700 1 -- 172.21.15.22:0/2852738709 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400ec30 con 0x7f70b8004810 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d651b700 1 -- 172.21.15.22:0/2852738709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 msgr2=0x7f70b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d651b700 1 --2- 172.21.15.22:0/2852738709 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70b8004c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f70d015a090 tx=0x7f70c40091a0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d4ab8700 1 -- 172.21.15.22:0/2852738709 reap_dead start 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d651b700 1 -- 172.21.15.22:0/2852738709 shutdown_connections 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d651b700 1 -- 172.21.15.22:0/2852738709 >> 172.21.15.22:0/2852738709 conn(0x7f70d0068e20 msgr2=0x7f70d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d651b700 1 -- 172.21.15.22:0/2852738709 shutdown_connections 2023-10-08T00:26:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.880+0000 7f70d651b700 1 -- 172.21.15.22:0/2852738709 wait complete. 2023-10-08T00:26:59.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.881+0000 7f70d651b700 1 Processor -- start 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.881+0000 7f70d651b700 1 -- start start 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d651b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70d0150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d651b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d00ca1a0 0x7f70d00cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d651b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70d0158580 0x7f70d01589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d651b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0158f30 con 0x7f70b8004810 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d651b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00ca610 con 0x7f70d0158580 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d651b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00cf9b0 con 0x7f70d00ca1a0 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70d0150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70d0150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52900/0 (socket says 172.21.15.22:52900) 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 -- 172.21.15.22:0/3704443123 learned_addr learned my addr 172.21.15.22:0/3704443123 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:26:59.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70d4ab8700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70d0158580 0x7f70d01589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d00ca1a0 0x7f70d00cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 -- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d00ca1a0 msgr2=0x7f70d00cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d00ca1a0 0x7f70d00cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 -- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70d0158580 msgr2=0x7f70d01589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.882+0000 7f70cffff700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70d0158580 0x7f70d01589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70cffff700 1 -- 172.21.15.22:0/3704443123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00cfc90 con 0x7f70b8004810 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d00ca1a0 0x7f70d00cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70cffff700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70d0150c80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f70c0007390 tx=0x7f70c0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0018030 con 0x7f70b8004810 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000f870 con 0x7f70b8004810 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d015b650 con 0x7f70b8004810 2023-10-08T00:26:59.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000fc10 con 0x7f70b8004810 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.883+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d00cf630 con 0x7f70b8004810 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.884+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00cfe80 con 0x7f70b8004810 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.884+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f70c001b070 con 0x7f70b8004810 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.885+0000 7f70b7fff700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70bc066fc0 0x7f70bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.885+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70c0019070 con 0x7f70b8004810 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.885+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70bc066fc0 0x7f70bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.886+0000 7f70cf7fe700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70bc066fc0 0x7f70bc069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70c40091e0 tx=0x7f70c401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:26:59.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:26:59.889+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70c0051770 con 0x7f70b8004810 2023-10-08T00:27:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.123+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70d004c3c0 con 0x7f70b8004810 2023-10-08T00:27:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.124+0000 7f70b7fff700 1 -- 172.21.15.22:0/3704443123 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f70c0054d90 con 0x7f70b8004810 2023-10-08T00:27:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:00.124 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:56.112286+0000","modified":"2023-10-08T00:26:59.735766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/2573785310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2573785310},{"type":"v1","addr":"172.21.15.22:6835","nonce":2573785310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T00:27:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70bc066fc0 msgr2=0x7f70bc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70bc066fc0 0x7f70bc069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70c40091e0 tx=0x7f70c401a000 comp rx=0 tx=0).stop 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 msgr2=0x7f70d0150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70d0150c80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f70c0007390 tx=0x7f70c0001e70 comp rx=0 tx=0).stop 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 shutdown_connections 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70d0158580 0x7f70d01589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70b8004810 0x7f70d0150c80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70bc066fc0 0x7f70bc069470 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 --2- 172.21.15.22:0/3704443123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70d00ca1a0 0x7f70d00cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 >> 172.21.15.22:0/3704443123 conn(0x7f70d0068e20 msgr2=0x7f70d0156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 shutdown_connections 2023-10-08T00:27:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.126+0000 7f70d651b700 1 -- 172.21.15.22:0/3704443123 wait complete. 2023-10-08T00:27:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 42 2023-10-08T00:27:00.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:27:00.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.257+0000 7f8a18661700 1 Processor -- start 2023-10-08T00:27:00.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.257+0000 7f8a18661700 1 -- start start 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a18661700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a1006bcd0 0x7f8a10140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a18661700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8a1006c0a0 0x7f8a10141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a18661700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1015c2a0 con 0x7f8a100c8e00 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a18661700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100c9900 con 0x7f8a1006bcd0 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a18661700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1015b690 con 0x7f8a1006c0a0 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a1006bcd0 0x7f8a10140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a1006bcd0 0x7f8a10140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52908/0 (socket says 172.21.15.22:52908) 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 -- 172.21.15.22:0/2397701134 learned_addr learned my addr 172.21.15.22:0/2397701134 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a15bfc700 1 --2- 172.21.15.22:0/2397701134 >> v2:172.21.15.192:3300/0 conn(0x7f8a1006c0a0 0x7f8a10141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 -- 172.21.15.22:0/2397701134 >> v2:172.21.15.192:3300/0 conn(0x7f8a1006c0a0 msgr2=0x7f8a10141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 --2- 172.21.15.22:0/2397701134 >> v2:172.21.15.192:3300/0 conn(0x7f8a1006c0a0 0x7f8a10141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 -- 172.21.15.22:0/2397701134 >> v1:172.21.15.192:6789/0 conn(0x7f8a100c8e00 legacy=0x7f8a100c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.258+0000 7f8a163fd700 1 -- 172.21.15.22:0/2397701134 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1015b970 con 0x7f8a1006bcd0 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a163fd700 1 --2- 172.21.15.22:0/2397701134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a10140df0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8a1006c6e0 tx=0x7f8a0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10cd0b33c83f7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a153fb700 1 -- 172.21.15.22:0/2397701134 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c009e70 con 0x7f8a1006bcd0 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a153fb700 1 -- 172.21.15.22:0/2397701134 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c00b860 con 0x7f8a1006bcd0 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a153fb700 1 -- 172.21.15.22:0/2397701134 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00bc00 con 0x7f8a1006bcd0 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 -- 172.21.15.22:0/2397701134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 msgr2=0x7f8a10140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 --2- 172.21.15.22:0/2397701134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a10140df0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8a1006c6e0 tx=0x7f8a0c009250 comp rx=0 tx=0).stop 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 -- 172.21.15.22:0/2397701134 shutdown_connections 2023-10-08T00:27:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 --2- 172.21.15.22:0/2397701134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a10140df0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 --2- 172.21.15.22:0/2397701134 >> v2:172.21.15.192:3300/0 conn(0x7f8a1006c0a0 0x7f8a10141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 -- 172.21.15.22:0/2397701134 >> 172.21.15.22:0/2397701134 conn(0x7f8a100ce600 msgr2=0x7f8a100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 -- 172.21.15.22:0/2397701134 shutdown_connections 2023-10-08T00:27:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.259+0000 7f8a18661700 1 -- 172.21.15.22:0/2397701134 wait complete. 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 Processor -- start 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 -- start start 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a1013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a1006c0a0 0x7f8a100b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a100c8e00 0x7f8a10157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100c56b0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10168830 con 0x7f8a100c8e00 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a18661700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100b3510 con 0x7f8a1006c0a0 2023-10-08T00:27:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a163fd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a1013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a163fd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a1013f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52916/0 (socket says 172.21.15.22:52916) 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a163fd700 1 -- 172.21.15.22:0/654965401 learned_addr learned my addr 172.21.15.22:0/654965401 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a15bfc700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a1006c0a0 0x7f8a100b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.261+0000 7f8a16bfe700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a100c8e00 0x7f8a10157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a163fd700 1 -- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a1006c0a0 msgr2=0x7f8a100b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a163fd700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a1006c0a0 0x7f8a100b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a163fd700 1 -- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a100c8e00 msgr2=0x7f8a10157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a163fd700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a100c8e00 0x7f8a10157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a163fd700 1 -- 172.21.15.22:0/654965401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0094f0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a16bfe700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a100c8e00 0x7f8a10157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a163fd700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a1013f090 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8a10069220 tx=0x7f8a0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c00b9d0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c00bb30 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a10167f00 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c025670 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.262+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a101684c0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.263+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1004c3c0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.263+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8a0c023070 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.264+0000 7f8a067fc700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f89f4066fc0 0x7f89f4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.264+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a0c085a60 con 0x7f8a1006bcd0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.264+0000 7f8a15bfc700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f89f4066fc0 0x7f89f4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.265+0000 7f8a15bfc700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f89f4066fc0 0x7f89f4069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a1016b1a0 tx=0x7f8a000091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.268+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a0c052ce0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.465+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a1006c9d0 con 0x7f8a1006bcd0 2023-10-08T00:27:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.466+0000 7f8a067fc700 1 -- 172.21.15.22:0/654965401 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f8a0c056300 con 0x7f8a1006bcd0 2023-10-08T00:27:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:00.467 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":64,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:26:57.718777+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:54.521604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:55.081427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:27:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f89f4066fc0 msgr2=0x7f89f4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f89f4066fc0 0x7f89f4069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a1016b1a0 tx=0x7f8a000091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 msgr2=0x7f8a1013f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a1013f090 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8a10069220 tx=0x7f8a0c017000 comp rx=0 tx=0).stop 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 shutdown_connections 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a100c8e00 0x7f8a10157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a1006bcd0 0x7f8a1013f090 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f89f4066fc0 0x7f89f4069470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 --2- 172.21.15.22:0/654965401 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a1006c0a0 0x7f8a100b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 >> 172.21.15.22:0/654965401 conn(0x7f8a100ce600 msgr2=0x7f8a100c3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 shutdown_connections 2023-10-08T00:27:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.468+0000 7f8a18661700 1 -- 172.21.15.22:0/654965401 wait complete. 2023-10-08T00:27:00.481 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:27:00.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:27:00.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 Processor -- start 2023-10-08T00:27:00.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 -- start start 2023-10-08T00:27:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfe8155c10 0x7fdfe8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfe80ac230 0x7fdfe80ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe80ad930 con 0x7fdfe81568a0 2023-10-08T00:27:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80acd20 con 0x7fdfe8155c10 2023-10-08T00:27:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.600+0000 7fdfeddf3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80ad000 con 0x7fdfe80ac230 2023-10-08T00:27:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfe8155c10 0x7fdfe8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdfe81568a0 0x7fdfe8156c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53020/0 (socket says 172.21.15.22:53020) 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe7fff700 1 -- 172.21.15.22:0/4212078010 learned_addr learned my addr 172.21.15.22:0/4212078010 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfdeffd700 1 --2- 172.21.15.22:0/4212078010 >> v2:172.21.15.192:3300/0 conn(0x7fdfe80ac230 0x7fdfe80ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe77fe700 1 -- 172.21.15.22:0/4212078010 >> v2:172.21.15.192:3300/0 conn(0x7fdfe80ac230 msgr2=0x7fdfe80ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe77fe700 1 --2- 172.21.15.22:0/4212078010 >> v2:172.21.15.192:3300/0 conn(0x7fdfe80ac230 0x7fdfe80ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe77fe700 1 -- 172.21.15.22:0/4212078010 >> v1:172.21.15.22:6789/0 conn(0x7fdfe81568a0 legacy=0x7fdfe8156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe77fe700 1 -- 172.21.15.22:0/4212078010 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80ad2e0 con 0x7fdfe8155c10 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe6ffd700 1 -- 172.21.15.22:0/4212078010 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153799345 0 0) 0x7fdfe80ad930 con 0x7fdfe81568a0 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe77fe700 1 --2- 172.21.15.22:0/4212078010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8155c10 0x7fdfe8155fe0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8065bb0 tx=0x7fdfd800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abfa2540b76a7d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe6ffd700 1 -- 172.21.15.22:0/4212078010 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd800db40 con 0x7fdfe8155c10 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe6ffd700 1 -- 172.21.15.22:0/4212078010 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd800dca0 con 0x7fdfe8155c10 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.601+0000 7fdfe6ffd700 1 -- 172.21.15.22:0/4212078010 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80196b0 con 0x7fdfe8155c10 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 -- 172.21.15.22:0/4212078010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8155c10 msgr2=0x7fdfe8155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/4212078010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8155c10 0x7fdfe8155fe0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8065bb0 tx=0x7fdfd800b430 comp rx=0 tx=0).stop 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 -- 172.21.15.22:0/4212078010 shutdown_connections 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/4212078010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8155c10 0x7fdfe8155fe0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/4212078010 >> v2:172.21.15.192:3300/0 conn(0x7fdfe80ac230 0x7fdfe80ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 -- 172.21.15.22:0/4212078010 >> 172.21.15.22:0/4212078010 conn(0x7fdfe806a320 msgr2=0x7fdfe80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 -- 172.21.15.22:0/4212078010 shutdown_connections 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.602+0000 7fdfeddf3700 1 -- 172.21.15.22:0/4212078010 wait complete. 2023-10-08T00:27:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.603+0000 7fdfeddf3700 1 Processor -- start 2023-10-08T00:27:00.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.603+0000 7fdfeddf3700 1 -- start start 2023-10-08T00:27:00.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfeddf3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe80ac230 0x7fdfe8145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfeddf3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe8155c10 0x7fdfe816ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfeddf3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 0x7fdfe816d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfeddf3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80a88f0 con 0x7fdfe81568a0 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfeddf3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe816dcc0 con 0x7fdfe8155c10 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfeddf3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80a6ef0 con 0x7fdfe80ac230 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 0x7fdfe816d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 0x7fdfe816d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52940/0 (socket says 172.21.15.22:52940) 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 -- 172.21.15.22:0/3269725447 learned_addr learned my addr 172.21.15.22:0/3269725447 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe77fe700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe80ac230 0x7fdfe8145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfdeffd700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe8155c10 0x7fdfe816ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 -- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe80ac230 msgr2=0x7fdfe8145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe80ac230 0x7fdfe8145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 -- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe8155c10 msgr2=0x7fdfe816ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe8155c10 0x7fdfe816ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 -- 172.21.15.22:0/3269725447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd800b6d0 con 0x7fdfe81568a0 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe77fe700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe80ac230 0x7fdfe8145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.604+0000 7fdfe7fff700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 0x7fdfe816d340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000cc20 tx=0x7fdfe00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.605+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0004bb0 con 0x7fdfe81568a0 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.605+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe0004d10 con 0x7fdfe81568a0 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.605+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe816d9e0 con 0x7fdfe81568a0 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.605+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000abd0 con 0x7fdfe81568a0 2023-10-08T00:27:00.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.605+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe80a6b80 con 0x7fdfe81568a0 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.606+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe804c3c0 con 0x7fdfe81568a0 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.606+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fdfe00070f0 con 0x7fdfe81568a0 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.606+0000 7fdfdffff700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8066fc0 0x7fdfc8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.606+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfe0084380 con 0x7fdfe81568a0 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.607+0000 7fdfe77fe700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8066fc0 0x7fdfc8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.607+0000 7fdfe77fe700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8066fc0 0x7fdfc8069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b2c0 tx=0x7fdfd801b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.611+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfe0051680 con 0x7fdfe81568a0 2023-10-08T00:27:00.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.801+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfe80a7030 con 0x7fdfc8066fc0 2023-10-08T00:27:00.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.810+0000 7fdfdffff700 1 -- 172.21.15.22:0/3269725447 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278581 (secure 0 0 0) 0x7fdfe80a7030 con 0x7fdfc8066fc0 2023-10-08T00:27:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:00.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8066fc0 msgr2=0x7fdfc8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8066fc0 0x7fdfc8069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b2c0 tx=0x7fdfd801b000 comp rx=0 tx=0).stop 2023-10-08T00:27:00.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 msgr2=0x7fdfe816d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 0x7fdfe816d340 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000cc20 tx=0x7fdfe00019b0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 shutdown_connections 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe81568a0 0x7fdfe816d340 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8066fc0 0x7fdfc8069470 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe80ac230 0x7fdfe8145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 --2- 172.21.15.22:0/3269725447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe8155c10 0x7fdfe816ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 >> 172.21.15.22:0/3269725447 conn(0x7fdfe806a320 msgr2=0x7fdfe81535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 shutdown_connections 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.813+0000 7fdfeddf3700 1 -- 172.21.15.22:0/3269725447 wait complete. 2023-10-08T00:27:00.817 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:27:00.826 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T00:27:00.412224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397520,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577200,"statfs":{"total":773094113280,"available":770639052800,"internally_reserved":0,"allocated":7094272,"data_stored":3670230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710477"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706871+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:09:10.797703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702570+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:56.865069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703941+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:16:32.236439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706143+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:35.361715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:32.827749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.709118+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:24.732838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706550+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704464+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:04.455095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703684+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:59.948502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707230+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:21:39.576244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:12:43.421595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706439+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:50:46.906246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706508+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708599+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:02.464447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:51:33.630847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703651+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708434+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:24:58.614550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703683+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:47.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706142+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:49.467384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706781+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:54.297394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707248+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.100759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706786+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:11.983810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702776+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:13.168893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706213+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:00:20.467599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706496+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:43.476715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704507+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:54.246185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702639+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:47.036620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704495+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:38:04.360255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706485+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703676+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706047+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:04.886746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706201+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.851148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-08T00:26:52.958499+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:52.958499+0000","last_peered":"2023-10-08T00:26:52.958499+0000","last_clean":"2023-10-08T00:26:52.958499+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:52.958499+0000","last_undegraded":"2023-10-08T00:26:52.958499+0000","last_fullsized":"2023-10-08T00:26:52.958499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.621},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.436}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.36499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71699999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":1.145,"15min":1.145},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70499999999999996,"5min":1.079,"15min":1.079},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.127,"15min":1.127},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":1.093,"15min":1.093},"last":0.50600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.373,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.34000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.624,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.32800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.871,"5min":1.004,"15min":1.004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.294,"15min":1.294},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.038,"15min":1.038},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.999,"15min":0.999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.752,"5min":0.879,"15min":0.879},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97999999999999998,"5min":1.087,"15min":1.087},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.434,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.22},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.24299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.317}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.46899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.311}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84899999999999998,"5min":1.242,"15min":1.242},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.874,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.46400000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.372}]},{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54900000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.31}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0489999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.278,"15min":1.278},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0880000000000001,"5min":1.137,"15min":1.137},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85899999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":1.343,"15min":1.343},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52300000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.41099999999999998},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78500000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.62},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93300000000000005,"5min":1.712,"15min":1.712},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66800000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71799999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.745}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67200000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74399999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:27:00.833 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:27:00.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:27:00.869 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:27:00.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.985+0000 7fde6a701700 1 Processor -- start 2023-10-08T00:27:00.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.985+0000 7fde6a701700 1 -- start start 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde6a701700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde64159b10 0x7fde640cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde6a701700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fde6415d730 0x7fde6415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde6a701700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde64159ee0 0x7fde6415a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde6a701700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640c74b0 con 0x7fde64159ee0 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde6a701700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6415e0e0 con 0x7fde6415d730 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde6a701700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c8700 con 0x7fde64159b10 2023-10-08T00:27:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde68c9e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde64159ee0 0x7fde6415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde68c9e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde64159ee0 0x7fde6415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52954/0 (socket says 172.21.15.22:52954) 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde68c9e700 1 -- 172.21.15.22:0/4065489016 learned_addr learned my addr 172.21.15.22:0/4065489016 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde637fe700 1 --2- 172.21.15.22:0/4065489016 >> v2:172.21.15.192:3300/0 conn(0x7fde6415d730 0x7fde6415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde63fff700 1 --2- 172.21.15.22:0/4065489016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde64159b10 0x7fde640cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde68c9e700 1 -- 172.21.15.22:0/4065489016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde64159b10 msgr2=0x7fde640cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.986+0000 7fde68c9e700 1 --2- 172.21.15.22:0/4065489016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde64159b10 0x7fde640cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde68c9e700 1 -- 172.21.15.22:0/4065489016 >> v2:172.21.15.192:3300/0 conn(0x7fde6415d730 msgr2=0x7fde6415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde68c9e700 1 --2- 172.21.15.22:0/4065489016 >> v2:172.21.15.192:3300/0 conn(0x7fde6415d730 0x7fde6415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde68c9e700 1 -- 172.21.15.22:0/4065489016 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640c9070 con 0x7fde64159ee0 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde68c9e700 1 --2- 172.21.15.22:0/4065489016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde6415a360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fde64064900 tx=0x7fde5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f417d7a8c32b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde62ffd700 1 -- 172.21.15.22:0/4065489016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00e070 con 0x7fde64159ee0 2023-10-08T00:27:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde62ffd700 1 -- 172.21.15.22:0/4065489016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c00bae0 con 0x7fde64159ee0 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde62ffd700 1 -- 172.21.15.22:0/4065489016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0092e0 con 0x7fde64159ee0 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 -- 172.21.15.22:0/4065489016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 msgr2=0x7fde6415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 --2- 172.21.15.22:0/4065489016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde6415a360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fde64064900 tx=0x7fde5c009840 comp rx=0 tx=0).stop 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 -- 172.21.15.22:0/4065489016 shutdown_connections 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 --2- 172.21.15.22:0/4065489016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde6415a360 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 --2- 172.21.15.22:0/4065489016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde64159b10 0x7fde640cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 --2- 172.21.15.22:0/4065489016 >> v2:172.21.15.192:3300/0 conn(0x7fde6415d730 0x7fde6415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 -- 172.21.15.22:0/4065489016 >> 172.21.15.22:0/4065489016 conn(0x7fde640c9870 msgr2=0x7fde640c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 -- 172.21.15.22:0/4065489016 shutdown_connections 2023-10-08T00:27:00.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.987+0000 7fde6a701700 1 -- 172.21.15.22:0/4065489016 wait complete. 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.988+0000 7fde6a701700 1 Processor -- start 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 -- start start 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64159b10 0x7fde640c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde64140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde6415d730 0x7fde64157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c6ad0 con 0x7fde64159ee0 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c5ec0 con 0x7fde64159b10 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde6a701700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c61a0 con 0x7fde6415d730 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.989+0000 7fde637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde64140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde64140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52956/0 (socket says 172.21.15.22:52956) 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 -- 172.21.15.22:0/3228505557 learned_addr learned my addr 172.21.15.22:0/3228505557 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde68c9e700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde6415d730 0x7fde64157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde63fff700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64159b10 0x7fde640c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 -- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde6415d730 msgr2=0x7fde64157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde6415d730 0x7fde64157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 -- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64159b10 msgr2=0x7fde640c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64159b10 0x7fde640c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 -- 172.21.15.22:0/3228505557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009ae0 con 0x7fde64159ee0 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde63fff700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64159b10 0x7fde640c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde637fe700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde64140280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00d860 tx=0x7fde4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c009610 con 0x7fde64159ee0 2023-10-08T00:27:00.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c009770 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde640c6480 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c009b30 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.990+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640c5b90 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.991+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640c6c40 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.992+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fde4c01e460 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.992+0000 7fde5bfff700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde44066fc0 0x7fde44069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.992+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fde4c084bc0 con 0x7fde64159ee0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.992+0000 7fde63fff700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde44066fc0 0x7fde44069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:00.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.993+0000 7fde63fff700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde44066fc0 0x7fde44069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fde54006fd0 tx=0x7fde54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:00.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:00.996+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde4c051e40 con 0x7fde64159ee0 2023-10-08T00:27:01.025 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-10-08T00:27:01.024+0000 7f8e24c5b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:27:01.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.184+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde6404c3c0 con 0x7fde44066fc0 2023-10-08T00:27:01.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.192+0000 7fde5bfff700 1 -- 172.21.15.22:0/3228505557 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278581 (secure 0 0 0) 0x7fde6404c3c0 con 0x7fde44066fc0 2023-10-08T00:27:01.196 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde44066fc0 msgr2=0x7fde44069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde44066fc0 0x7fde44069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fde54006fd0 tx=0x7fde54008040 comp rx=0 tx=0).stop 2023-10-08T00:27:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 msgr2=0x7fde64140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde64140280 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00d860 tx=0x7fde4c008040 comp rx=0 tx=0).stop 2023-10-08T00:27:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 shutdown_connections 2023-10-08T00:27:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde44066fc0 0x7fde44069470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde6415d730 0x7fde64157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde64159b10 0x7fde640c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 --2- 172.21.15.22:0/3228505557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde64159ee0 0x7fde64140280 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 >> 172.21.15.22:0/3228505557 conn(0x7fde640c9870 msgr2=0x7fde640ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.195+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 shutdown_connections 2023-10-08T00:27:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.196+0000 7fde6a701700 1 -- 172.21.15.22:0/3228505557 wait complete. 2023-10-08T00:27:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:27:01.208 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T00:27:00.412224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397520,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577200,"statfs":{"total":773094113280,"available":770639052800,"internally_reserved":0,"allocated":7094272,"data_stored":3670230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710477"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706871+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:09:10.797703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702570+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:56.865069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703941+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:16:32.236439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706143+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:35.361715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:32.827749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.709118+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:24.732838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706550+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704464+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:04.455095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703684+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:59.948502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707230+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:21:39.576244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:12:43.421595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706439+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:50:46.906246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706508+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708599+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:02.464447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:51:33.630847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703651+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708434+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:24:58.614550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703683+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:47.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706142+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:49.467384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706781+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:54.297394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707248+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.100759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706786+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:11.983810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702776+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:13.168893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706213+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:00:20.467599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706496+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:43.476715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704507+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:54.246185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702639+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:47.036620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704495+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:38:04.360255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706485+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703676+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706047+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:04.886746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706201+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.851148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-08T00:26:52.958499+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:52.958499+0000","last_peered":"2023-10-08T00:26:52.958499+0000","last_clean":"2023-10-08T00:26:52.958499+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:52.958499+0000","last_undegraded":"2023-10-08T00:26:52.958499+0000","last_fullsized":"2023-10-08T00:26:52.958499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.621},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.436}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.36499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71699999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":1.145,"15min":1.145},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70499999999999996,"5min":1.079,"15min":1.079},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.127,"15min":1.127},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":1.093,"15min":1.093},"last":0.50600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.373,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.34000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.624,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.32800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.871,"5min":1.004,"15min":1.004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.294,"15min":1.294},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.038,"15min":1.038},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.999,"15min":0.999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.752,"5min":0.879,"15min":0.879},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97999999999999998,"5min":1.087,"15min":1.087},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.434,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.22},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.24299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.317}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.46899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.311}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84899999999999998,"5min":1.242,"15min":1.242},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.874,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.46400000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.372}]},{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54900000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.31}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0489999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.278,"15min":1.278},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0880000000000001,"5min":1.137,"15min":1.137},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85899999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":1.343,"15min":1.343},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52300000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.41099999999999998},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78500000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.62},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93300000000000005,"5min":1.712,"15min":1.712},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66800000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71799999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.745}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67200000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74399999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:27:01.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:27:01.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.366+0000 7f3ac9690700 1 Processor -- start 2023-10-08T00:27:01.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.366+0000 7f3ac9690700 1 -- start start 2023-10-08T00:27:01.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac9690700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac9690700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ac4069560 0x7f3ac40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac9690700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac415a160 con 0x7f3ac4159c60 2023-10-08T00:27:01.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac9690700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac4069f20 con 0x7f3ac4069560 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac9690700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40d13a0 con 0x7f3ac4159890 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ac4069560 0x7f3ac40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ac4069560 0x7f3ac40699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52968/0 (socket says 172.21.15.22:52968) 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac37fe700 1 -- 172.21.15.22:0/3708516019 learned_addr learned my addr 172.21.15.22:0/3708516019 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.367+0000 7f3ac2ffd700 1 --2- 172.21.15.22:0/3708516019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac37fe700 1 -- 172.21.15.22:0/3708516019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 msgr2=0x7f3ac415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac37fe700 1 --2- 172.21.15.22:0/3708516019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac37fe700 1 -- 172.21.15.22:0/3708516019 >> v1:172.21.15.192:6789/0 conn(0x7f3ac4159c60 legacy=0x7f3ac415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac37fe700 1 -- 172.21.15.22:0/3708516019 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac415e140 con 0x7f3ac4069560 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac37fe700 1 --2- 172.21.15.22:0/3708516019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4069560 0x7f3ac40699e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009f20 tx=0x7f3abc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4140ba96fc6751d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:01.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac1ffb700 1 -- 172.21.15.22:0/3708516019 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc00e070 con 0x7f3ac4069560 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac1ffb700 1 -- 172.21.15.22:0/3708516019 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc00b9d0 con 0x7f3ac4069560 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac1ffb700 1 -- 172.21.15.22:0/3708516019 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc0092e0 con 0x7f3ac4069560 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac9690700 1 -- 172.21.15.22:0/3708516019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4069560 msgr2=0x7f3ac40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.368+0000 7f3ac9690700 1 --2- 172.21.15.22:0/3708516019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4069560 0x7f3ac40699e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3abc009f20 tx=0x7f3abc009840 comp rx=0 tx=0).stop 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.369+0000 7f3ac9690700 1 -- 172.21.15.22:0/3708516019 shutdown_connections 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.369+0000 7f3ac9690700 1 --2- 172.21.15.22:0/3708516019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4069560 0x7f3ac40699e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.369+0000 7f3ac9690700 1 --2- 172.21.15.22:0/3708516019 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.369+0000 7f3ac9690700 1 -- 172.21.15.22:0/3708516019 >> 172.21.15.22:0/3708516019 conn(0x7f3ac4068e20 msgr2=0x7f3ac40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.369+0000 7f3ac9690700 1 -- 172.21.15.22:0/3708516019 shutdown_connections 2023-10-08T00:27:01.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.369+0000 7f3ac9690700 1 -- 172.21.15.22:0/3708516019 wait complete. 2023-10-08T00:27:01.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.370+0000 7f3ac9690700 1 Processor -- start 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.370+0000 7f3ac9690700 1 -- start start 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ac4069560 0x7f3ac414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 0x7f3ac4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4151ae0 con 0x7f3ac4159c60 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40b0940 con 0x7f3ac4069560 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40ce9b0 con 0x7f3ac4159890 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 0x7f3ac4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 0x7f3ac4155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52974/0 (socket says 172.21.15.22:52974) 2023-10-08T00:27:01.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 -- 172.21.15.22:0/718705017 learned_addr learned my addr 172.21.15.22:0/718705017 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac2ffd700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ac4069560 0x7f3ac414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac27fc700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 -- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 msgr2=0x7f3ac4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac4154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 -- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ac4069560 msgr2=0x7f3ac414d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ac4069560 0x7f3ac414d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 -- 172.21.15.22:0/718705017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009ae0 con 0x7f3ac4159c60 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac2ffd700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ac4069560 0x7f3ac414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac37fe700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 0x7f3ac4155210 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b610 tx=0x7f3abc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc008c30 con 0x7f3ac4159c60 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc008d90 con 0x7f3ac4159c60 2023-10-08T00:27:01.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac40cec90 con 0x7f3ac4159c60 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc01c640 con 0x7f3ac4159c60 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.371+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac40b05d0 con 0x7f3ac4159c60 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.372+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac40b0ad0 con 0x7f3ac4159c60 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.373+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f3abc003040 con 0x7f3ac4159c60 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.373+0000 7f3abaffd700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3aa4066fc0 0x7f3aa4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.373+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3abc085ed0 con 0x7f3ac4159c60 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.373+0000 7f3ac2ffd700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3aa4066fc0 0x7f3aa4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.374+0000 7f3ac2ffd700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3aa4066fc0 0x7f3aa4069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4006f00 tx=0x7f3ab4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:01.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.377+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3abc053040 con 0x7f3ac4159c60 2023-10-08T00:27:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.567+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ac404c3c0 con 0x7f3aa4066fc0 2023-10-08T00:27:01.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.575+0000 7f3abaffd700 1 -- 172.21.15.22:0/718705017 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278581 (secure 0 0 0) 0x7f3ac404c3c0 con 0x7f3aa4066fc0 2023-10-08T00:27:01.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3aa4066fc0 msgr2=0x7f3aa4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3aa4066fc0 0x7f3aa4069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4006f00 tx=0x7f3ab4008040 comp rx=0 tx=0).stop 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 msgr2=0x7f3ac4155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 0x7f3ac4155210 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3abc00b610 tx=0x7f3abc018000 comp rx=0 tx=0).stop 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 shutdown_connections 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ac4159c60 0x7f3ac4155210 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ac4069560 0x7f3ac414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3aa4066fc0 0x7f3aa4069470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 --2- 172.21.15.22:0/718705017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ac4159890 0x7f3ac4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 >> 172.21.15.22:0/718705017 conn(0x7f3ac4068e20 msgr2=0x7f3ac4158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:01.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 shutdown_connections 2023-10-08T00:27:01.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.578+0000 7f3ac9690700 1 -- 172.21.15.22:0/718705017 wait complete. 2023-10-08T00:27:01.582 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:27:01.591 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T00:27:00.412224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397520,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577200,"statfs":{"total":773094113280,"available":770639052800,"internally_reserved":0,"allocated":7094272,"data_stored":3670230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710477"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706871+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:09:10.797703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702570+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:56.865069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703941+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:16:32.236439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706143+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:35.361715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:32.827749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.709118+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:24.732838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706550+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704464+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:04.455095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703684+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:59.948502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707230+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:21:39.576244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:12:43.421595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706439+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:50:46.906246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706508+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708599+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:02.464447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:51:33.630847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703651+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708434+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:24:58.614550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703683+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:47.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706142+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:49.467384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706781+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:54.297394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707248+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.100759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706786+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:11.983810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702776+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:13.168893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706213+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:00:20.467599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706496+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:43.476715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704507+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:54.246185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702639+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:47.036620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704495+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:38:04.360255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706485+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703676+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706047+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:04.886746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706201+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.851148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-08T00:26:52.958499+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:52.958499+0000","last_peered":"2023-10-08T00:26:52.958499+0000","last_clean":"2023-10-08T00:26:52.958499+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:52.958499+0000","last_undegraded":"2023-10-08T00:26:52.958499+0000","last_fullsized":"2023-10-08T00:26:52.958499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.621},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.436}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.36499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71699999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":1.145,"15min":1.145},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70499999999999996,"5min":1.079,"15min":1.079},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.127,"15min":1.127},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":1.093,"15min":1.093},"last":0.50600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.373,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.34000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.624,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.32800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.871,"5min":1.004,"15min":1.004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.294,"15min":1.294},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.038,"15min":1.038},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.999,"15min":0.999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.752,"5min":0.879,"15min":0.879},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97999999999999998,"5min":1.087,"15min":1.087},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.434,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.22},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.24299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.317}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.46899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.311}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84899999999999998,"5min":1.242,"15min":1.242},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.874,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.46400000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.372}]},{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54900000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.31}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0489999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.278,"15min":1.278},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0880000000000001,"5min":1.137,"15min":1.137},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85899999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":1.343,"15min":1.343},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52300000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.41099999999999998},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78500000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.62},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93300000000000005,"5min":1.712,"15min":1.712},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66800000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71799999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.745}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67200000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74399999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.597 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-08T00:27:01.598 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-08T00:27:01.600 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-08T00:27:01.601 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.602 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-08T00:27:01.603 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706871+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:09:10.797703+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.604 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.702570+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:17:56.865069+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703941+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:16:32.236439+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706143+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:00:35.361715+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.605 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703382+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:41:32.827749+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.709118+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T12:00:24.732838+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-08T00:27:01.606 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706550+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.704464+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:27:04.455095+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-08T00:27:01.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703684+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:44:59.948502+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.707230+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:21:39.576244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703382+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:12:43.421595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:27:01.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706439+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:50:46.906246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706508+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-08T00:27:01.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.708599+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:23:02.464447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.707382+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:51:33.630847+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-08T00:27:01.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703651+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.708434+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:24:58.614550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703683+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:14:47.231446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706142+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T00:57:49.467384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-08T00:27:01.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706781+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:03:54.297394+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.707248+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:08:08.100759+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706786+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:23:11.983810+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-08T00:27:01.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.702776+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:51:13.168893+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706213+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:00:20.467599+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-08T00:27:01.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706496+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:19:43.476715+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.704507+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:52:54.246185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-08T00:27:01.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.702639+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:32:47.036620+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.704495+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:38:04.360255+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-08T00:27:01.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706485+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:52:58.019148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.703676+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706047+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T00:43:04.886746+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-08T00:27:01.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T00:26:55.700090+0000', 'last_change': '2023-10-08T00:26:55.700090+0000', 'last_active': '2023-10-08T00:26:55.700090+0000', 'last_peered': '2023-10-08T00:26:55.700090+0000', 'last_clean': '2023-10-08T00:26:55.700090+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:55.700090+0000', 'last_undegraded': '2023-10-08T00:26:55.700090+0000', 'last_fullsized': '2023-10-08T00:26:55.700090+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:55.700090+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T00:27:01.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-08T00:27:01.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:26:54.694985+0000', 'last_change': '2023-10-08T00:26:54.706201+0000', 'last_active': '2023-10-08T00:26:54.694985+0000', 'last_peered': '2023-10-08T00:26:54.694985+0000', 'last_clean': '2023-10-08T00:26:54.694985+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:26:54.694985+0000', 'last_undegraded': '2023-10-08T00:26:54.694985+0000', 'last_fullsized': '2023-10-08T00:26:54.694985+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'last_clean_scrub_stamp': '2023-10-08T00:26:54.694985+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:29:46.851148+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:27:01.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T00:27:01.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.749+0000 7f8aa277e700 1 Processor -- start 2023-10-08T00:27:01.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 -- start start 2023-10-08T00:27:01.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c155360 0x7f8a9c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8a9c0b40f0 0x7f8a9c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a9c0ceb60 0x7f8a9c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c0b4560 con 0x7f8a9c0ceb60 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c15c320 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa277e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0cef90 con 0x7f8a9c155360 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.750+0000 7f8aa0d1b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a9c0ceb60 0x7f8a9c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a9c0ceb60 0x7f8a9c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52978/0 (socket says 172.21.15.22:52978) 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 -- 172.21.15.22:0/2499497448 learned_addr learned my addr 172.21.15.22:0/2499497448 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8a9b7fe700 1 --2- 172.21.15.22:0/2499497448 >> v2:172.21.15.192:3300/0 conn(0x7f8a9c0b40f0 0x7f8a9c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 -- 172.21.15.22:0/2499497448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c155360 msgr2=0x7f8a9c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 --2- 172.21.15.22:0/2499497448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c155360 0x7f8a9c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 -- 172.21.15.22:0/2499497448 >> v2:172.21.15.192:3300/0 conn(0x7f8a9c0b40f0 msgr2=0x7f8a9c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 --2- 172.21.15.22:0/2499497448 >> v2:172.21.15.192:3300/0 conn(0x7f8a9c0b40f0 0x7f8a9c0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 -- 172.21.15.22:0/2499497448 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c15b710 con 0x7f8a9c0ceb60 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8aa0d1b700 1 --2- 172.21.15.22:0/2499497448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0ceb60 0x7f8a9c06d130 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c06f4f0 tx=0x7f8a94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab975a060cde16e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8a9affd700 1 -- 172.21.15.22:0/2499497448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400e070 con 0x7f8a9c0ceb60 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8a9affd700 1 -- 172.21.15.22:0/2499497448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9400ba50 con 0x7f8a9c0ceb60 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.751+0000 7f8a9affd700 1 -- 172.21.15.22:0/2499497448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940092e0 con 0x7f8a9c0ceb60 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 -- 172.21.15.22:0/2499497448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0ceb60 msgr2=0x7f8a9c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 --2- 172.21.15.22:0/2499497448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0ceb60 0x7f8a9c06d130 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c06f4f0 tx=0x7f8a94009840 comp rx=0 tx=0).stop 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 -- 172.21.15.22:0/2499497448 shutdown_connections 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 --2- 172.21.15.22:0/2499497448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0ceb60 0x7f8a9c06d130 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 --2- 172.21.15.22:0/2499497448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c155360 0x7f8a9c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 --2- 172.21.15.22:0/2499497448 >> v2:172.21.15.192:3300/0 conn(0x7f8a9c0b40f0 0x7f8a9c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 -- 172.21.15.22:0/2499497448 >> 172.21.15.22:0/2499497448 conn(0x7f8a9c06baf0 msgr2=0x7f8a9c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:01.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 -- 172.21.15.22:0/2499497448 shutdown_connections 2023-10-08T00:27:01.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.752+0000 7f8aa277e700 1 -- 172.21.15.22:0/2499497448 wait complete. 2023-10-08T00:27:01.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.753+0000 7f8aa277e700 1 Processor -- start 2023-10-08T00:27:01.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.753+0000 7f8aa277e700 1 -- start start 2023-10-08T00:27:01.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 0x7f8a9c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0ceb60 0x7f8a9c0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c155360 0x7f8a9c156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0b0090 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0b0370 con 0x7f8a9c155360 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0b0650 con 0x7f8a9c0ceb60 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 0x7f8a9c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 0x7f8a9c153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52992/0 (socket says 172.21.15.22:52992) 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 -- 172.21.15.22:0/22532841 learned_addr learned my addr 172.21.15.22:0/22532841 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 -- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0ceb60 msgr2=0x7f8a9c0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9b7fe700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0ceb60 0x7f8a9c0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0ceb60 0x7f8a9c0af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa0d1b700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c155360 0x7f8a9c156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 -- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c155360 msgr2=0x7f8a9c156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c155360 0x7f8a9c156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 -- 172.21.15.22:0/22532841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94009ae0 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a9bfff700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 0x7f8a9c153270 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b810 tx=0x7f8a840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400f570 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8400f6d0 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c0b0930 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400fa90 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.754+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c1537b0 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.755+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c04c3c0 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.756+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8a8401a460 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.756+0000 7f8a93fff700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a7c066fc0 0x7f8a7c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.756+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a84084170 con 0x7f8a9c0b40f0 2023-10-08T00:27:01.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.756+0000 7f8a9b7fe700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a7c066fc0 0x7f8a7c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:01.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.757+0000 7f8a9b7fe700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a7c066fc0 0x7f8a7c069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c16b290 tx=0x7f8a8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:01.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:01.760+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a84051470 con 0x7f8a9c0b40f0 2023-10-08T00:27:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.037+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8a9c15b9f0 con 0x7f8a9c0b40f0 2023-10-08T00:27:02.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.038+0000 7f8a93fff700 1 -- 172.21.15.22:0/22532841 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1530 (secure 0 0 0) 0x7f8a84054a90 con 0x7f8a9c0b40f0 2023-10-08T00:27:02.038 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:02.038 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":147,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1696724684,"num_in_osds":8,"osd_in_since":1696724677,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2455060480,"bytes_avail":770639052800,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":42,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5709}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-08T00:26:04.399860+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T00:27:02.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a7c066fc0 msgr2=0x7f8a7c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a7c066fc0 0x7f8a7c069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c16b290 tx=0x7f8a8c008040 comp rx=0 tx=0).stop 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 msgr2=0x7f8a9c153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 0x7f8a9c153270 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b810 tx=0x7f8a840091d0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 shutdown_connections 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a9c155360 0x7f8a9c156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a9c0b40f0 0x7f8a9c153270 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a7c066fc0 0x7f8a7c069470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 --2- 172.21.15.22:0/22532841 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a9c0ceb60 0x7f8a9c0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 >> 172.21.15.22:0/22532841 conn(0x7f8a9c06baf0 msgr2=0x7f8a9c1594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 shutdown_connections 2023-10-08T00:27:02.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.040+0000 7f8aa277e700 1 -- 172.21.15.22:0/22532841 wait complete. 2023-10-08T00:27:02.052 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T00:27:02.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:27:02.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.171+0000 7f23b2dcf700 1 Processor -- start 2023-10-08T00:27:02.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.171+0000 7f23b2dcf700 1 -- start start 2023-10-08T00:27:02.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23b2dcf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23ac159c60 0x7f23ac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:02.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23b2dcf700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac15a160 con 0x7f23ac15db10 2023-10-08T00:27:02.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23b2dcf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0d13a0 con 0x7f23ac159890 2023-10-08T00:27:02.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23b2dcf700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac15df50 con 0x7f23ac159c60 2023-10-08T00:27:02.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23abfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f23ac159c60 0x7f23ac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23b136c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f23ac15db10 0x7f23ac069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53028/0 (socket says 172.21.15.22:53028) 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.172+0000 7f23b136c700 1 -- 172.21.15.22:0/144865942 learned_addr learned my addr 172.21.15.22:0/144865942 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23abfff700 1 -- 172.21.15.22:0/144865942 >> v1:172.21.15.192:6789/0 conn(0x7f23ac159890 legacy=0x7f23ac15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23abfff700 1 -- 172.21.15.22:0/144865942 >> v1:172.21.15.22:6789/0 conn(0x7f23ac15db10 legacy=0x7f23ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23ab7fe700 1 -- 172.21.15.22:0/144865942 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750334452 0 0) 0x7f23ac15a160 con 0x7f23ac15db10 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23abfff700 1 -- 172.21.15.22:0/144865942 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac15e140 con 0x7f23ac159c60 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23abfff700 1 --2- 172.21.15.22:0/144865942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159c60 0x7f23ac15d5d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23a00098e0 tx=0x7f23a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4939c57c3ac2db8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23ab7fe700 1 -- 172.21.15.22:0/144865942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a0009e80 con 0x7f23ac159c60 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23ab7fe700 1 -- 172.21.15.22:0/144865942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a000b860 con 0x7f23ac159c60 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.173+0000 7f23ab7fe700 1 -- 172.21.15.22:0/144865942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a000bbe0 con 0x7f23ac159c60 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 -- 172.21.15.22:0/144865942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159c60 msgr2=0x7f23ac15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/144865942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159c60 0x7f23ac15d5d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f23a00098e0 tx=0x7f23a00091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 -- 172.21.15.22:0/144865942 shutdown_connections 2023-10-08T00:27:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/144865942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159c60 0x7f23ac15d5d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 -- 172.21.15.22:0/144865942 >> 172.21.15.22:0/144865942 conn(0x7f23ac068e20 msgr2=0x7f23ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 -- 172.21.15.22:0/144865942 shutdown_connections 2023-10-08T00:27:02.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.174+0000 7f23b2dcf700 1 -- 172.21.15.22:0/144865942 wait complete. 2023-10-08T00:27:02.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.175+0000 7f23b2dcf700 1 Processor -- start 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.175+0000 7f23b2dcf700 1 -- start start 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 0x7f23ac155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac159c60 0x7f23ac148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac15db10 0x7f23ac1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac1497f0 con 0x7f23ac159890 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0cfcf0 con 0x7f23ac159c60 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac16d280 con 0x7f23ac15db10 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 0x7f23ac155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 0x7f23ac155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53010/0 (socket says 172.21.15.22:53010) 2023-10-08T00:27:02.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 -- 172.21.15.22:0/2103565669 learned_addr learned my addr 172.21.15.22:0/2103565669 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23abfff700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac159c60 0x7f23ac148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 -- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac15db10 msgr2=0x7f23ac1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac15db10 0x7f23ac1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 -- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac159c60 msgr2=0x7f23ac148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac159c60 0x7f23ac148d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 -- 172.21.15.22:0/2103565669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a0009420 con 0x7f23ac159890 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b0b6b700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 0x7f23ac155240 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c590 tx=0x7f239c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c011590 con 0x7f23ac159890 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c0116f0 con 0x7f23ac159890 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac16d560 con 0x7f23ac159890 2023-10-08T00:27:02.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c011ab0 con 0x7f23ac159890 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.176+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac16db20 con 0x7f23ac159890 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.178+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac04c3c0 con 0x7f23ac159890 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.178+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f239c01b3b0 con 0x7f23ac159890 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.178+0000 7f23a8ff9700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2398066fc0 0x7f2398069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.178+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f239c083b90 con 0x7f23ac159890 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.178+0000 7f23abfff700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2398066fc0 0x7f2398069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:02.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.179+0000 7f23abfff700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2398066fc0 0x7f2398069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f23a0003080 tx=0x7f23a0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:02.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.182+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f239c050e10 con 0x7f23ac159890 2023-10-08T00:27:02.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.371+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23ac0890e0 con 0x7f2398066fc0 2023-10-08T00:27:02.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.379+0000 7f23a8ff9700 1 -- 172.21.15.22:0/2103565669 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278581 (secure 0 0 0) 0x7f23ac0890e0 con 0x7f2398066fc0 2023-10-08T00:27:02.383 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:02.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2398066fc0 msgr2=0x7f2398069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2398066fc0 0x7f2398069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f23a0003080 tx=0x7f23a0017000 comp rx=0 tx=0).stop 2023-10-08T00:27:02.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 msgr2=0x7f23ac155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:02.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 0x7f23ac155240 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c590 tx=0x7f239c00c950 comp rx=0 tx=0).stop 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 shutdown_connections 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2398066fc0 0x7f2398069470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23ac15db10 0x7f23ac1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23ac159890 0x7f23ac155240 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 --2- 172.21.15.22:0/2103565669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23ac159c60 0x7f23ac148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 >> 172.21.15.22:0/2103565669 conn(0x7f23ac068e20 msgr2=0x7f23ac15cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 shutdown_connections 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:02.383+0000 7f23b2dcf700 1 -- 172.21.15.22:0/2103565669 wait complete. 2023-10-08T00:27:02.386 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:27:02.395 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2023-10-08T00:27:00.412224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397520,"kb_used_data":6928,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752577200,"statfs":{"total":773094113280,"available":770639052800,"internally_reserved":0,"allocated":7094272,"data_stored":3670230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.710477"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706871+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:09:10.797703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702570+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:56.865069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703941+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:16:32.236439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706143+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:00:35.361715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:32.827749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.709118+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:24.732838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706550+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704464+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:04.455095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703684+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:59.948502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707230+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:21:39.576244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:12:43.421595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706439+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:50:46.906246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706508+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708599+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:02.464447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707382+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:51:33.630847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703651+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:17:00.478583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.708434+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:24:58.614550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703683+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:47.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706142+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:49.467384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706781+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:54.297394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.707248+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.100759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706786+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:11.983810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702776+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:13.168893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706213+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:00:20.467599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706496+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:43.476715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704507+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:54.246185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.702639+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:47.036620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.704495+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:38:04.360255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706485+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:58.019148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.703676+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:26:17.882498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706047+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:04.886746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:26:55.700090+0000","last_change":"2023-10-08T00:26:55.700090+0000","last_active":"2023-10-08T00:26:55.700090+0000","last_peered":"2023-10-08T00:26:55.700090+0000","last_clean":"2023-10-08T00:26:55.700090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:55.700090+0000","last_undegraded":"2023-10-08T00:26:55.700090+0000","last_fullsized":"2023-10-08T00:26:55.700090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:26:54.694985+0000","last_change":"2023-10-08T00:26:54.706201+0000","last_active":"2023-10-08T00:26:54.694985+0000","last_peered":"2023-10-08T00:26:54.694985+0000","last_clean":"2023-10-08T00:26:54.694985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:26:54.694985+0000","last_undegraded":"2023-10-08T00:26:54.694985+0000","last_fullsized":"2023-10-08T00:26:54.694985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:29:46.851148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":196,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-08T00:26:52.958499+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:52.958499+0000","last_peered":"2023-10-08T00:26:52.958499+0000","last_clean":"2023-10-08T00:26:52.958499+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:52.958499+0000","last_undegraded":"2023-10-08T00:26:52.958499+0000","last_fullsized":"2023-10-08T00:26:52.958499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.621},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.436}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.36499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71699999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.62}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":1.145,"15min":1.145},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.58299999999999996}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70499999999999996,"5min":1.079,"15min":1.079},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.127,"15min":1.127},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.45700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.52400000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":1.093,"15min":1.093},"last":0.50600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.26300000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.373,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.34000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.624,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.32800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.871,"5min":1.004,"15min":1.004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.54600000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.294,"15min":1.294},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.038,"15min":1.038},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.999,"15min":0.999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.752,"5min":0.879,"15min":0.879},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97999999999999998,"5min":1.087,"15min":1.087},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1335296,"data_stored":903006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.434,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.22},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.24299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.317}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.46899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.311}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84899999999999998,"5min":1.242,"15min":1.242},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.874,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.46400000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.62}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.372}]},{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54900000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.31}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0489999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.278,"15min":1.278},"last":0.70399999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0880000000000001,"5min":1.137,"15min":1.137},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85899999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":1.343,"15min":1.343},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302108,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069732,"statfs":{"total":96636764160,"available":96327405568,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52300000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.41099999999999998},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78500000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.62},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073828,"statfs":{"total":96636764160,"available":96331599872,"internally_reserved":0,"allocated":741376,"data_stored":312638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93300000000000005,"5min":1.712,"15min":1.712},"last":0.495},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.87,"15min":0.87},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66800000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.52700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71799999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.745}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67200000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74399999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:27:05.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:27:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.536+0000 7fb74cd13700 1 Processor -- start 2023-10-08T00:27:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.536+0000 7fb74cd13700 1 -- start start 2023-10-08T00:27:05.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74cd13700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb748069560 0x7fb7480699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74cd13700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb748069ee0 con 0x7fb748159890 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74cd13700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74815a160 con 0x7fb748159c60 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74cd13700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480d13a0 con 0x7fb748069560 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb746d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb748069560 0x7fb7480699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb748159890 0x7fb74815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53044/0 (socket says 172.21.15.22:53044) 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74659c700 1 -- 172.21.15.22:0/676004426 learned_addr learned my addr 172.21.15.22:0/676004426 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb746d9d700 1 -- 172.21.15.22:0/676004426 >> v1:172.21.15.192:6789/0 conn(0x7fb748159c60 legacy=0x7fb74815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb746d9d700 1 -- 172.21.15.22:0/676004426 >> v1:172.21.15.22:6789/0 conn(0x7fb748159890 legacy=0x7fb74815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb74559a700 1 -- 172.21.15.22:0/676004426 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755778369 0 0) 0x7fb748069ee0 con 0x7fb748159890 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb746d9d700 1 -- 172.21.15.22:0/676004426 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74815e140 con 0x7fb748069560 2023-10-08T00:27:05.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.537+0000 7fb746d9d700 1 --2- 172.21.15.22:0/676004426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7480699a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb740009e60 tx=0x7fb740009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72768ba3bfbbcc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74559a700 1 -- 172.21.15.22:0/676004426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000e070 con 0x7fb748069560 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74559a700 1 -- 172.21.15.22:0/676004426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74000bbf0 con 0x7fb748069560 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74559a700 1 -- 172.21.15.22:0/676004426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740012430 con 0x7fb748069560 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 -- 172.21.15.22:0/676004426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 msgr2=0x7fb7480699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 --2- 172.21.15.22:0/676004426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7480699a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb740009e60 tx=0x7fb740009780 comp rx=0 tx=0).stop 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 -- 172.21.15.22:0/676004426 shutdown_connections 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 --2- 172.21.15.22:0/676004426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7480699a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 -- 172.21.15.22:0/676004426 >> 172.21.15.22:0/676004426 conn(0x7fb748068e20 msgr2=0x7fb7480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 -- 172.21.15.22:0/676004426 shutdown_connections 2023-10-08T00:27:05.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.538+0000 7fb74cd13700 1 -- 172.21.15.22:0/676004426 wait complete. 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.539+0000 7fb74cd13700 1 Processor -- start 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.539+0000 7fb74cd13700 1 -- start start 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74cd13700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7481534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74cd13700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb748159890 0x7fb7480b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74cd13700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb748159c60 0x7fb748154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74cd13700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480cd0c0 con 0x7fb748069560 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74cd13700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480cd960 con 0x7fb748159c60 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74cd13700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb748153a30 con 0x7fb748159890 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7481534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7481534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53028/0 (socket says 172.21.15.22:53028) 2023-10-08T00:27:05.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb74659c700 1 -- 172.21.15.22:0/2866830297 learned_addr learned my addr 172.21.15.22:0/2866830297 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.540+0000 7fb746d9d700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb748159c60 0x7fb748154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb745d9b700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb748159890 0x7fb7480b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74659c700 1 -- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb748159890 msgr2=0x7fb7480b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74659c700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb748159890 0x7fb7480b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74659c700 1 -- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb748159c60 msgr2=0x7fb748154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74659c700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb748159c60 0x7fb748154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74659c700 1 -- 172.21.15.22:0/2866830297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740009a20 con 0x7fb748069560 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb745d9b700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb748159890 0x7fb7480b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74659c700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7481534f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c810 tx=0x7fb738007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738005b30 con 0x7fb748069560 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb738005c90 con 0x7fb748069560 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480b62c0 con 0x7fb748069560 2023-10-08T00:27:05.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb738007300 con 0x7fb748069560 2023-10-08T00:27:05.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.541+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480cd5f0 con 0x7fb748069560 2023-10-08T00:27:05.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.542+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74804c3c0 con 0x7fb748069560 2023-10-08T00:27:05.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.542+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb73801b400 con 0x7fb748069560 2023-10-08T00:27:05.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.543+0000 7fb7367fc700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb728066fc0 0x7fb728069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.543+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb738084070 con 0x7fb748069560 2023-10-08T00:27:05.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.543+0000 7fb745d9b700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb728066fc0 0x7fb728069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.544+0000 7fb745d9b700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb728066fc0 0x7fb728069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006fd0 tx=0x7fb73c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:05.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.547+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb738051370 con 0x7fb748069560 2023-10-08T00:27:05.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.738+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb74806a5b0 con 0x7fb728066fc0 2023-10-08T00:27:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.746+0000 7fb7367fc700 1 -- 172.21.15.22:0/2866830297 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289298 (secure 0 0 0) 0x7fb74806a5b0 con 0x7fb728066fc0 2023-10-08T00:27:05.750 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:05.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb728066fc0 msgr2=0x7fb728069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb728066fc0 0x7fb728069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006fd0 tx=0x7fb73c008040 comp rx=0 tx=0).stop 2023-10-08T00:27:05.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 msgr2=0x7fb7481534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7481534f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb73800c810 tx=0x7fb738007df0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 shutdown_connections 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb748159c60 0x7fb748154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb748069560 0x7fb7481534f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb728066fc0 0x7fb728069470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 --2- 172.21.15.22:0/2866830297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb748159890 0x7fb7480b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 >> 172.21.15.22:0/2866830297 conn(0x7fb748068e20 msgr2=0x7fb7480d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.749+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 shutdown_connections 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.750+0000 7fb74cd13700 1 -- 172.21.15.22:0/2866830297 wait complete. 2023-10-08T00:27:05.753 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:27:05.762 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-10-08T00:27:04.413085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397896,"kb_used_data":7304,"kb_used_omap":0,"kb_used_meta":2390528,"kb_avail":752576824,"statfs":{"total":773094113280,"available":770638667776,"internally_reserved":0,"allocated":7479296,"data_stored":3840964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2447900672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001645"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740415+0000","last_change":"2023-10-08T00:26:56.735759+0000","last_active":"2023-10-08T00:26:56.740415+0000","last_peered":"2023-10-08T00:26:56.740415+0000","last_clean":"2023-10-08T00:26:56.740415+0000","last_became_active":"2023-10-08T00:26:56.735499+0000","last_became_peered":"2023-10-08T00:26:56.735499+0000","last_unstale":"2023-10-08T00:26:56.740415+0000","last_undegraded":"2023-10-08T00:26:56.740415+0000","last_fullsized":"2023-10-08T00:26:56.740415+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:48:21.261709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723060+0000","last_change":"2023-10-08T00:26:56.717954+0000","last_active":"2023-10-08T00:26:56.723060+0000","last_peered":"2023-10-08T00:26:56.723060+0000","last_clean":"2023-10-08T00:26:56.723060+0000","last_became_active":"2023-10-08T00:26:56.717679+0000","last_became_peered":"2023-10-08T00:26:56.717679+0000","last_unstale":"2023-10-08T00:26:56.723060+0000","last_undegraded":"2023-10-08T00:26:56.723060+0000","last_fullsized":"2023-10-08T00:26:56.723060+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:44.481820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731733+0000","last_change":"2023-10-08T00:26:56.723180+0000","last_active":"2023-10-08T00:26:56.731733+0000","last_peered":"2023-10-08T00:26:56.731733+0000","last_clean":"2023-10-08T00:26:56.731733+0000","last_became_active":"2023-10-08T00:26:56.722933+0000","last_became_peered":"2023-10-08T00:26:56.722933+0000","last_unstale":"2023-10-08T00:26:56.731733+0000","last_undegraded":"2023-10-08T00:26:56.731733+0000","last_fullsized":"2023-10-08T00:26:56.731733+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:35:14.666118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.722544+0000","last_change":"2023-10-08T00:26:56.718668+0000","last_active":"2023-10-08T00:26:56.722544+0000","last_peered":"2023-10-08T00:26:56.722544+0000","last_clean":"2023-10-08T00:26:56.722544+0000","last_became_active":"2023-10-08T00:26:56.718388+0000","last_became_peered":"2023-10-08T00:26:56.718388+0000","last_unstale":"2023-10-08T00:26:56.722544+0000","last_undegraded":"2023-10-08T00:26:56.722544+0000","last_fullsized":"2023-10-08T00:26:56.722544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:48.041725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723362+0000","last_change":"2023-10-08T00:26:56.721678+0000","last_active":"2023-10-08T00:26:56.723362+0000","last_peered":"2023-10-08T00:26:56.723362+0000","last_clean":"2023-10-08T00:26:56.723362+0000","last_became_active":"2023-10-08T00:26:56.721395+0000","last_became_peered":"2023-10-08T00:26:56.721395+0000","last_unstale":"2023-10-08T00:26:56.723362+0000","last_undegraded":"2023-10-08T00:26:56.723362+0000","last_fullsized":"2023-10-08T00:26:56.723362+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:24:59.619655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.724274+0000","last_change":"2023-10-08T00:26:56.718264+0000","last_active":"2023-10-08T00:26:56.724274+0000","last_peered":"2023-10-08T00:26:56.724274+0000","last_clean":"2023-10-08T00:26:56.724274+0000","last_became_active":"2023-10-08T00:26:56.718000+0000","last_became_peered":"2023-10-08T00:26:56.718000+0000","last_unstale":"2023-10-08T00:26:56.724274+0000","last_undegraded":"2023-10-08T00:26:56.724274+0000","last_fullsized":"2023-10-08T00:26:56.724274+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:12.988915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.725535+0000","last_change":"2023-10-08T00:26:56.720734+0000","last_active":"2023-10-08T00:26:56.725535+0000","last_peered":"2023-10-08T00:26:56.725535+0000","last_clean":"2023-10-08T00:26:56.725535+0000","last_became_active":"2023-10-08T00:26:56.720461+0000","last_became_peered":"2023-10-08T00:26:56.720461+0000","last_unstale":"2023-10-08T00:26:56.725535+0000","last_undegraded":"2023-10-08T00:26:56.725535+0000","last_fullsized":"2023-10-08T00:26:56.725535+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:02.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731001+0000","last_change":"2023-10-08T00:26:56.720191+0000","last_active":"2023-10-08T00:26:56.731001+0000","last_peered":"2023-10-08T00:26:56.731001+0000","last_clean":"2023-10-08T00:26:56.731001+0000","last_became_active":"2023-10-08T00:26:56.719945+0000","last_became_peered":"2023-10-08T00:26:56.719945+0000","last_unstale":"2023-10-08T00:26:56.731001+0000","last_undegraded":"2023-10-08T00:26:56.731001+0000","last_fullsized":"2023-10-08T00:26:56.731001+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:51:34.635952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.735955+0000","last_change":"2023-10-08T00:26:56.733415+0000","last_active":"2023-10-08T00:26:56.735955+0000","last_peered":"2023-10-08T00:26:56.735955+0000","last_clean":"2023-10-08T00:26:56.735955+0000","last_became_active":"2023-10-08T00:26:56.733180+0000","last_became_peered":"2023-10-08T00:26:56.733180+0000","last_unstale":"2023-10-08T00:26:56.735955+0000","last_undegraded":"2023-10-08T00:26:56.735955+0000","last_fullsized":"2023-10-08T00:26:56.735955+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:14:22.592720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.733514+0000","last_change":"2023-10-08T00:26:56.722208+0000","last_active":"2023-10-08T00:26:56.733514+0000","last_peered":"2023-10-08T00:26:56.733514+0000","last_clean":"2023-10-08T00:26:56.733514+0000","last_became_active":"2023-10-08T00:26:56.721882+0000","last_became_peered":"2023-10-08T00:26:56.721882+0000","last_unstale":"2023-10-08T00:26:56.733514+0000","last_undegraded":"2023-10-08T00:26:56.733514+0000","last_fullsized":"2023-10-08T00:26:56.733514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:21:26.244322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740429+0000","last_change":"2023-10-08T00:26:56.733550+0000","last_active":"2023-10-08T00:26:56.740429+0000","last_peered":"2023-10-08T00:26:56.740429+0000","last_clean":"2023-10-08T00:26:56.740429+0000","last_became_active":"2023-10-08T00:26:56.733181+0000","last_became_peered":"2023-10-08T00:26:56.733181+0000","last_unstale":"2023-10-08T00:26:56.740429+0000","last_undegraded":"2023-10-08T00:26:56.740429+0000","last_fullsized":"2023-10-08T00:26:56.740429+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:45.942482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739111+0000","last_change":"2023-10-08T00:26:56.722451+0000","last_active":"2023-10-08T00:26:56.739111+0000","last_peered":"2023-10-08T00:26:56.739111+0000","last_clean":"2023-10-08T00:26:56.739111+0000","last_became_active":"2023-10-08T00:26:56.721984+0000","last_became_peered":"2023-10-08T00:26:56.721984+0000","last_unstale":"2023-10-08T00:26:56.739111+0000","last_undegraded":"2023-10-08T00:26:56.739111+0000","last_fullsized":"2023-10-08T00:26:56.739111+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:14:05.639635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.728647+0000","last_change":"2023-10-08T00:26:56.721811+0000","last_active":"2023-10-08T00:26:56.728647+0000","last_peered":"2023-10-08T00:26:56.728647+0000","last_clean":"2023-10-08T00:26:56.728647+0000","last_became_active":"2023-10-08T00:26:56.721540+0000","last_became_peered":"2023-10-08T00:26:56.721540+0000","last_unstale":"2023-10-08T00:26:56.728647+0000","last_undegraded":"2023-10-08T00:26:56.728647+0000","last_fullsized":"2023-10-08T00:26:56.728647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:08:24.094207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.738109+0000","last_change":"2023-10-08T00:26:56.731436+0000","last_active":"2023-10-08T00:26:56.738109+0000","last_peered":"2023-10-08T00:26:56.738109+0000","last_clean":"2023-10-08T00:26:56.738109+0000","last_became_active":"2023-10-08T00:26:56.730580+0000","last_became_peered":"2023-10-08T00:26:56.730580+0000","last_unstale":"2023-10-08T00:26:56.738109+0000","last_undegraded":"2023-10-08T00:26:56.738109+0000","last_fullsized":"2023-10-08T00:26:56.738109+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:25.737943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.729477+0000","last_change":"2023-10-08T00:26:56.722623+0000","last_active":"2023-10-08T00:26:56.729477+0000","last_peered":"2023-10-08T00:26:56.729477+0000","last_clean":"2023-10-08T00:26:56.729477+0000","last_became_active":"2023-10-08T00:26:56.722360+0000","last_became_peered":"2023-10-08T00:26:56.722360+0000","last_unstale":"2023-10-08T00:26:56.729477+0000","last_undegraded":"2023-10-08T00:26:56.729477+0000","last_fullsized":"2023-10-08T00:26:56.729477+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:07.921136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.725882+0000","last_change":"2023-10-08T00:26:56.719861+0000","last_active":"2023-10-08T00:26:56.725882+0000","last_peered":"2023-10-08T00:26:56.725882+0000","last_clean":"2023-10-08T00:26:56.725882+0000","last_became_active":"2023-10-08T00:26:56.719576+0000","last_became_peered":"2023-10-08T00:26:56.719576+0000","last_unstale":"2023-10-08T00:26:56.725882+0000","last_undegraded":"2023-10-08T00:26:56.725882+0000","last_fullsized":"2023-10-08T00:26:56.725882+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:09:11.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.735934+0000","last_change":"2023-10-08T00:26:56.732422+0000","last_active":"2023-10-08T00:26:56.735934+0000","last_peered":"2023-10-08T00:26:56.735934+0000","last_clean":"2023-10-08T00:26:56.735934+0000","last_became_active":"2023-10-08T00:26:56.732158+0000","last_became_peered":"2023-10-08T00:26:56.732158+0000","last_unstale":"2023-10-08T00:26:56.735934+0000","last_undegraded":"2023-10-08T00:26:56.735934+0000","last_fullsized":"2023-10-08T00:26:56.735934+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:35.448635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.722160+0000","last_change":"2023-10-08T00:26:56.719379+0000","last_active":"2023-10-08T00:26:56.722160+0000","last_peered":"2023-10-08T00:26:56.722160+0000","last_clean":"2023-10-08T00:26:56.722160+0000","last_became_active":"2023-10-08T00:26:56.719129+0000","last_became_peered":"2023-10-08T00:26:56.719129+0000","last_unstale":"2023-10-08T00:26:56.722160+0000","last_undegraded":"2023-10-08T00:26:56.722160+0000","last_fullsized":"2023-10-08T00:26:56.722160+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:23:12.988915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.730966+0000","last_change":"2023-10-08T00:26:56.719852+0000","last_active":"2023-10-08T00:26:56.730966+0000","last_peered":"2023-10-08T00:26:56.730966+0000","last_clean":"2023-10-08T00:26:56.730966+0000","last_became_active":"2023-10-08T00:26:56.719582+0000","last_became_peered":"2023-10-08T00:26:56.719582+0000","last_unstale":"2023-10-08T00:26:56.730966+0000","last_undegraded":"2023-10-08T00:26:56.730966+0000","last_fullsized":"2023-10-08T00:26:56.730966+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:42.479790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.732104+0000","last_change":"2023-10-08T00:26:56.728376+0000","last_active":"2023-10-08T00:26:56.732104+0000","last_peered":"2023-10-08T00:26:56.732104+0000","last_clean":"2023-10-08T00:26:56.732104+0000","last_became_active":"2023-10-08T00:26:56.728020+0000","last_became_peered":"2023-10-08T00:26:56.728020+0000","last_unstale":"2023-10-08T00:26:56.732104+0000","last_undegraded":"2023-10-08T00:26:56.732104+0000","last_fullsized":"2023-10-08T00:26:56.732104+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:54.936065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.730662+0000","last_change":"2023-10-08T00:26:56.723068+0000","last_active":"2023-10-08T00:26:56.730662+0000","last_peered":"2023-10-08T00:26:56.730662+0000","last_clean":"2023-10-08T00:26:56.730662+0000","last_became_active":"2023-10-08T00:26:56.722751+0000","last_became_peered":"2023-10-08T00:26:56.722751+0000","last_unstale":"2023-10-08T00:26:56.730662+0000","last_undegraded":"2023-10-08T00:26:56.730662+0000","last_fullsized":"2023-10-08T00:26:56.730662+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:55.302499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731150+0000","last_change":"2023-10-08T00:26:56.722061+0000","last_active":"2023-10-08T00:26:56.731150+0000","last_peered":"2023-10-08T00:26:56.731150+0000","last_clean":"2023-10-08T00:26:56.731150+0000","last_became_active":"2023-10-08T00:26:56.721767+0000","last_became_peered":"2023-10-08T00:26:56.721767+0000","last_unstale":"2023-10-08T00:26:56.731150+0000","last_undegraded":"2023-10-08T00:26:56.731150+0000","last_fullsized":"2023-10-08T00:26:56.731150+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:21:44.910198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739871+0000","last_change":"2023-10-08T00:26:56.729988+0000","last_active":"2023-10-08T00:26:56.739871+0000","last_peered":"2023-10-08T00:26:56.739871+0000","last_clean":"2023-10-08T00:26:56.739871+0000","last_became_active":"2023-10-08T00:26:56.729654+0000","last_became_peered":"2023-10-08T00:26:56.729654+0000","last_unstale":"2023-10-08T00:26:56.739871+0000","last_undegraded":"2023-10-08T00:26:56.739871+0000","last_fullsized":"2023-10-08T00:26:56.739871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:42.325847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740062+0000","last_change":"2023-10-08T00:26:56.734583+0000","last_active":"2023-10-08T00:26:56.740062+0000","last_peered":"2023-10-08T00:26:56.740062+0000","last_clean":"2023-10-08T00:26:56.740062+0000","last_became_active":"2023-10-08T00:26:56.734069+0000","last_became_peered":"2023-10-08T00:26:56.734069+0000","last_unstale":"2023-10-08T00:26:56.740062+0000","last_undegraded":"2023-10-08T00:26:56.740062+0000","last_fullsized":"2023-10-08T00:26:56.740062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:32:36.002957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.730739+0000","last_change":"2023-10-08T00:26:56.723972+0000","last_active":"2023-10-08T00:26:56.730739+0000","last_peered":"2023-10-08T00:26:56.730739+0000","last_clean":"2023-10-08T00:26:56.730739+0000","last_became_active":"2023-10-08T00:26:56.722808+0000","last_became_peered":"2023-10-08T00:26:56.722808+0000","last_unstale":"2023-10-08T00:26:56.730739+0000","last_undegraded":"2023-10-08T00:26:56.730739+0000","last_fullsized":"2023-10-08T00:26:56.730739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:08.695473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.727539+0000","last_change":"2023-10-08T00:26:56.724485+0000","last_active":"2023-10-08T00:26:56.727539+0000","last_peered":"2023-10-08T00:26:56.727539+0000","last_clean":"2023-10-08T00:26:56.727539+0000","last_became_active":"2023-10-08T00:26:56.724230+0000","last_became_peered":"2023-10-08T00:26:56.724230+0000","last_unstale":"2023-10-08T00:26:56.727539+0000","last_undegraded":"2023-10-08T00:26:56.727539+0000","last_fullsized":"2023-10-08T00:26:56.727539+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:59.075462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.742162+0000","last_change":"2023-10-08T00:26:56.741544+0000","last_active":"2023-10-08T00:26:56.742162+0000","last_peered":"2023-10-08T00:26:56.742162+0000","last_clean":"2023-10-08T00:26:56.742162+0000","last_became_active":"2023-10-08T00:26:56.741288+0000","last_became_peered":"2023-10-08T00:26:56.741288+0000","last_unstale":"2023-10-08T00:26:56.742162+0000","last_undegraded":"2023-10-08T00:26:56.742162+0000","last_fullsized":"2023-10-08T00:26:56.742162+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:56.464111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.733462+0000","last_change":"2023-10-08T00:26:56.722013+0000","last_active":"2023-10-08T00:26:56.733462+0000","last_peered":"2023-10-08T00:26:56.733462+0000","last_clean":"2023-10-08T00:26:56.733462+0000","last_became_active":"2023-10-08T00:26:56.721736+0000","last_became_peered":"2023-10-08T00:26:56.721736+0000","last_unstale":"2023-10-08T00:26:56.733462+0000","last_undegraded":"2023-10-08T00:26:56.733462+0000","last_fullsized":"2023-10-08T00:26:56.733462+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:08:15.553975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731692+0000","last_change":"2023-10-08T00:26:56.728360+0000","last_active":"2023-10-08T00:26:56.731692+0000","last_peered":"2023-10-08T00:26:56.731692+0000","last_clean":"2023-10-08T00:26:56.731692+0000","last_became_active":"2023-10-08T00:26:56.728114+0000","last_became_peered":"2023-10-08T00:26:56.728114+0000","last_unstale":"2023-10-08T00:26:56.731692+0000","last_undegraded":"2023-10-08T00:26:56.731692+0000","last_fullsized":"2023-10-08T00:26:56.731692+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:54:35.150619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.736836+0000","last_change":"2023-10-08T00:26:56.734262+0000","last_active":"2023-10-08T00:26:56.736836+0000","last_peered":"2023-10-08T00:26:56.736836+0000","last_clean":"2023-10-08T00:26:56.736836+0000","last_became_active":"2023-10-08T00:26:56.734010+0000","last_became_peered":"2023-10-08T00:26:56.734010+0000","last_unstale":"2023-10-08T00:26:56.736836+0000","last_undegraded":"2023-10-08T00:26:56.736836+0000","last_fullsized":"2023-10-08T00:26:56.736836+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:07.921136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.728700+0000","last_change":"2023-10-08T00:26:56.722574+0000","last_active":"2023-10-08T00:26:56.728700+0000","last_peered":"2023-10-08T00:26:56.728700+0000","last_clean":"2023-10-08T00:26:56.728700+0000","last_became_active":"2023-10-08T00:26:56.721931+0000","last_became_peered":"2023-10-08T00:26:56.721931+0000","last_unstale":"2023-10-08T00:26:56.728700+0000","last_undegraded":"2023-10-08T00:26:56.728700+0000","last_fullsized":"2023-10-08T00:26:56.728700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:09:11.802808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.736696+0000","last_change":"2023-10-08T00:26:56.729174+0000","last_active":"2023-10-08T00:26:56.736696+0000","last_peered":"2023-10-08T00:26:56.736696+0000","last_clean":"2023-10-08T00:26:56.736696+0000","last_became_active":"2023-10-08T00:26:56.728652+0000","last_became_peered":"2023-10-08T00:26:56.728652+0000","last_unstale":"2023-10-08T00:26:56.736696+0000","last_undegraded":"2023-10-08T00:26:56.736696+0000","last_fullsized":"2023-10-08T00:26:56.736696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:14.173998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740338+0000","last_change":"2023-10-08T00:26:56.734848+0000","last_active":"2023-10-08T00:26:56.740338+0000","last_peered":"2023-10-08T00:26:56.740338+0000","last_clean":"2023-10-08T00:26:56.740338+0000","last_became_active":"2023-10-08T00:26:56.734354+0000","last_became_peered":"2023-10-08T00:26:56.734354+0000","last_unstale":"2023-10-08T00:26:56.740338+0000","last_undegraded":"2023-10-08T00:26:56.740338+0000","last_fullsized":"2023-10-08T00:26:56.740338+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:33.832854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"63'4","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.741690+0000","last_change":"2023-10-08T00:26:55.724836+0000","last_active":"2023-10-08T00:26:56.741690+0000","last_peered":"2023-10-08T00:26:56.741690+0000","last_clean":"2023-10-08T00:26:56.741690+0000","last_became_active":"2023-10-08T00:26:55.724562+0000","last_became_peered":"2023-10-08T00:26:55.724562+0000","last_unstale":"2023-10-08T00:26:56.741690+0000","last_undegraded":"2023-10-08T00:26:56.741690+0000","last_fullsized":"2023-10-08T00:26:56.741690+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:07.690368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.730040+0000","last_change":"2023-10-08T00:26:56.727700+0000","last_active":"2023-10-08T00:26:56.730040+0000","last_peered":"2023-10-08T00:26:56.730040+0000","last_clean":"2023-10-08T00:26:56.730040+0000","last_became_active":"2023-10-08T00:26:56.727324+0000","last_became_peered":"2023-10-08T00:26:56.727324+0000","last_unstale":"2023-10-08T00:26:56.730040+0000","last_undegraded":"2023-10-08T00:26:56.730040+0000","last_fullsized":"2023-10-08T00:26:56.730040+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:46.266944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.736126+0000","last_change":"2023-10-08T00:26:55.722009+0000","last_active":"2023-10-08T00:26:56.736126+0000","last_peered":"2023-10-08T00:26:56.736126+0000","last_clean":"2023-10-08T00:26:56.736126+0000","last_became_active":"2023-10-08T00:26:55.721745+0000","last_became_peered":"2023-10-08T00:26:55.721745+0000","last_unstale":"2023-10-08T00:26:56.736126+0000","last_undegraded":"2023-10-08T00:26:56.736126+0000","last_fullsized":"2023-10-08T00:26:56.736126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:53.410615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.736825+0000","last_change":"2023-10-08T00:26:56.726031+0000","last_active":"2023-10-08T00:26:56.736825+0000","last_peered":"2023-10-08T00:26:56.736825+0000","last_clean":"2023-10-08T00:26:56.736825+0000","last_became_active":"2023-10-08T00:26:56.725763+0000","last_became_peered":"2023-10-08T00:26:56.725763+0000","last_unstale":"2023-10-08T00:26:56.736825+0000","last_undegraded":"2023-10-08T00:26:56.736825+0000","last_fullsized":"2023-10-08T00:26:56.736825+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:57.870174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739920+0000","last_change":"2023-10-08T00:26:55.723063+0000","last_active":"2023-10-08T00:26:56.739920+0000","last_peered":"2023-10-08T00:26:56.739920+0000","last_clean":"2023-10-08T00:26:56.739920+0000","last_became_active":"2023-10-08T00:26:55.722715+0000","last_became_peered":"2023-10-08T00:26:55.722715+0000","last_unstale":"2023-10-08T00:26:56.739920+0000","last_undegraded":"2023-10-08T00:26:56.739920+0000","last_fullsized":"2023-10-08T00:26:56.739920+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:31.317080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740417+0000","last_change":"2023-10-08T00:26:56.730630+0000","last_active":"2023-10-08T00:26:56.740417+0000","last_peered":"2023-10-08T00:26:56.740417+0000","last_clean":"2023-10-08T00:26:56.740417+0000","last_became_active":"2023-10-08T00:26:56.730382+0000","last_became_peered":"2023-10-08T00:26:56.730382+0000","last_unstale":"2023-10-08T00:26:56.740417+0000","last_undegraded":"2023-10-08T00:26:56.740417+0000","last_fullsized":"2023-10-08T00:26:56.740417+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:00.154802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740215+0000","last_change":"2023-10-08T00:26:55.721233+0000","last_active":"2023-10-08T00:26:56.740215+0000","last_peered":"2023-10-08T00:26:56.740215+0000","last_clean":"2023-10-08T00:26:56.740215+0000","last_became_active":"2023-10-08T00:26:55.720956+0000","last_became_peered":"2023-10-08T00:26:55.720956+0000","last_unstale":"2023-10-08T00:26:56.740215+0000","last_undegraded":"2023-10-08T00:26:56.740215+0000","last_fullsized":"2023-10-08T00:26:56.740215+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:18.920989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.737287+0000","last_change":"2023-10-08T00:26:56.736634+0000","last_active":"2023-10-08T00:26:56.737287+0000","last_peered":"2023-10-08T00:26:56.737287+0000","last_clean":"2023-10-08T00:26:56.737287+0000","last_became_active":"2023-10-08T00:26:56.736338+0000","last_became_peered":"2023-10-08T00:26:56.736338+0000","last_unstale":"2023-10-08T00:26:56.737287+0000","last_undegraded":"2023-10-08T00:26:56.737287+0000","last_fullsized":"2023-10-08T00:26:56.737287+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:08:24.094207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.738925+0000","last_change":"2023-10-08T00:26:55.724633+0000","last_active":"2023-10-08T00:26:56.738925+0000","last_peered":"2023-10-08T00:26:56.738925+0000","last_clean":"2023-10-08T00:26:56.738925+0000","last_became_active":"2023-10-08T00:26:55.724324+0000","last_became_peered":"2023-10-08T00:26:55.724324+0000","last_unstale":"2023-10-08T00:26:56.738925+0000","last_undegraded":"2023-10-08T00:26:56.738925+0000","last_fullsized":"2023-10-08T00:26:56.738925+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:48:20.256604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.733185+0000","last_change":"2023-10-08T00:26:56.725439+0000","last_active":"2023-10-08T00:26:56.733185+0000","last_peered":"2023-10-08T00:26:56.733185+0000","last_clean":"2023-10-08T00:26:56.733185+0000","last_became_active":"2023-10-08T00:26:56.725187+0000","last_became_peered":"2023-10-08T00:26:56.725187+0000","last_unstale":"2023-10-08T00:26:56.733185+0000","last_undegraded":"2023-10-08T00:26:56.733185+0000","last_fullsized":"2023-10-08T00:26:56.733185+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:59.075462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739431+0000","last_change":"2023-10-08T00:26:55.727376+0000","last_active":"2023-10-08T00:26:56.739431+0000","last_peered":"2023-10-08T00:26:56.739431+0000","last_clean":"2023-10-08T00:26:56.739431+0000","last_became_active":"2023-10-08T00:26:55.727185+0000","last_became_peered":"2023-10-08T00:26:55.727185+0000","last_unstale":"2023-10-08T00:26:56.739431+0000","last_undegraded":"2023-10-08T00:26:56.739431+0000","last_fullsized":"2023-10-08T00:26:56.739431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:26:58.467948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723387+0000","last_change":"2023-10-08T00:26:56.722147+0000","last_active":"2023-10-08T00:26:56.723387+0000","last_peered":"2023-10-08T00:26:56.723387+0000","last_clean":"2023-10-08T00:26:56.723387+0000","last_became_active":"2023-10-08T00:26:56.721899+0000","last_became_peered":"2023-10-08T00:26:56.721899+0000","last_unstale":"2023-10-08T00:26:56.723387+0000","last_undegraded":"2023-10-08T00:26:56.723387+0000","last_fullsized":"2023-10-08T00:26:56.723387+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:23:03.469552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.711409+0000","last_change":"2023-10-08T00:26:55.723067+0000","last_active":"2023-10-08T00:26:56.711409+0000","last_peered":"2023-10-08T00:26:56.711409+0000","last_clean":"2023-10-08T00:26:56.711409+0000","last_became_active":"2023-10-08T00:26:55.722783+0000","last_became_peered":"2023-10-08T00:26:55.722783+0000","last_unstale":"2023-10-08T00:26:56.711409+0000","last_undegraded":"2023-10-08T00:26:56.711409+0000","last_fullsized":"2023-10-08T00:26:56.711409+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:16:32.236439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731969+0000","last_change":"2023-10-08T00:26:56.727049+0000","last_active":"2023-10-08T00:26:56.731969+0000","last_peered":"2023-10-08T00:26:56.731969+0000","last_clean":"2023-10-08T00:26:56.731969+0000","last_became_active":"2023-10-08T00:26:56.726793+0000","last_became_peered":"2023-10-08T00:26:56.726793+0000","last_unstale":"2023-10-08T00:26:56.731969+0000","last_undegraded":"2023-10-08T00:26:56.731969+0000","last_fullsized":"2023-10-08T00:26:56.731969+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:00.906714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.714334+0000","last_change":"2023-10-08T00:26:55.717763+0000","last_active":"2023-10-08T00:26:56.714334+0000","last_peered":"2023-10-08T00:26:56.714334+0000","last_clean":"2023-10-08T00:26:56.714334+0000","last_became_active":"2023-10-08T00:26:55.717533+0000","last_became_peered":"2023-10-08T00:26:55.717533+0000","last_unstale":"2023-10-08T00:26:56.714334+0000","last_undegraded":"2023-10-08T00:26:56.714334+0000","last_fullsized":"2023-10-08T00:26:56.714334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:48:43.907304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.733852+0000","last_change":"2023-10-08T00:26:56.728281+0000","last_active":"2023-10-08T00:26:56.733852+0000","last_peered":"2023-10-08T00:26:56.733852+0000","last_clean":"2023-10-08T00:26:56.733852+0000","last_became_active":"2023-10-08T00:26:56.727980+0000","last_became_peered":"2023-10-08T00:26:56.727980+0000","last_unstale":"2023-10-08T00:26:56.733852+0000","last_undegraded":"2023-10-08T00:26:56.733852+0000","last_fullsized":"2023-10-08T00:26:56.733852+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:08.695473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.713003+0000","last_change":"2023-10-08T00:26:55.724222+0000","last_active":"2023-10-08T00:26:56.713003+0000","last_peered":"2023-10-08T00:26:56.713003+0000","last_clean":"2023-10-08T00:26:56.713003+0000","last_became_active":"2023-10-08T00:26:55.723941+0000","last_became_peered":"2023-10-08T00:26:55.723941+0000","last_unstale":"2023-10-08T00:26:56.713003+0000","last_undegraded":"2023-10-08T00:26:56.713003+0000","last_fullsized":"2023-10-08T00:26:56.713003+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:31:39.680875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.744848+0000","last_change":"2023-10-08T00:26:56.737726+0000","last_active":"2023-10-08T00:26:56.744848+0000","last_peered":"2023-10-08T00:26:56.744848+0000","last_clean":"2023-10-08T00:26:56.744848+0000","last_became_active":"2023-10-08T00:26:56.737313+0000","last_became_peered":"2023-10-08T00:26:56.737313+0000","last_unstale":"2023-10-08T00:26:56.744848+0000","last_undegraded":"2023-10-08T00:26:56.744848+0000","last_fullsized":"2023-10-08T00:26:56.744848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:59:12.318974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.715300+0000","last_change":"2023-10-08T00:26:55.720512+0000","last_active":"2023-10-08T00:26:56.715300+0000","last_peered":"2023-10-08T00:26:56.715300+0000","last_clean":"2023-10-08T00:26:56.715300+0000","last_became_active":"2023-10-08T00:26:55.720059+0000","last_became_peered":"2023-10-08T00:26:55.720059+0000","last_unstale":"2023-10-08T00:26:56.715300+0000","last_undegraded":"2023-10-08T00:26:56.715300+0000","last_fullsized":"2023-10-08T00:26:56.715300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:34.443530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.724753+0000","last_change":"2023-10-08T00:26:56.718758+0000","last_active":"2023-10-08T00:26:56.724753+0000","last_peered":"2023-10-08T00:26:56.724753+0000","last_clean":"2023-10-08T00:26:56.724753+0000","last_became_active":"2023-10-08T00:26:56.717892+0000","last_became_peered":"2023-10-08T00:26:56.717892+0000","last_unstale":"2023-10-08T00:26:56.724753+0000","last_undegraded":"2023-10-08T00:26:56.724753+0000","last_fullsized":"2023-10-08T00:26:56.724753+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:32.322185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"63'3","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.741193+0000","last_change":"2023-10-08T00:26:55.724531+0000","last_active":"2023-10-08T00:26:56.741193+0000","last_peered":"2023-10-08T00:26:56.741193+0000","last_clean":"2023-10-08T00:26:56.741193+0000","last_became_active":"2023-10-08T00:26:55.723911+0000","last_became_peered":"2023-10-08T00:26:55.723911+0000","last_unstale":"2023-10-08T00:26:56.741193+0000","last_undegraded":"2023-10-08T00:26:56.741193+0000","last_fullsized":"2023-10-08T00:26:56.741193+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:38:57.975938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723390+0000","last_change":"2023-10-08T00:26:56.722356+0000","last_active":"2023-10-08T00:26:56.723390+0000","last_peered":"2023-10-08T00:26:56.723390+0000","last_clean":"2023-10-08T00:26:56.723390+0000","last_became_active":"2023-10-08T00:26:56.722084+0000","last_became_peered":"2023-10-08T00:26:56.722084+0000","last_unstale":"2023-10-08T00:26:56.723390+0000","last_undegraded":"2023-10-08T00:26:56.723390+0000","last_fullsized":"2023-10-08T00:26:56.723390+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:03:16.838324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"63'6","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.741587+0000","last_change":"2023-10-08T00:26:55.722699+0000","last_active":"2023-10-08T00:26:56.741587+0000","last_peered":"2023-10-08T00:26:56.741587+0000","last_clean":"2023-10-08T00:26:56.741587+0000","last_became_active":"2023-10-08T00:26:55.722204+0000","last_became_peered":"2023-10-08T00:26:55.722204+0000","last_unstale":"2023-10-08T00:26:56.741587+0000","last_undegraded":"2023-10-08T00:26:56.741587+0000","last_fullsized":"2023-10-08T00:26:56.741587+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:59.948502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.744888+0000","last_change":"2023-10-08T00:26:56.738673+0000","last_active":"2023-10-08T00:26:56.744888+0000","last_peered":"2023-10-08T00:26:56.744888+0000","last_clean":"2023-10-08T00:26:56.744888+0000","last_became_active":"2023-10-08T00:26:56.738431+0000","last_became_peered":"2023-10-08T00:26:56.738431+0000","last_unstale":"2023-10-08T00:26:56.744888+0000","last_undegraded":"2023-10-08T00:26:56.744888+0000","last_fullsized":"2023-10-08T00:26:56.744888+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:12:44.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740404+0000","last_change":"2023-10-08T00:26:55.719175+0000","last_active":"2023-10-08T00:26:56.740404+0000","last_peered":"2023-10-08T00:26:56.740404+0000","last_clean":"2023-10-08T00:26:56.740404+0000","last_became_active":"2023-10-08T00:26:55.718911+0000","last_became_peered":"2023-10-08T00:26:55.718911+0000","last_unstale":"2023-10-08T00:26:56.740404+0000","last_undegraded":"2023-10-08T00:26:56.740404+0000","last_fullsized":"2023-10-08T00:26:56.740404+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:31:39.680875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.730242+0000","last_change":"2023-10-08T00:26:56.728182+0000","last_active":"2023-10-08T00:26:56.730242+0000","last_peered":"2023-10-08T00:26:56.730242+0000","last_clean":"2023-10-08T00:26:56.730242+0000","last_became_active":"2023-10-08T00:26:56.727906+0000","last_became_peered":"2023-10-08T00:26:56.727906+0000","last_unstale":"2023-10-08T00:26:56.730242+0000","last_undegraded":"2023-10-08T00:26:56.730242+0000","last_fullsized":"2023-10-08T00:26:56.730242+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:00.906714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.715140+0000","last_change":"2023-10-08T00:26:55.720962+0000","last_active":"2023-10-08T00:26:56.715140+0000","last_peered":"2023-10-08T00:26:56.715140+0000","last_clean":"2023-10-08T00:26:56.715140+0000","last_became_active":"2023-10-08T00:26:55.720632+0000","last_became_peered":"2023-10-08T00:26:55.720632+0000","last_unstale":"2023-10-08T00:26:56.715140+0000","last_undegraded":"2023-10-08T00:26:56.715140+0000","last_fullsized":"2023-10-08T00:26:56.715140+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:05:50.813313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.728621+0000","last_change":"2023-10-08T00:26:56.721938+0000","last_active":"2023-10-08T00:26:56.728621+0000","last_peered":"2023-10-08T00:26:56.728621+0000","last_clean":"2023-10-08T00:26:56.728621+0000","last_became_active":"2023-10-08T00:26:56.721647+0000","last_became_peered":"2023-10-08T00:26:56.721647+0000","last_unstale":"2023-10-08T00:26:56.728621+0000","last_undegraded":"2023-10-08T00:26:56.728621+0000","last_fullsized":"2023-10-08T00:26:56.728621+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:13.704733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723499+0000","last_change":"2023-10-08T00:26:55.718120+0000","last_active":"2023-10-08T00:26:56.723499+0000","last_peered":"2023-10-08T00:26:56.723499+0000","last_clean":"2023-10-08T00:26:56.723499+0000","last_became_active":"2023-10-08T00:26:55.716227+0000","last_became_peered":"2023-10-08T00:26:55.716227+0000","last_unstale":"2023-10-08T00:26:56.723499+0000","last_undegraded":"2023-10-08T00:26:56.723499+0000","last_fullsized":"2023-10-08T00:26:56.723499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:47.036620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.735819+0000","last_change":"2023-10-08T00:26:56.731330+0000","last_active":"2023-10-08T00:26:56.735819+0000","last_peered":"2023-10-08T00:26:56.735819+0000","last_clean":"2023-10-08T00:26:56.735819+0000","last_became_active":"2023-10-08T00:26:56.731016+0000","last_became_peered":"2023-10-08T00:26:56.731016+0000","last_unstale":"2023-10-08T00:26:56.735819+0000","last_undegraded":"2023-10-08T00:26:56.735819+0000","last_fullsized":"2023-10-08T00:26:56.735819+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:26:02.074085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"63'8","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740941+0000","last_change":"2023-10-08T00:26:55.726665+0000","last_active":"2023-10-08T00:26:56.740941+0000","last_peered":"2023-10-08T00:26:56.740941+0000","last_clean":"2023-10-08T00:26:56.740941+0000","last_became_active":"2023-10-08T00:26:55.726316+0000","last_became_peered":"2023-10-08T00:26:55.726316+0000","last_unstale":"2023-10-08T00:26:56.740941+0000","last_undegraded":"2023-10-08T00:26:56.740941+0000","last_fullsized":"2023-10-08T00:26:56.740941+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:32:31.282924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.733493+0000","last_change":"2023-10-08T00:26:56.722167+0000","last_active":"2023-10-08T00:26:56.733493+0000","last_peered":"2023-10-08T00:26:56.733493+0000","last_clean":"2023-10-08T00:26:56.733493+0000","last_became_active":"2023-10-08T00:26:56.721395+0000","last_became_peered":"2023-10-08T00:26:56.721395+0000","last_unstale":"2023-10-08T00:26:56.733493+0000","last_undegraded":"2023-10-08T00:26:56.733493+0000","last_fullsized":"2023-10-08T00:26:56.733493+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:47:35.677488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739657+0000","last_change":"2023-10-08T00:26:55.720359+0000","last_active":"2023-10-08T00:26:56.739657+0000","last_peered":"2023-10-08T00:26:56.739657+0000","last_clean":"2023-10-08T00:26:56.739657+0000","last_became_active":"2023-10-08T00:26:55.719977+0000","last_became_peered":"2023-10-08T00:26:55.719977+0000","last_unstale":"2023-10-08T00:26:56.739657+0000","last_undegraded":"2023-10-08T00:26:56.739657+0000","last_fullsized":"2023-10-08T00:26:56.739657+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:14:21.587615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.745273+0000","last_change":"2023-10-08T00:26:56.742074+0000","last_active":"2023-10-08T00:26:56.745273+0000","last_peered":"2023-10-08T00:26:56.745273+0000","last_clean":"2023-10-08T00:26:56.745273+0000","last_became_active":"2023-10-08T00:26:56.741839+0000","last_became_peered":"2023-10-08T00:26:56.741839+0000","last_unstale":"2023-10-08T00:26:56.745273+0000","last_undegraded":"2023-10-08T00:26:56.745273+0000","last_fullsized":"2023-10-08T00:26:56.745273+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:03:17.454931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739885+0000","last_change":"2023-10-08T00:26:55.723136+0000","last_active":"2023-10-08T00:26:56.739885+0000","last_peered":"2023-10-08T00:26:56.739885+0000","last_clean":"2023-10-08T00:26:56.739885+0000","last_became_active":"2023-10-08T00:26:55.722713+0000","last_became_peered":"2023-10-08T00:26:55.722713+0000","last_unstale":"2023-10-08T00:26:56.739885+0000","last_undegraded":"2023-10-08T00:26:56.739885+0000","last_fullsized":"2023-10-08T00:26:56.739885+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:41.474685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739082+0000","last_change":"2023-10-08T00:26:56.722244+0000","last_active":"2023-10-08T00:26:56.739082+0000","last_peered":"2023-10-08T00:26:56.739082+0000","last_clean":"2023-10-08T00:26:56.739082+0000","last_became_active":"2023-10-08T00:26:56.721622+0000","last_became_peered":"2023-10-08T00:26:56.721622+0000","last_unstale":"2023-10-08T00:26:56.739082+0000","last_undegraded":"2023-10-08T00:26:56.739082+0000","last_fullsized":"2023-10-08T00:26:56.739082+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:14.173998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739518+0000","last_change":"2023-10-08T00:26:55.721256+0000","last_active":"2023-10-08T00:26:56.739518+0000","last_peered":"2023-10-08T00:26:56.739518+0000","last_clean":"2023-10-08T00:26:56.739518+0000","last_became_active":"2023-10-08T00:26:55.720279+0000","last_became_peered":"2023-10-08T00:26:55.720279+0000","last_unstale":"2023-10-08T00:26:56.739518+0000","last_undegraded":"2023-10-08T00:26:56.739518+0000","last_fullsized":"2023-10-08T00:26:56.739518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:01.205202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.735764+0000","last_change":"2023-10-08T00:26:56.729122+0000","last_active":"2023-10-08T00:26:56.735764+0000","last_peered":"2023-10-08T00:26:56.735764+0000","last_clean":"2023-10-08T00:26:56.735764+0000","last_became_active":"2023-10-08T00:26:56.728818+0000","last_became_peered":"2023-10-08T00:26:56.728818+0000","last_unstale":"2023-10-08T00:26:56.735764+0000","last_undegraded":"2023-10-08T00:26:56.735764+0000","last_fullsized":"2023-10-08T00:26:56.735764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:19.926094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.724156+0000","last_change":"2023-10-08T00:26:55.724280+0000","last_active":"2023-10-08T00:26:56.724156+0000","last_peered":"2023-10-08T00:26:56.724156+0000","last_clean":"2023-10-08T00:26:56.724156+0000","last_became_active":"2023-10-08T00:26:55.723982+0000","last_became_peered":"2023-10-08T00:26:55.723982+0000","last_unstale":"2023-10-08T00:26:56.724156+0000","last_undegraded":"2023-10-08T00:26:56.724156+0000","last_fullsized":"2023-10-08T00:26:56.724156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:03:58.070357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731675+0000","last_change":"2023-10-08T00:26:56.724119+0000","last_active":"2023-10-08T00:26:56.731675+0000","last_peered":"2023-10-08T00:26:56.731675+0000","last_clean":"2023-10-08T00:26:56.731675+0000","last_became_active":"2023-10-08T00:26:56.723838+0000","last_became_peered":"2023-10-08T00:26:56.723838+0000","last_unstale":"2023-10-08T00:26:56.731675+0000","last_undegraded":"2023-10-08T00:26:56.731675+0000","last_fullsized":"2023-10-08T00:26:56.731675+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:09.459474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.715384+0000","last_change":"2023-10-08T00:26:55.720851+0000","last_active":"2023-10-08T00:26:56.715384+0000","last_peered":"2023-10-08T00:26:56.715384+0000","last_clean":"2023-10-08T00:26:56.715384+0000","last_became_active":"2023-10-08T00:26:55.720343+0000","last_became_peered":"2023-10-08T00:26:55.720343+0000","last_unstale":"2023-10-08T00:26:56.715384+0000","last_undegraded":"2023-10-08T00:26:56.715384+0000","last_fullsized":"2023-10-08T00:26:56.715384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:50:37.146137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.731673+0000","last_change":"2023-10-08T00:26:56.726136+0000","last_active":"2023-10-08T00:26:56.731673+0000","last_peered":"2023-10-08T00:26:56.731673+0000","last_clean":"2023-10-08T00:26:56.731673+0000","last_became_active":"2023-10-08T00:26:56.725890+0000","last_became_peered":"2023-10-08T00:26:56.725890+0000","last_unstale":"2023-10-08T00:26:56.731673+0000","last_undegraded":"2023-10-08T00:26:56.731673+0000","last_fullsized":"2023-10-08T00:26:56.731673+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:05.467627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723603+0000","last_change":"2023-10-08T00:26:55.715629+0000","last_active":"2023-10-08T00:26:56.723603+0000","last_peered":"2023-10-08T00:26:56.723603+0000","last_clean":"2023-10-08T00:26:56.723603+0000","last_became_active":"2023-10-08T00:26:55.715339+0000","last_became_peered":"2023-10-08T00:26:55.715339+0000","last_unstale":"2023-10-08T00:26:56.723603+0000","last_undegraded":"2023-10-08T00:26:56.723603+0000","last_fullsized":"2023-10-08T00:26:56.723603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:09.249329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.738495+0000","last_change":"2023-10-08T00:26:56.737895+0000","last_active":"2023-10-08T00:26:56.738495+0000","last_peered":"2023-10-08T00:26:56.738495+0000","last_clean":"2023-10-08T00:26:56.738495+0000","last_became_active":"2023-10-08T00:26:56.737540+0000","last_became_peered":"2023-10-08T00:26:56.737540+0000","last_unstale":"2023-10-08T00:26:56.738495+0000","last_undegraded":"2023-10-08T00:26:56.738495+0000","last_fullsized":"2023-10-08T00:26:56.738495+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:17:31.775247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.714571+0000","last_change":"2023-10-08T00:26:55.721576+0000","last_active":"2023-10-08T00:26:56.714571+0000","last_peered":"2023-10-08T00:26:56.714571+0000","last_clean":"2023-10-08T00:26:56.714571+0000","last_became_active":"2023-10-08T00:26:55.721281+0000","last_became_peered":"2023-10-08T00:26:55.721281+0000","last_unstale":"2023-10-08T00:26:56.714571+0000","last_undegraded":"2023-10-08T00:26:56.714571+0000","last_fullsized":"2023-10-08T00:26:56.714571+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:08:37.394877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.729770+0000","last_change":"2023-10-08T00:26:56.722773+0000","last_active":"2023-10-08T00:26:56.729770+0000","last_peered":"2023-10-08T00:26:56.729770+0000","last_clean":"2023-10-08T00:26:56.729770+0000","last_became_active":"2023-10-08T00:26:56.722496+0000","last_became_peered":"2023-10-08T00:26:56.722496+0000","last_unstale":"2023-10-08T00:26:56.729770+0000","last_undegraded":"2023-10-08T00:26:56.729770+0000","last_fullsized":"2023-10-08T00:26:56.729770+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:02.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739557+0000","last_change":"2023-10-08T00:26:55.719948+0000","last_active":"2023-10-08T00:26:56.739557+0000","last_peered":"2023-10-08T00:26:56.739557+0000","last_clean":"2023-10-08T00:26:56.739557+0000","last_became_active":"2023-10-08T00:26:55.719536+0000","last_became_peered":"2023-10-08T00:26:55.719536+0000","last_unstale":"2023-10-08T00:26:56.739557+0000","last_undegraded":"2023-10-08T00:26:56.739557+0000","last_fullsized":"2023-10-08T00:26:56.739557+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:00:45.261839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.727511+0000","last_change":"2023-10-08T00:26:56.720795+0000","last_active":"2023-10-08T00:26:56.727511+0000","last_peered":"2023-10-08T00:26:56.727511+0000","last_clean":"2023-10-08T00:26:56.727511+0000","last_became_active":"2023-10-08T00:26:56.720523+0000","last_became_peered":"2023-10-08T00:26:56.720523+0000","last_unstale":"2023-10-08T00:26:56.727511+0000","last_undegraded":"2023-10-08T00:26:56.727511+0000","last_fullsized":"2023-10-08T00:26:56.727511+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:13.704733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.723381+0000","last_change":"2023-10-08T00:26:55.715984+0000","last_active":"2023-10-08T00:26:56.723381+0000","last_peered":"2023-10-08T00:26:56.723381+0000","last_clean":"2023-10-08T00:26:56.723381+0000","last_became_active":"2023-10-08T00:26:55.715689+0000","last_became_peered":"2023-10-08T00:26:55.715689+0000","last_unstale":"2023-10-08T00:26:56.723381+0000","last_undegraded":"2023-10-08T00:26:56.723381+0000","last_fullsized":"2023-10-08T00:26:56.723381+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:56.865069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740038+0000","last_change":"2023-10-08T00:26:56.734486+0000","last_active":"2023-10-08T00:26:56.740038+0000","last_peered":"2023-10-08T00:26:56.740038+0000","last_clean":"2023-10-08T00:26:56.740038+0000","last_became_active":"2023-10-08T00:26:56.734184+0000","last_became_peered":"2023-10-08T00:26:56.734184+0000","last_unstale":"2023-10-08T00:26:56.740038+0000","last_undegraded":"2023-10-08T00:26:56.740038+0000","last_fullsized":"2023-10-08T00:26:56.740038+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:38:58.981043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.714982+0000","last_change":"2023-10-08T00:26:55.714229+0000","last_active":"2023-10-08T00:26:56.714982+0000","last_peered":"2023-10-08T00:26:56.714982+0000","last_clean":"2023-10-08T00:26:56.714982+0000","last_became_active":"2023-10-08T00:26:55.713987+0000","last_became_peered":"2023-10-08T00:26:55.713987+0000","last_unstale":"2023-10-08T00:26:56.714982+0000","last_undegraded":"2023-10-08T00:26:56.714982+0000","last_fullsized":"2023-10-08T00:26:56.714982+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:02:25.671237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740398+0000","last_change":"2023-10-08T00:26:56.730094+0000","last_active":"2023-10-08T00:26:56.740398+0000","last_peered":"2023-10-08T00:26:56.740398+0000","last_clean":"2023-10-08T00:26:56.740398+0000","last_became_active":"2023-10-08T00:26:56.729480+0000","last_became_peered":"2023-10-08T00:26:56.729480+0000","last_unstale":"2023-10-08T00:26:56.740398+0000","last_undegraded":"2023-10-08T00:26:56.740398+0000","last_fullsized":"2023-10-08T00:26:56.740398+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:13.603344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.716964+0000","last_change":"2023-10-08T00:26:55.722812+0000","last_active":"2023-10-08T00:26:56.716964+0000","last_peered":"2023-10-08T00:26:56.716964+0000","last_clean":"2023-10-08T00:26:56.716964+0000","last_became_active":"2023-10-08T00:26:55.722553+0000","last_became_peered":"2023-10-08T00:26:55.722553+0000","last_unstale":"2023-10-08T00:26:56.716964+0000","last_undegraded":"2023-10-08T00:26:56.716964+0000","last_fullsized":"2023-10-08T00:26:56.716964+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:14:04.634530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.732739+0000","last_change":"2023-10-08T00:26:56.724553+0000","last_active":"2023-10-08T00:26:56.732739+0000","last_peered":"2023-10-08T00:26:56.732739+0000","last_clean":"2023-10-08T00:26:56.732739+0000","last_became_active":"2023-10-08T00:26:56.724281+0000","last_became_peered":"2023-10-08T00:26:56.724281+0000","last_unstale":"2023-10-08T00:26:56.732739+0000","last_undegraded":"2023-10-08T00:26:56.732739+0000","last_fullsized":"2023-10-08T00:26:56.732739+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:40:02.210307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.714715+0000","last_change":"2023-10-08T00:26:55.710861+0000","last_active":"2023-10-08T00:26:56.714715+0000","last_peered":"2023-10-08T00:26:56.714715+0000","last_clean":"2023-10-08T00:26:56.714715+0000","last_became_active":"2023-10-08T00:26:55.710484+0000","last_became_peered":"2023-10-08T00:26:55.710484+0000","last_unstale":"2023-10-08T00:26:56.714715+0000","last_undegraded":"2023-10-08T00:26:56.714715+0000","last_fullsized":"2023-10-08T00:26:56.714715+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:54.164905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.736870+0000","last_change":"2023-10-08T00:26:56.728334+0000","last_active":"2023-10-08T00:26:56.736870+0000","last_peered":"2023-10-08T00:26:56.736870+0000","last_clean":"2023-10-08T00:26:56.736870+0000","last_became_active":"2023-10-08T00:26:56.728075+0000","last_became_peered":"2023-10-08T00:26:56.728075+0000","last_unstale":"2023-10-08T00:26:56.736870+0000","last_undegraded":"2023-10-08T00:26:56.736870+0000","last_fullsized":"2023-10-08T00:26:56.736870+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:10.254434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.711407+0000","last_change":"2023-10-08T00:26:55.723666+0000","last_active":"2023-10-08T00:26:56.711407+0000","last_peered":"2023-10-08T00:26:56.711407+0000","last_clean":"2023-10-08T00:26:56.711407+0000","last_became_active":"2023-10-08T00:26:55.723406+0000","last_became_peered":"2023-10-08T00:26:55.723406+0000","last_unstale":"2023-10-08T00:26:56.711407+0000","last_undegraded":"2023-10-08T00:26:56.711407+0000","last_fullsized":"2023-10-08T00:26:56.711407+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:47.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.739358+0000","last_change":"2023-10-08T00:26:56.731624+0000","last_active":"2023-10-08T00:26:56.739358+0000","last_peered":"2023-10-08T00:26:56.739358+0000","last_clean":"2023-10-08T00:26:56.739358+0000","last_became_active":"2023-10-08T00:26:56.724959+0000","last_became_peered":"2023-10-08T00:26:56.724959+0000","last_unstale":"2023-10-08T00:26:56.739358+0000","last_undegraded":"2023-10-08T00:26:56.739358+0000","last_fullsized":"2023-10-08T00:26:56.739358+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:54.415720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.713053+0000","last_change":"2023-10-08T00:26:55.726598+0000","last_active":"2023-10-08T00:26:56.713053+0000","last_peered":"2023-10-08T00:26:56.713053+0000","last_clean":"2023-10-08T00:26:56.713053+0000","last_became_active":"2023-10-08T00:26:55.726328+0000","last_became_peered":"2023-10-08T00:26:55.726328+0000","last_unstale":"2023-10-08T00:26:56.713053+0000","last_undegraded":"2023-10-08T00:26:56.713053+0000","last_fullsized":"2023-10-08T00:26:56.713053+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:48:48.704296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740230+0000","last_change":"2023-10-08T00:26:56.735151+0000","last_active":"2023-10-08T00:26:56.740230+0000","last_peered":"2023-10-08T00:26:56.740230+0000","last_clean":"2023-10-08T00:26:56.740230+0000","last_became_active":"2023-10-08T00:26:56.734771+0000","last_became_peered":"2023-10-08T00:26:56.734771+0000","last_unstale":"2023-10-08T00:26:56.740230+0000","last_undegraded":"2023-10-08T00:26:56.740230+0000","last_fullsized":"2023-10-08T00:26:56.740230+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:48.041725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.714431+0000","last_change":"2023-10-08T00:26:55.720213+0000","last_active":"2023-10-08T00:26:56.714431+0000","last_peered":"2023-10-08T00:26:56.714431+0000","last_clean":"2023-10-08T00:26:56.714431+0000","last_became_active":"2023-10-08T00:26:55.719849+0000","last_became_peered":"2023-10-08T00:26:55.719849+0000","last_unstale":"2023-10-08T00:26:56.714431+0000","last_undegraded":"2023-10-08T00:26:56.714431+0000","last_fullsized":"2023-10-08T00:26:56.714431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:26:01.068980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.738493+0000","last_change":"2023-10-08T00:26:56.737905+0000","last_active":"2023-10-08T00:26:56.738493+0000","last_peered":"2023-10-08T00:26:56.738493+0000","last_clean":"2023-10-08T00:26:56.738493+0000","last_became_active":"2023-10-08T00:26:56.737574+0000","last_became_peered":"2023-10-08T00:26:56.737574+0000","last_unstale":"2023-10-08T00:26:56.738493+0000","last_undegraded":"2023-10-08T00:26:56.738493+0000","last_fullsized":"2023-10-08T00:26:56.738493+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:55.700090+0000","last_clean_scrub_stamp":"2023-10-08T00:26:55.700090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:17.688672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"63'2","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.740024+0000","last_change":"2023-10-08T00:26:55.721438+0000","last_active":"2023-10-08T00:26:56.740024+0000","last_peered":"2023-10-08T00:26:56.740024+0000","last_clean":"2023-10-08T00:26:56.740024+0000","last_became_active":"2023-10-08T00:26:55.721078+0000","last_became_peered":"2023-10-08T00:26:55.721078+0000","last_unstale":"2023-10-08T00:26:56.740024+0000","last_undegraded":"2023-10-08T00:26:56.740024+0000","last_fullsized":"2023-10-08T00:26:56.740024+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:26:54.694985+0000","last_clean_scrub_stamp":"2023-10-08T00:26:54.694985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:03:15.833219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-08T00:26:56.720589+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:26:56.720589+0000","last_peered":"2023-10-08T00:26:56.720589+0000","last_clean":"2023-10-08T00:26:56.720589+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:26:56.720589+0000","last_undegraded":"2023-10-08T00:26:56.720589+0000","last_fullsized":"2023-10-08T00:26:56.720589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073204,"statfs":{"total":96636764160,"available":96330960896,"internally_reserved":0,"allocated":1380352,"data_stored":922908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.505,"15min":0.501},"min":{"1min":0.34000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.432,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80200000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.36799999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71499999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59599999999999997,"15min":0.59999999999999998},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.752,"5min":1.048,"15min":1.048},"last":0.438}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64100000000000001,"15min":0.64300000000000002},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89400000000000002,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.505},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":332044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71699999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.73299999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80800000000000005,"5min":1.145,"15min":1.145},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54100000000000004},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.36499999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70499999999999996,"5min":1.079,"15min":1.079},"last":0.439},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.75900000000000001,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.871,"5min":1.127,"15min":1.127},"last":0.502},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77600000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.63600000000000001,"15min":0.64500000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78800000000000003,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.47899999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.65300000000000002,"15min":0.65700000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":1.093,"15min":1.093},"last":0.56000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302164,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069676,"statfs":{"total":96636764160,"available":96327348224,"internally_reserved":0,"allocated":798720,"data_stored":334076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33800000000000002,"15min":0.34000000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.50800000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.373,"15min":0.374},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.316},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29599999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57599999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.43099999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.34000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39700000000000002,"15min":0.39900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.624,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.871,"5min":1.004,"15min":1.004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.622,"15min":0.624},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81599999999999995,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90100000000000002,"5min":1.294,"15min":1.294},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65000000000000002,"15min":0.65600000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.82899999999999996,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.038,"15min":1.038},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.999,"15min":0.999},"last":0.65000000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.752,"5min":0.879,"15min":0.879},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.97999999999999998,"5min":1.087,"15min":1.087},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":1372160,"data_stored":922320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.371,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.434,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.315}]},{"osd":2,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38600000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54000000000000004,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40100000000000002},"min":{"1min":0.28699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35499999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.38300000000000001,"15min":0.38600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.46899999999999997,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.42999999999999999,"15min":0.42799999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.60899999999999999,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.47799999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83699999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.34200000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.84899999999999998,"5min":1.242,"15min":1.242},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.624,"15min":0.624},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.874,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.62,"15min":0.62},"min":{"1min":0.46400000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.505}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63100000000000001,"15min":0.63300000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94099999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.46200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298060,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073780,"statfs":{"total":96636764160,"available":96331550720,"internally_reserved":0,"allocated":790528,"data_stored":333488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.39600000000000002,"15min":0.40200000000000002},"min":{"1min":0.25600000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.48999999999999999,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.23000000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38,"15min":0.38400000000000001},"min":{"1min":0.27900000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54900000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.311},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42099999999999999,"15min":0.42899999999999999},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.56699999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.58699999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.505}]},{"osd":4,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.59299999999999997,"15min":0.59899999999999998},"min":{"1min":0.438,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0489999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.42599999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.44700000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.91100000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93899999999999995,"5min":1.278,"15min":1.278},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0880000000000001,"5min":1.137,"15min":1.137},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.624,"15min":0.63},"min":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85899999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58299999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:26:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.47799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.67700000000000005,"15min":0.68899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":1.343,"15min":1.343},"last":0.59999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302152,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069688,"statfs":{"total":96636764160,"available":96327360512,"internally_reserved":0,"allocated":786432,"data_stored":332064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.46600000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52300000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.38400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41199999999999998,"15min":0.41099999999999998},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.58899999999999997,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61199999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76100000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78500000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95599999999999996,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:26:45 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80700000000000005,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.62},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65100000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.65800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":332022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47699999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53600000000000003,"15min":0.53800000000000003},"min":{"1min":0.35499999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61799999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73499999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.622,"15min":0.629},"min":{"1min":0.41299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93300000000000005,"5min":1.712,"15min":1.712},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.36699999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55200000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.84999999999999998,"5min":0.87,"15min":0.87},"last":0.47999999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.502,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65600000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55100000000000005,"15min":0.54600000000000004},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60499999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:26:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.442,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.629,"15min":0.624},"min":{"1min":0.45300000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298052,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073788,"statfs":{"total":96636764160,"available":96331558912,"internally_reserved":0,"allocated":782336,"data_stored":332042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.496,"15min":0.48199999999999998},"min":{"1min":0.379,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.66800000000000004,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.64200000000000002,"15min":0.65500000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71799999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71099999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59299999999999997,"15min":0.59499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.502},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.67200000000000004,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.74399999999999999,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58199999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.33000000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.55700000000000005,"15min":0.56699999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:26:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:27:05.768 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:27:05.768 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:27:05.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.928+0000 7f67e5a6e700 1 Processor -- start 2023-10-08T00:27:05.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.928+0000 7f67e5a6e700 1 -- start start 2023-10-08T00:27:05.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67e5a6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67e015d930 0x7f67e01645c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67e5a6e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e00b10f0 con 0x7f67e00cf480 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67e5a6e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e015e000 con 0x7f67e01595d0 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67e5a6e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e00cf990 con 0x7f67e015d930 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67e526d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67e015d930 0x7f67e01645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67dffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f67e00cf480 0x7f67e015d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53060/0 (socket says 172.21.15.22:53060) 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67dffff700 1 -- 172.21.15.22:0/747827277 learned_addr learned my addr 172.21.15.22:0/747827277 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.929+0000 7f67e526d700 1 -- 172.21.15.22:0/747827277 >> v1:172.21.15.192:6789/0 conn(0x7f67e01595d0 legacy=0x7f67e00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e526d700 1 -- 172.21.15.22:0/747827277 >> v1:172.21.15.22:6789/0 conn(0x7f67e00cf480 legacy=0x7f67e015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67df7fe700 1 -- 172.21.15.22:0/747827277 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365240359 0 0) 0x7f67e00b10f0 con 0x7f67e00cf480 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e526d700 1 -- 172.21.15.22:0/747827277 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00cfc70 con 0x7f67e015d930 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e526d700 1 --2- 172.21.15.22:0/747827277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e01645c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009e60 tx=0x7f67d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb27e916a5d344e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67df7fe700 1 -- 172.21.15.22:0/747827277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800e070 con 0x7f67e015d930 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67df7fe700 1 -- 172.21.15.22:0/747827277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800bc30 con 0x7f67e015d930 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67df7fe700 1 -- 172.21.15.22:0/747827277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8012430 con 0x7f67e015d930 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 -- 172.21.15.22:0/747827277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 msgr2=0x7f67e01645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/747827277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e01645c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009e60 tx=0x7f67d8009780 comp rx=0 tx=0).stop 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 -- 172.21.15.22:0/747827277 shutdown_connections 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/747827277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e01645c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 -- 172.21.15.22:0/747827277 >> 172.21.15.22:0/747827277 conn(0x7f67e00d05f0 msgr2=0x7f67e00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:05.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 -- 172.21.15.22:0/747827277 shutdown_connections 2023-10-08T00:27:05.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.930+0000 7f67e5a6e700 1 -- 172.21.15.22:0/747827277 wait complete. 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 Processor -- start 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 -- start start 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e00cf480 0x7f67e013fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e01595d0 0x7f67e015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e014ec10 con 0x7f67e015d930 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e014e930 con 0x7f67e01595d0 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.932+0000 7f67e5a6e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e01511e0 con 0x7f67e00cf480 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e015cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53050/0 (socket says 172.21.15.22:53050) 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 -- 172.21.15.22:0/3926059754 learned_addr learned my addr 172.21.15.22:0/3926059754 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67dffff700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e01595d0 0x7f67e015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e4a6c700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e00cf480 0x7f67e013fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 -- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e00cf480 msgr2=0x7f67e013fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e00cf480 0x7f67e013fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 -- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e01595d0 msgr2=0x7f67e015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e01595d0 0x7f67e015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 -- 172.21.15.22:0/3926059754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8009a20 con 0x7f67e015d930 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e4a6c700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e00cf480 0x7f67e013fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:05.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e526d700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e015cb90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f67e00895f0 tx=0x7f67d8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d801b630 con 0x7f67e015d930 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d801b7d0 con 0x7f67e015d930 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e01514c0 con 0x7f67e015d930 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d801bb90 con 0x7f67e015d930 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.933+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e0169ba0 con 0x7f67e015d930 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.934+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e0151040 con 0x7f67e015d930 2023-10-08T00:27:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.935+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f67d801c400 con 0x7f67e015d930 2023-10-08T00:27:05.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.935+0000 7f67dcff9700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f67cc066fc0 0x7f67cc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:05.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.935+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67d8086460 con 0x7f67e015d930 2023-10-08T00:27:05.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.935+0000 7f67e4a6c700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f67cc066fc0 0x7f67cc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:05.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.936+0000 7f67e4a6c700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f67cc066fc0 0x7f67cc069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f67d00018f0 tx=0x7f67d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:05.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:05.939+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67e0151040 con 0x7f67e015d930 2023-10-08T00:27:06.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.216+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f67e0151040 con 0x7f67e015d930 2023-10-08T00:27:06.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.219+0000 7f67dcff9700 1 -- 172.21.15.22:0/3926059754 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f67e0151040 con 0x7f67e015d930 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f67cc066fc0 msgr2=0x7f67cc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f67cc066fc0 0x7f67cc069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f67d00018f0 tx=0x7f67d0009040 comp rx=0 tx=0).stop 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 msgr2=0x7f67e015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e015cb90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f67e00895f0 tx=0x7f67d8019000 comp rx=0 tx=0).stop 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 shutdown_connections 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e015d930 0x7f67e015cb90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f67cc066fc0 0x7f67cc069470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67e00cf480 0x7f67e013fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 --2- 172.21.15.22:0/3926059754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67e01595d0 0x7f67e015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 >> 172.21.15.22:0/3926059754 conn(0x7f67e00d05f0 msgr2=0x7f67e0153ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:06.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 shutdown_connections 2023-10-08T00:27:06.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.221+0000 7f67e5a6e700 1 -- 172.21.15.22:0/3926059754 wait complete. 2023-10-08T00:27:06.223 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:27:06.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:27:06.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.353+0000 7fa7214da700 1 Processor -- start 2023-10-08T00:27:06.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.353+0000 7fa7214da700 1 -- start start 2023-10-08T00:27:06.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa7214da700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa71c0cd0f0 0x7fa71c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa7214da700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c0d01f0 con 0x7fa71c1594d0 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa7214da700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c0cd540 con 0x7fa71c159de0 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa7214da700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c0cf5e0 con 0x7fa71c0cd0f0 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa71a7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa71c0cd0f0 0x7fa71c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa71affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa71c1594d0 0x7fa71c0b5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:53076/0 (socket says 172.21.15.22:53076) 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa71affd700 1 -- 172.21.15.22:0/2650270539 learned_addr learned my addr 172.21.15.22:0/2650270539 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa71a7fc700 1 -- 172.21.15.22:0/2650270539 >> v1:172.21.15.192:6789/0 conn(0x7fa71c159de0 legacy=0x7fa71c0b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa719ffb700 1 -- 172.21.15.22:0/2650270539 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541744837 0 0) 0x7fa71c0d01f0 con 0x7fa71c1594d0 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa71a7fc700 1 -- 172.21.15.22:0/2650270539 >> v1:172.21.15.22:6789/0 conn(0x7fa71c1594d0 legacy=0x7fa71c0b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.354+0000 7fa71a7fc700 1 -- 172.21.15.22:0/2650270539 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0cf8c0 con 0x7fa71c0cd0f0 2023-10-08T00:27:06.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa71a7fc700 1 --2- 172.21.15.22:0/2650270539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1598a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa7100098e0 tx=0x7fa7100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246c24ba5e0e746c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa719ffb700 1 -- 172.21.15.22:0/2650270539 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa710009e80 con 0x7fa71c0cd0f0 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa719ffb700 1 -- 172.21.15.22:0/2650270539 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71000b820 con 0x7fa71c0cd0f0 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa719ffb700 1 -- 172.21.15.22:0/2650270539 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71000bba0 con 0x7fa71c0cd0f0 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 -- 172.21.15.22:0/2650270539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c0cd0f0 msgr2=0x7fa71c1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 --2- 172.21.15.22:0/2650270539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1598a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa7100098e0 tx=0x7fa7100091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 -- 172.21.15.22:0/2650270539 shutdown_connections 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 --2- 172.21.15.22:0/2650270539 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1598a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 -- 172.21.15.22:0/2650270539 >> 172.21.15.22:0/2650270539 conn(0x7fa71c0d05f0 msgr2=0x7fa71c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 -- 172.21.15.22:0/2650270539 shutdown_connections 2023-10-08T00:27:06.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.355+0000 7fa7214da700 1 -- 172.21.15.22:0/2650270539 wait complete. 2023-10-08T00:27:06.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.356+0000 7fa7214da700 1 Processor -- start 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 -- start start 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa71c1594d0 0x7fa71c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 0x7fa71c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c156a80 con 0x7fa71c159de0 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c158890 con 0x7fa71c0cd0f0 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa7214da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c156470 con 0x7fa71c1594d0 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa71b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 0x7fa71c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa71b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 0x7fa71c152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53060/0 (socket says 172.21.15.22:53060) 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa71b7fe700 1 -- 172.21.15.22:0/3178827275 learned_addr learned my addr 172.21.15.22:0/3178827275 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:06.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.357+0000 7fa71affd700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71a7fc700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa71c1594d0 0x7fa71c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71b7fe700 1 -- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa71c1594d0 msgr2=0x7fa71c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71b7fe700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa71c1594d0 0x7fa71c1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71b7fe700 1 -- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa71c0cd0f0 msgr2=0x7fa71c1497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71b7fe700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71b7fe700 1 -- 172.21.15.22:0/3178827275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710009420 con 0x7fa71c159de0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71affd700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa71b7fe700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 0x7fa71c152d10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa71400bc30 tx=0x7fa714009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400c9b0 con 0x7fa71c159de0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71400cb50 con 0x7fa71c159de0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c1585b0 con 0x7fa71c159de0 2023-10-08T00:27:06.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa714014410 con 0x7fa71c159de0 2023-10-08T00:27:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.358+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c153250 con 0x7fa71c159de0 2023-10-08T00:27:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.359+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c04c3c0 con 0x7fa71c159de0 2023-10-08T00:27:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.359+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa714014800 con 0x7fa71c159de0 2023-10-08T00:27:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.360+0000 7fa702ffd700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa708066fc0 0x7fa708069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:06.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.360+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa714084600 con 0x7fa71c159de0 2023-10-08T00:27:06.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.360+0000 7fa71affd700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa708066fc0 0x7fa708069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:06.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.361+0000 7fa71affd700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa708066fc0 0x7fa708069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa71c15ee20 tx=0x7fa70c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:06.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.364+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa71404c5a0 con 0x7fa71c159de0 2023-10-08T00:27:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.600+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa71c156bc0 con 0x7fa71c159de0 2023-10-08T00:27:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.601+0000 7fa702ffd700 1 -- 172.21.15.22:0/3178827275 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fa71c156bc0 con 0x7fa71c159de0 2023-10-08T00:27:06.602 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:27:06.602 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:56.112286+0000","modified":"2023-10-08T00:26:59.735766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/2573785310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2573785310},{"type":"v1","addr":"172.21.15.22:6835","nonce":2573785310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa708066fc0 msgr2=0x7fa708069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa708066fc0 0x7fa708069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa71c15ee20 tx=0x7fa70c009040 comp rx=0 tx=0).stop 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 msgr2=0x7fa71c152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 0x7fa71c152d10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa71400bc30 tx=0x7fa714009820 comp rx=0 tx=0).stop 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 shutdown_connections 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa71c159de0 0x7fa71c152d10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa71c0cd0f0 0x7fa71c1497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa708066fc0 0x7fa708069470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 --2- 172.21.15.22:0/3178827275 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa71c1594d0 0x7fa71c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:06.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 >> 172.21.15.22:0/3178827275 conn(0x7fa71c0d05f0 msgr2=0x7fa71c155120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:06.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 shutdown_connections 2023-10-08T00:27:06.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:06.603+0000 7fa7214da700 1 -- 172.21.15.22:0/3178827275 wait complete. 2023-10-08T00:27:06.605 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 42 2023-10-08T00:27:07.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:26:56.112286+0000', 'modified': '2023-10-08T00:26:59.735766+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5709}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5709': {'gid': 5709, 'name': 'c', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6835/2573785310', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6834', 'nonce': 2573785310}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 2573785310}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:27:07.019 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:27:07.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T00:27:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.142+0000 7f8e53cd0700 1 Processor -- start 2023-10-08T00:27:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.143+0000 7f8e53cd0700 1 -- start start 2023-10-08T00:27:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.143+0000 7f8e53cd0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c159c60 0x7f8e4c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.143+0000 7f8e53cd0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c15a160 con 0x7f8e4c15db10 2023-10-08T00:27:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.143+0000 7f8e53cd0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0d13a0 con 0x7f8e4c159890 2023-10-08T00:27:07.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.143+0000 7f8e53cd0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c15e140 con 0x7f8e4c159c60 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5226d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8e4c15db10 0x7f8e4c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37588/0 (socket says 172.21.15.22:37588) 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5226d700 1 -- 172.21.15.22:0/1832665373 learned_addr learned my addr 172.21.15.22:0/1832665373 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1832665373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c159c60 0x7f8e4c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086355085 0 0) 0x7f8e4c15a160 con 0x7f8e4c15db10 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e34003570 con 0x7f8e4c15db10 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186347493 0 0) 0x7f8e4c0d13a0 con 0x7f8e4c159890 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e4c15a160 con 0x7f8e4c159890 2023-10-08T00:27:07.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5126b700 1 -- 172.21.15.22:0/1832665373 >> v1:172.21.15.192:6789/0 conn(0x7f8e4c159890 legacy=0x7f8e4c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5126b700 1 -- 172.21.15.22:0/1832665373 >> v1:172.21.15.22:6789/0 conn(0x7f8e4c15db10 legacy=0x7f8e4c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5126b700 1 -- 172.21.15.22:0/1832665373 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c15a3d0 con 0x7f8e4c159c60 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1832665373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c159c60 0x7f8e4c15d5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009910 tx=0x7f8e400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3457f303a2c7c280 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.144+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40011630 con 0x7f8e4c159c60 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40011790 con 0x7f8e4c159c60 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e50a6a700 1 -- 172.21.15.22:0/1832665373 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40011b30 con 0x7f8e4c159c60 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 -- 172.21.15.22:0/1832665373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c159c60 msgr2=0x7f8e4c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/1832665373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c159c60 0x7f8e4c15d5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009910 tx=0x7f8e400091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 -- 172.21.15.22:0/1832665373 shutdown_connections 2023-10-08T00:27:07.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/1832665373 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c159c60 0x7f8e4c15d5d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 -- 172.21.15.22:0/1832665373 >> 172.21.15.22:0/1832665373 conn(0x7f8e4c068e20 msgr2=0x7f8e4c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 -- 172.21.15.22:0/1832665373 shutdown_connections 2023-10-08T00:27:07.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.145+0000 7f8e53cd0700 1 -- 172.21.15.22:0/1832665373 wait complete. 2023-10-08T00:27:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.146+0000 7f8e53cd0700 1 Processor -- start 2023-10-08T00:27:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.146+0000 7f8e53cd0700 1 -- start start 2023-10-08T00:27:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e53cd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 0x7f8e4c0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e53cd0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e4c159c60 0x7f8e4c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e53cd0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c15db10 0x7f8e4c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e53cd0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c154ff0 con 0x7f8e4c159890 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e53cd0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0b5680 con 0x7f8e4c159c60 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e53cd0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0cb540 con 0x7f8e4c15db10 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 0x7f8e4c0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 0x7f8e4c0b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51350/0 (socket says 172.21.15.22:51350) 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 -- 172.21.15.22:0/2855481541 learned_addr learned my addr 172.21.15.22:0/2855481541 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e5126b700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e4c159c60 0x7f8e4c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e5226d700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c15db10 0x7f8e4c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 -- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c15db10 msgr2=0x7f8e4c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c15db10 0x7f8e4c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 -- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e4c159c60 msgr2=0x7f8e4c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e4c159c60 0x7f8e4c151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.147+0000 7f8e51a6c700 1 -- 172.21.15.22:0/2855481541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009420 con 0x7f8e4c159890 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.148+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 0x7f8e4c0b6010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c790 tx=0x7f8e3c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.148+0000 7f8e49ffb700 1 -- 172.21.15.22:0/2855481541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c010510 con 0x7f8e4c159890 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.148+0000 7f8e49ffb700 1 -- 172.21.15.22:0/2855481541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c010670 con 0x7f8e4c159890 2023-10-08T00:27:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.148+0000 7f8e49ffb700 1 -- 172.21.15.22:0/2855481541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c010a10 con 0x7f8e4c159890 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.148+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c0b58d0 con 0x7f8e4c159890 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.148+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0c78a0 con 0x7f8e4c159890 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.149+0000 7f8e49ffb700 1 -- 172.21.15.22:0/2855481541 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8e3c01b3b0 con 0x7f8e4c159890 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.150+0000 7f8e49ffb700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e38067090 0x7f8e38069540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.150+0000 7f8e49ffb700 1 -- 172.21.15.22:0/2855481541 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e3c083d90 con 0x7f8e4c159890 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.150+0000 7f8e5126b700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e38067090 0x7f8e38069540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.150+0000 7f8e5126b700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e38067090 0x7f8e38069540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c15a090 tx=0x7f8e40017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 Processor -- start 2023-10-08T00:27:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 -- start start 2023-10-08T00:27:07.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda570ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5733f60 0x55dda5706cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda5661a70 con 0x55dda570aa50 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda565f270 con 0x55dda5754d00 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.152+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda565b060 con 0x55dda5733f60 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda570ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda570ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51364/0 (socket says 172.21.15.22:51364) 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1057623772 learned_addr learned my addr 172.21.15.22:0/1057623772 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e5226d700 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5733f60 0x55dda5706cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5733f60 msgr2=0x55dda5706cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5733f60 0x55dda5706cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 msgr2=0x55dda5733a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1057623772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda54f5270 con 0x55dda570aa50 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e5226d700 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5733f60 0x55dda5706cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda570ae20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c002390 tx=0x7f8e3c054b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7690e110e90e83c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e32ffd700 1 -- 172.21.15.22:0/1057623772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c054db0 con 0x55dda570aa50 2023-10-08T00:27:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e32ffd700 1 -- 172.21.15.22:0/1057623772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c05a0c0 con 0x55dda570aa50 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.153+0000 7f8e32ffd700 1 -- 172.21.15.22:0/1057623772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c057fa0 con 0x55dda570aa50 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1057623772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 msgr2=0x55dda570ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda570ae20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c002390 tx=0x7f8e3c054b20 comp rx=0 tx=0).stop 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1057623772 shutdown_connections 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5733f60 0x55dda5706cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda570ae20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1057623772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1057623772 >> 172.21.15.22:0/1057623772 conn(0x55dda570c370 msgr2=0x55dda570c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1057623772 shutdown_connections 2023-10-08T00:27:07.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1057623772 wait complete. 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 -- start start 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.154+0000 7f8e5cfc8b80 1 Processor -- start 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda5738db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5733f60 0x55dda5730390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda57544f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda5606890 con 0x55dda570aa50 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda5621ea0 con 0x55dda5733f60 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda54dde30 con 0x55dda5754d00 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e5cfc8b80 10 client.0 _ll_register_callbacks cb 0x55dda56ce110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:27:07.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e51a6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda5738db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e51a6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda5738db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51366/0 (socket says 172.21.15.22:51366) 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.155+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1436895329 learned_addr learned my addr 172.21.15.22:0/1436895329 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5733f60 0x55dda5730390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5226d700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda57544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 msgr2=0x55dda57544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda57544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5733f60 msgr2=0x55dda5730390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5733f60 0x55dda5730390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e51a6c700 1 -- 172.21.15.22:0/1436895329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0c78a0 con 0x55dda570aa50 2023-10-08T00:27:07.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5226d700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda57544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5733f60 0x55dda5730390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda5738db0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00cd80 tx=0x7f8e3c069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3457cea8102604b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e27fff700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e27fff700 1 -- 172.21.15.22:0/1436895329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c054db0 con 0x55dda570aa50 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e27fff700 1 -- 172.21.15.22:0/1436895329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e3c05bcf0 con 0x55dda570aa50 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dda56ffb70 con 0x55dda570aa50 2023-10-08T00:27:07.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e27fff700 1 -- 172.21.15.22:0/1436895329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e3c057fa0 con 0x55dda570aa50 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 10 client.5886 fetch_fsmap learned FSMap version 42 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55dda5497fe0 con 0x55dda570aa50 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e27fff700 1 -- 172.21.15.22:0/1436895329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dda56ffb70 con 0x55dda570aa50 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e27fff700 1 -- 172.21.15.22:0/1436895329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8e3c0670b0 con 0x55dda570aa50 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 10 client.5886 fetch_fsmap finished waiting for FSMap version 42 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 10 client.5886 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 20 client.5886 populate_metadata read hostname 'smithi022' 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda57650d0 0x55dda5707780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 4 client.5886 mds_command: new command op to 5709 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.156+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 --> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dda56dcaa0 con 0x55dda57650d0 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.157+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda57650d0 0x55dda5707780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.157+0000 7f8e27fff700 10 client.5886 ms_handle_connect on v2:172.21.15.22:6834/2573785310 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.157+0000 7f8e5126b700 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda57650d0 0x55dda5707780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c76773c7944247d server_cookie=da8fb558b75a6768 in_seq=0 out_seq=0 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.157+0000 7f8e27fff700 1 -- 172.21.15.22:0/1436895329 <== mds.0 v2:172.21.15.22:6834/2573785310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dda56dcaa0 con 0x55dda57650d0 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.157+0000 7f8e27fff700 10 client.5886 handle_command_reply: tid=0 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.157+0000 7f8e5cfc8b80 1 client.5886 shutdown 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 msgr2=0x55dda5738db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda5738db0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00cd80 tx=0x7f8e3c069000 comp rx=0 tx=0).stop 2023-10-08T00:27:07.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 shutdown_connections 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda57650d0 0x55dda5707780 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda57544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e27fff700 0 client.5886 ms_handle_reset on v2:172.21.15.22:6834/2573785310 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda570aa50 0x55dda5738db0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/1436895329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5733f60 0x55dda5730390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 >> 172.21.15.22:0/1436895329 conn(0x55dda570c370 msgr2=0x55dda570b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 shutdown_connections 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/1436895329 wait complete. 2023-10-08T00:27:07.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.158+0000 7f8e5cfc8b80 20 client.5886 trim_cache size 0 max 16384 2023-10-08T00:27:07.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.175+0000 7f8e5cfc8b80 1 Processor -- start 2023-10-08T00:27:07.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.175+0000 7f8e5cfc8b80 1 -- start start 2023-10-08T00:27:07.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda570aa50 0x55dda5750380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda57337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda5707780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda570e410 con 0x55dda5733f60 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda570a370 con 0x55dda570aa50 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda57739e0 con 0x55dda5754d00 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda57337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda57337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51368/0 (socket says 172.21.15.22:51368) 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 -- 172.21.15.22:0/2735846819 learned_addr learned my addr 172.21.15.22:0/2735846819 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda570aa50 0x55dda5750380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5226d700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda5707780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 -- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 msgr2=0x55dda5707780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda5707780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 -- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda570aa50 msgr2=0x55dda5750380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda570aa50 0x55dda5750380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 -- 172.21.15.22:0/2735846819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda5629780 con 0x55dda5733f60 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda570aa50 0x55dda5750380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5226d700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda5707780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e5126b700 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda57337b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8e40013000 tx=0x7f8e40029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2552883d859383dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e337fe700 1 -- 172.21.15.22:0/2735846819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4002c040 con 0x55dda5733f60 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e337fe700 1 -- 172.21.15.22:0/2735846819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4002d040 con 0x55dda5733f60 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.176+0000 7f8e337fe700 1 -- 172.21.15.22:0/2735846819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4001ab10 con 0x55dda5733f60 2023-10-08T00:27:07.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/2735846819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 msgr2=0x55dda57337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda57337b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8e40013000 tx=0x7f8e40029040 comp rx=0 tx=0).stop 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/2735846819 shutdown_connections 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda5754d00 0x55dda5707780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda570aa50 0x55dda5750380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/2735846819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda57337b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/2735846819 >> 172.21.15.22:0/2735846819 conn(0x55dda570c370 msgr2=0x55dda5749f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/2735846819 shutdown_connections 2023-10-08T00:27:07.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/2735846819 wait complete. 2023-10-08T00:27:07.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 -- start start 2023-10-08T00:27:07.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.177+0000 7f8e5cfc8b80 1 Processor -- start 2023-10-08T00:27:07.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda570aa50 0x55dda57b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda5732b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda572fce0 con 0x55dda5733f60 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda5753070 con 0x55dda5754d00 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda5753ed0 con 0x55dda570aa50 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5cfc8b80 10 client.0 _ll_register_callbacks cb 0x55dda56ce110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.178+0000 7f8e5126b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda5732b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda5732b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51380/0 (socket says 172.21.15.22:51380) 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 -- 172.21.15.22:0/3988982017 learned_addr learned my addr 172.21.15.22:0/3988982017 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda570aa50 0x55dda57b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5226d700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 -- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda570aa50 msgr2=0x55dda57b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda570aa50 0x55dda57b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 -- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 msgr2=0x55dda5733050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 -- 172.21.15.22:0/3988982017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c15a3d0 con 0x55dda5733f60 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5226d700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5126b700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda5732b10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009860 tx=0x7f8e40033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ec1c9792e5894c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e27fff700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:27:07.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e27fff700 1 -- 172.21.15.22:0/3988982017 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4002c050 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e27fff700 1 -- 172.21.15.22:0/3988982017 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e400357b0 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e3c05a0c0 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e27fff700 1 -- 172.21.15.22:0/3988982017 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e40035b80 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5cfc8b80 10 client.5892 fetch_fsmap learned FSMap version 42 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x55dda5610470 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e27fff700 1 -- 172.21.15.22:0/3988982017 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c05a0c0 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.179+0000 7f8e27fff700 1 -- 172.21.15.22:0/3988982017 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8e40035ce0 con 0x55dda5733f60 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 10 client.5892 fetch_fsmap finished waiting for FSMap version 42 2023-10-08T00:27:07.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 10 client.5892 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 20 client.5892 populate_metadata read hostname 'smithi022' 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda5736710 0x55dda5736ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 4 client.5892 mds_command: new command op to 5709 tid=0[{"prefix": "status"}] 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 --> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dda55fde00 con 0x55dda5736710 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda5736710 0x55dda5736ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e27fff700 10 client.5892 ms_handle_connect on v2:172.21.15.22:6834/2573785310 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e51a6c700 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda5736710 0x55dda5736ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce315bd8dc7f5fd server_cookie=dd034d479383a202 in_seq=0 out_seq=0 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e27fff700 1 -- 172.21.15.22:0/3988982017 <== mds.0 v2:172.21.15.22:6834/2573785310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55dda55fde00 con 0x55dda5736710 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e27fff700 10 client.5892 handle_command_reply: tid=0 2023-10-08T00:27:07.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 client.5892 shutdown 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 msgr2=0x55dda5732b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda5732b10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009860 tx=0x7f8e40033000 comp rx=0 tx=0).stop 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 shutdown_connections 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda5754d00 0x55dda5733050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:6834/2573785310,v1:172.21.15.22:6835/2573785310] conn(0x55dda5736710 0x55dda5736ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda570aa50 0x55dda57b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 --2- 172.21.15.22:0/3988982017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda5733f60 0x55dda5732b10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e27fff700 0 client.5892 ms_handle_reset on v2:172.21.15.22:6834/2573785310 2023-10-08T00:27:07.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.180+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 >> 172.21.15.22:0/3988982017 conn(0x55dda570c370 msgr2=0x55dda57337b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 shutdown_connections 2023-10-08T00:27:07.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e5cfc8b80 1 -- 172.21.15.22:0/3988982017 wait complete. 2023-10-08T00:27:07.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e5cfc8b80 20 client.5892 trim_cache size 0 max 16384 2023-10-08T00:27:07.191 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:27:07.191 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:27:07.191 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 5709, 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.461531825, 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 42, 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 64, 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 64, 2023-10-08T00:27:07.192 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 21.542208116000001 2023-10-08T00:27:07.193 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:27:07.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e38067090 msgr2=0x7f8e38069540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e38067090 0x7f8e38069540 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c15a090 tx=0x7f8e40017000 comp rx=0 tx=0).stop 2023-10-08T00:27:07.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 msgr2=0x7f8e4c0b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 0x7f8e4c0b6010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00c790 tx=0x7f8e3c007e10 comp rx=0 tx=0).stop 2023-10-08T00:27:07.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 shutdown_connections 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8e38067090 0x7f8e38069540 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8e4c15db10 0x7f8e4c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e4c159890 0x7f8e4c0b6010 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 --2- 172.21.15.22:0/2855481541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e4c159c60 0x7f8e4c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 >> 172.21.15.22:0/2855481541 conn(0x7f8e4c068e20 msgr2=0x7f8e4c152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 shutdown_connections 2023-10-08T00:27:07.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.181+0000 7f8e53cd0700 1 -- 172.21.15.22:0/2855481541 wait complete. 2023-10-08T00:27:07.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:27:07.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.314+0000 7f4a76f6d700 1 Processor -- start 2023-10-08T00:27:07.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.314+0000 7f4a76f6d700 1 -- start start 2023-10-08T00:27:07.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a76f6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a70159420 0x7f4a700b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a76f6d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a7015d230 0x7f4a7015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a76f6d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7015dbd0 con 0x7f4a701597f0 2023-10-08T00:27:07.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a76f6d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a700b2980 con 0x7f4a7015d230 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a76f6d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700b11d0 con 0x7f4a70159420 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7676c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a7015d230 0x7f4a7015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a75f6b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a70159420 0x7f4a700b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7676c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a7015d230 0x7f4a7015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:52540/0 (socket says 172.21.15.22:52540) 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7576a700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4a701597f0 0x7f4a700b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:40166/0 (socket says 172.21.15.22:40166) 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7676c700 1 -- 172.21.15.22:0/2393980759 learned_addr learned my addr 172.21.15.22:0/2393980759 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a75f6b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a70159420 0x7f4a700b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:50478/0 (socket says 172.21.15.22:50478) 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7676c700 1 -- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a70159420 msgr2=0x7f4a700b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7676c700 1 --2- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a70159420 0x7f4a700b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a7676c700 1 -- 172.21.15.22:0/2393980759 >> v1:172.21.15.192:6789/0 conn(0x7f4a701597f0 legacy=0x7f4a700b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a7676c700 1 -- 172.21.15.22:0/2393980759 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700b14b0 con 0x7f4a7015d230 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.315+0000 7f4a74f69700 1 -- 172.21.15.22:0/2393980759 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688199131 0 0) 0x7f4a60001110 con 0x7f4a701597f0 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a7676c700 1 --2- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7015d230 0x7f4a7015d690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009f20 tx=0x7f4a68009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9642c5111a270f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a74f69700 1 -- 172.21.15.22:0/2393980759 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800e070 con 0x7f4a7015d230 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a74f69700 1 -- 172.21.15.22:0/2393980759 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6800b9d0 con 0x7f4a7015d230 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a74f69700 1 -- 172.21.15.22:0/2393980759 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680092e0 con 0x7f4a7015d230 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a76f6d700 1 -- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7015d230 msgr2=0x7f4a7015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7015d230 0x7f4a7015d690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009f20 tx=0x7f4a68009840 comp rx=0 tx=0).stop 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a76f6d700 1 -- 172.21.15.22:0/2393980759 shutdown_connections 2023-10-08T00:27:07.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7015d230 0x7f4a7015d690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/2393980759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a70159420 0x7f4a700b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.316+0000 7f4a76f6d700 1 -- 172.21.15.22:0/2393980759 >> 172.21.15.22:0/2393980759 conn(0x7f4a700d0660 msgr2=0x7f4a700d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.317+0000 7f4a76f6d700 1 -- 172.21.15.22:0/2393980759 shutdown_connections 2023-10-08T00:27:07.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.317+0000 7f4a76f6d700 1 -- 172.21.15.22:0/2393980759 wait complete. 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 Processor -- start 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 -- start start 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70159420 0x7f4a7016a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a701597f0 0x7f4a7016c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 0x7f4a7015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015ba00 con 0x7f4a7015d230 2023-10-08T00:27:07.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7015ab30 con 0x7f4a70159420 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a76f6d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70159fb0 con 0x7f4a701597f0 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a7676c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 0x7f4a7015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a7676c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 0x7f4a7015c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51392/0 (socket says 172.21.15.22:51392) 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.318+0000 7f4a7676c700 1 -- 172.21.15.22:0/427936072 learned_addr learned my addr 172.21.15.22:0/427936072 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a75f6b700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70159420 0x7f4a7016a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7576a700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a701597f0 0x7f4a7016c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7676c700 1 -- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a701597f0 msgr2=0x7f4a7016c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7676c700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a701597f0 0x7f4a7016c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7676c700 1 -- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70159420 msgr2=0x7f4a7016a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7676c700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70159420 0x7f4a7016a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7676c700 1 -- 172.21.15.22:0/427936072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68009ae0 con 0x7f4a7015d230 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7576a700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a701597f0 0x7f4a7016c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a7676c700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 0x7f4a7015c6f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4a70089340 tx=0x7f4a68018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68008bc0 con 0x7f4a7015d230 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68008d40 con 0x7f4a7015d230 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7015a290 con 0x7f4a7015d230 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6801c660 con 0x7f4a7015d230 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.319+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7015a850 con 0x7f4a7015d230 2023-10-08T00:27:07.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.320+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7004c3c0 con 0x7f4a7015d230 2023-10-08T00:27:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.321+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4a68003040 con 0x7f4a7015d230 2023-10-08T00:27:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.321+0000 7f4a65ffb700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a54066fc0 0x7f4a54069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.321+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a68085eb0 con 0x7f4a7015d230 2023-10-08T00:27:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.321+0000 7f4a75f6b700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a54066fc0 0x7f4a54069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.322+0000 7f4a75f6b700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a54066fc0 0x7f4a54069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009db0 tx=0x7f4a6c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:07.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.325+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a68053020 con 0x7f4a7015d230 2023-10-08T00:27:07.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.564+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4a700b1790 con 0x7f4a7015d230 2023-10-08T00:27:07.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.564+0000 7f4a65ffb700 1 -- 172.21.15.22:0/427936072 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4a68056640 con 0x7f4a7015d230 2023-10-08T00:27:07.961 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a54066fc0 msgr2=0x7f4a54069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a54066fc0 0x7f4a54069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009db0 tx=0x7f4a6c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 msgr2=0x7f4a7015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 0x7f4a7015c6f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4a70089340 tx=0x7f4a68018000 comp rx=0 tx=0).stop 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 shutdown_connections 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a7015d230 0x7f4a7015c6f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a70159420 0x7f4a7016a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a54066fc0 0x7f4a54069470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 --2- 172.21.15.22:0/427936072 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a701597f0 0x7f4a7016c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 >> 172.21.15.22:0/427936072 conn(0x7f4a700d0660 msgr2=0x7f4a701553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 shutdown_connections 2023-10-08T00:27:07.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:07.566+0000 7f4a76f6d700 1 -- 172.21.15.22:0/427936072 wait complete. 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:27:07.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:27:07.964 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:27:07.964 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:27:07.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:07.964 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:27:07.981 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:27:07.981 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:27:07.981 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:27:07.981 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.981 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:27:07.981 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:27:07.983 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.984 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:27:07.984 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:27:07.984 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:27:07.984 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:07.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:07.984 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:27:08.046 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:27:08.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:08.048 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:27:08.106 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:27:08.106 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:27:08.106 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:27:08.106 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:27:08.107 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:27:08.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:08.107 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:27:08.107 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:27:08.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:27:08.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:27:08.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:27:08.108 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:27:08.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:08.210 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:27:08.224 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:27:08.224 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:27:08.224 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:27:08.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:08.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:27:08.289 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:27:08.289 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:27:08.344 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:27:08.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:27:08.345 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:27:08.398 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:27:08.399 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:27:08.399 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:08.480 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:27:08.499 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:27:08.500 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:27:08.521 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:08.521 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:27:08.522 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:27:08.523 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:27:08.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:08.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:27:08.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:27:08.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.748+0000 7f0340ce3700 1 Processor -- start 2023-10-08T00:27:08.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.748+0000 7f0340ce3700 1 -- start start 2023-10-08T00:27:08.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f0340ce3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c06bcd0 0x7f033c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f0340ce3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f033c06c0a0 0x7f033c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f0340ce3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c15d7e0 con 0x7f033c15df50 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f0340ce3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c15dac0 con 0x7f033c06c0a0 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f0340ce3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c15aa30 con 0x7f033c06bcd0 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f0339d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f033c06c0a0 0x7f033c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f033ad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f033c15df50 0x7f033c0c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37598/0 (socket says 172.21.15.22:37598) 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.749+0000 7f033ad9d700 1 -- 172.21.15.22:0/1864340000 learned_addr learned my addr 172.21.15.22:0/1864340000 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f033a59c700 1 --2- 172.21.15.22:0/1864340000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c06bcd0 0x7f033c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f0339d9b700 1 -- 172.21.15.22:0/1864340000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c06bcd0 msgr2=0x7f033c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:08.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f0339d9b700 1 --2- 172.21.15.22:0/1864340000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c06bcd0 0x7f033c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f0339d9b700 1 -- 172.21.15.22:0/1864340000 >> v1:172.21.15.22:6789/0 conn(0x7f033c15df50 legacy=0x7f033c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f0339d9b700 1 -- 172.21.15.22:0/1864340000 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c15ad10 con 0x7f033c06c0a0 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f033959a700 1 -- 172.21.15.22:0/1864340000 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688858816 0 0) 0x7f033c15d7e0 con 0x7f033c15df50 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f0339d9b700 1 --2- 172.21.15.22:0/1864340000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06c0a0 0x7f033c15a1e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f03240098e0 tx=0x7f03240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa85e66bcfc16e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f033959a700 1 -- 172.21.15.22:0/1864340000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324009e80 con 0x7f033c06c0a0 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f033959a700 1 -- 172.21.15.22:0/1864340000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032400b860 con 0x7f033c06c0a0 2023-10-08T00:27:08.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.750+0000 7f033959a700 1 -- 172.21.15.22:0/1864340000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400bbe0 con 0x7f033c06c0a0 2023-10-08T00:27:08.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 -- 172.21.15.22:0/1864340000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06c0a0 msgr2=0x7f033c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 --2- 172.21.15.22:0/1864340000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06c0a0 0x7f033c15a1e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f03240098e0 tx=0x7f03240091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 -- 172.21.15.22:0/1864340000 shutdown_connections 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 --2- 172.21.15.22:0/1864340000 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c06bcd0 0x7f033c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 --2- 172.21.15.22:0/1864340000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06c0a0 0x7f033c15a1e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 -- 172.21.15.22:0/1864340000 >> 172.21.15.22:0/1864340000 conn(0x7f033c0ce600 msgr2=0x7f033c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 -- 172.21.15.22:0/1864340000 shutdown_connections 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.751+0000 7f0340ce3700 1 -- 172.21.15.22:0/1864340000 wait complete. 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.752+0000 7f0340ce3700 1 Processor -- start 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.752+0000 7f0340ce3700 1 -- start start 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0340ce3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 0x7f033c0c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:08.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0340ce3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f033c06c0a0 0x7f033c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0340ce3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c15df50 0x7f033c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0340ce3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c16d1b0 con 0x7f033c06bcd0 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0340ce3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c16a120 con 0x7f033c06c0a0 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0340ce3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c16a400 con 0x7f033c15df50 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 0x7f033c0c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 0x7f033c0c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51422/0 (socket says 172.21.15.22:51422) 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 -- 172.21.15.22:0/2344732155 learned_addr learned my addr 172.21.15.22:0/2344732155 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033ad9d700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c15df50 0x7f033c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f0339d9b700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f033c06c0a0 0x7f033c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 -- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c15df50 msgr2=0x7f033c0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:08.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c15df50 0x7f033c0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 -- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f033c06c0a0 msgr2=0x7f033c14bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f033c06c0a0 0x7f033c14bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 -- 172.21.15.22:0/2344732155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009420 con 0x7f033c06bcd0 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.753+0000 7f033a59c700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 0x7f033c0c4530 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f032c00d860 tx=0x7f032c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.754+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c0125f0 con 0x7f033c06bcd0 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.754+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c012750 con 0x7f033c06bcd0 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.754+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c16a6e0 con 0x7f033c06bcd0 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.754+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c012b10 con 0x7f033c06bcd0 2023-10-08T00:27:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.754+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0c4a70 con 0x7f033c06bcd0 2023-10-08T00:27:08.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.755+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c04c3c0 con 0x7f033c06bcd0 2023-10-08T00:27:08.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.755+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f032c01e460 con 0x7f033c06bcd0 2023-10-08T00:27:08.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.756+0000 7f03327fc700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f031c066fc0 0x7f031c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:08.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.756+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f032c084a80 con 0x7f033c06bcd0 2023-10-08T00:27:08.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.756+0000 7f0339d9b700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f031c066fc0 0x7f031c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:08.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.756+0000 7f0339d9b700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f031c066fc0 0x7f031c069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f033c0b25b0 tx=0x7f0324017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:08.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.760+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f032c055790 con 0x7f033c06bcd0 2023-10-08T00:27:08.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.999+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f033c16d500 con 0x7f033c06bcd0 2023-10-08T00:27:09.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:08.999+0000 7f03327fc700 1 -- 172.21.15.22:0/2344732155 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f032c055320 con 0x7f033c06bcd0 2023-10-08T00:27:09.000 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f031c066fc0 msgr2=0x7f031c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f031c066fc0 0x7f031c069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f033c0b25b0 tx=0x7f0324017000 comp rx=0 tx=0).stop 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 msgr2=0x7f033c0c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 0x7f033c0c4530 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f032c00d860 tx=0x7f032c008040 comp rx=0 tx=0).stop 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 shutdown_connections 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f031c066fc0 0x7f031c069470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f033c15df50 0x7f033c0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f033c06bcd0 0x7f033c0c4530 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 --2- 172.21.15.22:0/2344732155 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f033c06c0a0 0x7f033c14bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 >> 172.21.15.22:0/2344732155 conn(0x7f033c0ce600 msgr2=0x7f033c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:09.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 shutdown_connections 2023-10-08T00:27:09.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.001+0000 7f0340ce3700 1 -- 172.21.15.22:0/2344732155 wait complete. 2023-10-08T00:27:09.013 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:27:09.013 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:27:09.013 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:27:09.013 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:27:09.014 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:27:09.014 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:27:09.014 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:27:09.014 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:27:09.014 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:27:09.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.014 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:27:09.032 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:27:09.033 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42346sec preferred_lft 42346sec 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:27:09.034 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:27:09.035 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:27:09.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.036 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:27:09.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.101 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:27:09.159 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:27:09.159 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:27:09.159 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:27:09.159 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:27:09.159 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:27:09.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.159 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:27:09.160 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:27:09.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:27:09.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:27:09.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:27:09.160 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:27:09.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.265 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:27:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:27:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:27:09.280 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:27:09.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.280 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:27:09.345 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:27:09.345 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:27:09.399 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:27:09.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:27:09.400 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:27:09.454 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:27:09.454 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:27:09.454 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:09.533 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:09.533 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:27:09.551 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:27:09.552 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:27:09.573 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:27:09.574 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:27:09.576 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:27:09.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:27:09.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:27:09.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:27:09.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.769+0000 7f9f05014700 1 Processor -- start 2023-10-08T00:27:09.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9f05014700 1 -- start start 2023-10-08T00:27:09.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9f05014700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f00159ec0 0x7f9f000b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:09.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9f05014700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f000cf350 0x7f9f000cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:09.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9f05014700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000b5b00 con 0x7f9f000b53d0 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9f05014700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000b5850 con 0x7f9f00159ec0 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9f05014700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000b5da0 con 0x7f9f000cf350 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9efed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f00159ec0 0x7f9f000b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9efe59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9f000b53d0 0x7f9f000cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37604/0 (socket says 172.21.15.22:37604) 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9efed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f00159ec0 0x7f9f000b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51424/0 (socket says 172.21.15.22:51424) 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.770+0000 7f9efe59c700 1 -- 172.21.15.22:0/3890125534 learned_addr learned my addr 172.21.15.22:0/3890125534 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9eff59e700 1 --2- 172.21.15.22:0/3890125534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f000cf350 0x7f9f000cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efed9d700 1 -- 172.21.15.22:0/3890125534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f000cf350 msgr2=0x7f9f000cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efed9d700 1 --2- 172.21.15.22:0/3890125534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f000cf350 0x7f9f000cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efed9d700 1 -- 172.21.15.22:0/3890125534 >> v1:172.21.15.22:6789/0 conn(0x7f9f000b53d0 legacy=0x7f9f000cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efed9d700 1 -- 172.21.15.22:0/3890125534 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000b6080 con 0x7f9f00159ec0 2023-10-08T00:27:09.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efdd9b700 1 -- 172.21.15.22:0/3890125534 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744730135 0 0) 0x7f9f000b5b00 con 0x7f9f000b53d0 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efed9d700 1 --2- 172.21.15.22:0/3890125534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f00159ec0 0x7f9f000b4e90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80098d0 tx=0x7f9ef8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c43d5e442378db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efdd9b700 1 -- 172.21.15.22:0/3890125534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8005c10 con 0x7f9f00159ec0 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efdd9b700 1 -- 172.21.15.22:0/3890125534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef8005d70 con 0x7f9f00159ec0 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.771+0000 7f9efdd9b700 1 -- 172.21.15.22:0/3890125534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8006280 con 0x7f9f00159ec0 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 -- 172.21.15.22:0/3890125534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f00159ec0 msgr2=0x7f9f000b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 --2- 172.21.15.22:0/3890125534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f00159ec0 0x7f9f000b4e90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80098d0 tx=0x7f9ef8009120 comp rx=0 tx=0).stop 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 -- 172.21.15.22:0/3890125534 shutdown_connections 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 --2- 172.21.15.22:0/3890125534 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f000cf350 0x7f9f000cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 --2- 172.21.15.22:0/3890125534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f00159ec0 0x7f9f000b4e90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 -- 172.21.15.22:0/3890125534 >> 172.21.15.22:0/3890125534 conn(0x7f9f000999f0 msgr2=0x7f9f000b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:09.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 -- 172.21.15.22:0/3890125534 shutdown_connections 2023-10-08T00:27:09.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.772+0000 7f9f05014700 1 -- 172.21.15.22:0/3890125534 wait complete. 2023-10-08T00:27:09.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.773+0000 7f9f05014700 1 Processor -- start 2023-10-08T00:27:09.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.773+0000 7f9f05014700 1 -- start start 2023-10-08T00:27:09.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 0x7f9f00068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:09.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f000cf350 0x7f9f00150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:09.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f00159ec0 0x7f9f0006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:09.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00150760 con 0x7f9f000b53d0 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00069380 con 0x7f9f000cf350 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00069660 con 0x7f9f00159ec0 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 0x7f9f00068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 0x7f9f00068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51426/0 (socket says 172.21.15.22:51426) 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 -- 172.21.15.22:0/446587329 learned_addr learned my addr 172.21.15.22:0/446587329 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9eff59e700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f00159ec0 0x7f9f0006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efe59c700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f000cf350 0x7f9f00150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 -- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f00159ec0 msgr2=0x7f9f0006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:09.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f00159ec0 0x7f9f0006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 -- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f000cf350 msgr2=0x7f9f00150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f000cf350 0x7f9f00150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 -- 172.21.15.22:0/446587329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80093c0 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9efed9d700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 0x7f9f00068da0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009f70 tx=0x7f9ef8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef801a700 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef801a860 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f00069940 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.774+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef801ac20 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.775+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0006ae20 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.776+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f00063c90 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.776+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9ef8011420 con 0x7f9f000b53d0 2023-10-08T00:27:09.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.776+0000 7f9ef6ffd700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ee0067040 0x7f9ee00694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:09.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.776+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ef8085c10 con 0x7f9f000b53d0 2023-10-08T00:27:09.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.776+0000 7f9efe59c700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ee0067040 0x7f9ee00694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:09.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.777+0000 7f9efe59c700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ee0067040 0x7f9ee00694f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9f000c6970 tx=0x7f9ee8007f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:09.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:09.781+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ef8052d90 con 0x7f9f000b53d0 2023-10-08T00:27:10.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.021+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9f000718b0 con 0x7f9f000b53d0 2023-10-08T00:27:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.760+0000 7f9ef6ffd700 1 -- 172.21.15.22:0/446587329 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9ef802b0c0 con 0x7f9f000b53d0 2023-10-08T00:27:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ee0067040 msgr2=0x7f9ee00694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ee0067040 0x7f9ee00694f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9f000c6970 tx=0x7f9ee8007f50 comp rx=0 tx=0).stop 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 msgr2=0x7f9f00068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 0x7f9f00068da0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009f70 tx=0x7f9ef8016000 comp rx=0 tx=0).stop 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 shutdown_connections 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ee0067040 0x7f9ee00694f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f00159ec0 0x7f9f0006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f000b53d0 0x7f9f00068da0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 --2- 172.21.15.22:0/446587329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f000cf350 0x7f9f00150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 >> 172.21.15.22:0/446587329 conn(0x7f9f000999f0 msgr2=0x7f9f00151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 shutdown_connections 2023-10-08T00:27:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.763+0000 7f9f05014700 1 -- 172.21.15.22:0/446587329 wait complete. 2023-10-08T00:27:10.778 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:27:10.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.904+0000 7ffadb59e700 1 Processor -- start 2023-10-08T00:27:10.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.904+0000 7ffadb59e700 1 -- start start 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffadc0b1e50 0x7ffadc159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadb59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffadc0ceaa0 0x7ffadc0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc0b6570 con 0x7ffadc1593b0 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadb59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0cfe20 con 0x7ffadc0ceaa0 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0cf210 con 0x7ffadc0b1e50 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffadc0ceaa0 0x7ffadc0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffadc0ceaa0 0x7ffadc0b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51432/0 (socket says 172.21.15.22:51432) 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadad9d700 1 -- 172.21.15.22:0/3767648826 learned_addr learned my addr 172.21.15.22:0/3767648826 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffad9d9b700 1 --2- 172.21.15.22:0/3767648826 >> v2:172.21.15.192:3300/0 conn(0x7ffadc0b1e50 0x7ffadc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadad9d700 1 -- 172.21.15.22:0/3767648826 >> v2:172.21.15.192:3300/0 conn(0x7ffadc0b1e50 msgr2=0x7ffadc159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadad9d700 1 --2- 172.21.15.22:0/3767648826 >> v2:172.21.15.192:3300/0 conn(0x7ffadc0b1e50 0x7ffadc159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.905+0000 7ffadad9d700 1 -- 172.21.15.22:0/3767648826 >> v1:172.21.15.192:6789/0 conn(0x7ffadc1593b0 legacy=0x7ffadc0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadad9d700 1 -- 172.21.15.22:0/3767648826 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0cf4f0 con 0x7ffadc0ceaa0 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadad9d700 1 --2- 172.21.15.22:0/3767648826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc0ceaa0 0x7ffadc0b6030 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0b2d90 tx=0x7ffad4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc50067202a875d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffad959a700 1 -- 172.21.15.22:0/3767648826 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400b820 con 0x7ffadc0ceaa0 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffad959a700 1 -- 172.21.15.22:0/3767648826 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad400b980 con 0x7ffadc0ceaa0 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffad959a700 1 -- 172.21.15.22:0/3767648826 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400bd20 con 0x7ffadc0ceaa0 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 -- 172.21.15.22:0/3767648826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc0ceaa0 msgr2=0x7ffadc0b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:10.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3767648826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc0ceaa0 0x7ffadc0b6030 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0b2d90 tx=0x7ffad4009250 comp rx=0 tx=0).stop 2023-10-08T00:27:10.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 -- 172.21.15.22:0/3767648826 shutdown_connections 2023-10-08T00:27:10.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3767648826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc0ceaa0 0x7ffadc0b6030 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3767648826 >> v2:172.21.15.192:3300/0 conn(0x7ffadc0b1e50 0x7ffadc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 -- 172.21.15.22:0/3767648826 >> 172.21.15.22:0/3767648826 conn(0x7ffadc0d1130 msgr2=0x7ffadc0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:10.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 -- 172.21.15.22:0/3767648826 shutdown_connections 2023-10-08T00:27:10.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.906+0000 7ffadb59e700 1 -- 172.21.15.22:0/3767648826 wait complete. 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.907+0000 7ffadb59e700 1 Processor -- start 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 -- start start 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffadc0b1e50 0x7ffadc0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffadc0ceaa0 0x7ffadc0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 0x7ffadc15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc157250 con 0x7ffadc1593b0 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0c5400 con 0x7ffadc0b1e50 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0c5650 con 0x7ffadc0ceaa0 2023-10-08T00:27:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 0x7ffadc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 0x7ffadc15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51438/0 (socket says 172.21.15.22:51438) 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.908+0000 7ffadad9d700 1 -- 172.21.15.22:0/3813523234 learned_addr learned my addr 172.21.15.22:0/3813523234 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffada59c700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffadc0b1e50 0x7ffadc0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffad9d9b700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffadc0ceaa0 0x7ffadc0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadad9d700 1 -- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffadc0ceaa0 msgr2=0x7ffadc0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadad9d700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffadc0ceaa0 0x7ffadc0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadad9d700 1 -- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffadc0b1e50 msgr2=0x7ffadc0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadad9d700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffadc0b1e50 0x7ffadc0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadad9d700 1 -- 172.21.15.22:0/3813523234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40094f0 con 0x7ffadc1593b0 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadad9d700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 0x7ffadc15a750 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffad40030c0 tx=0x7ffad4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad401b680 con 0x7ffadc1593b0 2023-10-08T00:27:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad401b7e0 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0c5930 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad401bba0 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.909+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc0c5ef0 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.910+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc04c3c0 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.910+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ffad401c450 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.911+0000 7ffad27fc700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffabc066fc0 0x7ffabc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.911+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffad4086380 con 0x7ffadc1593b0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.911+0000 7ffada59c700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffabc066fc0 0x7ffabc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.911+0000 7ffada59c700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffabc066fc0 0x7ffabc069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009fd0 tx=0x7ffacc009600 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:10.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:10.915+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffad4053500 con 0x7ffadc1593b0 2023-10-08T00:27:11.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.138+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ffadc0b6570 con 0x7ffabc066fc0 2023-10-08T00:27:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.141+0000 7ffad27fc700 1 -- 172.21.15.22:0/3813523234 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ffadc0b6570 con 0x7ffabc066fc0 2023-10-08T00:27:11.140 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:27:11.141 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:27:11.141 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:27:11.141 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:27:11.141 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffabc066fc0 msgr2=0x7ffabc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffabc066fc0 0x7ffabc069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009fd0 tx=0x7ffacc009600 comp rx=0 tx=0).stop 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 msgr2=0x7ffadc15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 0x7ffadc15a750 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ffad40030c0 tx=0x7ffad4016000 comp rx=0 tx=0).stop 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 shutdown_connections 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffadc1593b0 0x7ffadc15a750 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffadc0b1e50 0x7ffadc0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffabc066fc0 0x7ffabc069470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 --2- 172.21.15.22:0/3813523234 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffadc0ceaa0 0x7ffadc0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 >> 172.21.15.22:0/3813523234 conn(0x7ffadc0d1130 msgr2=0x7ffadc0b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 shutdown_connections 2023-10-08T00:27:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.142+0000 7ffadb59e700 1 -- 172.21.15.22:0/3813523234 wait complete. 2023-10-08T00:27:11.154 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:27:11.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.276+0000 7f6f95354700 1 Processor -- start 2023-10-08T00:27:11.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.276+0000 7f6f95354700 1 -- start start 2023-10-08T00:27:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f95354700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f95354700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f900b1b40 0x7f6f9015d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f95354700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900cfb00 con 0x7f6f900b16d0 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f95354700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900b5c40 con 0x7f6f900b1b40 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f95354700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900b5f20 con 0x7f6f900b4e70 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f94b53700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f900b1b40 0x7f6f9015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f8f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6f900b16d0 0x7f6f9015d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37612/0 (socket says 172.21.15.22:37612) 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f8f7fe700 1 -- 172.21.15.22:0/3086849647 learned_addr learned my addr 172.21.15.22:0/3086849647 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f8ffff700 1 --2- 172.21.15.22:0/3086849647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f94b53700 1 -- 172.21.15.22:0/3086849647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 msgr2=0x7f6f900ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f94b53700 1 --2- 172.21.15.22:0/3086849647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f94b53700 1 -- 172.21.15.22:0/3086849647 >> v1:172.21.15.22:6789/0 conn(0x7f6f900b16d0 legacy=0x7f6f9015d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f94b53700 1 -- 172.21.15.22:0/3086849647 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900b6200 con 0x7f6f900b1b40 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.277+0000 7f6f8effd700 1 -- 172.21.15.22:0/3086849647 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246251498 0 0) 0x7f6f900cfb00 con 0x7f6f900b16d0 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f94b53700 1 --2- 172.21.15.22:0/3086849647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b1b40 0x7f6f9015d950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e60 tx=0x7f6f88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4836ae145ae3de73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f8effd700 1 -- 172.21.15.22:0/3086849647 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800e070 con 0x7f6f900b1b40 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f8effd700 1 -- 172.21.15.22:0/3086849647 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800bb60 con 0x7f6f900b1b40 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f8effd700 1 -- 172.21.15.22:0/3086849647 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88012430 con 0x7f6f900b1b40 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 -- 172.21.15.22:0/3086849647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b1b40 msgr2=0x7f6f9015d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 --2- 172.21.15.22:0/3086849647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b1b40 0x7f6f9015d950 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009e60 tx=0x7f6f88009780 comp rx=0 tx=0).stop 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 -- 172.21.15.22:0/3086849647 shutdown_connections 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 --2- 172.21.15.22:0/3086849647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b1b40 0x7f6f9015d950 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 --2- 172.21.15.22:0/3086849647 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 -- 172.21.15.22:0/3086849647 >> 172.21.15.22:0/3086849647 conn(0x7f6f900d10c0 msgr2=0x7f6f900affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 -- 172.21.15.22:0/3086849647 shutdown_connections 2023-10-08T00:27:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.278+0000 7f6f95354700 1 -- 172.21.15.22:0/3086849647 wait complete. 2023-10-08T00:27:11.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.279+0000 7f6f95354700 1 Processor -- start 2023-10-08T00:27:11.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 -- start start 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 0x7f6f900af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f900b1b40 0x7f6f900c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900af5a0 con 0x7f6f900b16d0 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900c9e10 con 0x7f6f900b1b40 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f95354700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f900ca0f0 con 0x7f6f900b4e70 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 0x7f6f900af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f8ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 0x7f6f900af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51460/0 (socket says 172.21.15.22:51460) 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.280+0000 7f6f8ffff700 1 -- 172.21.15.22:0/1605053311 learned_addr learned my addr 172.21.15.22:0/1605053311 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f94b53700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f8ffff700 1 -- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 msgr2=0x7f6f900ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f8ffff700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f8ffff700 1 -- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f900b1b40 msgr2=0x7f6f900c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f8ffff700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f900b1b40 0x7f6f900c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f8ffff700 1 -- 172.21.15.22:0/1605053311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88009a20 con 0x7f6f900b16d0 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f8ffff700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 0x7f6f900af060 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e930 tx=0x7f6f800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000eed0 con 0x7f6f900b16d0 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000c850 con 0x7f6f900b16d0 2023-10-08T00:27:11.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f900ca3d0 con 0x7f6f900b16d0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000cbf0 con 0x7f6f900b16d0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.281+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f900c7ea0 con 0x7f6f900b16d0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.282+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f900c8390 con 0x7f6f900b16d0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.282+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6f80013470 con 0x7f6f900b16d0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.283+0000 7f6f87fff700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f70066fc0 0x7f6f70069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.283+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f80084740 con 0x7f6f900b16d0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.283+0000 7f6f8f7fe700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f70066fc0 0x7f6f70069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.283+0000 7f6f8f7fe700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f70066fc0 0x7f6f70069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f780011e0 tx=0x7f6f780079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.287+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f800519c0 con 0x7f6f900b16d0 2023-10-08T00:27:11.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.478+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6f900b1510 con 0x7f6f900b16d0 2023-10-08T00:27:11.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.478+0000 7f6f87fff700 1 -- 172.21.15.22:0/1605053311 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f80054fe0 con 0x7f6f900b16d0 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f70066fc0 msgr2=0x7f6f70069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f70066fc0 0x7f6f70069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6f780011e0 tx=0x7f6f780079d0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 msgr2=0x7f6f900af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 0x7f6f900af060 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e930 tx=0x7f6f800091a0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 shutdown_connections 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f70066fc0 0x7f6f70069470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f900b4e70 0x7f6f900ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f900b16d0 0x7f6f900af060 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 --2- 172.21.15.22:0/1605053311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f900b1b40 0x7f6f900c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 >> 172.21.15.22:0/1605053311 conn(0x7f6f900d10c0 msgr2=0x7f6f900b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:11.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 shutdown_connections 2023-10-08T00:27:11.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.480+0000 7f6f95354700 1 -- 172.21.15.22:0/1605053311 wait complete. 2023-10-08T00:27:11.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000424239 --mode=777 2023-10-08T00:27:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.615+0000 7fb393db2700 1 Processor -- start 2023-10-08T00:27:11.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.615+0000 7fb393db2700 1 -- start start 2023-10-08T00:27:11.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb393db2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb38c0cd910 0x7fb38c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb393db2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb38c0b55a0 0x7fb38c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb393db2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38c0b5b00 con 0x7fb38c159ec0 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb393db2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c0b5da0 con 0x7fb38c0b55a0 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb393db2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38c0b6080 con 0x7fb38c0cd910 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb38c0b55a0 0x7fb38c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb38c0b55a0 0x7fb38c0ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51462/0 (socket says 172.21.15.22:51462) 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 -- 172.21.15.22:0/2515657462 learned_addr learned my addr 172.21.15.22:0/2515657462 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39134d700 1 --2- 172.21.15.22:0/2515657462 >> v2:172.21.15.192:3300/0 conn(0x7fb38c0cd910 0x7fb38c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 -- 172.21.15.22:0/2515657462 >> v2:172.21.15.192:3300/0 conn(0x7fb38c0cd910 msgr2=0x7fb38c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 --2- 172.21.15.22:0/2515657462 >> v2:172.21.15.192:3300/0 conn(0x7fb38c0cd910 0x7fb38c0ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 -- 172.21.15.22:0/2515657462 >> v1:172.21.15.192:6789/0 conn(0x7fb38c159ec0 legacy=0x7fb38c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:11.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 -- 172.21.15.22:0/2515657462 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c0cc100 con 0x7fb38c0b55a0 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb39234f700 1 --2- 172.21.15.22:0/2515657462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0b55a0 0x7fb38c0ce880 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb384009f20 tx=0x7fb384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723ca8c70fe85bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb390b4c700 1 -- 172.21.15.22:0/2515657462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38400e070 con 0x7fb38c0b55a0 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb390b4c700 1 -- 172.21.15.22:0/2515657462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb38400ba00 con 0x7fb38c0b55a0 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.616+0000 7fb390b4c700 1 -- 172.21.15.22:0/2515657462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840092e0 con 0x7fb38c0b55a0 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 -- 172.21.15.22:0/2515657462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0b55a0 msgr2=0x7fb38c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 --2- 172.21.15.22:0/2515657462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0b55a0 0x7fb38c0ce880 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb384009f20 tx=0x7fb384009840 comp rx=0 tx=0).stop 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 -- 172.21.15.22:0/2515657462 shutdown_connections 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 --2- 172.21.15.22:0/2515657462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c0b55a0 0x7fb38c0ce880 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 --2- 172.21.15.22:0/2515657462 >> v2:172.21.15.192:3300/0 conn(0x7fb38c0cd910 0x7fb38c0ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 -- 172.21.15.22:0/2515657462 >> 172.21.15.22:0/2515657462 conn(0x7fb38c0999f0 msgr2=0x7fb38c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:11.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 -- 172.21.15.22:0/2515657462 shutdown_connections 2023-10-08T00:27:11.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.617+0000 7fb393db2700 1 -- 172.21.15.22:0/2515657462 wait complete. 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.618+0000 7fb393db2700 1 Processor -- start 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.618+0000 7fb393db2700 1 -- start start 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb393db2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38c0b55a0 0x7fb38c1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb393db2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38c159ec0 0x7fb38c09cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb393db2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 0x7fb38c068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb393db2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c09d5b0 con 0x7fb38c09d110 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb393db2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c16ae20 con 0x7fb38c0b55a0 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb393db2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38c069080 con 0x7fb38c159ec0 2023-10-08T00:27:11.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 0x7fb38c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 0x7fb38c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51468/0 (socket says 172.21.15.22:51468) 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 -- 172.21.15.22:0/3951442049 learned_addr learned my addr 172.21.15.22:0/3951442049 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb391b4e700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38c0b55a0 0x7fb38c1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39134d700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38c159ec0 0x7fb38c09cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 -- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38c159ec0 msgr2=0x7fb38c09cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38c159ec0 0x7fb38c09cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 -- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38c0b55a0 msgr2=0x7fb38c1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38c0b55a0 0x7fb38c1570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 -- 172.21.15.22:0/3951442049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009ae0 con 0x7fb38c09d110 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39134d700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38c159ec0 0x7fb38c09cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb391b4e700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38c0b55a0 0x7fb38c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:11.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.619+0000 7fb39234f700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 0x7fb38c068390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb38400b6c0 tx=0x7fb384017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.620+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384012e90 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.620+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840092e0 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.620+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38c069360 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.620+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb38401d670 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.620+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38c069920 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.621+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38c09a460 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.621+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb38401da20 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.621+0000 7fb389ffb700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb378066fc0 0x7fb378069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.622+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb384085f40 con 0x7fb38c09d110 2023-10-08T00:27:11.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.622+0000 7fb391b4e700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb378066fc0 0x7fb378069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:11.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.622+0000 7fb391b4e700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb378066fc0 0x7fb378069470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb38c06a080 tx=0x7fb37c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:11.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.626+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3840b75a0 con 0x7fb38c09d110 2023-10-08T00:27:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.857+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000424239", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7fb38c063c90 con 0x7fb378066fc0 2023-10-08T00:27:11.860 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:27:11.860+0000 7f7d5e472700 -1 client.5347 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-08T00:26:34.727049+0000 mtime=2023-10-08T00:26:34.727049+0000 ctime=2023-10-08T00:26:34.732121+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000509384"] has_dir_layout 0x55cc96d92600) 2023-10-08T00:27:11.864 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:27:11.865+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:27:11.865 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:27:11.865+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:27:11.865 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:27:11.865+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:27:11.865 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:27:11.865+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:27:11.865 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:27:11.865+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:27:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.893+0000 7fb389ffb700 1 -- 172.21.15.22:0/3951442049 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb38c063c90 con 0x7fb378066fc0 2023-10-08T00:27:11.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb378066fc0 msgr2=0x7fb378069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb378066fc0 0x7fb378069470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb38c06a080 tx=0x7fb37c009040 comp rx=0 tx=0).stop 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 msgr2=0x7fb38c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 0x7fb38c068390 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb38400b6c0 tx=0x7fb384017000 comp rx=0 tx=0).stop 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 shutdown_connections 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c09d110 0x7fb38c068390 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb38c0b55a0 0x7fb38c1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb378066fc0 0x7fb378069470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 --2- 172.21.15.22:0/3951442049 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb38c159ec0 0x7fb38c09cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 >> 172.21.15.22:0/3951442049 conn(0x7fb38c0999f0 msgr2=0x7fb38c159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 shutdown_connections 2023-10-08T00:27:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:11.896+0000 7fb393db2700 1 -- 172.21.15.22:0/3951442049 wait complete. 2023-10-08T00:27:11.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000424239 2023-10-08T00:27:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.030+0000 7fd285a77700 1 Processor -- start 2023-10-08T00:27:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.030+0000 7fd285a77700 1 -- start start 2023-10-08T00:27:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285a77700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b16d0 0x7fd2800b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285a77700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd2800b33b0 0x7fd2800b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285a77700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2800b2080 con 0x7fd2800b4e70 2023-10-08T00:27:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285a77700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2800cfb00 con 0x7fd2800b33b0 2023-10-08T00:27:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285a77700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800b5c40 con 0x7fd2800b16d0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285276700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd2800b33b0 0x7fd2800b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd284a75700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd2800b4e70 0x7fd2800ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37628/0 (socket says 172.21.15.22:37628) 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd284a75700 1 -- 172.21.15.22:0/2268419914 learned_addr learned my addr 172.21.15.22:0/2268419914 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd27ffff700 1 --2- 172.21.15.22:0/2268419914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b16d0 0x7fd2800b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.031+0000 7fd285276700 1 -- 172.21.15.22:0/2268419914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b16d0 msgr2=0x7fd2800b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285276700 1 --2- 172.21.15.22:0/2268419914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b16d0 0x7fd2800b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285276700 1 -- 172.21.15.22:0/2268419914 >> v1:172.21.15.22:6789/0 conn(0x7fd2800b4e70 legacy=0x7fd2800ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd27f7fe700 1 -- 172.21.15.22:0/2268419914 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102078248 0 0) 0x7fd2800b2080 con 0x7fd2800b4e70 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285276700 1 -- 172.21.15.22:0/2268419914 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800b5f20 con 0x7fd2800b33b0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285276700 1 --2- 172.21.15.22:0/2268419914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b33b0 0x7fd2800b3830 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd278009e60 tx=0x7fd278009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf058e850fc8145 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd27f7fe700 1 -- 172.21.15.22:0/2268419914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800e070 con 0x7fd2800b33b0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd27f7fe700 1 -- 172.21.15.22:0/2268419914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27800bc30 con 0x7fd2800b33b0 2023-10-08T00:27:12.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd27f7fe700 1 -- 172.21.15.22:0/2268419914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278012430 con 0x7fd2800b33b0 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 -- 172.21.15.22:0/2268419914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b33b0 msgr2=0x7fd2800b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 --2- 172.21.15.22:0/2268419914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b33b0 0x7fd2800b3830 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd278009e60 tx=0x7fd278009780 comp rx=0 tx=0).stop 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 -- 172.21.15.22:0/2268419914 shutdown_connections 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 --2- 172.21.15.22:0/2268419914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b33b0 0x7fd2800b3830 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 --2- 172.21.15.22:0/2268419914 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b16d0 0x7fd2800b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 -- 172.21.15.22:0/2268419914 >> 172.21.15.22:0/2268419914 conn(0x7fd2800d10c0 msgr2=0x7fd2800affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 -- 172.21.15.22:0/2268419914 shutdown_connections 2023-10-08T00:27:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.032+0000 7fd285a77700 1 -- 172.21.15.22:0/2268419914 wait complete. 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.033+0000 7fd285a77700 1 Processor -- start 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 -- start start 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 0x7fd2800ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2800b33b0 0x7fd280068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4e70 0x7fd280068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800c6660 con 0x7fd2800b16d0 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28016dfa0 con 0x7fd2800b33b0 2023-10-08T00:27:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd285a77700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800c5d30 con 0x7fd2800b4e70 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd284a75700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 0x7fd2800ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.034+0000 7fd284a75700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 0x7fd2800ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51486/0 (socket says 172.21.15.22:51486) 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 -- 172.21.15.22:0/3317557547 learned_addr learned my addr 172.21.15.22:0/3317557547 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd27ffff700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2800b33b0 0x7fd280068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd285276700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4e70 0x7fd280068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 -- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4e70 msgr2=0x7fd280068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4e70 0x7fd280068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 -- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2800b33b0 msgr2=0x7fd280068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2800b33b0 0x7fd280068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 -- 172.21.15.22:0/3317557547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009a20 con 0x7fd2800b16d0 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd27ffff700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2800b33b0 0x7fd280068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:27:12.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd284a75700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 0x7fd2800ca250 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c5b0 tx=0x7fd270001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270005b30 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd270005c90 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2800c6010 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270007300 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.035+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2800ca790 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.036+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd280088990 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.037+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd27001b3b0 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.037+0000 7fd27cff9700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd26c066fc0 0x7fd26c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.037+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd270083a90 con 0x7fd2800b16d0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.037+0000 7fd27ffff700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd26c066fc0 0x7fd26c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:27:12.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.038+0000 7fd27ffff700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd26c066fc0 0x7fd26c069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2800c7b40 tx=0x7fd274008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:27:12.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.041+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd270050d10 con 0x7fd2800b16d0 2023-10-08T00:27:12.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.269+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000424239", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2800c67a0 con 0x7fd26c066fc0 2023-10-08T00:27:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.275+0000 7fd27cff9700 1 -- 172.21.15.22:0/3317557547 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7fd27400f760 con 0x7fd26c066fc0 2023-10-08T00:27:12.276 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088 2023-10-08T00:27:12.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd26c066fc0 msgr2=0x7fd26c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:12.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd26c066fc0 0x7fd26c069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd2800c7b40 tx=0x7fd274008040 comp rx=0 tx=0).stop 2023-10-08T00:27:12.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 msgr2=0x7fd2800ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 0x7fd2800ca250 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd27000c5b0 tx=0x7fd270001070 comp rx=0 tx=0).stop 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 shutdown_connections 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd26c066fc0 0x7fd26c069470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd2800b4e70 0x7fd280068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2800b16d0 0x7fd2800ca250 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 --2- 172.21.15.22:0/3317557547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2800b33b0 0x7fd280068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 >> 172.21.15.22:0/3317557547 conn(0x7fd2800d10c0 msgr2=0x7fd280158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 shutdown_connections 2023-10-08T00:27:12.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:27:12.277+0000 7fd285a77700 1 -- 172.21.15.22:0/3317557547 wait complete. 2023-10-08T00:27:12.290 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000424239 with 3000 files each 0.1MB size under directory volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088 2023-10-08T00:27:12.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.290 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.313 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1181e-05 s, 0.0 kB/s 2023-10-08T00:27:12.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.313 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-08T00:27:12.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.369 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.426e-05 s, 0.0 kB/s 2023-10-08T00:27:12.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.425 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.481 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8531e-05 s, 0.0 kB/s 2023-10-08T00:27:12.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.481 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0113e-05 s, 0.0 kB/s 2023-10-08T00:27:12.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.537 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2604e-05 s, 0.0 kB/s 2023-10-08T00:27:12.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.649 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.650 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2309e-05 s, 0.0 kB/s 2023-10-08T00:27:12.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.650 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.705 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3081e-05 s, 0.0 kB/s 2023-10-08T00:27:12.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.706 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.760 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.761 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.4617e-05 s, 0.0 kB/s 2023-10-08T00:27:12.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.762 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.819 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1717e-05 s, 0.0 kB/s 2023-10-08T00:27:12.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.875 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-08T00:27:12.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.933 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4626e-05 s, 0.0 kB/s 2023-10-08T00:27:12.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.933 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:12.988 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:12.988 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:12.988 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-08T00:27:12.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:12.989 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.044 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.045 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3008e-05 s, 0.0 kB/s 2023-10-08T00:27:13.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.046 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.102 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3476e-05 s, 0.0 kB/s 2023-10-08T00:27:13.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.158 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.8908e-05 s, 0.0 kB/s 2023-10-08T00:27:13.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.159 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.213 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.214 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.899e-05 s, 0.0 kB/s 2023-10-08T00:27:13.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.214 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1201e-05 s, 0.0 kB/s 2023-10-08T00:27:13.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.270 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.933e-05 s, 0.0 kB/s 2023-10-08T00:27:13.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.326 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.382 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.7989e-05 s, 0.0 kB/s 2023-10-08T00:27:13.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.382 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.438 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8583e-05 s, 0.0 kB/s 2023-10-08T00:27:13.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.438 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.493 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.494 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.494 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8144e-05 s, 0.0 kB/s 2023-10-08T00:27:13.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.494 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.549 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.550 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.164e-05 s, 0.0 kB/s 2023-10-08T00:27:13.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.550 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.606 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0385e-05 s, 0.0 kB/s 2023-10-08T00:27:13.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.606 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9968e-05 s, 0.0 kB/s 2023-10-08T00:27:13.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.663 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3471e-05 s, 0.0 kB/s 2023-10-08T00:27:13.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.719 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.775 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2384e-05 s, 0.0 kB/s 2023-10-08T00:27:13.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.776 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.831 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3514e-05 s, 0.0 kB/s 2023-10-08T00:27:13.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.832 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.887 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-08T00:27:13.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.888 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.943 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1151e-05 s, 0.0 kB/s 2023-10-08T00:27:13.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.944 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:13.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:13.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:13.999 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3311e-05 s, 0.0 kB/s 2023-10-08T00:27:13.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:13.999 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.054 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.055 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8188e-05 s, 0.0 kB/s 2023-10-08T00:27:14.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.111 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.111 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.111 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0543e-05 s, 0.0 kB/s 2023-10-08T00:27:14.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.111 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.167 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.167 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.167 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9865e-05 s, 0.0 kB/s 2023-10-08T00:27:14.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.223 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9489e-05 s, 0.0 kB/s 2023-10-08T00:27:14.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.223 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.279 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3127e-05 s, 0.0 kB/s 2023-10-08T00:27:14.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.281 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.335 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4772e-05 s, 0.0 kB/s 2023-10-08T00:27:14.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.335 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1122e-05 s, 0.0 kB/s 2023-10-08T00:27:14.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.391 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.447 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1755e-05 s, 0.0 kB/s 2023-10-08T00:27:14.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.448 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.503 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.503 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.503 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1232e-05 s, 0.0 kB/s 2023-10-08T00:27:14.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.504 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.559 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.559 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.559 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8885e-05 s, 0.0 kB/s 2023-10-08T00:27:14.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.559 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.615 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5003e-05 s, 0.0 kB/s 2023-10-08T00:27:14.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.616 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.671 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.671 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.671 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.987e-05 s, 0.0 kB/s 2023-10-08T00:27:14.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.671 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.727 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1184e-05 s, 0.0 kB/s 2023-10-08T00:27:14.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.727 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.783 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3633e-05 s, 0.0 kB/s 2023-10-08T00:27:14.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.784 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.839 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9791e-05 s, 0.0 kB/s 2023-10-08T00:27:14.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.839 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.895 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.895 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1005e-05 s, 0.0 kB/s 2023-10-08T00:27:14.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.895 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:14.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:14.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:14.951 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2998e-05 s, 0.0 kB/s 2023-10-08T00:27:14.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:14.952 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.007 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.007 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2649e-05 s, 0.0 kB/s 2023-10-08T00:27:15.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3229e-05 s, 0.0 kB/s 2023-10-08T00:27:15.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.119 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.323e-05 s, 0.0 kB/s 2023-10-08T00:27:15.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.175 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2309e-05 s, 0.0 kB/s 2023-10-08T00:27:15.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0686e-05 s, 0.0 kB/s 2023-10-08T00:27:15.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.231 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8842e-05 s, 0.0 kB/s 2023-10-08T00:27:15.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.287 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.343 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2149e-05 s, 0.0 kB/s 2023-10-08T00:27:15.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.399 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9677e-05 s, 0.0 kB/s 2023-10-08T00:27:15.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.399 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9569e-05 s, 0.0 kB/s 2023-10-08T00:27:15.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.455 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.510 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9752e-05 s, 0.0 kB/s 2023-10-08T00:27:15.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.511 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.566 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-08T00:27:15.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.567 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0198e-05 s, 0.0 kB/s 2023-10-08T00:27:15.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1585e-05 s, 0.0 kB/s 2023-10-08T00:27:15.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.735 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1886e-05 s, 0.0 kB/s 2023-10-08T00:27:15.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2752e-05 s, 0.0 kB/s 2023-10-08T00:27:15.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2784e-05 s, 0.0 kB/s 2023-10-08T00:27:15.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3664e-05 s, 0.0 kB/s 2023-10-08T00:27:15.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:15.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:15.961 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:15.961 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3289e-05 s, 0.0 kB/s 2023-10-08T00:27:15.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:15.961 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.017 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3164e-05 s, 0.0 kB/s 2023-10-08T00:27:16.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.073 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1749e-05 s, 0.0 kB/s 2023-10-08T00:27:16.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.073 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.128 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0807e-05 s, 0.0 kB/s 2023-10-08T00:27:16.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.129 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.185 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4102e-05 s, 0.0 kB/s 2023-10-08T00:27:16.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.185 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.241 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0736e-05 s, 0.0 kB/s 2023-10-08T00:27:16.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.241 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.296 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.297 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1744e-05 s, 0.0 kB/s 2023-10-08T00:27:16.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.298 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.354 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.354 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.354 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9665e-05 s, 0.0 kB/s 2023-10-08T00:27:16.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.362 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1515e-05 s, 0.0 kB/s 2023-10-08T00:27:16.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.410 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.466 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.466 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.466 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2082e-05 s, 0.0 kB/s 2023-10-08T00:27:16.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.466 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.522 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.522 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.522 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1941e-05 s, 0.0 kB/s 2023-10-08T00:27:16.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.522 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.578 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2251e-05 s, 0.0 kB/s 2023-10-08T00:27:16.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.579 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.634 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.634 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.634 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0528e-05 s, 0.0 kB/s 2023-10-08T00:27:16.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.634 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.690 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.690 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.690 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9743e-05 s, 0.0 kB/s 2023-10-08T00:27:16.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.690 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.749 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.749 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.749 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4671e-05 s, 0.0 kB/s 2023-10-08T00:27:16.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.749 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.805 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.805 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.805 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4444e-05 s, 0.0 kB/s 2023-10-08T00:27:16.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.806 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.861 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3876e-05 s, 0.0 kB/s 2023-10-08T00:27:16.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.917 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1446e-05 s, 0.0 kB/s 2023-10-08T00:27:16.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.917 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:16.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:16.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:16.974 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9186e-05 s, 0.0 kB/s 2023-10-08T00:27:16.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:16.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0871e-05 s, 0.0 kB/s 2023-10-08T00:27:17.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.030 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0676e-05 s, 0.0 kB/s 2023-10-08T00:27:17.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.086 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0234e-05 s, 0.0 kB/s 2023-10-08T00:27:17.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.143 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.198 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.198 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1233e-05 s, 0.0 kB/s 2023-10-08T00:27:17.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.198 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.017e-05 s, 0.0 kB/s 2023-10-08T00:27:17.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.254 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.310 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1268e-05 s, 0.0 kB/s 2023-10-08T00:27:17.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.310 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0748e-05 s, 0.0 kB/s 2023-10-08T00:27:17.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.366 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.422 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2997e-05 s, 0.0 kB/s 2023-10-08T00:27:17.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.422 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.478 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0339e-05 s, 0.0 kB/s 2023-10-08T00:27:17.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.478 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.534 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.534 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.534 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0872e-05 s, 0.0 kB/s 2023-10-08T00:27:17.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.534 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.590 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1835e-05 s, 0.0 kB/s 2023-10-08T00:27:17.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.590 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.646 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.646 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.646 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9532e-05 s, 0.0 kB/s 2023-10-08T00:27:17.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.646 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.702 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0274e-05 s, 0.0 kB/s 2023-10-08T00:27:17.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.702 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0891e-05 s, 0.0 kB/s 2023-10-08T00:27:17.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.758 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.814 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.303e-05 s, 0.0 kB/s 2023-10-08T00:27:17.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.815 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3002e-05 s, 0.0 kB/s 2023-10-08T00:27:17.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.870 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.926 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.926 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.926 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1107e-05 s, 0.0 kB/s 2023-10-08T00:27:17.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.926 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0911e-05 s, 0.0 kB/s 2023-10-08T00:27:17.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:17.983 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.040 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2542e-05 s, 0.0 kB/s 2023-10-08T00:27:18.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.040 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.096 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.096 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.097 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0796e-05 s, 0.0 kB/s 2023-10-08T00:27:18.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.097 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.153 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9999e-05 s, 0.0 kB/s 2023-10-08T00:27:18.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.154 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.211 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9811e-05 s, 0.0 kB/s 2023-10-08T00:27:18.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.212 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.267 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0243e-05 s, 0.0 kB/s 2023-10-08T00:27:18.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.268 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.325 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0606e-05 s, 0.0 kB/s 2023-10-08T00:27:18.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.325 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.381 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1492e-05 s, 0.0 kB/s 2023-10-08T00:27:18.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.382 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1412e-05 s, 0.0 kB/s 2023-10-08T00:27:18.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.439 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.496 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0094e-05 s, 0.0 kB/s 2023-10-08T00:27:18.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.552 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.552 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.552 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1995e-05 s, 0.0 kB/s 2023-10-08T00:27:18.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.553 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.609 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1078e-05 s, 0.0 kB/s 2023-10-08T00:27:18.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.610 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.667 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9423e-05 s, 0.0 kB/s 2023-10-08T00:27:18.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.668 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.725 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.725 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.725 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1363e-05 s, 0.0 kB/s 2023-10-08T00:27:18.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.781 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.781 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3502e-05 s, 0.0 kB/s 2023-10-08T00:27:18.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.782 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.839 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2902e-05 s, 0.0 kB/s 2023-10-08T00:27:18.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.839 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.895 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.139e-05 s, 0.0 kB/s 2023-10-08T00:27:18.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.896 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:18.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:18.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:18.951 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4543e-05 s, 0.0 kB/s 2023-10-08T00:27:18.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:18.951 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.007 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.007 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4494e-05 s, 0.0 kB/s 2023-10-08T00:27:19.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1184e-05 s, 0.0 kB/s 2023-10-08T00:27:19.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.119 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9221e-05 s, 0.0 kB/s 2023-10-08T00:27:19.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.175 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0275e-05 s, 0.0 kB/s 2023-10-08T00:27:19.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9206e-05 s, 0.0 kB/s 2023-10-08T00:27:19.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.232 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1299e-05 s, 0.0 kB/s 2023-10-08T00:27:19.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.342 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-08T00:27:19.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.343 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.399 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-08T00:27:19.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0293e-05 s, 0.0 kB/s 2023-10-08T00:27:19.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.456 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9927e-05 s, 0.0 kB/s 2023-10-08T00:27:19.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.511 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9769e-05 s, 0.0 kB/s 2023-10-08T00:27:19.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.568 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8255e-05 s, 0.0 kB/s 2023-10-08T00:27:19.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.678 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.678 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.678 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9466e-05 s, 0.0 kB/s 2023-10-08T00:27:19.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.679 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.735 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3281e-05 s, 0.0 kB/s 2023-10-08T00:27:19.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-08T00:27:19.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.847 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3816e-05 s, 0.0 kB/s 2023-10-08T00:27:19.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.902 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1519e-05 s, 0.0 kB/s 2023-10-08T00:27:19.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.903 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:19.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:19.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:19.958 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9842e-05 s, 0.0 kB/s 2023-10-08T00:27:19.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:19.958 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.014 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1783e-05 s, 0.0 kB/s 2023-10-08T00:27:20.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9831e-05 s, 0.0 kB/s 2023-10-08T00:27:20.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.071 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.126 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.923e-05 s, 0.0 kB/s 2023-10-08T00:27:20.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.126 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.182 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.182 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.182 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0946e-05 s, 0.0 kB/s 2023-10-08T00:27:20.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.182 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.238 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.238 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0491e-05 s, 0.0 kB/s 2023-10-08T00:27:20.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.238 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9977e-05 s, 0.0 kB/s 2023-10-08T00:27:20.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.847e-05 s, 0.0 kB/s 2023-10-08T00:27:20.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.351 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.406 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.406 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.406 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9505e-05 s, 0.0 kB/s 2023-10-08T00:27:20.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.406 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.462 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1671e-05 s, 0.0 kB/s 2023-10-08T00:27:20.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.462 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.518 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1495e-05 s, 0.0 kB/s 2023-10-08T00:27:20.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.518 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.574 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0483e-05 s, 0.0 kB/s 2023-10-08T00:27:20.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.574 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.630 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0133e-05 s, 0.0 kB/s 2023-10-08T00:27:20.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-08T00:27:20.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.745 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8423e-05 s, 0.0 kB/s 2023-10-08T00:27:20.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.802 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0213e-05 s, 0.0 kB/s 2023-10-08T00:27:20.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.802 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.857 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.451e-05 s, 0.0 kB/s 2023-10-08T00:27:20.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.858 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.913 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.914 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.914 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0789e-05 s, 0.0 kB/s 2023-10-08T00:27:20.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.914 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:20.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:20.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:20.971 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1037e-05 s, 0.0 kB/s 2023-10-08T00:27:20.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:20.972 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.027 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.027 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.027 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2267e-05 s, 0.0 kB/s 2023-10-08T00:27:21.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.028 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.083 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.083 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.083 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1271e-05 s, 0.0 kB/s 2023-10-08T00:27:21.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.084 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.139 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.139 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.139 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2758e-05 s, 0.0 kB/s 2023-10-08T00:27:21.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.139 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.195 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8488e-05 s, 0.0 kB/s 2023-10-08T00:27:21.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.195 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.251 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9707e-05 s, 0.0 kB/s 2023-10-08T00:27:21.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.306 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.307 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2994e-05 s, 0.0 kB/s 2023-10-08T00:27:21.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.307 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.362 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.362 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.362 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1231e-05 s, 0.0 kB/s 2023-10-08T00:27:21.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.363 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.418 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.418 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.418 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8114e-05 s, 0.0 kB/s 2023-10-08T00:27:21.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.418 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9554e-05 s, 0.0 kB/s 2023-10-08T00:27:21.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.474 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.530 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0579e-05 s, 0.0 kB/s 2023-10-08T00:27:21.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.586 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.586 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8366e-05 s, 0.0 kB/s 2023-10-08T00:27:21.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.586 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.642 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.642 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.642 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-08T00:27:21.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.697 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.917e-05 s, 0.0 kB/s 2023-10-08T00:27:21.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.698 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.754 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.754 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2975e-05 s, 0.0 kB/s 2023-10-08T00:27:21.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1529e-05 s, 0.0 kB/s 2023-10-08T00:27:21.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.811 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.3189e-05 s, 0.0 kB/s 2023-10-08T00:27:21.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.867 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.924 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2041e-05 s, 0.0 kB/s 2023-10-08T00:27:21.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:21.980 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:21.980 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:21.980 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.471e-05 s, 0.0 kB/s 2023-10-08T00:27:21.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:21.981 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.036 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4648e-05 s, 0.0 kB/s 2023-10-08T00:27:22.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.037 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.092 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3636e-05 s, 0.0 kB/s 2023-10-08T00:27:22.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.093 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0345e-05 s, 0.0 kB/s 2023-10-08T00:27:22.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.205 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.206 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.206 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3024e-05 s, 0.0 kB/s 2023-10-08T00:27:22.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.206 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.263 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8582e-05 s, 0.0 kB/s 2023-10-08T00:27:22.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.263 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.319 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2393e-05 s, 0.0 kB/s 2023-10-08T00:27:22.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.319 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.375 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1026e-05 s, 0.0 kB/s 2023-10-08T00:27:22.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.375 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.430 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0828e-05 s, 0.0 kB/s 2023-10-08T00:27:22.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.431 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.489 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.489 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.489 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1365e-05 s, 0.0 kB/s 2023-10-08T00:27:22.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.545 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.545 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.545 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3238e-05 s, 0.0 kB/s 2023-10-08T00:27:22.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.545 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2199e-05 s, 0.0 kB/s 2023-10-08T00:27:22.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.602 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.657 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.657 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.657 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.171e-05 s, 0.0 kB/s 2023-10-08T00:27:22.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.658 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9682e-05 s, 0.0 kB/s 2023-10-08T00:27:22.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.714 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.769 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1941e-05 s, 0.0 kB/s 2023-10-08T00:27:22.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.769 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.825 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9491e-05 s, 0.0 kB/s 2023-10-08T00:27:22.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.826 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.882 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.882 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.882 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1874e-05 s, 0.0 kB/s 2023-10-08T00:27:22.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.882 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.939 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1888e-05 s, 0.0 kB/s 2023-10-08T00:27:22.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.940 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:22.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:22.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:22.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-08T00:27:22.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:22.995 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1003e-05 s, 0.0 kB/s 2023-10-08T00:27:23.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.052 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3732e-05 s, 0.0 kB/s 2023-10-08T00:27:23.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.107 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.163 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.06e-05 s, 0.0 kB/s 2023-10-08T00:27:23.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.163 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.219 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1358e-05 s, 0.0 kB/s 2023-10-08T00:27:23.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.219 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1385e-05 s, 0.0 kB/s 2023-10-08T00:27:23.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.276 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1225e-05 s, 0.0 kB/s 2023-10-08T00:27:23.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.388 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8001e-05 s, 0.0 kB/s 2023-10-08T00:27:23.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.388 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.443 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.7517e-05 s, 0.0 kB/s 2023-10-08T00:27:23.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.444 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-08T00:27:23.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.500 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.555 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3154e-05 s, 0.0 kB/s 2023-10-08T00:27:23.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.611 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0005e-05 s, 0.0 kB/s 2023-10-08T00:27:23.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.667 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.099e-05 s, 0.0 kB/s 2023-10-08T00:27:23.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.667 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.253e-05 s, 0.0 kB/s 2023-10-08T00:27:23.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.724 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.779 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0764e-05 s, 0.0 kB/s 2023-10-08T00:27:23.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.779 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.835 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7774e-05 s, 0.0 kB/s 2023-10-08T00:27:23.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1684e-05 s, 0.0 kB/s 2023-10-08T00:27:23.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.891 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3371e-05 s, 0.0 kB/s 2023-10-08T00:27:23.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:23.948 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0687e-05 s, 0.0 kB/s 2023-10-08T00:27:24.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.003 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-08T00:27:24.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.059 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.114 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.115 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0786e-05 s, 0.0 kB/s 2023-10-08T00:27:24.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.115 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.170 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.171 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.171 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2251e-05 s, 0.0 kB/s 2023-10-08T00:27:24.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.171 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.227 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.227 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.227 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0714e-05 s, 0.0 kB/s 2023-10-08T00:27:24.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.228 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.283 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.7875e-05 s, 0.0 kB/s 2023-10-08T00:27:24.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.284 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.339 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.339 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.339 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.387e-05 s, 0.0 kB/s 2023-10-08T00:27:24.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.339 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.395 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.395 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.395 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1242e-05 s, 0.0 kB/s 2023-10-08T00:27:24.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.396 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.451 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.451 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4073e-05 s, 0.0 kB/s 2023-10-08T00:27:24.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.452 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.507 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2159e-05 s, 0.0 kB/s 2023-10-08T00:27:24.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.564 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.564 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.564 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0942e-05 s, 0.0 kB/s 2023-10-08T00:27:24.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.565 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.621 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3389e-05 s, 0.0 kB/s 2023-10-08T00:27:24.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.621 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.237e-05 s, 0.0 kB/s 2023-10-08T00:27:24.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.677 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.731 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.732 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1342e-05 s, 0.0 kB/s 2023-10-08T00:27:24.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.732 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.789 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4449e-05 s, 0.0 kB/s 2023-10-08T00:27:24.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.845 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0814e-05 s, 0.0 kB/s 2023-10-08T00:27:24.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.845 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2015e-05 s, 0.0 kB/s 2023-10-08T00:27:24.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.901 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0186e-05 s, 0.0 kB/s 2023-10-08T00:27:24.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:24.958 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.013 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0732e-05 s, 0.0 kB/s 2023-10-08T00:27:25.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.014 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.069 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8527e-05 s, 0.0 kB/s 2023-10-08T00:27:25.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.069 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.125 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-08T00:27:25.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.125 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.181 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.181 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.181 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9516e-05 s, 0.0 kB/s 2023-10-08T00:27:25.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.182 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1621e-05 s, 0.0 kB/s 2023-10-08T00:27:25.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.237 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.293 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.293 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9741e-05 s, 0.0 kB/s 2023-10-08T00:27:25.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.293 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.349 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-08T00:27:25.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.349 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.405 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9538e-05 s, 0.0 kB/s 2023-10-08T00:27:25.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.406 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.461 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.461 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.461 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0636e-05 s, 0.0 kB/s 2023-10-08T00:27:25.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.461 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.517 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1191e-05 s, 0.0 kB/s 2023-10-08T00:27:25.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.517 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.573 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9548e-05 s, 0.0 kB/s 2023-10-08T00:27:25.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.573 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.629 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1308e-05 s, 0.0 kB/s 2023-10-08T00:27:25.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.629 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0886e-05 s, 0.0 kB/s 2023-10-08T00:27:25.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.686 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.178e-05 s, 0.0 kB/s 2023-10-08T00:27:25.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.742 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.797 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0856e-05 s, 0.0 kB/s 2023-10-08T00:27:25.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.798 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.853 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.853 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.853 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-08T00:27:25.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.853 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.909 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2931e-05 s, 0.0 kB/s 2023-10-08T00:27:25.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.910 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5135e-05 s, 0.0 kB/s 2023-10-08T00:27:25.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:25.966 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.022 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1369e-05 s, 0.0 kB/s 2023-10-08T00:27:26.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.022 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.078 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2944e-05 s, 0.0 kB/s 2023-10-08T00:27:26.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.134 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0906e-05 s, 0.0 kB/s 2023-10-08T00:27:26.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.135 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1294e-05 s, 0.0 kB/s 2023-10-08T00:27:26.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.191 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.246 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0581e-05 s, 0.0 kB/s 2023-10-08T00:27:26.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.247 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.302 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.302 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.302 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.7656e-05 s, 0.0 kB/s 2023-10-08T00:27:26.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.303 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.358 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2186e-05 s, 0.0 kB/s 2023-10-08T00:27:26.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.359 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.414 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0803e-05 s, 0.0 kB/s 2023-10-08T00:27:26.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.415 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.470 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.470 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.471 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0393e-05 s, 0.0 kB/s 2023-10-08T00:27:26.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.471 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.526 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.526 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.526 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2231e-05 s, 0.0 kB/s 2023-10-08T00:27:26.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.526 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1612e-05 s, 0.0 kB/s 2023-10-08T00:27:26.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.583 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9916e-05 s, 0.0 kB/s 2023-10-08T00:27:26.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.639 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.694 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.212e-05 s, 0.0 kB/s 2023-10-08T00:27:26.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.749 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.750 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0991e-05 s, 0.0 kB/s 2023-10-08T00:27:26.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.750 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.806 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3852e-05 s, 0.0 kB/s 2023-10-08T00:27:26.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.807 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.862 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2119e-05 s, 0.0 kB/s 2023-10-08T00:27:26.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8961e-05 s, 0.0 kB/s 2023-10-08T00:27:26.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.918 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:26.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:26.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:26.975 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1921e-05 s, 0.0 kB/s 2023-10-08T00:27:26.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:26.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.031 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1473e-05 s, 0.0 kB/s 2023-10-08T00:27:27.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.031 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.087 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1214e-05 s, 0.0 kB/s 2023-10-08T00:27:27.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.087 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.143 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3302e-05 s, 0.0 kB/s 2023-10-08T00:27:27.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.144 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.199 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2198e-05 s, 0.0 kB/s 2023-10-08T00:27:27.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.199 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.255 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2185e-05 s, 0.0 kB/s 2023-10-08T00:27:27.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.255 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0849e-05 s, 0.0 kB/s 2023-10-08T00:27:27.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.312 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.367 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3217e-05 s, 0.0 kB/s 2023-10-08T00:27:27.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.367 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.425 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.3815e-05 s, 0.0 kB/s 2023-10-08T00:27:27.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.425 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.481 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0647e-05 s, 0.0 kB/s 2023-10-08T00:27:27.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.482 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.538 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.539 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.539 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9569e-05 s, 0.0 kB/s 2023-10-08T00:27:27.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.540 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1132e-05 s, 0.0 kB/s 2023-10-08T00:27:27.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.595 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.651 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1552e-05 s, 0.0 kB/s 2023-10-08T00:27:27.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.652 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.709 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.709 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.413e-05 s, 0.0 kB/s 2023-10-08T00:27:27.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.709 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.764 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1058e-05 s, 0.0 kB/s 2023-10-08T00:27:27.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.765 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.820 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4688e-05 s, 0.0 kB/s 2023-10-08T00:27:27.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.821 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3423e-05 s, 0.0 kB/s 2023-10-08T00:27:27.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.932 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.932 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.932 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.066e-05 s, 0.0 kB/s 2023-10-08T00:27:27.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.932 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:27.988 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:27.988 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:27.988 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1492e-05 s, 0.0 kB/s 2023-10-08T00:27:27.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:27.989 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.044 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.044 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.044 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1784e-05 s, 0.0 kB/s 2023-10-08T00:27:28.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.045 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2221e-05 s, 0.0 kB/s 2023-10-08T00:27:28.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.100 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.157 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0652e-05 s, 0.0 kB/s 2023-10-08T00:27:28.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.157 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.212 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1104e-05 s, 0.0 kB/s 2023-10-08T00:27:28.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.391e-05 s, 0.0 kB/s 2023-10-08T00:27:28.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.268 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.324 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0331e-05 s, 0.0 kB/s 2023-10-08T00:27:28.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.325 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0715e-05 s, 0.0 kB/s 2023-10-08T00:27:28.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.380 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.436 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.436 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.436 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-08T00:27:28.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.436 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1788e-05 s, 0.0 kB/s 2023-10-08T00:27:28.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.493 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0015e-05 s, 0.0 kB/s 2023-10-08T00:27:28.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.548 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.607 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0349e-05 s, 0.0 kB/s 2023-10-08T00:27:28.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.607 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0351e-05 s, 0.0 kB/s 2023-10-08T00:27:28.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.663 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.719 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8209e-05 s, 0.0 kB/s 2023-10-08T00:27:28.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.719 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.775 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0627e-05 s, 0.0 kB/s 2023-10-08T00:27:28.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.775 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.832 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9682e-05 s, 0.0 kB/s 2023-10-08T00:27:28.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.832 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.887 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9757e-05 s, 0.0 kB/s 2023-10-08T00:27:28.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.888 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:28.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:28.943 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1527e-05 s, 0.0 kB/s 2023-10-08T00:27:28.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:28.943 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:28.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0117e-05 s, 0.0 kB/s 2023-10-08T00:27:29.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.000 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.057 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.057 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.057 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8495e-05 s, 0.0 kB/s 2023-10-08T00:27:29.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.058 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.112 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.113 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.113 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0498e-05 s, 0.0 kB/s 2023-10-08T00:27:29.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.113 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.169 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.169 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.169 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.946e-05 s, 0.0 kB/s 2023-10-08T00:27:29.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.169 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.225 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.225 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.225 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.463e-05 s, 0.0 kB/s 2023-10-08T00:27:29.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.225 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.281 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1973e-05 s, 0.0 kB/s 2023-10-08T00:27:29.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.281 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.337 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0198e-05 s, 0.0 kB/s 2023-10-08T00:27:29.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.337 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.393 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9915e-05 s, 0.0 kB/s 2023-10-08T00:27:29.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.393 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.449 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4186e-05 s, 0.0 kB/s 2023-10-08T00:27:29.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.449 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.505 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.505 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.506 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.07e-05 s, 0.0 kB/s 2023-10-08T00:27:29.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.506 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.561 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.561 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.561 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1976e-05 s, 0.0 kB/s 2023-10-08T00:27:29.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.561 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.617 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.618 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.618 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2718e-05 s, 0.0 kB/s 2023-10-08T00:27:29.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.618 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.674 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3272e-05 s, 0.0 kB/s 2023-10-08T00:27:29.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.674 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.730 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2628e-05 s, 0.0 kB/s 2023-10-08T00:27:29.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.731 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.785 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.786 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.786 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0017e-05 s, 0.0 kB/s 2023-10-08T00:27:29.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.786 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.842 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.842 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.842 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4145e-05 s, 0.0 kB/s 2023-10-08T00:27:29.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.842 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.899 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.899 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.899 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9522e-05 s, 0.0 kB/s 2023-10-08T00:27:29.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.899 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:29.955 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.307e-05 s, 0.0 kB/s 2023-10-08T00:27:29.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:29.956 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.011 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2468e-05 s, 0.0 kB/s 2023-10-08T00:27:30.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.012 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0551e-05 s, 0.0 kB/s 2023-10-08T00:27:30.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.069 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3741e-05 s, 0.0 kB/s 2023-10-08T00:27:30.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.126 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.181 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.181 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.181 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1078e-05 s, 0.0 kB/s 2023-10-08T00:27:30.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.182 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3278e-05 s, 0.0 kB/s 2023-10-08T00:27:30.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.238 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.294 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.294 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.294 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0246e-05 s, 0.0 kB/s 2023-10-08T00:27:30.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-08T00:27:30.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.350 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.405 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1042e-05 s, 0.0 kB/s 2023-10-08T00:27:30.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.406 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1541e-05 s, 0.0 kB/s 2023-10-08T00:27:30.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.463 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0687e-05 s, 0.0 kB/s 2023-10-08T00:27:30.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.518 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9654e-05 s, 0.0 kB/s 2023-10-08T00:27:30.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3279e-05 s, 0.0 kB/s 2023-10-08T00:27:30.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3315e-05 s, 0.0 kB/s 2023-10-08T00:27:30.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.689 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9564e-05 s, 0.0 kB/s 2023-10-08T00:27:30.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.800 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.297e-05 s, 0.0 kB/s 2023-10-08T00:27:30.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1178e-05 s, 0.0 kB/s 2023-10-08T00:27:30.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.857 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.912 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2593e-05 s, 0.0 kB/s 2023-10-08T00:27:30.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.912 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:30.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:27:30.955 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:27:30.968 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:30.968 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:30.968 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9668e-05 s, 0.0 kB/s 2023-10-08T00:27:30.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:30.969 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.025 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0263e-05 s, 0.0 kB/s 2023-10-08T00:27:31.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.025 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.081 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.081 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.081 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3059e-05 s, 0.0 kB/s 2023-10-08T00:27:31.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.081 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.137 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9655e-05 s, 0.0 kB/s 2023-10-08T00:27:31.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.137 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.402e-05 s, 0.0 kB/s 2023-10-08T00:27:31.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.219 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.275 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4089e-05 s, 0.0 kB/s 2023-10-08T00:27:31.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.275 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1734e-05 s, 0.0 kB/s 2023-10-08T00:27:31.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4103e-05 s, 0.0 kB/s 2023-10-08T00:27:31.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.443 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0192e-05 s, 0.0 kB/s 2023-10-08T00:27:31.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.443 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.098e-05 s, 0.0 kB/s 2023-10-08T00:27:31.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.555 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-08T00:27:31.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1424e-05 s, 0.0 kB/s 2023-10-08T00:27:31.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.667 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0164e-05 s, 0.0 kB/s 2023-10-08T00:27:31.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.668 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.723 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2039e-05 s, 0.0 kB/s 2023-10-08T00:27:31.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.723 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.779 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.143e-05 s, 0.0 kB/s 2023-10-08T00:27:31.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.780 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.292e-05 s, 0.0 kB/s 2023-10-08T00:27:31.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-08T00:27:31.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.892 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:31.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:31.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:31.948 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9656e-05 s, 0.0 kB/s 2023-10-08T00:27:31.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:31.948 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.004 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.004 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.004 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0989e-05 s, 0.0 kB/s 2023-10-08T00:27:32.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.005 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.060 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.916e-05 s, 0.0 kB/s 2023-10-08T00:27:32.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.061 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.116 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0905e-05 s, 0.0 kB/s 2023-10-08T00:27:32.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.116 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3058e-05 s, 0.0 kB/s 2023-10-08T00:27:32.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.173 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.228 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.8897e-05 s, 0.0 kB/s 2023-10-08T00:27:32.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.228 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0419e-05 s, 0.0 kB/s 2023-10-08T00:27:32.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.284 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.339 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.340 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8927e-05 s, 0.0 kB/s 2023-10-08T00:27:32.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.340 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.396 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4116e-05 s, 0.0 kB/s 2023-10-08T00:27:32.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.452 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1525e-05 s, 0.0 kB/s 2023-10-08T00:27:32.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.452 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.508 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.508 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.508 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3119e-05 s, 0.0 kB/s 2023-10-08T00:27:32.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.564 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.564 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2698e-05 s, 0.0 kB/s 2023-10-08T00:27:32.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.564 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.620 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1308e-05 s, 0.0 kB/s 2023-10-08T00:27:32.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.676 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0852e-05 s, 0.0 kB/s 2023-10-08T00:27:32.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.676 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.119e-05 s, 0.0 kB/s 2023-10-08T00:27:32.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.732 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0437e-05 s, 0.0 kB/s 2023-10-08T00:27:32.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.788 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0436e-05 s, 0.0 kB/s 2023-10-08T00:27:32.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.845 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.900 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.900 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.901 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2428e-05 s, 0.0 kB/s 2023-10-08T00:27:32.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.901 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:32.956 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:32.956 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:32.956 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1423e-05 s, 0.0 kB/s 2023-10-08T00:27:32.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:32.957 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.012 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.012 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.012 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.083e-05 s, 0.0 kB/s 2023-10-08T00:27:33.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.012 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.068 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0056e-05 s, 0.0 kB/s 2023-10-08T00:27:33.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.069 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.124 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.124 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.124 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-08T00:27:33.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.124 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.180 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3279e-05 s, 0.0 kB/s 2023-10-08T00:27:33.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.181 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.236 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0052e-05 s, 0.0 kB/s 2023-10-08T00:27:33.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.236 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.292 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0297e-05 s, 0.0 kB/s 2023-10-08T00:27:33.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.292 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1437e-05 s, 0.0 kB/s 2023-10-08T00:27:33.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.349 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.405 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.432e-05 s, 0.0 kB/s 2023-10-08T00:27:33.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.405 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.461 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.461 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9983e-05 s, 0.0 kB/s 2023-10-08T00:27:33.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.461 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.517 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0765e-05 s, 0.0 kB/s 2023-10-08T00:27:33.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.517 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.573 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2687e-05 s, 0.0 kB/s 2023-10-08T00:27:33.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.574 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.628 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.628 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.628 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1393e-05 s, 0.0 kB/s 2023-10-08T00:27:33.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.629 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0561e-05 s, 0.0 kB/s 2023-10-08T00:27:33.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.748 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.748 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.748 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2922e-05 s, 0.0 kB/s 2023-10-08T00:27:33.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.749 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.814 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3714e-05 s, 0.0 kB/s 2023-10-08T00:27:33.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.815 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0322e-05 s, 0.0 kB/s 2023-10-08T00:27:33.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.873 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2531e-05 s, 0.0 kB/s 2023-10-08T00:27:33.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.931 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:33.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:33.991 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1767e-05 s, 0.0 kB/s 2023-10-08T00:27:33.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:33.991 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.049 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2333e-05 s, 0.0 kB/s 2023-10-08T00:27:34.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.049 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.107 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0499e-05 s, 0.0 kB/s 2023-10-08T00:27:34.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.108 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.164 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9661e-05 s, 0.0 kB/s 2023-10-08T00:27:34.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.165 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.221 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.181e-05 s, 0.0 kB/s 2023-10-08T00:27:34.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.221 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.278 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1241e-05 s, 0.0 kB/s 2023-10-08T00:27:34.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.278 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.334 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.334 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.334 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 5.0728e-05 s, 0.0 kB/s 2023-10-08T00:27:34.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.335 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.391 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0907e-05 s, 0.0 kB/s 2023-10-08T00:27:34.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.392 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.448 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.448 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8331e-05 s, 0.0 kB/s 2023-10-08T00:27:34.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.448 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4498e-05 s, 0.0 kB/s 2023-10-08T00:27:34.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.504 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.560 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.560 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.560 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9337e-05 s, 0.0 kB/s 2023-10-08T00:27:34.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.560 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.616 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.616 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.616 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3069e-05 s, 0.0 kB/s 2023-10-08T00:27:34.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.617 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.672 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.672 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.672 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1039e-05 s, 0.0 kB/s 2023-10-08T00:27:34.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.672 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.728 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.728 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.728 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3342e-05 s, 0.0 kB/s 2023-10-08T00:27:34.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.728 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.784 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.784 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.784 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2375e-05 s, 0.0 kB/s 2023-10-08T00:27:34.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.784 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.840 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.840 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.840 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8296e-05 s, 0.0 kB/s 2023-10-08T00:27:34.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.841 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2945e-05 s, 0.0 kB/s 2023-10-08T00:27:34.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.896 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:34.952 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:34.952 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1664e-05 s, 0.0 kB/s 2023-10-08T00:27:34.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:34.952 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.008 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.364e-05 s, 0.0 kB/s 2023-10-08T00:27:35.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.009 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.064 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2291e-05 s, 0.0 kB/s 2023-10-08T00:27:35.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.064 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.120 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.120 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.120 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9847e-05 s, 0.0 kB/s 2023-10-08T00:27:35.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.121 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.176 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.176 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.176 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0618e-05 s, 0.0 kB/s 2023-10-08T00:27:35.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.177 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.232 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.232 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0965e-05 s, 0.0 kB/s 2023-10-08T00:27:35.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.232 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.288 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.288 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-08T00:27:35.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.344 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.977e-05 s, 0.0 kB/s 2023-10-08T00:27:35.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.400 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0191e-05 s, 0.0 kB/s 2023-10-08T00:27:35.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.456 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8993e-05 s, 0.0 kB/s 2023-10-08T00:27:35.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.456 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.512 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.897e-05 s, 0.0 kB/s 2023-10-08T00:27:35.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.568 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.568 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.568 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8664e-05 s, 0.0 kB/s 2023-10-08T00:27:35.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.568 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.624 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.624 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.624 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0345e-05 s, 0.0 kB/s 2023-10-08T00:27:35.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2622e-05 s, 0.0 kB/s 2023-10-08T00:27:35.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.681 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.737 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2459e-05 s, 0.0 kB/s 2023-10-08T00:27:35.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.737 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.793 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2769e-05 s, 0.0 kB/s 2023-10-08T00:27:35.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.793 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0276e-05 s, 0.0 kB/s 2023-10-08T00:27:35.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.850 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9771e-05 s, 0.0 kB/s 2023-10-08T00:27:35.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.906 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:35.962 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:35.962 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:35.962 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0727e-05 s, 0.0 kB/s 2023-10-08T00:27:35.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:35.962 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.018 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.018 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.018 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9824e-05 s, 0.0 kB/s 2023-10-08T00:27:36.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2879e-05 s, 0.0 kB/s 2023-10-08T00:27:36.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.074 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1194e-05 s, 0.0 kB/s 2023-10-08T00:27:36.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.131 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.7548e-05 s, 0.0 kB/s 2023-10-08T00:27:36.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.186 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.242 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3091e-05 s, 0.0 kB/s 2023-10-08T00:27:36.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.242 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.298 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8451e-05 s, 0.0 kB/s 2023-10-08T00:27:36.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.298 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0584e-05 s, 0.0 kB/s 2023-10-08T00:27:36.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.353 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.409 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.409 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.409 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-08T00:27:36.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.409 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.465 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9815e-05 s, 0.0 kB/s 2023-10-08T00:27:36.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.465 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.521 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.521 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.521 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1505e-05 s, 0.0 kB/s 2023-10-08T00:27:36.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.522 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1454e-05 s, 0.0 kB/s 2023-10-08T00:27:36.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.578 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9553e-05 s, 0.0 kB/s 2023-10-08T00:27:36.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.634 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.689 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.689 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.689 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9902e-05 s, 0.0 kB/s 2023-10-08T00:27:36.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.690 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.745 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2938e-05 s, 0.0 kB/s 2023-10-08T00:27:36.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.801 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6604e-05 s, 0.0 kB/s 2023-10-08T00:27:36.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.802 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.857 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-08T00:27:36.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.859 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.915 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4672e-05 s, 0.0 kB/s 2023-10-08T00:27:36.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.916 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:36.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:36.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:36.971 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1236e-05 s, 0.0 kB/s 2023-10-08T00:27:36.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:36.971 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0626e-05 s, 0.0 kB/s 2023-10-08T00:27:37.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.028 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.083 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.083 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.083 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1684e-05 s, 0.0 kB/s 2023-10-08T00:27:37.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.083 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.139 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.140 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-08T00:27:37.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.140 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.195 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1382e-05 s, 0.0 kB/s 2023-10-08T00:27:37.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.195 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.251 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9385e-05 s, 0.0 kB/s 2023-10-08T00:27:37.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.306 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.306 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.306 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9832e-05 s, 0.0 kB/s 2023-10-08T00:27:37.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.307 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.363 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.047e-05 s, 0.0 kB/s 2023-10-08T00:27:37.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.363 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-08T00:27:37.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.420 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.475 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2586e-05 s, 0.0 kB/s 2023-10-08T00:27:37.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.475 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.531 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.531 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.531 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9581e-05 s, 0.0 kB/s 2023-10-08T00:27:37.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.531 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.586 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.586 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.587 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.089e-05 s, 0.0 kB/s 2023-10-08T00:27:37.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.588 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1308e-05 s, 0.0 kB/s 2023-10-08T00:27:37.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.643 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.699 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9504e-05 s, 0.0 kB/s 2023-10-08T00:27:37.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.699 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3991e-05 s, 0.0 kB/s 2023-10-08T00:27:37.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.756 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-08T00:27:37.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1698e-05 s, 0.0 kB/s 2023-10-08T00:27:37.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3911e-05 s, 0.0 kB/s 2023-10-08T00:27:37.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:37.978 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1099e-05 s, 0.0 kB/s 2023-10-08T00:27:37.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:37.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.036 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.42e-05 s, 0.0 kB/s 2023-10-08T00:27:38.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2993e-05 s, 0.0 kB/s 2023-10-08T00:27:38.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.092 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2579e-05 s, 0.0 kB/s 2023-10-08T00:27:38.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.204 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1248e-05 s, 0.0 kB/s 2023-10-08T00:27:38.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.205 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.260 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1193e-05 s, 0.0 kB/s 2023-10-08T00:27:38.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.261 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.317 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-08T00:27:38.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.318 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-08T00:27:38.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.374 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.430 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.208e-05 s, 0.0 kB/s 2023-10-08T00:27:38.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.431 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.486 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9638e-05 s, 0.0 kB/s 2023-10-08T00:27:38.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.487 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.542 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1155e-05 s, 0.0 kB/s 2023-10-08T00:27:38.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.543 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1713e-05 s, 0.0 kB/s 2023-10-08T00:27:38.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.599 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0973e-05 s, 0.0 kB/s 2023-10-08T00:27:38.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.710 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.710 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.710 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6268e-05 s, 0.0 kB/s 2023-10-08T00:27:38.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.711 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0729e-05 s, 0.0 kB/s 2023-10-08T00:27:38.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.767 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8436e-05 s, 0.0 kB/s 2023-10-08T00:27:38.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.823 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.878 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.878 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.878 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0983e-05 s, 0.0 kB/s 2023-10-08T00:27:38.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.878 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.934 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9816e-05 s, 0.0 kB/s 2023-10-08T00:27:38.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.935 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:38.989 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:38.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:38.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1557e-05 s, 0.0 kB/s 2023-10-08T00:27:38.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:38.990 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0316e-05 s, 0.0 kB/s 2023-10-08T00:27:39.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.101 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.102 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1063e-05 s, 0.0 kB/s 2023-10-08T00:27:39.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.102 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1777e-05 s, 0.0 kB/s 2023-10-08T00:27:39.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.159 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.214 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6932e-05 s, 0.0 kB/s 2023-10-08T00:27:39.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.214 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.270 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1777e-05 s, 0.0 kB/s 2023-10-08T00:27:39.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.270 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.326 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9319e-05 s, 0.0 kB/s 2023-10-08T00:27:39.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.326 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.382 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2137e-05 s, 0.0 kB/s 2023-10-08T00:27:39.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.382 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.438 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0029e-05 s, 0.0 kB/s 2023-10-08T00:27:39.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.438 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0457e-05 s, 0.0 kB/s 2023-10-08T00:27:39.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.497 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.552 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.552 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-08T00:27:39.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.608 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1189e-05 s, 0.0 kB/s 2023-10-08T00:27:39.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.609 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2013e-05 s, 0.0 kB/s 2023-10-08T00:27:39.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.665 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.720 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0468e-05 s, 0.0 kB/s 2023-10-08T00:27:39.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.721 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.776 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4069e-05 s, 0.0 kB/s 2023-10-08T00:27:39.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.777 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.833 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.834 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.834 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0225e-05 s, 0.0 kB/s 2023-10-08T00:27:39.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.834 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.890 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.890 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.890 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-08T00:27:39.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.891 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4272e-05 s, 0.0 kB/s 2023-10-08T00:27:39.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:39.947 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.001 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.001 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.002 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3739e-05 s, 0.0 kB/s 2023-10-08T00:27:40.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.003 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.060 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3511e-05 s, 0.0 kB/s 2023-10-08T00:27:40.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.007e-05 s, 0.0 kB/s 2023-10-08T00:27:40.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.116 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.172 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1554e-05 s, 0.0 kB/s 2023-10-08T00:27:40.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.172 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2333e-05 s, 0.0 kB/s 2023-10-08T00:27:40.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.229 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.943e-05 s, 0.0 kB/s 2023-10-08T00:27:40.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.285 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.339 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.340 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2233e-05 s, 0.0 kB/s 2023-10-08T00:27:40.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.341 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0346e-05 s, 0.0 kB/s 2023-10-08T00:27:40.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.398 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.453 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.938e-05 s, 0.0 kB/s 2023-10-08T00:27:40.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.454 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.509 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0653e-05 s, 0.0 kB/s 2023-10-08T00:27:40.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.510 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2414e-05 s, 0.0 kB/s 2023-10-08T00:27:40.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.566 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.621 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2088e-05 s, 0.0 kB/s 2023-10-08T00:27:40.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.622 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.678 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-08T00:27:40.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.679 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.734 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3495e-05 s, 0.0 kB/s 2023-10-08T00:27:40.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.734 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.790 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9747e-05 s, 0.0 kB/s 2023-10-08T00:27:40.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.847 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4511e-05 s, 0.0 kB/s 2023-10-08T00:27:40.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.848 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1429e-05 s, 0.0 kB/s 2023-10-08T00:27:40.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.903 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:40.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:40.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:40.959 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.7928e-05 s, 0.0 kB/s 2023-10-08T00:27:40.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:40.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.015 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3133e-05 s, 0.0 kB/s 2023-10-08T00:27:41.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3661e-05 s, 0.0 kB/s 2023-10-08T00:27:41.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.072 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.127 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3476e-05 s, 0.0 kB/s 2023-10-08T00:27:41.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.127 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.149e-05 s, 0.0 kB/s 2023-10-08T00:27:41.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.239 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.239 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.239 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0786e-05 s, 0.0 kB/s 2023-10-08T00:27:41.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.239 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1049e-05 s, 0.0 kB/s 2023-10-08T00:27:41.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.351 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3676e-05 s, 0.0 kB/s 2023-10-08T00:27:41.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.351 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9605e-05 s, 0.0 kB/s 2023-10-08T00:27:41.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.407 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.463 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1777e-05 s, 0.0 kB/s 2023-10-08T00:27:41.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.519 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2591e-05 s, 0.0 kB/s 2023-10-08T00:27:41.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2416e-05 s, 0.0 kB/s 2023-10-08T00:27:41.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3898e-05 s, 0.0 kB/s 2023-10-08T00:27:41.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2783e-05 s, 0.0 kB/s 2023-10-08T00:27:41.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.743 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1101e-05 s, 0.0 kB/s 2023-10-08T00:27:41.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.744 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2737e-05 s, 0.0 kB/s 2023-10-08T00:27:41.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.800 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.855 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3651e-05 s, 0.0 kB/s 2023-10-08T00:27:41.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.855 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.910 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.911 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9184e-05 s, 0.0 kB/s 2023-10-08T00:27:41.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.911 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8543e-05 s, 0.0 kB/s 2023-10-08T00:27:41.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:41.967 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0922e-05 s, 0.0 kB/s 2023-10-08T00:27:42.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.023 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.078 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.079 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1548e-05 s, 0.0 kB/s 2023-10-08T00:27:42.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.135 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0653e-05 s, 0.0 kB/s 2023-10-08T00:27:42.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.135 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.192 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.193 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.193 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5815e-05 s, 0.0 kB/s 2023-10-08T00:27:42.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.193 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.355e-05 s, 0.0 kB/s 2023-10-08T00:27:42.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.250 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.305 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2649e-05 s, 0.0 kB/s 2023-10-08T00:27:42.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.305 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.361 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.361 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.362 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4533e-05 s, 0.0 kB/s 2023-10-08T00:27:42.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.362 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.417 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.417 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.417 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-08T00:27:42.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.418 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.473 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1998e-05 s, 0.0 kB/s 2023-10-08T00:27:42.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.473 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2109e-05 s, 0.0 kB/s 2023-10-08T00:27:42.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.585 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0714e-05 s, 0.0 kB/s 2023-10-08T00:27:42.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.586 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.641 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3346e-05 s, 0.0 kB/s 2023-10-08T00:27:42.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.697 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.9381e-05 s, 0.0 kB/s 2023-10-08T00:27:42.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.698 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.101e-05 s, 0.0 kB/s 2023-10-08T00:27:42.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.753 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.809 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0829e-05 s, 0.0 kB/s 2023-10-08T00:27:42.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.809 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.864 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.865 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.865 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2257e-05 s, 0.0 kB/s 2023-10-08T00:27:42.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.866 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.922 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2195e-05 s, 0.0 kB/s 2023-10-08T00:27:42.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.922 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:42.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:42.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:42.978 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.7215e-05 s, 0.0 kB/s 2023-10-08T00:27:42.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:42.978 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9639e-05 s, 0.0 kB/s 2023-10-08T00:27:43.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.035 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.090 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-08T00:27:43.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.090 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.146 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8903e-05 s, 0.0 kB/s 2023-10-08T00:27:43.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.146 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.202 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.202 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.202 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3869e-05 s, 0.0 kB/s 2023-10-08T00:27:43.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.203 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.258 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.258 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.258 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9514e-05 s, 0.0 kB/s 2023-10-08T00:27:43.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.259 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.314 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3363e-05 s, 0.0 kB/s 2023-10-08T00:27:43.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.315 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.371 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2172e-05 s, 0.0 kB/s 2023-10-08T00:27:43.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.371 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0172e-05 s, 0.0 kB/s 2023-10-08T00:27:43.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.427 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.482 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9654e-05 s, 0.0 kB/s 2023-10-08T00:27:43.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.483 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.538 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.538 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.538 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9419e-05 s, 0.0 kB/s 2023-10-08T00:27:43.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.538 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3239e-05 s, 0.0 kB/s 2023-10-08T00:27:43.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.595 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9248e-05 s, 0.0 kB/s 2023-10-08T00:27:43.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.651 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2527e-05 s, 0.0 kB/s 2023-10-08T00:27:43.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.708 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.764 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6565e-05 s, 0.0 kB/s 2023-10-08T00:27:43.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.765 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.820 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.416e-05 s, 0.0 kB/s 2023-10-08T00:27:43.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.821 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.877 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.877 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2038e-05 s, 0.0 kB/s 2023-10-08T00:27:43.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.877 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.933 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1676e-05 s, 0.0 kB/s 2023-10-08T00:27:43.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.933 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6777e-05 s, 0.0 kB/s 2023-10-08T00:27:43.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:43.990 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9342e-05 s, 0.0 kB/s 2023-10-08T00:27:44.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.047 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.101 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.102 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4306e-05 s, 0.0 kB/s 2023-10-08T00:27:44.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.159 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3632e-05 s, 0.0 kB/s 2023-10-08T00:27:44.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.159 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.215 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.887e-05 s, 0.0 kB/s 2023-10-08T00:27:44.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.216 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.271 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9399e-05 s, 0.0 kB/s 2023-10-08T00:27:44.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.271 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.327 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1048e-05 s, 0.0 kB/s 2023-10-08T00:27:44.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.383 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1983e-05 s, 0.0 kB/s 2023-10-08T00:27:44.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.383 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.439 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2089e-05 s, 0.0 kB/s 2023-10-08T00:27:44.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.439 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.495 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1863e-05 s, 0.0 kB/s 2023-10-08T00:27:44.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.495 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.551 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1807e-05 s, 0.0 kB/s 2023-10-08T00:27:44.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.551 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.608 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.4015e-05 s, 0.0 kB/s 2023-10-08T00:27:44.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.608 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.663 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2157e-05 s, 0.0 kB/s 2023-10-08T00:27:44.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.663 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.719 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9211e-05 s, 0.0 kB/s 2023-10-08T00:27:44.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.720 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.775 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4361e-05 s, 0.0 kB/s 2023-10-08T00:27:44.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.776 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.831 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1834e-05 s, 0.0 kB/s 2023-10-08T00:27:44.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.832 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.888 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9107e-05 s, 0.0 kB/s 2023-10-08T00:27:44.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.889 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1385e-05 s, 0.0 kB/s 2023-10-08T00:27:44.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:44.945 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.000 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.000 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.000 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1347e-05 s, 0.0 kB/s 2023-10-08T00:27:45.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.001 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.056 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.056 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.056 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9374e-05 s, 0.0 kB/s 2023-10-08T00:27:45.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.056 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8602e-05 s, 0.0 kB/s 2023-10-08T00:27:45.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.112 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1746e-05 s, 0.0 kB/s 2023-10-08T00:27:45.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.168 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.224 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.224 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.224 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8976e-05 s, 0.0 kB/s 2023-10-08T00:27:45.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.225 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3584e-05 s, 0.0 kB/s 2023-10-08T00:27:45.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.281 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.337 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.943e-05 s, 0.0 kB/s 2023-10-08T00:27:45.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.337 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.393 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8102e-05 s, 0.0 kB/s 2023-10-08T00:27:45.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.394 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.449 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0388e-05 s, 0.0 kB/s 2023-10-08T00:27:45.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.450 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.505 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.505 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.505 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1593e-05 s, 0.0 kB/s 2023-10-08T00:27:45.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.505 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.561 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.561 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.561 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9254e-05 s, 0.0 kB/s 2023-10-08T00:27:45.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.561 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0365e-05 s, 0.0 kB/s 2023-10-08T00:27:45.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.619 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.674 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2723e-05 s, 0.0 kB/s 2023-10-08T00:27:45.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.675 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.730 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4279e-05 s, 0.0 kB/s 2023-10-08T00:27:45.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.730 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.786 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.786 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.786 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2691e-05 s, 0.0 kB/s 2023-10-08T00:27:45.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.787 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.842 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2317e-05 s, 0.0 kB/s 2023-10-08T00:27:45.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.843 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.898 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.898 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.898 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9836e-05 s, 0.0 kB/s 2023-10-08T00:27:45.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.898 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-08T00:27:45.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:45.954 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0622e-05 s, 0.0 kB/s 2023-10-08T00:27:46.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.010 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.066 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.066 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.066 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3564e-05 s, 0.0 kB/s 2023-10-08T00:27:46.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.067 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.122 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1955e-05 s, 0.0 kB/s 2023-10-08T00:27:46.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.123 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.179 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2053e-05 s, 0.0 kB/s 2023-10-08T00:27:46.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.179 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.235 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.235 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.235 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2247e-05 s, 0.0 kB/s 2023-10-08T00:27:46.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.236 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.291 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.292 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0594e-05 s, 0.0 kB/s 2023-10-08T00:27:46.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.292 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.346 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.347 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0431e-05 s, 0.0 kB/s 2023-10-08T00:27:46.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.347 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3048e-05 s, 0.0 kB/s 2023-10-08T00:27:46.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.403 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1377e-05 s, 0.0 kB/s 2023-10-08T00:27:46.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.459 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.515 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.515 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.515 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2208e-05 s, 0.0 kB/s 2023-10-08T00:27:46.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.515 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.571 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.571 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.571 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2505e-05 s, 0.0 kB/s 2023-10-08T00:27:46.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.572 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.626 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2202e-05 s, 0.0 kB/s 2023-10-08T00:27:46.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.627 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.683 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0218e-05 s, 0.0 kB/s 2023-10-08T00:27:46.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.683 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.739 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.739 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.739 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9916e-05 s, 0.0 kB/s 2023-10-08T00:27:46.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.740 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4397e-05 s, 0.0 kB/s 2023-10-08T00:27:46.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.796 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.852 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0349e-05 s, 0.0 kB/s 2023-10-08T00:27:46.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.852 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.907 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.018e-05 s, 0.0 kB/s 2023-10-08T00:27:46.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.907 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.089e-05 s, 0.0 kB/s 2023-10-08T00:27:46.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:46.963 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.019 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.019 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.019 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.7479e-05 s, 0.0 kB/s 2023-10-08T00:27:47.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.019 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.075 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.075 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.075 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.917e-05 s, 0.0 kB/s 2023-10-08T00:27:47.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.075 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-08T00:27:47.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.131 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.187 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0026e-05 s, 0.0 kB/s 2023-10-08T00:27:47.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.187 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.244 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1196e-05 s, 0.0 kB/s 2023-10-08T00:27:47.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.244 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1557e-05 s, 0.0 kB/s 2023-10-08T00:27:47.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.300 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.355 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-08T00:27:47.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.411 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1854e-05 s, 0.0 kB/s 2023-10-08T00:27:47.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.412 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.467 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1169e-05 s, 0.0 kB/s 2023-10-08T00:27:47.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.467 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.523 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1464e-05 s, 0.0 kB/s 2023-10-08T00:27:47.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.524 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.580 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.580 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.580 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1201e-05 s, 0.0 kB/s 2023-10-08T00:27:47.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.580 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.636 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.636 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.636 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1243e-05 s, 0.0 kB/s 2023-10-08T00:27:47.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.637 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0565e-05 s, 0.0 kB/s 2023-10-08T00:27:47.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.692 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4004e-05 s, 0.0 kB/s 2023-10-08T00:27:47.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.748 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.804 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.804 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.804 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3403e-05 s, 0.0 kB/s 2023-10-08T00:27:47.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.805 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.861 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1149e-05 s, 0.0 kB/s 2023-10-08T00:27:47.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.917 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.918 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0898e-05 s, 0.0 kB/s 2023-10-08T00:27:47.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.918 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.096e-05 s, 0.0 kB/s 2023-10-08T00:27:47.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:47.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.030 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.030 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.030 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.331e-05 s, 0.0 kB/s 2023-10-08T00:27:48.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.031 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9426e-05 s, 0.0 kB/s 2023-10-08T00:27:48.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.087 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2332e-05 s, 0.0 kB/s 2023-10-08T00:27:48.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.142 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.197 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0805e-05 s, 0.0 kB/s 2023-10-08T00:27:48.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.199 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.254 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.255 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5155e-05 s, 0.0 kB/s 2023-10-08T00:27:48.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.255 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.311 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0754e-05 s, 0.0 kB/s 2023-10-08T00:27:48.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.311 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0043e-05 s, 0.0 kB/s 2023-10-08T00:27:48.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.366 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.422 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.422 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.423 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0306e-05 s, 0.0 kB/s 2023-10-08T00:27:48.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.423 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-08T00:27:48.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.478 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.534 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9621e-05 s, 0.0 kB/s 2023-10-08T00:27:48.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.534 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.590 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1527e-05 s, 0.0 kB/s 2023-10-08T00:27:48.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.591 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2312e-05 s, 0.0 kB/s 2023-10-08T00:27:48.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.647 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.702 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9609e-05 s, 0.0 kB/s 2023-10-08T00:27:48.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.703 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2625e-05 s, 0.0 kB/s 2023-10-08T00:27:48.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.758 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.814 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2877e-05 s, 0.0 kB/s 2023-10-08T00:27:48.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.814 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.870 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.871 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.871 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2849e-05 s, 0.0 kB/s 2023-10-08T00:27:48.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.871 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.927 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9639e-05 s, 0.0 kB/s 2023-10-08T00:27:48.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.928 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:48.983 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:48.983 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:48.983 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1364e-05 s, 0.0 kB/s 2023-10-08T00:27:48.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:48.984 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3893e-05 s, 0.0 kB/s 2023-10-08T00:27:49.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.040 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.095 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.095 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.095 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0402e-05 s, 0.0 kB/s 2023-10-08T00:27:49.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.096 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1835e-05 s, 0.0 kB/s 2023-10-08T00:27:49.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.152 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.207 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.207 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.207 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9674e-05 s, 0.0 kB/s 2023-10-08T00:27:49.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.207 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8959e-05 s, 0.0 kB/s 2023-10-08T00:27:49.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.265 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.324 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9511e-05 s, 0.0 kB/s 2023-10-08T00:27:49.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.325 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0399e-05 s, 0.0 kB/s 2023-10-08T00:27:49.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.445 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0142e-05 s, 0.0 kB/s 2023-10-08T00:27:49.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.446 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.509 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0308e-05 s, 0.0 kB/s 2023-10-08T00:27:49.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1802e-05 s, 0.0 kB/s 2023-10-08T00:27:49.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.566 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9235e-05 s, 0.0 kB/s 2023-10-08T00:27:49.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.623 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.681 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.15e-05 s, 0.0 kB/s 2023-10-08T00:27:49.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.682 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2857e-05 s, 0.0 kB/s 2023-10-08T00:27:49.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.740 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.795 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.795 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.795 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0122e-05 s, 0.0 kB/s 2023-10-08T00:27:49.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.796 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.851 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4024e-05 s, 0.0 kB/s 2023-10-08T00:27:49.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.852 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.907 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.182e-05 s, 0.0 kB/s 2023-10-08T00:27:49.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.907 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3366e-05 s, 0.0 kB/s 2023-10-08T00:27:49.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:49.963 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0798e-05 s, 0.0 kB/s 2023-10-08T00:27:50.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.019 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.075 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.075 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.075 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9321e-05 s, 0.0 kB/s 2023-10-08T00:27:50.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.076 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4549e-05 s, 0.0 kB/s 2023-10-08T00:27:50.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.133 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.187 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0822e-05 s, 0.0 kB/s 2023-10-08T00:27:50.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.187 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.243 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.038e-05 s, 0.0 kB/s 2023-10-08T00:27:50.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.244 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.300 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.300 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.300 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0142e-05 s, 0.0 kB/s 2023-10-08T00:27:50.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.301 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.356 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.356 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.356 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0931e-05 s, 0.0 kB/s 2023-10-08T00:27:50.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.357 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.412 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0089e-05 s, 0.0 kB/s 2023-10-08T00:27:50.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.413 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1095e-05 s, 0.0 kB/s 2023-10-08T00:27:50.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.470 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.525 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0904e-05 s, 0.0 kB/s 2023-10-08T00:27:50.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.526 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.581 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1613e-05 s, 0.0 kB/s 2023-10-08T00:27:50.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.582 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2386e-05 s, 0.0 kB/s 2023-10-08T00:27:50.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.637 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.695 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3793e-05 s, 0.0 kB/s 2023-10-08T00:27:50.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.750 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1106e-05 s, 0.0 kB/s 2023-10-08T00:27:50.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.751 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.806 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2155e-05 s, 0.0 kB/s 2023-10-08T00:27:50.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.806 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.862 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0388e-05 s, 0.0 kB/s 2023-10-08T00:27:50.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.863 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.918 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1216e-05 s, 0.0 kB/s 2023-10-08T00:27:50.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:50.974 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0254e-05 s, 0.0 kB/s 2023-10-08T00:27:50.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:50.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.029 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.030 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.030 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4548e-05 s, 0.0 kB/s 2023-10-08T00:27:51.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.031 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.087 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0957e-05 s, 0.0 kB/s 2023-10-08T00:27:51.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.087 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.143 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.085e-05 s, 0.0 kB/s 2023-10-08T00:27:51.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.144 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.199 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0808e-05 s, 0.0 kB/s 2023-10-08T00:27:51.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.200 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.256 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2997e-05 s, 0.0 kB/s 2023-10-08T00:27:51.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.256 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.311 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-08T00:27:51.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.312 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.366 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.367 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2345e-05 s, 0.0 kB/s 2023-10-08T00:27:51.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.367 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.423 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1924e-05 s, 0.0 kB/s 2023-10-08T00:27:51.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.423 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.479 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.479 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.479 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0636e-05 s, 0.0 kB/s 2023-10-08T00:27:51.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.480 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0929e-05 s, 0.0 kB/s 2023-10-08T00:27:51.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.536 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.592 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2575e-05 s, 0.0 kB/s 2023-10-08T00:27:51.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.648 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1346e-05 s, 0.0 kB/s 2023-10-08T00:27:51.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.648 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.704 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0578e-05 s, 0.0 kB/s 2023-10-08T00:27:51.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.704 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.759 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.760 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3117e-05 s, 0.0 kB/s 2023-10-08T00:27:51.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.761 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.817 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1352e-05 s, 0.0 kB/s 2023-10-08T00:27:51.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.874 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2537e-05 s, 0.0 kB/s 2023-10-08T00:27:51.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.875 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.930 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.229e-05 s, 0.0 kB/s 2023-10-08T00:27:51.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.931 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:51.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:51.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:51.986 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0614e-05 s, 0.0 kB/s 2023-10-08T00:27:51.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:51.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.041 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1785e-05 s, 0.0 kB/s 2023-10-08T00:27:52.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.043 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.098 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.099 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.934e-05 s, 0.0 kB/s 2023-10-08T00:27:52.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.099 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.155 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-08T00:27:52.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.155 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.284e-05 s, 0.0 kB/s 2023-10-08T00:27:52.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.211 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.267 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1078e-05 s, 0.0 kB/s 2023-10-08T00:27:52.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.268 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.323 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.181e-05 s, 0.0 kB/s 2023-10-08T00:27:52.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.324 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.379 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0915e-05 s, 0.0 kB/s 2023-10-08T00:27:52.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.379 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.435 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1534e-05 s, 0.0 kB/s 2023-10-08T00:27:52.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.435 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.491 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1715e-05 s, 0.0 kB/s 2023-10-08T00:27:52.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.491 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.547 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1878e-05 s, 0.0 kB/s 2023-10-08T00:27:52.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.548 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.602 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.99e-05 s, 0.0 kB/s 2023-10-08T00:27:52.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.603 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.659 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0714e-05 s, 0.0 kB/s 2023-10-08T00:27:52.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.659 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1874e-05 s, 0.0 kB/s 2023-10-08T00:27:52.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.716 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.771 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2158e-05 s, 0.0 kB/s 2023-10-08T00:27:52.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.772 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.827 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1283e-05 s, 0.0 kB/s 2023-10-08T00:27:52.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.828 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.883 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3949e-05 s, 0.0 kB/s 2023-10-08T00:27:52.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.939 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3315e-05 s, 0.0 kB/s 2023-10-08T00:27:52.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.940 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:52.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:52.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:52.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0577e-05 s, 0.0 kB/s 2023-10-08T00:27:52.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:52.995 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.051 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1139e-05 s, 0.0 kB/s 2023-10-08T00:27:53.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.051 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.107 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9744e-05 s, 0.0 kB/s 2023-10-08T00:27:53.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.107 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.163 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2784e-05 s, 0.0 kB/s 2023-10-08T00:27:53.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.163 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.219 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1587e-05 s, 0.0 kB/s 2023-10-08T00:27:53.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.219 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.275 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2023e-05 s, 0.0 kB/s 2023-10-08T00:27:53.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.276 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.332 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3417e-05 s, 0.0 kB/s 2023-10-08T00:27:53.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.332 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2578e-05 s, 0.0 kB/s 2023-10-08T00:27:53.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.388 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.443 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1248e-05 s, 0.0 kB/s 2023-10-08T00:27:53.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.443 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2237e-05 s, 0.0 kB/s 2023-10-08T00:27:53.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.500 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.555 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0646e-05 s, 0.0 kB/s 2023-10-08T00:27:53.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.556 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.611 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-08T00:27:53.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.667 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1929e-05 s, 0.0 kB/s 2023-10-08T00:27:53.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.667 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.723 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1521e-05 s, 0.0 kB/s 2023-10-08T00:27:53.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.723 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.779 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-08T00:27:53.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.779 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.835 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1285e-05 s, 0.0 kB/s 2023-10-08T00:27:53.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.891 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0817e-05 s, 0.0 kB/s 2023-10-08T00:27:53.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.892 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:53.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:53.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:53.947 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0909e-05 s, 0.0 kB/s 2023-10-08T00:27:53.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:53.947 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.003 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1e-05 s, 0.0 kB/s 2023-10-08T00:27:54.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.059 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3799e-05 s, 0.0 kB/s 2023-10-08T00:27:54.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.114 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.115 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.066e-05 s, 0.0 kB/s 2023-10-08T00:27:54.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.115 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.172 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1779e-05 s, 0.0 kB/s 2023-10-08T00:27:54.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.173 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.228 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.904e-05 s, 0.0 kB/s 2023-10-08T00:27:54.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.229 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1343e-05 s, 0.0 kB/s 2023-10-08T00:27:54.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.284 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.340 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2827e-05 s, 0.0 kB/s 2023-10-08T00:27:54.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.341 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.396 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8509e-05 s, 0.0 kB/s 2023-10-08T00:27:54.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.452 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1477e-05 s, 0.0 kB/s 2023-10-08T00:27:54.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.452 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0838e-05 s, 0.0 kB/s 2023-10-08T00:27:54.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.564 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.564 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.564 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0579e-05 s, 0.0 kB/s 2023-10-08T00:27:54.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.564 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.621 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6914e-05 s, 0.0 kB/s 2023-10-08T00:27:54.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.621 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.677 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0587e-05 s, 0.0 kB/s 2023-10-08T00:27:54.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.677 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.733 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.733 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.733 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0583e-05 s, 0.0 kB/s 2023-10-08T00:27:54.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.733 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.789 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1188e-05 s, 0.0 kB/s 2023-10-08T00:27:54.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1075e-05 s, 0.0 kB/s 2023-10-08T00:27:54.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.846 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.902 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4607e-05 s, 0.0 kB/s 2023-10-08T00:27:54.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:54.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:54.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:54.958 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3191e-05 s, 0.0 kB/s 2023-10-08T00:27:54.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:54.958 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.014 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3828e-05 s, 0.0 kB/s 2023-10-08T00:27:55.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9094e-05 s, 0.0 kB/s 2023-10-08T00:27:55.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.071 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.126 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0559e-05 s, 0.0 kB/s 2023-10-08T00:27:55.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.126 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.182 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.182 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.182 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.271e-05 s, 0.0 kB/s 2023-10-08T00:27:55.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.183 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.239 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.239 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.239 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3461e-05 s, 0.0 kB/s 2023-10-08T00:27:55.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.241 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.078e-05 s, 0.0 kB/s 2023-10-08T00:27:55.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2872e-05 s, 0.0 kB/s 2023-10-08T00:27:55.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.352 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.407 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2592e-05 s, 0.0 kB/s 2023-10-08T00:27:55.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.407 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.463 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0937e-05 s, 0.0 kB/s 2023-10-08T00:27:55.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.463 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.519 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9476e-05 s, 0.0 kB/s 2023-10-08T00:27:55.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0912e-05 s, 0.0 kB/s 2023-10-08T00:27:55.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0384e-05 s, 0.0 kB/s 2023-10-08T00:27:55.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3334e-05 s, 0.0 kB/s 2023-10-08T00:27:55.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.976e-05 s, 0.0 kB/s 2023-10-08T00:27:55.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.800 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9984e-05 s, 0.0 kB/s 2023-10-08T00:27:55.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.858 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.858 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3741e-05 s, 0.0 kB/s 2023-10-08T00:27:55.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.859 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9812e-05 s, 0.0 kB/s 2023-10-08T00:27:55.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.912 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:55.967 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0009e-05 s, 0.0 kB/s 2023-10-08T00:27:55.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:55.969 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9598e-05 s, 0.0 kB/s 2023-10-08T00:27:56.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.024 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8079e-05 s, 0.0 kB/s 2023-10-08T00:27:56.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.081 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.136 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.136 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.136 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2183e-05 s, 0.0 kB/s 2023-10-08T00:27:56.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.137 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0325e-05 s, 0.0 kB/s 2023-10-08T00:27:56.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.192 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.247 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9635e-05 s, 0.0 kB/s 2023-10-08T00:27:56.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.248 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.303 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.303 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.303 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.063e-05 s, 0.0 kB/s 2023-10-08T00:27:56.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.304 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.361 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9309e-05 s, 0.0 kB/s 2023-10-08T00:27:56.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.362 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.417 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.417 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.417 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.914e-05 s, 0.0 kB/s 2023-10-08T00:27:56.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.473 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2328e-05 s, 0.0 kB/s 2023-10-08T00:27:56.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.473 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2432e-05 s, 0.0 kB/s 2023-10-08T00:27:56.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.585 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.983e-05 s, 0.0 kB/s 2023-10-08T00:27:56.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.586 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.641 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.169e-05 s, 0.0 kB/s 2023-10-08T00:27:56.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.698 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0623e-05 s, 0.0 kB/s 2023-10-08T00:27:56.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.699 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.754 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.754 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.754 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3873e-05 s, 0.0 kB/s 2023-10-08T00:27:56.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1963e-05 s, 0.0 kB/s 2023-10-08T00:27:56.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.811 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3478e-05 s, 0.0 kB/s 2023-10-08T00:27:56.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.867 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.922 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9932e-05 s, 0.0 kB/s 2023-10-08T00:27:56.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.922 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:56.978 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0036e-05 s, 0.0 kB/s 2023-10-08T00:27:56.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:56.978 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.034 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2274e-05 s, 0.0 kB/s 2023-10-08T00:27:57.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.035 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.090 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.091 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8778e-05 s, 0.0 kB/s 2023-10-08T00:27:57.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.091 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.147 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3089e-05 s, 0.0 kB/s 2023-10-08T00:27:57.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.147 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.201 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.202 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.202 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9343e-05 s, 0.0 kB/s 2023-10-08T00:27:57.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.202 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.258 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.258 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.258 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0084e-05 s, 0.0 kB/s 2023-10-08T00:27:57.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.259 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.314 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2967e-05 s, 0.0 kB/s 2023-10-08T00:27:57.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.315 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.371 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-08T00:27:57.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.372 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.427 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.427 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.427 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.378e-05 s, 0.0 kB/s 2023-10-08T00:27:57.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.428 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2073e-05 s, 0.0 kB/s 2023-10-08T00:27:57.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.484 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.540 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0538e-05 s, 0.0 kB/s 2023-10-08T00:27:57.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.540 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.596 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.596 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.596 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1544e-05 s, 0.0 kB/s 2023-10-08T00:27:57.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.596 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.652 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.652 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.652 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4002e-05 s, 0.0 kB/s 2023-10-08T00:27:57.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.653 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.708 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8612e-05 s, 0.0 kB/s 2023-10-08T00:27:57.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.709 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.764 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1408e-05 s, 0.0 kB/s 2023-10-08T00:27:57.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.764 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.820 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1701e-05 s, 0.0 kB/s 2023-10-08T00:27:57.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.820 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.877 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.877 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.877 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3111e-05 s, 0.0 kB/s 2023-10-08T00:27:57.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.877 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.934 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-08T00:27:57.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.934 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:57.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1794e-05 s, 0.0 kB/s 2023-10-08T00:27:57.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:57.991 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1846e-05 s, 0.0 kB/s 2023-10-08T00:27:58.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.047 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.103 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.104 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.946e-05 s, 0.0 kB/s 2023-10-08T00:27:58.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.104 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.160 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.160 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2469e-05 s, 0.0 kB/s 2023-10-08T00:27:58.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.161 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.217 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4676e-05 s, 0.0 kB/s 2023-10-08T00:27:58.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.274 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.274 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2894e-05 s, 0.0 kB/s 2023-10-08T00:27:58.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1494e-05 s, 0.0 kB/s 2023-10-08T00:27:58.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1088e-05 s, 0.0 kB/s 2023-10-08T00:27:58.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.388 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.444 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.281e-05 s, 0.0 kB/s 2023-10-08T00:27:58.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.444 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.500 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1368e-05 s, 0.0 kB/s 2023-10-08T00:27:58.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.501 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.556 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0992e-05 s, 0.0 kB/s 2023-10-08T00:27:58.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.557 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.612 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1507e-05 s, 0.0 kB/s 2023-10-08T00:27:58.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.613 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.668 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4089e-05 s, 0.0 kB/s 2023-10-08T00:27:58.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.669 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0544e-05 s, 0.0 kB/s 2023-10-08T00:27:58.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.724 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.183e-05 s, 0.0 kB/s 2023-10-08T00:27:58.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.781 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.837 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.837 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1727e-05 s, 0.0 kB/s 2023-10-08T00:27:58.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.893 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2401e-05 s, 0.0 kB/s 2023-10-08T00:27:58.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.894 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:58.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:58.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:58.949 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0967e-05 s, 0.0 kB/s 2023-10-08T00:27:58.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:58.950 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.005 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2129e-05 s, 0.0 kB/s 2023-10-08T00:27:59.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.006 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.061 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2387e-05 s, 0.0 kB/s 2023-10-08T00:27:59.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.062 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.117 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4328e-05 s, 0.0 kB/s 2023-10-08T00:27:59.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.118 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.174 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0491e-05 s, 0.0 kB/s 2023-10-08T00:27:59.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.123e-05 s, 0.0 kB/s 2023-10-08T00:27:59.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.231 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.286 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0755e-05 s, 0.0 kB/s 2023-10-08T00:27:59.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.287 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.341 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.342 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9012e-05 s, 0.0 kB/s 2023-10-08T00:27:59.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.342 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.182e-05 s, 0.0 kB/s 2023-10-08T00:27:59.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.456 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1717e-05 s, 0.0 kB/s 2023-10-08T00:27:59.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.456 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.512 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1066e-05 s, 0.0 kB/s 2023-10-08T00:27:59.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.570 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.570 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.570 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4107e-05 s, 0.0 kB/s 2023-10-08T00:27:59.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.572 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2994e-05 s, 0.0 kB/s 2023-10-08T00:27:59.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.702 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2017e-05 s, 0.0 kB/s 2023-10-08T00:27:59.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.702 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.765 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.765 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.765 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1949e-05 s, 0.0 kB/s 2023-10-08T00:27:59.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.765 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.827 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1742e-05 s, 0.0 kB/s 2023-10-08T00:27:59.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.827 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3211e-05 s, 0.0 kB/s 2023-10-08T00:27:59.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.940 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0926e-05 s, 0.0 kB/s 2023-10-08T00:27:59.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.941 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:27:59.998 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:27:59.998 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:27:59.998 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9466e-05 s, 0.0 kB/s 2023-10-08T00:27:59.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:27:59.999 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.054 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.054 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.054 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0593e-05 s, 0.0 kB/s 2023-10-08T00:28:00.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.110 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.067e-05 s, 0.0 kB/s 2023-10-08T00:28:00.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.166 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2194e-05 s, 0.0 kB/s 2023-10-08T00:28:00.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1691e-05 s, 0.0 kB/s 2023-10-08T00:28:00.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.222 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.278 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2156e-05 s, 0.0 kB/s 2023-10-08T00:28:00.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.278 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.334 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.334 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.334 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0149e-05 s, 0.0 kB/s 2023-10-08T00:28:00.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.335 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1223e-05 s, 0.0 kB/s 2023-10-08T00:28:00.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.391 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.447 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.215e-05 s, 0.0 kB/s 2023-10-08T00:28:00.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.448 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.503 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.504 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.84e-05 s, 0.0 kB/s 2023-10-08T00:28:00.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.504 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.560 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.561 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.561 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1903e-05 s, 0.0 kB/s 2023-10-08T00:28:00.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.561 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4183e-05 s, 0.0 kB/s 2023-10-08T00:28:00.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.618 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.675 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.675 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5793e-05 s, 0.0 kB/s 2023-10-08T00:28:00.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.676 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.4292e-05 s, 0.0 kB/s 2023-10-08T00:28:00.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.733 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.789 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1676e-05 s, 0.0 kB/s 2023-10-08T00:28:00.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.845 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1424e-05 s, 0.0 kB/s 2023-10-08T00:28:00.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.846 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.900 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.901 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1452e-05 s, 0.0 kB/s 2023-10-08T00:28:00.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:00.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:00.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:00.958 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1239e-05 s, 0.0 kB/s 2023-10-08T00:28:00.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:00.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.014 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9864e-05 s, 0.0 kB/s 2023-10-08T00:28:01.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.014 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1711e-05 s, 0.0 kB/s 2023-10-08T00:28:01.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.071 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.126 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-08T00:28:01.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.127 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.163 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:28:01.169 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:28:01.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.183 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.134e-05 s, 0.0 kB/s 2023-10-08T00:28:01.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.183 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.272 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.272 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4013e-05 s, 0.0 kB/s 2023-10-08T00:28:01.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.272 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.328 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0573e-05 s, 0.0 kB/s 2023-10-08T00:28:01.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.328 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.384 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.384 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.384 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9488e-05 s, 0.0 kB/s 2023-10-08T00:28:01.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.385 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3497e-05 s, 0.0 kB/s 2023-10-08T00:28:01.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.440 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.496 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-08T00:28:01.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.497 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.552 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.552 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.552 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.97e-05 s, 0.0 kB/s 2023-10-08T00:28:01.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.609 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7211e-05 s, 0.0 kB/s 2023-10-08T00:28:01.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.609 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.664 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1931e-05 s, 0.0 kB/s 2023-10-08T00:28:01.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.665 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.720 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2802e-05 s, 0.0 kB/s 2023-10-08T00:28:01.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.721 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.278e-05 s, 0.0 kB/s 2023-10-08T00:28:01.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.776 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.832 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.832 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2904e-05 s, 0.0 kB/s 2023-10-08T00:28:01.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.833 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.889 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2586e-05 s, 0.0 kB/s 2023-10-08T00:28:01.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.890 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:01.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:01.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:01.946 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9533e-05 s, 0.0 kB/s 2023-10-08T00:28:01.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:01.946 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3068e-05 s, 0.0 kB/s 2023-10-08T00:28:02.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.002 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.058 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.058 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.058 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1e-05 s, 0.0 kB/s 2023-10-08T00:28:02.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.058 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.113 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.114 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8927e-05 s, 0.0 kB/s 2023-10-08T00:28:02.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.114 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.169 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.169 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.169 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-08T00:28:02.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.170 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.225 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1194e-05 s, 0.0 kB/s 2023-10-08T00:28:02.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.225 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.281 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1191e-05 s, 0.0 kB/s 2023-10-08T00:28:02.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.282 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.337 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0756e-05 s, 0.0 kB/s 2023-10-08T00:28:02.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.338 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.394 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.394 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.394 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2501e-05 s, 0.0 kB/s 2023-10-08T00:28:02.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.394 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.451 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.451 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.26e-05 s, 0.0 kB/s 2023-10-08T00:28:02.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.451 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.507 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.023e-05 s, 0.0 kB/s 2023-10-08T00:28:02.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.508 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.563 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2435e-05 s, 0.0 kB/s 2023-10-08T00:28:02.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.564 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.619 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-08T00:28:02.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.676 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2087e-05 s, 0.0 kB/s 2023-10-08T00:28:02.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.676 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.732 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1342e-05 s, 0.0 kB/s 2023-10-08T00:28:02.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.733 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1631e-05 s, 0.0 kB/s 2023-10-08T00:28:02.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.789 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.844 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.844 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.844 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3854e-05 s, 0.0 kB/s 2023-10-08T00:28:02.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.844 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.900 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.900 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.900 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0653e-05 s, 0.0 kB/s 2023-10-08T00:28:02.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.901 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9674e-05 s, 0.0 kB/s 2023-10-08T00:28:02.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:02.956 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.013 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0679e-05 s, 0.0 kB/s 2023-10-08T00:28:03.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.014 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.068 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9553e-05 s, 0.0 kB/s 2023-10-08T00:28:03.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.069 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.124 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0672e-05 s, 0.0 kB/s 2023-10-08T00:28:03.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.124 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.180 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9708e-05 s, 0.0 kB/s 2023-10-08T00:28:03.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.181 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.236 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2184e-05 s, 0.0 kB/s 2023-10-08T00:28:03.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.237 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.292 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0246e-05 s, 0.0 kB/s 2023-10-08T00:28:03.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.292 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.348 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.348 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.348 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1416e-05 s, 0.0 kB/s 2023-10-08T00:28:03.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.348 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.404 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.404 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9657e-05 s, 0.0 kB/s 2023-10-08T00:28:03.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.459 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.460 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9448e-05 s, 0.0 kB/s 2023-10-08T00:28:03.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.460 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.516 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2259e-05 s, 0.0 kB/s 2023-10-08T00:28:03.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.517 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.571 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.572 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.572 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9965e-05 s, 0.0 kB/s 2023-10-08T00:28:03.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.572 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.273e-05 s, 0.0 kB/s 2023-10-08T00:28:03.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0118e-05 s, 0.0 kB/s 2023-10-08T00:28:03.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.686 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.742 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3368e-05 s, 0.0 kB/s 2023-10-08T00:28:03.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.742 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2499e-05 s, 0.0 kB/s 2023-10-08T00:28:03.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.799 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.854 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0264e-05 s, 0.0 kB/s 2023-10-08T00:28:03.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.854 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.910 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2532e-05 s, 0.0 kB/s 2023-10-08T00:28:03.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.911 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0418e-05 s, 0.0 kB/s 2023-10-08T00:28:03.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:03.967 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.023 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.023 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.023 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9764e-05 s, 0.0 kB/s 2023-10-08T00:28:04.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.024 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2019e-05 s, 0.0 kB/s 2023-10-08T00:28:04.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.135 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3683e-05 s, 0.0 kB/s 2023-10-08T00:28:04.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.135 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.191 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1418e-05 s, 0.0 kB/s 2023-10-08T00:28:04.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.191 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.247 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9862e-05 s, 0.0 kB/s 2023-10-08T00:28:04.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.247 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.303 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.303 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.303 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3458e-05 s, 0.0 kB/s 2023-10-08T00:28:04.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.303 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0833e-05 s, 0.0 kB/s 2023-10-08T00:28:04.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.360 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.415 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.415 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.415 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.159e-05 s, 0.0 kB/s 2023-10-08T00:28:04.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.415 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3905e-05 s, 0.0 kB/s 2023-10-08T00:28:04.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.471 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.527 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.527 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.527 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4241e-05 s, 0.0 kB/s 2023-10-08T00:28:04.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.528 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.583 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.583 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.583 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4001e-05 s, 0.0 kB/s 2023-10-08T00:28:04.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.584 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.639 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.640 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5236e-05 s, 0.0 kB/s 2023-10-08T00:28:04.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.640 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1518e-05 s, 0.0 kB/s 2023-10-08T00:28:04.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.696 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1202e-05 s, 0.0 kB/s 2023-10-08T00:28:04.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.753 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.807 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9778e-05 s, 0.0 kB/s 2023-10-08T00:28:04.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.808 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0959e-05 s, 0.0 kB/s 2023-10-08T00:28:04.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.864 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.919 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.919 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.919 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0978e-05 s, 0.0 kB/s 2023-10-08T00:28:04.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:04.975 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3389e-05 s, 0.0 kB/s 2023-10-08T00:28:04.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:04.976 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.031 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2892e-05 s, 0.0 kB/s 2023-10-08T00:28:05.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.031 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.087 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2031e-05 s, 0.0 kB/s 2023-10-08T00:28:05.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.087 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.143 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1705e-05 s, 0.0 kB/s 2023-10-08T00:28:05.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.143 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.199 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0814e-05 s, 0.0 kB/s 2023-10-08T00:28:05.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.200 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.255 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0058e-05 s, 0.0 kB/s 2023-10-08T00:28:05.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.256 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.311 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3397e-05 s, 0.0 kB/s 2023-10-08T00:28:05.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.311 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2226e-05 s, 0.0 kB/s 2023-10-08T00:28:05.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.368 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.423 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2679e-05 s, 0.0 kB/s 2023-10-08T00:28:05.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.423 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.479 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.479 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.479 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9239e-05 s, 0.0 kB/s 2023-10-08T00:28:05.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.480 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.536 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3703e-05 s, 0.0 kB/s 2023-10-08T00:28:05.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.536 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4618e-05 s, 0.0 kB/s 2023-10-08T00:28:05.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.649 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4615e-05 s, 0.0 kB/s 2023-10-08T00:28:05.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.649 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.705 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1111e-05 s, 0.0 kB/s 2023-10-08T00:28:05.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.706 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.762 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7854e-05 s, 0.0 kB/s 2023-10-08T00:28:05.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.762 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.817 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4783e-05 s, 0.0 kB/s 2023-10-08T00:28:05.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.874 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.018e-05 s, 0.0 kB/s 2023-10-08T00:28:05.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.874 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.929 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.103e-05 s, 0.0 kB/s 2023-10-08T00:28:05.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.929 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:05.986 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1942e-05 s, 0.0 kB/s 2023-10-08T00:28:05.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:05.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.042 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.042 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.042 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3209e-05 s, 0.0 kB/s 2023-10-08T00:28:06.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.043 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.114e-05 s, 0.0 kB/s 2023-10-08T00:28:06.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.099 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.154 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.154 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.155 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2639e-05 s, 0.0 kB/s 2023-10-08T00:28:06.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.155 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.210 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2805e-05 s, 0.0 kB/s 2023-10-08T00:28:06.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.210 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.267 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0894e-05 s, 0.0 kB/s 2023-10-08T00:28:06.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.267 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.322 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.322 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.322 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2489e-05 s, 0.0 kB/s 2023-10-08T00:28:06.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.322 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.378 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.378 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.378 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1683e-05 s, 0.0 kB/s 2023-10-08T00:28:06.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.379 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1232e-05 s, 0.0 kB/s 2023-10-08T00:28:06.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.435 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0138e-05 s, 0.0 kB/s 2023-10-08T00:28:06.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.491 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.547 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0617e-05 s, 0.0 kB/s 2023-10-08T00:28:06.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.548 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.603 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2704e-05 s, 0.0 kB/s 2023-10-08T00:28:06.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.604 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.659 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.151e-05 s, 0.0 kB/s 2023-10-08T00:28:06.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.659 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.715 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3139e-05 s, 0.0 kB/s 2023-10-08T00:28:06.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.715 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.771 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9852e-05 s, 0.0 kB/s 2023-10-08T00:28:06.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.771 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4255e-05 s, 0.0 kB/s 2023-10-08T00:28:06.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.828 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.883 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.031e-05 s, 0.0 kB/s 2023-10-08T00:28:06.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.888e-05 s, 0.0 kB/s 2023-10-08T00:28:06.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.939 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:06.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9824e-05 s, 0.0 kB/s 2023-10-08T00:28:06.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:06.995 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2004e-05 s, 0.0 kB/s 2023-10-08T00:28:07.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.052 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.107 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1374e-05 s, 0.0 kB/s 2023-10-08T00:28:07.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.108 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.164 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3609e-05 s, 0.0 kB/s 2023-10-08T00:28:07.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.164 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.220 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0393e-05 s, 0.0 kB/s 2023-10-08T00:28:07.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.220 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.275 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.055e-05 s, 0.0 kB/s 2023-10-08T00:28:07.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.275 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.331 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-08T00:28:07.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.332 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1122e-05 s, 0.0 kB/s 2023-10-08T00:28:07.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2458e-05 s, 0.0 kB/s 2023-10-08T00:28:07.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.444 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8807e-05 s, 0.0 kB/s 2023-10-08T00:28:07.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.556 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2141e-05 s, 0.0 kB/s 2023-10-08T00:28:07.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.556 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.612 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2582e-05 s, 0.0 kB/s 2023-10-08T00:28:07.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.612 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.668 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0052e-05 s, 0.0 kB/s 2023-10-08T00:28:07.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.669 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.725 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1352e-05 s, 0.0 kB/s 2023-10-08T00:28:07.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3119e-05 s, 0.0 kB/s 2023-10-08T00:28:07.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.781 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-08T00:28:07.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2163e-05 s, 0.0 kB/s 2023-10-08T00:28:07.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.893 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:07.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:07.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:07.948 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0905e-05 s, 0.0 kB/s 2023-10-08T00:28:07.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:07.949 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.003 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4081e-05 s, 0.0 kB/s 2023-10-08T00:28:08.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.060 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2133e-05 s, 0.0 kB/s 2023-10-08T00:28:08.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.117 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1182e-05 s, 0.0 kB/s 2023-10-08T00:28:08.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.117 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.173 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9877e-05 s, 0.0 kB/s 2023-10-08T00:28:08.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.173 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.229 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3069e-05 s, 0.0 kB/s 2023-10-08T00:28:08.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.229 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4251e-05 s, 0.0 kB/s 2023-10-08T00:28:08.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.285 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.340 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3551e-05 s, 0.0 kB/s 2023-10-08T00:28:08.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.340 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.396 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.084e-05 s, 0.0 kB/s 2023-10-08T00:28:08.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.452 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2458e-05 s, 0.0 kB/s 2023-10-08T00:28:08.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.453 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.508 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.508 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.508 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0712e-05 s, 0.0 kB/s 2023-10-08T00:28:08.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.508 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.565 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-08T00:28:08.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.565 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.621 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2182e-05 s, 0.0 kB/s 2023-10-08T00:28:08.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.622 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.677 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1184e-05 s, 0.0 kB/s 2023-10-08T00:28:08.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.677 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.734 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1276e-05 s, 0.0 kB/s 2023-10-08T00:28:08.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.734 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.791 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1495e-05 s, 0.0 kB/s 2023-10-08T00:28:08.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2679e-05 s, 0.0 kB/s 2023-10-08T00:28:08.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.848 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.904 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7179e-05 s, 0.0 kB/s 2023-10-08T00:28:08.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:08.960 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3746e-05 s, 0.0 kB/s 2023-10-08T00:28:08.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:08.961 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.016 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.016 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.016 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1694e-05 s, 0.0 kB/s 2023-10-08T00:28:09.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.017 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.072 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.072 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9739e-05 s, 0.0 kB/s 2023-10-08T00:28:09.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.073 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.129 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4208e-05 s, 0.0 kB/s 2023-10-08T00:28:09.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.130 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.185 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.185 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.185 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2646e-05 s, 0.0 kB/s 2023-10-08T00:28:09.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.186 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4188e-05 s, 0.0 kB/s 2023-10-08T00:28:09.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.242 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1681e-05 s, 0.0 kB/s 2023-10-08T00:28:09.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.298 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.353 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.353 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.353 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2967e-05 s, 0.0 kB/s 2023-10-08T00:28:09.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.353 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.409 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.409 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.409 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4227e-05 s, 0.0 kB/s 2023-10-08T00:28:09.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.409 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.465 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.223e-05 s, 0.0 kB/s 2023-10-08T00:28:09.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.465 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.520 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.520 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.520 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9113e-05 s, 0.0 kB/s 2023-10-08T00:28:09.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.521 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.577 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.573e-05 s, 0.0 kB/s 2023-10-08T00:28:09.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.578 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.633 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.633 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.633 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3838e-05 s, 0.0 kB/s 2023-10-08T00:28:09.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.634 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.689 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.689 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.689 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.957e-05 s, 0.0 kB/s 2023-10-08T00:28:09.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.689 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.793 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.193e-05 s, 0.0 kB/s 2023-10-08T00:28:09.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.794 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0799e-05 s, 0.0 kB/s 2023-10-08T00:28:09.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.810 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.866 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.144e-05 s, 0.0 kB/s 2023-10-08T00:28:09.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.867 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.922 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.022e-05 s, 0.0 kB/s 2023-10-08T00:28:09.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.922 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:09.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:09.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:09.978 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0473e-05 s, 0.0 kB/s 2023-10-08T00:28:09.978 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:09.978 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.034 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4702e-05 s, 0.0 kB/s 2023-10-08T00:28:10.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.035 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.090 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0161e-05 s, 0.0 kB/s 2023-10-08T00:28:10.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.090 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.146 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-08T00:28:10.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.146 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.202 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.202 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.202 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9724e-05 s, 0.0 kB/s 2023-10-08T00:28:10.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.202 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.258 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.258 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.258 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-08T00:28:10.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.259 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.314 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9713e-05 s, 0.0 kB/s 2023-10-08T00:28:10.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.314 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0755e-05 s, 0.0 kB/s 2023-10-08T00:28:10.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.371 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.426 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.426 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.426 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2247e-05 s, 0.0 kB/s 2023-10-08T00:28:10.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.427 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.482 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3174e-05 s, 0.0 kB/s 2023-10-08T00:28:10.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.483 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2178e-05 s, 0.0 kB/s 2023-10-08T00:28:10.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.539 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.595 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.595 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3534e-05 s, 0.0 kB/s 2023-10-08T00:28:10.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.597 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.652 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.652 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.652 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4843e-05 s, 0.0 kB/s 2023-10-08T00:28:10.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.652 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.709 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.709 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3199e-05 s, 0.0 kB/s 2023-10-08T00:28:10.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.709 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1422e-05 s, 0.0 kB/s 2023-10-08T00:28:10.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.765 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.821 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.821 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.822 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9661e-05 s, 0.0 kB/s 2023-10-08T00:28:10.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.822 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.877 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.877 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.877 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.29e-05 s, 0.0 kB/s 2023-10-08T00:28:10.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.877 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.933 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1316e-05 s, 0.0 kB/s 2023-10-08T00:28:10.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.933 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:10.989 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:10.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:10.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0831e-05 s, 0.0 kB/s 2023-10-08T00:28:10.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:10.990 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.145e-05 s, 0.0 kB/s 2023-10-08T00:28:11.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.046 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.102 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1091e-05 s, 0.0 kB/s 2023-10-08T00:28:11.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.158 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-08T00:28:11.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.159 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.215 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2284e-05 s, 0.0 kB/s 2023-10-08T00:28:11.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.215 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.271 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3387e-05 s, 0.0 kB/s 2023-10-08T00:28:11.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.271 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.327 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2613e-05 s, 0.0 kB/s 2023-10-08T00:28:11.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.383 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2312e-05 s, 0.0 kB/s 2023-10-08T00:28:11.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.383 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.439 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1504e-05 s, 0.0 kB/s 2023-10-08T00:28:11.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.440 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.495 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3658e-05 s, 0.0 kB/s 2023-10-08T00:28:11.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.551 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3371e-05 s, 0.0 kB/s 2023-10-08T00:28:11.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.608 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.608 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6571e-05 s, 0.0 kB/s 2023-10-08T00:28:11.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.609 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.665 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1552e-05 s, 0.0 kB/s 2023-10-08T00:28:11.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.666 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.721 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.721 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.721 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9276e-05 s, 0.0 kB/s 2023-10-08T00:28:11.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.721 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3775e-05 s, 0.0 kB/s 2023-10-08T00:28:11.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.777 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.832 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2304e-05 s, 0.0 kB/s 2023-10-08T00:28:11.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.835 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3362e-05 s, 0.0 kB/s 2023-10-08T00:28:11.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.892 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:11.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:11.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:11.948 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2925e-05 s, 0.0 kB/s 2023-10-08T00:28:11.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:11.949 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.005 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.381e-05 s, 0.0 kB/s 2023-10-08T00:28:12.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.006 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.061 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1311e-05 s, 0.0 kB/s 2023-10-08T00:28:12.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.062 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1484e-05 s, 0.0 kB/s 2023-10-08T00:28:12.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.118 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.175 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1947e-05 s, 0.0 kB/s 2023-10-08T00:28:12.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2379e-05 s, 0.0 kB/s 2023-10-08T00:28:12.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.232 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.288 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.289 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.289 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3176e-05 s, 0.0 kB/s 2023-10-08T00:28:12.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.289 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.345 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1006e-05 s, 0.0 kB/s 2023-10-08T00:28:12.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.346 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.401 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.401 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.401 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5362e-05 s, 0.0 kB/s 2023-10-08T00:28:12.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.402 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.457 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.457 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.457 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3776e-05 s, 0.0 kB/s 2023-10-08T00:28:12.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.457 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.513 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3388e-05 s, 0.0 kB/s 2023-10-08T00:28:12.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.514 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.569 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9439e-05 s, 0.0 kB/s 2023-10-08T00:28:12.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.569 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.625 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.626 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-08T00:28:12.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.626 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.681 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.19e-05 s, 0.0 kB/s 2023-10-08T00:28:12.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.682 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3126e-05 s, 0.0 kB/s 2023-10-08T00:28:12.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.738 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.794 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.794 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4265e-05 s, 0.0 kB/s 2023-10-08T00:28:12.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.794 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.851 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2696e-05 s, 0.0 kB/s 2023-10-08T00:28:12.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.851 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2224e-05 s, 0.0 kB/s 2023-10-08T00:28:12.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.908 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:12.965 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3601e-05 s, 0.0 kB/s 2023-10-08T00:28:12.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:12.965 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.022 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3432e-05 s, 0.0 kB/s 2023-10-08T00:28:13.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.022 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.079 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.446e-05 s, 0.0 kB/s 2023-10-08T00:28:13.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2826e-05 s, 0.0 kB/s 2023-10-08T00:28:13.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.136 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.193 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.193 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2352e-05 s, 0.0 kB/s 2023-10-08T00:28:13.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.193 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3422e-05 s, 0.0 kB/s 2023-10-08T00:28:13.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3309e-05 s, 0.0 kB/s 2023-10-08T00:28:13.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.309 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.364 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.364 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6299e-05 s, 0.0 kB/s 2023-10-08T00:28:13.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.365 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.422 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.423 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2287e-05 s, 0.0 kB/s 2023-10-08T00:28:13.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.423 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.481 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4735e-05 s, 0.0 kB/s 2023-10-08T00:28:13.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.481 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4367e-05 s, 0.0 kB/s 2023-10-08T00:28:13.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.538 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.594 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.594 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.594 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3547e-05 s, 0.0 kB/s 2023-10-08T00:28:13.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.595 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.651 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0069e-05 s, 0.0 kB/s 2023-10-08T00:28:13.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.652 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3948e-05 s, 0.0 kB/s 2023-10-08T00:28:13.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.709 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.765 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.765 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2447e-05 s, 0.0 kB/s 2023-10-08T00:28:13.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.765 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1531e-05 s, 0.0 kB/s 2023-10-08T00:28:13.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.822 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.878 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.879 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.879 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1783e-05 s, 0.0 kB/s 2023-10-08T00:28:13.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.879 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.935 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1164e-05 s, 0.0 kB/s 2023-10-08T00:28:13.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.935 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:13.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:13.991 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4375e-05 s, 0.0 kB/s 2023-10-08T00:28:13.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:13.991 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.047 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.047 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2623e-05 s, 0.0 kB/s 2023-10-08T00:28:14.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.048 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.104 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1651e-05 s, 0.0 kB/s 2023-10-08T00:28:14.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.105 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.160 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.160 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.160 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.3356e-05 s, 0.0 kB/s 2023-10-08T00:28:14.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.161 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.218 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2258e-05 s, 0.0 kB/s 2023-10-08T00:28:14.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.275 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4792e-05 s, 0.0 kB/s 2023-10-08T00:28:14.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.275 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.332 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.332 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.332 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2414e-05 s, 0.0 kB/s 2023-10-08T00:28:14.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.332 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1289e-05 s, 0.0 kB/s 2023-10-08T00:28:14.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.389 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.444 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1388e-05 s, 0.0 kB/s 2023-10-08T00:28:14.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.444 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.500 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2081e-05 s, 0.0 kB/s 2023-10-08T00:28:14.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.500 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.556 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2311e-05 s, 0.0 kB/s 2023-10-08T00:28:14.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.557 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.613 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.151e-05 s, 0.0 kB/s 2023-10-08T00:28:14.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.613 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.668 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1217e-05 s, 0.0 kB/s 2023-10-08T00:28:14.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.669 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0558e-05 s, 0.0 kB/s 2023-10-08T00:28:14.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.724 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4013e-05 s, 0.0 kB/s 2023-10-08T00:28:14.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.781 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2436e-05 s, 0.0 kB/s 2023-10-08T00:28:14.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.895 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.895 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.895 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0986e-05 s, 0.0 kB/s 2023-10-08T00:28:14.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.895 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:14.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:14.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:14.958 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3155e-05 s, 0.0 kB/s 2023-10-08T00:28:14.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:14.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.019 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.019 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.019 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0583e-05 s, 0.0 kB/s 2023-10-08T00:28:15.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.019 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.084 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.084 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.084 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6348e-05 s, 0.0 kB/s 2023-10-08T00:28:15.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.085 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.145 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1469e-05 s, 0.0 kB/s 2023-10-08T00:28:15.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.145 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.206 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.206 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.206 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.264e-05 s, 0.0 kB/s 2023-10-08T00:28:15.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.206 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.266 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1352e-05 s, 0.0 kB/s 2023-10-08T00:28:15.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.266 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.327 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4096e-05 s, 0.0 kB/s 2023-10-08T00:28:15.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.386 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4775e-05 s, 0.0 kB/s 2023-10-08T00:28:15.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.444 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6437e-05 s, 0.0 kB/s 2023-10-08T00:28:15.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.445 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.500 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4074e-05 s, 0.0 kB/s 2023-10-08T00:28:15.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.501 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.558 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8591e-05 s, 0.0 kB/s 2023-10-08T00:28:15.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.560 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.619 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8129e-05 s, 0.0 kB/s 2023-10-08T00:28:15.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.619 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6046e-05 s, 0.0 kB/s 2023-10-08T00:28:15.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.678 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.738 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7573e-05 s, 0.0 kB/s 2023-10-08T00:28:15.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.738 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6951e-05 s, 0.0 kB/s 2023-10-08T00:28:15.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.796 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8089e-05 s, 0.0 kB/s 2023-10-08T00:28:15.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.853 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.535e-05 s, 0.0 kB/s 2023-10-08T00:28:15.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.912 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6263e-05 s, 0.0 kB/s 2023-10-08T00:28:15.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:15.973 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0252e-05 s, 0.0 kB/s 2023-10-08T00:28:16.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.031 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.091 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9481e-05 s, 0.0 kB/s 2023-10-08T00:28:16.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.091 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.150 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.150 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.150 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8411e-05 s, 0.0 kB/s 2023-10-08T00:28:16.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.151 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.210 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9639e-05 s, 0.0 kB/s 2023-10-08T00:28:16.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.212 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.989e-05 s, 0.0 kB/s 2023-10-08T00:28:16.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.271 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7195e-05 s, 0.0 kB/s 2023-10-08T00:28:16.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.332 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.391 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0506e-05 s, 0.0 kB/s 2023-10-08T00:28:16.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.392 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.451 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.451 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2429e-05 s, 0.0 kB/s 2023-10-08T00:28:16.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.451 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.510 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.510 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.510 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.3581e-05 s, 0.0 kB/s 2023-10-08T00:28:16.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.511 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.570 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.571 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.571 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.934e-05 s, 0.0 kB/s 2023-10-08T00:28:16.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.571 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8267e-05 s, 0.0 kB/s 2023-10-08T00:28:16.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.691 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1254e-05 s, 0.0 kB/s 2023-10-08T00:28:16.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.692 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.750 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9938e-05 s, 0.0 kB/s 2023-10-08T00:28:16.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.751 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7005e-05 s, 0.0 kB/s 2023-10-08T00:28:16.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.810 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0428e-05 s, 0.0 kB/s 2023-10-08T00:28:16.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.925 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.925 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.926 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0309e-05 s, 0.0 kB/s 2023-10-08T00:28:16.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.926 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8259e-05 s, 0.0 kB/s 2023-10-08T00:28:16.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:16.984 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7389e-05 s, 0.0 kB/s 2023-10-08T00:28:17.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.044 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.102 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7558e-05 s, 0.0 kB/s 2023-10-08T00:28:17.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.161 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.162 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9282e-05 s, 0.0 kB/s 2023-10-08T00:28:17.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.163 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.222 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7899e-05 s, 0.0 kB/s 2023-10-08T00:28:17.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.223 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.282 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.3478e-05 s, 0.0 kB/s 2023-10-08T00:28:17.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.282 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.342 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8619e-05 s, 0.0 kB/s 2023-10-08T00:28:17.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.342 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.404 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.404 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0382e-05 s, 0.0 kB/s 2023-10-08T00:28:17.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.464 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.464 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0293e-05 s, 0.0 kB/s 2023-10-08T00:28:17.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.524 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.524 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9349e-05 s, 0.0 kB/s 2023-10-08T00:28:17.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.524 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.583 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.583 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.583 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8497e-05 s, 0.0 kB/s 2023-10-08T00:28:17.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.584 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6416e-05 s, 0.0 kB/s 2023-10-08T00:28:17.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.643 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.701 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6753e-05 s, 0.0 kB/s 2023-10-08T00:28:17.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.701 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.758 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.759 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.905e-05 s, 0.0 kB/s 2023-10-08T00:28:17.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.760 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.818 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5624e-05 s, 0.0 kB/s 2023-10-08T00:28:17.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.876 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.538e-05 s, 0.0 kB/s 2023-10-08T00:28:17.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.935 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.935 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4417e-05 s, 0.0 kB/s 2023-10-08T00:28:17.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.936 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:17.993 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:17.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:17.994 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7509e-05 s, 0.0 kB/s 2023-10-08T00:28:17.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:17.994 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.052 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.053 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.053 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5751e-05 s, 0.0 kB/s 2023-10-08T00:28:18.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.053 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.111 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.112 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6893e-05 s, 0.0 kB/s 2023-10-08T00:28:18.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.112 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8121e-05 s, 0.0 kB/s 2023-10-08T00:28:18.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.172 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.229 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6498e-05 s, 0.0 kB/s 2023-10-08T00:28:18.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.229 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6697e-05 s, 0.0 kB/s 2023-10-08T00:28:18.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.346 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4507e-05 s, 0.0 kB/s 2023-10-08T00:28:18.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.347 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.405 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3379e-05 s, 0.0 kB/s 2023-10-08T00:28:18.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.406 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.463 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.303e-05 s, 0.0 kB/s 2023-10-08T00:28:18.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.521 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5549e-05 s, 0.0 kB/s 2023-10-08T00:28:18.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.521 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.579 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7889e-05 s, 0.0 kB/s 2023-10-08T00:28:18.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.579 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4689e-05 s, 0.0 kB/s 2023-10-08T00:28:18.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.637 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4787e-05 s, 0.0 kB/s 2023-10-08T00:28:18.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2995e-05 s, 0.0 kB/s 2023-10-08T00:28:18.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.753 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3099e-05 s, 0.0 kB/s 2023-10-08T00:28:18.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.811 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6687e-05 s, 0.0 kB/s 2023-10-08T00:28:18.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.869 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.925 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.925 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.925 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4333e-05 s, 0.0 kB/s 2023-10-08T00:28:18.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.925 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:18.981 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:18.982 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:18.982 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5263e-05 s, 0.0 kB/s 2023-10-08T00:28:18.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:18.982 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.039 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.039 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.039 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2617e-05 s, 0.0 kB/s 2023-10-08T00:28:19.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.039 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.095 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.095 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.095 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3882e-05 s, 0.0 kB/s 2023-10-08T00:28:19.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.096 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.152 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.152 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.152 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1721e-05 s, 0.0 kB/s 2023-10-08T00:28:19.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.152 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.208 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.208 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.208 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2489e-05 s, 0.0 kB/s 2023-10-08T00:28:19.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.209 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.264 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1942e-05 s, 0.0 kB/s 2023-10-08T00:28:19.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.265 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.320 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.320 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.320 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5205e-05 s, 0.0 kB/s 2023-10-08T00:28:19.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.321 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3929e-05 s, 0.0 kB/s 2023-10-08T00:28:19.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.378 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.435 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.436 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.436 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-08T00:28:19.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.436 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.492 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.492 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.492 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2511e-05 s, 0.0 kB/s 2023-10-08T00:28:19.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.493 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.548 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.548 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.548 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8668e-05 s, 0.0 kB/s 2023-10-08T00:28:19.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.549 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.604 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.604 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5385e-05 s, 0.0 kB/s 2023-10-08T00:28:19.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.605 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.660 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.661 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.661 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1886e-05 s, 0.0 kB/s 2023-10-08T00:28:19.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.661 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.717 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.717 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.717 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1232e-05 s, 0.0 kB/s 2023-10-08T00:28:19.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.718 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.773 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.773 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.773 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2776e-05 s, 0.0 kB/s 2023-10-08T00:28:19.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.774 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.830 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3302e-05 s, 0.0 kB/s 2023-10-08T00:28:19.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.830 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.886 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-08T00:28:19.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.887 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.942 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.942 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.942 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3702e-05 s, 0.0 kB/s 2023-10-08T00:28:19.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.943 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1737e-05 s, 0.0 kB/s 2023-10-08T00:28:19.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:19.999 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.055 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5112e-05 s, 0.0 kB/s 2023-10-08T00:28:20.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.056 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.130 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.131 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.141e-05 s, 0.0 kB/s 2023-10-08T00:28:20.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.131 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.188 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.188 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.188 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4689e-05 s, 0.0 kB/s 2023-10-08T00:28:20.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.188 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.244 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3671e-05 s, 0.0 kB/s 2023-10-08T00:28:20.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.245 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3043e-05 s, 0.0 kB/s 2023-10-08T00:28:20.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.301 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.146e-05 s, 0.0 kB/s 2023-10-08T00:28:20.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.357 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.412 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3678e-05 s, 0.0 kB/s 2023-10-08T00:28:20.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.412 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.468 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.469 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2409e-05 s, 0.0 kB/s 2023-10-08T00:28:20.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.469 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0737e-05 s, 0.0 kB/s 2023-10-08T00:28:20.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.526 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.581 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.043e-05 s, 0.0 kB/s 2023-10-08T00:28:20.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.581 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.233e-05 s, 0.0 kB/s 2023-10-08T00:28:20.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.638 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3283e-05 s, 0.0 kB/s 2023-10-08T00:28:20.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.695 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4229e-05 s, 0.0 kB/s 2023-10-08T00:28:20.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.751 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.808 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9584e-05 s, 0.0 kB/s 2023-10-08T00:28:20.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.808 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.863 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0225e-05 s, 0.0 kB/s 2023-10-08T00:28:20.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.863 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.919 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.919 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.919 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2168e-05 s, 0.0 kB/s 2023-10-08T00:28:20.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.920 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:20.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:20.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:20.976 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4104e-05 s, 0.0 kB/s 2023-10-08T00:28:20.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:20.977 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.031 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.017e-05 s, 0.0 kB/s 2023-10-08T00:28:21.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.032 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.087 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1043e-05 s, 0.0 kB/s 2023-10-08T00:28:21.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.088 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.142 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.143 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2041e-05 s, 0.0 kB/s 2023-10-08T00:28:21.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.144 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.200 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1998e-05 s, 0.0 kB/s 2023-10-08T00:28:21.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.201 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.256 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9469e-05 s, 0.0 kB/s 2023-10-08T00:28:21.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.257 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.312 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9175e-05 s, 0.0 kB/s 2023-10-08T00:28:21.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.312 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.368 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3097e-05 s, 0.0 kB/s 2023-10-08T00:28:21.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.368 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.424 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3798e-05 s, 0.0 kB/s 2023-10-08T00:28:21.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.424 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.479 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.480 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9657e-05 s, 0.0 kB/s 2023-10-08T00:28:21.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.480 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.536 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9871e-05 s, 0.0 kB/s 2023-10-08T00:28:21.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.536 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.592 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0848e-05 s, 0.0 kB/s 2023-10-08T00:28:21.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.648 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5554e-05 s, 0.0 kB/s 2023-10-08T00:28:21.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.649 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.704 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4664e-05 s, 0.0 kB/s 2023-10-08T00:28:21.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.706 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.762 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1894e-05 s, 0.0 kB/s 2023-10-08T00:28:21.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.762 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7721e-05 s, 0.0 kB/s 2023-10-08T00:28:21.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.875 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-08T00:28:21.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.875 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2988e-05 s, 0.0 kB/s 2023-10-08T00:28:21.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.932 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:21.987 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1721e-05 s, 0.0 kB/s 2023-10-08T00:28:21.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:21.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.043 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9597e-05 s, 0.0 kB/s 2023-10-08T00:28:22.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.043 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.099 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2284e-05 s, 0.0 kB/s 2023-10-08T00:28:22.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.100 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.155 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1266e-05 s, 0.0 kB/s 2023-10-08T00:28:22.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.156 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.211 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3403e-05 s, 0.0 kB/s 2023-10-08T00:28:22.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.211 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1157e-05 s, 0.0 kB/s 2023-10-08T00:28:22.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.268 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9843e-05 s, 0.0 kB/s 2023-10-08T00:28:22.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.323 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1679e-05 s, 0.0 kB/s 2023-10-08T00:28:22.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.379 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3722e-05 s, 0.0 kB/s 2023-10-08T00:28:22.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.435 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.491 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9974e-05 s, 0.0 kB/s 2023-10-08T00:28:22.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.491 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.547 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9439e-05 s, 0.0 kB/s 2023-10-08T00:28:22.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.548 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.603 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2426e-05 s, 0.0 kB/s 2023-10-08T00:28:22.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.603 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.659 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0875e-05 s, 0.0 kB/s 2023-10-08T00:28:22.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.660 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.715 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0574e-05 s, 0.0 kB/s 2023-10-08T00:28:22.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.715 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.771 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0774e-05 s, 0.0 kB/s 2023-10-08T00:28:22.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.772 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.058e-05 s, 0.0 kB/s 2023-10-08T00:28:22.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.828 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.883 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2426e-05 s, 0.0 kB/s 2023-10-08T00:28:22.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.939 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4416e-05 s, 0.0 kB/s 2023-10-08T00:28:22.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.939 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:22.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:22.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:22.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9508e-05 s, 0.0 kB/s 2023-10-08T00:28:22.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:22.996 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.002e-05 s, 0.0 kB/s 2023-10-08T00:28:23.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.052 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.107 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4273e-05 s, 0.0 kB/s 2023-10-08T00:28:23.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.109 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.164 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1825e-05 s, 0.0 kB/s 2023-10-08T00:28:23.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.165 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1063e-05 s, 0.0 kB/s 2023-10-08T00:28:23.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.220 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8248e-05 s, 0.0 kB/s 2023-10-08T00:28:23.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.276 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.332 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.332 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.332 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1493e-05 s, 0.0 kB/s 2023-10-08T00:28:23.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.332 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.388 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-08T00:28:23.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.389 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.444 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0719e-05 s, 0.0 kB/s 2023-10-08T00:28:23.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.444 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.500 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0812e-05 s, 0.0 kB/s 2023-10-08T00:28:23.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.500 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.557 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.182e-05 s, 0.0 kB/s 2023-10-08T00:28:23.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.557 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.612 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9313e-05 s, 0.0 kB/s 2023-10-08T00:28:23.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.613 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.668 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2782e-05 s, 0.0 kB/s 2023-10-08T00:28:23.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.669 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9029e-05 s, 0.0 kB/s 2023-10-08T00:28:23.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1794e-05 s, 0.0 kB/s 2023-10-08T00:28:23.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.780 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4505e-05 s, 0.0 kB/s 2023-10-08T00:28:23.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1405e-05 s, 0.0 kB/s 2023-10-08T00:28:23.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.893 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:23.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:23.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:23.948 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0901e-05 s, 0.0 kB/s 2023-10-08T00:28:23.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:23.948 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9329e-05 s, 0.0 kB/s 2023-10-08T00:28:24.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0908e-05 s, 0.0 kB/s 2023-10-08T00:28:24.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.116 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1957e-05 s, 0.0 kB/s 2023-10-08T00:28:24.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.117 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.173 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.173 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1496e-05 s, 0.0 kB/s 2023-10-08T00:28:24.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.173 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.229 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2997e-05 s, 0.0 kB/s 2023-10-08T00:28:24.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.230 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.285 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.285 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.285 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0682e-05 s, 0.0 kB/s 2023-10-08T00:28:24.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.285 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.287e-05 s, 0.0 kB/s 2023-10-08T00:28:24.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.342 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.397 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2066e-05 s, 0.0 kB/s 2023-10-08T00:28:24.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.398 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.453 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3371e-05 s, 0.0 kB/s 2023-10-08T00:28:24.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.454 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.509 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-08T00:28:24.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.566 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1169e-05 s, 0.0 kB/s 2023-10-08T00:28:24.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.567 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.622 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.094e-05 s, 0.0 kB/s 2023-10-08T00:28:24.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.623 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3261e-05 s, 0.0 kB/s 2023-10-08T00:28:24.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.736 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.737 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.131e-05 s, 0.0 kB/s 2023-10-08T00:28:24.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.737 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.792 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4533e-05 s, 0.0 kB/s 2023-10-08T00:28:24.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.793 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.849 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.849 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.849 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.6759e-05 s, 0.0 kB/s 2023-10-08T00:28:24.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.849 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.906 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.906 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3056e-05 s, 0.0 kB/s 2023-10-08T00:28:24.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.907 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:24.961 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:24.961 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0832e-05 s, 0.0 kB/s 2023-10-08T00:28:24.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:24.962 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.018 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.018 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.018 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9044e-05 s, 0.0 kB/s 2023-10-08T00:28:25.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.074 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3517e-05 s, 0.0 kB/s 2023-10-08T00:28:25.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.075 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.135 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1512e-05 s, 0.0 kB/s 2023-10-08T00:28:25.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.135 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.198 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.198 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.198 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1273e-05 s, 0.0 kB/s 2023-10-08T00:28:25.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.199 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.257 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.257 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.257 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.035e-05 s, 0.0 kB/s 2023-10-08T00:28:25.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.258 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.315 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.315 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.315 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.004e-05 s, 0.0 kB/s 2023-10-08T00:28:25.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.316 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.373 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.373 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.373 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.517e-05 s, 0.0 kB/s 2023-10-08T00:28:25.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.373 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8364e-05 s, 0.0 kB/s 2023-10-08T00:28:25.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.429 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.484 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.485 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.902e-05 s, 0.0 kB/s 2023-10-08T00:28:25.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.485 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.541 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.541 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.541 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1408e-05 s, 0.0 kB/s 2023-10-08T00:28:25.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.541 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.079e-05 s, 0.0 kB/s 2023-10-08T00:28:25.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.598 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.655 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.655 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4326e-05 s, 0.0 kB/s 2023-10-08T00:28:25.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.656 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.712 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4312e-05 s, 0.0 kB/s 2023-10-08T00:28:25.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.713 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7231e-05 s, 0.0 kB/s 2023-10-08T00:28:25.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.769 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.824 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.824 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.824 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3001e-05 s, 0.0 kB/s 2023-10-08T00:28:25.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.826 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.880 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.880 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.881 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.342e-05 s, 0.0 kB/s 2023-10-08T00:28:25.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.881 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.936 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3611e-05 s, 0.0 kB/s 2023-10-08T00:28:25.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.936 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:25.993 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:25.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:25.994 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3509e-05 s, 0.0 kB/s 2023-10-08T00:28:25.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:25.994 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.050 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5395e-05 s, 0.0 kB/s 2023-10-08T00:28:26.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.051 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.105 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.105 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.105 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1009e-05 s, 0.0 kB/s 2023-10-08T00:28:26.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.106 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4625e-05 s, 0.0 kB/s 2023-10-08T00:28:26.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.162 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.218 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.208e-05 s, 0.0 kB/s 2023-10-08T00:28:26.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.273 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0943e-05 s, 0.0 kB/s 2023-10-08T00:28:26.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1725e-05 s, 0.0 kB/s 2023-10-08T00:28:26.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.330 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.386 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2419e-05 s, 0.0 kB/s 2023-10-08T00:28:26.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.386 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.441 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.442 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.285e-05 s, 0.0 kB/s 2023-10-08T00:28:26.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.442 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.498 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3533e-05 s, 0.0 kB/s 2023-10-08T00:28:26.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3741e-05 s, 0.0 kB/s 2023-10-08T00:28:26.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2002e-05 s, 0.0 kB/s 2023-10-08T00:28:26.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.666 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.666 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.666 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1138e-05 s, 0.0 kB/s 2023-10-08T00:28:26.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.667 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.946e-05 s, 0.0 kB/s 2023-10-08T00:28:26.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.724 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3259e-05 s, 0.0 kB/s 2023-10-08T00:28:26.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.781 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1724e-05 s, 0.0 kB/s 2023-10-08T00:28:26.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1918e-05 s, 0.0 kB/s 2023-10-08T00:28:26.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.894 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:26.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:26.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:26.951 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4174e-05 s, 0.0 kB/s 2023-10-08T00:28:26.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:26.951 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.007 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.007 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.007 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-08T00:28:27.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0951e-05 s, 0.0 kB/s 2023-10-08T00:28:27.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.064 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.119 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-08T00:28:27.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.175 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3037e-05 s, 0.0 kB/s 2023-10-08T00:28:27.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.176 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2747e-05 s, 0.0 kB/s 2023-10-08T00:28:27.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.232 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3888e-05 s, 0.0 kB/s 2023-10-08T00:28:27.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.287 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0472e-05 s, 0.0 kB/s 2023-10-08T00:28:27.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.343 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.399 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.961e-05 s, 0.0 kB/s 2023-10-08T00:28:27.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.399 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0822e-05 s, 0.0 kB/s 2023-10-08T00:28:27.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.456 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3292e-05 s, 0.0 kB/s 2023-10-08T00:28:27.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.511 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8822e-05 s, 0.0 kB/s 2023-10-08T00:28:27.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.567 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-08T00:28:27.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5703e-05 s, 0.0 kB/s 2023-10-08T00:28:27.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.735 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3133e-05 s, 0.0 kB/s 2023-10-08T00:28:27.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.791 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4549e-05 s, 0.0 kB/s 2023-10-08T00:28:27.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.792 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.847 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4004e-05 s, 0.0 kB/s 2023-10-08T00:28:27.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.903 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2016e-05 s, 0.0 kB/s 2023-10-08T00:28:27.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0328e-05 s, 0.0 kB/s 2023-10-08T00:28:27.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:27.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.015 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1359e-05 s, 0.0 kB/s 2023-10-08T00:28:28.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-08T00:28:28.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.072 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.127 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2402e-05 s, 0.0 kB/s 2023-10-08T00:28:28.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.127 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.183 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0575e-05 s, 0.0 kB/s 2023-10-08T00:28:28.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3858e-05 s, 0.0 kB/s 2023-10-08T00:28:28.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.239 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.295 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0736e-05 s, 0.0 kB/s 2023-10-08T00:28:28.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.351 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4629e-05 s, 0.0 kB/s 2023-10-08T00:28:28.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.351 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3319e-05 s, 0.0 kB/s 2023-10-08T00:28:28.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.408 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.392e-05 s, 0.0 kB/s 2023-10-08T00:28:28.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0391e-05 s, 0.0 kB/s 2023-10-08T00:28:28.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.924e-05 s, 0.0 kB/s 2023-10-08T00:28:28.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1791e-05 s, 0.0 kB/s 2023-10-08T00:28:28.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.632 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0923e-05 s, 0.0 kB/s 2023-10-08T00:28:28.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1964e-05 s, 0.0 kB/s 2023-10-08T00:28:28.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.743 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.203e-05 s, 0.0 kB/s 2023-10-08T00:28:28.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.800 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2422e-05 s, 0.0 kB/s 2023-10-08T00:28:28.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.855 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.911 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3357e-05 s, 0.0 kB/s 2023-10-08T00:28:28.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.912 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:28.967 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9784e-05 s, 0.0 kB/s 2023-10-08T00:28:28.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:28.968 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.023 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.023 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.023 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0585e-05 s, 0.0 kB/s 2023-10-08T00:28:29.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.024 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.079 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4211e-05 s, 0.0 kB/s 2023-10-08T00:28:29.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.298e-05 s, 0.0 kB/s 2023-10-08T00:28:29.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.136 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.191 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2596e-05 s, 0.0 kB/s 2023-10-08T00:28:29.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.191 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.247 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0418e-05 s, 0.0 kB/s 2023-10-08T00:28:29.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.247 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.303 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.303 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.303 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9687e-05 s, 0.0 kB/s 2023-10-08T00:28:29.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.303 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.359 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4674e-05 s, 0.0 kB/s 2023-10-08T00:28:29.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.360 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.415 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.416 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8974e-05 s, 0.0 kB/s 2023-10-08T00:28:29.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.416 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.471 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.472 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4773e-05 s, 0.0 kB/s 2023-10-08T00:28:29.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.472 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.528 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1318e-05 s, 0.0 kB/s 2023-10-08T00:28:29.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.529 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.584 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1034e-05 s, 0.0 kB/s 2023-10-08T00:28:29.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.584 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.640 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.640 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.641 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2338e-05 s, 0.0 kB/s 2023-10-08T00:28:29.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.698 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3932e-05 s, 0.0 kB/s 2023-10-08T00:28:29.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.698 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.754 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.754 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.754 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3379e-05 s, 0.0 kB/s 2023-10-08T00:28:29.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0797e-05 s, 0.0 kB/s 2023-10-08T00:28:29.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.811 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.866 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2042e-05 s, 0.0 kB/s 2023-10-08T00:28:29.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.867 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9446e-05 s, 0.0 kB/s 2023-10-08T00:28:29.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0588e-05 s, 0.0 kB/s 2023-10-08T00:28:29.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:29.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.036 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2881e-05 s, 0.0 kB/s 2023-10-08T00:28:30.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.092 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9938e-05 s, 0.0 kB/s 2023-10-08T00:28:30.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.093 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.147 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.147 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.147 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.998e-05 s, 0.0 kB/s 2023-10-08T00:28:30.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.148 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.203 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.203 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.203 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2646e-05 s, 0.0 kB/s 2023-10-08T00:28:30.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.204 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.265 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.265 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.265 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0208e-05 s, 0.0 kB/s 2023-10-08T00:28:30.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.266 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.331 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5982e-05 s, 0.0 kB/s 2023-10-08T00:28:30.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.394 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.394 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.395 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2635e-05 s, 0.0 kB/s 2023-10-08T00:28:30.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.395 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3603e-05 s, 0.0 kB/s 2023-10-08T00:28:30.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.459 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1177e-05 s, 0.0 kB/s 2023-10-08T00:28:30.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.518 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8989e-05 s, 0.0 kB/s 2023-10-08T00:28:30.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.574 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.632 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.633 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.633 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.348e-05 s, 0.0 kB/s 2023-10-08T00:28:30.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.633 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.691 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1339e-05 s, 0.0 kB/s 2023-10-08T00:28:30.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.692 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.750 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.39e-05 s, 0.0 kB/s 2023-10-08T00:28:30.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.751 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.806 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3841e-05 s, 0.0 kB/s 2023-10-08T00:28:30.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.807 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.889 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.889 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.889 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1205e-05 s, 0.0 kB/s 2023-10-08T00:28:30.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.889 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.136e-05 s, 0.0 kB/s 2023-10-08T00:28:30.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:30.947 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2284e-05 s, 0.0 kB/s 2023-10-08T00:28:31.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.059 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4982e-05 s, 0.0 kB/s 2023-10-08T00:28:31.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.117 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1659e-05 s, 0.0 kB/s 2023-10-08T00:28:31.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.118 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.173 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.173 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.173 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0408e-05 s, 0.0 kB/s 2023-10-08T00:28:31.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.174 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:28:31.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.230 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1517e-05 s, 0.0 kB/s 2023-10-08T00:28:31.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.230 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.271 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:28:31.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1949e-05 s, 0.0 kB/s 2023-10-08T00:28:31.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.287 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.372 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.372 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.372 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.43e-05 s, 0.0 kB/s 2023-10-08T00:28:31.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.373 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.429 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1464e-05 s, 0.0 kB/s 2023-10-08T00:28:31.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.429 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.486 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.993e-05 s, 0.0 kB/s 2023-10-08T00:28:31.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.486 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.541 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.542 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5686e-05 s, 0.0 kB/s 2023-10-08T00:28:31.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.542 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.599 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2995e-05 s, 0.0 kB/s 2023-10-08T00:28:31.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.599 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.655 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1815e-05 s, 0.0 kB/s 2023-10-08T00:28:31.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.711 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.712 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2108e-05 s, 0.0 kB/s 2023-10-08T00:28:31.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.712 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.769 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2124e-05 s, 0.0 kB/s 2023-10-08T00:28:31.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.769 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1533e-05 s, 0.0 kB/s 2023-10-08T00:28:31.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.826 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.881 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.881 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.881 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2585e-05 s, 0.0 kB/s 2023-10-08T00:28:31.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.882 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5361e-05 s, 0.0 kB/s 2023-10-08T00:28:31.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.938 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:31.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:31.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:31.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.296e-05 s, 0.0 kB/s 2023-10-08T00:28:31.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:31.996 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.052 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.052 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0872e-05 s, 0.0 kB/s 2023-10-08T00:28:32.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.052 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3701e-05 s, 0.0 kB/s 2023-10-08T00:28:32.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.108 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.164 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.165 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2891e-05 s, 0.0 kB/s 2023-10-08T00:28:32.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.165 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.220 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.220 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.221 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1351e-05 s, 0.0 kB/s 2023-10-08T00:28:32.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.221 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.278 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4174e-05 s, 0.0 kB/s 2023-10-08T00:28:32.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.278 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.334 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.334 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.334 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1898e-05 s, 0.0 kB/s 2023-10-08T00:28:32.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.335 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.391 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3649e-05 s, 0.0 kB/s 2023-10-08T00:28:32.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.391 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1529e-05 s, 0.0 kB/s 2023-10-08T00:28:32.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.449 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1731e-05 s, 0.0 kB/s 2023-10-08T00:28:32.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.506 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.561 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.562 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2074e-05 s, 0.0 kB/s 2023-10-08T00:28:32.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.562 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4285e-05 s, 0.0 kB/s 2023-10-08T00:28:32.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.618 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.674 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.674 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1081e-05 s, 0.0 kB/s 2023-10-08T00:28:32.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.674 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.731 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.731 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1957e-05 s, 0.0 kB/s 2023-10-08T00:28:32.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.731 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.787 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2846e-05 s, 0.0 kB/s 2023-10-08T00:28:32.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.788 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.844 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3455e-05 s, 0.0 kB/s 2023-10-08T00:28:32.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.845 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.902 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3536e-05 s, 0.0 kB/s 2023-10-08T00:28:32.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:32.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:32.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:32.959 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7769e-05 s, 0.0 kB/s 2023-10-08T00:28:32.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:32.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7485e-05 s, 0.0 kB/s 2023-10-08T00:28:33.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.016 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.071 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.072 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.072 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4555e-05 s, 0.0 kB/s 2023-10-08T00:28:33.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.072 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.128 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.128 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3611e-05 s, 0.0 kB/s 2023-10-08T00:28:33.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.129 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.186 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.186 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.186 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3377e-05 s, 0.0 kB/s 2023-10-08T00:28:33.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.186 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2214e-05 s, 0.0 kB/s 2023-10-08T00:28:33.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.243 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.300 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.314e-05 s, 0.0 kB/s 2023-10-08T00:28:33.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.300 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.354 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.355 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5354e-05 s, 0.0 kB/s 2023-10-08T00:28:33.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.356 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.412 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-08T00:28:33.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.413 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.41e-05 s, 0.0 kB/s 2023-10-08T00:28:33.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.470 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2813e-05 s, 0.0 kB/s 2023-10-08T00:28:33.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.526 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2098e-05 s, 0.0 kB/s 2023-10-08T00:28:33.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.582 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.639 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.117e-05 s, 0.0 kB/s 2023-10-08T00:28:33.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.639 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4451e-05 s, 0.0 kB/s 2023-10-08T00:28:33.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.696 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.751 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.751 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.751 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1976e-05 s, 0.0 kB/s 2023-10-08T00:28:33.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.752 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3999e-05 s, 0.0 kB/s 2023-10-08T00:28:33.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.808 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3749e-05 s, 0.0 kB/s 2023-10-08T00:28:33.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.865 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.920 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.920 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.920 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.383e-05 s, 0.0 kB/s 2023-10-08T00:28:33.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.921 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:33.976 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:33.976 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:33.976 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4133e-05 s, 0.0 kB/s 2023-10-08T00:28:33.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:33.977 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.032 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.033 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.033 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2062e-05 s, 0.0 kB/s 2023-10-08T00:28:34.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.033 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4053e-05 s, 0.0 kB/s 2023-10-08T00:28:34.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.090 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2896e-05 s, 0.0 kB/s 2023-10-08T00:28:34.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.145 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.201 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.201 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.201 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1237e-05 s, 0.0 kB/s 2023-10-08T00:28:34.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.202 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3975e-05 s, 0.0 kB/s 2023-10-08T00:28:34.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.258 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.314 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1184e-05 s, 0.0 kB/s 2023-10-08T00:28:34.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.314 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.370 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1512e-05 s, 0.0 kB/s 2023-10-08T00:28:34.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.370 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.427 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.427 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.427 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9933e-05 s, 0.0 kB/s 2023-10-08T00:28:34.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.428 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1443e-05 s, 0.0 kB/s 2023-10-08T00:28:34.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.484 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.540 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.540 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.540 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0029e-05 s, 0.0 kB/s 2023-10-08T00:28:34.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.541 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.595 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.595 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.595 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1739e-05 s, 0.0 kB/s 2023-10-08T00:28:34.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.596 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.652 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.652 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.652 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3695e-05 s, 0.0 kB/s 2023-10-08T00:28:34.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.653 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.708 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.708 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.203e-05 s, 0.0 kB/s 2023-10-08T00:28:34.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.709 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.764 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.764 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.144e-05 s, 0.0 kB/s 2023-10-08T00:28:34.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.764 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.820 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.820 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.25e-05 s, 0.0 kB/s 2023-10-08T00:28:34.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.821 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.876 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2122e-05 s, 0.0 kB/s 2023-10-08T00:28:34.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.877 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.932 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.932 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.932 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2011e-05 s, 0.0 kB/s 2023-10-08T00:28:34.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.932 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4303e-05 s, 0.0 kB/s 2023-10-08T00:28:34.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:34.989 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.045 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.045 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0609e-05 s, 0.0 kB/s 2023-10-08T00:28:35.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.046 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0846e-05 s, 0.0 kB/s 2023-10-08T00:28:35.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.159 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2532e-05 s, 0.0 kB/s 2023-10-08T00:28:35.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.160 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.215 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.077e-05 s, 0.0 kB/s 2023-10-08T00:28:35.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.216 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.272 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.218e-05 s, 0.0 kB/s 2023-10-08T00:28:35.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.272 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.327 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.401e-05 s, 0.0 kB/s 2023-10-08T00:28:35.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.328 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.383 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1736e-05 s, 0.0 kB/s 2023-10-08T00:28:35.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.384 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.440 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.119e-05 s, 0.0 kB/s 2023-10-08T00:28:35.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.440 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.495 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4809e-05 s, 0.0 kB/s 2023-10-08T00:28:35.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.552 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0737e-05 s, 0.0 kB/s 2023-10-08T00:28:35.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.609 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1767e-05 s, 0.0 kB/s 2023-10-08T00:28:35.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.609 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.666 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3668e-05 s, 0.0 kB/s 2023-10-08T00:28:35.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.666 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.721 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.721 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.05e-05 s, 0.0 kB/s 2023-10-08T00:28:35.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.722 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.778 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.779 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3024e-05 s, 0.0 kB/s 2023-10-08T00:28:35.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.779 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2577e-05 s, 0.0 kB/s 2023-10-08T00:28:35.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0566e-05 s, 0.0 kB/s 2023-10-08T00:28:35.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.892 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:35.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:35.948 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:35.948 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2597e-05 s, 0.0 kB/s 2023-10-08T00:28:35.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:35.948 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.004 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.004 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.004 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3012e-05 s, 0.0 kB/s 2023-10-08T00:28:36.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.005 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.062 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-08T00:28:36.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0153e-05 s, 0.0 kB/s 2023-10-08T00:28:36.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.174 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2397e-05 s, 0.0 kB/s 2023-10-08T00:28:36.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2267e-05 s, 0.0 kB/s 2023-10-08T00:28:36.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.231 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.286 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.481e-05 s, 0.0 kB/s 2023-10-08T00:28:36.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.287 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.342 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0654e-05 s, 0.0 kB/s 2023-10-08T00:28:36.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.343 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.398 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.398 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.13e-05 s, 0.0 kB/s 2023-10-08T00:28:36.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.399 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.457 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3576e-05 s, 0.0 kB/s 2023-10-08T00:28:36.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.458 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.510 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.510 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1109e-05 s, 0.0 kB/s 2023-10-08T00:28:36.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1705e-05 s, 0.0 kB/s 2023-10-08T00:28:36.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.567 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.28e-05 s, 0.0 kB/s 2023-10-08T00:28:36.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.682 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.682 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.682 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2191e-05 s, 0.0 kB/s 2023-10-08T00:28:36.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.682 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.738 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1315e-05 s, 0.0 kB/s 2023-10-08T00:28:36.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.738 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.794 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.794 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.794 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4175e-05 s, 0.0 kB/s 2023-10-08T00:28:36.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.795 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0589e-05 s, 0.0 kB/s 2023-10-08T00:28:36.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.851 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1381e-05 s, 0.0 kB/s 2023-10-08T00:28:36.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.908 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:36.963 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:36.964 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:36.964 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1393e-05 s, 0.0 kB/s 2023-10-08T00:28:36.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:36.964 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.020 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.021 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.021 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.469e-05 s, 0.0 kB/s 2023-10-08T00:28:37.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.021 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.077 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.077 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.077 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1284e-05 s, 0.0 kB/s 2023-10-08T00:28:37.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.077 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1943e-05 s, 0.0 kB/s 2023-10-08T00:28:37.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.133 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.189 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.189 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.189 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1133e-05 s, 0.0 kB/s 2023-10-08T00:28:37.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.189 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.245 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.245 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.245 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.201e-05 s, 0.0 kB/s 2023-10-08T00:28:37.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.246 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.301 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.301 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.301 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2259e-05 s, 0.0 kB/s 2023-10-08T00:28:37.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.301 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.357 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.357 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.357 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9564e-05 s, 0.0 kB/s 2023-10-08T00:28:37.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.357 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.413 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2403e-05 s, 0.0 kB/s 2023-10-08T00:28:37.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.413 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.469 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4179e-05 s, 0.0 kB/s 2023-10-08T00:28:37.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.470 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.524 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.525 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0821e-05 s, 0.0 kB/s 2023-10-08T00:28:37.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.525 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.581 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-08T00:28:37.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.582 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.638 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2403e-05 s, 0.0 kB/s 2023-10-08T00:28:37.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.638 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.693 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.693 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.694 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-08T00:28:37.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.694 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.748 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.749 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.749 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4363e-05 s, 0.0 kB/s 2023-10-08T00:28:37.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.750 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.805 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.806 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-08T00:28:37.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.807 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4647e-05 s, 0.0 kB/s 2023-10-08T00:28:37.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.864 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.919 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.919 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0712e-05 s, 0.0 kB/s 2023-10-08T00:28:37.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.920 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:37.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:37.976 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:37.976 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3911e-05 s, 0.0 kB/s 2023-10-08T00:28:37.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:37.976 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.032 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8738e-05 s, 0.0 kB/s 2023-10-08T00:28:38.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.033 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.088 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.088 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.089 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.309e-05 s, 0.0 kB/s 2023-10-08T00:28:38.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.089 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.144 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.381e-05 s, 0.0 kB/s 2023-10-08T00:28:38.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.145 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.200 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3264e-05 s, 0.0 kB/s 2023-10-08T00:28:38.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.200 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.256 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2871e-05 s, 0.0 kB/s 2023-10-08T00:28:38.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.257 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.312 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0899e-05 s, 0.0 kB/s 2023-10-08T00:28:38.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.313 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.368 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0879e-05 s, 0.0 kB/s 2023-10-08T00:28:38.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.368 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.424 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1654e-05 s, 0.0 kB/s 2023-10-08T00:28:38.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.425 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2002e-05 s, 0.0 kB/s 2023-10-08T00:28:38.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.482 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3468e-05 s, 0.0 kB/s 2023-10-08T00:28:38.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.537 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3756e-05 s, 0.0 kB/s 2023-10-08T00:28:38.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.594 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0933e-05 s, 0.0 kB/s 2023-10-08T00:28:38.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.650 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.705 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.41e-05 s, 0.0 kB/s 2023-10-08T00:28:38.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.706 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5021e-05 s, 0.0 kB/s 2023-10-08T00:28:38.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.761 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.141e-05 s, 0.0 kB/s 2023-10-08T00:28:38.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.873 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9217e-05 s, 0.0 kB/s 2023-10-08T00:28:38.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.874 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.929 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1004e-05 s, 0.0 kB/s 2023-10-08T00:28:38.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.930 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:38.985 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2043e-05 s, 0.0 kB/s 2023-10-08T00:28:38.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:38.986 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-08T00:28:39.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.042 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.098 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.098 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.098 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3563e-05 s, 0.0 kB/s 2023-10-08T00:28:39.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.099 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1865e-05 s, 0.0 kB/s 2023-10-08T00:28:39.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.156 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.212 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2065e-05 s, 0.0 kB/s 2023-10-08T00:28:39.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.212 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.268 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2599e-05 s, 0.0 kB/s 2023-10-08T00:28:39.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.269 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.324 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1116e-05 s, 0.0 kB/s 2023-10-08T00:28:39.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.324 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.380 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.380 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.380 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-08T00:28:39.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.381 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.437 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.437 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.437 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1479e-05 s, 0.0 kB/s 2023-10-08T00:28:39.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.437 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.492 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.299e-05 s, 0.0 kB/s 2023-10-08T00:28:39.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.493 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.550 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1441e-05 s, 0.0 kB/s 2023-10-08T00:28:39.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.551 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.607 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4591e-05 s, 0.0 kB/s 2023-10-08T00:28:39.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.608 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5633e-05 s, 0.0 kB/s 2023-10-08T00:28:39.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.665 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.720 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-08T00:28:39.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.721 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.776 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1557e-05 s, 0.0 kB/s 2023-10-08T00:28:39.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.776 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.831 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0462e-05 s, 0.0 kB/s 2023-10-08T00:28:39.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.832 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.888 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.443e-05 s, 0.0 kB/s 2023-10-08T00:28:39.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.889 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3753e-05 s, 0.0 kB/s 2023-10-08T00:28:39.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:39.948 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4419e-05 s, 0.0 kB/s 2023-10-08T00:28:40.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.059 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1691e-05 s, 0.0 kB/s 2023-10-08T00:28:40.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1776e-05 s, 0.0 kB/s 2023-10-08T00:28:40.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.117 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.172 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4682e-05 s, 0.0 kB/s 2023-10-08T00:28:40.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.173 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1588e-05 s, 0.0 kB/s 2023-10-08T00:28:40.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.228 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0751e-05 s, 0.0 kB/s 2023-10-08T00:28:40.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.285 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.340 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1222e-05 s, 0.0 kB/s 2023-10-08T00:28:40.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.341 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.396 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1387e-05 s, 0.0 kB/s 2023-10-08T00:28:40.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.462 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 6.4808e-05 s, 0.0 kB/s 2023-10-08T00:28:40.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.462 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1049e-05 s, 0.0 kB/s 2023-10-08T00:28:40.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.574 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2639e-05 s, 0.0 kB/s 2023-10-08T00:28:40.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.574 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.630 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0185e-05 s, 0.0 kB/s 2023-10-08T00:28:40.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.686 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3421e-05 s, 0.0 kB/s 2023-10-08T00:28:40.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.687 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.743 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3761e-05 s, 0.0 kB/s 2023-10-08T00:28:40.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.743 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.801 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-08T00:28:40.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.802 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.861 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3239e-05 s, 0.0 kB/s 2023-10-08T00:28:40.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.863 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1847e-05 s, 0.0 kB/s 2023-10-08T00:28:40.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:40.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:40.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:40.986 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1591e-05 s, 0.0 kB/s 2023-10-08T00:28:40.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:40.986 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-08T00:28:41.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.047 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.106 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.106 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.106 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6786e-05 s, 0.0 kB/s 2023-10-08T00:28:41.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.107 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.163 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0162e-05 s, 0.0 kB/s 2023-10-08T00:28:41.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.164 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.220 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.221 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2402e-05 s, 0.0 kB/s 2023-10-08T00:28:41.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.221 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.278 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-08T00:28:41.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.278 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.332 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.333 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.333 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0732e-05 s, 0.0 kB/s 2023-10-08T00:28:41.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.334 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1468e-05 s, 0.0 kB/s 2023-10-08T00:28:41.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.390 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.446 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.446 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.446 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5374e-05 s, 0.0 kB/s 2023-10-08T00:28:41.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.446 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.502 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.502 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.502 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0805e-05 s, 0.0 kB/s 2023-10-08T00:28:41.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.503 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.558 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0774e-05 s, 0.0 kB/s 2023-10-08T00:28:41.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.559 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.614 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1139e-05 s, 0.0 kB/s 2023-10-08T00:28:41.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.615 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0838e-05 s, 0.0 kB/s 2023-10-08T00:28:41.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.671 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.726 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3244e-05 s, 0.0 kB/s 2023-10-08T00:28:41.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.727 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.782 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9325e-05 s, 0.0 kB/s 2023-10-08T00:28:41.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.838 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.252e-05 s, 0.0 kB/s 2023-10-08T00:28:41.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.839 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.894 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.03e-05 s, 0.0 kB/s 2023-10-08T00:28:41.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.895 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:41.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:41.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:41.951 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5127e-05 s, 0.0 kB/s 2023-10-08T00:28:41.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:41.951 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.007 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.007 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.007 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-08T00:28:42.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0181e-05 s, 0.0 kB/s 2023-10-08T00:28:42.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.148 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.254e-05 s, 0.0 kB/s 2023-10-08T00:28:42.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.148 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.165 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.165 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.165 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-08T00:28:42.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.165 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.221 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.008e-05 s, 0.0 kB/s 2023-10-08T00:28:42.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.222 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1471e-05 s, 0.0 kB/s 2023-10-08T00:28:42.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.278 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0559e-05 s, 0.0 kB/s 2023-10-08T00:28:42.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.334 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.389 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.389 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.389 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2575e-05 s, 0.0 kB/s 2023-10-08T00:28:42.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.389 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.445 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4461e-05 s, 0.0 kB/s 2023-10-08T00:28:42.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.446 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.501 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.502 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5521e-05 s, 0.0 kB/s 2023-10-08T00:28:42.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.502 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.557 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.558 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6516e-05 s, 0.0 kB/s 2023-10-08T00:28:42.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.558 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.615 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8312e-05 s, 0.0 kB/s 2023-10-08T00:28:42.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.615 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.671 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.671 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.671 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.344e-05 s, 0.0 kB/s 2023-10-08T00:28:42.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.671 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.727 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.727 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.727 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3216e-05 s, 0.0 kB/s 2023-10-08T00:28:42.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.727 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.783 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.345e-05 s, 0.0 kB/s 2023-10-08T00:28:42.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.839 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0414e-05 s, 0.0 kB/s 2023-10-08T00:28:42.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.840 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.896 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9909e-05 s, 0.0 kB/s 2023-10-08T00:28:42.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.897 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:42.952 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:42.952 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:42.952 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9103e-05 s, 0.0 kB/s 2023-10-08T00:28:42.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:42.952 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.010 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.010 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.010 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2887e-05 s, 0.0 kB/s 2023-10-08T00:28:43.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.011 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.066 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.066 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.066 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2168e-05 s, 0.0 kB/s 2023-10-08T00:28:43.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.067 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.122 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.122 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.122 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9268e-05 s, 0.0 kB/s 2023-10-08T00:28:43.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.122 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.178 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.546e-05 s, 0.0 kB/s 2023-10-08T00:28:43.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.179 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.233 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.233 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.234 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1755e-05 s, 0.0 kB/s 2023-10-08T00:28:43.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.235 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.291 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.291 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.291 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2788e-05 s, 0.0 kB/s 2023-10-08T00:28:43.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.292 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2682e-05 s, 0.0 kB/s 2023-10-08T00:28:43.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.347 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.403 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.08e-05 s, 0.0 kB/s 2023-10-08T00:28:43.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.460 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1812e-05 s, 0.0 kB/s 2023-10-08T00:28:43.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.461 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.517 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2711e-05 s, 0.0 kB/s 2023-10-08T00:28:43.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.518 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.575 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0583e-05 s, 0.0 kB/s 2023-10-08T00:28:43.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.576 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.632 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2978e-05 s, 0.0 kB/s 2023-10-08T00:28:43.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.632 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3221e-05 s, 0.0 kB/s 2023-10-08T00:28:43.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.743 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0541e-05 s, 0.0 kB/s 2023-10-08T00:28:43.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.743 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.799 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.799 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.799 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.011e-05 s, 0.0 kB/s 2023-10-08T00:28:43.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.799 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.855 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1833e-05 s, 0.0 kB/s 2023-10-08T00:28:43.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.856 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.911 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2273e-05 s, 0.0 kB/s 2023-10-08T00:28:43.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.911 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1142e-05 s, 0.0 kB/s 2023-10-08T00:28:43.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:43.968 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0707e-05 s, 0.0 kB/s 2023-10-08T00:28:44.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.024 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.079 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4022e-05 s, 0.0 kB/s 2023-10-08T00:28:44.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.080 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.134 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1572e-05 s, 0.0 kB/s 2023-10-08T00:28:44.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.136 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.192 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0717e-05 s, 0.0 kB/s 2023-10-08T00:28:44.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.192 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2298e-05 s, 0.0 kB/s 2023-10-08T00:28:44.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.248 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.304 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-08T00:28:44.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.305 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.360 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.233e-05 s, 0.0 kB/s 2023-10-08T00:28:44.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.361 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.416 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.385e-05 s, 0.0 kB/s 2023-10-08T00:28:44.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.472 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1371e-05 s, 0.0 kB/s 2023-10-08T00:28:44.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.473 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.411e-05 s, 0.0 kB/s 2023-10-08T00:28:44.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.529 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.585 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9822e-05 s, 0.0 kB/s 2023-10-08T00:28:44.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.586 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.642 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.642 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.303e-05 s, 0.0 kB/s 2023-10-08T00:28:44.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.699 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-08T00:28:44.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.700 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1912e-05 s, 0.0 kB/s 2023-10-08T00:28:44.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.756 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4578e-05 s, 0.0 kB/s 2023-10-08T00:28:44.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3083e-05 s, 0.0 kB/s 2023-10-08T00:28:44.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2159e-05 s, 0.0 kB/s 2023-10-08T00:28:44.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2813e-05 s, 0.0 kB/s 2023-10-08T00:28:44.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:44.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.036 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2641e-05 s, 0.0 kB/s 2023-10-08T00:28:45.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.092 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2452e-05 s, 0.0 kB/s 2023-10-08T00:28:45.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.092 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9574e-05 s, 0.0 kB/s 2023-10-08T00:28:45.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.205 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.287e-05 s, 0.0 kB/s 2023-10-08T00:28:45.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.206 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.261 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0614e-05 s, 0.0 kB/s 2023-10-08T00:28:45.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.262 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.317 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3593e-05 s, 0.0 kB/s 2023-10-08T00:28:45.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.318 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.373 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.373 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.373 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9473e-05 s, 0.0 kB/s 2023-10-08T00:28:45.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.374 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.429 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2127e-05 s, 0.0 kB/s 2023-10-08T00:28:45.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.429 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.485 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1994e-05 s, 0.0 kB/s 2023-10-08T00:28:45.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.486 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.541 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.553 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.553 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9999e-05 s, 0.0 kB/s 2023-10-08T00:28:45.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.553 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2741e-05 s, 0.0 kB/s 2023-10-08T00:28:45.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.598 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.655 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.655 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.655 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1818e-05 s, 0.0 kB/s 2023-10-08T00:28:45.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.656 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.712 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5078e-05 s, 0.0 kB/s 2023-10-08T00:28:45.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.713 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.768 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1537e-05 s, 0.0 kB/s 2023-10-08T00:28:45.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.768 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.824 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1486e-05 s, 0.0 kB/s 2023-10-08T00:28:45.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.882 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0469e-05 s, 0.0 kB/s 2023-10-08T00:28:45.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.883 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2556e-05 s, 0.0 kB/s 2023-10-08T00:28:45.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.939 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:45.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:45.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:45.994 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3492e-05 s, 0.0 kB/s 2023-10-08T00:28:45.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:45.995 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.050 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.050 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.051 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-08T00:28:46.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.051 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.106 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.106 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.106 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3351e-05 s, 0.0 kB/s 2023-10-08T00:28:46.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.107 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.162 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.171e-05 s, 0.0 kB/s 2023-10-08T00:28:46.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.163 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.219 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.197e-05 s, 0.0 kB/s 2023-10-08T00:28:46.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.219 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.274 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2689e-05 s, 0.0 kB/s 2023-10-08T00:28:46.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.275 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0531e-05 s, 0.0 kB/s 2023-10-08T00:28:46.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.388 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1271e-05 s, 0.0 kB/s 2023-10-08T00:28:46.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.388 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1153e-05 s, 0.0 kB/s 2023-10-08T00:28:46.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.445 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0815e-05 s, 0.0 kB/s 2023-10-08T00:28:46.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.503 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.558 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3549e-05 s, 0.0 kB/s 2023-10-08T00:28:46.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.559 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.614 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2592e-05 s, 0.0 kB/s 2023-10-08T00:28:46.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.615 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.670 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1393e-05 s, 0.0 kB/s 2023-10-08T00:28:46.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.671 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.726 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1953e-05 s, 0.0 kB/s 2023-10-08T00:28:46.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.727 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.783 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0587e-05 s, 0.0 kB/s 2023-10-08T00:28:46.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.838 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.393e-05 s, 0.0 kB/s 2023-10-08T00:28:46.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.839 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.894 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2014e-05 s, 0.0 kB/s 2023-10-08T00:28:46.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.895 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:46.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:46.951 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9987e-05 s, 0.0 kB/s 2023-10-08T00:28:46.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:46.951 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.006 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3203e-05 s, 0.0 kB/s 2023-10-08T00:28:47.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1076e-05 s, 0.0 kB/s 2023-10-08T00:28:47.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.062 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.118 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4572e-05 s, 0.0 kB/s 2023-10-08T00:28:47.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.174 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0925e-05 s, 0.0 kB/s 2023-10-08T00:28:47.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0697e-05 s, 0.0 kB/s 2023-10-08T00:28:47.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.231 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8892e-05 s, 0.0 kB/s 2023-10-08T00:28:47.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.343 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2313e-05 s, 0.0 kB/s 2023-10-08T00:28:47.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.399 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3329e-05 s, 0.0 kB/s 2023-10-08T00:28:47.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1669e-05 s, 0.0 kB/s 2023-10-08T00:28:47.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.455 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4627e-05 s, 0.0 kB/s 2023-10-08T00:28:47.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0653e-05 s, 0.0 kB/s 2023-10-08T00:28:47.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.568 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4392e-05 s, 0.0 kB/s 2023-10-08T00:28:47.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1816e-05 s, 0.0 kB/s 2023-10-08T00:28:47.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.737 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3228e-05 s, 0.0 kB/s 2023-10-08T00:28:47.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.738 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.810 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.746e-05 s, 0.0 kB/s 2023-10-08T00:28:47.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.810 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3262e-05 s, 0.0 kB/s 2023-10-08T00:28:47.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.867 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.22e-05 s, 0.0 kB/s 2023-10-08T00:28:47.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:47.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:47.978 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9235e-05 s, 0.0 kB/s 2023-10-08T00:28:47.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:47.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.036 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-08T00:28:48.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.037 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.092 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1966e-05 s, 0.0 kB/s 2023-10-08T00:28:48.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.093 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1424e-05 s, 0.0 kB/s 2023-10-08T00:28:48.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.148 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.204 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0101e-05 s, 0.0 kB/s 2023-10-08T00:28:48.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.205 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.261 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3332e-05 s, 0.0 kB/s 2023-10-08T00:28:48.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.262 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.318 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.183e-05 s, 0.0 kB/s 2023-10-08T00:28:48.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.319 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1046e-05 s, 0.0 kB/s 2023-10-08T00:28:48.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.375 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.430 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.192e-05 s, 0.0 kB/s 2023-10-08T00:28:48.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.430 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.486 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2373e-05 s, 0.0 kB/s 2023-10-08T00:28:48.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.487 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.542 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.155e-05 s, 0.0 kB/s 2023-10-08T00:28:48.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.543 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9734e-05 s, 0.0 kB/s 2023-10-08T00:28:48.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.599 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2371e-05 s, 0.0 kB/s 2023-10-08T00:28:48.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.710 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.710 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.710 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.011e-05 s, 0.0 kB/s 2023-10-08T00:28:48.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.710 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4591e-05 s, 0.0 kB/s 2023-10-08T00:28:48.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.767 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0261e-05 s, 0.0 kB/s 2023-10-08T00:28:48.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.823 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2917e-05 s, 0.0 kB/s 2023-10-08T00:28:48.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.879 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.935 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.094e-05 s, 0.0 kB/s 2023-10-08T00:28:48.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.935 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:48.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:48.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:48.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.256e-05 s, 0.0 kB/s 2023-10-08T00:28:48.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:48.991 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9625e-05 s, 0.0 kB/s 2023-10-08T00:28:49.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.047 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.102 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3683e-05 s, 0.0 kB/s 2023-10-08T00:28:49.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3009e-05 s, 0.0 kB/s 2023-10-08T00:28:49.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.158 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.214 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4556e-05 s, 0.0 kB/s 2023-10-08T00:28:49.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.215 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.271 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.361e-05 s, 0.0 kB/s 2023-10-08T00:28:49.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.271 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.327 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.327 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0227e-05 s, 0.0 kB/s 2023-10-08T00:28:49.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.383 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2111e-05 s, 0.0 kB/s 2023-10-08T00:28:49.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.384 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.438 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2091e-05 s, 0.0 kB/s 2023-10-08T00:28:49.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.439 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3741e-05 s, 0.0 kB/s 2023-10-08T00:28:49.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3518e-05 s, 0.0 kB/s 2023-10-08T00:28:49.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5769e-05 s, 0.0 kB/s 2023-10-08T00:28:49.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.608 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.664 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.254e-05 s, 0.0 kB/s 2023-10-08T00:28:49.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.664 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.720 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.721 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.721 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2566e-05 s, 0.0 kB/s 2023-10-08T00:28:49.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.721 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.777 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.777 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.777 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2008e-05 s, 0.0 kB/s 2023-10-08T00:28:49.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.778 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6293e-05 s, 0.0 kB/s 2023-10-08T00:28:49.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.834 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.889 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0296e-05 s, 0.0 kB/s 2023-10-08T00:28:49.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.890 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:49.944 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:49.944 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:49.944 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9443e-05 s, 0.0 kB/s 2023-10-08T00:28:49.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:49.945 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.001 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.002 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.002 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-08T00:28:50.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.002 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.058 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.058 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.058 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1162e-05 s, 0.0 kB/s 2023-10-08T00:28:50.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.058 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2062e-05 s, 0.0 kB/s 2023-10-08T00:28:50.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.115 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1e-05 s, 0.0 kB/s 2023-10-08T00:28:50.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.171 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.226 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.226 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.226 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0208e-05 s, 0.0 kB/s 2023-10-08T00:28:50.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.227 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.283 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.283 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.082e-05 s, 0.0 kB/s 2023-10-08T00:28:50.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.283 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.338 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.339 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0651e-05 s, 0.0 kB/s 2023-10-08T00:28:50.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.340 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.396 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9924e-05 s, 0.0 kB/s 2023-10-08T00:28:50.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1615e-05 s, 0.0 kB/s 2023-10-08T00:28:50.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.453 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.509 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-08T00:28:50.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.509 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.565 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1317e-05 s, 0.0 kB/s 2023-10-08T00:28:50.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.566 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3208e-05 s, 0.0 kB/s 2023-10-08T00:28:50.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.622 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3462e-05 s, 0.0 kB/s 2023-10-08T00:28:50.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.736 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.736 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3723e-05 s, 0.0 kB/s 2023-10-08T00:28:50.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.736 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.793 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1456e-05 s, 0.0 kB/s 2023-10-08T00:28:50.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.793 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.849 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.850 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.850 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.397e-05 s, 0.0 kB/s 2023-10-08T00:28:50.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.850 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.906 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.907 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-08T00:28:50.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.907 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:50.963 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:50.964 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:50.964 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-08T00:28:50.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:50.964 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.022 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2167e-05 s, 0.0 kB/s 2023-10-08T00:28:51.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.023 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3681e-05 s, 0.0 kB/s 2023-10-08T00:28:51.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.083 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1385e-05 s, 0.0 kB/s 2023-10-08T00:28:51.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.141 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.200 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9231e-05 s, 0.0 kB/s 2023-10-08T00:28:51.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.200 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.256 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1233e-05 s, 0.0 kB/s 2023-10-08T00:28:51.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.257 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.313 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.313 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9206e-05 s, 0.0 kB/s 2023-10-08T00:28:51.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.314 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.369 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.369 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.369 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9839e-05 s, 0.0 kB/s 2023-10-08T00:28:51.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.370 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.425 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1424e-05 s, 0.0 kB/s 2023-10-08T00:28:51.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.426 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.481 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4449e-05 s, 0.0 kB/s 2023-10-08T00:28:51.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.482 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.122e-05 s, 0.0 kB/s 2023-10-08T00:28:51.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.537 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4669e-05 s, 0.0 kB/s 2023-10-08T00:28:51.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.594 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.650 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4762e-05 s, 0.0 kB/s 2023-10-08T00:28:51.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.651 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.707 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2086e-05 s, 0.0 kB/s 2023-10-08T00:28:51.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.707 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.762 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2062e-05 s, 0.0 kB/s 2023-10-08T00:28:51.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.763 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.819 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3687e-05 s, 0.0 kB/s 2023-10-08T00:28:51.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.876 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1323e-05 s, 0.0 kB/s 2023-10-08T00:28:51.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.933 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.933 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.303e-05 s, 0.0 kB/s 2023-10-08T00:28:51.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.933 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:51.989 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:51.989 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:51.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3362e-05 s, 0.0 kB/s 2023-10-08T00:28:51.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:51.990 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.045 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.045 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.045 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-08T00:28:52.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.046 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.101 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.101 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.101 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.922e-05 s, 0.0 kB/s 2023-10-08T00:28:52.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.102 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.157 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.964e-05 s, 0.0 kB/s 2023-10-08T00:28:52.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.158 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1132e-05 s, 0.0 kB/s 2023-10-08T00:28:52.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.269 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.269 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.269 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0987e-05 s, 0.0 kB/s 2023-10-08T00:28:52.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.270 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0009e-05 s, 0.0 kB/s 2023-10-08T00:28:52.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.326 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.382 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0627e-05 s, 0.0 kB/s 2023-10-08T00:28:52.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.382 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.438 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3298e-05 s, 0.0 kB/s 2023-10-08T00:28:52.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.439 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.494 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0318e-05 s, 0.0 kB/s 2023-10-08T00:28:52.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.495 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.551 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0445e-05 s, 0.0 kB/s 2023-10-08T00:28:52.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.551 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.606 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0563e-05 s, 0.0 kB/s 2023-10-08T00:28:52.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.606 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.662 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.663 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2427e-05 s, 0.0 kB/s 2023-10-08T00:28:52.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.663 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.719 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3555e-05 s, 0.0 kB/s 2023-10-08T00:28:52.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.720 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4435e-05 s, 0.0 kB/s 2023-10-08T00:28:52.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.776 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.830 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3079e-05 s, 0.0 kB/s 2023-10-08T00:28:52.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.834 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.893 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3972e-05 s, 0.0 kB/s 2023-10-08T00:28:52.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.894 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:52.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:52.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:52.949 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3259e-05 s, 0.0 kB/s 2023-10-08T00:28:52.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:52.950 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.005 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9765e-05 s, 0.0 kB/s 2023-10-08T00:28:53.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.006 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.061 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2598e-05 s, 0.0 kB/s 2023-10-08T00:28:53.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.062 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8376e-05 s, 0.0 kB/s 2023-10-08T00:28:53.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.118 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.173 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.173 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.173 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0233e-05 s, 0.0 kB/s 2023-10-08T00:28:53.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.174 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.229 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.142e-05 s, 0.0 kB/s 2023-10-08T00:28:53.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.230 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.285 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.285 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.285 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9919e-05 s, 0.0 kB/s 2023-10-08T00:28:53.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.286 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.341 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.341 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.341 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9822e-05 s, 0.0 kB/s 2023-10-08T00:28:53.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.342 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.397 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2475e-05 s, 0.0 kB/s 2023-10-08T00:28:53.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.398 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.453 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.93e-05 s, 0.0 kB/s 2023-10-08T00:28:53.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.454 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.509 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4047e-05 s, 0.0 kB/s 2023-10-08T00:28:53.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.510 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.565 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0184e-05 s, 0.0 kB/s 2023-10-08T00:28:53.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.566 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.621 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0879e-05 s, 0.0 kB/s 2023-10-08T00:28:53.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.622 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.677 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3469e-05 s, 0.0 kB/s 2023-10-08T00:28:53.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.678 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.733 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.733 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.733 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.774e-05 s, 0.0 kB/s 2023-10-08T00:28:53.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.734 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.789 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2476e-05 s, 0.0 kB/s 2023-10-08T00:28:53.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.789 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.845 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.092e-05 s, 0.0 kB/s 2023-10-08T00:28:53.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.846 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.901 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9857e-05 s, 0.0 kB/s 2023-10-08T00:28:53.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:53.957 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:53.957 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:53.957 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1769e-05 s, 0.0 kB/s 2023-10-08T00:28:53.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:53.958 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.013 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0687e-05 s, 0.0 kB/s 2023-10-08T00:28:54.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.013 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.069 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1154e-05 s, 0.0 kB/s 2023-10-08T00:28:54.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.070 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.125 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0436e-05 s, 0.0 kB/s 2023-10-08T00:28:54.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.126 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.181 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.181 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.181 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1858e-05 s, 0.0 kB/s 2023-10-08T00:28:54.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.182 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.237 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2359e-05 s, 0.0 kB/s 2023-10-08T00:28:54.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.237 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.293 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.293 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.293 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9506e-05 s, 0.0 kB/s 2023-10-08T00:28:54.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.294 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.350 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.350 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9459e-05 s, 0.0 kB/s 2023-10-08T00:28:54.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.350 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.406 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3923e-05 s, 0.0 kB/s 2023-10-08T00:28:54.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.407 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9563e-05 s, 0.0 kB/s 2023-10-08T00:28:54.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.463 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.518 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1008e-05 s, 0.0 kB/s 2023-10-08T00:28:54.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0697e-05 s, 0.0 kB/s 2023-10-08T00:28:54.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2758e-05 s, 0.0 kB/s 2023-10-08T00:28:54.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.445e-05 s, 0.0 kB/s 2023-10-08T00:28:54.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5183e-05 s, 0.0 kB/s 2023-10-08T00:28:54.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.800 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0273e-05 s, 0.0 kB/s 2023-10-08T00:28:54.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.856 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4599e-05 s, 0.0 kB/s 2023-10-08T00:28:54.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.857 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.913 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0182e-05 s, 0.0 kB/s 2023-10-08T00:28:54.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.914 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:54.969 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0755e-05 s, 0.0 kB/s 2023-10-08T00:28:54.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:54.970 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.025 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1729e-05 s, 0.0 kB/s 2023-10-08T00:28:55.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.026 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.081 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.082 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3799e-05 s, 0.0 kB/s 2023-10-08T00:28:55.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.082 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.138 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-08T00:28:55.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.139 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-08T00:28:55.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.196 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.250 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.251 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9267e-05 s, 0.0 kB/s 2023-10-08T00:28:55.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.252 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.308 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.308 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.308 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.009e-05 s, 0.0 kB/s 2023-10-08T00:28:55.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.309 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1071e-05 s, 0.0 kB/s 2023-10-08T00:28:55.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.365 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4873e-05 s, 0.0 kB/s 2023-10-08T00:28:55.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.420 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.476 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.476 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.476 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5321e-05 s, 0.0 kB/s 2023-10-08T00:28:55.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.477 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.532 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.532 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.532 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3299e-05 s, 0.0 kB/s 2023-10-08T00:28:55.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.532 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.588 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.588 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.588 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1331e-05 s, 0.0 kB/s 2023-10-08T00:28:55.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.588 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.644 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.644 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.644 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.8408e-05 s, 0.0 kB/s 2023-10-08T00:28:55.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.645 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.703 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-08T00:28:55.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.704 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.759 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.759 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.759 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0668e-05 s, 0.0 kB/s 2023-10-08T00:28:55.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.760 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.815 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.815 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.815 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3232e-05 s, 0.0 kB/s 2023-10-08T00:28:55.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.815 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.872 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3272e-05 s, 0.0 kB/s 2023-10-08T00:28:55.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.872 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.928 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1466e-05 s, 0.0 kB/s 2023-10-08T00:28:55.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.928 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:55.983 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:55.983 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:55.984 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2793e-05 s, 0.0 kB/s 2023-10-08T00:28:55.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:55.984 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.038 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.039 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.039 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0587e-05 s, 0.0 kB/s 2023-10-08T00:28:56.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.040 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.096 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.096 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.096 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-08T00:28:56.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.096 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.152 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.152 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.152 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3845e-05 s, 0.0 kB/s 2023-10-08T00:28:56.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.152 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4298e-05 s, 0.0 kB/s 2023-10-08T00:28:56.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.209 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.264 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1201e-05 s, 0.0 kB/s 2023-10-08T00:28:56.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.265 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.320 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.320 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.320 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0723e-05 s, 0.0 kB/s 2023-10-08T00:28:56.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.320 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.286e-05 s, 0.0 kB/s 2023-10-08T00:28:56.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.377 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4277e-05 s, 0.0 kB/s 2023-10-08T00:28:56.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.432 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9475e-05 s, 0.0 kB/s 2023-10-08T00:28:56.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.544 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.545 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.545 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4213e-05 s, 0.0 kB/s 2023-10-08T00:28:56.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.545 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.601 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3158e-05 s, 0.0 kB/s 2023-10-08T00:28:56.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.602 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.657 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.658 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1479e-05 s, 0.0 kB/s 2023-10-08T00:28:56.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.658 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.713 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.713 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.713 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0501e-05 s, 0.0 kB/s 2023-10-08T00:28:56.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.714 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.769 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2102e-05 s, 0.0 kB/s 2023-10-08T00:28:56.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.770 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.825 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3981e-05 s, 0.0 kB/s 2023-10-08T00:28:56.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2043e-05 s, 0.0 kB/s 2023-10-08T00:28:56.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.882 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.938 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.938 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.938 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-08T00:28:56.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.938 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:56.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:56.994 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:56.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1535e-05 s, 0.0 kB/s 2023-10-08T00:28:56.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:56.995 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.050 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.050 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.050 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3537e-05 s, 0.0 kB/s 2023-10-08T00:28:57.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.051 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.106 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.106 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.106 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0181e-05 s, 0.0 kB/s 2023-10-08T00:28:57.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.107 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.162 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.162 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2071e-05 s, 0.0 kB/s 2023-10-08T00:28:57.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.162 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.218 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0168e-05 s, 0.0 kB/s 2023-10-08T00:28:57.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.219 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1703e-05 s, 0.0 kB/s 2023-10-08T00:28:57.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4413e-05 s, 0.0 kB/s 2023-10-08T00:28:57.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4095e-05 s, 0.0 kB/s 2023-10-08T00:28:57.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.443 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.444 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6659e-05 s, 0.0 kB/s 2023-10-08T00:28:57.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.444 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0546e-05 s, 0.0 kB/s 2023-10-08T00:28:57.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.500 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.556 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9885e-05 s, 0.0 kB/s 2023-10-08T00:28:57.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.557 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.612 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5071e-05 s, 0.0 kB/s 2023-10-08T00:28:57.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.613 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9593e-05 s, 0.0 kB/s 2023-10-08T00:28:57.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.669 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4694e-05 s, 0.0 kB/s 2023-10-08T00:28:57.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2722e-05 s, 0.0 kB/s 2023-10-08T00:28:57.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.780 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3898e-05 s, 0.0 kB/s 2023-10-08T00:28:57.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2182e-05 s, 0.0 kB/s 2023-10-08T00:28:57.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.893 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:57.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:57.951 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:57.951 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4562e-05 s, 0.0 kB/s 2023-10-08T00:28:57.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:57.951 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.014 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7509e-05 s, 0.0 kB/s 2023-10-08T00:28:58.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1979e-05 s, 0.0 kB/s 2023-10-08T00:28:58.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.071 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.125 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.126 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-08T00:28:58.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.127 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.183 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-08T00:28:58.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.238 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.238 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.238 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1981e-05 s, 0.0 kB/s 2023-10-08T00:28:58.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.239 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.295 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.295 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.108e-05 s, 0.0 kB/s 2023-10-08T00:28:58.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.351 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.351 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0005e-05 s, 0.0 kB/s 2023-10-08T00:28:58.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.352 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.408 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.408 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.408 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9831e-05 s, 0.0 kB/s 2023-10-08T00:28:58.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.408 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1115e-05 s, 0.0 kB/s 2023-10-08T00:28:58.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.465 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.520 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.520 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.520 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0336e-05 s, 0.0 kB/s 2023-10-08T00:28:58.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.521 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.576 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.576 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.576 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3482e-05 s, 0.0 kB/s 2023-10-08T00:28:58.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.577 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.632 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.632 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3458e-05 s, 0.0 kB/s 2023-10-08T00:28:58.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.632 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0245e-05 s, 0.0 kB/s 2023-10-08T00:28:58.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.689 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3056e-05 s, 0.0 kB/s 2023-10-08T00:28:58.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.800 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.085e-05 s, 0.0 kB/s 2023-10-08T00:28:58.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.856 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0138e-05 s, 0.0 kB/s 2023-10-08T00:28:58.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.857 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.912 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0369e-05 s, 0.0 kB/s 2023-10-08T00:28:58.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.913 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:58.969 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4603e-05 s, 0.0 kB/s 2023-10-08T00:28:58.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:58.970 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.026 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.026 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.026 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3204e-05 s, 0.0 kB/s 2023-10-08T00:28:59.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.026 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.082 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3518e-05 s, 0.0 kB/s 2023-10-08T00:28:59.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.083 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.138 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.138 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.138 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9948e-05 s, 0.0 kB/s 2023-10-08T00:28:59.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.139 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.194 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1598e-05 s, 0.0 kB/s 2023-10-08T00:28:59.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.195 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.250 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2209e-05 s, 0.0 kB/s 2023-10-08T00:28:59.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.251 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.306 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.306 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.306 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9861e-05 s, 0.0 kB/s 2023-10-08T00:28:59.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.307 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.362 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-08T00:28:59.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.363 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.418 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.419 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6205e-05 s, 0.0 kB/s 2023-10-08T00:28:59.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.419 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.475 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0452e-05 s, 0.0 kB/s 2023-10-08T00:28:59.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.476 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.531 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-08T00:28:59.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.531 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.587 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.587 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.587 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-08T00:28:59.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.588 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.644 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.365e-05 s, 0.0 kB/s 2023-10-08T00:28:59.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.700 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4545e-05 s, 0.0 kB/s 2023-10-08T00:28:59.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.700 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9651e-05 s, 0.0 kB/s 2023-10-08T00:28:59.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9349e-05 s, 0.0 kB/s 2023-10-08T00:28:59.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.811 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2221e-05 s, 0.0 kB/s 2023-10-08T00:28:59.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.867 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3361e-05 s, 0.0 kB/s 2023-10-08T00:28:59.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:28:59.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0154e-05 s, 0.0 kB/s 2023-10-08T00:28:59.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:28:59.979 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.035 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9874e-05 s, 0.0 kB/s 2023-10-08T00:29:00.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.091 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2325e-05 s, 0.0 kB/s 2023-10-08T00:29:00.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.092 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.147 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.147 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1097e-05 s, 0.0 kB/s 2023-10-08T00:29:00.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.147 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.203 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.203 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.203 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9007e-05 s, 0.0 kB/s 2023-10-08T00:29:00.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.204 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0271e-05 s, 0.0 kB/s 2023-10-08T00:29:00.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.260 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.315 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.315 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.315 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1031e-05 s, 0.0 kB/s 2023-10-08T00:29:00.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.315 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.370 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.370 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3123e-05 s, 0.0 kB/s 2023-10-08T00:29:00.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.371 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.427 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.427 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.427 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0719e-05 s, 0.0 kB/s 2023-10-08T00:29:00.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.428 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0449e-05 s, 0.0 kB/s 2023-10-08T00:29:00.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.484 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.539 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.540 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.540 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4453e-05 s, 0.0 kB/s 2023-10-08T00:29:00.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.540 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.596 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.597 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0328e-05 s, 0.0 kB/s 2023-10-08T00:29:00.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.598 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.654 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4975e-05 s, 0.0 kB/s 2023-10-08T00:29:00.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.713 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2833e-05 s, 0.0 kB/s 2023-10-08T00:29:00.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.713 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2131e-05 s, 0.0 kB/s 2023-10-08T00:29:00.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.769 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0926e-05 s, 0.0 kB/s 2023-10-08T00:29:00.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.880 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.880 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.880 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1589e-05 s, 0.0 kB/s 2023-10-08T00:29:00.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.880 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1726e-05 s, 0.0 kB/s 2023-10-08T00:29:00.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.937 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:00.992 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:00.992 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:00.992 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2781e-05 s, 0.0 kB/s 2023-10-08T00:29:00.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:00.993 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.048 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5316e-05 s, 0.0 kB/s 2023-10-08T00:29:01.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.049 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1188e-05 s, 0.0 kB/s 2023-10-08T00:29:01.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.104 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.160 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.160 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.160 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2766e-05 s, 0.0 kB/s 2023-10-08T00:29:01.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.161 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.218 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9813e-05 s, 0.0 kB/s 2023-10-08T00:29:01.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.277 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.277 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2047e-05 s, 0.0 kB/s 2023-10-08T00:29:01.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.278 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:29:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0982e-05 s, 0.0 kB/s 2023-10-08T00:29:01.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.337 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.382 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:29:01.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.397 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1757e-05 s, 0.0 kB/s 2023-10-08T00:29:01.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1967e-05 s, 0.0 kB/s 2023-10-08T00:29:01.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.455 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.513 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.582e-05 s, 0.0 kB/s 2023-10-08T00:29:01.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.513 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.570 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.570 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.570 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2874e-05 s, 0.0 kB/s 2023-10-08T00:29:01.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.570 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.627 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1949e-05 s, 0.0 kB/s 2023-10-08T00:29:01.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.627 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.683 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3075e-05 s, 0.0 kB/s 2023-10-08T00:29:01.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.684 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.740 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.740 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.740 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4439e-05 s, 0.0 kB/s 2023-10-08T00:29:01.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.741 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.796 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.796 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.796 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3085e-05 s, 0.0 kB/s 2023-10-08T00:29:01.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.797 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.853 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.853 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.853 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.041e-05 s, 0.0 kB/s 2023-10-08T00:29:01.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.854 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.909 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2942e-05 s, 0.0 kB/s 2023-10-08T00:29:01.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.909 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7483e-05 s, 0.0 kB/s 2023-10-08T00:29:01.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:01.967 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.023 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5397e-05 s, 0.0 kB/s 2023-10-08T00:29:02.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.023 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.078 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.078 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.078 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2938e-05 s, 0.0 kB/s 2023-10-08T00:29:02.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.134 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4254e-05 s, 0.0 kB/s 2023-10-08T00:29:02.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.134 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1109e-05 s, 0.0 kB/s 2023-10-08T00:29:02.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.191 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.246 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.246 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.246 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1176e-05 s, 0.0 kB/s 2023-10-08T00:29:02.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.247 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.302 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.302 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.303 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.232e-05 s, 0.0 kB/s 2023-10-08T00:29:02.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.303 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.358 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2255e-05 s, 0.0 kB/s 2023-10-08T00:29:02.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.359 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2499e-05 s, 0.0 kB/s 2023-10-08T00:29:02.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.415 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.473 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1055e-05 s, 0.0 kB/s 2023-10-08T00:29:02.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.473 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0775e-05 s, 0.0 kB/s 2023-10-08T00:29:02.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.586 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.587 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0368e-05 s, 0.0 kB/s 2023-10-08T00:29:02.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.587 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.643 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3378e-05 s, 0.0 kB/s 2023-10-08T00:29:02.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.700 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1473e-05 s, 0.0 kB/s 2023-10-08T00:29:02.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.700 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0952e-05 s, 0.0 kB/s 2023-10-08T00:29:02.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1712e-05 s, 0.0 kB/s 2023-10-08T00:29:02.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3198e-05 s, 0.0 kB/s 2023-10-08T00:29:02.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.870 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9606e-05 s, 0.0 kB/s 2023-10-08T00:29:02.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:02.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:02.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:02.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0307e-05 s, 0.0 kB/s 2023-10-08T00:29:02.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:02.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.036 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1935e-05 s, 0.0 kB/s 2023-10-08T00:29:03.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.090 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.091 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5827e-05 s, 0.0 kB/s 2023-10-08T00:29:03.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.092 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.148 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9145e-05 s, 0.0 kB/s 2023-10-08T00:29:03.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.204 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3251e-05 s, 0.0 kB/s 2023-10-08T00:29:03.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.204 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.260 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.260 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.260 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2918e-05 s, 0.0 kB/s 2023-10-08T00:29:03.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.260 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.316 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2034e-05 s, 0.0 kB/s 2023-10-08T00:29:03.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.317 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.371 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.371 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.372 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3788e-05 s, 0.0 kB/s 2023-10-08T00:29:03.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.373 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.429 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.429 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.075e-05 s, 0.0 kB/s 2023-10-08T00:29:03.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.430 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9142e-05 s, 0.0 kB/s 2023-10-08T00:29:03.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.486 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.542 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1729e-05 s, 0.0 kB/s 2023-10-08T00:29:03.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.543 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.598 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.598 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2509e-05 s, 0.0 kB/s 2023-10-08T00:29:03.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.599 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.654 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.654 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-08T00:29:03.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.655 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.710 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.711 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.711 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1409e-05 s, 0.0 kB/s 2023-10-08T00:29:03.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.711 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.767 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.767 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.768 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7304e-05 s, 0.0 kB/s 2023-10-08T00:29:03.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.768 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3194e-05 s, 0.0 kB/s 2023-10-08T00:29:03.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.823 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1129e-05 s, 0.0 kB/s 2023-10-08T00:29:03.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.879 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.935 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0995e-05 s, 0.0 kB/s 2023-10-08T00:29:03.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.936 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:03.990 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:03.991 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:03.991 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2451e-05 s, 0.0 kB/s 2023-10-08T00:29:03.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:03.992 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3945e-05 s, 0.0 kB/s 2023-10-08T00:29:04.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.049 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.105 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.105 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.105 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2903e-05 s, 0.0 kB/s 2023-10-08T00:29:04.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.105 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.167 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.167 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.168 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.457e-05 s, 0.0 kB/s 2023-10-08T00:29:04.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.168 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.576e-05 s, 0.0 kB/s 2023-10-08T00:29:04.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.224 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.280 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3121e-05 s, 0.0 kB/s 2023-10-08T00:29:04.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.280 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.335 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6176e-05 s, 0.0 kB/s 2023-10-08T00:29:04.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.336 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.392 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.392 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.392 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4422e-05 s, 0.0 kB/s 2023-10-08T00:29:04.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.393 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.449 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2379e-05 s, 0.0 kB/s 2023-10-08T00:29:04.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.450 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.506 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.507 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2754e-05 s, 0.0 kB/s 2023-10-08T00:29:04.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.507 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6786e-05 s, 0.0 kB/s 2023-10-08T00:29:04.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.564 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.620 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2444e-05 s, 0.0 kB/s 2023-10-08T00:29:04.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.677 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.677 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5741e-05 s, 0.0 kB/s 2023-10-08T00:29:04.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.678 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.735 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-08T00:29:04.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.791 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8353e-05 s, 0.0 kB/s 2023-10-08T00:29:04.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.846 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4754e-05 s, 0.0 kB/s 2023-10-08T00:29:04.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.902 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3221e-05 s, 0.0 kB/s 2023-10-08T00:29:04.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.903 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:04.958 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1143e-05 s, 0.0 kB/s 2023-10-08T00:29:04.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:04.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1383e-05 s, 0.0 kB/s 2023-10-08T00:29:05.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.015 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2479e-05 s, 0.0 kB/s 2023-10-08T00:29:05.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.071 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.126 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.126 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2568e-05 s, 0.0 kB/s 2023-10-08T00:29:05.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.126 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.182 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.182 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.182 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1783e-05 s, 0.0 kB/s 2023-10-08T00:29:05.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.183 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.238 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.238 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.238 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.268e-05 s, 0.0 kB/s 2023-10-08T00:29:05.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.239 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.294 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.294 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.294 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9404e-05 s, 0.0 kB/s 2023-10-08T00:29:05.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.295 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.350 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.350 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.351 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0651e-05 s, 0.0 kB/s 2023-10-08T00:29:05.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.351 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.406 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.406 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.406 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1922e-05 s, 0.0 kB/s 2023-10-08T00:29:05.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.406 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.463 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.463 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3047e-05 s, 0.0 kB/s 2023-10-08T00:29:05.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.463 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.522 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.522 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.522 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2165e-05 s, 0.0 kB/s 2023-10-08T00:29:05.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.522 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.578 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.578 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.578 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1826e-05 s, 0.0 kB/s 2023-10-08T00:29:05.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.579 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.485e-05 s, 0.0 kB/s 2023-10-08T00:29:05.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.635 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.691 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1008e-05 s, 0.0 kB/s 2023-10-08T00:29:05.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.692 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.747 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.747 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.747 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2242e-05 s, 0.0 kB/s 2023-10-08T00:29:05.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.748 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1474e-05 s, 0.0 kB/s 2023-10-08T00:29:05.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.804 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.860 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.860 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.860 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4803e-05 s, 0.0 kB/s 2023-10-08T00:29:05.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.861 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.916 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9987e-05 s, 0.0 kB/s 2023-10-08T00:29:05.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.917 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:05.972 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1611e-05 s, 0.0 kB/s 2023-10-08T00:29:05.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:05.973 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.028 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3583e-05 s, 0.0 kB/s 2023-10-08T00:29:06.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.029 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.084 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.084 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.084 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0598e-05 s, 0.0 kB/s 2023-10-08T00:29:06.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.085 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.140 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.140 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.140 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-08T00:29:06.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.141 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.197 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.466e-05 s, 0.0 kB/s 2023-10-08T00:29:06.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.197 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2802e-05 s, 0.0 kB/s 2023-10-08T00:29:06.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.254 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.309 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.309 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.309 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1544e-05 s, 0.0 kB/s 2023-10-08T00:29:06.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.310 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.365 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.365 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.365 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0923e-05 s, 0.0 kB/s 2023-10-08T00:29:06.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.366 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.421 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4088e-05 s, 0.0 kB/s 2023-10-08T00:29:06.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.422 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.477 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.477 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.477 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2301e-05 s, 0.0 kB/s 2023-10-08T00:29:06.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.478 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.534 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.536 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2671e-05 s, 0.0 kB/s 2023-10-08T00:29:06.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.536 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.592 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0025e-05 s, 0.0 kB/s 2023-10-08T00:29:06.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.648 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1946e-05 s, 0.0 kB/s 2023-10-08T00:29:06.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.649 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.704 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.705 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.705 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.429e-05 s, 0.0 kB/s 2023-10-08T00:29:06.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.705 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.761 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.762 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2121e-05 s, 0.0 kB/s 2023-10-08T00:29:06.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.762 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.817 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2247e-05 s, 0.0 kB/s 2023-10-08T00:29:06.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.873 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3616e-05 s, 0.0 kB/s 2023-10-08T00:29:06.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.874 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.929 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0776e-05 s, 0.0 kB/s 2023-10-08T00:29:06.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.930 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:06.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:06.986 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2855e-05 s, 0.0 kB/s 2023-10-08T00:29:06.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:06.986 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.041 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1264e-05 s, 0.0 kB/s 2023-10-08T00:29:07.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.042 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.098 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.098 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.098 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0447e-05 s, 0.0 kB/s 2023-10-08T00:29:07.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.099 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.154 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.155 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2443e-05 s, 0.0 kB/s 2023-10-08T00:29:07.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.155 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.210 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1092e-05 s, 0.0 kB/s 2023-10-08T00:29:07.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.211 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.266 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.067e-05 s, 0.0 kB/s 2023-10-08T00:29:07.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.267 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.322 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.634e-05 s, 0.0 kB/s 2023-10-08T00:29:07.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.323 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.378 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.378 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.379 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.897e-05 s, 0.0 kB/s 2023-10-08T00:29:07.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.379 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.434 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8883e-05 s, 0.0 kB/s 2023-10-08T00:29:07.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.435 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2273e-05 s, 0.0 kB/s 2023-10-08T00:29:07.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.491 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.546 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.547 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4134e-05 s, 0.0 kB/s 2023-10-08T00:29:07.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.547 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.603 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5647e-05 s, 0.0 kB/s 2023-10-08T00:29:07.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.604 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.659 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.194e-05 s, 0.0 kB/s 2023-10-08T00:29:07.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.660 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0197e-05 s, 0.0 kB/s 2023-10-08T00:29:07.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.716 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2269e-05 s, 0.0 kB/s 2023-10-08T00:29:07.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.772 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.827 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1921e-05 s, 0.0 kB/s 2023-10-08T00:29:07.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.827 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.883 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1473e-05 s, 0.0 kB/s 2023-10-08T00:29:07.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.939 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.939 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4753e-05 s, 0.0 kB/s 2023-10-08T00:29:07.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.940 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:07.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:07.995 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:07.995 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9228e-05 s, 0.0 kB/s 2023-10-08T00:29:07.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:07.996 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.051 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.051 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1415e-05 s, 0.0 kB/s 2023-10-08T00:29:08.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.052 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.107 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.107 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3742e-05 s, 0.0 kB/s 2023-10-08T00:29:08.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.108 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.163 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.163 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3515e-05 s, 0.0 kB/s 2023-10-08T00:29:08.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.164 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.219 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.219 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3114e-05 s, 0.0 kB/s 2023-10-08T00:29:08.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.220 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.276 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.276 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.276 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4596e-05 s, 0.0 kB/s 2023-10-08T00:29:08.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.277 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.332 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.333 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.333 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1079e-05 s, 0.0 kB/s 2023-10-08T00:29:08.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.333 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.388 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3011e-05 s, 0.0 kB/s 2023-10-08T00:29:08.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.389 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.444 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0086e-05 s, 0.0 kB/s 2023-10-08T00:29:08.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.445 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.500 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.501 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.501 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1296e-05 s, 0.0 kB/s 2023-10-08T00:29:08.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.501 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.557 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.558 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6272e-05 s, 0.0 kB/s 2023-10-08T00:29:08.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.558 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.614 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.615 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.615 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3008e-05 s, 0.0 kB/s 2023-10-08T00:29:08.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.615 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.670 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.670 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.670 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8212e-05 s, 0.0 kB/s 2023-10-08T00:29:08.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.671 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.239e-05 s, 0.0 kB/s 2023-10-08T00:29:08.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.727 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.782 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2013e-05 s, 0.0 kB/s 2023-10-08T00:29:08.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.839 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2151e-05 s, 0.0 kB/s 2023-10-08T00:29:08.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.840 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.896 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3032e-05 s, 0.0 kB/s 2023-10-08T00:29:08.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.897 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:08.953 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:08.953 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:08.953 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5069e-05 s, 0.0 kB/s 2023-10-08T00:29:08.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:08.954 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.010 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.010 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.010 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.259e-05 s, 0.0 kB/s 2023-10-08T00:29:09.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.010 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.067 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2259e-05 s, 0.0 kB/s 2023-10-08T00:29:09.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.067 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.122 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.002e-05 s, 0.0 kB/s 2023-10-08T00:29:09.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.123 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.179 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.179 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.179 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2413e-05 s, 0.0 kB/s 2023-10-08T00:29:09.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.180 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.235 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.235 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.235 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3408e-05 s, 0.0 kB/s 2023-10-08T00:29:09.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.235 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.291 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9987e-05 s, 0.0 kB/s 2023-10-08T00:29:09.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.291 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.347 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2256e-05 s, 0.0 kB/s 2023-10-08T00:29:09.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.348 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.404 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9196e-05 s, 0.0 kB/s 2023-10-08T00:29:09.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.460 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5674e-05 s, 0.0 kB/s 2023-10-08T00:29:09.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.460 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.516 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1442e-05 s, 0.0 kB/s 2023-10-08T00:29:09.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.517 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.574 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2351e-05 s, 0.0 kB/s 2023-10-08T00:29:09.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3717e-05 s, 0.0 kB/s 2023-10-08T00:29:09.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5028e-05 s, 0.0 kB/s 2023-10-08T00:29:09.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.743 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.743 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0788e-05 s, 0.0 kB/s 2023-10-08T00:29:09.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.744 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.801 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2279e-05 s, 0.0 kB/s 2023-10-08T00:29:09.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.858 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1102e-05 s, 0.0 kB/s 2023-10-08T00:29:09.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.858 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.914 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.914 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.915 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2263e-05 s, 0.0 kB/s 2023-10-08T00:29:09.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.915 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:09.970 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:09.970 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:09.970 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2819e-05 s, 0.0 kB/s 2023-10-08T00:29:09.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:09.971 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1922e-05 s, 0.0 kB/s 2023-10-08T00:29:10.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.030 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.085 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.085 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.085 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4411e-05 s, 0.0 kB/s 2023-10-08T00:29:10.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.086 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.141 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.141 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.141 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3714e-05 s, 0.0 kB/s 2023-10-08T00:29:10.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.142 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.197 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8133e-05 s, 0.0 kB/s 2023-10-08T00:29:10.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.199 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8963e-05 s, 0.0 kB/s 2023-10-08T00:29:10.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.255 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.310 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3929e-05 s, 0.0 kB/s 2023-10-08T00:29:10.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.311 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.984e-05 s, 0.0 kB/s 2023-10-08T00:29:10.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.367 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.423 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1489e-05 s, 0.0 kB/s 2023-10-08T00:29:10.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.424 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.480 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2487e-05 s, 0.0 kB/s 2023-10-08T00:29:10.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.480 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.536 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4441e-05 s, 0.0 kB/s 2023-10-08T00:29:10.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.537 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2367e-05 s, 0.0 kB/s 2023-10-08T00:29:10.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.650 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2205e-05 s, 0.0 kB/s 2023-10-08T00:29:10.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.651 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.707 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1801e-05 s, 0.0 kB/s 2023-10-08T00:29:10.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.707 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.186e-05 s, 0.0 kB/s 2023-10-08T00:29:10.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.764 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.820 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1068e-05 s, 0.0 kB/s 2023-10-08T00:29:10.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.820 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.875 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4593e-05 s, 0.0 kB/s 2023-10-08T00:29:10.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.931 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.931 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.931 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3998e-05 s, 0.0 kB/s 2023-10-08T00:29:10.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.932 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:10.987 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:10.987 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:10.987 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.014e-05 s, 0.0 kB/s 2023-10-08T00:29:10.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:10.988 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.044 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2768e-05 s, 0.0 kB/s 2023-10-08T00:29:11.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.044 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4442e-05 s, 0.0 kB/s 2023-10-08T00:29:11.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.100 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.155 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.155 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0771e-05 s, 0.0 kB/s 2023-10-08T00:29:11.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.156 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.211 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1738e-05 s, 0.0 kB/s 2023-10-08T00:29:11.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.212 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2578e-05 s, 0.0 kB/s 2023-10-08T00:29:11.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.268 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.323 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0005e-05 s, 0.0 kB/s 2023-10-08T00:29:11.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.324 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9419e-05 s, 0.0 kB/s 2023-10-08T00:29:11.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.380 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1577e-05 s, 0.0 kB/s 2023-10-08T00:29:11.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.483 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3036e-05 s, 0.0 kB/s 2023-10-08T00:29:11.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.555 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.555 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.36e-05 s, 0.0 kB/s 2023-10-08T00:29:11.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.612 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2235e-05 s, 0.0 kB/s 2023-10-08T00:29:11.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.612 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.669 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.669 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.669 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-08T00:29:11.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.670 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.726 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1114e-05 s, 0.0 kB/s 2023-10-08T00:29:11.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.726 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1178e-05 s, 0.0 kB/s 2023-10-08T00:29:11.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.179e-05 s, 0.0 kB/s 2023-10-08T00:29:11.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.839 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0717e-05 s, 0.0 kB/s 2023-10-08T00:29:11.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.895 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:11.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:11.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:11.950 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1525e-05 s, 0.0 kB/s 2023-10-08T00:29:11.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:11.951 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.008 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.008 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.008 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3073e-05 s, 0.0 kB/s 2023-10-08T00:29:12.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.009 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.067 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.067 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1695e-05 s, 0.0 kB/s 2023-10-08T00:29:12.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.067 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.123 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.123 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.123 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-08T00:29:12.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.124 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.180 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1189e-05 s, 0.0 kB/s 2023-10-08T00:29:12.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.181 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.237 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1672e-05 s, 0.0 kB/s 2023-10-08T00:29:12.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.237 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.293 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.293 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.293 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1704e-05 s, 0.0 kB/s 2023-10-08T00:29:12.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.294 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.349 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.349 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1785e-05 s, 0.0 kB/s 2023-10-08T00:29:12.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.350 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.405 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.405 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.263e-05 s, 0.0 kB/s 2023-10-08T00:29:12.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.406 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.461 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.461 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.214e-05 s, 0.0 kB/s 2023-10-08T00:29:12.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.462 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.519 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.519 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2657e-05 s, 0.0 kB/s 2023-10-08T00:29:12.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.519 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.575 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0558e-05 s, 0.0 kB/s 2023-10-08T00:29:12.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.631 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2785e-05 s, 0.0 kB/s 2023-10-08T00:29:12.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3558e-05 s, 0.0 kB/s 2023-10-08T00:29:12.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3463e-05 s, 0.0 kB/s 2023-10-08T00:29:12.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.744 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0798e-05 s, 0.0 kB/s 2023-10-08T00:29:12.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.857 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3626e-05 s, 0.0 kB/s 2023-10-08T00:29:12.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.857 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.912 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.213e-05 s, 0.0 kB/s 2023-10-08T00:29:12.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.913 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:12.968 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9899e-05 s, 0.0 kB/s 2023-10-08T00:29:12.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:12.969 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.025 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.06e-05 s, 0.0 kB/s 2023-10-08T00:29:13.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.025 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4791e-05 s, 0.0 kB/s 2023-10-08T00:29:13.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.081 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5616e-05 s, 0.0 kB/s 2023-10-08T00:29:13.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.137 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.192 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3339e-05 s, 0.0 kB/s 2023-10-08T00:29:13.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.193 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-08T00:29:13.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.249 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.304 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2391e-05 s, 0.0 kB/s 2023-10-08T00:29:13.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.305 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.360 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5366e-05 s, 0.0 kB/s 2023-10-08T00:29:13.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.361 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.417 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.417 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.417 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9977e-05 s, 0.0 kB/s 2023-10-08T00:29:13.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2779e-05 s, 0.0 kB/s 2023-10-08T00:29:13.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.474 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2401e-05 s, 0.0 kB/s 2023-10-08T00:29:13.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.238e-05 s, 0.0 kB/s 2023-10-08T00:29:13.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.586 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.642 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.642 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5177e-05 s, 0.0 kB/s 2023-10-08T00:29:13.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.642 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.699 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.699 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2018e-05 s, 0.0 kB/s 2023-10-08T00:29:13.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.699 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.756 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0813e-05 s, 0.0 kB/s 2023-10-08T00:29:13.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.756 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.97e-05 s, 0.0 kB/s 2023-10-08T00:29:13.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3866e-05 s, 0.0 kB/s 2023-10-08T00:29:13.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.925 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.925 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.925 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1506e-05 s, 0.0 kB/s 2023-10-08T00:29:13.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.926 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:13.981 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:13.981 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:13.981 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4513e-05 s, 0.0 kB/s 2023-10-08T00:29:13.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:13.982 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.037 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.037 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0734e-05 s, 0.0 kB/s 2023-10-08T00:29:14.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.038 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.094 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5988e-05 s, 0.0 kB/s 2023-10-08T00:29:14.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.095 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.150 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.150 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.150 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1681e-05 s, 0.0 kB/s 2023-10-08T00:29:14.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.151 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.206 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2045e-05 s, 0.0 kB/s 2023-10-08T00:29:14.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.207 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.262 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4731e-05 s, 0.0 kB/s 2023-10-08T00:29:14.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.262 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.318 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.415e-05 s, 0.0 kB/s 2023-10-08T00:29:14.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.319 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.375 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.375 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1461e-05 s, 0.0 kB/s 2023-10-08T00:29:14.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.376 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.430 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.431 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0246e-05 s, 0.0 kB/s 2023-10-08T00:29:14.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.431 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3448e-05 s, 0.0 kB/s 2023-10-08T00:29:14.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.488 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.542 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.543 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.543 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1377e-05 s, 0.0 kB/s 2023-10-08T00:29:14.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.544 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.600 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.600 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.600 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1047e-05 s, 0.0 kB/s 2023-10-08T00:29:14.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.601 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.657 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.657 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.657 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-08T00:29:14.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.658 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.713 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.714 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9576e-05 s, 0.0 kB/s 2023-10-08T00:29:14.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.714 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.769 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0607e-05 s, 0.0 kB/s 2023-10-08T00:29:14.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.769 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0295e-05 s, 0.0 kB/s 2023-10-08T00:29:14.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.825 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.913 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.913 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1861e-05 s, 0.0 kB/s 2023-10-08T00:29:14.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.913 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.929 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2698e-05 s, 0.0 kB/s 2023-10-08T00:29:14.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.930 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:14.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:14.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:14.985 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9379e-05 s, 0.0 kB/s 2023-10-08T00:29:14.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:14.985 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.041 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2405e-05 s, 0.0 kB/s 2023-10-08T00:29:15.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.041 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.097 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.097 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.097 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0775e-05 s, 0.0 kB/s 2023-10-08T00:29:15.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.098 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.153 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.154 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.154 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0605e-05 s, 0.0 kB/s 2023-10-08T00:29:15.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.154 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.210 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.211 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1329e-05 s, 0.0 kB/s 2023-10-08T00:29:15.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.211 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.266 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.266 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2877e-05 s, 0.0 kB/s 2023-10-08T00:29:15.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.267 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.322 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3446e-05 s, 0.0 kB/s 2023-10-08T00:29:15.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.323 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.378 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.378 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.378 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2006e-05 s, 0.0 kB/s 2023-10-08T00:29:15.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.379 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0897e-05 s, 0.0 kB/s 2023-10-08T00:29:15.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.435 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.490 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.093e-05 s, 0.0 kB/s 2023-10-08T00:29:15.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.491 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1868e-05 s, 0.0 kB/s 2023-10-08T00:29:15.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.547 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.602 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2958e-05 s, 0.0 kB/s 2023-10-08T00:29:15.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.603 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.660 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2943e-05 s, 0.0 kB/s 2023-10-08T00:29:15.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.661 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.718 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3677e-05 s, 0.0 kB/s 2023-10-08T00:29:15.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.718 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.774 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.774 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.774 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2266e-05 s, 0.0 kB/s 2023-10-08T00:29:15.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.774 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1463e-05 s, 0.0 kB/s 2023-10-08T00:29:15.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.831 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4622e-05 s, 0.0 kB/s 2023-10-08T00:29:15.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.888 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:15.945 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2365e-05 s, 0.0 kB/s 2023-10-08T00:29:15.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:15.945 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.001 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.001 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.002 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8613e-05 s, 0.0 kB/s 2023-10-08T00:29:16.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.002 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.058 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.058 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.058 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1737e-05 s, 0.0 kB/s 2023-10-08T00:29:16.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.059 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.114 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.115 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1939e-05 s, 0.0 kB/s 2023-10-08T00:29:16.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.115 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.172 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.172 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-08T00:29:16.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.172 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.228 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.229 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4718e-05 s, 0.0 kB/s 2023-10-08T00:29:16.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.229 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.285 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.286 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3668e-05 s, 0.0 kB/s 2023-10-08T00:29:16.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.286 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.344 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.344 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3496e-05 s, 0.0 kB/s 2023-10-08T00:29:16.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.400 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.298e-05 s, 0.0 kB/s 2023-10-08T00:29:16.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.401 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.456 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4737e-05 s, 0.0 kB/s 2023-10-08T00:29:16.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.457 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.512 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1958e-05 s, 0.0 kB/s 2023-10-08T00:29:16.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.513 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.569 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.343e-05 s, 0.0 kB/s 2023-10-08T00:29:16.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.570 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5033e-05 s, 0.0 kB/s 2023-10-08T00:29:16.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3263e-05 s, 0.0 kB/s 2023-10-08T00:29:16.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.689 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.745 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.897e-05 s, 0.0 kB/s 2023-10-08T00:29:16.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.809 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3328e-05 s, 0.0 kB/s 2023-10-08T00:29:16.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.809 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.223e-05 s, 0.0 kB/s 2023-10-08T00:29:16.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.927 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1211e-05 s, 0.0 kB/s 2023-10-08T00:29:16.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.928 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:16.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:16.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:16.986 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4718e-05 s, 0.0 kB/s 2023-10-08T00:29:16.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:16.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.044 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-08T00:29:17.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.044 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.101 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.101 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.101 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5133e-05 s, 0.0 kB/s 2023-10-08T00:29:17.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.101 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.158 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3097e-05 s, 0.0 kB/s 2023-10-08T00:29:17.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.159 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1993e-05 s, 0.0 kB/s 2023-10-08T00:29:17.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.215 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.271 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.272 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.272 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3947e-05 s, 0.0 kB/s 2023-10-08T00:29:17.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.272 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.328 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.329 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.329 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2864e-05 s, 0.0 kB/s 2023-10-08T00:29:17.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.329 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.386 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3287e-05 s, 0.0 kB/s 2023-10-08T00:29:17.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.386 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.441 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.441 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.442 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9489e-05 s, 0.0 kB/s 2023-10-08T00:29:17.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.442 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.497 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.497 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.497 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3886e-05 s, 0.0 kB/s 2023-10-08T00:29:17.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.498 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.553 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.553 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.553 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0542e-05 s, 0.0 kB/s 2023-10-08T00:29:17.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.554 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.609 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3425e-05 s, 0.0 kB/s 2023-10-08T00:29:17.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.609 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.665 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.462e-05 s, 0.0 kB/s 2023-10-08T00:29:17.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.666 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.722 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.722 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.723 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5461e-05 s, 0.0 kB/s 2023-10-08T00:29:17.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.723 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2671e-05 s, 0.0 kB/s 2023-10-08T00:29:17.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.779 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3119e-05 s, 0.0 kB/s 2023-10-08T00:29:17.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2264e-05 s, 0.0 kB/s 2023-10-08T00:29:17.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.892 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2189e-05 s, 0.0 kB/s 2023-10-08T00:29:17.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:17.949 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1667e-05 s, 0.0 kB/s 2023-10-08T00:29:18.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.006 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0613e-05 s, 0.0 kB/s 2023-10-08T00:29:18.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.120 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6911e-05 s, 0.0 kB/s 2023-10-08T00:29:18.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.120 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.176 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1727e-05 s, 0.0 kB/s 2023-10-08T00:29:18.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.176 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.233 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.233 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.233 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.305e-05 s, 0.0 kB/s 2023-10-08T00:29:18.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.233 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.289 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.289 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.290 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2476e-05 s, 0.0 kB/s 2023-10-08T00:29:18.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.290 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.345 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2948e-05 s, 0.0 kB/s 2023-10-08T00:29:18.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.346 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.401 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.401 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.401 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0756e-05 s, 0.0 kB/s 2023-10-08T00:29:18.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.402 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.457 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.457 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.458 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0394e-05 s, 0.0 kB/s 2023-10-08T00:29:18.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.458 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1692e-05 s, 0.0 kB/s 2023-10-08T00:29:18.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.514 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.570 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.570 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6898e-05 s, 0.0 kB/s 2023-10-08T00:29:18.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.570 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.626 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.627 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1564e-05 s, 0.0 kB/s 2023-10-08T00:29:18.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.627 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.683 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3633e-05 s, 0.0 kB/s 2023-10-08T00:29:18.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.683 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.740 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.740 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.740 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2249e-05 s, 0.0 kB/s 2023-10-08T00:29:18.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.741 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.796 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1763e-05 s, 0.0 kB/s 2023-10-08T00:29:18.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.797 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.852 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.852 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.852 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1527e-05 s, 0.0 kB/s 2023-10-08T00:29:18.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.853 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.908 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.908 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.908 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2132e-05 s, 0.0 kB/s 2023-10-08T00:29:18.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.908 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:18.964 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.141e-05 s, 0.0 kB/s 2023-10-08T00:29:18.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:18.965 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.020 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.020 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.020 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9522e-05 s, 0.0 kB/s 2023-10-08T00:29:19.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.021 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3408e-05 s, 0.0 kB/s 2023-10-08T00:29:19.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.077 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.132 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.132 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.132 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1804e-05 s, 0.0 kB/s 2023-10-08T00:29:19.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.133 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.188 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.188 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.188 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4079e-05 s, 0.0 kB/s 2023-10-08T00:29:19.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.189 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.246 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.246 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.246 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9724e-05 s, 0.0 kB/s 2023-10-08T00:29:19.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.247 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1437e-05 s, 0.0 kB/s 2023-10-08T00:29:19.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.302 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.358 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.358 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4308e-05 s, 0.0 kB/s 2023-10-08T00:29:19.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.359 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9907e-05 s, 0.0 kB/s 2023-10-08T00:29:19.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.415 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.471 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.471 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.471 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2115e-05 s, 0.0 kB/s 2023-10-08T00:29:19.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.472 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.528 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2847e-05 s, 0.0 kB/s 2023-10-08T00:29:19.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.529 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.002e-05 s, 0.0 kB/s 2023-10-08T00:29:19.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.585 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.640 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.641 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4946e-05 s, 0.0 kB/s 2023-10-08T00:29:19.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1252e-05 s, 0.0 kB/s 2023-10-08T00:29:19.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.698 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5951e-05 s, 0.0 kB/s 2023-10-08T00:29:19.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0327e-05 s, 0.0 kB/s 2023-10-08T00:29:19.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.867 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.22e-05 s, 0.0 kB/s 2023-10-08T00:29:19.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.942e-05 s, 0.0 kB/s 2023-10-08T00:29:19.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:19.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-08T00:29:19.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:19.981 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.046 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.046 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5431e-05 s, 0.0 kB/s 2023-10-08T00:29:20.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.047 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.103 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2673e-05 s, 0.0 kB/s 2023-10-08T00:29:20.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.158 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0475e-05 s, 0.0 kB/s 2023-10-08T00:29:20.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.158 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.214 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9671e-05 s, 0.0 kB/s 2023-10-08T00:29:20.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.215 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2134e-05 s, 0.0 kB/s 2023-10-08T00:29:20.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.271 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.326 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2898e-05 s, 0.0 kB/s 2023-10-08T00:29:20.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.382 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9364e-05 s, 0.0 kB/s 2023-10-08T00:29:20.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.383 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.439 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.439 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9605e-05 s, 0.0 kB/s 2023-10-08T00:29:20.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.440 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.495 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.495 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1951e-05 s, 0.0 kB/s 2023-10-08T00:29:20.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.551 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.551 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.158e-05 s, 0.0 kB/s 2023-10-08T00:29:20.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.606 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.607 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.273e-05 s, 0.0 kB/s 2023-10-08T00:29:20.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.608 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.665 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3772e-05 s, 0.0 kB/s 2023-10-08T00:29:20.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.665 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.722 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.722 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.722 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1146e-05 s, 0.0 kB/s 2023-10-08T00:29:20.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.722 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.324e-05 s, 0.0 kB/s 2023-10-08T00:29:20.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.779 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3553e-05 s, 0.0 kB/s 2023-10-08T00:29:20.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.835 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.891 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.891 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3078e-05 s, 0.0 kB/s 2023-10-08T00:29:20.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.892 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:20.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:20.947 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:20.947 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0899e-05 s, 0.0 kB/s 2023-10-08T00:29:20.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:20.948 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.003 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0515e-05 s, 0.0 kB/s 2023-10-08T00:29:21.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.004 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.059 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.060 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3222e-05 s, 0.0 kB/s 2023-10-08T00:29:21.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.060 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.115 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.116 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.525e-05 s, 0.0 kB/s 2023-10-08T00:29:21.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.116 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.172 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2905e-05 s, 0.0 kB/s 2023-10-08T00:29:21.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.172 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.227 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.227 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.227 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1034e-05 s, 0.0 kB/s 2023-10-08T00:29:21.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.228 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.284 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.284 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4037e-05 s, 0.0 kB/s 2023-10-08T00:29:21.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.285 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2886e-05 s, 0.0 kB/s 2023-10-08T00:29:21.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.341 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.398 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.398 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.398 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4219e-05 s, 0.0 kB/s 2023-10-08T00:29:21.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.399 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.459e-05 s, 0.0 kB/s 2023-10-08T00:29:21.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.455 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.431e-05 s, 0.0 kB/s 2023-10-08T00:29:21.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.242e-05 s, 0.0 kB/s 2023-10-08T00:29:21.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.568 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.623 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2892e-05 s, 0.0 kB/s 2023-10-08T00:29:21.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.679 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.679 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1409e-05 s, 0.0 kB/s 2023-10-08T00:29:21.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.680 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.736 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.477e-05 s, 0.0 kB/s 2023-10-08T00:29:21.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.736 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.792 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4575e-05 s, 0.0 kB/s 2023-10-08T00:29:21.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.792 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3509e-05 s, 0.0 kB/s 2023-10-08T00:29:21.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.849 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.905 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.905 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0674e-05 s, 0.0 kB/s 2023-10-08T00:29:21.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.905 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:21.961 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:21.961 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:21.961 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3977e-05 s, 0.0 kB/s 2023-10-08T00:29:21.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:21.962 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3011e-05 s, 0.0 kB/s 2023-10-08T00:29:22.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.022 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.075 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3786e-05 s, 0.0 kB/s 2023-10-08T00:29:22.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.075 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2761e-05 s, 0.0 kB/s 2023-10-08T00:29:22.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.132 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.187 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1149e-05 s, 0.0 kB/s 2023-10-08T00:29:22.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.188 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.243 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2191e-05 s, 0.0 kB/s 2023-10-08T00:29:22.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.244 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.299 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1315e-05 s, 0.0 kB/s 2023-10-08T00:29:22.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.300 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.355 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1455e-05 s, 0.0 kB/s 2023-10-08T00:29:22.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.356 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.412 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1357e-05 s, 0.0 kB/s 2023-10-08T00:29:22.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.412 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.469 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2641e-05 s, 0.0 kB/s 2023-10-08T00:29:22.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.469 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.523 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-08T00:29:22.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.524 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.579 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3228e-05 s, 0.0 kB/s 2023-10-08T00:29:22.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.579 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.635 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.635 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.635 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9719e-05 s, 0.0 kB/s 2023-10-08T00:29:22.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.635 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.692 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2658e-05 s, 0.0 kB/s 2023-10-08T00:29:22.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.692 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1853e-05 s, 0.0 kB/s 2023-10-08T00:29:22.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.748 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.803 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.804 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.804 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.087e-05 s, 0.0 kB/s 2023-10-08T00:29:22.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.804 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.860 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.860 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.860 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1453e-05 s, 0.0 kB/s 2023-10-08T00:29:22.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.861 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.916 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-08T00:29:22.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.917 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:22.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:22.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:22.972 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1957e-05 s, 0.0 kB/s 2023-10-08T00:29:22.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:22.973 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-08T00:29:23.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.028 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.084 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.085 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.085 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.4807e-05 s, 0.0 kB/s 2023-10-08T00:29:23.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.085 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.142 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.143 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3053e-05 s, 0.0 kB/s 2023-10-08T00:29:23.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.143 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.199 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.199 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1172e-05 s, 0.0 kB/s 2023-10-08T00:29:23.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.200 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3787e-05 s, 0.0 kB/s 2023-10-08T00:29:23.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.256 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.311 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.311 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.311 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3839e-05 s, 0.0 kB/s 2023-10-08T00:29:23.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.312 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.367 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2886e-05 s, 0.0 kB/s 2023-10-08T00:29:23.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.368 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.423 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.424 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.592e-05 s, 0.0 kB/s 2023-10-08T00:29:23.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.424 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.480 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3006e-05 s, 0.0 kB/s 2023-10-08T00:29:23.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.481 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1895e-05 s, 0.0 kB/s 2023-10-08T00:29:23.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.537 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.592 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.081e-05 s, 0.0 kB/s 2023-10-08T00:29:23.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.648 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.989e-05 s, 0.0 kB/s 2023-10-08T00:29:23.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.649 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.332e-05 s, 0.0 kB/s 2023-10-08T00:29:23.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.705 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.760 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.760 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.760 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0679e-05 s, 0.0 kB/s 2023-10-08T00:29:23.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.761 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.817 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.817 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0366e-05 s, 0.0 kB/s 2023-10-08T00:29:23.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.818 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0223e-05 s, 0.0 kB/s 2023-10-08T00:29:23.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.874 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.929 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-08T00:29:23.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.930 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:23.985 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2323e-05 s, 0.0 kB/s 2023-10-08T00:29:23.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:23.986 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.041 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.041 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.015e-05 s, 0.0 kB/s 2023-10-08T00:29:24.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.042 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9563e-05 s, 0.0 kB/s 2023-10-08T00:29:24.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.098 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.153 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.154 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.154 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2434e-05 s, 0.0 kB/s 2023-10-08T00:29:24.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.154 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.211 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2379e-05 s, 0.0 kB/s 2023-10-08T00:29:24.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.211 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.268 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1166e-05 s, 0.0 kB/s 2023-10-08T00:29:24.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.268 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.323 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1718e-05 s, 0.0 kB/s 2023-10-08T00:29:24.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.324 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1798e-05 s, 0.0 kB/s 2023-10-08T00:29:24.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.380 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.435 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.435 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.435 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-08T00:29:24.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.436 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1287e-05 s, 0.0 kB/s 2023-10-08T00:29:24.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.492 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.547 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-08T00:29:24.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.548 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.604 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.604 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2293e-05 s, 0.0 kB/s 2023-10-08T00:29:24.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.604 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0483e-05 s, 0.0 kB/s 2023-10-08T00:29:24.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.661 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.716 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8364e-05 s, 0.0 kB/s 2023-10-08T00:29:24.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.717 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.772 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2129e-05 s, 0.0 kB/s 2023-10-08T00:29:24.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.773 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.829 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.829 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.829 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3492e-05 s, 0.0 kB/s 2023-10-08T00:29:24.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.829 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.885 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9225e-05 s, 0.0 kB/s 2023-10-08T00:29:24.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.886 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.942 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.942 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.942 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1404e-05 s, 0.0 kB/s 2023-10-08T00:29:24.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.943 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:24.998 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:24.998 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:24.998 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2809e-05 s, 0.0 kB/s 2023-10-08T00:29:24.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:24.999 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9952e-05 s, 0.0 kB/s 2023-10-08T00:29:25.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.055 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.110 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.110 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.110 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3294e-05 s, 0.0 kB/s 2023-10-08T00:29:25.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.166 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.165e-05 s, 0.0 kB/s 2023-10-08T00:29:25.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2134e-05 s, 0.0 kB/s 2023-10-08T00:29:25.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.223 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.279 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-08T00:29:25.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.280 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.335 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.152e-05 s, 0.0 kB/s 2023-10-08T00:29:25.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.336 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.396 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1122e-05 s, 0.0 kB/s 2023-10-08T00:29:25.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.397 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0829e-05 s, 0.0 kB/s 2023-10-08T00:29:25.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.454 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.509 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.509 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0078e-05 s, 0.0 kB/s 2023-10-08T00:29:25.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.510 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.565 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.565 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5457e-05 s, 0.0 kB/s 2023-10-08T00:29:25.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.565 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.621 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.622 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.622 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.151e-05 s, 0.0 kB/s 2023-10-08T00:29:25.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.622 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3425e-05 s, 0.0 kB/s 2023-10-08T00:29:25.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.679 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4378e-05 s, 0.0 kB/s 2023-10-08T00:29:25.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0209e-05 s, 0.0 kB/s 2023-10-08T00:29:25.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.846 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0307e-05 s, 0.0 kB/s 2023-10-08T00:29:25.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.903 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3117e-05 s, 0.0 kB/s 2023-10-08T00:29:25.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:25.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:25.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:25.959 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1531e-05 s, 0.0 kB/s 2023-10-08T00:29:25.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:25.960 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.015 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.016 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.016 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5269e-05 s, 0.0 kB/s 2023-10-08T00:29:26.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.016 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.072 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3875e-05 s, 0.0 kB/s 2023-10-08T00:29:26.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.073 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.128 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.128 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.129 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3953e-05 s, 0.0 kB/s 2023-10-08T00:29:26.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.129 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.190 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5268e-05 s, 0.0 kB/s 2023-10-08T00:29:26.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.191 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.247 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.247 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2813e-05 s, 0.0 kB/s 2023-10-08T00:29:26.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.247 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.304 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3045e-05 s, 0.0 kB/s 2023-10-08T00:29:26.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.304 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.360 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-08T00:29:26.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.361 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.416 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-08T00:29:26.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.417 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.472 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1227e-05 s, 0.0 kB/s 2023-10-08T00:29:26.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.473 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1967e-05 s, 0.0 kB/s 2023-10-08T00:29:26.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.529 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1637e-05 s, 0.0 kB/s 2023-10-08T00:29:26.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.585 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.639 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.093e-05 s, 0.0 kB/s 2023-10-08T00:29:26.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.697 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.698 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1189e-05 s, 0.0 kB/s 2023-10-08T00:29:26.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.698 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.753 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.753 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.753 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3533e-05 s, 0.0 kB/s 2023-10-08T00:29:26.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.754 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.809 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.269e-05 s, 0.0 kB/s 2023-10-08T00:29:26.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.810 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.865 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.865 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.865 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4353e-05 s, 0.0 kB/s 2023-10-08T00:29:26.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.865 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2482e-05 s, 0.0 kB/s 2023-10-08T00:29:26.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.922 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:26.977 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:26.977 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:26.977 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3823e-05 s, 0.0 kB/s 2023-10-08T00:29:26.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:26.977 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.034 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.034 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2696e-05 s, 0.0 kB/s 2023-10-08T00:29:27.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.034 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.093 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.093 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.094 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1612e-05 s, 0.0 kB/s 2023-10-08T00:29:27.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.094 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.156 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1216e-05 s, 0.0 kB/s 2023-10-08T00:29:27.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.157 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0727e-05 s, 0.0 kB/s 2023-10-08T00:29:27.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.280 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.281 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.281 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0341e-05 s, 0.0 kB/s 2023-10-08T00:29:27.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.282 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.343 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1346e-05 s, 0.0 kB/s 2023-10-08T00:29:27.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.404 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.404 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1093e-05 s, 0.0 kB/s 2023-10-08T00:29:27.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.465 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1749e-05 s, 0.0 kB/s 2023-10-08T00:29:27.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.466 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.529 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.529 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5008e-05 s, 0.0 kB/s 2023-10-08T00:29:27.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.530 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.588 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.588 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.589 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1255e-05 s, 0.0 kB/s 2023-10-08T00:29:27.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.589 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.645 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.645 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.645 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.275e-05 s, 0.0 kB/s 2023-10-08T00:29:27.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.646 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.703 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2169e-05 s, 0.0 kB/s 2023-10-08T00:29:27.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.704 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.760 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.760 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.760 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4859e-05 s, 0.0 kB/s 2023-10-08T00:29:27.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.761 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.819 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0674e-05 s, 0.0 kB/s 2023-10-08T00:29:27.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.876 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4551e-05 s, 0.0 kB/s 2023-10-08T00:29:27.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.876 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.935 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-08T00:29:27.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.935 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:27.992 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:27.992 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:27.993 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1503e-05 s, 0.0 kB/s 2023-10-08T00:29:27.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:27.993 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.049 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.049 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.050 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3909e-05 s, 0.0 kB/s 2023-10-08T00:29:28.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.050 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4185e-05 s, 0.0 kB/s 2023-10-08T00:29:28.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.106 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.161 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.161 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.161 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.13e-05 s, 0.0 kB/s 2023-10-08T00:29:28.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.161 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.217 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1735e-05 s, 0.0 kB/s 2023-10-08T00:29:28.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0801e-05 s, 0.0 kB/s 2023-10-08T00:29:28.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0221e-05 s, 0.0 kB/s 2023-10-08T00:29:28.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.386 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.093e-05 s, 0.0 kB/s 2023-10-08T00:29:28.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.442 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1302e-05 s, 0.0 kB/s 2023-10-08T00:29:28.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.443 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1062e-05 s, 0.0 kB/s 2023-10-08T00:29:28.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4513e-05 s, 0.0 kB/s 2023-10-08T00:29:28.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.610 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1157e-05 s, 0.0 kB/s 2023-10-08T00:29:28.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3505e-05 s, 0.0 kB/s 2023-10-08T00:29:28.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.666 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.723 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.723 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1899e-05 s, 0.0 kB/s 2023-10-08T00:29:28.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.723 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.779 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.780 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2696e-05 s, 0.0 kB/s 2023-10-08T00:29:28.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.780 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.836 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9946e-05 s, 0.0 kB/s 2023-10-08T00:29:28.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.893 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3472e-05 s, 0.0 kB/s 2023-10-08T00:29:28.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.893 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:28.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:28.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:28.949 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-08T00:29:28.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:28.950 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.005 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.005 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9015e-05 s, 0.0 kB/s 2023-10-08T00:29:29.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.006 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.061 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.062 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0939e-05 s, 0.0 kB/s 2023-10-08T00:29:29.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.118 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.397e-05 s, 0.0 kB/s 2023-10-08T00:29:29.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.175 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2363e-05 s, 0.0 kB/s 2023-10-08T00:29:29.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.175 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.230 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0589e-05 s, 0.0 kB/s 2023-10-08T00:29:29.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.231 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3147e-05 s, 0.0 kB/s 2023-10-08T00:29:29.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.342 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4162e-05 s, 0.0 kB/s 2023-10-08T00:29:29.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.400 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.400 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0112e-05 s, 0.0 kB/s 2023-10-08T00:29:29.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3173e-05 s, 0.0 kB/s 2023-10-08T00:29:29.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.457 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.512 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.512 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3281e-05 s, 0.0 kB/s 2023-10-08T00:29:29.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.513 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.568 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.569 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4187e-05 s, 0.0 kB/s 2023-10-08T00:29:29.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.569 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.624 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.625 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.625 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0949e-05 s, 0.0 kB/s 2023-10-08T00:29:29.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.625 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.680 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.681 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2224e-05 s, 0.0 kB/s 2023-10-08T00:29:29.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.681 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.737 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.738 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2211e-05 s, 0.0 kB/s 2023-10-08T00:29:29.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.738 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.793 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.794 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0419e-05 s, 0.0 kB/s 2023-10-08T00:29:29.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.795 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2837e-05 s, 0.0 kB/s 2023-10-08T00:29:29.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.852 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.907 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.907 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4254e-05 s, 0.0 kB/s 2023-10-08T00:29:29.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.908 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:29.965 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2034e-05 s, 0.0 kB/s 2023-10-08T00:29:29.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:29.966 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.020 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.021 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.021 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1279e-05 s, 0.0 kB/s 2023-10-08T00:29:30.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.022 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.077 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.342e-05 s, 0.0 kB/s 2023-10-08T00:29:30.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.079 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1953e-05 s, 0.0 kB/s 2023-10-08T00:29:30.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.136 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0741e-05 s, 0.0 kB/s 2023-10-08T00:29:30.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.192 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.248 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.248 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.248 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3505e-05 s, 0.0 kB/s 2023-10-08T00:29:30.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.249 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.304 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.304 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1711e-05 s, 0.0 kB/s 2023-10-08T00:29:30.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.305 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.360 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.360 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0988e-05 s, 0.0 kB/s 2023-10-08T00:29:30.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.361 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.416 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.416 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2183e-05 s, 0.0 kB/s 2023-10-08T00:29:30.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.416 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1048e-05 s, 0.0 kB/s 2023-10-08T00:29:30.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.473 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.528 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.528 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4555e-05 s, 0.0 kB/s 2023-10-08T00:29:30.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.529 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.584 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.325e-05 s, 0.0 kB/s 2023-10-08T00:29:30.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.585 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.640 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.640 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.640 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3981e-05 s, 0.0 kB/s 2023-10-08T00:29:30.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.698 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-08T00:29:30.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.699 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2487e-05 s, 0.0 kB/s 2023-10-08T00:29:30.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1038e-05 s, 0.0 kB/s 2023-10-08T00:29:30.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1006e-05 s, 0.0 kB/s 2023-10-08T00:29:30.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.924 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.924 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.924 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0697e-05 s, 0.0 kB/s 2023-10-08T00:29:30.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.925 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:30.981 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:30.981 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:30.981 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3446e-05 s, 0.0 kB/s 2023-10-08T00:29:30.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:30.982 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4077e-05 s, 0.0 kB/s 2023-10-08T00:29:31.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.038 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.093 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.093 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.094 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0479e-05 s, 0.0 kB/s 2023-10-08T00:29:31.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.094 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.152 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.152 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.152 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1136e-05 s, 0.0 kB/s 2023-10-08T00:29:31.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.153 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.208 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.208 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.208 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.869e-05 s, 0.0 kB/s 2023-10-08T00:29:31.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.208 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.264 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-08T00:29:31.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.265 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.319 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.320 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.320 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0886e-05 s, 0.0 kB/s 2023-10-08T00:29:31.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.321 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1656e-05 s, 0.0 kB/s 2023-10-08T00:29:31.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.378 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.432 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.433 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.433 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4996e-05 s, 0.0 kB/s 2023-10-08T00:29:31.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.434 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:29:31.477 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:29:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.490 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4982e-05 s, 0.0 kB/s 2023-10-08T00:29:31.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.490 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3879e-05 s, 0.0 kB/s 2023-10-08T00:29:31.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.549 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.606 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-08T00:29:31.606 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.606 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.661 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3858e-05 s, 0.0 kB/s 2023-10-08T00:29:31.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.662 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.718 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2348e-05 s, 0.0 kB/s 2023-10-08T00:29:31.718 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.719 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.819 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 6.5565e-05 s, 0.0 kB/s 2023-10-08T00:29:31.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.835 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3255e-05 s, 0.0 kB/s 2023-10-08T00:29:31.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.836 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.892 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0893e-05 s, 0.0 kB/s 2023-10-08T00:29:31.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.893 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:31.950 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3705e-05 s, 0.0 kB/s 2023-10-08T00:29:31.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:31.954 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.007 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1611e-05 s, 0.0 kB/s 2023-10-08T00:29:32.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.062 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.063 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4765e-05 s, 0.0 kB/s 2023-10-08T00:29:32.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.063 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3058e-05 s, 0.0 kB/s 2023-10-08T00:29:32.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.119 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.175 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.175 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1251e-05 s, 0.0 kB/s 2023-10-08T00:29:32.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.176 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.435e-05 s, 0.0 kB/s 2023-10-08T00:29:32.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.232 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.287 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1495e-05 s, 0.0 kB/s 2023-10-08T00:29:32.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.343 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7298e-05 s, 0.0 kB/s 2023-10-08T00:29:32.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.398 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.399 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9192e-05 s, 0.0 kB/s 2023-10-08T00:29:32.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2936e-05 s, 0.0 kB/s 2023-10-08T00:29:32.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.457 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.512 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0519e-05 s, 0.0 kB/s 2023-10-08T00:29:32.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.513 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.569 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.569 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-08T00:29:32.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.569 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.625 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.625 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.625 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3636e-05 s, 0.0 kB/s 2023-10-08T00:29:32.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.626 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.681 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.681 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2541e-05 s, 0.0 kB/s 2023-10-08T00:29:32.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.682 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.738 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.738 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4142e-05 s, 0.0 kB/s 2023-10-08T00:29:32.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.738 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.794 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.795 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.795 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4369e-05 s, 0.0 kB/s 2023-10-08T00:29:32.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.795 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.851 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.851 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0962e-05 s, 0.0 kB/s 2023-10-08T00:29:32.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.852 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.908 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.908 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.908 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-08T00:29:32.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.909 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0443e-05 s, 0.0 kB/s 2023-10-08T00:29:32.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:32.965 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2125e-05 s, 0.0 kB/s 2023-10-08T00:29:33.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.022 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.077 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.077 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.077 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2456e-05 s, 0.0 kB/s 2023-10-08T00:29:33.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.078 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.133 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.133 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.133 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1934e-05 s, 0.0 kB/s 2023-10-08T00:29:33.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.134 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.189 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.189 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.190 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1499e-05 s, 0.0 kB/s 2023-10-08T00:29:33.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.190 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.245 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.245 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.245 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0896e-05 s, 0.0 kB/s 2023-10-08T00:29:33.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.246 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.301 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2019e-05 s, 0.0 kB/s 2023-10-08T00:29:33.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.302 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.357 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.357 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.357 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4804e-05 s, 0.0 kB/s 2023-10-08T00:29:33.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.358 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0435e-05 s, 0.0 kB/s 2023-10-08T00:29:33.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.414 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.469 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3392e-05 s, 0.0 kB/s 2023-10-08T00:29:33.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.470 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.525 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0141e-05 s, 0.0 kB/s 2023-10-08T00:29:33.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.526 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.581 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2289e-05 s, 0.0 kB/s 2023-10-08T00:29:33.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.582 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.638 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1038e-05 s, 0.0 kB/s 2023-10-08T00:29:33.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.638 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.692 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.693 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.693 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2498e-05 s, 0.0 kB/s 2023-10-08T00:29:33.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.694 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.751 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4565e-05 s, 0.0 kB/s 2023-10-08T00:29:33.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.751 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.261e-05 s, 0.0 kB/s 2023-10-08T00:29:33.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.807 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4598e-05 s, 0.0 kB/s 2023-10-08T00:29:33.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.863 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.919 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.919 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1663e-05 s, 0.0 kB/s 2023-10-08T00:29:33.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:33.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:33.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:33.975 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.204e-05 s, 0.0 kB/s 2023-10-08T00:29:33.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:33.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.032 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.032 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2897e-05 s, 0.0 kB/s 2023-10-08T00:29:34.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.032 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0285e-05 s, 0.0 kB/s 2023-10-08T00:29:34.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.089 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.144 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0491e-05 s, 0.0 kB/s 2023-10-08T00:29:34.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.145 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.201 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.201 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.556e-05 s, 0.0 kB/s 2023-10-08T00:29:34.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.201 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0029e-05 s, 0.0 kB/s 2023-10-08T00:29:34.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.257 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.312 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3911e-05 s, 0.0 kB/s 2023-10-08T00:29:34.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.313 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.368 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2612e-05 s, 0.0 kB/s 2023-10-08T00:29:34.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.369 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.425 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.144e-05 s, 0.0 kB/s 2023-10-08T00:29:34.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.425 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.480 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1332e-05 s, 0.0 kB/s 2023-10-08T00:29:34.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.481 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.537 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.988e-05 s, 0.0 kB/s 2023-10-08T00:29:34.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.538 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.594 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.594 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9777e-05 s, 0.0 kB/s 2023-10-08T00:29:34.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.594 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.649 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.650 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0564e-05 s, 0.0 kB/s 2023-10-08T00:29:34.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.650 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.706 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2345e-05 s, 0.0 kB/s 2023-10-08T00:29:34.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.707 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.762 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1652e-05 s, 0.0 kB/s 2023-10-08T00:29:34.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.763 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.818 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3359e-05 s, 0.0 kB/s 2023-10-08T00:29:34.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.874 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2185e-05 s, 0.0 kB/s 2023-10-08T00:29:34.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.875 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.930 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0911e-05 s, 0.0 kB/s 2023-10-08T00:29:34.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.931 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:34.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5818e-05 s, 0.0 kB/s 2023-10-08T00:29:34.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:34.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1958e-05 s, 0.0 kB/s 2023-10-08T00:29:35.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.044 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.100 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.100 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2202e-05 s, 0.0 kB/s 2023-10-08T00:29:35.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.100 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.157 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.935e-05 s, 0.0 kB/s 2023-10-08T00:29:35.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.157 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.212 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4008e-05 s, 0.0 kB/s 2023-10-08T00:29:35.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.268 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.268 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.268 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0498e-05 s, 0.0 kB/s 2023-10-08T00:29:35.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.269 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.325 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3546e-05 s, 0.0 kB/s 2023-10-08T00:29:35.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.326 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.382 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1636e-05 s, 0.0 kB/s 2023-10-08T00:29:35.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.383 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.442 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.11e-05 s, 0.0 kB/s 2023-10-08T00:29:35.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.442 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.387e-05 s, 0.0 kB/s 2023-10-08T00:29:35.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.554 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.145e-05 s, 0.0 kB/s 2023-10-08T00:29:35.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.610 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.610 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.610 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-08T00:29:35.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.676 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8223e-05 s, 0.0 kB/s 2023-10-08T00:29:35.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.677 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.734 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5108e-05 s, 0.0 kB/s 2023-10-08T00:29:35.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.791 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0215e-05 s, 0.0 kB/s 2023-10-08T00:29:35.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.791 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.846 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2128e-05 s, 0.0 kB/s 2023-10-08T00:29:35.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.847 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1818e-05 s, 0.0 kB/s 2023-10-08T00:29:35.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:35.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:35.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:35.960 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.072e-05 s, 0.0 kB/s 2023-10-08T00:29:35.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:35.961 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.016 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.017 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3304e-05 s, 0.0 kB/s 2023-10-08T00:29:36.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.017 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.337e-05 s, 0.0 kB/s 2023-10-08T00:29:36.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.074 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.130 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2599e-05 s, 0.0 kB/s 2023-10-08T00:29:36.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.131 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8203e-05 s, 0.0 kB/s 2023-10-08T00:29:36.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.187 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.243 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-08T00:29:36.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.243 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.298 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.298 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.299 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5316e-05 s, 0.0 kB/s 2023-10-08T00:29:36.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.299 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.353 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.354 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0264e-05 s, 0.0 kB/s 2023-10-08T00:29:36.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2003e-05 s, 0.0 kB/s 2023-10-08T00:29:36.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.412 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.467 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2939e-05 s, 0.0 kB/s 2023-10-08T00:29:36.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.468 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.523 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1248e-05 s, 0.0 kB/s 2023-10-08T00:29:36.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.524 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.579 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1472e-05 s, 0.0 kB/s 2023-10-08T00:29:36.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.580 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.635 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.636 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0807e-05 s, 0.0 kB/s 2023-10-08T00:29:36.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.636 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.691 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.691 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9756e-05 s, 0.0 kB/s 2023-10-08T00:29:36.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.692 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.747 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.748 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.748 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4144e-05 s, 0.0 kB/s 2023-10-08T00:29:36.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.748 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.804 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.804 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.805 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3261e-05 s, 0.0 kB/s 2023-10-08T00:29:36.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.805 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1386e-05 s, 0.0 kB/s 2023-10-08T00:29:36.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.929 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.929 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5802e-05 s, 0.0 kB/s 2023-10-08T00:29:36.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.929 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:36.985 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:36.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:36.986 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4456e-05 s, 0.0 kB/s 2023-10-08T00:29:36.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:36.986 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.043 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5272e-05 s, 0.0 kB/s 2023-10-08T00:29:37.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.043 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2e-05 s, 0 B/s 2023-10-08T00:29:37.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.100 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.156 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4139e-05 s, 0.0 kB/s 2023-10-08T00:29:37.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.157 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.212 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.365e-05 s, 0.0 kB/s 2023-10-08T00:29:37.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.213 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.267 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.268 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5409e-05 s, 0.0 kB/s 2023-10-08T00:29:37.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.269 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.325 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.325 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.222e-05 s, 0.0 kB/s 2023-10-08T00:29:37.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.326 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.381 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.381 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.381 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2793e-05 s, 0.0 kB/s 2023-10-08T00:29:37.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.382 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.438 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4962e-05 s, 0.0 kB/s 2023-10-08T00:29:37.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.438 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.494 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.494 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.494 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3623e-05 s, 0.0 kB/s 2023-10-08T00:29:37.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.495 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.550 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.551 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2674e-05 s, 0.0 kB/s 2023-10-08T00:29:37.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.552 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7644e-05 s, 0.0 kB/s 2023-10-08T00:29:37.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.609 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2634e-05 s, 0.0 kB/s 2023-10-08T00:29:37.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.664 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.719 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2722e-05 s, 0.0 kB/s 2023-10-08T00:29:37.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.720 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.775 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.775 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3171e-05 s, 0.0 kB/s 2023-10-08T00:29:37.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.776 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.831 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.831 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3151e-05 s, 0.0 kB/s 2023-10-08T00:29:37.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.832 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.888 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3627e-05 s, 0.0 kB/s 2023-10-08T00:29:37.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.888 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.943 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0977e-05 s, 0.0 kB/s 2023-10-08T00:29:37.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:37.944 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:37.999 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1082e-05 s, 0.0 kB/s 2023-10-08T00:29:38.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.000 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.055 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0931e-05 s, 0.0 kB/s 2023-10-08T00:29:38.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.056 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0668e-05 s, 0.0 kB/s 2023-10-08T00:29:38.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.111 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.167 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.167 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.167 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4195e-05 s, 0.0 kB/s 2023-10-08T00:29:38.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.168 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.223 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2647e-05 s, 0.0 kB/s 2023-10-08T00:29:38.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.224 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1943e-05 s, 0.0 kB/s 2023-10-08T00:29:38.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.279 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.337 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.338 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.338 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4751e-05 s, 0.0 kB/s 2023-10-08T00:29:38.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.338 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.394 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.394 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.394 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-08T00:29:38.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.395 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.450 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1883e-05 s, 0.0 kB/s 2023-10-08T00:29:38.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.451 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.507 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2625e-05 s, 0.0 kB/s 2023-10-08T00:29:38.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.508 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1757e-05 s, 0.0 kB/s 2023-10-08T00:29:38.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.564 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.619 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1274e-05 s, 0.0 kB/s 2023-10-08T00:29:38.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4181e-05 s, 0.0 kB/s 2023-10-08T00:29:38.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.676 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.731 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.732 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2247e-05 s, 0.0 kB/s 2023-10-08T00:29:38.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.732 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.788 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2753e-05 s, 0.0 kB/s 2023-10-08T00:29:38.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.789 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.845 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3552e-05 s, 0.0 kB/s 2023-10-08T00:29:38.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.846 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.901 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.901 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1661e-05 s, 0.0 kB/s 2023-10-08T00:29:38.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.902 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:38.957 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:38.957 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:38.957 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3173e-05 s, 0.0 kB/s 2023-10-08T00:29:38.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:38.958 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.013 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0788e-05 s, 0.0 kB/s 2023-10-08T00:29:39.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.014 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.069 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.070 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9665e-05 s, 0.0 kB/s 2023-10-08T00:29:39.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.070 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.128 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.128 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1348e-05 s, 0.0 kB/s 2023-10-08T00:29:39.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.129 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.183 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.254e-05 s, 0.0 kB/s 2023-10-08T00:29:39.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.184 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.240 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.241 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4694e-05 s, 0.0 kB/s 2023-10-08T00:29:39.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.241 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1335e-05 s, 0.0 kB/s 2023-10-08T00:29:39.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.296 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.352 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.352 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.352 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9683e-05 s, 0.0 kB/s 2023-10-08T00:29:39.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.353 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.408 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.408 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.408 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1497e-05 s, 0.0 kB/s 2023-10-08T00:29:39.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.409 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.464 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.464 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.464 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.942e-05 s, 0.0 kB/s 2023-10-08T00:29:39.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.465 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.520 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9307e-05 s, 0.0 kB/s 2023-10-08T00:29:39.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.521 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.576 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.576 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.576 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0645e-05 s, 0.0 kB/s 2023-10-08T00:29:39.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.577 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.632 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.633 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0631e-05 s, 0.0 kB/s 2023-10-08T00:29:39.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.633 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.688 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9098e-05 s, 0.0 kB/s 2023-10-08T00:29:39.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.689 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.745 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3747e-05 s, 0.0 kB/s 2023-10-08T00:29:39.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2853e-05 s, 0.0 kB/s 2023-10-08T00:29:39.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.856 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.856 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-08T00:29:39.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.857 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.912 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.913 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1477e-05 s, 0.0 kB/s 2023-10-08T00:29:39.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.913 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:39.968 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:39.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:39.969 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1564e-05 s, 0.0 kB/s 2023-10-08T00:29:39.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:39.969 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.025 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.035e-05 s, 0.0 kB/s 2023-10-08T00:29:40.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.025 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4019e-05 s, 0.0 kB/s 2023-10-08T00:29:40.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.082 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4723e-05 s, 0.0 kB/s 2023-10-08T00:29:40.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.138 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.193 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.194 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0525e-05 s, 0.0 kB/s 2023-10-08T00:29:40.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.195 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.251 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1261e-05 s, 0.0 kB/s 2023-10-08T00:29:40.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.252 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.307 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.307 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.307 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0472e-05 s, 0.0 kB/s 2023-10-08T00:29:40.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.308 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.363 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1981e-05 s, 0.0 kB/s 2023-10-08T00:29:40.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.364 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.419 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9966e-05 s, 0.0 kB/s 2023-10-08T00:29:40.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.419 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.475 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2272e-05 s, 0.0 kB/s 2023-10-08T00:29:40.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.476 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0194e-05 s, 0.0 kB/s 2023-10-08T00:29:40.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.532 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.587 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.063e-05 s, 0.0 kB/s 2023-10-08T00:29:40.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.588 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.643 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.643 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2163e-05 s, 0.0 kB/s 2023-10-08T00:29:40.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.644 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.700 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.700 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.701 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4859e-05 s, 0.0 kB/s 2023-10-08T00:29:40.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.701 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.756 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.756 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.757 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3185e-05 s, 0.0 kB/s 2023-10-08T00:29:40.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.757 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.812 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.812 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.813 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3594e-05 s, 0.0 kB/s 2023-10-08T00:29:40.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.813 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.868 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2107e-05 s, 0.0 kB/s 2023-10-08T00:29:40.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.869 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.924 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-08T00:29:40.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.925 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:40.980 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:40.980 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:40.980 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1847e-05 s, 0.0 kB/s 2023-10-08T00:29:40.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:40.981 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2609e-05 s, 0.0 kB/s 2023-10-08T00:29:41.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.037 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9966e-05 s, 0.0 kB/s 2023-10-08T00:29:41.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.093 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1967e-05 s, 0.0 kB/s 2023-10-08T00:29:41.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.205 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3261e-05 s, 0.0 kB/s 2023-10-08T00:29:41.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.205 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.262 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1542e-05 s, 0.0 kB/s 2023-10-08T00:29:41.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.262 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.319 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1031e-05 s, 0.0 kB/s 2023-10-08T00:29:41.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.320 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.376 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3333e-05 s, 0.0 kB/s 2023-10-08T00:29:41.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.377 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.433 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.433 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.433 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.422e-05 s, 0.0 kB/s 2023-10-08T00:29:41.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.433 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.490 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.490 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4811e-05 s, 0.0 kB/s 2023-10-08T00:29:41.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.490 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.547 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.547 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3812e-05 s, 0.0 kB/s 2023-10-08T00:29:41.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.547 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.604 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.604 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3848e-05 s, 0.0 kB/s 2023-10-08T00:29:41.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.604 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.662 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.662 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2349e-05 s, 0.0 kB/s 2023-10-08T00:29:41.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.663 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.719 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2425e-05 s, 0.0 kB/s 2023-10-08T00:29:41.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.719 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.776 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.776 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4641e-05 s, 0.0 kB/s 2023-10-08T00:29:41.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.777 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3071e-05 s, 0.0 kB/s 2023-10-08T00:29:41.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.833 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.889 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0542e-05 s, 0.0 kB/s 2023-10-08T00:29:41.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.890 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:41.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:41.946 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:41.946 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.47e-05 s, 0.0 kB/s 2023-10-08T00:29:41.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:41.947 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.003 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.003 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5529e-05 s, 0.0 kB/s 2023-10-08T00:29:42.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.003 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.060 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5551e-05 s, 0.0 kB/s 2023-10-08T00:29:42.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.061 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2782e-05 s, 0.0 kB/s 2023-10-08T00:29:42.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.118 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.173 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.174 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.174 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-08T00:29:42.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.174 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.230 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.231 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.231 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3759e-05 s, 0.0 kB/s 2023-10-08T00:29:42.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.231 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.287 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.288 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5708e-05 s, 0.0 kB/s 2023-10-08T00:29:42.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.288 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.343 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.344 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.344 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3282e-05 s, 0.0 kB/s 2023-10-08T00:29:42.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.344 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.399 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.399 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0721e-05 s, 0.0 kB/s 2023-10-08T00:29:42.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.400 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1496e-05 s, 0.0 kB/s 2023-10-08T00:29:42.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.456 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.511 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1893e-05 s, 0.0 kB/s 2023-10-08T00:29:42.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.512 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.567 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4451e-05 s, 0.0 kB/s 2023-10-08T00:29:42.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.568 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.623 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.624 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.624 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.1632e-05 s, 0.0 kB/s 2023-10-08T00:29:42.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.624 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.680 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.725 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-08T00:29:42.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.741 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.741 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.741 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3548e-05 s, 0.0 kB/s 2023-10-08T00:29:42.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.742 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.797 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3518e-05 s, 0.0 kB/s 2023-10-08T00:29:42.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.798 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.854 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.855 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.855 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0041e-05 s, 0.0 kB/s 2023-10-08T00:29:42.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.855 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2975e-05 s, 0.0 kB/s 2023-10-08T00:29:42.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.911 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:42.966 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:42.966 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:42.966 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1377e-05 s, 0.0 kB/s 2023-10-08T00:29:42.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:42.967 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.022 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.023 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2309e-05 s, 0.0 kB/s 2023-10-08T00:29:43.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.023 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5917e-05 s, 0.0 kB/s 2023-10-08T00:29:43.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.088 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.145 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.145 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.146 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2254e-05 s, 0.0 kB/s 2023-10-08T00:29:43.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.146 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.202 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.203 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4679e-05 s, 0.0 kB/s 2023-10-08T00:29:43.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.203 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.259 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.259 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.259 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4095e-05 s, 0.0 kB/s 2023-10-08T00:29:43.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.260 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.315 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.315 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.316 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3737e-05 s, 0.0 kB/s 2023-10-08T00:29:43.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.316 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.372 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.219e-05 s, 0.0 kB/s 2023-10-08T00:29:43.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.373 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.428 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.428 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.428 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.082e-05 s, 0.0 kB/s 2023-10-08T00:29:43.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.429 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.485 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.485 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2228e-05 s, 0.0 kB/s 2023-10-08T00:29:43.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.486 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.541 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.541 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.541 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.416e-05 s, 0.0 kB/s 2023-10-08T00:29:43.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.542 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.597 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0253e-05 s, 0.0 kB/s 2023-10-08T00:29:43.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.597 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1027e-05 s, 0.0 kB/s 2023-10-08T00:29:43.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.654 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.709 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2073e-05 s, 0.0 kB/s 2023-10-08T00:29:43.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.710 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.766 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.766 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.766 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0496e-05 s, 0.0 kB/s 2023-10-08T00:29:43.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.767 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.822 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9613e-05 s, 0.0 kB/s 2023-10-08T00:29:43.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.823 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.878 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.879 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.879 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2602e-05 s, 0.0 kB/s 2023-10-08T00:29:43.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.879 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2588e-05 s, 0.0 kB/s 2023-10-08T00:29:43.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.936 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2087e-05 s, 0.0 kB/s 2023-10-08T00:29:43.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:43.992 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.048 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.048 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2513e-05 s, 0.0 kB/s 2023-10-08T00:29:44.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.048 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.104 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.104 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1579e-05 s, 0.0 kB/s 2023-10-08T00:29:44.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.105 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.161 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.161 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.161 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0419e-05 s, 0.0 kB/s 2023-10-08T00:29:44.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.161 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.217 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4462e-05 s, 0.0 kB/s 2023-10-08T00:29:44.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.218 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.273 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.273 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4726e-05 s, 0.0 kB/s 2023-10-08T00:29:44.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.328 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.329 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.329 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1597e-05 s, 0.0 kB/s 2023-10-08T00:29:44.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.330 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.386 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.387 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.387 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0736e-05 s, 0.0 kB/s 2023-10-08T00:29:44.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.387 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.442 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.442 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1755e-05 s, 0.0 kB/s 2023-10-08T00:29:44.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.443 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.498 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1573e-05 s, 0.0 kB/s 2023-10-08T00:29:44.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.499 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.554 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.554 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.8928e-05 s, 0.0 kB/s 2023-10-08T00:29:44.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.555 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.611 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.611 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6116e-05 s, 0.0 kB/s 2023-10-08T00:29:44.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.667 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.668 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.668 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2213e-05 s, 0.0 kB/s 2023-10-08T00:29:44.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.668 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.724 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.724 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4531e-05 s, 0.0 kB/s 2023-10-08T00:29:44.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.724 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5336e-05 s, 0.0 kB/s 2023-10-08T00:29:44.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.781 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.836 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.837 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.837 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.999e-05 s, 0.0 kB/s 2023-10-08T00:29:44.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.837 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.893 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.894 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5428e-05 s, 0.0 kB/s 2023-10-08T00:29:44.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.894 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:44.949 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.267e-05 s, 0.0 kB/s 2023-10-08T00:29:44.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:44.950 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.006 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.007 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0001e-05 s, 0.0 kB/s 2023-10-08T00:29:45.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.007 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.063 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.064 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.264e-05 s, 0.0 kB/s 2023-10-08T00:29:45.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.064 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.120 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.506e-05 s, 0.0 kB/s 2023-10-08T00:29:45.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.121 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.177 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.177 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.177 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4231e-05 s, 0.0 kB/s 2023-10-08T00:29:45.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.178 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.233 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2371e-05 s, 0.0 kB/s 2023-10-08T00:29:45.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.234 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.289 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.290 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.290 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3632e-05 s, 0.0 kB/s 2023-10-08T00:29:45.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.290 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.347 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.347 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0765e-05 s, 0.0 kB/s 2023-10-08T00:29:45.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.348 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.403 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.404 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.404 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2324e-05 s, 0.0 kB/s 2023-10-08T00:29:45.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.461 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.461 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.461 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.135e-05 s, 0.0 kB/s 2023-10-08T00:29:45.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.462 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.518 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.518 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3381e-05 s, 0.0 kB/s 2023-10-08T00:29:45.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.518 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.574 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.574 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9323e-05 s, 0.0 kB/s 2023-10-08T00:29:45.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.575 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1667e-05 s, 0.0 kB/s 2023-10-08T00:29:45.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.631 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.9041e-05 s, 0.0 kB/s 2023-10-08T00:29:45.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.688 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4444e-05 s, 0.0 kB/s 2023-10-08T00:29:45.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.801 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.263e-05 s, 0.0 kB/s 2023-10-08T00:29:45.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2066e-05 s, 0.0 kB/s 2023-10-08T00:29:45.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.859 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.916 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.244e-05 s, 0.0 kB/s 2023-10-08T00:29:45.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.917 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:45.971 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:45.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:45.972 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3324e-05 s, 0.0 kB/s 2023-10-08T00:29:45.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:45.973 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.028 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.028 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.028 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1091e-05 s, 0.0 kB/s 2023-10-08T00:29:46.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.029 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.084 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.085 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5913e-05 s, 0.0 kB/s 2023-10-08T00:29:46.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.085 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.140 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.488e-05 s, 0.0 kB/s 2023-10-08T00:29:46.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.141 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.49e-05 s, 0.0 kB/s 2023-10-08T00:29:46.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.198 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.253 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.253 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.254 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8935e-05 s, 0.0 kB/s 2023-10-08T00:29:46.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.254 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.310 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.310 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1883e-05 s, 0.0 kB/s 2023-10-08T00:29:46.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.311 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.367 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.368 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.368 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0435e-05 s, 0.0 kB/s 2023-10-08T00:29:46.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.369 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.424 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.424 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9921e-05 s, 0.0 kB/s 2023-10-08T00:29:46.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.425 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.480 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.480 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1362e-05 s, 0.0 kB/s 2023-10-08T00:29:46.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.481 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.536 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.537 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1667e-05 s, 0.0 kB/s 2023-10-08T00:29:46.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.537 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.592 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.593 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0618e-05 s, 0.0 kB/s 2023-10-08T00:29:46.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.593 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.651 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0402e-05 s, 0.0 kB/s 2023-10-08T00:29:46.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.651 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.706 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0856e-05 s, 0.0 kB/s 2023-10-08T00:29:46.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.707 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.762 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2394e-05 s, 0.0 kB/s 2023-10-08T00:29:46.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.763 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.819 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3294e-05 s, 0.0 kB/s 2023-10-08T00:29:46.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.819 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.874 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.875 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.328e-05 s, 0.0 kB/s 2023-10-08T00:29:46.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.875 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.930 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.931 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.931 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2035e-05 s, 0.0 kB/s 2023-10-08T00:29:46.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.931 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:46.986 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:46.987 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4164e-05 s, 0.0 kB/s 2023-10-08T00:29:46.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:46.987 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.043 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.044 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-08T00:29:47.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.044 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.099 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3519e-05 s, 0.0 kB/s 2023-10-08T00:29:47.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.100 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.156 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.157 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.157 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.12e-05 s, 0.0 kB/s 2023-10-08T00:29:47.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.157 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-08T00:29:47.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.214 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.270 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4514e-05 s, 0.0 kB/s 2023-10-08T00:29:47.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.271 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.326 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.326 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3396e-05 s, 0.0 kB/s 2023-10-08T00:29:47.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.327 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.382 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.383 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.383 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3642e-05 s, 0.0 kB/s 2023-10-08T00:29:47.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.383 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.440 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6831e-05 s, 0.0 kB/s 2023-10-08T00:29:47.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.440 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.496 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.497 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.497 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3437e-05 s, 0.0 kB/s 2023-10-08T00:29:47.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.498 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.553 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.553 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.553 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4877e-05 s, 0.0 kB/s 2023-10-08T00:29:47.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.553 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.609 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.610 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1449e-05 s, 0.0 kB/s 2023-10-08T00:29:47.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.610 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.664 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.665 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.665 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1983e-05 s, 0.0 kB/s 2023-10-08T00:29:47.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.666 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3747e-05 s, 0.0 kB/s 2023-10-08T00:29:47.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.726 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.782 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.783 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6091e-05 s, 0.0 kB/s 2023-10-08T00:29:47.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.783 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2004e-05 s, 0.0 kB/s 2023-10-08T00:29:47.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.840 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.896 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.896 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.288e-05 s, 0.0 kB/s 2023-10-08T00:29:47.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.897 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:47.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:47.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:47.959 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-08T00:29:47.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:47.960 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.017 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.263e-05 s, 0.0 kB/s 2023-10-08T00:29:48.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.079 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2432e-05 s, 0.0 kB/s 2023-10-08T00:29:48.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.080 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3101e-05 s, 0.0 kB/s 2023-10-08T00:29:48.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.141 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.201 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.201 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.201 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2303e-05 s, 0.0 kB/s 2023-10-08T00:29:48.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.201 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.264 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.265 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.265 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1176e-05 s, 0.0 kB/s 2023-10-08T00:29:48.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.265 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.324 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.324 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3329e-05 s, 0.0 kB/s 2023-10-08T00:29:48.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.324 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3594e-05 s, 0.0 kB/s 2023-10-08T00:29:48.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.384 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.448 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.448 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3375e-05 s, 0.0 kB/s 2023-10-08T00:29:48.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.450 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.505 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3472e-05 s, 0.0 kB/s 2023-10-08T00:29:48.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.505 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.562 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.563 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4315e-05 s, 0.0 kB/s 2023-10-08T00:29:48.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.563 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3525e-05 s, 0.0 kB/s 2023-10-08T00:29:48.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.714 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.715 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.5709e-05 s, 0.0 kB/s 2023-10-08T00:29:48.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.715 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6019e-05 s, 0.0 kB/s 2023-10-08T00:29:48.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.732 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.789 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.790 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2648e-05 s, 0.0 kB/s 2023-10-08T00:29:48.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.845 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.846 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7345e-05 s, 0.0 kB/s 2023-10-08T00:29:48.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.846 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.902 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2343e-05 s, 0.0 kB/s 2023-10-08T00:29:48.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.903 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3573e-05 s, 0.0 kB/s 2023-10-08T00:29:48.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:48.960 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.016 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.016 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.016 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2162e-05 s, 0.0 kB/s 2023-10-08T00:29:49.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.017 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.918e-05 s, 0.0 kB/s 2023-10-08T00:29:49.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.074 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.129 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.130 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3327e-05 s, 0.0 kB/s 2023-10-08T00:29:49.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.130 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.187 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5374e-05 s, 0.0 kB/s 2023-10-08T00:29:49.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.188 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.244 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.244 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2636e-05 s, 0.0 kB/s 2023-10-08T00:29:49.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.244 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.300 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.301 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.301 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5274e-05 s, 0.0 kB/s 2023-10-08T00:29:49.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.301 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.357 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.358 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2079e-05 s, 0.0 kB/s 2023-10-08T00:29:49.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.358 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.413 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3691e-05 s, 0.0 kB/s 2023-10-08T00:29:49.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.414 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.470 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.471 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.386e-05 s, 0.0 kB/s 2023-10-08T00:29:49.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.471 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-08T00:29:49.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.527 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.582 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.582 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.583 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-08T00:29:49.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.583 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.639 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.639 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.639 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5936e-05 s, 0.0 kB/s 2023-10-08T00:29:49.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.639 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.695 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.695 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.696 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5416e-05 s, 0.0 kB/s 2023-10-08T00:29:49.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.696 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.751 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.752 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.752 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3234e-05 s, 0.0 kB/s 2023-10-08T00:29:49.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.752 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.809 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3551e-05 s, 0.0 kB/s 2023-10-08T00:29:49.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.809 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6692e-05 s, 0.0 kB/s 2023-10-08T00:29:49.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.866 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2958e-05 s, 0.0 kB/s 2023-10-08T00:29:49.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:49.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:49.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:49.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1258e-05 s, 0.0 kB/s 2023-10-08T00:29:49.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:49.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.035 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0185e-05 s, 0.0 kB/s 2023-10-08T00:29:50.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.091 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.091 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-08T00:29:50.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.092 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.147 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.147 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.422e-05 s, 0.0 kB/s 2023-10-08T00:29:50.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.148 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.205 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2657e-05 s, 0.0 kB/s 2023-10-08T00:29:50.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.205 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.261 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.262 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2176e-05 s, 0.0 kB/s 2023-10-08T00:29:50.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.262 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1153e-05 s, 0.0 kB/s 2023-10-08T00:29:50.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.318 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7541e-05 s, 0.0 kB/s 2023-10-08T00:29:50.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.376 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.431 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.432 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.432 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.301e-05 s, 0.0 kB/s 2023-10-08T00:29:50.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.432 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5353e-05 s, 0.0 kB/s 2023-10-08T00:29:50.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.490 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.545 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3678e-05 s, 0.0 kB/s 2023-10-08T00:29:50.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.545 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3552e-05 s, 0.0 kB/s 2023-10-08T00:29:50.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.602 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.659 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.174e-05 s, 0.0 kB/s 2023-10-08T00:29:50.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.659 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.715 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2164e-05 s, 0.0 kB/s 2023-10-08T00:29:50.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.716 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2683e-05 s, 0.0 kB/s 2023-10-08T00:29:50.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.772 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.872e-05 s, 0.0 kB/s 2023-10-08T00:29:50.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.829 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.884 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.884 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.884 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4625e-05 s, 0.0 kB/s 2023-10-08T00:29:50.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.885 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4766e-05 s, 0.0 kB/s 2023-10-08T00:29:50.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.942 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:50.997 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5377e-05 s, 0.0 kB/s 2023-10-08T00:29:50.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:50.998 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9749e-05 s, 0.0 kB/s 2023-10-08T00:29:51.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.054 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2438e-05 s, 0.0 kB/s 2023-10-08T00:29:51.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.165 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.165 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.166 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.798e-05 s, 0.0 kB/s 2023-10-08T00:29:51.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.166 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.223 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.223 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.277e-05 s, 0.0 kB/s 2023-10-08T00:29:51.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.224 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.279 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.279 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2589e-05 s, 0.0 kB/s 2023-10-08T00:29:51.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.280 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.336 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3538e-05 s, 0.0 kB/s 2023-10-08T00:29:51.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.336 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.391 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.391 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3699e-05 s, 0.0 kB/s 2023-10-08T00:29:51.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.392 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.447 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.448 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.166e-05 s, 0.0 kB/s 2023-10-08T00:29:51.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.448 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.503 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.504 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.504 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2684e-05 s, 0.0 kB/s 2023-10-08T00:29:51.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.504 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2538e-05 s, 0.0 kB/s 2023-10-08T00:29:51.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.561 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9539e-05 s, 0.0 kB/s 2023-10-08T00:29:51.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.617 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.672 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.672 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.672 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.2446e-05 s, 0.0 kB/s 2023-10-08T00:29:51.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.673 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.731 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.112e-05 s, 0.0 kB/s 2023-10-08T00:29:51.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.731 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.787 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.788 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.788 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2048e-05 s, 0.0 kB/s 2023-10-08T00:29:51.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.789 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.843 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.844 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.844 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-08T00:29:51.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.845 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.902 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.902 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0931e-05 s, 0.0 kB/s 2023-10-08T00:29:51.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.903 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:51.959 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.265e-05 s, 0.0 kB/s 2023-10-08T00:29:51.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:51.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.014 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2568e-05 s, 0.0 kB/s 2023-10-08T00:29:52.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.014 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.070 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2269e-05 s, 0.0 kB/s 2023-10-08T00:29:52.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.071 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.127 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.128 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.128 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4696e-05 s, 0.0 kB/s 2023-10-08T00:29:52.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.128 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.184 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.184 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.184 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0835e-05 s, 0.0 kB/s 2023-10-08T00:29:52.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.185 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.242 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3807e-05 s, 0.0 kB/s 2023-10-08T00:29:52.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.243 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.298 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.298 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.299 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2413e-05 s, 0.0 kB/s 2023-10-08T00:29:52.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.299 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.355 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2509e-05 s, 0.0 kB/s 2023-10-08T00:29:52.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.411 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.412 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.318e-05 s, 0.0 kB/s 2023-10-08T00:29:52.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.412 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.467 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.468 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3687e-05 s, 0.0 kB/s 2023-10-08T00:29:52.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.468 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.523 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.523 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0897e-05 s, 0.0 kB/s 2023-10-08T00:29:52.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.524 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.579 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.579 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1313e-05 s, 0.0 kB/s 2023-10-08T00:29:52.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.580 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.635 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.636 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5125e-05 s, 0.0 kB/s 2023-10-08T00:29:52.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.636 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.692 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.692 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.692 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2973e-05 s, 0.0 kB/s 2023-10-08T00:29:52.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.693 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.749 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.749 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.749 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3619e-05 s, 0.0 kB/s 2023-10-08T00:29:52.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.750 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.805 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.805 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.805 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2294e-05 s, 0.0 kB/s 2023-10-08T00:29:52.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.806 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.862 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.862 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3664e-05 s, 0.0 kB/s 2023-10-08T00:29:52.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.862 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.918 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.919 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9114e-05 s, 0.0 kB/s 2023-10-08T00:29:52.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.919 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:52.974 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:52.975 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:52.975 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-08T00:29:52.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:52.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.031 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.032 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.032 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0521e-05 s, 0.0 kB/s 2023-10-08T00:29:53.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.032 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2416e-05 s, 0.0 kB/s 2023-10-08T00:29:53.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.088 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.143 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.144 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.144 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0462e-05 s, 0.0 kB/s 2023-10-08T00:29:53.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.144 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.200 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.200 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.097e-05 s, 0.0 kB/s 2023-10-08T00:29:53.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.201 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.256 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.256 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0099e-05 s, 0.0 kB/s 2023-10-08T00:29:53.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.257 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.312 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.312 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3972e-05 s, 0.0 kB/s 2023-10-08T00:29:53.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.313 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.369 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.369 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.369 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3747e-05 s, 0.0 kB/s 2023-10-08T00:29:53.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.369 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.425 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.425 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-08T00:29:53.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.426 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.481 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.482 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.482 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.557e-05 s, 0.0 kB/s 2023-10-08T00:29:53.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.482 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.538 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.539 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.539 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3287e-05 s, 0.0 kB/s 2023-10-08T00:29:53.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.539 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.594 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.594 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.594 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1669e-05 s, 0.0 kB/s 2023-10-08T00:29:53.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.595 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.650 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.650 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0337e-05 s, 0.0 kB/s 2023-10-08T00:29:53.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.651 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.706 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.706 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0355e-05 s, 0.0 kB/s 2023-10-08T00:29:53.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.707 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.763 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.763 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2417e-05 s, 0.0 kB/s 2023-10-08T00:29:53.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.763 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.827 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.827 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3973e-05 s, 0.0 kB/s 2023-10-08T00:29:53.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.827 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.883 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.884 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.884 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2783e-05 s, 0.0 kB/s 2023-10-08T00:29:53.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.884 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.940 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.940 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.940 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1331e-05 s, 0.0 kB/s 2023-10-08T00:29:53.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.941 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:53.996 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:53.996 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:53.997 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9162e-05 s, 0.0 kB/s 2023-10-08T00:29:53.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:53.997 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.052 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9517e-05 s, 0.0 kB/s 2023-10-08T00:29:54.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.053 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3208e-05 s, 0.0 kB/s 2023-10-08T00:29:54.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.110 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.166 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.166 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.166 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0593e-05 s, 0.0 kB/s 2023-10-08T00:29:54.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.167 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.222 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.222 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.372e-05 s, 0.0 kB/s 2023-10-08T00:29:54.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.222 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0657e-05 s, 0.0 kB/s 2023-10-08T00:29:54.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.279 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.335 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.336 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.336 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.789e-05 s, 0.0 kB/s 2023-10-08T00:29:54.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.336 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1476e-05 s, 0.0 kB/s 2023-10-08T00:29:54.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.393 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.449 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.450 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6194e-05 s, 0.0 kB/s 2023-10-08T00:29:54.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.450 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2014e-05 s, 0.0 kB/s 2023-10-08T00:29:54.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.507 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2378e-05 s, 0.0 kB/s 2023-10-08T00:29:54.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.564 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.619 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.187e-05 s, 0.0 kB/s 2023-10-08T00:29:54.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.675 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.675 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.675 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7388e-05 s, 0.0 kB/s 2023-10-08T00:29:54.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.676 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.734 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.735 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.735 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3536e-05 s, 0.0 kB/s 2023-10-08T00:29:54.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.735 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.792 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.792 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4732e-05 s, 0.0 kB/s 2023-10-08T00:29:54.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.792 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.848 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.848 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.849 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5184e-05 s, 0.0 kB/s 2023-10-08T00:29:54.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.849 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.904 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5205e-05 s, 0.0 kB/s 2023-10-08T00:29:54.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.905 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:54.961 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3179e-05 s, 0.0 kB/s 2023-10-08T00:29:54.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:54.962 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.018 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.018 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4274e-05 s, 0.0 kB/s 2023-10-08T00:29:55.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.074 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.074 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.251e-05 s, 0.0 kB/s 2023-10-08T00:29:55.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.075 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.131 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0098e-05 s, 0.0 kB/s 2023-10-08T00:29:55.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.131 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2767e-05 s, 0.0 kB/s 2023-10-08T00:29:55.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.188 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.243 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.243 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2689e-05 s, 0.0 kB/s 2023-10-08T00:29:55.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.244 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.299 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.299 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1493e-05 s, 0.0 kB/s 2023-10-08T00:29:55.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.300 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.355 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.356 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2709e-05 s, 0.0 kB/s 2023-10-08T00:29:55.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.356 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.413 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.414 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2737e-05 s, 0.0 kB/s 2023-10-08T00:29:55.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.414 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.469 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.470 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.470 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-08T00:29:55.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.470 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.527 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.527 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.527 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3815e-05 s, 0.0 kB/s 2023-10-08T00:29:55.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.528 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.584 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.586 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.586 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.413e-05 s, 0.0 kB/s 2023-10-08T00:29:55.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.587 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.641 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.641 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7714e-05 s, 0.0 kB/s 2023-10-08T00:29:55.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.641 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.698 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6059e-05 s, 0.0 kB/s 2023-10-08T00:29:55.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.698 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.755 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.755 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2637e-05 s, 0.0 kB/s 2023-10-08T00:29:55.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.755 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.811 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.811 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.237e-05 s, 0.0 kB/s 2023-10-08T00:29:55.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.812 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.868 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2927e-05 s, 0.0 kB/s 2023-10-08T00:29:55.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.868 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.923 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.923 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1879e-05 s, 0.0 kB/s 2023-10-08T00:29:55.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.924 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:55.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:55.979 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:55.979 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2754e-05 s, 0.0 kB/s 2023-10-08T00:29:55.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:55.980 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.035 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.035 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1853e-05 s, 0.0 kB/s 2023-10-08T00:29:56.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.036 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.092 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.092 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3526e-05 s, 0.0 kB/s 2023-10-08T00:29:56.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.092 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.149 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.149 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.149 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2753e-05 s, 0.0 kB/s 2023-10-08T00:29:56.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.149 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.204 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.205 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.205 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2406e-05 s, 0.0 kB/s 2023-10-08T00:29:56.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.206 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.262 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.262 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4302e-05 s, 0.0 kB/s 2023-10-08T00:29:56.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.263 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.318 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.318 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2644e-05 s, 0.0 kB/s 2023-10-08T00:29:56.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.319 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.374 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.375 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2395e-05 s, 0.0 kB/s 2023-10-08T00:29:56.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.375 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.432 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4177e-05 s, 0.0 kB/s 2023-10-08T00:29:56.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.433 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5311e-05 s, 0.0 kB/s 2023-10-08T00:29:56.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.546 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.546 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.546 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.213e-05 s, 0.0 kB/s 2023-10-08T00:29:56.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.546 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.602 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.603 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2595e-05 s, 0.0 kB/s 2023-10-08T00:29:56.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.603 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.659 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.659 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0052e-05 s, 0.0 kB/s 2023-10-08T00:29:56.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.660 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.716 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.716 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.716 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3867e-05 s, 0.0 kB/s 2023-10-08T00:29:56.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.716 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.773 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.773 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.773 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-08T00:29:56.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.774 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.830 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.830 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.327e-05 s, 0.0 kB/s 2023-10-08T00:29:56.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.831 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1462e-05 s, 0.0 kB/s 2023-10-08T00:29:56.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.887 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.943 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0023e-05 s, 0.0 kB/s 2023-10-08T00:29:56.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:56.944 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4531e-05 s, 0.0 kB/s 2023-10-08T00:29:57.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.000 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.055 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.055 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1197e-05 s, 0.0 kB/s 2023-10-08T00:29:57.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.056 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.111 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.112 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.112 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.0467e-05 s, 0.0 kB/s 2023-10-08T00:29:57.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.112 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.168 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.168 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.168 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2297e-05 s, 0.0 kB/s 2023-10-08T00:29:57.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.169 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.224 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.224 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.224 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2879e-05 s, 0.0 kB/s 2023-10-08T00:29:57.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.225 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.280 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.280 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.280 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3558e-05 s, 0.0 kB/s 2023-10-08T00:29:57.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.281 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.336 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.336 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.336 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3253e-05 s, 0.0 kB/s 2023-10-08T00:29:57.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.337 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.393 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.393 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2556e-05 s, 0.0 kB/s 2023-10-08T00:29:57.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.394 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.450 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2132e-05 s, 0.0 kB/s 2023-10-08T00:29:57.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.450 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.506 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.506 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.506 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-08T00:29:57.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.507 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.563 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.563 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1795e-05 s, 0.0 kB/s 2023-10-08T00:29:57.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.565 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.619 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.619 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4021e-05 s, 0.0 kB/s 2023-10-08T00:29:57.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.620 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.675 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.676 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1558e-05 s, 0.0 kB/s 2023-10-08T00:29:57.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.676 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.732 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.733 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.733 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4026e-05 s, 0.0 kB/s 2023-10-08T00:29:57.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.733 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.790 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.790 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0143e-05 s, 0.0 kB/s 2023-10-08T00:29:57.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.847 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9091e-05 s, 0.0 kB/s 2023-10-08T00:29:57.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.848 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2737e-05 s, 0.0 kB/s 2023-10-08T00:29:57.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.904 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:57.959 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:57.960 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:57.960 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2621e-05 s, 0.0 kB/s 2023-10-08T00:29:57.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:57.960 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.017 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.017 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.282e-05 s, 0.0 kB/s 2023-10-08T00:29:58.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.018 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.073 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2238e-05 s, 0.0 kB/s 2023-10-08T00:29:58.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.074 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-08T00:29:58.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.130 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.185 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.185 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.185 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1079e-05 s, 0.0 kB/s 2023-10-08T00:29:58.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.186 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.142e-05 s, 0.0 kB/s 2023-10-08T00:29:58.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.242 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.297 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.297 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2092e-05 s, 0.0 kB/s 2023-10-08T00:29:58.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.298 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.353 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.354 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.354 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-08T00:29:58.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.355 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3441e-05 s, 0.0 kB/s 2023-10-08T00:29:58.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.410 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.466 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.466 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-08T00:29:58.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.466 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.522 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.522 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.522 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3296e-05 s, 0.0 kB/s 2023-10-08T00:29:58.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.523 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.43e-05 s, 0.0 kB/s 2023-10-08T00:29:58.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.580 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.637 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.637 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2783e-05 s, 0.0 kB/s 2023-10-08T00:29:58.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.638 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.693 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.693 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.693 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9843e-05 s, 0.0 kB/s 2023-10-08T00:29:58.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.694 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.750 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.750 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4901e-05 s, 0.0 kB/s 2023-10-08T00:29:58.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.751 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.806 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1718e-05 s, 0.0 kB/s 2023-10-08T00:29:58.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.807 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.863 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.864 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2661e-05 s, 0.0 kB/s 2023-10-08T00:29:58.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.864 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.972 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.972 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.067e-05 s, 0.0 kB/s 2023-10-08T00:29:58.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.973 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:58.989 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:58.989 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:58.990 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3958e-05 s, 0.0 kB/s 2023-10-08T00:29:58.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:58.990 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.045 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.045 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.045 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4358e-05 s, 0.0 kB/s 2023-10-08T00:29:59.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.046 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.102 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.103 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.103 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.9431e-05 s, 0.0 kB/s 2023-10-08T00:29:59.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.103 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.159 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.741e-05 s, 0.0 kB/s 2023-10-08T00:29:59.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.160 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.216 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.217 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.421e-05 s, 0.0 kB/s 2023-10-08T00:29:59.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.217 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.274 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.274 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.274 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1999e-05 s, 0.0 kB/s 2023-10-08T00:29:59.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.274 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.331 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.331 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1497e-05 s, 0.0 kB/s 2023-10-08T00:29:59.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.331 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.388 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.388 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3397e-05 s, 0.0 kB/s 2023-10-08T00:29:59.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.388 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.444 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.445 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2113e-05 s, 0.0 kB/s 2023-10-08T00:29:59.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.446 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.502 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.502 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.502 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4321e-05 s, 0.0 kB/s 2023-10-08T00:29:59.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.503 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.558 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.559 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.559 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4154e-05 s, 0.0 kB/s 2023-10-08T00:29:59.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.559 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.405e-05 s, 0.0 kB/s 2023-10-08T00:29:59.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.617 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.673 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.673 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.673 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1996e-05 s, 0.0 kB/s 2023-10-08T00:29:59.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.673 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.730 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.731 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5718e-05 s, 0.0 kB/s 2023-10-08T00:29:59.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.731 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.786 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.786 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.787 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3955e-05 s, 0.0 kB/s 2023-10-08T00:29:59.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.788 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3054e-05 s, 0.0 kB/s 2023-10-08T00:29:59.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.844 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.899 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.899 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.900 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3782e-05 s, 0.0 kB/s 2023-10-08T00:29:59.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.900 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:29:59.956 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:29:59.956 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:29:59.956 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2515e-05 s, 0.0 kB/s 2023-10-08T00:29:59.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:29:59.957 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.012 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.012 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.013 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2959e-05 s, 0.0 kB/s 2023-10-08T00:30:00.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.013 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.068 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.069 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0365e-05 s, 0.0 kB/s 2023-10-08T00:30:00.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.069 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.124 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.125 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9296e-05 s, 0.0 kB/s 2023-10-08T00:30:00.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.125 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.180 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.180 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4502e-05 s, 0.0 kB/s 2023-10-08T00:30:00.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.181 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9933e-05 s, 0.0 kB/s 2023-10-08T00:30:00.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.237 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.292 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.293 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.293 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 2.9857e-05 s, 0.0 kB/s 2023-10-08T00:30:00.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.293 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.121e-05 s, 0.0 kB/s 2023-10-08T00:30:00.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.348 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3275e-05 s, 0.0 kB/s 2023-10-08T00:30:00.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.405 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.460 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.460 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.37e-05 s, 0.0 kB/s 2023-10-08T00:30:00.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.461 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.516 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.517 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.517 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0781e-05 s, 0.0 kB/s 2023-10-08T00:30:00.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.517 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.573 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.573 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2186e-05 s, 0.0 kB/s 2023-10-08T00:30:00.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.574 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2578e-05 s, 0.0 kB/s 2023-10-08T00:30:00.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.630 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.686 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.687 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.687 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 4.918e-05 s, 0.0 kB/s 2023-10-08T00:30:00.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.687 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.744 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.744 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3705e-05 s, 0.0 kB/s 2023-10-08T00:30:00.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.744 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.800 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.801 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.8183e-05 s, 0.0 kB/s 2023-10-08T00:30:00.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.801 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4379e-05 s, 0.0 kB/s 2023-10-08T00:30:00.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.858 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.913 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.914 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.757e-05 s, 0.0 kB/s 2023-10-08T00:30:00.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.914 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3798e-05 s, 0.0 kB/s 2023-10-08T00:30:00.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:00.970 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.025 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.025 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3808e-05 s, 0.0 kB/s 2023-10-08T00:30:01.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.026 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.081 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.082 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2879e-05 s, 0.0 kB/s 2023-10-08T00:30:01.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.082 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.139 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.386e-05 s, 0.0 kB/s 2023-10-08T00:30:01.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.139 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.5008e-05 s, 0.0 kB/s 2023-10-08T00:30:01.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.196 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.251 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.251 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2997e-05 s, 0.0 kB/s 2023-10-08T00:30:01.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.252 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.307 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0648e-05 s, 0.0 kB/s 2023-10-08T00:30:01.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.308 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.363 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2045e-05 s, 0.0 kB/s 2023-10-08T00:30:01.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.364 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.419 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.420 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1387e-05 s, 0.0 kB/s 2023-10-08T00:30:01.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.420 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.475 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.476 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.0896e-05 s, 0.0 kB/s 2023-10-08T00:30:01.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.476 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.532 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.532 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.533 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.2054e-05 s, 0.0 kB/s 2023-10-08T00:30:01.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.533 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:30:01.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:30:01.588 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.588 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.589 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4198e-05 s, 0.0 kB/s 2023-10-08T00:30:01.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.589 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.647 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.3226e-05 s, 0.0 kB/s 2023-10-08T00:30:01.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.647 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.702 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.703 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.703 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.7452e-05 s, 0.0 kB/s 2023-10-08T00:30:01.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.704 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.759 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.6754e-05 s, 0.0 kB/s 2023-10-08T00:30:01.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.759 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4158e-05 s, 0.0 kB/s 2023-10-08T00:30:01.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.816 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.871 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.871 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.871 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.4806e-05 s, 0.0 kB/s 2023-10-08T00:30:01.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:01.872 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000424239/5a1cd30d-bcca-4ae7-8425-c56af8b5f088/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-08T00:30:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records in 2023-10-08T00:30:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:0+0 records out 2023-10-08T00:30:01.927 INFO:teuthology.orchestra.run.smithi022.stderr:0 bytes copied, 3.1806e-05 s, 0.0 kB/s 2023-10-08T00:30:01.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000424239 2023-10-08T00:30:02.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.088+0000 7f4b25bd3700 1 Processor -- start 2023-10-08T00:30:02.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.088+0000 7f4b25bd3700 1 -- start start 2023-10-08T00:30:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b25bd3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b20155eb0 0x7f4b2006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b25bd3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4b20069e80 0x7f4b200ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b25bd3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2006eb90 con 0x7f4b200c70b0 2023-10-08T00:30:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b25bd3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2006ee70 con 0x7f4b20155eb0 2023-10-08T00:30:02.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b25bd3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2006f150 con 0x7f4b20069e80 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b20155eb0 0x7f4b2006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4b200c70b0 0x7f4b20069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49480/0 (socket says 172.21.15.22:49480) 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1effd700 1 -- 172.21.15.22:0/3345158536 learned_addr learned my addr 172.21.15.22:0/3345158536 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1ffff700 1 --2- 172.21.15.22:0/3345158536 >> v2:172.21.15.192:3300/0 conn(0x7f4b20069e80 0x7f4b200ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/3345158536 >> v2:172.21.15.192:3300/0 conn(0x7f4b20069e80 msgr2=0x7f4b200ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1f7fe700 1 --2- 172.21.15.22:0/3345158536 >> v2:172.21.15.192:3300/0 conn(0x7f4b20069e80 0x7f4b200ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/3345158536 >> v1:172.21.15.22:6789/0 conn(0x7f4b200c70b0 legacy=0x7f4b20069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/3345158536 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2006f430 con 0x7f4b20155eb0 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.089+0000 7f4b1e7fc700 1 -- 172.21.15.22:0/3345158536 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742083182 0 0) 0x7f4b2006eb90 con 0x7f4b200c70b0 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b1f7fe700 1 --2- 172.21.15.22:0/3345158536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20155eb0 0x7f4b2006e240 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4b2006d270 tx=0x7f4b100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8679c029ac891dfa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:02.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b1e7fc700 1 -- 172.21.15.22:0/3345158536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000b6b0 con 0x7f4b20155eb0 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b1e7fc700 1 -- 172.21.15.22:0/3345158536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000b810 con 0x7f4b20155eb0 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b1e7fc700 1 -- 172.21.15.22:0/3345158536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000bbb0 con 0x7f4b20155eb0 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 -- 172.21.15.22:0/3345158536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20155eb0 msgr2=0x7f4b2006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/3345158536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20155eb0 0x7f4b2006e240 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4b2006d270 tx=0x7f4b100091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 -- 172.21.15.22:0/3345158536 shutdown_connections 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/3345158536 >> v2:172.21.15.192:3300/0 conn(0x7f4b20069e80 0x7f4b200ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/3345158536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20155eb0 0x7f4b2006e240 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 -- 172.21.15.22:0/3345158536 >> 172.21.15.22:0/3345158536 conn(0x7f4b20068e10 msgr2=0x7f4b200cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 -- 172.21.15.22:0/3345158536 shutdown_connections 2023-10-08T00:30:02.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.090+0000 7f4b25bd3700 1 -- 172.21.15.22:0/3345158536 wait complete. 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.092+0000 7f4b25bd3700 1 Processor -- start 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.092+0000 7f4b25bd3700 1 -- start start 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.092+0000 7f4b25bd3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 0x7f4b20169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.092+0000 7f4b25bd3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b200c70b0 0x7f4b2016ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b25bd3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b20155eb0 0x7f4b200a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b25bd3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c4e10 con 0x7f4b20069e80 2023-10-08T00:30:02.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b25bd3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c3fa0 con 0x7f4b20155eb0 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b25bd3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c4200 con 0x7f4b200c70b0 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 0x7f4b20169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 0x7f4b20169cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53744/0 (socket says 172.21.15.22:53744) 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/713296809 learned_addr learned my addr 172.21.15.22:0/713296809 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1ffff700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b20155eb0 0x7f4b200a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1effd700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b200c70b0 0x7f4b2016ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b200c70b0 msgr2=0x7f4b2016ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b200c70b0 0x7f4b2016ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b20155eb0 msgr2=0x7f4b200a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b20155eb0 0x7f4b200a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 -- 172.21.15.22:0/713296809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009420 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1ffff700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b20155eb0 0x7f4b200a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b1f7fe700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 0x7f4b20169cb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4b100091e0 tx=0x7f4b10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000bb90 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10011420 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b200c44e0 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100117c0 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.093+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200c4aa0 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.094+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2004c3c0 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.095+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f4b10011bf0 con 0x7f4b20069e80 2023-10-08T00:30:02.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.095+0000 7f4b077fe700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4b0c066fc0 0x7f4b0c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.095+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f4b10085f90 con 0x7f4b20069e80 2023-10-08T00:30:02.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.095+0000 7f4b1effd700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4b0c066fc0 0x7f4b0c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.096+0000 7f4b1effd700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4b0c066fc0 0x7f4b0c069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b20154b00 tx=0x7f4b14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:02.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.099+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b100531d0 con 0x7f4b20069e80 2023-10-08T00:30:02.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.325+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000424239", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b200c4c60 con 0x7f4b0c066fc0 2023-10-08T00:30:02.331 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.330+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.331 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.330+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.331 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.330+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.331 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.330+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.331 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.330+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.368+0000 7f4b077fe700 1 -- 172.21.15.22:0/713296809 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4b200c4c60 con 0x7f4b0c066fc0 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4b0c066fc0 msgr2=0x7f4b0c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4b0c066fc0 0x7f4b0c069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4b20154b00 tx=0x7f4b14009040 comp rx=0 tx=0).stop 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 msgr2=0x7f4b20169cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 0x7f4b20169cb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4b100091e0 tx=0x7f4b10017000 comp rx=0 tx=0).stop 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 shutdown_connections 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b20155eb0 0x7f4b200a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b20069e80 0x7f4b20169cb0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4b0c066fc0 0x7f4b0c069470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 --2- 172.21.15.22:0/713296809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b200c70b0 0x7f4b2016ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 >> 172.21.15.22:0/713296809 conn(0x7f4b20068e10 msgr2=0x7f4b20154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:02.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 shutdown_connections 2023-10-08T00:30:02.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.370+0000 7f4b25bd3700 1 -- 172.21.15.22:0/713296809 wait complete. 2023-10-08T00:30:02.373 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.372+0000 7f7d61478700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.374 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.372+0000 7f7d61478700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.374 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.372+0000 7f7d61478700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.374 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.372+0000 7f7d61478700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.374 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.372+0000 7f7d61478700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-08T00:30:02.388 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.386+0000 7f7d60c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.388 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.386+0000 7f7d60c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.388 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.386+0000 7f7d60c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.388 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.386+0000 7f7d60c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.388 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:02.386+0000 7f7d60c77700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:02.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.522+0000 7f0f73476700 1 Processor -- start 2023-10-08T00:30:02.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.523+0000 7f0f73476700 1 -- start start 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f73476700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0f6c06bcd0 0x7f0f6c140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f73476700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0f6c0c9510 0x7f0f6c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f73476700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c15c2a0 con 0x7f0f6c06c0a0 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f73476700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c9900 con 0x7f0f6c0c9510 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f73476700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c15b690 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f71a13700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0f6c0c9510 0x7f0f6c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f71a13700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0f6c0c9510 0x7f0f6c141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53754/0 (socket says 172.21.15.22:53754) 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f71a13700 1 -- 172.21.15.22:0/3350869267 learned_addr learned my addr 172.21.15.22:0/3350869267 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f70a11700 1 --1- 172.21.15.22:0/3350869267 >> v1:172.21.15.22:6789/0 conn(0x7f0f6c06c0a0 0x7f0f6c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49492/0 (socket says 172.21.15.22:49492) 2023-10-08T00:30:02.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.524+0000 7f0f71212700 1 --2- 172.21.15.22:0/3350869267 >> v2:172.21.15.192:3300/0 conn(0x7f0f6c06bcd0 0x7f0f6c140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f71a13700 1 -- 172.21.15.22:0/3350869267 >> v2:172.21.15.192:3300/0 conn(0x7f0f6c06bcd0 msgr2=0x7f0f6c140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f71a13700 1 --2- 172.21.15.22:0/3350869267 >> v2:172.21.15.192:3300/0 conn(0x7f0f6c06bcd0 0x7f0f6c140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f71a13700 1 -- 172.21.15.22:0/3350869267 >> v1:172.21.15.22:6789/0 conn(0x7f0f6c06c0a0 legacy=0x7f0f6c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f63fff700 1 -- 172.21.15.22:0/3350869267 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307161991 0 0) 0x7f0f6c15c2a0 con 0x7f0f6c06c0a0 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f71a13700 1 -- 172.21.15.22:0/3350869267 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c15b970 con 0x7f0f6c0c9510 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f71212700 1 --2- 172.21.15.22:0/3350869267 >> v2:172.21.15.192:3300/0 conn(0x7f0f6c06bcd0 0x7f0f6c140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f71a13700 1 --2- 172.21.15.22:0/3350869267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c141330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cafd0 tx=0x7f0f64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a562053cf71c7f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f63fff700 1 -- 172.21.15.22:0/3350869267 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400e070 con 0x7f0f6c0c9510 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f63fff700 1 -- 172.21.15.22:0/3350869267 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400ba50 con 0x7f0f6c0c9510 2023-10-08T00:30:02.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.525+0000 7f0f63fff700 1 -- 172.21.15.22:0/3350869267 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640092e0 con 0x7f0f6c0c9510 2023-10-08T00:30:02.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 -- 172.21.15.22:0/3350869267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c0c9510 msgr2=0x7f0f6c141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 --2- 172.21.15.22:0/3350869267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c141330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cafd0 tx=0x7f0f64009840 comp rx=0 tx=0).stop 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 -- 172.21.15.22:0/3350869267 shutdown_connections 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 --2- 172.21.15.22:0/3350869267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c141330 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 --2- 172.21.15.22:0/3350869267 >> v2:172.21.15.192:3300/0 conn(0x7f0f6c06bcd0 0x7f0f6c140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 -- 172.21.15.22:0/3350869267 >> 172.21.15.22:0/3350869267 conn(0x7f0f6c0ce600 msgr2=0x7f0f6c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 -- 172.21.15.22:0/3350869267 shutdown_connections 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.526+0000 7f0f73476700 1 -- 172.21.15.22:0/3350869267 wait complete. 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.528+0000 7f0f73476700 1 Processor -- start 2023-10-08T00:30:02.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.528+0000 7f0f73476700 1 -- start start 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f73476700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 0x7f0f6c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f73476700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6c06c0a0 0x7f0f6c0c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f73476700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c0c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f73476700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1592b0 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f73476700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c159590 con 0x7f0f6c0c9510 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f73476700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c159870 con 0x7f0f6c06c0a0 2023-10-08T00:30:02.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 0x7f0f6c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 0x7f0f6c0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53760/0 (socket says 172.21.15.22:53760) 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 -- 172.21.15.22:0/2388704118 learned_addr learned my addr 172.21.15.22:0/2388704118 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f70a11700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6c06c0a0 0x7f0f6c0c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71a13700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c0c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 -- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6c06c0a0 msgr2=0x7f0f6c0c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6c06c0a0 0x7f0f6c0c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 -- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6c0c9510 msgr2=0x7f0f6c0c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c0c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71212700 1 -- 172.21.15.22:0/2388704118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009ae0 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f70a11700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6c06c0a0 0x7f0f6c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.529+0000 7f0f71a13700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.530+0000 7f0f71212700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 0x7f0f6c0b1af0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800e8d0 tx=0x7f0f68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.530+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800ee70 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.530+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800c5e0 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.530+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800c980 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.530+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c159b50 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.530+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c0c56b0 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.531+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c04c3c0 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.531+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0f68013410 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.532+0000 7f0f617fa700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0f50066fc0 0x7f0f50069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:02.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.532+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0f68084490 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.532+0000 7f0f70a11700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0f50066fc0 0x7f0f50069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:02.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.532+0000 7f0f70a11700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0f50066fc0 0x7f0f50069470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c13ca20 tx=0x7f0f5c007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:02.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.539+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f680515c0 con 0x7f0f6c06bcd0 2023-10-08T00:30:02.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.818+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f6c06c9d0 con 0x7f0f50066fc0 2023-10-08T00:30:02.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.829+0000 7f0f617fa700 1 -- 172.21.15.22:0/2388704118 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+538 (secure 0 0 0) 0x7f0f6c06c9d0 con 0x7f0f50066fc0 2023-10-08T00:30:02.831 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_addrs": [ 2023-10-08T00:30:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6789", 2023-10-08T00:30:02.831 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6789", 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6790" 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "pending_subvolume_deletions": 1, 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": { 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "data": [ 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": 365958201344, 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_data", 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: "used": 8192 2023-10-08T00:30:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": [ 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": 365958201344, 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_metadata", 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "used": 20324352 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:02.833 INFO:teuthology.orchestra.run.smithi022.stdout: "used_size": 145 2023-10-08T00:30:02.834 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.831+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0f50066fc0 msgr2=0x7f0f50069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.831+0000 7f0f73476700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0f50066fc0 0x7f0f50069470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c13ca20 tx=0x7f0f5c007c90 comp rx=0 tx=0).stop 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.831+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 msgr2=0x7f0f6c0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.831+0000 7f0f73476700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 0x7f0f6c0b1af0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800e8d0 tx=0x7f0f68008040 comp rx=0 tx=0).stop 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 shutdown_connections 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f6c0c9510 0x7f0f6c0c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f6c06bcd0 0x7f0f6c0b1af0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0f50066fc0 0x7f0f50069470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 --2- 172.21.15.22:0/2388704118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0f6c06c0a0 0x7f0f6c0c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 >> 172.21.15.22:0/2388704118 conn(0x7f0f6c0ce600 msgr2=0x7f0f6c0c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 shutdown_connections 2023-10-08T00:30:02.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:02.832+0000 7f0f73476700 1 -- 172.21.15.22:0/2388704118 wait complete. 2023-10-08T00:30:02.845 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:30:02.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:02.884 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:02.929 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:30:02.929 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:30:02.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:02.930 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:03.491 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:30:03.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:03.491 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:30:03.519 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:30:03.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:03.520 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:03.983 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:30:03.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:03.983 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:30:03.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:04.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.117+0000 7fb85043b700 1 Processor -- start 2023-10-08T00:30:04.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.117+0000 7fb85043b700 1 -- start start 2023-10-08T00:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.118+0000 7fb85043b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb848159890 0x7fb84815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.118+0000 7fb85043b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb848069560 0x7fb8480699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.118+0000 7fb85043b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb848069ee0 con 0x7fb848159c60 2023-10-08T00:30:04.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.118+0000 7fb85043b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84815a160 con 0x7fb848159890 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.118+0000 7fb85043b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480d13a0 con 0x7fb848069560 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb848159890 0x7fb84815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb848159890 0x7fb84815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53762/0 (socket says 172.21.15.22:53762) 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 -- 172.21.15.22:0/2823880430 learned_addr learned my addr 172.21.15.22:0/2823880430 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e9d8700 1 --2- 172.21.15.22:0/2823880430 >> v2:172.21.15.192:3300/0 conn(0x7fb848069560 0x7fb8480699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 -- 172.21.15.22:0/2823880430 >> v2:172.21.15.192:3300/0 conn(0x7fb848069560 msgr2=0x7fb8480699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 --2- 172.21.15.22:0/2823880430 >> v2:172.21.15.192:3300/0 conn(0x7fb848069560 0x7fb8480699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 -- 172.21.15.22:0/2823880430 >> v1:172.21.15.22:6789/0 conn(0x7fb848159c60 legacy=0x7fb84815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84d1d5700 1 -- 172.21.15.22:0/2823880430 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127368871 0 0) 0x7fb848069ee0 con 0x7fb848159c60 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 -- 172.21.15.22:0/2823880430 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84815e140 con 0x7fb848159890 2023-10-08T00:30:04.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84e1d7700 1 --2- 172.21.15.22:0/2823880430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb84815abd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb84806a890 tx=0x7fb844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa4d1469cbf59d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84d1d5700 1 -- 172.21.15.22:0/2823880430 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844009e70 con 0x7fb848159890 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84d1d5700 1 -- 172.21.15.22:0/2823880430 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400b860 con 0x7fb848159890 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.119+0000 7fb84d1d5700 1 -- 172.21.15.22:0/2823880430 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400bc00 con 0x7fb848159890 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 -- 172.21.15.22:0/2823880430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 msgr2=0x7fb84815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 --2- 172.21.15.22:0/2823880430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb84815abd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb84806a890 tx=0x7fb844009250 comp rx=0 tx=0).stop 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 -- 172.21.15.22:0/2823880430 shutdown_connections 2023-10-08T00:30:04.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 --2- 172.21.15.22:0/2823880430 >> v2:172.21.15.192:3300/0 conn(0x7fb848069560 0x7fb8480699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 --2- 172.21.15.22:0/2823880430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb84815abd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 -- 172.21.15.22:0/2823880430 >> 172.21.15.22:0/2823880430 conn(0x7fb848068e20 msgr2=0x7fb8480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 -- 172.21.15.22:0/2823880430 shutdown_connections 2023-10-08T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.120+0000 7fb85043b700 1 -- 172.21.15.22:0/2823880430 wait complete. 2023-10-08T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.121+0000 7fb85043b700 1 Processor -- start 2023-10-08T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.121+0000 7fb85043b700 1 -- start start 2023-10-08T00:30:04.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb85043b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb848069560 0x7fb848156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb85043b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb8480b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb85043b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb848159c60 0x7fb848153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb85043b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480b3fd0 con 0x7fb848159890 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb85043b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480b36a0 con 0x7fb848069560 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb85043b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480b3980 con 0x7fb848159c60 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84d9d6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb8480b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84d9d6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb8480b5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53774/0 (socket says 172.21.15.22:53774) 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84d9d6700 1 -- 172.21.15.22:0/3900515659 learned_addr learned my addr 172.21.15.22:0/3900515659 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84e1d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb848069560 0x7fb848156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84e9d8700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb848159c60 0x7fb848153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84d9d6700 1 -- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb848159c60 msgr2=0x7fb848153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.122+0000 7fb84d9d6700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb848159c60 0x7fb848153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb84d9d6700 1 -- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb848069560 msgr2=0x7fb848156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb84d9d6700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb848069560 0x7fb848156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb84d9d6700 1 -- 172.21.15.22:0/3900515659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440094f0 con 0x7fb848159890 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb84e1d7700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb848069560 0x7fb848156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb84d9d6700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb8480b5bd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c530 tx=0x7fb83800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011590 con 0x7fb848159890 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011710 con 0x7fb848159890 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480b3c60 con 0x7fb848159890 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838011ad0 con 0x7fb848159890 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.123+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848156970 con 0x7fb848159890 2023-10-08T00:30:04.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.124+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480b4140 con 0x7fb848159890 2023-10-08T00:30:04.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.124+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb83801b3b0 con 0x7fb848159890 2023-10-08T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.125+0000 7fb83e7fc700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c066fc0 0x7fb82c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.125+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb8380839e0 con 0x7fb848159890 2023-10-08T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.125+0000 7fb84e1d7700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c066fc0 0x7fb82c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.125+0000 7fb84e1d7700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c066fc0 0x7fb82c069470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb84806a890 tx=0x7fb844017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.131+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb838050c20 con 0x7fb848159890 2023-10-08T00:30:04.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.473+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb84804c3c0 con 0x7fb848159890 2023-10-08T00:30:04.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.474+0000 7fb83e7fc700 1 -- 172.21.15.22:0/3900515659 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fb838017070 con 0x7fb848159890 2023-10-08T00:30:04.475 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:04.476 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:56.112286+0000","modified":"2023-10-08T00:26:59.735766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/2573785310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2573785310},{"type":"v1","addr":"172.21.15.22:6835","nonce":2573785310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T00:30:04.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c066fc0 msgr2=0x7fb82c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c066fc0 0x7fb82c069470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb84806a890 tx=0x7fb844017000 comp rx=0 tx=0).stop 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 msgr2=0x7fb8480b5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb8480b5bd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c530 tx=0x7fb83800c840 comp rx=0 tx=0).stop 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 shutdown_connections 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c066fc0 0x7fb82c069470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb848159c60 0x7fb848153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb848069560 0x7fb848156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 --2- 172.21.15.22:0/3900515659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb848159890 0x7fb8480b5bd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.476+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 >> 172.21.15.22:0/3900515659 conn(0x7fb848068e20 msgr2=0x7fb848155290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:04.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.477+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 shutdown_connections 2023-10-08T00:30:04.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.477+0000 7fb85043b700 1 -- 172.21.15.22:0/3900515659 wait complete. 2023-10-08T00:30:04.480 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 43 2023-10-08T00:30:04.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:04.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.627+0000 7f46d09ac700 1 Processor -- start 2023-10-08T00:30:04.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.627+0000 7f46d09ac700 1 -- start start 2023-10-08T00:30:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46d09ac700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46cc069560 0x7f46cc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46d09ac700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc069ee0 con 0x7f46cc159c60 2023-10-08T00:30:04.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46d09ac700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46cc15a160 con 0x7f46cc159890 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46d09ac700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46cc0d13a0 con 0x7f46cc069560 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46cad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46cc069560 0x7f46cc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46c9d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f46cc159c60 0x7f46cc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49506/0 (socket says 172.21.15.22:49506) 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46c9d9b700 1 -- 172.21.15.22:0/20304434 learned_addr learned my addr 172.21.15.22:0/20304434 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46c959a700 1 -- 172.21.15.22:0/20304434 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490312279 0 0) 0x7f46cc069ee0 con 0x7f46cc159c60 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46c959a700 1 -- 172.21.15.22:0/20304434 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b4003570 con 0x7f46cc159c60 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46c959a700 1 -- 172.21.15.22:0/20304434 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581963680 0 0) 0x7f46cc15a160 con 0x7f46cc159890 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46cad9d700 1 -- 172.21.15.22:0/20304434 >> v1:172.21.15.192:6789/0 conn(0x7f46cc159890 legacy=0x7f46cc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46cad9d700 1 -- 172.21.15.22:0/20304434 >> v1:172.21.15.22:6789/0 conn(0x7f46cc159c60 legacy=0x7f46cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.628+0000 7f46cad9d700 1 -- 172.21.15.22:0/20304434 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc15e140 con 0x7f46cc069560 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.629+0000 7f46cad9d700 1 --2- 172.21.15.22:0/20304434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0699a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009e60 tx=0x7f46c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623dea3a94c3516d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.629+0000 7f46c959a700 1 -- 172.21.15.22:0/20304434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400e070 con 0x7f46cc069560 2023-10-08T00:30:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.629+0000 7f46c959a700 1 -- 172.21.15.22:0/20304434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c400bb60 con 0x7f46cc069560 2023-10-08T00:30:04.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.629+0000 7f46c959a700 1 -- 172.21.15.22:0/20304434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4012430 con 0x7f46cc069560 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.629+0000 7f46d09ac700 1 -- 172.21.15.22:0/20304434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 msgr2=0x7f46cc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.629+0000 7f46d09ac700 1 --2- 172.21.15.22:0/20304434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0699a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009e60 tx=0x7f46c4009780 comp rx=0 tx=0).stop 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.630+0000 7f46d09ac700 1 -- 172.21.15.22:0/20304434 shutdown_connections 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.630+0000 7f46d09ac700 1 --2- 172.21.15.22:0/20304434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0699a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.630+0000 7f46d09ac700 1 -- 172.21.15.22:0/20304434 >> 172.21.15.22:0/20304434 conn(0x7f46cc068e20 msgr2=0x7f46cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.630+0000 7f46d09ac700 1 -- 172.21.15.22:0/20304434 shutdown_connections 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.630+0000 7f46d09ac700 1 -- 172.21.15.22:0/20304434 wait complete. 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.631+0000 7f46d09ac700 1 Processor -- start 2023-10-08T00:30:04.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.631+0000 7f46d09ac700 1 -- start start 2023-10-08T00:30:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46d09ac700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46d09ac700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46cc159890 0x7f46cc14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46d09ac700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46cc159c60 0x7f46cc15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46d09ac700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc14ed00 con 0x7f46cc069560 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46d09ac700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc15ba10 con 0x7f46cc159890 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46d09ac700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc15bc90 con 0x7f46cc159c60 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46ca59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46ca59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53790/0 (socket says 172.21.15.22:53790) 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46ca59c700 1 -- 172.21.15.22:0/1800674853 learned_addr learned my addr 172.21.15.22:0/1800674853 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46c9d9b700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46cc159890 0x7f46cc14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.632+0000 7f46cad9d700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46cc159c60 0x7f46cc15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ca59c700 1 -- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46cc159c60 msgr2=0x7f46cc15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ca59c700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46cc159c60 0x7f46cc15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ca59c700 1 -- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46cc159890 msgr2=0x7f46cc14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ca59c700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46cc159890 0x7f46cc14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ca59c700 1 -- 172.21.15.22:0/1800674853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4009a20 con 0x7f46cc069560 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ca59c700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0b1be0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c7e0 tx=0x7f46bc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0105c0 con 0x7f46cc069560 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc010740 con 0x7f46cc069560 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc15bf70 con 0x7f46cc069560 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc010b00 con 0x7f46cc069560 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.633+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc15c300 con 0x7f46cc069560 2023-10-08T00:30:04.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.634+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc04c3c0 con 0x7f46cc069560 2023-10-08T00:30:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.636+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f46bc01b3b0 con 0x7f46cc069560 2023-10-08T00:30:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.636+0000 7f46ba7fc700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46ac066fc0 0x7f46ac069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.636+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f46bc083f30 con 0x7f46cc069560 2023-10-08T00:30:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.636+0000 7f46c9d9b700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46ac066fc0 0x7f46ac069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.637+0000 7f46c9d9b700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46ac066fc0 0x7f46ac069470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f46c0007fd0 tx=0x7f46c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.639+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46bc0511f0 con 0x7f46cc069560 2023-10-08T00:30:04.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.745+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f46bc0515c0 con 0x7f46cc069560 2023-10-08T00:30:04.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.850+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46cc0ca8d0 con 0x7f46cc069560 2023-10-08T00:30:04.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.851+0000 7f46ba7fc700 1 -- 172.21.15.22:0/1800674853 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15450 (secure 0 0 0) 0x7f46bc054c80 con 0x7f46cc069560 2023-10-08T00:30:04.852 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:04.853 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":66,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:27:41.808268+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:54.521604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:55.081427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46ac066fc0 msgr2=0x7f46ac069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46ac066fc0 0x7f46ac069470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f46c0007fd0 tx=0x7f46c0009040 comp rx=0 tx=0).stop 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 msgr2=0x7f46cc0b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0b1be0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c7e0 tx=0x7f46bc007df0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 shutdown_connections 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46ac066fc0 0x7f46ac069470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46cc159c60 0x7f46cc15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46cc069560 0x7f46cc0b1be0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 --2- 172.21.15.22:0/1800674853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46cc159890 0x7f46cc14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 >> 172.21.15.22:0/1800674853 conn(0x7f46cc068e20 msgr2=0x7f46cc156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:04.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 shutdown_connections 2023-10-08T00:30:04.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.853+0000 7f46d09ac700 1 -- 172.21.15.22:0/1800674853 wait complete. 2023-10-08T00:30:04.867 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:26:54.521604+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:26:55.081427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:30:04.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:30:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.990+0000 7f1473d01700 1 Processor -- start 2023-10-08T00:30:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.991+0000 7f1473d01700 1 -- start start 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1473d01700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f146c159c60 0x7f146c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1473d01700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c15a160 con 0x7f146c15db10 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1473d01700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146c0d13a0 con 0x7f146c159890 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1473d01700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146c15df50 con 0x7f146c159c60 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f147229e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f146c15db10 0x7f146c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49516/0 (socket says 172.21.15.22:49516) 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f147229e700 1 -- 172.21.15.22:0/159923354 learned_addr learned my addr 172.21.15.22:0/159923354 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f147129c700 1 --2- 172.21.15.22:0/159923354 >> v2:172.21.15.192:3300/0 conn(0x7f146c159c60 0x7f146c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228459975 0 0) 0x7f146c15a160 con 0x7f146c15db10 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1458003570 con 0x7f146c15db10 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819126084 0 0) 0x7f146c0d13a0 con 0x7f146c159890 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f146c15a160 con 0x7f146c159890 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f147129c700 1 -- 172.21.15.22:0/159923354 >> v1:172.21.15.192:6789/0 conn(0x7f146c159890 legacy=0x7f146c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f147129c700 1 -- 172.21.15.22:0/159923354 >> v1:172.21.15.22:6789/0 conn(0x7f146c15db10 legacy=0x7f146c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913452730 0 0) 0x7f1458003570 con 0x7f146c15db10 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.992+0000 7f147129c700 1 -- 172.21.15.22:0/159923354 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c15e140 con 0x7f146c159c60 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f147129c700 1 --2- 172.21.15.22:0/159923354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15d5d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14600098e0 tx=0x7f14600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313121cd5c80a3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14640017f0 con 0x7f146c159c60 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460011420 con 0x7f146c159c60 2023-10-08T00:30:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1470a9b700 1 -- 172.21.15.22:0/159923354 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14600117c0 con 0x7f146c159c60 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 -- 172.21.15.22:0/159923354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 msgr2=0x7f146c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 --2- 172.21.15.22:0/159923354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15d5d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14600098e0 tx=0x7f14600091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 -- 172.21.15.22:0/159923354 shutdown_connections 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 --2- 172.21.15.22:0/159923354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15d5d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 -- 172.21.15.22:0/159923354 >> 172.21.15.22:0/159923354 conn(0x7f146c068e20 msgr2=0x7f146c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 -- 172.21.15.22:0/159923354 shutdown_connections 2023-10-08T00:30:04.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.993+0000 7f1473d01700 1 -- 172.21.15.22:0/159923354 wait complete. 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.994+0000 7f1473d01700 1 Processor -- start 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 -- start start 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 0x7f146c13eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146c15db10 0x7f146c1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c15c330 con 0x7f146c159890 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c15b4d0 con 0x7f146c159c60 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1473d01700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146c15d4d0 con 0x7f146c15db10 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1471a9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 0x7f146c13eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1471a9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 0x7f146c13eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53802/0 (socket says 172.21.15.22:53802) 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.995+0000 7f1471a9d700 1 -- 172.21.15.22:0/669295415 learned_addr learned my addr 172.21.15.22:0/669295415 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f147129c700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1471a9d700 1 -- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146c15db10 msgr2=0x7f146c1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1471a9d700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146c15db10 0x7f146c1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1471a9d700 1 -- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 msgr2=0x7f146c15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1471a9d700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1471a9d700 1 -- 172.21.15.22:0/669295415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1460009420 con 0x7f146c159890 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f147129c700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1471a9d700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 0x7f146c13eb70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f146800c7c0 tx=0x7f1468007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468010510 con 0x7f146c159890 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468010690 con 0x7f146c159890 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c15b720 con 0x7f146c159890 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468010a50 con 0x7f146c159890 2023-10-08T00:30:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.996+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c15bce0 con 0x7f146c159890 2023-10-08T00:30:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.998+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f146801b400 con 0x7f146c159890 2023-10-08T00:30:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.998+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c15d910 con 0x7f146c159890 2023-10-08T00:30:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.998+0000 7f145dffb700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1450067170 0x7f1450069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.998+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1468084020 con 0x7f146c159890 2023-10-08T00:30:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.998+0000 7f147129c700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1450067170 0x7f1450069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:04.999+0000 7f147129c700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1450067170 0x7f1450069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f146c0b6630 tx=0x7f1460016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.003+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f146804b5a0 con 0x7f146c159890 2023-10-08T00:30:05.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.208+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f146c04c3c0 con 0x7f146c159890 2023-10-08T00:30:05.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.208+0000 7f145dffb700 1 -- 172.21.15.22:0/669295415 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1468016020 con 0x7f146c159890 2023-10-08T00:30:05.210 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:30:05.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1450067170 msgr2=0x7f1450069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1450067170 0x7f1450069620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f146c0b6630 tx=0x7f1460016000 comp rx=0 tx=0).stop 2023-10-08T00:30:05.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 msgr2=0x7f146c13eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 0x7f146c13eb70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f146800c7c0 tx=0x7f1468007e10 comp rx=0 tx=0).stop 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 shutdown_connections 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1450067170 0x7f1450069620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f146c15db10 0x7f146c1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146c159890 0x7f146c13eb70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 --2- 172.21.15.22:0/669295415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f146c159c60 0x7f146c15cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 >> 172.21.15.22:0/669295415 conn(0x7f146c068e20 msgr2=0x7f146c155560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:05.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 shutdown_connections 2023-10-08T00:30:05.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.210+0000 7f1473d01700 1 -- 172.21.15.22:0/669295415 wait complete. 2023-10-08T00:30:05.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:30:05.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.348+0000 7fa1f1d2f700 1 Processor -- start 2023-10-08T00:30:05.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.348+0000 7fa1f1d2f700 1 -- start start 2023-10-08T00:30:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1f1d2f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec141500 0x7fa1ec0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1f1d2f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa1ec06c0a0 0x7fa1ec0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1f1d2f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec15c2a0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1f1d2f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ec0c9880 con 0x7fa1ec06c0a0 2023-10-08T00:30:05.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1f1d2f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec15b690 con 0x7fa1ec141500 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1eb7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa1ec06bcd0 0x7fa1ec140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49520/0 (socket says 172.21.15.22:49520) 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1eb7fe700 1 -- 172.21.15.22:0/1828977831 learned_addr learned my addr 172.21.15.22:0/1828977831 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1ebfff700 1 --2- 172.21.15.22:0/1828977831 >> v2:172.21.15.22:3300/0 conn(0x7fa1ec06c0a0 0x7fa1ec0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1eaffd700 1 --2- 172.21.15.22:0/1828977831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec141500 0x7fa1ec0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1ea7fc700 1 -- 172.21.15.22:0/1828977831 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879905392 0 0) 0x7fa1ec15c2a0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1ebfff700 1 -- 172.21.15.22:0/1828977831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec141500 msgr2=0x7fa1ec0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:05.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1ebfff700 1 --2- 172.21.15.22:0/1828977831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec141500 0x7fa1ec0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1ebfff700 1 -- 172.21.15.22:0/1828977831 >> v1:172.21.15.22:6789/0 conn(0x7fa1ec06bcd0 legacy=0x7fa1ec140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.349+0000 7fa1ebfff700 1 -- 172.21.15.22:0/1828977831 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec15b970 con 0x7fa1ec06c0a0 2023-10-08T00:30:05.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.350+0000 7fa1ebfff700 1 --2- 172.21.15.22:0/1828977831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06c0a0 0x7fa1ec0c9340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e60 tx=0x7fa1e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd978c329abc2f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.350+0000 7fa1ea7fc700 1 -- 172.21.15.22:0/1828977831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400e070 con 0x7fa1ec06c0a0 2023-10-08T00:30:05.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.350+0000 7fa1ea7fc700 1 -- 172.21.15.22:0/1828977831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e400bb60 con 0x7fa1ec06c0a0 2023-10-08T00:30:05.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.350+0000 7fa1ea7fc700 1 -- 172.21.15.22:0/1828977831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4012430 con 0x7fa1ec06c0a0 2023-10-08T00:30:05.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/1828977831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06c0a0 msgr2=0x7fa1ec0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/1828977831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06c0a0 0x7fa1ec0c9340 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e60 tx=0x7fa1e4009780 comp rx=0 tx=0).stop 2023-10-08T00:30:05.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/1828977831 shutdown_connections 2023-10-08T00:30:05.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/1828977831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06c0a0 0x7fa1ec0c9340 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/1828977831 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec141500 0x7fa1ec0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/1828977831 >> 172.21.15.22:0/1828977831 conn(0x7fa1ec0ce600 msgr2=0x7fa1ec0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/1828977831 shutdown_connections 2023-10-08T00:30:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.351+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/1828977831 wait complete. 2023-10-08T00:30:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 Processor -- start 2023-10-08T00:30:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 -- start start 2023-10-08T00:30:05.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 0x7fa1ec0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec06c0a0 0x7fa1ec0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1ec141500 0x7fa1ec0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec16bbe0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0c8710 con 0x7fa1ec141500 2023-10-08T00:30:05.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1f1d2f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec16afd0 con 0x7fa1ec06c0a0 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1eb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 0x7fa1ec0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1eb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 0x7fa1ec0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53820/0 (socket says 172.21.15.22:53820) 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.353+0000 7fa1eb7fe700 1 -- 172.21.15.22:0/4275834892 learned_addr learned my addr 172.21.15.22:0/4275834892 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eaffd700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec06c0a0 0x7fa1ec0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1ebfff700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1ec141500 0x7fa1ec0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eb7fe700 1 -- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec06c0a0 msgr2=0x7fa1ec0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eb7fe700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec06c0a0 0x7fa1ec0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eb7fe700 1 -- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1ec141500 msgr2=0x7fa1ec0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eb7fe700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1ec141500 0x7fa1ec0b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eb7fe700 1 -- 172.21.15.22:0/4275834892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4009a20 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eaffd700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec06c0a0 0x7fa1ec0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1eb7fe700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 0x7fa1ec0c81d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c7e0 tx=0x7fa1dc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc005b30 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc005c90 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec16b2a0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc007300 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.354+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec1577c0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.355+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec16bd20 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.356+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa1dc01b3b0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.356+0000 7fa1d37fe700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa1d8067170 0x7fa1d8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.356+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa1dc083ea0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.357+0000 7fa1eaffd700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa1d8067170 0x7fa1d8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.357+0000 7fa1eaffd700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa1d8067170 0x7fa1d8069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0c7fc0 tx=0x7fa1e00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.363+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1dc050d70 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.572+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1ec04c3c0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.573+0000 7fa1d37fe700 1 -- 172.21.15.22:0/4275834892 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1dc0170a0 con 0x7fa1ec06bcd0 2023-10-08T00:30:05.574 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa1d8067170 msgr2=0x7fa1d8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa1d8067170 0x7fa1d8069620 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0c7fc0 tx=0x7fa1e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 msgr2=0x7fa1ec0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 0x7fa1ec0c81d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00c7e0 tx=0x7fa1dc007df0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 shutdown_connections 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1ec141500 0x7fa1ec0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1ec06bcd0 0x7fa1ec0c81d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa1d8067170 0x7fa1d8069620 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 --2- 172.21.15.22:0/4275834892 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1ec06c0a0 0x7fa1ec0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 >> 172.21.15.22:0/4275834892 conn(0x7fa1ec0ce600 msgr2=0x7fa1ec0c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:05.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 shutdown_connections 2023-10-08T00:30:05.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.575+0000 7fa1f1d2f700 1 -- 172.21.15.22:0/4275834892 wait complete. 2023-10-08T00:30:05.589 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:30:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.720+0000 7fcd931f5700 1 Processor -- start 2023-10-08T00:30:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.720+0000 7fcd931f5700 1 -- start start 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd931f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b1b40 0x7fcd8c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd931f5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c0cfb00 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd931f5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8c0b5c40 con 0x7fcd8c0b16d0 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd931f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c0b5f20 con 0x7fcd8c0b1b40 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd921f3700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcd8c0b4e70 0x7fcd8c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49536/0 (socket says 172.21.15.22:49536) 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd921f3700 1 -- 172.21.15.22:0/1977016615 learned_addr learned my addr 172.21.15.22:0/1977016615 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd929f4700 1 --2- 172.21.15.22:0/1977016615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b1b40 0x7fcd8c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214518925 0 0) 0x7fcd8c0cfb00 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd78003570 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026886636 0 0) 0x7fcd8c0b5c40 con 0x7fcd8c0b16d0 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.721+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c0cfb00 con 0x7fcd8c0b16d0 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd929f4700 1 -- 172.21.15.22:0/1977016615 >> v1:172.21.15.192:6789/0 conn(0x7fcd8c0b16d0 legacy=0x7fcd8c0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052451850 0 0) 0x7fcd78003570 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd929f4700 1 -- 172.21.15.22:0/1977016615 >> v1:172.21.15.22:6789/0 conn(0x7fcd8c0b4e70 legacy=0x7fcd8c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd929f4700 1 -- 172.21.15.22:0/1977016615 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c0b6200 con 0x7fcd8c0b1b40 2023-10-08T00:30:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd929f4700 1 --2- 172.21.15.22:0/1977016615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b1b40 0x7fcd8c0b3ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009e90 tx=0x7fcd84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f009ff38809e30d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400e070 con 0x7fcd8c0b1b40 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400b870 con 0x7fcd8c0b1b40 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.722+0000 7fcd911f1700 1 -- 172.21.15.22:0/1977016615 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88001470 con 0x7fcd8c0b1b40 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 -- 172.21.15.22:0/1977016615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b1b40 msgr2=0x7fcd8c0b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1977016615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b1b40 0x7fcd8c0b3ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009e90 tx=0x7fcd84009780 comp rx=0 tx=0).stop 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 -- 172.21.15.22:0/1977016615 shutdown_connections 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1977016615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b1b40 0x7fcd8c0b3ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 -- 172.21.15.22:0/1977016615 >> 172.21.15.22:0/1977016615 conn(0x7fcd8c0d10c0 msgr2=0x7fcd8c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:05.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 -- 172.21.15.22:0/1977016615 shutdown_connections 2023-10-08T00:30:05.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.723+0000 7fcd931f5700 1 -- 172.21.15.22:0/1977016615 wait complete. 2023-10-08T00:30:05.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.724+0000 7fcd931f5700 1 Processor -- start 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.724+0000 7fcd931f5700 1 -- start start 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd931f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b16d0 0x7fcd8c16b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd931f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd8c0b1b40 0x7fcd8c149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd931f5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 0x7fcd8c16abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd931f5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c16c580 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd931f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c16b130 con 0x7fcd8c0b1b40 2023-10-08T00:30:05.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd931f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c16b970 con 0x7fcd8c0b16d0 2023-10-08T00:30:05.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 0x7fcd8c16abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 0x7fcd8c16abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53832/0 (socket says 172.21.15.22:53832) 2023-10-08T00:30:05.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 -- 172.21.15.22:0/1205943208 learned_addr learned my addr 172.21.15.22:0/1205943208 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:05.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd919f2700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd8c0b1b40 0x7fcd8c149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd921f3700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b16d0 0x7fcd8c16b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 -- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b16d0 msgr2=0x7fcd8c16b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b16d0 0x7fcd8c16b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 -- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd8c0b1b40 msgr2=0x7fcd8c149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd8c0b1b40 0x7fcd8c149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 -- 172.21.15.22:0/1205943208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd84009a20 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd921f3700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b16d0 0x7fcd8c16b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.725+0000 7fcd929f4700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 0x7fcd8c16abf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c070dd0 tx=0x7fcd84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.726+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84007040 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.726+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84012cd0 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.726+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84026690 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.726+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c16bc50 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.726+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c16c210 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.727+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c088990 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.727+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcd8401d440 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.728+0000 7fcd827fc700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd70067170 0x7fcd70069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:05.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.728+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fcd84086c50 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.728+0000 7fcd921f3700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd70067170 0x7fcd70069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:05.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.728+0000 7fcd921f3700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd70067170 0x7fcd70069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd880015a0 tx=0x7fcd88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:05.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.734+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd8408c020 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.937+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd8c159c40 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.938+0000 7fcd827fc700 1 -- 172.21.15.22:0/1205943208 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd84053ae0 con 0x7fcd8c0b4e70 2023-10-08T00:30:05.940 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:30:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd70067170 msgr2=0x7fcd70069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd70067170 0x7fcd70069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd880015a0 tx=0x7fcd88009040 comp rx=0 tx=0).stop 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 msgr2=0x7fcd8c16abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 0x7fcd8c16abf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c070dd0 tx=0x7fcd84017000 comp rx=0 tx=0).stop 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 shutdown_connections 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd8c0b4e70 0x7fcd8c16abf0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd70067170 0x7fcd70069620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd8c0b16d0 0x7fcd8c16b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 --2- 172.21.15.22:0/1205943208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd8c0b1b40 0x7fcd8c149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 >> 172.21.15.22:0/1205943208 conn(0x7fcd8c0d10c0 msgr2=0x7fcd8c0b4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 shutdown_connections 2023-10-08T00:30:05.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:05.941+0000 7fcd931f5700 1 -- 172.21.15.22:0/1205943208 wait complete. 2023-10-08T00:30:05.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.094+0000 7f7b0f409700 1 Processor -- start 2023-10-08T00:30:06.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.094+0000 7f7b0f409700 1 -- start start 2023-10-08T00:30:06.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0f409700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b08159840 0x7f7b080cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0f409700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b08069bb0 0x7f7b080b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0f409700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b080cfb30 con 0x7f7b080cba70 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0f409700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080cbf10 con 0x7f7b08159840 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0f409700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080cf4e0 con 0x7f7b08069bb0 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0d1a5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b08159840 0x7f7b080cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0d1a5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b08159840 0x7f7b080cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53844/0 (socket says 172.21.15.22:53844) 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/3245305488 learned_addr learned my addr 172.21.15.22:0/3245305488 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0c9a4700 1 --1- 172.21.15.22:0/3245305488 >> v1:172.21.15.22:6789/0 conn(0x7f7b080cba70 0x7f7b080694a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49548/0 (socket says 172.21.15.22:49548) 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.095+0000 7f7b0d9a6700 1 --2- 172.21.15.22:0/3245305488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b08069bb0 0x7f7b080b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/3245305488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b08069bb0 msgr2=0x7f7b080b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7b0d1a5700 1 --2- 172.21.15.22:0/3245305488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b08069bb0 0x7f7b080b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/3245305488 >> v1:172.21.15.22:6789/0 conn(0x7f7b080cba70 legacy=0x7f7b080694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/3245305488 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b080cf7c0 con 0x7f7b08159840 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7b0d1a5700 1 --2- 172.21.15.22:0/3245305488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08159840 0x7f7b080cb530 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7b040099e0 tx=0x7f7b04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a9eed67059e2ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7afffff700 1 -- 172.21.15.22:0/3245305488 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400b820 con 0x7f7b08159840 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7afffff700 1 -- 172.21.15.22:0/3245305488 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0400b980 con 0x7f7b08159840 2023-10-08T00:30:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.096+0000 7f7afffff700 1 -- 172.21.15.22:0/3245305488 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400bd40 con 0x7f7b08159840 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 -- 172.21.15.22:0/3245305488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08159840 msgr2=0x7f7b080cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 --2- 172.21.15.22:0/3245305488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08159840 0x7f7b080cb530 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7b040099e0 tx=0x7f7b04009250 comp rx=0 tx=0).stop 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 -- 172.21.15.22:0/3245305488 shutdown_connections 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 --2- 172.21.15.22:0/3245305488 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b08069bb0 0x7f7b080b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 --2- 172.21.15.22:0/3245305488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08159840 0x7f7b080cb530 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 -- 172.21.15.22:0/3245305488 >> 172.21.15.22:0/3245305488 conn(0x7f7b08068e10 msgr2=0x7f7b080d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:06.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 -- 172.21.15.22:0/3245305488 shutdown_connections 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.097+0000 7f7b0f409700 1 -- 172.21.15.22:0/3245305488 wait complete. 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.098+0000 7f7b0f409700 1 Processor -- start 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.098+0000 7f7b0f409700 1 -- start start 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0f409700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 0x7f7b08148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0f409700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b080cba70 0x7f7b080b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0f409700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b08159840 0x7f7b080b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0f409700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081486b0 con 0x7f7b08069bb0 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0f409700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080b4b70 con 0x7f7b08159840 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0f409700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b08159ed0 con 0x7f7b080cba70 2023-10-08T00:30:06.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0d1a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 0x7f7b08148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0d1a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 0x7f7b08148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53852/0 (socket says 172.21.15.22:53852) 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/2798332319 learned_addr learned my addr 172.21.15.22:0/2798332319 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0c9a4700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b080cba70 0x7f7b080b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0d9a6700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b08159840 0x7f7b080b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b080cba70 msgr2=0x7f7b080b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.099+0000 7f7b0d1a5700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b080cba70 0x7f7b080b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b08159840 msgr2=0x7f7b080b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7b0d1a5700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b08159840 0x7f7b080b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7b0d1a5700 1 -- 172.21.15.22:0/2798332319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b040094f0 con 0x7f7b08069bb0 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7b0d1a5700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 0x7f7b08148170 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006fd0 tx=0x7f7b04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:06.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0401f070 con 0x7f7b08069bb0 2023-10-08T00:30:06.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b04011d30 con 0x7f7b08069bb0 2023-10-08T00:30:06.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b080b4070 con 0x7f7b08069bb0 2023-10-08T00:30:06.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0400b820 con 0x7f7b08069bb0 2023-10-08T00:30:06.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.100+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b080b4dc0 con 0x7f7b08069bb0 2023-10-08T00:30:06.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.101+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08064550 con 0x7f7b08069bb0 2023-10-08T00:30:06.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.101+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7b0401a8c0 con 0x7f7b08069bb0 2023-10-08T00:30:06.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.102+0000 7f7afd7fa700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aec067240 0x7f7aec0696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.102+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7b04085cd0 con 0x7f7b08069bb0 2023-10-08T00:30:06.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.102+0000 7f7b0c9a4700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aec067240 0x7f7aec0696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.102+0000 7f7b0c9a4700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aec067240 0x7f7aec0696f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7b080697b0 tx=0x7f7af8007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:06.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.107+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b04052dd0 con 0x7f7b08069bb0 2023-10-08T00:30:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.437+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b0804c3c0 con 0x7f7b08069bb0 2023-10-08T00:30:06.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.437+0000 7f7afd7fa700 1 -- 172.21.15.22:0/2798332319 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f7b04015090 con 0x7f7b08069bb0 2023-10-08T00:30:06.439 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:06.439 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:56.112286+0000","modified":"2023-10-08T00:26:59.735766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/2573785310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2573785310},{"type":"v1","addr":"172.21.15.22:6835","nonce":2573785310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T00:30:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.439+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aec067240 msgr2=0x7f7aec0696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.439+0000 7f7b0f409700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aec067240 0x7f7aec0696f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7b080697b0 tx=0x7f7af8007eb0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.439+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 msgr2=0x7f7b08148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.439+0000 7f7b0f409700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 0x7f7b08148170 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7b04006fd0 tx=0x7f7b04017000 comp rx=0 tx=0).stop 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 shutdown_connections 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b08159840 0x7f7b080b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b08069bb0 0x7f7b08148170 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7aec067240 0x7f7aec0696f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 --2- 172.21.15.22:0/2798332319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b080cba70 0x7f7b080b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 >> 172.21.15.22:0/2798332319 conn(0x7f7b08068e10 msgr2=0x7f7b08158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 shutdown_connections 2023-10-08T00:30:06.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.440+0000 7f7b0f409700 1 -- 172.21.15.22:0/2798332319 wait complete. 2023-10-08T00:30:06.443 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 43 2023-10-08T00:30:06.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:06.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.595+0000 7f2d65d7c700 1 Processor -- start 2023-10-08T00:30:06.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.595+0000 7f2d65d7c700 1 -- start start 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d65d7c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d6006aa40 0x7f2d600cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d65d7c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006bac0 0x7f2d6006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d65d7c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d600cc210 con 0x7f2d6006b350 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d65d7c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600cc4f0 con 0x7f2d6006aa40 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d65d7c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600cc7d0 con 0x7f2d6006bac0 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2d6006b350 0x7f2d600c81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49564/0 (socket says 172.21.15.22:49564) 2023-10-08T00:30:06.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5ffff700 1 -- 172.21.15.22:0/1311091495 learned_addr learned my addr 172.21.15.22:0/1311091495 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1311091495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006bac0 0x7f2d6006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5f7fe700 1 --2- 172.21.15.22:0/1311091495 >> v2:172.21.15.192:3300/0 conn(0x7f2d6006aa40 0x7f2d600cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5e7fc700 1 -- 172.21.15.22:0/1311091495 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857154719 0 0) 0x7f2d600cc210 con 0x7f2d6006b350 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5e7fc700 1 -- 172.21.15.22:0/1311091495 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d48003570 con 0x7f2d6006b350 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5effd700 1 -- 172.21.15.22:0/1311091495 >> v2:172.21.15.192:3300/0 conn(0x7f2d6006aa40 msgr2=0x7f2d600cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.596+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1311091495 >> v2:172.21.15.192:3300/0 conn(0x7f2d6006aa40 0x7f2d600cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5effd700 1 -- 172.21.15.22:0/1311091495 >> v1:172.21.15.22:6789/0 conn(0x7f2d6006b350 legacy=0x7f2d600c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5effd700 1 -- 172.21.15.22:0/1311091495 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d600ccab0 con 0x7f2d6006bac0 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5f7fe700 1 --2- 172.21.15.22:0/1311091495 >> v2:172.21.15.192:3300/0 conn(0x7f2d6006aa40 0x7f2d600cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:06.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1311091495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006bac0 0x7f2d6006ae10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d540098e0 tx=0x7f2d540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1b1c2e1545101f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5e7fc700 1 -- 172.21.15.22:0/1311091495 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011630 con 0x7f2d6006bac0 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5e7fc700 1 -- 172.21.15.22:0/1311091495 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54011790 con 0x7f2d6006bac0 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.597+0000 7f2d5e7fc700 1 -- 172.21.15.22:0/1311091495 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011b30 con 0x7f2d6006bac0 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1311091495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006bac0 msgr2=0x7f2d6006ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1311091495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006bac0 0x7f2d6006ae10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2d540098e0 tx=0x7f2d540091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1311091495 shutdown_connections 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1311091495 >> v2:172.21.15.192:3300/0 conn(0x7f2d6006aa40 0x7f2d600cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1311091495 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006bac0 0x7f2d6006ae10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1311091495 >> 172.21.15.22:0/1311091495 conn(0x7f2d600cd670 msgr2=0x7f2d600cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:06.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1311091495 shutdown_connections 2023-10-08T00:30:06.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.598+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1311091495 wait complete. 2023-10-08T00:30:06.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.599+0000 7f2d65d7c700 1 Processor -- start 2023-10-08T00:30:06.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.599+0000 7f2d65d7c700 1 -- start start 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d65d7c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 0x7f2d6014f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d65d7c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6006b350 0x7f2d60165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d65d7c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 0x7f2d600c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d65d7c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600c5400 con 0x7f2d6006bac0 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d65d7c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d600c56e0 con 0x7f2d6006b350 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d65d7c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d601525b0 con 0x7f2d6006aa40 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 0x7f2d600c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5f7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 0x7f2d6014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5f7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 0x7f2d6014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:54012/0 (socket says 172.21.15.22:54012) 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5f7fe700 1 -- 172.21.15.22:0/1879133114 learned_addr learned my addr 172.21.15.22:0/1879133114 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 0x7f2d600c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53856/0 (socket says 172.21.15.22:53856) 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6006b350 0x7f2d60165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5effd700 1 -- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 msgr2=0x7f2d6014f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 0x7f2d6014f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5effd700 1 -- 172.21.15.22:0/1879133114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 msgr2=0x7f2d600c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 0x7f2d600c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5effd700 1 -- 172.21.15.22:0/1879133114 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5000b660 con 0x7f2d6006b350 2023-10-08T00:30:06.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5ffff700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 0x7f2d600c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.600+0000 7f2d5f7fe700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 0x7f2d6014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.601+0000 7f2d5effd700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6006b350 0x7f2d60165420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2d54016000 tx=0x7f2d54017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.601+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54000d10 con 0x7f2d6006b350 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.601+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54011b10 con 0x7f2d6006b350 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.601+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54025620 con 0x7f2d6006b350 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.601+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d54009420 con 0x7f2d6006b350 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.601+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d60152b70 con 0x7f2d6006b350 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.602+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d60152d60 con 0x7f2d6006b350 2023-10-08T00:30:06.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.602+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2d5402e450 con 0x7f2d6006b350 2023-10-08T00:30:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.603+0000 7f2d477fe700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d4c067170 0x7f2d4c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.603+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2d54085fb0 con 0x7f2d6006b350 2023-10-08T00:30:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.603+0000 7f2d5f7fe700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d4c067170 0x7f2d4c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.603+0000 7f2d5f7fe700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d4c067170 0x7f2d4c069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d50011b20 tx=0x7f2d5000b3e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:06.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.608+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d540b75a0 con 0x7f2d6006b350 2023-10-08T00:30:06.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.892+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d6004c3c0 con 0x7f2d6006b350 2023-10-08T00:30:06.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.893+0000 7f2d477fe700 1 -- 172.21.15.22:0/1879133114 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15450 (secure 0 0 0) 0x7f2d54015020 con 0x7f2d6006b350 2023-10-08T00:30:06.894 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:06.894 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":66,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:27:41.808268+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:54.521604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:55.081427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:06.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.895+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d4c067170 msgr2=0x7f2d4c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.895+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d4c067170 0x7f2d4c069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d50011b20 tx=0x7f2d5000b3e0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.895+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6006b350 msgr2=0x7f2d60165420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.895+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6006b350 0x7f2d60165420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2d54016000 tx=0x7f2d54017000 comp rx=0 tx=0).stop 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.895+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 shutdown_connections 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.895+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d6006bac0 0x7f2d600c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.896+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d4c067170 0x7f2d4c069620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.896+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d6006aa40 0x7f2d6014f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.896+0000 7f2d65d7c700 1 --2- 172.21.15.22:0/1879133114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d6006b350 0x7f2d60165420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.896+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 >> 172.21.15.22:0/1879133114 conn(0x7f2d600cd670 msgr2=0x7f2d600c25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:06.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.896+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 shutdown_connections 2023-10-08T00:30:06.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:06.896+0000 7f2d65d7c700 1 -- 172.21.15.22:0/1879133114 wait complete. 2023-10-08T00:30:06.913 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:30:06.913 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:07.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.034+0000 7f230639a700 1 Processor -- start 2023-10-08T00:30:07.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.034+0000 7f230639a700 1 -- start start 2023-10-08T00:30:07.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f230639a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f23001574d0 0x7f23000cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f230639a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23000cc3c0 0x7f230006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f230639a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230006c380 con 0x7f230006bf20 2023-10-08T00:30:07.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f230639a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000b16a0 con 0x7f23001574d0 2023-10-08T00:30:07.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f230639a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000b1c60 con 0x7f23000cc3c0 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2305b99700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f230006bf20 0x7f230006cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34202/0 (socket says 172.21.15.22:34202) 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2305b99700 1 -- 172.21.15.22:0/1030870371 learned_addr learned my addr 172.21.15.22:0/1030870371 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2304b97700 1 --2- 172.21.15.22:0/1030870371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23000cc3c0 0x7f230006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2305398700 1 --2- 172.21.15.22:0/1030870371 >> v2:172.21.15.192:3300/0 conn(0x7f23001574d0 0x7f23000cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f22f3fff700 1 -- 172.21.15.22:0/1030870371 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547713257 0 0) 0x7f22f8001490 con 0x7f230006bf20 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f22f3fff700 1 -- 172.21.15.22:0/1030870371 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ec003570 con 0x7f230006bf20 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2304b97700 1 -- 172.21.15.22:0/1030870371 >> v2:172.21.15.192:3300/0 conn(0x7f23001574d0 msgr2=0x7f23000cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2304b97700 1 --2- 172.21.15.22:0/1030870371 >> v2:172.21.15.192:3300/0 conn(0x7f23001574d0 0x7f23000cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2304b97700 1 -- 172.21.15.22:0/1030870371 >> v1:172.21.15.22:6789/0 conn(0x7f230006bf20 legacy=0x7f230006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f22f3fff700 1 -- 172.21.15.22:0/1030870371 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2911119702 0 0) 0x7f22ec003570 con 0x7f230006bf20 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2304b97700 1 -- 172.21.15.22:0/1030870371 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23001578a0 con 0x7f23000cc3c0 2023-10-08T00:30:07.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.036+0000 7f2305398700 1 --2- 172.21.15.22:0/1030870371 >> v2:172.21.15.192:3300/0 conn(0x7f23001574d0 0x7f23000cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f2304b97700 1 --2- 172.21.15.22:0/1030870371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23000cc3c0 0x7f230006b9e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0098e0 tx=0x7f22fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a146404b9143752 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f22f3fff700 1 -- 172.21.15.22:0/1030870371 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8001980 con 0x7f23000cc3c0 2023-10-08T00:30:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f22f3fff700 1 -- 172.21.15.22:0/1030870371 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc011420 con 0x7f23000cc3c0 2023-10-08T00:30:07.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f22f3fff700 1 -- 172.21.15.22:0/1030870371 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0117a0 con 0x7f23000cc3c0 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 -- 172.21.15.22:0/1030870371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23000cc3c0 msgr2=0x7f230006b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 --2- 172.21.15.22:0/1030870371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23000cc3c0 0x7f230006b9e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0098e0 tx=0x7f22fc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 -- 172.21.15.22:0/1030870371 shutdown_connections 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 --2- 172.21.15.22:0/1030870371 >> v2:172.21.15.192:3300/0 conn(0x7f23001574d0 0x7f23000cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 --2- 172.21.15.22:0/1030870371 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f23000cc3c0 0x7f230006b9e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 -- 172.21.15.22:0/1030870371 >> 172.21.15.22:0/1030870371 conn(0x7f23000ce430 msgr2=0x7f23000ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:07.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.037+0000 7f230639a700 1 -- 172.21.15.22:0/1030870371 shutdown_connections 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.038+0000 7f230639a700 1 -- 172.21.15.22:0/1030870371 wait complete. 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.039+0000 7f230639a700 1 Processor -- start 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.039+0000 7f230639a700 1 -- start start 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f230639a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f230006bf20 0x7f230015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f230639a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 0x7f230014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f230639a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23001574d0 0x7f2300159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f230639a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230014d820 con 0x7f23000cc3c0 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f230639a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230015a470 con 0x7f23001574d0 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f230639a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230014ecc0 con 0x7f230006bf20 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 0x7f230014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 0x7f230014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32904/0 (socket says 172.21.15.22:32904) 2023-10-08T00:30:07.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 -- 172.21.15.22:0/332775641 learned_addr learned my addr 172.21.15.22:0/332775641 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2305398700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f230006bf20 0x7f230015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2305b99700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23001574d0 0x7f2300159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 -- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f230006bf20 msgr2=0x7f230015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f230006bf20 0x7f230015c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 -- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23001574d0 msgr2=0x7f2300159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23001574d0 0x7f2300159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 -- 172.21.15.22:0/332775641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40093c0 con 0x7f23000cc3c0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f2304b97700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 0x7f230014d2e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0091e0 tx=0x7f22fc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc01cb30 con 0x7f23000cc3c0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc01ccb0 con 0x7f23000cc3c0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.040+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc01a6a0 con 0x7f23000cc3c0 2023-10-08T00:30:07.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.041+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc009420 con 0x7f23000cc3c0 2023-10-08T00:30:07.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.041+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230015a960 con 0x7f23000cc3c0 2023-10-08T00:30:07.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.042+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230004c3c0 con 0x7f23000cc3c0 2023-10-08T00:30:07.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.042+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f22fc01aa90 con 0x7f23000cc3c0 2023-10-08T00:30:07.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.042+0000 7f22f17fa700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22e4067170 0x7f22e4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.043+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f22fc085e20 con 0x7f23000cc3c0 2023-10-08T00:30:07.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.043+0000 7f2305398700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22e4067170 0x7f22e4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.043+0000 7f2305398700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22e4067170 0x7f22e4069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009e90 tx=0x7f22f4009120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.047+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22fc052e80 con 0x7f23000cc3c0 2023-10-08T00:30:07.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.290+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23000adad0 con 0x7f23000cc3c0 2023-10-08T00:30:07.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.290+0000 7f22f17fa700 1 -- 172.21.15.22:0/332775641 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f22fc0563e0 con 0x7f23000cc3c0 2023-10-08T00:30:07.292 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:07.292 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:56.112286+0000","modified":"2023-10-08T00:26:59.735766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/2573785310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2573785310},{"type":"v1","addr":"172.21.15.22:6835","nonce":2573785310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T00:30:07.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22e4067170 msgr2=0x7f22e4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22e4067170 0x7f22e4069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009e90 tx=0x7f22f4009120 comp rx=0 tx=0).stop 2023-10-08T00:30:07.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 msgr2=0x7f230014d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 0x7f230014d2e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f22fc0091e0 tx=0x7f22fc016000 comp rx=0 tx=0).stop 2023-10-08T00:30:07.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 shutdown_connections 2023-10-08T00:30:07.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23001574d0 0x7f2300159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f22e4067170 0x7f22e4069620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f230006bf20 0x7f230015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 --2- 172.21.15.22:0/332775641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23000cc3c0 0x7f230014d2e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 >> 172.21.15.22:0/332775641 conn(0x7f23000ce430 msgr2=0x7f2300154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 shutdown_connections 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.292+0000 7f230639a700 1 -- 172.21.15.22:0/332775641 wait complete. 2023-10-08T00:30:07.295 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 43 2023-10-08T00:30:07.306 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:07.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.435+0000 7faf96b16700 1 Processor -- start 2023-10-08T00:30:07.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.435+0000 7faf96b16700 1 -- start start 2023-10-08T00:30:07.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf96b16700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf900aca80 0x7faf9006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf96b16700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf90069d60 0x7faf900c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf96b16700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9006bdb0 con 0x7faf900c81f0 2023-10-08T00:30:07.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf96b16700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900c8670 con 0x7faf900aca80 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf96b16700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900cb370 con 0x7faf90069d60 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf948b2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf900aca80 0x7faf9006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf950b3700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faf900c81f0 0x7faf90068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34212/0 (socket says 172.21.15.22:34212) 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf950b3700 1 -- 172.21.15.22:0/3888946185 learned_addr learned my addr 172.21.15.22:0/3888946185 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf8ffff700 1 --2- 172.21.15.22:0/3888946185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf90069d60 0x7faf900c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf948b2700 1 -- 172.21.15.22:0/3888946185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf90069d60 msgr2=0x7faf900c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf948b2700 1 --2- 172.21.15.22:0/3888946185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf90069d60 0x7faf900c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf948b2700 1 -- 172.21.15.22:0/3888946185 >> v1:172.21.15.22:6789/0 conn(0x7faf900c81f0 legacy=0x7faf90068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.436+0000 7faf948b2700 1 -- 172.21.15.22:0/3888946185 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90159f60 con 0x7faf900aca80 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf948b2700 1 --2- 172.21.15.22:0/3888946185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf900aca80 0x7faf9006aba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7faf840098d0 tx=0x7faf84009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf89d0b8e3a7d223 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf8f7fe700 1 -- 172.21.15.22:0/3888946185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84009e70 con 0x7faf900aca80 2023-10-08T00:30:07.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf8f7fe700 1 -- 172.21.15.22:0/3888946185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84005c10 con 0x7faf900aca80 2023-10-08T00:30:07.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf8f7fe700 1 -- 172.21.15.22:0/3888946185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400b650 con 0x7faf900aca80 2023-10-08T00:30:07.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf96b16700 1 -- 172.21.15.22:0/3888946185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf900aca80 msgr2=0x7faf9006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf96b16700 1 --2- 172.21.15.22:0/3888946185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf900aca80 0x7faf9006aba0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7faf840098d0 tx=0x7faf84009120 comp rx=0 tx=0).stop 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf96b16700 1 -- 172.21.15.22:0/3888946185 shutdown_connections 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf96b16700 1 --2- 172.21.15.22:0/3888946185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf900aca80 0x7faf9006aba0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf96b16700 1 --2- 172.21.15.22:0/3888946185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf90069d60 0x7faf900c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.437+0000 7faf96b16700 1 -- 172.21.15.22:0/3888946185 >> 172.21.15.22:0/3888946185 conn(0x7faf900cd670 msgr2=0x7faf900cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.438+0000 7faf96b16700 1 -- 172.21.15.22:0/3888946185 shutdown_connections 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.438+0000 7faf96b16700 1 -- 172.21.15.22:0/3888946185 wait complete. 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.439+0000 7faf96b16700 1 Processor -- start 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.439+0000 7faf96b16700 1 -- start start 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.439+0000 7faf96b16700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 0x7faf90160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.439+0000 7faf96b16700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf900aca80 0x7faf9015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.439+0000 7faf96b16700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf900c81f0 0x7faf9015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf96b16700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9015bec0 con 0x7faf90069d60 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf96b16700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9015a660 con 0x7faf900c81f0 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf96b16700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9015a8e0 con 0x7faf900aca80 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 0x7faf90160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 0x7faf90160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32926/0 (socket says 172.21.15.22:32926) 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 -- 172.21.15.22:0/201109715 learned_addr learned my addr 172.21.15.22:0/201109715 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf950b3700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf900c81f0 0x7faf9015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf8ffff700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf900aca80 0x7faf9015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 -- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf900aca80 msgr2=0x7faf9015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf900aca80 0x7faf9015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 -- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf900c81f0 msgr2=0x7faf9015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf900c81f0 0x7faf9015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 -- 172.21.15.22:0/201109715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840093c0 con 0x7faf90069d60 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf948b2700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 0x7faf90160010 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faf8400b3c0 tx=0x7faf84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84006210 con 0x7faf90069d60 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf84006390 con 0x7faf90069d60 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84006750 con 0x7faf90069d60 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9015abc0 con 0x7faf90069d60 2023-10-08T00:30:07.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.440+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9015b200 con 0x7faf90069d60 2023-10-08T00:30:07.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.441+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9004c3c0 con 0x7faf90069d60 2023-10-08T00:30:07.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.442+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7faf8401b690 con 0x7faf90069d60 2023-10-08T00:30:07.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.442+0000 7faf8cff9700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf74067170 0x7faf74069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.442+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7faf84086b70 con 0x7faf90069d60 2023-10-08T00:30:07.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.442+0000 7faf8ffff700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf74067170 0x7faf74069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.443+0000 7faf8ffff700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf74067170 0x7faf74069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faf90063850 tx=0x7faf7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.446+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf84053a40 con 0x7faf90069d60 2023-10-08T00:30:07.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.696+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf9006b510 con 0x7faf90069d60 2023-10-08T00:30:07.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.697+0000 7faf8cff9700 1 -- 172.21.15.22:0/201109715 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4596 (secure 0 0 0) 0x7faf84057060 con 0x7faf90069d60 2023-10-08T00:30:07.698 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:07.698 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:26:56.112286+0000","modified":"2023-10-08T00:26:59.735766+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5709":{"gid":5709,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6835/2573785310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2573785310},{"type":"v1","addr":"172.21.15.22:6835","nonce":2573785310}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T00:30:07.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf74067170 msgr2=0x7faf74069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf74067170 0x7faf74069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7faf90063850 tx=0x7faf7c008040 comp rx=0 tx=0).stop 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 msgr2=0x7faf90160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 0x7faf90160010 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faf8400b3c0 tx=0x7faf84016000 comp rx=0 tx=0).stop 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 shutdown_connections 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf900c81f0 0x7faf9015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf90069d60 0x7faf90160010 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf74067170 0x7faf74069620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 --2- 172.21.15.22:0/201109715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf900aca80 0x7faf9015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 >> 172.21.15.22:0/201109715 conn(0x7faf900cd670 msgr2=0x7faf9006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 shutdown_connections 2023-10-08T00:30:07.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.699+0000 7faf96b16700 1 -- 172.21.15.22:0/201109715 wait complete. 2023-10-08T00:30:07.702 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 43 2023-10-08T00:30:07.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:07.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.837+0000 7fe26982c700 1 Processor -- start 2023-10-08T00:30:07.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.837+0000 7fe26982c700 1 -- start start 2023-10-08T00:30:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe26982c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe264156a50 0x7fe2640c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe26982c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2640c7e70 0x7fe2640af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe26982c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26406be50 con 0x7fe264156680 2023-10-08T00:30:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe26982c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2640c88d0 con 0x7fe2640c7e70 2023-10-08T00:30:07.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe26982c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26406c3f0 con 0x7fe264156a50 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe2637fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2640c7e70 0x7fe2640af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe2637fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2640c7e70 0x7fe2640af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32934/0 (socket says 172.21.15.22:32934) 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe2637fe700 1 -- 172.21.15.22:0/1903696932 learned_addr learned my addr 172.21.15.22:0/1903696932 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe2627fc700 1 --2- 172.21.15.22:0/1903696932 >> v2:172.21.15.192:3300/0 conn(0x7fe264156a50 0x7fe2640c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe2637fe700 1 -- 172.21.15.22:0/1903696932 >> v2:172.21.15.192:3300/0 conn(0x7fe264156a50 msgr2=0x7fe2640c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.838+0000 7fe2637fe700 1 --2- 172.21.15.22:0/1903696932 >> v2:172.21.15.192:3300/0 conn(0x7fe264156a50 0x7fe2640c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe2637fe700 1 -- 172.21.15.22:0/1903696932 >> v1:172.21.15.192:6789/0 conn(0x7fe264156680 legacy=0x7fe26406c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe2637fe700 1 -- 172.21.15.22:0/1903696932 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26406cf90 con 0x7fe2640c7e70 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe2627fc700 1 --2- 172.21.15.22:0/1903696932 >> v2:172.21.15.192:3300/0 conn(0x7fe264156a50 0x7fe2640c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe2637fe700 1 --2- 172.21.15.22:0/1903696932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2640c7e70 0x7fe2640af1a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe2640ccac0 tx=0x7fe25c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4e017ba34fa407 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe261ffb700 1 -- 172.21.15.22:0/1903696932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c010070 con 0x7fe2640c7e70 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe261ffb700 1 -- 172.21.15.22:0/1903696932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00de90 con 0x7fe2640c7e70 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe261ffb700 1 -- 172.21.15.22:0/1903696932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00b320 con 0x7fe2640c7e70 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 -- 172.21.15.22:0/1903696932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2640c7e70 msgr2=0x7fe2640af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 --2- 172.21.15.22:0/1903696932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2640c7e70 0x7fe2640af1a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe2640ccac0 tx=0x7fe25c00ba50 comp rx=0 tx=0).stop 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 -- 172.21.15.22:0/1903696932 shutdown_connections 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 --2- 172.21.15.22:0/1903696932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2640c7e70 0x7fe2640af1a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 --2- 172.21.15.22:0/1903696932 >> v2:172.21.15.192:3300/0 conn(0x7fe264156a50 0x7fe2640c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 -- 172.21.15.22:0/1903696932 >> 172.21.15.22:0/1903696932 conn(0x7fe2640cdd80 msgr2=0x7fe2640c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.839+0000 7fe26982c700 1 -- 172.21.15.22:0/1903696932 shutdown_connections 2023-10-08T00:30:07.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.840+0000 7fe26982c700 1 -- 172.21.15.22:0/1903696932 wait complete. 2023-10-08T00:30:07.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.841+0000 7fe26982c700 1 Processor -- start 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.841+0000 7fe26982c700 1 -- start start 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe26982c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2640c7e70 0x7fe26414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe26982c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264156680 0x7fe2640c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe26982c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 0x7fe2641529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe26982c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b0090 con 0x7fe264156a50 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe26982c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264150300 con 0x7fe264156680 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe26982c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640b02e0 con 0x7fe2640c7e70 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 0x7fe2641529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 0x7fe2641529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32936/0 (socket says 172.21.15.22:32936) 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2627fc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264156680 0x7fe2640c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 -- 172.21.15.22:0/856288262 learned_addr learned my addr 172.21.15.22:0/856288262 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe262ffd700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2640c7e70 0x7fe26414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 -- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2640c7e70 msgr2=0x7fe26414fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2640c7e70 0x7fe26414fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 -- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264156680 msgr2=0x7fe2640c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264156680 0x7fe2640c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 -- 172.21.15.22:0/856288262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c00bcf0 con 0x7fe264156a50 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2627fc700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264156680 0x7fe2640c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.842+0000 7fe2637fe700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 0x7fe2641529d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe25c014000 tx=0x7fe25c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.843+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00ac10 con 0x7fe264156a50 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.843+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00ad90 con 0x7fe264156a50 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.843+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c01e690 con 0x7fe264156a50 2023-10-08T00:30:07.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.843+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2640b05c0 con 0x7fe264156a50 2023-10-08T00:30:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.843+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2640b0b80 con 0x7fe264156a50 2023-10-08T00:30:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.844+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fe25c003040 con 0x7fe264156a50 2023-10-08T00:30:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.844+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26404c3c0 con 0x7fe264156a50 2023-10-08T00:30:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.845+0000 7fe24affd700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe250067170 0x7fe250069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.845+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe25c0862f0 con 0x7fe264156a50 2023-10-08T00:30:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.845+0000 7fe262ffd700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe250067170 0x7fe250069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:07.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.845+0000 7fe262ffd700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe250067170 0x7fe250069620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe254003a80 tx=0x7fe254007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:07.850+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe25c053180 con 0x7fe264156a50 2023-10-08T00:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.093+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2640c8360 con 0x7fe264156a50 2023-10-08T00:30:08.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.094+0000 7fe24affd700 1 -- 172.21.15.22:0/856288262 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+15450 (secure 0 0 0) 0x7fe25c0567a0 con 0x7fe264156a50 2023-10-08T00:30:08.096 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:08.096 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":66,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:27:41.808268+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:26:54.521604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T00:26:55.081427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1","mappings":[{"from":6,"to":0}]},{"pgid":"11.2d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe250067170 msgr2=0x7fe250069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe250067170 0x7fe250069620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe254003a80 tx=0x7fe254007ec0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 msgr2=0x7fe2641529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 0x7fe2641529d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe25c014000 tx=0x7fe25c01a000 comp rx=0 tx=0).stop 2023-10-08T00:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 shutdown_connections 2023-10-08T00:30:08.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe264156a50 0x7fe2641529d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe250067170 0x7fe250069620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2640c7e70 0x7fe26414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 --2- 172.21.15.22:0/856288262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264156680 0x7fe2640c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.096+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 >> 172.21.15.22:0/856288262 conn(0x7fe2640cdd80 msgr2=0x7fe2640c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:08.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.097+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 shutdown_connections 2023-10-08T00:30:08.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.097+0000 7fe26982c700 1 -- 172.21.15.22:0/856288262 wait complete. 2023-10-08T00:30:08.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:30:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.232+0000 7fd97a634700 1 Processor -- start 2023-10-08T00:30:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.232+0000 7fd97a634700 1 -- start start 2023-10-08T00:30:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd97a634700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd974141500 0x7fd9740c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd97a634700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd97406c0a0 0x7fd9740c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd97a634700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97415c2a0 con 0x7fd97406bcd0 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd97a634700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740c9880 con 0x7fd974141500 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd97a634700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97415b690 con 0x7fd97406c0a0 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd9737fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd974141500 0x7fd9740c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd9737fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd974141500 0x7fd9740c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32952/0 (socket says 172.21.15.22:32952) 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd9737fe700 1 -- 172.21.15.22:0/4213744773 learned_addr learned my addr 172.21.15.22:0/4213744773 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.233+0000 7fd978bd1700 1 --2- 172.21.15.22:0/4213744773 >> v2:172.21.15.192:3300/0 conn(0x7fd97406c0a0 0x7fd9740c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd9737fe700 1 -- 172.21.15.22:0/4213744773 >> v2:172.21.15.192:3300/0 conn(0x7fd97406c0a0 msgr2=0x7fd9740c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd9737fe700 1 --2- 172.21.15.22:0/4213744773 >> v2:172.21.15.192:3300/0 conn(0x7fd97406c0a0 0x7fd9740c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd9737fe700 1 -- 172.21.15.22:0/4213744773 >> v1:172.21.15.192:6789/0 conn(0x7fd97406bcd0 legacy=0x7fd974140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd9737fe700 1 -- 172.21.15.22:0/4213744773 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97415b970 con 0x7fd974141500 2023-10-08T00:30:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd9737fe700 1 --2- 172.21.15.22:0/4213744773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd974141500 0x7fd9740c8e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cf210 tx=0x7fd968009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccf74799c938f7a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd972ffd700 1 -- 172.21.15.22:0/4213744773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968009e70 con 0x7fd974141500 2023-10-08T00:30:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd972ffd700 1 -- 172.21.15.22:0/4213744773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800b860 con 0x7fd974141500 2023-10-08T00:30:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.234+0000 7fd972ffd700 1 -- 172.21.15.22:0/4213744773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800bc00 con 0x7fd974141500 2023-10-08T00:30:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 -- 172.21.15.22:0/4213744773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd974141500 msgr2=0x7fd9740c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 --2- 172.21.15.22:0/4213744773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd974141500 0x7fd9740c8e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cf210 tx=0x7fd968009250 comp rx=0 tx=0).stop 2023-10-08T00:30:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 -- 172.21.15.22:0/4213744773 shutdown_connections 2023-10-08T00:30:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 --2- 172.21.15.22:0/4213744773 >> v2:172.21.15.192:3300/0 conn(0x7fd97406c0a0 0x7fd9740c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 --2- 172.21.15.22:0/4213744773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd974141500 0x7fd9740c8e00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 -- 172.21.15.22:0/4213744773 >> 172.21.15.22:0/4213744773 conn(0x7fd9740ce600 msgr2=0x7fd9740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 -- 172.21.15.22:0/4213744773 shutdown_connections 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.235+0000 7fd97a634700 1 -- 172.21.15.22:0/4213744773 wait complete. 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.236+0000 7fd97a634700 1 Processor -- start 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.236+0000 7fd97a634700 1 -- start start 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd97a634700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 0x7fd97413edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd97a634700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97406c0a0 0x7fd9740c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd97a634700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9740c6640 0x7fd9741572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd97a634700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740b4150 con 0x7fd97406bcd0 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd97a634700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740c56b0 con 0x7fd97406c0a0 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd97a634700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9740c5c70 con 0x7fd9740c6640 2023-10-08T00:30:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 0x7fd97413edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 0x7fd97413edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32962/0 (socket says 172.21.15.22:32962) 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 -- 172.21.15.22:0/1889075963 learned_addr learned my addr 172.21.15.22:0/1889075963 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd9737fe700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97406c0a0 0x7fd9740c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd978bd1700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9740c6640 0x7fd9741572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 -- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9740c6640 msgr2=0x7fd9741572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9740c6640 0x7fd9741572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 -- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97406c0a0 msgr2=0x7fd9740c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97406c0a0 0x7fd9740c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 -- 172.21.15.22:0/1889075963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680094f0 con 0x7fd97406bcd0 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd978bd1700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9740c6640 0x7fd9741572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.237+0000 7fd973fff700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 0x7fd97413edf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c5c0 tx=0x7fd96400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.238+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011590 con 0x7fd97406bcd0 2023-10-08T00:30:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.238+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011710 con 0x7fd97406bcd0 2023-10-08T00:30:08.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.238+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9740b2f80 con 0x7fd97406bcd0 2023-10-08T00:30:08.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.238+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011ad0 con 0x7fd97406bcd0 2023-10-08T00:30:08.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.238+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9740c5900 con 0x7fd97406bcd0 2023-10-08T00:30:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.239+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd96401b3b0 con 0x7fd97406bcd0 2023-10-08T00:30:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.239+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97404c3c0 con 0x7fd97406bcd0 2023-10-08T00:30:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.239+0000 7fd95bfff700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd960067170 0x7fd960069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.240+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fd964083e40 con 0x7fd97406bcd0 2023-10-08T00:30:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.240+0000 7fd9737fe700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd960067170 0x7fd960069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.241+0000 7fd9737fe700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd960067170 0x7fd960069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cf210 tx=0x7fd968017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:08.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.244+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd964050de0 con 0x7fd97406bcd0 2023-10-08T00:30:08.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.493+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd97415bc50 con 0x7fd97406bcd0 2023-10-08T00:30:08.495 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:30:08.494+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:30:08.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.498+0000 7fd95bfff700 1 -- 172.21.15.22:0/1889075963 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd964017070 con 0x7fd97406bcd0 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd960067170 msgr2=0x7fd960069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd960067170 0x7fd960069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd9740cf210 tx=0x7fd968017000 comp rx=0 tx=0).stop 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 msgr2=0x7fd97413edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 0x7fd97413edf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd96400c5c0 tx=0x7fd96400c980 comp rx=0 tx=0).stop 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 shutdown_connections 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd960067170 0x7fd960069620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd9740c6640 0x7fd9741572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd97406bcd0 0x7fd97413edf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 --2- 172.21.15.22:0/1889075963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd97406c0a0 0x7fd9740c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 >> 172.21.15.22:0/1889075963 conn(0x7fd9740ce600 msgr2=0x7fd97413fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:08.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 shutdown_connections 2023-10-08T00:30:08.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.500+0000 7fd97a634700 1 -- 172.21.15.22:0/1889075963 wait complete. 2023-10-08T00:30:08.503 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:30:08.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:30:08.535 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:30:08.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.637+0000 7fd647256700 1 Processor -- start 2023-10-08T00:30:08.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.637+0000 7fd647256700 1 -- start start 2023-10-08T00:30:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd647256700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6400b16d0 0x7fd6400b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd647256700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b33b0 0x7fd6400b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd647256700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6400b2080 con 0x7fd6400b4e70 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd647256700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400cfb00 con 0x7fd6400b16d0 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd647256700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400b5c40 con 0x7fd6400b33b0 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd645a53700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6400b16d0 0x7fd6400b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd645a53700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6400b16d0 0x7fd6400b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32988/0 (socket says 172.21.15.22:32988) 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd645a53700 1 -- 172.21.15.22:0/2539660946 learned_addr learned my addr 172.21.15.22:0/2539660946 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd646a55700 1 --2- 172.21.15.22:0/2539660946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b33b0 0x7fd6400b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645a53700 1 -- 172.21.15.22:0/2539660946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b33b0 msgr2=0x7fd6400b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645a53700 1 --2- 172.21.15.22:0/2539660946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b33b0 0x7fd6400b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.638+0000 7fd645252700 1 -- 172.21.15.22:0/2539660946 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785902194 0 0) 0x7fd6400b2080 con 0x7fd6400b4e70 2023-10-08T00:30:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645a53700 1 -- 172.21.15.22:0/2539660946 >> v1:172.21.15.192:6789/0 conn(0x7fd6400b4e70 legacy=0x7fd6400ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645a53700 1 -- 172.21.15.22:0/2539660946 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400b5f20 con 0x7fd6400b16d0 2023-10-08T00:30:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645a53700 1 --2- 172.21.15.22:0/2539660946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b16d0 0x7fd6400b1b40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd6340099b0 tx=0x7fd634009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b038d75a06cb0a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645252700 1 -- 172.21.15.22:0/2539660946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd634009ea0 con 0x7fd6400b16d0 2023-10-08T00:30:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645252700 1 -- 172.21.15.22:0/2539660946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63400b860 con 0x7fd6400b16d0 2023-10-08T00:30:08.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd645252700 1 -- 172.21.15.22:0/2539660946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63400bc20 con 0x7fd6400b16d0 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd647256700 1 -- 172.21.15.22:0/2539660946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b16d0 msgr2=0x7fd6400b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.639+0000 7fd647256700 1 --2- 172.21.15.22:0/2539660946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b16d0 0x7fd6400b1b40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd6340099b0 tx=0x7fd634009250 comp rx=0 tx=0).stop 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.640+0000 7fd647256700 1 -- 172.21.15.22:0/2539660946 shutdown_connections 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.640+0000 7fd647256700 1 --2- 172.21.15.22:0/2539660946 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b33b0 0x7fd6400b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.640+0000 7fd647256700 1 --2- 172.21.15.22:0/2539660946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b16d0 0x7fd6400b1b40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.640+0000 7fd647256700 1 -- 172.21.15.22:0/2539660946 >> 172.21.15.22:0/2539660946 conn(0x7fd6400d10c0 msgr2=0x7fd6400affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.640+0000 7fd647256700 1 -- 172.21.15.22:0/2539660946 shutdown_connections 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.640+0000 7fd647256700 1 -- 172.21.15.22:0/2539660946 wait complete. 2023-10-08T00:30:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 Processor -- start 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 -- start start 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b16d0 0x7fd6400c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6400b33b0 0x7fd640157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 0x7fd640169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400c89c0 con 0x7fd6400b4e70 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64016daa0 con 0x7fd6400b33b0 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.641+0000 7fd647256700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64016dd80 con 0x7fd6400b16d0 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 0x7fd640169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 0x7fd640169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32992/0 (socket says 172.21.15.22:32992) 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 -- 172.21.15.22:0/2221342169 learned_addr learned my addr 172.21.15.22:0/2221342169 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd645a53700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6400b33b0 0x7fd640157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646254700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b16d0 0x7fd6400c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 -- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b16d0 msgr2=0x7fd6400c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b16d0 0x7fd6400c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 -- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6400b33b0 msgr2=0x7fd640157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6400b33b0 0x7fd640157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 -- 172.21.15.22:0/2221342169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340094f0 con 0x7fd6400b4e70 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd646a55700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 0x7fd640169f60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd638009e90 tx=0x7fd63800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800cc00 con 0x7fd6400b4e70 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800f040 con 0x7fd6400b4e70 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638014480 con 0x7fd6400b4e70 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64016e060 con 0x7fd6400b4e70 2023-10-08T00:30:08.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.642+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6400c8cc0 con 0x7fd6400b4e70 2023-10-08T00:30:08.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.643+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6400c8ee0 con 0x7fd6400b4e70 2023-10-08T00:30:08.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.644+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd638014830 con 0x7fd6400b4e70 2023-10-08T00:30:08.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.644+0000 7fd63e7fc700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd62c067170 0x7fd62c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:08.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.644+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fd638085420 con 0x7fd6400b4e70 2023-10-08T00:30:08.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.644+0000 7fd646254700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd62c067170 0x7fd62c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:08.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.645+0000 7fd646254700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd62c067170 0x7fd62c069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd630007fd0 tx=0x7fd630007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:08.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.648+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd638055cf0 con 0x7fd6400b4e70 2023-10-08T00:30:08.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:08.891+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6400cf4b0 con 0x7fd6400b4e70 2023-10-08T00:30:09.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.498+0000 7fd63e7fc700 1 -- 172.21.15.22:0/2221342169 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd638055880 con 0x7fd6400b4e70 2023-10-08T00:30:09.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd62c067170 msgr2=0x7fd62c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd62c067170 0x7fd62c069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd630007fd0 tx=0x7fd630007d30 comp rx=0 tx=0).stop 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 msgr2=0x7fd640169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 0x7fd640169f60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd638009e90 tx=0x7fd63800b040 comp rx=0 tx=0).stop 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 shutdown_connections 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6400b4e70 0x7fd640169f60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd62c067170 0x7fd62c069620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6400b16d0 0x7fd6400c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 --2- 172.21.15.22:0/2221342169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6400b33b0 0x7fd640157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.501+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 >> 172.21.15.22:0/2221342169 conn(0x7fd6400d10c0 msgr2=0x7fd640069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:09.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.502+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 shutdown_connections 2023-10-08T00:30:09.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.502+0000 7fd647256700 1 -- 172.21.15.22:0/2221342169 wait complete. 2023-10-08T00:30:09.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:30:09.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.688+0000 7fcf17fff700 1 Processor -- start 2023-10-08T00:30:09.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.688+0000 7fcf17fff700 1 -- start start 2023-10-08T00:30:09.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf17fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcf180cd6a0 0x7fcf180cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf17fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1815b560 con 0x7fcf18157540 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf17fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1815b840 con 0x7fcf180c94c0 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf17fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180cbbe0 con 0x7fcf180cd6a0 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf177fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcf180cd6a0 0x7fcf180cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf16ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcf18157540 0x7fcf180c8db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34230/0 (socket says 172.21.15.22:34230) 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.689+0000 7fcf16ffd700 1 -- 172.21.15.22:0/4114358359 learned_addr learned my addr 172.21.15.22:0/4114358359 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf177fe700 1 -- 172.21.15.22:0/4114358359 >> v1:172.21.15.192:6789/0 conn(0x7fcf180c94c0 legacy=0x7fcf180cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf177fe700 1 -- 172.21.15.22:0/4114358359 >> v1:172.21.15.22:6789/0 conn(0x7fcf18157540 legacy=0x7fcf180c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf177fe700 1 -- 172.21.15.22:0/4114358359 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1815bb20 con 0x7fcf180cd6a0 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf177fe700 1 --2- 172.21.15.22:0/4114358359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180cd6a0 0x7fcf180cb4e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009e60 tx=0x7fcf08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deebe9eb2909272 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf15ffb700 1 -- 172.21.15.22:0/4114358359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800e070 con 0x7fcf180cd6a0 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf15ffb700 1 -- 172.21.15.22:0/4114358359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800bc30 con 0x7fcf180cd6a0 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf15ffb700 1 -- 172.21.15.22:0/4114358359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08012430 con 0x7fcf180cd6a0 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf17fff700 1 -- 172.21.15.22:0/4114358359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180cd6a0 msgr2=0x7fcf180cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.690+0000 7fcf17fff700 1 --2- 172.21.15.22:0/4114358359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180cd6a0 0x7fcf180cb4e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009e60 tx=0x7fcf08009780 comp rx=0 tx=0).stop 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.691+0000 7fcf17fff700 1 -- 172.21.15.22:0/4114358359 shutdown_connections 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.691+0000 7fcf17fff700 1 --2- 172.21.15.22:0/4114358359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180cd6a0 0x7fcf180cb4e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.691+0000 7fcf17fff700 1 -- 172.21.15.22:0/4114358359 >> 172.21.15.22:0/4114358359 conn(0x7fcf1806baf0 msgr2=0x7fcf1806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.691+0000 7fcf17fff700 1 -- 172.21.15.22:0/4114358359 shutdown_connections 2023-10-08T00:30:09.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.691+0000 7fcf17fff700 1 -- 172.21.15.22:0/4114358359 wait complete. 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.692+0000 7fcf17fff700 1 Processor -- start 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.692+0000 7fcf17fff700 1 -- start start 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.692+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 0x7fcf180b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf180cd6a0 0x7fcf18152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf18157540 0x7fcf18167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1816b4e0 con 0x7fcf180c94c0 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180b4150 con 0x7fcf180cd6a0 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18151b00 con 0x7fcf18157540 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 0x7fcf180b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 0x7fcf180b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33008/0 (socket says 172.21.15.22:33008) 2023-10-08T00:30:09.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 -- 172.21.15.22:0/1554303997 learned_addr learned my addr 172.21.15.22:0/1554303997 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 -- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf18157540 msgr2=0x7fcf18167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf167fc700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf180cd6a0 0x7fcf18152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf18157540 0x7fcf18167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 -- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf180cd6a0 msgr2=0x7fcf18152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf180cd6a0 0x7fcf18152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 -- 172.21.15.22:0/1554303997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08009a20 con 0x7fcf180c94c0 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf167fc700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf180cd6a0 0x7fcf18152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf16ffd700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 0x7fcf180b2b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c7c0 tx=0x7fcf10007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:09.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10005b30 con 0x7fcf180c94c0 2023-10-08T00:30:09.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10005c90 con 0x7fcf180c94c0 2023-10-08T00:30:09.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf18151de0 con 0x7fcf180c94c0 2023-10-08T00:30:09.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10007320 con 0x7fcf180c94c0 2023-10-08T00:30:09.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.693+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf181523a0 con 0x7fcf180c94c0 2023-10-08T00:30:09.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.694+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1816b6b0 con 0x7fcf180c94c0 2023-10-08T00:30:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.695+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcf10007690 con 0x7fcf180c94c0 2023-10-08T00:30:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.695+0000 7fcf0effd700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcef8067170 0x7fcef8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.695+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5849+0+0 (secure 0 0 0) 0x7fcf10083e10 con 0x7fcf180c94c0 2023-10-08T00:30:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.695+0000 7fcf167fc700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcef8067170 0x7fcef8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.696+0000 7fcf167fc700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcef8067170 0x7fcef8069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcf180b3b50 tx=0x7fcf00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:09.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.700+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf1816b6b0 con 0x7fcf180c94c0 2023-10-08T00:30:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:09.897+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcf181546c0 con 0x7fcf180c94c0 2023-10-08T00:30:10.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.756+0000 7fcf0effd700 1 -- 172.21.15.22:0/1554303997 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v68) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcf10017070 con 0x7fcf180c94c0 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcef8067170 msgr2=0x7fcef8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcef8067170 0x7fcef8069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcf180b3b50 tx=0x7fcf00009040 comp rx=0 tx=0).stop 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 msgr2=0x7fcf180b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 0x7fcf180b2b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000c7c0 tx=0x7fcf10007f30 comp rx=0 tx=0).stop 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 shutdown_connections 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcef8067170 0x7fcef8069620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcf18157540 0x7fcf18167e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcf180c94c0 0x7fcf180b2b10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 --2- 172.21.15.22:0/1554303997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf180cd6a0 0x7fcf18152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 >> 172.21.15.22:0/1554303997 conn(0x7fcf1806baf0 msgr2=0x7fcf18149300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 shutdown_connections 2023-10-08T00:30:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.760+0000 7fcf17fff700 1 -- 172.21.15.22:0/1554303997 wait complete. 2023-10-08T00:30:10.763 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:30:10.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:30:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.906+0000 7fd809b22700 1 Processor -- start 2023-10-08T00:30:10.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.906+0000 7fd809b22700 1 -- start start 2023-10-08T00:30:10.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.906+0000 7fd809b22700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd804153f50 0x7fd8040b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.906+0000 7fd809b22700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd804154320 0x7fd80406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd809b22700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd80415a190 0x7fd80406d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd809b22700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040b4570 con 0x7fd804154320 2023-10-08T00:30:10.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd809b22700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80415a730 con 0x7fd80415a190 2023-10-08T00:30:10.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd809b22700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415aa10 con 0x7fd804153f50 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd804154320 0x7fd80406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd804154320 0x7fd80406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33018/0 (socket says 172.21.15.22:33018) 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 -- 172.21.15.22:0/1933892468 learned_addr learned my addr 172.21.15.22:0/1933892468 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd803fff700 1 --2- 172.21.15.22:0/1933892468 >> v2:172.21.15.192:3300/0 conn(0x7fd80415a190 0x7fd80406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd8037fe700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd804153f50 0x7fd8040b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 -- 172.21.15.22:0/1933892468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd804153f50 msgr2=0x7fd8040b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:10.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd804153f50 0x7fd8040b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 -- 172.21.15.22:0/1933892468 >> v2:172.21.15.192:3300/0 conn(0x7fd80415a190 msgr2=0x7fd80406d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 --2- 172.21.15.22:0/1933892468 >> v2:172.21.15.192:3300/0 conn(0x7fd80415a190 0x7fd80406d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 -- 172.21.15.22:0/1933892468 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80415acf0 con 0x7fd804154320 2023-10-08T00:30:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd803fff700 1 --2- 172.21.15.22:0/1933892468 >> v2:172.21.15.192:3300/0 conn(0x7fd80415a190 0x7fd80406d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:10.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd8037fe700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd804153f50 0x7fd8040b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd802ffd700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd80406d130 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd8040cf1c0 tx=0x7fd7ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f4fdc9c2b334b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd8027fc700 1 -- 172.21.15.22:0/1933892468 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00b860 con 0x7fd804154320 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd8027fc700 1 -- 172.21.15.22:0/1933892468 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec00b9c0 con 0x7fd804154320 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.907+0000 7fd8027fc700 1 -- 172.21.15.22:0/1933892468 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00bd60 con 0x7fd804154320 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 -- 172.21.15.22:0/1933892468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 msgr2=0x7fd80406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd80406d130 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd8040cf1c0 tx=0x7fd7ec009250 comp rx=0 tx=0).stop 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 -- 172.21.15.22:0/1933892468 shutdown_connections 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 --2- 172.21.15.22:0/1933892468 >> v2:172.21.15.192:3300/0 conn(0x7fd80415a190 0x7fd80406d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd804153f50 0x7fd8040b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 --2- 172.21.15.22:0/1933892468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd80406d130 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 -- 172.21.15.22:0/1933892468 >> 172.21.15.22:0/1933892468 conn(0x7fd80406baf0 msgr2=0x7fd80406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:10.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 -- 172.21.15.22:0/1933892468 shutdown_connections 2023-10-08T00:30:10.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.908+0000 7fd809b22700 1 -- 172.21.15.22:0/1933892468 wait complete. 2023-10-08T00:30:10.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.909+0000 7fd809b22700 1 Processor -- start 2023-10-08T00:30:10.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.909+0000 7fd809b22700 1 -- start start 2023-10-08T00:30:10.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd809b22700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd804153f50 0x7fd804153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd809b22700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd8040ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd809b22700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd80415a190 0x7fd8040afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd809b22700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416b030 con 0x7fd804154320 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd809b22700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416ae10 con 0x7fd804153f50 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd809b22700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80416b230 con 0x7fd80415a190 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd8040ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd8040ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33024/0 (socket says 172.21.15.22:33024) 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 -- 172.21.15.22:0/3515545215 learned_addr learned my addr 172.21.15.22:0/3515545215 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd803fff700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd80415a190 0x7fd8040afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd8037fe700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd804153f50 0x7fd804153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 -- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd80415a190 msgr2=0x7fd8040afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:10.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd80415a190 0x7fd8040afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 -- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd804153f50 msgr2=0x7fd804153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd804153f50 0x7fd804153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd802ffd700 1 -- 172.21.15.22:0/3515545215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0094f0 con 0x7fd804154320 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.910+0000 7fd8037fe700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd804153f50 0x7fd804153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.911+0000 7fd802ffd700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd8040ce290 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009290 tx=0x7fd7ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.911+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec026480 con 0x7fd804154320 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.911+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec01f070 con 0x7fd804154320 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.911+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80416b510 con 0x7fd804154320 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.911+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec026830 con 0x7fd804154320 2023-10-08T00:30:10.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.911+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80416bad0 con 0x7fd804154320 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.912+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040718b0 con 0x7fd804154320 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.912+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd7ec026ba0 con 0x7fd804154320 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.912+0000 7fd7fb7fe700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067170 0x7fd7e4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.913+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fd7ec021070 con 0x7fd804154320 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.913+0000 7fd8037fe700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067170 0x7fd7e4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.913+0000 7fd8037fe700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067170 0x7fd7e4069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4006f00 tx=0x7fd7f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:10.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:10.917+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7ec0536d0 con 0x7fd804154320 2023-10-08T00:30:11.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.111+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd80415afd0 con 0x7fd804154320 2023-10-08T00:30:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.758+0000 7fd7fb7fe700 1 -- 172.21.15.22:0/3515545215 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v69) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd7ec056cf0 con 0x7fd804154320 2023-10-08T00:30:11.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067170 msgr2=0x7fd7e4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:11.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067170 0x7fd7e4069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4006f00 tx=0x7fd7f4008040 comp rx=0 tx=0).stop 2023-10-08T00:30:11.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 msgr2=0x7fd8040ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:11.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd8040ce290 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec009290 tx=0x7fd7ec017000 comp rx=0 tx=0).stop 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 shutdown_connections 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067170 0x7fd7e4069620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd80415a190 0x7fd8040afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd804153f50 0x7fd804153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 --2- 172.21.15.22:0/3515545215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd804154320 0x7fd8040ce290 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.763+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 >> 172.21.15.22:0/3515545215 conn(0x7fd80406baf0 msgr2=0x7fd8040ca0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:11.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.764+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 shutdown_connections 2023-10-08T00:30:11.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.765+0000 7fd809b22700 1 -- 172.21.15.22:0/3515545215 wait complete. 2023-10-08T00:30:11.772 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:30:11.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:30:11.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.911+0000 7fd7fc987700 1 Processor -- start 2023-10-08T00:30:11.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.911+0000 7fd7fc987700 1 -- start start 2023-10-08T00:30:11.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7fc987700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7fc987700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7fc987700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7f815db10 0x7fd7f8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7fc987700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f815a160 con 0x7fd7f8159890 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7fc987700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80d13a0 con 0x7fd7f815db10 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7fc987700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f815e140 con 0x7fd7f8159c60 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7f659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7f659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33030/0 (socket says 172.21.15.22:33030) 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.912+0000 7fd7f659c700 1 -- 172.21.15.22:0/2536514209 learned_addr learned my addr 172.21.15.22:0/2536514209 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f6d9d700 1 --2- 172.21.15.22:0/2536514209 >> v2:172.21.15.192:3300/0 conn(0x7fd7f815db10 0x7fd7f8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f5d9b700 1 --2- 172.21.15.22:0/2536514209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f659c700 1 -- 172.21.15.22:0/2536514209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 msgr2=0x7fd7f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:11.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f659c700 1 --2- 172.21.15.22:0/2536514209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f659c700 1 -- 172.21.15.22:0/2536514209 >> v2:172.21.15.192:3300/0 conn(0x7fd7f815db10 msgr2=0x7fd7f8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f659c700 1 --2- 172.21.15.22:0/2536514209 >> v2:172.21.15.192:3300/0 conn(0x7fd7f815db10 0x7fd7f8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f659c700 1 -- 172.21.15.22:0/2536514209 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f815a3d0 con 0x7fd7f8159890 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f6d9d700 1 --2- 172.21.15.22:0/2536514209 >> v2:172.21.15.192:3300/0 conn(0x7fd7f815db10 0x7fd7f8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f659c700 1 --2- 172.21.15.22:0/2536514209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f815abd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8089b50 tx=0x7fd7e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fca278aa2bf2d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f559a700 1 -- 172.21.15.22:0/2536514209 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800e070 con 0x7fd7f8159890 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f559a700 1 -- 172.21.15.22:0/2536514209 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e800ba50 con 0x7fd7f8159890 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.913+0000 7fd7f559a700 1 -- 172.21.15.22:0/2536514209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80092e0 con 0x7fd7f8159890 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 -- 172.21.15.22:0/2536514209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 msgr2=0x7fd7f815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 --2- 172.21.15.22:0/2536514209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f815abd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8089b50 tx=0x7fd7e8009840 comp rx=0 tx=0).stop 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 -- 172.21.15.22:0/2536514209 shutdown_connections 2023-10-08T00:30:11.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 --2- 172.21.15.22:0/2536514209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 --2- 172.21.15.22:0/2536514209 >> v2:172.21.15.192:3300/0 conn(0x7fd7f815db10 0x7fd7f8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 --2- 172.21.15.22:0/2536514209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 -- 172.21.15.22:0/2536514209 >> 172.21.15.22:0/2536514209 conn(0x7fd7f8068e20 msgr2=0x7fd7f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:11.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 -- 172.21.15.22:0/2536514209 shutdown_connections 2023-10-08T00:30:11.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.914+0000 7fd7fc987700 1 -- 172.21.15.22:0/2536514209 wait complete. 2023-10-08T00:30:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.915+0000 7fd7fc987700 1 Processor -- start 2023-10-08T00:30:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.915+0000 7fd7fc987700 1 -- start start 2023-10-08T00:30:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.915+0000 7fd7fc987700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f80c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f815db10 0x7fd7f80ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b3590 con 0x7fd7f8159890 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b3870 con 0x7fd7f815db10 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b3b50 con 0x7fd7f8159c60 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f814d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33032/0 (socket says 172.21.15.22:33032) 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 -- 172.21.15.22:0/1310164573 learned_addr learned my addr 172.21.15.22:0/1310164573 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f6d9d700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f815db10 0x7fd7f80ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 -- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 msgr2=0x7fd7f80c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f5d9b700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f80c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f80c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 -- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f815db10 msgr2=0x7fd7f80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f815db10 0x7fd7f80ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 -- 172.21.15.22:0/1310164573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8009ae0 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f6d9d700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f815db10 0x7fd7f80ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f5d9b700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f80c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7f659c700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f814d1b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8070e20 tx=0x7fd7e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8008b70 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8008d10 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f80b3e30 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80266b0 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.916+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f815d440 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.917+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f80b4350 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.918+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd7e8003040 con 0x7fd7f8159890 2023-10-08T00:30:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.918+0000 7fd7ee7fc700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7d80671a0 0x7fd7d8069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:11.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.918+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd7e8085ef0 con 0x7fd7f8159890 2023-10-08T00:30:11.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.918+0000 7fd7f5d9b700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7d80671a0 0x7fd7d8069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:11.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.919+0000 7fd7f5d9b700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7d80671a0 0x7fd7d8069650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd7f81511d0 tx=0x7fd7e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:11.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:11.922+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7f80b4350 con 0x7fd7f8159890 2023-10-08T00:30:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.117+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd7f80b4350 con 0x7fd7f8159890 2023-10-08T00:30:12.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.120+0000 7fd7ee7fc700 1 -- 172.21.15.22:0/1310164573 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd7f80b4350 con 0x7fd7f8159890 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7d80671a0 msgr2=0x7fd7d8069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7d80671a0 0x7fd7d8069650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd7f81511d0 tx=0x7fd7e0008040 comp rx=0 tx=0).stop 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 msgr2=0x7fd7f814d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f814d1b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8070e20 tx=0x7fd7e8018000 comp rx=0 tx=0).stop 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 shutdown_connections 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f815db10 0x7fd7f80ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8159890 0x7fd7f814d1b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7d80671a0 0x7fd7d8069650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 --2- 172.21.15.22:0/1310164573 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159c60 0x7fd7f80c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 >> 172.21.15.22:0/1310164573 conn(0x7fd7f8068e20 msgr2=0x7fd7f80c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 shutdown_connections 2023-10-08T00:30:12.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.122+0000 7fd7fc987700 1 -- 172.21.15.22:0/1310164573 wait complete. 2023-10-08T00:30:12.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-08T00:30:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.254+0000 7f8d5c9cc700 1 Processor -- start 2023-10-08T00:30:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.254+0000 7f8d5c9cc700 1 -- start start 2023-10-08T00:30:12.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5c9cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806bcd0 0x7f8d580caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5c9cc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d5806c0a0 0x7f8d5815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5c9cc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d5815df50 0x7f8d5815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5c9cc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5815d7e0 con 0x7f8d5806c0a0 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5c9cc700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5815dac0 con 0x7f8d5815df50 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5c9cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5815aa30 con 0x7f8d5806bcd0 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d5806c0a0 0x7f8d5815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d5806c0a0 0x7f8d5815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33034/0 (socket says 172.21.15.22:33034) 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 -- 172.21.15.22:0/4116449380 learned_addr learned my addr 172.21.15.22:0/4116449380 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d5659c700 1 --2- 172.21.15.22:0/4116449380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806bcd0 0x7f8d580caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d56d9d700 1 --2- 172.21.15.22:0/4116449380 >> v2:172.21.15.192:3300/0 conn(0x7f8d5815df50 0x7f8d5815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 -- 172.21.15.22:0/4116449380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806bcd0 msgr2=0x7f8d580caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:12.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 --2- 172.21.15.22:0/4116449380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806bcd0 0x7f8d580caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 -- 172.21.15.22:0/4116449380 >> v2:172.21.15.192:3300/0 conn(0x7f8d5815df50 msgr2=0x7f8d5815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 --2- 172.21.15.22:0/4116449380 >> v2:172.21.15.192:3300/0 conn(0x7f8d5815df50 0x7f8d5815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 -- 172.21.15.22:0/4116449380 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5815ad10 con 0x7f8d5806c0a0 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.255+0000 7f8d55d9b700 1 --2- 172.21.15.22:0/4116449380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5806c0a0 0x7f8d5815a1e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8d5806b620 tx=0x7f8d4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9004c5889278523a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5559a700 1 -- 172.21.15.22:0/4116449380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00b860 con 0x7f8d5806c0a0 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5559a700 1 -- 172.21.15.22:0/4116449380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c00b9c0 con 0x7f8d5806c0a0 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5559a700 1 -- 172.21.15.22:0/4116449380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00bd80 con 0x7f8d5806c0a0 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/4116449380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5806c0a0 msgr2=0x7f8d5815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/4116449380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5806c0a0 0x7f8d5815a1e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8d5806b620 tx=0x7f8d4c009250 comp rx=0 tx=0).stop 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/4116449380 shutdown_connections 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/4116449380 >> v2:172.21.15.192:3300/0 conn(0x7f8d5815df50 0x7f8d5815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/4116449380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806bcd0 0x7f8d580caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/4116449380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5806c0a0 0x7f8d5815a1e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/4116449380 >> 172.21.15.22:0/4116449380 conn(0x7f8d580ce600 msgr2=0x7f8d580cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:12.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/4116449380 shutdown_connections 2023-10-08T00:30:12.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.256+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/4116449380 wait complete. 2023-10-08T00:30:12.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.257+0000 7f8d5c9cc700 1 Processor -- start 2023-10-08T00:30:12.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.257+0000 7f8d5c9cc700 1 -- start start 2023-10-08T00:30:12.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5c9cc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d5806bcd0 0x7f8d580c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5c9cc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806c0a0 0x7f8d581432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5c9cc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 0x7f8d58143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5c9cc700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580c88b0 con 0x7f8d5815df50 2023-10-08T00:30:12.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5c9cc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58142fe0 con 0x7f8d5806bcd0 2023-10-08T00:30:12.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5c9cc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580c7ca0 con 0x7f8d5806c0a0 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 0x7f8d58143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 0x7f8d58143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33050/0 (socket says 172.21.15.22:33050) 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 -- 172.21.15.22:0/2211053868 learned_addr learned my addr 172.21.15.22:0/2211053868 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d5659c700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d5806bcd0 0x7f8d580c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d55d9b700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806c0a0 0x7f8d581432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 -- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806c0a0 msgr2=0x7f8d581432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806c0a0 0x7f8d581432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 -- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d5806bcd0 msgr2=0x7f8d580c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d5806bcd0 0x7f8d580c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.258+0000 7f8d56d9d700 1 -- 172.21.15.22:0/2211053868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0094f0 con 0x7f8d5815df50 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.259+0000 7f8d56d9d700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 0x7f8d58143810 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009fa0 tx=0x7f8d50009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.259+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000ebc0 con 0x7f8d5815df50 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.259+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5000ed20 con 0x7f8d5815df50 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.259+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d580c7f80 con 0x7f8d5815df50 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.259+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50014670 con 0x7f8d5815df50 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.259+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d580c8540 con 0x7f8d5815df50 2023-10-08T00:30:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.260+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d580c8a20 con 0x7f8d5815df50 2023-10-08T00:30:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.260+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8d500149e0 con 0x7f8d5815df50 2023-10-08T00:30:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.261+0000 7f8d467fc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d38067170 0x7f8d38069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.261+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8d50084cb0 con 0x7f8d5815df50 2023-10-08T00:30:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.261+0000 7f8d5659c700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d38067170 0x7f8d38069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.261+0000 7f8d5659c700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d38067170 0x7f8d38069620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006fd0 tx=0x7f8d48008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.265+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d50051ef0 con 0x7f8d5815df50 2023-10-08T00:30:12.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.542+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f8d5804c3c0 con 0x7f8d5815df50 2023-10-08T00:30:12.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.764+0000 7f8d467fc700 1 -- 172.21.15.22:0/2211053868 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v244) v1 ==== 158+0+0 (secure 0 0 0) 0x7f8d50055510 con 0x7f8d5815df50 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d38067170 msgr2=0x7f8d38069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d38067170 0x7f8d38069620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8d48006fd0 tx=0x7f8d48008040 comp rx=0 tx=0).stop 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 msgr2=0x7f8d58143810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 0x7f8d58143810 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009fa0 tx=0x7f8d50009900 comp rx=0 tx=0).stop 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 shutdown_connections 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d5815df50 0x7f8d58143810 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d5806bcd0 0x7f8d580c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d38067170 0x7f8d38069620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 --2- 172.21.15.22:0/2211053868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d5806c0a0 0x7f8d581432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 >> 172.21.15.22:0/2211053868 conn(0x7f8d580ce600 msgr2=0x7f8d581570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:12.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 shutdown_connections 2023-10-08T00:30:12.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.766+0000 7f8d5c9cc700 1 -- 172.21.15.22:0/2211053868 wait complete. 2023-10-08T00:30:12.781 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ok 2023-10-08T00:30:12.781 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command 2023-10-08T00:30:12.781 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:30:12.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-08T00:30:12.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.899+0000 7f86f0c77700 1 Processor -- start 2023-10-08T00:30:12.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.899+0000 7f86f0c77700 1 -- start start 2023-10-08T00:30:12.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.900+0000 7f86f0c77700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86ec159c60 0x7f86ec15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.900+0000 7f86f0c77700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86ec15db10 0x7f86ec069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.900+0000 7f86f0c77700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec15a160 con 0x7f86ec159890 2023-10-08T00:30:12.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.900+0000 7f86f0c77700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec15df50 con 0x7f86ec15db10 2023-10-08T00:30:12.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.900+0000 7f86f0c77700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec0d13a0 con 0x7f86ec159c60 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.900+0000 7f86ead9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86ec15db10 0x7f86ec069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ea59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f86ec159890 0x7f86ec15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34246/0 (socket says 172.21.15.22:34246) 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ea59c700 1 -- 172.21.15.22:0/913795925 learned_addr learned my addr 172.21.15.22:0/913795925 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86e9d9b700 1 --2- 172.21.15.22:0/913795925 >> v2:172.21.15.192:3300/0 conn(0x7f86ec159c60 0x7f86ec15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86e959a700 1 -- 172.21.15.22:0/913795925 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659509551 0 0) 0x7f86ec15a160 con 0x7f86ec159890 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86e959a700 1 -- 172.21.15.22:0/913795925 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d8003570 con 0x7f86ec159890 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ead9d700 1 -- 172.21.15.22:0/913795925 >> v2:172.21.15.192:3300/0 conn(0x7f86ec159c60 msgr2=0x7f86ec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ead9d700 1 --2- 172.21.15.22:0/913795925 >> v2:172.21.15.192:3300/0 conn(0x7f86ec159c60 0x7f86ec15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ead9d700 1 -- 172.21.15.22:0/913795925 >> v1:172.21.15.22:6789/0 conn(0x7f86ec159890 legacy=0x7f86ec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ead9d700 1 -- 172.21.15.22:0/913795925 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec15e140 con 0x7f86ec15db10 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86ead9d700 1 --2- 172.21.15.22:0/913795925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec15db10 0x7f86ec069560 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0b67f0 tx=0x7f86e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf05958f3328cd2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:12.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86e959a700 1 -- 172.21.15.22:0/913795925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4011630 con 0x7f86ec15db10 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86e959a700 1 -- 172.21.15.22:0/913795925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4011790 con 0x7f86ec15db10 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.901+0000 7f86e959a700 1 -- 172.21.15.22:0/913795925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4011b50 con 0x7f86ec15db10 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 -- 172.21.15.22:0/913795925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec15db10 msgr2=0x7f86ec069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 --2- 172.21.15.22:0/913795925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec15db10 0x7f86ec069560 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0b67f0 tx=0x7f86e40091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 -- 172.21.15.22:0/913795925 shutdown_connections 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 --2- 172.21.15.22:0/913795925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec15db10 0x7f86ec069560 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 --2- 172.21.15.22:0/913795925 >> v2:172.21.15.192:3300/0 conn(0x7f86ec159c60 0x7f86ec15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 -- 172.21.15.22:0/913795925 >> 172.21.15.22:0/913795925 conn(0x7f86ec068e20 msgr2=0x7f86ec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 -- 172.21.15.22:0/913795925 shutdown_connections 2023-10-08T00:30:12.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.902+0000 7f86f0c77700 1 -- 172.21.15.22:0/913795925 wait complete. 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.903+0000 7f86f0c77700 1 Processor -- start 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.903+0000 7f86f0c77700 1 -- start start 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 0x7f86ec14f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86ec159c60 0x7f86ec0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86ec15db10 0x7f86ec0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0cea00 con 0x7f86ec159890 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0cee90 con 0x7f86ec15db10 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0cddf0 con 0x7f86ec159c60 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 0x7f86ec14f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 0x7f86ec14f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33070/0 (socket says 172.21.15.22:33070) 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 -- 172.21.15.22:0/1137490992 learned_addr learned my addr 172.21.15.22:0/1137490992 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ead9d700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86ec15db10 0x7f86ec0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86e9d9b700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86ec159c60 0x7f86ec0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 -- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86ec159c60 msgr2=0x7f86ec0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86ec159c60 0x7f86ec0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 -- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86ec15db10 msgr2=0x7f86ec0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86ec15db10 0x7f86ec0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 -- 172.21.15.22:0/1137490992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4009420 con 0x7f86ec159890 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ead9d700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86ec15db10 0x7f86ec0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86e9d9b700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86ec159c60 0x7f86ec0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86ea59c700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 0x7f86ec14f730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00cd30 tx=0x7f86dc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:12.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00ab70 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00acf0 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec0ce0d0 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.904+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007340 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.905+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec0ce690 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.905+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec04c3c0 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.906+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f86dc007770 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.906+0000 7f86e27fc700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f86cc067170 0x7f86cc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.906+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f86dc084a80 con 0x7f86ec159890 2023-10-08T00:30:12.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.907+0000 7f86e9d9b700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f86cc067170 0x7f86cc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:12.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.907+0000 7f86e9d9b700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f86cc067170 0x7f86cc069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006f00 tx=0x7f86d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:12.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:12.910+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86dc051de0 con 0x7f86ec159890 2023-10-08T00:30:13.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.184+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f86ec06a5b0 con 0x7f86ec159890 2023-10-08T00:30:13.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.765+0000 7f86e27fc700 1 -- 172.21.15.22:0/1137490992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v245) v1 ==== 161+0+0 (secure 0 0 0) 0x7f86dc00ae60 con 0x7f86ec159890 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f86cc067170 msgr2=0x7f86cc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f86cc067170 0x7f86cc069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006f00 tx=0x7f86d4008040 comp rx=0 tx=0).stop 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 msgr2=0x7f86ec14f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 0x7f86ec14f730 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00cd30 tx=0x7f86dc001b10 comp rx=0 tx=0).stop 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 shutdown_connections 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86ec15db10 0x7f86ec0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86ec159890 0x7f86ec14f730 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f86cc067170 0x7f86cc069620 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 --2- 172.21.15.22:0/1137490992 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f86ec159c60 0x7f86ec0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:13.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 >> 172.21.15.22:0/1137490992 conn(0x7f86ec068e20 msgr2=0x7f86ec1523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:13.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 shutdown_connections 2023-10-08T00:30:13.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.769+0000 7f86f0c77700 1 -- 172.21.15.22:0/1137490992 wait complete. 2023-10-08T00:30:13.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:30:13.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.909+0000 7fec91c20700 1 Processor -- start 2023-10-08T00:30:14.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.909+0000 7fec91c20700 1 -- start start 2023-10-08T00:30:14.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec91c20700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec8c069560 0x7fec8c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec91c20700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c069ee0 con 0x7fec8c159890 2023-10-08T00:30:14.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec91c20700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c15a160 con 0x7fec8c159c60 2023-10-08T00:30:14.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec91c20700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c0d13a0 con 0x7fec8c069560 2023-10-08T00:30:14.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec8b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fec8c159890 0x7fec8c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34248/0 (socket says 172.21.15.22:34248) 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec8b7fe700 1 -- 172.21.15.22:0/2427101344 learned_addr learned my addr 172.21.15.22:0/2427101344 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.910+0000 7fec8bfff700 1 --2- 172.21.15.22:0/2427101344 >> v2:172.21.15.22:3300/0 conn(0x7fec8c069560 0x7fec8c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8bfff700 1 -- 172.21.15.22:0/2427101344 >> v1:172.21.15.192:6789/0 conn(0x7fec8c159c60 legacy=0x7fec8c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8bfff700 1 -- 172.21.15.22:0/2427101344 >> v1:172.21.15.22:6789/0 conn(0x7fec8c159890 legacy=0x7fec8c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8bfff700 1 -- 172.21.15.22:0/2427101344 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c15e140 con 0x7fec8c069560 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8bfff700 1 --2- 172.21.15.22:0/2427101344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0699a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fec84009e60 tx=0x7fec84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31c2ef8b231823e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8a7fc700 1 -- 172.21.15.22:0/2427101344 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400e070 con 0x7fec8c069560 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8a7fc700 1 -- 172.21.15.22:0/2427101344 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8400bbf0 con 0x7fec8c069560 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec8a7fc700 1 -- 172.21.15.22:0/2427101344 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84012430 con 0x7fec8c069560 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec91c20700 1 -- 172.21.15.22:0/2427101344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 msgr2=0x7fec8c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec91c20700 1 --2- 172.21.15.22:0/2427101344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0699a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fec84009e60 tx=0x7fec84009780 comp rx=0 tx=0).stop 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec91c20700 1 -- 172.21.15.22:0/2427101344 shutdown_connections 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec91c20700 1 --2- 172.21.15.22:0/2427101344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0699a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.911+0000 7fec91c20700 1 -- 172.21.15.22:0/2427101344 >> 172.21.15.22:0/2427101344 conn(0x7fec8c068e20 msgr2=0x7fec8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.912+0000 7fec91c20700 1 -- 172.21.15.22:0/2427101344 shutdown_connections 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.912+0000 7fec91c20700 1 -- 172.21.15.22:0/2427101344 wait complete. 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 Processor -- start 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 -- start start 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec8c159890 0x7fec8c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec8c159c60 0x7fec8c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b5b40 con 0x7fec8c069560 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b3ad0 con 0x7fec8c159890 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.913+0000 7fec91c20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b5de0 con 0x7fec8c159c60 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33088/0 (socket says 172.21.15.22:33088) 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 -- 172.21.15.22:0/1645621477 learned_addr learned my addr 172.21.15.22:0/1645621477 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8affd700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec8c159890 0x7fec8c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8bfff700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec8c159c60 0x7fec8c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 -- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec8c159c60 msgr2=0x7fec8c15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec8c159c60 0x7fec8c15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 -- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec8c159890 msgr2=0x7fec8c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec8c159890 0x7fec8c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 -- 172.21.15.22:0/1645621477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84009a20 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8affd700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec8c159890 0x7fec8c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec8b7fe700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0cd0c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00c7c0 tx=0x7fec7c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c005b30 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c005c90 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c0b60c0 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c007320 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.914+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c15c540 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.915+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c04c3c0 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.916+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fec7c007690 con 0x7fec8c069560 2023-10-08T00:30:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.916+0000 7fec737fe700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec78067170 0x7fec78069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.916+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fec7c083a80 con 0x7fec8c069560 2023-10-08T00:30:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.916+0000 7fec8affd700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec78067170 0x7fec78069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.917+0000 7fec8affd700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec78067170 0x7fec78069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec80006fd0 tx=0x7fec80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:13.921+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec7c050d60 con 0x7fec8c069560 2023-10-08T00:30:14.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.114+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fec8c06a5b0 con 0x7fec8c069560 2023-10-08T00:30:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.117+0000 7fec737fe700 1 -- 172.21.15.22:0/1645621477 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fec7c017070 con 0x7fec8c069560 2023-10-08T00:30:14.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec78067170 msgr2=0x7fec78069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec78067170 0x7fec78069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec80006fd0 tx=0x7fec80008040 comp rx=0 tx=0).stop 2023-10-08T00:30:14.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 msgr2=0x7fec8c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0cd0c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00c7c0 tx=0x7fec7c007f30 comp rx=0 tx=0).stop 2023-10-08T00:30:14.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 shutdown_connections 2023-10-08T00:30:14.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec78067170 0x7fec78069620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec8c159c60 0x7fec8c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec8c069560 0x7fec8c0cd0c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 --2- 172.21.15.22:0/1645621477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec8c159890 0x7fec8c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 >> 172.21.15.22:0/1645621477 conn(0x7fec8c068e20 msgr2=0x7fec8c153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 shutdown_connections 2023-10-08T00:30:14.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.119+0000 7fec91c20700 1 -- 172.21.15.22:0/1645621477 wait complete. 2023-10-08T00:30:14.133 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:30:14.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:14.173 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:14.217 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:30:14.218 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:30:14.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.335+0000 7f20226f7700 1 Processor -- start 2023-10-08T00:30:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.335+0000 7f20226f7700 1 -- start start 2023-10-08T00:30:14.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f20226f7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f201c159890 0x7f201c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f20226f7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f201c069560 0x7f201c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f20226f7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c069ee0 con 0x7f201c159c60 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f20226f7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c15a160 con 0x7f201c069560 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f20226f7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0d13a0 con 0x7f201c159890 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f2020c94700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f201c069560 0x7f201c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f2020c94700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f201c069560 0x7f201c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33100/0 (socket says 172.21.15.22:33100) 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.336+0000 7f2020c94700 1 -- 172.21.15.22:0/2465527248 learned_addr learned my addr 172.21.15.22:0/2465527248 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f201bfff700 1 --2- 172.21.15.22:0/2465527248 >> v2:172.21.15.192:3300/0 conn(0x7f201c159890 0x7f201c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f2020c94700 1 -- 172.21.15.22:0/2465527248 >> v2:172.21.15.192:3300/0 conn(0x7f201c159890 msgr2=0x7f201c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f2020c94700 1 --2- 172.21.15.22:0/2465527248 >> v2:172.21.15.192:3300/0 conn(0x7f201c159890 0x7f201c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f2020c94700 1 -- 172.21.15.22:0/2465527248 >> v1:172.21.15.192:6789/0 conn(0x7f201c159c60 legacy=0x7f201c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f2020c94700 1 -- 172.21.15.22:0/2465527248 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c15e140 con 0x7f201c069560 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f2020c94700 1 --2- 172.21.15.22:0/2465527248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c069560 0x7f201c0699a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f201c0d1090 tx=0x7f2014009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b94e9c9acae5056 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f201affd700 1 -- 172.21.15.22:0/2465527248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400e070 con 0x7f201c069560 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f201affd700 1 -- 172.21.15.22:0/2465527248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400ba10 con 0x7f201c069560 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.337+0000 7f201affd700 1 -- 172.21.15.22:0/2465527248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20140092e0 con 0x7f201c069560 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 -- 172.21.15.22:0/2465527248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c069560 msgr2=0x7f201c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 --2- 172.21.15.22:0/2465527248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c069560 0x7f201c0699a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f201c0d1090 tx=0x7f2014009840 comp rx=0 tx=0).stop 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 -- 172.21.15.22:0/2465527248 shutdown_connections 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 --2- 172.21.15.22:0/2465527248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c069560 0x7f201c0699a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 --2- 172.21.15.22:0/2465527248 >> v2:172.21.15.192:3300/0 conn(0x7f201c159890 0x7f201c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 -- 172.21.15.22:0/2465527248 >> 172.21.15.22:0/2465527248 conn(0x7f201c068e20 msgr2=0x7f201c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 -- 172.21.15.22:0/2465527248 shutdown_connections 2023-10-08T00:30:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.338+0000 7f20226f7700 1 -- 172.21.15.22:0/2465527248 wait complete. 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.339+0000 7f20226f7700 1 Processor -- start 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.339+0000 7f20226f7700 1 -- start start 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f201c069560 0x7f201c16a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 0x7f201c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f201c159c60 0x7f201c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15d420 con 0x7f201c159890 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15b9b0 con 0x7f201c069560 2023-10-08T00:30:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c15bc90 con 0x7f201c159c60 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 0x7f201c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 0x7f201c14d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33112/0 (socket says 172.21.15.22:33112) 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 -- 172.21.15.22:0/478130580 learned_addr learned my addr 172.21.15.22:0/478130580 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201bfff700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f201c069560 0x7f201c16a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f2020c94700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f201c159c60 0x7f201c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 -- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f201c159c60 msgr2=0x7f201c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f201c159c60 0x7f201c1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 -- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f201c069560 msgr2=0x7f201c16a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f201c069560 0x7f201c16a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 -- 172.21.15.22:0/478130580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009ae0 con 0x7f201c159890 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f2020c94700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f201c159c60 0x7f201c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:14.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f201b7fe700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 0x7f201c14d250 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b5e0 tx=0x7f200c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00f510 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00f670 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c15bf70 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00fa30 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.340+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c15c530 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.341+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c15c750 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.342+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f200c01a400 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.342+0000 7f2013fff700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ffc067170 0x7f1ffc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.342+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f200c084010 con 0x7f201c159890 2023-10-08T00:30:14.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.343+0000 7f201bfff700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ffc067170 0x7f1ffc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.343+0000 7f201bfff700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ffc067170 0x7f1ffc069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f200400acb0 tx=0x7f2004008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.346+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f200c054e00 con 0x7f201c159890 2023-10-08T00:30:14.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.584+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f201c04c3c0 con 0x7f201c159890 2023-10-08T00:30:14.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.584+0000 7f2013fff700 1 -- 172.21.15.22:0/478130580 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f200c054990 con 0x7f201c159890 2023-10-08T00:30:14.586 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:14.586 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2610217113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2610217113},{"type":"v1","addr":"172.21.15.192:6835","nonce":2610217113}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5458,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/59547825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":59547825},{"type":"v1","addr":"172.21.15.192:6837","nonce":59547825}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":5706,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/561423512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":561423512},{"type":"v1","addr":"172.21.15.22:6833","nonce":561423512}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6072,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2988530039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2988530039},{"type":"v1","addr":"172.21.15.22:6835","nonce":2988530039}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[]} 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ffc067170 msgr2=0x7f1ffc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ffc067170 0x7f1ffc069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f200400acb0 tx=0x7f2004008040 comp rx=0 tx=0).stop 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 msgr2=0x7f201c14d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 0x7f201c14d250 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b5e0 tx=0x7f200c0090f0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 shutdown_connections 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ffc067170 0x7f1ffc069620 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f201c159c60 0x7f201c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f201c069560 0x7f201c16a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 --2- 172.21.15.22:0/478130580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c159890 0x7f201c14d250 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 >> 172.21.15.22:0/478130580 conn(0x7f201c068e20 msgr2=0x7f201c0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:14.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 shutdown_connections 2023-10-08T00:30:14.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.586+0000 7f20226f7700 1 -- 172.21.15.22:0/478130580 wait complete. 2023-10-08T00:30:14.589 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 45 2023-10-08T00:30:14.600 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:30:14.600 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:30:14.601 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:30:14.601 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:14.601 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:30:14.601 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:30:14.601 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:30:14.601 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:14.602 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:30:14.602 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:30:14.602 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:30:14.602 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:14.602 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:30:14.602 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:30:14.602 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:30:14.603 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:14.610 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:30:14.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:30:14.611 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:30:14.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:30:14.613 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:30:14.613 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:30:14.614 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:30:14.614 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:30:14.652 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:30:14.653 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:14.653 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:30:14.653 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:14.655 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:30:14.655 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:14.656 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:30:14.656 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:14.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:30:14.728 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:30:14.729 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:30:14.735 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:30:14.735 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:30:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.785+0000 7fa865973700 1 Processor -- start 2023-10-08T00:30:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.785+0000 7fa865973700 1 -- start start 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa865973700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159c60 0x7fa86015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa865973700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa86015db10 0x7fa860069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa865973700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86015a160 con 0x7fa860159890 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa865973700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600d13a0 con 0x7fa86015db10 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa865973700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015e140 con 0x7fa860159c60 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa86015db10 0x7fa860069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa86015db10 0x7fa860069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33146/0 (socket says 172.21.15.22:33146) 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 -- 172.21.15.22:0/4069906138 learned_addr learned my addr 172.21.15.22:0/4069906138 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85e7fc700 1 --2- 172.21.15.22:0/4069906138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159c60 0x7fa86015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 -- 172.21.15.22:0/4069906138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159c60 msgr2=0x7fa86015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 --2- 172.21.15.22:0/4069906138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159c60 0x7fa86015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 -- 172.21.15.22:0/4069906138 >> v1:172.21.15.192:6789/0 conn(0x7fa860159890 legacy=0x7fa86015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 -- 172.21.15.22:0/4069906138 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86015a3d0 con 0x7fa86015db10 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85f7fe700 1 --2- 172.21.15.22:0/4069906138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa860069560 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa858009f20 tx=0x7fa858009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeed403678a264 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85dffb700 1 -- 172.21.15.22:0/4069906138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800e070 con 0x7fa86015db10 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85dffb700 1 -- 172.21.15.22:0/4069906138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85800b9d0 con 0x7fa86015db10 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.786+0000 7fa85dffb700 1 -- 172.21.15.22:0/4069906138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580092e0 con 0x7fa86015db10 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 -- 172.21.15.22:0/4069906138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 msgr2=0x7fa860069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 --2- 172.21.15.22:0/4069906138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa860069560 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa858009f20 tx=0x7fa858009840 comp rx=0 tx=0).stop 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 -- 172.21.15.22:0/4069906138 shutdown_connections 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 --2- 172.21.15.22:0/4069906138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa860069560 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 --2- 172.21.15.22:0/4069906138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159c60 0x7fa86015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 -- 172.21.15.22:0/4069906138 >> 172.21.15.22:0/4069906138 conn(0x7fa860068e20 msgr2=0x7fa8600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 -- 172.21.15.22:0/4069906138 shutdown_connections 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.787+0000 7fa865973700 1 -- 172.21.15.22:0/4069906138 wait complete. 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.788+0000 7fa865973700 1 Processor -- start 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.788+0000 7fa865973700 1 -- start start 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa865973700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159890 0x7fa8600b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa865973700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa860159c60 0x7fa86016d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa865973700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa8600cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa865973700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86016e450 con 0x7fa86015db10 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa865973700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b0c50 con 0x7fa860159c60 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa865973700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600b0f30 con 0x7fa860159890 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa8600cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa8600cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33154/0 (socket says 172.21.15.22:33154) 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 -- 172.21.15.22:0/1325745191 learned_addr learned my addr 172.21.15.22:0/1325745191 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85e7fc700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa860159c60 0x7fa86016d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85effd700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159890 0x7fa8600b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 -- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159890 msgr2=0x7fa8600b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159890 0x7fa8600b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 -- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa860159c60 msgr2=0x7fa86016d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:14.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa860159c60 0x7fa86016d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.789+0000 7fa85f7fe700 1 -- 172.21.15.22:0/1325745191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009ae0 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.790+0000 7fa85f7fe700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa8600cdce0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa85800b610 tx=0x7fa858018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.790+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858008ad0 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.790+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858008c30 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.790+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85801c410 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.790+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600b1210 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.790+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8600b17d0 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.791+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600b1990 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.791+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa858003040 con 0x7fa86015db10 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.791+0000 7fa846ffd700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa84c067170 0x7fa84c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:14.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.792+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa8580861a0 con 0x7fa86015db10 2023-10-08T00:30:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.792+0000 7fa85effd700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa84c067170 0x7fa84c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.792+0000 7fa85effd700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa84c067170 0x7fa84c069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa850003a80 tx=0x7fa850007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:14.796+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa858053370 con 0x7fa86015db10 2023-10-08T00:30:14.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T00:30:15.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.003+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa86004c3c0 con 0x7fa86015db10 2023-10-08T00:30:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.781+0000 7fa846ffd700 1 -- 172.21.15.22:0/1325745191 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v74) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa858056990 con 0x7fa86015db10 2023-10-08T00:30:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa84c067170 msgr2=0x7fa84c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa84c067170 0x7fa84c069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa850003a80 tx=0x7fa850007ec0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 msgr2=0x7fa8600cdce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa8600cdce0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa85800b610 tx=0x7fa858018000 comp rx=0 tx=0).stop 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 shutdown_connections 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa86015db10 0x7fa8600cdce0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa84c067170 0x7fa84c069620 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa860159890 0x7fa8600b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 --2- 172.21.15.22:0/1325745191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa860159c60 0x7fa86016d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.783+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 >> 172.21.15.22:0/1325745191 conn(0x7fa860068e20 msgr2=0x7fa860153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.784+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 shutdown_connections 2023-10-08T00:30:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.784+0000 7fa865973700 1 -- 172.21.15.22:0/1325745191 wait complete. 2023-10-08T00:30:15.786 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:30:15.799 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:30:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.924+0000 7f17dda2d700 1 Processor -- start 2023-10-08T00:30:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.924+0000 7f17dda2d700 1 -- start start 2023-10-08T00:30:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17dda2d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f17d80cc260 0x7f17d806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17dda2d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d80ca490 con 0x7f17d8159c90 2023-10-08T00:30:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17dda2d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d80cca40 con 0x7f17d81598c0 2023-10-08T00:30:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17dda2d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d806a6a0 con 0x7f17d80cc260 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17d67fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f17d80cc260 0x7f17d806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17d77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f17d8159c90 0x7f17d8163650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34260/0 (socket says 172.21.15.22:34260) 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.925+0000 7f17d77fe700 1 -- 172.21.15.22:0/2498564900 learned_addr learned my addr 172.21.15.22:0/2498564900 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d67fc700 1 -- 172.21.15.22:0/2498564900 >> v1:172.21.15.192:6789/0 conn(0x7f17d81598c0 legacy=0x7f17d806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d67fc700 1 -- 172.21.15.22:0/2498564900 >> v1:172.21.15.22:6789/0 conn(0x7f17d8159c90 legacy=0x7f17d8163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d67fc700 1 -- 172.21.15.22:0/2498564900 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80cc760 con 0x7f17d80cc260 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d5ffb700 1 -- 172.21.15.22:0/2498564900 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699800846 0 0) 0x7f17d80ca490 con 0x7f17d8159c90 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d67fc700 1 --2- 172.21.15.22:0/2498564900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d806d130 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0098e0 tx=0x7f17cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7514a68969324096 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d5ffb700 1 -- 172.21.15.22:0/2498564900 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc009e80 con 0x7f17d80cc260 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d5ffb700 1 -- 172.21.15.22:0/2498564900 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00b860 con 0x7f17d80cc260 2023-10-08T00:30:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17d5ffb700 1 -- 172.21.15.22:0/2498564900 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00bbe0 con 0x7f17d80cc260 2023-10-08T00:30:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17dda2d700 1 -- 172.21.15.22:0/2498564900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 msgr2=0x7f17d806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2498564900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d806d130 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0098e0 tx=0x7f17cc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17dda2d700 1 -- 172.21.15.22:0/2498564900 shutdown_connections 2023-10-08T00:30:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.926+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2498564900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d806d130 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.927+0000 7f17dda2d700 1 -- 172.21.15.22:0/2498564900 >> 172.21.15.22:0/2498564900 conn(0x7f17d806baa0 msgr2=0x7f17d806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.927+0000 7f17dda2d700 1 -- 172.21.15.22:0/2498564900 shutdown_connections 2023-10-08T00:30:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.927+0000 7f17dda2d700 1 -- 172.21.15.22:0/2498564900 wait complete. 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.928+0000 7f17dda2d700 1 Processor -- start 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.928+0000 7f17dda2d700 1 -- start start 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.928+0000 7f17dda2d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d80c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.928+0000 7f17dda2d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17d81598c0 0x7f17d815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.928+0000 7f17dda2d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17d8159c90 0x7f17d814c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.928+0000 7f17dda2d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d815b9c0 con 0x7f17d80cc260 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17dda2d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d815c800 con 0x7f17d81598c0 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17dda2d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d815bbf0 con 0x7f17d8159c90 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d80c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d80c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33172/0 (socket says 172.21.15.22:33172) 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 -- 172.21.15.22:0/2196628844 learned_addr learned my addr 172.21.15.22:0/2196628844 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d77fe700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17d8159c90 0x7f17d814c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 -- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17d8159c90 msgr2=0x7f17d814c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d67fc700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17d81598c0 0x7f17d815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17d8159c90 0x7f17d814c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 -- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17d81598c0 msgr2=0x7f17d815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17d81598c0 0x7f17d815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 -- 172.21.15.22:0/2196628844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc009420 con 0x7f17d80cc260 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d67fc700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17d81598c0 0x7f17d815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d77fe700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17d8159c90 0x7f17d814c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17d6ffd700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d80c6bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f17c800c7c0 tx=0x7f17c8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011590 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c8011710 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d815bed0 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011ad0 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.929+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d815c490 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.930+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d804c3c0 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.931+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f17c801b3b0 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.931+0000 7f17beffd700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17c4067170 0x7f17c4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.931+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f17c8083a40 con 0x7f17d80cc260 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.931+0000 7f17d67fc700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17c4067170 0x7f17c4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.932+0000 7f17d67fc700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17c4067170 0x7f17c4069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f17d80cc690 tx=0x7f17cc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:15.935+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17c8085e60 con 0x7f17d80cc260 2023-10-08T00:30:16.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.206+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f17d8069fe0 con 0x7f17d80cc260 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.206+0000 7f17beffd700 1 -- 172.21.15.22:0/2196628844 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f17c8017070 con 0x7f17d80cc260 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:30:16.207 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:16.209 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.210 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.211 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:30:16.213 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.214 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.215 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:30:16.217 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.218 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:30:16.219 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:30:16.220 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.221 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:30:16.222 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:30:16.223 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17c4067170 msgr2=0x7f17c4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17c4067170 0x7f17c4069620 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f17d80cc690 tx=0x7f17cc017000 comp rx=0 tx=0).stop 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 msgr2=0x7f17d80c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d80c6bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f17c800c7c0 tx=0x7f17c8007f70 comp rx=0 tx=0).stop 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 shutdown_connections 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17c4067170 0x7f17c4069620 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17d8159c90 0x7f17d814c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17d80cc260 0x7f17d80c6bf0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 --2- 172.21.15.22:0/2196628844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17d81598c0 0x7f17d815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 >> 172.21.15.22:0/2196628844 conn(0x7f17d806baa0 msgr2=0x7f17d80cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:16.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.208+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 shutdown_connections 2023-10-08T00:30:16.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.209+0000 7f17dda2d700 1 -- 172.21.15.22:0/2196628844 wait complete. 2023-10-08T00:30:16.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:16.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.345+0000 7f82a359e700 1 Processor -- start 2023-10-08T00:30:16.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.345+0000 7f82a359e700 1 -- start start 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82a4159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a359e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a40cfe20 con 0x7f82a40ceaa0 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a40cf210 con 0x7f82a41593b0 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40cf4f0 con 0x7f82a40b1e50 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a2d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f82a40ceaa0 0x7f82a40b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34262/0 (socket says 172.21.15.22:34262) 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a2d9d700 1 -- 172.21.15.22:0/243920505 learned_addr learned my addr 172.21.15.22:0/243920505 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a1d9b700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82a4159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926179624 0 0) 0x7f82a40cfe20 con 0x7f82a40ceaa0 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8290003570 con 0x7f82a40ceaa0 2023-10-08T00:30:16.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 365121552 0 0) 0x7f8290003570 con 0x7f82a40ceaa0 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 msgr2=0x7f82a4159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a159a700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82a4159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.346+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 >> v1:172.21.15.192:6789/0 conn(0x7f82a41593b0 legacy=0x7f82a40b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40cf7d0 con 0x7f82a40ceaa0 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f829c0017f0 con 0x7f82a40ceaa0 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 >> v1:172.21.15.22:6789/0 conn(0x7f82a40ceaa0 legacy=0x7f82a40b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8290003a90 0x7f8290003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8290004810 0x7f8290004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82900051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40cf4f0 con 0x7f8290004810 2023-10-08T00:30:16.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829000bb60 con 0x7f8290003a90 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829000bd20 con 0x7f82a40b1e50 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8290004810 0x7f8290004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a259c700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8290003a90 0x7f8290003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a2d9d700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82900051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 -- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 msgr2=0x7f82900051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82900051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 -- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8290003a90 msgr2=0x7f8290003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8290003a90 0x7f8290003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 -- 172.21.15.22:0/243920505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290003570 con 0x7f8290004810 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a2d9d700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82a40b1e50 0x7f82900051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a1d9b700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8290004810 0x7f8290004c80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f828c009c00 tx=0x7f828c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51a2261b928dd49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:16.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00e710 con 0x7f8290004810 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00e870 con 0x7f8290004810 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.347+0000 7f82a159a700 1 -- 172.21.15.22:0/243920505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00ec30 con 0x7f8290004810 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a359e700 1 -- 172.21.15.22:0/243920505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8290004810 msgr2=0x7f8290004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a359e700 1 --2- 172.21.15.22:0/243920505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8290004810 0x7f8290004c80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f828c009c00 tx=0x7f828c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a2d9d700 1 -- 172.21.15.22:0/243920505 reap_dead start 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a359e700 1 -- 172.21.15.22:0/243920505 shutdown_connections 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a359e700 1 -- 172.21.15.22:0/243920505 >> 172.21.15.22:0/243920505 conn(0x7f82a40d1130 msgr2=0x7f82a40b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a359e700 1 -- 172.21.15.22:0/243920505 shutdown_connections 2023-10-08T00:30:16.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.348+0000 7f82a359e700 1 -- 172.21.15.22:0/243920505 wait complete. 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.349+0000 7f82a359e700 1 Processor -- start 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.349+0000 7f82a359e700 1 -- start start 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8290004810 0x7f82a414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40b0d40 0x7f82a40b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 0x7f82a416d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a359e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40ca400 con 0x7f82a416cc20 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b16f0 con 0x7f82a40b0d40 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a416db80 con 0x7f8290004810 2023-10-08T00:30:16.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 0x7f82a416d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 0x7f82a416d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33180/0 (socket says 172.21.15.22:33180) 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 -- 172.21.15.22:0/3180987983 learned_addr learned my addr 172.21.15.22:0/3180987983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a259c700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8290004810 0x7f82a414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a1d9b700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40b0d40 0x7f82a40b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 -- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8290004810 msgr2=0x7f82a414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8290004810 0x7f82a414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 -- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40b0d40 msgr2=0x7f82a40b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40b0d40 0x7f82a40b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 -- 172.21.15.22:0/3180987983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a416d5e0 con 0x7f82a416cc20 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f82a2d9d700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 0x7f82a416d0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f829c002250 tx=0x7f82a40cfd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:16.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.350+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00eab0 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.351+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00ec30 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.351+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c013420 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.351+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a416d8a0 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.351+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40ca910 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.351+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40c6270 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.352+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f829c013790 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.352+0000 7f829a7fc700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8284067170 0x7f8284069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.352+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f829c0849a0 con 0x7f82a416cc20 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.352+0000 7f82a259c700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8284067170 0x7f8284069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.353+0000 7f82a259c700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8284067170 0x7f8284069620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8294003b80 tx=0x7f8294007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.357+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f829c051cd0 con 0x7f82a416cc20 2023-10-08T00:30:16.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.552+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82a404c3c0 con 0x7f82a416cc20 2023-10-08T00:30:16.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.552+0000 7f829a7fc700 1 -- 172.21.15.22:0/3180987983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f829c0017b0 con 0x7f82a416cc20 2023-10-08T00:30:16.553 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:16.553 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":74,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:15.778866+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:16.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.554+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8284067170 msgr2=0x7f8284069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.554+0000 7f82a359e700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8284067170 0x7f8284069620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8294003b80 tx=0x7f8294007d30 comp rx=0 tx=0).stop 2023-10-08T00:30:16.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.554+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 msgr2=0x7f82a416d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 0x7f82a416d0a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f829c002250 tx=0x7f82a40cfd90 comp rx=0 tx=0).stop 2023-10-08T00:30:16.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 shutdown_connections 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82a416cc20 0x7f82a416d0a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8284067170 0x7f8284069620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8290004810 0x7f82a414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 --2- 172.21.15.22:0/3180987983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82a40b0d40 0x7f82a40b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 >> 172.21.15.22:0/3180987983 conn(0x7f82a40d1130 msgr2=0x7f82a41578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 shutdown_connections 2023-10-08T00:30:16.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.555+0000 7f82a359e700 1 -- 172.21.15.22:0/3180987983 wait complete. 2023-10-08T00:30:16.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:30:16.568 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:30:16.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.689+0000 7f5f2a893700 1 Processor -- start 2023-10-08T00:30:16.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f2a893700 1 -- start start 2023-10-08T00:30:16.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f2a893700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 0x7f5f240c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f2a893700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f2406c0a0 0x7f5f240c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f2a893700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2415c2a0 con 0x7f5f2406bcd0 2023-10-08T00:30:16.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f2a893700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f240c9880 con 0x7f5f2406c0a0 2023-10-08T00:30:16.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f2a893700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2415b690 con 0x7f5f24141500 2023-10-08T00:30:16.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f23fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5f2406bcd0 0x7f5f24140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36668/0 (socket says 172.21.15.22:36668) 2023-10-08T00:30:16.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.690+0000 7f5f23fff700 1 -- 172.21.15.22:0/2730884090 learned_addr learned my addr 172.21.15.22:0/2730884090 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:16.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413480934 0 0) 0x7f5f2415c2a0 con 0x7f5f2406bcd0 2023-10-08T00:30:16.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f237fe700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 0x7f5f240c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f0c003570 con 0x7f5f2406bcd0 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f28e30700 1 --2- 172.21.15.22:0/2730884090 >> v2:172.21.15.192:3300/0 conn(0x7f5f2406c0a0 0x7f5f240c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2907710576 0 0) 0x7f5f0c003570 con 0x7f5f2406bcd0 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 msgr2=0x7f5f240c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 0x7f5f240c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 >> v2:172.21.15.192:3300/0 conn(0x7f5f2406c0a0 msgr2=0x7f5f240c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 --2- 172.21.15.22:0/2730884090 >> v2:172.21.15.192:3300/0 conn(0x7f5f2406c0a0 0x7f5f240c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2415b970 con 0x7f5f2406bcd0 2023-10-08T00:30:16.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5f14001470 con 0x7f5f2406bcd0 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 >> v1:172.21.15.22:6789/0 conn(0x7f5f2406bcd0 legacy=0x7f5f24140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f0c003a60 0x7f5f0c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 0x7f5f0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240c9880 con 0x7f5f0c004810 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2415b690 con 0x7f5f0c003a60 2023-10-08T00:30:16.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c00ba60 con 0x7f5f24141500 2023-10-08T00:30:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f237fe700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f23fff700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f0c003a60 0x7f5f0c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.691+0000 7f5f28e30700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 0x7f5f0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f237fe700 1 -- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 msgr2=0x7f5f0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f237fe700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f24141500 0x7f5f0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f237fe700 1 -- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f0c003a60 msgr2=0x7f5f0c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f237fe700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f0c003a60 0x7f5f0c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f237fe700 1 -- 172.21.15.22:0/2730884090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c003570 con 0x7f5f0c004810 2023-10-08T00:30:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f237fe700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f0c004c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009c30 tx=0x7f5f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3642074b78d444e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800e710 con 0x7f5f0c004810 2023-10-08T00:30:16.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1800e870 con 0x7f5f0c004810 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f22ffd700 1 -- 172.21.15.22:0/2730884090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800ec30 con 0x7f5f0c004810 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f2a893700 1 -- 172.21.15.22:0/2730884090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 msgr2=0x7f5f0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f2a893700 1 --2- 172.21.15.22:0/2730884090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f0c004c80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5f18009c30 tx=0x7f5f180091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f28e30700 1 -- 172.21.15.22:0/2730884090 reap_dead start 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f2a893700 1 -- 172.21.15.22:0/2730884090 shutdown_connections 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f2a893700 1 -- 172.21.15.22:0/2730884090 >> 172.21.15.22:0/2730884090 conn(0x7f5f240ce600 msgr2=0x7f5f240cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:16.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f2a893700 1 -- 172.21.15.22:0/2730884090 shutdown_connections 2023-10-08T00:30:16.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.692+0000 7f5f2a893700 1 -- 172.21.15.22:0/2730884090 wait complete. 2023-10-08T00:30:16.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 Processor -- start 2023-10-08T00:30:16.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 -- start start 2023-10-08T00:30:16.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f240afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f240b1db0 0x7f5f24167f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f240b2220 0x7f5f241684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f24169600 con 0x7f5f0c004810 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f241689f0 con 0x7f5f240b2220 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.694+0000 7f5f2a893700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f240b2d30 con 0x7f5f240b1db0 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f240afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f240afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56270/0 (socket says 172.21.15.22:56270) 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 -- 172.21.15.22:0/3033326804 learned_addr learned my addr 172.21.15.22:0/3033326804 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:16.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f237fe700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f240b1db0 0x7f5f24167f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f28e30700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f240b2220 0x7f5f241684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 -- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f240b1db0 msgr2=0x7f5f24167f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f240b1db0 0x7f5f24167f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 -- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f240b2220 msgr2=0x7f5f241684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f240b2220 0x7f5f241684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 -- 172.21.15.22:0/3033326804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f240b2770 con 0x7f5f0c004810 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f28e30700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f240b2220 0x7f5f241684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f237fe700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f240b1db0 0x7f5f24167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:16.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f23fff700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f240afcc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5f14007420 tx=0x7f5f2406e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14018030 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1400f9a0 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f240b2a50 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400fd40 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.695+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f240b0200 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.696+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2406de30 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.697+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5f1401b070 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.697+0000 7f5f0bfff700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f10067170 0x7f5f10069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.697+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5f14019070 con 0x7f5f0c004810 2023-10-08T00:30:16.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.697+0000 7f5f237fe700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f10067170 0x7f5f10069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.698+0000 7f5f237fe700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f10067170 0x7f5f10069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5f180091e0 tx=0x7f5f1801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:16.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.701+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f14051970 con 0x7f5f0c004810 2023-10-08T00:30:16.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.893+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f2404c3c0 con 0x7f5f0c004810 2023-10-08T00:30:16.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.893+0000 7f5f0bfff700 1 -- 172.21.15.22:0/3033326804 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f1400fea0 con 0x7f5f0c004810 2023-10-08T00:30:16.894 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:30:16.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f10067170 msgr2=0x7f5f10069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f10067170 0x7f5f10069620 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5f180091e0 tx=0x7f5f1801a000 comp rx=0 tx=0).stop 2023-10-08T00:30:16.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 msgr2=0x7f5f240afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:16.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f240afcc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5f14007420 tx=0x7f5f2406e470 comp rx=0 tx=0).stop 2023-10-08T00:30:16.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 shutdown_connections 2023-10-08T00:30:16.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f240b2220 0x7f5f241684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f0c004810 0x7f5f240afcc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f10067170 0x7f5f10069620 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 --2- 172.21.15.22:0/3033326804 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f240b1db0 0x7f5f24167f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:16.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 >> 172.21.15.22:0/3033326804 conn(0x7f5f240ce600 msgr2=0x7f5f2413fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:16.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 shutdown_connections 2023-10-08T00:30:16.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:16.895+0000 7f5f2a893700 1 -- 172.21.15.22:0/3033326804 wait complete. 2023-10-08T00:30:16.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:30:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.027+0000 7f5e2143c700 1 Processor -- start 2023-10-08T00:30:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.027+0000 7f5e2143c700 1 -- start start 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e2143c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c1594d0 0x7f5e1c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e2143c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e1c0b5fb0 0x7f5e1c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e2143c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c0d01f0 con 0x7f5e1c159de0 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e2143c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1c0cf5e0 con 0x7f5e1c0b5fb0 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e2143c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c0cf8c0 con 0x7f5e1c1594d0 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e1a7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e1c0b5fb0 0x7f5e1c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e1b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5e1c159de0 0x7f5e1c15d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36684/0 (socket says 172.21.15.22:36684) 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e1b7fe700 1 -- 172.21.15.22:0/2082448682 learned_addr learned my addr 172.21.15.22:0/2082448682 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e1affd700 1 --2- 172.21.15.22:0/2082448682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c1594d0 0x7f5e1c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.028+0000 7f5e1a7fc700 1 -- 172.21.15.22:0/2082448682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c1594d0 msgr2=0x7f5e1c0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e1a7fc700 1 --2- 172.21.15.22:0/2082448682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c1594d0 0x7f5e1c0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e1a7fc700 1 -- 172.21.15.22:0/2082448682 >> v1:172.21.15.22:6789/0 conn(0x7f5e1c159de0 legacy=0x7f5e1c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e1a7fc700 1 -- 172.21.15.22:0/2082448682 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0cfba0 con 0x7f5e1c0b5fb0 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e19ffb700 1 -- 172.21.15.22:0/2082448682 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818841489 0 0) 0x7f5e1c0d01f0 con 0x7f5e1c159de0 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e1a7fc700 1 --2- 172.21.15.22:0/2082448682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c0b5fb0 0x7f5e1c1598a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5e040098e0 tx=0x7f5e040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d0246470d835 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e19ffb700 1 -- 172.21.15.22:0/2082448682 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04009e80 con 0x7f5e1c0b5fb0 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e19ffb700 1 -- 172.21.15.22:0/2082448682 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400b860 con 0x7f5e1c0b5fb0 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e19ffb700 1 -- 172.21.15.22:0/2082448682 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400bbe0 con 0x7f5e1c0b5fb0 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 -- 172.21.15.22:0/2082448682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c0b5fb0 msgr2=0x7f5e1c1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 --2- 172.21.15.22:0/2082448682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c0b5fb0 0x7f5e1c1598a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5e040098e0 tx=0x7f5e040091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 -- 172.21.15.22:0/2082448682 shutdown_connections 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 --2- 172.21.15.22:0/2082448682 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c1594d0 0x7f5e1c0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 --2- 172.21.15.22:0/2082448682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c0b5fb0 0x7f5e1c1598a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 -- 172.21.15.22:0/2082448682 >> 172.21.15.22:0/2082448682 conn(0x7f5e1c0d05f0 msgr2=0x7f5e1c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 -- 172.21.15.22:0/2082448682 shutdown_connections 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.029+0000 7f5e2143c700 1 -- 172.21.15.22:0/2082448682 wait complete. 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.031+0000 7f5e2143c700 1 Processor -- start 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.031+0000 7f5e2143c700 1 -- start start 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.031+0000 7f5e2143c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c0b5fb0 0x7f5e1c0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e1c1594d0 0x7f5e1c16d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 0x7f5e1c16d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15bbe0 con 0x7f5e1c159de0 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15bec0 con 0x7f5e1c1594d0 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15c1a0 con 0x7f5e1c0b5fb0 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 0x7f5e1c16d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 0x7f5e1c16d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56278/0 (socket says 172.21.15.22:56278) 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 -- 172.21.15.22:0/4258787477 learned_addr learned my addr 172.21.15.22:0/4258787477 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1affd700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c0b5fb0 0x7f5e1c0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1a7fc700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e1c1594d0 0x7f5e1c16d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 -- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c0b5fb0 msgr2=0x7f5e1c0c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c0b5fb0 0x7f5e1c0c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 -- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e1c1594d0 msgr2=0x7f5e1c16d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e1c1594d0 0x7f5e1c16d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 -- 172.21.15.22:0/4258787477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009420 con 0x7f5e1c159de0 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e1b7fe700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 0x7f5e1c16d820 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c530 tx=0x7f5e14007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14005b30 con 0x7f5e1c159de0 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14005c90 con 0x7f5e1c159de0 2023-10-08T00:30:17.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14007320 con 0x7f5e1c159de0 2023-10-08T00:30:17.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1c15c480 con 0x7f5e1c159de0 2023-10-08T00:30:17.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.032+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c0c5940 con 0x7f5e1c159de0 2023-10-08T00:30:17.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.033+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c04c3c0 con 0x7f5e1c159de0 2023-10-08T00:30:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.034+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5e1401b3b0 con 0x7f5e1c159de0 2023-10-08T00:30:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.034+0000 7f5e12ffd700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dfc067170 0x7f5dfc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.034+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e140838b0 con 0x7f5e1c159de0 2023-10-08T00:30:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.034+0000 7f5e1affd700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dfc067170 0x7f5dfc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.035+0000 7f5e1affd700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dfc067170 0x7f5dfc069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009fd0 tx=0x7f5e0c009880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.038+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e14050be0 con 0x7f5e1c159de0 2023-10-08T00:30:17.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.235+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e1c06a160 con 0x7f5e1c159de0 2023-10-08T00:30:17.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.235+0000 7f5e12ffd700 1 -- 172.21.15.22:0/4258787477 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5e14017090 con 0x7f5e1c159de0 2023-10-08T00:30:17.236 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:17.236 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:30:17.236 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:17.236 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:30:17.237 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:30:17.237 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:17.237 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:30:17.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dfc067170 msgr2=0x7f5dfc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dfc067170 0x7f5dfc069620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009fd0 tx=0x7f5e0c009880 comp rx=0 tx=0).stop 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 msgr2=0x7f5e1c16d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 0x7f5e1c16d820 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c530 tx=0x7f5e14007f90 comp rx=0 tx=0).stop 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 shutdown_connections 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e1c159de0 0x7f5e1c16d820 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dfc067170 0x7f5dfc069620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5e1c0b5fb0 0x7f5e1c0c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 --2- 172.21.15.22:0/4258787477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e1c1594d0 0x7f5e1c16d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 >> 172.21.15.22:0/4258787477 conn(0x7f5e1c0d05f0 msgr2=0x7f5e1c155110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:17.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 shutdown_connections 2023-10-08T00:30:17.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.238+0000 7f5e2143c700 1 -- 172.21.15.22:0/4258787477 wait complete. 2023-10-08T00:30:17.251 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:30:17.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:30:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.374+0000 7f105f277700 1 Processor -- start 2023-10-08T00:30:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.374+0000 7f105f277700 1 -- start start 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105f277700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10580b0790 0x7f10580cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105f277700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10581591e0 0x7f1058159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105f277700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10580cfa00 con 0x7f10580b03c0 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105f277700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580cb580 con 0x7f10580b0790 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105f277700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10580cf160 con 0x7f10581591e0 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10580b0790 0x7f10580cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10580b0790 0x7f10580cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56282/0 (socket says 172.21.15.22:56282) 2023-10-08T00:30:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 -- 172.21.15.22:0/2541385166 learned_addr learned my addr 172.21.15.22:0/2541385166 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 -- 172.21.15.22:0/2541385166 >> v2:172.21.15.192:3300/0 conn(0x7f10581591e0 msgr2=0x7f1058159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105ea76700 1 --2- 172.21.15.22:0/2541385166 >> v2:172.21.15.192:3300/0 conn(0x7f10581591e0 0x7f1058159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 --2- 172.21.15.22:0/2541385166 >> v2:172.21.15.192:3300/0 conn(0x7f10581591e0 0x7f1058159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 -- 172.21.15.22:0/2541385166 >> v1:172.21.15.192:6789/0 conn(0x7f10580b03c0 legacy=0x7f10580b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.375+0000 7f105da74700 1 -- 172.21.15.22:0/2541385166 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580cf440 con 0x7f10580b0790 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105da74700 1 --2- 172.21.15.22:0/2541385166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580b0790 0x7f10580cea70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f104c0099b0 tx=0x7f104c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef555ccbdd58553 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105d273700 1 -- 172.21.15.22:0/2541385166 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00b7e0 con 0x7f10580b0790 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105d273700 1 -- 172.21.15.22:0/2541385166 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c00b940 con 0x7f10580b0790 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105d273700 1 -- 172.21.15.22:0/2541385166 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c00bd00 con 0x7f10580b0790 2023-10-08T00:30:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 -- 172.21.15.22:0/2541385166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580b0790 msgr2=0x7f10580cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 --2- 172.21.15.22:0/2541385166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580b0790 0x7f10580cea70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f104c0099b0 tx=0x7f104c009250 comp rx=0 tx=0).stop 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 -- 172.21.15.22:0/2541385166 shutdown_connections 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 --2- 172.21.15.22:0/2541385166 >> v2:172.21.15.192:3300/0 conn(0x7f10581591e0 0x7f1058159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 --2- 172.21.15.22:0/2541385166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10580b0790 0x7f10580cea70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 -- 172.21.15.22:0/2541385166 >> 172.21.15.22:0/2541385166 conn(0x7f1058063230 msgr2=0x7f1058063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 -- 172.21.15.22:0/2541385166 shutdown_connections 2023-10-08T00:30:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.376+0000 7f105f277700 1 -- 172.21.15.22:0/2541385166 wait complete. 2023-10-08T00:30:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 Processor -- start 2023-10-08T00:30:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 -- start start 2023-10-08T00:30:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10580b03c0 0x7f10580c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10580b0790 0x7f1058155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 0x7f10580c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10580c5030 con 0x7f10581591e0 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1058156a60 con 0x7f10580b0790 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105f277700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10580ca1b0 con 0x7f10580b03c0 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105ea76700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 0x7f10580c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105ea76700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 0x7f10580c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56290/0 (socket says 172.21.15.22:56290) 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.378+0000 7f105ea76700 1 -- 172.21.15.22:0/1430003701 learned_addr learned my addr 172.21.15.22:0/1430003701 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105da74700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10580b0790 0x7f1058155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105e275700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10580b03c0 0x7f10580c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105ea76700 1 -- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10580b03c0 msgr2=0x7f10580c4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105ea76700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10580b03c0 0x7f10580c4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105ea76700 1 -- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10580b0790 msgr2=0x7f1058155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105ea76700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10580b0790 0x7f1058155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105ea76700 1 -- 172.21.15.22:0/1430003701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c0094f0 con 0x7f10581591e0 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105e275700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10580b03c0 0x7f10580c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105ea76700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 0x7f10580c9640 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f105000c880 tx=0x7f1050008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011600 con 0x7f10581591e0 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050011760 con 0x7f10581591e0 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10580ca490 con 0x7f10581591e0 2023-10-08T00:30:17.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050011ae0 con 0x7f10581591e0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.379+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10580c42f0 con 0x7f10581591e0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.380+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105804c3c0 con 0x7f10581591e0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.380+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f10500193f0 con 0x7f10581591e0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.381+0000 7f10567fc700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1044067170 0x7f1044069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.381+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1050084980 con 0x7f10581591e0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.381+0000 7f105e275700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1044067170 0x7f1044069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.382+0000 7f105e275700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1044067170 0x7f1044069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f10581591b0 tx=0x7f10480096a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.385+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1050051ba0 con 0x7f10581591e0 2023-10-08T00:30:17.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.578+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f10580cad50 con 0x7f10581591e0 2023-10-08T00:30:17.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.790+0000 7f10567fc700 1 -- 172.21.15.22:0/1430003701 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) v1 ==== 138+0+0 (secure 0 0 0) 0x7f10500551c0 con 0x7f10581591e0 2023-10-08T00:30:17.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1044067170 msgr2=0x7f1044069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1044067170 0x7f1044069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f10581591b0 tx=0x7f10480096a0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 msgr2=0x7f10580c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 0x7f10580c9640 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f105000c880 tx=0x7f1050008040 comp rx=0 tx=0).stop 2023-10-08T00:30:17.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 shutdown_connections 2023-10-08T00:30:17.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10581591e0 0x7f10580c9640 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1044067170 0x7f1044069620 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10580b03c0 0x7f10580c4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 --2- 172.21.15.22:0/1430003701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10580b0790 0x7f1058155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.794+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 >> 172.21.15.22:0/1430003701 conn(0x7f1058063230 msgr2=0x7f10580685a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:17.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.795+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 shutdown_connections 2023-10-08T00:30:17.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.795+0000 7f105f277700 1 -- 172.21.15.22:0/1430003701 wait complete. 2023-10-08T00:30:17.798 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:30:17.809 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:30:17.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.935+0000 7fdcfb266700 1 Processor -- start 2023-10-08T00:30:17.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.936+0000 7fdcfb266700 1 -- start start 2023-10-08T00:30:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.936+0000 7fdcfb266700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcf40cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.936+0000 7fdcfb266700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40ce380 con 0x7fdcf4069c70 2023-10-08T00:30:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.936+0000 7fdcfb266700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf40cec20 con 0x7fdcf40af320 2023-10-08T00:30:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.936+0000 7fdcfb266700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40afa90 con 0x7fdcf4159950 2023-10-08T00:30:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf9803700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdcf4069c70 0x7fdcf40cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36690/0 (socket says 172.21.15.22:36690) 2023-10-08T00:30:17.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf9803700 1 -- 172.21.15.22:0/3945386138 learned_addr learned my addr 172.21.15.22:0/3945386138 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:17.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf9002700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcf40cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720433412 0 0) 0x7fdcf40ce380 con 0x7fdcf4069c70 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc003570 con 0x7fdcf4069c70 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688686661 0 0) 0x7fdcf40cec20 con 0x7fdcf40af320 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf40ce380 con 0x7fdcf40af320 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704924307 0 0) 0x7fdcdc003570 con 0x7fdcf4069c70 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 msgr2=0x7fdcf40cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcf40cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 >> v1:172.21.15.192:6789/0 conn(0x7fdcf40af320 legacy=0x7fdcf4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf40ce5d0 con 0x7fdcf4069c70 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fdcec001470 con 0x7fdcf4069c70 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf9002700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcf40cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 >> v1:172.21.15.22:6789/0 conn(0x7fdcf4069c70 legacy=0x7fdcf40cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcdc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcdc004810 0x7fdcdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40afa90 con 0x7fdcdc003c20 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00bb10 con 0x7fdcdc004810 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.937+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00bcd0 con 0x7fdcf4159950 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcdc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf8801700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcdc004810 0x7fdcdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9803700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 -- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 msgr2=0x7fdcdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf4159950 0x7fdcdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 -- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcdc004810 msgr2=0x7fdcdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcdc004810 0x7fdcdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 -- 172.21.15.22:0/3945386138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce4009a20 con 0x7fdcdc003c20 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf9002700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcdc004010 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e3c0 tx=0x7fdce400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ef4d04a395e4d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4009c50 con 0x7fdcdc003c20 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce400f040 con 0x7fdcdc003c20 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.938+0000 7fdcf3fff700 1 -- 172.21.15.22:0/3945386138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce400eea0 con 0x7fdcdc003c20 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcfb266700 1 -- 172.21.15.22:0/3945386138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 msgr2=0x7fdcdc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcfb266700 1 --2- 172.21.15.22:0/3945386138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcdc004010 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdce400e3c0 tx=0x7fdce400b040 comp rx=0 tx=0).stop 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcf9803700 1 -- 172.21.15.22:0/3945386138 reap_dead start 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcfb266700 1 -- 172.21.15.22:0/3945386138 shutdown_connections 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcfb266700 1 -- 172.21.15.22:0/3945386138 >> 172.21.15.22:0/3945386138 conn(0x7fdcf4068e00 msgr2=0x7fdcf40d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:17.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcfb266700 1 -- 172.21.15.22:0/3945386138 shutdown_connections 2023-10-08T00:30:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.939+0000 7fdcfb266700 1 -- 172.21.15.22:0/3945386138 wait complete. 2023-10-08T00:30:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.940+0000 7fdcfb266700 1 Processor -- start 2023-10-08T00:30:17.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.940+0000 7fdcfb266700 1 -- start start 2023-10-08T00:30:17.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcfb266700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcf40c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcfb266700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf415db20 0x7fdcf415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcfb266700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf40c9e80 0x7fdcf40ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcfb266700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf40ca840 con 0x7fdcdc003c20 2023-10-08T00:30:17.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcfb266700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf416a150 con 0x7fdcf40c9e80 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcfb266700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf416a430 con 0x7fdcf415db20 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcf40c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcf40c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56316/0 (socket says 172.21.15.22:56316) 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 -- 172.21.15.22:0/1547244493 learned_addr learned my addr 172.21.15.22:0/1547244493 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf8801700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf415db20 0x7fdcf415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9803700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf40c9e80 0x7fdcf40ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 -- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf415db20 msgr2=0x7fdcf415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf415db20 0x7fdcf415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 -- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf40c9e80 msgr2=0x7fdcf40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf40c9e80 0x7fdcf40ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.941+0000 7fdcf9002700 1 -- 172.21.15.22:0/1547244493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf416a710 con 0x7fdcdc003c20 2023-10-08T00:30:17.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.942+0000 7fdcf9002700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcf40c8d60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdce40099f0 tx=0x7fdce401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.942+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce4014e50 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.942+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce401d660 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.942+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf416a9f0 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.942+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce401da20 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.942+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf40c92a0 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.943+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf40718b0 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.943+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fdce4003040 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.944+0000 7fdcf17fa700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdce0067170 0x7fdce0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.944+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fdce4086640 con 0x7fdcdc003c20 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.944+0000 7fdcf8801700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdce0067170 0x7fdce0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:17.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.944+0000 7fdcf8801700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdce0067170 0x7fdce0069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4158430 tx=0x7fdce8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:17.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:17.948+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdce40537b0 con 0x7fdcdc003c20 2023-10-08T00:30:18.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.143+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdcf40ce8b0 con 0x7fdcdc003c20 2023-10-08T00:30:18.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.796+0000 7fdcf17fa700 1 -- 172.21.15.22:0/1547244493 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdce4056dd0 con 0x7fdcdc003c20 2023-10-08T00:30:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.802+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdce0067170 msgr2=0x7fdce0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.802+0000 7fdcfb266700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdce0067170 0x7fdce0069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4158430 tx=0x7fdce8007d30 comp rx=0 tx=0).stop 2023-10-08T00:30:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.802+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 msgr2=0x7fdcf40c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.802+0000 7fdcfb266700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcf40c8d60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdce40099f0 tx=0x7fdce401a000 comp rx=0 tx=0).stop 2023-10-08T00:30:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 shutdown_connections 2023-10-08T00:30:18.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf40c9e80 0x7fdcf40ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcdc003c20 0x7fdcf40c8d60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdce0067170 0x7fdce0069620 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4158430 tx=0x7fdce8007d30 comp rx=0 tx=0).stop 2023-10-08T00:30:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 --2- 172.21.15.22:0/1547244493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdcf415db20 0x7fdcf415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 >> 172.21.15.22:0/1547244493 conn(0x7fdcf4068e00 msgr2=0x7fdcf4069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:18.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.803+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 shutdown_connections 2023-10-08T00:30:18.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.808+0000 7fdcfb266700 1 -- 172.21.15.22:0/1547244493 wait complete. 2023-10-08T00:30:18.815 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:30:18.830 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:30:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.958+0000 7f8c9bec7700 1 Processor -- start 2023-10-08T00:30:18.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.959+0000 7f8c9bec7700 1 -- start start 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.959+0000 7f8c9bec7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.959+0000 7f8c9bec7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.959+0000 7f8c9bec7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9415a160 con 0x7f8c9415db10 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.959+0000 7f8c9bec7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9415df50 con 0x7f8c94159c60 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.959+0000 7f8c9bec7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940d13a0 con 0x7f8c94159890 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56332/0 (socket says 172.21.15.22:56332) 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 -- 172.21.15.22:0/2857425121 learned_addr learned my addr 172.21.15.22:0/2857425121 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:18.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 -- 172.21.15.22:0/2857425121 >> v2:172.21.15.192:3300/0 conn(0x7f8c94159890 msgr2=0x7f8c9415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99c63700 1 --2- 172.21.15.22:0/2857425121 >> v2:172.21.15.192:3300/0 conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 --2- 172.21.15.22:0/2857425121 >> v2:172.21.15.192:3300/0 conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 -- 172.21.15.22:0/2857425121 >> v1:172.21.15.192:6789/0 conn(0x7f8c9415db10 legacy=0x7f8c94069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 -- 172.21.15.22:0/2857425121 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9415e140 con 0x7f8c94159c60 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99c63700 1 --2- 172.21.15.22:0/2857425121 >> v2:172.21.15.192:3300/0 conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c99462700 1 --2- 172.21.15.22:0/2857425121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c94159c60 0x7f8c9415d5d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8c940d1090 tx=0x7f8c88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43639d37744379c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c98c61700 1 -- 172.21.15.22:0/2857425121 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800b820 con 0x7f8c94159c60 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c98c61700 1 -- 172.21.15.22:0/2857425121 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800b980 con 0x7f8c94159c60 2023-10-08T00:30:18.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.960+0000 7f8c98c61700 1 -- 172.21.15.22:0/2857425121 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800bd20 con 0x7f8c94159c60 2023-10-08T00:30:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 -- 172.21.15.22:0/2857425121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c94159c60 msgr2=0x7f8c9415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:18.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/2857425121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c94159c60 0x7f8c9415d5d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8c940d1090 tx=0x7f8c88009250 comp rx=0 tx=0).stop 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 -- 172.21.15.22:0/2857425121 shutdown_connections 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/2857425121 >> v2:172.21.15.192:3300/0 conn(0x7f8c94159890 0x7f8c9415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/2857425121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c94159c60 0x7f8c9415d5d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 -- 172.21.15.22:0/2857425121 >> 172.21.15.22:0/2857425121 conn(0x7f8c94068e20 msgr2=0x7f8c940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 -- 172.21.15.22:0/2857425121 shutdown_connections 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.961+0000 7f8c9bec7700 1 -- 172.21.15.22:0/2857425121 wait complete. 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.962+0000 7f8c9bec7700 1 Processor -- start 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.962+0000 7f8c9bec7700 1 -- start start 2023-10-08T00:30:18.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9bec7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c94159890 0x7f8c940b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9bec7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c94159c60 0x7f8c940ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9bec7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 0x7f8c940cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9bec7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940b3ad0 con 0x7f8c9415db10 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9bec7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940cf1d0 con 0x7f8c94159c60 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9bec7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940b12b0 con 0x7f8c94159890 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 0x7f8c940cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 0x7f8c940cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56340/0 (socket says 172.21.15.22:56340) 2023-10-08T00:30:18.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 -- 172.21.15.22:0/1337693972 learned_addr learned my addr 172.21.15.22:0/1337693972 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c99c63700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c94159890 0x7f8c940b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c99462700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c94159c60 0x7f8c940ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 -- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c94159890 msgr2=0x7f8c940b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c94159890 0x7f8c940b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 -- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c94159c60 msgr2=0x7f8c940ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c94159c60 0x7f8c940ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 -- 172.21.15.22:0/1337693972 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c880094f0 con 0x7f8c9415db10 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c9a464700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 0x7f8c940cec90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b4e0 tx=0x7f8c8c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.963+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00f5e0 con 0x7f8c9415db10 2023-10-08T00:30:18.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.964+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c00f740 con 0x7f8c9415db10 2023-10-08T00:30:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.964+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c940b1590 con 0x7f8c9415db10 2023-10-08T00:30:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.964+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c00fb00 con 0x7f8c9415db10 2023-10-08T00:30:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.964+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c940b1bd0 con 0x7f8c9415db10 2023-10-08T00:30:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.965+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940b1d60 con 0x7f8c9415db10 2023-10-08T00:30:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.965+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8c8c01a400 con 0x7f8c9415db10 2023-10-08T00:30:18.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.965+0000 7f8c91ffb700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c80067170 0x7f8c80069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:18.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.966+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f8c8c0843d0 con 0x7f8c9415db10 2023-10-08T00:30:18.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.966+0000 7f8c99c63700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c80067170 0x7f8c80069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:18.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.966+0000 7f8c99c63700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c80067170 0x7f8c80069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400d560 tx=0x7f8c840075a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:18.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:18.970+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c8c051490 con 0x7f8c9415db10 2023-10-08T00:30:19.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.208+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8c9404c3c0 con 0x7f8c9415db10 2023-10-08T00:30:19.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.796+0000 7f8c91ffb700 1 -- 172.21.15.22:0/1337693972 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8c8c054ab0 con 0x7f8c9415db10 2023-10-08T00:30:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.804+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c80067170 msgr2=0x7f8c80069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.804+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c80067170 0x7f8c80069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400d560 tx=0x7f8c840075a0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.804+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 msgr2=0x7f8c940cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 0x7f8c940cec90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00b4e0 tx=0x7f8c8c006f90 comp rx=0 tx=0).stop 2023-10-08T00:30:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 shutdown_connections 2023-10-08T00:30:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c9415db10 0x7f8c940cec90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8c80067170 0x7f8c80069620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c94159890 0x7f8c940b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 --2- 172.21.15.22:0/1337693972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c94159c60 0x7f8c940ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 >> 172.21.15.22:0/1337693972 conn(0x7f8c94068e20 msgr2=0x7f8c94153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:19.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 shutdown_connections 2023-10-08T00:30:19.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.805+0000 7f8c9bec7700 1 -- 172.21.15.22:0/1337693972 wait complete. 2023-10-08T00:30:19.807 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 12 and data pool 13 2023-10-08T00:30:19.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:19.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.942+0000 7f420c617700 1 Processor -- start 2023-10-08T00:30:19.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.942+0000 7f420c617700 1 -- start start 2023-10-08T00:30:19.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420c617700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4204159890 0x7f420415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420c617700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4204159c60 0x7f420415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420c617700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f420415db10 0x7f4204069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420c617700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420415df50 con 0x7f4204159890 2023-10-08T00:30:19.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420c617700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420415a160 con 0x7f4204159c60 2023-10-08T00:30:19.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420c617700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42040d13a0 con 0x7f420415db10 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4204159890 0x7f420415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4204159890 0x7f420415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56356/0 (socket says 172.21.15.22:56356) 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 -- 172.21.15.22:0/2413085408 learned_addr learned my addr 172.21.15.22:0/2413085408 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420abb4700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f420415db10 0x7f4204069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f4209bb2700 1 --2- 172.21.15.22:0/2413085408 >> v2:172.21.15.192:3300/0 conn(0x7f4204159c60 0x7f420415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 -- 172.21.15.22:0/2413085408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f420415db10 msgr2=0x7f4204069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:19.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f420415db10 0x7f4204069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 -- 172.21.15.22:0/2413085408 >> v2:172.21.15.192:3300/0 conn(0x7f4204159c60 msgr2=0x7f420415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 --2- 172.21.15.22:0/2413085408 >> v2:172.21.15.192:3300/0 conn(0x7f4204159c60 0x7f420415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 -- 172.21.15.22:0/2413085408 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420415e140 con 0x7f4204159890 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420abb4700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f420415db10 0x7f4204069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f4209bb2700 1 --2- 172.21.15.22:0/2413085408 >> v2:172.21.15.192:3300/0 conn(0x7f4204159c60 0x7f420415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f420a3b3700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4204159890 0x7f420415abd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f42040b67f0 tx=0x7f4200009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f224528694c0862 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.943+0000 7f42093b1700 1 -- 172.21.15.22:0/2413085408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000b860 con 0x7f4204159890 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f42093b1700 1 -- 172.21.15.22:0/2413085408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000b9c0 con 0x7f4204159890 2023-10-08T00:30:19.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f42093b1700 1 -- 172.21.15.22:0/2413085408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000bd60 con 0x7f4204159890 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 -- 172.21.15.22:0/2413085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4204159890 msgr2=0x7f420415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4204159890 0x7f420415abd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f42040b67f0 tx=0x7f4200009250 comp rx=0 tx=0).stop 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 -- 172.21.15.22:0/2413085408 shutdown_connections 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4204159890 0x7f420415abd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 --2- 172.21.15.22:0/2413085408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f420415db10 0x7f4204069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 --2- 172.21.15.22:0/2413085408 >> v2:172.21.15.192:3300/0 conn(0x7f4204159c60 0x7f420415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 -- 172.21.15.22:0/2413085408 >> 172.21.15.22:0/2413085408 conn(0x7f4204068e20 msgr2=0x7f42040d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:19.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 -- 172.21.15.22:0/2413085408 shutdown_connections 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.944+0000 7f420c617700 1 -- 172.21.15.22:0/2413085408 wait complete. 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.945+0000 7f420c617700 1 Processor -- start 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.945+0000 7f420c617700 1 -- start start 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420c617700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4204159890 0x7f42040b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420c617700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4204159c60 0x7f420415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420c617700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 0x7f420415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420c617700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041557a0 con 0x7f420415db10 2023-10-08T00:30:19.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420c617700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204155f10 con 0x7f4204159c60 2023-10-08T00:30:19.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420c617700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42041561f0 con 0x7f4204159890 2023-10-08T00:30:19.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 0x7f420415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 0x7f420415d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56362/0 (socket says 172.21.15.22:56362) 2023-10-08T00:30:19.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 -- 172.21.15.22:0/1374217717 learned_addr learned my addr 172.21.15.22:0/1374217717 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:19.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f4209bb2700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4204159c60 0x7f420415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420a3b3700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4204159890 0x7f42040b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 -- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4204159890 msgr2=0x7f42040b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:19.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4204159890 0x7f42040b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 -- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4204159c60 msgr2=0x7f420415cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4204159c60 0x7f420415cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.946+0000 7f420abb4700 1 -- 172.21.15.22:0/1374217717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000094f0 con 0x7f420415db10 2023-10-08T00:30:19.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.947+0000 7f420abb4700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 0x7f420415d140 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00a380 tx=0x7f41fc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.947+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc015440 con 0x7f420415db10 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.947+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc0155a0 con 0x7f420415db10 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.947+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42041564d0 con 0x7f420415db10 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.947+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc015960 con 0x7f420415db10 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.947+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4204156a90 con 0x7f420415db10 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.948+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4204156c80 con 0x7f420415db10 2023-10-08T00:30:19.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.948+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f41fc00d440 con 0x7f420415db10 2023-10-08T00:30:19.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.949+0000 7f41fa7fc700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41e8067170 0x7f41e8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:19.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.949+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41fc0852f0 con 0x7f420415db10 2023-10-08T00:30:19.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.949+0000 7f420a3b3700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41e8067170 0x7f41e8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:19.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.949+0000 7f420a3b3700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41e8067170 0x7f41e8069620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42040b67f0 tx=0x7f4200017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:19.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:19.953+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41fc0522d0 con 0x7f420415db10 2023-10-08T00:30:20.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.148+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f420404c3c0 con 0x7f420415db10 2023-10-08T00:30:20.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.149+0000 7f41fa7fc700 1 -- 172.21.15.22:0/1374217717 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f41fc0558f0 con 0x7f420415db10 2023-10-08T00:30:20.150 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:20.150 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":77,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:19.209478+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:17.609244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:18.173807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41e8067170 msgr2=0x7f41e8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41e8067170 0x7f41e8069620 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f42040b67f0 tx=0x7f4200017000 comp rx=0 tx=0).stop 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 msgr2=0x7f420415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 0x7f420415d140 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00a380 tx=0x7f41fc007900 comp rx=0 tx=0).stop 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 shutdown_connections 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f420415db10 0x7f420415d140 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f41e8067170 0x7f41e8069620 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4204159890 0x7f42040b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 --2- 172.21.15.22:0/1374217717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4204159c60 0x7f420415cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 >> 172.21.15.22:0/1374217717 conn(0x7f4204068e20 msgr2=0x7f420415f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 shutdown_connections 2023-10-08T00:30:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.151+0000 7f420c617700 1 -- 172.21.15.22:0/1374217717 wait complete. 2023-10-08T00:30:20.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.283+0000 7faf3fb63700 1 Processor -- start 2023-10-08T00:30:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.283+0000 7faf3fb63700 1 -- start start 2023-10-08T00:30:20.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3fb63700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf38159c60 0x7faf3815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3fb63700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3815a160 con 0x7faf38159890 2023-10-08T00:30:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3fb63700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380d13a0 con 0x7faf3815db10 2023-10-08T00:30:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3fb63700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3815df50 con 0x7faf38159c60 2023-10-08T00:30:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3d8ff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faf38159890 0x7faf3815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36698/0 (socket says 172.21.15.22:36698) 2023-10-08T00:30:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3d8ff700 1 -- 172.21.15.22:0/3382837240 learned_addr learned my addr 172.21.15.22:0/3382837240 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3d0fe700 1 --2- 172.21.15.22:0/3382837240 >> v2:172.21.15.22:3300/0 conn(0x7faf38159c60 0x7faf3815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.284+0000 7faf3c8fd700 1 -- 172.21.15.22:0/3382837240 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62525046 0 0) 0x7faf3815a160 con 0x7faf38159890 2023-10-08T00:30:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3c8fd700 1 -- 172.21.15.22:0/3382837240 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf20003570 con 0x7faf38159890 2023-10-08T00:30:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3d0fe700 1 -- 172.21.15.22:0/3382837240 >> v1:172.21.15.192:6789/0 conn(0x7faf3815db10 legacy=0x7faf38069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3d0fe700 1 -- 172.21.15.22:0/3382837240 >> v1:172.21.15.22:6789/0 conn(0x7faf38159890 legacy=0x7faf3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3d0fe700 1 -- 172.21.15.22:0/3382837240 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3815e140 con 0x7faf38159c60 2023-10-08T00:30:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3d0fe700 1 --2- 172.21.15.22:0/3382837240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159c60 0x7faf3815d5d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0098e0 tx=0x7faf2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a26505f4a358d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3c8fd700 1 -- 172.21.15.22:0/3382837240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00b640 con 0x7faf38159c60 2023-10-08T00:30:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3c8fd700 1 -- 172.21.15.22:0/3382837240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00b7a0 con 0x7faf38159c60 2023-10-08T00:30:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3c8fd700 1 -- 172.21.15.22:0/3382837240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00bb40 con 0x7faf38159c60 2023-10-08T00:30:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3fb63700 1 -- 172.21.15.22:0/3382837240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159c60 msgr2=0x7faf3815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3fb63700 1 --2- 172.21.15.22:0/3382837240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159c60 0x7faf3815d5d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0098e0 tx=0x7faf2c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3fb63700 1 -- 172.21.15.22:0/3382837240 shutdown_connections 2023-10-08T00:30:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3fb63700 1 --2- 172.21.15.22:0/3382837240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159c60 0x7faf3815d5d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3fb63700 1 -- 172.21.15.22:0/3382837240 >> 172.21.15.22:0/3382837240 conn(0x7faf38068e20 msgr2=0x7faf380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.285+0000 7faf3fb63700 1 -- 172.21.15.22:0/3382837240 shutdown_connections 2023-10-08T00:30:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.286+0000 7faf3fb63700 1 -- 172.21.15.22:0/3382837240 wait complete. 2023-10-08T00:30:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 Processor -- start 2023-10-08T00:30:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 -- start start 2023-10-08T00:30:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 0x7faf38145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38159c60 0x7faf38154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3815db10 0x7faf3815f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf38152620 con 0x7faf38159890 2023-10-08T00:30:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3816d080 con 0x7faf38159c60 2023-10-08T00:30:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3fb63700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380b23a0 con 0x7faf3815db10 2023-10-08T00:30:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3d8ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 0x7faf38145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3d8ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 0x7faf38145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56388/0 (socket says 172.21.15.22:56388) 2023-10-08T00:30:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.287+0000 7faf3d8ff700 1 -- 172.21.15.22:0/1328678995 learned_addr learned my addr 172.21.15.22:0/1328678995 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d0fe700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38159c60 0x7faf38154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3e100700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3815db10 0x7faf3815f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d8ff700 1 -- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3815db10 msgr2=0x7faf3815f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d8ff700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3815db10 0x7faf3815f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d8ff700 1 -- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38159c60 msgr2=0x7faf38154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d8ff700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38159c60 0x7faf38154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d8ff700 1 -- 172.21.15.22:0/1328678995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009420 con 0x7faf38159890 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3d8ff700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 0x7faf38145110 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7faf2800cd30 tx=0x7faf28001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800ce90 con 0x7faf38159890 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2800aac0 con 0x7faf38159890 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3816d380 con 0x7faf38159890 2023-10-08T00:30:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800aea0 con 0x7faf38159890 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.288+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf38145650 con 0x7faf38159890 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.289+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3804c3c0 con 0x7faf38159890 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.290+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7faf28007300 con 0x7faf38159890 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.290+0000 7faf35ffb700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf24067170 0x7faf24069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.290+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf28084bd0 con 0x7faf38159890 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.290+0000 7faf3d0fe700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf24067170 0x7faf24069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.291+0000 7faf3d0fe700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf24067170 0x7faf24069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0093f0 tx=0x7faf2c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.294+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf28051c30 con 0x7faf38159890 2023-10-08T00:30:20.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.489+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf3806a5b0 con 0x7faf38159890 2023-10-08T00:30:20.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.490+0000 7faf35ffb700 1 -- 172.21.15.22:0/1328678995 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15366 (secure 0 0 0) 0x7faf28055250 con 0x7faf38159890 2023-10-08T00:30:20.491 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:20.491 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":77,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:19.209478+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:17.609244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:18.173807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf24067170 msgr2=0x7faf24069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf24067170 0x7faf24069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0093f0 tx=0x7faf2c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:20.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 msgr2=0x7faf38145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 0x7faf38145110 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7faf2800cd30 tx=0x7faf28001b10 comp rx=0 tx=0).stop 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 shutdown_connections 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf24067170 0x7faf24069620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf3815db10 0x7faf3815f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.492+0000 7faf3fb63700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf38159890 0x7faf38145110 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.493+0000 7faf3fb63700 1 --2- 172.21.15.22:0/1328678995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38159c60 0x7faf38154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.493+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 >> 172.21.15.22:0/1328678995 conn(0x7faf38068e20 msgr2=0x7faf381553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.493+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 shutdown_connections 2023-10-08T00:30:20.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.493+0000 7faf3fb63700 1 -- 172.21.15.22:0/1328678995 wait complete. 2023-10-08T00:30:20.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:30:20.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.628+0000 7efdfaf8f700 1 Processor -- start 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.628+0000 7efdfaf8f700 1 -- start start 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdfaf8f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efdf4159c60 0x7efdf415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdfaf8f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efdf415db10 0x7efdf4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdfaf8f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf415a160 con 0x7efdf4159890 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdfaf8f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf415df50 con 0x7efdf4159c60 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdfaf8f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40d13a0 con 0x7efdf415db10 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdf3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efdf4159c60 0x7efdf415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdf8d2b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efdf4159890 0x7efdf415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36712/0 (socket says 172.21.15.22:36712) 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.629+0000 7efdf8d2b700 1 -- 172.21.15.22:0/2886665456 learned_addr learned my addr 172.21.15.22:0/2886665456 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf3fff700 1 -- 172.21.15.22:0/2886665456 >> v2:172.21.15.192:3300/0 conn(0x7efdf415db10 msgr2=0x7efdf4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf952c700 1 --2- 172.21.15.22:0/2886665456 >> v2:172.21.15.192:3300/0 conn(0x7efdf415db10 0x7efdf4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf37fe700 1 -- 172.21.15.22:0/2886665456 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98792533 0 0) 0x7efdf415a160 con 0x7efdf4159890 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf3fff700 1 --2- 172.21.15.22:0/2886665456 >> v2:172.21.15.192:3300/0 conn(0x7efdf415db10 0x7efdf4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf3fff700 1 -- 172.21.15.22:0/2886665456 >> v1:172.21.15.22:6789/0 conn(0x7efdf4159890 legacy=0x7efdf415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf3fff700 1 -- 172.21.15.22:0/2886665456 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf415e140 con 0x7efdf4159c60 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf952c700 1 --2- 172.21.15.22:0/2886665456 >> v2:172.21.15.192:3300/0 conn(0x7efdf415db10 0x7efdf4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf3fff700 1 --2- 172.21.15.22:0/2886665456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf415d5d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efdf406a890 tx=0x7efde80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58376ed85dc0352b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf37fe700 1 -- 172.21.15.22:0/2886665456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800b6b0 con 0x7efdf4159c60 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf37fe700 1 -- 172.21.15.22:0/2886665456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde800b810 con 0x7efdf4159c60 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.630+0000 7efdf37fe700 1 -- 172.21.15.22:0/2886665456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800bbb0 con 0x7efdf4159c60 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 -- 172.21.15.22:0/2886665456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 msgr2=0x7efdf415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/2886665456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf415d5d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efdf406a890 tx=0x7efde80091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 -- 172.21.15.22:0/2886665456 shutdown_connections 2023-10-08T00:30:20.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/2886665456 >> v2:172.21.15.192:3300/0 conn(0x7efdf415db10 0x7efdf4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/2886665456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf415d5d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 -- 172.21.15.22:0/2886665456 >> 172.21.15.22:0/2886665456 conn(0x7efdf4068e20 msgr2=0x7efdf40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:20.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 -- 172.21.15.22:0/2886665456 shutdown_connections 2023-10-08T00:30:20.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.631+0000 7efdfaf8f700 1 -- 172.21.15.22:0/2886665456 wait complete. 2023-10-08T00:30:20.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.632+0000 7efdfaf8f700 1 Processor -- start 2023-10-08T00:30:20.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.632+0000 7efdfaf8f700 1 -- start start 2023-10-08T00:30:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdf4159890 0x7efdf416af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf4140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf415db10 0x7efdf40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40b1e60 con 0x7efdf4159c60 2023-10-08T00:30:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40b2140 con 0x7efdf415db10 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40b2420 con 0x7efdf4159890 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf4140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56406/0 (socket says 172.21.15.22:56406) 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 -- 172.21.15.22:0/3090104133 learned_addr learned my addr 172.21.15.22:0/3090104133 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 -- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdf4159890 msgr2=0x7efdf416af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdf4159890 0x7efdf416af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 -- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf415db10 msgr2=0x7efdf40b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf415db10 0x7efdf40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 -- 172.21.15.22:0/3090104133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8009420 con 0x7efdf4159c60 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf3fff700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf4140940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7efdf4070e20 tx=0x7efde8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011420 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde8011580 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf40b51b0 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde8011920 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.633+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf4140e80 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.634+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf40b5010 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.635+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7efde8011d10 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.635+0000 7efdf0ff9700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efde0067170 0x7efde0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.635+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efde8086390 con 0x7efdf4159c60 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.635+0000 7efdf8d2b700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efde0067170 0x7efde0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.636+0000 7efdf8d2b700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efde0067170 0x7efde0069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efdec002120 tx=0x7efdec0016c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.640+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdf40b5010 con 0x7efdf4159c60 2023-10-08T00:30:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:20.879+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efdf40b53f0 con 0x7efdf4159c60 2023-10-08T00:30:21.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T00:30:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.813+0000 7efdf0ff9700 1 -- 172.21.15.22:0/3090104133 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7efdf40b53f0 con 0x7efdf4159c60 2023-10-08T00:30:21.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.815+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efde0067170 msgr2=0x7efde0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:21.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.815+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efde0067170 0x7efde0069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efdec002120 tx=0x7efdec0016c0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.815+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 msgr2=0x7efdf4140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.815+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf4140940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7efdf4070e20 tx=0x7efde8017000 comp rx=0 tx=0).stop 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 shutdown_connections 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdf415db10 0x7efdf40b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efde0067170 0x7efde0069620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efdf4159890 0x7efdf416af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 --2- 172.21.15.22:0/3090104133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdf4159c60 0x7efdf4140940 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 >> 172.21.15.22:0/3090104133 conn(0x7efdf4068e20 msgr2=0x7efdf4152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 shutdown_connections 2023-10-08T00:30:21.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.816+0000 7efdfaf8f700 1 -- 172.21.15.22:0/3090104133 wait complete. 2023-10-08T00:30:21.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:30:21.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.962+0000 7f8bd4710700 1 Processor -- start 2023-10-08T00:30:21.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.962+0000 7f8bd4710700 1 -- start start 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd4710700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8bcc159890 0x7f8bcc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd4710700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bcc069560 0x7f8bcc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd4710700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc069ee0 con 0x7f8bcc159c60 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd4710700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc15a160 con 0x7f8bcc159890 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd4710700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0d13a0 con 0x7f8bcc069560 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd24ac700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8bcc159890 0x7f8bcc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd1cab700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8bcc159c60 0x7f8bcc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36728/0 (socket says 172.21.15.22:36728) 2023-10-08T00:30:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd1cab700 1 -- 172.21.15.22:0/3124304988 learned_addr learned my addr 172.21.15.22:0/3124304988 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd2cad700 1 --2- 172.21.15.22:0/3124304988 >> v2:172.21.15.192:3300/0 conn(0x7f8bcc069560 0x7f8bcc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3124304988 >> v2:172.21.15.192:3300/0 conn(0x7f8bcc069560 msgr2=0x7f8bcc0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd24ac700 1 --2- 172.21.15.22:0/3124304988 >> v2:172.21.15.192:3300/0 conn(0x7f8bcc069560 0x7f8bcc0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3124304988 >> v1:172.21.15.22:6789/0 conn(0x7f8bcc159c60 legacy=0x7f8bcc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3124304988 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc15e140 con 0x7f8bcc159890 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd14aa700 1 -- 172.21.15.22:0/3124304988 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031899732 0 0) 0x7f8bcc069ee0 con 0x7f8bcc159c60 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.963+0000 7f8bd24ac700 1 --2- 172.21.15.22:0/3124304988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc159890 0x7f8bcc15abd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc06a890 tx=0x7f8bbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb768b5c59c3874 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd14aa700 1 -- 172.21.15.22:0/3124304988 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00b6b0 con 0x7f8bcc159890 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd14aa700 1 -- 172.21.15.22:0/3124304988 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00b810 con 0x7f8bcc159890 2023-10-08T00:30:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd14aa700 1 -- 172.21.15.22:0/3124304988 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00bbb0 con 0x7f8bcc159890 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 -- 172.21.15.22:0/3124304988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc159890 msgr2=0x7f8bcc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3124304988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc159890 0x7f8bcc15abd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc06a890 tx=0x7f8bbc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 -- 172.21.15.22:0/3124304988 shutdown_connections 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3124304988 >> v2:172.21.15.192:3300/0 conn(0x7f8bcc069560 0x7f8bcc0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3124304988 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc159890 0x7f8bcc15abd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 -- 172.21.15.22:0/3124304988 >> 172.21.15.22:0/3124304988 conn(0x7f8bcc068e20 msgr2=0x7f8bcc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 -- 172.21.15.22:0/3124304988 shutdown_connections 2023-10-08T00:30:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.964+0000 7f8bd4710700 1 -- 172.21.15.22:0/3124304988 wait complete. 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.965+0000 7f8bd4710700 1 Processor -- start 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.965+0000 7f8bd4710700 1 -- start start 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd4710700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 0x7f8bcc0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd4710700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bcc159890 0x7f8bcc153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd4710700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bcc159c60 0x7f8bcc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd4710700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc155c90 con 0x7f8bcc069560 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd4710700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc156810 con 0x7f8bcc159c60 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd4710700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc155ee0 con 0x7f8bcc159890 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 0x7f8bcc0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 0x7f8bcc0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56428/0 (socket says 172.21.15.22:56428) 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3349338963 learned_addr learned my addr 172.21.15.22:0/3349338963 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd2cad700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bcc159c60 0x7f8bcc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd1cab700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bcc159890 0x7f8bcc153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bcc159890 msgr2=0x7f8bcc153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bcc159890 0x7f8bcc153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bcc159c60 msgr2=0x7f8bcc0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bcc159c60 0x7f8bcc0ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd24ac700 1 -- 172.21.15.22:0/3349338963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc009420 con 0x7f8bcc069560 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.966+0000 7f8bd2cad700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bcc159c60 0x7f8bcc0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.967+0000 7f8bd24ac700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 0x7f8bcc0cd0c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc070e20 tx=0x7f8bbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.967+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc00b980 con 0x7f8bcc069560 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.967+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00bb00 con 0x7f8bcc069560 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.967+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc1561c0 con 0x7f8bcc069560 2023-10-08T00:30:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.967+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc025670 con 0x7f8bcc069560 2023-10-08T00:30:21.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.967+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc0cd600 con 0x7f8bcc069560 2023-10-08T00:30:21.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.968+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc156660 con 0x7f8bcc069560 2023-10-08T00:30:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.968+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8bbc023070 con 0x7f8bcc069560 2023-10-08T00:30:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.969+0000 7f8bca7fc700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bb8067170 0x7f8bb8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.969+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bbc085f00 con 0x7f8bcc069560 2023-10-08T00:30:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.969+0000 7f8bd1cab700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bb8067170 0x7f8bb8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.969+0000 7f8bd1cab700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bb8067170 0x7f8bb8069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc1548e0 tx=0x7f8bc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:21.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:21.973+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bbc052ee0 con 0x7f8bcc069560 2023-10-08T00:30:22.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.210+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8bcc04c3c0 con 0x7f8bcc069560 2023-10-08T00:30:22.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.817+0000 7f8bca7fc700 1 -- 172.21.15.22:0/3349338963 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8bbc056500 con 0x7f8bcc069560 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bb8067170 msgr2=0x7f8bb8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bb8067170 0x7f8bb8069620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc1548e0 tx=0x7f8bc0009040 comp rx=0 tx=0).stop 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 msgr2=0x7f8bcc0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 0x7f8bcc0cd0c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc070e20 tx=0x7f8bbc017000 comp rx=0 tx=0).stop 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 shutdown_connections 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bcc159c60 0x7f8bcc0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bcc069560 0x7f8bcc0cd0c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bb8067170 0x7f8bb8069620 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 --2- 172.21.15.22:0/3349338963 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bcc159890 0x7f8bcc153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 >> 172.21.15.22:0/3349338963 conn(0x7f8bcc068e20 msgr2=0x7f8bcc0d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:22.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 shutdown_connections 2023-10-08T00:30:22.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.820+0000 7f8bd4710700 1 -- 172.21.15.22:0/3349338963 wait complete. 2023-10-08T00:30:22.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:22.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.957+0000 7f40e759e700 1 Processor -- start 2023-10-08T00:30:22.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.957+0000 7f40e759e700 1 -- start start 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40e8159420 0x7f40e80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40e81597f0 0x7f40e80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e80b11d0 con 0x7f40e815d230 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e759e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e80b14b0 con 0x7f40e8159420 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e80b1790 con 0x7f40e81597f0 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40e8159420 0x7f40e80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40e8159420 0x7f40e80b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56436/0 (socket says 172.21.15.22:56436) 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 -- 172.21.15.22:0/353236077 learned_addr learned my addr 172.21.15.22:0/353236077 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:22.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 -- 172.21.15.22:0/353236077 >> v2:172.21.15.192:3300/0 conn(0x7f40e81597f0 msgr2=0x7f40e80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 --2- 172.21.15.22:0/353236077 >> v2:172.21.15.192:3300/0 conn(0x7f40e81597f0 0x7f40e80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 -- 172.21.15.22:0/353236077 >> v1:172.21.15.192:6789/0 conn(0x7f40e815d230 legacy=0x7f40e815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.958+0000 7f40e659c700 1 -- 172.21.15.22:0/353236077 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e80b1a70 con 0x7f40e8159420 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e659c700 1 --2- 172.21.15.22:0/353236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e80b5f40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f40e8089750 tx=0x7f40d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c39cb005bbbcf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e559a700 1 -- 172.21.15.22:0/353236077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800e070 con 0x7f40e8159420 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e559a700 1 -- 172.21.15.22:0/353236077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800ba10 con 0x7f40e8159420 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e559a700 1 -- 172.21.15.22:0/353236077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80092e0 con 0x7f40e8159420 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 -- 172.21.15.22:0/353236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 msgr2=0x7f40e80b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 --2- 172.21.15.22:0/353236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e80b5f40 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f40e8089750 tx=0x7f40d8009840 comp rx=0 tx=0).stop 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 -- 172.21.15.22:0/353236077 shutdown_connections 2023-10-08T00:30:22.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 --2- 172.21.15.22:0/353236077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e80b5f40 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 --2- 172.21.15.22:0/353236077 >> v2:172.21.15.192:3300/0 conn(0x7f40e81597f0 0x7f40e80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 -- 172.21.15.22:0/353236077 >> 172.21.15.22:0/353236077 conn(0x7f40e80d0660 msgr2=0x7f40e80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 -- 172.21.15.22:0/353236077 shutdown_connections 2023-10-08T00:30:22.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.959+0000 7f40e759e700 1 -- 172.21.15.22:0/353236077 wait complete. 2023-10-08T00:30:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 Processor -- start 2023-10-08T00:30:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 -- start start 2023-10-08T00:30:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:22.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e81597f0 0x7f40e80ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e815d230 0x7f40e80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80c7530 con 0x7f40e8159420 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e80c70a0 con 0x7f40e815d230 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e814a660 con 0x7f40e81597f0 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e814a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56446/0 (socket says 172.21.15.22:56446) 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.961+0000 7f40e659c700 1 -- 172.21.15.22:0/2660437256 learned_addr learned my addr 172.21.15.22:0/2660437256 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e6d9d700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e815d230 0x7f40e80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e5d9b700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e81597f0 0x7f40e80ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e659c700 1 -- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e81597f0 msgr2=0x7f40e80ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:22.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e659c700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e81597f0 0x7f40e80ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e659c700 1 -- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e815d230 msgr2=0x7f40e80ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e659c700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e815d230 0x7f40e80ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e659c700 1 -- 172.21.15.22:0/2660437256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8009ae0 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e659c700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e814a120 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009430 tx=0x7f40d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8012aa0 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8012c00 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e80c6490 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d801e430 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.962+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e80c6a50 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.963+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e804c3c0 con 0x7f40e8159420 2023-10-08T00:30:22.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.963+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f40d801e820 con 0x7f40e8159420 2023-10-08T00:30:22.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.964+0000 7f40de7fc700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:22.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.964+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40d8086430 con 0x7f40e8159420 2023-10-08T00:30:22.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.964+0000 7f40e5d9b700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:22.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.965+0000 7f40e5d9b700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f40c8067170 0x7f40c8069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f40d0006fd0 tx=0x7f40d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:22.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:22.968+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40d8053300 con 0x7f40e8159420 2023-10-08T00:30:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.206+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e80b1d50 con 0x7f40e8159420 2023-10-08T00:30:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.207+0000 7f40de7fc700 1 -- 172.21.15.22:0/2660437256 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f40d8056920 con 0x7f40e8159420 2023-10-08T00:30:23.207 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:23.208 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:19.209800+0000","modified":"2023-10-08T00:30:22.812658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/2279072181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2279072181},{"type":"v1","addr":"172.21.15.22:6835","nonce":2279072181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f40c8067170 msgr2=0x7f40c8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f40c8067170 0x7f40c8069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f40d0006fd0 tx=0x7f40d0008040 comp rx=0 tx=0).stop 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 msgr2=0x7f40e814a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e814a120 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009430 tx=0x7f40d8017000 comp rx=0 tx=0).stop 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 shutdown_connections 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40e815d230 0x7f40e80ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40e8159420 0x7f40e814a120 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 --2- 172.21.15.22:0/2660437256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40e81597f0 0x7f40e80ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 >> 172.21.15.22:0/2660437256 conn(0x7f40e80d0660 msgr2=0x7f40e8158670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:23.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 shutdown_connections 2023-10-08T00:30:23.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.209+0000 7f40e759e700 1 -- 172.21.15.22:0/2660437256 wait complete. 2023-10-08T00:30:23.211 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 51 2023-10-08T00:30:23.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:23.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.341+0000 7fb553307700 1 Processor -- start 2023-10-08T00:30:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.341+0000 7fb553307700 1 -- start start 2023-10-08T00:30:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb553307700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb54c068aa0 0x7fb54c1628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb553307700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c06b030 con 0x7fb54c0af250 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb553307700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c06bbe0 con 0x7fb54c157960 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb553307700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0ac760 con 0x7fb54c068aa0 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb5508a2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb54c0af250 0x7fb54c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36742/0 (socket says 172.21.15.22:36742) 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb5508a2700 1 -- 172.21.15.22:0/2063707325 learned_addr learned my addr 172.21.15.22:0/2063707325 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb5518a4700 1 --2- 172.21.15.22:0/2063707325 >> v2:172.21.15.192:3300/0 conn(0x7fb54c068aa0 0x7fb54c1628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb54bfff700 1 -- 172.21.15.22:0/2063707325 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417208265 0 0) 0x7fb54c06b030 con 0x7fb54c0af250 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.342+0000 7fb54bfff700 1 -- 172.21.15.22:0/2063707325 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb534003570 con 0x7fb54c0af250 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb5518a4700 1 -- 172.21.15.22:0/2063707325 >> v1:172.21.15.192:6789/0 conn(0x7fb54c157960 legacy=0x7fb54c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb54bfff700 1 -- 172.21.15.22:0/2063707325 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2708026209 0 0) 0x7fb534003570 con 0x7fb54c0af250 2023-10-08T00:30:23.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb5518a4700 1 -- 172.21.15.22:0/2063707325 >> v1:172.21.15.22:6789/0 conn(0x7fb54c0af250 legacy=0x7fb54c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb5518a4700 1 -- 172.21.15.22:0/2063707325 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0c7f60 con 0x7fb54c068aa0 2023-10-08T00:30:23.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb5518a4700 1 --2- 172.21.15.22:0/2063707325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c1628a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e60 tx=0x7fb544009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf7acc50500fa615 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:23.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb54bfff700 1 -- 172.21.15.22:0/2063707325 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400e070 con 0x7fb54c068aa0 2023-10-08T00:30:23.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb54bfff700 1 -- 172.21.15.22:0/2063707325 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400b850 con 0x7fb54c068aa0 2023-10-08T00:30:23.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb54bfff700 1 -- 172.21.15.22:0/2063707325 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb540001470 con 0x7fb54c068aa0 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb553307700 1 -- 172.21.15.22:0/2063707325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 msgr2=0x7fb54c1628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.343+0000 7fb553307700 1 --2- 172.21.15.22:0/2063707325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c1628a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e60 tx=0x7fb544009780 comp rx=0 tx=0).stop 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.344+0000 7fb553307700 1 -- 172.21.15.22:0/2063707325 shutdown_connections 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.344+0000 7fb553307700 1 --2- 172.21.15.22:0/2063707325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c1628a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.344+0000 7fb553307700 1 -- 172.21.15.22:0/2063707325 >> 172.21.15.22:0/2063707325 conn(0x7fb54c0c9870 msgr2=0x7fb54c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.344+0000 7fb553307700 1 -- 172.21.15.22:0/2063707325 shutdown_connections 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.344+0000 7fb553307700 1 -- 172.21.15.22:0/2063707325 wait complete. 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.345+0000 7fb553307700 1 Processor -- start 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.345+0000 7fb553307700 1 -- start start 2023-10-08T00:30:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb54c0af250 0x7fb54c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 0x7fb54c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0af830 con 0x7fb54c157960 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15ca40 con 0x7fb54c068aa0 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0c4630 con 0x7fb54c0af250 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 0x7fb54c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 0x7fb54c156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56452/0 (socket says 172.21.15.22:56452) 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 -- 172.21.15.22:0/4200605112 learned_addr learned my addr 172.21.15.22:0/4200605112 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 -- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb54c0af250 msgr2=0x7fb54c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb54c0af250 0x7fb54c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5510a3700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 -- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 msgr2=0x7fb54c147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 -- 172.21.15.22:0/4200605112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009a20 con 0x7fb54c157960 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5518a4700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 0x7fb54c156760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb54c064930 tx=0x7fb544017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544012de0 con 0x7fb54c157960 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54401e450 con 0x7fb54c157960 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c15c760 con 0x7fb54c157960 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54401e810 con 0x7fb54c157960 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.346+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c0c42c0 con 0x7fb54c157960 2023-10-08T00:30:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.347+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c04c3c0 con 0x7fb54c157960 2023-10-08T00:30:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.348+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb54401ec00 con 0x7fb54c157960 2023-10-08T00:30:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.348+0000 7fb5497fa700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb538067170 0x7fb538069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.348+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb544086e50 con 0x7fb54c157960 2023-10-08T00:30:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.348+0000 7fb5510a3700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb538067170 0x7fb538069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.349+0000 7fb5510a3700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb538067170 0x7fb538069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb53c001760 tx=0x7fb53c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:23.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.353+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb544053d20 con 0x7fb54c157960 2023-10-08T00:30:23.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.547+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb54c0c4770 con 0x7fb54c157960 2023-10-08T00:30:23.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.548+0000 7fb5497fa700 1 -- 172.21.15.22:0/4200605112 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7fb544057340 con 0x7fb54c157960 2023-10-08T00:30:23.549 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:23.549 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":78,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:20.606387+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:17.609244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:18.173807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:23.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb538067170 msgr2=0x7fb538069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb538067170 0x7fb538069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb53c001760 tx=0x7fb53c009040 comp rx=0 tx=0).stop 2023-10-08T00:30:23.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 msgr2=0x7fb54c156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 0x7fb54c156760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb54c064930 tx=0x7fb544017000 comp rx=0 tx=0).stop 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 shutdown_connections 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb54c157960 0x7fb54c156760 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb54c068aa0 0x7fb54c147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb538067170 0x7fb538069620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 --2- 172.21.15.22:0/4200605112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb54c0af250 0x7fb54c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 >> 172.21.15.22:0/4200605112 conn(0x7fb54c0c9870 msgr2=0x7fb54c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.550+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 shutdown_connections 2023-10-08T00:30:23.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.551+0000 7fb553307700 1 -- 172.21.15.22:0/4200605112 wait complete. 2023-10-08T00:30:23.563 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:30:23.563 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:23.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 Processor -- start 2023-10-08T00:30:23.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 -- start start 2023-10-08T00:30:23.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2f0159c60 0x7fe2f015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe2f015db10 0x7fe2f0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f015a160 con 0x7fe2f0159890 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f015df50 con 0x7fe2f0159c60 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.683+0000 7fe2f5c39700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00d13a0 con 0x7fe2f015db10 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2f0159c60 0x7fe2f015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2f0159c60 0x7fe2f015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56466/0 (socket says 172.21.15.22:56466) 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 -- 172.21.15.22:0/4192649682 learned_addr learned my addr 172.21.15.22:0/4192649682 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2effff700 1 --2- 172.21.15.22:0/4192649682 >> v2:172.21.15.192:3300/0 conn(0x7fe2f015db10 0x7fe2f0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 -- 172.21.15.22:0/4192649682 >> v2:172.21.15.192:3300/0 conn(0x7fe2f015db10 msgr2=0x7fe2f0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 --2- 172.21.15.22:0/4192649682 >> v2:172.21.15.192:3300/0 conn(0x7fe2f015db10 0x7fe2f0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 -- 172.21.15.22:0/4192649682 >> v1:172.21.15.192:6789/0 conn(0x7fe2f0159890 legacy=0x7fe2f015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 -- 172.21.15.22:0/4192649682 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f015e140 con 0x7fe2f0159c60 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2effff700 1 --2- 172.21.15.22:0/4192649682 >> v2:172.21.15.192:3300/0 conn(0x7fe2f015db10 0x7fe2f0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2eeffd700 1 --2- 172.21.15.22:0/4192649682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f0159c60 0x7fe2f015d5d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe2f006a890 tx=0x7fe2e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa20e31581b8606a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2ee7fc700 1 -- 172.21.15.22:0/4192649682 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400b820 con 0x7fe2f0159c60 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2ee7fc700 1 -- 172.21.15.22:0/4192649682 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e400b980 con 0x7fe2f0159c60 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.684+0000 7fe2ee7fc700 1 -- 172.21.15.22:0/4192649682 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400bd20 con 0x7fe2f0159c60 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 -- 172.21.15.22:0/4192649682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f0159c60 msgr2=0x7fe2f015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/4192649682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f0159c60 0x7fe2f015d5d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe2f006a890 tx=0x7fe2e4009250 comp rx=0 tx=0).stop 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 -- 172.21.15.22:0/4192649682 shutdown_connections 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/4192649682 >> v2:172.21.15.192:3300/0 conn(0x7fe2f015db10 0x7fe2f0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/4192649682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f0159c60 0x7fe2f015d5d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 -- 172.21.15.22:0/4192649682 >> 172.21.15.22:0/4192649682 conn(0x7fe2f0068e20 msgr2=0x7fe2f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:23.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 -- 172.21.15.22:0/4192649682 shutdown_connections 2023-10-08T00:30:23.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.685+0000 7fe2f5c39700 1 -- 172.21.15.22:0/4192649682 wait complete. 2023-10-08T00:30:23.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.686+0000 7fe2f5c39700 1 Processor -- start 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.686+0000 7fe2f5c39700 1 -- start start 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2f5c39700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f0159890 0x7fe2f00ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2f5c39700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f0159c60 0x7fe2f00b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2f5c39700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 0x7fe2f00b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2f5c39700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f014ce60 con 0x7fe2f015db10 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2f5c39700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b1d90 con 0x7fe2f0159c60 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2f5c39700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00b6450 con 0x7fe2f0159890 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 0x7fe2f00b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 0x7fe2f00b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56478/0 (socket says 172.21.15.22:56478) 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 -- 172.21.15.22:0/3857078874 learned_addr learned my addr 172.21.15.22:0/3857078874 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:23.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2eeffd700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f0159c60 0x7fe2f00b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 -- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f0159890 msgr2=0x7fe2f00ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f0159890 0x7fe2f00ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 -- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f0159c60 msgr2=0x7fe2f00b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f0159c60 0x7fe2f00b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2effff700 1 -- 172.21.15.22:0/3857078874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40094f0 con 0x7fe2f015db10 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.687+0000 7fe2eeffd700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f0159c60 0x7fe2f00b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.688+0000 7fe2effff700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 0x7fe2f00b0880 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c850 tx=0x7fe2e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.688+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8011600 con 0x7fe2f015db10 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.688+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e8011760 con 0x7fe2f015db10 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.688+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8011b20 con 0x7fe2f015db10 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.688+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f00b1180 con 0x7fe2f015db10 2023-10-08T00:30:23.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.688+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f00b17c0 con 0x7fe2f015db10 2023-10-08T00:30:23.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.689+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f004c3c0 con 0x7fe2f015db10 2023-10-08T00:30:23.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.689+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fe2e8018350 con 0x7fe2f015db10 2023-10-08T00:30:23.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.690+0000 7fe2d77fe700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe2dc067170 0x7fe2dc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:23.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.690+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2e8084990 con 0x7fe2f015db10 2023-10-08T00:30:23.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.690+0000 7fe2ef7fe700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe2dc067170 0x7fe2dc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:23.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.690+0000 7fe2ef7fe700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe2dc067170 0x7fe2dc069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0002d90 tx=0x7fe2e0007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:23.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.694+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2e8051860 con 0x7fe2f015db10 2023-10-08T00:30:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.887+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2f00b1ae0 con 0x7fe2dc067170 2023-10-08T00:30:23.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.896+0000 7fe2d77fe700 1 -- 172.21.15.22:0/3857078874 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289412 (secure 0 0 0) 0x7fe2f00b1ae0 con 0x7fe2dc067170 2023-10-08T00:30:23.900 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe2dc067170 msgr2=0x7fe2dc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe2dc067170 0x7fe2dc069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0002d90 tx=0x7fe2e0007ea0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 msgr2=0x7fe2f00b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 0x7fe2f00b0880 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800c850 tx=0x7fe2e8008040 comp rx=0 tx=0).stop 2023-10-08T00:30:23.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 shutdown_connections 2023-10-08T00:30:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2f015db10 0x7fe2f00b0880 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe2dc067170 0x7fe2dc069620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe2f0159890 0x7fe2f00ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 --2- 172.21.15.22:0/3857078874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2f0159c60 0x7fe2f00b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.899+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 >> 172.21.15.22:0/3857078874 conn(0x7fe2f0068e20 msgr2=0x7fe2f0157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:23.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.900+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 shutdown_connections 2023-10-08T00:30:23.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:23.900+0000 7fe2f5c39700 1 -- 172.21.15.22:0/3857078874 wait complete. 2023-10-08T00:30:23.906 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:23.912 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-10-08T00:30:22.462135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403288,"kb_used_data":8600,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752571432,"statfs":{"total":773094113280,"available":770633146368,"internally_reserved":0,"allocated":8806400,"data_stored":4433030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.671220"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629905+0000","last_change":"2023-10-08T00:30:19.629905+0000","last_active":"2023-10-08T00:30:19.629905+0000","last_peered":"2023-10-08T00:30:19.629905+0000","last_clean":"2023-10-08T00:30:19.629905+0000","last_became_active":"2023-10-08T00:30:19.629455+0000","last_became_peered":"2023-10-08T00:30:19.629455+0000","last_unstale":"2023-10-08T00:30:19.629905+0000","last_undegraded":"2023-10-08T00:30:19.629905+0000","last_fullsized":"2023-10-08T00:30:19.629905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626982+0000","last_change":"2023-10-08T00:30:19.626982+0000","last_active":"2023-10-08T00:30:19.626982+0000","last_peered":"2023-10-08T00:30:19.626982+0000","last_clean":"2023-10-08T00:30:19.626982+0000","last_became_active":"2023-10-08T00:30:19.626620+0000","last_became_peered":"2023-10-08T00:30:19.626620+0000","last_unstale":"2023-10-08T00:30:19.626982+0000","last_undegraded":"2023-10-08T00:30:19.626982+0000","last_fullsized":"2023-10-08T00:30:19.626982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626608+0000","last_change":"2023-10-08T00:30:19.626608+0000","last_active":"2023-10-08T00:30:19.626608+0000","last_peered":"2023-10-08T00:30:19.626608+0000","last_clean":"2023-10-08T00:30:19.626608+0000","last_became_active":"2023-10-08T00:30:19.626304+0000","last_became_peered":"2023-10-08T00:30:19.626304+0000","last_unstale":"2023-10-08T00:30:19.626608+0000","last_undegraded":"2023-10-08T00:30:19.626608+0000","last_fullsized":"2023-10-08T00:30:19.626608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:08.514756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623740+0000","last_change":"2023-10-08T00:30:19.623740+0000","last_active":"2023-10-08T00:30:19.623740+0000","last_peered":"2023-10-08T00:30:19.623740+0000","last_clean":"2023-10-08T00:30:19.623740+0000","last_became_active":"2023-10-08T00:30:19.621933+0000","last_became_peered":"2023-10-08T00:30:19.621933+0000","last_unstale":"2023-10-08T00:30:19.623740+0000","last_undegraded":"2023-10-08T00:30:19.623740+0000","last_fullsized":"2023-10-08T00:30:19.623740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:22.496168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623453+0000","last_change":"2023-10-08T00:30:19.623453+0000","last_active":"2023-10-08T00:30:19.623453+0000","last_peered":"2023-10-08T00:30:19.623453+0000","last_clean":"2023-10-08T00:30:19.623453+0000","last_became_active":"2023-10-08T00:30:19.623145+0000","last_became_peered":"2023-10-08T00:30:19.623145+0000","last_unstale":"2023-10-08T00:30:19.623453+0000","last_undegraded":"2023-10-08T00:30:19.623453+0000","last_fullsized":"2023-10-08T00:30:19.623453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:16.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614360+0000","last_change":"2023-10-08T00:30:19.614360+0000","last_active":"2023-10-08T00:30:19.614360+0000","last_peered":"2023-10-08T00:30:19.614360+0000","last_clean":"2023-10-08T00:30:19.614360+0000","last_became_active":"2023-10-08T00:30:19.614092+0000","last_became_peered":"2023-10-08T00:30:19.614092+0000","last_unstale":"2023-10-08T00:30:19.614360+0000","last_undegraded":"2023-10-08T00:30:19.614360+0000","last_fullsized":"2023-10-08T00:30:19.614360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:53.989941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627421+0000","last_change":"2023-10-08T00:30:19.627421+0000","last_active":"2023-10-08T00:30:19.627421+0000","last_peered":"2023-10-08T00:30:19.627421+0000","last_clean":"2023-10-08T00:30:19.627421+0000","last_became_active":"2023-10-08T00:30:19.627112+0000","last_became_peered":"2023-10-08T00:30:19.627112+0000","last_unstale":"2023-10-08T00:30:19.627421+0000","last_undegraded":"2023-10-08T00:30:19.627421+0000","last_fullsized":"2023-10-08T00:30:19.627421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:02:32.715203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.619174+0000","last_change":"2023-10-08T00:30:19.619174+0000","last_active":"2023-10-08T00:30:19.619174+0000","last_peered":"2023-10-08T00:30:19.619174+0000","last_clean":"2023-10-08T00:30:19.619174+0000","last_became_active":"2023-10-08T00:30:19.618887+0000","last_became_peered":"2023-10-08T00:30:19.618887+0000","last_unstale":"2023-10-08T00:30:19.619174+0000","last_undegraded":"2023-10-08T00:30:19.619174+0000","last_fullsized":"2023-10-08T00:30:19.619174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:32.779686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.617476+0000","last_change":"2023-10-08T00:30:19.617476+0000","last_active":"2023-10-08T00:30:19.617476+0000","last_peered":"2023-10-08T00:30:19.617476+0000","last_clean":"2023-10-08T00:30:19.617476+0000","last_became_active":"2023-10-08T00:30:19.617118+0000","last_became_peered":"2023-10-08T00:30:19.617118+0000","last_unstale":"2023-10-08T00:30:19.617476+0000","last_undegraded":"2023-10-08T00:30:19.617476+0000","last_fullsized":"2023-10-08T00:30:19.617476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:37.112618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621629+0000","last_change":"2023-10-08T00:30:19.621629+0000","last_active":"2023-10-08T00:30:19.621629+0000","last_peered":"2023-10-08T00:30:19.621629+0000","last_clean":"2023-10-08T00:30:19.621629+0000","last_became_active":"2023-10-08T00:30:19.620752+0000","last_became_peered":"2023-10-08T00:30:19.620752+0000","last_unstale":"2023-10-08T00:30:19.621629+0000","last_undegraded":"2023-10-08T00:30:19.621629+0000","last_fullsized":"2023-10-08T00:30:19.621629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:52:01.918902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.628341+0000","last_change":"2023-10-08T00:30:19.628341+0000","last_active":"2023-10-08T00:30:19.628341+0000","last_peered":"2023-10-08T00:30:19.628341+0000","last_clean":"2023-10-08T00:30:19.628341+0000","last_became_active":"2023-10-08T00:30:19.627990+0000","last_became_peered":"2023-10-08T00:30:19.627990+0000","last_unstale":"2023-10-08T00:30:19.628341+0000","last_undegraded":"2023-10-08T00:30:19.628341+0000","last_fullsized":"2023-10-08T00:30:19.628341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:56.372954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622769+0000","last_change":"2023-10-08T00:30:19.622769+0000","last_active":"2023-10-08T00:30:19.622769+0000","last_peered":"2023-10-08T00:30:19.622769+0000","last_clean":"2023-10-08T00:30:19.622769+0000","last_became_active":"2023-10-08T00:30:19.622076+0000","last_became_peered":"2023-10-08T00:30:19.622076+0000","last_unstale":"2023-10-08T00:30:19.622769+0000","last_undegraded":"2023-10-08T00:30:19.622769+0000","last_fullsized":"2023-10-08T00:30:19.622769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:56.372954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627755+0000","last_change":"2023-10-08T00:30:19.627755+0000","last_active":"2023-10-08T00:30:19.627755+0000","last_peered":"2023-10-08T00:30:19.627755+0000","last_clean":"2023-10-08T00:30:19.627755+0000","last_became_active":"2023-10-08T00:30:19.627460+0000","last_became_peered":"2023-10-08T00:30:19.627460+0000","last_unstale":"2023-10-08T00:30:19.627755+0000","last_undegraded":"2023-10-08T00:30:19.627755+0000","last_fullsized":"2023-10-08T00:30:19.627755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:23.695763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622826+0000","last_change":"2023-10-08T00:30:19.622826+0000","last_active":"2023-10-08T00:30:19.622826+0000","last_peered":"2023-10-08T00:30:19.622826+0000","last_clean":"2023-10-08T00:30:19.622826+0000","last_became_active":"2023-10-08T00:30:19.622541+0000","last_became_peered":"2023-10-08T00:30:19.622541+0000","last_unstale":"2023-10-08T00:30:19.622826+0000","last_undegraded":"2023-10-08T00:30:19.622826+0000","last_fullsized":"2023-10-08T00:30:19.622826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:28:09.198208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.625798+0000","last_change":"2023-10-08T00:30:19.625798+0000","last_active":"2023-10-08T00:30:19.625798+0000","last_peered":"2023-10-08T00:30:19.625798+0000","last_clean":"2023-10-08T00:30:19.625798+0000","last_became_active":"2023-10-08T00:30:19.625500+0000","last_became_peered":"2023-10-08T00:30:19.625500+0000","last_unstale":"2023-10-08T00:30:19.625798+0000","last_undegraded":"2023-10-08T00:30:19.625798+0000","last_fullsized":"2023-10-08T00:30:19.625798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:49:54.323854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623889+0000","last_change":"2023-10-08T00:30:19.623889+0000","last_active":"2023-10-08T00:30:19.623889+0000","last_peered":"2023-10-08T00:30:19.623889+0000","last_clean":"2023-10-08T00:30:19.623889+0000","last_became_active":"2023-10-08T00:30:19.623601+0000","last_became_peered":"2023-10-08T00:30:19.623601+0000","last_unstale":"2023-10-08T00:30:19.623889+0000","last_undegraded":"2023-10-08T00:30:19.623889+0000","last_fullsized":"2023-10-08T00:30:19.623889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:06.489321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627303+0000","last_change":"2023-10-08T00:30:19.627303+0000","last_active":"2023-10-08T00:30:19.627303+0000","last_peered":"2023-10-08T00:30:19.627303+0000","last_clean":"2023-10-08T00:30:19.627303+0000","last_became_active":"2023-10-08T00:30:19.626482+0000","last_became_peered":"2023-10-08T00:30:19.626482+0000","last_unstale":"2023-10-08T00:30:19.627303+0000","last_undegraded":"2023-10-08T00:30:19.627303+0000","last_fullsized":"2023-10-08T00:30:19.627303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622670+0000","last_change":"2023-10-08T00:30:19.622670+0000","last_active":"2023-10-08T00:30:19.622670+0000","last_peered":"2023-10-08T00:30:19.622670+0000","last_clean":"2023-10-08T00:30:19.622670+0000","last_became_active":"2023-10-08T00:30:19.621980+0000","last_became_peered":"2023-10-08T00:30:19.621980+0000","last_unstale":"2023-10-08T00:30:19.622670+0000","last_undegraded":"2023-10-08T00:30:19.622670+0000","last_fullsized":"2023-10-08T00:30:19.622670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:29.433981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.615805+0000","last_change":"2023-10-08T00:30:19.615805+0000","last_active":"2023-10-08T00:30:19.615805+0000","last_peered":"2023-10-08T00:30:19.615805+0000","last_clean":"2023-10-08T00:30:19.615805+0000","last_became_active":"2023-10-08T00:30:19.615420+0000","last_became_peered":"2023-10-08T00:30:19.615420+0000","last_unstale":"2023-10-08T00:30:19.615805+0000","last_undegraded":"2023-10-08T00:30:19.615805+0000","last_fullsized":"2023-10-08T00:30:19.615805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:07:44.257681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614795+0000","last_change":"2023-10-08T00:30:19.614795+0000","last_active":"2023-10-08T00:30:19.614795+0000","last_peered":"2023-10-08T00:30:19.614795+0000","last_clean":"2023-10-08T00:30:19.614795+0000","last_became_active":"2023-10-08T00:30:19.614523+0000","last_became_peered":"2023-10-08T00:30:19.614523+0000","last_unstale":"2023-10-08T00:30:19.614795+0000","last_undegraded":"2023-10-08T00:30:19.614795+0000","last_fullsized":"2023-10-08T00:30:19.614795+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:49.651053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620342+0000","last_change":"2023-10-08T00:30:19.620342+0000","last_active":"2023-10-08T00:30:19.620342+0000","last_peered":"2023-10-08T00:30:19.620342+0000","last_clean":"2023-10-08T00:30:19.620342+0000","last_became_active":"2023-10-08T00:30:19.620079+0000","last_became_peered":"2023-10-08T00:30:19.620079+0000","last_unstale":"2023-10-08T00:30:19.620342+0000","last_undegraded":"2023-10-08T00:30:19.620342+0000","last_fullsized":"2023-10-08T00:30:19.620342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:42.248952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621454+0000","last_change":"2023-10-08T00:30:19.621454+0000","last_active":"2023-10-08T00:30:19.621454+0000","last_peered":"2023-10-08T00:30:19.621454+0000","last_clean":"2023-10-08T00:30:19.621454+0000","last_became_active":"2023-10-08T00:30:19.621172+0000","last_became_peered":"2023-10-08T00:30:19.621172+0000","last_unstale":"2023-10-08T00:30:19.621454+0000","last_undegraded":"2023-10-08T00:30:19.621454+0000","last_fullsized":"2023-10-08T00:30:19.621454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621620+0000","last_change":"2023-10-08T00:30:19.621620+0000","last_active":"2023-10-08T00:30:19.621620+0000","last_peered":"2023-10-08T00:30:19.621620+0000","last_clean":"2023-10-08T00:30:19.621620+0000","last_became_active":"2023-10-08T00:30:19.620214+0000","last_became_peered":"2023-10-08T00:30:19.620214+0000","last_unstale":"2023-10-08T00:30:19.621620+0000","last_undegraded":"2023-10-08T00:30:19.621620+0000","last_fullsized":"2023-10-08T00:30:19.621620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:13:30.458026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623574+0000","last_change":"2023-10-08T00:30:19.623574+0000","last_active":"2023-10-08T00:30:19.623574+0000","last_peered":"2023-10-08T00:30:19.623574+0000","last_clean":"2023-10-08T00:30:19.623574+0000","last_became_active":"2023-10-08T00:30:19.623321+0000","last_became_peered":"2023-10-08T00:30:19.623321+0000","last_unstale":"2023-10-08T00:30:19.623574+0000","last_undegraded":"2023-10-08T00:30:19.623574+0000","last_fullsized":"2023-10-08T00:30:19.623574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:24.104140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626995+0000","last_change":"2023-10-08T00:30:19.626995+0000","last_active":"2023-10-08T00:30:19.626995+0000","last_peered":"2023-10-08T00:30:19.626995+0000","last_clean":"2023-10-08T00:30:19.626995+0000","last_became_active":"2023-10-08T00:30:19.626678+0000","last_became_peered":"2023-10-08T00:30:19.626678+0000","last_unstale":"2023-10-08T00:30:19.626995+0000","last_undegraded":"2023-10-08T00:30:19.626995+0000","last_fullsized":"2023-10-08T00:30:19.626995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:24:50.842623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623405+0000","last_change":"2023-10-08T00:30:19.623405+0000","last_active":"2023-10-08T00:30:19.623405+0000","last_peered":"2023-10-08T00:30:19.623405+0000","last_clean":"2023-10-08T00:30:19.623405+0000","last_became_active":"2023-10-08T00:30:19.623084+0000","last_became_peered":"2023-10-08T00:30:19.623084+0000","last_unstale":"2023-10-08T00:30:19.623405+0000","last_undegraded":"2023-10-08T00:30:19.623405+0000","last_fullsized":"2023-10-08T00:30:19.623405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:43.459644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629543+0000","last_change":"2023-10-08T00:30:19.629543+0000","last_active":"2023-10-08T00:30:19.629543+0000","last_peered":"2023-10-08T00:30:19.629543+0000","last_clean":"2023-10-08T00:30:19.629543+0000","last_became_active":"2023-10-08T00:30:19.628924+0000","last_became_peered":"2023-10-08T00:30:19.628924+0000","last_unstale":"2023-10-08T00:30:19.629543+0000","last_undegraded":"2023-10-08T00:30:19.629543+0000","last_fullsized":"2023-10-08T00:30:19.629543+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:30.808829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.630008+0000","last_change":"2023-10-08T00:30:19.630008+0000","last_active":"2023-10-08T00:30:19.630008+0000","last_peered":"2023-10-08T00:30:19.630008+0000","last_clean":"2023-10-08T00:30:19.630008+0000","last_became_active":"2023-10-08T00:30:19.629613+0000","last_became_peered":"2023-10-08T00:30:19.629613+0000","last_unstale":"2023-10-08T00:30:19.630008+0000","last_undegraded":"2023-10-08T00:30:19.630008+0000","last_fullsized":"2023-10-08T00:30:19.630008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:34.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620506+0000","last_change":"2023-10-08T00:30:19.620506+0000","last_active":"2023-10-08T00:30:19.620506+0000","last_peered":"2023-10-08T00:30:19.620506+0000","last_clean":"2023-10-08T00:30:19.620506+0000","last_became_active":"2023-10-08T00:30:19.620259+0000","last_became_peered":"2023-10-08T00:30:19.620259+0000","last_unstale":"2023-10-08T00:30:19.620506+0000","last_undegraded":"2023-10-08T00:30:19.620506+0000","last_fullsized":"2023-10-08T00:30:19.620506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:34.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627642+0000","last_change":"2023-10-08T00:30:19.627642+0000","last_active":"2023-10-08T00:30:19.627642+0000","last_peered":"2023-10-08T00:30:19.627642+0000","last_clean":"2023-10-08T00:30:19.627642+0000","last_became_active":"2023-10-08T00:30:19.627412+0000","last_became_peered":"2023-10-08T00:30:19.627412+0000","last_unstale":"2023-10-08T00:30:19.627642+0000","last_undegraded":"2023-10-08T00:30:19.627642+0000","last_fullsized":"2023-10-08T00:30:19.627642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:34.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627956+0000","last_change":"2023-10-08T00:30:19.627956+0000","last_active":"2023-10-08T00:30:19.627956+0000","last_peered":"2023-10-08T00:30:19.627956+0000","last_clean":"2023-10-08T00:30:19.627956+0000","last_became_active":"2023-10-08T00:30:19.627673+0000","last_became_peered":"2023-10-08T00:30:19.627673+0000","last_unstale":"2023-10-08T00:30:19.627956+0000","last_undegraded":"2023-10-08T00:30:19.627956+0000","last_fullsized":"2023-10-08T00:30:19.627956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:37.112618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622434+0000","last_change":"2023-10-08T00:30:19.622434+0000","last_active":"2023-10-08T00:30:19.622434+0000","last_peered":"2023-10-08T00:30:19.622434+0000","last_clean":"2023-10-08T00:30:19.622434+0000","last_became_active":"2023-10-08T00:30:19.622159+0000","last_became_peered":"2023-10-08T00:30:19.622159+0000","last_unstale":"2023-10-08T00:30:19.622434+0000","last_undegraded":"2023-10-08T00:30:19.622434+0000","last_fullsized":"2023-10-08T00:30:19.622434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:47.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627230+0000","last_change":"2023-10-08T00:30:19.627230+0000","last_active":"2023-10-08T00:30:19.627230+0000","last_peered":"2023-10-08T00:30:19.627230+0000","last_clean":"2023-10-08T00:30:19.627230+0000","last_became_active":"2023-10-08T00:30:19.626975+0000","last_became_peered":"2023-10-08T00:30:19.626975+0000","last_unstale":"2023-10-08T00:30:19.627230+0000","last_undegraded":"2023-10-08T00:30:19.627230+0000","last_fullsized":"2023-10-08T00:30:19.627230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:04.378528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"77'4","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805565+0000","last_change":"2023-10-08T00:30:18.815120+0000","last_active":"2023-10-08T00:30:19.805565+0000","last_peered":"2023-10-08T00:30:19.805565+0000","last_clean":"2023-10-08T00:30:19.805565+0000","last_became_active":"2023-10-08T00:30:18.814871+0000","last_became_peered":"2023-10-08T00:30:18.814871+0000","last_unstale":"2023-10-08T00:30:19.805565+0000","last_undegraded":"2023-10-08T00:30:19.805565+0000","last_fullsized":"2023-10-08T00:30:19.805565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:04.686632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621259+0000","last_change":"2023-10-08T00:30:19.621259+0000","last_active":"2023-10-08T00:30:19.621259+0000","last_peered":"2023-10-08T00:30:19.621259+0000","last_clean":"2023-10-08T00:30:19.621259+0000","last_became_active":"2023-10-08T00:30:19.620979+0000","last_became_peered":"2023-10-08T00:30:19.620979+0000","last_unstale":"2023-10-08T00:30:19.621259+0000","last_undegraded":"2023-10-08T00:30:19.621259+0000","last_fullsized":"2023-10-08T00:30:19.621259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:30.808829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621693+0000","last_change":"2023-10-08T00:30:18.805432+0000","last_active":"2023-10-08T00:30:19.621693+0000","last_peered":"2023-10-08T00:30:19.621693+0000","last_clean":"2023-10-08T00:30:19.621693+0000","last_became_active":"2023-10-08T00:30:18.804861+0000","last_became_peered":"2023-10-08T00:30:18.804861+0000","last_unstale":"2023-10-08T00:30:19.621693+0000","last_undegraded":"2023-10-08T00:30:19.621693+0000","last_fullsized":"2023-10-08T00:30:19.621693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:33:07.281161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622973+0000","last_change":"2023-10-08T00:30:19.622973+0000","last_active":"2023-10-08T00:30:19.622973+0000","last_peered":"2023-10-08T00:30:19.622973+0000","last_clean":"2023-10-08T00:30:19.622973+0000","last_became_active":"2023-10-08T00:30:19.622401+0000","last_became_peered":"2023-10-08T00:30:19.622401+0000","last_unstale":"2023-10-08T00:30:19.622973+0000","last_undegraded":"2023-10-08T00:30:19.622973+0000","last_fullsized":"2023-10-08T00:30:19.622973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:32.779686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805273+0000","last_change":"2023-10-08T00:30:18.810584+0000","last_active":"2023-10-08T00:30:19.805273+0000","last_peered":"2023-10-08T00:30:19.805273+0000","last_clean":"2023-10-08T00:30:19.805273+0000","last_became_active":"2023-10-08T00:30:18.810373+0000","last_became_peered":"2023-10-08T00:30:18.810373+0000","last_unstale":"2023-10-08T00:30:19.805273+0000","last_undegraded":"2023-10-08T00:30:19.805273+0000","last_fullsized":"2023-10-08T00:30:19.805273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:31:14.277840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623164+0000","last_change":"2023-10-08T00:30:19.623164+0000","last_active":"2023-10-08T00:30:19.623164+0000","last_peered":"2023-10-08T00:30:19.623164+0000","last_clean":"2023-10-08T00:30:19.623164+0000","last_became_active":"2023-10-08T00:30:19.622912+0000","last_became_peered":"2023-10-08T00:30:19.622912+0000","last_unstale":"2023-10-08T00:30:19.623164+0000","last_undegraded":"2023-10-08T00:30:19.623164+0000","last_fullsized":"2023-10-08T00:30:19.623164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:49:54.323854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805367+0000","last_change":"2023-10-08T00:30:18.810084+0000","last_active":"2023-10-08T00:30:19.805367+0000","last_peered":"2023-10-08T00:30:19.805367+0000","last_clean":"2023-10-08T00:30:19.805367+0000","last_became_active":"2023-10-08T00:30:18.809801+0000","last_became_peered":"2023-10-08T00:30:18.809801+0000","last_unstale":"2023-10-08T00:30:19.805367+0000","last_undegraded":"2023-10-08T00:30:19.805367+0000","last_fullsized":"2023-10-08T00:30:19.805367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:59:32.042532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626122+0000","last_change":"2023-10-08T00:30:19.626122+0000","last_active":"2023-10-08T00:30:19.626122+0000","last_peered":"2023-10-08T00:30:19.626122+0000","last_clean":"2023-10-08T00:30:19.626122+0000","last_became_active":"2023-10-08T00:30:19.625862+0000","last_became_peered":"2023-10-08T00:30:19.625862+0000","last_unstale":"2023-10-08T00:30:19.626122+0000","last_undegraded":"2023-10-08T00:30:19.626122+0000","last_fullsized":"2023-10-08T00:30:19.626122+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:13:30.458026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614898+0000","last_change":"2023-10-08T00:30:18.809250+0000","last_active":"2023-10-08T00:30:19.614898+0000","last_peered":"2023-10-08T00:30:19.614898+0000","last_clean":"2023-10-08T00:30:19.614898+0000","last_became_active":"2023-10-08T00:30:18.808555+0000","last_became_peered":"2023-10-08T00:30:18.808555+0000","last_unstale":"2023-10-08T00:30:19.614898+0000","last_undegraded":"2023-10-08T00:30:19.614898+0000","last_fullsized":"2023-10-08T00:30:19.614898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:32.323102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621166+0000","last_change":"2023-10-08T00:30:19.621166+0000","last_active":"2023-10-08T00:30:19.621166+0000","last_peered":"2023-10-08T00:30:19.621166+0000","last_clean":"2023-10-08T00:30:19.621166+0000","last_became_active":"2023-10-08T00:30:19.620895+0000","last_became_peered":"2023-10-08T00:30:19.620895+0000","last_unstale":"2023-10-08T00:30:19.621166+0000","last_undegraded":"2023-10-08T00:30:19.621166+0000","last_fullsized":"2023-10-08T00:30:19.621166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:47.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614668+0000","last_change":"2023-10-08T00:30:18.805214+0000","last_active":"2023-10-08T00:30:19.614668+0000","last_peered":"2023-10-08T00:30:19.614668+0000","last_clean":"2023-10-08T00:30:19.614668+0000","last_became_active":"2023-10-08T00:30:18.804850+0000","last_became_peered":"2023-10-08T00:30:18.804850+0000","last_unstale":"2023-10-08T00:30:19.614668+0000","last_undegraded":"2023-10-08T00:30:19.614668+0000","last_fullsized":"2023-10-08T00:30:19.614668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:58:11.044207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618348+0000","last_change":"2023-10-08T00:30:19.618348+0000","last_active":"2023-10-08T00:30:19.618348+0000","last_peered":"2023-10-08T00:30:19.618348+0000","last_clean":"2023-10-08T00:30:19.618348+0000","last_became_active":"2023-10-08T00:30:19.618070+0000","last_became_peered":"2023-10-08T00:30:19.618070+0000","last_unstale":"2023-10-08T00:30:19.618348+0000","last_undegraded":"2023-10-08T00:30:19.618348+0000","last_fullsized":"2023-10-08T00:30:19.618348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:37:40.567110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.816510+0000","last_change":"2023-10-08T00:30:18.813847+0000","last_active":"2023-10-08T00:30:18.816510+0000","last_peered":"2023-10-08T00:30:18.816510+0000","last_clean":"2023-10-08T00:30:18.816510+0000","last_became_active":"2023-10-08T00:30:18.813562+0000","last_became_peered":"2023-10-08T00:30:18.813562+0000","last_unstale":"2023-10-08T00:30:18.816510+0000","last_undegraded":"2023-10-08T00:30:18.816510+0000","last_fullsized":"2023-10-08T00:30:18.816510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:03.372740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.624539+0000","last_change":"2023-10-08T00:30:19.624539+0000","last_active":"2023-10-08T00:30:19.624539+0000","last_peered":"2023-10-08T00:30:19.624539+0000","last_clean":"2023-10-08T00:30:19.624539+0000","last_became_active":"2023-10-08T00:30:19.624229+0000","last_became_peered":"2023-10-08T00:30:19.624229+0000","last_unstale":"2023-10-08T00:30:19.624539+0000","last_undegraded":"2023-10-08T00:30:19.624539+0000","last_fullsized":"2023-10-08T00:30:19.624539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:37:40.567110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.818298+0000","last_change":"2023-10-08T00:30:18.817528+0000","last_active":"2023-10-08T00:30:18.818298+0000","last_peered":"2023-10-08T00:30:18.818298+0000","last_clean":"2023-10-08T00:30:18.818298+0000","last_became_active":"2023-10-08T00:30:18.815824+0000","last_became_peered":"2023-10-08T00:30:18.815824+0000","last_unstale":"2023-10-08T00:30:18.818298+0000","last_undegraded":"2023-10-08T00:30:18.818298+0000","last_fullsized":"2023-10-08T00:30:18.818298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:34.598067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620973+0000","last_change":"2023-10-08T00:30:19.620973+0000","last_active":"2023-10-08T00:30:19.620973+0000","last_peered":"2023-10-08T00:30:19.620973+0000","last_clean":"2023-10-08T00:30:19.620973+0000","last_became_active":"2023-10-08T00:30:19.620674+0000","last_became_peered":"2023-10-08T00:30:19.620674+0000","last_unstale":"2023-10-08T00:30:19.620973+0000","last_undegraded":"2023-10-08T00:30:19.620973+0000","last_fullsized":"2023-10-08T00:30:19.620973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:43.459644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817482+0000","last_change":"2023-10-08T00:30:18.808885+0000","last_active":"2023-10-08T00:30:18.817482+0000","last_peered":"2023-10-08T00:30:18.817482+0000","last_clean":"2023-10-08T00:30:18.817482+0000","last_became_active":"2023-10-08T00:30:18.808625+0000","last_became_peered":"2023-10-08T00:30:18.808625+0000","last_unstale":"2023-10-08T00:30:18.817482+0000","last_undegraded":"2023-10-08T00:30:18.817482+0000","last_fullsized":"2023-10-08T00:30:18.817482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:34.598067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.625255+0000","last_change":"2023-10-08T00:30:19.625255+0000","last_active":"2023-10-08T00:30:19.625255+0000","last_peered":"2023-10-08T00:30:19.625255+0000","last_clean":"2023-10-08T00:30:19.625255+0000","last_became_active":"2023-10-08T00:30:19.624997+0000","last_became_peered":"2023-10-08T00:30:19.624997+0000","last_unstale":"2023-10-08T00:30:19.625255+0000","last_undegraded":"2023-10-08T00:30:19.625255+0000","last_fullsized":"2023-10-08T00:30:19.625255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:30.808829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.820278+0000","last_change":"2023-10-08T00:30:18.816037+0000","last_active":"2023-10-08T00:30:18.820278+0000","last_peered":"2023-10-08T00:30:18.820278+0000","last_clean":"2023-10-08T00:30:18.820278+0000","last_became_active":"2023-10-08T00:30:18.815755+0000","last_became_peered":"2023-10-08T00:30:18.815755+0000","last_unstale":"2023-10-08T00:30:18.820278+0000","last_undegraded":"2023-10-08T00:30:18.820278+0000","last_fullsized":"2023-10-08T00:30:18.820278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:59:30.283861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623339+0000","last_change":"2023-10-08T00:30:19.623339+0000","last_active":"2023-10-08T00:30:19.623339+0000","last_peered":"2023-10-08T00:30:19.623339+0000","last_clean":"2023-10-08T00:30:19.623339+0000","last_became_active":"2023-10-08T00:30:19.623094+0000","last_became_peered":"2023-10-08T00:30:19.623094+0000","last_unstale":"2023-10-08T00:30:19.623339+0000","last_undegraded":"2023-10-08T00:30:19.623339+0000","last_fullsized":"2023-10-08T00:30:19.623339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:24.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"77'3","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.806442+0000","last_change":"2023-10-08T00:30:18.811279+0000","last_active":"2023-10-08T00:30:19.806442+0000","last_peered":"2023-10-08T00:30:19.806442+0000","last_clean":"2023-10-08T00:30:19.806442+0000","last_became_active":"2023-10-08T00:30:18.810894+0000","last_became_peered":"2023-10-08T00:30:18.810894+0000","last_unstale":"2023-10-08T00:30:19.806442+0000","last_undegraded":"2023-10-08T00:30:19.806442+0000","last_fullsized":"2023-10-08T00:30:19.806442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:36.161753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629278+0000","last_change":"2023-10-08T00:30:19.629278+0000","last_active":"2023-10-08T00:30:19.629278+0000","last_peered":"2023-10-08T00:30:19.629278+0000","last_clean":"2023-10-08T00:30:19.629278+0000","last_became_active":"2023-10-08T00:30:19.628717+0000","last_became_peered":"2023-10-08T00:30:19.628717+0000","last_unstale":"2023-10-08T00:30:19.629278+0000","last_undegraded":"2023-10-08T00:30:19.629278+0000","last_fullsized":"2023-10-08T00:30:19.629278+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:46:33.280760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"77'6","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.807045+0000","last_change":"2023-10-08T00:30:18.814265+0000","last_active":"2023-10-08T00:30:19.807045+0000","last_peered":"2023-10-08T00:30:19.807045+0000","last_clean":"2023-10-08T00:30:19.807045+0000","last_became_active":"2023-10-08T00:30:18.813970+0000","last_became_peered":"2023-10-08T00:30:18.813970+0000","last_unstale":"2023-10-08T00:30:19.807045+0000","last_undegraded":"2023-10-08T00:30:19.807045+0000","last_fullsized":"2023-10-08T00:30:19.807045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:05:42.041516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620452+0000","last_change":"2023-10-08T00:30:19.620452+0000","last_active":"2023-10-08T00:30:19.620452+0000","last_peered":"2023-10-08T00:30:19.620452+0000","last_clean":"2023-10-08T00:30:19.620452+0000","last_became_active":"2023-10-08T00:30:19.619987+0000","last_became_peered":"2023-10-08T00:30:19.619987+0000","last_unstale":"2023-10-08T00:30:19.620452+0000","last_undegraded":"2023-10-08T00:30:19.620452+0000","last_fullsized":"2023-10-08T00:30:19.620452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:08.514756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.804657+0000","last_change":"2023-10-08T00:30:18.810986+0000","last_active":"2023-10-08T00:30:19.804657+0000","last_peered":"2023-10-08T00:30:19.804657+0000","last_clean":"2023-10-08T00:30:19.804657+0000","last_became_active":"2023-10-08T00:30:18.810623+0000","last_became_peered":"2023-10-08T00:30:18.810623+0000","last_unstale":"2023-10-08T00:30:19.804657+0000","last_undegraded":"2023-10-08T00:30:19.804657+0000","last_fullsized":"2023-10-08T00:30:19.804657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:12:34.202569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621248+0000","last_change":"2023-10-08T00:30:19.621248+0000","last_active":"2023-10-08T00:30:19.621248+0000","last_peered":"2023-10-08T00:30:19.621248+0000","last_clean":"2023-10-08T00:30:19.621248+0000","last_became_active":"2023-10-08T00:30:19.620961+0000","last_became_peered":"2023-10-08T00:30:19.620961+0000","last_unstale":"2023-10-08T00:30:19.621248+0000","last_undegraded":"2023-10-08T00:30:19.621248+0000","last_fullsized":"2023-10-08T00:30:19.621248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:07.893635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.814928+0000","last_change":"2023-10-08T00:30:18.813458+0000","last_active":"2023-10-08T00:30:18.814928+0000","last_peered":"2023-10-08T00:30:18.814928+0000","last_clean":"2023-10-08T00:30:18.814928+0000","last_became_active":"2023-10-08T00:30:18.813182+0000","last_became_peered":"2023-10-08T00:30:18.813182+0000","last_unstale":"2023-10-08T00:30:18.814928+0000","last_undegraded":"2023-10-08T00:30:18.814928+0000","last_fullsized":"2023-10-08T00:30:18.814928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:23.212503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.628282+0000","last_change":"2023-10-08T00:30:19.628282+0000","last_active":"2023-10-08T00:30:19.628282+0000","last_peered":"2023-10-08T00:30:19.628282+0000","last_clean":"2023-10-08T00:30:19.628282+0000","last_became_active":"2023-10-08T00:30:19.628008+0000","last_became_peered":"2023-10-08T00:30:19.628008+0000","last_unstale":"2023-10-08T00:30:19.628282+0000","last_undegraded":"2023-10-08T00:30:19.628282+0000","last_fullsized":"2023-10-08T00:30:19.628282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:32.779686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.810357+0000","last_change":"2023-10-08T00:30:18.806284+0000","last_active":"2023-10-08T00:30:18.810357+0000","last_peered":"2023-10-08T00:30:18.810357+0000","last_clean":"2023-10-08T00:30:18.810357+0000","last_became_active":"2023-10-08T00:30:18.806038+0000","last_became_peered":"2023-10-08T00:30:18.806038+0000","last_unstale":"2023-10-08T00:30:18.810357+0000","last_undegraded":"2023-10-08T00:30:18.810357+0000","last_fullsized":"2023-10-08T00:30:18.810357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:08:44.517840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622881+0000","last_change":"2023-10-08T00:30:19.622881+0000","last_active":"2023-10-08T00:30:19.622881+0000","last_peered":"2023-10-08T00:30:19.622881+0000","last_clean":"2023-10-08T00:30:19.622881+0000","last_became_active":"2023-10-08T00:30:19.622605+0000","last_became_peered":"2023-10-08T00:30:19.622605+0000","last_unstale":"2023-10-08T00:30:19.622881+0000","last_undegraded":"2023-10-08T00:30:19.622881+0000","last_fullsized":"2023-10-08T00:30:19.622881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:08:45.523628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"77'8","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.810245+0000","last_change":"2023-10-08T00:30:18.814926+0000","last_active":"2023-10-08T00:30:19.810245+0000","last_peered":"2023-10-08T00:30:19.810245+0000","last_clean":"2023-10-08T00:30:19.810245+0000","last_became_active":"2023-10-08T00:30:18.814556+0000","last_became_peered":"2023-10-08T00:30:18.814556+0000","last_unstale":"2023-10-08T00:30:19.810245+0000","last_undegraded":"2023-10-08T00:30:19.810245+0000","last_fullsized":"2023-10-08T00:30:19.810245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:05.483533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618969+0000","last_change":"2023-10-08T00:30:19.618969+0000","last_active":"2023-10-08T00:30:19.618969+0000","last_peered":"2023-10-08T00:30:19.618969+0000","last_clean":"2023-10-08T00:30:19.618969+0000","last_became_active":"2023-10-08T00:30:19.618703+0000","last_became_peered":"2023-10-08T00:30:19.618703+0000","last_unstale":"2023-10-08T00:30:19.618969+0000","last_undegraded":"2023-10-08T00:30:19.618969+0000","last_fullsized":"2023-10-08T00:30:19.618969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:07:44.257681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.613926+0000","last_change":"2023-10-08T00:30:18.811921+0000","last_active":"2023-10-08T00:30:19.613926+0000","last_peered":"2023-10-08T00:30:19.613926+0000","last_clean":"2023-10-08T00:30:19.613926+0000","last_became_active":"2023-10-08T00:30:18.811654+0000","last_became_peered":"2023-10-08T00:30:18.811654+0000","last_unstale":"2023-10-08T00:30:19.613926+0000","last_undegraded":"2023-10-08T00:30:19.613926+0000","last_fullsized":"2023-10-08T00:30:19.613926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:56.906557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.625946+0000","last_change":"2023-10-08T00:30:19.625946+0000","last_active":"2023-10-08T00:30:19.625946+0000","last_peered":"2023-10-08T00:30:19.625946+0000","last_clean":"2023-10-08T00:30:19.625946+0000","last_became_active":"2023-10-08T00:30:19.625253+0000","last_became_peered":"2023-10-08T00:30:19.625253+0000","last_unstale":"2023-10-08T00:30:19.625946+0000","last_undegraded":"2023-10-08T00:30:19.625946+0000","last_fullsized":"2023-10-08T00:30:19.625946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:53.989941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805347+0000","last_change":"2023-10-08T00:30:18.816146+0000","last_active":"2023-10-08T00:30:19.805347+0000","last_peered":"2023-10-08T00:30:19.805347+0000","last_clean":"2023-10-08T00:30:19.805347+0000","last_became_active":"2023-10-08T00:30:18.815972+0000","last_became_peered":"2023-10-08T00:30:18.815972+0000","last_unstale":"2023-10-08T00:30:19.805347+0000","last_undegraded":"2023-10-08T00:30:19.805347+0000","last_fullsized":"2023-10-08T00:30:19.805347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:15.228906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629045+0000","last_change":"2023-10-08T00:30:19.629045+0000","last_active":"2023-10-08T00:30:19.629045+0000","last_peered":"2023-10-08T00:30:19.629045+0000","last_clean":"2023-10-08T00:30:19.629045+0000","last_became_active":"2023-10-08T00:30:19.627065+0000","last_became_peered":"2023-10-08T00:30:19.627065+0000","last_unstale":"2023-10-08T00:30:19.629045+0000","last_undegraded":"2023-10-08T00:30:19.629045+0000","last_fullsized":"2023-10-08T00:30:19.629045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:59:33.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817115+0000","last_change":"2023-10-08T00:30:18.815184+0000","last_active":"2023-10-08T00:30:18.817115+0000","last_peered":"2023-10-08T00:30:18.817115+0000","last_clean":"2023-10-08T00:30:18.817115+0000","last_became_active":"2023-10-08T00:30:18.814524+0000","last_became_peered":"2023-10-08T00:30:18.814524+0000","last_unstale":"2023-10-08T00:30:18.817115+0000","last_undegraded":"2023-10-08T00:30:18.817115+0000","last_fullsized":"2023-10-08T00:30:18.817115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:46:32.274971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622899+0000","last_change":"2023-10-08T00:30:19.622899+0000","last_active":"2023-10-08T00:30:19.622899+0000","last_peered":"2023-10-08T00:30:19.622899+0000","last_clean":"2023-10-08T00:30:19.622899+0000","last_became_active":"2023-10-08T00:30:19.622631+0000","last_became_peered":"2023-10-08T00:30:19.622631+0000","last_unstale":"2023-10-08T00:30:19.622899+0000","last_undegraded":"2023-10-08T00:30:19.622899+0000","last_fullsized":"2023-10-08T00:30:19.622899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:38.616266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805537+0000","last_change":"2023-10-08T00:30:18.805914+0000","last_active":"2023-10-08T00:30:19.805537+0000","last_peered":"2023-10-08T00:30:19.805537+0000","last_clean":"2023-10-08T00:30:19.805537+0000","last_became_active":"2023-10-08T00:30:18.805631+0000","last_became_peered":"2023-10-08T00:30:18.805631+0000","last_unstale":"2023-10-08T00:30:19.805537+0000","last_undegraded":"2023-10-08T00:30:19.805537+0000","last_fullsized":"2023-10-08T00:30:19.805537+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:09.902371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618182+0000","last_change":"2023-10-08T00:30:19.618182+0000","last_active":"2023-10-08T00:30:19.618182+0000","last_peered":"2023-10-08T00:30:19.618182+0000","last_clean":"2023-10-08T00:30:19.618182+0000","last_became_active":"2023-10-08T00:30:19.617688+0000","last_became_peered":"2023-10-08T00:30:19.617688+0000","last_unstale":"2023-10-08T00:30:19.618182+0000","last_undegraded":"2023-10-08T00:30:19.618182+0000","last_fullsized":"2023-10-08T00:30:19.618182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817350+0000","last_change":"2023-10-08T00:30:18.813020+0000","last_active":"2023-10-08T00:30:18.817350+0000","last_peered":"2023-10-08T00:30:18.817350+0000","last_clean":"2023-10-08T00:30:18.817350+0000","last_became_active":"2023-10-08T00:30:18.812721+0000","last_became_peered":"2023-10-08T00:30:18.812721+0000","last_unstale":"2023-10-08T00:30:18.817350+0000","last_undegraded":"2023-10-08T00:30:18.817350+0000","last_fullsized":"2023-10-08T00:30:18.817350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:45:20.378991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.613024+0000","last_change":"2023-10-08T00:30:19.613024+0000","last_active":"2023-10-08T00:30:19.613024+0000","last_peered":"2023-10-08T00:30:19.613024+0000","last_clean":"2023-10-08T00:30:19.613024+0000","last_became_active":"2023-10-08T00:30:19.612740+0000","last_became_peered":"2023-10-08T00:30:19.612740+0000","last_unstale":"2023-10-08T00:30:19.613024+0000","last_undegraded":"2023-10-08T00:30:19.613024+0000","last_fullsized":"2023-10-08T00:30:19.613024+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:42.582393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.812373+0000","last_change":"2023-10-08T00:30:18.809820+0000","last_active":"2023-10-08T00:30:18.812373+0000","last_peered":"2023-10-08T00:30:18.812373+0000","last_clean":"2023-10-08T00:30:18.812373+0000","last_became_active":"2023-10-08T00:30:18.809518+0000","last_became_peered":"2023-10-08T00:30:18.809518+0000","last_unstale":"2023-10-08T00:30:18.812373+0000","last_undegraded":"2023-10-08T00:30:18.812373+0000","last_fullsized":"2023-10-08T00:30:18.812373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:07:18.889715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618160+0000","last_change":"2023-10-08T00:30:19.618160+0000","last_active":"2023-10-08T00:30:19.618160+0000","last_peered":"2023-10-08T00:30:19.618160+0000","last_clean":"2023-10-08T00:30:19.618160+0000","last_became_active":"2023-10-08T00:30:19.617836+0000","last_became_peered":"2023-10-08T00:30:19.617836+0000","last_unstale":"2023-10-08T00:30:19.618160+0000","last_undegraded":"2023-10-08T00:30:19.618160+0000","last_fullsized":"2023-10-08T00:30:19.618160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.807836+0000","last_change":"2023-10-08T00:30:18.805838+0000","last_active":"2023-10-08T00:30:18.807836+0000","last_peered":"2023-10-08T00:30:18.807836+0000","last_clean":"2023-10-08T00:30:18.807836+0000","last_became_active":"2023-10-08T00:30:18.805534+0000","last_became_peered":"2023-10-08T00:30:18.805534+0000","last_unstale":"2023-10-08T00:30:18.807836+0000","last_undegraded":"2023-10-08T00:30:18.807836+0000","last_fullsized":"2023-10-08T00:30:18.807836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:07:43.251893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622228+0000","last_change":"2023-10-08T00:30:19.622228+0000","last_active":"2023-10-08T00:30:19.622228+0000","last_peered":"2023-10-08T00:30:19.622228+0000","last_clean":"2023-10-08T00:30:19.622228+0000","last_became_active":"2023-10-08T00:30:19.621941+0000","last_became_peered":"2023-10-08T00:30:19.621941+0000","last_unstale":"2023-10-08T00:30:19.622228+0000","last_undegraded":"2023-10-08T00:30:19.622228+0000","last_fullsized":"2023-10-08T00:30:19.622228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.809603+0000","last_change":"2023-10-08T00:30:18.813376+0000","last_active":"2023-10-08T00:30:19.809603+0000","last_peered":"2023-10-08T00:30:19.809603+0000","last_clean":"2023-10-08T00:30:19.809603+0000","last_became_active":"2023-10-08T00:30:18.813090+0000","last_became_peered":"2023-10-08T00:30:18.813090+0000","last_unstale":"2023-10-08T00:30:19.809603+0000","last_undegraded":"2023-10-08T00:30:19.809603+0000","last_fullsized":"2023-10-08T00:30:19.809603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:10:28.689581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.624887+0000","last_change":"2023-10-08T00:30:19.624887+0000","last_active":"2023-10-08T00:30:19.624887+0000","last_peered":"2023-10-08T00:30:19.624887+0000","last_clean":"2023-10-08T00:30:19.624887+0000","last_became_active":"2023-10-08T00:30:19.624630+0000","last_became_peered":"2023-10-08T00:30:19.624630+0000","last_unstale":"2023-10-08T00:30:19.624887+0000","last_undegraded":"2023-10-08T00:30:19.624887+0000","last_fullsized":"2023-10-08T00:30:19.624887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:40.199872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817276+0000","last_change":"2023-10-08T00:30:18.813526+0000","last_active":"2023-10-08T00:30:18.817276+0000","last_peered":"2023-10-08T00:30:18.817276+0000","last_clean":"2023-10-08T00:30:18.817276+0000","last_became_active":"2023-10-08T00:30:18.813227+0000","last_became_peered":"2023-10-08T00:30:18.813227+0000","last_unstale":"2023-10-08T00:30:18.817276+0000","last_undegraded":"2023-10-08T00:30:18.817276+0000","last_fullsized":"2023-10-08T00:30:18.817276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:44.575920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627884+0000","last_change":"2023-10-08T00:30:19.627884+0000","last_active":"2023-10-08T00:30:19.627884+0000","last_peered":"2023-10-08T00:30:19.627884+0000","last_clean":"2023-10-08T00:30:19.627884+0000","last_became_active":"2023-10-08T00:30:19.627603+0000","last_became_peered":"2023-10-08T00:30:19.627603+0000","last_unstale":"2023-10-08T00:30:19.627884+0000","last_undegraded":"2023-10-08T00:30:19.627884+0000","last_fullsized":"2023-10-08T00:30:19.627884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:37.112618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817619+0000","last_change":"2023-10-08T00:30:18.811377+0000","last_active":"2023-10-08T00:30:18.817619+0000","last_peered":"2023-10-08T00:30:18.817619+0000","last_clean":"2023-10-08T00:30:18.817619+0000","last_became_active":"2023-10-08T00:30:18.811111+0000","last_became_peered":"2023-10-08T00:30:18.811111+0000","last_unstale":"2023-10-08T00:30:18.817619+0000","last_undegraded":"2023-10-08T00:30:18.817619+0000","last_fullsized":"2023-10-08T00:30:18.817619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:10:28.689581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.628636+0000","last_change":"2023-10-08T00:30:19.628636+0000","last_active":"2023-10-08T00:30:19.628636+0000","last_peered":"2023-10-08T00:30:19.628636+0000","last_clean":"2023-10-08T00:30:19.628636+0000","last_became_active":"2023-10-08T00:30:19.626709+0000","last_became_peered":"2023-10-08T00:30:19.626709+0000","last_unstale":"2023-10-08T00:30:19.628636+0000","last_undegraded":"2023-10-08T00:30:19.628636+0000","last_fullsized":"2023-10-08T00:30:19.628636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:53.989941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817474+0000","last_change":"2023-10-08T00:30:18.808882+0000","last_active":"2023-10-08T00:30:18.817474+0000","last_peered":"2023-10-08T00:30:18.817474+0000","last_clean":"2023-10-08T00:30:18.817474+0000","last_became_active":"2023-10-08T00:30:18.808571+0000","last_became_peered":"2023-10-08T00:30:18.808571+0000","last_unstale":"2023-10-08T00:30:18.817474+0000","last_undegraded":"2023-10-08T00:30:18.817474+0000","last_fullsized":"2023-10-08T00:30:18.817474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:44.575920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.617630+0000","last_change":"2023-10-08T00:30:19.617630+0000","last_active":"2023-10-08T00:30:19.617630+0000","last_peered":"2023-10-08T00:30:19.617630+0000","last_clean":"2023-10-08T00:30:19.617630+0000","last_became_active":"2023-10-08T00:30:19.617210+0000","last_became_peered":"2023-10-08T00:30:19.617210+0000","last_unstale":"2023-10-08T00:30:19.617630+0000","last_undegraded":"2023-10-08T00:30:19.617630+0000","last_fullsized":"2023-10-08T00:30:19.617630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:34.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817053+0000","last_change":"2023-10-08T00:30:18.814399+0000","last_active":"2023-10-08T00:30:18.817053+0000","last_peered":"2023-10-08T00:30:18.817053+0000","last_clean":"2023-10-08T00:30:18.817053+0000","last_became_active":"2023-10-08T00:30:18.814089+0000","last_became_peered":"2023-10-08T00:30:18.814089+0000","last_unstale":"2023-10-08T00:30:18.817053+0000","last_undegraded":"2023-10-08T00:30:18.817053+0000","last_fullsized":"2023-10-08T00:30:18.817053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:46.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623780+0000","last_change":"2023-10-08T00:30:19.623780+0000","last_active":"2023-10-08T00:30:19.623780+0000","last_peered":"2023-10-08T00:30:19.623780+0000","last_clean":"2023-10-08T00:30:19.623780+0000","last_became_active":"2023-10-08T00:30:19.623527+0000","last_became_peered":"2023-10-08T00:30:19.623527+0000","last_unstale":"2023-10-08T00:30:19.623780+0000","last_undegraded":"2023-10-08T00:30:19.623780+0000","last_fullsized":"2023-10-08T00:30:19.623780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:37.641517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.815221+0000","last_change":"2023-10-08T00:30:18.805099+0000","last_active":"2023-10-08T00:30:18.815221+0000","last_peered":"2023-10-08T00:30:18.815221+0000","last_clean":"2023-10-08T00:30:18.815221+0000","last_became_active":"2023-10-08T00:30:18.804482+0000","last_became_peered":"2023-10-08T00:30:18.804482+0000","last_unstale":"2023-10-08T00:30:18.815221+0000","last_undegraded":"2023-10-08T00:30:18.815221+0000","last_fullsized":"2023-10-08T00:30:18.815221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:51:37.267027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621390+0000","last_change":"2023-10-08T00:30:19.621390+0000","last_active":"2023-10-08T00:30:19.621390+0000","last_peered":"2023-10-08T00:30:19.621390+0000","last_clean":"2023-10-08T00:30:19.621390+0000","last_became_active":"2023-10-08T00:30:19.621110+0000","last_became_peered":"2023-10-08T00:30:19.621110+0000","last_unstale":"2023-10-08T00:30:19.621390+0000","last_undegraded":"2023-10-08T00:30:19.621390+0000","last_fullsized":"2023-10-08T00:30:19.621390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:31.906579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817490+0000","last_change":"2023-10-08T00:30:18.809077+0000","last_active":"2023-10-08T00:30:18.817490+0000","last_peered":"2023-10-08T00:30:18.817490+0000","last_clean":"2023-10-08T00:30:18.817490+0000","last_became_active":"2023-10-08T00:30:18.808223+0000","last_became_peered":"2023-10-08T00:30:18.808223+0000","last_unstale":"2023-10-08T00:30:18.817490+0000","last_undegraded":"2023-10-08T00:30:18.817490+0000","last_fullsized":"2023-10-08T00:30:18.817490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:12:34.202569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622950+0000","last_change":"2023-10-08T00:30:19.622950+0000","last_active":"2023-10-08T00:30:19.622950+0000","last_peered":"2023-10-08T00:30:19.622950+0000","last_clean":"2023-10-08T00:30:19.622950+0000","last_became_active":"2023-10-08T00:30:19.622672+0000","last_became_peered":"2023-10-08T00:30:19.622672+0000","last_unstale":"2023-10-08T00:30:19.622950+0000","last_undegraded":"2023-10-08T00:30:19.622950+0000","last_fullsized":"2023-10-08T00:30:19.622950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.815365+0000","last_change":"2023-10-08T00:30:18.810122+0000","last_active":"2023-10-08T00:30:18.815365+0000","last_peered":"2023-10-08T00:30:18.815365+0000","last_clean":"2023-10-08T00:30:18.815365+0000","last_became_active":"2023-10-08T00:30:18.809860+0000","last_became_peered":"2023-10-08T00:30:18.809860+0000","last_unstale":"2023-10-08T00:30:18.815365+0000","last_undegraded":"2023-10-08T00:30:18.815365+0000","last_fullsized":"2023-10-08T00:30:18.815365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:38:53.498788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621258+0000","last_change":"2023-10-08T00:30:19.621258+0000","last_active":"2023-10-08T00:30:19.621258+0000","last_peered":"2023-10-08T00:30:19.621258+0000","last_clean":"2023-10-08T00:30:19.621258+0000","last_became_active":"2023-10-08T00:30:19.620979+0000","last_became_peered":"2023-10-08T00:30:19.620979+0000","last_unstale":"2023-10-08T00:30:19.621258+0000","last_undegraded":"2023-10-08T00:30:19.621258+0000","last_fullsized":"2023-10-08T00:30:19.621258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:49.042367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614328+0000","last_change":"2023-10-08T00:30:18.815683+0000","last_active":"2023-10-08T00:30:19.614328+0000","last_peered":"2023-10-08T00:30:19.614328+0000","last_clean":"2023-10-08T00:30:19.614328+0000","last_became_active":"2023-10-08T00:30:18.815427+0000","last_became_peered":"2023-10-08T00:30:18.815427+0000","last_unstale":"2023-10-08T00:30:19.614328+0000","last_undegraded":"2023-10-08T00:30:19.614328+0000","last_fullsized":"2023-10-08T00:30:19.614328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:15.228906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.807335+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:18.807335+0000","last_peered":"2023-10-08T00:30:18.807335+0000","last_clean":"2023-10-08T00:30:18.807335+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:18.807335+0000","last_undegraded":"2023-10-08T00:30:18.807335+0000","last_fullsized":"2023-10-08T00:30:18.807335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073048,"statfs":{"total":96636764160,"available":96330801152,"internally_reserved":0,"allocated":1540096,"data_stored":996529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.67900000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":406827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.501}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":406355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.247},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.308}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33200000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.45400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.46800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302892,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068948,"statfs":{"total":96636764160,"available":96326602752,"internally_reserved":0,"allocated":1544192,"data_stored":996563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.252},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.36499999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.627},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66200000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.52300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":406715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.315},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33200000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.44600000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.497},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.435}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":406161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.433}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.628},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":406161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.625},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.495}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073612,"statfs":{"total":96636764160,"available":96331378688,"internally_reserved":0,"allocated":962560,"data_stored":407719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.34499999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.62}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42299999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:23.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.072+0000 7f5fd555f700 1 Processor -- start 2023-10-08T00:30:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.072+0000 7f5fd555f700 1 -- start start 2023-10-08T00:30:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fd555f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5fd01594d0 0x7f5fd00cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fd555f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fd0159fb0 0x7f5fd00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fd555f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00d01f0 con 0x7f5fd00b5fb0 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fd555f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00cf5e0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fd555f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00cf8c0 con 0x7f5fd01594d0 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fcf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fd0159fb0 0x7f5fd00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fcf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5fd0159fb0 0x7f5fd00b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56480/0 (socket says 172.21.15.22:56480) 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/260428507 learned_addr learned my addr 172.21.15.22:0/260428507 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.073+0000 7f5fceffd700 1 --2- 172.21.15.22:0/260428507 >> v2:172.21.15.192:3300/0 conn(0x7f5fd01594d0 0x7f5fd00cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/260428507 >> v2:172.21.15.192:3300/0 conn(0x7f5fd01594d0 msgr2=0x7f5fd00cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcf7fe700 1 --2- 172.21.15.22:0/260428507 >> v2:172.21.15.192:3300/0 conn(0x7f5fd01594d0 0x7f5fd00cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/260428507 >> v1:172.21.15.192:6789/0 conn(0x7f5fd00b5fb0 legacy=0x7f5fd01598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/260428507 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00cfba0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fceffd700 1 --2- 172.21.15.22:0/260428507 >> v2:172.21.15.192:3300/0 conn(0x7f5fd01594d0 0x7f5fd00cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcf7fe700 1 --2- 172.21.15.22:0/260428507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00b1050 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0089720 tx=0x7f5fc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4590b6be29595ae0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcdffb700 1 -- 172.21.15.22:0/260428507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000e070 con 0x7f5fd0159fb0 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcdffb700 1 -- 172.21.15.22:0/260428507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc000ba50 con 0x7f5fd0159fb0 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fcdffb700 1 -- 172.21.15.22:0/260428507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00092e0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 -- 172.21.15.22:0/260428507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 msgr2=0x7f5fd00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 --2- 172.21.15.22:0/260428507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00b1050 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0089720 tx=0x7f5fc0009840 comp rx=0 tx=0).stop 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 -- 172.21.15.22:0/260428507 shutdown_connections 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 --2- 172.21.15.22:0/260428507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00b1050 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 --2- 172.21.15.22:0/260428507 >> v2:172.21.15.192:3300/0 conn(0x7f5fd01594d0 0x7f5fd00cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 -- 172.21.15.22:0/260428507 >> 172.21.15.22:0/260428507 conn(0x7f5fd00d05f0 msgr2=0x7f5fd00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 -- 172.21.15.22:0/260428507 shutdown_connections 2023-10-08T00:30:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.074+0000 7f5fd555f700 1 -- 172.21.15.22:0/260428507 wait complete. 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 Processor -- start 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 -- start start 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fd00b5fb0 0x7f5fd015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd01594d0 0x7f5fd00b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd016cf80 con 0x7f5fd0159fb0 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0156950 con 0x7f5fd01594d0 2023-10-08T00:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.076+0000 7f5fd555f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd016aa40 con 0x7f5fd00b5fb0 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56484/0 (socket says 172.21.15.22:56484) 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/3777476252 learned_addr learned my addr 172.21.15.22:0/3777476252 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fce7fc700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd01594d0 0x7f5fd00b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fd00b5fb0 msgr2=0x7f5fd015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fd00b5fb0 0x7f5fd015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd01594d0 msgr2=0x7f5fd00b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd01594d0 0x7f5fd00b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 -- 172.21.15.22:0/3777476252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc0009ae0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fce7fc700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd01594d0 0x7f5fd00b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fcf7fe700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00c84e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00895a0 tx=0x7f5fc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0008e40 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc000be60 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd0169e90 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00266b0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.077+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd016a6d0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.078+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd004c3c0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.079+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5fc0003040 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.079+0000 7f5fc6ffd700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067170 0x7f5fb0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.079+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fc00869f0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.080+0000 7f5fceffd700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067170 0x7f5fb0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.080+0000 7f5fceffd700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067170 0x7f5fb0069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8006fd0 tx=0x7f5fc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.084+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fc00538d0 con 0x7f5fd0159fb0 2023-10-08T00:30:24.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.272+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fd016a280 con 0x7f5fb0067170 2023-10-08T00:30:24.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.281+0000 7f5fc6ffd700 1 -- 172.21.15.22:0/3777476252 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289412 (secure 0 0 0) 0x7f5fd016a280 con 0x7f5fb0067170 2023-10-08T00:30:24.285 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:24.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067170 msgr2=0x7f5fb0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067170 0x7f5fb0069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8006fd0 tx=0x7f5fc8008040 comp rx=0 tx=0).stop 2023-10-08T00:30:24.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 msgr2=0x7f5fd00c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00c84e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00895a0 tx=0x7f5fc0018000 comp rx=0 tx=0).stop 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 shutdown_connections 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd0159fb0 0x7f5fd00c84e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067170 0x7f5fb0069620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fd00b5fb0 0x7f5fd015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 --2- 172.21.15.22:0/3777476252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd01594d0 0x7f5fd00b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 >> 172.21.15.22:0/3777476252 conn(0x7f5fd00d05f0 msgr2=0x7f5fd00d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 shutdown_connections 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.284+0000 7f5fd555f700 1 -- 172.21.15.22:0/3777476252 wait complete. 2023-10-08T00:30:24.288 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:24.296 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-10-08T00:30:22.462135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2403288,"kb_used_data":8600,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752571432,"statfs":{"total":773094113280,"available":770633146368,"internally_reserved":0,"allocated":8806400,"data_stored":4433030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.671220"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629905+0000","last_change":"2023-10-08T00:30:19.629905+0000","last_active":"2023-10-08T00:30:19.629905+0000","last_peered":"2023-10-08T00:30:19.629905+0000","last_clean":"2023-10-08T00:30:19.629905+0000","last_became_active":"2023-10-08T00:30:19.629455+0000","last_became_peered":"2023-10-08T00:30:19.629455+0000","last_unstale":"2023-10-08T00:30:19.629905+0000","last_undegraded":"2023-10-08T00:30:19.629905+0000","last_fullsized":"2023-10-08T00:30:19.629905+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626982+0000","last_change":"2023-10-08T00:30:19.626982+0000","last_active":"2023-10-08T00:30:19.626982+0000","last_peered":"2023-10-08T00:30:19.626982+0000","last_clean":"2023-10-08T00:30:19.626982+0000","last_became_active":"2023-10-08T00:30:19.626620+0000","last_became_peered":"2023-10-08T00:30:19.626620+0000","last_unstale":"2023-10-08T00:30:19.626982+0000","last_undegraded":"2023-10-08T00:30:19.626982+0000","last_fullsized":"2023-10-08T00:30:19.626982+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626608+0000","last_change":"2023-10-08T00:30:19.626608+0000","last_active":"2023-10-08T00:30:19.626608+0000","last_peered":"2023-10-08T00:30:19.626608+0000","last_clean":"2023-10-08T00:30:19.626608+0000","last_became_active":"2023-10-08T00:30:19.626304+0000","last_became_peered":"2023-10-08T00:30:19.626304+0000","last_unstale":"2023-10-08T00:30:19.626608+0000","last_undegraded":"2023-10-08T00:30:19.626608+0000","last_fullsized":"2023-10-08T00:30:19.626608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:08.514756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623740+0000","last_change":"2023-10-08T00:30:19.623740+0000","last_active":"2023-10-08T00:30:19.623740+0000","last_peered":"2023-10-08T00:30:19.623740+0000","last_clean":"2023-10-08T00:30:19.623740+0000","last_became_active":"2023-10-08T00:30:19.621933+0000","last_became_peered":"2023-10-08T00:30:19.621933+0000","last_unstale":"2023-10-08T00:30:19.623740+0000","last_undegraded":"2023-10-08T00:30:19.623740+0000","last_fullsized":"2023-10-08T00:30:19.623740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:22.496168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623453+0000","last_change":"2023-10-08T00:30:19.623453+0000","last_active":"2023-10-08T00:30:19.623453+0000","last_peered":"2023-10-08T00:30:19.623453+0000","last_clean":"2023-10-08T00:30:19.623453+0000","last_became_active":"2023-10-08T00:30:19.623145+0000","last_became_peered":"2023-10-08T00:30:19.623145+0000","last_unstale":"2023-10-08T00:30:19.623453+0000","last_undegraded":"2023-10-08T00:30:19.623453+0000","last_fullsized":"2023-10-08T00:30:19.623453+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:16.234694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614360+0000","last_change":"2023-10-08T00:30:19.614360+0000","last_active":"2023-10-08T00:30:19.614360+0000","last_peered":"2023-10-08T00:30:19.614360+0000","last_clean":"2023-10-08T00:30:19.614360+0000","last_became_active":"2023-10-08T00:30:19.614092+0000","last_became_peered":"2023-10-08T00:30:19.614092+0000","last_unstale":"2023-10-08T00:30:19.614360+0000","last_undegraded":"2023-10-08T00:30:19.614360+0000","last_fullsized":"2023-10-08T00:30:19.614360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:53.989941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627421+0000","last_change":"2023-10-08T00:30:19.627421+0000","last_active":"2023-10-08T00:30:19.627421+0000","last_peered":"2023-10-08T00:30:19.627421+0000","last_clean":"2023-10-08T00:30:19.627421+0000","last_became_active":"2023-10-08T00:30:19.627112+0000","last_became_peered":"2023-10-08T00:30:19.627112+0000","last_unstale":"2023-10-08T00:30:19.627421+0000","last_undegraded":"2023-10-08T00:30:19.627421+0000","last_fullsized":"2023-10-08T00:30:19.627421+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:02:32.715203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.619174+0000","last_change":"2023-10-08T00:30:19.619174+0000","last_active":"2023-10-08T00:30:19.619174+0000","last_peered":"2023-10-08T00:30:19.619174+0000","last_clean":"2023-10-08T00:30:19.619174+0000","last_became_active":"2023-10-08T00:30:19.618887+0000","last_became_peered":"2023-10-08T00:30:19.618887+0000","last_unstale":"2023-10-08T00:30:19.619174+0000","last_undegraded":"2023-10-08T00:30:19.619174+0000","last_fullsized":"2023-10-08T00:30:19.619174+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:32.779686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.617476+0000","last_change":"2023-10-08T00:30:19.617476+0000","last_active":"2023-10-08T00:30:19.617476+0000","last_peered":"2023-10-08T00:30:19.617476+0000","last_clean":"2023-10-08T00:30:19.617476+0000","last_became_active":"2023-10-08T00:30:19.617118+0000","last_became_peered":"2023-10-08T00:30:19.617118+0000","last_unstale":"2023-10-08T00:30:19.617476+0000","last_undegraded":"2023-10-08T00:30:19.617476+0000","last_fullsized":"2023-10-08T00:30:19.617476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:37.112618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621629+0000","last_change":"2023-10-08T00:30:19.621629+0000","last_active":"2023-10-08T00:30:19.621629+0000","last_peered":"2023-10-08T00:30:19.621629+0000","last_clean":"2023-10-08T00:30:19.621629+0000","last_became_active":"2023-10-08T00:30:19.620752+0000","last_became_peered":"2023-10-08T00:30:19.620752+0000","last_unstale":"2023-10-08T00:30:19.621629+0000","last_undegraded":"2023-10-08T00:30:19.621629+0000","last_fullsized":"2023-10-08T00:30:19.621629+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:52:01.918902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.628341+0000","last_change":"2023-10-08T00:30:19.628341+0000","last_active":"2023-10-08T00:30:19.628341+0000","last_peered":"2023-10-08T00:30:19.628341+0000","last_clean":"2023-10-08T00:30:19.628341+0000","last_became_active":"2023-10-08T00:30:19.627990+0000","last_became_peered":"2023-10-08T00:30:19.627990+0000","last_unstale":"2023-10-08T00:30:19.628341+0000","last_undegraded":"2023-10-08T00:30:19.628341+0000","last_fullsized":"2023-10-08T00:30:19.628341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:56.372954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622769+0000","last_change":"2023-10-08T00:30:19.622769+0000","last_active":"2023-10-08T00:30:19.622769+0000","last_peered":"2023-10-08T00:30:19.622769+0000","last_clean":"2023-10-08T00:30:19.622769+0000","last_became_active":"2023-10-08T00:30:19.622076+0000","last_became_peered":"2023-10-08T00:30:19.622076+0000","last_unstale":"2023-10-08T00:30:19.622769+0000","last_undegraded":"2023-10-08T00:30:19.622769+0000","last_fullsized":"2023-10-08T00:30:19.622769+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:56.372954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627755+0000","last_change":"2023-10-08T00:30:19.627755+0000","last_active":"2023-10-08T00:30:19.627755+0000","last_peered":"2023-10-08T00:30:19.627755+0000","last_clean":"2023-10-08T00:30:19.627755+0000","last_became_active":"2023-10-08T00:30:19.627460+0000","last_became_peered":"2023-10-08T00:30:19.627460+0000","last_unstale":"2023-10-08T00:30:19.627755+0000","last_undegraded":"2023-10-08T00:30:19.627755+0000","last_fullsized":"2023-10-08T00:30:19.627755+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:23.695763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622826+0000","last_change":"2023-10-08T00:30:19.622826+0000","last_active":"2023-10-08T00:30:19.622826+0000","last_peered":"2023-10-08T00:30:19.622826+0000","last_clean":"2023-10-08T00:30:19.622826+0000","last_became_active":"2023-10-08T00:30:19.622541+0000","last_became_peered":"2023-10-08T00:30:19.622541+0000","last_unstale":"2023-10-08T00:30:19.622826+0000","last_undegraded":"2023-10-08T00:30:19.622826+0000","last_fullsized":"2023-10-08T00:30:19.622826+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:28:09.198208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.625798+0000","last_change":"2023-10-08T00:30:19.625798+0000","last_active":"2023-10-08T00:30:19.625798+0000","last_peered":"2023-10-08T00:30:19.625798+0000","last_clean":"2023-10-08T00:30:19.625798+0000","last_became_active":"2023-10-08T00:30:19.625500+0000","last_became_peered":"2023-10-08T00:30:19.625500+0000","last_unstale":"2023-10-08T00:30:19.625798+0000","last_undegraded":"2023-10-08T00:30:19.625798+0000","last_fullsized":"2023-10-08T00:30:19.625798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:49:54.323854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623889+0000","last_change":"2023-10-08T00:30:19.623889+0000","last_active":"2023-10-08T00:30:19.623889+0000","last_peered":"2023-10-08T00:30:19.623889+0000","last_clean":"2023-10-08T00:30:19.623889+0000","last_became_active":"2023-10-08T00:30:19.623601+0000","last_became_peered":"2023-10-08T00:30:19.623601+0000","last_unstale":"2023-10-08T00:30:19.623889+0000","last_undegraded":"2023-10-08T00:30:19.623889+0000","last_fullsized":"2023-10-08T00:30:19.623889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:06.489321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627303+0000","last_change":"2023-10-08T00:30:19.627303+0000","last_active":"2023-10-08T00:30:19.627303+0000","last_peered":"2023-10-08T00:30:19.627303+0000","last_clean":"2023-10-08T00:30:19.627303+0000","last_became_active":"2023-10-08T00:30:19.626482+0000","last_became_peered":"2023-10-08T00:30:19.626482+0000","last_unstale":"2023-10-08T00:30:19.627303+0000","last_undegraded":"2023-10-08T00:30:19.627303+0000","last_fullsized":"2023-10-08T00:30:19.627303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622670+0000","last_change":"2023-10-08T00:30:19.622670+0000","last_active":"2023-10-08T00:30:19.622670+0000","last_peered":"2023-10-08T00:30:19.622670+0000","last_clean":"2023-10-08T00:30:19.622670+0000","last_became_active":"2023-10-08T00:30:19.621980+0000","last_became_peered":"2023-10-08T00:30:19.621980+0000","last_unstale":"2023-10-08T00:30:19.622670+0000","last_undegraded":"2023-10-08T00:30:19.622670+0000","last_fullsized":"2023-10-08T00:30:19.622670+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:29.433981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.615805+0000","last_change":"2023-10-08T00:30:19.615805+0000","last_active":"2023-10-08T00:30:19.615805+0000","last_peered":"2023-10-08T00:30:19.615805+0000","last_clean":"2023-10-08T00:30:19.615805+0000","last_became_active":"2023-10-08T00:30:19.615420+0000","last_became_peered":"2023-10-08T00:30:19.615420+0000","last_unstale":"2023-10-08T00:30:19.615805+0000","last_undegraded":"2023-10-08T00:30:19.615805+0000","last_fullsized":"2023-10-08T00:30:19.615805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:07:44.257681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614795+0000","last_change":"2023-10-08T00:30:19.614795+0000","last_active":"2023-10-08T00:30:19.614795+0000","last_peered":"2023-10-08T00:30:19.614795+0000","last_clean":"2023-10-08T00:30:19.614795+0000","last_became_active":"2023-10-08T00:30:19.614523+0000","last_became_peered":"2023-10-08T00:30:19.614523+0000","last_unstale":"2023-10-08T00:30:19.614795+0000","last_undegraded":"2023-10-08T00:30:19.614795+0000","last_fullsized":"2023-10-08T00:30:19.614795+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:49.651053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620342+0000","last_change":"2023-10-08T00:30:19.620342+0000","last_active":"2023-10-08T00:30:19.620342+0000","last_peered":"2023-10-08T00:30:19.620342+0000","last_clean":"2023-10-08T00:30:19.620342+0000","last_became_active":"2023-10-08T00:30:19.620079+0000","last_became_peered":"2023-10-08T00:30:19.620079+0000","last_unstale":"2023-10-08T00:30:19.620342+0000","last_undegraded":"2023-10-08T00:30:19.620342+0000","last_fullsized":"2023-10-08T00:30:19.620342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:42.248952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621454+0000","last_change":"2023-10-08T00:30:19.621454+0000","last_active":"2023-10-08T00:30:19.621454+0000","last_peered":"2023-10-08T00:30:19.621454+0000","last_clean":"2023-10-08T00:30:19.621454+0000","last_became_active":"2023-10-08T00:30:19.621172+0000","last_became_peered":"2023-10-08T00:30:19.621172+0000","last_unstale":"2023-10-08T00:30:19.621454+0000","last_undegraded":"2023-10-08T00:30:19.621454+0000","last_fullsized":"2023-10-08T00:30:19.621454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621620+0000","last_change":"2023-10-08T00:30:19.621620+0000","last_active":"2023-10-08T00:30:19.621620+0000","last_peered":"2023-10-08T00:30:19.621620+0000","last_clean":"2023-10-08T00:30:19.621620+0000","last_became_active":"2023-10-08T00:30:19.620214+0000","last_became_peered":"2023-10-08T00:30:19.620214+0000","last_unstale":"2023-10-08T00:30:19.621620+0000","last_undegraded":"2023-10-08T00:30:19.621620+0000","last_fullsized":"2023-10-08T00:30:19.621620+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:13:30.458026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623574+0000","last_change":"2023-10-08T00:30:19.623574+0000","last_active":"2023-10-08T00:30:19.623574+0000","last_peered":"2023-10-08T00:30:19.623574+0000","last_clean":"2023-10-08T00:30:19.623574+0000","last_became_active":"2023-10-08T00:30:19.623321+0000","last_became_peered":"2023-10-08T00:30:19.623321+0000","last_unstale":"2023-10-08T00:30:19.623574+0000","last_undegraded":"2023-10-08T00:30:19.623574+0000","last_fullsized":"2023-10-08T00:30:19.623574+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:24.104140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626995+0000","last_change":"2023-10-08T00:30:19.626995+0000","last_active":"2023-10-08T00:30:19.626995+0000","last_peered":"2023-10-08T00:30:19.626995+0000","last_clean":"2023-10-08T00:30:19.626995+0000","last_became_active":"2023-10-08T00:30:19.626678+0000","last_became_peered":"2023-10-08T00:30:19.626678+0000","last_unstale":"2023-10-08T00:30:19.626995+0000","last_undegraded":"2023-10-08T00:30:19.626995+0000","last_fullsized":"2023-10-08T00:30:19.626995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:24:50.842623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623405+0000","last_change":"2023-10-08T00:30:19.623405+0000","last_active":"2023-10-08T00:30:19.623405+0000","last_peered":"2023-10-08T00:30:19.623405+0000","last_clean":"2023-10-08T00:30:19.623405+0000","last_became_active":"2023-10-08T00:30:19.623084+0000","last_became_peered":"2023-10-08T00:30:19.623084+0000","last_unstale":"2023-10-08T00:30:19.623405+0000","last_undegraded":"2023-10-08T00:30:19.623405+0000","last_fullsized":"2023-10-08T00:30:19.623405+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:43.459644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629543+0000","last_change":"2023-10-08T00:30:19.629543+0000","last_active":"2023-10-08T00:30:19.629543+0000","last_peered":"2023-10-08T00:30:19.629543+0000","last_clean":"2023-10-08T00:30:19.629543+0000","last_became_active":"2023-10-08T00:30:19.628924+0000","last_became_peered":"2023-10-08T00:30:19.628924+0000","last_unstale":"2023-10-08T00:30:19.629543+0000","last_undegraded":"2023-10-08T00:30:19.629543+0000","last_fullsized":"2023-10-08T00:30:19.629543+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:30.808829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.630008+0000","last_change":"2023-10-08T00:30:19.630008+0000","last_active":"2023-10-08T00:30:19.630008+0000","last_peered":"2023-10-08T00:30:19.630008+0000","last_clean":"2023-10-08T00:30:19.630008+0000","last_became_active":"2023-10-08T00:30:19.629613+0000","last_became_peered":"2023-10-08T00:30:19.629613+0000","last_unstale":"2023-10-08T00:30:19.630008+0000","last_undegraded":"2023-10-08T00:30:19.630008+0000","last_fullsized":"2023-10-08T00:30:19.630008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:34.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620506+0000","last_change":"2023-10-08T00:30:19.620506+0000","last_active":"2023-10-08T00:30:19.620506+0000","last_peered":"2023-10-08T00:30:19.620506+0000","last_clean":"2023-10-08T00:30:19.620506+0000","last_became_active":"2023-10-08T00:30:19.620259+0000","last_became_peered":"2023-10-08T00:30:19.620259+0000","last_unstale":"2023-10-08T00:30:19.620506+0000","last_undegraded":"2023-10-08T00:30:19.620506+0000","last_fullsized":"2023-10-08T00:30:19.620506+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:34.771830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627642+0000","last_change":"2023-10-08T00:30:19.627642+0000","last_active":"2023-10-08T00:30:19.627642+0000","last_peered":"2023-10-08T00:30:19.627642+0000","last_clean":"2023-10-08T00:30:19.627642+0000","last_became_active":"2023-10-08T00:30:19.627412+0000","last_became_peered":"2023-10-08T00:30:19.627412+0000","last_unstale":"2023-10-08T00:30:19.627642+0000","last_undegraded":"2023-10-08T00:30:19.627642+0000","last_fullsized":"2023-10-08T00:30:19.627642+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:34.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627956+0000","last_change":"2023-10-08T00:30:19.627956+0000","last_active":"2023-10-08T00:30:19.627956+0000","last_peered":"2023-10-08T00:30:19.627956+0000","last_clean":"2023-10-08T00:30:19.627956+0000","last_became_active":"2023-10-08T00:30:19.627673+0000","last_became_peered":"2023-10-08T00:30:19.627673+0000","last_unstale":"2023-10-08T00:30:19.627956+0000","last_undegraded":"2023-10-08T00:30:19.627956+0000","last_fullsized":"2023-10-08T00:30:19.627956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:37.112618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622434+0000","last_change":"2023-10-08T00:30:19.622434+0000","last_active":"2023-10-08T00:30:19.622434+0000","last_peered":"2023-10-08T00:30:19.622434+0000","last_clean":"2023-10-08T00:30:19.622434+0000","last_became_active":"2023-10-08T00:30:19.622159+0000","last_became_peered":"2023-10-08T00:30:19.622159+0000","last_unstale":"2023-10-08T00:30:19.622434+0000","last_undegraded":"2023-10-08T00:30:19.622434+0000","last_fullsized":"2023-10-08T00:30:19.622434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:47.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627230+0000","last_change":"2023-10-08T00:30:19.627230+0000","last_active":"2023-10-08T00:30:19.627230+0000","last_peered":"2023-10-08T00:30:19.627230+0000","last_clean":"2023-10-08T00:30:19.627230+0000","last_became_active":"2023-10-08T00:30:19.626975+0000","last_became_peered":"2023-10-08T00:30:19.626975+0000","last_unstale":"2023-10-08T00:30:19.627230+0000","last_undegraded":"2023-10-08T00:30:19.627230+0000","last_fullsized":"2023-10-08T00:30:19.627230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:04.378528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"77'4","reported_seq":13,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805565+0000","last_change":"2023-10-08T00:30:18.815120+0000","last_active":"2023-10-08T00:30:19.805565+0000","last_peered":"2023-10-08T00:30:19.805565+0000","last_clean":"2023-10-08T00:30:19.805565+0000","last_became_active":"2023-10-08T00:30:18.814871+0000","last_became_peered":"2023-10-08T00:30:18.814871+0000","last_unstale":"2023-10-08T00:30:19.805565+0000","last_undegraded":"2023-10-08T00:30:19.805565+0000","last_fullsized":"2023-10-08T00:30:19.805565+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:04.686632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621259+0000","last_change":"2023-10-08T00:30:19.621259+0000","last_active":"2023-10-08T00:30:19.621259+0000","last_peered":"2023-10-08T00:30:19.621259+0000","last_clean":"2023-10-08T00:30:19.621259+0000","last_became_active":"2023-10-08T00:30:19.620979+0000","last_became_peered":"2023-10-08T00:30:19.620979+0000","last_unstale":"2023-10-08T00:30:19.621259+0000","last_undegraded":"2023-10-08T00:30:19.621259+0000","last_fullsized":"2023-10-08T00:30:19.621259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:30.808829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621693+0000","last_change":"2023-10-08T00:30:18.805432+0000","last_active":"2023-10-08T00:30:19.621693+0000","last_peered":"2023-10-08T00:30:19.621693+0000","last_clean":"2023-10-08T00:30:19.621693+0000","last_became_active":"2023-10-08T00:30:18.804861+0000","last_became_peered":"2023-10-08T00:30:18.804861+0000","last_unstale":"2023-10-08T00:30:19.621693+0000","last_undegraded":"2023-10-08T00:30:19.621693+0000","last_fullsized":"2023-10-08T00:30:19.621693+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:33:07.281161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622973+0000","last_change":"2023-10-08T00:30:19.622973+0000","last_active":"2023-10-08T00:30:19.622973+0000","last_peered":"2023-10-08T00:30:19.622973+0000","last_clean":"2023-10-08T00:30:19.622973+0000","last_became_active":"2023-10-08T00:30:19.622401+0000","last_became_peered":"2023-10-08T00:30:19.622401+0000","last_unstale":"2023-10-08T00:30:19.622973+0000","last_undegraded":"2023-10-08T00:30:19.622973+0000","last_fullsized":"2023-10-08T00:30:19.622973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:32.779686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805273+0000","last_change":"2023-10-08T00:30:18.810584+0000","last_active":"2023-10-08T00:30:19.805273+0000","last_peered":"2023-10-08T00:30:19.805273+0000","last_clean":"2023-10-08T00:30:19.805273+0000","last_became_active":"2023-10-08T00:30:18.810373+0000","last_became_peered":"2023-10-08T00:30:18.810373+0000","last_unstale":"2023-10-08T00:30:19.805273+0000","last_undegraded":"2023-10-08T00:30:19.805273+0000","last_fullsized":"2023-10-08T00:30:19.805273+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:31:14.277840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623164+0000","last_change":"2023-10-08T00:30:19.623164+0000","last_active":"2023-10-08T00:30:19.623164+0000","last_peered":"2023-10-08T00:30:19.623164+0000","last_clean":"2023-10-08T00:30:19.623164+0000","last_became_active":"2023-10-08T00:30:19.622912+0000","last_became_peered":"2023-10-08T00:30:19.622912+0000","last_unstale":"2023-10-08T00:30:19.623164+0000","last_undegraded":"2023-10-08T00:30:19.623164+0000","last_fullsized":"2023-10-08T00:30:19.623164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:49:54.323854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805367+0000","last_change":"2023-10-08T00:30:18.810084+0000","last_active":"2023-10-08T00:30:19.805367+0000","last_peered":"2023-10-08T00:30:19.805367+0000","last_clean":"2023-10-08T00:30:19.805367+0000","last_became_active":"2023-10-08T00:30:18.809801+0000","last_became_peered":"2023-10-08T00:30:18.809801+0000","last_unstale":"2023-10-08T00:30:19.805367+0000","last_undegraded":"2023-10-08T00:30:19.805367+0000","last_fullsized":"2023-10-08T00:30:19.805367+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:59:32.042532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.626122+0000","last_change":"2023-10-08T00:30:19.626122+0000","last_active":"2023-10-08T00:30:19.626122+0000","last_peered":"2023-10-08T00:30:19.626122+0000","last_clean":"2023-10-08T00:30:19.626122+0000","last_became_active":"2023-10-08T00:30:19.625862+0000","last_became_peered":"2023-10-08T00:30:19.625862+0000","last_unstale":"2023-10-08T00:30:19.626122+0000","last_undegraded":"2023-10-08T00:30:19.626122+0000","last_fullsized":"2023-10-08T00:30:19.626122+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:13:30.458026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614898+0000","last_change":"2023-10-08T00:30:18.809250+0000","last_active":"2023-10-08T00:30:19.614898+0000","last_peered":"2023-10-08T00:30:19.614898+0000","last_clean":"2023-10-08T00:30:19.614898+0000","last_became_active":"2023-10-08T00:30:18.808555+0000","last_became_peered":"2023-10-08T00:30:18.808555+0000","last_unstale":"2023-10-08T00:30:19.614898+0000","last_undegraded":"2023-10-08T00:30:19.614898+0000","last_fullsized":"2023-10-08T00:30:19.614898+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:32.323102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621166+0000","last_change":"2023-10-08T00:30:19.621166+0000","last_active":"2023-10-08T00:30:19.621166+0000","last_peered":"2023-10-08T00:30:19.621166+0000","last_clean":"2023-10-08T00:30:19.621166+0000","last_became_active":"2023-10-08T00:30:19.620895+0000","last_became_peered":"2023-10-08T00:30:19.620895+0000","last_unstale":"2023-10-08T00:30:19.621166+0000","last_undegraded":"2023-10-08T00:30:19.621166+0000","last_fullsized":"2023-10-08T00:30:19.621166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:47.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614668+0000","last_change":"2023-10-08T00:30:18.805214+0000","last_active":"2023-10-08T00:30:19.614668+0000","last_peered":"2023-10-08T00:30:19.614668+0000","last_clean":"2023-10-08T00:30:19.614668+0000","last_became_active":"2023-10-08T00:30:18.804850+0000","last_became_peered":"2023-10-08T00:30:18.804850+0000","last_unstale":"2023-10-08T00:30:19.614668+0000","last_undegraded":"2023-10-08T00:30:19.614668+0000","last_fullsized":"2023-10-08T00:30:19.614668+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:58:11.044207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618348+0000","last_change":"2023-10-08T00:30:19.618348+0000","last_active":"2023-10-08T00:30:19.618348+0000","last_peered":"2023-10-08T00:30:19.618348+0000","last_clean":"2023-10-08T00:30:19.618348+0000","last_became_active":"2023-10-08T00:30:19.618070+0000","last_became_peered":"2023-10-08T00:30:19.618070+0000","last_unstale":"2023-10-08T00:30:19.618348+0000","last_undegraded":"2023-10-08T00:30:19.618348+0000","last_fullsized":"2023-10-08T00:30:19.618348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:37:40.567110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.816510+0000","last_change":"2023-10-08T00:30:18.813847+0000","last_active":"2023-10-08T00:30:18.816510+0000","last_peered":"2023-10-08T00:30:18.816510+0000","last_clean":"2023-10-08T00:30:18.816510+0000","last_became_active":"2023-10-08T00:30:18.813562+0000","last_became_peered":"2023-10-08T00:30:18.813562+0000","last_unstale":"2023-10-08T00:30:18.816510+0000","last_undegraded":"2023-10-08T00:30:18.816510+0000","last_fullsized":"2023-10-08T00:30:18.816510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:03.372740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.624539+0000","last_change":"2023-10-08T00:30:19.624539+0000","last_active":"2023-10-08T00:30:19.624539+0000","last_peered":"2023-10-08T00:30:19.624539+0000","last_clean":"2023-10-08T00:30:19.624539+0000","last_became_active":"2023-10-08T00:30:19.624229+0000","last_became_peered":"2023-10-08T00:30:19.624229+0000","last_unstale":"2023-10-08T00:30:19.624539+0000","last_undegraded":"2023-10-08T00:30:19.624539+0000","last_fullsized":"2023-10-08T00:30:19.624539+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:37:40.567110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.818298+0000","last_change":"2023-10-08T00:30:18.817528+0000","last_active":"2023-10-08T00:30:18.818298+0000","last_peered":"2023-10-08T00:30:18.818298+0000","last_clean":"2023-10-08T00:30:18.818298+0000","last_became_active":"2023-10-08T00:30:18.815824+0000","last_became_peered":"2023-10-08T00:30:18.815824+0000","last_unstale":"2023-10-08T00:30:18.818298+0000","last_undegraded":"2023-10-08T00:30:18.818298+0000","last_fullsized":"2023-10-08T00:30:18.818298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:34.598067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620973+0000","last_change":"2023-10-08T00:30:19.620973+0000","last_active":"2023-10-08T00:30:19.620973+0000","last_peered":"2023-10-08T00:30:19.620973+0000","last_clean":"2023-10-08T00:30:19.620973+0000","last_became_active":"2023-10-08T00:30:19.620674+0000","last_became_peered":"2023-10-08T00:30:19.620674+0000","last_unstale":"2023-10-08T00:30:19.620973+0000","last_undegraded":"2023-10-08T00:30:19.620973+0000","last_fullsized":"2023-10-08T00:30:19.620973+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:53:43.459644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817482+0000","last_change":"2023-10-08T00:30:18.808885+0000","last_active":"2023-10-08T00:30:18.817482+0000","last_peered":"2023-10-08T00:30:18.817482+0000","last_clean":"2023-10-08T00:30:18.817482+0000","last_became_active":"2023-10-08T00:30:18.808625+0000","last_became_peered":"2023-10-08T00:30:18.808625+0000","last_unstale":"2023-10-08T00:30:18.817482+0000","last_undegraded":"2023-10-08T00:30:18.817482+0000","last_fullsized":"2023-10-08T00:30:18.817482+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:34.598067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.625255+0000","last_change":"2023-10-08T00:30:19.625255+0000","last_active":"2023-10-08T00:30:19.625255+0000","last_peered":"2023-10-08T00:30:19.625255+0000","last_clean":"2023-10-08T00:30:19.625255+0000","last_became_active":"2023-10-08T00:30:19.624997+0000","last_became_peered":"2023-10-08T00:30:19.624997+0000","last_unstale":"2023-10-08T00:30:19.625255+0000","last_undegraded":"2023-10-08T00:30:19.625255+0000","last_fullsized":"2023-10-08T00:30:19.625255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:53:30.808829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.820278+0000","last_change":"2023-10-08T00:30:18.816037+0000","last_active":"2023-10-08T00:30:18.820278+0000","last_peered":"2023-10-08T00:30:18.820278+0000","last_clean":"2023-10-08T00:30:18.820278+0000","last_became_active":"2023-10-08T00:30:18.815755+0000","last_became_peered":"2023-10-08T00:30:18.815755+0000","last_unstale":"2023-10-08T00:30:18.820278+0000","last_undegraded":"2023-10-08T00:30:18.820278+0000","last_fullsized":"2023-10-08T00:30:18.820278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:59:30.283861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623339+0000","last_change":"2023-10-08T00:30:19.623339+0000","last_active":"2023-10-08T00:30:19.623339+0000","last_peered":"2023-10-08T00:30:19.623339+0000","last_clean":"2023-10-08T00:30:19.623339+0000","last_became_active":"2023-10-08T00:30:19.623094+0000","last_became_peered":"2023-10-08T00:30:19.623094+0000","last_unstale":"2023-10-08T00:30:19.623339+0000","last_undegraded":"2023-10-08T00:30:19.623339+0000","last_fullsized":"2023-10-08T00:30:19.623339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:24.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"77'3","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.806442+0000","last_change":"2023-10-08T00:30:18.811279+0000","last_active":"2023-10-08T00:30:19.806442+0000","last_peered":"2023-10-08T00:30:19.806442+0000","last_clean":"2023-10-08T00:30:19.806442+0000","last_became_active":"2023-10-08T00:30:18.810894+0000","last_became_peered":"2023-10-08T00:30:18.810894+0000","last_unstale":"2023-10-08T00:30:19.806442+0000","last_undegraded":"2023-10-08T00:30:19.806442+0000","last_fullsized":"2023-10-08T00:30:19.806442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:14:36.161753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629278+0000","last_change":"2023-10-08T00:30:19.629278+0000","last_active":"2023-10-08T00:30:19.629278+0000","last_peered":"2023-10-08T00:30:19.629278+0000","last_clean":"2023-10-08T00:30:19.629278+0000","last_became_active":"2023-10-08T00:30:19.628717+0000","last_became_peered":"2023-10-08T00:30:19.628717+0000","last_unstale":"2023-10-08T00:30:19.629278+0000","last_undegraded":"2023-10-08T00:30:19.629278+0000","last_fullsized":"2023-10-08T00:30:19.629278+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:46:33.280760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"77'6","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.807045+0000","last_change":"2023-10-08T00:30:18.814265+0000","last_active":"2023-10-08T00:30:19.807045+0000","last_peered":"2023-10-08T00:30:19.807045+0000","last_clean":"2023-10-08T00:30:19.807045+0000","last_became_active":"2023-10-08T00:30:18.813970+0000","last_became_peered":"2023-10-08T00:30:18.813970+0000","last_unstale":"2023-10-08T00:30:19.807045+0000","last_undegraded":"2023-10-08T00:30:19.807045+0000","last_fullsized":"2023-10-08T00:30:19.807045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:05:42.041516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.620452+0000","last_change":"2023-10-08T00:30:19.620452+0000","last_active":"2023-10-08T00:30:19.620452+0000","last_peered":"2023-10-08T00:30:19.620452+0000","last_clean":"2023-10-08T00:30:19.620452+0000","last_became_active":"2023-10-08T00:30:19.619987+0000","last_became_peered":"2023-10-08T00:30:19.619987+0000","last_unstale":"2023-10-08T00:30:19.620452+0000","last_undegraded":"2023-10-08T00:30:19.620452+0000","last_fullsized":"2023-10-08T00:30:19.620452+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:08.514756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.804657+0000","last_change":"2023-10-08T00:30:18.810986+0000","last_active":"2023-10-08T00:30:19.804657+0000","last_peered":"2023-10-08T00:30:19.804657+0000","last_clean":"2023-10-08T00:30:19.804657+0000","last_became_active":"2023-10-08T00:30:18.810623+0000","last_became_peered":"2023-10-08T00:30:18.810623+0000","last_unstale":"2023-10-08T00:30:19.804657+0000","last_undegraded":"2023-10-08T00:30:19.804657+0000","last_fullsized":"2023-10-08T00:30:19.804657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:12:34.202569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621248+0000","last_change":"2023-10-08T00:30:19.621248+0000","last_active":"2023-10-08T00:30:19.621248+0000","last_peered":"2023-10-08T00:30:19.621248+0000","last_clean":"2023-10-08T00:30:19.621248+0000","last_became_active":"2023-10-08T00:30:19.620961+0000","last_became_peered":"2023-10-08T00:30:19.620961+0000","last_unstale":"2023-10-08T00:30:19.621248+0000","last_undegraded":"2023-10-08T00:30:19.621248+0000","last_fullsized":"2023-10-08T00:30:19.621248+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:07.893635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.814928+0000","last_change":"2023-10-08T00:30:18.813458+0000","last_active":"2023-10-08T00:30:18.814928+0000","last_peered":"2023-10-08T00:30:18.814928+0000","last_clean":"2023-10-08T00:30:18.814928+0000","last_became_active":"2023-10-08T00:30:18.813182+0000","last_became_peered":"2023-10-08T00:30:18.813182+0000","last_unstale":"2023-10-08T00:30:18.814928+0000","last_undegraded":"2023-10-08T00:30:18.814928+0000","last_fullsized":"2023-10-08T00:30:18.814928+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:23.212503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.628282+0000","last_change":"2023-10-08T00:30:19.628282+0000","last_active":"2023-10-08T00:30:19.628282+0000","last_peered":"2023-10-08T00:30:19.628282+0000","last_clean":"2023-10-08T00:30:19.628282+0000","last_became_active":"2023-10-08T00:30:19.628008+0000","last_became_peered":"2023-10-08T00:30:19.628008+0000","last_unstale":"2023-10-08T00:30:19.628282+0000","last_undegraded":"2023-10-08T00:30:19.628282+0000","last_fullsized":"2023-10-08T00:30:19.628282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:32.779686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.810357+0000","last_change":"2023-10-08T00:30:18.806284+0000","last_active":"2023-10-08T00:30:18.810357+0000","last_peered":"2023-10-08T00:30:18.810357+0000","last_clean":"2023-10-08T00:30:18.810357+0000","last_became_active":"2023-10-08T00:30:18.806038+0000","last_became_peered":"2023-10-08T00:30:18.806038+0000","last_unstale":"2023-10-08T00:30:18.810357+0000","last_undegraded":"2023-10-08T00:30:18.810357+0000","last_fullsized":"2023-10-08T00:30:18.810357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:08:44.517840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622881+0000","last_change":"2023-10-08T00:30:19.622881+0000","last_active":"2023-10-08T00:30:19.622881+0000","last_peered":"2023-10-08T00:30:19.622881+0000","last_clean":"2023-10-08T00:30:19.622881+0000","last_became_active":"2023-10-08T00:30:19.622605+0000","last_became_peered":"2023-10-08T00:30:19.622605+0000","last_unstale":"2023-10-08T00:30:19.622881+0000","last_undegraded":"2023-10-08T00:30:19.622881+0000","last_fullsized":"2023-10-08T00:30:19.622881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:08:45.523628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"77'8","reported_seq":17,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.810245+0000","last_change":"2023-10-08T00:30:18.814926+0000","last_active":"2023-10-08T00:30:19.810245+0000","last_peered":"2023-10-08T00:30:19.810245+0000","last_clean":"2023-10-08T00:30:19.810245+0000","last_became_active":"2023-10-08T00:30:18.814556+0000","last_became_peered":"2023-10-08T00:30:18.814556+0000","last_unstale":"2023-10-08T00:30:19.810245+0000","last_undegraded":"2023-10-08T00:30:19.810245+0000","last_fullsized":"2023-10-08T00:30:19.810245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:52:05.483533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618969+0000","last_change":"2023-10-08T00:30:19.618969+0000","last_active":"2023-10-08T00:30:19.618969+0000","last_peered":"2023-10-08T00:30:19.618969+0000","last_clean":"2023-10-08T00:30:19.618969+0000","last_became_active":"2023-10-08T00:30:19.618703+0000","last_became_peered":"2023-10-08T00:30:19.618703+0000","last_unstale":"2023-10-08T00:30:19.618969+0000","last_undegraded":"2023-10-08T00:30:19.618969+0000","last_fullsized":"2023-10-08T00:30:19.618969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:07:44.257681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.613926+0000","last_change":"2023-10-08T00:30:18.811921+0000","last_active":"2023-10-08T00:30:19.613926+0000","last_peered":"2023-10-08T00:30:19.613926+0000","last_clean":"2023-10-08T00:30:19.613926+0000","last_became_active":"2023-10-08T00:30:18.811654+0000","last_became_peered":"2023-10-08T00:30:18.811654+0000","last_unstale":"2023-10-08T00:30:19.613926+0000","last_undegraded":"2023-10-08T00:30:19.613926+0000","last_fullsized":"2023-10-08T00:30:19.613926+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:56.906557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.625946+0000","last_change":"2023-10-08T00:30:19.625946+0000","last_active":"2023-10-08T00:30:19.625946+0000","last_peered":"2023-10-08T00:30:19.625946+0000","last_clean":"2023-10-08T00:30:19.625946+0000","last_became_active":"2023-10-08T00:30:19.625253+0000","last_became_peered":"2023-10-08T00:30:19.625253+0000","last_unstale":"2023-10-08T00:30:19.625946+0000","last_undegraded":"2023-10-08T00:30:19.625946+0000","last_fullsized":"2023-10-08T00:30:19.625946+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:53.989941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805347+0000","last_change":"2023-10-08T00:30:18.816146+0000","last_active":"2023-10-08T00:30:19.805347+0000","last_peered":"2023-10-08T00:30:19.805347+0000","last_clean":"2023-10-08T00:30:19.805347+0000","last_became_active":"2023-10-08T00:30:18.815972+0000","last_became_peered":"2023-10-08T00:30:18.815972+0000","last_unstale":"2023-10-08T00:30:19.805347+0000","last_undegraded":"2023-10-08T00:30:19.805347+0000","last_fullsized":"2023-10-08T00:30:19.805347+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:15.228906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.629045+0000","last_change":"2023-10-08T00:30:19.629045+0000","last_active":"2023-10-08T00:30:19.629045+0000","last_peered":"2023-10-08T00:30:19.629045+0000","last_clean":"2023-10-08T00:30:19.629045+0000","last_became_active":"2023-10-08T00:30:19.627065+0000","last_became_peered":"2023-10-08T00:30:19.627065+0000","last_unstale":"2023-10-08T00:30:19.629045+0000","last_undegraded":"2023-10-08T00:30:19.629045+0000","last_fullsized":"2023-10-08T00:30:19.629045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:59:33.048320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817115+0000","last_change":"2023-10-08T00:30:18.815184+0000","last_active":"2023-10-08T00:30:18.817115+0000","last_peered":"2023-10-08T00:30:18.817115+0000","last_clean":"2023-10-08T00:30:18.817115+0000","last_became_active":"2023-10-08T00:30:18.814524+0000","last_became_peered":"2023-10-08T00:30:18.814524+0000","last_unstale":"2023-10-08T00:30:18.817115+0000","last_undegraded":"2023-10-08T00:30:18.817115+0000","last_fullsized":"2023-10-08T00:30:18.817115+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:46:32.274971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622899+0000","last_change":"2023-10-08T00:30:19.622899+0000","last_active":"2023-10-08T00:30:19.622899+0000","last_peered":"2023-10-08T00:30:19.622899+0000","last_clean":"2023-10-08T00:30:19.622899+0000","last_became_active":"2023-10-08T00:30:19.622631+0000","last_became_peered":"2023-10-08T00:30:19.622631+0000","last_unstale":"2023-10-08T00:30:19.622899+0000","last_undegraded":"2023-10-08T00:30:19.622899+0000","last_fullsized":"2023-10-08T00:30:19.622899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:38.616266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.805537+0000","last_change":"2023-10-08T00:30:18.805914+0000","last_active":"2023-10-08T00:30:19.805537+0000","last_peered":"2023-10-08T00:30:19.805537+0000","last_clean":"2023-10-08T00:30:19.805537+0000","last_became_active":"2023-10-08T00:30:18.805631+0000","last_became_peered":"2023-10-08T00:30:18.805631+0000","last_unstale":"2023-10-08T00:30:19.805537+0000","last_undegraded":"2023-10-08T00:30:19.805537+0000","last_fullsized":"2023-10-08T00:30:19.805537+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:09.902371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618182+0000","last_change":"2023-10-08T00:30:19.618182+0000","last_active":"2023-10-08T00:30:19.618182+0000","last_peered":"2023-10-08T00:30:19.618182+0000","last_clean":"2023-10-08T00:30:19.618182+0000","last_became_active":"2023-10-08T00:30:19.617688+0000","last_became_peered":"2023-10-08T00:30:19.617688+0000","last_unstale":"2023-10-08T00:30:19.618182+0000","last_undegraded":"2023-10-08T00:30:19.618182+0000","last_fullsized":"2023-10-08T00:30:19.618182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:07.016686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817350+0000","last_change":"2023-10-08T00:30:18.813020+0000","last_active":"2023-10-08T00:30:18.817350+0000","last_peered":"2023-10-08T00:30:18.817350+0000","last_clean":"2023-10-08T00:30:18.817350+0000","last_became_active":"2023-10-08T00:30:18.812721+0000","last_became_peered":"2023-10-08T00:30:18.812721+0000","last_unstale":"2023-10-08T00:30:18.817350+0000","last_undegraded":"2023-10-08T00:30:18.817350+0000","last_fullsized":"2023-10-08T00:30:18.817350+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:45:20.378991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.613024+0000","last_change":"2023-10-08T00:30:19.613024+0000","last_active":"2023-10-08T00:30:19.613024+0000","last_peered":"2023-10-08T00:30:19.613024+0000","last_clean":"2023-10-08T00:30:19.613024+0000","last_became_active":"2023-10-08T00:30:19.612740+0000","last_became_peered":"2023-10-08T00:30:19.612740+0000","last_unstale":"2023-10-08T00:30:19.613024+0000","last_undegraded":"2023-10-08T00:30:19.613024+0000","last_fullsized":"2023-10-08T00:30:19.613024+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:42.582393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.812373+0000","last_change":"2023-10-08T00:30:18.809820+0000","last_active":"2023-10-08T00:30:18.812373+0000","last_peered":"2023-10-08T00:30:18.812373+0000","last_clean":"2023-10-08T00:30:18.812373+0000","last_became_active":"2023-10-08T00:30:18.809518+0000","last_became_peered":"2023-10-08T00:30:18.809518+0000","last_unstale":"2023-10-08T00:30:18.812373+0000","last_undegraded":"2023-10-08T00:30:18.812373+0000","last_fullsized":"2023-10-08T00:30:18.812373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:07:18.889715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.618160+0000","last_change":"2023-10-08T00:30:19.618160+0000","last_active":"2023-10-08T00:30:19.618160+0000","last_peered":"2023-10-08T00:30:19.618160+0000","last_clean":"2023-10-08T00:30:19.618160+0000","last_became_active":"2023-10-08T00:30:19.617836+0000","last_became_peered":"2023-10-08T00:30:19.617836+0000","last_unstale":"2023-10-08T00:30:19.618160+0000","last_undegraded":"2023-10-08T00:30:19.618160+0000","last_fullsized":"2023-10-08T00:30:19.618160+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.807836+0000","last_change":"2023-10-08T00:30:18.805838+0000","last_active":"2023-10-08T00:30:18.807836+0000","last_peered":"2023-10-08T00:30:18.807836+0000","last_clean":"2023-10-08T00:30:18.807836+0000","last_became_active":"2023-10-08T00:30:18.805534+0000","last_became_peered":"2023-10-08T00:30:18.805534+0000","last_unstale":"2023-10-08T00:30:18.807836+0000","last_undegraded":"2023-10-08T00:30:18.807836+0000","last_fullsized":"2023-10-08T00:30:18.807836+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:07:43.251893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622228+0000","last_change":"2023-10-08T00:30:19.622228+0000","last_active":"2023-10-08T00:30:19.622228+0000","last_peered":"2023-10-08T00:30:19.622228+0000","last_clean":"2023-10-08T00:30:19.622228+0000","last_became_active":"2023-10-08T00:30:19.621941+0000","last_became_peered":"2023-10-08T00:30:19.621941+0000","last_unstale":"2023-10-08T00:30:19.622228+0000","last_undegraded":"2023-10-08T00:30:19.622228+0000","last_fullsized":"2023-10-08T00:30:19.622228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"77'2","reported_seq":11,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.809603+0000","last_change":"2023-10-08T00:30:18.813376+0000","last_active":"2023-10-08T00:30:19.809603+0000","last_peered":"2023-10-08T00:30:19.809603+0000","last_clean":"2023-10-08T00:30:19.809603+0000","last_became_active":"2023-10-08T00:30:18.813090+0000","last_became_peered":"2023-10-08T00:30:18.813090+0000","last_unstale":"2023-10-08T00:30:19.809603+0000","last_undegraded":"2023-10-08T00:30:19.809603+0000","last_fullsized":"2023-10-08T00:30:19.809603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:10:28.689581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.624887+0000","last_change":"2023-10-08T00:30:19.624887+0000","last_active":"2023-10-08T00:30:19.624887+0000","last_peered":"2023-10-08T00:30:19.624887+0000","last_clean":"2023-10-08T00:30:19.624887+0000","last_became_active":"2023-10-08T00:30:19.624630+0000","last_became_peered":"2023-10-08T00:30:19.624630+0000","last_unstale":"2023-10-08T00:30:19.624887+0000","last_undegraded":"2023-10-08T00:30:19.624887+0000","last_fullsized":"2023-10-08T00:30:19.624887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:44:40.199872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817276+0000","last_change":"2023-10-08T00:30:18.813526+0000","last_active":"2023-10-08T00:30:18.817276+0000","last_peered":"2023-10-08T00:30:18.817276+0000","last_clean":"2023-10-08T00:30:18.817276+0000","last_became_active":"2023-10-08T00:30:18.813227+0000","last_became_peered":"2023-10-08T00:30:18.813227+0000","last_unstale":"2023-10-08T00:30:18.817276+0000","last_undegraded":"2023-10-08T00:30:18.817276+0000","last_fullsized":"2023-10-08T00:30:18.817276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:44.575920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.627884+0000","last_change":"2023-10-08T00:30:19.627884+0000","last_active":"2023-10-08T00:30:19.627884+0000","last_peered":"2023-10-08T00:30:19.627884+0000","last_clean":"2023-10-08T00:30:19.627884+0000","last_became_active":"2023-10-08T00:30:19.627603+0000","last_became_peered":"2023-10-08T00:30:19.627603+0000","last_unstale":"2023-10-08T00:30:19.627884+0000","last_undegraded":"2023-10-08T00:30:19.627884+0000","last_fullsized":"2023-10-08T00:30:19.627884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:37.112618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817619+0000","last_change":"2023-10-08T00:30:18.811377+0000","last_active":"2023-10-08T00:30:18.817619+0000","last_peered":"2023-10-08T00:30:18.817619+0000","last_clean":"2023-10-08T00:30:18.817619+0000","last_became_active":"2023-10-08T00:30:18.811111+0000","last_became_peered":"2023-10-08T00:30:18.811111+0000","last_unstale":"2023-10-08T00:30:18.817619+0000","last_undegraded":"2023-10-08T00:30:18.817619+0000","last_fullsized":"2023-10-08T00:30:18.817619+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:10:28.689581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.628636+0000","last_change":"2023-10-08T00:30:19.628636+0000","last_active":"2023-10-08T00:30:19.628636+0000","last_peered":"2023-10-08T00:30:19.628636+0000","last_clean":"2023-10-08T00:30:19.628636+0000","last_became_active":"2023-10-08T00:30:19.626709+0000","last_became_peered":"2023-10-08T00:30:19.626709+0000","last_unstale":"2023-10-08T00:30:19.628636+0000","last_undegraded":"2023-10-08T00:30:19.628636+0000","last_fullsized":"2023-10-08T00:30:19.628636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:53.989941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817474+0000","last_change":"2023-10-08T00:30:18.808882+0000","last_active":"2023-10-08T00:30:18.817474+0000","last_peered":"2023-10-08T00:30:18.817474+0000","last_clean":"2023-10-08T00:30:18.817474+0000","last_became_active":"2023-10-08T00:30:18.808571+0000","last_became_peered":"2023-10-08T00:30:18.808571+0000","last_unstale":"2023-10-08T00:30:18.817474+0000","last_undegraded":"2023-10-08T00:30:18.817474+0000","last_fullsized":"2023-10-08T00:30:18.817474+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:24:44.575920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.617630+0000","last_change":"2023-10-08T00:30:19.617630+0000","last_active":"2023-10-08T00:30:19.617630+0000","last_peered":"2023-10-08T00:30:19.617630+0000","last_clean":"2023-10-08T00:30:19.617630+0000","last_became_active":"2023-10-08T00:30:19.617210+0000","last_became_peered":"2023-10-08T00:30:19.617210+0000","last_unstale":"2023-10-08T00:30:19.617630+0000","last_undegraded":"2023-10-08T00:30:19.617630+0000","last_fullsized":"2023-10-08T00:30:19.617630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:10:34.163944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817053+0000","last_change":"2023-10-08T00:30:18.814399+0000","last_active":"2023-10-08T00:30:18.817053+0000","last_peered":"2023-10-08T00:30:18.817053+0000","last_clean":"2023-10-08T00:30:18.817053+0000","last_became_active":"2023-10-08T00:30:18.814089+0000","last_became_peered":"2023-10-08T00:30:18.814089+0000","last_unstale":"2023-10-08T00:30:18.817053+0000","last_undegraded":"2023-10-08T00:30:18.817053+0000","last_fullsized":"2023-10-08T00:30:18.817053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:08:46.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.623780+0000","last_change":"2023-10-08T00:30:19.623780+0000","last_active":"2023-10-08T00:30:19.623780+0000","last_peered":"2023-10-08T00:30:19.623780+0000","last_clean":"2023-10-08T00:30:19.623780+0000","last_became_active":"2023-10-08T00:30:19.623527+0000","last_became_peered":"2023-10-08T00:30:19.623527+0000","last_unstale":"2023-10-08T00:30:19.623780+0000","last_undegraded":"2023-10-08T00:30:19.623780+0000","last_fullsized":"2023-10-08T00:30:19.623780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:43:37.641517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.815221+0000","last_change":"2023-10-08T00:30:18.805099+0000","last_active":"2023-10-08T00:30:18.815221+0000","last_peered":"2023-10-08T00:30:18.815221+0000","last_clean":"2023-10-08T00:30:18.815221+0000","last_became_active":"2023-10-08T00:30:18.804482+0000","last_became_peered":"2023-10-08T00:30:18.804482+0000","last_unstale":"2023-10-08T00:30:18.815221+0000","last_undegraded":"2023-10-08T00:30:18.815221+0000","last_fullsized":"2023-10-08T00:30:18.815221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:51:37.267027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621390+0000","last_change":"2023-10-08T00:30:19.621390+0000","last_active":"2023-10-08T00:30:19.621390+0000","last_peered":"2023-10-08T00:30:19.621390+0000","last_clean":"2023-10-08T00:30:19.621390+0000","last_became_active":"2023-10-08T00:30:19.621110+0000","last_became_peered":"2023-10-08T00:30:19.621110+0000","last_unstale":"2023-10-08T00:30:19.621390+0000","last_undegraded":"2023-10-08T00:30:19.621390+0000","last_fullsized":"2023-10-08T00:30:19.621390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:31.906579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.817490+0000","last_change":"2023-10-08T00:30:18.809077+0000","last_active":"2023-10-08T00:30:18.817490+0000","last_peered":"2023-10-08T00:30:18.817490+0000","last_clean":"2023-10-08T00:30:18.817490+0000","last_became_active":"2023-10-08T00:30:18.808223+0000","last_became_peered":"2023-10-08T00:30:18.808223+0000","last_unstale":"2023-10-08T00:30:18.817490+0000","last_undegraded":"2023-10-08T00:30:18.817490+0000","last_fullsized":"2023-10-08T00:30:18.817490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:12:34.202569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.622950+0000","last_change":"2023-10-08T00:30:19.622950+0000","last_active":"2023-10-08T00:30:19.622950+0000","last_peered":"2023-10-08T00:30:19.622950+0000","last_clean":"2023-10-08T00:30:19.622950+0000","last_became_active":"2023-10-08T00:30:19.622672+0000","last_became_peered":"2023-10-08T00:30:19.622672+0000","last_unstale":"2023-10-08T00:30:19.622950+0000","last_undegraded":"2023-10-08T00:30:19.622950+0000","last_fullsized":"2023-10-08T00:30:19.622950+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:28:46.704639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.815365+0000","last_change":"2023-10-08T00:30:18.810122+0000","last_active":"2023-10-08T00:30:18.815365+0000","last_peered":"2023-10-08T00:30:18.815365+0000","last_clean":"2023-10-08T00:30:18.815365+0000","last_became_active":"2023-10-08T00:30:18.809860+0000","last_became_peered":"2023-10-08T00:30:18.809860+0000","last_unstale":"2023-10-08T00:30:18.815365+0000","last_undegraded":"2023-10-08T00:30:18.815365+0000","last_fullsized":"2023-10-08T00:30:18.815365+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:38:53.498788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":8,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.621258+0000","last_change":"2023-10-08T00:30:19.621258+0000","last_active":"2023-10-08T00:30:19.621258+0000","last_peered":"2023-10-08T00:30:19.621258+0000","last_clean":"2023-10-08T00:30:19.621258+0000","last_became_active":"2023-10-08T00:30:19.620979+0000","last_became_peered":"2023-10-08T00:30:19.620979+0000","last_unstale":"2023-10-08T00:30:19.621258+0000","last_undegraded":"2023-10-08T00:30:19.621258+0000","last_fullsized":"2023-10-08T00:30:19.621258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:18.790249+0000","last_clean_scrub_stamp":"2023-10-08T00:30:18.790249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:19:49.042367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"77'1","reported_seq":10,"reported_epoch":77,"state":"active+clean","last_fresh":"2023-10-08T00:30:19.614328+0000","last_change":"2023-10-08T00:30:18.815683+0000","last_active":"2023-10-08T00:30:19.614328+0000","last_peered":"2023-10-08T00:30:19.614328+0000","last_clean":"2023-10-08T00:30:19.614328+0000","last_became_active":"2023-10-08T00:30:18.815427+0000","last_became_peered":"2023-10-08T00:30:18.815427+0000","last_unstale":"2023-10-08T00:30:19.614328+0000","last_undegraded":"2023-10-08T00:30:19.614328+0000","last_fullsized":"2023-10-08T00:30:19.614328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:17.784461+0000","last_clean_scrub_stamp":"2023-10-08T00:30:17.784461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:15.228906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-08T00:30:18.807335+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:18.807335+0000","last_peered":"2023-10-08T00:30:18.807335+0000","last_clean":"2023-10-08T00:30:18.807335+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:18.807335+0000","last_undegraded":"2023-10-08T00:30:18.807335+0000","last_fullsized":"2023-10-08T00:30:18.807335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298792,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073048,"statfs":{"total":96636764160,"available":96330801152,"internally_reserved":0,"allocated":1540096,"data_stored":996529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.67900000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":406827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.501}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302320,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069520,"statfs":{"total":96636764160,"available":96327188480,"internally_reserved":0,"allocated":958464,"data_stored":406355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.247},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.308}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.33200000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.45400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.46800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302892,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068948,"statfs":{"total":96636764160,"available":96326602752,"internally_reserved":0,"allocated":1544192,"data_stored":996563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.252},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.36499999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.627},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.66200000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.52300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":950272,"data_stored":406715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.315},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.29399999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33200000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.44600000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.40200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.497},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.435}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":406161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.40300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.433}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.628},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":406161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.625},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.53700000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.495}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073612,"statfs":{"total":96636764160,"available":96331378688,"internally_reserved":0,"allocated":962560,"data_stored":407719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.34499999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.62}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.55200000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42299999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:30:24.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:30:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.465+0000 7fcdc5ad2700 1 Processor -- start 2023-10-08T00:30:24.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.465+0000 7fcdc5ad2700 1 -- start start 2023-10-08T00:30:24.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdc5ad2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcdc00cca50 0x7fcdc00caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdc5ad2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcdc00cce20 0x7fcdc015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdc5ad2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc0157c50 con 0x7fcdc015df40 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdc5ad2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc015d7d0 con 0x7fcdc00cca50 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdc5ad2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc015aa20 con 0x7fcdc00cce20 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdbf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcdc00cca50 0x7fcdc00caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdbffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcdc015df40 0x7fcdc006ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36754/0 (socket says 172.21.15.22:36754) 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.466+0000 7fcdbffff700 1 -- 172.21.15.22:0/4049819519 learned_addr learned my addr 172.21.15.22:0/4049819519 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbeffd700 1 --2- 172.21.15.22:0/4049819519 >> v2:172.21.15.192:3300/0 conn(0x7fcdc00cce20 0x7fcdc015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/4049819519 >> v2:172.21.15.192:3300/0 conn(0x7fcdc00cce20 msgr2=0x7fcdc015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbf7fe700 1 --2- 172.21.15.22:0/4049819519 >> v2:172.21.15.192:3300/0 conn(0x7fcdc00cce20 0x7fcdc015a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/4049819519 >> v1:172.21.15.22:6789/0 conn(0x7fcdc015df40 legacy=0x7fcdc006ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/4049819519 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc015ad00 con 0x7fcdc00cca50 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbe7fc700 1 -- 172.21.15.22:0/4049819519 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324829748 0 0) 0x7fcdb8001490 con 0x7fcdc015df40 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbeffd700 1 --2- 172.21.15.22:0/4049819519 >> v2:172.21.15.192:3300/0 conn(0x7fcdc00cce20 0x7fcdc015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbf7fe700 1 --2- 172.21.15.22:0/4049819519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc00caab0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcdc006ada0 tx=0x7fcdb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44be6b5ccffcab59 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbe7fc700 1 -- 172.21.15.22:0/4049819519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000b6b0 con 0x7fcdc00cca50 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbe7fc700 1 -- 172.21.15.22:0/4049819519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb000b810 con 0x7fcdc00cca50 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.467+0000 7fcdbe7fc700 1 -- 172.21.15.22:0/4049819519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000bbb0 con 0x7fcdc00cca50 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/4049819519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 msgr2=0x7fcdc00caab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/4049819519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc00caab0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcdc006ada0 tx=0x7fcdb00091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/4049819519 shutdown_connections 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/4049819519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc00caab0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/4049819519 >> v2:172.21.15.192:3300/0 conn(0x7fcdc00cce20 0x7fcdc015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/4049819519 >> 172.21.15.22:0/4049819519 conn(0x7fcdc00ce5c0 msgr2=0x7fcdc00ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/4049819519 shutdown_connections 2023-10-08T00:30:24.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.468+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/4049819519 wait complete. 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.469+0000 7fcdc5ad2700 1 Processor -- start 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.469+0000 7fcdc5ad2700 1 -- start start 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc014a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdc00cce20 0x7fcdc015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc015df40 0x7fcdc0156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00b3070 con 0x7fcdc00cca50 2023-10-08T00:30:24.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc014a910 con 0x7fcdc015df40 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00b2460 con 0x7fcdc00cce20 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc014a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc014a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56514/0 (socket says 172.21.15.22:56514) 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/352190323 learned_addr learned my addr 172.21.15.22:0/352190323 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbeffd700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdc00cce20 0x7fcdc015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdc00cce20 msgr2=0x7fcdc015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbffff700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc015df40 0x7fcdc0156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdc00cce20 0x7fcdc015cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc015df40 msgr2=0x7fcdc0156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc015df40 0x7fcdc0156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 -- 172.21.15.22:0/352190323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0009420 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdbf7fe700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc014a3d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0069220 tx=0x7fcdb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011420 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0011580 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc00b2740 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.470+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0011920 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.471+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc00b2d00 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.472+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc00718b0 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.472+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fcdb0011d10 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.472+0000 7fcda77fe700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdac067170 0x7fcdac069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.473+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdb0085f50 con 0x7fcdc00cca50 2023-10-08T00:30:24.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.473+0000 7fcdbeffd700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdac067170 0x7fcdac069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.473+0000 7fcdbeffd700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdac067170 0x7fcdac069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcdc006e400 tx=0x7fcdb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.477+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdb0052fb0 con 0x7fcdc00cca50 2023-10-08T00:30:24.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.755+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcdc015afe0 con 0x7fcdc00cca50 2023-10-08T00:30:24.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.759+0000 7fcda77fe700 1 -- 172.21.15.22:0/352190323 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcdb00565d0 con 0x7fcdc00cca50 2023-10-08T00:30:24.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdac067170 msgr2=0x7fcdac069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdac067170 0x7fcdac069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcdc006e400 tx=0x7fcdb4008040 comp rx=0 tx=0).stop 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 msgr2=0x7fcdc014a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc014a3d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0069220 tx=0x7fcdb0017000 comp rx=0 tx=0).stop 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 shutdown_connections 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc015df40 0x7fcdc0156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdc00cca50 0x7fcdc014a3d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdac067170 0x7fcdac069620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 --2- 172.21.15.22:0/352190323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdc00cce20 0x7fcdc015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 >> 172.21.15.22:0/352190323 conn(0x7fcdc00ce5c0 msgr2=0x7fcdc00c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 shutdown_connections 2023-10-08T00:30:24.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.761+0000 7fcdc5ad2700 1 -- 172.21.15.22:0/352190323 wait complete. 2023-10-08T00:30:24.763 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:30:24.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.893+0000 7f6a93d83700 1 Processor -- start 2023-10-08T00:30:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.893+0000 7f6a93d83700 1 -- start start 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a93d83700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a8c159890 0x7f6a8c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a93d83700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6a8c159c60 0x7f6a8c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a93d83700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c15a160 con 0x7f6a8c15db10 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a93d83700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c15df50 con 0x7f6a8c159890 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a93d83700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0d13a0 con 0x7f6a8c159c60 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a91b1f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6a8c159890 0x7f6a8c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a92320700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6a8c15db10 0x7f6a8c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36768/0 (socket says 172.21.15.22:36768) 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a92320700 1 -- 172.21.15.22:0/2730308923 learned_addr learned my addr 172.21.15.22:0/2730308923 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.894+0000 7f6a9131e700 1 --2- 172.21.15.22:0/2730308923 >> v2:172.21.15.192:3300/0 conn(0x7f6a8c159c60 0x7f6a8c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a91b1f700 1 -- 172.21.15.22:0/2730308923 >> v2:172.21.15.192:3300/0 conn(0x7f6a8c159c60 msgr2=0x7f6a8c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a91b1f700 1 --2- 172.21.15.22:0/2730308923 >> v2:172.21.15.192:3300/0 conn(0x7f6a8c159c60 0x7f6a8c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a91b1f700 1 -- 172.21.15.22:0/2730308923 >> v1:172.21.15.22:6789/0 conn(0x7f6a8c15db10 legacy=0x7f6a8c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a91b1f700 1 -- 172.21.15.22:0/2730308923 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c15e140 con 0x7f6a8c159890 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a90b1d700 1 -- 172.21.15.22:0/2730308923 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134882043 0 0) 0x7f6a8c15a160 con 0x7f6a8c15db10 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a91b1f700 1 --2- 172.21.15.22:0/2730308923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c15abd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0b67f0 tx=0x7f6a84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb2a73e353accbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a90b1d700 1 -- 172.21.15.22:0/2730308923 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8400e070 con 0x7f6a8c159890 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a90b1d700 1 -- 172.21.15.22:0/2730308923 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8400bc30 con 0x7f6a8c159890 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a90b1d700 1 -- 172.21.15.22:0/2730308923 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84012430 con 0x7f6a8c159890 2023-10-08T00:30:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 -- 172.21.15.22:0/2730308923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 msgr2=0x7f6a8c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 --2- 172.21.15.22:0/2730308923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c15abd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0b67f0 tx=0x7f6a84009780 comp rx=0 tx=0).stop 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 -- 172.21.15.22:0/2730308923 shutdown_connections 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 --2- 172.21.15.22:0/2730308923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c15abd0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 --2- 172.21.15.22:0/2730308923 >> v2:172.21.15.192:3300/0 conn(0x7f6a8c159c60 0x7f6a8c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 -- 172.21.15.22:0/2730308923 >> 172.21.15.22:0/2730308923 conn(0x7f6a8c068e20 msgr2=0x7f6a8c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.895+0000 7f6a93d83700 1 -- 172.21.15.22:0/2730308923 shutdown_connections 2023-10-08T00:30:24.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.896+0000 7f6a93d83700 1 -- 172.21.15.22:0/2730308923 wait complete. 2023-10-08T00:30:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 Processor -- start 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 -- start start 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a8c159c60 0x7f6a8c16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a8c15db10 0x7f6a8c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cf3c0 con 0x7f6a8c159890 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cf6a0 con 0x7f6a8c159c60 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a93d83700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0cf980 con 0x7f6a8c15db10 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a91b1f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a91b1f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56524/0 (socket says 172.21.15.22:56524) 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.897+0000 7f6a91b1f700 1 -- 172.21.15.22:0/4126942239 learned_addr learned my addr 172.21.15.22:0/4126942239 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a92320700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a8c15db10 0x7f6a8c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a9131e700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a8c159c60 0x7f6a8c16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a91b1f700 1 -- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a8c15db10 msgr2=0x7f6a8c152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a91b1f700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a8c15db10 0x7f6a8c152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a91b1f700 1 -- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a8c159c60 msgr2=0x7f6a8c16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a91b1f700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a8c159c60 0x7f6a8c16a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a91b1f700 1 -- 172.21.15.22:0/4126942239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009a20 con 0x7f6a8c159890 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a91b1f700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c0ceac0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6a840099f0 tx=0x7f6a84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84027470 con 0x7f6a8c159890 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84027610 con 0x7f6a8c159890 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0cfc60 con 0x7f6a8c159890 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840279d0 con 0x7f6a8c159890 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.898+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c16a710 con 0x7f6a8c159890 2023-10-08T00:30:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.899+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c04c3c0 con 0x7f6a8c159890 2023-10-08T00:30:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.900+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6a84024070 con 0x7f6a8c159890 2023-10-08T00:30:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.900+0000 7f6a89ffb700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a78067170 0x7f6a78069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.900+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a84086ec0 con 0x7f6a8c159890 2023-10-08T00:30:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.900+0000 7f6a9131e700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a78067170 0x7f6a78069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.901+0000 7f6a9131e700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a78067170 0x7f6a78069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c1513b0 tx=0x7f6a80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:24.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:24.905+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a84053ea0 con 0x7f6a8c159890 2023-10-08T00:30:25.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.141+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a8c0cbe40 con 0x7f6a8c159890 2023-10-08T00:30:25.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.141+0000 7f6a89ffb700 1 -- 172.21.15.22:0/4126942239 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f6a8402c020 con 0x7f6a8c159890 2023-10-08T00:30:25.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:25.142 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":51,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:19.209800+0000","modified":"2023-10-08T00:30:22.812658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/2279072181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2279072181},{"type":"v1","addr":"172.21.15.22:6835","nonce":2279072181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T00:30:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a78067170 msgr2=0x7f6a78069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a78067170 0x7f6a78069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c1513b0 tx=0x7f6a80008040 comp rx=0 tx=0).stop 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 msgr2=0x7f6a8c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c0ceac0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6a840099f0 tx=0x7f6a84019000 comp rx=0 tx=0).stop 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 shutdown_connections 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a78067170 0x7f6a78069620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6a8c15db10 0x7f6a8c152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a8c159890 0x7f6a8c0ceac0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 --2- 172.21.15.22:0/4126942239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a8c159c60 0x7f6a8c16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 >> 172.21.15.22:0/4126942239 conn(0x7f6a8c068e20 msgr2=0x7f6a8c1584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 shutdown_connections 2023-10-08T00:30:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.144+0000 7f6a93d83700 1 -- 172.21.15.22:0/4126942239 wait complete. 2023-10-08T00:30:25.146 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 51 2023-10-08T00:30:25.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:30:19.209800+0000', 'modified': '2023-10-08T00:30:22.812658+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6141}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6141': {'gid': 6141, 'name': 'a', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6835/2279072181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6833', 'nonce': 2279072181}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 2279072181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:30:25.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:30:25.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T00:30:25.611 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:30:25.611+0000 7ff16fb29700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:30:25.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.683+0000 7f6f25535700 1 Processor -- start 2023-10-08T00:30:25.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.683+0000 7f6f25535700 1 -- start start 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f25535700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f20159420 0x7f6f200b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f25535700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f200b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f25535700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200b11d0 con 0x7f6f2015d230 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f25535700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200b14b0 con 0x7f6f20159420 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f25535700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200b1790 con 0x7f6f201597f0 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f1ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f20159420 0x7f6f200b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f1ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f20159420 0x7f6f200b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56536/0 (socket says 172.21.15.22:56536) 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f1ffff700 1 -- 172.21.15.22:0/2189783715 learned_addr learned my addr 172.21.15.22:0/2189783715 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/2189783715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f200b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f1ffff700 1 -- 172.21.15.22:0/2189783715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 msgr2=0x7f6f200b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.684+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/2189783715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f200b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f1ffff700 1 -- 172.21.15.22:0/2189783715 >> v1:172.21.15.192:6789/0 conn(0x7f6f2015d230 legacy=0x7f6f200b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f1ffff700 1 -- 172.21.15.22:0/2189783715 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200b1a70 con 0x7f6f20159420 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/2189783715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200b5f40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6f100099b0 tx=0x7f6f10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae53019cde10902 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f1effd700 1 -- 172.21.15.22:0/2189783715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10009ea0 con 0x7f6f20159420 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f1effd700 1 -- 172.21.15.22:0/2189783715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1000b860 con 0x7f6f20159420 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f1effd700 1 -- 172.21.15.22:0/2189783715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000bc00 con 0x7f6f20159420 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f25535700 1 -- 172.21.15.22:0/2189783715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 msgr2=0x7f6f200b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f25535700 1 --2- 172.21.15.22:0/2189783715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200b5f40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6f100099b0 tx=0x7f6f10009250 comp rx=0 tx=0).stop 2023-10-08T00:30:25.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f25535700 1 -- 172.21.15.22:0/2189783715 shutdown_connections 2023-10-08T00:30:25.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f25535700 1 --2- 172.21.15.22:0/2189783715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200b5f40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f25535700 1 --2- 172.21.15.22:0/2189783715 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f200b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.685+0000 7f6f25535700 1 -- 172.21.15.22:0/2189783715 >> 172.21.15.22:0/2189783715 conn(0x7f6f200d0660 msgr2=0x7f6f200d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.686+0000 7f6f25535700 1 -- 172.21.15.22:0/2189783715 shutdown_connections 2023-10-08T00:30:25.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.686+0000 7f6f25535700 1 -- 172.21.15.22:0/2189783715 wait complete. 2023-10-08T00:30:25.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 Processor -- start 2023-10-08T00:30:25.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 -- start start 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f2016d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f2015d230 0x7f6f200ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2016e050 con 0x7f6f20159420 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2016d5a0 con 0x7f6f2015d230 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.687+0000 7f6f25535700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2016d7b0 con 0x7f6f201597f0 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56546/0 (socket says 172.21.15.22:56546) 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 -- 172.21.15.22:0/522259116 learned_addr learned my addr 172.21.15.22:0/522259116 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f2016d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f24d34700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f2015d230 0x7f6f200ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 -- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 msgr2=0x7f6f2016d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f2016d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 -- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f2015d230 msgr2=0x7f6f200ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f2015d230 0x7f6f200ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 -- 172.21.15.22:0/522259116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f100094f0 con 0x7f6f20159420 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f24d34700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f2015d230 0x7f6f200ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200c6b20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6f20089340 tx=0x7f6f10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f07fff700 1 -- 172.21.15.22:0/522259116 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000bbe0 con 0x7f6f20159420 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f07fff700 1 -- 172.21.15.22:0/522259116 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f10011420 con 0x7f6f20159420 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2016da90 con 0x7f6f20159420 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f07fff700 1 -- 172.21.15.22:0/522259116 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100117c0 con 0x7f6f20159420 2023-10-08T00:30:25.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.688+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f200c7b60 con 0x7f6f20159420 2023-10-08T00:30:25.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.689+0000 7f6f07fff700 1 -- 172.21.15.22:0/522259116 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6f10011b70 con 0x7f6f20159420 2023-10-08T00:30:25.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.690+0000 7f6f07fff700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f0c067170 0x7f6f0c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.690+0000 7f6f07fff700 1 -- 172.21.15.22:0/522259116 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f10086240 con 0x7f6f20159420 2023-10-08T00:30:25.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.690+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f0c067170 0x7f6f0c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.691+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f0c067170 0x7f6f0c069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6f20158aa0 tx=0x7f6f14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.692+0000 7f6f2fa8fb80 1 Processor -- start 2023-10-08T00:30:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.692+0000 7f6f2fa8fb80 1 -- start start 2023-10-08T00:30:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a1a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a1c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a17aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a0d1a70 con 0x55a41a1c5480 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a0cf270 con 0x55a41a17ab80 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a41a0cb060 con 0x55a41a1785f0 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a1a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a1a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56558/0 (socket says 172.21.15.22:56558) 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 -- 172.21.15.22:0/1394131170 learned_addr learned my addr 172.21.15.22:0/1394131170 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a1c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f24d34700 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a17aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 -- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 msgr2=0x55a41a1c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a1c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 -- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 msgr2=0x55a41a17aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a17aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 -- 172.21.15.22:0/1394131170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a419f65270 con 0x55a41a1c5480 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a1a47d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6f10084490 tx=0x7f6f10053220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2688d0b126ed54 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f057fa700 1 -- 172.21.15.22:0/1394131170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100860c0 con 0x55a41a1c5480 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f057fa700 1 -- 172.21.15.22:0/1394131170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100575e0 con 0x55a41a1c5480 2023-10-08T00:30:25.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.693+0000 7f6f057fa700 1 -- 172.21.15.22:0/1394131170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10056ee0 con 0x55a41a1c5480 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1394131170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 msgr2=0x55a41a1a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a1a47d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6f10084490 tx=0x7f6f10053220 comp rx=0 tx=0).stop 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1394131170 shutdown_connections 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a17aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a1a47d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1394131170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a1c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1394131170 >> 172.21.15.22:0/1394131170 conn(0x55a41a17c0c0 msgr2=0x55a41a17c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1394131170 shutdown_connections 2023-10-08T00:30:25.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.694+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1394131170 wait complete. 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.695+0000 7f6f2fa8fb80 1 -- start start 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.695+0000 7f6f2fa8fb80 1 Processor -- start 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.695+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 0x55a41a1a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1c5480 0x55a41a17de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a076890 con 0x55a41a17ab80 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a091ea0 con 0x55a41a1c5480 2023-10-08T00:30:25.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a419f4de30 con 0x55a41a1785f0 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 10 client.0 _ll_register_callbacks cb 0x55a41a13e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 0x55a41a1a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 0x55a41a1a5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56560/0 (socket says 172.21.15.22:56560) 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 -- 172.21.15.22:0/1241954435 learned_addr learned my addr 172.21.15.22:0/1241954435 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f24d34700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1c5480 0x55a41a17de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 -- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 msgr2=0x55a41a19eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a19eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 -- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1c5480 msgr2=0x55a41a17de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1c5480 0x55a41a17de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 -- 172.21.15.22:0/1241954435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f200c7b60 con 0x55a41a17ab80 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 0x55a41a1a5af0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6f14015820 tx=0x7f6f14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f96c807c9f76d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6efe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6efe7fc700 1 -- 172.21.15.22:0/1241954435 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14021620 con 0x55a41a17ab80 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6efe7fc700 1 -- 172.21.15.22:0/1241954435 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f14021780 con 0x55a41a17ab80 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a41a16fcd0 con 0x55a41a17ab80 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6efe7fc700 1 -- 172.21.15.22:0/1241954435 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f14021b50 con 0x55a41a17ab80 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 10 client.6297 fetch_fsmap learned FSMap version 51 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.696+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55a419f07fe0 con 0x55a41a17ab80 2023-10-08T00:30:25.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6efe7fc700 1 -- 172.21.15.22:0/1241954435 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a41a16fcd0 con 0x55a41a17ab80 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6efe7fc700 1 -- 172.21.15.22:0/1241954435 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6f14021cb0 con 0x55a41a17ab80 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f2fa8fb80 10 client.6297 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f2fa8fb80 10 client.6297 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f2fa8fb80 20 client.6297 populate_metadata read hostname 'smithi022' 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1c4720 0x55a41a1c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f2fa8fb80 4 client.6297 mds_command: new command op to 6141 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 --> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a41a14caa0 con 0x55a41a1c4720 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1c4720 0x55a41a1c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6efe7fc700 10 client.6297 ms_handle_connect on v2:172.21.15.22:6833/2279072181 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.697+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1c4720 0x55a41a1c4af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef9082403298713 server_cookie=1e99b413ff94aad2 in_seq=0 out_seq=0 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6efe7fc700 1 -- 172.21.15.22:0/1241954435 <== mds.0 v2:172.21.15.22:6833/2279072181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a41a14caa0 con 0x55a41a1c4720 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6efe7fc700 10 client.6297 handle_command_reply: tid=0 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 client.6297 shutdown 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 msgr2=0x55a41a1a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 0x55a41a1a5af0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6f14015820 tx=0x7f6f14018000 comp rx=0 tx=0).stop 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 shutdown_connections 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1c4720 0x55a41a1c4af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1c5480 0x55a41a17de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1785f0 0x55a41a19eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/1241954435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a17ab80 0x55a41a1a5af0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6efe7fc700 0 client.6297 ms_handle_reset on v2:172.21.15.22:6833/2279072181 2023-10-08T00:30:25.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 >> 172.21.15.22:0/1241954435 conn(0x55a41a17c0c0 msgr2=0x55a41a171cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 shutdown_connections 2023-10-08T00:30:25.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/1241954435 wait complete. 2023-10-08T00:30:25.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.698+0000 7f6f2fa8fb80 20 client.6297 trim_cache size 0 max 16384 2023-10-08T00:30:25.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.715+0000 7f6f2fa8fb80 1 Processor -- start 2023-10-08T00:30:25.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.715+0000 7f6f2fa8fb80 1 -- start start 2023-10-08T00:30:25.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1785f0 0x55a41a177980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a17ab80 0x55a41a177ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a19eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a15a510 con 0x55a41a1c5480 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a17a9f0 con 0x55a41a1785f0 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a41a176f90 con 0x55a41a17ab80 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a19eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a19eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56576/0 (socket says 172.21.15.22:56576) 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 -- 172.21.15.22:0/2596903782 learned_addr learned my addr 172.21.15.22:0/2596903782 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a17ab80 0x55a41a177ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1785f0 0x55a41a177980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 -- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a17ab80 msgr2=0x55a41a177ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a17ab80 0x55a41a177ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 -- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1785f0 msgr2=0x55a41a177980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1785f0 0x55a41a177980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f24d34700 1 -- 172.21.15.22:0/2596903782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a41a099780 con 0x55a41a1c5480 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.716+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a17ab80 0x55a41a177ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f24d34700 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a19eea0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6f18003c00 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561b83fdf8808058 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f05ffb700 1 -- 172.21.15.22:0/2596903782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18006ba0 con 0x55a41a1c5480 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f05ffb700 1 -- 172.21.15.22:0/2596903782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800d040 con 0x55a41a1c5480 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f05ffb700 1 -- 172.21.15.22:0/2596903782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180108c0 con 0x55a41a1c5480 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/2596903782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 msgr2=0x55a41a19eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a19eea0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6f18003c00 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/2596903782 shutdown_connections 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1c5480 0x55a41a19eea0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a1785f0 0x55a41a177980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/2596903782 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a17ab80 0x55a41a177ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/2596903782 >> 172.21.15.22:0/2596903782 conn(0x55a41a17c0c0 msgr2=0x55a41a170f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/2596903782 shutdown_connections 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.717+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/2596903782 wait complete. 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.718+0000 7f6f2fa8fb80 1 -- start start 2023-10-08T00:30:25.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.718+0000 7f6f2fa8fb80 1 Processor -- start 2023-10-08T00:30:25.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 0x55a41a1a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a1a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1c5480 0x55a41a1a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a2284e0 con 0x55a41a1785f0 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41a1a39b0 con 0x55a41a17ab80 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a41a1a7090 con 0x55a41a1c5480 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f2fa8fb80 10 client.0 _ll_register_callbacks cb 0x55a41a13e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 0x55a41a1a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 0x55a41a1a3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56592/0 (socket says 172.21.15.22:56592) 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 -- 172.21.15.22:0/3379131016 learned_addr learned my addr 172.21.15.22:0/3379131016 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f24d34700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1c5480 0x55a41a1a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a1a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 -- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1c5480 msgr2=0x55a41a1a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1c5480 0x55a41a1a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 -- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 msgr2=0x55a41a1a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a1a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 -- 172.21.15.22:0/3379131016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f200b11d0 con 0x55a41a1785f0 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a1a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:25.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6f1ffff700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 0x55a41a1a3e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f10056b90 tx=0x7f6f10058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac047bf604f8f33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.719+0000 7f6efe7fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6efe7fc700 1 -- 172.21.15.22:0/3379131016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10056ee0 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6efe7fc700 1 -- 172.21.15.22:0/3379131016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f10055280 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f100575e0 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6efe7fc700 1 -- 172.21.15.22:0/3379131016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f100565e0 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 10 client.6303 fetch_fsmap learned FSMap version 51 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55a41a080470 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6efe7fc700 1 -- 172.21.15.22:0/3379131016 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100575e0 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6efe7fc700 1 -- 172.21.15.22:0/3379131016 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 51) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6f1006d100 con 0x55a41a1785f0 2023-10-08T00:30:25.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 10 client.6303 fetch_fsmap finished waiting for FSMap version 51 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 10 client.6303 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 20 client.6303 populate_metadata read hostname 'smithi022' 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1d30f0 0x55a41a1d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 4 client.6303 mds_command: new command op to 6141 tid=0[{"prefix": "status"}] 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 --> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a41a06de00 con 0x55a41a1d30f0 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.720+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1d30f0 0x55a41a1d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6efe7fc700 10 client.6303 ms_handle_connect on v2:172.21.15.22:6833/2279072181 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f1f7fe700 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1d30f0 0x55a41a1d34c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f5b22d3b34afe server_cookie=146a58e3523a72db in_seq=0 out_seq=0 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6efe7fc700 1 -- 172.21.15.22:0/3379131016 <== mds.0 v2:172.21.15.22:6833/2279072181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a41a06de00 con 0x55a41a1d30f0 2023-10-08T00:30:25.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6efe7fc700 10 client.6303 handle_command_reply: tid=0 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 client.6303 shutdown 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 msgr2=0x55a41a1a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 0x55a41a1a3e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6f10056b90 tx=0x7f6f10058000 comp rx=0 tx=0).stop 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 shutdown_connections 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:6833/2279072181,v1:172.21.15.22:6835/2279072181] conn(0x55a41a1d30f0 0x55a41a1d34c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a41a1c5480 0x55a41a1a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6efe7fc700 0 client.6303 ms_handle_reset on v2:172.21.15.22:6833/2279072181 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a41a1785f0 0x55a41a1a3e40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 --2- 172.21.15.22:0/3379131016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a41a17ab80 0x55a41a1a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 >> 172.21.15.22:0/3379131016 conn(0x55a41a17c0c0 msgr2=0x55a41a170f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 shutdown_connections 2023-10-08T00:30:25.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 1 -- 172.21.15.22:0/3379131016 wait complete. 2023-10-08T00:30:25.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.721+0000 7f6f2fa8fb80 20 client.6303 trim_cache size 0 max 16384 2023-10-08T00:30:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:25.731 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 6141, 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 5.9259252580000004, 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 51, 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 78, 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 78, 2023-10-08T00:30:25.732 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 10.99094672 2023-10-08T00:30:25.733 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:25.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f0c067170 msgr2=0x7f6f0c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f0c067170 0x7f6f0c069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6f20158aa0 tx=0x7f6f14008040 comp rx=0 tx=0).stop 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 msgr2=0x7f6f200c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200c6b20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6f20089340 tx=0x7f6f10017000 comp rx=0 tx=0).stop 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 shutdown_connections 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f2015d230 0x7f6f200ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f20159420 0x7f6f200c6b20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f0c067170 0x7f6f0c069620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 --2- 172.21.15.22:0/522259116 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f201597f0 0x7f6f2016d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 >> 172.21.15.22:0/522259116 conn(0x7f6f200d0660 msgr2=0x7f6f201571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 shutdown_connections 2023-10-08T00:30:25.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.722+0000 7f6f25535700 1 -- 172.21.15.22:0/522259116 wait complete. 2023-10-08T00:30:25.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:30:25.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.854+0000 7f12ba6cb700 1 Processor -- start 2023-10-08T00:30:25.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.854+0000 7f12ba6cb700 1 -- start start 2023-10-08T00:30:25.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12ba6cb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12b4159890 0x7f12b415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12ba6cb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12b4069560 0x7f12b40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12ba6cb700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b4069ee0 con 0x7f12b4159c60 2023-10-08T00:30:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12ba6cb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b415a160 con 0x7f12b4159890 2023-10-08T00:30:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12ba6cb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b40d13a0 con 0x7f12b4069560 2023-10-08T00:30:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12b3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f12b4159890 0x7f12b415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12b37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f12b4159c60 0x7f12b415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36778/0 (socket says 172.21.15.22:36778) 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.855+0000 7f12b37fe700 1 -- 172.21.15.22:0/246836030 learned_addr learned my addr 172.21.15.22:0/246836030 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b8c68700 1 --2- 172.21.15.22:0/246836030 >> v2:172.21.15.192:3300/0 conn(0x7f12b4069560 0x7f12b40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b3fff700 1 -- 172.21.15.22:0/246836030 >> v2:172.21.15.192:3300/0 conn(0x7f12b4069560 msgr2=0x7f12b40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b3fff700 1 --2- 172.21.15.22:0/246836030 >> v2:172.21.15.192:3300/0 conn(0x7f12b4069560 0x7f12b40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b3fff700 1 -- 172.21.15.22:0/246836030 >> v1:172.21.15.22:6789/0 conn(0x7f12b4159c60 legacy=0x7f12b415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b2ffd700 1 -- 172.21.15.22:0/246836030 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795654518 0 0) 0x7f12b4069ee0 con 0x7f12b4159c60 2023-10-08T00:30:25.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b3fff700 1 -- 172.21.15.22:0/246836030 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b415e140 con 0x7f12b4159890 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b3fff700 1 --2- 172.21.15.22:0/246836030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4159890 0x7f12b415abd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f12b406a890 tx=0x7f12a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122ddbfb38d39d80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b2ffd700 1 -- 172.21.15.22:0/246836030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400b6b0 con 0x7f12b4159890 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b2ffd700 1 -- 172.21.15.22:0/246836030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400b810 con 0x7f12b4159890 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.856+0000 7f12b2ffd700 1 -- 172.21.15.22:0/246836030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400bbb0 con 0x7f12b4159890 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 -- 172.21.15.22:0/246836030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4159890 msgr2=0x7f12b415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/246836030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4159890 0x7f12b415abd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f12b406a890 tx=0x7f12a40091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 -- 172.21.15.22:0/246836030 shutdown_connections 2023-10-08T00:30:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/246836030 >> v2:172.21.15.192:3300/0 conn(0x7f12b4069560 0x7f12b40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/246836030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4159890 0x7f12b415abd0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 -- 172.21.15.22:0/246836030 >> 172.21.15.22:0/246836030 conn(0x7f12b4068e20 msgr2=0x7f12b40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 -- 172.21.15.22:0/246836030 shutdown_connections 2023-10-08T00:30:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.857+0000 7f12ba6cb700 1 -- 172.21.15.22:0/246836030 wait complete. 2023-10-08T00:30:25.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.858+0000 7f12ba6cb700 1 Processor -- start 2023-10-08T00:30:25.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.858+0000 7f12ba6cb700 1 -- start start 2023-10-08T00:30:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 0x7f12b4169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b4159890 0x7f12b4151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b4159c60 0x7f12b416b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40b48f0 con 0x7f12b4069560 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b416a840 con 0x7f12b4159890 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b416ab20 con 0x7f12b4159c60 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 0x7f12b4169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 0x7f12b4169ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56616/0 (socket says 172.21.15.22:56616) 2023-10-08T00:30:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 -- 172.21.15.22:0/856885449 learned_addr learned my addr 172.21.15.22:0/856885449 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b8c68700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b4159c60 0x7f12b416b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b37fe700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b4159890 0x7f12b4151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 -- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b4159c60 msgr2=0x7f12b416b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b4159c60 0x7f12b416b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 -- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b4159890 msgr2=0x7f12b4151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b4159890 0x7f12b4151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 -- 172.21.15.22:0/856885449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4009420 con 0x7f12b4069560 2023-10-08T00:30:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12b3fff700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 0x7f12b4169ed0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f12b4070e20 tx=0x7f12a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400b980 con 0x7f12b4069560 2023-10-08T00:30:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400bb00 con 0x7f12b4069560 2023-10-08T00:30:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b40b4b90 con 0x7f12b4069560 2023-10-08T00:30:25.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.859+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4025670 con 0x7f12b4069560 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.860+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b416a410 con 0x7f12b4069560 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.860+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b416a600 con 0x7f12b4069560 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.861+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f12a4023070 con 0x7f12b4069560 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.861+0000 7f129bfff700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f12a0067170 0x7f12a0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.861+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12a4085fd0 con 0x7f12b4069560 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.862+0000 7f12b37fe700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f12a0067170 0x7f12a0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.862+0000 7f12b37fe700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f12a0067170 0x7f12a0069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12b40b0290 tx=0x7f12a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:25.865+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12b416a600 con 0x7f12b4069560 2023-10-08T00:30:26.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.106+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12b40b4dd0 con 0x7f12b4069560 2023-10-08T00:30:26.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.106+0000 7f129bfff700 1 -- 172.21.15.22:0/856885449 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12b40b4dd0 con 0x7f12b4069560 2023-10-08T00:30:26.107 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:30:26.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f12a0067170 msgr2=0x7f12a0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:26.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f12a0067170 0x7f12a0069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12b40b0290 tx=0x7f12a8009040 comp rx=0 tx=0).stop 2023-10-08T00:30:26.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 msgr2=0x7f12b4169ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:26.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 0x7f12b4169ed0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f12b4070e20 tx=0x7f12a4017000 comp rx=0 tx=0).stop 2023-10-08T00:30:26.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 shutdown_connections 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f12a0067170 0x7f12a0069620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f12b4159c60 0x7f12b416b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f12b4069560 0x7f12b4169ed0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 --2- 172.21.15.22:0/856885449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12b4159890 0x7f12b4151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 >> 172.21.15.22:0/856885449 conn(0x7f12b4068e20 msgr2=0x7f12b40c6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 shutdown_connections 2023-10-08T00:30:26.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.108+0000 7f12ba6cb700 1 -- 172.21.15.22:0/856885449 wait complete. 2023-10-08T00:30:26.121 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:30:26.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:30:26.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:30:26.121 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:30:26.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:26.121 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:30:26.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:30:26.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:30:26.122 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:30:26.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.122 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:26.138 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42145sec preferred_lft 42145sec 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:30:26.139 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:30:26.140 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:30:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.141 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:30:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:30:26.141 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:26.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.141 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:30:26.202 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:30:26.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.204 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:30:26.261 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:30:26.261 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:30:26.261 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:30:26.261 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:30:26.261 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:30:26.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.262 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:30:26.262 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:30:26.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:30:26.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:30:26.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:30:26.262 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:30:26.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.364 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:30:26.379 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:30:26.379 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:30:26.380 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:30:26.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:30:26.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:26.444 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:26.502 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:30:26.502 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:26.502 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:26.557 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:30:26.557 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:30:26.557 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:26.639 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:26.639 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:26.658 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:26.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:26.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:26.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:26.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:26.658 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:26.659 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:26.659 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:26.680 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:30:26.681 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:30:26.683 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:30:26.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:26.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:26.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:30:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.910+0000 7fa761b19700 1 Processor -- start 2023-10-08T00:30:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.910+0000 7fa761b19700 1 -- start start 2023-10-08T00:30:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa761b19700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa761b19700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa75c15db10 0x7fa75c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa761b19700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c15a160 con 0x7fa75c159890 2023-10-08T00:30:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa761b19700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c0d13a0 con 0x7fa75c15db10 2023-10-08T00:30:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa761b19700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c15e140 con 0x7fa75c159c60 2023-10-08T00:30:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa75affd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa75bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa75c15db10 0x7fa75c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa75bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa75c15db10 0x7fa75c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:50290/0 (socket says 172.21.15.22:50290) 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa75affd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:58848/0 (socket says 172.21.15.22:58848) 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa75b7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa75c159890 0x7fa75c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:38100/0 (socket says 172.21.15.22:38100) 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.911+0000 7fa75bfff700 1 -- 172.21.15.22:0/2918841536 learned_addr learned my addr 172.21.15.22:0/2918841536 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75bfff700 1 -- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 msgr2=0x7fa75c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75bfff700 1 --2- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75bfff700 1 -- 172.21.15.22:0/2918841536 >> v1:172.21.15.192:6789/0 conn(0x7fa75c159890 legacy=0x7fa75c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75bfff700 1 -- 172.21.15.22:0/2918841536 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c15a3d0 con 0x7fa75c15db10 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75affd700 1 --2- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75bfff700 1 --2- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c069560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa754009f20 tx=0x7fa754009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d7ca7969007fe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75a7fc700 1 -- 172.21.15.22:0/2918841536 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400e070 con 0x7fa75c15db10 2023-10-08T00:30:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75a7fc700 1 -- 172.21.15.22:0/2918841536 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75400b9d0 con 0x7fa75c15db10 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.912+0000 7fa75a7fc700 1 -- 172.21.15.22:0/2918841536 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7540092e0 con 0x7fa75c15db10 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 -- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 msgr2=0x7fa75c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 --2- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c069560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa754009f20 tx=0x7fa754009840 comp rx=0 tx=0).stop 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 -- 172.21.15.22:0/2918841536 shutdown_connections 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 --2- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c069560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 --2- 172.21.15.22:0/2918841536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 -- 172.21.15.22:0/2918841536 >> 172.21.15.22:0/2918841536 conn(0x7fa75c068e20 msgr2=0x7fa75c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 -- 172.21.15.22:0/2918841536 shutdown_connections 2023-10-08T00:30:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.913+0000 7fa761b19700 1 -- 172.21.15.22:0/2918841536 wait complete. 2023-10-08T00:30:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.914+0000 7fa761b19700 1 Processor -- start 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.914+0000 7fa761b19700 1 -- start start 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 0x7fa75c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c16d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c16abd0 con 0x7fa75c159890 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c169f50 con 0x7fa75c15db10 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c16a230 con 0x7fa75c159c60 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 0x7fa75c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 0x7fa75c0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52996/0 (socket says 172.21.15.22:52996) 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 -- 172.21.15.22:0/4104798705 learned_addr learned my addr 172.21.15.22:0/4104798705 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75bfff700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c16d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75affd700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 -- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 msgr2=0x7fa75c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c0cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 -- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 msgr2=0x7fa75c16d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c16d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 -- 172.21.15.22:0/4104798705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750009420 con 0x7fa75c159890 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa75b7fe700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 0x7fa75c0cf210 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00c7c0 tx=0x7fa74c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c005a70 con 0x7fa75c159890 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c005bf0 con 0x7fa75c159890 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa754009ae0 con 0x7fa75c159890 2023-10-08T00:30:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.915+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0070d0 con 0x7fa75c159890 2023-10-08T00:30:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.916+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c16a7f0 con 0x7fa75c159890 2023-10-08T00:30:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.917+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c04c3c0 con 0x7fa75c159890 2023-10-08T00:30:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.917+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa74c007480 con 0x7fa75c159890 2023-10-08T00:30:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.917+0000 7fa7437fe700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa748067170 0x7fa748069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.917+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa74c083be0 con 0x7fa75c159890 2023-10-08T00:30:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.917+0000 7fa75affd700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa748067170 0x7fa748069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.918+0000 7fa75affd700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa748067170 0x7fa748069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0cff50 tx=0x7fa7500091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:26.921+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa74c050bc0 con 0x7fa75c159890 2023-10-08T00:30:27.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.160+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa75c0b0120 con 0x7fa75c159890 2023-10-08T00:30:27.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.160+0000 7fa7437fe700 1 -- 172.21.15.22:0/4104798705 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa74c017020 con 0x7fa75c159890 2023-10-08T00:30:27.161 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa748067170 msgr2=0x7fa748069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa748067170 0x7fa748069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0cff50 tx=0x7fa7500091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 msgr2=0x7fa75c0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 0x7fa75c0cf210 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00c7c0 tx=0x7fa74c007f70 comp rx=0 tx=0).stop 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 shutdown_connections 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa75c15db10 0x7fa75c16d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa75c159890 0x7fa75c0cf210 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa748067170 0x7fa748069620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 --2- 172.21.15.22:0/4104798705 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa75c159c60 0x7fa75c0cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 >> 172.21.15.22:0/4104798705 conn(0x7fa75c068e20 msgr2=0x7fa75c152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 shutdown_connections 2023-10-08T00:30:27.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.162+0000 7fa761b19700 1 -- 172.21.15.22:0/4104798705 wait complete. 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:30:27.178 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:30:27.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.179 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:30:27.197 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:30:27.197 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:30:27.197 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:27.198 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42148sec preferred_lft 42148sec 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:30:27.199 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:27.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.200 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:30:27.265 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:30:27.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.267 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:30:27.325 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:30:27.325 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:30:27.325 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:30:27.325 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:30:27.325 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:30:27.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.326 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:30:27.326 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:30:27.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:30:27.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:30:27.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:30:27.326 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:30:27.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.431 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:30:27.446 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:30:27.446 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:30:27.446 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:30:27.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.447 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:30:27.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:27.512 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:27.567 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:30:27.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:27.567 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:27.622 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:30:27.622 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:30:27.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:27.703 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:27.703 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:27.722 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:27.722 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:27.722 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:27.722 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:27.723 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:27.723 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:27.723 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:27.723 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:27.745 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:27.746 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:27.746 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:27.746 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:27.746 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:27.746 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:27.747 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:27.747 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:27.747 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:30:27.747 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:30:27.747 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:30:27.748 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:30:27.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:27.749 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:27.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:30:27.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.943+0000 7f7a3cc20700 1 Processor -- start 2023-10-08T00:30:27.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.943+0000 7f7a3cc20700 1 -- start start 2023-10-08T00:30:27.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a3cc20700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7a38159ec0 0x7f7a380b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:27.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a3cc20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380b53d0 0x7f7a380cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:27.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a3cc20700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a380b5b00 con 0x7f7a380cce40 2023-10-08T00:30:27.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a3cc20700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a380b5850 con 0x7f7a38159ec0 2023-10-08T00:30:27.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a3cc20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a380b5da0 con 0x7f7a380b53d0 2023-10-08T00:30:27.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a36d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7a380cce40 0x7f7a380cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41176/0 (socket says 172.21.15.22:41176) 2023-10-08T00:30:27.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.944+0000 7f7a36d9d700 1 -- 172.21.15.22:0/916086931 learned_addr learned my addr 172.21.15.22:0/916086931 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:27.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a35d9b700 1 --2- 172.21.15.22:0/916086931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380b53d0 0x7f7a380cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:27.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3659c700 1 --2- 172.21.15.22:0/916086931 >> v2:172.21.15.192:3300/0 conn(0x7f7a38159ec0 0x7f7a380b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:27.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3559a700 1 -- 172.21.15.22:0/916086931 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311596215 0 0) 0x7f7a380b5b00 con 0x7f7a380cce40 2023-10-08T00:30:27.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3559a700 1 -- 172.21.15.22:0/916086931 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a24003570 con 0x7f7a380cce40 2023-10-08T00:30:27.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a35d9b700 1 -- 172.21.15.22:0/916086931 >> v2:172.21.15.192:3300/0 conn(0x7f7a38159ec0 msgr2=0x7f7a380b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:27.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a35d9b700 1 --2- 172.21.15.22:0/916086931 >> v2:172.21.15.192:3300/0 conn(0x7f7a38159ec0 0x7f7a380b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a35d9b700 1 -- 172.21.15.22:0/916086931 >> v1:172.21.15.22:6789/0 conn(0x7f7a380cce40 legacy=0x7f7a380cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:27.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a35d9b700 1 -- 172.21.15.22:0/916086931 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380b6080 con 0x7f7a380b53d0 2023-10-08T00:30:27.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3659c700 1 --2- 172.21.15.22:0/916086931 >> v2:172.21.15.192:3300/0 conn(0x7f7a38159ec0 0x7f7a380b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:27.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a35d9b700 1 --2- 172.21.15.22:0/916086931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380b53d0 0x7f7a380cc900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a200098e0 tx=0x7f7a200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185160f8ac25cd93 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:27.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3559a700 1 -- 172.21.15.22:0/916086931 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011630 con 0x7f7a380b53d0 2023-10-08T00:30:27.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3559a700 1 -- 172.21.15.22:0/916086931 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20011790 con 0x7f7a380b53d0 2023-10-08T00:30:27.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.945+0000 7f7a3559a700 1 -- 172.21.15.22:0/916086931 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011b30 con 0x7f7a380b53d0 2023-10-08T00:30:27.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 -- 172.21.15.22:0/916086931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380b53d0 msgr2=0x7f7a380cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:27.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/916086931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380b53d0 0x7f7a380cc900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7a200098e0 tx=0x7f7a200091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 -- 172.21.15.22:0/916086931 shutdown_connections 2023-10-08T00:30:27.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/916086931 >> v2:172.21.15.192:3300/0 conn(0x7f7a38159ec0 0x7f7a380b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/916086931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380b53d0 0x7f7a380cc900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 -- 172.21.15.22:0/916086931 >> 172.21.15.22:0/916086931 conn(0x7f7a380999f0 msgr2=0x7f7a380b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 -- 172.21.15.22:0/916086931 shutdown_connections 2023-10-08T00:30:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.946+0000 7f7a3cc20700 1 -- 172.21.15.22:0/916086931 wait complete. 2023-10-08T00:30:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.947+0000 7f7a3cc20700 1 Processor -- start 2023-10-08T00:30:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.947+0000 7f7a3cc20700 1 -- start start 2023-10-08T00:30:27.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3cc20700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 0x7f7a381575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:27.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3cc20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380cce40 0x7f7a38158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:27.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3cc20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38159ec0 0x7f7a381515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:27.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3cc20700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3816e7f0 con 0x7f7a380b53d0 2023-10-08T00:30:27.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3cc20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3816dbe0 con 0x7f7a38159ec0 2023-10-08T00:30:27.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3cc20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3816dec0 con 0x7f7a380cce40 2023-10-08T00:30:27.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 0x7f7a381575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:27.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 0x7f7a381575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53012/0 (socket says 172.21.15.22:53012) 2023-10-08T00:30:27.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 -- 172.21.15.22:0/4034880324 learned_addr learned my addr 172.21.15.22:0/4034880324 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:27.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 -- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380cce40 msgr2=0x7f7a38158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:27.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380cce40 0x7f7a38158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a36d9d700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38159ec0 0x7f7a381515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:27.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 -- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38159ec0 msgr2=0x7f7a381515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:27.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38159ec0 0x7f7a381515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:27.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 -- 172.21.15.22:0/4034880324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300093c0 con 0x7f7a380b53d0 2023-10-08T00:30:27.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a36d9d700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38159ec0 0x7f7a381515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:27.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.948+0000 7f7a3659c700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 0x7f7a381575a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000ec80 tx=0x7f7a30009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:27.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.949+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30005a00 con 0x7f7a380b53d0 2023-10-08T00:30:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.949+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30005b60 con 0x7f7a380b53d0 2023-10-08T00:30:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.949+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000c9d0 con 0x7f7a380b53d0 2023-10-08T00:30:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.949+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a20009420 con 0x7f7a380b53d0 2023-10-08T00:30:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.949+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3816e480 con 0x7f7a380b53d0 2023-10-08T00:30:27.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.950+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a38063c90 con 0x7f7a380b53d0 2023-10-08T00:30:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.950+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7a3000cd80 con 0x7f7a380b53d0 2023-10-08T00:30:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.950+0000 7f7a2e7fc700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a18067170 0x7f7a18069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.950+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a30084ed0 con 0x7f7a380b53d0 2023-10-08T00:30:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.951+0000 7f7a35d9b700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a18067170 0x7f7a18069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:27.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.951+0000 7f7a35d9b700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a18067170 0x7f7a18069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7a380cc370 tx=0x7f7a20017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:27.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:27.955+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a30051eb0 con 0x7f7a380b53d0 2023-10-08T00:30:28.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.194+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7a380718b0 con 0x7f7a380b53d0 2023-10-08T00:30:28.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.626+0000 7f7a2e7fc700 1 -- 172.21.15.22:0/4034880324 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7a300200c0 con 0x7f7a380b53d0 2023-10-08T00:30:28.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a18067170 msgr2=0x7f7a18069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:28.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a18067170 0x7f7a18069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7a380cc370 tx=0x7f7a20017000 comp rx=0 tx=0).stop 2023-10-08T00:30:28.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 msgr2=0x7f7a381575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:28.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 0x7f7a381575a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000ec80 tx=0x7f7a30009120 comp rx=0 tx=0).stop 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 shutdown_connections 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a38159ec0 0x7f7a381515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a380b53d0 0x7f7a381575a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7a18067170 0x7f7a18069620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 --2- 172.21.15.22:0/4034880324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7a380cce40 0x7f7a38158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.628+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 >> 172.21.15.22:0/4034880324 conn(0x7f7a380999f0 msgr2=0x7f7a38151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.629+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 shutdown_connections 2023-10-08T00:30:28.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.629+0000 7f7a3cc20700 1 -- 172.21.15.22:0/4034880324 wait complete. 2023-10-08T00:30:28.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.762+0000 7f0d3c066700 1 Processor -- start 2023-10-08T00:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.763+0000 7f0d3c066700 1 -- start start 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.763+0000 7f0d3c066700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0d34159890 0x7f0d3415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.763+0000 7f0d3c066700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d34159c60 0x7f0d3415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.763+0000 7f0d3c066700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3415a160 con 0x7f0d3415db10 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.763+0000 7f0d3c066700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d340d13a0 con 0x7f0d34159890 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.763+0000 7f0d3c066700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3415e140 con 0x7f0d34159c60 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d3a603700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0d3415db10 0x7f0d34069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41178/0 (socket says 172.21.15.22:41178) 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d3a603700 1 -- 172.21.15.22:0/842843151 learned_addr learned my addr 172.21.15.22:0/842843151 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39e02700 1 --2- 172.21.15.22:0/842843151 >> v2:172.21.15.22:3300/0 conn(0x7f0d34159890 0x7f0d3415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:28.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39601700 1 --2- 172.21.15.22:0/842843151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d34159c60 0x7f0d3415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d38e00700 1 -- 172.21.15.22:0/842843151 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223690566 0 0) 0x7f0d3415a160 con 0x7f0d3415db10 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d38e00700 1 -- 172.21.15.22:0/842843151 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d1c003570 con 0x7f0d3415db10 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39e02700 1 -- 172.21.15.22:0/842843151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d34159c60 msgr2=0x7f0d3415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39e02700 1 --2- 172.21.15.22:0/842843151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d34159c60 0x7f0d3415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39e02700 1 -- 172.21.15.22:0/842843151 >> v1:172.21.15.22:6789/0 conn(0x7f0d3415db10 legacy=0x7f0d34069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39e02700 1 -- 172.21.15.22:0/842843151 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3415a3d0 con 0x7f0d34159890 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d39e02700 1 --2- 172.21.15.22:0/842843151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159890 0x7f0d3415abd0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0098e0 tx=0x7f0d2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8353d5cedca6cb71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d38e00700 1 -- 172.21.15.22:0/842843151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00b640 con 0x7f0d34159890 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d38e00700 1 -- 172.21.15.22:0/842843151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c00b7a0 con 0x7f0d34159890 2023-10-08T00:30:28.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.764+0000 7f0d38e00700 1 -- 172.21.15.22:0/842843151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c00bb40 con 0x7f0d34159890 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 -- 172.21.15.22:0/842843151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159890 msgr2=0x7f0d3415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 --2- 172.21.15.22:0/842843151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159890 0x7f0d3415abd0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0098e0 tx=0x7f0d2c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 -- 172.21.15.22:0/842843151 shutdown_connections 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 --2- 172.21.15.22:0/842843151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159890 0x7f0d3415abd0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 --2- 172.21.15.22:0/842843151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d34159c60 0x7f0d3415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 -- 172.21.15.22:0/842843151 >> 172.21.15.22:0/842843151 conn(0x7f0d34068e20 msgr2=0x7f0d340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:28.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 -- 172.21.15.22:0/842843151 shutdown_connections 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.765+0000 7f0d3c066700 1 -- 172.21.15.22:0/842843151 wait complete. 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.766+0000 7f0d3c066700 1 Processor -- start 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.766+0000 7f0d3c066700 1 -- start start 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3c066700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d34159890 0x7f0d34152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3c066700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 0x7f0d340cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3c066700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d3415db10 0x7f0d340b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3c066700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340ce320 con 0x7f0d34159c60 2023-10-08T00:30:28.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3c066700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340ce600 con 0x7f0d34159890 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3c066700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340ce8e0 con 0x7f0d3415db10 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d39601700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 0x7f0d340cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d39601700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 0x7f0d340cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53034/0 (socket says 172.21.15.22:53034) 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d39601700 1 -- 172.21.15.22:0/199195282 learned_addr learned my addr 172.21.15.22:0/199195282 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d3a603700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d3415db10 0x7f0d340b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d39e02700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d34159890 0x7f0d34152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:28.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.767+0000 7f0d39601700 1 -- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d3415db10 msgr2=0x7f0d340b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d39601700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d3415db10 0x7f0d340b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d39601700 1 -- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d34159890 msgr2=0x7f0d34152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d39601700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d34159890 0x7f0d34152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d39601700 1 -- 172.21.15.22:0/199195282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c009420 con 0x7f0d34159c60 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d39601700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 0x7f0d340cda80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800d860 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d280125f0 con 0x7f0d34159c60 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d28012750 con 0x7f0d34159c60 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28012af0 con 0x7f0d34159c60 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d340c8a10 con 0x7f0d34159c60 2023-10-08T00:30:28.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.768+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d340cdfc0 con 0x7f0d34159c60 2023-10-08T00:30:28.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.769+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3404c3c0 con 0x7f0d34159c60 2023-10-08T00:30:28.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.769+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0d28013480 con 0x7f0d34159c60 2023-10-08T00:30:28.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.770+0000 7f0d31ffb700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d20067170 0x7f0d20069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:28.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.770+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0d28084bd0 con 0x7f0d34159c60 2023-10-08T00:30:28.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.770+0000 7f0d39e02700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d20067170 0x7f0d20069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:28.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.770+0000 7f0d39e02700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d20067170 0x7f0d20069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0093f0 tx=0x7f0d2c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:28.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.774+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d28055640 con 0x7f0d34159c60 2023-10-08T00:30:28.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:28.998+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d3406a5b0 con 0x7f0d20067170 2023-10-08T00:30:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.000+0000 7f0d31ffb700 1 -- 172.21.15.22:0/199195282 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0d3406a5b0 con 0x7f0d20067170 2023-10-08T00:30:29.000 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:30:29.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:29.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:30:29.001 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:29.001 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d20067170 msgr2=0x7f0d20069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d20067170 0x7f0d20069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0093f0 tx=0x7f0d2c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 msgr2=0x7f0d340cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 0x7f0d340cda80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800d860 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 shutdown_connections 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0d20067170 0x7f0d20069620 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0d3415db10 0x7f0d340b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d34159890 0x7f0d34152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 --2- 172.21.15.22:0/199195282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0d34159c60 0x7f0d340cda80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 >> 172.21.15.22:0/199195282 conn(0x7f0d34068e20 msgr2=0x7f0d3415bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:29.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 shutdown_connections 2023-10-08T00:30:29.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.002+0000 7f0d3c066700 1 -- 172.21.15.22:0/199195282 wait complete. 2023-10-08T00:30:29.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:30:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.136+0000 7f8325181700 1 Processor -- start 2023-10-08T00:30:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.136+0000 7f8325181700 1 -- start start 2023-10-08T00:30:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f8325181700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159890 0x7f832015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f8325181700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 0x7f83200699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f8325181700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832015a160 con 0x7f8320159c60 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f8325181700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8320069f20 con 0x7f8320069560 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f8325181700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200d13a0 con 0x7f8320159890 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f831f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 0x7f83200699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.137+0000 7f831ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159890 0x7f832015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831e59c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8320159c60 0x7f832015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:38108/0 (socket says 172.21.15.22:38108) 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831f59e700 1 --2- 172.21.15.22:0/3517944324 >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 0x7f83200699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:50338/0 (socket says 172.21.15.22:50338) 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831e59c700 1 -- 172.21.15.22:0/3517944324 learned_addr learned my addr 172.21.15.22:0/3517944324 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831ed9d700 1 -- 172.21.15.22:0/3517944324 >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 msgr2=0x7f83200699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831ed9d700 1 --2- 172.21.15.22:0/3517944324 >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 0x7f83200699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831ed9d700 1 -- 172.21.15.22:0/3517944324 >> v1:172.21.15.192:6789/0 conn(0x7f8320159c60 legacy=0x7f832015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831ed9d700 1 -- 172.21.15.22:0/3517944324 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832015e140 con 0x7f8320159890 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831dd9b700 1 -- 172.21.15.22:0/3517944324 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197639272 0 0) 0x7f832015a160 con 0x7f8320159c60 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831f59e700 1 --2- 172.21.15.22:0/3517944324 >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 0x7f83200699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831ed9d700 1 --2- 172.21.15.22:0/3517944324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159890 0x7f832015abd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8310009e60 tx=0x7f8310009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9c2b3ccd488ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831dd9b700 1 -- 172.21.15.22:0/3517944324 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000e070 con 0x7f8320159890 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831dd9b700 1 -- 172.21.15.22:0/3517944324 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000bb60 con 0x7f8320159890 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.138+0000 7f831dd9b700 1 -- 172.21.15.22:0/3517944324 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012430 con 0x7f8320159890 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 -- 172.21.15.22:0/3517944324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159890 msgr2=0x7f832015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 --2- 172.21.15.22:0/3517944324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159890 0x7f832015abd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8310009e60 tx=0x7f8310009780 comp rx=0 tx=0).stop 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 -- 172.21.15.22:0/3517944324 shutdown_connections 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 --2- 172.21.15.22:0/3517944324 >> v2:172.21.15.192:3300/0 conn(0x7f8320069560 0x7f83200699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 --2- 172.21.15.22:0/3517944324 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159890 0x7f832015abd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 -- 172.21.15.22:0/3517944324 >> 172.21.15.22:0/3517944324 conn(0x7f8320068e20 msgr2=0x7f83200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 -- 172.21.15.22:0/3517944324 shutdown_connections 2023-10-08T00:30:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.139+0000 7f8325181700 1 -- 172.21.15.22:0/3517944324 wait complete. 2023-10-08T00:30:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.140+0000 7f8325181700 1 Processor -- start 2023-10-08T00:30:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.140+0000 7f8325181700 1 -- start start 2023-10-08T00:30:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f8325181700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 0x7f83200ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f8325181700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8320159890 0x7f83200ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f8325181700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159c60 0x7f8320169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f8325181700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200cf3e0 con 0x7f8320069560 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f8325181700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200cee20 con 0x7f8320159890 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f8325181700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200cf100 con 0x7f8320159c60 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 0x7f83200ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 0x7f83200ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53040/0 (socket says 172.21.15.22:53040) 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 -- 172.21.15.22:0/238308652 learned_addr learned my addr 172.21.15.22:0/238308652 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:29.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831e59c700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8320159890 0x7f83200ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831f59e700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159c60 0x7f8320169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 -- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159c60 msgr2=0x7f8320169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159c60 0x7f8320169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 -- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8320159890 msgr2=0x7f83200ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8320159890 0x7f83200ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 -- 172.21.15.22:0/238308652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318009420 con 0x7f8320069560 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831f59e700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159c60 0x7f8320169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.141+0000 7f831ed9d700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 0x7f83200ce060 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f831000b6c0 tx=0x7f8310019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.142+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310012c90 con 0x7f8320069560 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.142+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310012e10 con 0x7f8320069560 2023-10-08T00:30:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.142+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8310009a20 con 0x7f8320069560 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.142+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100276c0 con 0x7f8320069560 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.142+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83200c5d10 con 0x7f8320069560 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.142+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832004c3c0 con 0x7f8320069560 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.143+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8310024070 con 0x7f8320069560 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.143+0000 7f8316ffd700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8300067170 0x7f8300069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.143+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8310086fc0 con 0x7f8320069560 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.143+0000 7f831e59c700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8300067170 0x7f8300069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.144+0000 7f831e59c700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8300067170 0x7f8300069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f83200cde50 tx=0x7f8308007f50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.148+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83100b85a0 con 0x7f8320069560 2023-10-08T00:30:29.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.340+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f832006a5b0 con 0x7f8320069560 2023-10-08T00:30:29.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.341+0000 7f8316ffd700 1 -- 172.21.15.22:0/238308652 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8310053ed0 con 0x7f8320069560 2023-10-08T00:30:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8300067170 msgr2=0x7f8300069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8300067170 0x7f8300069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f83200cde50 tx=0x7f8308007f50 comp rx=0 tx=0).stop 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 msgr2=0x7f83200ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 0x7f83200ce060 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f831000b6c0 tx=0x7f8310019000 comp rx=0 tx=0).stop 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 shutdown_connections 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8300067170 0x7f8300069620 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8320159c60 0x7f8320169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8320069560 0x7f83200ce060 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 --2- 172.21.15.22:0/238308652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8320159890 0x7f83200ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 >> 172.21.15.22:0/238308652 conn(0x7f8320068e20 msgr2=0x7f83200b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 shutdown_connections 2023-10-08T00:30:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.343+0000 7f8325181700 1 -- 172.21.15.22:0/238308652 wait complete. 2023-10-08T00:30:29.355 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000881248 2023-10-08T00:30:29.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.476+0000 7efe901d1700 1 Processor -- start 2023-10-08T00:30:29.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.476+0000 7efe901d1700 1 -- start start 2023-10-08T00:30:29.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe901d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe8815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe901d1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe8815db10 0x7efe88069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe901d1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8815a160 con 0x7efe88159890 2023-10-08T00:30:29.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe901d1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880d13a0 con 0x7efe8815db10 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe901d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8815e140 con 0x7efe88159c60 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe8e76e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe8815db10 0x7efe88069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe8df6d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efe88159890 0x7efe8815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41192/0 (socket says 172.21.15.22:41192) 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe8df6d700 1 -- 172.21.15.22:0/570466309 learned_addr learned my addr 172.21.15.22:0/570466309 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.477+0000 7efe8d76c700 1 --2- 172.21.15.22:0/570466309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe8815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8e76e700 1 -- 172.21.15.22:0/570466309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 msgr2=0x7efe8815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8e76e700 1 --2- 172.21.15.22:0/570466309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe8815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8e76e700 1 -- 172.21.15.22:0/570466309 >> v1:172.21.15.22:6789/0 conn(0x7efe88159890 legacy=0x7efe8815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8e76e700 1 -- 172.21.15.22:0/570466309 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8815a3d0 con 0x7efe8815db10 2023-10-08T00:30:29.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8cf6b700 1 -- 172.21.15.22:0/570466309 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076155124 0 0) 0x7efe8815a160 con 0x7efe88159890 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8e76e700 1 --2- 172.21.15.22:0/570466309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe8815db10 0x7efe88069560 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efe780098e0 tx=0x7efe780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9326ec3f745af86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8cf6b700 1 -- 172.21.15.22:0/570466309 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800b640 con 0x7efe8815db10 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8cf6b700 1 -- 172.21.15.22:0/570466309 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7800b7a0 con 0x7efe8815db10 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe8cf6b700 1 -- 172.21.15.22:0/570466309 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800bb40 con 0x7efe8815db10 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe901d1700 1 -- 172.21.15.22:0/570466309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe8815db10 msgr2=0x7efe88069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe901d1700 1 --2- 172.21.15.22:0/570466309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe8815db10 0x7efe88069560 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efe780098e0 tx=0x7efe780091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe901d1700 1 -- 172.21.15.22:0/570466309 shutdown_connections 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe901d1700 1 --2- 172.21.15.22:0/570466309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe8815db10 0x7efe88069560 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.478+0000 7efe901d1700 1 --2- 172.21.15.22:0/570466309 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe8815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.479+0000 7efe901d1700 1 -- 172.21.15.22:0/570466309 >> 172.21.15.22:0/570466309 conn(0x7efe88068e20 msgr2=0x7efe880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:29.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.479+0000 7efe901d1700 1 -- 172.21.15.22:0/570466309 shutdown_connections 2023-10-08T00:30:29.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.479+0000 7efe901d1700 1 -- 172.21.15.22:0/570466309 wait complete. 2023-10-08T00:30:29.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 Processor -- start 2023-10-08T00:30:29.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 -- start start 2023-10-08T00:30:29.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 0x7efe88147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe880b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe8815db10 0x7efe880b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880cd100 con 0x7efe88159890 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880cd960 con 0x7efe8815db10 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.480+0000 7efe901d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe881477c0 con 0x7efe88159c60 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 0x7efe88147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 0x7efe88147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53056/0 (socket says 172.21.15.22:53056) 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 -- 172.21.15.22:0/3130496576 learned_addr learned my addr 172.21.15.22:0/3130496576 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8d76c700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe880b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 -- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 msgr2=0x7efe880b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8e76e700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe8815db10 0x7efe880b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe880b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 -- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe8815db10 msgr2=0x7efe880b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe8815db10 0x7efe880b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 -- 172.21.15.22:0/3130496576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009420 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe8df6d700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 0x7efe88147280 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efe8000cdb0 tx=0x7efe80001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8000aad0 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000ac30 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe880b6230 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe800070f0 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.481+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880cd5f0 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.482+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8804c3c0 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.483+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7efe800074a0 con 0x7efe88159890 2023-10-08T00:30:29.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.483+0000 7efe85ffb700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efe74067170 0x7efe74069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.483+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe80084e00 con 0x7efe88159890 2023-10-08T00:30:29.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.483+0000 7efe8d76c700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efe74067170 0x7efe74069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.484+0000 7efe8d76c700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efe74067170 0x7efe74069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0093f0 tx=0x7efe7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.487+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe80051dc0 con 0x7efe88159890 2023-10-08T00:30:29.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.710+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000881248", "target": ["mon-mgr", ""]}) v1 -- 0x7efe880cdaa0 con 0x7efe74067170 2023-10-08T00:30:29.716 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:29.715+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:29.716 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:29.715+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:29.716 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:29.715+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:29.716 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:29.715+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:29.716 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:29.715+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:29.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.731+0000 7efe85ffb700 1 -- 172.21.15.22:0/3130496576 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7efe7c009dc0 con 0x7efe74067170 2023-10-08T00:30:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efe74067170 msgr2=0x7efe74069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efe74067170 0x7efe74069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0093f0 tx=0x7efe7c008040 comp rx=0 tx=0).stop 2023-10-08T00:30:29.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 msgr2=0x7efe88147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 0x7efe88147280 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efe8000cdb0 tx=0x7efe80001ae0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 shutdown_connections 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe8815db10 0x7efe880b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe88159890 0x7efe88147280 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efe74067170 0x7efe74069620 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 --2- 172.21.15.22:0/3130496576 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efe88159c60 0x7efe880b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.733+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 >> 172.21.15.22:0/3130496576 conn(0x7efe88068e20 msgr2=0x7efe88157130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.734+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 shutdown_connections 2023-10-08T00:30:29.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.734+0000 7efe901d1700 1 -- 172.21.15.22:0/3130496576 wait complete. 2023-10-08T00:30:29.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-08T00:30:29.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.868+0000 7fd5e333a700 1 Processor -- start 2023-10-08T00:30:29.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.868+0000 7fd5e333a700 1 -- start start 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e333a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc159c60 0x7fd5dc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e333a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5dc15db10 0x7fd5dc069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e333a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc15a160 con 0x7fd5dc159890 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e333a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc0d13a0 con 0x7fd5dc15db10 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e333a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc15e140 con 0x7fd5dc159c60 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e18d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5dc15db10 0x7fd5dc069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e18d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5dc15db10 0x7fd5dc069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53068/0 (socket says 172.21.15.22:53068) 2023-10-08T00:30:29.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e18d7700 1 -- 172.21.15.22:0/509269262 learned_addr learned my addr 172.21.15.22:0/509269262 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.869+0000 7fd5e08d5700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc159c60 0x7fd5dc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e18d7700 1 -- 172.21.15.22:0/509269262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc159c60 msgr2=0x7fd5dc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e18d7700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc159c60 0x7fd5dc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e18d7700 1 -- 172.21.15.22:0/509269262 >> v1:172.21.15.192:6789/0 conn(0x7fd5dc159890 legacy=0x7fd5dc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e18d7700 1 -- 172.21.15.22:0/509269262 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc15a3d0 con 0x7fd5dc15db10 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e08d5700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc159c60 0x7fd5dc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e18d7700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc15db10 0x7fd5dc069560 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40099b0 tx=0x7fd5d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d653e256e11d934 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5dbfff700 1 -- 172.21.15.22:0/509269262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400b820 con 0x7fd5dc15db10 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5dbfff700 1 -- 172.21.15.22:0/509269262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d400b980 con 0x7fd5dc15db10 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5dbfff700 1 -- 172.21.15.22:0/509269262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d400bd20 con 0x7fd5dc15db10 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e333a700 1 -- 172.21.15.22:0/509269262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc15db10 msgr2=0x7fd5dc069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e333a700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc15db10 0x7fd5dc069560 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40099b0 tx=0x7fd5d4009250 comp rx=0 tx=0).stop 2023-10-08T00:30:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e333a700 1 -- 172.21.15.22:0/509269262 shutdown_connections 2023-10-08T00:30:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e333a700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc15db10 0x7fd5dc069560 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e333a700 1 --2- 172.21.15.22:0/509269262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc159c60 0x7fd5dc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.870+0000 7fd5e333a700 1 -- 172.21.15.22:0/509269262 >> 172.21.15.22:0/509269262 conn(0x7fd5dc068e20 msgr2=0x7fd5dc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.871+0000 7fd5e333a700 1 -- 172.21.15.22:0/509269262 shutdown_connections 2023-10-08T00:30:29.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.871+0000 7fd5e333a700 1 -- 172.21.15.22:0/509269262 wait complete. 2023-10-08T00:30:29.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 Processor -- start 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 -- start start 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 0x7fd5dc0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5dc159c60 0x7fd5dc14ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc15db10 0x7fd5dc153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b1760 con 0x7fd5dc159890 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b0b50 con 0x7fd5dc159c60 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.872+0000 7fd5e333a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b0e30 con 0x7fd5dc15db10 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 0x7fd5dc0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 0x7fd5dc0cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53072/0 (socket says 172.21.15.22:53072) 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 -- 172.21.15.22:0/90047159 learned_addr learned my addr 172.21.15.22:0/90047159 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e08d5700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5dc159c60 0x7fd5dc14ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e18d7700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc15db10 0x7fd5dc153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 -- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc15db10 msgr2=0x7fd5dc153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc15db10 0x7fd5dc153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 -- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5dc159c60 msgr2=0x7fd5dc14ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5dc159c60 0x7fd5dc14ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 -- 172.21.15.22:0/90047159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d40094f0 con 0x7fd5dc159890 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e10d6700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 0x7fd5dc0cf630 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c950 tx=0x7fd5cc002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc012630 con 0x7fd5dc159890 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0127b0 con 0x7fd5dc159890 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0b1110 con 0x7fd5dc159890 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc012b70 con 0x7fd5dc159890 2023-10-08T00:30:29.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.873+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc0b26b0 con 0x7fd5dc159890 2023-10-08T00:30:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.874+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc0b15b0 con 0x7fd5dc159890 2023-10-08T00:30:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.875+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd5cc01b400 con 0x7fd5dc159890 2023-10-08T00:30:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.875+0000 7fd5d97fa700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd5c8067170 0x7fd5c8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.875+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5cc084b70 con 0x7fd5dc159890 2023-10-08T00:30:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.875+0000 7fd5e08d5700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd5c8067170 0x7fd5c8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:29.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.876+0000 7fd5e08d5700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd5c8067170 0x7fd5c8069620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc153730 tx=0x7fd5d0006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:29.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:29.880+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5cc051b50 con 0x7fd5dc159890 2023-10-08T00:30:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.102+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd5dc0b18a0 con 0x7fd5c8067170 2023-10-08T00:30:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.105+0000 7fd5d97fa700 1 -- 172.21.15.22:0/90047159 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+534 (secure 0 0 0) 0x7fd5d000c040 con 0x7fd5c8067170 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_addrs": [ 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6789", 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6789", 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6790" 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "pending_subvolume_deletions": 0, 2023-10-08T00:30:30.106 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": { 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "data": [ 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": " 340G", 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_data", 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "used": " 0 " 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": [ 2023-10-08T00:30:30.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": " 340G", 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_metadata", 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "used": "64.0k" 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout: "used_size": " 0 " 2023-10-08T00:30:30.108 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd5c8067170 msgr2=0x7fd5c8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd5c8067170 0x7fd5c8069620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc153730 tx=0x7fd5d0006f90 comp rx=0 tx=0).stop 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 msgr2=0x7fd5dc0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 0x7fd5dc0cf630 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c950 tx=0x7fd5cc002760 comp rx=0 tx=0).stop 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 shutdown_connections 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd5c8067170 0x7fd5c8069620 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5dc15db10 0x7fd5dc153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5dc159890 0x7fd5dc0cf630 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 --2- 172.21.15.22:0/90047159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5dc159c60 0x7fd5dc14ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 >> 172.21.15.22:0/90047159 conn(0x7fd5dc068e20 msgr2=0x7fd5dc156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 shutdown_connections 2023-10-08T00:30:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.107+0000 7fd5e333a700 1 -- 172.21.15.22:0/90047159 wait complete. 2023-10-08T00:30:30.121 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:30:30.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:30.159 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:30.200 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:30:30.201 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:30:30.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:30.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:30.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:30:30.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:30.248 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:30:30.263 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:30:30.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:30.263 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:30.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:30:30.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:30.303 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:30:30.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.477+0000 7f8fc0c49700 1 Processor -- start 2023-10-08T00:30:30.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.478+0000 7f8fc0c49700 1 -- start start 2023-10-08T00:30:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.478+0000 7f8fc0c49700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fbc0b1850 0x7f8fbc0b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.478+0000 7f8fc0c49700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fbc1579f0 0x7f8fbc0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.478+0000 7f8fc0c49700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fbc0cb300 con 0x7f8fbc0ae680 2023-10-08T00:30:30.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.478+0000 7f8fc0c49700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc06fc30 con 0x7f8fbc0b1850 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fc0c49700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc0cc260 con 0x7f8fbc1579f0 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fbc0b1850 0x7f8fbc0b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fbc0b1850 0x7f8fbc0b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53076/0 (socket says 172.21.15.22:53076) 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 -- 172.21.15.22:0/3179898480 learned_addr learned my addr 172.21.15.22:0/3179898480 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fbad9d700 1 --2- 172.21.15.22:0/3179898480 >> v2:172.21.15.192:3300/0 conn(0x7f8fbc1579f0 0x7f8fbc0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 -- 172.21.15.22:0/3179898480 >> v2:172.21.15.192:3300/0 conn(0x7f8fbc1579f0 msgr2=0x7f8fbc0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 --2- 172.21.15.22:0/3179898480 >> v2:172.21.15.192:3300/0 conn(0x7f8fbc1579f0 0x7f8fbc0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 -- 172.21.15.22:0/3179898480 >> v1:172.21.15.192:6789/0 conn(0x7f8fbc0ae680 legacy=0x7f8fbc1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 -- 172.21.15.22:0/3179898480 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0cb5e0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fba59c700 1 --2- 172.21.15.22:0/3179898480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc0b1c20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0cc160 tx=0x7f8fb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533d226d584b5822 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fb959a700 1 -- 172.21.15.22:0/3179898480 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009e70 con 0x7f8fbc0b1850 2023-10-08T00:30:30.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fb959a700 1 -- 172.21.15.22:0/3179898480 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400b860 con 0x7f8fbc0b1850 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.479+0000 7f8fb959a700 1 -- 172.21.15.22:0/3179898480 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400bc00 con 0x7f8fbc0b1850 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3179898480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 msgr2=0x7f8fbc0b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3179898480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc0b1c20 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0cc160 tx=0x7f8fb4009250 comp rx=0 tx=0).stop 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3179898480 shutdown_connections 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3179898480 >> v2:172.21.15.192:3300/0 conn(0x7f8fbc1579f0 0x7f8fbc0abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3179898480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc0b1c20 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3179898480 >> 172.21.15.22:0/3179898480 conn(0x7f8fbc06a320 msgr2=0x7f8fbc0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3179898480 shutdown_connections 2023-10-08T00:30:30.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.480+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3179898480 wait complete. 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.481+0000 7f8fc0c49700 1 Processor -- start 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.481+0000 7f8fc0c49700 1 -- start start 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fc0c49700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fbc0ae680 0x7f8fbc14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fc0c49700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fc0c49700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fbc1579f0 0x7f8fbc14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fc0c49700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc15a5d0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fc0c49700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc14df00 con 0x7f8fbc0ae680 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fc0c49700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc14e9d0 con 0x7f8fbc1579f0 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc14d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53086/0 (socket says 172.21.15.22:53086) 2023-10-08T00:30:30.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 -- 172.21.15.22:0/3232983246 learned_addr learned my addr 172.21.15.22:0/3232983246 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fbad9d700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fbc1579f0 0x7f8fbc14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fba59c700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fbc0ae680 0x7f8fbc14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 -- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fbc1579f0 msgr2=0x7f8fbc14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fbc1579f0 0x7f8fbc14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 -- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fbc0ae680 msgr2=0x7f8fbc14c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fbc0ae680 0x7f8fbc14c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 -- 172.21.15.22:0/3232983246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40094f0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.482+0000 7f8fb9d9b700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc14d9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400c590 tx=0x7f8fa400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:30.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.483+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011590 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.483+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4011710 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.483+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc15a7e0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.483+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4011ad0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.483+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc14e130 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.484+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fbc04c3c0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.484+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8fa401b3b0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.484+0000 7f8fb27fc700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8f9c067170 0x7f8f9c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.484+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8fa4083cd0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.485+0000 7f8fba59c700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8f9c067170 0x7f8f9c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.485+0000 7f8fba59c700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8f9c067170 0x7f8f9c069620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0cc160 tx=0x7f8fb4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:30.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.489+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fa4050cb0 con 0x7f8fbc0b1850 2023-10-08T00:30:30.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.635+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8fa4051080 con 0x7f8fbc0b1850 2023-10-08T00:30:30.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.727+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fbc15a970 con 0x7f8fbc0b1850 2023-10-08T00:30:30.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.728+0000 7f8fb27fc700 1 -- 172.21.15.22:0/3232983246 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8fa4054740 con 0x7f8fbc0b1850 2023-10-08T00:30:30.729 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:30.729 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:19.209800+0000","modified":"2023-10-08T00:30:22.812658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/2279072181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2279072181},{"type":"v1","addr":"172.21.15.22:6835","nonce":2279072181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8f9c067170 msgr2=0x7f8f9c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8f9c067170 0x7f8f9c069620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0cc160 tx=0x7f8fb4017000 comp rx=0 tx=0).stop 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 msgr2=0x7f8fbc14d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc14d9c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8fa400c590 tx=0x7f8fa400c8a0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 shutdown_connections 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8f9c067170 0x7f8f9c069620 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fbc1579f0 0x7f8fbc14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fbc0ae680 0x7f8fbc14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 --2- 172.21.15.22:0/3232983246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fbc0b1850 0x7f8fbc14d9c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 >> 172.21.15.22:0/3232983246 conn(0x7f8fbc06a320 msgr2=0x7f8fbc0ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:30.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 shutdown_connections 2023-10-08T00:30:30.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.730+0000 7f8fc0c49700 1 -- 172.21.15.22:0/3232983246 wait complete. 2023-10-08T00:30:30.732 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 52 2023-10-08T00:30:30.743 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 Processor -- start 2023-10-08T00:30:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 -- start start 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6b98159420 0x7f6b980b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6b981597f0 0x7f6b980b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9815d230 0x7f6b9815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9815dbb0 con 0x7f6b98159420 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.862+0000 7f6b9cb9b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b980b11d0 con 0x7f6b981597f0 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b9cb9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b980b14b0 con 0x7f6b9815d230 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6b98159420 0x7f6b980b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6b98159420 0x7f6b980b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53094/0 (socket says 172.21.15.22:53094) 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 -- 172.21.15.22:0/443058436 learned_addr learned my addr 172.21.15.22:0/443058436 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:30.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b97fff700 1 --2- 172.21.15.22:0/443058436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9815d230 0x7f6b9815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b96ffd700 1 --2- 172.21.15.22:0/443058436 >> v2:172.21.15.192:3300/0 conn(0x7f6b981597f0 0x7f6b980b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 -- 172.21.15.22:0/443058436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9815d230 msgr2=0x7f6b9815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 --2- 172.21.15.22:0/443058436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9815d230 0x7f6b9815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 -- 172.21.15.22:0/443058436 >> v2:172.21.15.192:3300/0 conn(0x7f6b981597f0 msgr2=0x7f6b980b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 --2- 172.21.15.22:0/443058436 >> v2:172.21.15.192:3300/0 conn(0x7f6b981597f0 0x7f6b980b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 -- 172.21.15.22:0/443058436 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b980b1790 con 0x7f6b98159420 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b977fe700 1 --2- 172.21.15.22:0/443058436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b980b5f40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6b98089750 tx=0x7f6b88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5849f0435b535f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b967fc700 1 -- 172.21.15.22:0/443058436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800b860 con 0x7f6b98159420 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b967fc700 1 -- 172.21.15.22:0/443058436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8800b9c0 con 0x7f6b98159420 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.863+0000 7f6b967fc700 1 -- 172.21.15.22:0/443058436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8800bd60 con 0x7f6b98159420 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/443058436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 msgr2=0x7f6b980b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/443058436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b980b5f40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6b98089750 tx=0x7f6b88009250 comp rx=0 tx=0).stop 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/443058436 shutdown_connections 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/443058436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b980b5f40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/443058436 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b9815d230 0x7f6b9815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/443058436 >> v2:172.21.15.192:3300/0 conn(0x7f6b981597f0 0x7f6b980b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/443058436 >> 172.21.15.22:0/443058436 conn(0x7f6b980d0660 msgr2=0x7f6b980d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/443058436 shutdown_connections 2023-10-08T00:30:30.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.864+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/443058436 wait complete. 2023-10-08T00:30:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.865+0000 7f6b9cb9b700 1 Processor -- start 2023-10-08T00:30:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.865+0000 7f6b9cb9b700 1 -- start start 2023-10-08T00:30:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b9cb9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b9816aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b9cb9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b981597f0 0x7f6b98141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b9cb9b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9815d230 0x7f6b9816c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b9cb9b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9816be90 con 0x7f6b98159420 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b9cb9b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9816b280 con 0x7f6b9815d230 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b9cb9b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9816b560 con 0x7f6b981597f0 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b9816aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b9816aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53102/0 (socket says 172.21.15.22:53102) 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 -- 172.21.15.22:0/3236216844 learned_addr learned my addr 172.21.15.22:0/3236216844 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b96ffd700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b981597f0 0x7f6b98141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b97fff700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9815d230 0x7f6b9816c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 -- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b981597f0 msgr2=0x7f6b98141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b981597f0 0x7f6b98141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 -- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9815d230 msgr2=0x7f6b9816c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9815d230 0x7f6b9816c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 -- 172.21.15.22:0/3236216844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880094f0 con 0x7f6b98159420 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.866+0000 7f6b977fe700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b9816aa30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6b98089340 tx=0x7f6b88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.867+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88011dc0 con 0x7f6b98159420 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.867+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b88024440 con 0x7f6b98159420 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.867+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9816b840 con 0x7f6b98159420 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.867+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b88024800 con 0x7f6b98159420 2023-10-08T00:30:30.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.867+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9816af70 con 0x7f6b98159420 2023-10-08T00:30:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.868+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9816c170 con 0x7f6b98159420 2023-10-08T00:30:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.868+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6b8801a420 con 0x7f6b98159420 2023-10-08T00:30:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.868+0000 7f6b7f7fe700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b84067200 0x7f6b840696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.868+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6b88086890 con 0x7f6b98159420 2023-10-08T00:30:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.868+0000 7f6b96ffd700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b84067200 0x7f6b840696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:30.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.869+0000 7f6b96ffd700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b84067200 0x7f6b840696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b980cc5e0 tx=0x7f6b8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:30.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:30.873+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b880537b0 con 0x7f6b98159420 2023-10-08T00:30:31.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.065+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b98088350 con 0x7f6b98159420 2023-10-08T00:30:31.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.066+0000 7f6b7f7fe700 1 -- 172.21.15.22:0/3236216844 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f6b88056dd0 con 0x7f6b98159420 2023-10-08T00:30:31.067 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:31.067 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":78,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:20.606387+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:17.609244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:18.173807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:31.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b84067200 msgr2=0x7f6b840696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b84067200 0x7f6b840696b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b980cc5e0 tx=0x7f6b8c008040 comp rx=0 tx=0).stop 2023-10-08T00:30:31.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 msgr2=0x7f6b9816aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b9816aa30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6b98089340 tx=0x7f6b88017000 comp rx=0 tx=0).stop 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 shutdown_connections 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b9815d230 0x7f6b9816c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98159420 0x7f6b9816aa30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6b84067200 0x7f6b840696b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 --2- 172.21.15.22:0/3236216844 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6b981597f0 0x7f6b98141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 >> 172.21.15.22:0/3236216844 conn(0x7f6b980d0660 msgr2=0x7f6b980cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 shutdown_connections 2023-10-08T00:30:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.068+0000 7f6b9cb9b700 1 -- 172.21.15.22:0/3236216844 wait complete. 2023-10-08T00:30:31.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:30:17.609244+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:30:18.173807+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:30:31.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:30:31.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.203+0000 7ffa7fce2700 1 Processor -- start 2023-10-08T00:30:31.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.204+0000 7ffa7fce2700 1 -- start start 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7fce2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa7806bcd0 0x7ffa780caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7fce2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7815d7e0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7fce2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7815dac0 con 0x7ffa7815df50 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7fce2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7815aa30 con 0x7ffa7806bcd0 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa7806bcd0 0x7ffa780caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffa7806bcd0 0x7ffa780caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53108/0 (socket says 172.21.15.22:53108) 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 -- 172.21.15.22:0/3035724287 learned_addr learned my addr 172.21.15.22:0/3035724287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 -- 172.21.15.22:0/3035724287 >> v1:172.21.15.192:6789/0 conn(0x7ffa7815df50 legacy=0x7ffa780c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:31.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 -- 172.21.15.22:0/3035724287 >> v1:172.21.15.22:6789/0 conn(0x7ffa7806c0a0 legacy=0x7ffa7815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 -- 172.21.15.22:0/3035724287 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7815ad10 con 0x7ffa7806bcd0 2023-10-08T00:30:31.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7da7e700 1 --2- 172.21.15.22:0/3035724287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806bcd0 0x7ffa780caa90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009f20 tx=0x7ffa68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bce58cd4154ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7ca7c700 1 -- 172.21.15.22:0/3035724287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6800e070 con 0x7ffa7806bcd0 2023-10-08T00:30:31.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7ca7c700 1 -- 172.21.15.22:0/3035724287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6800ba40 con 0x7ffa7806bcd0 2023-10-08T00:30:31.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.205+0000 7ffa7ca7c700 1 -- 172.21.15.22:0/3035724287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa680092e0 con 0x7ffa7806bcd0 2023-10-08T00:30:31.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3035724287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806bcd0 msgr2=0x7ffa780caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3035724287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806bcd0 0x7ffa780caa90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009f20 tx=0x7ffa68009840 comp rx=0 tx=0).stop 2023-10-08T00:30:31.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3035724287 shutdown_connections 2023-10-08T00:30:31.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3035724287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806bcd0 0x7ffa780caa90 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3035724287 >> 172.21.15.22:0/3035724287 conn(0x7ffa780ce600 msgr2=0x7ffa780cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:31.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3035724287 shutdown_connections 2023-10-08T00:30:31.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.206+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3035724287 wait complete. 2023-10-08T00:30:31.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.207+0000 7ffa7fce2700 1 Processor -- start 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.207+0000 7ffa7fce2700 1 -- start start 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7fce2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa7806bcd0 0x7ffa780c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7fce2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 0x7ffa780c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7fce2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7815df50 0x7ffa780c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7fce2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780b2f00 con 0x7ffa7806c0a0 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7fce2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c8750 con 0x7ffa7815df50 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7fce2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7816ad20 con 0x7ffa7806bcd0 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 0x7ffa780c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 0x7ffa780c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53112/0 (socket says 172.21.15.22:53112) 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 -- 172.21.15.22:0/3141149837 learned_addr learned my addr 172.21.15.22:0/3141149837 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7da7e700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa7806bcd0 0x7ffa780c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7e27f700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7815df50 0x7ffa780c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 -- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa7806bcd0 msgr2=0x7ffa780c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa7806bcd0 0x7ffa780c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 -- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7815df50 msgr2=0x7ffa780c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7815df50 0x7ffa780c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 -- 172.21.15.22:0/3141149837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68009ae0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.208+0000 7ffa7d27d700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 0x7ffa780c6d30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c510 tx=0x7ffa6c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.209+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c011590 con 0x7ffa7806c0a0 2023-10-08T00:30:31.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.209+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c011710 con 0x7ffa7806c0a0 2023-10-08T00:30:31.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.209+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7816aa40 con 0x7ffa7806c0a0 2023-10-08T00:30:31.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.209+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c011ad0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.209+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa780c8ce0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.210+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7804c3c0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.210+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ffa6c01b3b0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.210+0000 7ffa75ffb700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa64067200 0x7ffa640696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.210+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa6c083dd0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.211+0000 7ffa7da7e700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa64067200 0x7ffa640696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.211+0000 7ffa7da7e700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa64067200 0x7ffa640696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009ab0 tx=0x7ffa68017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.215+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa6c050cf0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.406+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa7815aff0 con 0x7ffa7806c0a0 2023-10-08T00:30:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.407+0000 7ffa75ffb700 1 -- 172.21.15.22:0/3141149837 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa6c017070 con 0x7ffa7806c0a0 2023-10-08T00:30:31.408 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:30:31.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa64067200 msgr2=0x7ffa640696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa64067200 0x7ffa640696b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009ab0 tx=0x7ffa68017000 comp rx=0 tx=0).stop 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 msgr2=0x7ffa780c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 0x7ffa780c6d30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c00c510 tx=0x7ffa6c00c820 comp rx=0 tx=0).stop 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 shutdown_connections 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa7815df50 0x7ffa780c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffa64067200 0x7ffa640696b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffa7806bcd0 0x7ffa780c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 --2- 172.21.15.22:0/3141149837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa7806c0a0 0x7ffa780c6d30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 >> 172.21.15.22:0/3141149837 conn(0x7ffa780ce600 msgr2=0x7ffa7806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:31.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 shutdown_connections 2023-10-08T00:30:31.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.409+0000 7ffa7fce2700 1 -- 172.21.15.22:0/3141149837 wait complete. 2023-10-08T00:30:31.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:30:31.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.543+0000 7f28f09bb700 1 Processor -- start 2023-10-08T00:30:31.544 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.543+0000 7f28f09bb700 1 -- start start 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28f09bb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28ec0b16d0 0x7f28ec0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28f09bb700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec0b2080 con 0x7f28ec0b33b0 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28f09bb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec0cfb00 con 0x7f28ec0b4e70 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28f09bb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec0b5c40 con 0x7f28ec0b16d0 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28ea59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28ec0b16d0 0x7f28ec0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28ea59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28ec0b16d0 0x7f28ec0b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53124/0 (socket says 172.21.15.22:53124) 2023-10-08T00:30:31.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28eb59e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f28ec0b33b0 0x7f28ec0b37d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41208/0 (socket says 172.21.15.22:41208) 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28ea59c700 1 -- 172.21.15.22:0/3073312425 learned_addr learned my addr 172.21.15.22:0/3073312425 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28ea59c700 1 -- 172.21.15.22:0/3073312425 >> v1:172.21.15.192:6789/0 conn(0x7f28ec0b4e70 legacy=0x7f28ec0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28ea59c700 1 -- 172.21.15.22:0/3073312425 >> v1:172.21.15.22:6789/0 conn(0x7f28ec0b33b0 legacy=0x7f28ec0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.544+0000 7f28ea59c700 1 -- 172.21.15.22:0/3073312425 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0b5f20 con 0x7f28ec0b16d0 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28ea59c700 1 --2- 172.21.15.22:0/3073312425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b16d0 0x7f28ec0b1b40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f28d40099b0 tx=0x7f28d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe68f952c472ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28e9d9b700 1 -- 172.21.15.22:0/3073312425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400b820 con 0x7f28ec0b16d0 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28e9d9b700 1 -- 172.21.15.22:0/3073312425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d400b980 con 0x7f28ec0b16d0 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28e9d9b700 1 -- 172.21.15.22:0/3073312425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400bd40 con 0x7f28ec0b16d0 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 -- 172.21.15.22:0/3073312425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b16d0 msgr2=0x7f28ec0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3073312425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b16d0 0x7f28ec0b1b40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f28d40099b0 tx=0x7f28d4009250 comp rx=0 tx=0).stop 2023-10-08T00:30:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 -- 172.21.15.22:0/3073312425 shutdown_connections 2023-10-08T00:30:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3073312425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b16d0 0x7f28ec0b1b40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 -- 172.21.15.22:0/3073312425 >> 172.21.15.22:0/3073312425 conn(0x7f28ec0d10c0 msgr2=0x7f28ec0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 -- 172.21.15.22:0/3073312425 shutdown_connections 2023-10-08T00:30:31.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.545+0000 7f28f09bb700 1 -- 172.21.15.22:0/3073312425 wait complete. 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.546+0000 7f28f09bb700 1 Processor -- start 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 -- start start 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ec0b16d0 0x7f28ec16d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 0x7f28ec15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28ec0b4e70 0x7f28ec15a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec158510 con 0x7f28ec0b33b0 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec16d9e0 con 0x7f28ec0b4e70 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28f09bb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec159c40 con 0x7f28ec0b16d0 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28ea59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 0x7f28ec15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28ea59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 0x7f28ec15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53128/0 (socket says 172.21.15.22:53128) 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.547+0000 7f28ea59c700 1 -- 172.21.15.22:0/3836405120 learned_addr learned my addr 172.21.15.22:0/3836405120 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28ea59c700 1 -- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ec0b16d0 msgr2=0x7f28ec16d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28eb59e700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28ec0b4e70 0x7f28ec15a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28ea59c700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ec0b16d0 0x7f28ec16d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28ea59c700 1 -- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28ec0b4e70 msgr2=0x7f28ec15a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28ea59c700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28ec0b4e70 0x7f28ec15a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28ea59c700 1 -- 172.21.15.22:0/3836405120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40094f0 con 0x7f28ec0b33b0 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28eb59e700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28ec0b4e70 0x7f28ec15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28ea59c700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 0x7f28ec15df50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f28ec070dd0 tx=0x7f28d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4011c40 con 0x7f28ec0b33b0 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4020070 con 0x7f28ec0b33b0 2023-10-08T00:30:31.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec15e490 con 0x7f28ec0b33b0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d401b450 con 0x7f28ec0b33b0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.548+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec16def0 con 0x7f28ec0b33b0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.549+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec088990 con 0x7f28ec0b33b0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.549+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f28d4022030 con 0x7f28ec0b33b0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.550+0000 7f28e2ffd700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28cc067200 0x7f28cc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.550+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28d4086880 con 0x7f28ec0b33b0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.550+0000 7f28ead9d700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28cc067200 0x7f28cc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.550+0000 7f28ead9d700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28cc067200 0x7f28cc0696b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00acf0 tx=0x7f28dc009350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.554+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d40536c0 con 0x7f28ec0b33b0 2023-10-08T00:30:31.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:30:31.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.750+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28ec088990 con 0x7f28ec0b33b0 2023-10-08T00:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.751+0000 7f28e2ffd700 1 -- 172.21.15.22:0/3836405120 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28d4023e60 con 0x7f28ec0b33b0 2023-10-08T00:30:31.751 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28cc067200 msgr2=0x7f28cc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28cc067200 0x7f28cc0696b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00acf0 tx=0x7f28dc009350 comp rx=0 tx=0).stop 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 msgr2=0x7f28ec15df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 0x7f28ec15df50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f28ec070dd0 tx=0x7f28d4016000 comp rx=0 tx=0).stop 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 shutdown_connections 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28ec0b4e70 0x7f28ec15a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28cc067200 0x7f28cc0696b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28ec0b16d0 0x7f28ec16d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 --2- 172.21.15.22:0/3836405120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28ec0b33b0 0x7f28ec15df50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 >> 172.21.15.22:0/3836405120 conn(0x7f28ec0d10c0 msgr2=0x7f28ec0c5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 shutdown_connections 2023-10-08T00:30:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.753+0000 7f28f09bb700 1 -- 172.21.15.22:0/3836405120 wait complete. 2023-10-08T00:30:31.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:30:31.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.928+0000 7fcae7d98700 1 Processor -- start 2023-10-08T00:30:31.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.928+0000 7fcae7d98700 1 -- start start 2023-10-08T00:30:31.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae7d98700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcae0159890 0x7fcae015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae7d98700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcae0159c60 0x7fcae015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae7d98700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae015a160 con 0x7fcae015db10 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae7d98700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae015df50 con 0x7fcae0159890 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae7d98700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00d13a0 con 0x7fcae0159c60 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae5b34700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcae0159890 0x7fcae015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae5b34700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcae0159890 0x7fcae015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53130/0 (socket says 172.21.15.22:53130) 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae5b34700 1 -- 172.21.15.22:0/3888113894 learned_addr learned my addr 172.21.15.22:0/3888113894 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.929+0000 7fcae5333700 1 --2- 172.21.15.22:0/3888113894 >> v2:172.21.15.192:3300/0 conn(0x7fcae0159c60 0x7fcae015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae5b34700 1 -- 172.21.15.22:0/3888113894 >> v2:172.21.15.192:3300/0 conn(0x7fcae0159c60 msgr2=0x7fcae015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae5b34700 1 --2- 172.21.15.22:0/3888113894 >> v2:172.21.15.192:3300/0 conn(0x7fcae0159c60 0x7fcae015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae5b34700 1 -- 172.21.15.22:0/3888113894 >> v1:172.21.15.192:6789/0 conn(0x7fcae015db10 legacy=0x7fcae0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae5b34700 1 -- 172.21.15.22:0/3888113894 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae015e140 con 0x7fcae0159890 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae5b34700 1 --2- 172.21.15.22:0/3888113894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159890 0x7fcae015abd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcae00b67f0 tx=0x7fcad0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0c506806b912d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae4b32700 1 -- 172.21.15.22:0/3888113894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad000e070 con 0x7fcae0159890 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae4b32700 1 -- 172.21.15.22:0/3888113894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad000ba20 con 0x7fcae0159890 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae4b32700 1 -- 172.21.15.22:0/3888113894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad00092e0 con 0x7fcae0159890 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae7d98700 1 -- 172.21.15.22:0/3888113894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159890 msgr2=0x7fcae015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.930+0000 7fcae7d98700 1 --2- 172.21.15.22:0/3888113894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159890 0x7fcae015abd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fcae00b67f0 tx=0x7fcad0009840 comp rx=0 tx=0).stop 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.931+0000 7fcae7d98700 1 -- 172.21.15.22:0/3888113894 shutdown_connections 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.931+0000 7fcae7d98700 1 --2- 172.21.15.22:0/3888113894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159890 0x7fcae015abd0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.931+0000 7fcae7d98700 1 --2- 172.21.15.22:0/3888113894 >> v2:172.21.15.192:3300/0 conn(0x7fcae0159c60 0x7fcae015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.931+0000 7fcae7d98700 1 -- 172.21.15.22:0/3888113894 >> 172.21.15.22:0/3888113894 conn(0x7fcae0068e20 msgr2=0x7fcae00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.931+0000 7fcae7d98700 1 -- 172.21.15.22:0/3888113894 shutdown_connections 2023-10-08T00:30:31.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.931+0000 7fcae7d98700 1 -- 172.21.15.22:0/3888113894 wait complete. 2023-10-08T00:30:31.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 Processor -- start 2023-10-08T00:30:31.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 -- start start 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcae0159890 0x7fcae00b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 0x7fcae016b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae015db10 0x7fcae00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00ceb60 con 0x7fcae0159c60 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00ce230 con 0x7fcae015db10 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.932+0000 7fcae7d98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae00ce510 con 0x7fcae0159890 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 0x7fcae016b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 0x7fcae016b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53142/0 (socket says 172.21.15.22:53142) 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 -- 172.21.15.22:0/585780789 learned_addr learned my addr 172.21.15.22:0/585780789 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 -- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcae0159890 msgr2=0x7fcae00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5b34700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcae0159890 0x7fcae00b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcae0159890 0x7fcae00b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 -- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae015db10 msgr2=0x7fcae00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae6335700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae015db10 0x7fcae00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae015db10 0x7fcae00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 -- 172.21.15.22:0/585780789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0009ae0 con 0x7fcae0159c60 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae5333700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 0x7fcae016b230 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcad400ec80 tx=0x7fcad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400c9d0 con 0x7fcae0159c60 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400cb30 con 0x7fcae0159c60 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae00ce7f0 con 0x7fcae0159c60 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4013470 con 0x7fcae0159c60 2023-10-08T00:30:31.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.933+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae00b3ad0 con 0x7fcae0159c60 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.934+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae00ce980 con 0x7fcae0159c60 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.935+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fcad4013820 con 0x7fcae0159c60 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.935+0000 7fcaddffb700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcacc067200 0x7fcacc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.935+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcad4084d40 con 0x7fcae0159c60 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.935+0000 7fcae5b34700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcacc067200 0x7fcacc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.936+0000 7fcae5b34700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcacc067200 0x7fcacc0696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009ab0 tx=0x7fcad0018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:31.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:31.939+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcad4051c60 con 0x7fcae0159c60 2023-10-08T00:30:32.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.130+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcae004c3c0 con 0x7fcae0159c60 2023-10-08T00:30:32.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.131+0000 7fcaddffb700 1 -- 172.21.15.22:0/585780789 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcad4055280 con 0x7fcae0159c60 2023-10-08T00:30:32.132 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:30:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcacc067200 msgr2=0x7fcacc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcacc067200 0x7fcacc0696b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcad0009ab0 tx=0x7fcad0018000 comp rx=0 tx=0).stop 2023-10-08T00:30:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 msgr2=0x7fcae016b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 0x7fcae016b230 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcad400ec80 tx=0x7fcad40091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 shutdown_connections 2023-10-08T00:30:32.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae015db10 0x7fcae00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcacc067200 0x7fcacc0696b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcae0159890 0x7fcae00b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 --2- 172.21.15.22:0/585780789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcae0159c60 0x7fcae016b230 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 >> 172.21.15.22:0/585780789 conn(0x7fcae0068e20 msgr2=0x7fcae00b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 shutdown_connections 2023-10-08T00:30:32.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.133+0000 7fcae7d98700 1 -- 172.21.15.22:0/585780789 wait complete. 2023-10-08T00:30:32.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.264+0000 7f4d0890f700 1 Processor -- start 2023-10-08T00:30:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.265+0000 7f4d0890f700 1 -- start start 2023-10-08T00:30:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.265+0000 7f4d0890f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.265+0000 7f4d0890f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d040699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0890f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d04069ee0 con 0x7f4d04159c60 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0890f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0415a160 con 0x7f4d04159890 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0890f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040d13a0 con 0x7f4d04069560 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53150/0 (socket says 172.21.15.22:53150) 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 -- 172.21.15.22:0/333428506 learned_addr learned my addr 172.21.15.22:0/333428506 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 -- 172.21.15.22:0/333428506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 msgr2=0x7f4d040699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d02d9d700 1 --2- 172.21.15.22:0/333428506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d040699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 --2- 172.21.15.22:0/333428506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d040699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 -- 172.21.15.22:0/333428506 >> v1:172.21.15.192:6789/0 conn(0x7f4d04159c60 legacy=0x7f4d0415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 -- 172.21.15.22:0/333428506 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0415e140 con 0x7f4d04159890 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0259c700 1 --2- 172.21.15.22:0/333428506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415abd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40099b0 tx=0x7f4cf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6e2e2c437d3fed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0159a700 1 -- 172.21.15.22:0/333428506 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400b820 con 0x7f4d04159890 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0159a700 1 -- 172.21.15.22:0/333428506 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf400b980 con 0x7f4d04159890 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.266+0000 7f4d0159a700 1 -- 172.21.15.22:0/333428506 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400bd20 con 0x7f4d04159890 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 -- 172.21.15.22:0/333428506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 msgr2=0x7f4d0415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 --2- 172.21.15.22:0/333428506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415abd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40099b0 tx=0x7f4cf4009250 comp rx=0 tx=0).stop 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 -- 172.21.15.22:0/333428506 shutdown_connections 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 --2- 172.21.15.22:0/333428506 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d040699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 --2- 172.21.15.22:0/333428506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 -- 172.21.15.22:0/333428506 >> 172.21.15.22:0/333428506 conn(0x7f4d04068e20 msgr2=0x7f4d040d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 -- 172.21.15.22:0/333428506 shutdown_connections 2023-10-08T00:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.267+0000 7f4d0890f700 1 -- 172.21.15.22:0/333428506 wait complete. 2023-10-08T00:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.268+0000 7f4d0890f700 1 Processor -- start 2023-10-08T00:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.268+0000 7f4d0890f700 1 -- start start 2023-10-08T00:30:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0890f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d04152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0890f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0890f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d0415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0890f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0416d290 con 0x7f4d04159890 2023-10-08T00:30:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0890f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0416de10 con 0x7f4d04159c60 2023-10-08T00:30:32.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0890f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0416d4e0 con 0x7f4d04069560 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53152/0 (socket says 172.21.15.22:53152) 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 -- 172.21.15.22:0/2467642003 learned_addr learned my addr 172.21.15.22:0/2467642003 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d0259c700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d04152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d02d9d700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d0415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 -- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 msgr2=0x7f4d04152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d04152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 -- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 msgr2=0x7f4d0415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d0415cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 -- 172.21.15.22:0/2467642003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40094f0 con 0x7f4d04159890 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.269+0000 7f4d01d9b700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415c9d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00c5d0 tx=0x7f4cec007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:32.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.270+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec011590 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.270+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec011710 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.270+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec011ad0 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.270+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0416d7c0 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.270+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d04152ba0 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.271+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0416df80 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.271+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4cec01c460 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.271+0000 7f4cfa7fc700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067200 0x7f4ce40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.272+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4cec084740 con 0x7f4d04159890 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.272+0000 7f4d0259c700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067200 0x7f4ce40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.272+0000 7f4d0259c700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067200 0x7f4ce40696b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40099b0 tx=0x7f4cf4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:32.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.276+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cec0516a0 con 0x7f4d04159890 2023-10-08T00:30:32.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.513+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d0404c3c0 con 0x7f4d04159890 2023-10-08T00:30:32.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.514+0000 7f4cfa7fc700 1 -- 172.21.15.22:0/2467642003 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4cec054cc0 con 0x7f4d04159890 2023-10-08T00:30:32.515 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:32.515 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:19.209800+0000","modified":"2023-10-08T00:30:22.812658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/2279072181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2279072181},{"type":"v1","addr":"172.21.15.22:6835","nonce":2279072181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T00:30:32.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067200 msgr2=0x7f4ce40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067200 0x7f4ce40696b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40099b0 tx=0x7f4cf4016000 comp rx=0 tx=0).stop 2023-10-08T00:30:32.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 msgr2=0x7f4d0415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415c9d0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00c5d0 tx=0x7f4cec007f60 comp rx=0 tx=0).stop 2023-10-08T00:30:32.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 shutdown_connections 2023-10-08T00:30:32.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d0415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067200 0x7f4ce40696b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04069560 0x7f4d04152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 --2- 172.21.15.22:0/2467642003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d0415c9d0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 >> 172.21.15.22:0/2467642003 conn(0x7f4d04068e20 msgr2=0x7f4d040d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:32.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 shutdown_connections 2023-10-08T00:30:32.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.516+0000 7f4d0890f700 1 -- 172.21.15.22:0/2467642003 wait complete. 2023-10-08T00:30:32.519 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 52 2023-10-08T00:30:32.529 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:32.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.648+0000 7f39d9e41700 1 Processor -- start 2023-10-08T00:30:32.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.648+0000 7f39d9e41700 1 -- start start 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d9e41700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39d406bcd0 0x7f39d40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d9e41700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39d415df50 0x7f39d415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d9e41700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d415d7e0 con 0x7f39d406c0a0 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d9e41700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d415dac0 con 0x7f39d406bcd0 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d9e41700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d415aa30 con 0x7f39d415df50 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39d406bcd0 0x7f39d40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39d406bcd0 0x7f39d40caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53166/0 (socket says 172.21.15.22:53166) 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 -- 172.21.15.22:0/1248935685 learned_addr learned my addr 172.21.15.22:0/1248935685 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 -- 172.21.15.22:0/1248935685 >> v2:172.21.15.192:3300/0 conn(0x7f39d415df50 msgr2=0x7f39d415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:32.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 --2- 172.21.15.22:0/1248935685 >> v2:172.21.15.192:3300/0 conn(0x7f39d415df50 0x7f39d415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 -- 172.21.15.22:0/1248935685 >> v1:172.21.15.192:6789/0 conn(0x7f39d406c0a0 legacy=0x7f39d415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 -- 172.21.15.22:0/1248935685 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d415ad10 con 0x7f39d406bcd0 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.649+0000 7f39d37fe700 1 --2- 172.21.15.22:0/1248935685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d40caa90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f39d415d720 tx=0x7f39c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982beb1075fdcbe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d27fc700 1 -- 172.21.15.22:0/1248935685 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400b820 con 0x7f39d406bcd0 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d27fc700 1 -- 172.21.15.22:0/1248935685 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400b980 con 0x7f39d406bcd0 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d27fc700 1 -- 172.21.15.22:0/1248935685 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400bd40 con 0x7f39d406bcd0 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 -- 172.21.15.22:0/1248935685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 msgr2=0x7f39d40caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1248935685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d40caa90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f39d415d720 tx=0x7f39c4009250 comp rx=0 tx=0).stop 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 -- 172.21.15.22:0/1248935685 shutdown_connections 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1248935685 >> v2:172.21.15.192:3300/0 conn(0x7f39d415df50 0x7f39d415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1248935685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d40caa90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 -- 172.21.15.22:0/1248935685 >> 172.21.15.22:0/1248935685 conn(0x7f39d40ce600 msgr2=0x7f39d40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:32.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 -- 172.21.15.22:0/1248935685 shutdown_connections 2023-10-08T00:30:32.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.650+0000 7f39d9e41700 1 -- 172.21.15.22:0/1248935685 wait complete. 2023-10-08T00:30:32.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.651+0000 7f39d9e41700 1 Processor -- start 2023-10-08T00:30:32.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 -- start start 2023-10-08T00:30:32.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d416cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d406c0a0 0x7f39d4169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d415df50 0x7f39d415c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d416adb0 con 0x7f39d406bcd0 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d4159010 con 0x7f39d406c0a0 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d9e41700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d416a7f0 con 0x7f39d415df50 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d416cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d416cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53176/0 (socket says 172.21.15.22:53176) 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d37fe700 1 -- 172.21.15.22:0/1857254729 learned_addr learned my addr 172.21.15.22:0/1857254729 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d2ffd700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d406c0a0 0x7f39d4169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.652+0000 7f39d3fff700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d415df50 0x7f39d415c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d37fe700 1 -- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d415df50 msgr2=0x7f39d415c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d37fe700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d415df50 0x7f39d415c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d37fe700 1 -- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d406c0a0 msgr2=0x7f39d4169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d37fe700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d406c0a0 0x7f39d4169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d37fe700 1 -- 172.21.15.22:0/1857254729 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40094f0 con 0x7f39d406bcd0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d37fe700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d416cd20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f39c40090b0 tx=0x7f39c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c4011e70 con 0x7f39d406bcd0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c401f070 con 0x7f39d406bcd0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c40266d0 con 0x7f39d406bcd0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d416aad0 con 0x7f39d406bcd0 2023-10-08T00:30:32.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.653+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d40b1870 con 0x7f39d406bcd0 2023-10-08T00:30:32.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.654+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d40b1a90 con 0x7f39d406bcd0 2023-10-08T00:30:32.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.654+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f39c4026b00 con 0x7f39d406bcd0 2023-10-08T00:30:32.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.655+0000 7f39bb7fe700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39c0067200 0x7f39c00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.655+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39c4021070 con 0x7f39d406bcd0 2023-10-08T00:30:32.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.655+0000 7f39d2ffd700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39c0067200 0x7f39c00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.655+0000 7f39d2ffd700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39c0067200 0x7f39c00696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f39d415a650 tx=0x7f39c8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:32.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.659+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39d40b1a90 con 0x7f39d406bcd0 2023-10-08T00:30:32.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.854+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d4158b00 con 0x7f39d406bcd0 2023-10-08T00:30:32.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.855+0000 7f39bb7fe700 1 -- 172.21.15.22:0/1857254729 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f39d4158b00 con 0x7f39d406bcd0 2023-10-08T00:30:32.856 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:32.856 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":78,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:20.606387+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:17.609244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:18.173807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:32.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.857+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39c0067200 msgr2=0x7f39c00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.857+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39c0067200 0x7f39c00696b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f39d415a650 tx=0x7f39c8009060 comp rx=0 tx=0).stop 2023-10-08T00:30:32.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.857+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 msgr2=0x7f39d416cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.857+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d416cd20 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f39c40090b0 tx=0x7f39c4016000 comp rx=0 tx=0).stop 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 shutdown_connections 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f39c0067200 0x7f39c00696b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39d415df50 0x7f39d415c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39d406bcd0 0x7f39d416cd20 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 --2- 172.21.15.22:0/1857254729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d406c0a0 0x7f39d4169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 >> 172.21.15.22:0/1857254729 conn(0x7f39d40ce600 msgr2=0x7f39d4069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 shutdown_connections 2023-10-08T00:30:32.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.858+0000 7f39d9e41700 1 -- 172.21.15.22:0/1857254729 wait complete. 2023-10-08T00:30:32.871 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:30:32.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.990+0000 7f243759e700 1 Processor -- start 2023-10-08T00:30:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.990+0000 7f243759e700 1 -- start start 2023-10-08T00:30:32.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24381597f0 0x7f24380b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f243815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:32.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243759e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243815dbb0 con 0x7f2438159420 2023-10-08T00:30:32.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243759e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380b11d0 con 0x7f24381597f0 2023-10-08T00:30:32.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380b14b0 con 0x7f243815d230 2023-10-08T00:30:32.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2438159420 0x7f24380b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41224/0 (socket says 172.21.15.22:41224) 2023-10-08T00:30:32.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243659c700 1 -- 172.21.15.22:0/4214092595 learned_addr learned my addr 172.21.15.22:0/4214092595 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f2435d9b700 1 --2- 172.21.15.22:0/4214092595 >> v2:172.21.15.22:3300/0 conn(0x7f24381597f0 0x7f24380b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f2436d9d700 1 --2- 172.21.15.22:0/4214092595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f243815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243559a700 1 -- 172.21.15.22:0/4214092595 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458115486 0 0) 0x7f243815dbb0 con 0x7f2438159420 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f243559a700 1 -- 172.21.15.22:0/4214092595 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2424003570 con 0x7f2438159420 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f2435d9b700 1 -- 172.21.15.22:0/4214092595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 msgr2=0x7f243815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f2435d9b700 1 --2- 172.21.15.22:0/4214092595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f243815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:32.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f2435d9b700 1 -- 172.21.15.22:0/4214092595 >> v1:172.21.15.22:6789/0 conn(0x7f2438159420 legacy=0x7f24380b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.991+0000 7f2435d9b700 1 -- 172.21.15.22:0/4214092595 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380b1790 con 0x7f24381597f0 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f2435d9b700 1 --2- 172.21.15.22:0/4214092595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24381597f0 0x7f24380b2270 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f24200098e0 tx=0x7f24200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11a19a16cad499 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243559a700 1 -- 172.21.15.22:0/4214092595 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420011630 con 0x7f24381597f0 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243559a700 1 -- 172.21.15.22:0/4214092595 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420011790 con 0x7f24381597f0 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243559a700 1 -- 172.21.15.22:0/4214092595 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420011b30 con 0x7f24381597f0 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 -- 172.21.15.22:0/4214092595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24381597f0 msgr2=0x7f24380b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 --2- 172.21.15.22:0/4214092595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24381597f0 0x7f24380b2270 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f24200098e0 tx=0x7f24200091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 -- 172.21.15.22:0/4214092595 shutdown_connections 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 --2- 172.21.15.22:0/4214092595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f243815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 --2- 172.21.15.22:0/4214092595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24381597f0 0x7f24380b2270 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 -- 172.21.15.22:0/4214092595 >> 172.21.15.22:0/4214092595 conn(0x7f24380d0660 msgr2=0x7f24380d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 -- 172.21.15.22:0/4214092595 shutdown_connections 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.992+0000 7f243759e700 1 -- 172.21.15.22:0/4214092595 wait complete. 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.993+0000 7f243759e700 1 Processor -- start 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.993+0000 7f243759e700 1 -- start start 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 0x7f2438152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24381597f0 0x7f243816a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f2438154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243759e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24380af7a0 con 0x7f2438159420 2023-10-08T00:30:33.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438169df0 con 0x7f24381597f0 2023-10-08T00:30:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2438154010 con 0x7f243815d230 2023-10-08T00:30:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 0x7f2438152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 0x7f2438152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53200/0 (socket says 172.21.15.22:53200) 2023-10-08T00:30:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243659c700 1 -- 172.21.15.22:0/1488249387 learned_addr learned my addr 172.21.15.22:0/1488249387 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243659c700 1 -- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 msgr2=0x7f2438154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f2435d9b700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24381597f0 0x7f243816a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243659c700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f2438154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.994+0000 7f243659c700 1 -- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24381597f0 msgr2=0x7f243816a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f243659c700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24381597f0 0x7f243816a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f243659c700 1 -- 172.21.15.22:0/1488249387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420009420 con 0x7f2438159420 2023-10-08T00:30:33.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f2435d9b700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24381597f0 0x7f243816a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:33.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f243659c700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 0x7f2438152cb0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f243000c7c0 tx=0x7f2430007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430005b30 con 0x7f2438159420 2023-10-08T00:30:33.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2430005c90 con 0x7f2438159420 2023-10-08T00:30:33.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2438153a50 con 0x7f2438159420 2023-10-08T00:30:33.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430007340 con 0x7f2438159420 2023-10-08T00:30:33.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.995+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2438169a80 con 0x7f2438159420 2023-10-08T00:30:33.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.996+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243804c3c0 con 0x7f2438159420 2023-10-08T00:30:33.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.996+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f243001b400 con 0x7f2438159420 2023-10-08T00:30:33.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.996+0000 7f242e7fc700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2418067200 0x7f24180696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.997+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2430084470 con 0x7f2438159420 2023-10-08T00:30:33.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.997+0000 7f2435d9b700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2418067200 0x7f24180696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:32.997+0000 7f2435d9b700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2418067200 0x7f24180696b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2438159c70 tx=0x7f2420017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.001+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2430051410 con 0x7f2438159420 2023-10-08T00:30:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.238+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24380b1a70 con 0x7f2438159420 2023-10-08T00:30:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.239+0000 7f242e7fc700 1 -- 172.21.15.22:0/1488249387 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f2430054a30 con 0x7f2438159420 2023-10-08T00:30:33.239 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:33.240 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:19.209800+0000","modified":"2023-10-08T00:30:22.812658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/2279072181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2279072181},{"type":"v1","addr":"172.21.15.22:6835","nonce":2279072181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T00:30:33.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2418067200 msgr2=0x7f24180696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2418067200 0x7f24180696b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2438159c70 tx=0x7f2420017000 comp rx=0 tx=0).stop 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 msgr2=0x7f2438152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 0x7f2438152cb0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f243000c7c0 tx=0x7f2430007e00 comp rx=0 tx=0).stop 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 shutdown_connections 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2418067200 0x7f24180696b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f243815d230 0x7f2438154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2438159420 0x7f2438152cb0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 --2- 172.21.15.22:0/1488249387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24381597f0 0x7f243816a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 >> 172.21.15.22:0/1488249387 conn(0x7f24380d0660 msgr2=0x7f24380afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 shutdown_connections 2023-10-08T00:30:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.241+0000 7f243759e700 1 -- 172.21.15.22:0/1488249387 wait complete. 2023-10-08T00:30:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 52 2023-10-08T00:30:33.254 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.373+0000 7f96d1a39700 1 Processor -- start 2023-10-08T00:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.373+0000 7f96d1a39700 1 -- start start 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1a39700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96cc15d230 0x7f96cc15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1a39700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0b2980 con 0x7f96cc159420 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1a39700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc15db70 con 0x7f96cc1597f0 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1a39700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0b11d0 con 0x7f96cc15d230 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1238700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96cc15d230 0x7f96cc15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1238700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96cc15d230 0x7f96cc15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53208/0 (socket says 172.21.15.22:53208) 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1238700 1 -- 172.21.15.22:0/2248369836 learned_addr learned my addr 172.21.15.22:0/2248369836 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d0a37700 1 --1- 172.21.15.22:0/2248369836 >> v1:172.21.15.22:6789/0 conn(0x7f96cc159420 0x7f96cc0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41230/0 (socket says 172.21.15.22:41230) 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1238700 1 -- 172.21.15.22:0/2248369836 >> v1:172.21.15.192:6789/0 conn(0x7f96cc1597f0 legacy=0x7f96cc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1238700 1 -- 172.21.15.22:0/2248369836 >> v1:172.21.15.22:6789/0 conn(0x7f96cc159420 legacy=0x7f96cc0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.374+0000 7f96d1238700 1 -- 172.21.15.22:0/2248369836 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0b14b0 con 0x7f96cc15d230 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1238700 1 --2- 172.21.15.22:0/2248369836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc15d230 0x7f96cc15d630 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009f20 tx=0x7f96c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337d1a5a66a6a5c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96cb7fe700 1 -- 172.21.15.22:0/2248369836 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400e070 con 0x7f96cc15d230 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96cb7fe700 1 -- 172.21.15.22:0/2248369836 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400ba80 con 0x7f96cc15d230 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96cb7fe700 1 -- 172.21.15.22:0/2248369836 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40092e0 con 0x7f96cc15d230 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 -- 172.21.15.22:0/2248369836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc15d230 msgr2=0x7f96cc15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2248369836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc15d230 0x7f96cc15d630 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009f20 tx=0x7f96c4009840 comp rx=0 tx=0).stop 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 -- 172.21.15.22:0/2248369836 shutdown_connections 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2248369836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc15d230 0x7f96cc15d630 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 -- 172.21.15.22:0/2248369836 >> 172.21.15.22:0/2248369836 conn(0x7f96cc0d0660 msgr2=0x7f96cc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 -- 172.21.15.22:0/2248369836 shutdown_connections 2023-10-08T00:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.375+0000 7f96d1a39700 1 -- 172.21.15.22:0/2248369836 wait complete. 2023-10-08T00:30:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.376+0000 7f96d1a39700 1 Processor -- start 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 -- start start 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96cc159420 0x7f96cc149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 0x7f96cc069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96cc15d230 0x7f96cc069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c6010 con 0x7f96cc1597f0 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c5400 con 0x7f96cc15d230 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1a39700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c56e0 con 0x7f96cc159420 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96cbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 0x7f96cc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96cbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 0x7f96cc069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53212/0 (socket says 172.21.15.22:53212) 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96cbfff700 1 -- 172.21.15.22:0/2169590241 learned_addr learned my addr 172.21.15.22:0/2169590241 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d1238700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96cc15d230 0x7f96cc069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.377+0000 7f96d0a37700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96cc159420 0x7f96cc149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96cbfff700 1 -- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96cc159420 msgr2=0x7f96cc149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96cbfff700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96cc159420 0x7f96cc149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96cbfff700 1 -- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96cc15d230 msgr2=0x7f96cc069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96cbfff700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96cc15d230 0x7f96cc069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96cbfff700 1 -- 172.21.15.22:0/2169590241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009ae0 con 0x7f96cc1597f0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96d1238700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96cc15d230 0x7f96cc069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96cbfff700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 0x7f96cc069800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c7c0 tx=0x7f96c0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0011590 con 0x7f96cc1597f0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c00116f0 con 0x7f96cc1597f0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc0c59c0 con 0x7f96cc1597f0 2023-10-08T00:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c0011ab0 con 0x7f96cc1597f0 2023-10-08T00:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.378+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc0c64a0 con 0x7f96cc1597f0 2023-10-08T00:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.379+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc0c6180 con 0x7f96cc1597f0 2023-10-08T00:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.379+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f96c001b3b0 con 0x7f96cc1597f0 2023-10-08T00:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.380+0000 7f96c8ff9700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f96b8067200 0x7f96b80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.380+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f96c0083ec0 con 0x7f96cc1597f0 2023-10-08T00:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.380+0000 7f96d0a37700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f96b8067200 0x7f96b80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.381+0000 7f96d0a37700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f96b8067200 0x7f96b80696b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007fd0 tx=0x7f96bc007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.384+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96c0050de0 con 0x7f96cc1597f0 2023-10-08T00:30:33.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.622+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96cc04c3c0 con 0x7f96cc1597f0 2023-10-08T00:30:33.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.623+0000 7f96c8ff9700 1 -- 172.21.15.22:0/2169590241 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f96c0017070 con 0x7f96cc1597f0 2023-10-08T00:30:33.623 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:33.623 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":52,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:19.209800+0000","modified":"2023-10-08T00:30:22.812658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6141},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6141":{"gid":6141,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/2279072181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2279072181},{"type":"v1","addr":"172.21.15.22:6835","nonce":2279072181}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T00:30:33.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.624+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f96b8067200 msgr2=0x7f96b80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.624+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f96b8067200 0x7f96b80696b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f96bc007fd0 tx=0x7f96bc007d70 comp rx=0 tx=0).stop 2023-10-08T00:30:33.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.624+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 msgr2=0x7f96cc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.624+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 0x7f96cc069800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c7c0 tx=0x7f96c0007f50 comp rx=0 tx=0).stop 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 shutdown_connections 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96cc15d230 0x7f96cc069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f96b8067200 0x7f96b80696b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f96cc159420 0x7f96cc149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 --2- 172.21.15.22:0/2169590241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96cc1597f0 0x7f96cc069800 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 >> 172.21.15.22:0/2169590241 conn(0x7f96cc0d0660 msgr2=0x7f96cc0b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 shutdown_connections 2023-10-08T00:30:33.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.625+0000 7f96d1a39700 1 -- 172.21.15.22:0/2169590241 wait complete. 2023-10-08T00:30:33.627 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 52 2023-10-08T00:30:33.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:33.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.755+0000 7f92706b9700 1 Processor -- start 2023-10-08T00:30:33.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.755+0000 7f92706b9700 1 -- start start 2023-10-08T00:30:33.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.756+0000 7f92706b9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9268159c60 0x7f926815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.756+0000 7f92706b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.756+0000 7f92706b9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926815a160 con 0x7f9268159890 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.756+0000 7f92706b9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926815df50 con 0x7f9268159c60 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.756+0000 7f92706b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680d13a0 con 0x7f926815db10 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9268159c60 0x7f926815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926e455700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9268159890 0x7f926815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41244/0 (socket says 172.21.15.22:41244) 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9268159c60 0x7f926815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53224/0 (socket says 172.21.15.22:53224) 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926e455700 1 -- 172.21.15.22:0/1498304700 learned_addr learned my addr 172.21.15.22:0/1498304700 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:33.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926ec56700 1 --2- 172.21.15.22:0/1498304700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 -- 172.21.15.22:0/1498304700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 msgr2=0x7f9268069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 --2- 172.21.15.22:0/1498304700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 -- 172.21.15.22:0/1498304700 >> v1:172.21.15.22:6789/0 conn(0x7f9268159890 legacy=0x7f926815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926d453700 1 -- 172.21.15.22:0/1498304700 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155932187 0 0) 0x7f926815a160 con 0x7f9268159890 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 -- 172.21.15.22:0/1498304700 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926815e140 con 0x7f9268159c60 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926dc54700 1 --2- 172.21.15.22:0/1498304700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159c60 0x7f926815d5d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f925c0098e0 tx=0x7f925c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d098273a2811ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926d453700 1 -- 172.21.15.22:0/1498304700 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c009e80 con 0x7f9268159c60 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926d453700 1 -- 172.21.15.22:0/1498304700 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c00b860 con 0x7f9268159c60 2023-10-08T00:30:33.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.757+0000 7f926d453700 1 -- 172.21.15.22:0/1498304700 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00bbe0 con 0x7f9268159c60 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 -- 172.21.15.22:0/1498304700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159c60 msgr2=0x7f926815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 --2- 172.21.15.22:0/1498304700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159c60 0x7f926815d5d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f925c0098e0 tx=0x7f925c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 -- 172.21.15.22:0/1498304700 shutdown_connections 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 --2- 172.21.15.22:0/1498304700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 --2- 172.21.15.22:0/1498304700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159c60 0x7f926815d5d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 -- 172.21.15.22:0/1498304700 >> 172.21.15.22:0/1498304700 conn(0x7f9268068e20 msgr2=0x7f92680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 -- 172.21.15.22:0/1498304700 shutdown_connections 2023-10-08T00:30:33.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.758+0000 7f92706b9700 1 -- 172.21.15.22:0/1498304700 wait complete. 2023-10-08T00:30:33.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.759+0000 7f92706b9700 1 Processor -- start 2023-10-08T00:30:33.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.759+0000 7f92706b9700 1 -- start start 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 0x7f9268145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9268159c60 0x7f92680c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680c6770 con 0x7f9268159890 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9268152600 con 0x7f9268159c60 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680c5f10 con 0x7f926815db10 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 0x7f9268145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 0x7f9268145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53234/0 (socket says 172.21.15.22:53234) 2023-10-08T00:30:33.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 -- 172.21.15.22:0/72540666 learned_addr learned my addr 172.21.15.22:0/72540666 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 -- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 msgr2=0x7f9268146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 -- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9268159c60 msgr2=0x7f92680c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9268159c60 0x7f92680c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 -- 172.21.15.22:0/72540666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c009420 con 0x7f9268159890 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f926e455700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 0x7f9268145bf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f925800cd80 tx=0x7f9258001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800ab10 con 0x7f9268159890 2023-10-08T00:30:33.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800ac70 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.760+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9268151ff0 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.761+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580070f0 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.761+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92680c6230 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.761+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92680c65b0 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.762+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f92580074e0 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.762+0000 7f92667fc700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9254067200 0x7f92540696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.762+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9258084eb0 con 0x7f9268159890 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.762+0000 7f926dc54700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9254067200 0x7f92540696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:33.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.763+0000 7f926dc54700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9254067200 0x7f92540696b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f92681559a0 tx=0x7f925c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:33.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.766+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9258051e50 con 0x7f9268159890 2023-10-08T00:30:33.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.963+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f926804c3c0 con 0x7f9268159890 2023-10-08T00:30:33.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.964+0000 7f92667fc700 1 -- 172.21.15.22:0/72540666 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f9258055470 con 0x7f9268159890 2023-10-08T00:30:33.964 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:33.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":78,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:20.606387+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:17.609244+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:18.173807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:33.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9254067200 msgr2=0x7f92540696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9254067200 0x7f92540696b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f92681559a0 tx=0x7f925c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 msgr2=0x7f9268145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 0x7f9268145bf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f925800cd80 tx=0x7f9258001ae0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 shutdown_connections 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9254067200 0x7f92540696b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f926815db10 0x7f9268146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9268159890 0x7f9268145bf0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 --2- 172.21.15.22:0/72540666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9268159c60 0x7f92680c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:33.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 >> 172.21.15.22:0/72540666 conn(0x7f9268068e20 msgr2=0x7f9268156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:33.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 shutdown_connections 2023-10-08T00:30:33.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:33.966+0000 7f92706b9700 1 -- 172.21.15.22:0/72540666 wait complete. 2023-10-08T00:30:33.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:30:34.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.099+0000 7fbf6a816700 1 Processor -- start 2023-10-08T00:30:34.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.099+0000 7fbf6a816700 1 -- start start 2023-10-08T00:30:34.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.099+0000 7fbf6a816700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbf64159c60 0x7fbf6415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.099+0000 7fbf6a816700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf6415db10 0x7fbf64069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf6a816700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6415a160 con 0x7fbf64159890 2023-10-08T00:30:34.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf6a816700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6415df50 con 0x7fbf6415db10 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf6a816700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640d13a0 con 0x7fbf64159c60 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf6415db10 0x7fbf64069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf6415db10 0x7fbf64069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53238/0 (socket says 172.21.15.22:53238) 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 -- 172.21.15.22:0/316441070 learned_addr learned my addr 172.21.15.22:0/316441070 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf637fe700 1 --2- 172.21.15.22:0/316441070 >> v2:172.21.15.192:3300/0 conn(0x7fbf64159c60 0x7fbf6415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 -- 172.21.15.22:0/316441070 >> v2:172.21.15.192:3300/0 conn(0x7fbf64159c60 msgr2=0x7fbf6415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 --2- 172.21.15.22:0/316441070 >> v2:172.21.15.192:3300/0 conn(0x7fbf64159c60 0x7fbf6415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 -- 172.21.15.22:0/316441070 >> v1:172.21.15.192:6789/0 conn(0x7fbf64159890 legacy=0x7fbf6415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 -- 172.21.15.22:0/316441070 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6415e140 con 0x7fbf6415db10 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf637fe700 1 --2- 172.21.15.22:0/316441070 >> v2:172.21.15.192:3300/0 conn(0x7fbf64159c60 0x7fbf6415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:34.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf68db3700 1 --2- 172.21.15.22:0/316441070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64069560 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbf640b67f0 tx=0x7fbf5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2fb2add83b1d13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf62ffd700 1 -- 172.21.15.22:0/316441070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c00e070 con 0x7fbf6415db10 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf62ffd700 1 -- 172.21.15.22:0/316441070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c00ba10 con 0x7fbf6415db10 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.100+0000 7fbf62ffd700 1 -- 172.21.15.22:0/316441070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0092e0 con 0x7fbf6415db10 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 -- 172.21.15.22:0/316441070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 msgr2=0x7fbf64069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 --2- 172.21.15.22:0/316441070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64069560 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbf640b67f0 tx=0x7fbf5c009840 comp rx=0 tx=0).stop 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 -- 172.21.15.22:0/316441070 shutdown_connections 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 --2- 172.21.15.22:0/316441070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64069560 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 --2- 172.21.15.22:0/316441070 >> v2:172.21.15.192:3300/0 conn(0x7fbf64159c60 0x7fbf6415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 -- 172.21.15.22:0/316441070 >> 172.21.15.22:0/316441070 conn(0x7fbf64068e20 msgr2=0x7fbf640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 -- 172.21.15.22:0/316441070 shutdown_connections 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.101+0000 7fbf6a816700 1 -- 172.21.15.22:0/316441070 wait complete. 2023-10-08T00:30:34.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.102+0000 7fbf6a816700 1 Processor -- start 2023-10-08T00:30:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.102+0000 7fbf6a816700 1 -- start start 2023-10-08T00:30:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf6a816700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf64159890 0x7fbf640b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf6a816700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf64159c60 0x7fbf64154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf6a816700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf6a816700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64153cb0 con 0x7fbf6415db10 2023-10-08T00:30:34.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf6a816700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf641552a0 con 0x7fbf64159c60 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf6a816700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf64155580 con 0x7fbf64159890 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53240/0 (socket says 172.21.15.22:53240) 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 -- 172.21.15.22:0/256536538 learned_addr learned my addr 172.21.15.22:0/256536538 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf637fe700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf64159c60 0x7fbf64154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf63fff700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf64159890 0x7fbf640b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 -- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf64159890 msgr2=0x7fbf640b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf64159890 0x7fbf640b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 -- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf64159c60 msgr2=0x7fbf64154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf64159c60 0x7fbf64154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf68db3700 1 -- 172.21.15.22:0/256536538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c009ae0 con 0x7fbf6415db10 2023-10-08T00:30:34.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.103+0000 7fbf63fff700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf64159890 0x7fbf640b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:34.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.104+0000 7fbf68db3700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64144120 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbf64070e20 tx=0x7fbf5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:34.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.104+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0032f0 con 0x7fbf6415db10 2023-10-08T00:30:34.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.104+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c012db0 con 0x7fbf6415db10 2023-10-08T00:30:34.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.104+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf64155860 con 0x7fbf6415db10 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.104+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c01d670 con 0x7fbf6415db10 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.104+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf640b2860 con 0x7fbf6415db10 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.105+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf64153e60 con 0x7fbf6415db10 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.105+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fbf5c01daa0 con 0x7fbf6415db10 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.106+0000 7fbf4bfff700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf50067200 0x7fbf500696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.106+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf5c086330 con 0x7fbf6415db10 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.106+0000 7fbf63fff700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf50067200 0x7fbf500696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.106+0000 7fbf63fff700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf50067200 0x7fbf500696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf58007fd0 tx=0x7fbf58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:34.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.110+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf64153e60 con 0x7fbf6415db10 2023-10-08T00:30:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.348+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbf6404c3c0 con 0x7fbf6415db10 2023-10-08T00:30:34.349 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:30:34.349+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:30:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.353+0000 7fbf4bfff700 1 -- 172.21.15.22:0/256536538 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbf5c053140 con 0x7fbf6415db10 2023-10-08T00:30:34.358 INFO:tasks.ceph.mds.a.smithi022.stderr: -1760> 2023-10-08T00:30:25.611+0000 7ff16fb29700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf50067200 msgr2=0x7fbf500696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf50067200 0x7fbf500696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf58007fd0 tx=0x7fbf58009040 comp rx=0 tx=0).stop 2023-10-08T00:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 msgr2=0x7fbf64144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64144120 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbf64070e20 tx=0x7fbf5c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 shutdown_connections 2023-10-08T00:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf6415db10 0x7fbf64144120 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf50067200 0x7fbf500696b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf64159890 0x7fbf640b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 --2- 172.21.15.22:0/256536538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf64159c60 0x7fbf64154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 >> 172.21.15.22:0/256536538 conn(0x7fbf64068e20 msgr2=0x7fbf64157020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 shutdown_connections 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.356+0000 7fbf6a816700 1 -- 172.21.15.22:0/256536538 wait complete. 2023-10-08T00:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:30:34.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:30:34.378 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:30:34.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.490+0000 7f822006d700 1 Processor -- start 2023-10-08T00:30:34.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.490+0000 7f822006d700 1 -- start start 2023-10-08T00:30:34.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f822006d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f821806ab40 0x7f82180ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f822006d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821806af10 0x7f82180c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f822006d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82180c9900 0x7f8218156110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f822006d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821815a2a0 con 0x7f82180c9900 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f822006d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821815a490 con 0x7f821806ab40 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f822006d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821815a730 con 0x7f821806af10 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f821e60a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82180c9900 0x7f8218156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f821e60a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f82180c9900 0x7f8218156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53276/0 (socket says 172.21.15.22:53276) 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.491+0000 7f821e60a700 1 -- 172.21.15.22:0/614060158 learned_addr learned my addr 172.21.15.22:0/614060158 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821de09700 1 --2- 172.21.15.22:0/614060158 >> v2:172.21.15.192:3300/0 conn(0x7f821806ab40 0x7f82180ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821d608700 1 --2- 172.21.15.22:0/614060158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821806af10 0x7f82180c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821e60a700 1 -- 172.21.15.22:0/614060158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821806af10 msgr2=0x7f82180c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821e60a700 1 --2- 172.21.15.22:0/614060158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821806af10 0x7f82180c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821e60a700 1 -- 172.21.15.22:0/614060158 >> v2:172.21.15.192:3300/0 conn(0x7f821806ab40 msgr2=0x7f82180ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:34.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821e60a700 1 --2- 172.21.15.22:0/614060158 >> v2:172.21.15.192:3300/0 conn(0x7f821806ab40 0x7f82180ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821e60a700 1 -- 172.21.15.22:0/614060158 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821815aa10 con 0x7f82180c9900 2023-10-08T00:30:34.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821e60a700 1 --2- 172.21.15.22:0/614060158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82180c9900 0x7f8218156110 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f821806e5a0 tx=0x7f820800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5211446291cb4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:34.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821ce07700 1 -- 172.21.15.22:0/614060158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208010070 con 0x7f82180c9900 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821ce07700 1 -- 172.21.15.22:0/614060158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800de90 con 0x7f82180c9900 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.492+0000 7f821ce07700 1 -- 172.21.15.22:0/614060158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800b320 con 0x7f82180c9900 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 -- 172.21.15.22:0/614060158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82180c9900 msgr2=0x7f8218156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 --2- 172.21.15.22:0/614060158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82180c9900 0x7f8218156110 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f821806e5a0 tx=0x7f820800ba50 comp rx=0 tx=0).stop 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 -- 172.21.15.22:0/614060158 shutdown_connections 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 --2- 172.21.15.22:0/614060158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82180c9900 0x7f8218156110 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 --2- 172.21.15.22:0/614060158 >> v2:172.21.15.192:3300/0 conn(0x7f821806ab40 0x7f82180ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 --2- 172.21.15.22:0/614060158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f821806af10 0x7f82180c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 -- 172.21.15.22:0/614060158 >> 172.21.15.22:0/614060158 conn(0x7f82180cd640 msgr2=0x7f82180cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 -- 172.21.15.22:0/614060158 shutdown_connections 2023-10-08T00:30:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.493+0000 7f822006d700 1 -- 172.21.15.22:0/614060158 wait complete. 2023-10-08T00:30:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.494+0000 7f822006d700 1 Processor -- start 2023-10-08T00:30:34.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.494+0000 7f822006d700 1 -- start start 2023-10-08T00:30:34.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 0x7f82180c0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f821806af10 0x7f821814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82180c9900 0x7f821814dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c35f0 con 0x7f821806ab40 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c3890 con 0x7f821806af10 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c3b70 con 0x7f82180c9900 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 0x7f82180c0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 0x7f82180c0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53278/0 (socket says 172.21.15.22:53278) 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 -- 172.21.15.22:0/1687786253 learned_addr learned my addr 172.21.15.22:0/1687786253 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821e60a700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82180c9900 0x7f821814dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821d608700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f821806af10 0x7f821814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 -- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82180c9900 msgr2=0x7f821814dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82180c9900 0x7f821814dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 -- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f821806af10 msgr2=0x7f821814d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f821806af10 0x7f821814d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 -- 172.21.15.22:0/1687786253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820800bcf0 con 0x7f821806ab40 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821d608700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f821806af10 0x7f821814d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f821de09700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 0x7f82180c0ec0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f821000d890 tx=0x7f8210008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821000b6c0 con 0x7f821806ab40 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821000b840 con 0x7f821806ab40 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180c3e50 con 0x7f821806ab40 2023-10-08T00:30:34.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.495+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821000bc00 con 0x7f821806ab40 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.496+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82180b23c0 con 0x7f821806ab40 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.497+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821804c3c0 con 0x7f821806ab40 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.497+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f821001e460 con 0x7f821806ab40 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.497+0000 7f8215ffb700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8204067200 0x7f82040696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.497+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8210085170 con 0x7f821806ab40 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.498+0000 7f821d608700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8204067200 0x7f82040696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.498+0000 7f821d608700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8204067200 0x7f82040696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f82180acb70 tx=0x7f820c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:34.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.502+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8210052040 con 0x7f821806ab40 2023-10-08T00:30:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:34.740+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82180678d0 con 0x7f821806ab40 2023-10-08T00:30:35.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.353+0000 7f8215ffb700 1 -- 172.21.15.22:0/1687786253 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8210055660 con 0x7f821806ab40 2023-10-08T00:30:35.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8204067200 msgr2=0x7f82040696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8204067200 0x7f82040696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f82180acb70 tx=0x7f820c008040 comp rx=0 tx=0).stop 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 msgr2=0x7f82180c0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 0x7f82180c0ec0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f821000d890 tx=0x7f8210008040 comp rx=0 tx=0).stop 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 shutdown_connections 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8204067200 0x7f82040696b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82180c9900 0x7f821814dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821806ab40 0x7f82180c0ec0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 --2- 172.21.15.22:0/1687786253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f821806af10 0x7f821814d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 >> 172.21.15.22:0/1687786253 conn(0x7f82180cd640 msgr2=0x7f82181527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:35.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 shutdown_connections 2023-10-08T00:30:35.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.356+0000 7f822006d700 1 -- 172.21.15.22:0/1687786253 wait complete. 2023-10-08T00:30:35.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:30:35.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.537+0000 7f7850f45700 1 Processor -- start 2023-10-08T00:30:35.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.537+0000 7f7850f45700 1 -- start start 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7850f45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c159ec0 0x7f784c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7850f45700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f784c0b53d0 0x7f784c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7850f45700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0b5b00 con 0x7f784c0cce40 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7850f45700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c0b5da0 con 0x7f784c0b53d0 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7850f45700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0b6080 con 0x7f784c159ec0 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7849d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f784c0b53d0 0x7f784c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784ad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f784c0cce40 0x7f784c0cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41254/0 (socket says 172.21.15.22:41254) 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784ad9d700 1 -- 172.21.15.22:0/1399477881 learned_addr learned my addr 172.21.15.22:0/1399477881 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:35.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784a59c700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c159ec0 0x7f784c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7849d9b700 1 -- 172.21.15.22:0/1399477881 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c159ec0 msgr2=0x7f784c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7849d9b700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c159ec0 0x7f784c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7849d9b700 1 -- 172.21.15.22:0/1399477881 >> v1:172.21.15.22:6789/0 conn(0x7f784c0cce40 legacy=0x7f784c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784959a700 1 -- 172.21.15.22:0/1399477881 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432764776 0 0) 0x7f784c0b5b00 con 0x7f784c0cce40 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7849d9b700 1 -- 172.21.15.22:0/1399477881 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0cc100 con 0x7f784c0b53d0 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784a59c700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c159ec0 0x7f784c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f7849d9b700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c0cc900 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f78340098e0 tx=0x7f78340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a692af8936f096 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784959a700 1 -- 172.21.15.22:0/1399477881 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7834009e80 con 0x7f784c0b53d0 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784959a700 1 -- 172.21.15.22:0/1399477881 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783400b860 con 0x7f784c0b53d0 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.538+0000 7f784959a700 1 -- 172.21.15.22:0/1399477881 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400bbe0 con 0x7f784c0b53d0 2023-10-08T00:30:35.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 -- 172.21.15.22:0/1399477881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 msgr2=0x7f784c0cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c0cc900 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f78340098e0 tx=0x7f78340091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 -- 172.21.15.22:0/1399477881 shutdown_connections 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c159ec0 0x7f784c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 --2- 172.21.15.22:0/1399477881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c0cc900 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 -- 172.21.15.22:0/1399477881 >> 172.21.15.22:0/1399477881 conn(0x7f784c0999f0 msgr2=0x7f784c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 -- 172.21.15.22:0/1399477881 shutdown_connections 2023-10-08T00:30:35.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.539+0000 7f7850f45700 1 -- 172.21.15.22:0/1399477881 wait complete. 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.540+0000 7f7850f45700 1 Processor -- start 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.540+0000 7f7850f45700 1 -- start start 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7850f45700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7850f45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c0cce40 0x7f784c169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7850f45700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f784c159ec0 0x7f784c09c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7850f45700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c069f70 con 0x7f784c0b53d0 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7850f45700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c157570 con 0x7f784c159ec0 2023-10-08T00:30:35.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7850f45700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c069360 con 0x7f784c0cce40 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53300/0 (socket says 172.21.15.22:53300) 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 -- 172.21.15.22:0/3196095510 learned_addr learned my addr 172.21.15.22:0/3196095510 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f7849d9b700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c0cce40 0x7f784c169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784ad9d700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f784c159ec0 0x7f784c09c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 -- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c0cce40 msgr2=0x7f784c169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c0cce40 0x7f784c169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 -- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f784c159ec0 msgr2=0x7f784c09c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f784c159ec0 0x7f784c09c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.541+0000 7f784a59c700 1 -- 172.21.15.22:0/3196095510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009420 con 0x7f784c0b53d0 2023-10-08T00:30:35.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.542+0000 7f784a59c700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c157030 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f784400a520 tx=0x7f7844007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.542+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844008590 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.542+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78440086f0 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.542+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844008a90 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.542+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c069640 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.542+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c069c00 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.543+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c063c90 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.543+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f7844014410 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.544+0000 7f78427fc700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f782c067200 0x7f782c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.544+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f7844085760 con 0x7f784c0b53d0 2023-10-08T00:30:35.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.544+0000 7f7849d9b700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f782c067200 0x7f782c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.544+0000 7f7849d9b700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f782c067200 0x7f782c0696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f78340091e0 tx=0x7f7834017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:35.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.548+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7844052520 con 0x7f784c0b53d0 2023-10-08T00:30:35.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:35.746+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f784c0718b0 con 0x7f784c0b53d0 2023-10-08T00:30:36.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.650+0000 7f78427fc700 1 -- 172.21.15.22:0/3196095510 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 181+0+0 (secure 0 0 0) 0x7f784405b030 con 0x7f784c0b53d0 2023-10-08T00:30:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f782c067200 msgr2=0x7f782c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f782c067200 0x7f782c0696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f78340091e0 tx=0x7f7834017000 comp rx=0 tx=0).stop 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 msgr2=0x7f784c157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c157030 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f784400a520 tx=0x7f7844007960 comp rx=0 tx=0).stop 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 shutdown_connections 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f784c159ec0 0x7f784c09c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f784c0b53d0 0x7f784c157030 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f782c067200 0x7f782c0696b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.655+0000 7f7850f45700 1 --2- 172.21.15.22:0/3196095510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f784c0cce40 0x7f784c169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.656+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 >> 172.21.15.22:0/3196095510 conn(0x7f784c0999f0 msgr2=0x7f784c0c9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.656+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 shutdown_connections 2023-10-08T00:30:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.656+0000 7f7850f45700 1 -- 172.21.15.22:0/3196095510 wait complete. 2023-10-08T00:30:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:30:36.672 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:30:36.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.803+0000 7f144cafe700 1 Processor -- start 2023-10-08T00:30:36.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.803+0000 7f144cafe700 1 -- start start 2023-10-08T00:30:36.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144cafe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1448159ec0 0x7f14480b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144cafe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14480b53d0 0x7f14480cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144cafe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14480cce40 0x7f14480cd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144cafe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480b5b00 con 0x7f14480b53d0 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144cafe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480b5850 con 0x7f1448159ec0 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144cafe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480b5da0 con 0x7f14480cce40 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14480b53d0 0x7f14480cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f14480b53d0 0x7f14480cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43564/0 (socket says 172.21.15.22:43564) 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 -- 172.21.15.22:0/3457091103 learned_addr learned my addr 172.21.15.22:0/3457091103 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144659c700 1 --2- 172.21.15.22:0/3457091103 >> v2:172.21.15.192:3300/0 conn(0x7f1448159ec0 0x7f14480b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1446d9d700 1 --2- 172.21.15.22:0/3457091103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14480cce40 0x7f14480cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 -- 172.21.15.22:0/3457091103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14480cce40 msgr2=0x7f14480cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 --2- 172.21.15.22:0/3457091103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14480cce40 0x7f14480cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 -- 172.21.15.22:0/3457091103 >> v2:172.21.15.192:3300/0 conn(0x7f1448159ec0 msgr2=0x7f14480b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 --2- 172.21.15.22:0/3457091103 >> v2:172.21.15.192:3300/0 conn(0x7f1448159ec0 0x7f14480b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 -- 172.21.15.22:0/3457091103 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480b6080 con 0x7f14480b53d0 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f1445d9b700 1 --2- 172.21.15.22:0/3457091103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f14480cc900 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1448089120 tx=0x7f1430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b61dd0dfea63b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.804+0000 7f144559a700 1 -- 172.21.15.22:0/3457091103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000b860 con 0x7f14480b53d0 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144559a700 1 -- 172.21.15.22:0/3457091103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000b9c0 con 0x7f14480b53d0 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144559a700 1 -- 172.21.15.22:0/3457091103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000bd60 con 0x7f14480b53d0 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 -- 172.21.15.22:0/3457091103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 msgr2=0x7f14480cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 --2- 172.21.15.22:0/3457091103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f14480cc900 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1448089120 tx=0x7f1430009250 comp rx=0 tx=0).stop 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 -- 172.21.15.22:0/3457091103 shutdown_connections 2023-10-08T00:30:36.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 --2- 172.21.15.22:0/3457091103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f14480cce40 0x7f14480cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 --2- 172.21.15.22:0/3457091103 >> v2:172.21.15.192:3300/0 conn(0x7f1448159ec0 0x7f14480b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 --2- 172.21.15.22:0/3457091103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f14480cc900 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 -- 172.21.15.22:0/3457091103 >> 172.21.15.22:0/3457091103 conn(0x7f14480999f0 msgr2=0x7f14480b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 -- 172.21.15.22:0/3457091103 shutdown_connections 2023-10-08T00:30:36.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.805+0000 7f144cafe700 1 -- 172.21.15.22:0/3457091103 wait complete. 2023-10-08T00:30:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.806+0000 7f144cafe700 1 Processor -- start 2023-10-08T00:30:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.806+0000 7f144cafe700 1 -- start start 2023-10-08T00:30:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144cafe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f1448155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144cafe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14480cce40 0x7f144816d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144cafe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1448159ec0 0x7f144809c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144cafe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448068810 con 0x7f14480b53d0 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144cafe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144816e040 con 0x7f14480cce40 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144cafe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144816da80 con 0x7f1448159ec0 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f1448155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f1448155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43570/0 (socket says 172.21.15.22:43570) 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 -- 172.21.15.22:0/919636810 learned_addr learned my addr 172.21.15.22:0/919636810 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f1445d9b700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14480cce40 0x7f144816d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f1446d9d700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1448159ec0 0x7f144809c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 -- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1448159ec0 msgr2=0x7f144809c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1448159ec0 0x7f144809c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 -- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14480cce40 msgr2=0x7f144816d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14480cce40 0x7f144816d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.807+0000 7f144659c700 1 -- 172.21.15.22:0/919636810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300094f0 con 0x7f14480b53d0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.808+0000 7f144659c700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f1448155f20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f144000e110 tx=0x7f14400098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.808+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000edb0 con 0x7f14480b53d0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.808+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440014420 con 0x7f14480b53d0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.808+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144816dd60 con 0x7f14480b53d0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.808+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400147e0 con 0x7f14480b53d0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.808+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1448156460 con 0x7f14480b53d0 2023-10-08T00:30:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.809+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448068af0 con 0x7f14480b53d0 2023-10-08T00:30:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.809+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f1440014b50 con 0x7f14480b53d0 2023-10-08T00:30:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.810+0000 7f143e7fc700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1428067200 0x7f14280696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.810+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f1440084ff0 con 0x7f14480b53d0 2023-10-08T00:30:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.810+0000 7f1445d9b700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1428067200 0x7f14280696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.811+0000 7f1445d9b700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1428067200 0x7f14280696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1448089120 tx=0x7f1430017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:36.814+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1440052070 con 0x7f14480b53d0 2023-10-08T00:30:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.006+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1448063c90 con 0x7f14480b53d0 2023-10-08T00:30:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.652+0000 7f143e7fc700 1 -- 172.21.15.22:0/919636810 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1440055690 con 0x7f14480b53d0 2023-10-08T00:30:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1428067200 msgr2=0x7f14280696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1428067200 0x7f14280696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1448089120 tx=0x7f1430017000 comp rx=0 tx=0).stop 2023-10-08T00:30:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 msgr2=0x7f1448155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f1448155f20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f144000e110 tx=0x7f14400098d0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 shutdown_connections 2023-10-08T00:30:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1428067200 0x7f14280696b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1448159ec0 0x7f144809c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14480b53d0 0x7f1448155f20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 --2- 172.21.15.22:0/919636810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14480cce40 0x7f144816d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 >> 172.21.15.22:0/919636810 conn(0x7f14480999f0 msgr2=0x7f14480d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 shutdown_connections 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.659+0000 7f144cafe700 1 -- 172.21.15.22:0/919636810 wait complete. 2023-10-08T00:30:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:30:37.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:30:37.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.798+0000 7f7368d1a700 1 Processor -- start 2023-10-08T00:30:37.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.798+0000 7f7368d1a700 1 -- start start 2023-10-08T00:30:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7368d1a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7364159890 0x7f736415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7368d1a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7368d1a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7364069ee0 con 0x7f7364159c60 2023-10-08T00:30:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7368d1a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736415a160 con 0x7f7364159890 2023-10-08T00:30:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7368d1a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73640d13a0 con 0x7f7364069560 2023-10-08T00:30:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7364159890 0x7f736415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7361d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7364159c60 0x7f736415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42752/0 (socket says 172.21.15.22:42752) 2023-10-08T00:30:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7361d9b700 1 -- 172.21.15.22:0/2201621296 learned_addr learned my addr 172.21.15.22:0/2201621296 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7362d9d700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736259c700 1 -- 172.21.15.22:0/2201621296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 msgr2=0x7f73640699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736259c700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736259c700 1 -- 172.21.15.22:0/2201621296 >> v1:172.21.15.22:6789/0 conn(0x7f7364159c60 legacy=0x7f736415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736259c700 1 -- 172.21.15.22:0/2201621296 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736415e140 con 0x7f7364159890 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736159a700 1 -- 172.21.15.22:0/2201621296 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199087816 0 0) 0x7f7364069ee0 con 0x7f7364159c60 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f7362d9d700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736259c700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159890 0x7f736415abd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7354009e60 tx=0x7f7354009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790f9f89fd298050 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.799+0000 7f736159a700 1 -- 172.21.15.22:0/2201621296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735400e070 con 0x7f7364159890 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f736159a700 1 -- 172.21.15.22:0/2201621296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735400bc30 con 0x7f7364159890 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f736159a700 1 -- 172.21.15.22:0/2201621296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354012430 con 0x7f7364159890 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 -- 172.21.15.22:0/2201621296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159890 msgr2=0x7f736415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159890 0x7f736415abd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f7354009e60 tx=0x7f7354009780 comp rx=0 tx=0).stop 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 -- 172.21.15.22:0/2201621296 shutdown_connections 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 --2- 172.21.15.22:0/2201621296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159890 0x7f736415abd0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 -- 172.21.15.22:0/2201621296 >> 172.21.15.22:0/2201621296 conn(0x7f7364068e20 msgr2=0x7f73640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:37.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 -- 172.21.15.22:0/2201621296 shutdown_connections 2023-10-08T00:30:37.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.800+0000 7f7368d1a700 1 -- 172.21.15.22:0/2201621296 wait complete. 2023-10-08T00:30:37.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.801+0000 7f7368d1a700 1 Processor -- start 2023-10-08T00:30:37.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.801+0000 7f7368d1a700 1 -- start start 2023-10-08T00:30:37.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7368d1a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:37.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7368d1a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7364159890 0x7f7364169980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:37.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7368d1a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 0x7f7364169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:37.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7368d1a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7364155dc0 con 0x7f7364159c60 2023-10-08T00:30:37.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7368d1a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73641560a0 con 0x7f7364159890 2023-10-08T00:30:37.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7368d1a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7364155890 con 0x7f7364069560 2023-10-08T00:30:37.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 0x7f7364169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 0x7f7364169ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43588/0 (socket says 172.21.15.22:43588) 2023-10-08T00:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 -- 172.21.15.22:0/867300092 learned_addr learned my addr 172.21.15.22:0/867300092 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f736259c700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7361d9b700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7364159890 0x7f7364169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 -- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 msgr2=0x7f73640c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:37.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 -- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7364159890 msgr2=0x7f7364169980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7364159890 0x7f7364169980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 -- 172.21.15.22:0/867300092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354009a20 con 0x7f7364159c60 2023-10-08T00:30:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7361d9b700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7364159890 0x7f7364169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.802+0000 7f7362d9d700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 0x7f7364169ec0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c8b0 tx=0x7f735c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:37.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.803+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c011600 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.803+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c011760 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.803+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73640ca490 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.803+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c011b00 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.803+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73640caa50 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.804+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7364156230 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.804+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f735c018350 con 0x7f7364159c60 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.804+0000 7f735a7fc700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7344067200 0x7f73440696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:37.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.805+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f735c0846f0 con 0x7f7364159c60 2023-10-08T00:30:37.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.805+0000 7f736259c700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7344067200 0x7f73440696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:37.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.805+0000 7f736259c700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7344067200 0x7f73440696b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7354009e60 tx=0x7f7354019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:37.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:37.809+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f735c055290 con 0x7f7364159c60 2023-10-08T00:30:38.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.006+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f736404c3c0 con 0x7f7364159c60 2023-10-08T00:30:38.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.009+0000 7f735a7fc700 1 -- 172.21.15.22:0/867300092 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f735c054e20 con 0x7f7364159c60 2023-10-08T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7344067200 msgr2=0x7f73440696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7344067200 0x7f73440696b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7354009e60 tx=0x7f7354019000 comp rx=0 tx=0).stop 2023-10-08T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 msgr2=0x7f7364169ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 0x7f7364169ec0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f735c00c8b0 tx=0x7f735c008040 comp rx=0 tx=0).stop 2023-10-08T00:30:38.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 shutdown_connections 2023-10-08T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7364159c60 0x7f7364169ec0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7344067200 0x7f73440696b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7364069560 0x7f73640c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 --2- 172.21.15.22:0/867300092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7364159890 0x7f7364169980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 >> 172.21.15.22:0/867300092 conn(0x7f7364068e20 msgr2=0x7f73640b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:38.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 shutdown_connections 2023-10-08T00:30:38.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.011+0000 7f7368d1a700 1 -- 172.21.15.22:0/867300092 wait complete. 2023-10-08T00:30:38.024 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-08T00:30:38.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.145+0000 7f3a6d850700 1 Processor -- start 2023-10-08T00:30:38.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.145+0000 7f3a6d850700 1 -- start start 2023-10-08T00:30:38.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d850700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a68159420 0x7f3a680b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d850700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a6815d230 0x7f3a6815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d850700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6815dbd0 con 0x7f3a681597f0 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d850700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680b2980 con 0x7f3a6815d230 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d850700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680b11d0 con 0x7f3a68159420 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d04f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a6815d230 0x7f3a6815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d04f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a6815d230 0x7f3a6815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43602/0 (socket says 172.21.15.22:43602) 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.146+0000 7f3a6d04f700 1 -- 172.21.15.22:0/798814235 learned_addr learned my addr 172.21.15.22:0/798814235 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a6c84e700 1 --2- 172.21.15.22:0/798814235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a68159420 0x7f3a680b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a6d04f700 1 -- 172.21.15.22:0/798814235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a68159420 msgr2=0x7f3a680b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a6d04f700 1 --2- 172.21.15.22:0/798814235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a68159420 0x7f3a680b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a6d04f700 1 -- 172.21.15.22:0/798814235 >> v1:172.21.15.192:6789/0 conn(0x7f3a681597f0 legacy=0x7f3a680b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a6d04f700 1 -- 172.21.15.22:0/798814235 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680b14b0 con 0x7f3a6815d230 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a6d04f700 1 --2- 172.21.15.22:0/798814235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6815d230 0x7f3a6815d690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3a600099b0 tx=0x7f3a60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70c52ba37e8225d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:38.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a677fe700 1 -- 172.21.15.22:0/798814235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60009ea0 con 0x7f3a6815d230 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a677fe700 1 -- 172.21.15.22:0/798814235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6000b860 con 0x7f3a6815d230 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.147+0000 7f3a677fe700 1 -- 172.21.15.22:0/798814235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000bc00 con 0x7f3a6815d230 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 -- 172.21.15.22:0/798814235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6815d230 msgr2=0x7f3a6815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 --2- 172.21.15.22:0/798814235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6815d230 0x7f3a6815d690 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3a600099b0 tx=0x7f3a60009250 comp rx=0 tx=0).stop 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 -- 172.21.15.22:0/798814235 shutdown_connections 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 --2- 172.21.15.22:0/798814235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a6815d230 0x7f3a6815d690 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 --2- 172.21.15.22:0/798814235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a68159420 0x7f3a680b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 -- 172.21.15.22:0/798814235 >> 172.21.15.22:0/798814235 conn(0x7f3a680d0660 msgr2=0x7f3a680d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 -- 172.21.15.22:0/798814235 shutdown_connections 2023-10-08T00:30:38.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.148+0000 7f3a6d850700 1 -- 172.21.15.22:0/798814235 wait complete. 2023-10-08T00:30:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.149+0000 7f3a6d850700 1 Processor -- start 2023-10-08T00:30:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.149+0000 7f3a6d850700 1 -- start start 2023-10-08T00:30:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a68159420 0x7f3a680ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 0x7f3a680cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a6815d230 0x7f3a6816a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680caf70 con 0x7f3a681597f0 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680cb250 con 0x7f3a68159420 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680cb530 con 0x7f3a6815d230 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 0x7f3a680cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 0x7f3a680cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43606/0 (socket says 172.21.15.22:43606) 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 -- 172.21.15.22:0/2457447191 learned_addr learned my addr 172.21.15.22:0/2457447191 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6c84e700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a68159420 0x7f3a680ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d04f700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a6815d230 0x7f3a6816a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 -- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a6815d230 msgr2=0x7f3a6816a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a6815d230 0x7f3a6816a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 -- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a68159420 msgr2=0x7f3a680ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a68159420 0x7f3a680ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 -- 172.21.15.22:0/2457447191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600094f0 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d04f700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a6815d230 0x7f3a6816a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a67fff700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 0x7f3a680cc010 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800cb10 tx=0x7f3a580017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580020c0 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800a7e0 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a680cb810 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.150+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800ab80 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.151+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a68155920 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.151+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804c3c0 con 0x7f3a681597f0 2023-10-08T00:30:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.152+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3a58003030 con 0x7f3a681597f0 2023-10-08T00:30:38.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.152+0000 7f3a64ff9700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a48067200 0x7f3a480696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.152+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3a58084550 con 0x7f3a681597f0 2023-10-08T00:30:38.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.153+0000 7f3a6c84e700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a48067200 0x7f3a480696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.153+0000 7f3a6c84e700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a48067200 0x7f3a480696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3a68156080 tx=0x7f3a500091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:38.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.157+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a58051730 con 0x7f3a681597f0 2023-10-08T00:30:38.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.425+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f3a6815dbd0 con 0x7f3a681597f0 2023-10-08T00:30:38.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.658+0000 7f3a64ff9700 1 -- 172.21.15.22:0/2457447191 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v269) v1 ==== 158+0+0 (secure 0 0 0) 0x7f3a6815dbd0 con 0x7f3a681597f0 2023-10-08T00:30:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.660+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a48067200 msgr2=0x7f3a480696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.660+0000 7f3a6d850700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a48067200 0x7f3a480696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3a68156080 tx=0x7f3a500091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.660+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 msgr2=0x7f3a680cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.660+0000 7f3a6d850700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 0x7f3a680cc010 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800cb10 tx=0x7f3a580017b0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 shutdown_connections 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a48067200 0x7f3a480696b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a6815d230 0x7f3a6816a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a68159420 0x7f3a680ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 --2- 172.21.15.22:0/2457447191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a681597f0 0x7f3a680cc010 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 >> 172.21.15.22:0/2457447191 conn(0x7f3a680d0660 msgr2=0x7f3a681564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 shutdown_connections 2023-10-08T00:30:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.661+0000 7f3a6d850700 1 -- 172.21.15.22:0/2457447191 wait complete. 2023-10-08T00:30:38.674 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command ... ok 2023-10-08T00:30:38.674 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command without subvolume group 2023-10-08T00:30:38.674 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:30:38.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-08T00:30:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.797+0000 7f3a9359e700 1 Processor -- start 2023-10-08T00:30:38.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.797+0000 7f3a9359e700 1 -- start start 2023-10-08T00:30:38.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.798+0000 7f3a9359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a940c8d10 0x7f3a9406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.798+0000 7f3a9359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a9406e570 0x7f3a94156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.798+0000 7f3a9359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9406f6f0 con 0x7f3a940c90e0 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.798+0000 7f3a9359e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9406eae0 con 0x7f3a9406e570 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.798+0000 7f3a9359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9406edc0 con 0x7f3a940c8d10 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.798+0000 7f3a91d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a9406e570 0x7f3a94156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a9406e570 0x7f3a94156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43610/0 (socket says 172.21.15.22:43610) 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 -- 172.21.15.22:0/3317140668 learned_addr learned my addr 172.21.15.22:0/3317140668 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a9259c700 1 --2- 172.21.15.22:0/3317140668 >> v2:172.21.15.192:3300/0 conn(0x7f3a940c8d10 0x7f3a9406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 -- 172.21.15.22:0/3317140668 >> v2:172.21.15.192:3300/0 conn(0x7f3a940c8d10 msgr2=0x7f3a9406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 --2- 172.21.15.22:0/3317140668 >> v2:172.21.15.192:3300/0 conn(0x7f3a940c8d10 0x7f3a9406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 -- 172.21.15.22:0/3317140668 >> v1:172.21.15.192:6789/0 conn(0x7f3a940c90e0 legacy=0x7f3a940c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 -- 172.21.15.22:0/3317140668 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9406f0a0 con 0x7f3a9406e570 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a91d9b700 1 --2- 172.21.15.22:0/3317140668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a94156220 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3a94063ef0 tx=0x7f3a7c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d70a5c9a78571 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a9159a700 1 -- 172.21.15.22:0/3317140668 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c005c10 con 0x7f3a9406e570 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a9159a700 1 -- 172.21.15.22:0/3317140668 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c005d70 con 0x7f3a9406e570 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.799+0000 7f3a9159a700 1 -- 172.21.15.22:0/3317140668 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00b840 con 0x7f3a9406e570 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 -- 172.21.15.22:0/3317140668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 msgr2=0x7f3a94156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 --2- 172.21.15.22:0/3317140668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a94156220 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3a94063ef0 tx=0x7f3a7c009220 comp rx=0 tx=0).stop 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 -- 172.21.15.22:0/3317140668 shutdown_connections 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 --2- 172.21.15.22:0/3317140668 >> v2:172.21.15.192:3300/0 conn(0x7f3a940c8d10 0x7f3a9406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 --2- 172.21.15.22:0/3317140668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a94156220 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 -- 172.21.15.22:0/3317140668 >> 172.21.15.22:0/3317140668 conn(0x7f3a9406b450 msgr2=0x7f3a940cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:38.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 -- 172.21.15.22:0/3317140668 shutdown_connections 2023-10-08T00:30:38.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.800+0000 7f3a9359e700 1 -- 172.21.15.22:0/3317140668 wait complete. 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.801+0000 7f3a9359e700 1 Processor -- start 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.801+0000 7f3a9359e700 1 -- start start 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a940cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a940c8d10 0x7f3a940c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a940c90e0 0x7f3a940c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940cb800 con 0x7f3a9406e570 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940cddb0 con 0x7f3a940c90e0 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a940c58a0 con 0x7f3a940c8d10 2023-10-08T00:30:38.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a940cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a940cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43616/0 (socket says 172.21.15.22:43616) 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 -- 172.21.15.22:0/1405172703 learned_addr learned my addr 172.21.15.22:0/1405172703 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a92d9d700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a940c90e0 0x7f3a940c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 -- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a940c8d10 msgr2=0x7f3a940c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a940c8d10 0x7f3a940c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 -- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a940c90e0 msgr2=0x7f3a940c2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a940c90e0 0x7f3a940c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 -- 172.21.15.22:0/1405172703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c009480 con 0x7f3a9406e570 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9259c700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a940cd870 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400e190 tx=0x7f3a84009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400ee30 con 0x7f3a9406e570 2023-10-08T00:30:38.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84014420 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a940caed0 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.802+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840147e0 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.803+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a940cb490 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.803+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a940cbae0 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.804+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3a84014b90 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.804+0000 7f3a8a7fc700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a74067200 0x7f3a740696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.804+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3a84084ef0 con 0x7f3a9406e570 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.804+0000 7f3a91d9b700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a74067200 0x7f3a740696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:38.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.805+0000 7f3a91d9b700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a74067200 0x7f3a740696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3a94063ef0 tx=0x7f3a7c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:38.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:38.808+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a84052110 con 0x7f3a9406e570 2023-10-08T00:30:39.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.085+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f3a9404c3c0 con 0x7f3a9406e570 2023-10-08T00:30:39.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.659+0000 7f3a8a7fc700 1 -- 172.21.15.22:0/1405172703 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v270) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3a84009a60 con 0x7f3a9406e570 2023-10-08T00:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a74067200 msgr2=0x7f3a740696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a74067200 0x7f3a740696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3a94063ef0 tx=0x7f3a7c015000 comp rx=0 tx=0).stop 2023-10-08T00:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 msgr2=0x7f3a940cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a940cd870 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400e190 tx=0x7f3a84009920 comp rx=0 tx=0).stop 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 shutdown_connections 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a940c90e0 0x7f3a940c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a9406e570 0x7f3a940cd870 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a74067200 0x7f3a740696b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 --2- 172.21.15.22:0/1405172703 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a940c8d10 0x7f3a940c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 >> 172.21.15.22:0/1405172703 conn(0x7f3a9406b450 msgr2=0x7f3a940c19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 shutdown_connections 2023-10-08T00:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.662+0000 7f3a9359e700 1 -- 172.21.15.22:0/1405172703 wait complete. 2023-10-08T00:30:39.676 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:30:39.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 Processor -- start 2023-10-08T00:30:39.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 -- start start 2023-10-08T00:30:39.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6000159890 0x7f600015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f600015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f600015db10 0x7f6000069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600015a160 con 0x7f6000159890 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000d13a0 con 0x7f600015db10 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.801+0000 7f6005d8e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600015e140 con 0x7f6000159c60 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6000159890 0x7f600015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6000159890 0x7f600015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43628/0 (socket says 172.21.15.22:43628) 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2392270882 learned_addr learned my addr 172.21.15.22:0/2392270882 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5ffffff700 1 --2- 172.21.15.22:0/2392270882 >> v2:172.21.15.192:3300/0 conn(0x7f600015db10 0x7f6000069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5ffeffd700 1 --2- 172.21.15.22:0/2392270882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f600015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2392270882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 msgr2=0x7f600015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 --2- 172.21.15.22:0/2392270882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f600015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2392270882 >> v2:172.21.15.192:3300/0 conn(0x7f600015db10 msgr2=0x7f6000069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 --2- 172.21.15.22:0/2392270882 >> v2:172.21.15.192:3300/0 conn(0x7f600015db10 0x7f6000069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2392270882 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600015a3d0 con 0x7f6000159890 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5ffffff700 1 --2- 172.21.15.22:0/2392270882 >> v2:172.21.15.192:3300/0 conn(0x7f600015db10 0x7f6000069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5fff7fe700 1 --2- 172.21.15.22:0/2392270882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600015abd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6000089b50 tx=0x7f5ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcd4df8384235b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5ffe7fc700 1 -- 172.21.15.22:0/2392270882 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000b860 con 0x7f6000159890 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5ffe7fc700 1 -- 172.21.15.22:0/2392270882 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000b9c0 con 0x7f6000159890 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.802+0000 7f5ffe7fc700 1 -- 172.21.15.22:0/2392270882 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000bd60 con 0x7f6000159890 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 -- 172.21.15.22:0/2392270882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 msgr2=0x7f600015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2392270882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600015abd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6000089b50 tx=0x7f5ff0009250 comp rx=0 tx=0).stop 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 -- 172.21.15.22:0/2392270882 shutdown_connections 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2392270882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600015abd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2392270882 >> v2:172.21.15.192:3300/0 conn(0x7f600015db10 0x7f6000069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2392270882 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f600015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 -- 172.21.15.22:0/2392270882 >> 172.21.15.22:0/2392270882 conn(0x7f6000068e20 msgr2=0x7f60000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 -- 172.21.15.22:0/2392270882 shutdown_connections 2023-10-08T00:30:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.803+0000 7f6005d8e700 1 -- 172.21.15.22:0/2392270882 wait complete. 2023-10-08T00:30:39.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.804+0000 7f6005d8e700 1 Processor -- start 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.804+0000 7f6005d8e700 1 -- start start 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f6005d8e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f6005d8e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f60000cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f6005d8e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f600015db10 0x7f6000151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f6005d8e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600014caf0 con 0x7f6000159890 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f6005d8e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600014b2c0 con 0x7f600015db10 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f6005d8e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600014c120 con 0x7f6000159c60 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600014c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43642/0 (socket says 172.21.15.22:43642) 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2657138388 learned_addr learned my addr 172.21.15.22:0/2657138388 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5ffeffd700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f60000cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5ffffff700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f600015db10 0x7f6000151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 msgr2=0x7f60000cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f60000cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f600015db10 msgr2=0x7f6000151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f600015db10 0x7f6000151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 -- 172.21.15.22:0/2657138388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00094f0 con 0x7f6000159890 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.805+0000 7f5fff7fe700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600014c5b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0006fd0 tx=0x7f5ff0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.806+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0024440 con 0x7f6000159890 2023-10-08T00:30:39.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.806+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00245a0 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.806+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600014b510 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.806+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0024960 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.806+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600014bad0 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.807+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600014c400 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.807+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5ff0024d50 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.807+0000 7f5fe77fe700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fec067200 0x7f5fec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.807+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5ff0086220 con 0x7f6000159890 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.808+0000 7f5ffeffd700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fec067200 0x7f5fec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:39.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.808+0000 7f5ffeffd700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fec067200 0x7f5fec0696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f60000b0c90 tx=0x7f5ff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:39.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:39.812+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ff0053440 con 0x7f6000159890 2023-10-08T00:30:40.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.009+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f600004c3c0 con 0x7f6000159890 2023-10-08T00:30:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.013+0000 7f5fe77fe700 1 -- 172.21.15.22:0/2657138388 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ff0084e60 con 0x7f6000159890 2023-10-08T00:30:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fec067200 msgr2=0x7f5fec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fec067200 0x7f5fec0696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f60000b0c90 tx=0x7f5ff4008040 comp rx=0 tx=0).stop 2023-10-08T00:30:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 msgr2=0x7f600014c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600014c5b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0006fd0 tx=0x7f5ff0017000 comp rx=0 tx=0).stop 2023-10-08T00:30:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 shutdown_connections 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f600015db10 0x7f6000151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6000159890 0x7f600014c5b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fec067200 0x7f5fec0696b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 --2- 172.21.15.22:0/2657138388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6000159c60 0x7f60000cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 >> 172.21.15.22:0/2657138388 conn(0x7f6000068e20 msgr2=0x7f600014d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 shutdown_connections 2023-10-08T00:30:40.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.015+0000 7f6005d8e700 1 -- 172.21.15.22:0/2657138388 wait complete. 2023-10-08T00:30:40.028 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:30:40.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:40.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:40.111 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:30:40.112 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:30:40.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.230+0000 7f0b05e97700 1 Processor -- start 2023-10-08T00:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.230+0000 7f0b05e97700 1 -- start start 2023-10-08T00:30:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.231+0000 7f0b05e97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 0x7f0b0015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.231+0000 7f0b05e97700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0015a160 con 0x7f0b00159c60 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.231+0000 7f0b05e97700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000d13a0 con 0x7f0b00069560 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.231+0000 7f0b05e97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0015e140 con 0x7f0b00159890 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.231+0000 7f0afeffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0b00159c60 0x7f0b0015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42768/0 (socket says 172.21.15.22:42768) 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.231+0000 7f0afeffd700 1 -- 172.21.15.22:0/4166056048 learned_addr learned my addr 172.21.15.22:0/4166056048 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0aff7fe700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 0x7f0b0015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851481442 0 0) 0x7f0b0015a160 con 0x7f0b00159c60 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae8003570 con 0x7f0b00159c60 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 322120783 0 0) 0x7f0ae8003570 con 0x7f0b00159c60 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 msgr2=0x7f0b0015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 0x7f0b0015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 >> v1:172.21.15.192:6789/0 conn(0x7f0b00069560 legacy=0x7f0b000ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0015a3d0 con 0x7f0b00159c60 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f0af4001470 con 0x7f0b00159c60 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 >> v1:172.21.15.22:6789/0 conn(0x7f0b00159c60 legacy=0x7f0b0015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 0x7f0ae8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0ae8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ae8004d50 0x7f0ae80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0015e140 con 0x7f0ae8003fd0 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae800bb40 con 0x7f0ae8004d50 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae800bd00 con 0x7f0b00159890 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afeffd700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0ae8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0aff7fe700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 0x7f0ae8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afffff700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ae8004d50 0x7f0ae80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afeffd700 1 -- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 msgr2=0x7f0ae8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afeffd700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00159890 0x7f0ae8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afeffd700 1 -- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ae8004d50 msgr2=0x7f0ae80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.232+0000 7f0afeffd700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ae8004d50 0x7f0ae80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0afeffd700 1 -- 172.21.15.22:0/4166056048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8003570 con 0x7f0ae8003fd0 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0afeffd700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0ae8004810 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c390 tx=0x7f0af4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2ef11bbef366b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400cc60 con 0x7f0ae8003fd0 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af400cdc0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0afe7fc700 1 -- 172.21.15.22:0/4166056048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4005b70 con 0x7f0ae8003fd0 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0b05e97700 1 -- 172.21.15.22:0/4166056048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 msgr2=0x7f0ae8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0b05e97700 1 --2- 172.21.15.22:0/4166056048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0ae8004810 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c390 tx=0x7f0af4001e70 comp rx=0 tx=0).stop 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0afffff700 1 -- 172.21.15.22:0/4166056048 reap_dead start 2023-10-08T00:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0b05e97700 1 -- 172.21.15.22:0/4166056048 shutdown_connections 2023-10-08T00:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0b05e97700 1 -- 172.21.15.22:0/4166056048 >> 172.21.15.22:0/4166056048 conn(0x7f0b00068e20 msgr2=0x7f0b000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0b05e97700 1 -- 172.21.15.22:0/4166056048 shutdown_connections 2023-10-08T00:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.233+0000 7f0b05e97700 1 -- 172.21.15.22:0/4166056048 wait complete. 2023-10-08T00:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 Processor -- start 2023-10-08T00:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 -- start start 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0b000cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00158650 0x7f0b000cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b000c5e60 0x7f0b000c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c6820 con 0x7f0ae8003fd0 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b00156630 con 0x7f0b000c5e60 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0b05e97700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cd910 con 0x7f0b00158650 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0aff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0b000cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0aff7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0b000cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43658/0 (socket says 172.21.15.22:43658) 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.235+0000 7f0aff7fe700 1 -- 172.21.15.22:0/156645304 learned_addr learned my addr 172.21.15.22:0/156645304 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0afeffd700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00158650 0x7f0b000cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0afffff700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b000c5e60 0x7f0b000c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0aff7fe700 1 -- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00158650 msgr2=0x7f0b000cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0aff7fe700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00158650 0x7f0b000cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0aff7fe700 1 -- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b000c5e60 msgr2=0x7f0b000c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0aff7fe700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b000c5e60 0x7f0b000c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0aff7fe700 1 -- 172.21.15.22:0/156645304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000cdbf0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0aff7fe700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0b000cfa90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0af0011d40 tx=0x7f0af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af000fac0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000fc20 con 0x7f0ae8003fd0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000cded0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0014440 con 0x7f0ae8003fd0 2023-10-08T00:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.236+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b000cd600 con 0x7f0ae8003fd0 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.237+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0004c3c0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.237+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0af0014a80 con 0x7f0ae8003fd0 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.238+0000 7f0ae77fe700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0aec067200 0x7f0aec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.238+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0af0018030 con 0x7f0ae8003fd0 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.238+0000 7f0afeffd700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0aec067200 0x7f0aec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.238+0000 7f0afeffd700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0aec067200 0x7f0aec0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0af4001ed0 tx=0x7f0af4015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.242+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0af00525d0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.480+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b000d11e0 con 0x7f0ae8003fd0 2023-10-08T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.480+0000 7f0ae77fe700 1 -- 172.21.15.22:0/156645304 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f0af0022090 con 0x7f0ae8003fd0 2023-10-08T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:40.481 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5429,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1396602975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1396602975},{"type":"v1","addr":"172.21.15.192:6836","nonce":1396602975}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":5779,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1563647247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1563647247},{"type":"v1","addr":"172.21.15.192:6837","nonce":1563647247}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6138,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2102706998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2102706998},{"type":"v1","addr":"172.21.15.22:6834","nonce":2102706998}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6441,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2788329214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2788329214},{"type":"v1","addr":"172.21.15.22:6835","nonce":2788329214}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2023-10-08T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0aec067200 msgr2=0x7f0aec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0aec067200 0x7f0aec0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0af4001ed0 tx=0x7f0af4015000 comp rx=0 tx=0).stop 2023-10-08T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 msgr2=0x7f0b000cfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0b000cfa90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0af0011d40 tx=0x7f0af00091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 shutdown_connections 2023-10-08T00:30:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b000c5e60 0x7f0b000c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ae8003fd0 0x7f0b000cfa90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0aec067200 0x7f0aec0696b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 --2- 172.21.15.22:0/156645304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0b00158650 0x7f0b000cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 >> 172.21.15.22:0/156645304 conn(0x7f0b00068e20 msgr2=0x7f0b00149a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 shutdown_connections 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.482+0000 7f0b05e97700 1 -- 172.21.15.22:0/156645304 wait complete. 2023-10-08T00:30:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 54 2023-10-08T00:30:40.496 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:30:40.497 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:30:40.497 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:30:40.497 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:40.497 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:30:40.497 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:30:40.497 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:30:40.498 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:40.498 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:30:40.498 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:30:40.498 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:30:40.498 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:40.498 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:30:40.498 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:30:40.499 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:30:40.499 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:30:40.506 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:30:40.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:30:40.508 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:30:40.508 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:30:40.510 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:30:40.510 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:30:40.511 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:30:40.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:30:40.549 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:30:40.549 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:40.550 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:30:40.550 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:40.553 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:30:40.554 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:40.554 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:30:40.554 DEBUG:teuthology.parallel:result is None 2023-10-08T00:30:40.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:30:40.625 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:30:40.625 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:30:40.637 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:30:40.638 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:30:40.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.684+0000 7fd8026de700 1 Processor -- start 2023-10-08T00:30:40.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.684+0000 7fd8026de700 1 -- start start 2023-10-08T00:30:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd8026de700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7fc159420 0x7fd7fc0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd8026de700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0b2980 con 0x7fd7fc15d230 2023-10-08T00:30:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd8026de700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7fc0b11d0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd8026de700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7fc0b14b0 con 0x7fd7fc159420 2023-10-08T00:30:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd801edd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd7fc15d230 0x7fd7fc15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42798/0 (socket says 172.21.15.22:42798) 2023-10-08T00:30:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd801edd700 1 -- 172.21.15.22:0/3630608820 learned_addr learned my addr 172.21.15.22:0/3630608820 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd8016dc700 1 --2- 172.21.15.22:0/3630608820 >> v2:172.21.15.192:3300/0 conn(0x7fd7fc159420 0x7fd7fc0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd7effff700 1 -- 172.21.15.22:0/3630608820 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541986940 0 0) 0x7fd7fc0b2980 con 0x7fd7fc15d230 2023-10-08T00:30:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.685+0000 7fd7effff700 1 -- 172.21.15.22:0/3630608820 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e8003570 con 0x7fd7fc15d230 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8016dc700 1 -- 172.21.15.22:0/3630608820 >> v1:172.21.15.192:6789/0 conn(0x7fd7fc1597f0 legacy=0x7fd7fc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd7effff700 1 -- 172.21.15.22:0/3630608820 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250558430 0 0) 0x7fd7e8003570 con 0x7fd7fc15d230 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8016dc700 1 -- 172.21.15.22:0/3630608820 >> v1:172.21.15.22:6789/0 conn(0x7fd7fc15d230 legacy=0x7fd7fc15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8016dc700 1 -- 172.21.15.22:0/3630608820 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0b1790 con 0x7fd7fc159420 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8016dc700 1 --2- 172.21.15.22:0/3630608820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc159420 0x7fd7fc0b5f40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00098e0 tx=0x7fd7f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dbb13c85333b19b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd7effff700 1 -- 172.21.15.22:0/3630608820 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40017f0 con 0x7fd7fc159420 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd7effff700 1 -- 172.21.15.22:0/3630608820 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f0011420 con 0x7fd7fc159420 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd7effff700 1 -- 172.21.15.22:0/3630608820 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f00117c0 con 0x7fd7fc159420 2023-10-08T00:30:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8026de700 1 -- 172.21.15.22:0/3630608820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc159420 msgr2=0x7fd7fc0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8026de700 1 --2- 172.21.15.22:0/3630608820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc159420 0x7fd7fc0b5f40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00098e0 tx=0x7fd7f00091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8026de700 1 -- 172.21.15.22:0/3630608820 shutdown_connections 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8026de700 1 --2- 172.21.15.22:0/3630608820 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc159420 0x7fd7fc0b5f40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.686+0000 7fd8026de700 1 -- 172.21.15.22:0/3630608820 >> 172.21.15.22:0/3630608820 conn(0x7fd7fc0d0660 msgr2=0x7fd7fc0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.687+0000 7fd8026de700 1 -- 172.21.15.22:0/3630608820 shutdown_connections 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.687+0000 7fd8026de700 1 -- 172.21.15.22:0/3630608820 wait complete. 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.688+0000 7fd8026de700 1 Processor -- start 2023-10-08T00:30:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.688+0000 7fd8026de700 1 -- start start 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.688+0000 7fd8026de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc159420 0x7fd7fc0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 0x7fd7fc14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc15d230 0x7fd7fc1697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc14c710 con 0x7fd7fc1597f0 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc157b60 con 0x7fd7fc15d230 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7fc0c72c0 con 0x7fd7fc159420 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 0x7fd7fc14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 0x7fd7fc14c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43708/0 (socket says 172.21.15.22:43708) 2023-10-08T00:30:40.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 -- 172.21.15.22:0/2384875597 learned_addr learned my addr 172.21.15.22:0/2384875597 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd801edd700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc15d230 0x7fd7fc1697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8016dc700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc159420 0x7fd7fc0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 -- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc159420 msgr2=0x7fd7fc0cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc159420 0x7fd7fc0cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 -- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc15d230 msgr2=0x7fd7fc1697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc15d230 0x7fd7fc1697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 -- 172.21.15.22:0/2384875597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009420 con 0x7fd7fc1597f0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd800edb700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 0x7fd7fc14c1d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c760 tx=0x7fd7f8007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011590 con 0x7fd7fc1597f0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f80116f0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8011ab0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7fc0c75a0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.689+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7fc16a3d0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.690+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7fc0c7730 con 0x7fd7fc1597f0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.691+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fd7f801b3b0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.691+0000 7fd7ed7fa700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e0067200 0x7fd7e00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.691+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd7f8083be0 con 0x7fd7fc1597f0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.691+0000 7fd8016dc700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e0067200 0x7fd7e00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.692+0000 7fd8016dc700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e0067200 0x7fd7e00696b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00030c0 tx=0x7fd7f0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:40.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.695+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7f8050e00 con 0x7fd7fc1597f0 2023-10-08T00:30:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:40.906+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd7fc04c3f0 con 0x7fd7fc1597f0 2023-10-08T00:30:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.676+0000 7fd7ed7fa700 1 -- 172.21.15.22:0/2384875597 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd7f8017070 con 0x7fd7fc1597f0 2023-10-08T00:30:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e0067200 msgr2=0x7fd7e00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e0067200 0x7fd7e00696b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00030c0 tx=0x7fd7f0017000 comp rx=0 tx=0).stop 2023-10-08T00:30:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 msgr2=0x7fd7fc14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:41.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 0x7fd7fc14c1d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c760 tx=0x7fd7f8007f00 comp rx=0 tx=0).stop 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 shutdown_connections 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7fc15d230 0x7fd7fc1697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e0067200 0x7fd7e00696b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7fc159420 0x7fd7fc0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 --2- 172.21.15.22:0/2384875597 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7fc1597f0 0x7fd7fc14c1d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.679+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 >> 172.21.15.22:0/2384875597 conn(0x7fd7fc0d0660 msgr2=0x7fd7fc15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.680+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 shutdown_connections 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.680+0000 7fd8026de700 1 -- 172.21.15.22:0/2384875597 wait complete. 2023-10-08T00:30:41.681 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:30:41.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:30:41.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.822+0000 7fa6534b1700 1 Processor -- start 2023-10-08T00:30:41.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.822+0000 7fa6534b1700 1 -- start start 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa6534b1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa64c159420 0x7fa64c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa6534b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 0x7fa64c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa6534b1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0b2980 con 0x7fa64c1597f0 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa6534b1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c15dbb0 con 0x7fa64c159420 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa6534b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0b11d0 con 0x7fa64c15d230 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa652cb0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 0x7fa64c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.823+0000 7fa6524af700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa64c159420 0x7fa64c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa64c159420 0x7fa64c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:44694/0 (socket says 172.21.15.22:44694) 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa652cb0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 0x7fa64c15d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:46200/0 (socket says 172.21.15.22:46200) 2023-10-08T00:30:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 -- 172.21.15.22:0/872761868 learned_addr learned my addr 172.21.15.22:0/872761868 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 -- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 msgr2=0x7fa64c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 --2- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 0x7fa64c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 -- 172.21.15.22:0/872761868 >> v1:172.21.15.192:6789/0 conn(0x7fa64c1597f0 legacy=0x7fa64c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 -- 172.21.15.22:0/872761868 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0b14b0 con 0x7fa64c159420 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa652cb0700 1 --2- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 0x7fa64c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6524af700 1 --2- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c159420 0x7fa64c0b5f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa644009f20 tx=0x7fa644009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c011662eec54aa71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6514ad700 1 -- 172.21.15.22:0/872761868 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64400e070 con 0x7fa64c159420 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6514ad700 1 -- 172.21.15.22:0/872761868 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64400b9d0 con 0x7fa64c159420 2023-10-08T00:30:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.824+0000 7fa6514ad700 1 -- 172.21.15.22:0/872761868 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6440092e0 con 0x7fa64c159420 2023-10-08T00:30:41.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 -- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c159420 msgr2=0x7fa64c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:41.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 --2- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c159420 0x7fa64c0b5f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa644009f20 tx=0x7fa644009840 comp rx=0 tx=0).stop 2023-10-08T00:30:41.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 -- 172.21.15.22:0/872761868 shutdown_connections 2023-10-08T00:30:41.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 --2- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c15d230 0x7fa64c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 --2- 172.21.15.22:0/872761868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c159420 0x7fa64c0b5f40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 -- 172.21.15.22:0/872761868 >> 172.21.15.22:0/872761868 conn(0x7fa64c0d0660 msgr2=0x7fa64c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 -- 172.21.15.22:0/872761868 shutdown_connections 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.825+0000 7fa6534b1700 1 -- 172.21.15.22:0/872761868 wait complete. 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.826+0000 7fa6534b1700 1 Processor -- start 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.826+0000 7fa6534b1700 1 -- start start 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6534b1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c159420 0x7fa64c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6534b1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c1597f0 0x7fa64c0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6534b1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 0x7fa64c0c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6534b1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0c6120 con 0x7fa64c15d230 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6534b1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0cb230 con 0x7fa64c1597f0 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6534b1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0cb510 con 0x7fa64c159420 2023-10-08T00:30:41.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 0x7fa64c0c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 0x7fa64c0c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43724/0 (socket says 172.21.15.22:43724) 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 -- 172.21.15.22:0/574472965 learned_addr learned my addr 172.21.15.22:0/574472965 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa651cae700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c1597f0 0x7fa64c0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6524af700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c159420 0x7fa64c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 -- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c159420 msgr2=0x7fa64c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c159420 0x7fa64c155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 -- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c1597f0 msgr2=0x7fa64c0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c1597f0 0x7fa64c0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 -- 172.21.15.22:0/574472965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009420 con 0x7fa64c15d230 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa6524af700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c159420 0x7fa64c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.827+0000 7fa652cb0700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 0x7fa64c0c7e10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00ea20 tx=0x7fa63c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:41.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.828+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00c850 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.828+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00c9b0 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.828+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00cd70 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.828+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644009ae0 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.828+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c0cbad0 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.829+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c0cbcc0 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.829+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa63c013680 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.830+0000 7fa64a7fc700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067200 0x7fa6380696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.830+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa63c0847f0 con 0x7fa64c15d230 2023-10-08T00:30:41.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.830+0000 7fa6524af700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067200 0x7fa6380696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:41.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.830+0000 7fa6524af700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067200 0x7fa6380696b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0c5b40 tx=0x7fa644018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:41.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:41.834+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa63c051a20 con 0x7fa64c15d230 2023-10-08T00:30:42.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.104+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa64c04c3c0 con 0x7fa64c15d230 2023-10-08T00:30:42.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.104+0000 7fa64a7fc700 1 -- 172.21.15.22:0/574472965 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa63c055040 con 0x7fa64c15d230 2023-10-08T00:30:42.105 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:42.105 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:42.105 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:30:42.105 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.105 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:30:42.106 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.107 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:42.108 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.109 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:30:42.110 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.111 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.112 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.112 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.112 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:30:42.112 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:30:42.112 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.113 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.114 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:30:42.116 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:30:42.117 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.118 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:30:42.119 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:30:42.121 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:42.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067200 msgr2=0x7fa6380696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067200 0x7fa6380696b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0c5b40 tx=0x7fa644018000 comp rx=0 tx=0).stop 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 msgr2=0x7fa64c0c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 0x7fa64c0c7e10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00ea20 tx=0x7fa63c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 shutdown_connections 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa64c15d230 0x7fa64c0c7e10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067200 0x7fa6380696b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa64c159420 0x7fa64c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 --2- 172.21.15.22:0/574472965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa64c1597f0 0x7fa64c0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 >> 172.21.15.22:0/574472965 conn(0x7fa64c0d0660 msgr2=0x7fa64c156120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 shutdown_connections 2023-10-08T00:30:42.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.106+0000 7fa6534b1700 1 -- 172.21.15.22:0/574472965 wait complete. 2023-10-08T00:30:42.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.245+0000 7f2121639700 1 Processor -- start 2023-10-08T00:30:42.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.245+0000 7f2121639700 1 -- start start 2023-10-08T00:30:42.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f2121639700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 0x7f211c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f2121639700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f2121639700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0b11d0 con 0x7f211c15d230 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f2121639700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c0b14b0 con 0x7f211c159420 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f2121639700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0b1790 con 0x7f211c1597f0 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f211b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f211bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 0x7f211c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f211bfff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 0x7f211c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:44714/0 (socket says 172.21.15.22:44714) 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f211b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c0b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:46206/0 (socket says 172.21.15.22:46206) 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.246+0000 7f211bfff700 1 -- 172.21.15.22:0/130671535 learned_addr learned my addr 172.21.15.22:0/130671535 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211b7fe700 1 -- 172.21.15.22:0/130671535 >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 msgr2=0x7f211c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211b7fe700 1 --2- 172.21.15.22:0/130671535 >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 0x7f211c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211b7fe700 1 -- 172.21.15.22:0/130671535 >> v1:172.21.15.192:6789/0 conn(0x7f211c15d230 legacy=0x7f211c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211b7fe700 1 -- 172.21.15.22:0/130671535 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0b1a70 con 0x7f211c1597f0 2023-10-08T00:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211bfff700 1 --2- 172.21.15.22:0/130671535 >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 0x7f211c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211b7fe700 1 --2- 172.21.15.22:0/130671535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c0b2270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f210c0098e0 tx=0x7f210c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e488e2f21bc2b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211affd700 1 -- 172.21.15.22:0/130671535 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c00b640 con 0x7f211c1597f0 2023-10-08T00:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211affd700 1 -- 172.21.15.22:0/130671535 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00b7a0 con 0x7f211c1597f0 2023-10-08T00:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.247+0000 7f211affd700 1 -- 172.21.15.22:0/130671535 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c00bb40 con 0x7f211c1597f0 2023-10-08T00:30:42.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 -- 172.21.15.22:0/130671535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 msgr2=0x7f211c0b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 --2- 172.21.15.22:0/130671535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c0b2270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f210c0098e0 tx=0x7f210c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 -- 172.21.15.22:0/130671535 shutdown_connections 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 --2- 172.21.15.22:0/130671535 >> v2:172.21.15.192:3300/0 conn(0x7f211c159420 0x7f211c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 --2- 172.21.15.22:0/130671535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c0b2270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 -- 172.21.15.22:0/130671535 >> 172.21.15.22:0/130671535 conn(0x7f211c0d0660 msgr2=0x7f211c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 -- 172.21.15.22:0/130671535 shutdown_connections 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.248+0000 7f2121639700 1 -- 172.21.15.22:0/130671535 wait complete. 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.249+0000 7f2121639700 1 Processor -- start 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.249+0000 7f2121639700 1 -- start start 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 0x7f211c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c16d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211c15d230 0x7f211c146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c140ba0 con 0x7f211c159420 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15cec0 con 0x7f211c15d230 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15b2f0 con 0x7f211c1597f0 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 0x7f211c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 0x7f211c15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43730/0 (socket says 172.21.15.22:43730) 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 -- 172.21.15.22:0/1561048934 learned_addr learned my addr 172.21.15.22:0/1561048934 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 -- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 msgr2=0x7f211c16d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c16d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 -- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211c15d230 msgr2=0x7f211c146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2120e38700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211c15d230 0x7f211c146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211c15d230 0x7f211c146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 -- 172.21.15.22:0/1561048934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21040094f0 con 0x7f211c159420 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f211bfff700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 0x7f211c15c980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f210400ec50 tx=0x7f2104009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400c9d0 con 0x7f211c159420 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400cb30 con 0x7f211c159420 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c009420 con 0x7f211c159420 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104013470 con 0x7f211c159420 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.250+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c15aca0 con 0x7f211c159420 2023-10-08T00:30:42.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.251+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c15b5d0 con 0x7f211c159420 2023-10-08T00:30:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.252+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f2104013860 con 0x7f211c159420 2023-10-08T00:30:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.252+0000 7f2113fff700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20fc067200 0x7f20fc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.252+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2104084ea0 con 0x7f211c159420 2023-10-08T00:30:42.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.252+0000 7f211b7fe700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20fc067200 0x7f20fc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.253+0000 7f211b7fe700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20fc067200 0x7f20fc0696b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f211c0688c0 tx=0x7f210c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.257+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2104052030 con 0x7f211c159420 2023-10-08T00:30:42.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.452+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f211c04c3c0 con 0x7f211c159420 2023-10-08T00:30:42.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.452+0000 7f2113fff700 1 -- 172.21.15.22:0/1561048934 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f2104055650 con 0x7f211c159420 2023-10-08T00:30:42.453 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:42.453 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":86,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:41.674647+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20fc067200 msgr2=0x7f20fc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20fc067200 0x7f20fc0696b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f211c0688c0 tx=0x7f210c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 msgr2=0x7f211c15c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 0x7f211c15c980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f210400ec50 tx=0x7f2104009250 comp rx=0 tx=0).stop 2023-10-08T00:30:42.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 shutdown_connections 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f211c15d230 0x7f211c146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f211c159420 0x7f211c15c980 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20fc067200 0x7f20fc0696b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 --2- 172.21.15.22:0/1561048934 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f211c1597f0 0x7f211c16d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 >> 172.21.15.22:0/1561048934 conn(0x7f211c0d0660 msgr2=0x7f211c0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.454+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 shutdown_connections 2023-10-08T00:30:42.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.455+0000 7f2121639700 1 -- 172.21.15.22:0/1561048934 wait complete. 2023-10-08T00:30:42.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:30:42.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:30:42.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.589+0000 7f8d9686d700 1 Processor -- start 2023-10-08T00:30:42.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.589+0000 7f8d9686d700 1 -- start start 2023-10-08T00:30:42.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9686d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d900b4e70 0x7f8d900ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9686d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d900b16d0 0x7f8d900b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9686d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d900b2080 con 0x7f8d9015d240 2023-10-08T00:30:42.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9686d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900cfb00 con 0x7f8d900b4e70 2023-10-08T00:30:42.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9686d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d900b5c40 con 0x7f8d900b16d0 2023-10-08T00:30:42.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d900b4e70 0x7f8d900ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d900b4e70 0x7f8d900ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43746/0 (socket says 172.21.15.22:43746) 2023-10-08T00:30:42.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 -- 172.21.15.22:0/2277826043 learned_addr learned my addr 172.21.15.22:0/2277826043 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9506a700 1 --2- 172.21.15.22:0/2277826043 >> v2:172.21.15.192:3300/0 conn(0x7f8d900b16d0 0x7f8d900b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 -- 172.21.15.22:0/2277826043 >> v2:172.21.15.192:3300/0 conn(0x7f8d900b16d0 msgr2=0x7f8d900b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 --2- 172.21.15.22:0/2277826043 >> v2:172.21.15.192:3300/0 conn(0x7f8d900b16d0 0x7f8d900b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 -- 172.21.15.22:0/2277826043 >> v1:172.21.15.192:6789/0 conn(0x7f8d9015d240 legacy=0x7f8d9015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 -- 172.21.15.22:0/2277826043 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d900b5f20 con 0x7f8d900b4e70 2023-10-08T00:30:42.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.590+0000 7f8d9586b700 1 --2- 172.21.15.22:0/2277826043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d900b4e70 0x7f8d900ccff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8d90089830 tx=0x7f8d80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2795bc0510b1d78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d94869700 1 -- 172.21.15.22:0/2277826043 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8000e070 con 0x7f8d900b4e70 2023-10-08T00:30:42.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d94869700 1 -- 172.21.15.22:0/2277826043 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8000ba10 con 0x7f8d900b4e70 2023-10-08T00:30:42.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d94869700 1 -- 172.21.15.22:0/2277826043 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800092e0 con 0x7f8d900b4e70 2023-10-08T00:30:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 -- 172.21.15.22:0/2277826043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d900b4e70 msgr2=0x7f8d900ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 --2- 172.21.15.22:0/2277826043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d900b4e70 0x7f8d900ccff0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8d90089830 tx=0x7f8d80009840 comp rx=0 tx=0).stop 2023-10-08T00:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 -- 172.21.15.22:0/2277826043 shutdown_connections 2023-10-08T00:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 --2- 172.21.15.22:0/2277826043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d900b4e70 0x7f8d900ccff0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 --2- 172.21.15.22:0/2277826043 >> v2:172.21.15.192:3300/0 conn(0x7f8d900b16d0 0x7f8d900b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 -- 172.21.15.22:0/2277826043 >> 172.21.15.22:0/2277826043 conn(0x7f8d900d10c0 msgr2=0x7f8d900affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 -- 172.21.15.22:0/2277826043 shutdown_connections 2023-10-08T00:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.591+0000 7f8d9686d700 1 -- 172.21.15.22:0/2277826043 wait complete. 2023-10-08T00:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.592+0000 7f8d9686d700 1 Processor -- start 2023-10-08T00:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.592+0000 7f8d9686d700 1 -- start start 2023-10-08T00:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9686d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d900b16d0 0x7f8d900c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9686d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d900b4e70 0x7f8d9016df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9686d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 0x7f8d900ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9686d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d90158830 con 0x7f8d9015d240 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9686d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d900c94c0 con 0x7f8d900b16d0 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9686d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9016e490 con 0x7f8d900b4e70 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 0x7f8d900ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 0x7f8d900ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43758/0 (socket says 172.21.15.22:43758) 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 -- 172.21.15.22:0/3369830035 learned_addr learned my addr 172.21.15.22:0/3369830035 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9586b700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d900b16d0 0x7f8d900c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9506a700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d900b4e70 0x7f8d9016df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 -- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d900b4e70 msgr2=0x7f8d9016df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d900b4e70 0x7f8d9016df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 -- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d900b16d0 msgr2=0x7f8d900c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.593+0000 7f8d9606c700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d900b16d0 0x7f8d900c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d9606c700 1 -- 172.21.15.22:0/3369830035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d80009ae0 con 0x7f8d9015d240 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d9506a700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d900b4e70 0x7f8d9016df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d9606c700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 0x7f8d900ca3b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800b4e0 tx=0x7f8d88006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800f510 con 0x7f8d9015d240 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800f670 con 0x7f8d9015d240 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d900c88b0 con 0x7f8d9015d240 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800fa30 con 0x7f8d9015d240 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.594+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d900c8e70 con 0x7f8d9015d240 2023-10-08T00:30:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.595+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d900c9630 con 0x7f8d9015d240 2023-10-08T00:30:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.595+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f8d8801a400 con 0x7f8d9015d240 2023-10-08T00:30:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.596+0000 7f8d8dffb700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d7c067200 0x7f8d7c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.596+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8d88083ff0 con 0x7f8d9015d240 2023-10-08T00:30:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.596+0000 7f8d9586b700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d7c067200 0x7f8d7c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.597+0000 7f8d9586b700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d7c067200 0x7f8d7c0696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009880 tx=0x7f8d80017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.600+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d880512e0 con 0x7f8d9015d240 2023-10-08T00:30:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.795+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d9004bb80 con 0x7f8d9015d240 2023-10-08T00:30:42.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.795+0000 7f8d8dffb700 1 -- 172.21.15.22:0/3369830035 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d88054900 con 0x7f8d9015d240 2023-10-08T00:30:42.796 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:30:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d7c067200 msgr2=0x7f8d7c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d7c067200 0x7f8d7c0696b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009880 tx=0x7f8d80017000 comp rx=0 tx=0).stop 2023-10-08T00:30:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 msgr2=0x7f8d900ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 0x7f8d900ca3b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800b4e0 tx=0x7f8d88006f90 comp rx=0 tx=0).stop 2023-10-08T00:30:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 shutdown_connections 2023-10-08T00:30:42.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d9015d240 0x7f8d900ca3b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d900b16d0 0x7f8d900c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8d7c067200 0x7f8d7c0696b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 --2- 172.21.15.22:0/3369830035 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8d900b4e70 0x7f8d9016df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 >> 172.21.15.22:0/3369830035 conn(0x7f8d900d10c0 msgr2=0x7f8d900b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 shutdown_connections 2023-10-08T00:30:42.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.797+0000 7f8d9686d700 1 -- 172.21.15.22:0/3369830035 wait complete. 2023-10-08T00:30:42.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:30:42.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.930+0000 7f952f59e700 1 Processor -- start 2023-10-08T00:30:42.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.930+0000 7f952f59e700 1 -- start start 2023-10-08T00:30:42.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952f59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f953015d230 0x7f953015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952f59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95300b2980 con 0x7f9530159420 2023-10-08T00:30:42.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952f59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953015db70 con 0x7f95301597f0 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952f59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300b11d0 con 0x7f953015d230 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f953015d230 0x7f953015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f953015d230 0x7f953015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43764/0 (socket says 172.21.15.22:43764) 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952ed9d700 1 -- 172.21.15.22:0/3323922589 learned_addr learned my addr 172.21.15.22:0/3323922589 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.931+0000 7f952e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9530159420 0x7f95300b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42812/0 (socket says 172.21.15.22:42812) 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952ed9d700 1 -- 172.21.15.22:0/3323922589 >> v1:172.21.15.192:6789/0 conn(0x7f95301597f0 legacy=0x7f95300b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952ed9d700 1 -- 172.21.15.22:0/3323922589 >> v1:172.21.15.22:6789/0 conn(0x7f9530159420 legacy=0x7f95300b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952ed9d700 1 -- 172.21.15.22:0/3323922589 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300b14b0 con 0x7f953015d230 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952d59a700 1 -- 172.21.15.22:0/3323922589 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191085772 0 0) 0x7f95300b2980 con 0x7f9530159420 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952ed9d700 1 --2- 172.21.15.22:0/3323922589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953015d230 0x7f953015d630 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f95280099b0 tx=0x7f9528009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a07fffc3e4ea141 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952d59a700 1 -- 172.21.15.22:0/3323922589 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800b820 con 0x7f953015d230 2023-10-08T00:30:42.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952d59a700 1 -- 172.21.15.22:0/3323922589 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800b980 con 0x7f953015d230 2023-10-08T00:30:42.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952d59a700 1 -- 172.21.15.22:0/3323922589 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800bd20 con 0x7f953015d230 2023-10-08T00:30:42.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952f59e700 1 -- 172.21.15.22:0/3323922589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953015d230 msgr2=0x7f953015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952f59e700 1 --2- 172.21.15.22:0/3323922589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953015d230 0x7f953015d630 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f95280099b0 tx=0x7f9528009250 comp rx=0 tx=0).stop 2023-10-08T00:30:42.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952f59e700 1 -- 172.21.15.22:0/3323922589 shutdown_connections 2023-10-08T00:30:42.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952f59e700 1 --2- 172.21.15.22:0/3323922589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953015d230 0x7f953015d630 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.932+0000 7f952f59e700 1 -- 172.21.15.22:0/3323922589 >> 172.21.15.22:0/3323922589 conn(0x7f95300d0660 msgr2=0x7f95300d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.933+0000 7f952f59e700 1 -- 172.21.15.22:0/3323922589 shutdown_connections 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.933+0000 7f952f59e700 1 -- 172.21.15.22:0/3323922589 wait complete. 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 Processor -- start 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 -- start start 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 0x7f9530154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95301597f0 0x7f9530159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953015d230 0x7f9530169770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953014f840 con 0x7f9530159420 2023-10-08T00:30:42.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953015f1c0 con 0x7f953015d230 2023-10-08T00:30:42.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953015a1e0 con 0x7f95301597f0 2023-10-08T00:30:42.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.934+0000 7f952e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 0x7f9530154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 0x7f9530154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43780/0 (socket says 172.21.15.22:43780) 2023-10-08T00:30:42.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 -- 172.21.15.22:0/3319747827 learned_addr learned my addr 172.21.15.22:0/3319747827 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:42.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952ed9d700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953015d230 0x7f9530169770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952dd9b700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95301597f0 0x7f9530159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 -- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95301597f0 msgr2=0x7f9530159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95301597f0 0x7f9530159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 -- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953015d230 msgr2=0x7f9530169770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953015d230 0x7f9530169770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 -- 172.21.15.22:0/3319747827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280094f0 con 0x7f9530159420 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952e59c700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 0x7f9530154d20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f952000cdd0 tx=0x7f9520001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520005df0 con 0x7f9530159420 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000a8b0 con 0x7f9530159420 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9530155420 con 0x7f9530159420 2023-10-08T00:30:42.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000ac70 con 0x7f9530159420 2023-10-08T00:30:42.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.935+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953015eb70 con 0x7f9530159420 2023-10-08T00:30:42.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.936+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f953004c3c0 con 0x7f9530159420 2023-10-08T00:30:42.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.937+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9520007300 con 0x7f9530159420 2023-10-08T00:30:42.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.937+0000 7f95267fc700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9510067200 0x7f95100696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:42.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.937+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9520084760 con 0x7f9530159420 2023-10-08T00:30:42.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.937+0000 7f952dd9b700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9510067200 0x7f95100696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:42.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.938+0000 7f952dd9b700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9510067200 0x7f95100696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9530152cd0 tx=0x7f9518007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:42.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:42.941+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9520051a50 con 0x7f9530159420 2023-10-08T00:30:43.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.136+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f95300b1790 con 0x7f9530159420 2023-10-08T00:30:43.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.136+0000 7f95267fc700 1 -- 172.21.15.22:0/3319747827 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9520055070 con 0x7f9530159420 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:43.137 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:30:43.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9510067200 msgr2=0x7f95100696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9510067200 0x7f95100696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9530152cd0 tx=0x7f9518007ea0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 msgr2=0x7f9530154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 0x7f9530154d20 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f952000cdd0 tx=0x7f9520001bc0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 shutdown_connections 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f953015d230 0x7f9530169770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530159420 0x7f9530154d20 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9510067200 0x7f95100696b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 --2- 172.21.15.22:0/3319747827 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f95301597f0 0x7f9530159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 >> 172.21.15.22:0/3319747827 conn(0x7f95300d0660 msgr2=0x7f95300cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 shutdown_connections 2023-10-08T00:30:43.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.138+0000 7f952f59e700 1 -- 172.21.15.22:0/3319747827 wait complete. 2023-10-08T00:30:43.150 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:30:43.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:30:43.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.273+0000 7f4906dc5700 1 Processor -- start 2023-10-08T00:30:43.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.273+0000 7f4906dc5700 1 -- start start 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f4906dc5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b0790 0x7f49000cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f4906dc5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49000cfa00 con 0x7f49001591e0 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f4906dc5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49000cb580 con 0x7f49000b03c0 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f4906dc5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49000cf160 con 0x7f49000b0790 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f49065c4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f49001591e0 0x7f4900159620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42826/0 (socket says 172.21.15.22:42826) 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f49065c4700 1 -- 172.21.15.22:0/1110665953 learned_addr learned my addr 172.21.15.22:0/1110665953 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f49055c2700 1 --2- 172.21.15.22:0/1110665953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b0790 0x7f49000cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.274+0000 7f4904dc1700 1 -- 172.21.15.22:0/1110665953 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903042834 0 0) 0x7f49000cfa00 con 0x7f49001591e0 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f4904dc1700 1 -- 172.21.15.22:0/1110665953 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e8003570 con 0x7f49001591e0 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f4904dc1700 1 -- 172.21.15.22:0/1110665953 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845437957 0 0) 0x7f49000cb580 con 0x7f49000b03c0 2023-10-08T00:30:43.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f49055c2700 1 -- 172.21.15.22:0/1110665953 >> v1:172.21.15.192:6789/0 conn(0x7f49000b03c0 legacy=0x7f49000b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f49055c2700 1 -- 172.21.15.22:0/1110665953 >> v1:172.21.15.22:6789/0 conn(0x7f49001591e0 legacy=0x7f4900159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f49055c2700 1 -- 172.21.15.22:0/1110665953 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49000cf440 con 0x7f49000b0790 2023-10-08T00:30:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f49055c2700 1 --2- 172.21.15.22:0/1110665953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b0790 0x7f49000cea70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009910 tx=0x7f48f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d27f2d126cd6e741 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f4904dc1700 1 -- 172.21.15.22:0/1110665953 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400b680 con 0x7f49000b0790 2023-10-08T00:30:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f4904dc1700 1 -- 172.21.15.22:0/1110665953 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f400b7e0 con 0x7f49000b0790 2023-10-08T00:30:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.275+0000 7f4904dc1700 1 -- 172.21.15.22:0/1110665953 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400bb60 con 0x7f49000b0790 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 -- 172.21.15.22:0/1110665953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b0790 msgr2=0x7f49000cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 --2- 172.21.15.22:0/1110665953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b0790 0x7f49000cea70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009910 tx=0x7f48f40091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 -- 172.21.15.22:0/1110665953 shutdown_connections 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 --2- 172.21.15.22:0/1110665953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b0790 0x7f49000cea70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 -- 172.21.15.22:0/1110665953 >> 172.21.15.22:0/1110665953 conn(0x7f4900063230 msgr2=0x7f4900063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 -- 172.21.15.22:0/1110665953 shutdown_connections 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.276+0000 7f4906dc5700 1 -- 172.21.15.22:0/1110665953 wait complete. 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.277+0000 7f4906dc5700 1 Processor -- start 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.277+0000 7f4906dc5700 1 -- start start 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4906dc5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b03c0 0x7f490015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4906dc5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 0x7f49000c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4906dc5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49001591e0 0x7f49000c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4906dc5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49000c9110 con 0x7f49000b0790 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4906dc5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49000c4500 con 0x7f49001591e0 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4906dc5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49000c8b50 con 0x7f49000b03c0 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 0x7f49000c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 0x7f49000c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43792/0 (socket says 172.21.15.22:43792) 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 -- 172.21.15.22:0/3675558738 learned_addr learned my addr 172.21.15.22:0/3675558738 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49065c4700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49001591e0 0x7f49000c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f4905dc3700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b03c0 0x7f490015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 -- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b03c0 msgr2=0x7f490015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b03c0 0x7f490015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 -- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49001591e0 msgr2=0x7f49000c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49001591e0 0x7f49000c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 -- 172.21.15.22:0/3675558738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f4009420 con 0x7f49000b0790 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.278+0000 7f49055c2700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 0x7f49000c8020 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f48f40093f0 tx=0x7f48f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.279+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f400bb60 con 0x7f49000b0790 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.279+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f4011420 con 0x7f49000b0790 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.279+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f40117e0 con 0x7f49000b0790 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.279+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49000c8e30 con 0x7f49000b0790 2023-10-08T00:30:43.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.279+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4900157a90 con 0x7f49000b0790 2023-10-08T00:30:43.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.280+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49000c3ff0 con 0x7f49000b0790 2023-10-08T00:30:43.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.280+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f48f4011b90 con 0x7f49000b0790 2023-10-08T00:30:43.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.281+0000 7f48fdffb700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48ec067200 0x7f48ec0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.281+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f48f4085c30 con 0x7f49000b0790 2023-10-08T00:30:43.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.281+0000 7f4905dc3700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48ec067200 0x7f48ec0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.281+0000 7f4905dc3700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48ec067200 0x7f48ec0696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f48f00011e0 tx=0x7f48f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:43.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.285+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49000c3ff0 con 0x7f49000b0790 2023-10-08T00:30:43.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.479+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f49000c3ff0 con 0x7f49000b0790 2023-10-08T00:30:43.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.685+0000 7f48fdffb700 1 -- 172.21.15.22:0/3675558738 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) v1 ==== 138+0+0 (secure 0 0 0) 0x7f49000c3ff0 con 0x7f49000b0790 2023-10-08T00:30:43.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.689+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48ec067200 msgr2=0x7f48ec0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.689+0000 7f4906dc5700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48ec067200 0x7f48ec0696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f48f00011e0 tx=0x7f48f0009040 comp rx=0 tx=0).stop 2023-10-08T00:30:43.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.689+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 msgr2=0x7f49000c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.689+0000 7f4906dc5700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 0x7f49000c8020 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f48f40093f0 tx=0x7f48f4017000 comp rx=0 tx=0).stop 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 shutdown_connections 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49001591e0 0x7f49000c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f48ec067200 0x7f48ec0696b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49000b03c0 0x7f490015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 --2- 172.21.15.22:0/3675558738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49000b0790 0x7f49000c8020 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 >> 172.21.15.22:0/3675558738 conn(0x7f4900063230 msgr2=0x7f49000ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 shutdown_connections 2023-10-08T00:30:43.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.690+0000 7f4906dc5700 1 -- 172.21.15.22:0/3675558738 wait complete. 2023-10-08T00:30:43.692 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:30:43.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:30:43.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.833+0000 7ff9bf59e700 1 Processor -- start 2023-10-08T00:30:43.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.833+0000 7ff9bf59e700 1 -- start start 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9c00cf480 0x7ff9c015d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bf59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c00b10f0 con 0x7ff9c015d760 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bf59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c015db80 con 0x7ff9c01595d0 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c015e000 con 0x7ff9c00cf480 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9c015d760 0x7ff9c00b1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42834/0 (socket says 172.21.15.22:42834) 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bed9d700 1 -- 172.21.15.22:0/1489680196 learned_addr learned my addr 172.21.15.22:0/1489680196 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:43.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bdd9b700 1 --2- 172.21.15.22:0/1489680196 >> v2:172.21.15.192:3300/0 conn(0x7ff9c00cf480 0x7ff9c015d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887100491 0 0) 0x7ff9c00b10f0 con 0x7ff9c015d760 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ac003570 con 0x7ff9c015d760 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1265325292 0 0) 0x7ff9ac003570 con 0x7ff9c015d760 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 >> v2:172.21.15.192:3300/0 conn(0x7ff9c00cf480 msgr2=0x7ff9c015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 --2- 172.21.15.22:0/1489680196 >> v2:172.21.15.192:3300/0 conn(0x7ff9c00cf480 0x7ff9c015d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 >> v1:172.21.15.192:6789/0 conn(0x7ff9c01595d0 legacy=0x7ff9c00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00cf990 con 0x7ff9c015d760 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7ff9b8001470 con 0x7ff9c015d760 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 >> v1:172.21.15.22:6789/0 conn(0x7ff9c015d760 legacy=0x7ff9c00b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9ac003a60 0x7ff9ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9ac004810 0x7ff9ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0051c0 0x7ff9ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c015e000 con 0x7ff9ac004810 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac00c0d0 con 0x7ff9ac0051c0 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.834+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac00c290 con 0x7ff9ac003a60 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9ac004810 0x7ff9ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9be59c700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9ac003a60 0x7ff9ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bed9d700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0051c0 0x7ff9ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 -- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9ac003a60 msgr2=0x7ff9ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9ac003a60 0x7ff9ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 -- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0051c0 msgr2=0x7ff9ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0051c0 0x7ff9ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bed9d700 1 -- 172.21.15.22:0/1489680196 reap_dead start 2023-10-08T00:30:43.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 -- 172.21.15.22:0/1489680196 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac003570 con 0x7ff9ac004810 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bdd9b700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9ac004810 0x7ff9ac004c80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00cf8c0 tx=0x7ff9a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6908482299503574 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800e710 con 0x7ff9ac004810 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800e870 con 0x7ff9ac004810 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.835+0000 7ff9bd59a700 1 -- 172.21.15.22:0/1489680196 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800ec30 con 0x7ff9ac004810 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 -- 172.21.15.22:0/1489680196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9ac004810 msgr2=0x7ff9ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9ac004810 0x7ff9ac004c80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00cf8c0 tx=0x7ff9a80091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 -- 172.21.15.22:0/1489680196 shutdown_connections 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/1489680196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9ac004810 0x7ff9ac004c80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 -- 172.21.15.22:0/1489680196 >> 172.21.15.22:0/1489680196 conn(0x7ff9c00d05f0 msgr2=0x7ff9c00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 -- 172.21.15.22:0/1489680196 shutdown_connections 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.836+0000 7ff9bf59e700 1 -- 172.21.15.22:0/1489680196 wait complete. 2023-10-08T00:30:43.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.837+0000 7ff9bf59e700 1 Processor -- start 2023-10-08T00:30:43.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.837+0000 7ff9bf59e700 1 -- start start 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac004810 0x7ff9c0156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9c01523d0 0x7ff9c015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 0x7ff9c016d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c015ced0 con 0x7ff9c015ca60 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0156ed0 con 0x7ff9ac004810 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0154d60 con 0x7ff9c01523d0 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 0x7ff9c016d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 0x7ff9c016d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43810/0 (socket says 172.21.15.22:43810) 2023-10-08T00:30:43.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 -- 172.21.15.22:0/4198179367 learned_addr learned my addr 172.21.15.22:0/4198179367 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9be59c700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac004810 0x7ff9c0156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bdd9b700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9c01523d0 0x7ff9c015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 -- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9c01523d0 msgr2=0x7ff9c015c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9c01523d0 0x7ff9c015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 -- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac004810 msgr2=0x7ff9c0156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac004810 0x7ff9c0156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 -- 172.21.15.22:0/4198179367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0155040 con 0x7ff9c015ca60 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bed9d700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 0x7ff9c016d2e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00899c0 tx=0x7ff9c00b1060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8018030 con 0x7ff9c015ca60 2023-10-08T00:30:43.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800f8a0 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800fc80 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c0155320 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.838+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c01558e0 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.839+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c0157210 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.840+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ff9b801b070 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.840+0000 7ff9b67fc700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9a0067200 0x7ff9a00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.840+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ff9b8019070 con 0x7ff9c015ca60 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.840+0000 7ff9be59c700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9a0067200 0x7ff9a00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:43.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.841+0000 7ff9be59c700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9a0067200 0x7ff9a00696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0001900 tx=0x7ff9b0001a70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:43.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:43.845+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9b80517b0 con 0x7ff9c015ca60 2023-10-08T00:30:44.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.037+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff9c004c3c0 con 0x7ff9c015ca60 2023-10-08T00:30:44.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.692+0000 7ff9b67fc700 1 -- 172.21.15.22:0/4198179367 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff9b8054dd0 con 0x7ff9c015ca60 2023-10-08T00:30:44.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9a0067200 msgr2=0x7ff9a00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9a0067200 0x7ff9a00696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0001900 tx=0x7ff9b0001a70 comp rx=0 tx=0).stop 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 msgr2=0x7ff9c016d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 0x7ff9c016d2e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00899c0 tx=0x7ff9c00b1060 comp rx=0 tx=0).stop 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 shutdown_connections 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c015ca60 0x7ff9c016d2e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac004810 0x7ff9c0156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9a0067200 0x7ff9a00696b0 secure :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0001900 tx=0x7ff9b0001a70 comp rx=0 tx=0).stop 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 --2- 172.21.15.22:0/4198179367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9c01523d0 0x7ff9c015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.696+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 >> 172.21.15.22:0/4198179367 conn(0x7ff9c00d05f0 msgr2=0x7ff9c0152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:44.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.702+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 shutdown_connections 2023-10-08T00:30:44.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.704+0000 7ff9bf59e700 1 -- 172.21.15.22:0/4198179367 wait complete. 2023-10-08T00:30:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:30:44.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:30:44.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.851+0000 7fc2e2778700 1 Processor -- start 2023-10-08T00:30:44.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.851+0000 7fc2e2778700 1 -- start start 2023-10-08T00:30:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e2778700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc2dc159a70 0x7fc2dc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e2778700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc2dc06bfa0 0x7fc2dc0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e2778700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc068810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e2778700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc068d50 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e2778700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc0ca920 con 0x7fc2dc159a70 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e2778700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc06af00 con 0x7fc2dc068390 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e0f75700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc2dc06bfa0 0x7fc2dc0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e0f75700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc2dc06bfa0 0x7fc2dc0c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43826/0 (socket says 172.21.15.22:43826) 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2183973629 learned_addr learned my addr 172.21.15.22:0/2183973629 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e1776700 1 --2- 172.21.15.22:0/2183973629 >> v2:172.21.15.192:3300/0 conn(0x7fc2dc159a70 0x7fc2dc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.852+0000 7fc2e1f77700 1 --2- 172.21.15.22:0/2183973629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2183973629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 msgr2=0x7fc2dc068810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e0f75700 1 --2- 172.21.15.22:0/2183973629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc068810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2183973629 >> v2:172.21.15.192:3300/0 conn(0x7fc2dc159a70 msgr2=0x7fc2dc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e0f75700 1 --2- 172.21.15.22:0/2183973629 >> v2:172.21.15.192:3300/0 conn(0x7fc2dc159a70 0x7fc2dc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2183973629 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc06b1e0 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e0f75700 1 --2- 172.21.15.22:0/2183973629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc0c8830 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0640b0 tx=0x7fc2d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcd8065521bbe12 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2dbfff700 1 -- 172.21.15.22:0/2183973629 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0005c10 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2dbfff700 1 -- 172.21.15.22:0/2183973629 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0005d70 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2dbfff700 1 -- 172.21.15.22:0/2183973629 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0006260 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e2778700 1 -- 172.21.15.22:0/2183973629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 msgr2=0x7fc2dc0c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.853+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2183973629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc0c8830 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0640b0 tx=0x7fc2d0009220 comp rx=0 tx=0).stop 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 -- 172.21.15.22:0/2183973629 shutdown_connections 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2183973629 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc068810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2183973629 >> v2:172.21.15.192:3300/0 conn(0x7fc2dc159a70 0x7fc2dc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2183973629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc0c8830 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 -- 172.21.15.22:0/2183973629 >> 172.21.15.22:0/2183973629 conn(0x7fc2dc0cddc0 msgr2=0x7fc2dc0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 -- 172.21.15.22:0/2183973629 shutdown_connections 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.854+0000 7fc2e2778700 1 -- 172.21.15.22:0/2183973629 wait complete. 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.855+0000 7fc2e2778700 1 Processor -- start 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.855+0000 7fc2e2778700 1 -- start start 2023-10-08T00:30:44.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2dc159a70 0x7fc2dc157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0b1260 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0b0dd0 con 0x7fc2dc159a70 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0b01c0 con 0x7fc2dc068390 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc1578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43842/0 (socket says 172.21.15.22:43842) 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2206596256 learned_addr learned my addr 172.21.15.22:0/2206596256 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:44.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e1776700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e1f77700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2dc159a70 0x7fc2dc157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 msgr2=0x7fc2dc15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc15d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2dc159a70 msgr2=0x7fc2dc157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2dc159a70 0x7fc2dc157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 -- 172.21.15.22:0/2206596256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0009480 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e1776700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e1f77700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2dc159a70 0x7fc2dc157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:44.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e0f75700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc1578f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009f50 tx=0x7fc2d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0011a10 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0011b70 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.856+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2dc0b04a0 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.857+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d001b430 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.857+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc0b0a60 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.858+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc0b0f40 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.858+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fc2d001b860 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.858+0000 7fc2d97fa700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc2c8067200 0x7fc2c80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:44.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.859+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fc2d0086150 con 0x7fc2dc06bfa0 2023-10-08T00:30:44.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.859+0000 7fc2e1776700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc2c8067200 0x7fc2c80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:44.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.859+0000 7fc2e1776700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc2c8067200 0x7fc2c80696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc007620 tx=0x7fc2cc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:44.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:44.863+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2d00530d0 con 0x7fc2dc06bfa0 2023-10-08T00:30:45.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.101+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc2dc063d10 con 0x7fc2dc06bfa0 2023-10-08T00:30:45.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.695+0000 7fc2d97fa700 1 -- 172.21.15.22:0/2206596256 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc2d00566f0 con 0x7fc2dc06bfa0 2023-10-08T00:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.701+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc2c8067200 msgr2=0x7fc2c80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.701+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc2c8067200 0x7fc2c80696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc007620 tx=0x7fc2cc00b040 comp rx=0 tx=0).stop 2023-10-08T00:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.701+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 msgr2=0x7fc2dc1578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.701+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc1578f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009f50 tx=0x7fc2d0016000 comp rx=0 tx=0).stop 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.701+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 shutdown_connections 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.702+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2dc159a70 0x7fc2dc157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.702+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc2c8067200 0x7fc2c80696b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.702+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc2dc068390 0x7fc2dc15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.702+0000 7fc2e2778700 1 --2- 172.21.15.22:0/2206596256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2dc06bfa0 0x7fc2dc1578f0 secure :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0009f50 tx=0x7fc2d0016000 comp rx=0 tx=0).stop 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.702+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 >> 172.21.15.22:0/2206596256 conn(0x7fc2dc0cddc0 msgr2=0x7fc2dc0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.703+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 shutdown_connections 2023-10-08T00:30:45.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.705+0000 7fc2e2778700 1 -- 172.21.15.22:0/2206596256 wait complete. 2023-10-08T00:30:45.720 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 14 and data pool 15 2023-10-08T00:30:45.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:45.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.853+0000 7f02c231a700 1 Processor -- start 2023-10-08T00:30:45.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.853+0000 7f02c231a700 1 -- start start 2023-10-08T00:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02c231a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02bc159890 0x7f02bc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02c231a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc15a160 con 0x7f02bc159c60 2023-10-08T00:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02c231a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc0d13a0 con 0x7f02bc069560 2023-10-08T00:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02c231a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc15e140 con 0x7f02bc159890 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02bbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02bc159890 0x7f02bc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02bb7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f02bc159c60 0x7f02bc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42842/0 (socket says 172.21.15.22:42842) 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.854+0000 7f02bb7fe700 1 -- 172.21.15.22:0/828602585 learned_addr learned my addr 172.21.15.22:0/828602585 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02bbfff700 1 -- 172.21.15.22:0/828602585 >> v1:172.21.15.192:6789/0 conn(0x7f02bc069560 legacy=0x7f02bc0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02bbfff700 1 -- 172.21.15.22:0/828602585 >> v1:172.21.15.22:6789/0 conn(0x7f02bc159c60 legacy=0x7f02bc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02baffd700 1 -- 172.21.15.22:0/828602585 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775246875 0 0) 0x7f02bc15a160 con 0x7f02bc159c60 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02bbfff700 1 -- 172.21.15.22:0/828602585 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc15a3d0 con 0x7f02bc159890 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02bbfff700 1 --2- 172.21.15.22:0/828602585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15abd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0098e0 tx=0x7f02ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5a24df1eef1eeb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02baffd700 1 -- 172.21.15.22:0/828602585 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac009e80 con 0x7f02bc159890 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02baffd700 1 -- 172.21.15.22:0/828602585 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac00b820 con 0x7f02bc159890 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02baffd700 1 -- 172.21.15.22:0/828602585 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00bba0 con 0x7f02bc159890 2023-10-08T00:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02c231a700 1 -- 172.21.15.22:0/828602585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 msgr2=0x7f02bc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02c231a700 1 --2- 172.21.15.22:0/828602585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15abd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0098e0 tx=0x7f02ac0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.855+0000 7f02c231a700 1 -- 172.21.15.22:0/828602585 shutdown_connections 2023-10-08T00:30:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.856+0000 7f02c231a700 1 --2- 172.21.15.22:0/828602585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15abd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.856+0000 7f02c231a700 1 -- 172.21.15.22:0/828602585 >> 172.21.15.22:0/828602585 conn(0x7f02bc068e20 msgr2=0x7f02bc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.856+0000 7f02c231a700 1 -- 172.21.15.22:0/828602585 shutdown_connections 2023-10-08T00:30:45.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.856+0000 7f02c231a700 1 -- 172.21.15.22:0/828602585 wait complete. 2023-10-08T00:30:45.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.857+0000 7f02c231a700 1 Processor -- start 2023-10-08T00:30:45.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.857+0000 7f02c231a700 1 -- start start 2023-10-08T00:30:45.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02bc069560 0x7f02bc14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02bc159c60 0x7f02bc0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0b4850 con 0x7f02bc159890 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0b4ac0 con 0x7f02bc069560 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0b4da0 con 0x7f02bc159c60 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43860/0 (socket says 172.21.15.22:43860) 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 -- 172.21.15.22:0/1501846478 learned_addr learned my addr 172.21.15.22:0/1501846478 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c08b7700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02bc159c60 0x7f02bc0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:45.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bbfff700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02bc069560 0x7f02bc14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 -- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02bc159c60 msgr2=0x7f02bc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02bc159c60 0x7f02bc0ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 -- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02bc069560 msgr2=0x7f02bc14d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02bc069560 0x7f02bc14d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 -- 172.21.15.22:0/1501846478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009420 con 0x7f02bc159890 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c08b7700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02bc159c60 0x7f02bc0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:45.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bbfff700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02bc069560 0x7f02bc14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02bb7fe700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15d810 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f02b000c7e0 tx=0x7f02b0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0005b30 con 0x7f02bc159890 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b0005c90 con 0x7f02bc159890 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc0b5080 con 0x7f02bc159890 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b0007300 con 0x7f02bc159890 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.858+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc14d930 con 0x7f02bc159890 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.859+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc0b55a0 con 0x7f02bc159890 2023-10-08T00:30:45.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.860+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f02b001b400 con 0x7f02bc159890 2023-10-08T00:30:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.860+0000 7f02a3fff700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a8067200 0x7f02a80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.861+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02b0084480 con 0x7f02bc159890 2023-10-08T00:30:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.861+0000 7f02bbfff700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a8067200 0x7f02a80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.861+0000 7f02bbfff700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a8067200 0x7f02a80696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0030c0 tx=0x7f02ac016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:45.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:45.865+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02bc0b55a0 con 0x7f02bc159890 2023-10-08T00:30:46.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.059+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02bc0b55a0 con 0x7f02bc159890 2023-10-08T00:30:46.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.060+0000 7f02a3fff700 1 -- 172.21.15.22:0/1501846478 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f02bc0b55a0 con 0x7f02bc159890 2023-10-08T00:30:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:46.061 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":89,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:45.102823+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:43.509676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:44.068405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a8067200 msgr2=0x7f02a80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a8067200 0x7f02a80696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0030c0 tx=0x7f02ac016000 comp rx=0 tx=0).stop 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 msgr2=0x7f02bc15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15d810 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f02b000c7e0 tx=0x7f02b0007df0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 shutdown_connections 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a8067200 0x7f02a80696b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02bc159c60 0x7f02bc0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02bc069560 0x7f02bc14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 --2- 172.21.15.22:0/1501846478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02bc159890 0x7f02bc15d810 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 >> 172.21.15.22:0/1501846478 conn(0x7f02bc068e20 msgr2=0x7f02bc0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:46.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 shutdown_connections 2023-10-08T00:30:46.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.062+0000 7f02c231a700 1 -- 172.21.15.22:0/1501846478 wait complete. 2023-10-08T00:30:46.075 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:46.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 Processor -- start 2023-10-08T00:30:46.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 -- start start 2023-10-08T00:30:46.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f24a8159890 0x7f24a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24a8159c60 0x7f24a815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a815a160 con 0x7f24a815db10 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a815df50 con 0x7f24a8159c60 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.194+0000 7f24af110700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80d13a0 con 0x7f24a8159890 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24a8159c60 0x7f24a815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24ad6ad700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f24a815db10 0x7f24a8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42848/0 (socket says 172.21.15.22:42848) 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24ad6ad700 1 -- 172.21.15.22:0/2813841892 learned_addr learned my addr 172.21.15.22:0/2813841892 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24aceac700 1 --2- 172.21.15.22:0/2813841892 >> v2:172.21.15.192:3300/0 conn(0x7f24a8159890 0x7f24a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a7fff700 1 -- 172.21.15.22:0/2813841892 >> v2:172.21.15.192:3300/0 conn(0x7f24a8159890 msgr2=0x7f24a815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a7fff700 1 --2- 172.21.15.22:0/2813841892 >> v2:172.21.15.192:3300/0 conn(0x7f24a8159890 0x7f24a815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a7fff700 1 -- 172.21.15.22:0/2813841892 >> v1:172.21.15.22:6789/0 conn(0x7f24a815db10 legacy=0x7f24a8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a7fff700 1 -- 172.21.15.22:0/2813841892 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a815e140 con 0x7f24a8159c60 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a77fe700 1 -- 172.21.15.22:0/2813841892 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657081787 0 0) 0x7f24a815a160 con 0x7f24a815db10 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a7fff700 1 --2- 172.21.15.22:0/2813841892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a815d5d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f24a80d1090 tx=0x7f249c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864b27f7472f47b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a77fe700 1 -- 172.21.15.22:0/2813841892 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00b6b0 con 0x7f24a8159c60 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a77fe700 1 -- 172.21.15.22:0/2813841892 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c00b810 con 0x7f24a8159c60 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.195+0000 7f24a77fe700 1 -- 172.21.15.22:0/2813841892 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00bbb0 con 0x7f24a8159c60 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 -- 172.21.15.22:0/2813841892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 msgr2=0x7f24a815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 --2- 172.21.15.22:0/2813841892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a815d5d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f24a80d1090 tx=0x7f249c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 -- 172.21.15.22:0/2813841892 shutdown_connections 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 --2- 172.21.15.22:0/2813841892 >> v2:172.21.15.192:3300/0 conn(0x7f24a8159890 0x7f24a815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 --2- 172.21.15.22:0/2813841892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a815d5d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 -- 172.21.15.22:0/2813841892 >> 172.21.15.22:0/2813841892 conn(0x7f24a8068e20 msgr2=0x7f24a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:46.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 -- 172.21.15.22:0/2813841892 shutdown_connections 2023-10-08T00:30:46.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.196+0000 7f24af110700 1 -- 172.21.15.22:0/2813841892 wait complete. 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.197+0000 7f24af110700 1 Processor -- start 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.197+0000 7f24af110700 1 -- start start 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24af110700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a8159890 0x7f24a80cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24af110700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a814d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24af110700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a815db10 0x7f24a8152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24af110700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8151ff0 con 0x7f24a8159c60 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24af110700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80cdc20 con 0x7f24a815db10 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24af110700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80cdec0 con 0x7f24a8159890 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a814d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a814d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43876/0 (socket says 172.21.15.22:43876) 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 -- 172.21.15.22:0/1835000445 learned_addr learned my addr 172.21.15.22:0/1835000445 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24ad6ad700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a815db10 0x7f24a8152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24aceac700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a8159890 0x7f24a80cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 -- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a8159890 msgr2=0x7f24a80cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a8159890 0x7f24a80cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 -- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a815db10 msgr2=0x7f24a8152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a815db10 0x7f24a8152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 -- 172.21.15.22:0/1835000445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c009420 con 0x7f24a8159c60 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.198+0000 7f24a7fff700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a814d460 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f24a8070e20 tx=0x7f249c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.199+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011420 con 0x7f24a8159c60 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.199+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c011580 con 0x7f24a8159c60 2023-10-08T00:30:46.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.199+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a8152e50 con 0x7f24a8159c60 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.199+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c011920 con 0x7f24a8159c60 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.199+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80ce4c0 con 0x7f24a8159c60 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.199+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a8152130 con 0x7f24a8159c60 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.200+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f249c011d10 con 0x7f24a8159c60 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.200+0000 7f24a4ff9700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067200 0x7f24940696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.200+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f249c0864b0 con 0x7f24a8159c60 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.201+0000 7f24aceac700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067200 0x7f24940696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.201+0000 7f24aceac700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067200 0x7f24940696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f24a00070b0 tx=0x7f24a0007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:46.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.205+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f249c053450 con 0x7f24a8159c60 2023-10-08T00:30:46.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.399+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24a804c3c0 con 0x7f24a8159c60 2023-10-08T00:30:46.400 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.400+0000 7f24a4ff9700 1 -- 172.21.15.22:0/1835000445 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15366 (secure 0 0 0) 0x7f249c056a70 con 0x7f24a8159c60 2023-10-08T00:30:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:46.401 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":89,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:45.102823+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:43.509676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:44.068405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:46.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067200 msgr2=0x7f24940696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067200 0x7f24940696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f24a00070b0 tx=0x7f24a0007040 comp rx=0 tx=0).stop 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 msgr2=0x7f24a814d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a814d460 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f24a8070e20 tx=0x7f249c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 shutdown_connections 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a815db10 0x7f24a8152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067200 0x7f24940696b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a8159890 0x7f24a80cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 --2- 172.21.15.22:0/1835000445 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a8159c60 0x7f24a814d460 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 >> 172.21.15.22:0/1835000445 conn(0x7f24a8068e20 msgr2=0x7f24a8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:46.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 shutdown_connections 2023-10-08T00:30:46.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.402+0000 7f24af110700 1 -- 172.21.15.22:0/1835000445 wait complete. 2023-10-08T00:30:46.415 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:30:46.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.538+0000 7f467735f700 1 Processor -- start 2023-10-08T00:30:46.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.538+0000 7f467735f700 1 -- start start 2023-10-08T00:30:46.540 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f467735f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f467015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f467735f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4670159c60 0x7f467015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f467735f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467015a160 con 0x7f467015db10 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f467735f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46700d13a0 con 0x7f4670159c60 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f467735f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467015e140 con 0x7f4670159890 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46748fa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4670159c60 0x7f467015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46758fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f467015db10 0x7f4670069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42864/0 (socket says 172.21.15.22:42864) 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46758fc700 1 -- 172.21.15.22:0/3078632606 learned_addr learned my addr 172.21.15.22:0/3078632606 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46750fb700 1 --2- 172.21.15.22:0/3078632606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f467015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46748fa700 1 -- 172.21.15.22:0/3078632606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 msgr2=0x7f467015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46748fa700 1 --2- 172.21.15.22:0/3078632606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f467015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46748fa700 1 -- 172.21.15.22:0/3078632606 >> v1:172.21.15.22:6789/0 conn(0x7f467015db10 legacy=0x7f4670069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f466ffff700 1 -- 172.21.15.22:0/3078632606 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442836842 0 0) 0x7f467015a160 con 0x7f467015db10 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46748fa700 1 -- 172.21.15.22:0/3078632606 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467015a3d0 con 0x7f4670159c60 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f46748fa700 1 --2- 172.21.15.22:0/3078632606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4670159c60 0x7f467015d5d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f46640098e0 tx=0x7f46640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f2afcd101e0ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.539+0000 7f466ffff700 1 -- 172.21.15.22:0/3078632606 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664009e80 con 0x7f4670159c60 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f466ffff700 1 -- 172.21.15.22:0/3078632606 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466400b860 con 0x7f4670159c60 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f466ffff700 1 -- 172.21.15.22:0/3078632606 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400bbe0 con 0x7f4670159c60 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 -- 172.21.15.22:0/3078632606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4670159c60 msgr2=0x7f467015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 --2- 172.21.15.22:0/3078632606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4670159c60 0x7f467015d5d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f46640098e0 tx=0x7f46640091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 -- 172.21.15.22:0/3078632606 shutdown_connections 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 --2- 172.21.15.22:0/3078632606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f467015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 --2- 172.21.15.22:0/3078632606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4670159c60 0x7f467015d5d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 -- 172.21.15.22:0/3078632606 >> 172.21.15.22:0/3078632606 conn(0x7f4670068e20 msgr2=0x7f46700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:46.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 -- 172.21.15.22:0/3078632606 shutdown_connections 2023-10-08T00:30:46.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.540+0000 7f467735f700 1 -- 172.21.15.22:0/3078632606 wait complete. 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.541+0000 7f467735f700 1 Processor -- start 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.541+0000 7f467735f700 1 -- start start 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f467735f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f46700b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f467735f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4670159c60 0x7f46701472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f467735f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 0x7f46700cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f467735f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4670147830 con 0x7f467015db10 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f467735f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700cfd50 con 0x7f4670159c60 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f467735f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46700b5b00 con 0x7f4670159890 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f46758fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 0x7f46700cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f46758fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 0x7f46700cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43904/0 (socket says 172.21.15.22:43904) 2023-10-08T00:30:46.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f46758fc700 1 -- 172.21.15.22:0/1385572802 learned_addr learned my addr 172.21.15.22:0/1385572802 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f46748fa700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4670159c60 0x7f46701472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.542+0000 7f46750fb700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f46700b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f46758fc700 1 -- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 msgr2=0x7f46700b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f46758fc700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f46700b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f46758fc700 1 -- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4670159c60 msgr2=0x7f46701472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f46758fc700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4670159c60 0x7f46701472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f46758fc700 1 -- 172.21.15.22:0/1385572802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009420 con 0x7f467015db10 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f46758fc700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 0x7f46700cf810 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f466000cbf0 tx=0x7f46600019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000a850 con 0x7f467015db10 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000a9b0 con 0x7f467015db10 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000ad70 con 0x7f467015db10 2023-10-08T00:30:46.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700b51d0 con 0x7f467015db10 2023-10-08T00:30:46.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.543+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46700b5790 con 0x7f467015db10 2023-10-08T00:30:46.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.544+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46700b64d0 con 0x7f467015db10 2023-10-08T00:30:46.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.544+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f4660007300 con 0x7f467015db10 2023-10-08T00:30:46.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.545+0000 7f466d7fa700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f465c067200 0x7f465c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:46.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.545+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4660084c00 con 0x7f467015db10 2023-10-08T00:30:46.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.545+0000 7f46750fb700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f465c067200 0x7f465c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:46.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.545+0000 7f46750fb700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f465c067200 0x7f465c0696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:46.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.549+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4660051b60 con 0x7f467015db10 2023-10-08T00:30:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:46.791+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46700b5c70 con 0x7f467015db10 2023-10-08T00:30:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.725+0000 7f466d7fa700 1 -- 172.21.15.22:0/1385572802 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4660055180 con 0x7f467015db10 2023-10-08T00:30:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f465c067200 msgr2=0x7f465c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f465c067200 0x7f465c0696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668008040 comp rx=0 tx=0).stop 2023-10-08T00:30:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 msgr2=0x7f46700cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 0x7f46700cf810 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f466000cbf0 tx=0x7f46600019b0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 shutdown_connections 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f467015db10 0x7f46700cf810 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f465c067200 0x7f465c0696b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4670159890 0x7f46700b5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 --2- 172.21.15.22:0/1385572802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4670159c60 0x7f46701472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 >> 172.21.15.22:0/1385572802 conn(0x7f4670068e20 msgr2=0x7f46701530e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 shutdown_connections 2023-10-08T00:30:47.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.728+0000 7f467735f700 1 -- 172.21.15.22:0/1385572802 wait complete. 2023-10-08T00:30:47.744 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:30:47.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.872+0000 7fb9608a9700 1 Processor -- start 2023-10-08T00:30:47.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.872+0000 7fb9608a9700 1 -- start start 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb9608a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c06bfa0 0x7fb95c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb9608a9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb95c0688d0 0x7fb95c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb9608a9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95c0ca920 con 0x7fb95c159a70 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb9608a9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c068d50 con 0x7fb95c0688d0 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb9608a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c06af00 con 0x7fb95c06bfa0 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb95c0688d0 0x7fb95c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb95c0688d0 0x7fb95c0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54678/0 (socket says 172.21.15.22:54678) 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 -- 172.21.15.22:0/2289610864 learned_addr learned my addr 172.21.15.22:0/2289610864 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95a59c700 1 --2- 172.21.15.22:0/2289610864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c06bfa0 0x7fb95c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:47.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 -- 172.21.15.22:0/2289610864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c06bfa0 msgr2=0x7fb95c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 --2- 172.21.15.22:0/2289610864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c06bfa0 0x7fb95c068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 -- 172.21.15.22:0/2289610864 >> v1:172.21.15.192:6789/0 conn(0x7fb95c159a70 legacy=0x7fb95c0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.873+0000 7fb95b59e700 1 -- 172.21.15.22:0/2289610864 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c06b1e0 con 0x7fb95c0688d0 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb95b59e700 1 --2- 172.21.15.22:0/2289610864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c0688d0 0x7fb95c0caec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb9540099b0 tx=0x7fb954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d9e00c9ca4f24d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb959d9b700 1 -- 172.21.15.22:0/2289610864 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400b860 con 0x7fb95c0688d0 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb959d9b700 1 -- 172.21.15.22:0/2289610864 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400b9c0 con 0x7fb95c0688d0 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb959d9b700 1 -- 172.21.15.22:0/2289610864 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400bd60 con 0x7fb95c0688d0 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 -- 172.21.15.22:0/2289610864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c0688d0 msgr2=0x7fb95c0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 --2- 172.21.15.22:0/2289610864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c0688d0 0x7fb95c0caec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fb9540099b0 tx=0x7fb954009250 comp rx=0 tx=0).stop 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 -- 172.21.15.22:0/2289610864 shutdown_connections 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 --2- 172.21.15.22:0/2289610864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c0688d0 0x7fb95c0caec0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 --2- 172.21.15.22:0/2289610864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c06bfa0 0x7fb95c068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 -- 172.21.15.22:0/2289610864 >> 172.21.15.22:0/2289610864 conn(0x7fb95c0cddc0 msgr2=0x7fb95c0c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:47.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 -- 172.21.15.22:0/2289610864 shutdown_connections 2023-10-08T00:30:47.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.874+0000 7fb9608a9700 1 -- 172.21.15.22:0/2289610864 wait complete. 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.875+0000 7fb9608a9700 1 Processor -- start 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 -- start start 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c0688d0 0x7fb95c1426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb95c06bfa0 0x7fb95c159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 0x7fb95c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c0c6d00 con 0x7fb95c159a70 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c15bf50 con 0x7fb95c06bfa0 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb9608a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c15c180 con 0x7fb95c0688d0 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb95b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 0x7fb95c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb95b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 0x7fb95c15a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54682/0 (socket says 172.21.15.22:54682) 2023-10-08T00:30:47.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb95b59e700 1 -- 172.21.15.22:0/558106469 learned_addr learned my addr 172.21.15.22:0/558106469 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb95a59c700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb95c06bfa0 0x7fb95c159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.876+0000 7fb95ad9d700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c0688d0 0x7fb95c1426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb95b59e700 1 -- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c0688d0 msgr2=0x7fb95c1426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb95b59e700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c0688d0 0x7fb95c1426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb95b59e700 1 -- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb95c06bfa0 msgr2=0x7fb95c159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb95b59e700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb95c06bfa0 0x7fb95c159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb95b59e700 1 -- 172.21.15.22:0/558106469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540094f0 con 0x7fb95c159a70 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb95b59e700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 0x7fb95c15a380 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb95c06a6a0 tx=0x7fb954017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011ea0 con 0x7fb95c159a70 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95401a630 con 0x7fb95c159a70 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c15c460 con 0x7fb95c159a70 2023-10-08T00:30:47.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95401a9f0 con 0x7fb95c159a70 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.877+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c15ca20 con 0x7fb95c159a70 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.878+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c06d560 con 0x7fb95c159a70 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.878+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb9540253f0 con 0x7fb95c159a70 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.879+0000 7fb952ffd700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb93c067200 0x7fb93c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.879+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb954086360 con 0x7fb95c159a70 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.879+0000 7fb95ad9d700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb93c067200 0x7fb93c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:47.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.880+0000 7fb95ad9d700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb93c067200 0x7fb93c0696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb94c007fd0 tx=0x7fb94c0016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:47.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:47.883+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb954053280 con 0x7fb95c159a70 2023-10-08T00:30:48.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.120+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb95c04bb80 con 0x7fb95c159a70 2023-10-08T00:30:48.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.731+0000 7fb952ffd700 1 -- 172.21.15.22:0/558106469 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb9540568a0 con 0x7fb95c159a70 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb93c067200 msgr2=0x7fb93c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb93c067200 0x7fb93c0696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb94c007fd0 tx=0x7fb94c0016f0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 msgr2=0x7fb95c15a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 0x7fb95c15a380 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb95c06a6a0 tx=0x7fb954017000 comp rx=0 tx=0).stop 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 shutdown_connections 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95c159a70 0x7fb95c15a380 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb93c067200 0x7fb93c0696b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb95c0688d0 0x7fb95c1426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 --2- 172.21.15.22:0/558106469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb95c06bfa0 0x7fb95c159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 >> 172.21.15.22:0/558106469 conn(0x7fb95c0cddc0 msgr2=0x7fb95c155420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:48.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 shutdown_connections 2023-10-08T00:30:48.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.734+0000 7fb9608a9700 1 -- 172.21.15.22:0/558106469 wait complete. 2023-10-08T00:30:48.749 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:48.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.875+0000 7f311f07b700 1 Processor -- start 2023-10-08T00:30:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.875+0000 7f311f07b700 1 -- start start 2023-10-08T00:30:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311f07b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3118159420 0x7f31180b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311f07b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31181597f0 0x7f31180b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311f07b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180b11d0 con 0x7f311815d230 2023-10-08T00:30:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311f07b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180b14b0 con 0x7f31181597f0 2023-10-08T00:30:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311f07b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180b1790 con 0x7f3118159420 2023-10-08T00:30:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311d878700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31181597f0 0x7f31180b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311e87a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f311815d230 0x7f31180b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55282/0 (socket says 172.21.15.22:55282) 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311e87a700 1 -- 172.21.15.22:0/3816416119 learned_addr learned my addr 172.21.15.22:0/3816416119 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311e079700 1 --2- 172.21.15.22:0/3816416119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3118159420 0x7f31180b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311d878700 1 -- 172.21.15.22:0/3816416119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3118159420 msgr2=0x7f31180b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311d878700 1 --2- 172.21.15.22:0/3816416119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3118159420 0x7f31180b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311d878700 1 -- 172.21.15.22:0/3816416119 >> v1:172.21.15.22:6789/0 conn(0x7f311815d230 legacy=0x7f31180b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.876+0000 7f311d878700 1 -- 172.21.15.22:0/3816416119 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180b1a70 con 0x7f31181597f0 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311d878700 1 --2- 172.21.15.22:0/3816416119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31181597f0 0x7f31180b2270 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f310c0098e0 tx=0x7f310c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14133993a438bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311d077700 1 -- 172.21.15.22:0/3816416119 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c009e80 con 0x7f31181597f0 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311d077700 1 -- 172.21.15.22:0/3816416119 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c00b760 con 0x7f31181597f0 2023-10-08T00:30:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311d077700 1 -- 172.21.15.22:0/3816416119 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c00bae0 con 0x7f31181597f0 2023-10-08T00:30:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 -- 172.21.15.22:0/3816416119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31181597f0 msgr2=0x7f31180b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 --2- 172.21.15.22:0/3816416119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31181597f0 0x7f31180b2270 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f310c0098e0 tx=0x7f310c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 -- 172.21.15.22:0/3816416119 shutdown_connections 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 --2- 172.21.15.22:0/3816416119 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3118159420 0x7f31180b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 --2- 172.21.15.22:0/3816416119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31181597f0 0x7f31180b2270 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 -- 172.21.15.22:0/3816416119 >> 172.21.15.22:0/3816416119 conn(0x7f31180d0660 msgr2=0x7f31180d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 -- 172.21.15.22:0/3816416119 shutdown_connections 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.877+0000 7f311f07b700 1 -- 172.21.15.22:0/3816416119 wait complete. 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.878+0000 7f311f07b700 1 Processor -- start 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 -- start start 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 0x7f3118159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31181597f0 0x7f311814bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311815d230 0x7f31180b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311814e4d0 con 0x7f3118159420 2023-10-08T00:30:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311814c130 con 0x7f311815d230 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311f07b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311814d900 con 0x7f31181597f0 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311e079700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 0x7f3118159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311e079700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 0x7f3118159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54690/0 (socket says 172.21.15.22:54690) 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.879+0000 7f311e079700 1 -- 172.21.15.22:0/2587485833 learned_addr learned my addr 172.21.15.22:0/2587485833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e87a700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311815d230 0x7f31180b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311d878700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31181597f0 0x7f311814bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e079700 1 -- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31181597f0 msgr2=0x7f311814bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e079700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31181597f0 0x7f311814bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e079700 1 -- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311815d230 msgr2=0x7f31180b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e079700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311815d230 0x7f31180b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e079700 1 -- 172.21.15.22:0/2587485833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c009420 con 0x7f3118159420 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311e079700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 0x7f3118159c00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f310800e190 tx=0x7f3108009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310800ee30 con 0x7f3118159420 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108014420 con 0x7f3118159420 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311814dba0 con 0x7f3118159420 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080147e0 con 0x7f3118159420 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.880+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311814e160 con 0x7f3118159420 2023-10-08T00:30:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.881+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311814e7b0 con 0x7f3118159420 2023-10-08T00:30:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.881+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3108014b90 con 0x7f3118159420 2023-10-08T00:30:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.882+0000 7f31167fc700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3104067200 0x7f31040696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.882+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31080851d0 con 0x7f3118159420 2023-10-08T00:30:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.882+0000 7f311d878700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3104067200 0x7f31040696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.882+0000 7f311d878700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3104067200 0x7f31040696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f310c0093f0 tx=0x7f310c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:48.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:48.886+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31080520f0 con 0x7f3118159420 2023-10-08T00:30:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.121+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f311804c3c0 con 0x7f3118159420 2023-10-08T00:30:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.122+0000 7f31167fc700 1 -- 172.21.15.22:0/2587485833 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f3108009a60 con 0x7f3118159420 2023-10-08T00:30:49.123 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:49.123 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:45.103135+0000","modified":"2023-10-08T00:30:48.725392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"d","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/3601516791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3601516791},{"type":"v1","addr":"172.21.15.192:6836","nonce":3601516791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3104067200 msgr2=0x7f31040696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3104067200 0x7f31040696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f310c0093f0 tx=0x7f310c016000 comp rx=0 tx=0).stop 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 msgr2=0x7f3118159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 0x7f3118159c00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f310800e190 tx=0x7f3108009920 comp rx=0 tx=0).stop 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 shutdown_connections 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f311815d230 0x7f31180b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3118159420 0x7f3118159c00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3104067200 0x7f31040696b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 --2- 172.21.15.22:0/2587485833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f31181597f0 0x7f311814bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 >> 172.21.15.22:0/2587485833 conn(0x7f31180d0660 msgr2=0x7f3118157710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:49.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 shutdown_connections 2023-10-08T00:30:49.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.124+0000 7f311f07b700 1 -- 172.21.15.22:0/2587485833 wait complete. 2023-10-08T00:30:49.126 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 60 2023-10-08T00:30:49.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:30:49.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.256+0000 7f0bca7c0700 1 Processor -- start 2023-10-08T00:30:49.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.256+0000 7f0bca7c0700 1 -- start start 2023-10-08T00:30:49.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bca7c0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0bc415dba0 0x7f0bc406ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bca7c0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40c74b0 con 0x7f0bc4159b10 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bca7c0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40c8700 con 0x7f0bc415d730 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bca7c0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc40c9070 con 0x7f0bc415dba0 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0bc4159b10 0x7f0bc40cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55284/0 (socket says 172.21.15.22:55284) 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc3fff700 1 -- 172.21.15.22:0/4023061230 learned_addr learned my addr 172.21.15.22:0/4023061230 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145049117 0 0) 0x7f0bc40c74b0 con 0x7f0bc4159b10 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc8d5d700 1 --2- 172.21.15.22:0/4023061230 >> v2:172.21.15.192:3300/0 conn(0x7f0bc415dba0 0x7f0bc406ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bac003570 con 0x7f0bc4159b10 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 662925000 0 0) 0x7f0bac003570 con 0x7f0bc4159b10 2023-10-08T00:30:49.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 >> v2:172.21.15.192:3300/0 conn(0x7f0bc415dba0 msgr2=0x7f0bc406ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 --2- 172.21.15.22:0/4023061230 >> v2:172.21.15.192:3300/0 conn(0x7f0bc415dba0 0x7f0bc406ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 >> v1:172.21.15.192:6789/0 conn(0x7f0bc415d730 legacy=0x7f0bc406a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc40c80f0 con 0x7f0bc4159b10 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f0bb4001470 con 0x7f0bc4159b10 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 >> v1:172.21.15.22:6789/0 conn(0x7f0bc4159b10 legacy=0x7f0bc40cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.257+0000 7f0bc2ffd700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bac003a60 0x7f0bac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bac004810 0x7f0bac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac0051c0 0x7f0bac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40c9070 con 0x7f0bac003a60 2023-10-08T00:30:49.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac00c0d0 con 0x7f0bac004810 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac00c290 con 0x7f0bac0051c0 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bac003a60 0x7f0bac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc37fe700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bac004810 0x7f0bac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc8d5d700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac0051c0 0x7f0bac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 -- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac0051c0 msgr2=0x7f0bac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac0051c0 0x7f0bac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 -- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bac004810 msgr2=0x7f0bac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bac004810 0x7f0bac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 -- 172.21.15.22:0/4023061230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac003570 con 0x7f0bac003a60 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc37fe700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bac004810 0x7f0bac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc8d5d700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac0051c0 0x7f0bac00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:49.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc8d5d700 1 -- 172.21.15.22:0/4023061230 reap_dead start 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bac003a60 0x7f0bac003e70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400c390 tx=0x7f0bc40c8280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb057b45bdd8877 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400cc60 con 0x7f0bac003a60 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb400cdc0 con 0x7f0bac003a60 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.258+0000 7f0bc2ffd700 1 -- 172.21.15.22:0/4023061230 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4005b70 con 0x7f0bac003a60 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 -- 172.21.15.22:0/4023061230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bac003a60 msgr2=0x7f0bac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bac003a60 0x7f0bac003e70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400c390 tx=0x7f0bc40c8280 comp rx=0 tx=0).stop 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 -- 172.21.15.22:0/4023061230 shutdown_connections 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/4023061230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bac003a60 0x7f0bac003e70 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 -- 172.21.15.22:0/4023061230 >> 172.21.15.22:0/4023061230 conn(0x7f0bc40c9870 msgr2=0x7f0bc40c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 -- 172.21.15.22:0/4023061230 shutdown_connections 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.259+0000 7f0bca7c0700 1 -- 172.21.15.22:0/4023061230 wait complete. 2023-10-08T00:30:49.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.260+0000 7f0bca7c0700 1 Processor -- start 2023-10-08T00:30:49.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.260+0000 7f0bca7c0700 1 -- start start 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bca7c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac003a60 0x7f0bc41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bca7c0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bc40b1cb0 0x7f0bc40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bca7c0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 0x7f0bc40b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bca7c0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc415b300 con 0x7f0bc40afba0 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bca7c0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc415b550 con 0x7f0bc40b1cb0 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bca7c0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc415b830 con 0x7f0bac003a60 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 0x7f0bc40b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 0x7f0bc40b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54702/0 (socket says 172.21.15.22:54702) 2023-10-08T00:30:49.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 -- 172.21.15.22:0/3468743191 learned_addr learned my addr 172.21.15.22:0/3468743191 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac003a60 0x7f0bc41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc37fe700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bc40b1cb0 0x7f0bc40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 -- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac003a60 msgr2=0x7f0bc41542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac003a60 0x7f0bc41542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 -- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bc40b1cb0 msgr2=0x7f0bc40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bc40b1cb0 0x7f0bc40b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.261+0000 7f0bc8d5d700 1 -- 172.21.15.22:0/3468743191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc415bb10 con 0x7f0bc40afba0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.262+0000 7f0bc8d5d700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 0x7f0bc40b0010 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40632c0 tx=0x7f0bbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.262+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc01b070 con 0x7f0bc40afba0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.262+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc00f040 con 0x7f0bc40afba0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.262+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00e050 con 0x7f0bc40afba0 2023-10-08T00:30:49.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.262+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc415bdf0 con 0x7f0bc40afba0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.262+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc40b0550 con 0x7f0bc40afba0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.263+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc415bfe0 con 0x7f0bc40afba0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.263+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0bbc003020 con 0x7f0bc40afba0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.263+0000 7f0babfff700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bb0067230 0x7f0bb00696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.264+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bbc084d70 con 0x7f0bc40afba0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.264+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bb0067230 0x7f0bb00696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.264+0000 7f0bc3fff700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bb0067230 0x7f0bb00696e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4007cd0 tx=0x7f0bb4015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.268+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bbc051b80 con 0x7f0bc40afba0 2023-10-08T00:30:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.464+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bc404c3c0 con 0x7f0bc40afba0 2023-10-08T00:30:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.465+0000 7f0babfff700 1 -- 172.21.15.22:0/3468743191 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f0bbc06be60 con 0x7f0bc40afba0 2023-10-08T00:30:49.465 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:49.466 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":90,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:46.691667+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:43.509676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:44.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bb0067230 msgr2=0x7f0bb00696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bb0067230 0x7f0bb00696e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4007cd0 tx=0x7f0bb4015000 comp rx=0 tx=0).stop 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 msgr2=0x7f0bc40b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 0x7f0bc40b0010 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40632c0 tx=0x7f0bbc00b040 comp rx=0 tx=0).stop 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 shutdown_connections 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0bc40afba0 0x7f0bc40b0010 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bb0067230 0x7f0bb00696e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0bac003a60 0x7f0bc41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 --2- 172.21.15.22:0/3468743191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bc40b1cb0 0x7f0bc40b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 >> 172.21.15.22:0/3468743191 conn(0x7f0bc40c9870 msgr2=0x7f0bc41566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 shutdown_connections 2023-10-08T00:30:49.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.467+0000 7f0bca7c0700 1 -- 172.21.15.22:0/3468743191 wait complete. 2023-10-08T00:30:49.480 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:30:49.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:49.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.600+0000 7f5fc9400700 1 Processor -- start 2023-10-08T00:30:49.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.600+0000 7f5fc9400700 1 -- start start 2023-10-08T00:30:49.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc9400700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5fc40cc260 0x7f5fc406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc9400700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40ca490 con 0x7f5fc4159c90 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc9400700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40cca40 con 0x7f5fc41598c0 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc9400700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc406a6a0 con 0x7f5fc40cc260 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5fc4159c90 0x7f5fc4163650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55298/0 (socket says 172.21.15.22:55298) 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc37fe700 1 -- 172.21.15.22:0/2173824785 learned_addr learned my addr 172.21.15.22:0/2173824785 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/2173824785 >> v2:172.21.15.192:3300/0 conn(0x7f5fc40cc260 0x7f5fc406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618797881 0 0) 0x7f5fc40ca490 con 0x7f5fc4159c90 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fac003570 con 0x7f5fc4159c90 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3121020026 0 0) 0x7f5fac003570 con 0x7f5fc4159c90 2023-10-08T00:30:49.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 >> v2:172.21.15.192:3300/0 conn(0x7f5fc40cc260 msgr2=0x7f5fc406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 --2- 172.21.15.22:0/2173824785 >> v2:172.21.15.192:3300/0 conn(0x7f5fc40cc260 0x7f5fc406d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 >> v1:172.21.15.192:6789/0 conn(0x7f5fc41598c0 legacy=0x7f5fc406b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40cc760 con 0x7f5fc4159c90 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5fbc0017f0 con 0x7f5fc4159c90 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 >> v1:172.21.15.22:6789/0 conn(0x7f5fc4159c90 legacy=0x7f5fc4163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fac003a60 0x7f5fac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fac0051c0 0x7f5fac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc406a6a0 con 0x7f5fac004810 2023-10-08T00:30:49.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac00c0d0 con 0x7f5fac003a60 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac00c290 con 0x7f5fac0051c0 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.601+0000 7f5fc2ffd700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fac003a60 0x7f5fac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc37fe700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fac0051c0 0x7f5fac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc27fc700 1 -- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fac0051c0 msgr2=0x7f5fac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fac0051c0 0x7f5fac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc27fc700 1 -- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fac003a60 msgr2=0x7f5fac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fac003a60 0x7f5fac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc27fc700 1 -- 172.21.15.22:0/2173824785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac003570 con 0x7f5fac004810 2023-10-08T00:30:49.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc37fe700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fac0051c0 0x7f5fac00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc37fe700 1 -- 172.21.15.22:0/2173824785 reap_dead start 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fac004c80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40cc690 tx=0x7f5fb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213502a239ac4e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800e710 con 0x7f5fac004810 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb800e870 con 0x7f5fac004810 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc1ffb700 1 -- 172.21.15.22:0/2173824785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb800ec30 con 0x7f5fac004810 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc9400700 1 -- 172.21.15.22:0/2173824785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 msgr2=0x7f5fac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.602+0000 7f5fc9400700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fac004c80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40cc690 tx=0x7f5fb80091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.603+0000 7f5fc9400700 1 -- 172.21.15.22:0/2173824785 shutdown_connections 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.603+0000 7f5fc9400700 1 --2- 172.21.15.22:0/2173824785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fac004c80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.603+0000 7f5fc9400700 1 -- 172.21.15.22:0/2173824785 >> 172.21.15.22:0/2173824785 conn(0x7f5fc406baa0 msgr2=0x7f5fc406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.603+0000 7f5fc9400700 1 -- 172.21.15.22:0/2173824785 shutdown_connections 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.603+0000 7f5fc9400700 1 -- 172.21.15.22:0/2173824785 wait complete. 2023-10-08T00:30:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.604+0000 7f5fc9400700 1 Processor -- start 2023-10-08T00:30:49.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.604+0000 7f5fc9400700 1 -- start start 2023-10-08T00:30:49.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fc415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc41512e0 0x7f5fc415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc415a630 0x7f5fc40b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc415cf50 con 0x7f5fac004810 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40b1430 con 0x7f5fc41512e0 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40b19f0 con 0x7f5fc415a630 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fc415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fc415ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54718/0 (socket says 172.21.15.22:54718) 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 -- 172.21.15.22:0/3193306731 learned_addr learned my addr 172.21.15.22:0/3193306731 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc37fe700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc415a630 0x7f5fc40b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc41512e0 0x7f5fc415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 -- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc415a630 msgr2=0x7f5fc40b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc415a630 0x7f5fc40b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 -- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc41512e0 msgr2=0x7f5fc415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc41512e0 0x7f5fc415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 -- 172.21.15.22:0/3193306731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40b3d30 con 0x7f5fac004810 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc37fe700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc415a630 0x7f5fc40b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc2ffd700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fc415ca10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4002920 tx=0x7f5fb4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb40033e0 con 0x7f5fac004810 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4006870 con 0x7f5fac004810 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc40b4010 con 0x7f5fac004810 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4006c10 con 0x7f5fac004810 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.605+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc4151750 con 0x7f5fac004810 2023-10-08T00:30:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.606+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc4151970 con 0x7f5fac004810 2023-10-08T00:30:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.607+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5fb400f870 con 0x7f5fac004810 2023-10-08T00:30:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.607+0000 7f5faaffd700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067200 0x7f5fb00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.607+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5fb4084a00 con 0x7f5fac004810 2023-10-08T00:30:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.607+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067200 0x7f5fb00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.608+0000 7f5fc27fc700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067200 0x7f5fb00696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80091e0 tx=0x7f5fb801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.611+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fb4051920 con 0x7f5fac004810 2023-10-08T00:30:49.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.802+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fc40b1840 con 0x7f5fb0067200 2023-10-08T00:30:49.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.811+0000 7f5faaffd700 1 -- 172.21.15.22:0/3193306731 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286549 (secure 0 0 0) 0x7f5fc40b1840 con 0x7f5fb0067200 2023-10-08T00:30:49.815 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067200 msgr2=0x7f5fb00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067200 0x7f5fb00696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5fb80091e0 tx=0x7f5fb801a000 comp rx=0 tx=0).stop 2023-10-08T00:30:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 msgr2=0x7f5fc415ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fc415ca10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4002920 tx=0x7f5fb4007d80 comp rx=0 tx=0).stop 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 shutdown_connections 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5fb0067200 0x7f5fb00696b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5fc415a630 0x7f5fc40b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fac004810 0x7f5fc415ca10 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 --2- 172.21.15.22:0/3193306731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fc41512e0 0x7f5fc415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 >> 172.21.15.22:0/3193306731 conn(0x7f5fc406baa0 msgr2=0x7f5fc4158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 shutdown_connections 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.814+0000 7f5fc9400700 1 -- 172.21.15.22:0/3193306731 wait complete. 2023-10-08T00:30:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:49.827 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2023-10-08T00:30:48.468198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404360,"kb_used_data":9672,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752570360,"statfs":{"total":773094113280,"available":770632048640,"internally_reserved":0,"allocated":9904128,"data_stored":4922888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.782514"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697851+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704294+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.223595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695760+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699693+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:53.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700320+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700826+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701164+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:46.910499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696840+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697024+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700717+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702970+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697139+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702419+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698846+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:37:21.022626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703777+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700317+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698009+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703190+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698148+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:49.590987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696568+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697993+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:09.354869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697898+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694404+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699830+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702690+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703350+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:14.664818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702484+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:08.057908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703162+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702560+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:56.250315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696658+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:20.219079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699364+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695714+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696551+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:38:06.462335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713193+0000","last_change":"2023-10-08T00:30:44.713193+0000","last_active":"2023-10-08T00:30:44.713193+0000","last_peered":"2023-10-08T00:30:44.713193+0000","last_clean":"2023-10-08T00:30:44.713193+0000","last_became_active":"2023-10-08T00:30:44.712908+0000","last_became_peered":"2023-10-08T00:30:44.712908+0000","last_unstale":"2023-10-08T00:30:44.713193+0000","last_undegraded":"2023-10-08T00:30:44.713193+0000","last_fullsized":"2023-10-08T00:30:44.713193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702147+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711311+0000","last_change":"2023-10-08T00:30:44.711311+0000","last_active":"2023-10-08T00:30:44.711311+0000","last_peered":"2023-10-08T00:30:44.711311+0000","last_clean":"2023-10-08T00:30:44.711311+0000","last_became_active":"2023-10-08T00:30:44.711061+0000","last_became_peered":"2023-10-08T00:30:44.711061+0000","last_unstale":"2023-10-08T00:30:44.711311+0000","last_undegraded":"2023-10-08T00:30:44.711311+0000","last_fullsized":"2023-10-08T00:30:44.711311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696535+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:26.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708464+0000","last_change":"2023-10-08T00:30:44.708464+0000","last_active":"2023-10-08T00:30:44.708464+0000","last_peered":"2023-10-08T00:30:44.708464+0000","last_clean":"2023-10-08T00:30:44.708464+0000","last_became_active":"2023-10-08T00:30:44.708106+0000","last_became_peered":"2023-10-08T00:30:44.708106+0000","last_unstale":"2023-10-08T00:30:44.708464+0000","last_undegraded":"2023-10-08T00:30:44.708464+0000","last_fullsized":"2023-10-08T00:30:44.708464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:35.787697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696119+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708535+0000","last_change":"2023-10-08T00:30:44.708535+0000","last_active":"2023-10-08T00:30:44.708535+0000","last_peered":"2023-10-08T00:30:44.708535+0000","last_clean":"2023-10-08T00:30:44.708535+0000","last_became_active":"2023-10-08T00:30:44.708164+0000","last_became_peered":"2023-10-08T00:30:44.708164+0000","last_unstale":"2023-10-08T00:30:44.708535+0000","last_undegraded":"2023-10-08T00:30:44.708535+0000","last_fullsized":"2023-10-08T00:30:44.708535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:45.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699473+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707659+0000","last_change":"2023-10-08T00:30:44.707659+0000","last_active":"2023-10-08T00:30:44.707659+0000","last_peered":"2023-10-08T00:30:44.707659+0000","last_clean":"2023-10-08T00:30:44.707659+0000","last_became_active":"2023-10-08T00:30:44.707397+0000","last_became_peered":"2023-10-08T00:30:44.707397+0000","last_unstale":"2023-10-08T00:30:44.707659+0000","last_undegraded":"2023-10-08T00:30:44.707659+0000","last_fullsized":"2023-10-08T00:30:44.707659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:46.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700873+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714388+0000","last_change":"2023-10-08T00:30:44.714388+0000","last_active":"2023-10-08T00:30:44.714388+0000","last_peered":"2023-10-08T00:30:44.714388+0000","last_clean":"2023-10-08T00:30:44.714388+0000","last_became_active":"2023-10-08T00:30:44.713881+0000","last_became_peered":"2023-10-08T00:30:44.713881+0000","last_unstale":"2023-10-08T00:30:44.714388+0000","last_undegraded":"2023-10-08T00:30:44.714388+0000","last_fullsized":"2023-10-08T00:30:44.714388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:17.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700994+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713361+0000","last_change":"2023-10-08T00:30:44.713361+0000","last_active":"2023-10-08T00:30:44.713361+0000","last_peered":"2023-10-08T00:30:44.713361+0000","last_clean":"2023-10-08T00:30:44.713361+0000","last_became_active":"2023-10-08T00:30:44.713127+0000","last_became_peered":"2023-10-08T00:30:44.713127+0000","last_unstale":"2023-10-08T00:30:44.713361+0000","last_undegraded":"2023-10-08T00:30:44.713361+0000","last_fullsized":"2023-10-08T00:30:44.713361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695718+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708243+0000","last_change":"2023-10-08T00:30:44.708243+0000","last_active":"2023-10-08T00:30:44.708243+0000","last_peered":"2023-10-08T00:30:44.708243+0000","last_clean":"2023-10-08T00:30:44.708243+0000","last_became_active":"2023-10-08T00:30:44.707712+0000","last_became_peered":"2023-10-08T00:30:44.707712+0000","last_unstale":"2023-10-08T00:30:44.708243+0000","last_undegraded":"2023-10-08T00:30:44.708243+0000","last_fullsized":"2023-10-08T00:30:44.708243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:20:48.812143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698566+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:30.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704305+0000","last_change":"2023-10-08T00:30:44.704305+0000","last_active":"2023-10-08T00:30:44.704305+0000","last_peered":"2023-10-08T00:30:44.704305+0000","last_clean":"2023-10-08T00:30:44.704305+0000","last_became_active":"2023-10-08T00:30:44.704022+0000","last_became_peered":"2023-10-08T00:30:44.704022+0000","last_unstale":"2023-10-08T00:30:44.704305+0000","last_undegraded":"2023-10-08T00:30:44.704305+0000","last_fullsized":"2023-10-08T00:30:44.704305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:11.800190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714717+0000","last_change":"2023-10-08T00:30:44.714717+0000","last_active":"2023-10-08T00:30:44.714717+0000","last_peered":"2023-10-08T00:30:44.714717+0000","last_clean":"2023-10-08T00:30:44.714717+0000","last_became_active":"2023-10-08T00:30:44.714309+0000","last_became_peered":"2023-10-08T00:30:44.714309+0000","last_unstale":"2023-10-08T00:30:44.714717+0000","last_undegraded":"2023-10-08T00:30:44.714717+0000","last_fullsized":"2023-10-08T00:30:44.714717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:41.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701179+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710363+0000","last_change":"2023-10-08T00:30:44.710363+0000","last_active":"2023-10-08T00:30:44.710363+0000","last_peered":"2023-10-08T00:30:44.710363+0000","last_clean":"2023-10-08T00:30:44.710363+0000","last_became_active":"2023-10-08T00:30:44.710061+0000","last_became_peered":"2023-10-08T00:30:44.710061+0000","last_unstale":"2023-10-08T00:30:44.710363+0000","last_undegraded":"2023-10-08T00:30:44.710363+0000","last_fullsized":"2023-10-08T00:30:44.710363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:25.939919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702056+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:11.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705064+0000","last_change":"2023-10-08T00:30:44.705064+0000","last_active":"2023-10-08T00:30:44.705064+0000","last_peered":"2023-10-08T00:30:44.705064+0000","last_clean":"2023-10-08T00:30:44.705064+0000","last_became_active":"2023-10-08T00:30:44.704781+0000","last_became_peered":"2023-10-08T00:30:44.704781+0000","last_unstale":"2023-10-08T00:30:44.705064+0000","last_undegraded":"2023-10-08T00:30:44.705064+0000","last_fullsized":"2023-10-08T00:30:44.705064+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:05.062638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699080+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707647+0000","last_change":"2023-10-08T00:30:44.707647+0000","last_active":"2023-10-08T00:30:44.707647+0000","last_peered":"2023-10-08T00:30:44.707647+0000","last_clean":"2023-10-08T00:30:44.707647+0000","last_became_active":"2023-10-08T00:30:44.707180+0000","last_became_peered":"2023-10-08T00:30:44.707180+0000","last_unstale":"2023-10-08T00:30:44.707647+0000","last_undegraded":"2023-10-08T00:30:44.707647+0000","last_fullsized":"2023-10-08T00:30:44.707647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:45.073156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695493+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:15.178276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705769+0000","last_change":"2023-10-08T00:30:44.705769+0000","last_active":"2023-10-08T00:30:44.705769+0000","last_peered":"2023-10-08T00:30:44.705769+0000","last_clean":"2023-10-08T00:30:44.705769+0000","last_became_active":"2023-10-08T00:30:44.705519+0000","last_became_peered":"2023-10-08T00:30:44.705519+0000","last_unstale":"2023-10-08T00:30:44.705769+0000","last_undegraded":"2023-10-08T00:30:44.705769+0000","last_fullsized":"2023-10-08T00:30:44.705769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:16.315798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696992+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710405+0000","last_change":"2023-10-08T00:30:44.710405+0000","last_active":"2023-10-08T00:30:44.710405+0000","last_peered":"2023-10-08T00:30:44.710405+0000","last_clean":"2023-10-08T00:30:44.710405+0000","last_became_active":"2023-10-08T00:30:44.710098+0000","last_became_peered":"2023-10-08T00:30:44.710098+0000","last_unstale":"2023-10-08T00:30:44.710405+0000","last_undegraded":"2023-10-08T00:30:44.710405+0000","last_fullsized":"2023-10-08T00:30:44.710405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695954+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:34.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708459+0000","last_change":"2023-10-08T00:30:44.708459+0000","last_active":"2023-10-08T00:30:44.708459+0000","last_peered":"2023-10-08T00:30:44.708459+0000","last_clean":"2023-10-08T00:30:44.708459+0000","last_became_active":"2023-10-08T00:30:44.708004+0000","last_became_peered":"2023-10-08T00:30:44.708004+0000","last_unstale":"2023-10-08T00:30:44.708459+0000","last_undegraded":"2023-10-08T00:30:44.708459+0000","last_fullsized":"2023-10-08T00:30:44.708459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702181+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.709060+0000","last_change":"2023-10-08T00:30:44.709060+0000","last_active":"2023-10-08T00:30:44.709060+0000","last_peered":"2023-10-08T00:30:44.709060+0000","last_clean":"2023-10-08T00:30:44.709060+0000","last_became_active":"2023-10-08T00:30:44.708679+0000","last_became_peered":"2023-10-08T00:30:44.708679+0000","last_unstale":"2023-10-08T00:30:44.709060+0000","last_undegraded":"2023-10-08T00:30:44.709060+0000","last_fullsized":"2023-10-08T00:30:44.709060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:25.267932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700204+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705803+0000","last_change":"2023-10-08T00:30:44.705803+0000","last_active":"2023-10-08T00:30:44.705803+0000","last_peered":"2023-10-08T00:30:44.705803+0000","last_clean":"2023-10-08T00:30:44.705803+0000","last_became_active":"2023-10-08T00:30:44.705386+0000","last_became_peered":"2023-10-08T00:30:44.705386+0000","last_unstale":"2023-10-08T00:30:44.705803+0000","last_undegraded":"2023-10-08T00:30:44.705803+0000","last_fullsized":"2023-10-08T00:30:44.705803+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701622+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705265+0000","last_change":"2023-10-08T00:30:44.705265+0000","last_active":"2023-10-08T00:30:44.705265+0000","last_peered":"2023-10-08T00:30:44.705265+0000","last_clean":"2023-10-08T00:30:44.705265+0000","last_became_active":"2023-10-08T00:30:44.704959+0000","last_became_peered":"2023-10-08T00:30:44.704959+0000","last_unstale":"2023-10-08T00:30:44.705265+0000","last_undegraded":"2023-10-08T00:30:44.705265+0000","last_fullsized":"2023-10-08T00:30:44.705265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:33.211544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696185+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:33.788860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713341+0000","last_change":"2023-10-08T00:30:44.713341+0000","last_active":"2023-10-08T00:30:44.713341+0000","last_peered":"2023-10-08T00:30:44.713341+0000","last_clean":"2023-10-08T00:30:44.713341+0000","last_became_active":"2023-10-08T00:30:44.712993+0000","last_became_peered":"2023-10-08T00:30:44.712993+0000","last_unstale":"2023-10-08T00:30:44.713341+0000","last_undegraded":"2023-10-08T00:30:44.713341+0000","last_fullsized":"2023-10-08T00:30:44.713341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:52.621901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695895+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:03.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.703046+0000","last_change":"2023-10-08T00:30:44.703046+0000","last_active":"2023-10-08T00:30:44.703046+0000","last_peered":"2023-10-08T00:30:44.703046+0000","last_clean":"2023-10-08T00:30:44.703046+0000","last_became_active":"2023-10-08T00:30:44.702787+0000","last_became_peered":"2023-10-08T00:30:44.702787+0000","last_unstale":"2023-10-08T00:30:44.703046+0000","last_undegraded":"2023-10-08T00:30:44.703046+0000","last_fullsized":"2023-10-08T00:30:44.703046+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694971+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708004+0000","last_change":"2023-10-08T00:30:44.708004+0000","last_active":"2023-10-08T00:30:44.708004+0000","last_peered":"2023-10-08T00:30:44.708004+0000","last_clean":"2023-10-08T00:30:44.708004+0000","last_became_active":"2023-10-08T00:30:44.707667+0000","last_became_peered":"2023-10-08T00:30:44.707667+0000","last_unstale":"2023-10-08T00:30:44.708004+0000","last_undegraded":"2023-10-08T00:30:44.708004+0000","last_fullsized":"2023-10-08T00:30:44.708004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:00.514679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703257+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714436+0000","last_change":"2023-10-08T00:30:44.714436+0000","last_active":"2023-10-08T00:30:44.714436+0000","last_peered":"2023-10-08T00:30:44.714436+0000","last_clean":"2023-10-08T00:30:44.714436+0000","last_became_active":"2023-10-08T00:30:44.713873+0000","last_became_peered":"2023-10-08T00:30:44.713873+0000","last_unstale":"2023-10-08T00:30:44.714436+0000","last_undegraded":"2023-10-08T00:30:44.714436+0000","last_fullsized":"2023-10-08T00:30:44.714436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:52.850417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703803+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:50:16.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704755+0000","last_change":"2023-10-08T00:30:44.704755+0000","last_active":"2023-10-08T00:30:44.704755+0000","last_peered":"2023-10-08T00:30:44.704755+0000","last_clean":"2023-10-08T00:30:44.704755+0000","last_became_active":"2023-10-08T00:30:44.704481+0000","last_became_peered":"2023-10-08T00:30:44.704481+0000","last_unstale":"2023-10-08T00:30:44.704755+0000","last_undegraded":"2023-10-08T00:30:44.704755+0000","last_fullsized":"2023-10-08T00:30:44.704755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697417+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713430+0000","last_change":"2023-10-08T00:30:44.713430+0000","last_active":"2023-10-08T00:30:44.713430+0000","last_peered":"2023-10-08T00:30:44.713430+0000","last_clean":"2023-10-08T00:30:44.713430+0000","last_became_active":"2023-10-08T00:30:44.712985+0000","last_became_peered":"2023-10-08T00:30:44.712985+0000","last_unstale":"2023-10-08T00:30:44.713430+0000","last_undegraded":"2023-10-08T00:30:44.713430+0000","last_fullsized":"2023-10-08T00:30:44.713430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:36.560087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696096+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:06.067657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704933+0000","last_change":"2023-10-08T00:30:44.704933+0000","last_active":"2023-10-08T00:30:44.704933+0000","last_peered":"2023-10-08T00:30:44.704933+0000","last_clean":"2023-10-08T00:30:44.704933+0000","last_became_active":"2023-10-08T00:30:44.704649+0000","last_became_peered":"2023-10-08T00:30:44.704649+0000","last_unstale":"2023-10-08T00:30:44.704933+0000","last_undegraded":"2023-10-08T00:30:44.704933+0000","last_fullsized":"2023-10-08T00:30:44.704933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:07.459987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700168+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710667+0000","last_change":"2023-10-08T00:30:44.710667+0000","last_active":"2023-10-08T00:30:44.710667+0000","last_peered":"2023-10-08T00:30:44.710667+0000","last_clean":"2023-10-08T00:30:44.710667+0000","last_became_active":"2023-10-08T00:30:44.710406+0000","last_became_peered":"2023-10-08T00:30:44.710406+0000","last_unstale":"2023-10-08T00:30:44.710667+0000","last_undegraded":"2023-10-08T00:30:44.710667+0000","last_fullsized":"2023-10-08T00:30:44.710667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:14.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694034+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.803384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708441+0000","last_change":"2023-10-08T00:30:44.708441+0000","last_active":"2023-10-08T00:30:44.708441+0000","last_peered":"2023-10-08T00:30:44.708441+0000","last_clean":"2023-10-08T00:30:44.708441+0000","last_became_active":"2023-10-08T00:30:44.708130+0000","last_became_peered":"2023-10-08T00:30:44.708130+0000","last_unstale":"2023-10-08T00:30:44.708441+0000","last_undegraded":"2023-10-08T00:30:44.708441+0000","last_fullsized":"2023-10-08T00:30:44.708441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696167+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711775+0000","last_change":"2023-10-08T00:30:44.711775+0000","last_active":"2023-10-08T00:30:44.711775+0000","last_peered":"2023-10-08T00:30:44.711775+0000","last_clean":"2023-10-08T00:30:44.711775+0000","last_became_active":"2023-10-08T00:30:44.711484+0000","last_became_peered":"2023-10-08T00:30:44.711484+0000","last_unstale":"2023-10-08T00:30:44.711775+0000","last_undegraded":"2023-10-08T00:30:44.711775+0000","last_fullsized":"2023-10-08T00:30:44.711775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:33.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694497+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:08:10.152906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711141+0000","last_change":"2023-10-08T00:30:44.711141+0000","last_active":"2023-10-08T00:30:44.711141+0000","last_peered":"2023-10-08T00:30:44.711141+0000","last_clean":"2023-10-08T00:30:44.711141+0000","last_became_active":"2023-10-08T00:30:44.710854+0000","last_became_peered":"2023-10-08T00:30:44.710854+0000","last_unstale":"2023-10-08T00:30:44.711141+0000","last_undegraded":"2023-10-08T00:30:44.711141+0000","last_fullsized":"2023-10-08T00:30:44.711141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:21.892962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704236+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.696634+0000","last_change":"2023-10-08T00:30:44.696634+0000","last_active":"2023-10-08T00:30:44.696634+0000","last_peered":"2023-10-08T00:30:44.696634+0000","last_clean":"2023-10-08T00:30:44.696634+0000","last_became_active":"2023-10-08T00:30:44.696331+0000","last_became_peered":"2023-10-08T00:30:44.696331+0000","last_unstale":"2023-10-08T00:30:44.696634+0000","last_undegraded":"2023-10-08T00:30:44.696634+0000","last_fullsized":"2023-10-08T00:30:44.696634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.888161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:45:06.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.706968+0000","last_change":"2023-10-08T00:30:44.706968+0000","last_active":"2023-10-08T00:30:44.706968+0000","last_peered":"2023-10-08T00:30:44.706968+0000","last_clean":"2023-10-08T00:30:44.706968+0000","last_became_active":"2023-10-08T00:30:44.706703+0000","last_became_peered":"2023-10-08T00:30:44.706703+0000","last_unstale":"2023-10-08T00:30:44.706968+0000","last_undegraded":"2023-10-08T00:30:44.706968+0000","last_fullsized":"2023-10-08T00:30:44.706968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T00:30:43.688195+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:43.688195+0000","last_peered":"2023-10-08T00:30:43.688195+0000","last_clean":"2023-10-08T00:30:43.688195+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:43.688195+0000","last_undegraded":"2023-10-08T00:30:43.688195+0000","last_fullsized":"2023-10-08T00:30:43.688195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298932,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072908,"statfs":{"total":96636764160,"available":96330657792,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.496}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.435}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.254},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.372}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.63}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.37},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.23300000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.77200000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.5}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:49.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:49.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.986+0000 7f35a162f700 1 Processor -- start 2023-10-08T00:30:49.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.986+0000 7f35a162f700 1 -- start start 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a162f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 0x7f359c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a162f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f359c15d230 0x7f359c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a162f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c15dbd0 con 0x7f359c1597f0 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a162f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0b2980 con 0x7f359c15d230 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a162f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0b11d0 con 0x7f359c159420 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f359bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 0x7f359c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a0e2e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f359c15d230 0x7f359c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f359bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 0x7f359c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:59396/0 (socket says 172.21.15.22:59396) 2023-10-08T00:30:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f359bfff700 1 -- 172.21.15.22:0/687979420 learned_addr learned my addr 172.21.15.22:0/687979420 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.987+0000 7f35a0e2e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f359c15d230 0x7f359c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:34168/0 (socket says 172.21.15.22:34168) 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f35a0e2e700 1 -- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 msgr2=0x7f359c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f35a0e2e700 1 --2- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 0x7f359c0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f35a0e2e700 1 -- 172.21.15.22:0/687979420 >> v1:172.21.15.192:6789/0 conn(0x7f359c1597f0 legacy=0x7f359c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f35a0e2e700 1 -- 172.21.15.22:0/687979420 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0b14b0 con 0x7f359c15d230 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f359affd700 1 -- 172.21.15.22:0/687979420 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974251497 0 0) 0x7f358c001110 con 0x7f359c1597f0 2023-10-08T00:30:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f359bfff700 1 --2- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 0x7f359c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f35a0e2e700 1 --2- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c15d230 0x7f359c15d690 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3594009e60 tx=0x7f3594009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187fe28405e160f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f359affd700 1 -- 172.21.15.22:0/687979420 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400e070 con 0x7f359c15d230 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f359affd700 1 -- 172.21.15.22:0/687979420 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400bb60 con 0x7f359c15d230 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.988+0000 7f359affd700 1 -- 172.21.15.22:0/687979420 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594012430 con 0x7f359c15d230 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 -- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c15d230 msgr2=0x7f359c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 --2- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c15d230 0x7f359c15d690 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3594009e60 tx=0x7f3594009780 comp rx=0 tx=0).stop 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 -- 172.21.15.22:0/687979420 shutdown_connections 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 --2- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c15d230 0x7f359c15d690 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 --2- 172.21.15.22:0/687979420 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c159420 0x7f359c0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 -- 172.21.15.22:0/687979420 >> 172.21.15.22:0/687979420 conn(0x7f359c0d0660 msgr2=0x7f359c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:49.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 -- 172.21.15.22:0/687979420 shutdown_connections 2023-10-08T00:30:49.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.989+0000 7f35a162f700 1 -- 172.21.15.22:0/687979420 wait complete. 2023-10-08T00:30:49.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.990+0000 7f35a162f700 1 Processor -- start 2023-10-08T00:30:49.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.990+0000 7f35a162f700 1 -- start start 2023-10-08T00:30:49.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a162f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c159420 0x7f359c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a162f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c1597f0 0x7f359c0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a162f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 0x7f359c0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:49.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a162f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c15a910 con 0x7f359c15d230 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a162f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c159d00 con 0x7f359c159420 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a162f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c159fe0 con 0x7f359c1597f0 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 0x7f359c0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 0x7f359c0b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54726/0 (socket says 172.21.15.22:54726) 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 -- 172.21.15.22:0/1051800766 learned_addr learned my addr 172.21.15.22:0/1051800766 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f359bfff700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c159420 0x7f359c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f359b7fe700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c1597f0 0x7f359c0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 -- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c1597f0 msgr2=0x7f359c0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c1597f0 0x7f359c0b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 -- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c159420 msgr2=0x7f359c15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c159420 0x7f359c15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 -- 172.21.15.22:0/1051800766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840094f0 con 0x7f359c15d230 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.991+0000 7f35a0e2e700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 0x7f359c0b5e50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f359c089340 tx=0x7f3594019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.992+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594012ea0 con 0x7f359c15d230 2023-10-08T00:30:49.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.992+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594027470 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.992+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3594009a20 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.992+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594027830 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.992+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c15a5a0 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.993+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c15aa80 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.993+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3594024070 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.993+0000 7f3593fff700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f357c067200 0x7f357c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.993+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35940870d0 con 0x7f359c15d230 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.994+0000 7f359bfff700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f357c067200 0x7f357c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.994+0000 7f359bfff700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f357c067200 0x7f357c0696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3584006d20 tx=0x7f3584009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:49.998+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3594053fb0 con 0x7f359c15d230 2023-10-08T00:30:50.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.186+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f359c04c3c0 con 0x7f357c067200 2023-10-08T00:30:50.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.195+0000 7f3593fff700 1 -- 172.21.15.22:0/1051800766 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286549 (secure 0 0 0) 0x7f359c04c3c0 con 0x7f357c067200 2023-10-08T00:30:50.201 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:50.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f357c067200 msgr2=0x7f357c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f357c067200 0x7f357c0696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3584006d20 tx=0x7f3584009250 comp rx=0 tx=0).stop 2023-10-08T00:30:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 msgr2=0x7f359c0b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 0x7f359c0b5e50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f359c089340 tx=0x7f3594019000 comp rx=0 tx=0).stop 2023-10-08T00:30:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 shutdown_connections 2023-10-08T00:30:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f359c15d230 0x7f359c0b5e50 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f359c159420 0x7f359c15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f357c067200 0x7f357c0696b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 --2- 172.21.15.22:0/1051800766 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f359c1597f0 0x7f359c0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 >> 172.21.15.22:0/1051800766 conn(0x7f359c0d0660 msgr2=0x7f359c0d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:50.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 shutdown_connections 2023-10-08T00:30:50.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.198+0000 7f35a162f700 1 -- 172.21.15.22:0/1051800766 wait complete. 2023-10-08T00:30:50.209 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:50.211 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2023-10-08T00:30:48.468198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404360,"kb_used_data":9672,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752570360,"statfs":{"total":773094113280,"available":770632048640,"internally_reserved":0,"allocated":9904128,"data_stored":4922888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.782514"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697851+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704294+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.223595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695760+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699693+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:53.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700320+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700826+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701164+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:46.910499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696840+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697024+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700717+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702970+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697139+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702419+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698846+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:37:21.022626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703777+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700317+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698009+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703190+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698148+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:49.590987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696568+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697993+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:09.354869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697898+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694404+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699830+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702690+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703350+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:14.664818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702484+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:08.057908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703162+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702560+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:56.250315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696658+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:20.219079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699364+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695714+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696551+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:38:06.462335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713193+0000","last_change":"2023-10-08T00:30:44.713193+0000","last_active":"2023-10-08T00:30:44.713193+0000","last_peered":"2023-10-08T00:30:44.713193+0000","last_clean":"2023-10-08T00:30:44.713193+0000","last_became_active":"2023-10-08T00:30:44.712908+0000","last_became_peered":"2023-10-08T00:30:44.712908+0000","last_unstale":"2023-10-08T00:30:44.713193+0000","last_undegraded":"2023-10-08T00:30:44.713193+0000","last_fullsized":"2023-10-08T00:30:44.713193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702147+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711311+0000","last_change":"2023-10-08T00:30:44.711311+0000","last_active":"2023-10-08T00:30:44.711311+0000","last_peered":"2023-10-08T00:30:44.711311+0000","last_clean":"2023-10-08T00:30:44.711311+0000","last_became_active":"2023-10-08T00:30:44.711061+0000","last_became_peered":"2023-10-08T00:30:44.711061+0000","last_unstale":"2023-10-08T00:30:44.711311+0000","last_undegraded":"2023-10-08T00:30:44.711311+0000","last_fullsized":"2023-10-08T00:30:44.711311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696535+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:26.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708464+0000","last_change":"2023-10-08T00:30:44.708464+0000","last_active":"2023-10-08T00:30:44.708464+0000","last_peered":"2023-10-08T00:30:44.708464+0000","last_clean":"2023-10-08T00:30:44.708464+0000","last_became_active":"2023-10-08T00:30:44.708106+0000","last_became_peered":"2023-10-08T00:30:44.708106+0000","last_unstale":"2023-10-08T00:30:44.708464+0000","last_undegraded":"2023-10-08T00:30:44.708464+0000","last_fullsized":"2023-10-08T00:30:44.708464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:35.787697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696119+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708535+0000","last_change":"2023-10-08T00:30:44.708535+0000","last_active":"2023-10-08T00:30:44.708535+0000","last_peered":"2023-10-08T00:30:44.708535+0000","last_clean":"2023-10-08T00:30:44.708535+0000","last_became_active":"2023-10-08T00:30:44.708164+0000","last_became_peered":"2023-10-08T00:30:44.708164+0000","last_unstale":"2023-10-08T00:30:44.708535+0000","last_undegraded":"2023-10-08T00:30:44.708535+0000","last_fullsized":"2023-10-08T00:30:44.708535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:45.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699473+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707659+0000","last_change":"2023-10-08T00:30:44.707659+0000","last_active":"2023-10-08T00:30:44.707659+0000","last_peered":"2023-10-08T00:30:44.707659+0000","last_clean":"2023-10-08T00:30:44.707659+0000","last_became_active":"2023-10-08T00:30:44.707397+0000","last_became_peered":"2023-10-08T00:30:44.707397+0000","last_unstale":"2023-10-08T00:30:44.707659+0000","last_undegraded":"2023-10-08T00:30:44.707659+0000","last_fullsized":"2023-10-08T00:30:44.707659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:46.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700873+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714388+0000","last_change":"2023-10-08T00:30:44.714388+0000","last_active":"2023-10-08T00:30:44.714388+0000","last_peered":"2023-10-08T00:30:44.714388+0000","last_clean":"2023-10-08T00:30:44.714388+0000","last_became_active":"2023-10-08T00:30:44.713881+0000","last_became_peered":"2023-10-08T00:30:44.713881+0000","last_unstale":"2023-10-08T00:30:44.714388+0000","last_undegraded":"2023-10-08T00:30:44.714388+0000","last_fullsized":"2023-10-08T00:30:44.714388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:17.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700994+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713361+0000","last_change":"2023-10-08T00:30:44.713361+0000","last_active":"2023-10-08T00:30:44.713361+0000","last_peered":"2023-10-08T00:30:44.713361+0000","last_clean":"2023-10-08T00:30:44.713361+0000","last_became_active":"2023-10-08T00:30:44.713127+0000","last_became_peered":"2023-10-08T00:30:44.713127+0000","last_unstale":"2023-10-08T00:30:44.713361+0000","last_undegraded":"2023-10-08T00:30:44.713361+0000","last_fullsized":"2023-10-08T00:30:44.713361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695718+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708243+0000","last_change":"2023-10-08T00:30:44.708243+0000","last_active":"2023-10-08T00:30:44.708243+0000","last_peered":"2023-10-08T00:30:44.708243+0000","last_clean":"2023-10-08T00:30:44.708243+0000","last_became_active":"2023-10-08T00:30:44.707712+0000","last_became_peered":"2023-10-08T00:30:44.707712+0000","last_unstale":"2023-10-08T00:30:44.708243+0000","last_undegraded":"2023-10-08T00:30:44.708243+0000","last_fullsized":"2023-10-08T00:30:44.708243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:20:48.812143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698566+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:30.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704305+0000","last_change":"2023-10-08T00:30:44.704305+0000","last_active":"2023-10-08T00:30:44.704305+0000","last_peered":"2023-10-08T00:30:44.704305+0000","last_clean":"2023-10-08T00:30:44.704305+0000","last_became_active":"2023-10-08T00:30:44.704022+0000","last_became_peered":"2023-10-08T00:30:44.704022+0000","last_unstale":"2023-10-08T00:30:44.704305+0000","last_undegraded":"2023-10-08T00:30:44.704305+0000","last_fullsized":"2023-10-08T00:30:44.704305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:11.800190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714717+0000","last_change":"2023-10-08T00:30:44.714717+0000","last_active":"2023-10-08T00:30:44.714717+0000","last_peered":"2023-10-08T00:30:44.714717+0000","last_clean":"2023-10-08T00:30:44.714717+0000","last_became_active":"2023-10-08T00:30:44.714309+0000","last_became_peered":"2023-10-08T00:30:44.714309+0000","last_unstale":"2023-10-08T00:30:44.714717+0000","last_undegraded":"2023-10-08T00:30:44.714717+0000","last_fullsized":"2023-10-08T00:30:44.714717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:41.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701179+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710363+0000","last_change":"2023-10-08T00:30:44.710363+0000","last_active":"2023-10-08T00:30:44.710363+0000","last_peered":"2023-10-08T00:30:44.710363+0000","last_clean":"2023-10-08T00:30:44.710363+0000","last_became_active":"2023-10-08T00:30:44.710061+0000","last_became_peered":"2023-10-08T00:30:44.710061+0000","last_unstale":"2023-10-08T00:30:44.710363+0000","last_undegraded":"2023-10-08T00:30:44.710363+0000","last_fullsized":"2023-10-08T00:30:44.710363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:25.939919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702056+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:11.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705064+0000","last_change":"2023-10-08T00:30:44.705064+0000","last_active":"2023-10-08T00:30:44.705064+0000","last_peered":"2023-10-08T00:30:44.705064+0000","last_clean":"2023-10-08T00:30:44.705064+0000","last_became_active":"2023-10-08T00:30:44.704781+0000","last_became_peered":"2023-10-08T00:30:44.704781+0000","last_unstale":"2023-10-08T00:30:44.705064+0000","last_undegraded":"2023-10-08T00:30:44.705064+0000","last_fullsized":"2023-10-08T00:30:44.705064+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:05.062638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699080+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707647+0000","last_change":"2023-10-08T00:30:44.707647+0000","last_active":"2023-10-08T00:30:44.707647+0000","last_peered":"2023-10-08T00:30:44.707647+0000","last_clean":"2023-10-08T00:30:44.707647+0000","last_became_active":"2023-10-08T00:30:44.707180+0000","last_became_peered":"2023-10-08T00:30:44.707180+0000","last_unstale":"2023-10-08T00:30:44.707647+0000","last_undegraded":"2023-10-08T00:30:44.707647+0000","last_fullsized":"2023-10-08T00:30:44.707647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:45.073156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695493+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:15.178276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705769+0000","last_change":"2023-10-08T00:30:44.705769+0000","last_active":"2023-10-08T00:30:44.705769+0000","last_peered":"2023-10-08T00:30:44.705769+0000","last_clean":"2023-10-08T00:30:44.705769+0000","last_became_active":"2023-10-08T00:30:44.705519+0000","last_became_peered":"2023-10-08T00:30:44.705519+0000","last_unstale":"2023-10-08T00:30:44.705769+0000","last_undegraded":"2023-10-08T00:30:44.705769+0000","last_fullsized":"2023-10-08T00:30:44.705769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:16.315798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696992+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710405+0000","last_change":"2023-10-08T00:30:44.710405+0000","last_active":"2023-10-08T00:30:44.710405+0000","last_peered":"2023-10-08T00:30:44.710405+0000","last_clean":"2023-10-08T00:30:44.710405+0000","last_became_active":"2023-10-08T00:30:44.710098+0000","last_became_peered":"2023-10-08T00:30:44.710098+0000","last_unstale":"2023-10-08T00:30:44.710405+0000","last_undegraded":"2023-10-08T00:30:44.710405+0000","last_fullsized":"2023-10-08T00:30:44.710405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695954+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:34.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708459+0000","last_change":"2023-10-08T00:30:44.708459+0000","last_active":"2023-10-08T00:30:44.708459+0000","last_peered":"2023-10-08T00:30:44.708459+0000","last_clean":"2023-10-08T00:30:44.708459+0000","last_became_active":"2023-10-08T00:30:44.708004+0000","last_became_peered":"2023-10-08T00:30:44.708004+0000","last_unstale":"2023-10-08T00:30:44.708459+0000","last_undegraded":"2023-10-08T00:30:44.708459+0000","last_fullsized":"2023-10-08T00:30:44.708459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702181+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.709060+0000","last_change":"2023-10-08T00:30:44.709060+0000","last_active":"2023-10-08T00:30:44.709060+0000","last_peered":"2023-10-08T00:30:44.709060+0000","last_clean":"2023-10-08T00:30:44.709060+0000","last_became_active":"2023-10-08T00:30:44.708679+0000","last_became_peered":"2023-10-08T00:30:44.708679+0000","last_unstale":"2023-10-08T00:30:44.709060+0000","last_undegraded":"2023-10-08T00:30:44.709060+0000","last_fullsized":"2023-10-08T00:30:44.709060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:25.267932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700204+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705803+0000","last_change":"2023-10-08T00:30:44.705803+0000","last_active":"2023-10-08T00:30:44.705803+0000","last_peered":"2023-10-08T00:30:44.705803+0000","last_clean":"2023-10-08T00:30:44.705803+0000","last_became_active":"2023-10-08T00:30:44.705386+0000","last_became_peered":"2023-10-08T00:30:44.705386+0000","last_unstale":"2023-10-08T00:30:44.705803+0000","last_undegraded":"2023-10-08T00:30:44.705803+0000","last_fullsized":"2023-10-08T00:30:44.705803+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701622+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705265+0000","last_change":"2023-10-08T00:30:44.705265+0000","last_active":"2023-10-08T00:30:44.705265+0000","last_peered":"2023-10-08T00:30:44.705265+0000","last_clean":"2023-10-08T00:30:44.705265+0000","last_became_active":"2023-10-08T00:30:44.704959+0000","last_became_peered":"2023-10-08T00:30:44.704959+0000","last_unstale":"2023-10-08T00:30:44.705265+0000","last_undegraded":"2023-10-08T00:30:44.705265+0000","last_fullsized":"2023-10-08T00:30:44.705265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:33.211544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696185+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:33.788860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713341+0000","last_change":"2023-10-08T00:30:44.713341+0000","last_active":"2023-10-08T00:30:44.713341+0000","last_peered":"2023-10-08T00:30:44.713341+0000","last_clean":"2023-10-08T00:30:44.713341+0000","last_became_active":"2023-10-08T00:30:44.712993+0000","last_became_peered":"2023-10-08T00:30:44.712993+0000","last_unstale":"2023-10-08T00:30:44.713341+0000","last_undegraded":"2023-10-08T00:30:44.713341+0000","last_fullsized":"2023-10-08T00:30:44.713341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:52.621901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695895+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:03.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.703046+0000","last_change":"2023-10-08T00:30:44.703046+0000","last_active":"2023-10-08T00:30:44.703046+0000","last_peered":"2023-10-08T00:30:44.703046+0000","last_clean":"2023-10-08T00:30:44.703046+0000","last_became_active":"2023-10-08T00:30:44.702787+0000","last_became_peered":"2023-10-08T00:30:44.702787+0000","last_unstale":"2023-10-08T00:30:44.703046+0000","last_undegraded":"2023-10-08T00:30:44.703046+0000","last_fullsized":"2023-10-08T00:30:44.703046+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694971+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708004+0000","last_change":"2023-10-08T00:30:44.708004+0000","last_active":"2023-10-08T00:30:44.708004+0000","last_peered":"2023-10-08T00:30:44.708004+0000","last_clean":"2023-10-08T00:30:44.708004+0000","last_became_active":"2023-10-08T00:30:44.707667+0000","last_became_peered":"2023-10-08T00:30:44.707667+0000","last_unstale":"2023-10-08T00:30:44.708004+0000","last_undegraded":"2023-10-08T00:30:44.708004+0000","last_fullsized":"2023-10-08T00:30:44.708004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:00.514679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703257+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714436+0000","last_change":"2023-10-08T00:30:44.714436+0000","last_active":"2023-10-08T00:30:44.714436+0000","last_peered":"2023-10-08T00:30:44.714436+0000","last_clean":"2023-10-08T00:30:44.714436+0000","last_became_active":"2023-10-08T00:30:44.713873+0000","last_became_peered":"2023-10-08T00:30:44.713873+0000","last_unstale":"2023-10-08T00:30:44.714436+0000","last_undegraded":"2023-10-08T00:30:44.714436+0000","last_fullsized":"2023-10-08T00:30:44.714436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:52.850417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703803+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:50:16.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704755+0000","last_change":"2023-10-08T00:30:44.704755+0000","last_active":"2023-10-08T00:30:44.704755+0000","last_peered":"2023-10-08T00:30:44.704755+0000","last_clean":"2023-10-08T00:30:44.704755+0000","last_became_active":"2023-10-08T00:30:44.704481+0000","last_became_peered":"2023-10-08T00:30:44.704481+0000","last_unstale":"2023-10-08T00:30:44.704755+0000","last_undegraded":"2023-10-08T00:30:44.704755+0000","last_fullsized":"2023-10-08T00:30:44.704755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697417+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713430+0000","last_change":"2023-10-08T00:30:44.713430+0000","last_active":"2023-10-08T00:30:44.713430+0000","last_peered":"2023-10-08T00:30:44.713430+0000","last_clean":"2023-10-08T00:30:44.713430+0000","last_became_active":"2023-10-08T00:30:44.712985+0000","last_became_peered":"2023-10-08T00:30:44.712985+0000","last_unstale":"2023-10-08T00:30:44.713430+0000","last_undegraded":"2023-10-08T00:30:44.713430+0000","last_fullsized":"2023-10-08T00:30:44.713430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:36.560087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696096+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:06.067657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704933+0000","last_change":"2023-10-08T00:30:44.704933+0000","last_active":"2023-10-08T00:30:44.704933+0000","last_peered":"2023-10-08T00:30:44.704933+0000","last_clean":"2023-10-08T00:30:44.704933+0000","last_became_active":"2023-10-08T00:30:44.704649+0000","last_became_peered":"2023-10-08T00:30:44.704649+0000","last_unstale":"2023-10-08T00:30:44.704933+0000","last_undegraded":"2023-10-08T00:30:44.704933+0000","last_fullsized":"2023-10-08T00:30:44.704933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:07.459987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700168+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710667+0000","last_change":"2023-10-08T00:30:44.710667+0000","last_active":"2023-10-08T00:30:44.710667+0000","last_peered":"2023-10-08T00:30:44.710667+0000","last_clean":"2023-10-08T00:30:44.710667+0000","last_became_active":"2023-10-08T00:30:44.710406+0000","last_became_peered":"2023-10-08T00:30:44.710406+0000","last_unstale":"2023-10-08T00:30:44.710667+0000","last_undegraded":"2023-10-08T00:30:44.710667+0000","last_fullsized":"2023-10-08T00:30:44.710667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:14.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694034+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.803384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708441+0000","last_change":"2023-10-08T00:30:44.708441+0000","last_active":"2023-10-08T00:30:44.708441+0000","last_peered":"2023-10-08T00:30:44.708441+0000","last_clean":"2023-10-08T00:30:44.708441+0000","last_became_active":"2023-10-08T00:30:44.708130+0000","last_became_peered":"2023-10-08T00:30:44.708130+0000","last_unstale":"2023-10-08T00:30:44.708441+0000","last_undegraded":"2023-10-08T00:30:44.708441+0000","last_fullsized":"2023-10-08T00:30:44.708441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696167+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711775+0000","last_change":"2023-10-08T00:30:44.711775+0000","last_active":"2023-10-08T00:30:44.711775+0000","last_peered":"2023-10-08T00:30:44.711775+0000","last_clean":"2023-10-08T00:30:44.711775+0000","last_became_active":"2023-10-08T00:30:44.711484+0000","last_became_peered":"2023-10-08T00:30:44.711484+0000","last_unstale":"2023-10-08T00:30:44.711775+0000","last_undegraded":"2023-10-08T00:30:44.711775+0000","last_fullsized":"2023-10-08T00:30:44.711775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:33.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694497+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:08:10.152906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711141+0000","last_change":"2023-10-08T00:30:44.711141+0000","last_active":"2023-10-08T00:30:44.711141+0000","last_peered":"2023-10-08T00:30:44.711141+0000","last_clean":"2023-10-08T00:30:44.711141+0000","last_became_active":"2023-10-08T00:30:44.710854+0000","last_became_peered":"2023-10-08T00:30:44.710854+0000","last_unstale":"2023-10-08T00:30:44.711141+0000","last_undegraded":"2023-10-08T00:30:44.711141+0000","last_fullsized":"2023-10-08T00:30:44.711141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:21.892962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704236+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.696634+0000","last_change":"2023-10-08T00:30:44.696634+0000","last_active":"2023-10-08T00:30:44.696634+0000","last_peered":"2023-10-08T00:30:44.696634+0000","last_clean":"2023-10-08T00:30:44.696634+0000","last_became_active":"2023-10-08T00:30:44.696331+0000","last_became_peered":"2023-10-08T00:30:44.696331+0000","last_unstale":"2023-10-08T00:30:44.696634+0000","last_undegraded":"2023-10-08T00:30:44.696634+0000","last_fullsized":"2023-10-08T00:30:44.696634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.888161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:45:06.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.706968+0000","last_change":"2023-10-08T00:30:44.706968+0000","last_active":"2023-10-08T00:30:44.706968+0000","last_peered":"2023-10-08T00:30:44.706968+0000","last_clean":"2023-10-08T00:30:44.706968+0000","last_became_active":"2023-10-08T00:30:44.706703+0000","last_became_peered":"2023-10-08T00:30:44.706703+0000","last_unstale":"2023-10-08T00:30:44.706968+0000","last_undegraded":"2023-10-08T00:30:44.706968+0000","last_fullsized":"2023-10-08T00:30:44.706968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T00:30:43.688195+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:43.688195+0000","last_peered":"2023-10-08T00:30:43.688195+0000","last_clean":"2023-10-08T00:30:43.688195+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:43.688195+0000","last_undegraded":"2023-10-08T00:30:43.688195+0000","last_fullsized":"2023-10-08T00:30:43.688195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298932,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072908,"statfs":{"total":96636764160,"available":96330657792,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.496}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.435}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.254},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.372}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.63}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.37},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.23300000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.77200000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.5}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:50.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.374+0000 7f470e49c700 1 Processor -- start 2023-10-08T00:30:50.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.374+0000 7f470e49c700 1 -- start start 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f470e49c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470806bcd0 0x7f47080caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f470e49c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f470806c0a0 0x7f470815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f470e49c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470815d7e0 con 0x7f470815df50 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f470e49c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470815dac0 con 0x7f470806c0a0 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f470e49c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470815aa30 con 0x7f470806bcd0 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f4707fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470806bcd0 0x7f47080caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.375+0000 7f47077fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f470806c0a0 0x7f470815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f470ca39700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f470815df50 0x7f47080c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:43588/0 (socket says 172.21.15.22:43588) 2023-10-08T00:30:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f470ca39700 1 -- 172.21.15.22:0/2657762953 learned_addr learned my addr 172.21.15.22:0/2657762953 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4707fff700 1 -- 172.21.15.22:0/2657762953 >> v2:172.21.15.192:3300/0 conn(0x7f470806c0a0 msgr2=0x7f470815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:50.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4707fff700 1 --2- 172.21.15.22:0/2657762953 >> v2:172.21.15.192:3300/0 conn(0x7f470806c0a0 0x7f470815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4707fff700 1 -- 172.21.15.22:0/2657762953 >> v1:172.21.15.192:6789/0 conn(0x7f470815df50 legacy=0x7f47080c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4706ffd700 1 -- 172.21.15.22:0/2657762953 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381519686 0 0) 0x7f470815d7e0 con 0x7f470815df50 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4707fff700 1 -- 172.21.15.22:0/2657762953 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470815ad10 con 0x7f470806bcd0 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4707fff700 1 --2- 172.21.15.22:0/2657762953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470806bcd0 0x7f47080caa90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098e0 tx=0x7f46f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d722e4a90db7c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4706ffd700 1 -- 172.21.15.22:0/2657762953 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000b640 con 0x7f470806bcd0 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4706ffd700 1 -- 172.21.15.22:0/2657762953 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000b7a0 con 0x7f470806bcd0 2023-10-08T00:30:50.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.376+0000 7f4706ffd700 1 -- 172.21.15.22:0/2657762953 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000bb40 con 0x7f470806bcd0 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 -- 172.21.15.22:0/2657762953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470806bcd0 msgr2=0x7f47080caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 --2- 172.21.15.22:0/2657762953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470806bcd0 0x7f47080caa90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f46f00098e0 tx=0x7f46f00091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 -- 172.21.15.22:0/2657762953 shutdown_connections 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 --2- 172.21.15.22:0/2657762953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470806bcd0 0x7f47080caa90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 --2- 172.21.15.22:0/2657762953 >> v2:172.21.15.192:3300/0 conn(0x7f470806c0a0 0x7f470815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 -- 172.21.15.22:0/2657762953 >> 172.21.15.22:0/2657762953 conn(0x7f47080ce600 msgr2=0x7f47080cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 -- 172.21.15.22:0/2657762953 shutdown_connections 2023-10-08T00:30:50.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.377+0000 7f470e49c700 1 -- 172.21.15.22:0/2657762953 wait complete. 2023-10-08T00:30:50.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.378+0000 7f470e49c700 1 Processor -- start 2023-10-08T00:30:50.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.378+0000 7f470e49c700 1 -- start start 2023-10-08T00:30:50.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470e49c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 0x7f47080b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470e49c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f470806c0a0 0x7f470816a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470e49c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470815df50 0x7f470814f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470e49c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470816a260 con 0x7f470806bcd0 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470e49c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b2610 con 0x7f470806c0a0 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470e49c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b28f0 con 0x7f470815df50 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f4707fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 0x7f47080b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f4707fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 0x7f47080b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54740/0 (socket says 172.21.15.22:54740) 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f4707fff700 1 -- 172.21.15.22:0/2379260296 learned_addr learned my addr 172.21.15.22:0/2379260296 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f47077fe700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f470806c0a0 0x7f470816a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.379+0000 7f470ca39700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470815df50 0x7f470814f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f4707fff700 1 -- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470815df50 msgr2=0x7f470814f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f4707fff700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470815df50 0x7f470814f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f4707fff700 1 -- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f470806c0a0 msgr2=0x7f470816a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f4707fff700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f470806c0a0 0x7f470816a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f4707fff700 1 -- 172.21.15.22:0/2379260296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0009420 con 0x7f470806bcd0 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f4707fff700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 0x7f47080b1410 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f46f00093f0 tx=0x7f46f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0000bc0 con 0x7f470806bcd0 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f000b910 con 0x7f470806bcd0 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080b2bd0 con 0x7f470806bcd0 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0000d20 con 0x7f470806bcd0 2023-10-08T00:30:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.380+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47080b1950 con 0x7f470806bcd0 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.381+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470816a040 con 0x7f470806bcd0 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.381+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f46f0023070 con 0x7f470806bcd0 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.382+0000 7f46fffff700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46e8067200 0x7f46e80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.382+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46f0085ac0 con 0x7f470806bcd0 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.382+0000 7f47077fe700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46e8067200 0x7f46e80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.382+0000 7f47077fe700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46e8067200 0x7f46e80696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009db0 tx=0x7f46f80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.386+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46f00529e0 con 0x7f470806bcd0 2023-10-08T00:30:50.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.575+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f470816a3a0 con 0x7f46e8067200 2023-10-08T00:30:50.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.583+0000 7f46fffff700 1 -- 172.21.15.22:0/2379260296 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286549 (secure 0 0 0) 0x7f46f8011a50 con 0x7f46e8067200 2023-10-08T00:30:50.585 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46e8067200 msgr2=0x7f46e80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46e8067200 0x7f46e80696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009db0 tx=0x7f46f80091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 msgr2=0x7f47080b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 0x7f47080b1410 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f46f00093f0 tx=0x7f46f0017000 comp rx=0 tx=0).stop 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 shutdown_connections 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46e8067200 0x7f46e80696b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f470815df50 0x7f470814f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f470806bcd0 0x7f47080b1410 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 --2- 172.21.15.22:0/2379260296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f470806c0a0 0x7f470816a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 >> 172.21.15.22:0/2379260296 conn(0x7f47080ce600 msgr2=0x7f470806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:50.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 shutdown_connections 2023-10-08T00:30:50.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.586+0000 7f470e49c700 1 -- 172.21.15.22:0/2379260296 wait complete. 2023-10-08T00:30:50.591 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:50.600 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2023-10-08T00:30:50.468660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404360,"kb_used_data":9672,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752570360,"statfs":{"total":773094113280,"available":770632048640,"internally_reserved":0,"allocated":9904128,"data_stored":4922888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001261"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697851+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704294+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.223595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695760+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699693+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:53.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700320+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700826+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701164+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:46.910499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696840+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697024+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700717+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702970+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697139+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702419+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698846+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:37:21.022626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703777+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700317+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698009+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703190+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698148+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:49.590987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696568+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697993+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:09.354869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697898+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694404+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699830+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702690+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703350+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:14.664818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702484+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:08.057908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703162+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702560+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:56.250315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696658+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:20.219079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699364+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695714+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696551+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:38:06.462335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713193+0000","last_change":"2023-10-08T00:30:44.713193+0000","last_active":"2023-10-08T00:30:44.713193+0000","last_peered":"2023-10-08T00:30:44.713193+0000","last_clean":"2023-10-08T00:30:44.713193+0000","last_became_active":"2023-10-08T00:30:44.712908+0000","last_became_peered":"2023-10-08T00:30:44.712908+0000","last_unstale":"2023-10-08T00:30:44.713193+0000","last_undegraded":"2023-10-08T00:30:44.713193+0000","last_fullsized":"2023-10-08T00:30:44.713193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702147+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711311+0000","last_change":"2023-10-08T00:30:44.711311+0000","last_active":"2023-10-08T00:30:44.711311+0000","last_peered":"2023-10-08T00:30:44.711311+0000","last_clean":"2023-10-08T00:30:44.711311+0000","last_became_active":"2023-10-08T00:30:44.711061+0000","last_became_peered":"2023-10-08T00:30:44.711061+0000","last_unstale":"2023-10-08T00:30:44.711311+0000","last_undegraded":"2023-10-08T00:30:44.711311+0000","last_fullsized":"2023-10-08T00:30:44.711311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696535+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:26.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708464+0000","last_change":"2023-10-08T00:30:44.708464+0000","last_active":"2023-10-08T00:30:44.708464+0000","last_peered":"2023-10-08T00:30:44.708464+0000","last_clean":"2023-10-08T00:30:44.708464+0000","last_became_active":"2023-10-08T00:30:44.708106+0000","last_became_peered":"2023-10-08T00:30:44.708106+0000","last_unstale":"2023-10-08T00:30:44.708464+0000","last_undegraded":"2023-10-08T00:30:44.708464+0000","last_fullsized":"2023-10-08T00:30:44.708464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:35.787697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696119+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708535+0000","last_change":"2023-10-08T00:30:44.708535+0000","last_active":"2023-10-08T00:30:44.708535+0000","last_peered":"2023-10-08T00:30:44.708535+0000","last_clean":"2023-10-08T00:30:44.708535+0000","last_became_active":"2023-10-08T00:30:44.708164+0000","last_became_peered":"2023-10-08T00:30:44.708164+0000","last_unstale":"2023-10-08T00:30:44.708535+0000","last_undegraded":"2023-10-08T00:30:44.708535+0000","last_fullsized":"2023-10-08T00:30:44.708535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:45.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699473+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707659+0000","last_change":"2023-10-08T00:30:44.707659+0000","last_active":"2023-10-08T00:30:44.707659+0000","last_peered":"2023-10-08T00:30:44.707659+0000","last_clean":"2023-10-08T00:30:44.707659+0000","last_became_active":"2023-10-08T00:30:44.707397+0000","last_became_peered":"2023-10-08T00:30:44.707397+0000","last_unstale":"2023-10-08T00:30:44.707659+0000","last_undegraded":"2023-10-08T00:30:44.707659+0000","last_fullsized":"2023-10-08T00:30:44.707659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:46.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700873+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714388+0000","last_change":"2023-10-08T00:30:44.714388+0000","last_active":"2023-10-08T00:30:44.714388+0000","last_peered":"2023-10-08T00:30:44.714388+0000","last_clean":"2023-10-08T00:30:44.714388+0000","last_became_active":"2023-10-08T00:30:44.713881+0000","last_became_peered":"2023-10-08T00:30:44.713881+0000","last_unstale":"2023-10-08T00:30:44.714388+0000","last_undegraded":"2023-10-08T00:30:44.714388+0000","last_fullsized":"2023-10-08T00:30:44.714388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:17.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700994+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713361+0000","last_change":"2023-10-08T00:30:44.713361+0000","last_active":"2023-10-08T00:30:44.713361+0000","last_peered":"2023-10-08T00:30:44.713361+0000","last_clean":"2023-10-08T00:30:44.713361+0000","last_became_active":"2023-10-08T00:30:44.713127+0000","last_became_peered":"2023-10-08T00:30:44.713127+0000","last_unstale":"2023-10-08T00:30:44.713361+0000","last_undegraded":"2023-10-08T00:30:44.713361+0000","last_fullsized":"2023-10-08T00:30:44.713361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695718+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708243+0000","last_change":"2023-10-08T00:30:44.708243+0000","last_active":"2023-10-08T00:30:44.708243+0000","last_peered":"2023-10-08T00:30:44.708243+0000","last_clean":"2023-10-08T00:30:44.708243+0000","last_became_active":"2023-10-08T00:30:44.707712+0000","last_became_peered":"2023-10-08T00:30:44.707712+0000","last_unstale":"2023-10-08T00:30:44.708243+0000","last_undegraded":"2023-10-08T00:30:44.708243+0000","last_fullsized":"2023-10-08T00:30:44.708243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:20:48.812143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698566+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:30.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704305+0000","last_change":"2023-10-08T00:30:44.704305+0000","last_active":"2023-10-08T00:30:44.704305+0000","last_peered":"2023-10-08T00:30:44.704305+0000","last_clean":"2023-10-08T00:30:44.704305+0000","last_became_active":"2023-10-08T00:30:44.704022+0000","last_became_peered":"2023-10-08T00:30:44.704022+0000","last_unstale":"2023-10-08T00:30:44.704305+0000","last_undegraded":"2023-10-08T00:30:44.704305+0000","last_fullsized":"2023-10-08T00:30:44.704305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:11.800190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714717+0000","last_change":"2023-10-08T00:30:44.714717+0000","last_active":"2023-10-08T00:30:44.714717+0000","last_peered":"2023-10-08T00:30:44.714717+0000","last_clean":"2023-10-08T00:30:44.714717+0000","last_became_active":"2023-10-08T00:30:44.714309+0000","last_became_peered":"2023-10-08T00:30:44.714309+0000","last_unstale":"2023-10-08T00:30:44.714717+0000","last_undegraded":"2023-10-08T00:30:44.714717+0000","last_fullsized":"2023-10-08T00:30:44.714717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:41.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701179+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710363+0000","last_change":"2023-10-08T00:30:44.710363+0000","last_active":"2023-10-08T00:30:44.710363+0000","last_peered":"2023-10-08T00:30:44.710363+0000","last_clean":"2023-10-08T00:30:44.710363+0000","last_became_active":"2023-10-08T00:30:44.710061+0000","last_became_peered":"2023-10-08T00:30:44.710061+0000","last_unstale":"2023-10-08T00:30:44.710363+0000","last_undegraded":"2023-10-08T00:30:44.710363+0000","last_fullsized":"2023-10-08T00:30:44.710363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:25.939919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702056+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:11.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705064+0000","last_change":"2023-10-08T00:30:44.705064+0000","last_active":"2023-10-08T00:30:44.705064+0000","last_peered":"2023-10-08T00:30:44.705064+0000","last_clean":"2023-10-08T00:30:44.705064+0000","last_became_active":"2023-10-08T00:30:44.704781+0000","last_became_peered":"2023-10-08T00:30:44.704781+0000","last_unstale":"2023-10-08T00:30:44.705064+0000","last_undegraded":"2023-10-08T00:30:44.705064+0000","last_fullsized":"2023-10-08T00:30:44.705064+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:05.062638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699080+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707647+0000","last_change":"2023-10-08T00:30:44.707647+0000","last_active":"2023-10-08T00:30:44.707647+0000","last_peered":"2023-10-08T00:30:44.707647+0000","last_clean":"2023-10-08T00:30:44.707647+0000","last_became_active":"2023-10-08T00:30:44.707180+0000","last_became_peered":"2023-10-08T00:30:44.707180+0000","last_unstale":"2023-10-08T00:30:44.707647+0000","last_undegraded":"2023-10-08T00:30:44.707647+0000","last_fullsized":"2023-10-08T00:30:44.707647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:45.073156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695493+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:15.178276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705769+0000","last_change":"2023-10-08T00:30:44.705769+0000","last_active":"2023-10-08T00:30:44.705769+0000","last_peered":"2023-10-08T00:30:44.705769+0000","last_clean":"2023-10-08T00:30:44.705769+0000","last_became_active":"2023-10-08T00:30:44.705519+0000","last_became_peered":"2023-10-08T00:30:44.705519+0000","last_unstale":"2023-10-08T00:30:44.705769+0000","last_undegraded":"2023-10-08T00:30:44.705769+0000","last_fullsized":"2023-10-08T00:30:44.705769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:16.315798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696992+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710405+0000","last_change":"2023-10-08T00:30:44.710405+0000","last_active":"2023-10-08T00:30:44.710405+0000","last_peered":"2023-10-08T00:30:44.710405+0000","last_clean":"2023-10-08T00:30:44.710405+0000","last_became_active":"2023-10-08T00:30:44.710098+0000","last_became_peered":"2023-10-08T00:30:44.710098+0000","last_unstale":"2023-10-08T00:30:44.710405+0000","last_undegraded":"2023-10-08T00:30:44.710405+0000","last_fullsized":"2023-10-08T00:30:44.710405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695954+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:34.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708459+0000","last_change":"2023-10-08T00:30:44.708459+0000","last_active":"2023-10-08T00:30:44.708459+0000","last_peered":"2023-10-08T00:30:44.708459+0000","last_clean":"2023-10-08T00:30:44.708459+0000","last_became_active":"2023-10-08T00:30:44.708004+0000","last_became_peered":"2023-10-08T00:30:44.708004+0000","last_unstale":"2023-10-08T00:30:44.708459+0000","last_undegraded":"2023-10-08T00:30:44.708459+0000","last_fullsized":"2023-10-08T00:30:44.708459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702181+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.709060+0000","last_change":"2023-10-08T00:30:44.709060+0000","last_active":"2023-10-08T00:30:44.709060+0000","last_peered":"2023-10-08T00:30:44.709060+0000","last_clean":"2023-10-08T00:30:44.709060+0000","last_became_active":"2023-10-08T00:30:44.708679+0000","last_became_peered":"2023-10-08T00:30:44.708679+0000","last_unstale":"2023-10-08T00:30:44.709060+0000","last_undegraded":"2023-10-08T00:30:44.709060+0000","last_fullsized":"2023-10-08T00:30:44.709060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:25.267932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700204+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705803+0000","last_change":"2023-10-08T00:30:44.705803+0000","last_active":"2023-10-08T00:30:44.705803+0000","last_peered":"2023-10-08T00:30:44.705803+0000","last_clean":"2023-10-08T00:30:44.705803+0000","last_became_active":"2023-10-08T00:30:44.705386+0000","last_became_peered":"2023-10-08T00:30:44.705386+0000","last_unstale":"2023-10-08T00:30:44.705803+0000","last_undegraded":"2023-10-08T00:30:44.705803+0000","last_fullsized":"2023-10-08T00:30:44.705803+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701622+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705265+0000","last_change":"2023-10-08T00:30:44.705265+0000","last_active":"2023-10-08T00:30:44.705265+0000","last_peered":"2023-10-08T00:30:44.705265+0000","last_clean":"2023-10-08T00:30:44.705265+0000","last_became_active":"2023-10-08T00:30:44.704959+0000","last_became_peered":"2023-10-08T00:30:44.704959+0000","last_unstale":"2023-10-08T00:30:44.705265+0000","last_undegraded":"2023-10-08T00:30:44.705265+0000","last_fullsized":"2023-10-08T00:30:44.705265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:33.211544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696185+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:33.788860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713341+0000","last_change":"2023-10-08T00:30:44.713341+0000","last_active":"2023-10-08T00:30:44.713341+0000","last_peered":"2023-10-08T00:30:44.713341+0000","last_clean":"2023-10-08T00:30:44.713341+0000","last_became_active":"2023-10-08T00:30:44.712993+0000","last_became_peered":"2023-10-08T00:30:44.712993+0000","last_unstale":"2023-10-08T00:30:44.713341+0000","last_undegraded":"2023-10-08T00:30:44.713341+0000","last_fullsized":"2023-10-08T00:30:44.713341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:52.621901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695895+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:03.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.703046+0000","last_change":"2023-10-08T00:30:44.703046+0000","last_active":"2023-10-08T00:30:44.703046+0000","last_peered":"2023-10-08T00:30:44.703046+0000","last_clean":"2023-10-08T00:30:44.703046+0000","last_became_active":"2023-10-08T00:30:44.702787+0000","last_became_peered":"2023-10-08T00:30:44.702787+0000","last_unstale":"2023-10-08T00:30:44.703046+0000","last_undegraded":"2023-10-08T00:30:44.703046+0000","last_fullsized":"2023-10-08T00:30:44.703046+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694971+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708004+0000","last_change":"2023-10-08T00:30:44.708004+0000","last_active":"2023-10-08T00:30:44.708004+0000","last_peered":"2023-10-08T00:30:44.708004+0000","last_clean":"2023-10-08T00:30:44.708004+0000","last_became_active":"2023-10-08T00:30:44.707667+0000","last_became_peered":"2023-10-08T00:30:44.707667+0000","last_unstale":"2023-10-08T00:30:44.708004+0000","last_undegraded":"2023-10-08T00:30:44.708004+0000","last_fullsized":"2023-10-08T00:30:44.708004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:00.514679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703257+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714436+0000","last_change":"2023-10-08T00:30:44.714436+0000","last_active":"2023-10-08T00:30:44.714436+0000","last_peered":"2023-10-08T00:30:44.714436+0000","last_clean":"2023-10-08T00:30:44.714436+0000","last_became_active":"2023-10-08T00:30:44.713873+0000","last_became_peered":"2023-10-08T00:30:44.713873+0000","last_unstale":"2023-10-08T00:30:44.714436+0000","last_undegraded":"2023-10-08T00:30:44.714436+0000","last_fullsized":"2023-10-08T00:30:44.714436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:52.850417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703803+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:50:16.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704755+0000","last_change":"2023-10-08T00:30:44.704755+0000","last_active":"2023-10-08T00:30:44.704755+0000","last_peered":"2023-10-08T00:30:44.704755+0000","last_clean":"2023-10-08T00:30:44.704755+0000","last_became_active":"2023-10-08T00:30:44.704481+0000","last_became_peered":"2023-10-08T00:30:44.704481+0000","last_unstale":"2023-10-08T00:30:44.704755+0000","last_undegraded":"2023-10-08T00:30:44.704755+0000","last_fullsized":"2023-10-08T00:30:44.704755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697417+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713430+0000","last_change":"2023-10-08T00:30:44.713430+0000","last_active":"2023-10-08T00:30:44.713430+0000","last_peered":"2023-10-08T00:30:44.713430+0000","last_clean":"2023-10-08T00:30:44.713430+0000","last_became_active":"2023-10-08T00:30:44.712985+0000","last_became_peered":"2023-10-08T00:30:44.712985+0000","last_unstale":"2023-10-08T00:30:44.713430+0000","last_undegraded":"2023-10-08T00:30:44.713430+0000","last_fullsized":"2023-10-08T00:30:44.713430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:36.560087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696096+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:06.067657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704933+0000","last_change":"2023-10-08T00:30:44.704933+0000","last_active":"2023-10-08T00:30:44.704933+0000","last_peered":"2023-10-08T00:30:44.704933+0000","last_clean":"2023-10-08T00:30:44.704933+0000","last_became_active":"2023-10-08T00:30:44.704649+0000","last_became_peered":"2023-10-08T00:30:44.704649+0000","last_unstale":"2023-10-08T00:30:44.704933+0000","last_undegraded":"2023-10-08T00:30:44.704933+0000","last_fullsized":"2023-10-08T00:30:44.704933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:07.459987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700168+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710667+0000","last_change":"2023-10-08T00:30:44.710667+0000","last_active":"2023-10-08T00:30:44.710667+0000","last_peered":"2023-10-08T00:30:44.710667+0000","last_clean":"2023-10-08T00:30:44.710667+0000","last_became_active":"2023-10-08T00:30:44.710406+0000","last_became_peered":"2023-10-08T00:30:44.710406+0000","last_unstale":"2023-10-08T00:30:44.710667+0000","last_undegraded":"2023-10-08T00:30:44.710667+0000","last_fullsized":"2023-10-08T00:30:44.710667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:14.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694034+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.803384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708441+0000","last_change":"2023-10-08T00:30:44.708441+0000","last_active":"2023-10-08T00:30:44.708441+0000","last_peered":"2023-10-08T00:30:44.708441+0000","last_clean":"2023-10-08T00:30:44.708441+0000","last_became_active":"2023-10-08T00:30:44.708130+0000","last_became_peered":"2023-10-08T00:30:44.708130+0000","last_unstale":"2023-10-08T00:30:44.708441+0000","last_undegraded":"2023-10-08T00:30:44.708441+0000","last_fullsized":"2023-10-08T00:30:44.708441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696167+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711775+0000","last_change":"2023-10-08T00:30:44.711775+0000","last_active":"2023-10-08T00:30:44.711775+0000","last_peered":"2023-10-08T00:30:44.711775+0000","last_clean":"2023-10-08T00:30:44.711775+0000","last_became_active":"2023-10-08T00:30:44.711484+0000","last_became_peered":"2023-10-08T00:30:44.711484+0000","last_unstale":"2023-10-08T00:30:44.711775+0000","last_undegraded":"2023-10-08T00:30:44.711775+0000","last_fullsized":"2023-10-08T00:30:44.711775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:33.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694497+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:08:10.152906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711141+0000","last_change":"2023-10-08T00:30:44.711141+0000","last_active":"2023-10-08T00:30:44.711141+0000","last_peered":"2023-10-08T00:30:44.711141+0000","last_clean":"2023-10-08T00:30:44.711141+0000","last_became_active":"2023-10-08T00:30:44.710854+0000","last_became_peered":"2023-10-08T00:30:44.710854+0000","last_unstale":"2023-10-08T00:30:44.711141+0000","last_undegraded":"2023-10-08T00:30:44.711141+0000","last_fullsized":"2023-10-08T00:30:44.711141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:21.892962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704236+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.696634+0000","last_change":"2023-10-08T00:30:44.696634+0000","last_active":"2023-10-08T00:30:44.696634+0000","last_peered":"2023-10-08T00:30:44.696634+0000","last_clean":"2023-10-08T00:30:44.696634+0000","last_became_active":"2023-10-08T00:30:44.696331+0000","last_became_peered":"2023-10-08T00:30:44.696331+0000","last_unstale":"2023-10-08T00:30:44.696634+0000","last_undegraded":"2023-10-08T00:30:44.696634+0000","last_fullsized":"2023-10-08T00:30:44.696634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.888161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:45:06.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.706968+0000","last_change":"2023-10-08T00:30:44.706968+0000","last_active":"2023-10-08T00:30:44.706968+0000","last_peered":"2023-10-08T00:30:44.706968+0000","last_clean":"2023-10-08T00:30:44.706968+0000","last_became_active":"2023-10-08T00:30:44.706703+0000","last_became_peered":"2023-10-08T00:30:44.706703+0000","last_unstale":"2023-10-08T00:30:44.706968+0000","last_undegraded":"2023-10-08T00:30:44.706968+0000","last_fullsized":"2023-10-08T00:30:44.706968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T00:30:43.688195+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:43.688195+0000","last_peered":"2023-10-08T00:30:43.688195+0000","last_clean":"2023-10-08T00:30:43.688195+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:43.688195+0000","last_undegraded":"2023-10-08T00:30:43.688195+0000","last_fullsized":"2023-10-08T00:30:43.688195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298932,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072908,"statfs":{"total":96636764160,"available":96330657792,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.496}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.435}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.254},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.372}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.63}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.37},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.23300000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.77200000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.5}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:50.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2023-10-08T00:30:50.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.697851+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.704294+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:08:08.223595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.695760+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.699693+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:09:53.855436+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2023-10-08T00:30:50.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700320+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700826+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.701164+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:49:46.910499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696840+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2023-10-08T00:30:50.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.697024+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700717+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702970+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.697139+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2023-10-08T00:30:50.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702419+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.698846+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T04:37:21.022626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.703777+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700317+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.698009+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.703190+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.698148+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:59:49.590987+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696568+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2023-10-08T00:30:50.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.697993+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:54:09.354869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.697898+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.694404+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.699830+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702690+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.703350+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:38:14.664818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702484+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:50:08.057908+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.703162+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702560+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:18:56.250315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2023-10-08T00:30:50.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696658+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:50:20.219079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.699364+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.695714+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696551+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:38:06.462335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702147+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696535+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:57:26.272951+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696119+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.699473+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2023-10-08T00:30:50.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700873+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700994+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.695718+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.698566+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:56:30.632623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2023-10-08T00:30:50.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696067+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.701179+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702056+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:13:11.523592+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.699080+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.695493+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:52:15.178276+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696992+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.695954+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:43:34.409981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.702181+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700204+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T00:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.701622+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696185+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:33:33.788860+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.695895+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:44:03.536742+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.694971+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T06:02:50.113516+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2023-10-08T00:30:50.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.703257+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.703803+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:50:16.434920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.697417+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696096+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T00:59:06.067657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T00:30:50.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.700168+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.694034+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T09:05:36.803384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696167+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2023-10-08T00:30:50.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.694497+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:08:10.152906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2023-10-08T00:30:50.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.704236+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T00:30:50.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2023-10-08T00:30:50.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T00:30:44.685474+0000', 'last_change': '2023-10-08T00:30:44.696067+0000', 'last_active': '2023-10-08T00:30:44.685474+0000', 'last_peered': '2023-10-08T00:30:44.685474+0000', 'last_clean': '2023-10-08T00:30:44.685474+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T00:30:44.685474+0000', 'last_undegraded': '2023-10-08T00:30:44.685474+0000', 'last_fullsized': '2023-10-08T00:30:44.685474+0000', 'mapping_epoch': 88, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 88, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'last_clean_scrub_stamp': '2023-10-08T00:30:44.685474+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T11:45:06.095097+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T00:30:50.624 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T00:30:50.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.764+0000 7f97f1abc700 1 Processor -- start 2023-10-08T00:30:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.764+0000 7f97f1abc700 1 -- start start 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f1abc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97ec15c9a0 0x7f97ec0cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f1abc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec0ce900 0x7f97ec0cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f1abc700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec0cfa60 con 0x7f97ec15cd70 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f1abc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0cee50 con 0x7f97ec15c9a0 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f1abc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0cf130 con 0x7f97ec0ce900 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97ec15c9a0 0x7f97ec0cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97ec15c9a0 0x7f97ec0cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54756/0 (socket says 172.21.15.22:54756) 2023-10-08T00:30:50.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 -- 172.21.15.22:0/1510350731 learned_addr learned my addr 172.21.15.22:0/1510350731 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 -- 172.21.15.22:0/1510350731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec0ce900 msgr2=0x7f97ec0cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97ebfff700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec0ce900 0x7f97ec0cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec0ce900 0x7f97ec0cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 -- 172.21.15.22:0/1510350731 >> v1:172.21.15.192:6789/0 conn(0x7f97ec15cd70 legacy=0x7f97ec15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97f0aba700 1 -- 172.21.15.22:0/1510350731 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0cf410 con 0x7f97ec15c9a0 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.765+0000 7f97ebfff700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec0ce900 0x7f97ec0cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f0aba700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec15c9a0 0x7f97ec0cfef0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009f20 tx=0x7f97e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdc9a5178beaf2b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97eb7fe700 1 -- 172.21.15.22:0/1510350731 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e400e070 con 0x7f97ec15c9a0 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97eb7fe700 1 -- 172.21.15.22:0/1510350731 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e400ba40 con 0x7f97ec15c9a0 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97eb7fe700 1 -- 172.21.15.22:0/1510350731 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e40092e0 con 0x7f97ec15c9a0 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 -- 172.21.15.22:0/1510350731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec15c9a0 msgr2=0x7f97ec0cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec15c9a0 0x7f97ec0cfef0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f97e4009f20 tx=0x7f97e4009840 comp rx=0 tx=0).stop 2023-10-08T00:30:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 -- 172.21.15.22:0/1510350731 shutdown_connections 2023-10-08T00:30:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec15c9a0 0x7f97ec0cfef0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 --2- 172.21.15.22:0/1510350731 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec0ce900 0x7f97ec0cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 -- 172.21.15.22:0/1510350731 >> 172.21.15.22:0/1510350731 conn(0x7f97ec0d05c0 msgr2=0x7f97ec0d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 -- 172.21.15.22:0/1510350731 shutdown_connections 2023-10-08T00:30:50.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.766+0000 7f97f1abc700 1 -- 172.21.15.22:0/1510350731 wait complete. 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.767+0000 7f97f1abc700 1 Processor -- start 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 -- start start 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 0x7f97ec16a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec15c9a0 0x7f97ec15b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97ec15cd70 0x7f97ec154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec16ac50 con 0x7f97ec0ce900 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec0af7d0 con 0x7f97ec15cd70 2023-10-08T00:30:50.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f1abc700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec15b1f0 con 0x7f97ec15c9a0 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f0aba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 0x7f97ec16a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f0aba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 0x7f97ec16a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54768/0 (socket says 172.21.15.22:54768) 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f0aba700 1 -- 172.21.15.22:0/2606075164 learned_addr learned my addr 172.21.15.22:0/2606075164 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97ebfff700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec15c9a0 0x7f97ec15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.768+0000 7f97f12bb700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97ec15cd70 0x7f97ec154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f0aba700 1 -- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec15c9a0 msgr2=0x7f97ec15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f0aba700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec15c9a0 0x7f97ec15b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f0aba700 1 -- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97ec15cd70 msgr2=0x7f97ec154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f0aba700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97ec15cd70 0x7f97ec154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f0aba700 1 -- 172.21.15.22:0/2606075164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4009ae0 con 0x7f97ec0ce900 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f12bb700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97ec15cd70 0x7f97ec154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:50.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f0aba700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 0x7f97ec16a710 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b6c0 tx=0x7f97e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4012a20 con 0x7f97ec0ce900 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e4012ba0 con 0x7f97ec0ce900 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec0afa20 con 0x7f97ec0ce900 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e401d420 con 0x7f97ec0ce900 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.769+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec15ae80 con 0x7f97ec0ce900 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.770+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec15b4d0 con 0x7f97ec0ce900 2023-10-08T00:30:50.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.771+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f97e401d850 con 0x7f97ec0ce900 2023-10-08T00:30:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.771+0000 7f97e8ff9700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97cc067200 0x7f97cc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.771+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97e4086100 con 0x7f97ec0ce900 2023-10-08T00:30:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.771+0000 7f97ebfff700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97cc067200 0x7f97cc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:50.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.772+0000 7f97ebfff700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97cc067200 0x7f97cc0696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0b3ad0 tx=0x7f97dc006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:50.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:50.775+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97e4052f10 con 0x7f97ec0ce900 2023-10-08T00:30:51.021 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-08T00:30:51.020+0000 7f054622d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:30:51.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.047+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f97ec0cf6f0 con 0x7f97ec0ce900 2023-10-08T00:30:51.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.048+0000 7f97e8ff9700 1 -- 172.21.15.22:0/2606075164 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1455 (secure 0 0 0) 0x7f97e4056530 con 0x7f97ec0ce900 2023-10-08T00:30:51.049 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:51.049 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":376,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":90,"num_osds":8,"num_up_osds":8,"osd_up_since":1696724684,"num_in_osds":8,"osd_in_since":1696724677,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2462064640,"bytes_avail":770632048640,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":60,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":6519}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-08T00:30:34.465095+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T00:30:51.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97cc067200 msgr2=0x7f97cc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97cc067200 0x7f97cc0696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0b3ad0 tx=0x7f97dc006f90 comp rx=0 tx=0).stop 2023-10-08T00:30:51.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 msgr2=0x7f97ec16a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 0x7f97ec16a710 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b6c0 tx=0x7f97e4017000 comp rx=0 tx=0).stop 2023-10-08T00:30:51.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 shutdown_connections 2023-10-08T00:30:51.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97ec15cd70 0x7f97ec154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97ec0ce900 0x7f97ec16a710 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97cc067200 0x7f97cc0696b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 --2- 172.21.15.22:0/2606075164 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97ec15c9a0 0x7f97ec15b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.049+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 >> 172.21.15.22:0/2606075164 conn(0x7f97ec0d05c0 msgr2=0x7f97ec0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.050+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 shutdown_connections 2023-10-08T00:30:51.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.050+0000 7f97f1abc700 1 -- 172.21.15.22:0/2606075164 wait complete. 2023-10-08T00:30:51.063 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T00:30:51.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:51.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.183+0000 7f88d3709700 1 Processor -- start 2023-10-08T00:30:51.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.183+0000 7f88d3709700 1 -- start start 2023-10-08T00:30:51.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d3709700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88cc159890 0x7f88cc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d3709700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88cc069560 0x7f88cc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d3709700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc069ee0 con 0x7f88cc159c60 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d3709700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc15a160 con 0x7f88cc159890 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d3709700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc0d13a0 con 0x7f88cc069560 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88cc159890 0x7f88cc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88cc159890 0x7f88cc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54772/0 (socket says 172.21.15.22:54772) 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 -- 172.21.15.22:0/333162303 learned_addr learned my addr 172.21.15.22:0/333162303 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d1ca6700 1 --2- 172.21.15.22:0/333162303 >> v2:172.21.15.192:3300/0 conn(0x7f88cc069560 0x7f88cc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:51.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 -- 172.21.15.22:0/333162303 >> v2:172.21.15.192:3300/0 conn(0x7f88cc069560 msgr2=0x7f88cc0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 --2- 172.21.15.22:0/333162303 >> v2:172.21.15.192:3300/0 conn(0x7f88cc069560 0x7f88cc0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 -- 172.21.15.22:0/333162303 >> v1:172.21.15.192:6789/0 conn(0x7f88cc159c60 legacy=0x7f88cc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 -- 172.21.15.22:0/333162303 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc15e140 con 0x7f88cc159890 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d1ca6700 1 --2- 172.21.15.22:0/333162303 >> v2:172.21.15.192:3300/0 conn(0x7f88cc069560 0x7f88cc0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88d14a5700 1 --2- 172.21.15.22:0/333162303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc159890 0x7f88cc15abd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f88cc06a890 tx=0x7f88bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90b5c714d99984f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88cbfff700 1 -- 172.21.15.22:0/333162303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00b860 con 0x7f88cc159890 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88cbfff700 1 -- 172.21.15.22:0/333162303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc00b9c0 con 0x7f88cc159890 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.184+0000 7f88cbfff700 1 -- 172.21.15.22:0/333162303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00bd60 con 0x7f88cc159890 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 -- 172.21.15.22:0/333162303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc159890 msgr2=0x7f88cc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 --2- 172.21.15.22:0/333162303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc159890 0x7f88cc15abd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f88cc06a890 tx=0x7f88bc009250 comp rx=0 tx=0).stop 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 -- 172.21.15.22:0/333162303 shutdown_connections 2023-10-08T00:30:51.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 --2- 172.21.15.22:0/333162303 >> v2:172.21.15.192:3300/0 conn(0x7f88cc069560 0x7f88cc0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 --2- 172.21.15.22:0/333162303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc159890 0x7f88cc15abd0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 -- 172.21.15.22:0/333162303 >> 172.21.15.22:0/333162303 conn(0x7f88cc068e20 msgr2=0x7f88cc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:51.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 -- 172.21.15.22:0/333162303 shutdown_connections 2023-10-08T00:30:51.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.185+0000 7f88d3709700 1 -- 172.21.15.22:0/333162303 wait complete. 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.186+0000 7f88d3709700 1 Processor -- start 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.186+0000 7f88d3709700 1 -- start start 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d3709700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 0x7f88cc153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d3709700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88cc159890 0x7f88cc0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d3709700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88cc159c60 0x7f88cc16d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d3709700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc153d90 con 0x7f88cc069560 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d3709700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc16e040 con 0x7f88cc159c60 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d3709700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c90c0 con 0x7f88cc159890 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 0x7f88cc153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:51.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 0x7f88cc153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54774/0 (socket says 172.21.15.22:54774) 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 -- 172.21.15.22:0/3319900128 learned_addr learned my addr 172.21.15.22:0/3319900128 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d1ca6700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88cc159c60 0x7f88cc16d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d0ca4700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88cc159890 0x7f88cc0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 -- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88cc159890 msgr2=0x7f88cc0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88cc159890 0x7f88cc0c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 -- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88cc159c60 msgr2=0x7f88cc16d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88cc159c60 0x7f88cc16d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.187+0000 7f88d14a5700 1 -- 172.21.15.22:0/3319900128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc0094f0 con 0x7f88cc069560 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.188+0000 7f88d14a5700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 0x7f88cc153250 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009290 tx=0x7f88bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.188+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc026480 con 0x7f88cc069560 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.188+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc01f070 con 0x7f88cc069560 2023-10-08T00:30:51.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.188+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc0c93a0 con 0x7f88cc069560 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.188+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc026850 con 0x7f88cc069560 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.188+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc153790 con 0x7f88cc069560 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.189+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc0c98c0 con 0x7f88cc069560 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.189+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f88bc01a430 con 0x7f88cc069560 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.190+0000 7f88c97fa700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f88b8067200 0x7f88b80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.190+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88bc021070 con 0x7f88cc069560 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.190+0000 7f88d0ca4700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f88b8067200 0x7f88b80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:51.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.190+0000 7f88d0ca4700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f88b8067200 0x7f88b80696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0b3010 tx=0x7f88c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:51.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.194+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88cc0c98c0 con 0x7f88cc069560 2023-10-08T00:30:51.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.381+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88cc0c98c0 con 0x7f88b8067200 2023-10-08T00:30:51.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.389+0000 7f88c97fa700 1 -- 172.21.15.22:0/3319900128 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286549 (secure 0 0 0) 0x7f88cc0c98c0 con 0x7f88b8067200 2023-10-08T00:30:51.393 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:51.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.392+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f88b8067200 msgr2=0x7f88b80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.392+0000 7f88d3709700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f88b8067200 0x7f88b80696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0b3010 tx=0x7f88c0009040 comp rx=0 tx=0).stop 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.392+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 msgr2=0x7f88cc153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.392+0000 7f88d3709700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 0x7f88cc153250 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009290 tx=0x7f88bc017000 comp rx=0 tx=0).stop 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 shutdown_connections 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88cc159c60 0x7f88cc16d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc069560 0x7f88cc153250 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f88b8067200 0x7f88b80696b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 --2- 172.21.15.22:0/3319900128 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88cc159890 0x7f88cc0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 >> 172.21.15.22:0/3319900128 conn(0x7f88cc068e20 msgr2=0x7f88cc1545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 shutdown_connections 2023-10-08T00:30:51.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:51.393+0000 7f88d3709700 1 -- 172.21.15.22:0/3319900128 wait complete. 2023-10-08T00:30:51.397 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:51.405 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2023-10-08T00:30:50.468660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404360,"kb_used_data":9672,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752570360,"statfs":{"total":773094113280,"available":770632048640,"internally_reserved":0,"allocated":9904128,"data_stored":4922888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001261"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697851+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704294+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:08:08.223595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695760+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699693+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:53.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700320+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700826+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701164+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:46.910499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696840+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697024+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700717+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702970+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697139+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702419+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:08.465006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698846+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:37:21.022626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703777+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700317+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698009+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703190+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698148+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:59:49.590987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696568+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697993+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:54:09.354869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697898+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694404+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699830+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702690+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703350+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:14.664818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702484+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:08.057908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703162+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702560+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:56.250315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696658+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:50:20.219079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699364+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695714+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696551+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:38:06.462335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713193+0000","last_change":"2023-10-08T00:30:44.713193+0000","last_active":"2023-10-08T00:30:44.713193+0000","last_peered":"2023-10-08T00:30:44.713193+0000","last_clean":"2023-10-08T00:30:44.713193+0000","last_became_active":"2023-10-08T00:30:44.712908+0000","last_became_peered":"2023-10-08T00:30:44.712908+0000","last_unstale":"2023-10-08T00:30:44.713193+0000","last_undegraded":"2023-10-08T00:30:44.713193+0000","last_fullsized":"2023-10-08T00:30:44.713193+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702147+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:18.790764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711311+0000","last_change":"2023-10-08T00:30:44.711311+0000","last_active":"2023-10-08T00:30:44.711311+0000","last_peered":"2023-10-08T00:30:44.711311+0000","last_clean":"2023-10-08T00:30:44.711311+0000","last_became_active":"2023-10-08T00:30:44.711061+0000","last_became_peered":"2023-10-08T00:30:44.711061+0000","last_unstale":"2023-10-08T00:30:44.711311+0000","last_undegraded":"2023-10-08T00:30:44.711311+0000","last_fullsized":"2023-10-08T00:30:44.711311+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696535+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:26.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708464+0000","last_change":"2023-10-08T00:30:44.708464+0000","last_active":"2023-10-08T00:30:44.708464+0000","last_peered":"2023-10-08T00:30:44.708464+0000","last_clean":"2023-10-08T00:30:44.708464+0000","last_became_active":"2023-10-08T00:30:44.708106+0000","last_became_peered":"2023-10-08T00:30:44.708106+0000","last_unstale":"2023-10-08T00:30:44.708464+0000","last_undegraded":"2023-10-08T00:30:44.708464+0000","last_fullsized":"2023-10-08T00:30:44.708464+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:35.787697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696119+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:31:11.495699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708535+0000","last_change":"2023-10-08T00:30:44.708535+0000","last_active":"2023-10-08T00:30:44.708535+0000","last_peered":"2023-10-08T00:30:44.708535+0000","last_clean":"2023-10-08T00:30:44.708535+0000","last_became_active":"2023-10-08T00:30:44.708164+0000","last_became_peered":"2023-10-08T00:30:44.708164+0000","last_unstale":"2023-10-08T00:30:44.708535+0000","last_undegraded":"2023-10-08T00:30:44.708535+0000","last_fullsized":"2023-10-08T00:30:44.708535+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:45.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699473+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:41.506274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707659+0000","last_change":"2023-10-08T00:30:44.707659+0000","last_active":"2023-10-08T00:30:44.707659+0000","last_peered":"2023-10-08T00:30:44.707659+0000","last_clean":"2023-10-08T00:30:44.707659+0000","last_became_active":"2023-10-08T00:30:44.707397+0000","last_became_peered":"2023-10-08T00:30:44.707397+0000","last_unstale":"2023-10-08T00:30:44.707659+0000","last_undegraded":"2023-10-08T00:30:44.707659+0000","last_fullsized":"2023-10-08T00:30:44.707659+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:46.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700873+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:36.792716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714388+0000","last_change":"2023-10-08T00:30:44.714388+0000","last_active":"2023-10-08T00:30:44.714388+0000","last_peered":"2023-10-08T00:30:44.714388+0000","last_clean":"2023-10-08T00:30:44.714388+0000","last_became_active":"2023-10-08T00:30:44.713881+0000","last_became_peered":"2023-10-08T00:30:44.713881+0000","last_unstale":"2023-10-08T00:30:44.714388+0000","last_undegraded":"2023-10-08T00:30:44.714388+0000","last_fullsized":"2023-10-08T00:30:44.714388+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:17.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700994+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:34.216563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713361+0000","last_change":"2023-10-08T00:30:44.713361+0000","last_active":"2023-10-08T00:30:44.713361+0000","last_peered":"2023-10-08T00:30:44.713361+0000","last_clean":"2023-10-08T00:30:44.713361+0000","last_became_active":"2023-10-08T00:30:44.713127+0000","last_became_peered":"2023-10-08T00:30:44.713127+0000","last_unstale":"2023-10-08T00:30:44.713361+0000","last_undegraded":"2023-10-08T00:30:44.713361+0000","last_fullsized":"2023-10-08T00:30:44.713361+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695718+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708243+0000","last_change":"2023-10-08T00:30:44.708243+0000","last_active":"2023-10-08T00:30:44.708243+0000","last_peered":"2023-10-08T00:30:44.708243+0000","last_clean":"2023-10-08T00:30:44.708243+0000","last_became_active":"2023-10-08T00:30:44.707712+0000","last_became_peered":"2023-10-08T00:30:44.707712+0000","last_unstale":"2023-10-08T00:30:44.708243+0000","last_undegraded":"2023-10-08T00:30:44.708243+0000","last_fullsized":"2023-10-08T00:30:44.708243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:20:48.812143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.698566+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:30.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704305+0000","last_change":"2023-10-08T00:30:44.704305+0000","last_active":"2023-10-08T00:30:44.704305+0000","last_peered":"2023-10-08T00:30:44.704305+0000","last_clean":"2023-10-08T00:30:44.704305+0000","last_became_active":"2023-10-08T00:30:44.704022+0000","last_became_peered":"2023-10-08T00:30:44.704022+0000","last_unstale":"2023-10-08T00:30:44.704305+0000","last_undegraded":"2023-10-08T00:30:44.704305+0000","last_fullsized":"2023-10-08T00:30:44.704305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:11.800190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714717+0000","last_change":"2023-10-08T00:30:44.714717+0000","last_active":"2023-10-08T00:30:44.714717+0000","last_peered":"2023-10-08T00:30:44.714717+0000","last_clean":"2023-10-08T00:30:44.714717+0000","last_became_active":"2023-10-08T00:30:44.714309+0000","last_became_peered":"2023-10-08T00:30:44.714309+0000","last_unstale":"2023-10-08T00:30:44.714717+0000","last_undegraded":"2023-10-08T00:30:44.714717+0000","last_fullsized":"2023-10-08T00:30:44.714717+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:41.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701179+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710363+0000","last_change":"2023-10-08T00:30:44.710363+0000","last_active":"2023-10-08T00:30:44.710363+0000","last_peered":"2023-10-08T00:30:44.710363+0000","last_clean":"2023-10-08T00:30:44.710363+0000","last_became_active":"2023-10-08T00:30:44.710061+0000","last_became_peered":"2023-10-08T00:30:44.710061+0000","last_unstale":"2023-10-08T00:30:44.710363+0000","last_undegraded":"2023-10-08T00:30:44.710363+0000","last_fullsized":"2023-10-08T00:30:44.710363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:25.939919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702056+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:11.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705064+0000","last_change":"2023-10-08T00:30:44.705064+0000","last_active":"2023-10-08T00:30:44.705064+0000","last_peered":"2023-10-08T00:30:44.705064+0000","last_clean":"2023-10-08T00:30:44.705064+0000","last_became_active":"2023-10-08T00:30:44.704781+0000","last_became_peered":"2023-10-08T00:30:44.704781+0000","last_unstale":"2023-10-08T00:30:44.705064+0000","last_undegraded":"2023-10-08T00:30:44.705064+0000","last_fullsized":"2023-10-08T00:30:44.705064+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:05.062638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.699080+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.707647+0000","last_change":"2023-10-08T00:30:44.707647+0000","last_active":"2023-10-08T00:30:44.707647+0000","last_peered":"2023-10-08T00:30:44.707647+0000","last_clean":"2023-10-08T00:30:44.707647+0000","last_became_active":"2023-10-08T00:30:44.707180+0000","last_became_peered":"2023-10-08T00:30:44.707180+0000","last_unstale":"2023-10-08T00:30:44.707647+0000","last_undegraded":"2023-10-08T00:30:44.707647+0000","last_fullsized":"2023-10-08T00:30:44.707647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:45.073156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695493+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:15.178276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705769+0000","last_change":"2023-10-08T00:30:44.705769+0000","last_active":"2023-10-08T00:30:44.705769+0000","last_peered":"2023-10-08T00:30:44.705769+0000","last_clean":"2023-10-08T00:30:44.705769+0000","last_became_active":"2023-10-08T00:30:44.705519+0000","last_became_peered":"2023-10-08T00:30:44.705519+0000","last_unstale":"2023-10-08T00:30:44.705769+0000","last_undegraded":"2023-10-08T00:30:44.705769+0000","last_fullsized":"2023-10-08T00:30:44.705769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:16.315798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696992+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710405+0000","last_change":"2023-10-08T00:30:44.710405+0000","last_active":"2023-10-08T00:30:44.710405+0000","last_peered":"2023-10-08T00:30:44.710405+0000","last_clean":"2023-10-08T00:30:44.710405+0000","last_became_active":"2023-10-08T00:30:44.710098+0000","last_became_peered":"2023-10-08T00:30:44.710098+0000","last_unstale":"2023-10-08T00:30:44.710405+0000","last_undegraded":"2023-10-08T00:30:44.710405+0000","last_fullsized":"2023-10-08T00:30:44.710405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695954+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:43:34.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708459+0000","last_change":"2023-10-08T00:30:44.708459+0000","last_active":"2023-10-08T00:30:44.708459+0000","last_peered":"2023-10-08T00:30:44.708459+0000","last_clean":"2023-10-08T00:30:44.708459+0000","last_became_active":"2023-10-08T00:30:44.708004+0000","last_became_peered":"2023-10-08T00:30:44.708004+0000","last_unstale":"2023-10-08T00:30:44.708459+0000","last_undegraded":"2023-10-08T00:30:44.708459+0000","last_fullsized":"2023-10-08T00:30:44.708459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.702181+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.709060+0000","last_change":"2023-10-08T00:30:44.709060+0000","last_active":"2023-10-08T00:30:44.709060+0000","last_peered":"2023-10-08T00:30:44.709060+0000","last_clean":"2023-10-08T00:30:44.709060+0000","last_became_active":"2023-10-08T00:30:44.708679+0000","last_became_peered":"2023-10-08T00:30:44.708679+0000","last_unstale":"2023-10-08T00:30:44.709060+0000","last_undegraded":"2023-10-08T00:30:44.709060+0000","last_fullsized":"2023-10-08T00:30:44.709060+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:25.267932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700204+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:34.155041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705803+0000","last_change":"2023-10-08T00:30:44.705803+0000","last_active":"2023-10-08T00:30:44.705803+0000","last_peered":"2023-10-08T00:30:44.705803+0000","last_clean":"2023-10-08T00:30:44.705803+0000","last_became_active":"2023-10-08T00:30:44.705386+0000","last_became_peered":"2023-10-08T00:30:44.705386+0000","last_unstale":"2023-10-08T00:30:44.705803+0000","last_undegraded":"2023-10-08T00:30:44.705803+0000","last_fullsized":"2023-10-08T00:30:44.705803+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.701622+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:37.565107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.705265+0000","last_change":"2023-10-08T00:30:44.705265+0000","last_active":"2023-10-08T00:30:44.705265+0000","last_peered":"2023-10-08T00:30:44.705265+0000","last_clean":"2023-10-08T00:30:44.705265+0000","last_became_active":"2023-10-08T00:30:44.704959+0000","last_became_peered":"2023-10-08T00:30:44.704959+0000","last_unstale":"2023-10-08T00:30:44.705265+0000","last_undegraded":"2023-10-08T00:30:44.705265+0000","last_fullsized":"2023-10-08T00:30:44.705265+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:33.211544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696185+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:33:33.788860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713341+0000","last_change":"2023-10-08T00:30:44.713341+0000","last_active":"2023-10-08T00:30:44.713341+0000","last_peered":"2023-10-08T00:30:44.713341+0000","last_clean":"2023-10-08T00:30:44.713341+0000","last_became_active":"2023-10-08T00:30:44.712993+0000","last_became_peered":"2023-10-08T00:30:44.712993+0000","last_unstale":"2023-10-08T00:30:44.713341+0000","last_undegraded":"2023-10-08T00:30:44.713341+0000","last_fullsized":"2023-10-08T00:30:44.713341+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:52.621901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.695895+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:44:03.536742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.703046+0000","last_change":"2023-10-08T00:30:44.703046+0000","last_active":"2023-10-08T00:30:44.703046+0000","last_peered":"2023-10-08T00:30:44.703046+0000","last_clean":"2023-10-08T00:30:44.703046+0000","last_became_active":"2023-10-08T00:30:44.702787+0000","last_became_peered":"2023-10-08T00:30:44.702787+0000","last_unstale":"2023-10-08T00:30:44.703046+0000","last_undegraded":"2023-10-08T00:30:44.703046+0000","last_fullsized":"2023-10-08T00:30:44.703046+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694971+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:02:50.113516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708004+0000","last_change":"2023-10-08T00:30:44.708004+0000","last_active":"2023-10-08T00:30:44.708004+0000","last_peered":"2023-10-08T00:30:44.708004+0000","last_clean":"2023-10-08T00:30:44.708004+0000","last_became_active":"2023-10-08T00:30:44.707667+0000","last_became_peered":"2023-10-08T00:30:44.707667+0000","last_unstale":"2023-10-08T00:30:44.708004+0000","last_undegraded":"2023-10-08T00:30:44.708004+0000","last_fullsized":"2023-10-08T00:30:44.708004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:00.514679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703257+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.714436+0000","last_change":"2023-10-08T00:30:44.714436+0000","last_active":"2023-10-08T00:30:44.714436+0000","last_peered":"2023-10-08T00:30:44.714436+0000","last_clean":"2023-10-08T00:30:44.714436+0000","last_became_active":"2023-10-08T00:30:44.713873+0000","last_became_peered":"2023-10-08T00:30:44.713873+0000","last_unstale":"2023-10-08T00:30:44.714436+0000","last_undegraded":"2023-10-08T00:30:44.714436+0000","last_fullsized":"2023-10-08T00:30:44.714436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:52.850417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.703803+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:50:16.434920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704755+0000","last_change":"2023-10-08T00:30:44.704755+0000","last_active":"2023-10-08T00:30:44.704755+0000","last_peered":"2023-10-08T00:30:44.704755+0000","last_clean":"2023-10-08T00:30:44.704755+0000","last_became_active":"2023-10-08T00:30:44.704481+0000","last_became_peered":"2023-10-08T00:30:44.704481+0000","last_unstale":"2023-10-08T00:30:44.704755+0000","last_undegraded":"2023-10-08T00:30:44.704755+0000","last_fullsized":"2023-10-08T00:30:44.704755+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.697417+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.713430+0000","last_change":"2023-10-08T00:30:44.713430+0000","last_active":"2023-10-08T00:30:44.713430+0000","last_peered":"2023-10-08T00:30:44.713430+0000","last_clean":"2023-10-08T00:30:44.713430+0000","last_became_active":"2023-10-08T00:30:44.712985+0000","last_became_peered":"2023-10-08T00:30:44.712985+0000","last_unstale":"2023-10-08T00:30:44.713430+0000","last_undegraded":"2023-10-08T00:30:44.713430+0000","last_fullsized":"2023-10-08T00:30:44.713430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:36.560087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696096+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:06.067657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.704933+0000","last_change":"2023-10-08T00:30:44.704933+0000","last_active":"2023-10-08T00:30:44.704933+0000","last_peered":"2023-10-08T00:30:44.704933+0000","last_clean":"2023-10-08T00:30:44.704933+0000","last_became_active":"2023-10-08T00:30:44.704649+0000","last_became_peered":"2023-10-08T00:30:44.704649+0000","last_unstale":"2023-10-08T00:30:44.704933+0000","last_undegraded":"2023-10-08T00:30:44.704933+0000","last_fullsized":"2023-10-08T00:30:44.704933+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:07.459987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.700168+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:06.973726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.710667+0000","last_change":"2023-10-08T00:30:44.710667+0000","last_active":"2023-10-08T00:30:44.710667+0000","last_peered":"2023-10-08T00:30:44.710667+0000","last_clean":"2023-10-08T00:30:44.710667+0000","last_became_active":"2023-10-08T00:30:44.710406+0000","last_became_peered":"2023-10-08T00:30:44.710406+0000","last_unstale":"2023-10-08T00:30:44.710667+0000","last_undegraded":"2023-10-08T00:30:44.710667+0000","last_fullsized":"2023-10-08T00:30:44.710667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:14.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694034+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.803384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.708441+0000","last_change":"2023-10-08T00:30:44.708441+0000","last_active":"2023-10-08T00:30:44.708441+0000","last_peered":"2023-10-08T00:30:44.708441+0000","last_clean":"2023-10-08T00:30:44.708441+0000","last_became_active":"2023-10-08T00:30:44.708130+0000","last_became_peered":"2023-10-08T00:30:44.708130+0000","last_unstale":"2023-10-08T00:30:44.708441+0000","last_undegraded":"2023-10-08T00:30:44.708441+0000","last_fullsized":"2023-10-08T00:30:44.708441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696167+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711775+0000","last_change":"2023-10-08T00:30:44.711775+0000","last_active":"2023-10-08T00:30:44.711775+0000","last_peered":"2023-10-08T00:30:44.711775+0000","last_clean":"2023-10-08T00:30:44.711775+0000","last_became_active":"2023-10-08T00:30:44.711484+0000","last_became_peered":"2023-10-08T00:30:44.711484+0000","last_unstale":"2023-10-08T00:30:44.711775+0000","last_undegraded":"2023-10-08T00:30:44.711775+0000","last_fullsized":"2023-10-08T00:30:44.711775+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:33.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.694497+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:08:10.152906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.711141+0000","last_change":"2023-10-08T00:30:44.711141+0000","last_active":"2023-10-08T00:30:44.711141+0000","last_peered":"2023-10-08T00:30:44.711141+0000","last_clean":"2023-10-08T00:30:44.711141+0000","last_became_active":"2023-10-08T00:30:44.710854+0000","last_became_peered":"2023-10-08T00:30:44.710854+0000","last_unstale":"2023-10-08T00:30:44.711141+0000","last_undegraded":"2023-10-08T00:30:44.711141+0000","last_fullsized":"2023-10-08T00:30:44.711141+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:21.892962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.704236+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.696634+0000","last_change":"2023-10-08T00:30:44.696634+0000","last_active":"2023-10-08T00:30:44.696634+0000","last_peered":"2023-10-08T00:30:44.696634+0000","last_clean":"2023-10-08T00:30:44.696634+0000","last_became_active":"2023-10-08T00:30:44.696331+0000","last_became_peered":"2023-10-08T00:30:44.696331+0000","last_unstale":"2023-10-08T00:30:44.696634+0000","last_undegraded":"2023-10-08T00:30:44.696634+0000","last_fullsized":"2023-10-08T00:30:44.696634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.888161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T00:30:44.685474+0000","last_change":"2023-10-08T00:30:44.696067+0000","last_active":"2023-10-08T00:30:44.685474+0000","last_peered":"2023-10-08T00:30:44.685474+0000","last_clean":"2023-10-08T00:30:44.685474+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:30:44.685474+0000","last_undegraded":"2023-10-08T00:30:44.685474+0000","last_fullsized":"2023-10-08T00:30:44.685474+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:45:06.095097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-08T00:30:44.706968+0000","last_change":"2023-10-08T00:30:44.706968+0000","last_active":"2023-10-08T00:30:44.706968+0000","last_peered":"2023-10-08T00:30:44.706968+0000","last_clean":"2023-10-08T00:30:44.706968+0000","last_became_active":"2023-10-08T00:30:44.706703+0000","last_became_peered":"2023-10-08T00:30:44.706703+0000","last_unstale":"2023-10-08T00:30:44.706968+0000","last_undegraded":"2023-10-08T00:30:44.706968+0000","last_fullsized":"2023-10-08T00:30:44.706968+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":218,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-08T00:30:43.688195+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:43.688195+0000","last_peered":"2023-10-08T00:30:43.688195+0000","last_clean":"2023-10-08T00:30:43.688195+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:43.688195+0000","last_undegraded":"2023-10-08T00:30:43.688195+0000","last_fullsized":"2023-10-08T00:30:43.688195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298932,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072908,"statfs":{"total":96636764160,"available":96330657792,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.496}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.435}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.627}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.254},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.372}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.63}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.48399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.37},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.622},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.65900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.23300000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.316},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38800000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.41299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46200000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.66400000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.77200000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.75900000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298352,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073488,"statfs":{"total":96636764160,"available":96331251712,"internally_reserved":0,"allocated":1089536,"data_stored":467769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.5}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.622},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:54.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:30:54.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.545+0000 7f0ebd74a700 1 Processor -- start 2023-10-08T00:30:54.545 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.545+0000 7f0ebd74a700 1 -- start start 2023-10-08T00:30:54.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0ebd74a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 0x7f0eb815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0ebd74a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0eb815db10 0x7f0eb8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0ebd74a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb815a160 con 0x7f0eb8159890 2023-10-08T00:30:54.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0ebd74a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80d13a0 con 0x7f0eb815db10 2023-10-08T00:30:54.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0ebd74a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb815e140 con 0x7f0eb8159c60 2023-10-08T00:30:54.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 0x7f0eb815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb77fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0eb815db10 0x7f0eb8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 0x7f0eb815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:59442/0 (socket says 172.21.15.22:59442) 2023-10-08T00:30:54.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 -- 172.21.15.22:0/3329907819 learned_addr learned my addr 172.21.15.22:0/3329907819 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:54.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 -- 172.21.15.22:0/3329907819 >> v2:172.21.15.192:3300/0 conn(0x7f0eb815db10 msgr2=0x7f0eb8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:54.548 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 --2- 172.21.15.22:0/3329907819 >> v2:172.21.15.192:3300/0 conn(0x7f0eb815db10 0x7f0eb8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 -- 172.21.15.22:0/3329907819 >> v1:172.21.15.192:6789/0 conn(0x7f0eb8159890 legacy=0x7f0eb815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb67fc700 1 -- 172.21.15.22:0/3329907819 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb815a3d0 con 0x7f0eb8159c60 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.546+0000 7f0eb77fe700 1 --2- 172.21.15.22:0/3329907819 >> v2:172.21.15.192:3300/0 conn(0x7f0eb815db10 0x7f0eb8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0eb67fc700 1 --2- 172.21.15.22:0/3329907819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 0x7f0eb815d5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00099b0 tx=0x7f0ea0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5b168af8ddd7cea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0eb5ffb700 1 -- 172.21.15.22:0/3329907819 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0009ea0 con 0x7f0eb8159c60 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0eb5ffb700 1 -- 172.21.15.22:0/3329907819 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000b860 con 0x7f0eb8159c60 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0eb5ffb700 1 -- 172.21.15.22:0/3329907819 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000bc00 con 0x7f0eb8159c60 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 -- 172.21.15.22:0/3329907819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 msgr2=0x7f0eb815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/3329907819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 0x7f0eb815d5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00099b0 tx=0x7f0ea0009250 comp rx=0 tx=0).stop 2023-10-08T00:30:54.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 -- 172.21.15.22:0/3329907819 shutdown_connections 2023-10-08T00:30:54.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/3329907819 >> v2:172.21.15.192:3300/0 conn(0x7f0eb815db10 0x7f0eb8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/3329907819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159c60 0x7f0eb815d5d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 -- 172.21.15.22:0/3329907819 >> 172.21.15.22:0/3329907819 conn(0x7f0eb8068e20 msgr2=0x7f0eb80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:54.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 -- 172.21.15.22:0/3329907819 shutdown_connections 2023-10-08T00:30:54.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.547+0000 7f0ebd74a700 1 -- 172.21.15.22:0/3329907819 wait complete. 2023-10-08T00:30:54.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 Processor -- start 2023-10-08T00:30:54.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 -- start start 2023-10-08T00:30:54.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159890 0x7f0eb80c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 0x7f0eb8158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0eb815db10 0x7f0eb80b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b3fa0 con 0x7f0eb8159c60 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80b4280 con 0x7f0eb815db10 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0ebd74a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c82a0 con 0x7f0eb8159890 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0eb67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 0x7f0eb8158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.549+0000 7f0eb67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 0x7f0eb8158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54782/0 (socket says 172.21.15.22:54782) 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 -- 172.21.15.22:0/785056102 learned_addr learned my addr 172.21.15.22:0/785056102 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb6ffd700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159890 0x7f0eb80c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb77fe700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0eb815db10 0x7f0eb80b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 -- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159890 msgr2=0x7f0eb80c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159890 0x7f0eb80c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 -- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0eb815db10 msgr2=0x7f0eb80b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0eb815db10 0x7f0eb80b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 -- 172.21.15.22:0/785056102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8009a20 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eb67fc700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 0x7f0eb8158360 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8070e20 tx=0x7f0ea0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000bbe0 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0011420 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea00094f0 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea00117c0 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.550+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb80c8860 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.551+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb804c3c0 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.552+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0ea0011bf0 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.552+0000 7f0eaeffd700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e98067200 0x7f0e980696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.552+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ea00860f0 con 0x7f0eb8159c60 2023-10-08T00:30:54.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.552+0000 7f0eb6ffd700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e98067200 0x7f0e980696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.553+0000 7f0eb6ffd700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e98067200 0x7f0e980696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0003a80 tx=0x7f0eb0007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:54.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.556+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ea00530d0 con 0x7f0eb8159c60 2023-10-08T00:30:54.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.744+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0eb806a5b0 con 0x7f0e98067200 2023-10-08T00:30:54.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.753+0000 7f0eaeffd700 1 -- 172.21.15.22:0/785056102 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289466 (secure 0 0 0) 0x7f0eb806a5b0 con 0x7f0e98067200 2023-10-08T00:30:54.756 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e98067200 msgr2=0x7f0e980696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e98067200 0x7f0e980696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0003a80 tx=0x7f0eb0007ec0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 msgr2=0x7f0eb8158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 0x7f0eb8158360 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8070e20 tx=0x7f0ea0017000 comp rx=0 tx=0).stop 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 shutdown_connections 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0eb815db10 0x7f0eb80b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0e98067200 0x7f0e980696b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0eb8159890 0x7f0eb80c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 --2- 172.21.15.22:0/785056102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0eb8159c60 0x7f0eb8158360 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 >> 172.21.15.22:0/785056102 conn(0x7f0eb8068e20 msgr2=0x7f0eb80b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 shutdown_connections 2023-10-08T00:30:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.756+0000 7f0ebd74a700 1 -- 172.21.15.22:0/785056102 wait complete. 2023-10-08T00:30:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:30:54.769 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2023-10-08T00:30:54.469657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404616,"kb_used_data":9928,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752570104,"statfs":{"total":773094113280,"available":770631786496,"internally_reserved":0,"allocated":10166272,"data_stored":5031908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.775090"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717466+0000","last_change":"2023-10-08T00:30:45.715061+0000","last_active":"2023-10-08T00:30:45.717466+0000","last_peered":"2023-10-08T00:30:45.717466+0000","last_clean":"2023-10-08T00:30:45.717466+0000","last_became_active":"2023-10-08T00:30:45.714796+0000","last_became_peered":"2023-10-08T00:30:45.714796+0000","last_unstale":"2023-10-08T00:30:45.717466+0000","last_undegraded":"2023-10-08T00:30:45.717466+0000","last_fullsized":"2023-10-08T00:30:45.717466+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:32.905322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717336+0000","last_change":"2023-10-08T00:30:45.715305+0000","last_active":"2023-10-08T00:30:45.717336+0000","last_peered":"2023-10-08T00:30:45.717336+0000","last_clean":"2023-10-08T00:30:45.717336+0000","last_became_active":"2023-10-08T00:30:45.714989+0000","last_became_peered":"2023-10-08T00:30:45.714989+0000","last_unstale":"2023-10-08T00:30:45.717336+0000","last_undegraded":"2023-10-08T00:30:45.717336+0000","last_fullsized":"2023-10-08T00:30:45.717336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:57:19.424941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.715914+0000","last_change":"2023-10-08T00:30:45.714893+0000","last_active":"2023-10-08T00:30:45.715914+0000","last_peered":"2023-10-08T00:30:45.715914+0000","last_clean":"2023-10-08T00:30:45.715914+0000","last_became_active":"2023-10-08T00:30:45.714618+0000","last_became_peered":"2023-10-08T00:30:45.714618+0000","last_unstale":"2023-10-08T00:30:45.715914+0000","last_undegraded":"2023-10-08T00:30:45.715914+0000","last_fullsized":"2023-10-08T00:30:45.715914+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:56.698212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719357+0000","last_change":"2023-10-08T00:30:45.716913+0000","last_active":"2023-10-08T00:30:45.719357+0000","last_peered":"2023-10-08T00:30:45.719357+0000","last_clean":"2023-10-08T00:30:45.719357+0000","last_became_active":"2023-10-08T00:30:45.716607+0000","last_became_peered":"2023-10-08T00:30:45.716607+0000","last_unstale":"2023-10-08T00:30:45.719357+0000","last_undegraded":"2023-10-08T00:30:45.719357+0000","last_fullsized":"2023-10-08T00:30:45.719357+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:53.626920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719093+0000","last_change":"2023-10-08T00:30:45.710966+0000","last_active":"2023-10-08T00:30:45.719093+0000","last_peered":"2023-10-08T00:30:45.719093+0000","last_clean":"2023-10-08T00:30:45.719093+0000","last_became_active":"2023-10-08T00:30:45.710571+0000","last_became_peered":"2023-10-08T00:30:45.710571+0000","last_unstale":"2023-10-08T00:30:45.719093+0000","last_undegraded":"2023-10-08T00:30:45.719093+0000","last_fullsized":"2023-10-08T00:30:45.719093+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:22.897981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.722943+0000","last_change":"2023-10-08T00:30:45.717824+0000","last_active":"2023-10-08T00:30:45.722943+0000","last_peered":"2023-10-08T00:30:45.722943+0000","last_clean":"2023-10-08T00:30:45.722943+0000","last_became_active":"2023-10-08T00:30:45.712735+0000","last_became_peered":"2023-10-08T00:30:45.712735+0000","last_unstale":"2023-10-08T00:30:45.722943+0000","last_undegraded":"2023-10-08T00:30:45.722943+0000","last_fullsized":"2023-10-08T00:30:45.722943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.723053+0000","last_change":"2023-10-08T00:30:45.718601+0000","last_active":"2023-10-08T00:30:45.723053+0000","last_peered":"2023-10-08T00:30:45.723053+0000","last_clean":"2023-10-08T00:30:45.723053+0000","last_became_active":"2023-10-08T00:30:45.718274+0000","last_became_peered":"2023-10-08T00:30:45.718274+0000","last_unstale":"2023-10-08T00:30:45.723053+0000","last_undegraded":"2023-10-08T00:30:45.723053+0000","last_fullsized":"2023-10-08T00:30:45.723053+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:56:30.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.712527+0000","last_change":"2023-10-08T00:30:45.709529+0000","last_active":"2023-10-08T00:30:45.712527+0000","last_peered":"2023-10-08T00:30:45.712527+0000","last_clean":"2023-10-08T00:30:45.712527+0000","last_became_active":"2023-10-08T00:30:45.709364+0000","last_became_peered":"2023-10-08T00:30:45.709364+0000","last_unstale":"2023-10-08T00:30:45.712527+0000","last_undegraded":"2023-10-08T00:30:45.712527+0000","last_fullsized":"2023-10-08T00:30:45.712527+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:44.470163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719323+0000","last_change":"2023-10-08T00:30:45.712111+0000","last_active":"2023-10-08T00:30:45.719323+0000","last_peered":"2023-10-08T00:30:45.719323+0000","last_clean":"2023-10-08T00:30:45.719323+0000","last_became_active":"2023-10-08T00:30:45.711825+0000","last_became_peered":"2023-10-08T00:30:45.711825+0000","last_unstale":"2023-10-08T00:30:45.719323+0000","last_undegraded":"2023-10-08T00:30:45.719323+0000","last_fullsized":"2023-10-08T00:30:45.719323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719039+0000","last_change":"2023-10-08T00:30:45.710535+0000","last_active":"2023-10-08T00:30:45.719039+0000","last_peered":"2023-10-08T00:30:45.719039+0000","last_clean":"2023-10-08T00:30:45.719039+0000","last_became_active":"2023-10-08T00:30:45.710274+0000","last_became_peered":"2023-10-08T00:30:45.710274+0000","last_unstale":"2023-10-08T00:30:45.719039+0000","last_undegraded":"2023-10-08T00:30:45.719039+0000","last_fullsized":"2023-10-08T00:30:45.719039+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:02:21.555236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.723086+0000","last_change":"2023-10-08T00:30:45.721071+0000","last_active":"2023-10-08T00:30:45.723086+0000","last_peered":"2023-10-08T00:30:45.723086+0000","last_clean":"2023-10-08T00:30:45.723086+0000","last_became_active":"2023-10-08T00:30:45.720792+0000","last_became_peered":"2023-10-08T00:30:45.720792+0000","last_unstale":"2023-10-08T00:30:45.723086+0000","last_undegraded":"2023-10-08T00:30:45.723086+0000","last_fullsized":"2023-10-08T00:30:45.723086+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:25.122687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719687+0000","last_change":"2023-10-08T00:30:45.714150+0000","last_active":"2023-10-08T00:30:45.719687+0000","last_peered":"2023-10-08T00:30:45.719687+0000","last_clean":"2023-10-08T00:30:45.719687+0000","last_became_active":"2023-10-08T00:30:45.711651+0000","last_became_peered":"2023-10-08T00:30:45.711651+0000","last_unstale":"2023-10-08T00:30:45.719687+0000","last_undegraded":"2023-10-08T00:30:45.719687+0000","last_fullsized":"2023-10-08T00:30:45.719687+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:26.944938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719409+0000","last_change":"2023-10-08T00:30:45.718478+0000","last_active":"2023-10-08T00:30:45.719409+0000","last_peered":"2023-10-08T00:30:45.719409+0000","last_clean":"2023-10-08T00:30:45.719409+0000","last_became_active":"2023-10-08T00:30:45.718212+0000","last_became_peered":"2023-10-08T00:30:45.718212+0000","last_unstale":"2023-10-08T00:30:45.719409+0000","last_undegraded":"2023-10-08T00:30:45.719409+0000","last_fullsized":"2023-10-08T00:30:45.719409+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:11.523592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717772+0000","last_change":"2023-10-08T00:30:45.711251+0000","last_active":"2023-10-08T00:30:45.717772+0000","last_peered":"2023-10-08T00:30:45.717772+0000","last_clean":"2023-10-08T00:30:45.717772+0000","last_became_active":"2023-10-08T00:30:45.710987+0000","last_became_peered":"2023-10-08T00:30:45.710987+0000","last_unstale":"2023-10-08T00:30:45.717772+0000","last_undegraded":"2023-10-08T00:30:45.717772+0000","last_fullsized":"2023-10-08T00:30:45.717772+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:12.805210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719273+0000","last_change":"2023-10-08T00:30:45.716028+0000","last_active":"2023-10-08T00:30:45.719273+0000","last_peered":"2023-10-08T00:30:45.719273+0000","last_clean":"2023-10-08T00:30:45.719273+0000","last_became_active":"2023-10-08T00:30:45.715764+0000","last_became_peered":"2023-10-08T00:30:45.715764+0000","last_unstale":"2023-10-08T00:30:45.719273+0000","last_undegraded":"2023-10-08T00:30:45.719273+0000","last_fullsized":"2023-10-08T00:30:45.719273+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:29.440091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.710985+0000","last_change":"2023-10-08T00:30:45.709261+0000","last_active":"2023-10-08T00:30:45.710985+0000","last_peered":"2023-10-08T00:30:45.710985+0000","last_clean":"2023-10-08T00:30:45.710985+0000","last_became_active":"2023-10-08T00:30:45.709017+0000","last_became_peered":"2023-10-08T00:30:45.709017+0000","last_unstale":"2023-10-08T00:30:45.710985+0000","last_undegraded":"2023-10-08T00:30:45.710985+0000","last_fullsized":"2023-10-08T00:30:45.710985+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:53.626920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.712816+0000","last_change":"2023-10-08T00:30:45.710697+0000","last_active":"2023-10-08T00:30:45.712816+0000","last_peered":"2023-10-08T00:30:45.712816+0000","last_clean":"2023-10-08T00:30:45.712816+0000","last_became_active":"2023-10-08T00:30:45.710443+0000","last_became_peered":"2023-10-08T00:30:45.710443+0000","last_unstale":"2023-10-08T00:30:45.712816+0000","last_undegraded":"2023-10-08T00:30:45.712816+0000","last_fullsized":"2023-10-08T00:30:45.712816+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:23.305863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719432+0000","last_change":"2023-10-08T00:30:45.716908+0000","last_active":"2023-10-08T00:30:45.719432+0000","last_peered":"2023-10-08T00:30:45.719432+0000","last_clean":"2023-10-08T00:30:45.719432+0000","last_became_active":"2023-10-08T00:30:45.716667+0000","last_became_peered":"2023-10-08T00:30:45.716667+0000","last_unstale":"2023-10-08T00:30:45.719432+0000","last_undegraded":"2023-10-08T00:30:45.719432+0000","last_fullsized":"2023-10-08T00:30:45.719432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717915+0000","last_change":"2023-10-08T00:30:45.713166+0000","last_active":"2023-10-08T00:30:45.717915+0000","last_peered":"2023-10-08T00:30:45.717915+0000","last_clean":"2023-10-08T00:30:45.717915+0000","last_became_active":"2023-10-08T00:30:45.712869+0000","last_became_peered":"2023-10-08T00:30:45.712869+0000","last_unstale":"2023-10-08T00:30:45.717915+0000","last_undegraded":"2023-10-08T00:30:45.717915+0000","last_fullsized":"2023-10-08T00:30:45.717915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:17:36.396301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719709+0000","last_change":"2023-10-08T00:30:45.714540+0000","last_active":"2023-10-08T00:30:45.719709+0000","last_peered":"2023-10-08T00:30:45.719709+0000","last_clean":"2023-10-08T00:30:45.719709+0000","last_became_active":"2023-10-08T00:30:45.714191+0000","last_became_peered":"2023-10-08T00:30:45.714191+0000","last_unstale":"2023-10-08T00:30:45.719709+0000","last_undegraded":"2023-10-08T00:30:45.719709+0000","last_fullsized":"2023-10-08T00:30:45.719709+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717942+0000","last_change":"2023-10-08T00:30:45.713187+0000","last_active":"2023-10-08T00:30:45.717942+0000","last_peered":"2023-10-08T00:30:45.717942+0000","last_clean":"2023-10-08T00:30:45.717942+0000","last_became_active":"2023-10-08T00:30:45.712949+0000","last_became_peered":"2023-10-08T00:30:45.712949+0000","last_unstale":"2023-10-08T00:30:45.717942+0000","last_undegraded":"2023-10-08T00:30:45.717942+0000","last_fullsized":"2023-10-08T00:30:45.717942+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:53:58.046800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717325+0000","last_change":"2023-10-08T00:30:45.714841+0000","last_active":"2023-10-08T00:30:45.717325+0000","last_peered":"2023-10-08T00:30:45.717325+0000","last_clean":"2023-10-08T00:30:45.717325+0000","last_became_active":"2023-10-08T00:30:45.714496+0000","last_became_peered":"2023-10-08T00:30:45.714496+0000","last_unstale":"2023-10-08T00:30:45.717325+0000","last_undegraded":"2023-10-08T00:30:45.717325+0000","last_fullsized":"2023-10-08T00:30:45.717325+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:42.645341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.712934+0000","last_change":"2023-10-08T00:30:45.711357+0000","last_active":"2023-10-08T00:30:45.712934+0000","last_peered":"2023-10-08T00:30:45.712934+0000","last_clean":"2023-10-08T00:30:45.712934+0000","last_became_active":"2023-10-08T00:30:45.711072+0000","last_became_peered":"2023-10-08T00:30:45.711072+0000","last_unstale":"2023-10-08T00:30:45.712934+0000","last_undegraded":"2023-10-08T00:30:45.712934+0000","last_fullsized":"2023-10-08T00:30:45.712934+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:25.122687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.723047+0000","last_change":"2023-10-08T00:30:45.719448+0000","last_active":"2023-10-08T00:30:45.723047+0000","last_peered":"2023-10-08T00:30:45.723047+0000","last_clean":"2023-10-08T00:30:45.723047+0000","last_became_active":"2023-10-08T00:30:45.719199+0000","last_became_peered":"2023-10-08T00:30:45.719199+0000","last_unstale":"2023-10-08T00:30:45.723047+0000","last_undegraded":"2023-10-08T00:30:45.723047+0000","last_fullsized":"2023-10-08T00:30:45.723047+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:18:56.250315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719323+0000","last_change":"2023-10-08T00:30:45.713674+0000","last_active":"2023-10-08T00:30:45.719323+0000","last_peered":"2023-10-08T00:30:45.719323+0000","last_clean":"2023-10-08T00:30:45.719323+0000","last_became_active":"2023-10-08T00:30:45.713410+0000","last_became_peered":"2023-10-08T00:30:45.713410+0000","last_unstale":"2023-10-08T00:30:45.719323+0000","last_undegraded":"2023-10-08T00:30:45.719323+0000","last_fullsized":"2023-10-08T00:30:45.719323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:29.084875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.712703+0000","last_change":"2023-10-08T00:30:45.709251+0000","last_active":"2023-10-08T00:30:45.712703+0000","last_peered":"2023-10-08T00:30:45.712703+0000","last_clean":"2023-10-08T00:30:45.712703+0000","last_became_active":"2023-10-08T00:30:45.708869+0000","last_became_peered":"2023-10-08T00:30:45.708869+0000","last_unstale":"2023-10-08T00:30:45.712703+0000","last_undegraded":"2023-10-08T00:30:45.712703+0000","last_fullsized":"2023-10-08T00:30:45.712703+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:28.876304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.723005+0000","last_change":"2023-10-08T00:30:45.719008+0000","last_active":"2023-10-08T00:30:45.723005+0000","last_peered":"2023-10-08T00:30:45.723005+0000","last_clean":"2023-10-08T00:30:45.723005+0000","last_became_active":"2023-10-08T00:30:45.718701+0000","last_became_peered":"2023-10-08T00:30:45.718701+0000","last_unstale":"2023-10-08T00:30:45.723005+0000","last_undegraded":"2023-10-08T00:30:45.723005+0000","last_fullsized":"2023-10-08T00:30:45.723005+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:44.470163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717076+0000","last_change":"2023-10-08T00:30:45.708676+0000","last_active":"2023-10-08T00:30:45.717076+0000","last_peered":"2023-10-08T00:30:45.717076+0000","last_clean":"2023-10-08T00:30:45.717076+0000","last_became_active":"2023-10-08T00:30:45.708451+0000","last_became_peered":"2023-10-08T00:30:45.708451+0000","last_unstale":"2023-10-08T00:30:45.717076+0000","last_undegraded":"2023-10-08T00:30:45.717076+0000","last_fullsized":"2023-10-08T00:30:45.717076+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:36.259307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.712681+0000","last_change":"2023-10-08T00:30:45.708746+0000","last_active":"2023-10-08T00:30:45.712681+0000","last_peered":"2023-10-08T00:30:45.712681+0000","last_clean":"2023-10-08T00:30:45.712681+0000","last_became_active":"2023-10-08T00:30:45.708481+0000","last_became_peered":"2023-10-08T00:30:45.708481+0000","last_unstale":"2023-10-08T00:30:45.712681+0000","last_undegraded":"2023-10-08T00:30:45.712681+0000","last_fullsized":"2023-10-08T00:30:45.712681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:39:45.093376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717792+0000","last_change":"2023-10-08T00:30:45.711265+0000","last_active":"2023-10-08T00:30:45.717792+0000","last_peered":"2023-10-08T00:30:45.717792+0000","last_clean":"2023-10-08T00:30:45.717792+0000","last_became_active":"2023-10-08T00:30:45.711064+0000","last_became_peered":"2023-10-08T00:30:45.711064+0000","last_unstale":"2023-10-08T00:30:45.717792+0000","last_undegraded":"2023-10-08T00:30:45.717792+0000","last_fullsized":"2023-10-08T00:30:45.717792+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:26:03.580444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719259+0000","last_change":"2023-10-08T00:30:45.715809+0000","last_active":"2023-10-08T00:30:45.719259+0000","last_peered":"2023-10-08T00:30:45.719259+0000","last_clean":"2023-10-08T00:30:45.719259+0000","last_became_active":"2023-10-08T00:30:45.715509+0000","last_became_peered":"2023-10-08T00:30:45.715509+0000","last_unstale":"2023-10-08T00:30:45.719259+0000","last_undegraded":"2023-10-08T00:30:45.719259+0000","last_fullsized":"2023-10-08T00:30:45.719259+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.715648+0000","last_change":"2023-10-08T00:30:45.707438+0000","last_active":"2023-10-08T00:30:45.715648+0000","last_peered":"2023-10-08T00:30:45.715648+0000","last_clean":"2023-10-08T00:30:45.715648+0000","last_became_active":"2023-10-08T00:30:45.706685+0000","last_became_peered":"2023-10-08T00:30:45.706685+0000","last_unstale":"2023-10-08T00:30:45.715648+0000","last_undegraded":"2023-10-08T00:30:45.715648+0000","last_fullsized":"2023-10-08T00:30:45.715648+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:05:08.438926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717713+0000","last_change":"2023-10-08T00:30:45.711768+0000","last_active":"2023-10-08T00:30:45.717713+0000","last_peered":"2023-10-08T00:30:45.717713+0000","last_clean":"2023-10-08T00:30:45.717713+0000","last_became_active":"2023-10-08T00:30:45.711518+0000","last_became_peered":"2023-10-08T00:30:45.711518+0000","last_unstale":"2023-10-08T00:30:45.717713+0000","last_undegraded":"2023-10-08T00:30:45.717713+0000","last_fullsized":"2023-10-08T00:30:45.717713+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:47.261627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"89'4","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.716994+0000","last_change":"2023-10-08T00:30:44.713193+0000","last_active":"2023-10-08T00:30:45.716994+0000","last_peered":"2023-10-08T00:30:45.716994+0000","last_clean":"2023-10-08T00:30:45.716994+0000","last_became_active":"2023-10-08T00:30:44.712908+0000","last_became_peered":"2023-10-08T00:30:44.712908+0000","last_unstale":"2023-10-08T00:30:45.716994+0000","last_undegraded":"2023-10-08T00:30:45.716994+0000","last_fullsized":"2023-10-08T00:30:45.716994+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719310+0000","last_change":"2023-10-08T00:30:45.715681+0000","last_active":"2023-10-08T00:30:45.719310+0000","last_peered":"2023-10-08T00:30:45.719310+0000","last_clean":"2023-10-08T00:30:45.719310+0000","last_became_active":"2023-10-08T00:30:45.715359+0000","last_became_peered":"2023-10-08T00:30:45.715359+0000","last_unstale":"2023-10-08T00:30:45.719310+0000","last_undegraded":"2023-10-08T00:30:45.719310+0000","last_fullsized":"2023-10-08T00:30:45.719310+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:43.096507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.718936+0000","last_change":"2023-10-08T00:30:44.711311+0000","last_active":"2023-10-08T00:30:45.718936+0000","last_peered":"2023-10-08T00:30:45.718936+0000","last_clean":"2023-10-08T00:30:45.718936+0000","last_became_active":"2023-10-08T00:30:44.711061+0000","last_became_peered":"2023-10-08T00:30:44.711061+0000","last_unstale":"2023-10-08T00:30:45.718936+0000","last_undegraded":"2023-10-08T00:30:45.718936+0000","last_fullsized":"2023-10-08T00:30:45.718936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.718268+0000","last_change":"2023-10-08T00:30:45.716577+0000","last_active":"2023-10-08T00:30:45.718268+0000","last_peered":"2023-10-08T00:30:45.718268+0000","last_clean":"2023-10-08T00:30:45.718268+0000","last_became_active":"2023-10-08T00:30:45.716202+0000","last_became_peered":"2023-10-08T00:30:45.716202+0000","last_unstale":"2023-10-08T00:30:45.718268+0000","last_undegraded":"2023-10-08T00:30:45.718268+0000","last_fullsized":"2023-10-08T00:30:45.718268+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:18.475073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.716692+0000","last_change":"2023-10-08T00:30:44.708464+0000","last_active":"2023-10-08T00:30:45.716692+0000","last_peered":"2023-10-08T00:30:45.716692+0000","last_clean":"2023-10-08T00:30:45.716692+0000","last_became_active":"2023-10-08T00:30:44.708106+0000","last_became_peered":"2023-10-08T00:30:44.708106+0000","last_unstale":"2023-10-08T00:30:45.716692+0000","last_undegraded":"2023-10-08T00:30:45.716692+0000","last_fullsized":"2023-10-08T00:30:45.716692+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:18:35.787697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719471+0000","last_change":"2023-10-08T00:30:45.716099+0000","last_active":"2023-10-08T00:30:45.719471+0000","last_peered":"2023-10-08T00:30:45.719471+0000","last_clean":"2023-10-08T00:30:45.719471+0000","last_became_active":"2023-10-08T00:30:45.715839+0000","last_became_peered":"2023-10-08T00:30:45.715839+0000","last_unstale":"2023-10-08T00:30:45.719471+0000","last_undegraded":"2023-10-08T00:30:45.719471+0000","last_fullsized":"2023-10-08T00:30:45.719471+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:02:21.555236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.714628+0000","last_change":"2023-10-08T00:30:44.708535+0000","last_active":"2023-10-08T00:30:45.714628+0000","last_peered":"2023-10-08T00:30:45.714628+0000","last_clean":"2023-10-08T00:30:45.714628+0000","last_became_active":"2023-10-08T00:30:44.708164+0000","last_became_peered":"2023-10-08T00:30:44.708164+0000","last_unstale":"2023-10-08T00:30:45.714628+0000","last_undegraded":"2023-10-08T00:30:45.714628+0000","last_fullsized":"2023-10-08T00:30:45.714628+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:45.905480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.711863+0000","last_change":"2023-10-08T00:30:45.708901+0000","last_active":"2023-10-08T00:30:45.711863+0000","last_peered":"2023-10-08T00:30:45.711863+0000","last_clean":"2023-10-08T00:30:45.711863+0000","last_became_active":"2023-10-08T00:30:45.708666+0000","last_became_peered":"2023-10-08T00:30:45.708666+0000","last_unstale":"2023-10-08T00:30:45.711863+0000","last_undegraded":"2023-10-08T00:30:45.711863+0000","last_fullsized":"2023-10-08T00:30:45.711863+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:06.067657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.711907+0000","last_change":"2023-10-08T00:30:44.707659+0000","last_active":"2023-10-08T00:30:45.711907+0000","last_peered":"2023-10-08T00:30:45.711907+0000","last_clean":"2023-10-08T00:30:45.711907+0000","last_became_active":"2023-10-08T00:30:44.707397+0000","last_became_peered":"2023-10-08T00:30:44.707397+0000","last_unstale":"2023-10-08T00:30:45.711907+0000","last_undegraded":"2023-10-08T00:30:45.711907+0000","last_fullsized":"2023-10-08T00:30:45.711907+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:46.256608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.722525+0000","last_change":"2023-10-08T00:30:45.712603+0000","last_active":"2023-10-08T00:30:45.722525+0000","last_peered":"2023-10-08T00:30:45.722525+0000","last_clean":"2023-10-08T00:30:45.722525+0000","last_became_active":"2023-10-08T00:30:45.712301+0000","last_became_peered":"2023-10-08T00:30:45.712301+0000","last_unstale":"2023-10-08T00:30:45.722525+0000","last_undegraded":"2023-10-08T00:30:45.722525+0000","last_fullsized":"2023-10-08T00:30:45.722525+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:19:42.645341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.708875+0000","last_change":"2023-10-08T00:30:44.714388+0000","last_active":"2023-10-08T00:30:45.708875+0000","last_peered":"2023-10-08T00:30:45.708875+0000","last_clean":"2023-10-08T00:30:45.708875+0000","last_became_active":"2023-10-08T00:30:44.713881+0000","last_became_peered":"2023-10-08T00:30:44.713881+0000","last_unstale":"2023-10-08T00:30:45.708875+0000","last_undegraded":"2023-10-08T00:30:45.708875+0000","last_fullsized":"2023-10-08T00:30:45.708875+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:27:17.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719303+0000","last_change":"2023-10-08T00:30:45.716513+0000","last_active":"2023-10-08T00:30:45.719303+0000","last_peered":"2023-10-08T00:30:45.719303+0000","last_clean":"2023-10-08T00:30:45.719303+0000","last_became_active":"2023-10-08T00:30:45.716259+0000","last_became_peered":"2023-10-08T00:30:45.716259+0000","last_unstale":"2023-10-08T00:30:45.719303+0000","last_undegraded":"2023-10-08T00:30:45.719303+0000","last_fullsized":"2023-10-08T00:30:45.719303+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:50:08.057908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.699408+0000","last_change":"2023-10-08T00:30:44.713361+0000","last_active":"2023-10-08T00:30:45.699408+0000","last_peered":"2023-10-08T00:30:45.699408+0000","last_clean":"2023-10-08T00:30:45.699408+0000","last_became_active":"2023-10-08T00:30:44.713127+0000","last_became_peered":"2023-10-08T00:30:44.713127+0000","last_unstale":"2023-10-08T00:30:45.699408+0000","last_undegraded":"2023-10-08T00:30:45.699408+0000","last_fullsized":"2023-10-08T00:30:45.699408+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719214+0000","last_change":"2023-10-08T00:30:45.711070+0000","last_active":"2023-10-08T00:30:45.719214+0000","last_peered":"2023-10-08T00:30:45.719214+0000","last_clean":"2023-10-08T00:30:45.719214+0000","last_became_active":"2023-10-08T00:30:45.710829+0000","last_became_peered":"2023-10-08T00:30:45.710829+0000","last_unstale":"2023-10-08T00:30:45.719214+0000","last_undegraded":"2023-10-08T00:30:45.719214+0000","last_fullsized":"2023-10-08T00:30:45.719214+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:43:35.234111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.699922+0000","last_change":"2023-10-08T00:30:44.708243+0000","last_active":"2023-10-08T00:30:45.699922+0000","last_peered":"2023-10-08T00:30:45.699922+0000","last_clean":"2023-10-08T00:30:45.699922+0000","last_became_active":"2023-10-08T00:30:44.707712+0000","last_became_peered":"2023-10-08T00:30:44.707712+0000","last_unstale":"2023-10-08T00:30:45.699922+0000","last_undegraded":"2023-10-08T00:30:45.699922+0000","last_fullsized":"2023-10-08T00:30:45.699922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:20:48.812143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.709338+0000","last_change":"2023-10-08T00:30:45.707117+0000","last_active":"2023-10-08T00:30:45.709338+0000","last_peered":"2023-10-08T00:30:45.709338+0000","last_clean":"2023-10-08T00:30:45.709338+0000","last_became_active":"2023-10-08T00:30:45.706842+0000","last_became_peered":"2023-10-08T00:30:45.706842+0000","last_unstale":"2023-10-08T00:30:45.709338+0000","last_undegraded":"2023-10-08T00:30:45.709338+0000","last_fullsized":"2023-10-08T00:30:45.709338+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:44:52.720072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.705582+0000","last_change":"2023-10-08T00:30:44.704305+0000","last_active":"2023-10-08T00:30:45.705582+0000","last_peered":"2023-10-08T00:30:45.705582+0000","last_clean":"2023-10-08T00:30:45.705582+0000","last_became_active":"2023-10-08T00:30:44.704022+0000","last_became_peered":"2023-10-08T00:30:44.704022+0000","last_unstale":"2023-10-08T00:30:45.705582+0000","last_undegraded":"2023-10-08T00:30:45.705582+0000","last_fullsized":"2023-10-08T00:30:45.705582+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:11.800190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.720278+0000","last_change":"2023-10-08T00:30:45.716066+0000","last_active":"2023-10-08T00:30:45.720278+0000","last_peered":"2023-10-08T00:30:45.720278+0000","last_clean":"2023-10-08T00:30:45.720278+0000","last_became_active":"2023-10-08T00:30:45.715786+0000","last_became_peered":"2023-10-08T00:30:45.715786+0000","last_unstale":"2023-10-08T00:30:45.720278+0000","last_undegraded":"2023-10-08T00:30:45.720278+0000","last_fullsized":"2023-10-08T00:30:45.720278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:22.897981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.707284+0000","last_change":"2023-10-08T00:30:44.714717+0000","last_active":"2023-10-08T00:30:45.707284+0000","last_peered":"2023-10-08T00:30:45.707284+0000","last_clean":"2023-10-08T00:30:45.707284+0000","last_became_active":"2023-10-08T00:30:44.714309+0000","last_became_peered":"2023-10-08T00:30:44.714309+0000","last_unstale":"2023-10-08T00:30:45.707284+0000","last_undegraded":"2023-10-08T00:30:45.707284+0000","last_fullsized":"2023-10-08T00:30:45.707284+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:41.270496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717054+0000","last_change":"2023-10-08T00:30:45.707697+0000","last_active":"2023-10-08T00:30:45.717054+0000","last_peered":"2023-10-08T00:30:45.717054+0000","last_clean":"2023-10-08T00:30:45.717054+0000","last_became_active":"2023-10-08T00:30:45.706928+0000","last_became_peered":"2023-10-08T00:30:45.706928+0000","last_unstale":"2023-10-08T00:30:45.717054+0000","last_undegraded":"2023-10-08T00:30:45.717054+0000","last_fullsized":"2023-10-08T00:30:45.717054+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:26.944938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"89'3","reported_seq":13,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.720562+0000","last_change":"2023-10-08T00:30:44.710363+0000","last_active":"2023-10-08T00:30:45.720562+0000","last_peered":"2023-10-08T00:30:45.720562+0000","last_clean":"2023-10-08T00:30:45.720562+0000","last_became_active":"2023-10-08T00:30:44.710061+0000","last_became_peered":"2023-10-08T00:30:44.710061+0000","last_unstale":"2023-10-08T00:30:45.720562+0000","last_undegraded":"2023-10-08T00:30:45.720562+0000","last_fullsized":"2023-10-08T00:30:45.720562+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:25.939919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.711492+0000","last_change":"2023-10-08T00:30:45.710042+0000","last_active":"2023-10-08T00:30:45.711492+0000","last_peered":"2023-10-08T00:30:45.711492+0000","last_clean":"2023-10-08T00:30:45.711492+0000","last_became_active":"2023-10-08T00:30:45.709775+0000","last_became_peered":"2023-10-08T00:30:45.709775+0000","last_unstale":"2023-10-08T00:30:45.711492+0000","last_undegraded":"2023-10-08T00:30:45.711492+0000","last_fullsized":"2023-10-08T00:30:45.711492+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:15:24.683963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"89'6","reported_seq":16,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.722674+0000","last_change":"2023-10-08T00:30:44.705064+0000","last_active":"2023-10-08T00:30:45.722674+0000","last_peered":"2023-10-08T00:30:45.722674+0000","last_clean":"2023-10-08T00:30:45.722674+0000","last_became_active":"2023-10-08T00:30:44.704781+0000","last_became_peered":"2023-10-08T00:30:44.704781+0000","last_unstale":"2023-10-08T00:30:45.722674+0000","last_undegraded":"2023-10-08T00:30:45.722674+0000","last_fullsized":"2023-10-08T00:30:45.722674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:05.062638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.715431+0000","last_change":"2023-10-08T00:30:45.712830+0000","last_active":"2023-10-08T00:30:45.715431+0000","last_peered":"2023-10-08T00:30:45.715431+0000","last_clean":"2023-10-08T00:30:45.715431+0000","last_became_active":"2023-10-08T00:30:45.712277+0000","last_became_peered":"2023-10-08T00:30:45.712277+0000","last_unstale":"2023-10-08T00:30:45.715431+0000","last_undegraded":"2023-10-08T00:30:45.715431+0000","last_fullsized":"2023-10-08T00:30:45.715431+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:46.910499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.720604+0000","last_change":"2023-10-08T00:30:44.707647+0000","last_active":"2023-10-08T00:30:45.720604+0000","last_peered":"2023-10-08T00:30:45.720604+0000","last_clean":"2023-10-08T00:30:45.720604+0000","last_became_active":"2023-10-08T00:30:44.707180+0000","last_became_peered":"2023-10-08T00:30:44.707180+0000","last_unstale":"2023-10-08T00:30:45.720604+0000","last_undegraded":"2023-10-08T00:30:45.720604+0000","last_fullsized":"2023-10-08T00:30:45.720604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:45.073156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.714162+0000","last_change":"2023-10-08T00:30:45.708343+0000","last_active":"2023-10-08T00:30:45.714162+0000","last_peered":"2023-10-08T00:30:45.714162+0000","last_clean":"2023-10-08T00:30:45.714162+0000","last_became_active":"2023-10-08T00:30:45.708089+0000","last_became_peered":"2023-10-08T00:30:45.708089+0000","last_unstale":"2023-10-08T00:30:45.714162+0000","last_undegraded":"2023-10-08T00:30:45.714162+0000","last_fullsized":"2023-10-08T00:30:45.714162+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:13:34.227585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.694821+0000","last_change":"2023-10-08T00:30:44.705769+0000","last_active":"2023-10-08T00:30:45.694821+0000","last_peered":"2023-10-08T00:30:45.694821+0000","last_clean":"2023-10-08T00:30:45.694821+0000","last_became_active":"2023-10-08T00:30:44.705519+0000","last_became_peered":"2023-10-08T00:30:44.705519+0000","last_unstale":"2023-10-08T00:30:45.694821+0000","last_undegraded":"2023-10-08T00:30:45.694821+0000","last_fullsized":"2023-10-08T00:30:45.694821+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:16.315798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.719312+0000","last_change":"2023-10-08T00:30:45.711221+0000","last_active":"2023-10-08T00:30:45.719312+0000","last_peered":"2023-10-08T00:30:45.719312+0000","last_clean":"2023-10-08T00:30:45.719312+0000","last_became_active":"2023-10-08T00:30:45.708188+0000","last_became_peered":"2023-10-08T00:30:45.708188+0000","last_unstale":"2023-10-08T00:30:45.719312+0000","last_undegraded":"2023-10-08T00:30:45.719312+0000","last_fullsized":"2023-10-08T00:30:45.719312+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:23.380566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.705140+0000","last_change":"2023-10-08T00:30:44.710405+0000","last_active":"2023-10-08T00:30:45.705140+0000","last_peered":"2023-10-08T00:30:45.705140+0000","last_clean":"2023-10-08T00:30:45.705140+0000","last_became_active":"2023-10-08T00:30:44.710098+0000","last_became_peered":"2023-10-08T00:30:44.710098+0000","last_unstale":"2023-10-08T00:30:45.705140+0000","last_undegraded":"2023-10-08T00:30:45.705140+0000","last_fullsized":"2023-10-08T00:30:45.705140+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.716655+0000","last_change":"2023-10-08T00:30:45.706373+0000","last_active":"2023-10-08T00:30:45.716655+0000","last_peered":"2023-10-08T00:30:45.716655+0000","last_clean":"2023-10-08T00:30:45.716655+0000","last_became_active":"2023-10-08T00:30:45.706010+0000","last_became_peered":"2023-10-08T00:30:45.706010+0000","last_unstale":"2023-10-08T00:30:45.716655+0000","last_undegraded":"2023-10-08T00:30:45.716655+0000","last_fullsized":"2023-10-08T00:30:45.716655+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:24:31.494814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"89'8","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.715709+0000","last_change":"2023-10-08T00:30:44.708459+0000","last_active":"2023-10-08T00:30:45.715709+0000","last_peered":"2023-10-08T00:30:45.715709+0000","last_clean":"2023-10-08T00:30:45.715709+0000","last_became_active":"2023-10-08T00:30:44.708004+0000","last_became_peered":"2023-10-08T00:30:44.708004+0000","last_unstale":"2023-10-08T00:30:45.715709+0000","last_undegraded":"2023-10-08T00:30:45.715709+0000","last_fullsized":"2023-10-08T00:30:45.715709+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.718997+0000","last_change":"2023-10-08T00:30:45.710506+0000","last_active":"2023-10-08T00:30:45.718997+0000","last_peered":"2023-10-08T00:30:45.718997+0000","last_clean":"2023-10-08T00:30:45.718997+0000","last_became_active":"2023-10-08T00:30:45.710244+0000","last_became_peered":"2023-10-08T00:30:45.710244+0000","last_unstale":"2023-10-08T00:30:45.718997+0000","last_undegraded":"2023-10-08T00:30:45.718997+0000","last_fullsized":"2023-10-08T00:30:45.718997+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:23.380566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.718055+0000","last_change":"2023-10-08T00:30:44.709060+0000","last_active":"2023-10-08T00:30:45.718055+0000","last_peered":"2023-10-08T00:30:45.718055+0000","last_clean":"2023-10-08T00:30:45.718055+0000","last_became_active":"2023-10-08T00:30:44.708679+0000","last_became_peered":"2023-10-08T00:30:44.708679+0000","last_unstale":"2023-10-08T00:30:45.718055+0000","last_undegraded":"2023-10-08T00:30:45.718055+0000","last_fullsized":"2023-10-08T00:30:45.718055+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:25.267932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.714319+0000","last_change":"2023-10-08T00:30:45.713545+0000","last_active":"2023-10-08T00:30:45.714319+0000","last_peered":"2023-10-08T00:30:45.714319+0000","last_clean":"2023-10-08T00:30:45.714319+0000","last_became_active":"2023-10-08T00:30:45.713280+0000","last_became_peered":"2023-10-08T00:30:45.713280+0000","last_unstale":"2023-10-08T00:30:45.714319+0000","last_undegraded":"2023-10-08T00:30:45.714319+0000","last_fullsized":"2023-10-08T00:30:45.714319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:26.272951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.710219+0000","last_change":"2023-10-08T00:30:44.705803+0000","last_active":"2023-10-08T00:30:45.710219+0000","last_peered":"2023-10-08T00:30:45.710219+0000","last_clean":"2023-10-08T00:30:45.710219+0000","last_became_active":"2023-10-08T00:30:44.705386+0000","last_became_peered":"2023-10-08T00:30:44.705386+0000","last_unstale":"2023-10-08T00:30:45.710219+0000","last_undegraded":"2023-10-08T00:30:45.710219+0000","last_fullsized":"2023-10-08T00:30:45.710219+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:03:40.501255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.723097+0000","last_change":"2023-10-08T00:30:45.721172+0000","last_active":"2023-10-08T00:30:45.723097+0000","last_peered":"2023-10-08T00:30:45.723097+0000","last_clean":"2023-10-08T00:30:45.723097+0000","last_became_active":"2023-10-08T00:30:45.720983+0000","last_became_peered":"2023-10-08T00:30:45.720983+0000","last_unstale":"2023-10-08T00:30:45.723097+0000","last_undegraded":"2023-10-08T00:30:45.723097+0000","last_fullsized":"2023-10-08T00:30:45.723097+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:08.344372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.699877+0000","last_change":"2023-10-08T00:30:44.705265+0000","last_active":"2023-10-08T00:30:45.699877+0000","last_peered":"2023-10-08T00:30:45.699877+0000","last_clean":"2023-10-08T00:30:45.699877+0000","last_became_active":"2023-10-08T00:30:44.704959+0000","last_became_peered":"2023-10-08T00:30:44.704959+0000","last_unstale":"2023-10-08T00:30:45.699877+0000","last_undegraded":"2023-10-08T00:30:45.699877+0000","last_fullsized":"2023-10-08T00:30:45.699877+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:33.211544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717562+0000","last_change":"2023-10-08T00:30:45.710486+0000","last_active":"2023-10-08T00:30:45.717562+0000","last_peered":"2023-10-08T00:30:45.717562+0000","last_clean":"2023-10-08T00:30:45.717562+0000","last_became_active":"2023-10-08T00:30:45.710050+0000","last_became_peered":"2023-10-08T00:30:45.710050+0000","last_unstale":"2023-10-08T00:30:45.717562+0000","last_undegraded":"2023-10-08T00:30:45.717562+0000","last_fullsized":"2023-10-08T00:30:45.717562+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:10:11.595972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.716804+0000","last_change":"2023-10-08T00:30:44.713341+0000","last_active":"2023-10-08T00:30:45.716804+0000","last_peered":"2023-10-08T00:30:45.716804+0000","last_clean":"2023-10-08T00:30:45.716804+0000","last_became_active":"2023-10-08T00:30:44.712993+0000","last_became_peered":"2023-10-08T00:30:44.712993+0000","last_unstale":"2023-10-08T00:30:45.716804+0000","last_undegraded":"2023-10-08T00:30:45.716804+0000","last_fullsized":"2023-10-08T00:30:45.716804+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:56:52.621901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.716424+0000","last_change":"2023-10-08T00:30:45.706420+0000","last_active":"2023-10-08T00:30:45.716424+0000","last_peered":"2023-10-08T00:30:45.716424+0000","last_clean":"2023-10-08T00:30:45.716424+0000","last_became_active":"2023-10-08T00:30:45.706148+0000","last_became_peered":"2023-10-08T00:30:45.706148+0000","last_unstale":"2023-10-08T00:30:45.716424+0000","last_undegraded":"2023-10-08T00:30:45.716424+0000","last_fullsized":"2023-10-08T00:30:45.716424+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:27.216951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.704631+0000","last_change":"2023-10-08T00:30:44.703046+0000","last_active":"2023-10-08T00:30:45.704631+0000","last_peered":"2023-10-08T00:30:45.704631+0000","last_clean":"2023-10-08T00:30:45.704631+0000","last_became_active":"2023-10-08T00:30:44.702787+0000","last_became_peered":"2023-10-08T00:30:44.702787+0000","last_unstale":"2023-10-08T00:30:45.704631+0000","last_undegraded":"2023-10-08T00:30:45.704631+0000","last_fullsized":"2023-10-08T00:30:45.704631+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:08.293569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717432+0000","last_change":"2023-10-08T00:30:45.709370+0000","last_active":"2023-10-08T00:30:45.717432+0000","last_peered":"2023-10-08T00:30:45.717432+0000","last_clean":"2023-10-08T00:30:45.717432+0000","last_became_active":"2023-10-08T00:30:45.708957+0000","last_became_peered":"2023-10-08T00:30:45.708957+0000","last_unstale":"2023-10-08T00:30:45.717432+0000","last_undegraded":"2023-10-08T00:30:45.717432+0000","last_fullsized":"2023-10-08T00:30:45.717432+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:20:49.817162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.704898+0000","last_change":"2023-10-08T00:30:44.708004+0000","last_active":"2023-10-08T00:30:45.704898+0000","last_peered":"2023-10-08T00:30:45.704898+0000","last_clean":"2023-10-08T00:30:45.704898+0000","last_became_active":"2023-10-08T00:30:44.707667+0000","last_became_peered":"2023-10-08T00:30:44.707667+0000","last_unstale":"2023-10-08T00:30:45.704898+0000","last_undegraded":"2023-10-08T00:30:45.704898+0000","last_fullsized":"2023-10-08T00:30:45.704898+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:00.514679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.720374+0000","last_change":"2023-10-08T00:30:45.711333+0000","last_active":"2023-10-08T00:30:45.720374+0000","last_peered":"2023-10-08T00:30:45.720374+0000","last_clean":"2023-10-08T00:30:45.720374+0000","last_became_active":"2023-10-08T00:30:45.710604+0000","last_became_peered":"2023-10-08T00:30:45.710604+0000","last_unstale":"2023-10-08T00:30:45.720374+0000","last_undegraded":"2023-10-08T00:30:45.720374+0000","last_fullsized":"2023-10-08T00:30:45.720374+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:43:35.234111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.698894+0000","last_change":"2023-10-08T00:30:44.714436+0000","last_active":"2023-10-08T00:30:45.698894+0000","last_peered":"2023-10-08T00:30:45.698894+0000","last_clean":"2023-10-08T00:30:45.698894+0000","last_became_active":"2023-10-08T00:30:44.713873+0000","last_became_peered":"2023-10-08T00:30:44.713873+0000","last_unstale":"2023-10-08T00:30:45.698894+0000","last_undegraded":"2023-10-08T00:30:45.698894+0000","last_fullsized":"2023-10-08T00:30:45.698894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:52.850417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717319+0000","last_change":"2023-10-08T00:30:45.715107+0000","last_active":"2023-10-08T00:30:45.717319+0000","last_peered":"2023-10-08T00:30:45.717319+0000","last_clean":"2023-10-08T00:30:45.717319+0000","last_became_active":"2023-10-08T00:30:45.714632+0000","last_became_peered":"2023-10-08T00:30:45.714632+0000","last_unstale":"2023-10-08T00:30:45.717319+0000","last_undegraded":"2023-10-08T00:30:45.717319+0000","last_fullsized":"2023-10-08T00:30:45.717319+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:55.130031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"89'2","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717767+0000","last_change":"2023-10-08T00:30:44.704755+0000","last_active":"2023-10-08T00:30:45.717767+0000","last_peered":"2023-10-08T00:30:45.717767+0000","last_clean":"2023-10-08T00:30:45.717767+0000","last_became_active":"2023-10-08T00:30:44.704481+0000","last_became_peered":"2023-10-08T00:30:44.704481+0000","last_unstale":"2023-10-08T00:30:45.717767+0000","last_undegraded":"2023-10-08T00:30:45.717767+0000","last_fullsized":"2023-10-08T00:30:45.717767+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:48:12.780556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.714300+0000","last_change":"2023-10-08T00:30:45.708844+0000","last_active":"2023-10-08T00:30:45.714300+0000","last_peered":"2023-10-08T00:30:45.714300+0000","last_clean":"2023-10-08T00:30:45.714300+0000","last_became_active":"2023-10-08T00:30:45.708597+0000","last_became_peered":"2023-10-08T00:30:45.708597+0000","last_unstale":"2023-10-08T00:30:45.714300+0000","last_undegraded":"2023-10-08T00:30:45.714300+0000","last_fullsized":"2023-10-08T00:30:45.714300+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:45.124219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.701808+0000","last_change":"2023-10-08T00:30:44.713430+0000","last_active":"2023-10-08T00:30:45.701808+0000","last_peered":"2023-10-08T00:30:45.701808+0000","last_clean":"2023-10-08T00:30:45.701808+0000","last_became_active":"2023-10-08T00:30:44.712985+0000","last_became_peered":"2023-10-08T00:30:44.712985+0000","last_unstale":"2023-10-08T00:30:45.701808+0000","last_undegraded":"2023-10-08T00:30:45.701808+0000","last_fullsized":"2023-10-08T00:30:45.701808+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:28:36.560087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.715266+0000","last_change":"2023-10-08T00:30:45.713817+0000","last_active":"2023-10-08T00:30:45.715266+0000","last_peered":"2023-10-08T00:30:45.715266+0000","last_clean":"2023-10-08T00:30:45.715266+0000","last_became_active":"2023-10-08T00:30:45.713520+0000","last_became_peered":"2023-10-08T00:30:45.713520+0000","last_unstale":"2023-10-08T00:30:45.715266+0000","last_undegraded":"2023-10-08T00:30:45.715266+0000","last_fullsized":"2023-10-08T00:30:45.715266+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:58.896960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.701554+0000","last_change":"2023-10-08T00:30:44.704933+0000","last_active":"2023-10-08T00:30:45.701554+0000","last_peered":"2023-10-08T00:30:45.701554+0000","last_clean":"2023-10-08T00:30:45.701554+0000","last_became_active":"2023-10-08T00:30:44.704649+0000","last_became_peered":"2023-10-08T00:30:44.704649+0000","last_unstale":"2023-10-08T00:30:45.701554+0000","last_undegraded":"2023-10-08T00:30:45.701554+0000","last_fullsized":"2023-10-08T00:30:45.701554+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:07.459987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.718878+0000","last_change":"2023-10-08T00:30:45.710087+0000","last_active":"2023-10-08T00:30:45.718878+0000","last_peered":"2023-10-08T00:30:45.718878+0000","last_clean":"2023-10-08T00:30:45.718878+0000","last_became_active":"2023-10-08T00:30:45.709773+0000","last_became_peered":"2023-10-08T00:30:45.709773+0000","last_unstale":"2023-10-08T00:30:45.718878+0000","last_undegraded":"2023-10-08T00:30:45.718878+0000","last_fullsized":"2023-10-08T00:30:45.718878+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:42.275515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.699209+0000","last_change":"2023-10-08T00:30:44.710667+0000","last_active":"2023-10-08T00:30:45.699209+0000","last_peered":"2023-10-08T00:30:45.699209+0000","last_clean":"2023-10-08T00:30:45.699209+0000","last_became_active":"2023-10-08T00:30:44.710406+0000","last_became_peered":"2023-10-08T00:30:44.710406+0000","last_unstale":"2023-10-08T00:30:45.699209+0000","last_undegraded":"2023-10-08T00:30:45.699209+0000","last_fullsized":"2023-10-08T00:30:45.699209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:14.173257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717540+0000","last_change":"2023-10-08T00:30:45.710299+0000","last_active":"2023-10-08T00:30:45.717540+0000","last_peered":"2023-10-08T00:30:45.717540+0000","last_clean":"2023-10-08T00:30:45.717540+0000","last_became_active":"2023-10-08T00:30:45.709680+0000","last_became_peered":"2023-10-08T00:30:45.709680+0000","last_unstale":"2023-10-08T00:30:45.717540+0000","last_undegraded":"2023-10-08T00:30:45.717540+0000","last_fullsized":"2023-10-08T00:30:45.717540+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:57.801804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.700873+0000","last_change":"2023-10-08T00:30:44.708441+0000","last_active":"2023-10-08T00:30:45.700873+0000","last_peered":"2023-10-08T00:30:45.700873+0000","last_clean":"2023-10-08T00:30:45.700873+0000","last_became_active":"2023-10-08T00:30:44.708130+0000","last_became_peered":"2023-10-08T00:30:44.708130+0000","last_unstale":"2023-10-08T00:30:45.700873+0000","last_undegraded":"2023-10-08T00:30:45.700873+0000","last_fullsized":"2023-10-08T00:30:45.700873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:25:35.254288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.720459+0000","last_change":"2023-10-08T00:30:45.716717+0000","last_active":"2023-10-08T00:30:45.720459+0000","last_peered":"2023-10-08T00:30:45.720459+0000","last_clean":"2023-10-08T00:30:45.720459+0000","last_became_active":"2023-10-08T00:30:45.716281+0000","last_became_peered":"2023-10-08T00:30:45.716281+0000","last_unstale":"2023-10-08T00:30:45.720459+0000","last_undegraded":"2023-10-08T00:30:45.720459+0000","last_fullsized":"2023-10-08T00:30:45.720459+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:25:42.275515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.699117+0000","last_change":"2023-10-08T00:30:44.711775+0000","last_active":"2023-10-08T00:30:45.699117+0000","last_peered":"2023-10-08T00:30:45.699117+0000","last_clean":"2023-10-08T00:30:45.699117+0000","last_became_active":"2023-10-08T00:30:44.711484+0000","last_became_peered":"2023-10-08T00:30:44.711484+0000","last_unstale":"2023-10-08T00:30:45.699117+0000","last_undegraded":"2023-10-08T00:30:45.699117+0000","last_fullsized":"2023-10-08T00:30:45.699117+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:33.150022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717412+0000","last_change":"2023-10-08T00:30:45.709211+0000","last_active":"2023-10-08T00:30:45.717412+0000","last_peered":"2023-10-08T00:30:45.717412+0000","last_clean":"2023-10-08T00:30:45.717412+0000","last_became_active":"2023-10-08T00:30:45.708615+0000","last_became_peered":"2023-10-08T00:30:45.708615+0000","last_unstale":"2023-10-08T00:30:45.717412+0000","last_undegraded":"2023-10-08T00:30:45.717412+0000","last_fullsized":"2023-10-08T00:30:45.717412+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:30:46.028220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.707472+0000","last_change":"2023-10-08T00:30:44.711141+0000","last_active":"2023-10-08T00:30:45.707472+0000","last_peered":"2023-10-08T00:30:45.707472+0000","last_clean":"2023-10-08T00:30:45.707472+0000","last_became_active":"2023-10-08T00:30:44.710854+0000","last_became_peered":"2023-10-08T00:30:44.710854+0000","last_unstale":"2023-10-08T00:30:45.707472+0000","last_undegraded":"2023-10-08T00:30:45.707472+0000","last_fullsized":"2023-10-08T00:30:45.707472+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:02:21.892962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.720395+0000","last_change":"2023-10-08T00:30:45.712748+0000","last_active":"2023-10-08T00:30:45.720395+0000","last_peered":"2023-10-08T00:30:45.720395+0000","last_clean":"2023-10-08T00:30:45.720395+0000","last_became_active":"2023-10-08T00:30:45.711021+0000","last_became_peered":"2023-10-08T00:30:45.711021+0000","last_unstale":"2023-10-08T00:30:45.720395+0000","last_undegraded":"2023-10-08T00:30:45.720395+0000","last_fullsized":"2023-10-08T00:30:45.720395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:09:53.855436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.694561+0000","last_change":"2023-10-08T00:30:44.696634+0000","last_active":"2023-10-08T00:30:45.694561+0000","last_peered":"2023-10-08T00:30:45.694561+0000","last_clean":"2023-10-08T00:30:45.694561+0000","last_became_active":"2023-10-08T00:30:44.696331+0000","last_became_peered":"2023-10-08T00:30:44.696331+0000","last_unstale":"2023-10-08T00:30:45.694561+0000","last_undegraded":"2023-10-08T00:30:45.694561+0000","last_fullsized":"2023-10-08T00:30:45.694561+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:40:15.888161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.717409+0000","last_change":"2023-10-08T00:30:45.709058+0000","last_active":"2023-10-08T00:30:45.717409+0000","last_peered":"2023-10-08T00:30:45.717409+0000","last_clean":"2023-10-08T00:30:45.717409+0000","last_became_active":"2023-10-08T00:30:45.708798+0000","last_became_peered":"2023-10-08T00:30:45.708798+0000","last_unstale":"2023-10-08T00:30:45.717409+0000","last_undegraded":"2023-10-08T00:30:45.717409+0000","last_fullsized":"2023-10-08T00:30:45.717409+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:44.685474+0000","last_clean_scrub_stamp":"2023-10-08T00:30:44.685474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:31:59.295044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"89'1","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.712394+0000","last_change":"2023-10-08T00:30:44.706968+0000","last_active":"2023-10-08T00:30:45.712394+0000","last_peered":"2023-10-08T00:30:45.712394+0000","last_clean":"2023-10-08T00:30:45.712394+0000","last_became_active":"2023-10-08T00:30:44.706703+0000","last_became_peered":"2023-10-08T00:30:44.706703+0000","last_unstale":"2023-10-08T00:30:45.712394+0000","last_undegraded":"2023-10-08T00:30:45.712394+0000","last_fullsized":"2023-10-08T00:30:45.712394+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:30:43.680455+0000","last_clean_scrub_stamp":"2023-10-08T00:30:43.680455+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:19:28.079856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":220,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-10-08T00:30:45.703264+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:30:45.703264+0000","last_peered":"2023-10-08T00:30:45.703264+0000","last_clean":"2023-10-08T00:30:45.703264+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:30:45.703264+0000","last_undegraded":"2023-10-08T00:30:45.703264+0000","last_fullsized":"2023-10-08T00:30:45.703264+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":1071300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.50700000000000001},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52800000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53200000000000003},"min":{"1min":0.376,"5min":0.318,"15min":0.318},"max":{"1min":0.73299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.499},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79900000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57699999999999996}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54800000000000004,"15min":0.55800000000000005},"min":{"1min":0.41099999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.876,"15min":0.876},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.46899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.46999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.73999999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.50600000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61499999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53800000000000003,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.67200000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54900000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.54000000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70799999999999996,"5min":1.048,"15min":1.048},"last":0.48399999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.81299999999999994,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298384,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073456,"statfs":{"total":96636764160,"available":96331218944,"internally_reserved":0,"allocated":1122304,"data_stored":481444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.442},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.90700000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53300000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.35199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.747,"5min":1.145,"15min":1.145},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52800000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65800000000000003,"5min":0.873,"15min":0.873},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56100000000000005,"15min":0.57499999999999996},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71499999999999997,"5min":1.079,"15min":1.079},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.57999999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.72699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41599999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.70299999999999996,"5min":1.127,"15min":1.127},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76800000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.502}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.59799999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59299999999999997,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.81299999999999994,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.745,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.621},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.44400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67700000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59299999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.59299999999999997},"min":{"1min":0.45100000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.61599999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.68600000000000005,"5min":1.093,"15min":1.093},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302472,"kb_used_data":1088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069368,"statfs":{"total":96636764160,"available":96327032832,"internally_reserved":0,"allocated":1114112,"data_stored":480820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.219,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.44700000000000001,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24299999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46200000000000002,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.51800000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38,"15min":0.378},"min":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42899999999999999,"15min":0.41699999999999998},"min":{"1min":0.34399999999999997,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.55400000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.438},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39500000000000002,"15min":0.39900000000000002},"min":{"1min":0.33100000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54400000000000004,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.32400000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.48299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.77100000000000002,"5min":1.004,"15min":1.004},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.62,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.76800000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.311,"15min":0.311},"max":{"1min":0.78400000000000003,"5min":1.294,"15min":1.294},"last":0.745},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63800000000000001,"15min":0.65200000000000002},"min":{"1min":0.46899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80300000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88700000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72999999999999998,"5min":1.038,"15min":1.038},"last":0.621},{"interface":"front","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":0.999,"15min":0.999},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59499999999999997,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.754,"5min":0.879,"15min":0.879},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":1.087,"15min":1.087},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303056,"kb_used_data":1672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068784,"statfs":{"total":96636764160,"available":96326434816,"internally_reserved":0,"allocated":1712128,"data_stored":1071742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.33500000000000002,"15min":0.36199999999999999},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.44900000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.311},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.498,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.371,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.45100000000000001,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.38},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.55000000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.33300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.378},"min":{"1min":0.316,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53700000000000003,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.432,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.88600000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.621,"15min":0.624},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84899999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55800000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.83299999999999996,"5min":1.242,"15min":1.242},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.62,"15min":0.622},"min":{"1min":0.52400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85699999999999998,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.74099999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60699999999999998,"15min":0.61499999999999999},"min":{"1min":0.46000000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44600000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.72799999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.61599999999999999,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81999999999999995,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.42699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302476,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069364,"statfs":{"total":96636764160,"available":96327028736,"internally_reserved":0,"allocated":1118208,"data_stored":480854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.34999999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.443,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.35699999999999998,"15min":0.38900000000000001},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54900000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.38100000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35499999999999998,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48699999999999999,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.439},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41499999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60499999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.35299999999999998,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52700000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40699999999999997,"15min":0.433},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.59299999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80500000000000005,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.63400000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80000000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63800000000000001,"15min":0.67800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77700000000000002,"5min":1.278,"15min":1.278},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.66000000000000003},"min":{"1min":0.42799999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72699999999999998,"5min":1.137,"15min":1.137},"last":0.497},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59799999999999998,"15min":0.621},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77200000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:29:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.753,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.61799999999999999,"15min":0.67000000000000004},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.71799999999999997,"5min":1.343,"15min":1.343},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302488,"kb_used_data":1104,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069352,"statfs":{"total":96636764160,"available":96327016448,"internally_reserved":0,"allocated":1130496,"data_stored":482378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.34100000000000003,"15min":0.34699999999999998},"min":{"1min":0.23599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51200000000000001,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.501,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34000000000000002,"15min":0.34799999999999998},"min":{"1min":0.23100000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51600000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.371,"15min":0.373},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.36199999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39200000000000002,"15min":0.40400000000000003},"min":{"1min":0.28199999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42899999999999999,"15min":0.443},"min":{"1min":0.32700000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.376,"15min":0.376},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.59899999999999998},"min":{"1min":0.44400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.63300000000000001},"min":{"1min":0.51700000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60999999999999999,"15min":0.63300000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92100000000000004,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.504}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89100000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1134592,"data_stored":482480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.496,"15min":0.47999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.66600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.498},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64400000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.435}]},{"osd":1,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53400000000000003,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71599999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.58199999999999996,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":1.712,"15min":1.712},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.36899999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.73099999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71999999999999997,"5min":0.873,"15min":0.873},"last":0.40699999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.36599999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.753,"5min":1.002,"15min":1.002},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.54800000000000004},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69499999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.40100000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76800000000000002,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:29:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.38600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70599999999999996,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.622},"min":{"1min":0.438,"5min":0.373,"15min":0.373},"max":{"1min":0.73699999999999999,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298380,"kb_used_data":1092,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073460,"statfs":{"total":96636764160,"available":96331223040,"internally_reserved":0,"allocated":1118208,"data_stored":480890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52500000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.379,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.45600000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.629},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.63300000000000001,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71999999999999997,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77700000000000002,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.57099999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.627,"15min":0.68100000000000005},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77600000000000002,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.55800000000000005},"min":{"1min":0.372,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.52400000000000002,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.36299999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53200000000000003,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.74299999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56299999999999994,"15min":0.60299999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47999999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:29:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59799999999999998,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:30:54.777 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:30:54.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:30:54.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.935+0000 7fa3c1364700 1 Processor -- start 2023-10-08T00:30:54.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.936+0000 7fa3c1364700 1 -- start start 2023-10-08T00:30:54.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.936+0000 7fa3c1364700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3bc159950 0x7fa3bc0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.936+0000 7fa3c1364700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0ce380 con 0x7fa3bc069c70 2023-10-08T00:30:54.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.936+0000 7fa3c1364700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0cec20 con 0x7fa3bc0af320 2023-10-08T00:30:54.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.936+0000 7fa3c1364700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc0afa90 con 0x7fa3bc159950 2023-10-08T00:30:54.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3baffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3bc159950 0x7fa3bc0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3bb7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa3bc069c70 0x7fa3bc0cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:55304/0 (socket says 172.21.15.22:55304) 2023-10-08T00:30:54.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3bb7fe700 1 -- 172.21.15.22:0/947420207 learned_addr learned my addr 172.21.15.22:0/947420207 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3baffd700 1 -- 172.21.15.22:0/947420207 >> v1:172.21.15.192:6789/0 conn(0x7fa3bc0af320 legacy=0x7fa3bc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3baffd700 1 -- 172.21.15.22:0/947420207 >> v1:172.21.15.22:6789/0 conn(0x7fa3bc069c70 legacy=0x7fa3bc0cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3baffd700 1 -- 172.21.15.22:0/947420207 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0ce5d0 con 0x7fa3bc159950 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3baffd700 1 --2- 172.21.15.22:0/947420207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc159950 0x7fa3bc0cbb90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40098e0 tx=0x7fa3b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74eaa7e2dfbf70ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3b9ffb700 1 -- 172.21.15.22:0/947420207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4009e80 con 0x7fa3bc159950 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3b9ffb700 1 -- 172.21.15.22:0/947420207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b400b860 con 0x7fa3bc159950 2023-10-08T00:30:54.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.937+0000 7fa3b9ffb700 1 -- 172.21.15.22:0/947420207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400bbe0 con 0x7fa3bc159950 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 -- 172.21.15.22:0/947420207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc159950 msgr2=0x7fa3bc0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 --2- 172.21.15.22:0/947420207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc159950 0x7fa3bc0cbb90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40098e0 tx=0x7fa3b40091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 -- 172.21.15.22:0/947420207 shutdown_connections 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 --2- 172.21.15.22:0/947420207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc159950 0x7fa3bc0cbb90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 -- 172.21.15.22:0/947420207 >> 172.21.15.22:0/947420207 conn(0x7fa3bc068e00 msgr2=0x7fa3bc0d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 -- 172.21.15.22:0/947420207 shutdown_connections 2023-10-08T00:30:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.938+0000 7fa3c1364700 1 -- 172.21.15.22:0/947420207 wait complete. 2023-10-08T00:30:54.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.939+0000 7fa3c1364700 1 Processor -- start 2023-10-08T00:30:54.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.939+0000 7fa3c1364700 1 -- start start 2023-10-08T00:30:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3c1364700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc069c70 0x7fa3bc0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3c1364700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 0x7fa3bc0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3c1364700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3bc159950 0x7fa3bc0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3c1364700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c8b20 con 0x7fa3bc0af320 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3c1364700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c9980 con 0x7fa3bc069c70 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3c1364700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c8d70 con 0x7fa3bc159950 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 0x7fa3bc0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 0x7fa3bc0cf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54812/0 (socket says 172.21.15.22:54812) 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 -- 172.21.15.22:0/543548376 learned_addr learned my addr 172.21.15.22:0/543548376 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3baffd700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc069c70 0x7fa3bc0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3bb7fe700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3bc159950 0x7fa3bc0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 -- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3bc159950 msgr2=0x7fa3bc0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3bc159950 0x7fa3bc0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 -- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc069c70 msgr2=0x7fa3bc0b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc069c70 0x7fa3bc0b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 -- 172.21.15.22:0/543548376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4009420 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3bb7fe700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3bc159950 0x7fa3bc0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.940+0000 7fa3ba7fc700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 0x7fa3bc0cf0b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c590 tx=0x7fa3a400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.941+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011590 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.941+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4011710 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.941+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc0c9050 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.941+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4011ad0 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.941+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc0c9610 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.941+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc0c9af0 con 0x7fa3bc0af320 2023-10-08T00:30:54.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.942+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa3a401b3b0 con 0x7fa3bc0af320 2023-10-08T00:30:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.942+0000 7fa3b2ffd700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa39c067200 0x7fa39c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.942+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3a4083ec0 con 0x7fa3bc0af320 2023-10-08T00:30:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.943+0000 7fa3baffd700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa39c067200 0x7fa39c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.943+0000 7fa3baffd700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa39c067200 0x7fa39c0696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40093f0 tx=0x7fa3b4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:54.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:54.947+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3a4050de0 con 0x7fa3bc0af320 2023-10-08T00:30:55.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.223+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa3bc0718b0 con 0x7fa3bc0af320 2023-10-08T00:30:55.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.227+0000 7fa3b2ffd700 1 -- 172.21.15.22:0/543548376 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa3a4017070 con 0x7fa3bc0af320 2023-10-08T00:30:55.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa39c067200 msgr2=0x7fa39c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa39c067200 0x7fa39c0696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40093f0 tx=0x7fa3b4017000 comp rx=0 tx=0).stop 2023-10-08T00:30:55.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 msgr2=0x7fa3bc0cf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 0x7fa3bc0cf0b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c590 tx=0x7fa3a400c8a0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 shutdown_connections 2023-10-08T00:30:55.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa39c067200 0x7fa39c0696b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa3bc159950 0x7fa3bc0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3bc069c70 0x7fa3bc0b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 --2- 172.21.15.22:0/543548376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3bc0af320 0x7fa3bc0cf0b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 >> 172.21.15.22:0/543548376 conn(0x7fa3bc068e00 msgr2=0x7fa3bc069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 shutdown_connections 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.229+0000 7fa3c1364700 1 -- 172.21.15.22:0/543548376 wait complete. 2023-10-08T00:30:55.231 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:30:55.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:30:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.360+0000 7f8985c20700 1 Processor -- start 2023-10-08T00:30:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.360+0000 7f8985c20700 1 -- start start 2023-10-08T00:30:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f8985c20700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f898006aa40 0x7f89800cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f8985c20700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f898006bac0 0x7f898006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f8985c20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006b350 0x7f89800c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f8985c20700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800cc210 con 0x7f898006aa40 2023-10-08T00:30:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f8985c20700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800cc4f0 con 0x7f898006bac0 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f8985c20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800cc7d0 con 0x7f898006b350 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f897f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f898006aa40 0x7f89800cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f897f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f898006aa40 0x7f89800cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54816/0 (socket says 172.21.15.22:54816) 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.361+0000 7f897f7fe700 1 -- 172.21.15.22:0/1507455476 learned_addr learned my addr 172.21.15.22:0/1507455476 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897ffff700 1 --2- 172.21.15.22:0/1507455476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006b350 0x7f89800c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897effd700 1 --2- 172.21.15.22:0/1507455476 >> v2:172.21.15.192:3300/0 conn(0x7f898006bac0 0x7f898006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897f7fe700 1 -- 172.21.15.22:0/1507455476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006b350 msgr2=0x7f89800c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897f7fe700 1 --2- 172.21.15.22:0/1507455476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006b350 0x7f89800c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897f7fe700 1 -- 172.21.15.22:0/1507455476 >> v2:172.21.15.192:3300/0 conn(0x7f898006bac0 msgr2=0x7f898006ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897f7fe700 1 --2- 172.21.15.22:0/1507455476 >> v2:172.21.15.192:3300/0 conn(0x7f898006bac0 0x7f898006ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897f7fe700 1 -- 172.21.15.22:0/1507455476 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800ccab0 con 0x7f898006aa40 2023-10-08T00:30:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897f7fe700 1 --2- 172.21.15.22:0/1507455476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006aa40 0x7f89800cbc00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f89800cc140 tx=0x7f8970009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a53b604726f627 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897e7fc700 1 -- 172.21.15.22:0/1507455476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970005c10 con 0x7f898006aa40 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897e7fc700 1 -- 172.21.15.22:0/1507455476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8970005d70 con 0x7f898006aa40 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f897e7fc700 1 -- 172.21.15.22:0/1507455476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897000b880 con 0x7f898006aa40 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f8985c20700 1 -- 172.21.15.22:0/1507455476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006aa40 msgr2=0x7f89800cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.362+0000 7f8985c20700 1 --2- 172.21.15.22:0/1507455476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006aa40 0x7f89800cbc00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f89800cc140 tx=0x7f8970009220 comp rx=0 tx=0).stop 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 -- 172.21.15.22:0/1507455476 shutdown_connections 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 --2- 172.21.15.22:0/1507455476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006aa40 0x7f89800cbc00 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 --2- 172.21.15.22:0/1507455476 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006b350 0x7f89800c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 --2- 172.21.15.22:0/1507455476 >> v2:172.21.15.192:3300/0 conn(0x7f898006bac0 0x7f898006ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 -- 172.21.15.22:0/1507455476 >> 172.21.15.22:0/1507455476 conn(0x7f89800cd670 msgr2=0x7f89800cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 -- 172.21.15.22:0/1507455476 shutdown_connections 2023-10-08T00:30:55.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.363+0000 7f8985c20700 1 -- 172.21.15.22:0/1507455476 wait complete. 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.364+0000 7f8985c20700 1 Processor -- start 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.364+0000 7f8985c20700 1 -- start start 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.364+0000 7f8985c20700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f898006aa40 0x7f898014ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 0x7f89801530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006bac0 0x7f89801535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898013cc00 con 0x7f898006b350 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980156b10 con 0x7f898006aa40 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8980157970 con 0x7f898006bac0 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 0x7f89801530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 0x7f89801530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54830/0 (socket says 172.21.15.22:54830) 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 -- 172.21.15.22:0/223371044 learned_addr learned my addr 172.21.15.22:0/223371044 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897f7fe700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f898006aa40 0x7f898014ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897ffff700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006bac0 0x7f89801535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 -- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006bac0 msgr2=0x7f89801535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006bac0 0x7f89801535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 -- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f898006aa40 msgr2=0x7f898014ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f898006aa40 0x7f898014ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 -- 172.21.15.22:0/223371044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009480 con 0x7f898006b350 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897f7fe700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f898006aa40 0x7f898014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:55.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f897effd700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 0x7f89801530a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f897400d890 tx=0x7f8974008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974009610 con 0x7f898006b350 2023-10-08T00:30:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974009770 con 0x7f898006b350 2023-10-08T00:30:55.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8980156d60 con 0x7f898006b350 2023-10-08T00:30:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974009b30 con 0x7f898006b350 2023-10-08T00:30:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.365+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8980157320 con 0x7f898006b350 2023-10-08T00:30:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.366+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898004c3c0 con 0x7f898006b350 2023-10-08T00:30:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.367+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f897401e460 con 0x7f898006b350 2023-10-08T00:30:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.367+0000 7f89677fe700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f896c067200 0x7f896c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:55.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.367+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8974085000 con 0x7f898006b350 2023-10-08T00:30:55.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.367+0000 7f897f7fe700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f896c067200 0x7f896c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.368+0000 7f897f7fe700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f896c067200 0x7f896c0696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8970009260 tx=0x7f8970016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:55.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.371+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8974051f20 con 0x7f898006b350 2023-10-08T00:30:55.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.608+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8980157ab0 con 0x7f898006b350 2023-10-08T00:30:55.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.609+0000 7f89677fe700 1 -- 172.21.15.22:0/223371044 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8974055540 con 0x7f898006b350 2023-10-08T00:30:55.609 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:30:55.609 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":60,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:45.103135+0000","modified":"2023-10-08T00:30:48.725392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"d","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/3601516791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3601516791},{"type":"v1","addr":"172.21.15.192:6836","nonce":3601516791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f896c067200 msgr2=0x7f896c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f896c067200 0x7f896c0696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8970009260 tx=0x7f8970016000 comp rx=0 tx=0).stop 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 msgr2=0x7f89801530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 0x7f89801530a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f897400d890 tx=0x7f8974008040 comp rx=0 tx=0).stop 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 shutdown_connections 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f896c067200 0x7f896c0696b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f898006bac0 0x7f89801535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f898006aa40 0x7f898014ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 --2- 172.21.15.22:0/223371044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f898006b350 0x7f89801530a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:55.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 >> 172.21.15.22:0/223371044 conn(0x7f89800cd670 msgr2=0x7f89800cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:55.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 shutdown_connections 2023-10-08T00:30:55.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:55.611+0000 7f8985c20700 1 -- 172.21.15.22:0/223371044 wait complete. 2023-10-08T00:30:55.613 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 60 2023-10-08T00:30:56.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:30:45.103135+0000', 'modified': '2023-10-08T00:30:48.725392+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6519}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6519': {'gid': 6519, 'name': 'd', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6836/3601516791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 3601516791}, {'type': 'v1', 'addr': '172.21.15.192:6836', 'nonce': 3601516791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:30:56.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:30:56.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T00:30:56.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.150+0000 7fa9e5dce700 1 Processor -- start 2023-10-08T00:30:56.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.150+0000 7fa9e5dce700 1 -- start start 2023-10-08T00:30:56.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9e5dce700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9e006bcd0 0x7fa9e00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9e5dce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa9e006c0a0 0x7fa9e015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9e5dce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e015d7e0 con 0x7fa9e015df50 2023-10-08T00:30:56.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9e5dce700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e015dac0 con 0x7fa9e006bcd0 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9e5dce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e015aa30 con 0x7fa9e006c0a0 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9df7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9e006bcd0 0x7fa9e00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9df7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa9e006bcd0 0x7fa9e00caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54842/0 (socket says 172.21.15.22:54842) 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.151+0000 7fa9df7fe700 1 -- 172.21.15.22:0/2727643548 learned_addr learned my addr 172.21.15.22:0/2727643548 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9deffd700 1 --2- 172.21.15.22:0/2727643548 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006c0a0 0x7fa9e015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9df7fe700 1 -- 172.21.15.22:0/2727643548 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006c0a0 msgr2=0x7fa9e015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/2727643548 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006c0a0 0x7fa9e015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9df7fe700 1 -- 172.21.15.22:0/2727643548 >> v1:172.21.15.192:6789/0 conn(0x7fa9e015df50 legacy=0x7fa9e00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9df7fe700 1 -- 172.21.15.22:0/2727643548 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e015ad10 con 0x7fa9e006bcd0 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9deffd700 1 --2- 172.21.15.22:0/2727643548 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006c0a0 0x7fa9e015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:56.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/2727643548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00caa90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa9e006b4e0 tx=0x7fa9d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1a1b232772d571 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9de7fc700 1 -- 172.21.15.22:0/2727643548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000b820 con 0x7fa9e006bcd0 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9de7fc700 1 -- 172.21.15.22:0/2727643548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000b980 con 0x7fa9e006bcd0 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.152+0000 7fa9de7fc700 1 -- 172.21.15.22:0/2727643548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000bd40 con 0x7fa9e006bcd0 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 -- 172.21.15.22:0/2727643548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 msgr2=0x7fa9e00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/2727643548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00caa90 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa9e006b4e0 tx=0x7fa9d0009250 comp rx=0 tx=0).stop 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 -- 172.21.15.22:0/2727643548 shutdown_connections 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/2727643548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00caa90 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/2727643548 >> v2:172.21.15.192:3300/0 conn(0x7fa9e006c0a0 0x7fa9e015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 -- 172.21.15.22:0/2727643548 >> 172.21.15.22:0/2727643548 conn(0x7fa9e00ce600 msgr2=0x7fa9e00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 -- 172.21.15.22:0/2727643548 shutdown_connections 2023-10-08T00:30:56.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.153+0000 7fa9e5dce700 1 -- 172.21.15.22:0/2727643548 wait complete. 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.154+0000 7fa9e5dce700 1 Processor -- start 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.154+0000 7fa9e5dce700 1 -- start start 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006c0a0 0x7fa9e00c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e015df50 0x7fa9e014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00b2fe0 con 0x7fa9e006bcd0 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00c6590 con 0x7fa9e015df50 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00b2680 con 0x7fa9e006c0a0 2023-10-08T00:30:56.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54852/0 (socket says 172.21.15.22:54852) 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 -- 172.21.15.22:0/3453336328 learned_addr learned my addr 172.21.15.22:0/3453336328 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9deffd700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006c0a0 0x7fa9e00c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9dffff700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e015df50 0x7fa9e014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 -- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006c0a0 msgr2=0x7fa9e00c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006c0a0 0x7fa9e00c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 -- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e015df50 msgr2=0x7fa9e014a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e015df50 0x7fa9e014a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 -- 172.21.15.22:0/3453336328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00094f0 con 0x7fa9e006bcd0 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00b2aa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0069220 tx=0x7fa9d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9c77fe700 1 -- 172.21.15.22:0/3453336328 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0011d50 con 0x7fa9e006bcd0 2023-10-08T00:30:56.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9c77fe700 1 -- 172.21.15.22:0/3453336328 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d0020070 con 0x7fa9e006bcd0 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e00c33a0 con 0x7fa9e006bcd0 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.155+0000 7fa9c77fe700 1 -- 172.21.15.22:0/3453336328 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d001b6a0 con 0x7fa9e006bcd0 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.156+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e00c3960 con 0x7fa9e006bcd0 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.157+0000 7fa9c77fe700 1 -- 172.21.15.22:0/3453336328 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fa9d0022030 con 0x7fa9e006bcd0 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.157+0000 7fa9c77fe700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc067200 0x7fa9cc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.157+0000 7fa9c77fe700 1 -- 172.21.15.22:0/3453336328 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9d00867d0 con 0x7fa9e006bcd0 2023-10-08T00:30:56.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.158+0000 7fa9deffd700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc067200 0x7fa9cc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.158+0000 7fa9deffd700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc067200 0x7fa9cc0696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa9e016d450 tx=0x7fa9d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.159+0000 7fa9ef0c6b80 1 Processor -- start 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.159+0000 7fa9ef0c6b80 1 -- start start 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc564e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc58da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc560cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc4bba70 con 0x5598cc58df60 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc4b9270 con 0x5598cc564a50 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598cc4b5060 con 0x5598cc5aed00 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9dffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc560cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9dffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc560cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54868/0 (socket says 172.21.15.22:54868) 2023-10-08T00:30:56.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9dffff700 1 -- 172.21.15.22:0/1838575546 learned_addr learned my addr 172.21.15.22:0/1838575546 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9deffd700 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc58da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.160+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc564e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9dffff700 1 -- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 msgr2=0x5598cc58da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9dffff700 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc58da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9dffff700 1 -- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 msgr2=0x5598cc564e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9dffff700 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc564e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9dffff700 1 -- 172.21.15.22:0/1838575546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598cc34f270 con 0x5598cc58df60 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9dffff700 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc560cf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80013a0 tx=0x7fa9d8009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f814d0eadcf07589 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9c4ff9700 1 -- 172.21.15.22:0/1838575546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8013360 con 0x5598cc58df60 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9c4ff9700 1 -- 172.21.15.22:0/1838575546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80134c0 con 0x5598cc58df60 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9c4ff9700 1 -- 172.21.15.22:0/1838575546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8013880 con 0x5598cc58df60 2023-10-08T00:30:56.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.161+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1838575546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 msgr2=0x5598cc560cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc560cf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80013a0 tx=0x7fa9d8009940 comp rx=0 tx=0).stop 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1838575546 shutdown_connections 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc560cf0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc564e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1838575546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc58da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1838575546 >> 172.21.15.22:0/1838575546 conn(0x5598cc566370 msgr2=0x5598cc566740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1838575546 shutdown_connections 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1838575546 wait complete. 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 -- start start 2023-10-08T00:30:56.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.162+0000 7fa9ef0c6b80 1 Processor -- start 2023-10-08T00:30:56.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc5a7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc460890 con 0x5598cc58df60 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc47bea0 con 0x5598cc564a50 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598cc337e30 con 0x5598cc5aed00 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9ef0c6b80 10 client.0 _ll_register_callbacks cb 0x5598cc528110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc5a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc5a7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54884/0 (socket says 172.21.15.22:54884) 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 -- 172.21.15.22:0/508448162 learned_addr learned my addr 172.21.15.22:0/508448162 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9dffff700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 -- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 msgr2=0x5598cc5a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 -- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 msgr2=0x5598cc5a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.163+0000 7fa9deffd700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9deffd700 1 -- 172.21.15.22:0/508448162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d8009c00 con 0x5598cc58df60 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9dffff700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9deffd700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc5a7220 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40147e0 tx=0x7fa9d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a7db5f7bc8047e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9bdffb700 1 -- 172.21.15.22:0/508448162 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4015620 con 0x5598cc58df60 2023-10-08T00:30:56.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9bdffb700 1 -- 172.21.15.22:0/508448162 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9d4015780 con 0x5598cc58df60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598cc559b70 con 0x5598cc58df60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9bdffb700 1 -- 172.21.15.22:0/508448162 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9d4015b50 con 0x5598cc58df60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 10 client.6669 fetch_fsmap learned FSMap version 60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5598cc2f1fe0 con 0x5598cc58df60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9bdffb700 1 -- 172.21.15.22:0/508448162 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5598cc559b70 con 0x5598cc58df60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9bdffb700 1 -- 172.21.15.22:0/508448162 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa9d4015cb0 con 0x5598cc58df60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 10 client.6669 fetch_fsmap finished waiting for FSMap version 60 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 10 client.6669 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 20 client.6669 populate_metadata read hostname 'smithi022' 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5a2c20 0x5598cc5a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 4 client.6669 mds_command: new command op to 6519 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:30:56.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.164+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 --> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598cc536aa0 con 0x5598cc5a2c20 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.165+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5a2c20 0x5598cc5a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.165+0000 7fa9bdffb700 10 client.6669 ms_handle_connect on v2:172.21.15.192:6834/3601516791 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.165+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5a2c20 0x5598cc5a2ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37a156e22419c156 server_cookie=f63c7db421d340be in_seq=0 out_seq=0 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9bdffb700 1 -- 172.21.15.22:0/508448162 <== mds.0 v2:172.21.15.192:6834/3601516791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5598cc536aa0 con 0x5598cc5a2c20 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9bdffb700 10 client.6669 handle_command_reply: tid=0 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 client.6669 shutdown 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 msgr2=0x5598cc5a7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc5a7220 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40147e0 tx=0x7fa9d4016000 comp rx=0 tx=0).stop 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 shutdown_connections 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5a2c20 0x5598cc5a2ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9bdffb700 0 client.6669 ms_handle_reset on v2:172.21.15.192:6834/3601516791 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/508448162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc5a7220 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 >> 172.21.15.22:0/508448162 conn(0x5598cc566370 msgr2=0x5598cc561960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 shutdown_connections 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/508448162 wait complete. 2023-10-08T00:30:56.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.166+0000 7fa9ef0c6b80 20 client.6669 trim_cache size 0 max 16384 2023-10-08T00:30:56.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.183+0000 7fa9ef0c6b80 1 Processor -- start 2023-10-08T00:30:56.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.183+0000 7fa9ef0c6b80 1 -- start start 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 0x5598cc560fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc58df60 0x5598cc561820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc5aed00 0x5598cc561d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc567140 con 0x5598cc564a50 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc5a2ff0 con 0x5598cc5aed00 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598cc5be770 con 0x5598cc58df60 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 0x5598cc560fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 0x5598cc560fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54888/0 (socket says 172.21.15.22:54888) 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 -- 172.21.15.22:0/1051098411 learned_addr learned my addr 172.21.15.22:0/1051098411 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 -- 172.21.15.22:0/1051098411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc58df60 msgr2=0x5598cc561820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc58df60 0x5598cc561820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 -- 172.21.15.22:0/1051098411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc5aed00 msgr2=0x5598cc561d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc5aed00 0x5598cc561d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 -- 172.21.15.22:0/1051098411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598cc483780 con 0x5598cc564a50 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 0x5598cc560fa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0057300 tx=0x7fa9d0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118ce2632a926d45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9c57fa700 1 -- 172.21.15.22:0/1051098411 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0057370 con 0x5598cc564a50 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9c57fa700 1 -- 172.21.15.22:0/1051098411 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d005a5c0 con 0x5598cc564a50 2023-10-08T00:30:56.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.184+0000 7fa9c57fa700 1 -- 172.21.15.22:0/1051098411 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d005e310 con 0x5598cc564a50 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1051098411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 msgr2=0x5598cc560fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 0x5598cc560fa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0057300 tx=0x7fa9d0013040 comp rx=0 tx=0).stop 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1051098411 shutdown_connections 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc5aed00 0x5598cc561d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc564a50 0x5598cc560fa0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1051098411 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc58df60 0x5598cc561820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1051098411 >> 172.21.15.22:0/1051098411 conn(0x5598cc566370 msgr2=0x5598cc58a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1051098411 shutdown_connections 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1051098411 wait complete. 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.185+0000 7fa9ef0c6b80 1 -- start start 2023-10-08T00:30:56.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 Processor -- start 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc610cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5c0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc5c2fc0 con 0x5598cc58df60 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598cc5b91c0 con 0x5598cc564a50 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598cc5b9d40 con 0x5598cc5aed00 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9ef0c6b80 10 client.0 _ll_register_callbacks cb 0x5598cc528110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc610cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc610cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54902/0 (socket says 172.21.15.22:54902) 2023-10-08T00:30:56.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9deffd700 1 -- 172.21.15.22:0/1603605788 learned_addr learned my addr 172.21.15.22:0/1603605788 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.186+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9dffff700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5c0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9deffd700 1 -- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 msgr2=0x5598cc5c0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9deffd700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5c0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9deffd700 1 -- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 msgr2=0x5598cc5c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9deffd700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9deffd700 1 -- 172.21.15.22:0/1603605788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e00c3960 con 0x5598cc58df60 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9dffff700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9deffd700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc610cb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400a880 tx=0x7fa9d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5cec45a9c69b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9bdffb700 1 -- 172.21.15.22:0/1603605788 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4015b50 con 0x5598cc58df60 2023-10-08T00:30:56.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9bdffb700 1 -- 172.21.15.22:0/1603605788 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa9d4015cb0 con 0x5598cc58df60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598cc593ee0 con 0x5598cc58df60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9bdffb700 1 -- 172.21.15.22:0/1603605788 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9d402a720 con 0x5598cc58df60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 10 client.6675 fetch_fsmap learned FSMap version 60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x5598cc46a470 con 0x5598cc58df60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9bdffb700 1 -- 172.21.15.22:0/1603605788 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5598cc593ee0 con 0x5598cc58df60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9bdffb700 1 -- 172.21.15.22:0/1603605788 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 60) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa9d402a880 con 0x5598cc58df60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 10 client.6675 fetch_fsmap finished waiting for FSMap version 60 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 10 client.6675 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 20 client.6675 populate_metadata read hostname 'smithi022' 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5ba4f0 0x5598cc5ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 4 client.6675 mds_command: new command op to 6519 tid=0[{"prefix": "status"}] 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.187+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 --> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa9d80134c0 con 0x5598cc5ba4f0 2023-10-08T00:30:56.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5ba4f0 0x5598cc5ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9df7fe700 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5ba4f0 0x5598cc5ba8c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3065ad4e054b9ee server_cookie=47686986122f6294 in_seq=0 out_seq=0 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9bdffb700 10 client.6675 ms_handle_connect on v2:172.21.15.192:6834/3601516791 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9bdffb700 1 -- 172.21.15.22:0/1603605788 <== mds.0 v2:172.21.15.192:6834/3601516791 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7fa9d80134c0 con 0x5598cc5ba4f0 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9bdffb700 10 client.6675 handle_command_reply: tid=0 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 client.6675 shutdown 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 msgr2=0x5598cc610cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc610cb0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400a880 tx=0x7fa9d4019000 comp rx=0 tx=0).stop 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 shutdown_connections 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:6834/3601516791,v1:172.21.15.192:6836/3601516791] conn(0x5598cc5ba4f0 0x5598cc5ba8c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5598cc5aed00 0x5598cc5c0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5598cc564a50 0x5598cc5c2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9bdffb700 0 client.6675 ms_handle_reset on v2:172.21.15.192:6834/3601516791 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 --2- 172.21.15.22:0/1603605788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5598cc58df60 0x5598cc610cb0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.188+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 >> 172.21.15.22:0/1603605788 conn(0x5598cc566370 msgr2=0x5598cc5a3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 shutdown_connections 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9ef0c6b80 1 -- 172.21.15.22:0/1603605788 wait complete. 2023-10-08T00:30:56.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9ef0c6b80 20 client.6675 trim_cache size 0 max 16384 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 6519, 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.497201225, 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 60, 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 90, 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 90, 2023-10-08T00:30:56.198 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 15.550868019999999 2023-10-08T00:30:56.199 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:56.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc067200 msgr2=0x7fa9cc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc067200 0x7fa9cc0696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa9e016d450 tx=0x7fa9d4008040 comp rx=0 tx=0).stop 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 msgr2=0x7fa9e00b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00b2aa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0069220 tx=0x7fa9d0016000 comp rx=0 tx=0).stop 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 shutdown_connections 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9e015df50 0x7fa9e014a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9e006bcd0 0x7fa9e00b2aa0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa9cc067200 0x7fa9cc0696b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 --2- 172.21.15.22:0/3453336328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa9e006c0a0 0x7fa9e00c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 >> 172.21.15.22:0/3453336328 conn(0x7fa9e00ce600 msgr2=0x7fa9e01560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 shutdown_connections 2023-10-08T00:30:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.189+0000 7fa9e5dce700 1 -- 172.21.15.22:0/3453336328 wait complete. 2023-10-08T00:30:56.202 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:30:56.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.320+0000 7feadf495700 1 Processor -- start 2023-10-08T00:30:56.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.320+0000 7feadf495700 1 -- start start 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadf495700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fead8159890 0x7fead815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadf495700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fead8159c60 0x7fead815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadf495700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead815a160 con 0x7fead815db10 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadf495700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead815df50 con 0x7fead8159c60 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadf495700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead80d13a0 con 0x7fead8159890 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fead8159c60 0x7fead815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fead8159c60 0x7fead815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54906/0 (socket says 172.21.15.22:54906) 2023-10-08T00:30:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 -- 172.21.15.22:0/4161557944 learned_addr learned my addr 172.21.15.22:0/4161557944 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadd231700 1 --2- 172.21.15.22:0/4161557944 >> v2:172.21.15.192:3300/0 conn(0x7fead8159890 0x7fead815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 -- 172.21.15.22:0/4161557944 >> v2:172.21.15.192:3300/0 conn(0x7fead8159890 msgr2=0x7fead815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 --2- 172.21.15.22:0/4161557944 >> v2:172.21.15.192:3300/0 conn(0x7fead8159890 0x7fead815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 -- 172.21.15.22:0/4161557944 >> v1:172.21.15.192:6789/0 conn(0x7fead815db10 legacy=0x7fead8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 -- 172.21.15.22:0/4161557944 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead815e140 con 0x7fead8159c60 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadd231700 1 --2- 172.21.15.22:0/4161557944 >> v2:172.21.15.192:3300/0 conn(0x7fead8159890 0x7fead815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7feadca30700 1 --2- 172.21.15.22:0/4161557944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead815d5d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fead80d1090 tx=0x7feacc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8236174551c99d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.321+0000 7fead7fff700 1 -- 172.21.15.22:0/4161557944 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00b820 con 0x7fead8159c60 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7fead7fff700 1 -- 172.21.15.22:0/4161557944 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00b980 con 0x7fead8159c60 2023-10-08T00:30:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7fead7fff700 1 -- 172.21.15.22:0/4161557944 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00bd20 con 0x7fead8159c60 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 -- 172.21.15.22:0/4161557944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 msgr2=0x7fead815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 --2- 172.21.15.22:0/4161557944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead815d5d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fead80d1090 tx=0x7feacc009250 comp rx=0 tx=0).stop 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 -- 172.21.15.22:0/4161557944 shutdown_connections 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 --2- 172.21.15.22:0/4161557944 >> v2:172.21.15.192:3300/0 conn(0x7fead8159890 0x7fead815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 --2- 172.21.15.22:0/4161557944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead815d5d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 -- 172.21.15.22:0/4161557944 >> 172.21.15.22:0/4161557944 conn(0x7fead8068e20 msgr2=0x7fead80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 -- 172.21.15.22:0/4161557944 shutdown_connections 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.322+0000 7feadf495700 1 -- 172.21.15.22:0/4161557944 wait complete. 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.323+0000 7feadf495700 1 Processor -- start 2023-10-08T00:30:56.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.323+0000 7feadf495700 1 -- start start 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadf495700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fead8159890 0x7fead80b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadf495700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead8157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadf495700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead815db10 0x7fead8157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadf495700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80b0660 con 0x7fead8159c60 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadf495700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead80b0940 con 0x7fead815db10 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadf495700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead80b0c20 con 0x7fead8159890 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadca30700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadca30700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead8157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54910/0 (socket says 172.21.15.22:54910) 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadca30700 1 -- 172.21.15.22:0/42380352 learned_addr learned my addr 172.21.15.22:0/42380352 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadd231700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fead8159890 0x7fead80b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadda32700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead815db10 0x7fead8157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadca30700 1 -- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fead8159890 msgr2=0x7fead80b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.324+0000 7feadca30700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fead8159890 0x7fead80b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7feadca30700 1 -- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead815db10 msgr2=0x7fead8157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7feadca30700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead815db10 0x7fead8157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7feadca30700 1 -- 172.21.15.22:0/42380352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0094f0 con 0x7fead8159c60 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7feadca30700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead8157230 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7feacc009290 tx=0x7feacc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00bd00 con 0x7fead8159c60 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc01f070 con 0x7fead8159c60 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead80b0f00 con 0x7fead8159c60 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc0266b0 con 0x7fead8159c60 2023-10-08T00:30:56.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.325+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead80b16e0 con 0x7fead8159c60 2023-10-08T00:30:56.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.326+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead804c3c0 con 0x7fead8159c60 2023-10-08T00:30:56.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.326+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7feacc026aa0 con 0x7fead8159c60 2023-10-08T00:30:56.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.327+0000 7fead57fa700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feac4067200 0x7feac40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:56.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.327+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feacc021070 con 0x7fead8159c60 2023-10-08T00:30:56.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.327+0000 7feadd231700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feac4067200 0x7feac40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:56.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.327+0000 7feadd231700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feac4067200 0x7feac40696b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feac8009fd0 tx=0x7feac80099d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:56.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.331+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feacc053970 con 0x7fead8159c60 2023-10-08T00:30:56.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.572+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fead806a5b0 con 0x7fead8159c60 2023-10-08T00:30:56.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.572+0000 7fead57fa700 1 -- 172.21.15.22:0/42380352 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7feacc056f90 con 0x7fead8159c60 2023-10-08T00:30:56.573 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feac4067200 msgr2=0x7feac40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feac4067200 0x7feac40696b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feac8009fd0 tx=0x7feac80099d0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 msgr2=0x7fead8157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead8157230 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7feacc009290 tx=0x7feacc016000 comp rx=0 tx=0).stop 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 shutdown_connections 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead815db10 0x7fead8157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feac4067200 0x7feac40696b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fead8159890 0x7fead80b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 --2- 172.21.15.22:0/42380352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fead8159c60 0x7fead8157230 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:56.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 >> 172.21.15.22:0/42380352 conn(0x7fead8068e20 msgr2=0x7fead814d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:56.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 shutdown_connections 2023-10-08T00:30:56.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:56.574+0000 7feadf495700 1 -- 172.21.15.22:0/42380352 wait complete. 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:30:56.587 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:30:56.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:56.588 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:30:56.603 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:30:56.603 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:30:56.603 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:30:56.603 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:30:56.604 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42114sec preferred_lft 42114sec 2023-10-08T00:30:56.605 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:30:56.605 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.605 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:56.605 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:56.605 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:30:56.606 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:56.607 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:56.607 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:30:56.607 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:30:56.607 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:56.607 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:30:56.608 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:30:56.609 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:56.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:56.609 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:30:56.667 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:30:56.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:56.669 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:30:56.724 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:30:56.725 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:30:56.725 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:30:56.725 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:30:56.725 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:30:56.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:56.725 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:30:56.726 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:30:56.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:30:56.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:30:56.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:30:56.726 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:30:56.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:56.828 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:30:56.843 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:30:56.843 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:30:56.843 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:30:56.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:56.843 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:30:56.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:56.909 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:56.964 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:30:56.964 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:56.965 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:57.019 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:30:57.019 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:30:57.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:57.100 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:57.100 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:57.119 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:57.142 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:57.142 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:30:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:30:57.145 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:30:57.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:57.212 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:30:57.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.371+0000 7f6725579700 1 Processor -- start 2023-10-08T00:30:57.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.371+0000 7f6725579700 1 -- start start 2023-10-08T00:30:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f6725579700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6720159420 0x7f67200b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f6725579700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f67201597f0 0x7f67200b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f6725579700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200b11d0 con 0x7f672015d230 2023-10-08T00:30:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f6725579700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67200b14b0 con 0x7f6720159420 2023-10-08T00:30:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f6725579700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67200b1790 con 0x7f67201597f0 2023-10-08T00:30:57.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6720159420 0x7f67200b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6720159420 0x7f67200b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33948/0 (socket says 172.21.15.22:33948) 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 -- 172.21.15.22:0/2266281341 learned_addr learned my addr 172.21.15.22:0/2266281341 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671f7fe700 1 --2- 172.21.15.22:0/2266281341 >> v2:172.21.15.192:3300/0 conn(0x7f67201597f0 0x7f67200b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 -- 172.21.15.22:0/2266281341 >> v2:172.21.15.192:3300/0 conn(0x7f67201597f0 msgr2=0x7f67200b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 --2- 172.21.15.22:0/2266281341 >> v2:172.21.15.192:3300/0 conn(0x7f67201597f0 0x7f67200b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 -- 172.21.15.22:0/2266281341 >> v1:172.21.15.192:6789/0 conn(0x7f672015d230 legacy=0x7f672015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671ffff700 1 -- 172.21.15.22:0/2266281341 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200b1a70 con 0x7f6720159420 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.372+0000 7f671f7fe700 1 --2- 172.21.15.22:0/2266281341 >> v2:172.21.15.192:3300/0 conn(0x7f67201597f0 0x7f67200b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f671ffff700 1 --2- 172.21.15.22:0/2266281341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6720159420 0x7f67200b5f40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6720089750 tx=0x7f6708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc90feb2b46ea63 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f671effd700 1 -- 172.21.15.22:0/2266281341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800b820 con 0x7f6720159420 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f671effd700 1 -- 172.21.15.22:0/2266281341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670800b980 con 0x7f6720159420 2023-10-08T00:30:57.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f671effd700 1 -- 172.21.15.22:0/2266281341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670800bd20 con 0x7f6720159420 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 -- 172.21.15.22:0/2266281341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6720159420 msgr2=0x7f67200b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 --2- 172.21.15.22:0/2266281341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6720159420 0x7f67200b5f40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6720089750 tx=0x7f6708009250 comp rx=0 tx=0).stop 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 -- 172.21.15.22:0/2266281341 shutdown_connections 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 --2- 172.21.15.22:0/2266281341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6720159420 0x7f67200b5f40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 --2- 172.21.15.22:0/2266281341 >> v2:172.21.15.192:3300/0 conn(0x7f67201597f0 0x7f67200b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 -- 172.21.15.22:0/2266281341 >> 172.21.15.22:0/2266281341 conn(0x7f67200d0660 msgr2=0x7f67200d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 -- 172.21.15.22:0/2266281341 shutdown_connections 2023-10-08T00:30:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.373+0000 7f6725579700 1 -- 172.21.15.22:0/2266281341 wait complete. 2023-10-08T00:30:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.374+0000 7f6725579700 1 Processor -- start 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 -- start start 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720159420 0x7f6720155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 0x7f6720068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f672015d230 0x7f672015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672006a100 con 0x7f67201597f0 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200694f0 con 0x7f6720159420 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f6725579700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67200697d0 con 0x7f672015d230 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 0x7f6720068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f671f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 0x7f6720068b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33958/0 (socket says 172.21.15.22:33958) 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.375+0000 7f671f7fe700 1 -- 172.21.15.22:0/1254304396 learned_addr learned my addr 172.21.15.22:0/1254304396 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671ffff700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720159420 0x7f6720155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:57.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f6724d78700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f672015d230 0x7f672015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671f7fe700 1 -- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f672015d230 msgr2=0x7f672015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671f7fe700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f672015d230 0x7f672015bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671f7fe700 1 -- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720159420 msgr2=0x7f6720155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671f7fe700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720159420 0x7f6720155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671f7fe700 1 -- 172.21.15.22:0/1254304396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080094f0 con 0x7f67201597f0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f671f7fe700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 0x7f6720068b80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f671000c880 tx=0x7f6710008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710011600 con 0x7f67201597f0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6710011760 con 0x7f67201597f0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720069ab0 con 0x7f67201597f0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6710011b00 con 0x7f67201597f0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.376+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6720155780 con 0x7f67201597f0 2023-10-08T00:30:57.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.377+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67200c7e40 con 0x7f67201597f0 2023-10-08T00:30:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.378+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6710018360 con 0x7f67201597f0 2023-10-08T00:30:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.378+0000 7f6717fff700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6700067200 0x7f67000696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.378+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6710084ab0 con 0x7f67201597f0 2023-10-08T00:30:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.378+0000 7f671ffff700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6700067200 0x7f67000696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:57.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.379+0000 7f671ffff700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6700067200 0x7f67000696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6720089750 tx=0x7f6708016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:57.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.382+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67100518c0 con 0x7f67201597f0 2023-10-08T00:30:57.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.620+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f672004c3c0 con 0x7f67201597f0 2023-10-08T00:30:57.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.620+0000 7f6717fff700 1 -- 172.21.15.22:0/1254304396 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6710015070 con 0x7f67201597f0 2023-10-08T00:30:57.621 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:30:57.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6700067200 msgr2=0x7f67000696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:57.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6700067200 0x7f67000696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6720089750 tx=0x7f6708016000 comp rx=0 tx=0).stop 2023-10-08T00:30:57.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 msgr2=0x7f6720068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:57.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 0x7f6720068b80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f671000c880 tx=0x7f6710008040 comp rx=0 tx=0).stop 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 shutdown_connections 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6700067200 0x7f67000696b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f672015d230 0x7f672015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720159420 0x7f6720155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.622+0000 7f6725579700 1 --2- 172.21.15.22:0/1254304396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67201597f0 0x7f6720068b80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.623+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 >> 172.21.15.22:0/1254304396 conn(0x7f67200d0660 msgr2=0x7f67200b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.623+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 shutdown_connections 2023-10-08T00:30:57.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:57.623+0000 7f6725579700 1 -- 172.21.15.22:0/1254304396 wait complete. 2023-10-08T00:30:57.635 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:30:57.635 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:30:57.635 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:30:57.635 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:30:57.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:57.636 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:30:57.636 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:30:57.636 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:30:57.636 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:30:57.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.636 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:30:57.655 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:30:57.655 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:30:57.655 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:57.656 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42117sec preferred_lft 42117sec 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:57.657 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:30:57.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.658 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:30:57.725 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:30:57.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.727 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:30:57.785 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:30:57.785 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:30:57.785 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:30:57.785 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:30:57.786 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:30:57.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.786 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:30:57.786 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:30:57.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:30:57.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:30:57.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:30:57.786 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:30:57.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.892 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:30:57.908 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:30:57.908 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:30:57.908 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:30:57.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:57.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:30:57.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:57.973 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:58.028 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:30:58.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:30:58.028 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:58.082 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:30:58.082 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:30:58.083 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:58.163 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:58.163 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:58.182 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:30:58.204 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:30:58.206 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:30:58.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:58.206 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:30:58.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:30:58.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.407+0000 7fe7af074700 1 Processor -- start 2023-10-08T00:30:58.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.407+0000 7fe7af074700 1 -- start start 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7af074700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe7a80b03c0 0x7fe7a80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7af074700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80cfa00 con 0x7fe7a81591e0 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7af074700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a80cb580 con 0x7fe7a80b0790 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7af074700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a80cf160 con 0x7fe7a80b03c0 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7ae873700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe7a81591e0 0x7fe7a8159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48274/0 (socket says 172.21.15.22:48274) 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7ae873700 1 -- 172.21.15.22:0/2712000986 learned_addr learned my addr 172.21.15.22:0/2712000986 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7ae072700 1 --2- 172.21.15.22:0/2712000986 >> v2:172.21.15.192:3300/0 conn(0x7fe7a80b03c0 0x7fe7a80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.408+0000 7fe7ad070700 1 -- 172.21.15.22:0/2712000986 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296691049 0 0) 0x7fe7a80cfa00 con 0x7fe7a81591e0 2023-10-08T00:30:58.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ad070700 1 -- 172.21.15.22:0/2712000986 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe790003570 con 0x7fe7a81591e0 2023-10-08T00:30:58.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ae072700 1 -- 172.21.15.22:0/2712000986 >> v1:172.21.15.192:6789/0 conn(0x7fe7a80b0790 legacy=0x7fe7a80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ae072700 1 -- 172.21.15.22:0/2712000986 >> v1:172.21.15.22:6789/0 conn(0x7fe7a81591e0 legacy=0x7fe7a8159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ae072700 1 -- 172.21.15.22:0/2712000986 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a80cf440 con 0x7fe7a80b03c0 2023-10-08T00:30:58.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ae072700 1 --2- 172.21.15.22:0/2712000986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80cea70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009910 tx=0x7fe7a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f463982d1bacd0d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ad070700 1 -- 172.21.15.22:0/2712000986 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000b640 con 0x7fe7a80b03c0 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ad070700 1 -- 172.21.15.22:0/2712000986 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000b7a0 con 0x7fe7a80b03c0 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.409+0000 7fe7ad070700 1 -- 172.21.15.22:0/2712000986 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000bb60 con 0x7fe7a80b03c0 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 -- 172.21.15.22:0/2712000986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a80b03c0 msgr2=0x7fe7a80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 --2- 172.21.15.22:0/2712000986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80cea70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009910 tx=0x7fe7a00091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 -- 172.21.15.22:0/2712000986 shutdown_connections 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 --2- 172.21.15.22:0/2712000986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80cea70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 -- 172.21.15.22:0/2712000986 >> 172.21.15.22:0/2712000986 conn(0x7fe7a8063230 msgr2=0x7fe7a8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 -- 172.21.15.22:0/2712000986 shutdown_connections 2023-10-08T00:30:58.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.410+0000 7fe7af074700 1 -- 172.21.15.22:0/2712000986 wait complete. 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.411+0000 7fe7af074700 1 Processor -- start 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.411+0000 7fe7af074700 1 -- start start 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7af074700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7af074700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7a80b0790 0x7fe7a80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7af074700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a81591e0 0x7fe7a80c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7af074700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80c6290 con 0x7fe7a80b03c0 2023-10-08T00:30:58.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7af074700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80c8d20 con 0x7fe7a81591e0 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7af074700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a80c8110 con 0x7fe7a80b0790 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33970/0 (socket says 172.21.15.22:33970) 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 -- 172.21.15.22:0/3238661443 learned_addr learned my addr 172.21.15.22:0/3238661443 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae873700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a81591e0 0x7fe7a80c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ad871700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7a80b0790 0x7fe7a80c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 -- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7a80b0790 msgr2=0x7fe7a80c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7a80b0790 0x7fe7a80c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 -- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a81591e0 msgr2=0x7fe7a80c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a81591e0 0x7fe7a80c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 -- 172.21.15.22:0/3238661443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0009420 con 0x7fe7a80b03c0 2023-10-08T00:30:58.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ad871700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7a80b0790 0x7fe7a80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.412+0000 7fe7ae072700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80c91b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80cfe40 tx=0x7fe7a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.413+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a001f070 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.413+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0000bc0 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.413+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a80c83f0 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.413+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000bb60 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.413+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a80c8780 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.413+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a80c9000 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.414+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe7a0023070 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.414+0000 7fe7a67fc700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe794067200 0x7fe7940696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.415+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7a0085d70 con 0x7fe7a80b03c0 2023-10-08T00:30:58.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.415+0000 7fe7ad871700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe794067200 0x7fe7940696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.415+0000 7fe7ad871700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe794067200 0x7fe7940696b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80b6050 tx=0x7fe79c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:58.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.419+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7a0052c50 con 0x7fe7a80b03c0 2023-10-08T00:30:58.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.659+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe7a804c3c0 con 0x7fe7a80b03c0 2023-10-08T00:30:58.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.760+0000 7fe7a67fc700 1 -- 172.21.15.22:0/3238661443 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 136+0+0 (secure 0 0 0) 0x7fe7a00150c0 con 0x7fe7a80b03c0 2023-10-08T00:30:58.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe794067200 msgr2=0x7fe7940696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe794067200 0x7fe7940696b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80b6050 tx=0x7fe79c009040 comp rx=0 tx=0).stop 2023-10-08T00:30:58.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 msgr2=0x7fe7a80c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80c91b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe7a80cfe40 tx=0x7fe7a0017000 comp rx=0 tx=0).stop 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 shutdown_connections 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7a81591e0 0x7fe7a80c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7a80b03c0 0x7fe7a80c91b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe794067200 0x7fe7940696b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 --2- 172.21.15.22:0/3238661443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe7a80b0790 0x7fe7a80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.762+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 >> 172.21.15.22:0/3238661443 conn(0x7fe7a8063230 msgr2=0x7fe7a8068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.763+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 shutdown_connections 2023-10-08T00:30:58.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.763+0000 7fe7af074700 1 -- 172.21.15.22:0/3238661443 wait complete. 2023-10-08T00:30:58.775 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:30:58.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.896+0000 7fdab1c68700 1 Processor -- start 2023-10-08T00:30:58.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.896+0000 7fdab1c68700 1 -- start start 2023-10-08T00:30:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.896+0000 7fdab1c68700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdaac159c10 0x7fdaac15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.896+0000 7fdab1c68700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac0b5ea0 0x7fdaac068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.896+0000 7fdab1c68700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac15c480 con 0x7fdaac068bb0 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.896+0000 7fdab1c68700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0b2a40 con 0x7fdaac159c10 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdab1c68700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac15b5d0 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaab7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdaac159c10 0x7fdaac15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaabfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdaac068bb0 0x7fdaac15c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48276/0 (socket says 172.21.15.22:48276) 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaabfff700 1 -- 172.21.15.22:0/32838150 learned_addr learned my addr 172.21.15.22:0/32838150 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaaaffd700 1 --2- 172.21.15.22:0/32838150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac0b5ea0 0x7fdaac068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaab7fe700 1 -- 172.21.15.22:0/32838150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac0b5ea0 msgr2=0x7fdaac068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaab7fe700 1 --2- 172.21.15.22:0/32838150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac0b5ea0 0x7fdaac068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaab7fe700 1 -- 172.21.15.22:0/32838150 >> v1:172.21.15.22:6789/0 conn(0x7fdaac068bb0 legacy=0x7fdaac15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaab7fe700 1 -- 172.21.15.22:0/32838150 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac15b870 con 0x7fdaac159c10 2023-10-08T00:30:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaaa7fc700 1 -- 172.21.15.22:0/32838150 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802409702 0 0) 0x7fdaac15c480 con 0x7fdaac068bb0 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaab7fe700 1 --2- 172.21.15.22:0/32838150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac159c10 0x7fdaac15b090 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0098e0 tx=0x7fda9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9485b1fd58bc8fab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaaa7fc700 1 -- 172.21.15.22:0/32838150 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c009e80 con 0x7fdaac159c10 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaaa7fc700 1 -- 172.21.15.22:0/32838150 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c00b860 con 0x7fdaac159c10 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.897+0000 7fdaaa7fc700 1 -- 172.21.15.22:0/32838150 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c00bbe0 con 0x7fdaac159c10 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 -- 172.21.15.22:0/32838150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac159c10 msgr2=0x7fdaac15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 --2- 172.21.15.22:0/32838150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac159c10 0x7fdaac15b090 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0098e0 tx=0x7fda9c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 -- 172.21.15.22:0/32838150 shutdown_connections 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 --2- 172.21.15.22:0/32838150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac159c10 0x7fdaac15b090 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 --2- 172.21.15.22:0/32838150 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac0b5ea0 0x7fdaac068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 -- 172.21.15.22:0/32838150 >> 172.21.15.22:0/32838150 conn(0x7fdaac099a20 msgr2=0x7fdaac0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 -- 172.21.15.22:0/32838150 shutdown_connections 2023-10-08T00:30:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.898+0000 7fdab1c68700 1 -- 172.21.15.22:0/32838150 wait complete. 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.899+0000 7fdab1c68700 1 Processor -- start 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.899+0000 7fdab1c68700 1 -- start start 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdab1c68700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac068bb0 0x7fdaac158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdab1c68700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 0x7fdaac169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdab1c68700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaac159c10 0x7fdaac0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdab1c68700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0b06e0 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdab1c68700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c5cb0 con 0x7fdaac159c10 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdab1c68700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c6de0 con 0x7fdaac068bb0 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 0x7fdaac169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 0x7fdaac169230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33992/0 (socket says 172.21.15.22:33992) 2023-10-08T00:30:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 -- 172.21.15.22:0/858624498 learned_addr learned my addr 172.21.15.22:0/858624498 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaab7fe700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac068bb0 0x7fdaac158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaabfff700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaac159c10 0x7fdaac0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 -- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac068bb0 msgr2=0x7fdaac158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac068bb0 0x7fdaac158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 -- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaac159c10 msgr2=0x7fdaac0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaac159c10 0x7fdaac0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 -- 172.21.15.22:0/858624498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c009420 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaabfff700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaac159c10 0x7fdaac0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.900+0000 7fdaaaffd700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 0x7fdaac169230 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000d890 tx=0x7fdaa0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.901+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00125f0 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.901+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0012750 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.901+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac0c70c0 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.901+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0012ad0 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.901+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac0b0370 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.902+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac0b0850 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.902+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fdaa001e460 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.902+0000 7fda937fe700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fda98067200 0x7fda980696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.903+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdaa0084f90 con 0x7fdaac0b5ea0 2023-10-08T00:30:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.903+0000 7fdaab7fe700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fda98067200 0x7fda980696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.903+0000 7fdaab7fe700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fda98067200 0x7fda980696b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0091e0 tx=0x7fda9c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:58.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:58.907+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaa0051eb0 con 0x7fdaac0b5ea0 2023-10-08T00:30:59.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.127+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaac04c3c0 con 0x7fda98067200 2023-10-08T00:30:59.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.129+0000 7fda937fe700 1 -- 172.21.15.22:0/858624498 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdaac04c3c0 con 0x7fda98067200 2023-10-08T00:30:59.129 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:30:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:30:59.129 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:59.129 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:30:59.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.130+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fda98067200 msgr2=0x7fda980696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.130+0000 7fdab1c68700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fda98067200 0x7fda980696b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0091e0 tx=0x7fda9c017000 comp rx=0 tx=0).stop 2023-10-08T00:30:59.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.130+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 msgr2=0x7fdaac169230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.130+0000 7fdab1c68700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 0x7fdaac169230 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000d890 tx=0x7fdaa0008040 comp rx=0 tx=0).stop 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 shutdown_connections 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaac159c10 0x7fdaac0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fda98067200 0x7fda980696b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdaac068bb0 0x7fdaac158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 --2- 172.21.15.22:0/858624498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaac0b5ea0 0x7fdaac169230 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 >> 172.21.15.22:0/858624498 conn(0x7fdaac099a20 msgr2=0x7fdaac09ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 shutdown_connections 2023-10-08T00:30:59.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.131+0000 7fdab1c68700 1 -- 172.21.15.22:0/858624498 wait complete. 2023-10-08T00:30:59.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:30:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.264+0000 7fba6434d700 1 Processor -- start 2023-10-08T00:30:59.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.264+0000 7fba6434d700 1 -- start start 2023-10-08T00:30:59.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba6434d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c159890 0x7fba5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba6434d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba5c159c60 0x7fba5c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba6434d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba5c15db10 0x7fba5c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba6434d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c15a160 con 0x7fba5c159c60 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba6434d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0d13a0 con 0x7fba5c15db10 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba6434d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15e140 con 0x7fba5c159890 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.265+0000 7fba618e8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba5c159c60 0x7fba5c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba5c159c60 0x7fba5c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33994/0 (socket says 172.21.15.22:33994) 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 -- 172.21.15.22:0/3992145510 learned_addr learned my addr 172.21.15.22:0/3992145510 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba620e9700 1 --2- 172.21.15.22:0/3992145510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c159890 0x7fba5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba628ea700 1 --2- 172.21.15.22:0/3992145510 >> v2:172.21.15.192:3300/0 conn(0x7fba5c15db10 0x7fba5c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 -- 172.21.15.22:0/3992145510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c159890 msgr2=0x7fba5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 --2- 172.21.15.22:0/3992145510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c159890 0x7fba5c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 -- 172.21.15.22:0/3992145510 >> v2:172.21.15.192:3300/0 conn(0x7fba5c15db10 msgr2=0x7fba5c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 --2- 172.21.15.22:0/3992145510 >> v2:172.21.15.192:3300/0 conn(0x7fba5c15db10 0x7fba5c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 -- 172.21.15.22:0/3992145510 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c15a3d0 con 0x7fba5c159c60 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba618e8700 1 --2- 172.21.15.22:0/3992145510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c15d5d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fba5c089b50 tx=0x7fba50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d836e0fe950b29c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba610e7700 1 -- 172.21.15.22:0/3992145510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000b860 con 0x7fba5c159c60 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba610e7700 1 -- 172.21.15.22:0/3992145510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000b9c0 con 0x7fba5c159c60 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.266+0000 7fba610e7700 1 -- 172.21.15.22:0/3992145510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000bd60 con 0x7fba5c159c60 2023-10-08T00:30:59.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 -- 172.21.15.22:0/3992145510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 msgr2=0x7fba5c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 --2- 172.21.15.22:0/3992145510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c15d5d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fba5c089b50 tx=0x7fba50009250 comp rx=0 tx=0).stop 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 -- 172.21.15.22:0/3992145510 shutdown_connections 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 --2- 172.21.15.22:0/3992145510 >> v2:172.21.15.192:3300/0 conn(0x7fba5c15db10 0x7fba5c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 --2- 172.21.15.22:0/3992145510 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c159890 0x7fba5c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 --2- 172.21.15.22:0/3992145510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c15d5d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 -- 172.21.15.22:0/3992145510 >> 172.21.15.22:0/3992145510 conn(0x7fba5c068e20 msgr2=0x7fba5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:59.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 -- 172.21.15.22:0/3992145510 shutdown_connections 2023-10-08T00:30:59.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.267+0000 7fba6434d700 1 -- 172.21.15.22:0/3992145510 wait complete. 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.268+0000 7fba6434d700 1 Processor -- start 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.268+0000 7fba6434d700 1 -- start start 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba5c159890 0x7fba5c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c15db10 0x7fba5c0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c1498e0 con 0x7fba5c159c60 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0b0800 con 0x7fba5c159890 2023-10-08T00:30:59.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0cd0c0 con 0x7fba5c15db10 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c0b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34010/0 (socket says 172.21.15.22:34010) 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 -- 172.21.15.22:0/2814457614 learned_addr learned my addr 172.21.15.22:0/2814457614 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba620e9700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba5c159890 0x7fba5c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba628ea700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c15db10 0x7fba5c0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 -- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c15db10 msgr2=0x7fba5c0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c15db10 0x7fba5c0b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 -- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba5c159890 msgr2=0x7fba5c1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba5c159890 0x7fba5c1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 -- 172.21.15.22:0/2814457614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba500094f0 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba620e9700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba5c159890 0x7fba5c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba618e8700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c0b1fa0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fba5c070e20 tx=0x7fba50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50024440 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba500245a0 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c0cd3a0 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50024960 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.269+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c0cd960 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.270+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c0b09b0 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.271+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fba5001a420 con 0x7fba5c159c60 2023-10-08T00:30:59.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.271+0000 7fba5a7fc700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba48067200 0x7fba480696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.271+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba50086760 con 0x7fba5c159c60 2023-10-08T00:30:59.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.271+0000 7fba620e9700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba48067200 0x7fba480696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.272+0000 7fba620e9700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba48067200 0x7fba480696b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fba54006fd0 tx=0x7fba54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:59.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.275+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba5c0b09b0 con 0x7fba5c159c60 2023-10-08T00:30:59.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.468+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fba5c0b09b0 con 0x7fba5c159c60 2023-10-08T00:30:59.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.468+0000 7fba5a7fc700 1 -- 172.21.15.22:0/2814457614 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba5c0b09b0 con 0x7fba5c159c60 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba48067200 msgr2=0x7fba480696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba48067200 0x7fba480696b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fba54006fd0 tx=0x7fba54008040 comp rx=0 tx=0).stop 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 msgr2=0x7fba5c0b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c0b1fa0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fba5c070e20 tx=0x7fba50017000 comp rx=0 tx=0).stop 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 shutdown_connections 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba48067200 0x7fba480696b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba5c15db10 0x7fba5c0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba5c159890 0x7fba5c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 --2- 172.21.15.22:0/2814457614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c159c60 0x7fba5c0b1fa0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 >> 172.21.15.22:0/2814457614 conn(0x7fba5c068e20 msgr2=0x7fba5c153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:59.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 shutdown_connections 2023-10-08T00:30:59.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.470+0000 7fba6434d700 1 -- 172.21.15.22:0/2814457614 wait complete. 2023-10-08T00:30:59.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-08T00:30:59.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.605+0000 7feead1b9700 1 Processor -- start 2023-10-08T00:30:59.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.605+0000 7feead1b9700 1 -- start start 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feead1b9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feea8159890 0x7feea815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feead1b9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea815a160 con 0x7feea8159c60 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feead1b9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea80d13a0 con 0x7feea8069560 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feead1b9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea815e140 con 0x7feea8159890 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feea659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feea8159c60 0x7feea815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48278/0 (socket says 172.21.15.22:48278) 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feea659c700 1 -- 172.21.15.22:0/1144532364 learned_addr learned my addr 172.21.15.22:0/1144532364 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.606+0000 7feea6d9d700 1 --2- 172.21.15.22:0/1144532364 >> v2:172.21.15.192:3300/0 conn(0x7feea8159890 0x7feea815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085269630 0 0) 0x7feea815a160 con 0x7feea8159c60 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee94003570 con 0x7feea8159c60 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673304315 0 0) 0x7feea80d13a0 con 0x7feea8069560 2023-10-08T00:30:59.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea815a160 con 0x7feea8069560 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867477676 0 0) 0x7fee94003570 con 0x7feea8159c60 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 >> v2:172.21.15.192:3300/0 conn(0x7feea8159890 msgr2=0x7feea815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 --2- 172.21.15.22:0/1144532364 >> v2:172.21.15.192:3300/0 conn(0x7feea8159890 0x7feea815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 >> v1:172.21.15.192:6789/0 conn(0x7feea8069560 legacy=0x7feea80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea815a3d0 con 0x7feea8159c60 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fee90001470 con 0x7feea8159c60 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 --2- 172.21.15.22:0/1144532364 >> v2:172.21.15.192:3300/0 conn(0x7feea8159890 0x7feea815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 >> v1:172.21.15.22:6789/0 conn(0x7feea8159c60 legacy=0x7feea815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee94003bf0 0x7fee94003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94004810 0x7fee94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee940051c0 0x7fee9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea815e140 con 0x7fee94003bf0 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400c0b0 con 0x7fee940051c0 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9400c270 con 0x7fee94004810 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee94003bf0 0x7fee94003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea659c700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94004810 0x7fee94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea759e700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee940051c0 0x7fee9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 -- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94004810 msgr2=0x7fee94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94004810 0x7fee94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 -- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee940051c0 msgr2=0x7fee9400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee940051c0 0x7fee9400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 -- 172.21.15.22:0/1144532364 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94003570 con 0x7fee94003bf0 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea759e700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee940051c0 0x7fee9400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:30:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea759e700 1 -- 172.21.15.22:0/1144532364 reap_dead start 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.607+0000 7feea6d9d700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee94003bf0 0x7fee94003fe0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fee9800e3c0 tx=0x7fee9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76d51d3167bfd0b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98009c50 con 0x7fee94003bf0 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9800f040 con 0x7fee94003bf0 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feea5d9b700 1 -- 172.21.15.22:0/1144532364 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9800eea0 con 0x7fee94003bf0 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 -- 172.21.15.22:0/1144532364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee94003bf0 msgr2=0x7fee94003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee94003bf0 0x7fee94003fe0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fee9800e3c0 tx=0x7fee9800b040 comp rx=0 tx=0).stop 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 -- 172.21.15.22:0/1144532364 shutdown_connections 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 --2- 172.21.15.22:0/1144532364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee94003bf0 0x7fee94003fe0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 -- 172.21.15.22:0/1144532364 >> 172.21.15.22:0/1144532364 conn(0x7feea8068e20 msgr2=0x7feea80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 -- 172.21.15.22:0/1144532364 shutdown_connections 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.608+0000 7feead1b9700 1 -- 172.21.15.22:0/1144532364 wait complete. 2023-10-08T00:30:59.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.609+0000 7feead1b9700 1 Processor -- start 2023-10-08T00:30:59.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.609+0000 7feead1b9700 1 -- start start 2023-10-08T00:30:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feead1b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94003bf0 0x7feea814c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feead1b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea80b1990 0x7feea80cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feead1b9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 0x7feea80cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feead1b9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea80c8a00 con 0x7feea80b1e00 2023-10-08T00:30:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feead1b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea814cd00 con 0x7feea80b1990 2023-10-08T00:30:59.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feead1b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea80b23b0 con 0x7fee94003bf0 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feea759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 0x7feea80cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feea759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 0x7feea80cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34026/0 (socket says 172.21.15.22:34026) 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feea759e700 1 -- 172.21.15.22:0/3222290316 learned_addr learned my addr 172.21.15.22:0/3222290316 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feea6d9d700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94003bf0 0x7feea814c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.610+0000 7feea659c700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea80b1990 0x7feea80cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feea759e700 1 -- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94003bf0 msgr2=0x7feea814c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feea759e700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94003bf0 0x7feea814c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feea759e700 1 -- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea80b1990 msgr2=0x7feea80cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feea759e700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea80b1990 0x7feea80cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feea759e700 1 -- 172.21.15.22:0/3222290316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80b2690 con 0x7feea80b1e00 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feea759e700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 0x7feea80cdbe0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7feea0007bc0 tx=0x7feea0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0013420 con 0x7feea80b1e00 2023-10-08T00:30:59.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea0013580 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea80b2970 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea0013920 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.611+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea80cfa00 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.612+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea80c8850 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.612+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7feea0013d50 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.613+0000 7fee9effd700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fee88067200 0x7fee880696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.613+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feea0084720 con 0x7feea80b1e00 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.613+0000 7feea6d9d700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fee88067200 0x7fee880696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:30:59.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.614+0000 7feea6d9d700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fee88067200 0x7fee880696b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fee980099f0 tx=0x7fee9801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:30:59.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.617+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea0051680 con 0x7feea80b1e00 2023-10-08T00:30:59.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.843+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7feea80c8850 con 0x7fee88067200 2023-10-08T00:30:59.845 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:59.844+0000 7f7d5e472700 -1 client.5528 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-08T00:30:29.725338+0000 mtime=2023-10-08T00:30:29.725338+0000 ctime=2023-10-08T00:30:29.731983+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000881248"] has_dir_layout 0x55cc96ecde00) 2023-10-08T00:30:59.850 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:59.849+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:59.850 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:59.849+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:59.850 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:59.849+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:59.850 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:59.849+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:59.850 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:30:59.849+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:30:59.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.856+0000 7fee9effd700 1 -- 172.21.15.22:0/3222290316 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+470 (secure 0 0 0) 0x7feea80c8850 con 0x7fee88067200 2023-10-08T00:30:59.856 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:30:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_addrs": [ 2023-10-08T00:30:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6789", 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6789", 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6790" 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": { 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "data": [ 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": " 340G", 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_data", 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "used": " 0 " 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:30:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": [ 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": " 340G", 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_metadata", 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "used": "64.0k" 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:30:59.858 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:30:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fee88067200 msgr2=0x7fee880696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fee88067200 0x7fee880696b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fee980099f0 tx=0x7fee9801a000 comp rx=0 tx=0).stop 2023-10-08T00:30:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 msgr2=0x7feea80cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:30:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 0x7feea80cdbe0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7feea0007bc0 tx=0x7feea0009040 comp rx=0 tx=0).stop 2023-10-08T00:30:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 shutdown_connections 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feea80b1e00 0x7feea80cdbe0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fee88067200 0x7fee880696b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fee94003bf0 0x7feea814c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 --2- 172.21.15.22:0/3222290316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea80b1990 0x7feea80cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 >> 172.21.15.22:0/3222290316 conn(0x7feea8068e20 msgr2=0x7feea8153730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 shutdown_connections 2023-10-08T00:30:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:30:59.858+0000 7feead1b9700 1 -- 172.21.15.22:0/3222290316 wait complete. 2023-10-08T00:30:59.871 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:30:59.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:59.911 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:30:59.957 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:30:59.957 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:30:59.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:30:59.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:30:59.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:30:59.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:30:59.996 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:31:00.051 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:31:00.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:31:00.052 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:00.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:31:00.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:00.098 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:31:00.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:00.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.231+0000 7f1cbfc3c700 1 Processor -- start 2023-10-08T00:31:00.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.232+0000 7f1cbfc3c700 1 -- start start 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.232+0000 7f1cbfc3c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cb8159890 0x7f1cb815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.232+0000 7f1cbfc3c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1cb8159c60 0x7f1cb815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbfc3c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb815a160 con 0x7f1cb815db10 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbfc3c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb815df50 con 0x7f1cb8159890 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbfc3c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb80d13a0 con 0x7f1cb8159c60 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cb8159890 0x7f1cb815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1cb8159890 0x7f1cb815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34030/0 (socket says 172.21.15.22:34030) 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 -- 172.21.15.22:0/4235567389 learned_addr learned my addr 172.21.15.22:0/4235567389 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd1d7700 1 --2- 172.21.15.22:0/4235567389 >> v2:172.21.15.192:3300/0 conn(0x7f1cb8159c60 0x7f1cb815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 -- 172.21.15.22:0/4235567389 >> v2:172.21.15.192:3300/0 conn(0x7f1cb8159c60 msgr2=0x7f1cb815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 --2- 172.21.15.22:0/4235567389 >> v2:172.21.15.192:3300/0 conn(0x7f1cb8159c60 0x7f1cb815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 -- 172.21.15.22:0/4235567389 >> v1:172.21.15.192:6789/0 conn(0x7f1cb815db10 legacy=0x7f1cb8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 -- 172.21.15.22:0/4235567389 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb815e140 con 0x7f1cb8159890 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd1d7700 1 --2- 172.21.15.22:0/4235567389 >> v2:172.21.15.192:3300/0 conn(0x7f1cb8159c60 0x7f1cb815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbd9d8700 1 --2- 172.21.15.22:0/4235567389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8159890 0x7f1cb815abd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80b67f0 tx=0x7f1ca8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e921661b7b01658 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbc9d6700 1 -- 172.21.15.22:0/4235567389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800e070 con 0x7f1cb8159890 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbc9d6700 1 -- 172.21.15.22:0/4235567389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800ba10 con 0x7f1cb8159890 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.233+0000 7f1cbc9d6700 1 -- 172.21.15.22:0/4235567389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca80092e0 con 0x7f1cb8159890 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/4235567389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8159890 msgr2=0x7f1cb815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/4235567389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8159890 0x7f1cb815abd0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1cb80b67f0 tx=0x7f1ca8009840 comp rx=0 tx=0).stop 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/4235567389 shutdown_connections 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/4235567389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb8159890 0x7f1cb815abd0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/4235567389 >> v2:172.21.15.192:3300/0 conn(0x7f1cb8159c60 0x7f1cb815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/4235567389 >> 172.21.15.22:0/4235567389 conn(0x7f1cb8068e20 msgr2=0x7f1cb80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/4235567389 shutdown_connections 2023-10-08T00:31:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.234+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/4235567389 wait complete. 2023-10-08T00:31:00.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.235+0000 7f1cbfc3c700 1 Processor -- start 2023-10-08T00:31:00.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.235+0000 7f1cbfc3c700 1 -- start start 2023-10-08T00:31:00.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbfc3c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb8159890 0x7f1cb8158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbfc3c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cb8159c60 0x7f1cb80c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbfc3c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 0x7f1cb80c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbfc3c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80b4650 con 0x7f1cb815db10 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbfc3c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb80c7bd0 con 0x7f1cb8159890 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbfc3c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb816a890 con 0x7f1cb8159c60 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 0x7f1cb80c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 0x7f1cb80c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34032/0 (socket says 172.21.15.22:34032) 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 -- 172.21.15.22:0/665807562 learned_addr learned my addr 172.21.15.22:0/665807562 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbd9d8700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb8159890 0x7f1cb8158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbd1d7700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cb8159c60 0x7f1cb80c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 -- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cb8159c60 msgr2=0x7f1cb80c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cb8159c60 0x7f1cb80c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 -- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb8159890 msgr2=0x7f1cb8158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb8159890 0x7f1cb8158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.236+0000 7f1cbe1d9700 1 -- 172.21.15.22:0/665807562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8009ae0 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.237+0000 7f1cbe1d9700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 0x7f1cb80c82b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b4e0 tx=0x7f1cb0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.237+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000be90 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.237+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb000f510 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.237+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb8158790 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.237+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb000f8d0 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.237+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb816a2c0 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.238+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb816a640 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.238+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f1cb000fd00 con 0x7f1cb815db10 2023-10-08T00:31:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.239+0000 7f1cb5ffb700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ca4067200 0x7f1ca40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.239+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1cb0084290 con 0x7f1cb815db10 2023-10-08T00:31:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.239+0000 7f1cbd9d8700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ca4067200 0x7f1ca40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.240+0000 7f1cbd9d8700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ca4067200 0x7f1ca40696b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009880 tx=0x7f1ca8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.243+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb0051230 con 0x7f1cb815db10 2023-10-08T00:31:00.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.479+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cb816aa00 con 0x7f1cb815db10 2023-10-08T00:31:00.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.480+0000 7f1cb5ffb700 1 -- 172.21.15.22:0/665807562 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f1cb0054850 con 0x7f1cb815db10 2023-10-08T00:31:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:00.481 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:45.103135+0000","modified":"2023-10-08T00:30:48.725392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"d","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/3601516791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3601516791},{"type":"v1","addr":"172.21.15.192:6836","nonce":3601516791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ca4067200 msgr2=0x7f1ca40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ca4067200 0x7f1ca40696b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009880 tx=0x7f1ca8017000 comp rx=0 tx=0).stop 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 msgr2=0x7f1cb80c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 0x7f1cb80c82b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1cb000b4e0 tx=0x7f1cb0006f90 comp rx=0 tx=0).stop 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 shutdown_connections 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1cb815db10 0x7f1cb80c82b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb8159890 0x7f1cb8158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ca4067200 0x7f1ca40696b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 --2- 172.21.15.22:0/665807562 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1cb8159c60 0x7f1cb80c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 >> 172.21.15.22:0/665807562 conn(0x7f1cb8068e20 msgr2=0x7f1cb8152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:00.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 shutdown_connections 2023-10-08T00:31:00.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.482+0000 7f1cbfc3c700 1 -- 172.21.15.22:0/665807562 wait complete. 2023-10-08T00:31:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 61 2023-10-08T00:31:00.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:00.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.614+0000 7f83cf59e700 1 Processor -- start 2023-10-08T00:31:00.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.614+0000 7f83cf59e700 1 -- start start 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cf59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83d01597f0 0x7f83d00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cf59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83d015d230 0x7f83d015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cf59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d015db70 con 0x7f83d0159420 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cf59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00b11d0 con 0x7f83d01597f0 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cf59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00b14b0 con 0x7f83d015d230 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cdd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83d01597f0 0x7f83d00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83ce59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f83d0159420 0x7f83d00b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48280/0 (socket says 172.21.15.22:48280) 2023-10-08T00:31:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83ce59c700 1 -- 172.21.15.22:0/865537769 learned_addr learned my addr 172.21.15.22:0/865537769 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83ced9d700 1 --2- 172.21.15.22:0/865537769 >> v2:172.21.15.192:3300/0 conn(0x7f83d015d230 0x7f83d015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cdd9b700 1 -- 172.21.15.22:0/865537769 >> v2:172.21.15.192:3300/0 conn(0x7f83d015d230 msgr2=0x7f83d015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cdd9b700 1 --2- 172.21.15.22:0/865537769 >> v2:172.21.15.192:3300/0 conn(0x7f83d015d230 0x7f83d015d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cdd9b700 1 -- 172.21.15.22:0/865537769 >> v1:172.21.15.22:6789/0 conn(0x7f83d0159420 legacy=0x7f83d00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cdd9b700 1 -- 172.21.15.22:0/865537769 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00b1790 con 0x7f83d01597f0 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.615+0000 7f83cd59a700 1 -- 172.21.15.22:0/865537769 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192664757 0 0) 0x7f83d015db70 con 0x7f83d0159420 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cdd9b700 1 --2- 172.21.15.22:0/865537769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d00b2270 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f83d015d170 tx=0x7f83b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd1b6efef3d1835 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cd59a700 1 -- 172.21.15.22:0/865537769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800b6b0 con 0x7f83d01597f0 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cd59a700 1 -- 172.21.15.22:0/865537769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b800b810 con 0x7f83d01597f0 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cd59a700 1 -- 172.21.15.22:0/865537769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b800bbb0 con 0x7f83d01597f0 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 -- 172.21.15.22:0/865537769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 msgr2=0x7f83d00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 --2- 172.21.15.22:0/865537769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d00b2270 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f83d015d170 tx=0x7f83b80091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 -- 172.21.15.22:0/865537769 shutdown_connections 2023-10-08T00:31:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 --2- 172.21.15.22:0/865537769 >> v2:172.21.15.192:3300/0 conn(0x7f83d015d230 0x7f83d015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 --2- 172.21.15.22:0/865537769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d00b2270 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 -- 172.21.15.22:0/865537769 >> 172.21.15.22:0/865537769 conn(0x7f83d00d0660 msgr2=0x7f83d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 -- 172.21.15.22:0/865537769 shutdown_connections 2023-10-08T00:31:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.616+0000 7f83cf59e700 1 -- 172.21.15.22:0/865537769 wait complete. 2023-10-08T00:31:00.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.617+0000 7f83cf59e700 1 Processor -- start 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 -- start start 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83d0159420 0x7f83d015b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d01551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83d015d230 0x7f83d015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015cb50 con 0x7f83d01597f0 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015bf40 con 0x7f83d015d230 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d015c220 con 0x7f83d0159420 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cdd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d01551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cdd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d01551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34062/0 (socket says 172.21.15.22:34062) 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.618+0000 7f83cdd9b700 1 -- 172.21.15.22:0/608990529 learned_addr learned my addr 172.21.15.22:0/608990529 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83ce59c700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83d0159420 0x7f83d015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83ced9d700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83d015d230 0x7f83d015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cdd9b700 1 -- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83d0159420 msgr2=0x7f83d015b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cdd9b700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83d0159420 0x7f83d015b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cdd9b700 1 -- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83d015d230 msgr2=0x7f83d015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cdd9b700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83d015d230 0x7f83d015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cdd9b700 1 -- 172.21.15.22:0/608990529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009420 con 0x7f83d01597f0 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83ce59c700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83d0159420 0x7f83d015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83ced9d700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83d015d230 0x7f83d015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cdd9b700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d01551c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f83b8013000 tx=0x7f83b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011420 con 0x7f83d01597f0 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8011580 con 0x7f83d01597f0 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011940 con 0x7f83d01597f0 2023-10-08T00:31:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d015c500 con 0x7f83d01597f0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.619+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d015bb50 con 0x7f83d01597f0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.620+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d015cd00 con 0x7f83d01597f0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.620+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f83b8011d30 con 0x7f83d01597f0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.621+0000 7f83c67fc700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f83b0067200 0x7f83b00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.621+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f83b8085e80 con 0x7f83d01597f0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.621+0000 7f83ce59c700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f83b0067200 0x7f83b00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.622+0000 7f83ce59c700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f83b0067200 0x7f83b00696b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f83c80011e0 tx=0x7f83c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.625+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83d015cd00 con 0x7f83d01597f0 2023-10-08T00:31:00.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.772+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f83b8053170 con 0x7f83d01597f0 2023-10-08T00:31:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.824+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83d00af9e0 con 0x7f83d01597f0 2023-10-08T00:31:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.825+0000 7f83c67fc700 1 -- 172.21.15.22:0/608990529 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f83b80563c0 con 0x7f83d01597f0 2023-10-08T00:31:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:00.826 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":90,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:46.691667+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:43.509676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:44.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f83b0067200 msgr2=0x7f83b00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f83b0067200 0x7f83b00696b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f83c80011e0 tx=0x7f83c8009040 comp rx=0 tx=0).stop 2023-10-08T00:31:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 msgr2=0x7f83d01551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d01551c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f83b8013000 tx=0x7f83b8017000 comp rx=0 tx=0).stop 2023-10-08T00:31:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 shutdown_connections 2023-10-08T00:31:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83d015d230 0x7f83d015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f83b0067200 0x7f83b00696b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83d0159420 0x7f83d015b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 --2- 172.21.15.22:0/608990529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83d01597f0 0x7f83d01551c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 >> 172.21.15.22:0/608990529 conn(0x7f83d00d0660 msgr2=0x7f83d0155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 shutdown_connections 2023-10-08T00:31:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.827+0000 7f83cf59e700 1 -- 172.21.15.22:0/608990529 wait complete. 2023-10-08T00:31:00.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:30:43.509676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:30:44.068405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:31:00.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:31:00.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.962+0000 7f36f2229700 1 Processor -- start 2023-10-08T00:31:00.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.962+0000 7f36f2229700 1 -- start start 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36f2229700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36ec159890 0x7f36ec15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36f2229700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36ec069560 0x7f36ec0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36f2229700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ec069ee0 con 0x7f36ec159c60 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36f2229700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec15a160 con 0x7f36ec159890 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36f2229700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ec0d13a0 con 0x7f36ec069560 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36eb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36ec159890 0x7f36ec15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36eaffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f36ec159c60 0x7f36ec15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48288/0 (socket says 172.21.15.22:48288) 2023-10-08T00:31:00.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.963+0000 7f36eaffd700 1 -- 172.21.15.22:0/2646489277 learned_addr learned my addr 172.21.15.22:0/2646489277 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36ebfff700 1 --2- 172.21.15.22:0/2646489277 >> v2:172.21.15.192:3300/0 conn(0x7f36ec069560 0x7f36ec0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36eb7fe700 1 -- 172.21.15.22:0/2646489277 >> v2:172.21.15.192:3300/0 conn(0x7f36ec069560 msgr2=0x7f36ec0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36eb7fe700 1 --2- 172.21.15.22:0/2646489277 >> v2:172.21.15.192:3300/0 conn(0x7f36ec069560 0x7f36ec0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36eb7fe700 1 -- 172.21.15.22:0/2646489277 >> v1:172.21.15.22:6789/0 conn(0x7f36ec159c60 legacy=0x7f36ec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36eb7fe700 1 -- 172.21.15.22:0/2646489277 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec15e140 con 0x7f36ec159890 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36ea7fc700 1 -- 172.21.15.22:0/2646489277 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821719849 0 0) 0x7f36ec069ee0 con 0x7f36ec159c60 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36eb7fe700 1 --2- 172.21.15.22:0/2646489277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec15abd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f36ec06a890 tx=0x7f36dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb786431cc166089 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36ea7fc700 1 -- 172.21.15.22:0/2646489277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00b6b0 con 0x7f36ec159890 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36ea7fc700 1 -- 172.21.15.22:0/2646489277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00b810 con 0x7f36ec159890 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36ea7fc700 1 -- 172.21.15.22:0/2646489277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36dc00bbb0 con 0x7f36ec159890 2023-10-08T00:31:00.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 -- 172.21.15.22:0/2646489277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 msgr2=0x7f36ec15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 --2- 172.21.15.22:0/2646489277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec15abd0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f36ec06a890 tx=0x7f36dc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 -- 172.21.15.22:0/2646489277 shutdown_connections 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 --2- 172.21.15.22:0/2646489277 >> v2:172.21.15.192:3300/0 conn(0x7f36ec069560 0x7f36ec0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 --2- 172.21.15.22:0/2646489277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec15abd0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 -- 172.21.15.22:0/2646489277 >> 172.21.15.22:0/2646489277 conn(0x7f36ec068e20 msgr2=0x7f36ec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 -- 172.21.15.22:0/2646489277 shutdown_connections 2023-10-08T00:31:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.964+0000 7f36f2229700 1 -- 172.21.15.22:0/2646489277 wait complete. 2023-10-08T00:31:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.966+0000 7f36f2229700 1 Processor -- start 2023-10-08T00:31:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.966+0000 7f36f2229700 1 -- start start 2023-10-08T00:31:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36f2229700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ec069560 0x7f36ec154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36f2229700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36f2229700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ec159c60 0x7f36ec0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36f2229700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec0c8090 con 0x7f36ec159890 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36f2229700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec16a700 con 0x7f36ec069560 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36f2229700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ec1497c0 con 0x7f36ec159c60 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34086/0 (socket says 172.21.15.22:34086) 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 -- 172.21.15.22:0/1645019024 learned_addr learned my addr 172.21.15.22:0/1645019024 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eb7fe700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ec069560 0x7f36ec154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36ebfff700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ec159c60 0x7f36ec0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 -- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ec159c60 msgr2=0x7f36ec0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ec159c60 0x7f36ec0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 -- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ec069560 msgr2=0x7f36ec154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:00.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ec069560 0x7f36ec154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 -- 172.21.15.22:0/1645019024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009420 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.967+0000 7f36eaffd700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec149280 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f36e000c5b0 tx=0x7f36e0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.968+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0005b30 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.968+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0005c90 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.968+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ec0c7a40 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.968+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0007300 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.968+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ec0b3ad0 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.968+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ec0c7880 con 0x7f36ec159890 2023-10-08T00:31:00.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.969+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f36e001b3b0 con 0x7f36ec159890 2023-10-08T00:31:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.969+0000 7f36d37fe700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36d8067290 0x7f36d8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.969+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f36e0083ea0 con 0x7f36ec159890 2023-10-08T00:31:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.970+0000 7f36eb7fe700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36d8067290 0x7f36d8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.970+0000 7f36eb7fe700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36d8067290 0x7f36d8069740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0093f0 tx=0x7f36dc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:00.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:00.974+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36e0050d00 con 0x7f36ec159890 2023-10-08T00:31:01.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.166+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36ec04c3c0 con 0x7f36ec159890 2023-10-08T00:31:01.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.166+0000 7f36d37fe700 1 -- 172.21.15.22:0/1645019024 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36e00170a0 con 0x7f36ec159890 2023-10-08T00:31:01.167 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:31:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.168+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36d8067290 msgr2=0x7f36d8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.168+0000 7f36f2229700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36d8067290 0x7f36d8069740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f36dc0093f0 tx=0x7f36dc017000 comp rx=0 tx=0).stop 2023-10-08T00:31:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.168+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 msgr2=0x7f36ec149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.168+0000 7f36f2229700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec149280 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f36e000c5b0 tx=0x7f36e0001070 comp rx=0 tx=0).stop 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 shutdown_connections 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36d8067290 0x7f36d8069740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36ec159c60 0x7f36ec0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36ec069560 0x7f36ec154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 --2- 172.21.15.22:0/1645019024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ec159890 0x7f36ec149280 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 >> 172.21.15.22:0/1645019024 conn(0x7f36ec068e20 msgr2=0x7f36ec0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 shutdown_connections 2023-10-08T00:31:01.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.169+0000 7f36f2229700 1 -- 172.21.15.22:0/1645019024 wait complete. 2023-10-08T00:31:01.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:31:01.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.303+0000 7f04f73bd700 1 Processor -- start 2023-10-08T00:31:01.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.303+0000 7f04f73bd700 1 -- start start 2023-10-08T00:31:01.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f73bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 0x7f04f015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f73bd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04f0069560 0x7f04f00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f73bd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f015a160 con 0x7f04f0159c60 2023-10-08T00:31:01.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f73bd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f0069f20 con 0x7f04f0069560 2023-10-08T00:31:01.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f73bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00d13a0 con 0x7f04f0159890 2023-10-08T00:31:01.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f5159700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 0x7f04f015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f595a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04f0069560 0x7f04f00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f5159700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 0x7f04f015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:59866/0 (socket says 172.21.15.22:59866) 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.304+0000 7f04f5159700 1 -- 172.21.15.22:0/282415907 learned_addr learned my addr 172.21.15.22:0/282415907 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04f5159700 1 -- 172.21.15.22:0/282415907 >> v2:172.21.15.192:3300/0 conn(0x7f04f0069560 msgr2=0x7f04f00699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04f5159700 1 --2- 172.21.15.22:0/282415907 >> v2:172.21.15.192:3300/0 conn(0x7f04f0069560 0x7f04f00699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04f5159700 1 -- 172.21.15.22:0/282415907 >> v1:172.21.15.192:6789/0 conn(0x7f04f0159c60 legacy=0x7f04f015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04f5159700 1 -- 172.21.15.22:0/282415907 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f015e140 con 0x7f04f0159890 2023-10-08T00:31:01.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04f5159700 1 --2- 172.21.15.22:0/282415907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 0x7f04f015abd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009f20 tx=0x7f04e0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b717b9e81113bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04effff700 1 -- 172.21.15.22:0/282415907 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000e070 con 0x7f04f0159890 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04effff700 1 -- 172.21.15.22:0/282415907 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000b9d0 con 0x7f04f0159890 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.305+0000 7f04effff700 1 -- 172.21.15.22:0/282415907 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00092e0 con 0x7f04f0159890 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 -- 172.21.15.22:0/282415907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 msgr2=0x7f04f015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 --2- 172.21.15.22:0/282415907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 0x7f04f015abd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04e0009f20 tx=0x7f04e0009840 comp rx=0 tx=0).stop 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 -- 172.21.15.22:0/282415907 shutdown_connections 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 --2- 172.21.15.22:0/282415907 >> v2:172.21.15.192:3300/0 conn(0x7f04f0069560 0x7f04f00699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 --2- 172.21.15.22:0/282415907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0159890 0x7f04f015abd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 -- 172.21.15.22:0/282415907 >> 172.21.15.22:0/282415907 conn(0x7f04f0068e20 msgr2=0x7f04f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 -- 172.21.15.22:0/282415907 shutdown_connections 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.306+0000 7f04f73bd700 1 -- 172.21.15.22:0/282415907 wait complete. 2023-10-08T00:31:01.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.307+0000 7f04f73bd700 1 Processor -- start 2023-10-08T00:31:01.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.307+0000 7f04f73bd700 1 -- start start 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0069560 0x7f04f0147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04f0159890 0x7f04f0169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 0x7f04f015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f016d200 con 0x7f04f0159c60 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f016d7c0 con 0x7f04f0159890 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01477a0 con 0x7f04f0069560 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 0x7f04f015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 0x7f04f015d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34090/0 (socket says 172.21.15.22:34090) 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 -- 172.21.15.22:0/3915427546 learned_addr learned my addr 172.21.15.22:0/3915427546 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f5159700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0069560 0x7f04f0147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f4958700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04f0159890 0x7f04f0169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 -- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0069560 msgr2=0x7f04f0147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0069560 0x7f04f0147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 -- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04f0159890 msgr2=0x7f04f0169c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04f0159890 0x7f04f0169c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 -- 172.21.15.22:0/3915427546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009ae0 con 0x7f04f0159c60 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f4958700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04f0159890 0x7f04f0169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f595a700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 0x7f04f015d200 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f04e800ea80 tx=0x7f04e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e80096b0 con 0x7f04f0159c60 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800c920 con 0x7f04f0159c60 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f016a6e0 con 0x7f04f0159c60 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.308+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800ccc0 con 0x7f04f0159c60 2023-10-08T00:31:01.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.309+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f016d450 con 0x7f04f0159c60 2023-10-08T00:31:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.310+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f016d950 con 0x7f04f0159c60 2023-10-08T00:31:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.310+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f04e8013680 con 0x7f04f0159c60 2023-10-08T00:31:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.310+0000 7f04ed7fa700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f04dc067290 0x7f04dc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.310+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04e8084cc0 con 0x7f04f0159c60 2023-10-08T00:31:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.310+0000 7f04f5159700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f04dc067290 0x7f04dc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.311+0000 7f04f5159700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f04dc067290 0x7f04dc069740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f04f00cb8b0 tx=0x7f04e0018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.314+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04e8051b20 con 0x7f04f0159c60 2023-10-08T00:31:01.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.506+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04f004c3c0 con 0x7f04f0159c60 2023-10-08T00:31:01.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.507+0000 7f04ed7fa700 1 -- 172.21.15.22:0/3915427546 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04e8055140 con 0x7f04f0159c60 2023-10-08T00:31:01.508 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f04dc067290 msgr2=0x7f04dc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f04dc067290 0x7f04dc069740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f04f00cb8b0 tx=0x7f04e0018000 comp rx=0 tx=0).stop 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 msgr2=0x7f04f015d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 0x7f04f015d200 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f04e800ea80 tx=0x7f04e80091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 shutdown_connections 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f0159c60 0x7f04f015d200 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f04dc067290 0x7f04dc069740 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f04f0069560 0x7f04f0147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 --2- 172.21.15.22:0/3915427546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04f0159890 0x7f04f0169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 >> 172.21.15.22:0/3915427546 conn(0x7f04f0068e20 msgr2=0x7f04f0152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:01.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 shutdown_connections 2023-10-08T00:31:01.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.509+0000 7f04f73bd700 1 -- 172.21.15.22:0/3915427546 wait complete. 2023-10-08T00:31:01.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:31:01.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.643+0000 7eff4ae90700 1 Processor -- start 2023-10-08T00:31:01.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.643+0000 7eff4ae90700 1 -- start start 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.643+0000 7eff4ae90700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff44069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff4ae90700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7eff44069cb0 0x7eff440c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff4ae90700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff440af2f0 con 0x7eff4415b050 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff4ae90700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff440af5d0 con 0x7eff44069cb0 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff4ae90700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4406a0f0 con 0x7eff4415ac80 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff44069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff4942d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7eff44069cb0 0x7eff440c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff44069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:59874/0 (socket says 172.21.15.22:59874) 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 -- 172.21.15.22:0/2298243743 learned_addr learned my addr 172.21.15.22:0/2298243743 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:01.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff43fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7eff4415b050 0x7eff440afa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34912/0 (socket says 172.21.15.22:34912) 2023-10-08T00:31:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 -- 172.21.15.22:0/2298243743 >> v2:172.21.15.192:3300/0 conn(0x7eff44069cb0 msgr2=0x7eff440c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 --2- 172.21.15.22:0/2298243743 >> v2:172.21.15.192:3300/0 conn(0x7eff44069cb0 0x7eff440c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 -- 172.21.15.22:0/2298243743 >> v1:172.21.15.192:6789/0 conn(0x7eff4415b050 legacy=0x7eff440afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff48c2c700 1 -- 172.21.15.22:0/2298243743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff440c8660 con 0x7eff4415ac80 2023-10-08T00:31:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.644+0000 7eff4942d700 1 --2- 172.21.15.22:0/2298243743 >> v2:172.21.15.192:3300/0 conn(0x7eff44069cb0 0x7eff440c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:01.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff48c2c700 1 --2- 172.21.15.22:0/2298243743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff44069770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009f20 tx=0x7eff3c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b38c8164ccf72b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff437fe700 1 -- 172.21.15.22:0/2298243743 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00e070 con 0x7eff4415ac80 2023-10-08T00:31:01.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff437fe700 1 -- 172.21.15.22:0/2298243743 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c00b9d0 con 0x7eff4415ac80 2023-10-08T00:31:01.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff437fe700 1 -- 172.21.15.22:0/2298243743 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0092e0 con 0x7eff4415ac80 2023-10-08T00:31:01.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 -- 172.21.15.22:0/2298243743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 msgr2=0x7eff44069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 --2- 172.21.15.22:0/2298243743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff44069770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009f20 tx=0x7eff3c009840 comp rx=0 tx=0).stop 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 -- 172.21.15.22:0/2298243743 shutdown_connections 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 --2- 172.21.15.22:0/2298243743 >> v2:172.21.15.192:3300/0 conn(0x7eff44069cb0 0x7eff440c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 --2- 172.21.15.22:0/2298243743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff44069770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 -- 172.21.15.22:0/2298243743 >> 172.21.15.22:0/2298243743 conn(0x7eff44068e10 msgr2=0x7eff440cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 -- 172.21.15.22:0/2298243743 shutdown_connections 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.645+0000 7eff4ae90700 1 -- 172.21.15.22:0/2298243743 wait complete. 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.646+0000 7eff4ae90700 1 Processor -- start 2023-10-08T00:31:01.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 -- start start 2023-10-08T00:31:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff44069cb0 0x7eff440ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff4416a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 0x7eff440ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff440ca790 con 0x7eff4415b050 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff440caa70 con 0x7eff44069cb0 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4ae90700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff440cad50 con 0x7eff4415ac80 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4942d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 0x7eff440ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4942d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 0x7eff440ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34104/0 (socket says 172.21.15.22:34104) 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff4942d700 1 -- 172.21.15.22:0/3004699209 learned_addr learned my addr 172.21.15.22:0/3004699209 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.647+0000 7eff48c2c700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff44069cb0 0x7eff440ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff43fff700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff4416a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4942d700 1 -- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 msgr2=0x7eff4416a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4942d700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff4416a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4942d700 1 -- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff44069cb0 msgr2=0x7eff440ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4942d700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff44069cb0 0x7eff440ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4942d700 1 -- 172.21.15.22:0/3004699209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c009420 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4942d700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 0x7eff440ad410 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00ec80 tx=0x7eff2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00c850 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c00c9b0 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c009ae0 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00cd50 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.648+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff440cb310 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.649+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff440cb530 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.650+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7eff2c013680 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.650+0000 7eff40ff9700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff24067290 0x7eff24069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.650+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff2c084aa0 con 0x7eff4415b050 2023-10-08T00:31:01.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.650+0000 7eff48c2c700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff24067290 0x7eff24069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.651+0000 7eff48c2c700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff24067290 0x7eff24069740 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009880 tx=0x7eff3c018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.654+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff2c051900 con 0x7eff4415b050 2023-10-08T00:31:01.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:31:01.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:31:01.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.848+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff4404c3c0 con 0x7eff4415b050 2023-10-08T00:31:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.848+0000 7eff40ff9700 1 -- 172.21.15.22:0/3004699209 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff2c0170a0 con 0x7eff4415b050 2023-10-08T00:31:01.849 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:31:01.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff24067290 msgr2=0x7eff24069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff24067290 0x7eff24069740 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009880 tx=0x7eff3c018000 comp rx=0 tx=0).stop 2023-10-08T00:31:01.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 msgr2=0x7eff440ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 0x7eff440ad410 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00ec80 tx=0x7eff2c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 shutdown_connections 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4415b050 0x7eff440ad410 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff44069cb0 0x7eff440ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff24067290 0x7eff24069740 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 --2- 172.21.15.22:0/3004699209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4415ac80 0x7eff4416a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 >> 172.21.15.22:0/3004699209 conn(0x7eff44068e10 msgr2=0x7eff440c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.850+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 shutdown_connections 2023-10-08T00:31:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.851+0000 7eff4ae90700 1 -- 172.21.15.22:0/3004699209 wait complete. 2023-10-08T00:31:01.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:01.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.981+0000 7fe3feef5700 1 Processor -- start 2023-10-08T00:31:01.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.981+0000 7fe3feef5700 1 -- start start 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3feef5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe3f8159c60 0x7fe3f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3feef5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f815db10 0x7fe3f8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3feef5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f815a160 con 0x7fe3f8159890 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3feef5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f815df50 con 0x7fe3f8159c60 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3feef5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80d13a0 con 0x7fe3f815db10 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3fcc91700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe3f8159890 0x7fe3f815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48298/0 (socket says 172.21.15.22:48298) 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3fcc91700 1 -- 172.21.15.22:0/112861094 learned_addr learned my addr 172.21.15.22:0/112861094 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3f7fff700 1 --2- 172.21.15.22:0/112861094 >> v2:172.21.15.192:3300/0 conn(0x7fe3f8159c60 0x7fe3f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.982+0000 7fe3fd492700 1 --2- 172.21.15.22:0/112861094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f815db10 0x7fe3f8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3f77fe700 1 -- 172.21.15.22:0/112861094 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675412550 0 0) 0x7fe3f815a160 con 0x7fe3f8159890 2023-10-08T00:31:01.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3f77fe700 1 -- 172.21.15.22:0/112861094 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003570 con 0x7fe3f8159890 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3fd492700 1 -- 172.21.15.22:0/112861094 >> v2:172.21.15.192:3300/0 conn(0x7fe3f8159c60 msgr2=0x7fe3f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3fd492700 1 --2- 172.21.15.22:0/112861094 >> v2:172.21.15.192:3300/0 conn(0x7fe3f8159c60 0x7fe3f815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3fd492700 1 -- 172.21.15.22:0/112861094 >> v1:172.21.15.22:6789/0 conn(0x7fe3f8159890 legacy=0x7fe3f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3fd492700 1 -- 172.21.15.22:0/112861094 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f815e140 con 0x7fe3f815db10 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3f7fff700 1 --2- 172.21.15.22:0/112861094 >> v2:172.21.15.192:3300/0 conn(0x7fe3f8159c60 0x7fe3f815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3fd492700 1 --2- 172.21.15.22:0/112861094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f815db10 0x7fe3f8069560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e60 tx=0x7fe3f0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d6edd2f7d47077 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3f77fe700 1 -- 172.21.15.22:0/112861094 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e070 con 0x7fe3f815db10 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3f77fe700 1 -- 172.21.15.22:0/112861094 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000bab0 con 0x7fe3f815db10 2023-10-08T00:31:01.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.983+0000 7fe3f77fe700 1 -- 172.21.15.22:0/112861094 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000be70 con 0x7fe3f815db10 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 -- 172.21.15.22:0/112861094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f815db10 msgr2=0x7fe3f8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 --2- 172.21.15.22:0/112861094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f815db10 0x7fe3f8069560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e60 tx=0x7fe3f0009780 comp rx=0 tx=0).stop 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 -- 172.21.15.22:0/112861094 shutdown_connections 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 --2- 172.21.15.22:0/112861094 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f815db10 0x7fe3f8069560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 --2- 172.21.15.22:0/112861094 >> v2:172.21.15.192:3300/0 conn(0x7fe3f8159c60 0x7fe3f815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 -- 172.21.15.22:0/112861094 >> 172.21.15.22:0/112861094 conn(0x7fe3f8068e20 msgr2=0x7fe3f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 -- 172.21.15.22:0/112861094 shutdown_connections 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.984+0000 7fe3feef5700 1 -- 172.21.15.22:0/112861094 wait complete. 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.985+0000 7fe3feef5700 1 Processor -- start 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.985+0000 7fe3feef5700 1 -- start start 2023-10-08T00:31:01.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3feef5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3f8159890 0x7fe3f80b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3feef5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f8159c60 0x7fe3f813a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3feef5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 0x7fe3f813a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3feef5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b3ad0 con 0x7fe3f815db10 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3feef5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80cd170 con 0x7fe3f8159890 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3feef5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80cd730 con 0x7fe3f8159c60 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 0x7fe3f813a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 0x7fe3f813a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34106/0 (socket says 172.21.15.22:34106) 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 -- 172.21.15.22:0/1014223775 learned_addr learned my addr 172.21.15.22:0/1014223775 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fcc91700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3f8159890 0x7fe3f80b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3f7fff700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f8159c60 0x7fe3f813a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 -- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f8159c60 msgr2=0x7fe3f813a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f8159c60 0x7fe3f813a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 -- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3f8159890 msgr2=0x7fe3f80b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3f8159890 0x7fe3f80b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 -- 172.21.15.22:0/1014223775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec009420 con 0x7fe3f815db10 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3fd492700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 0x7fe3f813a640 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8070e20 tx=0x7fe3f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.986+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0012e10 con 0x7fe3f815db10 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.987+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0027470 con 0x7fe3f815db10 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.987+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0009a20 con 0x7fe3f815db10 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.987+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0027830 con 0x7fe3f815db10 2023-10-08T00:31:01.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.987+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f80b6280 con 0x7fe3f815db10 2023-10-08T00:31:01.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.988+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f804c3c0 con 0x7fe3f815db10 2023-10-08T00:31:01.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.988+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe3f0024070 con 0x7fe3f815db10 2023-10-08T00:31:01.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.988+0000 7fe3f4ff9700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3e4067290 0x7fe3e4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:01.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.988+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3f00874d0 con 0x7fe3f815db10 2023-10-08T00:31:01.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.988+0000 7fe3fcc91700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3e4067290 0x7fe3e4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:01.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.989+0000 7fe3fcc91700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3e4067290 0x7fe3e4069740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007fd0 tx=0x7fe3e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:01.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:01.993+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3f0054330 con 0x7fe3f815db10 2023-10-08T00:31:02.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.228+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3f80cd870 con 0x7fe3f815db10 2023-10-08T00:31:02.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.229+0000 7fe3f4ff9700 1 -- 172.21.15.22:0/1014223775 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fe3f0057950 con 0x7fe3f815db10 2023-10-08T00:31:02.229 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:02.230 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:45.103135+0000","modified":"2023-10-08T00:30:48.725392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"d","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/3601516791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3601516791},{"type":"v1","addr":"172.21.15.192:6836","nonce":3601516791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3e4067290 msgr2=0x7fe3e4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3e4067290 0x7fe3e4069740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007fd0 tx=0x7fe3e8009040 comp rx=0 tx=0).stop 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 msgr2=0x7fe3f813a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 0x7fe3f813a640 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8070e20 tx=0x7fe3f0019000 comp rx=0 tx=0).stop 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 shutdown_connections 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3f815db10 0x7fe3f813a640 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3f8159890 0x7fe3f80b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe3e4067290 0x7fe3e4069740 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 --2- 172.21.15.22:0/1014223775 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3f8159c60 0x7fe3f813a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 >> 172.21.15.22:0/1014223775 conn(0x7fe3f8068e20 msgr2=0x7fe3f814d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:02.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 shutdown_connections 2023-10-08T00:31:02.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.231+0000 7fe3feef5700 1 -- 172.21.15.22:0/1014223775 wait complete. 2023-10-08T00:31:02.233 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 61 2023-10-08T00:31:02.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:02.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.362+0000 7f786efb5700 1 Processor -- start 2023-10-08T00:31:02.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.362+0000 7f786efb5700 1 -- start start 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786efb5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7868157940 0x7f786806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786efb5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786806c750 con 0x7f786815baa0 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786efb5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786806ca30 con 0x7f786806c1e0 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786efb5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786806cd10 con 0x7f7868157940 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786d552700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f786815baa0 0x7f786815bec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48300/0 (socket says 172.21.15.22:48300) 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786d552700 1 -- 172.21.15.22:0/3934909188 learned_addr learned my addr 172.21.15.22:0/3934909188 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f786cd51700 1 --2- 172.21.15.22:0/3934909188 >> v2:172.21.15.192:3300/0 conn(0x7f7868157940 0x7f786806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986364377 0 0) 0x7f786806c750 con 0x7f786815baa0 2023-10-08T00:31:02.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.363+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7850003570 con 0x7f786815baa0 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061784559 0 0) 0x7f786806ca30 con 0x7f786806c1e0 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f786806c750 con 0x7f786806c1e0 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20238119 0 0) 0x7f7850003570 con 0x7f786815baa0 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 >> v2:172.21.15.192:3300/0 conn(0x7f7868157940 msgr2=0x7f786806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 --2- 172.21.15.22:0/3934909188 >> v2:172.21.15.192:3300/0 conn(0x7f7868157940 0x7f786806f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 >> v1:172.21.15.192:6789/0 conn(0x7f786806c1e0 legacy=0x7f78680cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786806cff0 con 0x7f786815baa0 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f7858001470 con 0x7f786815baa0 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786cd51700 1 --2- 172.21.15.22:0/3934909188 >> v2:172.21.15.192:3300/0 conn(0x7f7868157940 0x7f786806f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 >> v1:172.21.15.22:6789/0 conn(0x7f786815baa0 legacy=0x7f786815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7850003bf0 0x7f7850003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850004810 0x7f7850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78500051c0 0x7f785000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786806cd10 con 0x7f78500051c0 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785000c0b0 con 0x7f7850004810 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785000c270 con 0x7f7850003bf0 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78500051c0 0x7f785000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f7867fff700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850004810 0x7f7850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786cd51700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7850003bf0 0x7f7850003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 -- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7850003bf0 msgr2=0x7f7850003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7850003bf0 0x7f7850003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 -- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850004810 msgr2=0x7f7850004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:02.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7850004810 0x7f7850004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 -- 172.21.15.22:0/3934909188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7850003570 con 0x7f78500051c0 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786cd51700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7850003bf0 0x7f7850003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 -- 172.21.15.22:0/3934909188 reap_dead start 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.364+0000 7f786d552700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78500051c0 0x7f785000ba60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f785800c2d0 tx=0x7f7858001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cbcf5a660559189 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800cba0 con 0x7f78500051c0 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785800cd40 con 0x7f78500051c0 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f78677fe700 1 -- 172.21.15.22:0/3934909188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858005b70 con 0x7f78500051c0 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 -- 172.21.15.22:0/3934909188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78500051c0 msgr2=0x7f785000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78500051c0 0x7f785000ba60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f785800c2d0 tx=0x7f7858001e10 comp rx=0 tx=0).stop 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 -- 172.21.15.22:0/3934909188 shutdown_connections 2023-10-08T00:31:02.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 --2- 172.21.15.22:0/3934909188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78500051c0 0x7f785000ba60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 -- 172.21.15.22:0/3934909188 >> 172.21.15.22:0/3934909188 conn(0x7f78680cd480 msgr2=0x7f78680cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:02.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 -- 172.21.15.22:0/3934909188 shutdown_connections 2023-10-08T00:31:02.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.365+0000 7f786efb5700 1 -- 172.21.15.22:0/3934909188 wait complete. 2023-10-08T00:31:02.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.366+0000 7f786efb5700 1 Processor -- start 2023-10-08T00:31:02.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.366+0000 7f786efb5700 1 -- start start 2023-10-08T00:31:02.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786efb5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78500051c0 0x7f78680c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786efb5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78680c48e0 0x7f78680c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786efb5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 0x7f7868167180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786efb5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c68d0 con 0x7f786816b690 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786efb5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c6b90 con 0x7f78500051c0 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786efb5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680c6e70 con 0x7f78680c48e0 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786d552700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 0x7f7868167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786d552700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 0x7f7868167180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34114/0 (socket says 172.21.15.22:34114) 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786d552700 1 -- 172.21.15.22:0/3006770829 learned_addr learned my addr 172.21.15.22:0/3006770829 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f786cd51700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78500051c0 0x7f78680c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.367+0000 7f7867fff700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78680c48e0 0x7f78680c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786d552700 1 -- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78680c48e0 msgr2=0x7f78680c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786d552700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78680c48e0 0x7f78680c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786d552700 1 -- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78500051c0 msgr2=0x7f78680c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786d552700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78500051c0 0x7f78680c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786d552700 1 -- 172.21.15.22:0/3006770829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680c7150 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786d552700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 0x7f7868167180 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f786806f350 tx=0x7f7858013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580070d0 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858007250 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78680c9ef0 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858007610 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.368+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786816bd40 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.369+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786816bd40 con 0x7f786816b690 2023-10-08T00:31:02.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.369+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7858026460 con 0x7f786816b690 2023-10-08T00:31:02.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.370+0000 7f7864ff9700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7854067290 0x7f7854069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.370+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78580859f0 con 0x7f786816b690 2023-10-08T00:31:02.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.370+0000 7f786cd51700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7854067290 0x7f7854069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.371+0000 7f786cd51700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7854067290 0x7f7854069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f78600099f0 tx=0x7f786000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:02.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.374+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7858052850 con 0x7f786816b690 2023-10-08T00:31:02.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.569+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f786816bd40 con 0x7f786816b690 2023-10-08T00:31:02.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.570+0000 7f7864ff9700 1 -- 172.21.15.22:0/3006770829 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7f7858055e70 con 0x7f786816b690 2023-10-08T00:31:02.570 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:02.571 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":90,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:46.691667+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:43.509676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:44.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:02.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7854067290 msgr2=0x7f7854069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7854067290 0x7f7854069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f78600099f0 tx=0x7f786000b040 comp rx=0 tx=0).stop 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 msgr2=0x7f7868167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 0x7f7868167180 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f786806f350 tx=0x7f7858013000 comp rx=0 tx=0).stop 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 shutdown_connections 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f786816b690 0x7f7868167180 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78500051c0 0x7f78680c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7854067290 0x7f7854069740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 --2- 172.21.15.22:0/3006770829 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78680c48e0 0x7f78680c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 >> 172.21.15.22:0/3006770829 conn(0x7f78680cd480 msgr2=0x7f786806e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 shutdown_connections 2023-10-08T00:31:02.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.572+0000 7f786efb5700 1 -- 172.21.15.22:0/3006770829 wait complete. 2023-10-08T00:31:02.585 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:31:02.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:02.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.704+0000 7fdf99a99700 1 Processor -- start 2023-10-08T00:31:02.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.704+0000 7fdf99a99700 1 -- start start 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf99a99700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf94159890 0x7fdf9415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf99a99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf94159c60 0x7fdf9415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf99a99700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9415a160 con 0x7fdf9415db10 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf99a99700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf940d13a0 con 0x7fdf94159890 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf99a99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415e140 con 0x7fdf94159c60 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf937fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf94159890 0x7fdf9415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf92ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf94159c60 0x7fdf9415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf93fff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdf9415db10 0x7fdf94069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:34928/0 (socket says 172.21.15.22:34928) 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf93fff700 1 -- 172.21.15.22:0/3496034419 learned_addr learned my addr 172.21.15.22:0/3496034419 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf937fe700 1 -- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf94159c60 msgr2=0x7fdf9415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf937fe700 1 --2- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf94159c60 0x7fdf9415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf937fe700 1 -- 172.21.15.22:0/3496034419 >> v1:172.21.15.192:6789/0 conn(0x7fdf9415db10 legacy=0x7fdf94069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf937fe700 1 -- 172.21.15.22:0/3496034419 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9415a3d0 con 0x7fdf94159890 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.705+0000 7fdf927fc700 1 -- 172.21.15.22:0/3496034419 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879174499 0 0) 0x7fdf9415a160 con 0x7fdf9415db10 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf937fe700 1 --2- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159890 0x7fdf9415abd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdf840098e0 tx=0x7fdf840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7838501691446d90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf927fc700 1 -- 172.21.15.22:0/3496034419 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400b640 con 0x7fdf94159890 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf927fc700 1 -- 172.21.15.22:0/3496034419 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400b7a0 con 0x7fdf94159890 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf927fc700 1 -- 172.21.15.22:0/3496034419 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400bb40 con 0x7fdf94159890 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 -- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159890 msgr2=0x7fdf9415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 --2- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159890 0x7fdf9415abd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdf840098e0 tx=0x7fdf840091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 -- 172.21.15.22:0/3496034419 shutdown_connections 2023-10-08T00:31:02.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 --2- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159890 0x7fdf9415abd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 --2- 172.21.15.22:0/3496034419 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf94159c60 0x7fdf9415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 -- 172.21.15.22:0/3496034419 >> 172.21.15.22:0/3496034419 conn(0x7fdf94068e20 msgr2=0x7fdf940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:02.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 -- 172.21.15.22:0/3496034419 shutdown_connections 2023-10-08T00:31:02.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.706+0000 7fdf99a99700 1 -- 172.21.15.22:0/3496034419 wait complete. 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.708+0000 7fdf99a99700 1 Processor -- start 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.708+0000 7fdf99a99700 1 -- start start 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.708+0000 7fdf99a99700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 0x7fdf9415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.708+0000 7fdf99a99700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159c60 0x7fdf940ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf99a99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf9415db10 0x7fdf9414d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf99a99700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415c850 con 0x7fdf94159890 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf99a99700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415bc40 con 0x7fdf94159c60 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf99a99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9415bf20 con 0x7fdf9415db10 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 0x7fdf9415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 0x7fdf9415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34130/0 (socket says 172.21.15.22:34130) 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 -- 172.21.15.22:0/2661464456 learned_addr learned my addr 172.21.15.22:0/2661464456 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:02.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf92ffd700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159c60 0x7fdf940ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf93fff700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf9415db10 0x7fdf9414d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 -- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf9415db10 msgr2=0x7fdf9414d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf9415db10 0x7fdf9414d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 -- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159c60 msgr2=0x7fdf940ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159c60 0x7fdf940ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 -- 172.21.15.22:0/2661464456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009420 con 0x7fdf94159890 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf93fff700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf9415db10 0x7fdf9414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf937fe700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 0x7fdf9415cce0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fdf940899c0 tx=0x7fdf84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84000d10 con 0x7fdf94159890 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400bb20 con 0x7fdf94159890 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9415c200 con 0x7fdf94159890 2023-10-08T00:31:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84011670 con 0x7fdf94159890 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.709+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf940ce550 con 0x7fdf94159890 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.710+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9404c3c0 con 0x7fdf94159890 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.711+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdf84011a20 con 0x7fdf94159890 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.711+0000 7fdf7b7fe700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf80067290 0x7fdf80069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.711+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf84086050 con 0x7fdf94159890 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.711+0000 7fdf92ffd700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf80067290 0x7fdf80069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.712+0000 7fdf92ffd700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf80067290 0x7fdf80069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdf94158d70 tx=0x7fdf880091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:02.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.715+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf84052eb0 con 0x7fdf94159890 2023-10-08T00:31:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.961+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf9415cb30 con 0x7fdf94159890 2023-10-08T00:31:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.962+0000 7fdf7b7fe700 1 -- 172.21.15.22:0/2661464456 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fdf840564d0 con 0x7fdf94159890 2023-10-08T00:31:02.962 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:02.962 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:45.103135+0000","modified":"2023-10-08T00:30:48.725392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"d","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/3601516791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3601516791},{"type":"v1","addr":"172.21.15.192:6836","nonce":3601516791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf80067290 msgr2=0x7fdf80069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf80067290 0x7fdf80069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdf94158d70 tx=0x7fdf880091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 msgr2=0x7fdf9415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 0x7fdf9415cce0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fdf940899c0 tx=0x7fdf84017000 comp rx=0 tx=0).stop 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 shutdown_connections 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf80067290 0x7fdf80069740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf9415db10 0x7fdf9414d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf94159890 0x7fdf9415cce0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 --2- 172.21.15.22:0/2661464456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf94159c60 0x7fdf940ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:02.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 >> 172.21.15.22:0/2661464456 conn(0x7fdf94068e20 msgr2=0x7fdf940b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:02.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 shutdown_connections 2023-10-08T00:31:02.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:02.964+0000 7fdf99a99700 1 -- 172.21.15.22:0/2661464456 wait complete. 2023-10-08T00:31:02.967 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 61 2023-10-08T00:31:02.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:03.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.095+0000 7ff28c95e700 1 Processor -- start 2023-10-08T00:31:03.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.095+0000 7ff28c95e700 1 -- start start 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28c95e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288157750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28c95e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2880ae840 0x7ff2880aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28c95e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880af1a0 con 0x7ff288157380 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28c95e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28806ea60 con 0x7ff2880ae840 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28c95e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28806ed40 con 0x7ff2880c6b30 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2880ae840 0x7ff2880aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff286d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff288157380 0x7ff28815bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48310/0 (socket says 172.21.15.22:48310) 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff286d9d700 1 -- 172.21.15.22:0/4055046210 learned_addr learned my addr 172.21.15.22:0/4055046210 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28659c700 1 --2- 172.21.15.22:0/4055046210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28759e700 1 -- 172.21.15.22:0/4055046210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 msgr2=0x7ff288157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:03.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28759e700 1 --2- 172.21.15.22:0/4055046210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28759e700 1 -- 172.21.15.22:0/4055046210 >> v1:172.21.15.22:6789/0 conn(0x7ff288157380 legacy=0x7ff28815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28759e700 1 -- 172.21.15.22:0/4055046210 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880afe60 con 0x7ff2880ae840 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.096+0000 7ff28759e700 1 --2- 172.21.15.22:0/4055046210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff2880aec60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2780098e0 tx=0x7ff2780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b886153873a0d64c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff285d9b700 1 -- 172.21.15.22:0/4055046210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278009e80 con 0x7ff2880ae840 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff285d9b700 1 -- 172.21.15.22:0/4055046210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800b860 con 0x7ff2880ae840 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff285d9b700 1 -- 172.21.15.22:0/4055046210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800bbe0 con 0x7ff2880ae840 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 -- 172.21.15.22:0/4055046210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 msgr2=0x7ff2880aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 --2- 172.21.15.22:0/4055046210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff2880aec60 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff2780098e0 tx=0x7ff2780091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 -- 172.21.15.22:0/4055046210 shutdown_connections 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 --2- 172.21.15.22:0/4055046210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff2880aec60 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 --2- 172.21.15.22:0/4055046210 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 -- 172.21.15.22:0/4055046210 >> 172.21.15.22:0/4055046210 conn(0x7ff28806ddb0 msgr2=0x7ff28806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:03.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 -- 172.21.15.22:0/4055046210 shutdown_connections 2023-10-08T00:31:03.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.097+0000 7ff28c95e700 1 -- 172.21.15.22:0/4055046210 wait complete. 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.098+0000 7ff28c95e700 1 Processor -- start 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 -- start start 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff288169080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff288157380 0x7ff288154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2881695c0 con 0x7ff2880ae840 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28814e6c0 con 0x7ff288157380 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28c95e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff288069860 con 0x7ff2880c6b30 2023-10-08T00:31:03.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff286d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff288169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff286d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff288169080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34138/0 (socket says 172.21.15.22:34138) 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff286d9d700 1 -- 172.21.15.22:0/1527161158 learned_addr learned my addr 172.21.15.22:0/1527161158 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28659c700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.099+0000 7ff28759e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff288157380 0x7ff288154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff286d9d700 1 -- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 msgr2=0x7ff288068770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff286d9d700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288068770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff286d9d700 1 -- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff288157380 msgr2=0x7ff288154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff286d9d700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff288157380 0x7ff288154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff286d9d700 1 -- 172.21.15.22:0/1527161158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009420 con 0x7ff2880ae840 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff28759e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff288157380 0x7ff288154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff286d9d700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff288169080 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff28000cc70 tx=0x7ff280001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28000a940 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28000aac0 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff288068fc0 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28000ae80 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.100+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff288069580 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.101+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28804c3c0 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.101+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ff280007300 con 0x7ff2880ae840 2023-10-08T00:31:03.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.102+0000 7ff27effd700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff268067290 0x7ff268069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.102+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff280084ef0 con 0x7ff2880ae840 2023-10-08T00:31:03.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.102+0000 7ff28659c700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff268067290 0x7ff268069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.103+0000 7ff28659c700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff268067290 0x7ff268069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff2880ae810 tx=0x7ff270008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.106+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff280051c90 con 0x7ff2880ae840 2023-10-08T00:31:03.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.341+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff28814e4f0 con 0x7ff2880ae840 2023-10-08T00:31:03.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.341+0000 7ff27effd700 1 -- 172.21.15.22:0/1527161158 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff2800552b0 con 0x7ff2880ae840 2023-10-08T00:31:03.342 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:03.342 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":61,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:30:45.103135+0000","modified":"2023-10-08T00:30:48.725392+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"d","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/3601516791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3601516791},{"type":"v1","addr":"172.21.15.192:6836","nonce":3601516791}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff268067290 msgr2=0x7ff268069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff268067290 0x7ff268069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff2880ae810 tx=0x7ff270008040 comp rx=0 tx=0).stop 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 msgr2=0x7ff288169080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff288169080 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff28000cc70 tx=0x7ff280001a30 comp rx=0 tx=0).stop 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 shutdown_connections 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff288157380 0x7ff288154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2880ae840 0x7ff288169080 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff268067290 0x7ff268069740 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 --2- 172.21.15.22:0/1527161158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2880c6b30 0x7ff288068770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 >> 172.21.15.22:0/1527161158 conn(0x7ff28806ddb0 msgr2=0x7ff28806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:03.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 shutdown_connections 2023-10-08T00:31:03.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.343+0000 7ff28c95e700 1 -- 172.21.15.22:0/1527161158 wait complete. 2023-10-08T00:31:03.345 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 61 2023-10-08T00:31:03.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.476+0000 7ff1e7b64700 1 Processor -- start 2023-10-08T00:31:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.476+0000 7ff1e7b64700 1 -- start start 2023-10-08T00:31:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e7b64700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff1e0159c60 0x7ff1e015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e7b64700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e015a160 con 0x7ff1e0159890 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e7b64700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e00d13a0 con 0x7ff1e015db10 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e7b64700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e015df50 con 0x7ff1e0159c60 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e5900700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff1e0159890 0x7ff1e015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48318/0 (socket says 172.21.15.22:48318) 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e5900700 1 -- 172.21.15.22:0/3914314434 learned_addr learned my addr 172.21.15.22:0/3914314434 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.477+0000 7ff1e50ff700 1 --2- 172.21.15.22:0/3914314434 >> v2:172.21.15.192:3300/0 conn(0x7ff1e0159c60 0x7ff1e015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e48fe700 1 -- 172.21.15.22:0/3914314434 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748981593 0 0) 0x7ff1e015a160 con 0x7ff1e0159890 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e48fe700 1 -- 172.21.15.22:0/3914314434 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1c8003570 con 0x7ff1e0159890 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e50ff700 1 -- 172.21.15.22:0/3914314434 >> v1:172.21.15.192:6789/0 conn(0x7ff1e015db10 legacy=0x7ff1e0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e50ff700 1 -- 172.21.15.22:0/3914314434 >> v1:172.21.15.22:6789/0 conn(0x7ff1e0159890 legacy=0x7ff1e015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e50ff700 1 -- 172.21.15.22:0/3914314434 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e015e140 con 0x7ff1e0159c60 2023-10-08T00:31:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e50ff700 1 --2- 172.21.15.22:0/3914314434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e0159c60 0x7ff1e015d5d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40098e0 tx=0x7ff1d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ddcfaa736248b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e48fe700 1 -- 172.21.15.22:0/3914314434 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400b640 con 0x7ff1e0159c60 2023-10-08T00:31:03.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e48fe700 1 -- 172.21.15.22:0/3914314434 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d400b7a0 con 0x7ff1e0159c60 2023-10-08T00:31:03.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.478+0000 7ff1e48fe700 1 -- 172.21.15.22:0/3914314434 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400bb40 con 0x7ff1e0159c60 2023-10-08T00:31:03.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 -- 172.21.15.22:0/3914314434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e0159c60 msgr2=0x7ff1e015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/3914314434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e0159c60 0x7ff1e015d5d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40098e0 tx=0x7ff1d40091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 -- 172.21.15.22:0/3914314434 shutdown_connections 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/3914314434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e0159c60 0x7ff1e015d5d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 -- 172.21.15.22:0/3914314434 >> 172.21.15.22:0/3914314434 conn(0x7ff1e0068e20 msgr2=0x7ff1e00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 -- 172.21.15.22:0/3914314434 shutdown_connections 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.479+0000 7ff1e7b64700 1 -- 172.21.15.22:0/3914314434 wait complete. 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 Processor -- start 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 -- start start 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 0x7ff1e0145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1e0159c60 0x7ff1e0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e015db10 0x7ff1e015f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e0152620 con 0x7ff1e0159890 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e016d080 con 0x7ff1e015db10 2023-10-08T00:31:03.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.480+0000 7ff1e7b64700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e00b23a0 con 0x7ff1e0159c60 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 0x7ff1e0145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 0x7ff1e0145110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34150/0 (socket says 172.21.15.22:34150) 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 -- 172.21.15.22:0/2164610393 learned_addr learned my addr 172.21.15.22:0/2164610393 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e50ff700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1e0159c60 0x7ff1e0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e6101700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e015db10 0x7ff1e015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 -- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1e0159c60 msgr2=0x7ff1e0154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1e0159c60 0x7ff1e0154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 -- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e015db10 msgr2=0x7ff1e015f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e015db10 0x7ff1e015f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 -- 172.21.15.22:0/2164610393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4009420 con 0x7ff1e0159890 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e5900700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 0x7ff1e0145110 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800c7c0 tx=0x7ff1d8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8005b30 con 0x7ff1e0159890 2023-10-08T00:31:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8005c90 con 0x7ff1e0159890 2023-10-08T00:31:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e016d380 con 0x7ff1e0159890 2023-10-08T00:31:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.481+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8007340 con 0x7ff1e0159890 2023-10-08T00:31:03.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.482+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e0145650 con 0x7ff1e0159890 2023-10-08T00:31:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.482+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e004c3c0 con 0x7ff1e0159890 2023-10-08T00:31:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.483+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ff1d801b400 con 0x7ff1e0159890 2023-10-08T00:31:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.483+0000 7ff1ddffb700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff1cc067290 0x7ff1cc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.483+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1d8084690 con 0x7ff1e0159890 2023-10-08T00:31:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.484+0000 7ff1e50ff700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff1cc067290 0x7ff1cc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.484+0000 7ff1e50ff700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff1cc067290 0x7ff1cc069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40093f0 tx=0x7ff1d4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.487+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d8051430 con 0x7ff1e0159890 2023-10-08T00:31:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.685+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e006a5b0 con 0x7ff1e0159890 2023-10-08T00:31:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.686+0000 7ff1ddffb700 1 -- 172.21.15.22:0/2164610393 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+15353 (secure 0 0 0) 0x7ff1d8054a50 con 0x7ff1e0159890 2023-10-08T00:31:03.686 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:03.687 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":90,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:30:46.691667+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:30:43.509676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T00:30:44.068405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff1cc067290 msgr2=0x7ff1cc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff1cc067290 0x7ff1cc069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40093f0 tx=0x7ff1d4017000 comp rx=0 tx=0).stop 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 msgr2=0x7ff1e0145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 0x7ff1e0145110 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800c7c0 tx=0x7ff1d8007e00 comp rx=0 tx=0).stop 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 shutdown_connections 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1e015db10 0x7ff1e015f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1e0159890 0x7ff1e0145110 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff1cc067290 0x7ff1cc069740 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 --2- 172.21.15.22:0/2164610393 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff1e0159c60 0x7ff1e0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 >> 172.21.15.22:0/2164610393 conn(0x7ff1e0068e20 msgr2=0x7ff1e01553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:03.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 shutdown_connections 2023-10-08T00:31:03.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.688+0000 7ff1e7b64700 1 -- 172.21.15.22:0/2164610393 wait complete. 2023-10-08T00:31:03.701 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:31:03.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.821+0000 7f75609c1700 1 Processor -- start 2023-10-08T00:31:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.821+0000 7f75609c1700 1 -- start start 2023-10-08T00:31:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f75609c1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f755c06bcd0 0x7f755c140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f75609c1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c15c2a0 con 0x7f755c06c0a0 2023-10-08T00:31:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f75609c1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c15b690 con 0x7f755c0c9510 2023-10-08T00:31:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f75609c1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0c9900 con 0x7f755c06bcd0 2023-10-08T00:31:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f7559d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f755c06c0a0 0x7f755c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48334/0 (socket says 172.21.15.22:48334) 2023-10-08T00:31:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f7559d9b700 1 -- 172.21.15.22:0/647732969 learned_addr learned my addr 172.21.15.22:0/647732969 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f755a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f755c06bcd0 0x7f755c140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f755a59c700 1 -- 172.21.15.22:0/647732969 >> v1:172.21.15.192:6789/0 conn(0x7f755c0c9510 legacy=0x7f755c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f755a59c700 1 -- 172.21.15.22:0/647732969 >> v1:172.21.15.22:6789/0 conn(0x7f755c06c0a0 legacy=0x7f755c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f755a59c700 1 -- 172.21.15.22:0/647732969 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c15b970 con 0x7f755c06bcd0 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.822+0000 7f755959a700 1 -- 172.21.15.22:0/647732969 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774404959 0 0) 0x7f755c15c2a0 con 0x7f755c06c0a0 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f755a59c700 1 --2- 172.21.15.22:0/647732969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c140df0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f754c0098e0 tx=0x7f754c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27969bdb034aca36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f755959a700 1 -- 172.21.15.22:0/647732969 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c009e80 con 0x7f755c06bcd0 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f755959a700 1 -- 172.21.15.22:0/647732969 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00b860 con 0x7f755c06bcd0 2023-10-08T00:31:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f755959a700 1 -- 172.21.15.22:0/647732969 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00bbe0 con 0x7f755c06bcd0 2023-10-08T00:31:03.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 -- 172.21.15.22:0/647732969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 msgr2=0x7f755c140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 --2- 172.21.15.22:0/647732969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c140df0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f754c0098e0 tx=0x7f754c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 -- 172.21.15.22:0/647732969 shutdown_connections 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 --2- 172.21.15.22:0/647732969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c140df0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 -- 172.21.15.22:0/647732969 >> 172.21.15.22:0/647732969 conn(0x7f755c0ce600 msgr2=0x7f755c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 -- 172.21.15.22:0/647732969 shutdown_connections 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.823+0000 7f75609c1700 1 -- 172.21.15.22:0/647732969 wait complete. 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.824+0000 7f75609c1700 1 Processor -- start 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.824+0000 7f75609c1700 1 -- start start 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f75609c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c06a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f75609c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f755c06c0a0 0x7f755c13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f75609c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f755c0c9510 0x7f755c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f75609c1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c069640 con 0x7f755c06bcd0 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f75609c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c069920 con 0x7f755c0c9510 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f75609c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c069c00 con 0x7f755c06c0a0 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f755a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c06a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f755a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c06a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34168/0 (socket says 172.21.15.22:34168) 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f755a59c700 1 -- 172.21.15.22:0/341698926 learned_addr learned my addr 172.21.15.22:0/341698926 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f7559d9b700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f755c06c0a0 0x7f755c13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.825+0000 7f755ad9d700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f755c0c9510 0x7f755c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f755a59c700 1 -- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f755c06c0a0 msgr2=0x7f755c13cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f755a59c700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f755c06c0a0 0x7f755c13cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f755a59c700 1 -- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f755c0c9510 msgr2=0x7f755c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f755a59c700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f755c0c9510 0x7f755c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:03.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f755a59c700 1 -- 172.21.15.22:0/341698926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009420 con 0x7f755c06bcd0 2023-10-08T00:31:03.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f755a59c700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c06a7c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f755c069220 tx=0x7f754c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00bbe0 con 0x7f755c06bcd0 2023-10-08T00:31:03.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c011420 con 0x7f755c06bcd0 2023-10-08T00:31:03.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c069ee0 con 0x7f755c06bcd0 2023-10-08T00:31:03.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0117c0 con 0x7f755c06bcd0 2023-10-08T00:31:03.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.826+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c06ad00 con 0x7f755c06bcd0 2023-10-08T00:31:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.827+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c06a380 con 0x7f755c06bcd0 2023-10-08T00:31:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.827+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f754c011b30 con 0x7f755c06bcd0 2023-10-08T00:31:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.828+0000 7f754a7fc700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f753c067290 0x7f753c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.828+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f754c0865c0 con 0x7f755c06bcd0 2023-10-08T00:31:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.828+0000 7f7559d9b700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f753c067290 0x7f753c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.828+0000 7f7559d9b700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f753c067290 0x7f753c069740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f755c0c8ed0 tx=0x7f7550007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:03.832+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f754c053460 con 0x7f755c06bcd0 2023-10-08T00:31:04.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.071+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f755c04c3c0 con 0x7f755c06bcd0 2023-10-08T00:31:04.072 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:31:04.071+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:31:04.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.075+0000 7f754a7fc700 1 -- 172.21.15.22:0/341698926 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7f754c056a80 con 0x7f755c06bcd0 2023-10-08T00:31:04.077 INFO:tasks.ceph.mds.d.smithi192.stderr: -874> 2023-10-08T00:30:51.020+0000 7f054622d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:31:04.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f753c067290 msgr2=0x7f753c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f753c067290 0x7f753c069740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f755c0c8ed0 tx=0x7f7550007d10 comp rx=0 tx=0).stop 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 msgr2=0x7f755c06a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c06a7c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f755c069220 tx=0x7f754c017000 comp rx=0 tx=0).stop 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 shutdown_connections 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f755c0c9510 0x7f755c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f755c06bcd0 0x7f755c06a7c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f753c067290 0x7f753c069740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 --2- 172.21.15.22:0/341698926 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f755c06c0a0 0x7f755c13cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 >> 172.21.15.22:0/341698926 conn(0x7f755c0ce600 msgr2=0x7f755c1566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 shutdown_connections 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.077+0000 7f75609c1700 1 -- 172.21.15.22:0/341698926 wait complete. 2023-10-08T00:31:04.079 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:31:04.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:31:04.099 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:31:04.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.211+0000 7fecbde87700 1 Processor -- start 2023-10-08T00:31:04.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.211+0000 7fecbde87700 1 -- start start 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.212+0000 7fecbde87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 0x7fecb80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.212+0000 7fecbde87700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb815d7e0 con 0x7fecb806bcd0 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.212+0000 7fecbde87700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb815dac0 con 0x7fecb806c0a0 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.212+0000 7fecbde87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80caf30 con 0x7fecb80caa90 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.212+0000 7fecb77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fecb806bcd0 0x7fecb815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:48344/0 (socket says 172.21.15.22:48344) 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.212+0000 7fecb77fe700 1 -- 172.21.15.22:0/3912855781 learned_addr learned my addr 172.21.15.22:0/3912855781 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 0x7fecb80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914457326 0 0) 0x7fecb815d7e0 con 0x7fecb806bcd0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca0003570 con 0x7fecb806bcd0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631466576 0 0) 0x7fecb815dac0 con 0x7fecb806c0a0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb815d7e0 con 0x7fecb806c0a0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389168872 0 0) 0x7feca0003570 con 0x7fecb806bcd0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 msgr2=0x7fecb80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 0x7fecb80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 >> v1:172.21.15.192:6789/0 conn(0x7fecb806c0a0 legacy=0x7fecb815df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb815aa30 con 0x7fecb806bcd0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7feca8001470 con 0x7fecb806bcd0 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 >> v1:172.21.15.22:6789/0 conn(0x7fecb806bcd0 legacy=0x7fecb815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0003c20 0x7feca0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 0x7feca0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feca0004d50 0x7feca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80caf30 con 0x7feca0004d50 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca000bbf0 con 0x7feca0003c20 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca000bdb0 con 0x7fecb80caa90 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feca0004d50 0x7feca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb77fe700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0003c20 0x7feca0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb6ffd700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 0x7feca0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 -- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 msgr2=0x7feca0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80caa90 0x7feca0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 -- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0003c20 msgr2=0x7feca0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0003c20 0x7feca0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.213+0000 7fecb7fff700 1 -- 172.21.15.22:0/3912855781 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0003570 con 0x7feca0004d50 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecb7fff700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feca0004d50 0x7feca00051c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e210 tx=0x7fecb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174ce3ce94ccdebe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000eac0 con 0x7feca0004d50 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000f040 con 0x7feca0004d50 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecb67fc700 1 -- 172.21.15.22:0/3912855781 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000ee70 con 0x7feca0004d50 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecbde87700 1 -- 172.21.15.22:0/3912855781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feca0004d50 msgr2=0x7feca00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecbde87700 1 --2- 172.21.15.22:0/3912855781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feca0004d50 0x7feca00051c0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e210 tx=0x7fecb000b040 comp rx=0 tx=0).stop 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecb7fff700 1 -- 172.21.15.22:0/3912855781 reap_dead start 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecbde87700 1 -- 172.21.15.22:0/3912855781 shutdown_connections 2023-10-08T00:31:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecbde87700 1 -- 172.21.15.22:0/3912855781 >> 172.21.15.22:0/3912855781 conn(0x7fecb80ce600 msgr2=0x7fecb80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:04.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecbde87700 1 -- 172.21.15.22:0/3912855781 shutdown_connections 2023-10-08T00:31:04.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.214+0000 7fecbde87700 1 -- 172.21.15.22:0/3912855781 wait complete. 2023-10-08T00:31:04.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 Processor -- start 2023-10-08T00:31:04.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 -- start start 2023-10-08T00:31:04.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0004d50 0x7fecb816a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 0x7fecb81591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80b25e0 0x7fecb80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb816a920 con 0x7fecb8159c20 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b1540 con 0x7feca0004d50 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecbde87700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b1820 con 0x7fecb80b25e0 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 0x7fecb81591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecb6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 0x7fecb81591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34182/0 (socket says 172.21.15.22:34182) 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.216+0000 7fecb6ffd700 1 -- 172.21.15.22:0/1655975192 learned_addr learned my addr 172.21.15.22:0/1655975192 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb77fe700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0004d50 0x7fecb816a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb7fff700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80b25e0 0x7fecb80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb6ffd700 1 -- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80b25e0 msgr2=0x7fecb80b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb6ffd700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80b25e0 0x7fecb80b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb6ffd700 1 -- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0004d50 msgr2=0x7fecb816a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb6ffd700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0004d50 0x7fecb816a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb6ffd700 1 -- 172.21.15.22:0/1655975192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80b1b00 con 0x7fecb8159c20 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecb6ffd700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 0x7fecb81591c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fecac007a80 tx=0x7fecac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00d670 con 0x7fecb8159c20 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac00d7f0 con 0x7fecb8159c20 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80b1de0 con 0x7fecb8159c20 2023-10-08T00:31:04.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00dbb0 con 0x7fecb8159c20 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.217+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb8159700 con 0x7fecb8159c20 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.218+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb804c3c0 con 0x7fecb8159c20 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.218+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fecac01c400 con 0x7fecb8159c20 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.219+0000 7fec9f7fe700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feca40672c0 0x7feca4069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.219+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fecac084e70 con 0x7fecb8159c20 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.219+0000 7fecb77fe700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feca40672c0 0x7feca4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:04.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.220+0000 7fecb77fe700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feca40672c0 0x7feca4069770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feca8001200 tx=0x7feca8001e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:04.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.223+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecac051df0 con 0x7fecb8159c20 2023-10-08T00:31:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:04.462+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fecb815ad10 con 0x7fecb8159c20 2023-10-08T00:31:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.079+0000 7fec9f7fe700 1 -- 172.21.15.22:0/1655975192 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fecac055410 con 0x7fecb8159c20 2023-10-08T00:31:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feca40672c0 msgr2=0x7feca4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feca40672c0 0x7feca4069770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feca8001200 tx=0x7feca8001e10 comp rx=0 tx=0).stop 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 msgr2=0x7fecb81591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 0x7fecb81591c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fecac007a80 tx=0x7fecac007d30 comp rx=0 tx=0).stop 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 shutdown_connections 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feca40672c0 0x7feca4069770 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fecb80b25e0 0x7fecb80b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feca0004d50 0x7fecb816a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 --2- 172.21.15.22:0/1655975192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecb8159c20 0x7fecb81591c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 >> 172.21.15.22:0/1655975192 conn(0x7fecb80ce600 msgr2=0x7fecb8155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 shutdown_connections 2023-10-08T00:31:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.082+0000 7fecbde87700 1 -- 172.21.15.22:0/1655975192 wait complete. 2023-10-08T00:31:05.097 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:31:05.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.224+0000 7f651bc7c700 1 Processor -- start 2023-10-08T00:31:05.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.225+0000 7f651bc7c700 1 -- start start 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.225+0000 7f651bc7c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6514153f50 0x7f65140b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.225+0000 7f651bc7c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f651406d840 0x7f6514069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.225+0000 7f651bc7c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140b4570 con 0x7f6514154320 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.225+0000 7f651bc7c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651415a730 con 0x7f651406d840 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.225+0000 7f651bc7c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651415aa10 con 0x7f6514153f50 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f651406d840 0x7f6514069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f651406d840 0x7f6514069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34188/0 (socket says 172.21.15.22:34188) 2023-10-08T00:31:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 -- 172.21.15.22:0/3329348842 learned_addr learned my addr 172.21.15.22:0/3329348842 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f6519a18700 1 --2- 172.21.15.22:0/3329348842 >> v2:172.21.15.192:3300/0 conn(0x7f6514153f50 0x7f65140b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 -- 172.21.15.22:0/3329348842 >> v2:172.21.15.192:3300/0 conn(0x7f6514153f50 msgr2=0x7f65140b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 --2- 172.21.15.22:0/3329348842 >> v2:172.21.15.192:3300/0 conn(0x7f6514153f50 0x7f65140b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 -- 172.21.15.22:0/3329348842 >> v1:172.21.15.192:6789/0 conn(0x7f6514154320 legacy=0x7f651406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 -- 172.21.15.22:0/3329348842 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651415acf0 con 0x7f651406d840 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f651a219700 1 --2- 172.21.15.22:0/3329348842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f651406d840 0x7f6514069e30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6504009f20 tx=0x7f6504009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfeacf2ee1e866c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f6518a16700 1 -- 172.21.15.22:0/3329348842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650400e070 con 0x7f651406d840 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f6518a16700 1 -- 172.21.15.22:0/3329348842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650400ba40 con 0x7f651406d840 2023-10-08T00:31:05.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.226+0000 7f6518a16700 1 -- 172.21.15.22:0/3329348842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040092e0 con 0x7f651406d840 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 -- 172.21.15.22:0/3329348842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f651406d840 msgr2=0x7f6514069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 --2- 172.21.15.22:0/3329348842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f651406d840 0x7f6514069e30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6504009f20 tx=0x7f6504009840 comp rx=0 tx=0).stop 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 -- 172.21.15.22:0/3329348842 shutdown_connections 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 --2- 172.21.15.22:0/3329348842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f651406d840 0x7f6514069e30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 --2- 172.21.15.22:0/3329348842 >> v2:172.21.15.192:3300/0 conn(0x7f6514153f50 0x7f65140b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 -- 172.21.15.22:0/3329348842 >> 172.21.15.22:0/3329348842 conn(0x7f651406baf0 msgr2=0x7f651406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 -- 172.21.15.22:0/3329348842 shutdown_connections 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.227+0000 7f651bc7c700 1 -- 172.21.15.22:0/3329348842 wait complete. 2023-10-08T00:31:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.228+0000 7f651bc7c700 1 Processor -- start 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.228+0000 7f651bc7c700 1 -- start start 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651bc7c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f651406d840 0x7f651416e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651bc7c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 0x7f65140aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651bc7c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514154320 0x7f6514159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651bc7c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651416e5a0 con 0x7f6514153f50 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651bc7c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140b0350 con 0x7f6514154320 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651bc7c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65140b07e0 con 0x7f651406d840 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 0x7f65140aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 0x7f65140aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34200/0 (socket says 172.21.15.22:34200) 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 -- 172.21.15.22:0/793249579 learned_addr learned my addr 172.21.15.22:0/793249579 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519a18700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f651406d840 0x7f651416e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:05.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f651a219700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514154320 0x7f6514159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 -- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f651406d840 msgr2=0x7f651416e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f651406d840 0x7f651416e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 -- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514154320 msgr2=0x7f6514159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514154320 0x7f6514159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 -- 172.21.15.22:0/793249579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504009ae0 con 0x7f6514153f50 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.229+0000 7f6519217700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 0x7f65140aeef0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f650800c4e0 tx=0x7f650800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.230+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508011590 con 0x7f6514153f50 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.230+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6508011710 con 0x7f6514153f50 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.230+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508011ad0 con 0x7f6514153f50 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.230+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65140af740 con 0x7f6514153f50 2023-10-08T00:31:05.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.230+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65140afd80 con 0x7f6514153f50 2023-10-08T00:31:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.231+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65140b04c0 con 0x7f6514153f50 2023-10-08T00:31:05.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.231+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f650801b3b0 con 0x7f6514153f50 2023-10-08T00:31:05.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.231+0000 7f6511ffb700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6500067290 0x7f6500069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:05.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.231+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6508083e80 con 0x7f6514153f50 2023-10-08T00:31:05.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.232+0000 7f6519a18700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6500067290 0x7f6500069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:05.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.232+0000 7f6519a18700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6500067290 0x7f6500069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fd0 tx=0x7f650c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:05.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.236+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6508050c90 con 0x7f6514153f50 2023-10-08T00:31:05.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:05.431+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65140718b0 con 0x7f6514153f50 2023-10-08T00:31:06.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.081+0000 7f6511ffb700 1 -- 172.21.15.22:0/793249579 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6508017070 con 0x7f6514153f50 2023-10-08T00:31:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6500067290 msgr2=0x7f6500069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6500067290 0x7f6500069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fd0 tx=0x7f650c008040 comp rx=0 tx=0).stop 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 msgr2=0x7f65140aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 0x7f65140aeef0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f650800c4e0 tx=0x7f650800c7f0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 shutdown_connections 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514154320 0x7f6514159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6500067290 0x7f6500069740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f651406d840 0x7f651416e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 --2- 172.21.15.22:0/793249579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6514153f50 0x7f65140aeef0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 >> 172.21.15.22:0/793249579 conn(0x7f651406baf0 msgr2=0x7f6514153410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 shutdown_connections 2023-10-08T00:31:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.085+0000 7f651bc7c700 1 -- 172.21.15.22:0/793249579 wait complete. 2023-10-08T00:31:06.088 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:31:06.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:31:06.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.226+0000 7f02fe366700 1 Processor -- start 2023-10-08T00:31:06.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.226+0000 7f02fe366700 1 -- start start 2023-10-08T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02fe366700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02f80cd910 0x7f02f80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02fe366700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f02f80b55a0 0x7f02f80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02fe366700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f80b5b00 con 0x7f02f8159ec0 2023-10-08T00:31:06.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02fe366700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80b5da0 con 0x7f02f80cd910 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02fe366700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f80b6080 con 0x7f02f80b55a0 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02f77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02f80cd910 0x7f02f80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02f77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02f80cd910 0x7f02f80ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34214/0 (socket says 172.21.15.22:34214) 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02f77fe700 1 -- 172.21.15.22:0/1426790303 learned_addr learned my addr 172.21.15.22:0/1426790303 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.227+0000 7f02fc903700 1 --2- 172.21.15.22:0/1426790303 >> v2:172.21.15.192:3300/0 conn(0x7f02f80b55a0 0x7f02f80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f77fe700 1 -- 172.21.15.22:0/1426790303 >> v2:172.21.15.192:3300/0 conn(0x7f02f80b55a0 msgr2=0x7f02f80ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f77fe700 1 --2- 172.21.15.22:0/1426790303 >> v2:172.21.15.192:3300/0 conn(0x7f02f80b55a0 0x7f02f80ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f77fe700 1 -- 172.21.15.22:0/1426790303 >> v1:172.21.15.192:6789/0 conn(0x7f02f8159ec0 legacy=0x7f02f80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f77fe700 1 -- 172.21.15.22:0/1426790303 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80cc100 con 0x7f02f80cd910 2023-10-08T00:31:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f77fe700 1 --2- 172.21.15.22:0/1426790303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80cd910 0x7f02f80ce340 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0099b0 tx=0x7f02ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0806748b9fbbd49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f6ffd700 1 -- 172.21.15.22:0/1426790303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00b820 con 0x7f02f80cd910 2023-10-08T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f6ffd700 1 -- 172.21.15.22:0/1426790303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00b980 con 0x7f02f80cd910 2023-10-08T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02f6ffd700 1 -- 172.21.15.22:0/1426790303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00bd20 con 0x7f02f80cd910 2023-10-08T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02fe366700 1 -- 172.21.15.22:0/1426790303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80cd910 msgr2=0x7f02f80ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02fe366700 1 --2- 172.21.15.22:0/1426790303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80cd910 0x7f02f80ce340 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0099b0 tx=0x7f02ec009250 comp rx=0 tx=0).stop 2023-10-08T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02fe366700 1 -- 172.21.15.22:0/1426790303 shutdown_connections 2023-10-08T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02fe366700 1 --2- 172.21.15.22:0/1426790303 >> v2:172.21.15.192:3300/0 conn(0x7f02f80b55a0 0x7f02f80ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.228+0000 7f02fe366700 1 --2- 172.21.15.22:0/1426790303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80cd910 0x7f02f80ce340 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.229+0000 7f02fe366700 1 -- 172.21.15.22:0/1426790303 >> 172.21.15.22:0/1426790303 conn(0x7f02f80999f0 msgr2=0x7f02f80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.229+0000 7f02fe366700 1 -- 172.21.15.22:0/1426790303 shutdown_connections 2023-10-08T00:31:06.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.229+0000 7f02fe366700 1 -- 172.21.15.22:0/1426790303 wait complete. 2023-10-08T00:31:06.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 Processor -- start 2023-10-08T00:31:06.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 -- start start 2023-10-08T00:31:06.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 0x7f02f816af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f8159ec0 0x7f02f816cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f80c6a50 0x7f02f80c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f80c7410 con 0x7f02f80b55a0 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.230+0000 7f02fe366700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8153110 con 0x7f02f8159ec0 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02fe366700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8152b00 con 0x7f02f80c6a50 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 0x7f02f816af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 0x7f02f816af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34222/0 (socket says 172.21.15.22:34222) 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 -- 172.21.15.22:0/3919238129 learned_addr learned my addr 172.21.15.22:0/3919238129 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 -- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f80c6a50 msgr2=0x7f02f80c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f80c6a50 0x7f02f80c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 -- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f8159ec0 msgr2=0x7f02f816cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f8159ec0 0x7f02f816cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 -- 172.21.15.22:0/3919238129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0094f0 con 0x7f02f80b55a0 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02f7fff700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 0x7f02f816af00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f02e800c7f0 tx=0x7f02e8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8011590 con 0x7f02f80b55a0 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e8011710 con 0x7f02f80b55a0 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f806a140 con 0x7f02f80b55a0 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8011ad0 con 0x7f02f80b55a0 2023-10-08T00:31:06.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.231+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f816d080 con 0x7f02f80b55a0 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.232+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f8063c90 con 0x7f02f80b55a0 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.233+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f02e801b3b0 con 0x7f02f80b55a0 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.233+0000 7f02dffff700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02e4067290 0x7f02e4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.233+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f02e8083e10 con 0x7f02f80b55a0 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.233+0000 7f02f77fe700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02e4067290 0x7f02e4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.234+0000 7f02f77fe700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02e4067290 0x7f02e4069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0099b0 tx=0x7f02ec017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:06.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.237+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02e8050e80 con 0x7f02f80b55a0 2023-10-08T00:31:06.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:06.429+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02f80718b0 con 0x7f02f80b55a0 2023-10-08T00:31:07.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.088+0000 7f02dffff700 1 -- 172.21.15.22:0/3919238129 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02e8017070 con 0x7f02f80b55a0 2023-10-08T00:31:07.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.091+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02e4067290 msgr2=0x7f02e4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.091+0000 7f02fe366700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02e4067290 0x7f02e4069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0099b0 tx=0x7f02ec017000 comp rx=0 tx=0).stop 2023-10-08T00:31:07.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.091+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 msgr2=0x7f02f816af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.091+0000 7f02fe366700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 0x7f02f816af00 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f02e800c7f0 tx=0x7f02e8007f70 comp rx=0 tx=0).stop 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 shutdown_connections 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02e4067290 0x7f02e4069740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02f80c6a50 0x7f02f80c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02f80b55a0 0x7f02f816af00 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 --2- 172.21.15.22:0/3919238129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02f8159ec0 0x7f02f816cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 >> 172.21.15.22:0/3919238129 conn(0x7f02f80999f0 msgr2=0x7f02f80c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 shutdown_connections 2023-10-08T00:31:07.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.093+0000 7f02fe366700 1 -- 172.21.15.22:0/3919238129 wait complete. 2023-10-08T00:31:07.098 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:31:07.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:31:07.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.236+0000 7fb87aaf7700 1 Processor -- start 2023-10-08T00:31:07.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.236+0000 7fb87aaf7700 1 -- start start 2023-10-08T00:31:07.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.237+0000 7fb87aaf7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 0x7fb87406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.237+0000 7fb87aaf7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8740ac450 con 0x7fb87406a2b0 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.237+0000 7fb87aaf7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb874069d00 con 0x7fb8740637d0 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.237+0000 7fb87aaf7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740693d0 con 0x7fb87406b160 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.237+0000 7fb879094700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb87406a2b0 0x7fb87406a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56602/0 (socket says 172.21.15.22:56602) 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.237+0000 7fb879094700 1 -- 172.21.15.22:0/2946367231 learned_addr learned my addr 172.21.15.22:0/2946367231 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326629216 0 0) 0x7fb8740ac450 con 0x7fb87406a2b0 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb878893700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 0x7fb87406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb85c003570 con 0x7fb87406a2b0 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190763603 0 0) 0x7fb85c003570 con 0x7fb87406a2b0 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 msgr2=0x7fb87406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 0x7fb87406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 >> v1:172.21.15.192:6789/0 conn(0x7fb8740637d0 legacy=0x7fb874068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874068830 con 0x7fb87406a2b0 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fb864001470 con 0x7fb87406a2b0 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 >> v1:172.21.15.22:6789/0 conn(0x7fb87406a2b0 legacy=0x7fb87406a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c003a90 0x7fb85c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c004810 0x7fb85c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 0x7fb85c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740693d0 con 0x7fb85c003a90 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00bc20 con 0x7fb85c004810 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c00bde0 con 0x7fb87406b160 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb878893700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c003a90 0x7fb85c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb873fff700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c004810 0x7fb85c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb879094700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 0x7fb85c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb878893700 1 -- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 msgr2=0x7fb85c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb878893700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb87406b160 0x7fb85c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb878893700 1 -- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c004810 msgr2=0x7fb85c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.238+0000 7fb878893700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c004810 0x7fb85c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb878893700 1 -- 172.21.15.22:0/2946367231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c003570 con 0x7fb85c003a90 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb878893700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c003a90 0x7fb85c003ea0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0094d0 tx=0x7fb86c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a76b3fec4a8148 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00ea30 con 0x7fb85c003a90 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c00f040 con 0x7fb85c003a90 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb8737fe700 1 -- 172.21.15.22:0/2946367231 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c00edc0 con 0x7fb85c003a90 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb87aaf7700 1 -- 172.21.15.22:0/2946367231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c003a90 msgr2=0x7fb85c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/2946367231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb85c003a90 0x7fb85c003ea0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0094d0 tx=0x7fb86c00b040 comp rx=0 tx=0).stop 2023-10-08T00:31:07.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb879094700 1 -- 172.21.15.22:0/2946367231 reap_dead start 2023-10-08T00:31:07.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb87aaf7700 1 -- 172.21.15.22:0/2946367231 shutdown_connections 2023-10-08T00:31:07.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb87aaf7700 1 -- 172.21.15.22:0/2946367231 >> 172.21.15.22:0/2946367231 conn(0x7fb87406ded0 msgr2=0x7fb87406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:07.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb87aaf7700 1 -- 172.21.15.22:0/2946367231 shutdown_connections 2023-10-08T00:31:07.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.239+0000 7fb87aaf7700 1 -- 172.21.15.22:0/2946367231 wait complete. 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.240+0000 7fb87aaf7700 1 Processor -- start 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 -- start start 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c003a90 0x7fb87414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8740b1ec0 0x7fb8740b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 0x7fb874152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740b14c0 con 0x7fb874152970 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87414fdb0 con 0x7fb85c003a90 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.241+0000 7fb87aaf7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb874153800 con 0x7fb8740b1ec0 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 0x7fb874152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 0x7fb874152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38172/0 (socket says 172.21.15.22:38172) 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 -- 172.21.15.22:0/150547355 learned_addr learned my addr 172.21.15.22:0/150547355 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb878893700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c003a90 0x7fb87414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb873fff700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8740b1ec0 0x7fb8740b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 -- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8740b1ec0 msgr2=0x7fb8740b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8740b1ec0 0x7fb8740b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 -- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c003a90 msgr2=0x7fb87414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c003a90 0x7fb87414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 -- 172.21.15.22:0/150547355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874155070 con 0x7fb874152970 2023-10-08T00:31:07.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb879094700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 0x7fb874152dc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb874069570 tx=0x7fb864001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f690 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400f7f0 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400fbb0 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb874153300 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.242+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8740b0c20 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.243+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb874155200 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.244+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb86401e5c0 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.244+0000 7fb870ff9700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb860067290 0x7fb860069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.244+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb864084500 con 0x7fb874152970 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.244+0000 7fb878893700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb860067290 0x7fb860069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.245+0000 7fb878893700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb860067290 0x7fb860069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00afd0 tx=0x7fb86c01a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:07.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.248+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb864051720 con 0x7fb874152970 2023-10-08T00:31:07.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.443+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb87404c3c0 con 0x7fb874152970 2023-10-08T00:31:07.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.446+0000 7fb870ff9700 1 -- 172.21.15.22:0/150547355 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb86401a0a0 con 0x7fb874152970 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb860067290 msgr2=0x7fb860069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb860067290 0x7fb860069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00afd0 tx=0x7fb86c01a000 comp rx=0 tx=0).stop 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 msgr2=0x7fb874152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 0x7fb874152dc0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb874069570 tx=0x7fb864001e50 comp rx=0 tx=0).stop 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 shutdown_connections 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb874152970 0x7fb874152dc0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb85c003a90 0x7fb87414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb860067290 0x7fb860069740 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 --2- 172.21.15.22:0/150547355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8740b1ec0 0x7fb8740b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 >> 172.21.15.22:0/150547355 conn(0x7fb87406ded0 msgr2=0x7fb8740ad1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:07.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 shutdown_connections 2023-10-08T00:31:07.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.448+0000 7fb87aaf7700 1 -- 172.21.15.22:0/150547355 wait complete. 2023-10-08T00:31:07.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-08T00:31:07.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.582+0000 7f3f5d0a4700 1 Processor -- start 2023-10-08T00:31:07.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.582+0000 7f3f5d0a4700 1 -- start start 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5d0a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f580caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5d0a4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3f5815df50 0x7f3f5815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5d0a4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5815d7e0 con 0x7f3f5806bcd0 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5d0a4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5815dac0 con 0x7f3f5815df50 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5d0a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5815aa30 con 0x7f3f5806c0a0 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f56d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3f5806bcd0 0x7f3f5815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56608/0 (socket says 172.21.15.22:56608) 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f56d9d700 1 -- 172.21.15.22:0/3788734588 learned_addr learned my addr 172.21.15.22:0/3788734588 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175150626 0 0) 0x7f3f5815d7e0 con 0x7f3f5806bcd0 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3788734588 >> v2:172.21.15.192:3300/0 conn(0x7f3f5815df50 0x7f3f5815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5659c700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f580caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44003570 con 0x7f3f5806bcd0 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2133157294 0 0) 0x7f3f44003570 con 0x7f3f5806bcd0 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 msgr2=0x7f3f580caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f580caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 >> v2:172.21.15.192:3300/0 conn(0x7f3f5815df50 msgr2=0x7f3f5815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 --2- 172.21.15.22:0/3788734588 >> v2:172.21.15.192:3300/0 conn(0x7f3f5815df50 0x7f3f5815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5815ad10 con 0x7f3f5806bcd0 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f3f50001470 con 0x7f3f5806bcd0 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.583+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3788734588 >> v2:172.21.15.192:3300/0 conn(0x7f3f5815df50 0x7f3f5815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 >> v1:172.21.15.22:6789/0 conn(0x7f3f5806bcd0 legacy=0x7f3f5815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f44003a60 0x7f3f44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5815dac0 con 0x7f3f44003a60 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5815aa30 con 0x7f3f44004810 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4400bb90 con 0x7f3f5806c0a0 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f44003a60 0x7f3f44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f5659c700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 -- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 msgr2=0x7f3f440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 -- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f44004810 msgr2=0x7f3f44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 -- 172.21.15.22:0/3788734588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44003570 con 0x7f3f44003a60 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f5659c700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f5806c0a0 0x7f3f440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f44003a60 0x7f3f44003e70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000c390 tx=0x7f3f50001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6d9cb26ce06e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000cc60 con 0x7f3f44003a60 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000cde0 con 0x7f3f44003a60 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.584+0000 7f3f55d9b700 1 -- 172.21.15.22:0/3788734588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50005b70 con 0x7f3f44003a60 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3788734588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f44003a60 msgr2=0x7f3f44003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3788734588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f44003a60 0x7f3f44003e70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000c390 tx=0x7f3f50001e90 comp rx=0 tx=0).stop 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5759e700 1 -- 172.21.15.22:0/3788734588 reap_dead start 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3788734588 shutdown_connections 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3788734588 >> 172.21.15.22:0/3788734588 conn(0x7f3f580ce600 msgr2=0x7f3f580cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3788734588 shutdown_connections 2023-10-08T00:31:07.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.585+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3788734588 wait complete. 2023-10-08T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.586+0000 7f3f5d0a4700 1 Processor -- start 2023-10-08T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.586+0000 7f3f5d0a4700 1 -- start start 2023-10-08T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5d0a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f44003a60 0x7f3f58149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5d0a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f58069b70 0x7f3f58069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5d0a4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 0x7f3f580c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5d0a4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5806a520 con 0x7f3f580c6fa0 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5d0a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5816a190 con 0x7f3f58069b70 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5d0a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5816a470 con 0x7f3f44003a60 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 0x7f3f580c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 0x7f3f580c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38192/0 (socket says 172.21.15.22:38192) 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 -- 172.21.15.22:0/3887784011 learned_addr learned my addr 172.21.15.22:0/3887784011 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f44003a60 0x7f3f58149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5659c700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f58069b70 0x7f3f58069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 -- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f44003a60 msgr2=0x7f3f58149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f44003a60 0x7f3f58149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 -- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f58069b70 msgr2=0x7f3f58069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f58069b70 0x7f3f58069fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:07.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 -- 172.21.15.22:0/3887784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5816a750 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f5759e700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 0x7f3f580c7410 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3f58157db0 tx=0x7f3f480098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.587+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48007e80 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.588+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48002c80 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.588+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5816aa30 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.588+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48014400 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.588+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5816b250 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.588+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5816af50 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.589+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3f48003040 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.590+0000 7f3f4effd700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f38067290 0x7f3f38069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.590+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3f480840e0 con 0x7f3f580c6fa0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.590+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f38067290 0x7f3f38069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:07.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.591+0000 7f3f56d9d700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f38067290 0x7f3f38069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3f58069b10 tx=0x7f3f50015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:07.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.599+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f5816af50 con 0x7f3f580c6fa0 2023-10-08T00:31:07.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:07.873+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f3f5804c3c0 con 0x7f3f580c6fa0 2023-10-08T00:31:08.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.088+0000 7f3f4effd700 1 -- 172.21.15.22:0/3887784011 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v297) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3f48051240 con 0x7f3f580c6fa0 2023-10-08T00:31:08.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f38067290 msgr2=0x7f3f38069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:08.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f38067290 0x7f3f38069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3f58069b10 tx=0x7f3f50015000 comp rx=0 tx=0).stop 2023-10-08T00:31:08.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 msgr2=0x7f3f580c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:08.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 0x7f3f580c7410 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3f58157db0 tx=0x7f3f480098d0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 shutdown_connections 2023-10-08T00:31:08.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f580c6fa0 0x7f3f580c7410 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f38067290 0x7f3f38069740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f44003a60 0x7f3f58149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 --2- 172.21.15.22:0/3887784011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f58069b70 0x7f3f58069fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 >> 172.21.15.22:0/3887784011 conn(0x7f3f580ce600 msgr2=0x7f3f58154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:08.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 shutdown_connections 2023-10-08T00:31:08.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.090+0000 7f3f5d0a4700 1 -- 172.21.15.22:0/3887784011 wait complete. 2023-10-08T00:31:08.103 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command without subvolume group ... ok 2023-10-08T00:31:08.104 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command without subvolume group 2023-10-08T00:31:08.104 INFO:tasks.cephfs_test_runner:test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:31:08.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-08T00:31:08.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.223+0000 7f71789fa700 1 Processor -- start 2023-10-08T00:31:08.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.223+0000 7f71789fa700 1 -- start start 2023-10-08T00:31:08.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71789fa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f71741597f0 0x7f71740b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:08.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71789fa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f717415d230 0x7f717415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:08.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71789fa700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717415db70 con 0x7f7174159420 2023-10-08T00:31:08.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71789fa700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740b11d0 con 0x7f717415d230 2023-10-08T00:31:08.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71789fa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740b14b0 con 0x7f71741597f0 2023-10-08T00:31:08.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f7173fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f717415d230 0x7f717415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:08.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71737fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7174159420 0x7f71740b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56618/0 (socket says 172.21.15.22:56618) 2023-10-08T00:31:08.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.224+0000 7f71737fe700 1 -- 172.21.15.22:0/2819706813 learned_addr learned my addr 172.21.15.22:0/2819706813 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f7172ffd700 1 --2- 172.21.15.22:0/2819706813 >> v2:172.21.15.192:3300/0 conn(0x7f71741597f0 0x7f71740b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f7173fff700 1 -- 172.21.15.22:0/2819706813 >> v2:172.21.15.192:3300/0 conn(0x7f71741597f0 msgr2=0x7f71740b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f7173fff700 1 --2- 172.21.15.22:0/2819706813 >> v2:172.21.15.192:3300/0 conn(0x7f71741597f0 0x7f71740b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f7173fff700 1 -- 172.21.15.22:0/2819706813 >> v1:172.21.15.22:6789/0 conn(0x7f7174159420 legacy=0x7f71740b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f7173fff700 1 -- 172.21.15.22:0/2819706813 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740b1790 con 0x7f717415d230 2023-10-08T00:31:08.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f7173fff700 1 --2- 172.21.15.22:0/2819706813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717415d230 0x7f717415d630 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7174089750 tx=0x7f716c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c765cc5e3b048a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f71727fc700 1 -- 172.21.15.22:0/2819706813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00e070 con 0x7f717415d230 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f71727fc700 1 -- 172.21.15.22:0/2819706813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00bc30 con 0x7f717415d230 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.225+0000 7f71727fc700 1 -- 172.21.15.22:0/2819706813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c012430 con 0x7f717415d230 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 -- 172.21.15.22:0/2819706813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717415d230 msgr2=0x7f717415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 --2- 172.21.15.22:0/2819706813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717415d230 0x7f717415d630 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7174089750 tx=0x7f716c009780 comp rx=0 tx=0).stop 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 -- 172.21.15.22:0/2819706813 shutdown_connections 2023-10-08T00:31:08.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 --2- 172.21.15.22:0/2819706813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f717415d230 0x7f717415d630 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 --2- 172.21.15.22:0/2819706813 >> v2:172.21.15.192:3300/0 conn(0x7f71741597f0 0x7f71740b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 -- 172.21.15.22:0/2819706813 >> 172.21.15.22:0/2819706813 conn(0x7f71740d0660 msgr2=0x7f71740d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 -- 172.21.15.22:0/2819706813 shutdown_connections 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.226+0000 7f71789fa700 1 -- 172.21.15.22:0/2819706813 wait complete. 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.227+0000 7f71789fa700 1 Processor -- start 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.227+0000 7f71789fa700 1 -- start start 2023-10-08T00:31:08.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 0x7f71741533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71741597f0 0x7f717415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f717415d230 0x7f717415c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71740c67f0 con 0x7f7174159420 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7174154010 con 0x7f717415d230 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71740c6230 con 0x7f71741597f0 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 0x7f71741533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:08.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 0x7f71741533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38214/0 (socket says 172.21.15.22:38214) 2023-10-08T00:31:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 -- 172.21.15.22:0/3528655046 learned_addr learned my addr 172.21.15.22:0/3528655046 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f7173fff700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f717415d230 0x7f717415c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f7172ffd700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71741597f0 0x7f717415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 -- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71741597f0 msgr2=0x7f717415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71741597f0 0x7f717415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 -- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f717415d230 msgr2=0x7f717415c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f717415d230 0x7f717415c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 -- 172.21.15.22:0/3528655046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009a20 con 0x7f7174159420 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f7173fff700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f717415d230 0x7f717415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71737fe700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 0x7f71741533c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f716400c7c0 tx=0x7f7164007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164005b30 con 0x7f7174159420 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164005cb0 con 0x7f7174159420 2023-10-08T00:31:08.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71740c6510 con 0x7f7174159420 2023-10-08T00:31:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164004a80 con 0x7f7174159420 2023-10-08T00:31:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.228+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7174153900 con 0x7f7174159420 2023-10-08T00:31:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.229+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717404c3c0 con 0x7f7174159420 2023-10-08T00:31:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.230+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f71640070f0 con 0x7f7174159420 2023-10-08T00:31:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.230+0000 7f715b7fe700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7160067290 0x7f7160069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:08.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.230+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7164083b90 con 0x7f7174159420 2023-10-08T00:31:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.230+0000 7f7172ffd700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7160067290 0x7f7160069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.231+0000 7f7172ffd700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7160067290 0x7f7160069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f71740b0df0 tx=0x7f7168008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:08.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.235+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7164050d70 con 0x7f7174159420 2023-10-08T00:31:08.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:08.507+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f71740b1a70 con 0x7f7174159420 2023-10-08T00:31:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.092+0000 7f715b7fe700 1 -- 172.21.15.22:0/3528655046 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v298) v1 ==== 159+0+0 (secure 0 0 0) 0x7f7164018070 con 0x7f7174159420 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.094+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7160067290 msgr2=0x7f7160069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.094+0000 7f71789fa700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7160067290 0x7f7160069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f71740b0df0 tx=0x7f7168008040 comp rx=0 tx=0).stop 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.094+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 msgr2=0x7f71741533c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.094+0000 7f71789fa700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 0x7f71741533c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f716400c7c0 tx=0x7f7164007f70 comp rx=0 tx=0).stop 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.094+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 shutdown_connections 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f717415d230 0x7f717415c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7174159420 0x7f71741533c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7160067290 0x7f7160069740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 --2- 172.21.15.22:0/3528655046 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71741597f0 0x7f717415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 >> 172.21.15.22:0/3528655046 conn(0x7f71740d0660 msgr2=0x7f7174158390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:09.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 shutdown_connections 2023-10-08T00:31:09.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.095+0000 7f71789fa700 1 -- 172.21.15.22:0/3528655046 wait complete. 2023-10-08T00:31:09.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:31:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.236+0000 7f4af5260700 1 Processor -- start 2023-10-08T00:31:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.236+0000 7f4af5260700 1 -- start start 2023-10-08T00:31:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4af5260700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af00c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4af5260700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4af006bfa0 0x7f4af00c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4af5260700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00ca920 con 0x7f4af0068390 2023-10-08T00:31:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4af5260700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af006af00 con 0x7f4af006bfa0 2023-10-08T00:31:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4af5260700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af006b1e0 con 0x7f4af0159a70 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4af006bfa0 0x7f4af00c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4af006bfa0 0x7f4af00c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38216/0 (socket says 172.21.15.22:38216) 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 -- 172.21.15.22:0/2478565721 learned_addr learned my addr 172.21.15.22:0/2478565721 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 -- 172.21.15.22:0/2478565721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 msgr2=0x7f4af00c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aeffff700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af00c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af00c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 -- 172.21.15.22:0/2478565721 >> v1:172.21.15.192:6789/0 conn(0x7f4af0068390 legacy=0x7f4af00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aef7fe700 1 -- 172.21.15.22:0/2478565721 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af006b4c0 con 0x7f4af006bfa0 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.237+0000 7f4aeffff700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af00c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4aef7fe700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af00c8830 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009990 tx=0x7f4ae4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82827b4a7f097f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4aeeffd700 1 -- 172.21.15.22:0/2478565721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4005c10 con 0x7f4af006bfa0 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4aeeffd700 1 -- 172.21.15.22:0/2478565721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4005d70 con 0x7f4af006bfa0 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4aeeffd700 1 -- 172.21.15.22:0/2478565721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae400b840 con 0x7f4af006bfa0 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 -- 172.21.15.22:0/2478565721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 msgr2=0x7f4af00c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af00c8830 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009990 tx=0x7f4ae4009220 comp rx=0 tx=0).stop 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 -- 172.21.15.22:0/2478565721 shutdown_connections 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af00c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 --2- 172.21.15.22:0/2478565721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af00c8830 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 -- 172.21.15.22:0/2478565721 >> 172.21.15.22:0/2478565721 conn(0x7f4af00cddc0 msgr2=0x7f4af00c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 -- 172.21.15.22:0/2478565721 shutdown_connections 2023-10-08T00:31:09.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.238+0000 7f4af5260700 1 -- 172.21.15.22:0/2478565721 wait complete. 2023-10-08T00:31:09.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.239+0000 7f4af5260700 1 Processor -- start 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 -- start start 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af0068390 0x7f4af01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af0158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0151d10 con 0x7f4af006bfa0 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0169db0 con 0x7f4af0068390 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4af5260700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af01592c0 con 0x7f4af0159a70 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4aef7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af0158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4aef7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af0158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38232/0 (socket says 172.21.15.22:38232) 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4aef7fe700 1 -- 172.21.15.22:0/3477410240 learned_addr learned my addr 172.21.15.22:0/3477410240 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:09.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.240+0000 7f4aeffff700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af0068390 0x7f4af01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4af4a5f700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4aef7fe700 1 -- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 msgr2=0x7f4af0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4aef7fe700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af0158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4aef7fe700 1 -- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af0068390 msgr2=0x7f4af01517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4aef7fe700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af0068390 0x7f4af01517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4aef7fe700 1 -- 172.21.15.22:0/3477410240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4009480 con 0x7f4af006bfa0 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4aef7fe700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af0158840 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009260 tx=0x7f4ae4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:09.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4000d10 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae4011b20 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af01553a0 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae401c420 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.241+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0155660 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.242+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af006d560 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.242+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4ae401c810 con 0x7f4af006bfa0 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.243+0000 7f4ad7fff700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4adc067290 0x7f4adc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.243+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4ae40864f0 con 0x7f4af006bfa0 2023-10-08T00:31:09.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.243+0000 7f4aeffff700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4adc067290 0x7f4adc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.244+0000 7f4aeffff700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4adc067290 0x7f4adc069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000adc0 tx=0x7f4ae0006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:09.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.247+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ae4053650 con 0x7f4af006bfa0 2023-10-08T00:31:09.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.439+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4af006b7a0 con 0x7f4af006bfa0 2023-10-08T00:31:09.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.443+0000 7f4ad7fff700 1 -- 172.21.15.22:0/3477410240 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4ae4056c70 con 0x7f4af006bfa0 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4adc067290 msgr2=0x7f4adc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4adc067290 0x7f4adc069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000adc0 tx=0x7f4ae0006f90 comp rx=0 tx=0).stop 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 msgr2=0x7f4af0158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af0158840 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4009260 tx=0x7f4ae4015000 comp rx=0 tx=0).stop 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 shutdown_connections 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4adc067290 0x7f4adc069740 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4af0159a70 0x7f4af0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4af0068390 0x7f4af01517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 --2- 172.21.15.22:0/3477410240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4af006bfa0 0x7f4af0158840 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 >> 172.21.15.22:0/3477410240 conn(0x7f4af00cddc0 msgr2=0x7f4af01524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:09.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 shutdown_connections 2023-10-08T00:31:09.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.445+0000 7f4af5260700 1 -- 172.21.15.22:0/3477410240 wait complete. 2023-10-08T00:31:09.458 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:31:09.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:31:09.502 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:31:09.547 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:31:09.548 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:31:09.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.667+0000 7f3e60a98700 1 Processor -- start 2023-10-08T00:31:09.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.667+0000 7f3e60a98700 1 -- start start 2023-10-08T00:31:09.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e60a98700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e5c159420 0x7f3e5c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e60a98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e60a98700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0b11d0 con 0x7f3e5c15d230 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e60a98700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b14b0 con 0x7f3e5c159420 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e60a98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0b1790 con 0x7f3e5c1597f0 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e5b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e5c159420 0x7f3e5c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e5bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3e5c15d230 0x7f3e5c0b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56626/0 (socket says 172.21.15.22:56626) 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.668+0000 7f3e5bfff700 1 -- 172.21.15.22:0/138261458 learned_addr learned my addr 172.21.15.22:0/138261458 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5affd700 1 --2- 172.21.15.22:0/138261458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5b7fe700 1 -- 172.21.15.22:0/138261458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 msgr2=0x7f3e5c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5b7fe700 1 --2- 172.21.15.22:0/138261458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5b7fe700 1 -- 172.21.15.22:0/138261458 >> v1:172.21.15.22:6789/0 conn(0x7f3e5c15d230 legacy=0x7f3e5c0b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5b7fe700 1 -- 172.21.15.22:0/138261458 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0b1a70 con 0x7f3e5c159420 2023-10-08T00:31:09.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5a7fc700 1 -- 172.21.15.22:0/138261458 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36697166 0 0) 0x7f3e5c0b11d0 con 0x7f3e5c15d230 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5b7fe700 1 --2- 172.21.15.22:0/138261458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c159420 0x7f3e5c0b5f40 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0098e0 tx=0x7f3e4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b91d8e81a280aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5a7fc700 1 -- 172.21.15.22:0/138261458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c009e80 con 0x7f3e5c159420 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5a7fc700 1 -- 172.21.15.22:0/138261458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c00b860 con 0x7f3e5c159420 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e5a7fc700 1 -- 172.21.15.22:0/138261458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00bbe0 con 0x7f3e5c159420 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e60a98700 1 -- 172.21.15.22:0/138261458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c159420 msgr2=0x7f3e5c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.669+0000 7f3e60a98700 1 --2- 172.21.15.22:0/138261458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c159420 0x7f3e5c0b5f40 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0098e0 tx=0x7f3e4c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.670+0000 7f3e60a98700 1 -- 172.21.15.22:0/138261458 shutdown_connections 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.670+0000 7f3e60a98700 1 --2- 172.21.15.22:0/138261458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c159420 0x7f3e5c0b5f40 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.670+0000 7f3e60a98700 1 --2- 172.21.15.22:0/138261458 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.670+0000 7f3e60a98700 1 -- 172.21.15.22:0/138261458 >> 172.21.15.22:0/138261458 conn(0x7f3e5c0d0660 msgr2=0x7f3e5c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.670+0000 7f3e60a98700 1 -- 172.21.15.22:0/138261458 shutdown_connections 2023-10-08T00:31:09.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.670+0000 7f3e60a98700 1 -- 172.21.15.22:0/138261458 wait complete. 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.671+0000 7f3e60a98700 1 Processor -- start 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.671+0000 7f3e60a98700 1 -- start start 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c159420 0x7f3e5c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c15ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 0x7f3e5c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0c5730 con 0x7f3e5c15d230 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c15bc00 con 0x7f3e5c159420 2023-10-08T00:31:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c15b360 con 0x7f3e5c1597f0 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 0x7f3e5c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 0x7f3e5c0c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38244/0 (socket says 172.21.15.22:38244) 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 -- 172.21.15.22:0/1543605144 learned_addr learned my addr 172.21.15.22:0/1543605144 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5affd700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c15ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 -- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 msgr2=0x7f3e5c15ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c15ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 -- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c159420 msgr2=0x7f3e5c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5b7fe700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c159420 0x7f3e5c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c159420 0x7f3e5c1567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 -- 172.21.15.22:0/1543605144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c009420 con 0x7f3e5c15d230 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e5bfff700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 0x7f3e5c0c7d60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400cc20 tx=0x7f3e540019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e54004bb0 con 0x7f3e5c15d230 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54004d10 con 0x7f3e5c15d230 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c15b640 con 0x7f3e5c15d230 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5400abd0 con 0x7f3e5c15d230 2023-10-08T00:31:09.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.672+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c15b080 con 0x7f3e5c15d230 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.673+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c04c3c0 con 0x7f3e5c15d230 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.674+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f3e540070f0 con 0x7f3e5c15d230 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.674+0000 7f3e437fe700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e48067290 0x7f3e48069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.674+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3e540845b0 con 0x7f3e5c15d230 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.675+0000 7f3e5b7fe700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e48067290 0x7f3e48069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.675+0000 7f3e5b7fe700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e48067290 0x7f3e48069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c003080 tx=0x7f3e4c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:09.679 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.679+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e54051790 con 0x7f3e5c15d230 2023-10-08T00:31:09.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.916+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e5c0c5870 con 0x7f3e5c15d230 2023-10-08T00:31:09.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.917+0000 7f3e437fe700 1 -- 172.21.15.22:0/1543605144 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3e54018020 con 0x7f3e5c15d230 2023-10-08T00:31:09.917 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:09.918 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5609,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4225309681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":4225309681},{"type":"v1","addr":"172.21.15.192:6837","nonce":4225309681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2995597684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2995597684},{"type":"v1","addr":"172.21.15.192:6836","nonce":2995597684}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63},{"gid":6504,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/2268385516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2268385516},{"type":"v1","addr":"172.21.15.22:6834","nonce":2268385516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3450262131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3450262131},{"type":"v1","addr":"172.21.15.22:6835","nonce":3450262131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[]} 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e48067290 msgr2=0x7f3e48069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e48067290 0x7f3e48069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c003080 tx=0x7f3e4c017000 comp rx=0 tx=0).stop 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 msgr2=0x7f3e5c0c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 0x7f3e5c0c7d60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400cc20 tx=0x7f3e540019b0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 shutdown_connections 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e5c15d230 0x7f3e5c0c7d60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e5c159420 0x7f3e5c1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3e48067290 0x7f3e48069740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 --2- 172.21.15.22:0/1543605144 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3e5c1597f0 0x7f3e5c15ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:09.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 >> 172.21.15.22:0/1543605144 conn(0x7f3e5c0d0660 msgr2=0x7f3e5c0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:09.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 shutdown_connections 2023-10-08T00:31:09.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:09.919+0000 7f3e60a98700 1 -- 172.21.15.22:0/1543605144 wait complete. 2023-10-08T00:31:09.921 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 63 2023-10-08T00:31:09.932 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:31:09.932 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:31:09.932 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:31:09.932 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:09.932 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:31:09.932 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:31:09.933 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:31:09.933 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:09.933 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:31:09.933 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:31:09.933 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:31:09.933 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:09.933 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:31:09.934 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:31:09.934 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:31:09.934 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:09.941 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:31:09.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:31:09.942 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:31:09.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:31:09.944 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:31:09.944 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:31:09.945 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:31:09.945 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:31:09.983 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:31:09.984 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:09.984 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:31:09.984 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:09.987 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:31:09.987 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:09.987 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:31:09.988 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:09.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:31:10.059 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:31:10.059 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:31:10.067 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:31:10.067 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:31:10.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.115+0000 7f78a5bb1700 1 Processor -- start 2023-10-08T00:31:10.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.115+0000 7f78a5bb1700 1 -- start start 2023-10-08T00:31:10.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a5bb1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a00c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a5bb1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 0x7f78a00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a5bb1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00c8ac0 con 0x7f78a0153df0 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a5bb1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a015aa30 con 0x7f78a00c8660 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a5bb1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a015a100 con 0x7f78a006e8c0 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a53b0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 0x7f78a00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f789ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a00c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f789ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a00c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:56140/0 (socket says 172.21.15.22:56140) 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a53b0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 0x7f78a00b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:34868/0 (socket says 172.21.15.22:34868) 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f78a4baf700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f78a0153df0 0x7f78a0063230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:45004/0 (socket says 172.21.15.22:45004) 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.116+0000 7f789ffff700 1 -- 172.21.15.22:0/1440142772 learned_addr learned my addr 172.21.15.22:0/1440142772 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:10.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789ffff700 1 -- 172.21.15.22:0/1440142772 >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 msgr2=0x7f78a00b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789ffff700 1 --2- 172.21.15.22:0/1440142772 >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 0x7f78a00b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789ffff700 1 -- 172.21.15.22:0/1440142772 >> v1:172.21.15.192:6789/0 conn(0x7f78a0153df0 legacy=0x7f78a0063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789f7fe700 1 -- 172.21.15.22:0/1440142772 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757381858 0 0) 0x7f7890001110 con 0x7f78a0153df0 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789ffff700 1 -- 172.21.15.22:0/1440142772 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a015a3e0 con 0x7f78a006e8c0 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f78a53b0700 1 --2- 172.21.15.22:0/1440142772 >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 0x7f78a00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789ffff700 1 --2- 172.21.15.22:0/1440142772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a00c8120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f78940099b0 tx=0x7f7894009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6813d3843b318c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789f7fe700 1 -- 172.21.15.22:0/1440142772 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894009ea0 con 0x7f78a006e8c0 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789f7fe700 1 -- 172.21.15.22:0/1440142772 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789400b860 con 0x7f78a006e8c0 2023-10-08T00:31:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.117+0000 7f789f7fe700 1 -- 172.21.15.22:0/1440142772 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400bc00 con 0x7f78a006e8c0 2023-10-08T00:31:10.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 -- 172.21.15.22:0/1440142772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 msgr2=0x7f78a00c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:10.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/1440142772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a00c8120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f78940099b0 tx=0x7f7894009250 comp rx=0 tx=0).stop 2023-10-08T00:31:10.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 -- 172.21.15.22:0/1440142772 shutdown_connections 2023-10-08T00:31:10.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/1440142772 >> v2:172.21.15.192:3300/0 conn(0x7f78a00c8660 0x7f78a00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:10.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/1440142772 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a00c8120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:10.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 -- 172.21.15.22:0/1440142772 >> 172.21.15.22:0/1440142772 conn(0x7f78a006ddb0 msgr2=0x7f78a006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 -- 172.21.15.22:0/1440142772 shutdown_connections 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.118+0000 7f78a5bb1700 1 -- 172.21.15.22:0/1440142772 wait complete. 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.119+0000 7f78a5bb1700 1 Processor -- start 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.119+0000 7f78a5bb1700 1 -- start start 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00c8660 0x7f78a01699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 0x7f78a0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a014fb60 con 0x7f78a0153df0 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a014fe40 con 0x7f78a00c8660 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0150120 con 0x7f78a006e8c0 2023-10-08T00:31:10.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 0x7f78a0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 0x7f78a0154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38274/0 (socket says 172.21.15.22:38274) 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 -- 172.21.15.22:0/4101325366 learned_addr learned my addr 172.21.15.22:0/4101325366 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a4baf700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f789ffff700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00c8660 0x7f78a01699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 -- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 msgr2=0x7f78a014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a014c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 -- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00c8660 msgr2=0x7f78a01699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00c8660 0x7f78a01699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 -- 172.21.15.22:0/4101325366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009a20 con 0x7f78a0153df0 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a4baf700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a53b0700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 0x7f78a0154b80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7898009fc0 tx=0x7f789800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800cd30 con 0x7f78a0153df0 2023-10-08T00:31:10.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789800f040 con 0x7f78a0153df0 2023-10-08T00:31:10.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940094f0 con 0x7f78a0153df0 2023-10-08T00:31:10.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.120+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980146d0 con 0x7f78a0153df0 2023-10-08T00:31:10.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.121+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a014ca80 con 0x7f78a0153df0 2023-10-08T00:31:10.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.121+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a014fca0 con 0x7f78a0153df0 2023-10-08T00:31:10.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.122+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7898003020 con 0x7f78a0153df0 2023-10-08T00:31:10.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.123+0000 7f789cff9700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f788c067290 0x7f788c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:10.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.123+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7898085310 con 0x7f78a0153df0 2023-10-08T00:31:10.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.123+0000 7f78a4baf700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f788c067290 0x7f788c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:10.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.123+0000 7f78a4baf700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f788c067290 0x7f788c069740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7890007170 tx=0x7f7890007da0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:10.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.127+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78a014fca0 con 0x7f78a0153df0 2023-10-08T00:31:10.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:10.336+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f78a014ff80 con 0x7f78a0153df0 2023-10-08T00:31:11.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.114+0000 7f789cff9700 1 -- 172.21.15.22:0/4101325366 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) v1 ==== 97+0+0 (secure 0 0 0) 0x7f78a014ff80 con 0x7f78a0153df0 2023-10-08T00:31:11.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f788c067290 msgr2=0x7f788c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f788c067290 0x7f788c069740 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7890007170 tx=0x7f7890007da0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 msgr2=0x7f78a0154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 0x7f78a0154b80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f7898009fc0 tx=0x7f789800b040 comp rx=0 tx=0).stop 2023-10-08T00:31:11.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 shutdown_connections 2023-10-08T00:31:11.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78a0153df0 0x7f78a0154b80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f788c067290 0x7f788c069740 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78a006e8c0 0x7f78a014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 --2- 172.21.15.22:0/4101325366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78a00c8660 0x7f78a01699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 >> 172.21.15.22:0/4101325366 conn(0x7f78a006ddb0 msgr2=0x7f78a015af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 shutdown_connections 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.117+0000 7f78a5bb1700 1 -- 172.21.15.22:0/4101325366 wait complete. 2023-10-08T00:31:11.119 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:31:11.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:31:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.258+0000 7f5eb38dd700 1 Processor -- start 2023-10-08T00:31:11.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.259+0000 7f5eb38dd700 1 -- start start 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.259+0000 7f5eb38dd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5eac06f810 0x7f5eac1649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.259+0000 7f5eb38dd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac06ec70 con 0x7f5eac068920 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.259+0000 7f5eb38dd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eac0b2e70 con 0x7f5eac068550 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.259+0000 7f5eb38dd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eac068d90 con 0x7f5eac06f810 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb0e78700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5eac068920 0x7f5eac06f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56646/0 (socket says 172.21.15.22:56646) 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb0e78700 1 -- 172.21.15.22:0/1057468807 learned_addr learned my addr 172.21.15.22:0/1057468807 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb1e7a700 1 --2- 172.21.15.22:0/1057468807 >> v2:172.21.15.192:3300/0 conn(0x7f5eac06f810 0x7f5eac1649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eabfff700 1 -- 172.21.15.22:0/1057468807 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280032130 0 0) 0x7f5eac06ec70 con 0x7f5eac068920 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eabfff700 1 -- 172.21.15.22:0/1057468807 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e94003570 con 0x7f5eac068920 2023-10-08T00:31:11.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb1e7a700 1 -- 172.21.15.22:0/1057468807 >> v1:172.21.15.192:6789/0 conn(0x7f5eac068550 legacy=0x7f5eac15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb1e7a700 1 -- 172.21.15.22:0/1057468807 >> v1:172.21.15.22:6789/0 conn(0x7f5eac068920 legacy=0x7f5eac06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb1e7a700 1 -- 172.21.15.22:0/1057468807 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac0b3150 con 0x7f5eac06f810 2023-10-08T00:31:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eb1e7a700 1 --2- 172.21.15.22:0/1057468807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac1649f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098e0 tx=0x7f5ea40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d2c880e98842fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eabfff700 1 -- 172.21.15.22:0/1057468807 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400b640 con 0x7f5eac06f810 2023-10-08T00:31:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eabfff700 1 -- 172.21.15.22:0/1057468807 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea400b7a0 con 0x7f5eac06f810 2023-10-08T00:31:11.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.260+0000 7f5eabfff700 1 -- 172.21.15.22:0/1057468807 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400bb40 con 0x7f5eac06f810 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 -- 172.21.15.22:0/1057468807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 msgr2=0x7f5eac1649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/1057468807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac1649f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098e0 tx=0x7f5ea40091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 -- 172.21.15.22:0/1057468807 shutdown_connections 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/1057468807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac1649f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 -- 172.21.15.22:0/1057468807 >> 172.21.15.22:0/1057468807 conn(0x7f5eac0cd480 msgr2=0x7f5eac0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 -- 172.21.15.22:0/1057468807 shutdown_connections 2023-10-08T00:31:11.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.261+0000 7f5eb38dd700 1 -- 172.21.15.22:0/1057468807 wait complete. 2023-10-08T00:31:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.262+0000 7f5eb38dd700 1 Processor -- start 2023-10-08T00:31:11.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.262+0000 7f5eb38dd700 1 -- start start 2023-10-08T00:31:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb38dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 0x7f5eac14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb38dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eac068920 0x7f5eac14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb38dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb38dd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac14ccd0 con 0x7f5eac068550 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb38dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac149ea0 con 0x7f5eac06f810 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb38dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eac14c0c0 con 0x7f5eac068920 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb1679700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 0x7f5eac14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb1679700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 0x7f5eac14b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38280/0 (socket says 172.21.15.22:38280) 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb1679700 1 -- 172.21.15.22:0/98693834 learned_addr learned my addr 172.21.15.22:0/98693834 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb1e7a700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.263+0000 7f5eb0e78700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eac068920 0x7f5eac14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb1679700 1 -- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eac068920 msgr2=0x7f5eac14ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb1679700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eac068920 0x7f5eac14ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb1679700 1 -- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 msgr2=0x7f5eac15b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb1679700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac15b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb1679700 1 -- 172.21.15.22:0/98693834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009420 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb1679700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 0x7f5eac14b4e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00cb40 tx=0x7f5e9c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00ce50 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c00a7a0 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eac14c3a0 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c00ab60 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.264+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eac14c960 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.265+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac04c3c0 con 0x7f5eac068550 2023-10-08T00:31:11.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.265+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5e9c003030 con 0x7f5eac068550 2023-10-08T00:31:11.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.266+0000 7f5ea97fa700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5e98067290 0x7f5e98069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.266+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5e9c084870 con 0x7f5eac068550 2023-10-08T00:31:11.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.266+0000 7f5eb0e78700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5e98067290 0x7f5e98069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.266+0000 7f5eb0e78700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5e98067290 0x7f5e98069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5eac16d390 tx=0x7f5ea0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:11.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.270+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e9c051920 con 0x7f5eac068550 2023-10-08T00:31:11.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.540+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5eac06c990 con 0x7f5eac068550 2023-10-08T00:31:11.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.541+0000 7f5ea97fa700 1 -- 172.21.15.22:0/98693834 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5e9c054f40 con 0x7f5eac068550 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.542 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:11.543 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.545 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:31:11.546 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.548 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:31:11.549 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.550 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.551 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:31:11.552 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:31:11.552 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.552 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.552 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:31:11.552 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:31:11.554 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:31:11.556 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:31:11.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:11.558 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:31:11.559 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:31:11.559 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:11.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:11.559 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:31:11.559 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:31:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5e98067290 msgr2=0x7f5e98069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5e98067290 0x7f5e98069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5eac16d390 tx=0x7f5ea0009040 comp rx=0 tx=0).stop 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 msgr2=0x7f5eac14b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 0x7f5eac14b4e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00cb40 tx=0x7f5e9c0017b0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 shutdown_connections 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eac06f810 0x7f5eac15b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5eac068550 0x7f5eac14b4e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5e98067290 0x7f5e98069740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 --2- 172.21.15.22:0/98693834 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5eac068920 0x7f5eac14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 >> 172.21.15.22:0/98693834 conn(0x7f5eac0cd480 msgr2=0x7f5eac0b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 shutdown_connections 2023-10-08T00:31:11.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.543+0000 7f5eb38dd700 1 -- 172.21.15.22:0/98693834 wait complete. 2023-10-08T00:31:11.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:11.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.681+0000 7f2ae10b9700 1 Processor -- start 2023-10-08T00:31:11.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.681+0000 7f2ae10b9700 1 -- start start 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae10b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc159cc0 0x7f2adc0b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae10b9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2adc0b2920 0x7f2adc15a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae10b9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0b5b40 con 0x7f2adc15a5d0 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae10b9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0ce260 con 0x7f2adc0b2920 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae10b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b5e20 con 0x7f2adc159cc0 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2adc0b2920 0x7f2adc15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae08b8700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2adc15a5d0 0x7f2adc0ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56662/0 (socket says 172.21.15.22:56662) 2023-10-08T00:31:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2ae08b8700 1 -- 172.21.15.22:0/4231476067 learned_addr learned my addr 172.21.15.22:0/4231476067 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adbfff700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc159cc0 0x7f2adc0b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adb7fe700 1 -- 172.21.15.22:0/4231476067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc159cc0 msgr2=0x7f2adc0b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adb7fe700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc159cc0 0x7f2adc0b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adb7fe700 1 -- 172.21.15.22:0/4231476067 >> v1:172.21.15.22:6789/0 conn(0x7f2adc15a5d0 legacy=0x7f2adc0ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adb7fe700 1 -- 172.21.15.22:0/4231476067 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0b6100 con 0x7f2adc0b2920 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adaffd700 1 -- 172.21.15.22:0/4231476067 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305769817 0 0) 0x7f2adc0b5b40 con 0x7f2adc15a5d0 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adbfff700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc159cc0 0x7f2adc0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.682+0000 7f2adb7fe700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc0b2920 0x7f2adc15a090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098e0 tx=0x7f2acc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31a5920c13d720a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2adaffd700 1 -- 172.21.15.22:0/4231476067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc009e80 con 0x7f2adc0b2920 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2adaffd700 1 -- 172.21.15.22:0/4231476067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00b860 con 0x7f2adc0b2920 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2adaffd700 1 -- 172.21.15.22:0/4231476067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00bbe0 con 0x7f2adc0b2920 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 -- 172.21.15.22:0/4231476067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc0b2920 msgr2=0x7f2adc15a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc0b2920 0x7f2adc15a090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098e0 tx=0x7f2acc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 -- 172.21.15.22:0/4231476067 shutdown_connections 2023-10-08T00:31:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc159cc0 0x7f2adc0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/4231476067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc0b2920 0x7f2adc15a090 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 -- 172.21.15.22:0/4231476067 >> 172.21.15.22:0/4231476067 conn(0x7f2adc0d0560 msgr2=0x7f2adc0d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 -- 172.21.15.22:0/4231476067 shutdown_connections 2023-10-08T00:31:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.683+0000 7f2ae10b9700 1 -- 172.21.15.22:0/4231476067 wait complete. 2023-10-08T00:31:11.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.684+0000 7f2ae10b9700 1 Processor -- start 2023-10-08T00:31:11.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.684+0000 7f2ae10b9700 1 -- start start 2023-10-08T00:31:11.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae10b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2adc0b2920 0x7f2adc15ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae10b9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 0x7f2adc157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae10b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc15a5d0 0x7f2adc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae10b9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15f120 con 0x7f2adc159cc0 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae10b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc16a640 con 0x7f2adc0b2920 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae10b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc1575b0 con 0x7f2adc15a5d0 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2adb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 0x7f2adc157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2adb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 0x7f2adc157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38294/0 (socket says 172.21.15.22:38294) 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2adb7fe700 1 -- 172.21.15.22:0/3552901023 learned_addr learned my addr 172.21.15.22:0/3552901023 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2adbfff700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2adc0b2920 0x7f2adc15ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.685+0000 7f2ae08b8700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc15a5d0 0x7f2adc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2adb7fe700 1 -- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc15a5d0 msgr2=0x7f2adc1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2adb7fe700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc15a5d0 0x7f2adc1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2adb7fe700 1 -- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2adc0b2920 msgr2=0x7f2adc15ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2adb7fe700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2adc0b2920 0x7f2adc15ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2adb7fe700 1 -- 172.21.15.22:0/3552901023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc009420 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2ae08b8700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc15a5d0 0x7f2adc1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2adb7fe700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 0x7f2adc157070 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2adc089180 tx=0x7f2acc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00bbe0 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc000cc0 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc169a30 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc011630 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.686+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc169ff0 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.687+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc16cce0 con 0x7f2adc159cc0 2023-10-08T00:31:11.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.687+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2acc0119e0 con 0x7f2adc159cc0 2023-10-08T00:31:11.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.688+0000 7f2ad3fff700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2abc067290 0x7f2abc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:11.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.688+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2acc085ae0 con 0x7f2adc159cc0 2023-10-08T00:31:11.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.688+0000 7f2adbfff700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2abc067290 0x7f2abc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:11.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.689+0000 7f2adbfff700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2abc067290 0x7f2abc069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2adc069ec0 tx=0x7f2ac4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:11.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.692+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2adc16cce0 con 0x7f2adc159cc0 2023-10-08T00:31:11.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.887+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2adc16cce0 con 0x7f2adc159cc0 2023-10-08T00:31:11.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.887+0000 7f2ad3fff700 1 -- 172.21.15.22:0/3552901023 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+12135 (secure 0 0 0) 0x7f2adc16cce0 con 0x7f2adc159cc0 2023-10-08T00:31:11.888 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:11.888 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":98,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:11.110786+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.889+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2abc067290 msgr2=0x7f2abc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.889+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2abc067290 0x7f2abc069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2adc069ec0 tx=0x7f2ac4008040 comp rx=0 tx=0).stop 2023-10-08T00:31:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.889+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 msgr2=0x7f2adc157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:11.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.889+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 0x7f2adc157070 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2adc089180 tx=0x7f2acc017000 comp rx=0 tx=0).stop 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.889+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 shutdown_connections 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.889+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2abc067290 0x7f2abc069740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.890+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2adc15a5d0 0x7f2adc1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.890+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2adc0b2920 0x7f2adc15ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.890+0000 7f2ae10b9700 1 --2- 172.21.15.22:0/3552901023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2adc159cc0 0x7f2adc157070 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.890+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 >> 172.21.15.22:0/3552901023 conn(0x7f2adc0d0560 msgr2=0x7f2adc0b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.890+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 shutdown_connections 2023-10-08T00:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:11.890+0000 7f2ae10b9700 1 -- 172.21.15.22:0/3552901023 wait complete. 2023-10-08T00:31:11.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:31:11.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:31:12.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.026+0000 7f58821c3700 1 Processor -- start 2023-10-08T00:31:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.026+0000 7f58821c3700 1 -- start start 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58821c3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f587c0b4e70 0x7f587c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58821c3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 0x7f587c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58821c3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0cfb00 con 0x7f587c0b16d0 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58821c3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0b5c40 con 0x7f587c0b4e70 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58821c3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b5f20 con 0x7f587c0b1b40 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58809c0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f587c0b16d0 0x7f587c15d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56664/0 (socket says 172.21.15.22:56664) 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58809c0700 1 -- 172.21.15.22:0/379462869 learned_addr learned my addr 172.21.15.22:0/379462869 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58811c1700 1 --2- 172.21.15.22:0/379462869 >> v2:172.21.15.192:3300/0 conn(0x7f587c0b4e70 0x7f587c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f58819c2700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 0x7f587c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983993280 0 0) 0x7f587c0cfb00 con 0x7f587c0b16d0 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5868003570 con 0x7f587c0b16d0 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643350551 0 0) 0x7f5868003570 con 0x7f587c0b16d0 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 msgr2=0x7f587c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 0x7f587c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 >> v2:172.21.15.192:3300/0 conn(0x7f587c0b4e70 msgr2=0x7f587c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 --2- 172.21.15.22:0/379462869 >> v2:172.21.15.192:3300/0 conn(0x7f587c0b4e70 0x7f587c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.027+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b6200 con 0x7f587c0b16d0 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f586c001470 con 0x7f587c0b16d0 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 >> v1:172.21.15.22:6789/0 conn(0x7f587c0b16d0 legacy=0x7f587c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5868003a60 0x7f5868003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 0x7f5868004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5868004d50 0x7f58680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b5c40 con 0x7f5868004d50 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b5f20 con 0x7f5868003a60 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586800ba60 con 0x7f587c0b1b40 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5868004d50 0x7f58680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58811c1700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5868003a60 0x7f5868003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58809c0700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 0x7f5868004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 -- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 msgr2=0x7f5868004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c0b1b40 0x7f5868004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 -- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5868003a60 msgr2=0x7f5868003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5868003a60 0x7f5868003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 -- 172.21.15.22:0/379462869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868003570 con 0x7f5868004d50 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f58819c2700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5868004d50 0x7f58680051c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f587400e210 tx=0x7f587400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dadafc3b55ec4a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400ea60 con 0x7f5868004d50 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400f040 con 0x7f5868004d50 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.028+0000 7f5873fff700 1 -- 172.21.15.22:0/379462869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400ee10 con 0x7f5868004d50 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58821c3700 1 -- 172.21.15.22:0/379462869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5868004d50 msgr2=0x7f58680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58821c3700 1 --2- 172.21.15.22:0/379462869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5868004d50 0x7f58680051c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f587400e210 tx=0x7f587400b040 comp rx=0 tx=0).stop 2023-10-08T00:31:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58819c2700 1 -- 172.21.15.22:0/379462869 reap_dead start 2023-10-08T00:31:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58821c3700 1 -- 172.21.15.22:0/379462869 shutdown_connections 2023-10-08T00:31:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58821c3700 1 -- 172.21.15.22:0/379462869 >> 172.21.15.22:0/379462869 conn(0x7f587c0d10c0 msgr2=0x7f587c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58821c3700 1 -- 172.21.15.22:0/379462869 shutdown_connections 2023-10-08T00:31:12.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.029+0000 7f58821c3700 1 -- 172.21.15.22:0/379462869 wait complete. 2023-10-08T00:31:12.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.030+0000 7f58821c3700 1 Processor -- start 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.030+0000 7f58821c3700 1 -- start start 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58821c3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c169820 0x7f587c169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58821c3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f587c0ca630 0x7f587c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58821c3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 0x7f587c069a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58821c3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c069f40 con 0x7f587c069590 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58821c3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cb0b0 con 0x7f587c0ca630 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58821c3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cb390 con 0x7f587c169820 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58819c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 0x7f587c069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58819c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 0x7f587c069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38316/0 (socket says 172.21.15.22:38316) 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58819c2700 1 -- 172.21.15.22:0/1746596077 learned_addr learned my addr 172.21.15.22:0/1746596077 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58811c1700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c169820 0x7f587c169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.031+0000 7f58809c0700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f587c0ca630 0x7f587c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58819c2700 1 -- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c169820 msgr2=0x7f587c169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58819c2700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c169820 0x7f587c169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58819c2700 1 -- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f587c0ca630 msgr2=0x7f587c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58819c2700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f587c0ca630 0x7f587c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58819c2700 1 -- 172.21.15.22:0/1746596077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0cb670 con 0x7f587c069590 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58819c2700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 0x7f587c069a00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5874016000 tx=0x7f587401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400eee0 con 0x7f587c069590 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5874022070 con 0x7f587c069590 2023-10-08T00:31:12.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0cb950 con 0x7f587c069590 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874027680 con 0x7f587c069590 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.032+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c14d810 con 0x7f587c069590 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.033+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c088990 con 0x7f587c069590 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.033+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5874024030 con 0x7f587c069590 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.034+0000 7f58717fa700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5860067290 0x7f5860069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.034+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5874086610 con 0x7f587c069590 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.034+0000 7f58811c1700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5860067290 0x7f5860069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.035+0000 7f58811c1700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5860067290 0x7f5860069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5878006f00 tx=0x7f58780091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.038+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5874053870 con 0x7f587c069590 2023-10-08T00:31:12.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.229+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f587c15cea0 con 0x7f587c069590 2023-10-08T00:31:12.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.230+0000 7f58717fa700 1 -- 172.21.15.22:0/1746596077 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5874056e90 con 0x7f587c069590 2023-10-08T00:31:12.231 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5860067290 msgr2=0x7f5860069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5860067290 0x7f5860069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5878006f00 tx=0x7f58780091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 msgr2=0x7f587c069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 0x7f587c069a00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5874016000 tx=0x7f587401a000 comp rx=0 tx=0).stop 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 shutdown_connections 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f587c069590 0x7f587c069a00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5860067290 0x7f5860069740 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f587c169820 0x7f587c169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 --2- 172.21.15.22:0/1746596077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f587c0ca630 0x7f587c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 >> 172.21.15.22:0/1746596077 conn(0x7f587c0d10c0 msgr2=0x7f587c158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 shutdown_connections 2023-10-08T00:31:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.232+0000 7f58821c3700 1 -- 172.21.15.22:0/1746596077 wait complete. 2023-10-08T00:31:12.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:31:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.363+0000 7f175c444700 1 Processor -- start 2023-10-08T00:31:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.363+0000 7f175c444700 1 -- start start 2023-10-08T00:31:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f175c444700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 0x7f17540c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f175c444700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175415d7e0 con 0x7f175406c0a0 2023-10-08T00:31:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f175c444700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175415dac0 con 0x7f175406bcd0 2023-10-08T00:31:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f175c444700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17540caf30 con 0x7f17540caa90 2023-10-08T00:31:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f17599df700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f175406c0a0 0x7f175415df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56672/0 (socket says 172.21.15.22:56672) 2023-10-08T00:31:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f17599df700 1 -- 172.21.15.22:0/3225605750 learned_addr learned my addr 172.21.15.22:0/3225605750 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f175a9e1700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 0x7f17540c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851745057 0 0) 0x7f175415d7e0 con 0x7f175406c0a0 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.364+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c003570 con 0x7f175406c0a0 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4278980211 0 0) 0x7f173c003570 con 0x7f175406c0a0 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 msgr2=0x7f17540c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 0x7f17540c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 >> v1:172.21.15.192:6789/0 conn(0x7f175406bcd0 legacy=0x7f175415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175415aa30 con 0x7f175406c0a0 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f1748001470 con 0x7f175406c0a0 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 >> v1:172.21.15.22:6789/0 conn(0x7f175406c0a0 legacy=0x7f175415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f173c003a90 0x7f173c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 0x7f173c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173c004d50 0x7f173c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17540caf30 con 0x7f173c003a90 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c014430 con 0x7f173c004d50 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0145f0 con 0x7f17540caa90 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f173c003a90 0x7f173c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17599df700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 0x7f173c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a9e1700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173c004d50 0x7f173c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 -- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 msgr2=0x7f173c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17540caa90 0x7f173c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 -- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173c004d50 msgr2=0x7f173c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173c004d50 0x7f173c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 -- 172.21.15.22:0/3225605750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c003570 con 0x7f173c003a90 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a9e1700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f173c004d50 0x7f173c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f175a1e0700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f173c003a90 0x7f173c003ea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f174c001fc0 tx=0x7f174c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2d26c6bfe56914 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c001980 con 0x7f173c003a90 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00c8b0 con 0x7f173c003a90 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.365+0000 7f17591de700 1 -- 172.21.15.22:0/3225605750 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c00cc50 con 0x7f173c003a90 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175c444700 1 -- 172.21.15.22:0/3225605750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f173c003a90 msgr2=0x7f173c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175c444700 1 --2- 172.21.15.22:0/3225605750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f173c003a90 0x7f173c003ea0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f174c001fc0 tx=0x7f174c001670 comp rx=0 tx=0).stop 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175a9e1700 1 -- 172.21.15.22:0/3225605750 reap_dead start 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175c444700 1 -- 172.21.15.22:0/3225605750 shutdown_connections 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175c444700 1 -- 172.21.15.22:0/3225605750 >> 172.21.15.22:0/3225605750 conn(0x7f17540ce600 msgr2=0x7f17540cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175c444700 1 -- 172.21.15.22:0/3225605750 shutdown_connections 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.366+0000 7f175c444700 1 -- 172.21.15.22:0/3225605750 wait complete. 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.367+0000 7f175c444700 1 Processor -- start 2023-10-08T00:31:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.367+0000 7f175c444700 1 -- start start 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175c444700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173c003a90 0x7f175414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175c444700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1754146ed0 0x7f1754146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175c444700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 0x7f175414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175c444700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175414cb30 con 0x7f175414d620 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175c444700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175414dfb0 con 0x7f1754146ed0 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175c444700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17541695f0 con 0x7f173c003a90 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 0x7f175414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 0x7f175414da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38338/0 (socket says 172.21.15.22:38338) 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 -- 172.21.15.22:0/1436284246 learned_addr learned my addr 172.21.15.22:0/1436284246 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a1e0700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173c003a90 0x7f175414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f17599df700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1754146ed0 0x7f1754146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 -- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173c003a90 msgr2=0x7f175414c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173c003a90 0x7f175414c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 -- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1754146ed0 msgr2=0x7f1754146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1754146ed0 0x7f1754146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.368+0000 7f175a9e1700 1 -- 172.21.15.22:0/1436284246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175414cd60 con 0x7f175414d620 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.369+0000 7f175a9e1700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 0x7f175414da70 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f175406b640 tx=0x7f1744008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.369+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744011e70 con 0x7f175414d620 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.369+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744015670 con 0x7f175414d620 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.369+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175414d040 con 0x7f175414d620 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.369+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744015a30 con 0x7f175414d620 2023-10-08T00:31:12.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.369+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175414d320 con 0x7f175414d620 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.370+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175404c3c0 con 0x7f175414d620 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.370+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1744020460 con 0x7f175414d620 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.371+0000 7f17527fc700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17400672c0 0x7f1740069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.371+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1744084830 con 0x7f175414d620 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.371+0000 7f175a1e0700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17400672c0 0x7f1740069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.371+0000 7f175a1e0700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17400672c0 0x7f1740069770 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f174c001fc0 tx=0x7f174c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.375+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17440519e0 con 0x7f175414d620 2023-10-08T00:31:12.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.570+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f175415ad10 con 0x7f175414d620 2023-10-08T00:31:12.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.570+0000 7f17527fc700 1 -- 172.21.15.22:0/1436284246 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1744055000 con 0x7f175414d620 2023-10-08T00:31:12.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:12.571 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:31:12.571 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:12.571 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:31:12.572 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:31:12.572 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:12.572 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:31:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17400672c0 msgr2=0x7f1740069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17400672c0 0x7f1740069770 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f174c001fc0 tx=0x7f174c015000 comp rx=0 tx=0).stop 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 msgr2=0x7f175414da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 0x7f175414da70 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f175406b640 tx=0x7f1744008040 comp rx=0 tx=0).stop 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 shutdown_connections 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f175414d620 0x7f175414da70 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f17400672c0 0x7f1740069770 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f173c003a90 0x7f175414c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 --2- 172.21.15.22:0/1436284246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1754146ed0 0x7f1754146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 >> 172.21.15.22:0/1436284246 conn(0x7f17540ce600 msgr2=0x7f17540cb070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 shutdown_connections 2023-10-08T00:31:12.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.573+0000 7f175c444700 1 -- 172.21.15.22:0/1436284246 wait complete. 2023-10-08T00:31:12.585 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:31:12.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:31:12.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.707+0000 7fcd01aab700 1 Processor -- start 2023-10-08T00:31:12.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.707+0000 7fcd01aab700 1 -- start start 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.708+0000 7fcd01aab700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fccfc159ec0 0x7fccfc0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.708+0000 7fcd01aab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b53d0 0x7fccfc0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.708+0000 7fcd01aab700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc0b5b00 con 0x7fccfc0cce40 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.708+0000 7fcd01aab700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0b5850 con 0x7fccfc159ec0 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.708+0000 7fcd01aab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0b5da0 con 0x7fccfc0b53d0 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.708+0000 7fccfb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fccfc159ec0 0x7fccfc0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fccfc159ec0 0x7fccfc0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38346/0 (socket says 172.21.15.22:38346) 2023-10-08T00:31:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 -- 172.21.15.22:0/4028646366 learned_addr learned my addr 172.21.15.22:0/4028646366 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfaffd700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b53d0 0x7fccfc0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 -- 172.21.15.22:0/4028646366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b53d0 msgr2=0x7fccfc0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b53d0 0x7fccfc0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 -- 172.21.15.22:0/4028646366 >> v1:172.21.15.192:6789/0 conn(0x7fccfc0cce40 legacy=0x7fccfc0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:12.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 -- 172.21.15.22:0/4028646366 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0b6080 con 0x7fccfc159ec0 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfaffd700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b53d0 0x7fccfc0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfb7fe700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc159ec0 0x7fccfc0b4e90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fccec009990 tx=0x7fccec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684dfaa50dce95ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfa7fc700 1 -- 172.21.15.22:0/4028646366 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec005c10 con 0x7fccfc159ec0 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfa7fc700 1 -- 172.21.15.22:0/4028646366 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec005d70 con 0x7fccfc159ec0 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.709+0000 7fccfa7fc700 1 -- 172.21.15.22:0/4028646366 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00b840 con 0x7fccfc159ec0 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 -- 172.21.15.22:0/4028646366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc159ec0 msgr2=0x7fccfc0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc159ec0 0x7fccfc0b4e90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fccec009990 tx=0x7fccec009220 comp rx=0 tx=0).stop 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 -- 172.21.15.22:0/4028646366 shutdown_connections 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc159ec0 0x7fccfc0b4e90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 --2- 172.21.15.22:0/4028646366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0b53d0 0x7fccfc0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 -- 172.21.15.22:0/4028646366 >> 172.21.15.22:0/4028646366 conn(0x7fccfc0999f0 msgr2=0x7fccfc0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:12.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 -- 172.21.15.22:0/4028646366 shutdown_connections 2023-10-08T00:31:12.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.710+0000 7fcd01aab700 1 -- 172.21.15.22:0/4028646366 wait complete. 2023-10-08T00:31:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.711+0000 7fcd01aab700 1 Processor -- start 2023-10-08T00:31:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.711+0000 7fcd01aab700 1 -- start start 2023-10-08T00:31:12.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 0x7fccfc152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0cce40 0x7fccfc15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc159ec0 0x7fccfc154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc155510 con 0x7fccfc0b53d0 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc154900 con 0x7fccfc159ec0 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc154be0 con 0x7fccfc0cce40 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 0x7fccfc152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 0x7fccfc152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38352/0 (socket says 172.21.15.22:38352) 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 -- 172.21.15.22:0/170985259 learned_addr learned my addr 172.21.15.22:0/170985259 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 -- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0cce40 msgr2=0x7fccfc15d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0cce40 0x7fccfc15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 -- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc159ec0 msgr2=0x7fccfc154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfbfff700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc159ec0 0x7fccfc154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc159ec0 0x7fccfc154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 -- 172.21.15.22:0/170985259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009480 con 0x7fccfc0b53d0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfbfff700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc159ec0 0x7fccfc154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccfb7fe700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 0x7fccfc152800 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fccec0030c0 tx=0x7fccec015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec000cf0 con 0x7fccfc0b53d0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec011cc0 con 0x7fccfc0b53d0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc154ec0 con 0x7fccfc0b53d0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec01d6a0 con 0x7fccfc0b53d0 2023-10-08T00:31:12.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.712+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc154560 con 0x7fccfc0b53d0 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.713+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccfc063c90 con 0x7fccfc0b53d0 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.714+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fccec01da50 con 0x7fccfc0b53d0 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.714+0000 7fccf37fe700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fccdc067290 0x7fccdc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.714+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fccec086310 con 0x7fccfc0b53d0 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.714+0000 7fccfaffd700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fccdc067290 0x7fccdc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.715+0000 7fccfaffd700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fccdc067290 0x7fccdc069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcce4006fd0 tx=0x7fcce4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:12.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.718+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccec0534c0 con 0x7fccfc0b53d0 2023-10-08T00:31:12.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:12.912+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fccfc0718b0 con 0x7fccfc0b53d0 2023-10-08T00:31:13.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.120+0000 7fccf37fe700 1 -- 172.21.15.22:0/170985259 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) v1 ==== 138+0+0 (secure 0 0 0) 0x7fccec056ae0 con 0x7fccfc0b53d0 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fccdc067290 msgr2=0x7fccdc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fccdc067290 0x7fccdc069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fcce4006fd0 tx=0x7fcce4008040 comp rx=0 tx=0).stop 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 msgr2=0x7fccfc152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 0x7fccfc152800 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fccec0030c0 tx=0x7fccec015000 comp rx=0 tx=0).stop 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 shutdown_connections 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fccfc159ec0 0x7fccfc154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccfc0b53d0 0x7fccfc152800 secure :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fccec0030c0 tx=0x7fccec015000 comp rx=0 tx=0).stop 2023-10-08T00:31:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fccdc067290 0x7fccdc069740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 --2- 172.21.15.22:0/170985259 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fccfc0cce40 0x7fccfc15d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.123+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 >> 172.21.15.22:0/170985259 conn(0x7fccfc0999f0 msgr2=0x7fccfc0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.124+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 shutdown_connections 2023-10-08T00:31:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.124+0000 7fcd01aab700 1 -- 172.21.15.22:0/170985259 wait complete. 2023-10-08T00:31:13.126 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:31:13.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:31:13.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.265+0000 7f10e9184700 1 Processor -- start 2023-10-08T00:31:13.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.265+0000 7f10e9184700 1 -- start start 2023-10-08T00:31:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e9184700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10e406af90 0x7f10e40c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e9184700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40c9860 con 0x7f10e406b360 2023-10-08T00:31:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e9184700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40c8cd0 con 0x7f10e406d840 2023-10-08T00:31:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e9184700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e40cd200 con 0x7f10e406af90 2023-10-08T00:31:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10e406af90 0x7f10e40c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f10e406b360 0x7f10e406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56686/0 (socket says 172.21.15.22:56686) 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e37fe700 1 -- 172.21.15.22:0/3634668813 learned_addr learned my addr 172.21.15.22:0/3634668813 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e3fff700 1 -- 172.21.15.22:0/3634668813 >> v1:172.21.15.192:6789/0 conn(0x7f10e406d840 legacy=0x7f10e40ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e3fff700 1 -- 172.21.15.22:0/3634668813 >> v1:172.21.15.22:6789/0 conn(0x7f10e406b360 legacy=0x7f10e406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.266+0000 7f10e3fff700 1 -- 172.21.15.22:0/3634668813 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40c8f30 con 0x7f10e406af90 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e3fff700 1 --2- 172.21.15.22:0/3634668813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406af90 0x7f10e40c9cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0098e0 tx=0x7f10cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c065f03fc89271 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e2ffd700 1 -- 172.21.15.22:0/3634668813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc009e80 con 0x7f10e406af90 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e2ffd700 1 -- 172.21.15.22:0/3634668813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc00b8b0 con 0x7f10e406af90 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e2ffd700 1 -- 172.21.15.22:0/3634668813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc00bc30 con 0x7f10e406af90 2023-10-08T00:31:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 -- 172.21.15.22:0/3634668813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406af90 msgr2=0x7f10e40c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 --2- 172.21.15.22:0/3634668813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406af90 0x7f10e40c9cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0098e0 tx=0x7f10cc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 -- 172.21.15.22:0/3634668813 shutdown_connections 2023-10-08T00:31:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 --2- 172.21.15.22:0/3634668813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406af90 0x7f10e40c9cf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 -- 172.21.15.22:0/3634668813 >> 172.21.15.22:0/3634668813 conn(0x7f10e406baa0 msgr2=0x7f10e406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 -- 172.21.15.22:0/3634668813 shutdown_connections 2023-10-08T00:31:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.267+0000 7f10e9184700 1 -- 172.21.15.22:0/3634668813 wait complete. 2023-10-08T00:31:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.268+0000 7f10e9184700 1 Processor -- start 2023-10-08T00:31:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 -- start start 2023-10-08T00:31:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e406af90 0x7f10e416a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e406b360 0x7f10e415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 0x7f10e415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e415e510 con 0x7f10e406d840 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40c57e0 con 0x7f10e406af90 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e9184700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40c5a80 con 0x7f10e406b360 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e8983700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 0x7f10e415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e8983700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 0x7f10e415c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38362/0 (socket says 172.21.15.22:38362) 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.269+0000 7f10e8983700 1 -- 172.21.15.22:0/970319253 learned_addr learned my addr 172.21.15.22:0/970319253 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e37fe700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e406b360 0x7f10e415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e3fff700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e406af90 0x7f10e416a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e8983700 1 -- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e406b360 msgr2=0x7f10e415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e8983700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e406b360 0x7f10e415dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e8983700 1 -- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e406af90 msgr2=0x7f10e416a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e8983700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e406af90 0x7f10e416a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e8983700 1 -- 172.21.15.22:0/970319253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009420 con 0x7f10e406d840 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e3fff700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e406af90 0x7f10e416a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e37fe700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e406b360 0x7f10e415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e8983700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 0x7f10e415c440 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00bb30 tx=0x7f10dc0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00c940 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00cae0 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e40c5d60 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00cea0 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.270+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e40c60f0 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.271+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e40c6280 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.272+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f10dc014620 con 0x7f10e406d840 2023-10-08T00:31:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.272+0000 7f10dbfff700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10c4067290 0x7f10c4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:13.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.272+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f10dc084860 con 0x7f10e406d840 2023-10-08T00:31:13.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.272+0000 7f10e3fff700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10c4067290 0x7f10c4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:13.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.273+0000 7f10e3fff700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10c4067290 0x7f10c4069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0030c0 tx=0x7f10cc016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:13.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.277+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e40c6280 con 0x7f10e406d840 2023-10-08T00:31:13.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:13.472+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f10e40c6280 con 0x7f10e406d840 2023-10-08T00:31:14.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.126+0000 7f10dbfff700 1 -- 172.21.15.22:0/970319253 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) v1 ==== 170+0+0 (secure 0 0 0) 0x7f10e40c6280 con 0x7f10e406d840 2023-10-08T00:31:14.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10c4067290 msgr2=0x7f10c4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:14.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10c4067290 0x7f10c4069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0030c0 tx=0x7f10cc016000 comp rx=0 tx=0).stop 2023-10-08T00:31:14.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 msgr2=0x7f10e415c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:14.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 0x7f10e415c440 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00bb30 tx=0x7f10dc0097c0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 shutdown_connections 2023-10-08T00:31:14.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e406d840 0x7f10e415c440 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e406af90 0x7f10e416a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10c4067290 0x7f10c4069740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 --2- 172.21.15.22:0/970319253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e406b360 0x7f10e415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.139+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 >> 172.21.15.22:0/970319253 conn(0x7f10e406baa0 msgr2=0x7f10e40c4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:14.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.140+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 shutdown_connections 2023-10-08T00:31:14.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.140+0000 7f10e9184700 1 -- 172.21.15.22:0/970319253 wait complete. 2023-10-08T00:31:14.143 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:31:14.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:31:14.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.285+0000 7f849aa73700 1 Processor -- start 2023-10-08T00:31:14.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.285+0000 7f849aa73700 1 -- start start 2023-10-08T00:31:14.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.285+0000 7f849aa73700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f849415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:14.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.285+0000 7f849aa73700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8494159c60 0x7f849415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.285+0000 7f849aa73700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849415a160 con 0x7f849415db10 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.285+0000 7f849aa73700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940d13a0 con 0x7f8494159c60 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f849aa73700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849415e140 con 0x7f8494159890 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8494159c60 0x7f849415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8499010700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f849415db10 0x7f8494069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56702/0 (socket says 172.21.15.22:56702) 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8499010700 1 -- 172.21.15.22:0/278071924 learned_addr learned my addr 172.21.15.22:0/278071924 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8494159c60 0x7f849415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38370/0 (socket says 172.21.15.22:38370) 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f849880f700 1 --2- 172.21.15.22:0/278071924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f849415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:14.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 -- 172.21.15.22:0/278071924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 msgr2=0x7f849415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 --2- 172.21.15.22:0/278071924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f849415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 -- 172.21.15.22:0/278071924 >> v1:172.21.15.22:6789/0 conn(0x7f849415db10 legacy=0x7f8494069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 -- 172.21.15.22:0/278071924 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849415a3d0 con 0x7f8494159c60 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f84937fe700 1 -- 172.21.15.22:0/278071924 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578242002 0 0) 0x7f849415a160 con 0x7f849415db10 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f8493fff700 1 --2- 172.21.15.22:0/278071924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8494159c60 0x7f849415d5d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f84840098e0 tx=0x7f84840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609df27ac0be7242 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f84937fe700 1 -- 172.21.15.22:0/278071924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484009e80 con 0x7f8494159c60 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f84937fe700 1 -- 172.21.15.22:0/278071924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848400b860 con 0x7f8494159c60 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.286+0000 7f84937fe700 1 -- 172.21.15.22:0/278071924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848400bbe0 con 0x7f8494159c60 2023-10-08T00:31:14.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 -- 172.21.15.22:0/278071924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8494159c60 msgr2=0x7f849415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 --2- 172.21.15.22:0/278071924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8494159c60 0x7f849415d5d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f84840098e0 tx=0x7f84840091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 -- 172.21.15.22:0/278071924 shutdown_connections 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 --2- 172.21.15.22:0/278071924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f849415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 --2- 172.21.15.22:0/278071924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8494159c60 0x7f849415d5d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 -- 172.21.15.22:0/278071924 >> 172.21.15.22:0/278071924 conn(0x7f8494068e20 msgr2=0x7f84940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 -- 172.21.15.22:0/278071924 shutdown_connections 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.287+0000 7f849aa73700 1 -- 172.21.15.22:0/278071924 wait complete. 2023-10-08T00:31:14.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.288+0000 7f849aa73700 1 Processor -- start 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.288+0000 7f849aa73700 1 -- start start 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849aa73700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f84940cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849aa73700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8494159c60 0x7f84941493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849aa73700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 0x7f849416d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849aa73700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940b0700 con 0x7f849415db10 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849aa73700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940cfee0 con 0x7f8494159c60 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849aa73700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8494151880 con 0x7f8494159890 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 0x7f849416d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:14.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 0x7f849416d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38386/0 (socket says 172.21.15.22:38386) 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 -- 172.21.15.22:0/3057360247 learned_addr learned my addr 172.21.15.22:0/3057360247 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f849880f700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f84940cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8493fff700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8494159c60 0x7f84941493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 -- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 msgr2=0x7f84940cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f84940cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 -- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8494159c60 msgr2=0x7f84941493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8494159c60 0x7f84941493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:14.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.289+0000 7f8499010700 1 -- 172.21.15.22:0/3057360247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484009420 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.290+0000 7f8499010700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 0x7f849416d0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f847c00c4f0 tx=0x7f847c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.290+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00cea0 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.290+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c005b30 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.290+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8494151b60 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.290+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c0070d0 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.290+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8494149900 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.291+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84940b0870 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.292+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f847c007500 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.292+0000 7f8490ff9700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8474067290 0x7f8474069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.292+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f847c0840c0 con 0x7f849415db10 2023-10-08T00:31:14.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.292+0000 7f849880f700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8474067290 0x7f8474069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:14.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.293+0000 7f849880f700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8474067290 0x7f8474069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f848c009fd0 tx=0x7f848c009880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:14.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.296+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f847c050f70 con 0x7f849415db10 2023-10-08T00:31:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:14.534+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f84940b0840 con 0x7f849415db10 2023-10-08T00:31:15.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.137+0000 7f8490ff9700 1 -- 172.21.15.22:0/3057360247 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v65) v1 ==== 174+0+0 (secure 0 0 0) 0x7f847c0170c0 con 0x7f849415db10 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8474067290 msgr2=0x7f8474069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8474067290 0x7f8474069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f848c009fd0 tx=0x7f848c009880 comp rx=0 tx=0).stop 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 msgr2=0x7f849416d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 0x7f849416d0d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f847c00c4f0 tx=0x7f847c007f50 comp rx=0 tx=0).stop 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 shutdown_connections 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849415db10 0x7f849416d0d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8474067290 0x7f8474069740 secure :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f848c009fd0 tx=0x7f848c009880 comp rx=0 tx=0).stop 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8494159890 0x7f84940cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 --2- 172.21.15.22:0/3057360247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8494159c60 0x7f84941493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 >> 172.21.15.22:0/3057360247 conn(0x7f8494068e20 msgr2=0x7f8494153190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:15.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 shutdown_connections 2023-10-08T00:31:15.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.141+0000 7f849aa73700 1 -- 172.21.15.22:0/3057360247 wait complete. 2023-10-08T00:31:15.149 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 16 and data pool 17 2023-10-08T00:31:15.160 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:15.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.280+0000 7fa65d06a700 1 Processor -- start 2023-10-08T00:31:15.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.280+0000 7fa65d06a700 1 -- start start 2023-10-08T00:31:15.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65d06a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa65815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65d06a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65815a160 con 0x7fa65815db10 2023-10-08T00:31:15.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65d06a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6580d13a0 con 0x7fa658159890 2023-10-08T00:31:15.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65d06a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65815e140 con 0x7fa658159c60 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65759e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa65815db10 0x7fa658069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56704/0 (socket says 172.21.15.22:56704) 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65759e700 1 -- 172.21.15.22:0/1903643514 learned_addr learned my addr 172.21.15.22:0/1903643514 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa65659c700 1 --2- 172.21.15.22:0/1903643514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa65815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.281+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991059074 0 0) 0x7fa65815a160 con 0x7fa65815db10 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa644003570 con 0x7fa65815db10 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723223198 0 0) 0x7fa6580d13a0 con 0x7fa658159890 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65815a160 con 0x7fa658159890 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa65659c700 1 -- 172.21.15.22:0/1903643514 >> v1:172.21.15.192:6789/0 conn(0x7fa658159890 legacy=0x7fa65815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa65659c700 1 -- 172.21.15.22:0/1903643514 >> v1:172.21.15.22:6789/0 conn(0x7fa65815db10 legacy=0x7fa658069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa65659c700 1 -- 172.21.15.22:0/1903643514 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65815a3d0 con 0x7fa658159c60 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa65659c700 1 --2- 172.21.15.22:0/1903643514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa65815d5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa640009910 tx=0x7fa6400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30b7c0221caaa04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011630 con 0x7fa658159c60 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa640011790 con 0x7fa658159c60 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.282+0000 7fa655d9b700 1 -- 172.21.15.22:0/1903643514 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa640011b10 con 0x7fa658159c60 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 -- 172.21.15.22:0/1903643514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 msgr2=0x7fa65815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 --2- 172.21.15.22:0/1903643514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa65815d5d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa640009910 tx=0x7fa6400091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 -- 172.21.15.22:0/1903643514 shutdown_connections 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 --2- 172.21.15.22:0/1903643514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa65815d5d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 -- 172.21.15.22:0/1903643514 >> 172.21.15.22:0/1903643514 conn(0x7fa658068e20 msgr2=0x7fa6580d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 -- 172.21.15.22:0/1903643514 shutdown_connections 2023-10-08T00:31:15.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.283+0000 7fa65d06a700 1 -- 172.21.15.22:0/1903643514 wait complete. 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.284+0000 7fa65d06a700 1 Processor -- start 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.284+0000 7fa65d06a700 1 -- start start 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 0x7fa658156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa6580b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65815db10 0x7fa6580b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580b64a0 con 0x7fa658159890 2023-10-08T00:31:15.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581575c0 con 0x7fa65815db10 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6581578a0 con 0x7fa658159c60 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 0x7fa658156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 0x7fa658156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38396/0 (socket says 172.21.15.22:38396) 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 -- 172.21.15.22:0/396000344 learned_addr learned my addr 172.21.15.22:0/396000344 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65759e700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65815db10 0x7fa6580b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65659c700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa6580b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 -- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 msgr2=0x7fa6580b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa6580b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 -- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65815db10 msgr2=0x7fa6580b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65815db10 0x7fa6580b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 -- 172.21.15.22:0/396000344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa640009420 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65759e700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65815db10 0x7fa6580b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa656d9d700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 0x7fa658156f20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa65000cb40 tx=0x7fa6500027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000a7e0 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65000a940 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa658157b80 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65000ad00 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.285+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6580b4730 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.286+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6580b4980 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.287+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fa650012630 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.287+0000 7fa64effd700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067290 0x7fa638069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.287+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa650084d70 con 0x7fa658159890 2023-10-08T00:31:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.287+0000 7fa65659c700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067290 0x7fa638069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.288+0000 7fa65659c700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067290 0x7fa638069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa65815a090 tx=0x7fa640017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.291+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa650089070 con 0x7fa658159890 2023-10-08T00:31:15.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.486+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa65804c3c0 con 0x7fa658159890 2023-10-08T00:31:15.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.486+0000 7fa64effd700 1 -- 172.21.15.22:0/396000344 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fa650051ad0 con 0x7fa658159890 2023-10-08T00:31:15.488 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:15.488 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":101,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:14.535624+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:12.943014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:13.503263+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:15.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067290 msgr2=0x7fa638069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067290 0x7fa638069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa65815a090 tx=0x7fa640017000 comp rx=0 tx=0).stop 2023-10-08T00:31:15.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 msgr2=0x7fa658156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 0x7fa658156f20 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa65000cb40 tx=0x7fa6500027a0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 shutdown_connections 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65815db10 0x7fa6580b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa658159890 0x7fa658156f20 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa638067290 0x7fa638069740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 --2- 172.21.15.22:0/396000344 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa658159c60 0x7fa6580b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.488+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 >> 172.21.15.22:0/396000344 conn(0x7fa658068e20 msgr2=0x7fa6581531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.489+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 shutdown_connections 2023-10-08T00:31:15.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.489+0000 7fa65d06a700 1 -- 172.21.15.22:0/396000344 wait complete. 2023-10-08T00:31:15.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:15.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.620+0000 7fc4f60b7700 1 Processor -- start 2023-10-08T00:31:15.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.620+0000 7fc4f60b7700 1 -- start start 2023-10-08T00:31:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4f60b7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc4f0159890 0x7fc4f015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4f60b7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc4f0159c60 0x7fc4f015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4f60b7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f015a160 con 0x7fc4f015db10 2023-10-08T00:31:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4f60b7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f015df50 con 0x7fc4f0159c60 2023-10-08T00:31:15.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4f60b7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f00d13a0 con 0x7fc4f0159890 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc4f0159c60 0x7fc4f015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc4f0159c60 0x7fc4f015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38408/0 (socket says 172.21.15.22:38408) 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2536541056 learned_addr learned my addr 172.21.15.22:0/2536541056 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4ef7fe700 1 --2- 172.21.15.22:0/2536541056 >> v2:172.21.15.192:3300/0 conn(0x7fc4f0159890 0x7fc4f015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2536541056 >> v2:172.21.15.192:3300/0 conn(0x7fc4f0159890 msgr2=0x7fc4f015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 --2- 172.21.15.22:0/2536541056 >> v2:172.21.15.192:3300/0 conn(0x7fc4f0159890 0x7fc4f015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2536541056 >> v1:172.21.15.192:6789/0 conn(0x7fc4f015db10 legacy=0x7fc4f0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.621+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2536541056 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f015e140 con 0x7fc4f0159c60 2023-10-08T00:31:15.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.622+0000 7fc4eeffd700 1 --2- 172.21.15.22:0/2536541056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f015d5d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00d1090 tx=0x7fc4e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53ae48c45fd6153 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.624+0000 7fc4ee7fc700 1 -- 172.21.15.22:0/2536541056 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4009e70 con 0x7fc4f0159c60 2023-10-08T00:31:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.624+0000 7fc4ee7fc700 1 -- 172.21.15.22:0/2536541056 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e400b860 con 0x7fc4f0159c60 2023-10-08T00:31:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.624+0000 7fc4ee7fc700 1 -- 172.21.15.22:0/2536541056 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400bc00 con 0x7fc4f0159c60 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2536541056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 msgr2=0x7fc4f015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2536541056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f015d5d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00d1090 tx=0x7fc4e4009250 comp rx=0 tx=0).stop 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2536541056 shutdown_connections 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2536541056 >> v2:172.21.15.192:3300/0 conn(0x7fc4f0159890 0x7fc4f015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2536541056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f015d5d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2536541056 >> 172.21.15.22:0/2536541056 conn(0x7fc4f0068e20 msgr2=0x7fc4f00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2536541056 shutdown_connections 2023-10-08T00:31:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.625+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2536541056 wait complete. 2023-10-08T00:31:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.626+0000 7fc4f60b7700 1 Processor -- start 2023-10-08T00:31:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.626+0000 7fc4f60b7700 1 -- start start 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4f60b7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4f0159890 0x7fc4f01452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4f60b7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f00c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4f60b7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4f015db10 0x7fc4f00c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4f60b7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0145830 con 0x7fc4f0159c60 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4f60b7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b5100 con 0x7fc4f0159890 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4f60b7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f00b44f0 con 0x7fc4f015db10 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4eeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f00c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4eeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f00c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38424/0 (socket says 172.21.15.22:38424) 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2842745658 learned_addr learned my addr 172.21.15.22:0/2842745658 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:15.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4ef7fe700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4f0159890 0x7fc4f01452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.627+0000 7fc4effff700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4f015db10 0x7fc4f00c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4f015db10 msgr2=0x7fc4f00c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4eeffd700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4f015db10 0x7fc4f00c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4f0159890 msgr2=0x7fc4f01452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4eeffd700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4f0159890 0x7fc4f01452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4eeffd700 1 -- 172.21.15.22:0/2842745658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e40094f0 con 0x7fc4f0159c60 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4eeffd700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f00c6840 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0070e20 tx=0x7fc4e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400bbe0 con 0x7fc4f0159c60 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e4000c90 con 0x7fc4f0159c60 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f00b47d0 con 0x7fc4f0159c60 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4011670 con 0x7fc4f0159c60 2023-10-08T00:31:15.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.628+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f00b4d90 con 0x7fc4f0159c60 2023-10-08T00:31:15.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.629+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f00b5290 con 0x7fc4f0159c60 2023-10-08T00:31:15.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.629+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc4e4011a60 con 0x7fc4f0159c60 2023-10-08T00:31:15.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.630+0000 7fc4d77fe700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc4dc067290 0x7fc4dc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.630+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4e4086300 con 0x7fc4f0159c60 2023-10-08T00:31:15.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.630+0000 7fc4ef7fe700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc4dc067290 0x7fc4dc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.630+0000 7fc4ef7fe700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc4dc067290 0x7fc4dc069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4f01554e0 tx=0x7fc4e00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.634+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4e4053160 con 0x7fc4f0159c60 2023-10-08T00:31:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.830+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f004c3c0 con 0x7fc4f0159c60 2023-10-08T00:31:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.831+0000 7fc4d77fe700 1 -- 172.21.15.22:0/2842745658 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fc4e4056780 con 0x7fc4f0159c60 2023-10-08T00:31:15.833 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:15.833 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":102,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:15.622465+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:12.943014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:13.503263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc4dc067290 msgr2=0x7fc4dc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc4dc067290 0x7fc4dc069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4f01554e0 tx=0x7fc4e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 msgr2=0x7fc4f00c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f00c6840 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc4f0070e20 tx=0x7fc4e4017000 comp rx=0 tx=0).stop 2023-10-08T00:31:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 shutdown_connections 2023-10-08T00:31:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc4dc067290 0x7fc4dc069740 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc4f015db10 0x7fc4f00c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4f0159890 0x7fc4f01452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 --2- 172.21.15.22:0/2842745658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f0159c60 0x7fc4f00c6840 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 >> 172.21.15.22:0/2842745658 conn(0x7fc4f0068e20 msgr2=0x7fc4f01543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 shutdown_connections 2023-10-08T00:31:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.833+0000 7fc4f60b7700 1 -- 172.21.15.22:0/2842745658 wait complete. 2023-10-08T00:31:15.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:31:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.969+0000 7f0870b35700 1 Processor -- start 2023-10-08T00:31:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.969+0000 7f0870b35700 1 -- start start 2023-10-08T00:31:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f0870b35700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f086c06bcd0 0x7f086c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f0870b35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06c0a0 0x7f086c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f0870b35700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c15d7e0 con 0x7f086c15df50 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f0870b35700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c15dac0 con 0x7f086c06bcd0 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f0870b35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c15aa30 con 0x7f086c06c0a0 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f086c06bcd0 0x7f086c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f086c06bcd0 0x7f086c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38438/0 (socket says 172.21.15.22:38438) 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 -- 172.21.15.22:0/3588718966 learned_addr learned my addr 172.21.15.22:0/3588718966 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 -- 172.21.15.22:0/3588718966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06c0a0 msgr2=0x7f086c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 --2- 172.21.15.22:0/3588718966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06c0a0 0x7f086c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 -- 172.21.15.22:0/3588718966 >> v1:172.21.15.192:6789/0 conn(0x7f086c15df50 legacy=0x7f086c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 -- 172.21.15.22:0/3588718966 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c15ad10 con 0x7f086c06bcd0 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086a59c700 1 --2- 172.21.15.22:0/3588718966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06bcd0 0x7f086c0caa90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0864009f20 tx=0x7f0864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa117d461c2bc3df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086959a700 1 -- 172.21.15.22:0/3588718966 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400e070 con 0x7f086c06bcd0 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086959a700 1 -- 172.21.15.22:0/3588718966 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400ba40 con 0x7f086c06bcd0 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.970+0000 7f086959a700 1 -- 172.21.15.22:0/3588718966 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08640092e0 con 0x7f086c06bcd0 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 -- 172.21.15.22:0/3588718966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06bcd0 msgr2=0x7f086c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 --2- 172.21.15.22:0/3588718966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06bcd0 0x7f086c0caa90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0864009f20 tx=0x7f0864009840 comp rx=0 tx=0).stop 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 -- 172.21.15.22:0/3588718966 shutdown_connections 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 --2- 172.21.15.22:0/3588718966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06bcd0 0x7f086c0caa90 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 --2- 172.21.15.22:0/3588718966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06c0a0 0x7f086c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 -- 172.21.15.22:0/3588718966 >> 172.21.15.22:0/3588718966 conn(0x7f086c0ce600 msgr2=0x7f086c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 -- 172.21.15.22:0/3588718966 shutdown_connections 2023-10-08T00:31:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.971+0000 7f0870b35700 1 -- 172.21.15.22:0/3588718966 wait complete. 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.972+0000 7f0870b35700 1 Processor -- start 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.972+0000 7f0870b35700 1 -- start start 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0870b35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06bcd0 0x7f086c14a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0870b35700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 0x7f086c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0870b35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c15df50 0x7f086c0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0870b35700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c14a830 con 0x7f086c06c0a0 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0870b35700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c155760 con 0x7f086c15df50 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0870b35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0c8e20 con 0x7f086c06bcd0 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 0x7f086c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 0x7f086c0c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38440/0 (socket says 172.21.15.22:38440) 2023-10-08T00:31:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 -- 172.21.15.22:0/3182938714 learned_addr learned my addr 172.21.15.22:0/3182938714 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f086a59c700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06bcd0 0x7f086c14a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 -- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06bcd0 msgr2=0x7f086c14a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f086ad9d700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c15df50 0x7f086c0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06bcd0 0x7f086c14a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 -- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c15df50 msgr2=0x7f086c0c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c15df50 0x7f086c0c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 -- 172.21.15.22:0/3182938714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864009ae0 con 0x7f086c06c0a0 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.973+0000 7f0869d9b700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 0x7f086c0c4370 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f085400b810 tx=0x7f0854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.974+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400f5f0 con 0x7f086c06c0a0 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.974+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085400f770 con 0x7f086c06c0a0 2023-10-08T00:31:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.974+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c0c9100 con 0x7f086c06c0a0 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.974+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085400fb30 con 0x7f086c06c0a0 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.974+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0c96c0 con 0x7f086c06c0a0 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.975+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c04c3c0 con 0x7f086c06c0a0 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.975+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0854010480 con 0x7f086c06c0a0 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.975+0000 7f08627fc700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f084c067290 0x7f084c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.976+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08540849b0 con 0x7f086c06c0a0 2023-10-08T00:31:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.976+0000 7f086a59c700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f084c067290 0x7f084c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.976+0000 7f086a59c700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f084c067290 0x7f084c069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0864009ab0 tx=0x7f0864017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:15.980+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0854051890 con 0x7f086c06c0a0 2023-10-08T00:31:16.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:16.217+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f086c15aff0 con 0x7f086c06c0a0 2023-10-08T00:31:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.152+0000 7f08627fc700 1 -- 172.21.15.22:0/3182938714 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0854054eb0 con 0x7f086c06c0a0 2023-10-08T00:31:17.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.154+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f084c067290 msgr2=0x7f084c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:17.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.154+0000 7f0870b35700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f084c067290 0x7f084c069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0864009ab0 tx=0x7f0864017000 comp rx=0 tx=0).stop 2023-10-08T00:31:17.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.154+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 msgr2=0x7f086c0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.154+0000 7f0870b35700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 0x7f086c0c4370 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f085400b810 tx=0x7f0854009250 comp rx=0 tx=0).stop 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 shutdown_connections 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f086c15df50 0x7f086c0c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f084c067290 0x7f084c069740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f086c06bcd0 0x7f086c14a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 --2- 172.21.15.22:0/3182938714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f086c06c0a0 0x7f086c0c4370 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 >> 172.21.15.22:0/3182938714 conn(0x7f086c0ce600 msgr2=0x7f086c156030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 shutdown_connections 2023-10-08T00:31:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.155+0000 7f0870b35700 1 -- 172.21.15.22:0/3182938714 wait complete. 2023-10-08T00:31:17.171 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:31:17.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.298+0000 7f489d32f700 1 Processor -- start 2023-10-08T00:31:17.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.298+0000 7f489d32f700 1 -- start start 2023-10-08T00:31:17.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f489d32f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4898159c60 0x7f489815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:17.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f489d32f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f489815db10 0x7f4898069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:17.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f489d32f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489815a160 con 0x7f4898159890 2023-10-08T00:31:17.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f489d32f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489815df50 con 0x7f4898159c60 2023-10-08T00:31:17.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f489d32f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980d13a0 con 0x7f489815db10 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f48967fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4898159c60 0x7f489815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f4896ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4898159890 0x7f489815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39532/0 (socket says 172.21.15.22:39532) 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.299+0000 7f4896ffd700 1 -- 172.21.15.22:0/162650317 learned_addr learned my addr 172.21.15.22:0/162650317 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48977fe700 1 --2- 172.21.15.22:0/162650317 >> v2:172.21.15.192:3300/0 conn(0x7f489815db10 0x7f4898069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f4895ffb700 1 -- 172.21.15.22:0/162650317 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299286123 0 0) 0x7f489815a160 con 0x7f4898159890 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f4895ffb700 1 -- 172.21.15.22:0/162650317 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4884003570 con 0x7f4898159890 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48967fc700 1 -- 172.21.15.22:0/162650317 >> v2:172.21.15.192:3300/0 conn(0x7f489815db10 msgr2=0x7f4898069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48967fc700 1 --2- 172.21.15.22:0/162650317 >> v2:172.21.15.192:3300/0 conn(0x7f489815db10 0x7f4898069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48967fc700 1 -- 172.21.15.22:0/162650317 >> v1:172.21.15.22:6789/0 conn(0x7f4898159890 legacy=0x7f489815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48967fc700 1 -- 172.21.15.22:0/162650317 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489815e140 con 0x7f4898159c60 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48977fe700 1 --2- 172.21.15.22:0/162650317 >> v2:172.21.15.192:3300/0 conn(0x7f489815db10 0x7f4898069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f48967fc700 1 --2- 172.21.15.22:0/162650317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159c60 0x7f489815d5d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f489806a890 tx=0x7f48800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15951cf78b29e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:17.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f4895ffb700 1 -- 172.21.15.22:0/162650317 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011630 con 0x7f4898159c60 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f4895ffb700 1 -- 172.21.15.22:0/162650317 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880011790 con 0x7f4898159c60 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f4895ffb700 1 -- 172.21.15.22:0/162650317 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011b30 con 0x7f4898159c60 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 -- 172.21.15.22:0/162650317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159c60 msgr2=0x7f489815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 --2- 172.21.15.22:0/162650317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159c60 0x7f489815d5d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f489806a890 tx=0x7f48800091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 -- 172.21.15.22:0/162650317 shutdown_connections 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 --2- 172.21.15.22:0/162650317 >> v2:172.21.15.192:3300/0 conn(0x7f489815db10 0x7f4898069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 --2- 172.21.15.22:0/162650317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159c60 0x7f489815d5d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 -- 172.21.15.22:0/162650317 >> 172.21.15.22:0/162650317 conn(0x7f4898068e20 msgr2=0x7f48980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.300+0000 7f489d32f700 1 -- 172.21.15.22:0/162650317 shutdown_connections 2023-10-08T00:31:17.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.301+0000 7f489d32f700 1 -- 172.21.15.22:0/162650317 wait complete. 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 Processor -- start 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 -- start start 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 0x7f489813e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4898159c60 0x7f489816ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489815db10 0x7f489816d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980c8da0 con 0x7f4898159890 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980cea00 con 0x7f489815db10 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.302+0000 7f489d32f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48980c9340 con 0x7f4898159c60 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 0x7f489813e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:17.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 0x7f489813e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50186/0 (socket says 172.21.15.22:50186) 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 -- 172.21.15.22:0/1392165033 learned_addr learned my addr 172.21.15.22:0/1392165033 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f48977fe700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489815db10 0x7f489816d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f48967fc700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4898159c60 0x7f489816ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 -- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4898159c60 msgr2=0x7f489816ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4898159c60 0x7f489816ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 -- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489815db10 msgr2=0x7f489816d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489815db10 0x7f489816d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 -- 172.21.15.22:0/1392165033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009420 con 0x7f4898159890 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f48977fe700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489815db10 0x7f489816d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f48967fc700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4898159c60 0x7f489816ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f4896ffd700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 0x7f489813e0c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f488800cd30 tx=0x7f4888001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:17.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800ab70 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800acf0 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48980ce440 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888007340 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.303+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48980c8fd0 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.304+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489804c3c0 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.305+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4888007730 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.305+0000 7f488effd700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4878067290 0x7f4878069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.305+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48880850b0 con 0x7f4898159890 2023-10-08T00:31:17.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.305+0000 7f48967fc700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4878067290 0x7f4878069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:17.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.306+0000 7f48967fc700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4878067290 0x7f4878069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4898145020 tx=0x7f4880017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:17.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.309+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4888051e50 con 0x7f4898159890 2023-10-08T00:31:17.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:17.546+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f489806a5b0 con 0x7f4898159890 2023-10-08T00:31:18.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.153+0000 7f488effd700 1 -- 172.21.15.22:0/1392165033 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7f488800ae60 con 0x7f4898159890 2023-10-08T00:31:18.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.155+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4878067290 msgr2=0x7f4878069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.155+0000 7f489d32f700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4878067290 0x7f4878069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4898145020 tx=0x7f4880017000 comp rx=0 tx=0).stop 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 msgr2=0x7f489813e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 0x7f489813e0c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f488800cd30 tx=0x7f4888001b10 comp rx=0 tx=0).stop 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 shutdown_connections 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f489815db10 0x7f489816d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4898159890 0x7f489813e0c0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4878067290 0x7f4878069740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 --2- 172.21.15.22:0/1392165033 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4898159c60 0x7f489816ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 >> 172.21.15.22:0/1392165033 conn(0x7f4898068e20 msgr2=0x7f48980b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 shutdown_connections 2023-10-08T00:31:18.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.156+0000 7f489d32f700 1 -- 172.21.15.22:0/1392165033 wait complete. 2023-10-08T00:31:18.172 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.298+0000 7f7277452700 1 Processor -- start 2023-10-08T00:31:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.298+0000 7f7277452700 1 -- start start 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f7277452700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7270159890 0x7f727015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f7277452700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7270159c60 0x7f727015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f7277452700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f727015db10 0x7f7270069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f7277452700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727015a160 con 0x7f727015db10 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f7277452700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72700d13a0 con 0x7f7270159c60 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f7277452700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727015e140 con 0x7f7270159890 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f727015db10 0x7f7270069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f727015db10 0x7f7270069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50188/0 (socket says 172.21.15.22:50188) 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 -- 172.21.15.22:0/2240321598 learned_addr learned my addr 172.21.15.22:0/2240321598 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:18.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72749ed700 1 --2- 172.21.15.22:0/2240321598 >> v2:172.21.15.192:3300/0 conn(0x7f7270159c60 0x7f727015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72751ee700 1 --2- 172.21.15.22:0/2240321598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7270159890 0x7f727015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 -- 172.21.15.22:0/2240321598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7270159890 msgr2=0x7f727015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 --2- 172.21.15.22:0/2240321598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7270159890 0x7f727015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 -- 172.21.15.22:0/2240321598 >> v2:172.21.15.192:3300/0 conn(0x7f7270159c60 msgr2=0x7f727015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 --2- 172.21.15.22:0/2240321598 >> v2:172.21.15.192:3300/0 conn(0x7f7270159c60 0x7f727015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72759ef700 1 -- 172.21.15.22:0/2240321598 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727015a3d0 con 0x7f727015db10 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.299+0000 7f72749ed700 1 --2- 172.21.15.22:0/2240321598 >> v2:172.21.15.192:3300/0 conn(0x7f7270159c60 0x7f727015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f72759ef700 1 --2- 172.21.15.22:0/2240321598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727015db10 0x7f7270069560 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f72700650f0 tx=0x7f7268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1d9bec715c7ac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f726ffff700 1 -- 172.21.15.22:0/2240321598 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800b860 con 0x7f727015db10 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f726ffff700 1 -- 172.21.15.22:0/2240321598 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726800b9c0 con 0x7f727015db10 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f726ffff700 1 -- 172.21.15.22:0/2240321598 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800bd60 con 0x7f727015db10 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 -- 172.21.15.22:0/2240321598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727015db10 msgr2=0x7f7270069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 --2- 172.21.15.22:0/2240321598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727015db10 0x7f7270069560 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f72700650f0 tx=0x7f7268009250 comp rx=0 tx=0).stop 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 -- 172.21.15.22:0/2240321598 shutdown_connections 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 --2- 172.21.15.22:0/2240321598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f727015db10 0x7f7270069560 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 --2- 172.21.15.22:0/2240321598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7270159890 0x7f727015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 --2- 172.21.15.22:0/2240321598 >> v2:172.21.15.192:3300/0 conn(0x7f7270159c60 0x7f727015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 -- 172.21.15.22:0/2240321598 >> 172.21.15.22:0/2240321598 conn(0x7f7270068e20 msgr2=0x7f72700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 -- 172.21.15.22:0/2240321598 shutdown_connections 2023-10-08T00:31:18.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.300+0000 7f7277452700 1 -- 172.21.15.22:0/2240321598 wait complete. 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.301+0000 7f7277452700 1 Processor -- start 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 -- start start 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 0x7f72701491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7270159c60 0x7f72700b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f727015db10 0x7f72700b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72700b4f70 con 0x7f7270159890 2023-10-08T00:31:18.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270155bb0 con 0x7f7270159c60 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f7277452700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700b46d0 con 0x7f727015db10 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f72751ee700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 0x7f72701491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.302+0000 7f72751ee700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 0x7f72701491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50190/0 (socket says 172.21.15.22:50190) 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 -- 172.21.15.22:0/2296229163 learned_addr learned my addr 172.21.15.22:0/2296229163 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72749ed700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7270159c60 0x7f72700b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72759ef700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f727015db10 0x7f72700b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 -- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f727015db10 msgr2=0x7f72700b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f727015db10 0x7f72700b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 -- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7270159c60 msgr2=0x7f72700b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7270159c60 0x7f72700b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 -- 172.21.15.22:0/2296229163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680094f0 con 0x7f7270159890 2023-10-08T00:31:18.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72759ef700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f727015db10 0x7f72700b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f72751ee700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 0x7f72701491a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f726000e190 tx=0x7f7260009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000ed80 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260014420 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72700b49b0 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72600147e0 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.303+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72700ce710 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.304+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72700cea80 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.305+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7260014b90 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.305+0000 7f726d7fa700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f725c067290 0x7f725c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.305+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7260085220 con 0x7f7270159890 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.305+0000 7f72749ed700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f725c067290 0x7f725c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.306+0000 7f72749ed700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f725c067290 0x7f725c069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f72700cc750 tx=0x7f7264008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:18.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.309+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7260052080 con 0x7f7270159890 2023-10-08T00:31:18.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.545+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72700ce570 con 0x7f7270159890 2023-10-08T00:31:18.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.546+0000 7f726d7fa700 1 -- 172.21.15.22:0/2296229163 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f72700ce570 con 0x7f7270159890 2023-10-08T00:31:18.548 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:18.548 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:14.535940+0000","modified":"2023-10-08T00:31:18.152403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3654432591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3654432591},{"type":"v1","addr":"172.21.15.22:6835","nonce":3654432591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f725c067290 msgr2=0x7f725c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f725c067290 0x7f725c069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f72700cc750 tx=0x7f7264008040 comp rx=0 tx=0).stop 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 msgr2=0x7f72701491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 0x7f72701491a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f726000e190 tx=0x7f7260009920 comp rx=0 tx=0).stop 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 shutdown_connections 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f725c067290 0x7f725c069740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f727015db10 0x7f72700b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7270159890 0x7f72701491a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 --2- 172.21.15.22:0/2296229163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7270159c60 0x7f72700b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 >> 172.21.15.22:0/2296229163 conn(0x7f7270068e20 msgr2=0x7f727015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:18.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 shutdown_connections 2023-10-08T00:31:18.551 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.548+0000 7f7277452700 1 -- 172.21.15.22:0/2296229163 wait complete. 2023-10-08T00:31:18.551 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 69 2023-10-08T00:31:18.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.679+0000 7f7f62d85700 1 Processor -- start 2023-10-08T00:31:18.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.679+0000 7f7f62d85700 1 -- start start 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f62d85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 0x7f7f5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f62d85700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7f5c159c60 0x7f7f5c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f62d85700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c15a160 con 0x7f7f5c15db10 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f62d85700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0d13a0 con 0x7f7f5c159c60 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f62d85700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c15e140 con 0x7f7f5c159890 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f61322700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7f5c15db10 0x7f7f5c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39540/0 (socket says 172.21.15.22:39540) 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f61322700 1 -- 172.21.15.22:0/1619591645 learned_addr learned my addr 172.21.15.22:0/1619591645 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886110810 0 0) 0x7f7f5c15a160 con 0x7f7f5c15db10 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f60b21700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 0x7f7f5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5bfff700 1 --2- 172.21.15.22:0/1619591645 >> v2:172.21.15.192:3300/0 conn(0x7f7f5c159c60 0x7f7f5c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f4c003570 con 0x7f7f5c15db10 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171036440 0 0) 0x7f7f4c003570 con 0x7f7f5c15db10 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 msgr2=0x7f7f5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5b7fe700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 0x7f7f5c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.680+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 >> v2:172.21.15.192:3300/0 conn(0x7f7f5c159c60 msgr2=0x7f7f5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 --2- 172.21.15.22:0/1619591645 >> v2:172.21.15.192:3300/0 conn(0x7f7f5c159c60 0x7f7f5c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c15a3d0 con 0x7f7f5c15db10 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f7f540017f0 con 0x7f7f5c15db10 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 >> v1:172.21.15.22:6789/0 conn(0x7f7f5c15db10 legacy=0x7f7f5c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f4c003a60 0x7f7f4c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 0x7f7f4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c004d50 0x7f7f4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0d13a0 con 0x7f7f4c003a60 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c15e140 con 0x7f7f4c004d50 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4c00ba60 con 0x7f7f5c159890 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f4c003a60 0x7f7f4c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5bfff700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 0x7f7f4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f61322700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c004d50 0x7f7f4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 -- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 msgr2=0x7f7f4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:18.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c159890 0x7f7f4c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 -- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c004d50 msgr2=0x7f7f4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c004d50 0x7f7f4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 -- 172.21.15.22:0/1619591645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c003570 con 0x7f7f4c003a60 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f61322700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c004d50 0x7f7f4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f60b21700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f4c003a60 0x7f7f4c003e70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009c00 tx=0x7f7f500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582d90f14e58db5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000e6b0 con 0x7f7f4c003a60 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5000e810 con 0x7f7f4c003a60 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.681+0000 7f7f5b7fe700 1 -- 172.21.15.22:0/1619591645 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000ebd0 con 0x7f7f4c003a60 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f62d85700 1 -- 172.21.15.22:0/1619591645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f4c003a60 msgr2=0x7f7f4c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f62d85700 1 --2- 172.21.15.22:0/1619591645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f4c003a60 0x7f7f4c003e70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f7f50009c00 tx=0x7f7f500091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f61322700 1 -- 172.21.15.22:0/1619591645 reap_dead start 2023-10-08T00:31:18.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f62d85700 1 -- 172.21.15.22:0/1619591645 shutdown_connections 2023-10-08T00:31:18.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f62d85700 1 -- 172.21.15.22:0/1619591645 >> 172.21.15.22:0/1619591645 conn(0x7f7f5c068e20 msgr2=0x7f7f5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:18.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f62d85700 1 -- 172.21.15.22:0/1619591645 shutdown_connections 2023-10-08T00:31:18.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.682+0000 7f7f62d85700 1 -- 172.21.15.22:0/1619591645 wait complete. 2023-10-08T00:31:18.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.683+0000 7f7f62d85700 1 Processor -- start 2023-10-08T00:31:18.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.683+0000 7f7f62d85700 1 -- start start 2023-10-08T00:31:18.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f62d85700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c003a60 0x7f7f5c169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f62d85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c1471f0 0x7f7f5c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f62d85700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 0x7f7f5c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f62d85700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c16a100 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f62d85700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b4bf0 con 0x7f7f4c003a60 2023-10-08T00:31:18.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f62d85700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0b3fe0 con 0x7f7f5c1471f0 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 0x7f7f5c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 0x7f7f5c0c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50206/0 (socket says 172.21.15.22:50206) 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 -- 172.21.15.22:0/3125386769 learned_addr learned my addr 172.21.15.22:0/3125386769 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f5bfff700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c1471f0 0x7f7f5c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f60b21700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c003a60 0x7f7f5c169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 -- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c1471f0 msgr2=0x7f7f5c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c1471f0 0x7f7f5c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 -- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c003a60 msgr2=0x7f7f5c169bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c003a60 0x7f7f5c169bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 -- 172.21.15.22:0/3125386769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0b42c0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.684+0000 7f7f61322700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 0x7f7f5c0c69f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7f54001350 tx=0x7f7f54002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.685+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5400eb80 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.685+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5400ece0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.685+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c0b45a0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.685+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54013670 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.685+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c0cfcf0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.686+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c0b4d80 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.686+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7f54013aa0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.687+0000 7f7f58ff9700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f40067290 0x7f7f40069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:18.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.687+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7f540850b0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.687+0000 7f7f60b21700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f40067290 0x7f7f40069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:18.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.687+0000 7f7f60b21700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f40067290 0x7f7f40069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7f500091e0 tx=0x7f7f5001a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:18.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.691+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f54051f10 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.887+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f5c04c3c0 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.888+0000 7f7f58ff9700 1 -- 172.21.15.22:0/3125386769 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f7f54055530 con 0x7f7f5c0b3ad0 2023-10-08T00:31:18.890 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:18.890 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":102,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:15.622465+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:12.943014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:13.503263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f40067290 msgr2=0x7f7f40069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f40067290 0x7f7f40069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7f500091e0 tx=0x7f7f5001a000 comp rx=0 tx=0).stop 2023-10-08T00:31:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 msgr2=0x7f7f5c0c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:18.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 0x7f7f5c0c69f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f7f54001350 tx=0x7f7f54002180 comp rx=0 tx=0).stop 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 shutdown_connections 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f5c0b3ad0 0x7f7f5c0c69f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f4c003a60 0x7f7f5c169bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f40067290 0x7f7f40069740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 --2- 172.21.15.22:0/3125386769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f5c1471f0 0x7f7f5c0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 >> 172.21.15.22:0/3125386769 conn(0x7f7f5c068e20 msgr2=0x7f7f5c152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:18.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 shutdown_connections 2023-10-08T00:31:18.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:18.890+0000 7f7f62d85700 1 -- 172.21.15.22:0/3125386769 wait complete. 2023-10-08T00:31:18.904 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:31:18.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:31:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.022+0000 7fdfecfa8700 1 Processor -- start 2023-10-08T00:31:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.022+0000 7fdfecfa8700 1 -- start start 2023-10-08T00:31:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.022+0000 7fdfecfa8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfe8159c60 0x7fdfe815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.022+0000 7fdfecfa8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfe815db10 0x7fdfe8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfecfa8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe815a160 con 0x7fdfe8159890 2023-10-08T00:31:19.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfecfa8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe815df50 con 0x7fdfe8159c60 2023-10-08T00:31:19.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfecfa8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80d13a0 con 0x7fdfe815db10 2023-10-08T00:31:19.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfe8159c60 0x7fdfe815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdfe8159c60 0x7fdfe815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50218/0 (socket says 172.21.15.22:50218) 2023-10-08T00:31:19.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/4251800519 learned_addr learned my addr 172.21.15.22:0/4251800519 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:19.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe6d9d700 1 --2- 172.21.15.22:0/4251800519 >> v2:172.21.15.192:3300/0 conn(0x7fdfe815db10 0x7fdfe8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/4251800519 >> v2:172.21.15.192:3300/0 conn(0x7fdfe815db10 msgr2=0x7fdfe8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:19.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 --2- 172.21.15.22:0/4251800519 >> v2:172.21.15.192:3300/0 conn(0x7fdfe815db10 0x7fdfe8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/4251800519 >> v1:172.21.15.192:6789/0 conn(0x7fdfe8159890 legacy=0x7fdfe815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/4251800519 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe815e140 con 0x7fdfe8159c60 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe5d9b700 1 --2- 172.21.15.22:0/4251800519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe815d5d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdfe806a890 tx=0x7fdfd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a66b6b5f15249d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe559a700 1 -- 172.21.15.22:0/4251800519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000b860 con 0x7fdfe8159c60 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe559a700 1 -- 172.21.15.22:0/4251800519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd000b9c0 con 0x7fdfe8159c60 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.023+0000 7fdfe559a700 1 -- 172.21.15.22:0/4251800519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000bd60 con 0x7fdfe8159c60 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 -- 172.21.15.22:0/4251800519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 msgr2=0x7fdfe815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/4251800519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe815d5d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdfe806a890 tx=0x7fdfd0009250 comp rx=0 tx=0).stop 2023-10-08T00:31:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 -- 172.21.15.22:0/4251800519 shutdown_connections 2023-10-08T00:31:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/4251800519 >> v2:172.21.15.192:3300/0 conn(0x7fdfe815db10 0x7fdfe8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/4251800519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe815d5d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 -- 172.21.15.22:0/4251800519 >> 172.21.15.22:0/4251800519 conn(0x7fdfe8068e20 msgr2=0x7fdfe80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 -- 172.21.15.22:0/4251800519 shutdown_connections 2023-10-08T00:31:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.024+0000 7fdfecfa8700 1 -- 172.21.15.22:0/4251800519 wait complete. 2023-10-08T00:31:19.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.025+0000 7fdfecfa8700 1 Processor -- start 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.025+0000 7fdfecfa8700 1 -- start start 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfecfa8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe8159890 0x7fdfe814d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfecfa8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfecfa8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe815db10 0x7fdfe80cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfecfa8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80b5340 con 0x7fdfe8159c60 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfecfa8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80b4970 con 0x7fdfe815db10 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfecfa8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80cec10 con 0x7fdfe8159890 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe80b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50234/0 (socket says 172.21.15.22:50234) 2023-10-08T00:31:19.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/2197223491 learned_addr learned my addr 172.21.15.22:0/2197223491 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe6d9d700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe815db10 0x7fdfe80cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe659c700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe8159890 0x7fdfe814d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe8159890 msgr2=0x7fdfe814d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe8159890 0x7fdfe814d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe815db10 msgr2=0x7fdfe80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe815db10 0x7fdfe80cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 -- 172.21.15.22:0/2197223491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00094f0 con 0x7fdfe8159c60 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfe5d9b700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe80b4e00 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8070e20 tx=0x7fdfd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.026+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0024440 con 0x7fdfe8159c60 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.027+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd00245a0 con 0x7fdfe8159c60 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.027+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0024960 con 0x7fdfe8159c60 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.027+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe80cfe60 con 0x7fdfe8159c60 2023-10-08T00:31:19.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.027+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe80b4320 con 0x7fdfe8159c60 2023-10-08T00:31:19.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.028+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe80b4ae0 con 0x7fdfe8159c60 2023-10-08T00:31:19.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.028+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdfd001a420 con 0x7fdfe8159c60 2023-10-08T00:31:19.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.028+0000 7fdfde7fc700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8067290 0x7fdfc8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.028+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdfd00867c0 con 0x7fdfe8159c60 2023-10-08T00:31:19.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.029+0000 7fdfe659c700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8067290 0x7fdfc8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.029+0000 7fdfe659c700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8067290 0x7fdfc8069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8003a80 tx=0x7fdfd8007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.032+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfd0053620 con 0x7fdfe8159c60 2023-10-08T00:31:19.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.221+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfe804c3c0 con 0x7fdfc8067290 2023-10-08T00:31:19.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.231+0000 7fdfde7fc700 1 -- 172.21.15.22:0/2197223491 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289761 (secure 0 0 0) 0x7fdfe804c3c0 con 0x7fdfc8067290 2023-10-08T00:31:19.235 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:19.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8067290 msgr2=0x7fdfc8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8067290 0x7fdfc8069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8003a80 tx=0x7fdfd8007ec0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 msgr2=0x7fdfe80b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe80b4e00 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8070e20 tx=0x7fdfd0017000 comp rx=0 tx=0).stop 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 shutdown_connections 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe815db10 0x7fdfe80cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdfc8067290 0x7fdfc8069740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdfe8159890 0x7fdfe814d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 --2- 172.21.15.22:0/2197223491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfe8159c60 0x7fdfe80b4e00 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 >> 172.21.15.22:0/2197223491 conn(0x7fdfe8068e20 msgr2=0x7fdfe815b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 shutdown_connections 2023-10-08T00:31:19.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.234+0000 7fdfecfa8700 1 -- 172.21.15.22:0/2197223491 wait complete. 2023-10-08T00:31:19.241 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:31:19.247 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-10-08T00:31:18.474977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409808,"kb_used_data":11024,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752564912,"statfs":{"total":773094113280,"available":770626469888,"internally_reserved":0,"allocated":11288576,"data_stored":5526390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.352724"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639607+0000","last_change":"2023-10-08T00:31:14.639607+0000","last_active":"2023-10-08T00:31:14.639607+0000","last_peered":"2023-10-08T00:31:14.639607+0000","last_clean":"2023-10-08T00:31:14.639607+0000","last_became_active":"2023-10-08T00:31:14.639404+0000","last_became_peered":"2023-10-08T00:31:14.639404+0000","last_unstale":"2023-10-08T00:31:14.639607+0000","last_undegraded":"2023-10-08T00:31:14.639607+0000","last_fullsized":"2023-10-08T00:31:14.639607+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:32.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635182+0000","last_change":"2023-10-08T00:31:14.635182+0000","last_active":"2023-10-08T00:31:14.635182+0000","last_peered":"2023-10-08T00:31:14.635182+0000","last_clean":"2023-10-08T00:31:14.635182+0000","last_became_active":"2023-10-08T00:31:14.634854+0000","last_became_peered":"2023-10-08T00:31:14.634854+0000","last_unstale":"2023-10-08T00:31:14.635182+0000","last_undegraded":"2023-10-08T00:31:14.635182+0000","last_fullsized":"2023-10-08T00:31:14.635182+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:27:45.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640511+0000","last_change":"2023-10-08T00:31:14.640511+0000","last_active":"2023-10-08T00:31:14.640511+0000","last_peered":"2023-10-08T00:31:14.640511+0000","last_clean":"2023-10-08T00:31:14.640511+0000","last_became_active":"2023-10-08T00:31:14.639147+0000","last_became_peered":"2023-10-08T00:31:14.639147+0000","last_unstale":"2023-10-08T00:31:14.640511+0000","last_undegraded":"2023-10-08T00:31:14.640511+0000","last_fullsized":"2023-10-08T00:31:14.640511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:41.469959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640725+0000","last_change":"2023-10-08T00:31:14.640725+0000","last_active":"2023-10-08T00:31:14.640725+0000","last_peered":"2023-10-08T00:31:14.640725+0000","last_clean":"2023-10-08T00:31:14.640725+0000","last_became_active":"2023-10-08T00:31:14.640422+0000","last_became_peered":"2023-10-08T00:31:14.640422+0000","last_unstale":"2023-10-08T00:31:14.640725+0000","last_undegraded":"2023-10-08T00:31:14.640725+0000","last_fullsized":"2023-10-08T00:31:14.640725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:39.348793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635830+0000","last_change":"2023-10-08T00:31:14.635830+0000","last_active":"2023-10-08T00:31:14.635830+0000","last_peered":"2023-10-08T00:31:14.635830+0000","last_clean":"2023-10-08T00:31:14.635830+0000","last_became_active":"2023-10-08T00:31:14.635578+0000","last_became_peered":"2023-10-08T00:31:14.635578+0000","last_unstale":"2023-10-08T00:31:14.635830+0000","last_undegraded":"2023-10-08T00:31:14.635830+0000","last_fullsized":"2023-10-08T00:31:14.635830+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:56.084213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636144+0000","last_change":"2023-10-08T00:31:14.636144+0000","last_active":"2023-10-08T00:31:14.636144+0000","last_peered":"2023-10-08T00:31:14.636144+0000","last_clean":"2023-10-08T00:31:14.636144+0000","last_became_active":"2023-10-08T00:31:14.635878+0000","last_became_peered":"2023-10-08T00:31:14.635878+0000","last_unstale":"2023-10-08T00:31:14.636144+0000","last_undegraded":"2023-10-08T00:31:14.636144+0000","last_fullsized":"2023-10-08T00:31:14.636144+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:16.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638380+0000","last_change":"2023-10-08T00:31:14.638380+0000","last_active":"2023-10-08T00:31:14.638380+0000","last_peered":"2023-10-08T00:31:14.638380+0000","last_clean":"2023-10-08T00:31:14.638380+0000","last_became_active":"2023-10-08T00:31:14.638123+0000","last_became_peered":"2023-10-08T00:31:14.638123+0000","last_unstale":"2023-10-08T00:31:14.638380+0000","last_undegraded":"2023-10-08T00:31:14.638380+0000","last_fullsized":"2023-10-08T00:31:14.638380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:20.319595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.634439+0000","last_change":"2023-10-08T00:31:14.634439+0000","last_active":"2023-10-08T00:31:14.634439+0000","last_peered":"2023-10-08T00:31:14.634439+0000","last_clean":"2023-10-08T00:31:14.634439+0000","last_became_active":"2023-10-08T00:31:14.632634+0000","last_became_peered":"2023-10-08T00:31:14.632634+0000","last_unstale":"2023-10-08T00:31:14.634439+0000","last_undegraded":"2023-10-08T00:31:14.634439+0000","last_fullsized":"2023-10-08T00:31:14.634439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:29.340435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639183+0000","last_change":"2023-10-08T00:31:14.639183+0000","last_active":"2023-10-08T00:31:14.639183+0000","last_peered":"2023-10-08T00:31:14.639183+0000","last_clean":"2023-10-08T00:31:14.639183+0000","last_became_active":"2023-10-08T00:31:14.638595+0000","last_became_peered":"2023-10-08T00:31:14.638595+0000","last_unstale":"2023-10-08T00:31:14.639183+0000","last_undegraded":"2023-10-08T00:31:14.639183+0000","last_fullsized":"2023-10-08T00:31:14.639183+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:15:55.622214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.634867+0000","last_change":"2023-10-08T00:31:14.634867+0000","last_active":"2023-10-08T00:31:14.634867+0000","last_peered":"2023-10-08T00:31:14.634867+0000","last_clean":"2023-10-08T00:31:14.634867+0000","last_became_active":"2023-10-08T00:31:14.634522+0000","last_became_peered":"2023-10-08T00:31:14.634522+0000","last_unstale":"2023-10-08T00:31:14.634867+0000","last_undegraded":"2023-10-08T00:31:14.634867+0000","last_fullsized":"2023-10-08T00:31:14.634867+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:04:20.096924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638837+0000","last_change":"2023-10-08T00:31:14.638837+0000","last_active":"2023-10-08T00:31:14.638837+0000","last_peered":"2023-10-08T00:31:14.638837+0000","last_clean":"2023-10-08T00:31:14.638837+0000","last_became_active":"2023-10-08T00:31:14.638563+0000","last_became_peered":"2023-10-08T00:31:14.638563+0000","last_unstale":"2023-10-08T00:31:14.638837+0000","last_undegraded":"2023-10-08T00:31:14.638837+0000","last_fullsized":"2023-10-08T00:31:14.638837+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:48.057037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636389+0000","last_change":"2023-10-08T00:31:14.636389+0000","last_active":"2023-10-08T00:31:14.636389+0000","last_peered":"2023-10-08T00:31:14.636389+0000","last_clean":"2023-10-08T00:31:14.636389+0000","last_became_active":"2023-10-08T00:31:14.636079+0000","last_became_peered":"2023-10-08T00:31:14.636079+0000","last_unstale":"2023-10-08T00:31:14.636389+0000","last_undegraded":"2023-10-08T00:31:14.636389+0000","last_fullsized":"2023-10-08T00:31:14.636389+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:32.665570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636847+0000","last_change":"2023-10-08T00:31:14.636847+0000","last_active":"2023-10-08T00:31:14.636847+0000","last_peered":"2023-10-08T00:31:14.636847+0000","last_clean":"2023-10-08T00:31:14.636847+0000","last_became_active":"2023-10-08T00:31:14.636387+0000","last_became_peered":"2023-10-08T00:31:14.636387+0000","last_unstale":"2023-10-08T00:31:14.636847+0000","last_undegraded":"2023-10-08T00:31:14.636847+0000","last_fullsized":"2023-10-08T00:31:14.636847+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:48.656174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639912+0000","last_change":"2023-10-08T00:31:14.639912+0000","last_active":"2023-10-08T00:31:14.639912+0000","last_peered":"2023-10-08T00:31:14.639912+0000","last_clean":"2023-10-08T00:31:14.639912+0000","last_became_active":"2023-10-08T00:31:14.637186+0000","last_became_peered":"2023-10-08T00:31:14.637186+0000","last_unstale":"2023-10-08T00:31:14.639912+0000","last_undegraded":"2023-10-08T00:31:14.639912+0000","last_fullsized":"2023-10-08T00:31:14.639912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:30.392525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636349+0000","last_change":"2023-10-08T00:31:14.636349+0000","last_active":"2023-10-08T00:31:14.636349+0000","last_peered":"2023-10-08T00:31:14.636349+0000","last_clean":"2023-10-08T00:31:14.636349+0000","last_became_active":"2023-10-08T00:31:14.636046+0000","last_became_peered":"2023-10-08T00:31:14.636046+0000","last_unstale":"2023-10-08T00:31:14.636349+0000","last_undegraded":"2023-10-08T00:31:14.636349+0000","last_fullsized":"2023-10-08T00:31:14.636349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:15.979614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638911+0000","last_change":"2023-10-08T00:31:14.638911+0000","last_active":"2023-10-08T00:31:14.638911+0000","last_peered":"2023-10-08T00:31:14.638911+0000","last_clean":"2023-10-08T00:31:14.638911+0000","last_became_active":"2023-10-08T00:31:14.637661+0000","last_became_peered":"2023-10-08T00:31:14.637661+0000","last_unstale":"2023-10-08T00:31:14.638911+0000","last_undegraded":"2023-10-08T00:31:14.638911+0000","last_fullsized":"2023-10-08T00:31:14.638911+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:45.332909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638880+0000","last_change":"2023-10-08T00:31:14.638880+0000","last_active":"2023-10-08T00:31:14.638880+0000","last_peered":"2023-10-08T00:31:14.638880+0000","last_clean":"2023-10-08T00:31:14.638880+0000","last_became_active":"2023-10-08T00:31:14.638609+0000","last_became_peered":"2023-10-08T00:31:14.638609+0000","last_unstale":"2023-10-08T00:31:14.638880+0000","last_undegraded":"2023-10-08T00:31:14.638880+0000","last_fullsized":"2023-10-08T00:31:14.638880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:49.184354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638292+0000","last_change":"2023-10-08T00:31:14.638292+0000","last_active":"2023-10-08T00:31:14.638292+0000","last_peered":"2023-10-08T00:31:14.638292+0000","last_clean":"2023-10-08T00:31:14.638292+0000","last_became_active":"2023-10-08T00:31:14.638036+0000","last_became_peered":"2023-10-08T00:31:14.638036+0000","last_unstale":"2023-10-08T00:31:14.638292+0000","last_undegraded":"2023-10-08T00:31:14.638292+0000","last_fullsized":"2023-10-08T00:31:14.638292+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:26.797118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636858+0000","last_change":"2023-10-08T00:31:14.636858+0000","last_active":"2023-10-08T00:31:14.636858+0000","last_peered":"2023-10-08T00:31:14.636858+0000","last_clean":"2023-10-08T00:31:14.636858+0000","last_became_active":"2023-10-08T00:31:14.636250+0000","last_became_peered":"2023-10-08T00:31:14.636250+0000","last_unstale":"2023-10-08T00:31:14.636858+0000","last_undegraded":"2023-10-08T00:31:14.636858+0000","last_fullsized":"2023-10-08T00:31:14.636858+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:13.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633897+0000","last_change":"2023-10-08T00:31:14.633897+0000","last_active":"2023-10-08T00:31:14.633897+0000","last_peered":"2023-10-08T00:31:14.633897+0000","last_clean":"2023-10-08T00:31:14.633897+0000","last_became_active":"2023-10-08T00:31:14.633612+0000","last_became_peered":"2023-10-08T00:31:14.633612+0000","last_unstale":"2023-10-08T00:31:14.633897+0000","last_undegraded":"2023-10-08T00:31:14.633897+0000","last_fullsized":"2023-10-08T00:31:14.633897+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:19.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636188+0000","last_change":"2023-10-08T00:31:14.636188+0000","last_active":"2023-10-08T00:31:14.636188+0000","last_peered":"2023-10-08T00:31:14.636188+0000","last_clean":"2023-10-08T00:31:14.636188+0000","last_became_active":"2023-10-08T00:31:14.635921+0000","last_became_peered":"2023-10-08T00:31:14.635921+0000","last_unstale":"2023-10-08T00:31:14.636188+0000","last_undegraded":"2023-10-08T00:31:14.636188+0000","last_fullsized":"2023-10-08T00:31:14.636188+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:18.990112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640632+0000","last_change":"2023-10-08T00:31:14.640632+0000","last_active":"2023-10-08T00:31:14.640632+0000","last_peered":"2023-10-08T00:31:14.640632+0000","last_clean":"2023-10-08T00:31:14.640632+0000","last_became_active":"2023-10-08T00:31:14.640395+0000","last_became_peered":"2023-10-08T00:31:14.640395+0000","last_unstale":"2023-10-08T00:31:14.640632+0000","last_undegraded":"2023-10-08T00:31:14.640632+0000","last_fullsized":"2023-10-08T00:31:14.640632+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:20.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633929+0000","last_change":"2023-10-08T00:31:14.633929+0000","last_active":"2023-10-08T00:31:14.633929+0000","last_peered":"2023-10-08T00:31:14.633929+0000","last_clean":"2023-10-08T00:31:14.633929+0000","last_became_active":"2023-10-08T00:31:14.633649+0000","last_became_peered":"2023-10-08T00:31:14.633649+0000","last_unstale":"2023-10-08T00:31:14.633929+0000","last_undegraded":"2023-10-08T00:31:14.633929+0000","last_fullsized":"2023-10-08T00:31:14.633929+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:38.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638429+0000","last_change":"2023-10-08T00:31:14.638429+0000","last_active":"2023-10-08T00:31:14.638429+0000","last_peered":"2023-10-08T00:31:14.638429+0000","last_clean":"2023-10-08T00:31:14.638429+0000","last_became_active":"2023-10-08T00:31:14.638172+0000","last_became_peered":"2023-10-08T00:31:14.638172+0000","last_unstale":"2023-10-08T00:31:14.638429+0000","last_undegraded":"2023-10-08T00:31:14.638429+0000","last_fullsized":"2023-10-08T00:31:14.638429+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:54.289753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638167+0000","last_change":"2023-10-08T00:31:14.638167+0000","last_active":"2023-10-08T00:31:14.638167+0000","last_peered":"2023-10-08T00:31:14.638167+0000","last_clean":"2023-10-08T00:31:14.638167+0000","last_became_active":"2023-10-08T00:31:14.637891+0000","last_became_peered":"2023-10-08T00:31:14.637891+0000","last_unstale":"2023-10-08T00:31:14.638167+0000","last_undegraded":"2023-10-08T00:31:14.638167+0000","last_fullsized":"2023-10-08T00:31:14.638167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:30:37.710251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.643436+0000","last_change":"2023-10-08T00:31:14.643436+0000","last_active":"2023-10-08T00:31:14.643436+0000","last_peered":"2023-10-08T00:31:14.643436+0000","last_clean":"2023-10-08T00:31:14.643436+0000","last_became_active":"2023-10-08T00:31:14.642977+0000","last_became_peered":"2023-10-08T00:31:14.642977+0000","last_unstale":"2023-10-08T00:31:14.643436+0000","last_undegraded":"2023-10-08T00:31:14.643436+0000","last_fullsized":"2023-10-08T00:31:14.643436+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:10.023289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637602+0000","last_change":"2023-10-08T00:31:14.637602+0000","last_active":"2023-10-08T00:31:14.637602+0000","last_peered":"2023-10-08T00:31:14.637602+0000","last_clean":"2023-10-08T00:31:14.637602+0000","last_became_active":"2023-10-08T00:31:14.637357+0000","last_became_peered":"2023-10-08T00:31:14.637357+0000","last_unstale":"2023-10-08T00:31:14.637602+0000","last_undegraded":"2023-10-08T00:31:14.637602+0000","last_fullsized":"2023-10-08T00:31:14.637602+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:57.087805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641557+0000","last_change":"2023-10-08T00:31:14.641557+0000","last_active":"2023-10-08T00:31:14.641557+0000","last_peered":"2023-10-08T00:31:14.641557+0000","last_clean":"2023-10-08T00:31:14.641557+0000","last_became_active":"2023-10-08T00:31:14.641277+0000","last_became_peered":"2023-10-08T00:31:14.641277+0000","last_unstale":"2023-10-08T00:31:14.641557+0000","last_undegraded":"2023-10-08T00:31:14.641557+0000","last_fullsized":"2023-10-08T00:31:14.641557+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:13.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635852+0000","last_change":"2023-10-08T00:31:14.635852+0000","last_active":"2023-10-08T00:31:14.635852+0000","last_peered":"2023-10-08T00:31:14.635852+0000","last_clean":"2023-10-08T00:31:14.635852+0000","last_became_active":"2023-10-08T00:31:14.635533+0000","last_became_peered":"2023-10-08T00:31:14.635533+0000","last_unstale":"2023-10-08T00:31:14.635852+0000","last_undegraded":"2023-10-08T00:31:14.635852+0000","last_fullsized":"2023-10-08T00:31:14.635852+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:47:53.483845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636100+0000","last_change":"2023-10-08T00:31:14.636100+0000","last_active":"2023-10-08T00:31:14.636100+0000","last_peered":"2023-10-08T00:31:14.636100+0000","last_clean":"2023-10-08T00:31:14.636100+0000","last_became_active":"2023-10-08T00:31:14.635779+0000","last_became_peered":"2023-10-08T00:31:14.635779+0000","last_unstale":"2023-10-08T00:31:14.636100+0000","last_undegraded":"2023-10-08T00:31:14.636100+0000","last_fullsized":"2023-10-08T00:31:14.636100+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:56.947161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.642447+0000","last_change":"2023-10-08T00:31:14.642447+0000","last_active":"2023-10-08T00:31:14.642447+0000","last_peered":"2023-10-08T00:31:14.642447+0000","last_clean":"2023-10-08T00:31:14.642447+0000","last_became_active":"2023-10-08T00:31:14.642171+0000","last_became_peered":"2023-10-08T00:31:14.642171+0000","last_unstale":"2023-10-08T00:31:14.642447+0000","last_undegraded":"2023-10-08T00:31:14.642447+0000","last_fullsized":"2023-10-08T00:31:14.642447+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:34.207689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636583+0000","last_change":"2023-10-08T00:31:14.636583+0000","last_active":"2023-10-08T00:31:14.636583+0000","last_peered":"2023-10-08T00:31:14.636583+0000","last_clean":"2023-10-08T00:31:14.636583+0000","last_became_active":"2023-10-08T00:31:14.635385+0000","last_became_peered":"2023-10-08T00:31:14.635385+0000","last_unstale":"2023-10-08T00:31:14.636583+0000","last_undegraded":"2023-10-08T00:31:14.636583+0000","last_fullsized":"2023-10-08T00:31:14.636583+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:34:55.047672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633672+0000","last_change":"2023-10-08T00:31:14.633672+0000","last_active":"2023-10-08T00:31:14.633672+0000","last_peered":"2023-10-08T00:31:14.633672+0000","last_clean":"2023-10-08T00:31:14.633672+0000","last_became_active":"2023-10-08T00:31:14.633411+0000","last_became_peered":"2023-10-08T00:31:14.633411+0000","last_unstale":"2023-10-08T00:31:14.633672+0000","last_undegraded":"2023-10-08T00:31:14.633672+0000","last_fullsized":"2023-10-08T00:31:14.633672+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:35.542401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"101'4","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148702+0000","last_change":"2023-10-08T00:31:14.140132+0000","last_active":"2023-10-08T00:31:15.148702+0000","last_peered":"2023-10-08T00:31:15.148702+0000","last_clean":"2023-10-08T00:31:15.148702+0000","last_became_active":"2023-10-08T00:31:14.139551+0000","last_became_peered":"2023-10-08T00:31:14.139551+0000","last_unstale":"2023-10-08T00:31:15.148702+0000","last_undegraded":"2023-10-08T00:31:15.148702+0000","last_fullsized":"2023-10-08T00:31:15.148702+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:30.114197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637273+0000","last_change":"2023-10-08T00:31:14.637273+0000","last_active":"2023-10-08T00:31:14.637273+0000","last_peered":"2023-10-08T00:31:14.637273+0000","last_clean":"2023-10-08T00:31:14.637273+0000","last_became_active":"2023-10-08T00:31:14.636946+0000","last_became_peered":"2023-10-08T00:31:14.636946+0000","last_unstale":"2023-10-08T00:31:14.637273+0000","last_undegraded":"2023-10-08T00:31:14.637273+0000","last_fullsized":"2023-10-08T00:31:14.637273+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:39.961841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.625513+0000","last_change":"2023-10-08T00:31:14.139733+0000","last_active":"2023-10-08T00:31:14.625513+0000","last_peered":"2023-10-08T00:31:14.625513+0000","last_clean":"2023-10-08T00:31:14.625513+0000","last_became_active":"2023-10-08T00:31:14.139497+0000","last_became_peered":"2023-10-08T00:31:14.139497+0000","last_unstale":"2023-10-08T00:31:14.625513+0000","last_undegraded":"2023-10-08T00:31:14.625513+0000","last_fullsized":"2023-10-08T00:31:14.625513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:48.180515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636375+0000","last_change":"2023-10-08T00:31:14.636375+0000","last_active":"2023-10-08T00:31:14.636375+0000","last_peered":"2023-10-08T00:31:14.636375+0000","last_clean":"2023-10-08T00:31:14.636375+0000","last_became_active":"2023-10-08T00:31:14.634638+0000","last_became_peered":"2023-10-08T00:31:14.634638+0000","last_unstale":"2023-10-08T00:31:14.636375+0000","last_undegraded":"2023-10-08T00:31:14.636375+0000","last_fullsized":"2023-10-08T00:31:14.636375+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:16.639032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148211+0000","last_change":"2023-10-08T00:31:14.143237+0000","last_active":"2023-10-08T00:31:15.148211+0000","last_peered":"2023-10-08T00:31:15.148211+0000","last_clean":"2023-10-08T00:31:15.148211+0000","last_became_active":"2023-10-08T00:31:14.142933+0000","last_became_peered":"2023-10-08T00:31:14.142933+0000","last_unstale":"2023-10-08T00:31:15.148211+0000","last_undegraded":"2023-10-08T00:31:15.148211+0000","last_fullsized":"2023-10-08T00:31:15.148211+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:51.735675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637492+0000","last_change":"2023-10-08T00:31:14.637492+0000","last_active":"2023-10-08T00:31:14.637492+0000","last_peered":"2023-10-08T00:31:14.637492+0000","last_clean":"2023-10-08T00:31:14.637492+0000","last_became_active":"2023-10-08T00:31:14.636636+0000","last_became_peered":"2023-10-08T00:31:14.636636+0000","last_unstale":"2023-10-08T00:31:14.637492+0000","last_undegraded":"2023-10-08T00:31:14.637492+0000","last_fullsized":"2023-10-08T00:31:14.637492+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:54.289753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148016+0000","last_change":"2023-10-08T00:31:14.143340+0000","last_active":"2023-10-08T00:31:15.148016+0000","last_peered":"2023-10-08T00:31:15.148016+0000","last_clean":"2023-10-08T00:31:15.148016+0000","last_became_active":"2023-10-08T00:31:14.143043+0000","last_became_peered":"2023-10-08T00:31:14.143043+0000","last_unstale":"2023-10-08T00:31:15.148016+0000","last_undegraded":"2023-10-08T00:31:15.148016+0000","last_fullsized":"2023-10-08T00:31:15.148016+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:40:13.523188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635504+0000","last_change":"2023-10-08T00:31:14.635504+0000","last_active":"2023-10-08T00:31:14.635504+0000","last_peered":"2023-10-08T00:31:14.635504+0000","last_clean":"2023-10-08T00:31:14.635504+0000","last_became_active":"2023-10-08T00:31:14.635241+0000","last_became_peered":"2023-10-08T00:31:14.635241+0000","last_unstale":"2023-10-08T00:31:14.635504+0000","last_undegraded":"2023-10-08T00:31:14.635504+0000","last_fullsized":"2023-10-08T00:31:14.635504+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:39:36.732638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.628475+0000","last_change":"2023-10-08T00:31:14.146339+0000","last_active":"2023-10-08T00:31:14.628475+0000","last_peered":"2023-10-08T00:31:14.628475+0000","last_clean":"2023-10-08T00:31:14.628475+0000","last_became_active":"2023-10-08T00:31:14.146065+0000","last_became_peered":"2023-10-08T00:31:14.146065+0000","last_unstale":"2023-10-08T00:31:14.628475+0000","last_undegraded":"2023-10-08T00:31:14.628475+0000","last_fullsized":"2023-10-08T00:31:14.628475+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:51.735675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635637+0000","last_change":"2023-10-08T00:31:14.635637+0000","last_active":"2023-10-08T00:31:14.635637+0000","last_peered":"2023-10-08T00:31:14.635637+0000","last_clean":"2023-10-08T00:31:14.635637+0000","last_became_active":"2023-10-08T00:31:14.635160+0000","last_became_peered":"2023-10-08T00:31:14.635160+0000","last_unstale":"2023-10-08T00:31:14.635637+0000","last_undegraded":"2023-10-08T00:31:14.635637+0000","last_fullsized":"2023-10-08T00:31:14.635637+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:21.888164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.631860+0000","last_change":"2023-10-08T00:31:14.135014+0000","last_active":"2023-10-08T00:31:14.631860+0000","last_peered":"2023-10-08T00:31:14.631860+0000","last_clean":"2023-10-08T00:31:14.631860+0000","last_became_active":"2023-10-08T00:31:14.134753+0000","last_became_peered":"2023-10-08T00:31:14.134753+0000","last_unstale":"2023-10-08T00:31:14.631860+0000","last_undegraded":"2023-10-08T00:31:14.631860+0000","last_fullsized":"2023-10-08T00:31:14.631860+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:48.180515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.631780+0000","last_change":"2023-10-08T00:31:14.631780+0000","last_active":"2023-10-08T00:31:14.631780+0000","last_peered":"2023-10-08T00:31:14.631780+0000","last_clean":"2023-10-08T00:31:14.631780+0000","last_became_active":"2023-10-08T00:31:14.631534+0000","last_became_peered":"2023-10-08T00:31:14.631534+0000","last_unstale":"2023-10-08T00:31:14.631780+0000","last_undegraded":"2023-10-08T00:31:14.631780+0000","last_fullsized":"2023-10-08T00:31:14.631780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:00:54.864295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.138790+0000","last_change":"2023-10-08T00:31:14.136802+0000","last_active":"2023-10-08T00:31:14.138790+0000","last_peered":"2023-10-08T00:31:14.138790+0000","last_clean":"2023-10-08T00:31:14.138790+0000","last_became_active":"2023-10-08T00:31:14.136579+0000","last_became_peered":"2023-10-08T00:31:14.136579+0000","last_unstale":"2023-10-08T00:31:14.138790+0000","last_undegraded":"2023-10-08T00:31:14.138790+0000","last_fullsized":"2023-10-08T00:31:14.138790+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:54.540074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639056+0000","last_change":"2023-10-08T00:31:14.639056+0000","last_active":"2023-10-08T00:31:14.639056+0000","last_peered":"2023-10-08T00:31:14.639056+0000","last_clean":"2023-10-08T00:31:14.639056+0000","last_became_active":"2023-10-08T00:31:14.637659+0000","last_became_peered":"2023-10-08T00:31:14.637659+0000","last_unstale":"2023-10-08T00:31:14.639056+0000","last_undegraded":"2023-10-08T00:31:14.639056+0000","last_fullsized":"2023-10-08T00:31:14.639056+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:47.481758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.149217+0000","last_change":"2023-10-08T00:31:14.148068+0000","last_active":"2023-10-08T00:31:14.149217+0000","last_peered":"2023-10-08T00:31:14.149217+0000","last_clean":"2023-10-08T00:31:14.149217+0000","last_became_active":"2023-10-08T00:31:14.147748+0000","last_became_peered":"2023-10-08T00:31:14.147748+0000","last_unstale":"2023-10-08T00:31:14.149217+0000","last_undegraded":"2023-10-08T00:31:14.149217+0000","last_fullsized":"2023-10-08T00:31:14.149217+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:37:16.985156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.642560+0000","last_change":"2023-10-08T00:31:14.642560+0000","last_active":"2023-10-08T00:31:14.642560+0000","last_peered":"2023-10-08T00:31:14.642560+0000","last_clean":"2023-10-08T00:31:14.642560+0000","last_became_active":"2023-10-08T00:31:14.642232+0000","last_became_peered":"2023-10-08T00:31:14.642232+0000","last_unstale":"2023-10-08T00:31:14.642560+0000","last_undegraded":"2023-10-08T00:31:14.642560+0000","last_fullsized":"2023-10-08T00:31:14.642560+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:26:57.132900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.144853+0000","last_change":"2023-10-08T00:31:14.143347+0000","last_active":"2023-10-08T00:31:14.144853+0000","last_peered":"2023-10-08T00:31:14.144853+0000","last_clean":"2023-10-08T00:31:14.144853+0000","last_became_active":"2023-10-08T00:31:14.143021+0000","last_became_peered":"2023-10-08T00:31:14.143021+0000","last_unstale":"2023-10-08T00:31:14.144853+0000","last_undegraded":"2023-10-08T00:31:14.144853+0000","last_fullsized":"2023-10-08T00:31:14.144853+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:50:23.559843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641278+0000","last_change":"2023-10-08T00:31:14.641278+0000","last_active":"2023-10-08T00:31:14.641278+0000","last_peered":"2023-10-08T00:31:14.641278+0000","last_clean":"2023-10-08T00:31:14.641278+0000","last_became_active":"2023-10-08T00:31:14.640759+0000","last_became_peered":"2023-10-08T00:31:14.640759+0000","last_unstale":"2023-10-08T00:31:14.641278+0000","last_undegraded":"2023-10-08T00:31:14.641278+0000","last_fullsized":"2023-10-08T00:31:14.641278+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:15:30.149788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.137388+0000","last_change":"2023-10-08T00:31:14.134442+0000","last_active":"2023-10-08T00:31:14.137388+0000","last_peered":"2023-10-08T00:31:14.137388+0000","last_clean":"2023-10-08T00:31:14.137388+0000","last_became_active":"2023-10-08T00:31:14.134162+0000","last_became_peered":"2023-10-08T00:31:14.134162+0000","last_unstale":"2023-10-08T00:31:14.137388+0000","last_undegraded":"2023-10-08T00:31:14.137388+0000","last_fullsized":"2023-10-08T00:31:14.137388+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:47.053198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638397+0000","last_change":"2023-10-08T00:31:14.638397+0000","last_active":"2023-10-08T00:31:14.638397+0000","last_peered":"2023-10-08T00:31:14.638397+0000","last_clean":"2023-10-08T00:31:14.638397+0000","last_became_active":"2023-10-08T00:31:14.638132+0000","last_became_peered":"2023-10-08T00:31:14.638132+0000","last_unstale":"2023-10-08T00:31:14.638397+0000","last_undegraded":"2023-10-08T00:31:14.638397+0000","last_fullsized":"2023-10-08T00:31:14.638397+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:30.392525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"101'3","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.146497+0000","last_change":"2023-10-08T00:31:14.142998+0000","last_active":"2023-10-08T00:31:15.146497+0000","last_peered":"2023-10-08T00:31:15.146497+0000","last_clean":"2023-10-08T00:31:15.146497+0000","last_became_active":"2023-10-08T00:31:14.142698+0000","last_became_peered":"2023-10-08T00:31:14.142698+0000","last_unstale":"2023-10-08T00:31:15.146497+0000","last_undegraded":"2023-10-08T00:31:15.146497+0000","last_fullsized":"2023-10-08T00:31:15.146497+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:46:26.030069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641164+0000","last_change":"2023-10-08T00:31:14.641164+0000","last_active":"2023-10-08T00:31:14.641164+0000","last_peered":"2023-10-08T00:31:14.641164+0000","last_clean":"2023-10-08T00:31:14.641164+0000","last_became_active":"2023-10-08T00:31:14.640797+0000","last_became_peered":"2023-10-08T00:31:14.640797+0000","last_unstale":"2023-10-08T00:31:14.641164+0000","last_undegraded":"2023-10-08T00:31:14.641164+0000","last_fullsized":"2023-10-08T00:31:14.641164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:55.543913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"101'6","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.147383+0000","last_change":"2023-10-08T00:31:14.142461+0000","last_active":"2023-10-08T00:31:15.147383+0000","last_peered":"2023-10-08T00:31:15.147383+0000","last_clean":"2023-10-08T00:31:15.147383+0000","last_became_active":"2023-10-08T00:31:14.142179+0000","last_became_peered":"2023-10-08T00:31:14.142179+0000","last_unstale":"2023-10-08T00:31:15.147383+0000","last_undegraded":"2023-10-08T00:31:15.147383+0000","last_fullsized":"2023-10-08T00:31:15.147383+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:29.388687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635746+0000","last_change":"2023-10-08T00:31:14.635746+0000","last_active":"2023-10-08T00:31:14.635746+0000","last_peered":"2023-10-08T00:31:14.635746+0000","last_clean":"2023-10-08T00:31:14.635746+0000","last_became_active":"2023-10-08T00:31:14.635473+0000","last_became_peered":"2023-10-08T00:31:14.635473+0000","last_unstale":"2023-10-08T00:31:14.635746+0000","last_undegraded":"2023-10-08T00:31:14.635746+0000","last_fullsized":"2023-10-08T00:31:14.635746+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:37:17.988995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148723+0000","last_change":"2023-10-08T00:31:14.142396+0000","last_active":"2023-10-08T00:31:15.148723+0000","last_peered":"2023-10-08T00:31:15.148723+0000","last_clean":"2023-10-08T00:31:15.148723+0000","last_became_active":"2023-10-08T00:31:14.141982+0000","last_became_peered":"2023-10-08T00:31:14.141982+0000","last_unstale":"2023-10-08T00:31:15.148723+0000","last_undegraded":"2023-10-08T00:31:15.148723+0000","last_fullsized":"2023-10-08T00:31:15.148723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:00:47.187596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639795+0000","last_change":"2023-10-08T00:31:14.639795+0000","last_active":"2023-10-08T00:31:14.639795+0000","last_peered":"2023-10-08T00:31:14.639795+0000","last_clean":"2023-10-08T00:31:14.639795+0000","last_became_active":"2023-10-08T00:31:14.639543+0000","last_became_peered":"2023-10-08T00:31:14.639543+0000","last_unstale":"2023-10-08T00:31:14.639795+0000","last_undegraded":"2023-10-08T00:31:14.639795+0000","last_fullsized":"2023-10-08T00:31:14.639795+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:41.469959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.139322+0000","last_change":"2023-10-08T00:31:14.137549+0000","last_active":"2023-10-08T00:31:14.139322+0000","last_peered":"2023-10-08T00:31:14.139322+0000","last_clean":"2023-10-08T00:31:14.139322+0000","last_became_active":"2023-10-08T00:31:14.137244+0000","last_became_peered":"2023-10-08T00:31:14.137244+0000","last_unstale":"2023-10-08T00:31:14.139322+0000","last_undegraded":"2023-10-08T00:31:14.139322+0000","last_fullsized":"2023-10-08T00:31:14.139322+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:10.136838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639277+0000","last_change":"2023-10-08T00:31:14.639277+0000","last_active":"2023-10-08T00:31:14.639277+0000","last_peered":"2023-10-08T00:31:14.639277+0000","last_clean":"2023-10-08T00:31:14.639277+0000","last_became_active":"2023-10-08T00:31:14.637966+0000","last_became_peered":"2023-10-08T00:31:14.637966+0000","last_unstale":"2023-10-08T00:31:14.639277+0000","last_undegraded":"2023-10-08T00:31:14.639277+0000","last_fullsized":"2023-10-08T00:31:14.639277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:39.609469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"101'8","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.149155+0000","last_change":"2023-10-08T00:31:14.147157+0000","last_active":"2023-10-08T00:31:15.149155+0000","last_peered":"2023-10-08T00:31:15.149155+0000","last_clean":"2023-10-08T00:31:15.149155+0000","last_became_active":"2023-10-08T00:31:14.146865+0000","last_became_peered":"2023-10-08T00:31:14.146865+0000","last_unstale":"2023-10-08T00:31:15.149155+0000","last_undegraded":"2023-10-08T00:31:15.149155+0000","last_fullsized":"2023-10-08T00:31:15.149155+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:30.114197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637336+0000","last_change":"2023-10-08T00:31:14.637336+0000","last_active":"2023-10-08T00:31:14.637336+0000","last_peered":"2023-10-08T00:31:14.637336+0000","last_clean":"2023-10-08T00:31:14.637336+0000","last_became_active":"2023-10-08T00:31:14.637073+0000","last_became_peered":"2023-10-08T00:31:14.637073+0000","last_unstale":"2023-10-08T00:31:14.637336+0000","last_undegraded":"2023-10-08T00:31:14.637336+0000","last_fullsized":"2023-10-08T00:31:14.637336+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:03:18.418636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.631275+0000","last_change":"2023-10-08T00:31:14.139724+0000","last_active":"2023-10-08T00:31:14.631275+0000","last_peered":"2023-10-08T00:31:14.631275+0000","last_clean":"2023-10-08T00:31:14.631275+0000","last_became_active":"2023-10-08T00:31:14.139243+0000","last_became_peered":"2023-10-08T00:31:14.139243+0000","last_unstale":"2023-10-08T00:31:14.631275+0000","last_undegraded":"2023-10-08T00:31:14.631275+0000","last_fullsized":"2023-10-08T00:31:14.631275+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:19.505044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640814+0000","last_change":"2023-10-08T00:31:14.640814+0000","last_active":"2023-10-08T00:31:14.640814+0000","last_peered":"2023-10-08T00:31:14.640814+0000","last_clean":"2023-10-08T00:31:14.640814+0000","last_became_active":"2023-10-08T00:31:14.640552+0000","last_became_peered":"2023-10-08T00:31:14.640552+0000","last_unstale":"2023-10-08T00:31:14.640814+0000","last_undegraded":"2023-10-08T00:31:14.640814+0000","last_fullsized":"2023-10-08T00:31:14.640814+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:45.958938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.149335+0000","last_change":"2023-10-08T00:31:14.129589+0000","last_active":"2023-10-08T00:31:15.149335+0000","last_peered":"2023-10-08T00:31:15.149335+0000","last_clean":"2023-10-08T00:31:15.149335+0000","last_became_active":"2023-10-08T00:31:14.129298+0000","last_became_peered":"2023-10-08T00:31:14.129298+0000","last_unstale":"2023-10-08T00:31:15.149335+0000","last_undegraded":"2023-10-08T00:31:15.149335+0000","last_fullsized":"2023-10-08T00:31:15.149335+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:57.306116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641965+0000","last_change":"2023-10-08T00:31:14.641965+0000","last_active":"2023-10-08T00:31:14.641965+0000","last_peered":"2023-10-08T00:31:14.641965+0000","last_clean":"2023-10-08T00:31:14.641965+0000","last_became_active":"2023-10-08T00:31:14.641470+0000","last_became_peered":"2023-10-08T00:31:14.641470+0000","last_unstale":"2023-10-08T00:31:14.641965+0000","last_undegraded":"2023-10-08T00:31:14.641965+0000","last_fullsized":"2023-10-08T00:31:14.641965+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:22.813458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633258+0000","last_change":"2023-10-08T00:31:14.138672+0000","last_active":"2023-10-08T00:31:14.633258+0000","last_peered":"2023-10-08T00:31:14.633258+0000","last_clean":"2023-10-08T00:31:14.633258+0000","last_became_active":"2023-10-08T00:31:14.138414+0000","last_became_peered":"2023-10-08T00:31:14.138414+0000","last_unstale":"2023-10-08T00:31:14.633258+0000","last_undegraded":"2023-10-08T00:31:14.633258+0000","last_fullsized":"2023-10-08T00:31:14.633258+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:54.540074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.643064+0000","last_change":"2023-10-08T00:31:14.643064+0000","last_active":"2023-10-08T00:31:14.643064+0000","last_peered":"2023-10-08T00:31:14.643064+0000","last_clean":"2023-10-08T00:31:14.643064+0000","last_became_active":"2023-10-08T00:31:14.642584+0000","last_became_peered":"2023-10-08T00:31:14.642584+0000","last_unstale":"2023-10-08T00:31:14.643064+0000","last_undegraded":"2023-10-08T00:31:14.643064+0000","last_fullsized":"2023-10-08T00:31:14.643064+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:13.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148962+0000","last_change":"2023-10-08T00:31:14.148391+0000","last_active":"2023-10-08T00:31:14.148962+0000","last_peered":"2023-10-08T00:31:14.148962+0000","last_clean":"2023-10-08T00:31:14.148962+0000","last_became_active":"2023-10-08T00:31:14.148136+0000","last_became_peered":"2023-10-08T00:31:14.148136+0000","last_unstale":"2023-10-08T00:31:14.148962+0000","last_undegraded":"2023-10-08T00:31:14.148962+0000","last_fullsized":"2023-10-08T00:31:14.148962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:06:43.309508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638884+0000","last_change":"2023-10-08T00:31:14.638884+0000","last_active":"2023-10-08T00:31:14.638884+0000","last_peered":"2023-10-08T00:31:14.638884+0000","last_clean":"2023-10-08T00:31:14.638884+0000","last_became_active":"2023-10-08T00:31:14.638624+0000","last_became_peered":"2023-10-08T00:31:14.638624+0000","last_unstale":"2023-10-08T00:31:14.638884+0000","last_undegraded":"2023-10-08T00:31:14.638884+0000","last_fullsized":"2023-10-08T00:31:14.638884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:20.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148270+0000","last_change":"2023-10-08T00:31:14.142240+0000","last_active":"2023-10-08T00:31:15.148270+0000","last_peered":"2023-10-08T00:31:15.148270+0000","last_clean":"2023-10-08T00:31:15.148270+0000","last_became_active":"2023-10-08T00:31:14.141615+0000","last_became_peered":"2023-10-08T00:31:14.141615+0000","last_unstale":"2023-10-08T00:31:15.148270+0000","last_undegraded":"2023-10-08T00:31:15.148270+0000","last_fullsized":"2023-10-08T00:31:15.148270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:03:17.414797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637220+0000","last_change":"2023-10-08T00:31:14.637220+0000","last_active":"2023-10-08T00:31:14.637220+0000","last_peered":"2023-10-08T00:31:14.637220+0000","last_clean":"2023-10-08T00:31:14.637220+0000","last_became_active":"2023-10-08T00:31:14.636906+0000","last_became_peered":"2023-10-08T00:31:14.636906+0000","last_unstale":"2023-10-08T00:31:14.637220+0000","last_undegraded":"2023-10-08T00:31:14.637220+0000","last_fullsized":"2023-10-08T00:31:14.637220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:26:25.703773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.144911+0000","last_change":"2023-10-08T00:31:14.143904+0000","last_active":"2023-10-08T00:31:14.144911+0000","last_peered":"2023-10-08T00:31:14.144911+0000","last_clean":"2023-10-08T00:31:14.144911+0000","last_became_active":"2023-10-08T00:31:14.143634+0000","last_became_peered":"2023-10-08T00:31:14.143634+0000","last_unstale":"2023-10-08T00:31:14.144911+0000","last_undegraded":"2023-10-08T00:31:14.144911+0000","last_fullsized":"2023-10-08T00:31:14.144911+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:57:47.854753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633871+0000","last_change":"2023-10-08T00:31:14.633871+0000","last_active":"2023-10-08T00:31:14.633871+0000","last_peered":"2023-10-08T00:31:14.633871+0000","last_clean":"2023-10-08T00:31:14.633871+0000","last_became_active":"2023-10-08T00:31:14.633594+0000","last_became_peered":"2023-10-08T00:31:14.633594+0000","last_unstale":"2023-10-08T00:31:14.633871+0000","last_undegraded":"2023-10-08T00:31:14.633871+0000","last_fullsized":"2023-10-08T00:31:14.633871+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:06.967746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.142638+0000","last_change":"2023-10-08T00:31:14.141101+0000","last_active":"2023-10-08T00:31:14.142638+0000","last_peered":"2023-10-08T00:31:14.142638+0000","last_clean":"2023-10-08T00:31:14.142638+0000","last_became_active":"2023-10-08T00:31:14.140770+0000","last_became_peered":"2023-10-08T00:31:14.140770+0000","last_unstale":"2023-10-08T00:31:14.142638+0000","last_undegraded":"2023-10-08T00:31:14.142638+0000","last_fullsized":"2023-10-08T00:31:14.142638+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:17:03.063711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639780+0000","last_change":"2023-10-08T00:31:14.639780+0000","last_active":"2023-10-08T00:31:14.639780+0000","last_peered":"2023-10-08T00:31:14.639780+0000","last_clean":"2023-10-08T00:31:14.639780+0000","last_became_active":"2023-10-08T00:31:14.639521+0000","last_became_peered":"2023-10-08T00:31:14.639521+0000","last_unstale":"2023-10-08T00:31:14.639780+0000","last_undegraded":"2023-10-08T00:31:14.639780+0000","last_fullsized":"2023-10-08T00:31:14.639780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:22.813458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148915+0000","last_change":"2023-10-08T00:31:14.146869+0000","last_active":"2023-10-08T00:31:14.148915+0000","last_peered":"2023-10-08T00:31:14.148915+0000","last_clean":"2023-10-08T00:31:14.148915+0000","last_became_active":"2023-10-08T00:31:14.146600+0000","last_became_peered":"2023-10-08T00:31:14.146600+0000","last_unstale":"2023-10-08T00:31:14.148915+0000","last_undegraded":"2023-10-08T00:31:14.148915+0000","last_fullsized":"2023-10-08T00:31:14.148915+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:12.357387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641167+0000","last_change":"2023-10-08T00:31:14.641167+0000","last_active":"2023-10-08T00:31:14.641167+0000","last_peered":"2023-10-08T00:31:14.641167+0000","last_clean":"2023-10-08T00:31:14.641167+0000","last_became_active":"2023-10-08T00:31:14.640842+0000","last_became_peered":"2023-10-08T00:31:14.640842+0000","last_unstale":"2023-10-08T00:31:14.641167+0000","last_undegraded":"2023-10-08T00:31:14.641167+0000","last_fullsized":"2023-10-08T00:31:14.641167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:59:40.369723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.147633+0000","last_change":"2023-10-08T00:31:14.137790+0000","last_active":"2023-10-08T00:31:15.147633+0000","last_peered":"2023-10-08T00:31:15.147633+0000","last_clean":"2023-10-08T00:31:15.147633+0000","last_became_active":"2023-10-08T00:31:14.137498+0000","last_became_peered":"2023-10-08T00:31:14.137498+0000","last_unstale":"2023-10-08T00:31:15.147633+0000","last_undegraded":"2023-10-08T00:31:15.147633+0000","last_fullsized":"2023-10-08T00:31:15.147633+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:30:36.706413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638777+0000","last_change":"2023-10-08T00:31:14.638777+0000","last_active":"2023-10-08T00:31:14.638777+0000","last_peered":"2023-10-08T00:31:14.638777+0000","last_clean":"2023-10-08T00:31:14.638777+0000","last_became_active":"2023-10-08T00:31:14.637505+0000","last_became_peered":"2023-10-08T00:31:14.637505+0000","last_unstale":"2023-10-08T00:31:14.638777+0000","last_undegraded":"2023-10-08T00:31:14.638777+0000","last_fullsized":"2023-10-08T00:31:14.638777+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:39:54.842948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.139440+0000","last_change":"2023-10-08T00:31:14.138565+0000","last_active":"2023-10-08T00:31:14.139440+0000","last_peered":"2023-10-08T00:31:14.139440+0000","last_clean":"2023-10-08T00:31:14.139440+0000","last_became_active":"2023-10-08T00:31:14.138302+0000","last_became_peered":"2023-10-08T00:31:14.138302+0000","last_unstale":"2023-10-08T00:31:14.139440+0000","last_undegraded":"2023-10-08T00:31:14.139440+0000","last_fullsized":"2023-10-08T00:31:14.139440+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:22:04.070353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640712+0000","last_change":"2023-10-08T00:31:14.640712+0000","last_active":"2023-10-08T00:31:14.640712+0000","last_peered":"2023-10-08T00:31:14.640712+0000","last_clean":"2023-10-08T00:31:14.640712+0000","last_became_active":"2023-10-08T00:31:14.640359+0000","last_became_peered":"2023-10-08T00:31:14.640359+0000","last_unstale":"2023-10-08T00:31:14.640712+0000","last_undegraded":"2023-10-08T00:31:14.640712+0000","last_fullsized":"2023-10-08T00:31:14.640712+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:59:49.202759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148836+0000","last_change":"2023-10-08T00:31:14.142375+0000","last_active":"2023-10-08T00:31:14.148836+0000","last_peered":"2023-10-08T00:31:14.148836+0000","last_clean":"2023-10-08T00:31:14.148836+0000","last_became_active":"2023-10-08T00:31:14.142096+0000","last_became_peered":"2023-10-08T00:31:14.142096+0000","last_unstale":"2023-10-08T00:31:14.148836+0000","last_undegraded":"2023-10-08T00:31:14.148836+0000","last_fullsized":"2023-10-08T00:31:14.148836+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:40.466121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638837+0000","last_change":"2023-10-08T00:31:14.638837+0000","last_active":"2023-10-08T00:31:14.638837+0000","last_peered":"2023-10-08T00:31:14.638837+0000","last_clean":"2023-10-08T00:31:14.638837+0000","last_became_active":"2023-10-08T00:31:14.638563+0000","last_became_peered":"2023-10-08T00:31:14.638563+0000","last_unstale":"2023-10-08T00:31:14.638837+0000","last_undegraded":"2023-10-08T00:31:14.638837+0000","last_fullsized":"2023-10-08T00:31:14.638837+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:37.241674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.142294+0000","last_change":"2023-10-08T00:31:14.141871+0000","last_active":"2023-10-08T00:31:14.142294+0000","last_peered":"2023-10-08T00:31:14.142294+0000","last_clean":"2023-10-08T00:31:14.142294+0000","last_became_active":"2023-10-08T00:31:14.140911+0000","last_became_peered":"2023-10-08T00:31:14.140911+0000","last_unstale":"2023-10-08T00:31:14.142294+0000","last_undegraded":"2023-10-08T00:31:14.142294+0000","last_fullsized":"2023-10-08T00:31:14.142294+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:20.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.643745+0000","last_change":"2023-10-08T00:31:14.643745+0000","last_active":"2023-10-08T00:31:14.643745+0000","last_peered":"2023-10-08T00:31:14.643745+0000","last_clean":"2023-10-08T00:31:14.643745+0000","last_became_active":"2023-10-08T00:31:14.643474+0000","last_became_peered":"2023-10-08T00:31:14.643474+0000","last_unstale":"2023-10-08T00:31:14.643745+0000","last_undegraded":"2023-10-08T00:31:14.643745+0000","last_fullsized":"2023-10-08T00:31:14.643745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:42:04.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.137618+0000","last_change":"2023-10-08T00:31:14.132805+0000","last_active":"2023-10-08T00:31:14.137618+0000","last_peered":"2023-10-08T00:31:14.137618+0000","last_clean":"2023-10-08T00:31:14.137618+0000","last_became_active":"2023-10-08T00:31:14.132562+0000","last_became_peered":"2023-10-08T00:31:14.132562+0000","last_unstale":"2023-10-08T00:31:14.137618+0000","last_undegraded":"2023-10-08T00:31:14.137618+0000","last_fullsized":"2023-10-08T00:31:14.137618+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:21.149884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635446+0000","last_change":"2023-10-08T00:31:14.635446+0000","last_active":"2023-10-08T00:31:14.635446+0000","last_peered":"2023-10-08T00:31:14.635446+0000","last_clean":"2023-10-08T00:31:14.635446+0000","last_became_active":"2023-10-08T00:31:14.634778+0000","last_became_peered":"2023-10-08T00:31:14.634778+0000","last_unstale":"2023-10-08T00:31:14.635446+0000","last_undegraded":"2023-10-08T00:31:14.635446+0000","last_fullsized":"2023-10-08T00:31:14.635446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:59:40.369723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.145543+0000","last_change":"2023-10-08T00:31:14.145098+0000","last_active":"2023-10-08T00:31:14.145543+0000","last_peered":"2023-10-08T00:31:14.145543+0000","last_clean":"2023-10-08T00:31:14.145543+0000","last_became_active":"2023-10-08T00:31:14.144746+0000","last_became_peered":"2023-10-08T00:31:14.144746+0000","last_unstale":"2023-10-08T00:31:14.145543+0000","last_undegraded":"2023-10-08T00:31:14.145543+0000","last_fullsized":"2023-10-08T00:31:14.145543+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:19.315757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640338+0000","last_change":"2023-10-08T00:31:14.640338+0000","last_active":"2023-10-08T00:31:14.640338+0000","last_peered":"2023-10-08T00:31:14.640338+0000","last_clean":"2023-10-08T00:31:14.640338+0000","last_became_active":"2023-10-08T00:31:14.640015+0000","last_became_peered":"2023-10-08T00:31:14.640015+0000","last_unstale":"2023-10-08T00:31:14.640338+0000","last_undegraded":"2023-10-08T00:31:14.640338+0000","last_fullsized":"2023-10-08T00:31:14.640338+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:37:17.988995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.145798+0000","last_change":"2023-10-08T00:31:14.144729+0000","last_active":"2023-10-08T00:31:14.145798+0000","last_peered":"2023-10-08T00:31:14.145798+0000","last_clean":"2023-10-08T00:31:14.145798+0000","last_became_active":"2023-10-08T00:31:14.144185+0000","last_became_peered":"2023-10-08T00:31:14.144185+0000","last_unstale":"2023-10-08T00:31:14.145798+0000","last_undegraded":"2023-10-08T00:31:14.145798+0000","last_fullsized":"2023-10-08T00:31:14.145798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:21.149884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637461+0000","last_change":"2023-10-08T00:31:14.637461+0000","last_active":"2023-10-08T00:31:14.637461+0000","last_peered":"2023-10-08T00:31:14.637461+0000","last_clean":"2023-10-08T00:31:14.637461+0000","last_became_active":"2023-10-08T00:31:14.637146+0000","last_became_peered":"2023-10-08T00:31:14.637146+0000","last_unstale":"2023-10-08T00:31:14.637461+0000","last_undegraded":"2023-10-08T00:31:14.637461+0000","last_fullsized":"2023-10-08T00:31:14.637461+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:02.222983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.149249+0000","last_change":"2023-10-08T00:31:14.148390+0000","last_active":"2023-10-08T00:31:14.149249+0000","last_peered":"2023-10-08T00:31:14.149249+0000","last_clean":"2023-10-08T00:31:14.149249+0000","last_became_active":"2023-10-08T00:31:14.148113+0000","last_became_peered":"2023-10-08T00:31:14.148113+0000","last_unstale":"2023-10-08T00:31:14.149249+0000","last_undegraded":"2023-10-08T00:31:14.149249+0000","last_fullsized":"2023-10-08T00:31:14.149249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:38.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636771+0000","last_change":"2023-10-08T00:31:14.636771+0000","last_active":"2023-10-08T00:31:14.636771+0000","last_peered":"2023-10-08T00:31:14.636771+0000","last_clean":"2023-10-08T00:31:14.636771+0000","last_became_active":"2023-10-08T00:31:14.636521+0000","last_became_peered":"2023-10-08T00:31:14.636521+0000","last_unstale":"2023-10-08T00:31:14.636771+0000","last_undegraded":"2023-10-08T00:31:14.636771+0000","last_fullsized":"2023-10-08T00:31:14.636771+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:13.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148974+0000","last_change":"2023-10-08T00:31:14.148449+0000","last_active":"2023-10-08T00:31:14.148974+0000","last_peered":"2023-10-08T00:31:14.148974+0000","last_clean":"2023-10-08T00:31:14.148974+0000","last_became_active":"2023-10-08T00:31:14.148084+0000","last_became_peered":"2023-10-08T00:31:14.148084+0000","last_unstale":"2023-10-08T00:31:14.148974+0000","last_undegraded":"2023-10-08T00:31:14.148974+0000","last_fullsized":"2023-10-08T00:31:14.148974+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:05.549285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.135616+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:31:14.135616+0000","last_peered":"2023-10-08T00:31:14.135616+0000","last_clean":"2023-10-08T00:31:14.135616+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:31:14.135616+0000","last_undegraded":"2023-10-08T00:31:14.135616+0000","last_fullsized":"2023-10-08T00:31:14.135616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299104,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072736,"statfs":{"total":96636764160,"available":96330481664,"internally_reserved":0,"allocated":1859584,"data_stored":1133859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70699999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.876},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.502,"15min":0.52900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.55400000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71299999999999997,"5min":0.75,"15min":0.79000000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.86299999999999999,"15min":1.048},"last":0.42999999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":0.89400000000000002,"15min":1.0920000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.60299999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298520,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073320,"statfs":{"total":96636764160,"available":96331079680,"internally_reserved":0,"allocated":1261568,"data_stored":542973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.28100000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.77200000000000002,"15min":0.84399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.90700000000000003,"15min":0.94499999999999995},"last":0.59599999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.80800000000000005,"15min":1.145},"last":0.495},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.749,"15min":0.873},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.78500000000000003,"15min":1.079},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.76000000000000001,"15min":0.85799999999999998},"last":0.56899999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.871,"15min":1.127},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":1.1160000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70099999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57099999999999995,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29399999999999998},"max":{"1min":0.77700000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58799999999999997,"15min":0.63500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":1.093},"last":0.40600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":543027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.64300000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52300000000000002,"5min":0.58099999999999996,"15min":0.60199999999999998},"last":0.33600000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.254,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54300000000000004,"5min":0.624,"15min":0.84699999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77000000000000002,"5min":0.90100000000000002,"15min":1.294},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.503}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":1.038},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.46300000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.874,"15min":0.879},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.97999999999999998,"15min":1.087},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1134919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.63100000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.60699999999999998,"5min":0.60899999999999999,"15min":0.64700000000000002},"last":0.42199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.73399999999999999,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":1.242},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.86399999999999999,"15min":1.0800000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.78800000000000003,"5min":0.91000000000000003,"15min":1.0529999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.58799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.316,"15min":0.34599999999999997},"min":{"1min":0.218,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.60899999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.38400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.28100000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34699999999999998,"15min":0.373},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48099999999999998,"5min":0.54900000000000004,"15min":0.65000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.40899999999999997},"min":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53400000000000003,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60799999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39300000000000002,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51900000000000002,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":1.0489999999999999,"15min":1.0760000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.379},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91900000000000004,"5min":0.93899999999999995,"15min":1.278},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.0880000000000001,"15min":1.137},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.95999999999999996},"last":0.41299999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.65300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93899999999999995,"5min":1,"15min":1.1259999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.343},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33900000000000002,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.25},{"interface":"front","average":{"1min":0.374,"5min":0.371,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42699999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.625},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.629},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64200000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.371,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.93300000000000005,"15min":1.712},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.64800000000000002,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.0960000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":0.873,"15min":0.873},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.5},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77200000000000002,"5min":1.002,"15min":1.002},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.82799999999999996,"15min":0.84199999999999997},"last":0.70999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.747,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.621},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.378},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67800000000000005,"5min":0.71999999999999997,"15min":0.75700000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.58199999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29199999999999998},"max":{"1min":0.749,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.55100000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72699999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.61399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.82499999999999996,"15min":0.84499999999999997},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:31:19.254 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.405+0000 7f5a71743700 1 Processor -- start 2023-10-08T00:31:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.405+0000 7f5a71743700 1 -- start start 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a71743700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 0x7f5a6c140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a71743700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c15c2a0 con 0x7f5a6c06c0a0 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a71743700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c15b690 con 0x7f5a6c0c9510 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a71743700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c15b970 con 0x7f5a6c06bcd0 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a6a7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5a6c06c0a0 0x7f5a6c0c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39542/0 (socket says 172.21.15.22:39542) 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a6a7fc700 1 -- 172.21.15.22:0/3659689170 learned_addr learned my addr 172.21.15.22:0/3659689170 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:19.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a6affd700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 0x7f5a6c140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473973974 0 0) 0x7f5a6c15c2a0 con 0x7f5a6c06c0a0 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.406+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a58003570 con 0x7f5a6c06c0a0 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877482779 0 0) 0x7f5a58003570 con 0x7f5a6c06c0a0 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 msgr2=0x7f5a6c140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 0x7f5a6c140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 >> v1:172.21.15.192:6789/0 conn(0x7f5a6c0c9510 legacy=0x7f5a6c0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c15bc50 con 0x7f5a6c06c0a0 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5a54001470 con 0x7f5a6c06c0a0 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 >> v1:172.21.15.22:6789/0 conn(0x7f5a6c06c0a0 legacy=0x7f5a6c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a58003a90 0x7f5a58003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58004810 0x7f5a58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 0x7f5a580051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c15b970 con 0x7f5a58003a90 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800bb60 con 0x7f5a58004810 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5800bd20 con 0x7f5a6c06bcd0 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a58003a90 0x7f5a58003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6a7fc700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58004810 0x7f5a58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6b7fe700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 0x7f5a580051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 -- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 msgr2=0x7f5a580051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c06bcd0 0x7f5a580051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 -- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58004810 msgr2=0x7f5a58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58004810 0x7f5a58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 -- 172.21.15.22:0/3659689170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58003570 con 0x7f5a58003a90 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6a7fc700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58004810 0x7f5a58004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.407+0000 7f5a6affd700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a58003a90 0x7f5a58003ea0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009c00 tx=0x7f5a640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b7fc2c973d06b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400e710 con 0x7f5a58003a90 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400e870 con 0x7f5a58003a90 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a69ffb700 1 -- 172.21.15.22:0/3659689170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400ec30 con 0x7f5a58003a90 2023-10-08T00:31:19.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a71743700 1 -- 172.21.15.22:0/3659689170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a58003a90 msgr2=0x7f5a58003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a71743700 1 --2- 172.21.15.22:0/3659689170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a58003a90 0x7f5a58003ea0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f5a64009c00 tx=0x7f5a640091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a6b7fe700 1 -- 172.21.15.22:0/3659689170 reap_dead start 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a71743700 1 -- 172.21.15.22:0/3659689170 shutdown_connections 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a71743700 1 -- 172.21.15.22:0/3659689170 >> 172.21.15.22:0/3659689170 conn(0x7f5a6c0ce600 msgr2=0x7f5a6c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a71743700 1 -- 172.21.15.22:0/3659689170 shutdown_connections 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.408+0000 7f5a71743700 1 -- 172.21.15.22:0/3659689170 wait complete. 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.409+0000 7f5a71743700 1 Processor -- start 2023-10-08T00:31:19.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.409+0000 7f5a71743700 1 -- start start 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a71743700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58003a90 0x7f5a6c1726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a71743700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c158180 0x7f5a6c0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a71743700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 0x7f5a6c16dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a71743700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c13e940 con 0x7f5a6c16db10 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a71743700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c172be0 con 0x7f5a58003a90 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a71743700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c13eb70 con 0x7f5a6c158180 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 0x7f5a6c16dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 0x7f5a6c16dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50242/0 (socket says 172.21.15.22:50242) 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6b7fe700 1 -- 172.21.15.22:0/1766520154 learned_addr learned my addr 172.21.15.22:0/1766520154 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:19.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6a7fc700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c158180 0x7f5a6c0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6affd700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58003a90 0x7f5a6c1726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6b7fe700 1 -- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c158180 msgr2=0x7f5a6c0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.410+0000 7f5a6b7fe700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c158180 0x7f5a6c0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a6b7fe700 1 -- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58003a90 msgr2=0x7f5a6c1726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a6b7fe700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58003a90 0x7f5a6c1726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a6b7fe700 1 -- 172.21.15.22:0/1766520154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c13ee50 con 0x7f5a6c16db10 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a6b7fe700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 0x7f5a6c16dfb0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c007fd0 tx=0x7f5a5c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c0032e0 con 0x7f5a6c16db10 2023-10-08T00:31:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c001580 con 0x7f5a6c16db10 2023-10-08T00:31:19.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c13f130 con 0x7f5a6c16db10 2023-10-08T00:31:19.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c001940 con 0x7f5a6c16db10 2023-10-08T00:31:19.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.411+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c13f6f0 con 0x7f5a6c16db10 2023-10-08T00:31:19.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.412+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c13f910 con 0x7f5a6c16db10 2023-10-08T00:31:19.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.412+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5a5c001cb0 con 0x7f5a6c16db10 2023-10-08T00:31:19.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.413+0000 7f5a62ffd700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5a4c067290 0x7f5a4c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.413+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a5c0842d0 con 0x7f5a6c16db10 2023-10-08T00:31:19.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.413+0000 7f5a6affd700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5a4c067290 0x7f5a4c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.414+0000 7f5a6affd700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5a4c067290 0x7f5a4c069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a640091e0 tx=0x7f5a6401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.417+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a5c0511f0 con 0x7f5a6c16db10 2023-10-08T00:31:19.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.603+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a6c04c3c0 con 0x7f5a4c067290 2023-10-08T00:31:19.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.612+0000 7f5a62ffd700 1 -- 172.21.15.22:0/1766520154 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289761 (secure 0 0 0) 0x7f5a6c04c3c0 con 0x7f5a4c067290 2023-10-08T00:31:19.617 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5a4c067290 msgr2=0x7f5a4c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5a4c067290 0x7f5a4c069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a640091e0 tx=0x7f5a6401a000 comp rx=0 tx=0).stop 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 msgr2=0x7f5a6c16dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 0x7f5a6c16dfb0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c007fd0 tx=0x7f5a5c009040 comp rx=0 tx=0).stop 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 shutdown_connections 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a6c16db10 0x7f5a6c16dfb0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a58003a90 0x7f5a6c1726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5a4c067290 0x7f5a4c069740 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 --2- 172.21.15.22:0/1766520154 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5a6c158180 0x7f5a6c0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 >> 172.21.15.22:0/1766520154 conn(0x7f5a6c0ce600 msgr2=0x7f5a6c0cd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:19.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 shutdown_connections 2023-10-08T00:31:19.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.615+0000 7f5a71743700 1 -- 172.21.15.22:0/1766520154 wait complete. 2023-10-08T00:31:19.620 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:31:19.629 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-10-08T00:31:18.474977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2409808,"kb_used_data":11024,"kb_used_omap":0,"kb_used_meta":2398720,"kb_avail":752564912,"statfs":{"total":773094113280,"available":770626469888,"internally_reserved":0,"allocated":11288576,"data_stored":5526390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2456289280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.352724"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639607+0000","last_change":"2023-10-08T00:31:14.639607+0000","last_active":"2023-10-08T00:31:14.639607+0000","last_peered":"2023-10-08T00:31:14.639607+0000","last_clean":"2023-10-08T00:31:14.639607+0000","last_became_active":"2023-10-08T00:31:14.639404+0000","last_became_peered":"2023-10-08T00:31:14.639404+0000","last_unstale":"2023-10-08T00:31:14.639607+0000","last_undegraded":"2023-10-08T00:31:14.639607+0000","last_fullsized":"2023-10-08T00:31:14.639607+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:32.418126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635182+0000","last_change":"2023-10-08T00:31:14.635182+0000","last_active":"2023-10-08T00:31:14.635182+0000","last_peered":"2023-10-08T00:31:14.635182+0000","last_clean":"2023-10-08T00:31:14.635182+0000","last_became_active":"2023-10-08T00:31:14.634854+0000","last_became_peered":"2023-10-08T00:31:14.634854+0000","last_unstale":"2023-10-08T00:31:14.635182+0000","last_undegraded":"2023-10-08T00:31:14.635182+0000","last_fullsized":"2023-10-08T00:31:14.635182+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:27:45.276272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640511+0000","last_change":"2023-10-08T00:31:14.640511+0000","last_active":"2023-10-08T00:31:14.640511+0000","last_peered":"2023-10-08T00:31:14.640511+0000","last_clean":"2023-10-08T00:31:14.640511+0000","last_became_active":"2023-10-08T00:31:14.639147+0000","last_became_peered":"2023-10-08T00:31:14.639147+0000","last_unstale":"2023-10-08T00:31:14.640511+0000","last_undegraded":"2023-10-08T00:31:14.640511+0000","last_fullsized":"2023-10-08T00:31:14.640511+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:41.469959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640725+0000","last_change":"2023-10-08T00:31:14.640725+0000","last_active":"2023-10-08T00:31:14.640725+0000","last_peered":"2023-10-08T00:31:14.640725+0000","last_clean":"2023-10-08T00:31:14.640725+0000","last_became_active":"2023-10-08T00:31:14.640422+0000","last_became_peered":"2023-10-08T00:31:14.640422+0000","last_unstale":"2023-10-08T00:31:14.640725+0000","last_undegraded":"2023-10-08T00:31:14.640725+0000","last_fullsized":"2023-10-08T00:31:14.640725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:45:39.348793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635830+0000","last_change":"2023-10-08T00:31:14.635830+0000","last_active":"2023-10-08T00:31:14.635830+0000","last_peered":"2023-10-08T00:31:14.635830+0000","last_clean":"2023-10-08T00:31:14.635830+0000","last_became_active":"2023-10-08T00:31:14.635578+0000","last_became_peered":"2023-10-08T00:31:14.635578+0000","last_unstale":"2023-10-08T00:31:14.635830+0000","last_undegraded":"2023-10-08T00:31:14.635830+0000","last_fullsized":"2023-10-08T00:31:14.635830+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:56.084213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636144+0000","last_change":"2023-10-08T00:31:14.636144+0000","last_active":"2023-10-08T00:31:14.636144+0000","last_peered":"2023-10-08T00:31:14.636144+0000","last_clean":"2023-10-08T00:31:14.636144+0000","last_became_active":"2023-10-08T00:31:14.635878+0000","last_became_peered":"2023-10-08T00:31:14.635878+0000","last_unstale":"2023-10-08T00:31:14.636144+0000","last_undegraded":"2023-10-08T00:31:14.636144+0000","last_fullsized":"2023-10-08T00:31:14.636144+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:13:16.423701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638380+0000","last_change":"2023-10-08T00:31:14.638380+0000","last_active":"2023-10-08T00:31:14.638380+0000","last_peered":"2023-10-08T00:31:14.638380+0000","last_clean":"2023-10-08T00:31:14.638380+0000","last_became_active":"2023-10-08T00:31:14.638123+0000","last_became_peered":"2023-10-08T00:31:14.638123+0000","last_unstale":"2023-10-08T00:31:14.638380+0000","last_undegraded":"2023-10-08T00:31:14.638380+0000","last_fullsized":"2023-10-08T00:31:14.638380+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:20.319595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.634439+0000","last_change":"2023-10-08T00:31:14.634439+0000","last_active":"2023-10-08T00:31:14.634439+0000","last_peered":"2023-10-08T00:31:14.634439+0000","last_clean":"2023-10-08T00:31:14.634439+0000","last_became_active":"2023-10-08T00:31:14.632634+0000","last_became_peered":"2023-10-08T00:31:14.632634+0000","last_unstale":"2023-10-08T00:31:14.634439+0000","last_undegraded":"2023-10-08T00:31:14.634439+0000","last_fullsized":"2023-10-08T00:31:14.634439+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:29.340435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639183+0000","last_change":"2023-10-08T00:31:14.639183+0000","last_active":"2023-10-08T00:31:14.639183+0000","last_peered":"2023-10-08T00:31:14.639183+0000","last_clean":"2023-10-08T00:31:14.639183+0000","last_became_active":"2023-10-08T00:31:14.638595+0000","last_became_peered":"2023-10-08T00:31:14.638595+0000","last_unstale":"2023-10-08T00:31:14.639183+0000","last_undegraded":"2023-10-08T00:31:14.639183+0000","last_fullsized":"2023-10-08T00:31:14.639183+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:15:55.622214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.634867+0000","last_change":"2023-10-08T00:31:14.634867+0000","last_active":"2023-10-08T00:31:14.634867+0000","last_peered":"2023-10-08T00:31:14.634867+0000","last_clean":"2023-10-08T00:31:14.634867+0000","last_became_active":"2023-10-08T00:31:14.634522+0000","last_became_peered":"2023-10-08T00:31:14.634522+0000","last_unstale":"2023-10-08T00:31:14.634867+0000","last_undegraded":"2023-10-08T00:31:14.634867+0000","last_fullsized":"2023-10-08T00:31:14.634867+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:04:20.096924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638837+0000","last_change":"2023-10-08T00:31:14.638837+0000","last_active":"2023-10-08T00:31:14.638837+0000","last_peered":"2023-10-08T00:31:14.638837+0000","last_clean":"2023-10-08T00:31:14.638837+0000","last_became_active":"2023-10-08T00:31:14.638563+0000","last_became_peered":"2023-10-08T00:31:14.638563+0000","last_unstale":"2023-10-08T00:31:14.638837+0000","last_undegraded":"2023-10-08T00:31:14.638837+0000","last_fullsized":"2023-10-08T00:31:14.638837+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:48.057037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636389+0000","last_change":"2023-10-08T00:31:14.636389+0000","last_active":"2023-10-08T00:31:14.636389+0000","last_peered":"2023-10-08T00:31:14.636389+0000","last_clean":"2023-10-08T00:31:14.636389+0000","last_became_active":"2023-10-08T00:31:14.636079+0000","last_became_peered":"2023-10-08T00:31:14.636079+0000","last_unstale":"2023-10-08T00:31:14.636389+0000","last_undegraded":"2023-10-08T00:31:14.636389+0000","last_fullsized":"2023-10-08T00:31:14.636389+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:32.665570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636847+0000","last_change":"2023-10-08T00:31:14.636847+0000","last_active":"2023-10-08T00:31:14.636847+0000","last_peered":"2023-10-08T00:31:14.636847+0000","last_clean":"2023-10-08T00:31:14.636847+0000","last_became_active":"2023-10-08T00:31:14.636387+0000","last_became_peered":"2023-10-08T00:31:14.636387+0000","last_unstale":"2023-10-08T00:31:14.636847+0000","last_undegraded":"2023-10-08T00:31:14.636847+0000","last_fullsized":"2023-10-08T00:31:14.636847+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:17:48.656174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639912+0000","last_change":"2023-10-08T00:31:14.639912+0000","last_active":"2023-10-08T00:31:14.639912+0000","last_peered":"2023-10-08T00:31:14.639912+0000","last_clean":"2023-10-08T00:31:14.639912+0000","last_became_active":"2023-10-08T00:31:14.637186+0000","last_became_peered":"2023-10-08T00:31:14.637186+0000","last_unstale":"2023-10-08T00:31:14.639912+0000","last_undegraded":"2023-10-08T00:31:14.639912+0000","last_fullsized":"2023-10-08T00:31:14.639912+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:30.392525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636349+0000","last_change":"2023-10-08T00:31:14.636349+0000","last_active":"2023-10-08T00:31:14.636349+0000","last_peered":"2023-10-08T00:31:14.636349+0000","last_clean":"2023-10-08T00:31:14.636349+0000","last_became_active":"2023-10-08T00:31:14.636046+0000","last_became_peered":"2023-10-08T00:31:14.636046+0000","last_unstale":"2023-10-08T00:31:14.636349+0000","last_undegraded":"2023-10-08T00:31:14.636349+0000","last_fullsized":"2023-10-08T00:31:14.636349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:15.979614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638911+0000","last_change":"2023-10-08T00:31:14.638911+0000","last_active":"2023-10-08T00:31:14.638911+0000","last_peered":"2023-10-08T00:31:14.638911+0000","last_clean":"2023-10-08T00:31:14.638911+0000","last_became_active":"2023-10-08T00:31:14.637661+0000","last_became_peered":"2023-10-08T00:31:14.637661+0000","last_unstale":"2023-10-08T00:31:14.638911+0000","last_undegraded":"2023-10-08T00:31:14.638911+0000","last_fullsized":"2023-10-08T00:31:14.638911+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:45.332909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638880+0000","last_change":"2023-10-08T00:31:14.638880+0000","last_active":"2023-10-08T00:31:14.638880+0000","last_peered":"2023-10-08T00:31:14.638880+0000","last_clean":"2023-10-08T00:31:14.638880+0000","last_became_active":"2023-10-08T00:31:14.638609+0000","last_became_peered":"2023-10-08T00:31:14.638609+0000","last_unstale":"2023-10-08T00:31:14.638880+0000","last_undegraded":"2023-10-08T00:31:14.638880+0000","last_fullsized":"2023-10-08T00:31:14.638880+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:49.184354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638292+0000","last_change":"2023-10-08T00:31:14.638292+0000","last_active":"2023-10-08T00:31:14.638292+0000","last_peered":"2023-10-08T00:31:14.638292+0000","last_clean":"2023-10-08T00:31:14.638292+0000","last_became_active":"2023-10-08T00:31:14.638036+0000","last_became_peered":"2023-10-08T00:31:14.638036+0000","last_unstale":"2023-10-08T00:31:14.638292+0000","last_undegraded":"2023-10-08T00:31:14.638292+0000","last_fullsized":"2023-10-08T00:31:14.638292+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:54:26.797118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636858+0000","last_change":"2023-10-08T00:31:14.636858+0000","last_active":"2023-10-08T00:31:14.636858+0000","last_peered":"2023-10-08T00:31:14.636858+0000","last_clean":"2023-10-08T00:31:14.636858+0000","last_became_active":"2023-10-08T00:31:14.636250+0000","last_became_peered":"2023-10-08T00:31:14.636250+0000","last_unstale":"2023-10-08T00:31:14.636858+0000","last_undegraded":"2023-10-08T00:31:14.636858+0000","last_fullsized":"2023-10-08T00:31:14.636858+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:13.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633897+0000","last_change":"2023-10-08T00:31:14.633897+0000","last_active":"2023-10-08T00:31:14.633897+0000","last_peered":"2023-10-08T00:31:14.633897+0000","last_clean":"2023-10-08T00:31:14.633897+0000","last_became_active":"2023-10-08T00:31:14.633612+0000","last_became_peered":"2023-10-08T00:31:14.633612+0000","last_unstale":"2023-10-08T00:31:14.633897+0000","last_undegraded":"2023-10-08T00:31:14.633897+0000","last_fullsized":"2023-10-08T00:31:14.633897+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:19.675339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636188+0000","last_change":"2023-10-08T00:31:14.636188+0000","last_active":"2023-10-08T00:31:14.636188+0000","last_peered":"2023-10-08T00:31:14.636188+0000","last_clean":"2023-10-08T00:31:14.636188+0000","last_became_active":"2023-10-08T00:31:14.635921+0000","last_became_peered":"2023-10-08T00:31:14.635921+0000","last_unstale":"2023-10-08T00:31:14.636188+0000","last_undegraded":"2023-10-08T00:31:14.636188+0000","last_fullsized":"2023-10-08T00:31:14.636188+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:18.990112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640632+0000","last_change":"2023-10-08T00:31:14.640632+0000","last_active":"2023-10-08T00:31:14.640632+0000","last_peered":"2023-10-08T00:31:14.640632+0000","last_clean":"2023-10-08T00:31:14.640632+0000","last_became_active":"2023-10-08T00:31:14.640395+0000","last_became_peered":"2023-10-08T00:31:14.640395+0000","last_unstale":"2023-10-08T00:31:14.640632+0000","last_undegraded":"2023-10-08T00:31:14.640632+0000","last_fullsized":"2023-10-08T00:31:14.640632+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:20.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633929+0000","last_change":"2023-10-08T00:31:14.633929+0000","last_active":"2023-10-08T00:31:14.633929+0000","last_peered":"2023-10-08T00:31:14.633929+0000","last_clean":"2023-10-08T00:31:14.633929+0000","last_became_active":"2023-10-08T00:31:14.633649+0000","last_became_peered":"2023-10-08T00:31:14.633649+0000","last_unstale":"2023-10-08T00:31:14.633929+0000","last_undegraded":"2023-10-08T00:31:14.633929+0000","last_fullsized":"2023-10-08T00:31:14.633929+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:38.005441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638429+0000","last_change":"2023-10-08T00:31:14.638429+0000","last_active":"2023-10-08T00:31:14.638429+0000","last_peered":"2023-10-08T00:31:14.638429+0000","last_clean":"2023-10-08T00:31:14.638429+0000","last_became_active":"2023-10-08T00:31:14.638172+0000","last_became_peered":"2023-10-08T00:31:14.638172+0000","last_unstale":"2023-10-08T00:31:14.638429+0000","last_undegraded":"2023-10-08T00:31:14.638429+0000","last_fullsized":"2023-10-08T00:31:14.638429+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:54.289753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638167+0000","last_change":"2023-10-08T00:31:14.638167+0000","last_active":"2023-10-08T00:31:14.638167+0000","last_peered":"2023-10-08T00:31:14.638167+0000","last_clean":"2023-10-08T00:31:14.638167+0000","last_became_active":"2023-10-08T00:31:14.637891+0000","last_became_peered":"2023-10-08T00:31:14.637891+0000","last_unstale":"2023-10-08T00:31:14.638167+0000","last_undegraded":"2023-10-08T00:31:14.638167+0000","last_fullsized":"2023-10-08T00:31:14.638167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:30:37.710251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.643436+0000","last_change":"2023-10-08T00:31:14.643436+0000","last_active":"2023-10-08T00:31:14.643436+0000","last_peered":"2023-10-08T00:31:14.643436+0000","last_clean":"2023-10-08T00:31:14.643436+0000","last_became_active":"2023-10-08T00:31:14.642977+0000","last_became_peered":"2023-10-08T00:31:14.642977+0000","last_unstale":"2023-10-08T00:31:14.643436+0000","last_undegraded":"2023-10-08T00:31:14.643436+0000","last_fullsized":"2023-10-08T00:31:14.643436+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:10.023289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637602+0000","last_change":"2023-10-08T00:31:14.637602+0000","last_active":"2023-10-08T00:31:14.637602+0000","last_peered":"2023-10-08T00:31:14.637602+0000","last_clean":"2023-10-08T00:31:14.637602+0000","last_became_active":"2023-10-08T00:31:14.637357+0000","last_became_peered":"2023-10-08T00:31:14.637357+0000","last_unstale":"2023-10-08T00:31:14.637602+0000","last_undegraded":"2023-10-08T00:31:14.637602+0000","last_fullsized":"2023-10-08T00:31:14.637602+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:57.087805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641557+0000","last_change":"2023-10-08T00:31:14.641557+0000","last_active":"2023-10-08T00:31:14.641557+0000","last_peered":"2023-10-08T00:31:14.641557+0000","last_clean":"2023-10-08T00:31:14.641557+0000","last_became_active":"2023-10-08T00:31:14.641277+0000","last_became_peered":"2023-10-08T00:31:14.641277+0000","last_unstale":"2023-10-08T00:31:14.641557+0000","last_undegraded":"2023-10-08T00:31:14.641557+0000","last_fullsized":"2023-10-08T00:31:14.641557+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:13.309773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635852+0000","last_change":"2023-10-08T00:31:14.635852+0000","last_active":"2023-10-08T00:31:14.635852+0000","last_peered":"2023-10-08T00:31:14.635852+0000","last_clean":"2023-10-08T00:31:14.635852+0000","last_became_active":"2023-10-08T00:31:14.635533+0000","last_became_peered":"2023-10-08T00:31:14.635533+0000","last_unstale":"2023-10-08T00:31:14.635852+0000","last_undegraded":"2023-10-08T00:31:14.635852+0000","last_fullsized":"2023-10-08T00:31:14.635852+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:47:53.483845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636100+0000","last_change":"2023-10-08T00:31:14.636100+0000","last_active":"2023-10-08T00:31:14.636100+0000","last_peered":"2023-10-08T00:31:14.636100+0000","last_clean":"2023-10-08T00:31:14.636100+0000","last_became_active":"2023-10-08T00:31:14.635779+0000","last_became_peered":"2023-10-08T00:31:14.635779+0000","last_unstale":"2023-10-08T00:31:14.636100+0000","last_undegraded":"2023-10-08T00:31:14.636100+0000","last_fullsized":"2023-10-08T00:31:14.636100+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:56.947161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.642447+0000","last_change":"2023-10-08T00:31:14.642447+0000","last_active":"2023-10-08T00:31:14.642447+0000","last_peered":"2023-10-08T00:31:14.642447+0000","last_clean":"2023-10-08T00:31:14.642447+0000","last_became_active":"2023-10-08T00:31:14.642171+0000","last_became_peered":"2023-10-08T00:31:14.642171+0000","last_unstale":"2023-10-08T00:31:14.642447+0000","last_undegraded":"2023-10-08T00:31:14.642447+0000","last_fullsized":"2023-10-08T00:31:14.642447+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:34.207689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636583+0000","last_change":"2023-10-08T00:31:14.636583+0000","last_active":"2023-10-08T00:31:14.636583+0000","last_peered":"2023-10-08T00:31:14.636583+0000","last_clean":"2023-10-08T00:31:14.636583+0000","last_became_active":"2023-10-08T00:31:14.635385+0000","last_became_peered":"2023-10-08T00:31:14.635385+0000","last_unstale":"2023-10-08T00:31:14.636583+0000","last_undegraded":"2023-10-08T00:31:14.636583+0000","last_fullsized":"2023-10-08T00:31:14.636583+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:34:55.047672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633672+0000","last_change":"2023-10-08T00:31:14.633672+0000","last_active":"2023-10-08T00:31:14.633672+0000","last_peered":"2023-10-08T00:31:14.633672+0000","last_clean":"2023-10-08T00:31:14.633672+0000","last_became_active":"2023-10-08T00:31:14.633411+0000","last_became_peered":"2023-10-08T00:31:14.633411+0000","last_unstale":"2023-10-08T00:31:14.633672+0000","last_undegraded":"2023-10-08T00:31:14.633672+0000","last_fullsized":"2023-10-08T00:31:14.633672+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:35.542401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"101'4","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148702+0000","last_change":"2023-10-08T00:31:14.140132+0000","last_active":"2023-10-08T00:31:15.148702+0000","last_peered":"2023-10-08T00:31:15.148702+0000","last_clean":"2023-10-08T00:31:15.148702+0000","last_became_active":"2023-10-08T00:31:14.139551+0000","last_became_peered":"2023-10-08T00:31:14.139551+0000","last_unstale":"2023-10-08T00:31:15.148702+0000","last_undegraded":"2023-10-08T00:31:15.148702+0000","last_fullsized":"2023-10-08T00:31:15.148702+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:30.114197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637273+0000","last_change":"2023-10-08T00:31:14.637273+0000","last_active":"2023-10-08T00:31:14.637273+0000","last_peered":"2023-10-08T00:31:14.637273+0000","last_clean":"2023-10-08T00:31:14.637273+0000","last_became_active":"2023-10-08T00:31:14.636946+0000","last_became_peered":"2023-10-08T00:31:14.636946+0000","last_unstale":"2023-10-08T00:31:14.637273+0000","last_undegraded":"2023-10-08T00:31:14.637273+0000","last_fullsized":"2023-10-08T00:31:14.637273+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:39.961841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.625513+0000","last_change":"2023-10-08T00:31:14.139733+0000","last_active":"2023-10-08T00:31:14.625513+0000","last_peered":"2023-10-08T00:31:14.625513+0000","last_clean":"2023-10-08T00:31:14.625513+0000","last_became_active":"2023-10-08T00:31:14.139497+0000","last_became_peered":"2023-10-08T00:31:14.139497+0000","last_unstale":"2023-10-08T00:31:14.625513+0000","last_undegraded":"2023-10-08T00:31:14.625513+0000","last_fullsized":"2023-10-08T00:31:14.625513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:48.180515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636375+0000","last_change":"2023-10-08T00:31:14.636375+0000","last_active":"2023-10-08T00:31:14.636375+0000","last_peered":"2023-10-08T00:31:14.636375+0000","last_clean":"2023-10-08T00:31:14.636375+0000","last_became_active":"2023-10-08T00:31:14.634638+0000","last_became_peered":"2023-10-08T00:31:14.634638+0000","last_unstale":"2023-10-08T00:31:14.636375+0000","last_undegraded":"2023-10-08T00:31:14.636375+0000","last_fullsized":"2023-10-08T00:31:14.636375+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:10:16.639032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148211+0000","last_change":"2023-10-08T00:31:14.143237+0000","last_active":"2023-10-08T00:31:15.148211+0000","last_peered":"2023-10-08T00:31:15.148211+0000","last_clean":"2023-10-08T00:31:15.148211+0000","last_became_active":"2023-10-08T00:31:14.142933+0000","last_became_peered":"2023-10-08T00:31:14.142933+0000","last_unstale":"2023-10-08T00:31:15.148211+0000","last_undegraded":"2023-10-08T00:31:15.148211+0000","last_fullsized":"2023-10-08T00:31:15.148211+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:51.735675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637492+0000","last_change":"2023-10-08T00:31:14.637492+0000","last_active":"2023-10-08T00:31:14.637492+0000","last_peered":"2023-10-08T00:31:14.637492+0000","last_clean":"2023-10-08T00:31:14.637492+0000","last_became_active":"2023-10-08T00:31:14.636636+0000","last_became_peered":"2023-10-08T00:31:14.636636+0000","last_unstale":"2023-10-08T00:31:14.637492+0000","last_undegraded":"2023-10-08T00:31:14.637492+0000","last_fullsized":"2023-10-08T00:31:14.637492+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:54.289753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148016+0000","last_change":"2023-10-08T00:31:14.143340+0000","last_active":"2023-10-08T00:31:15.148016+0000","last_peered":"2023-10-08T00:31:15.148016+0000","last_clean":"2023-10-08T00:31:15.148016+0000","last_became_active":"2023-10-08T00:31:14.143043+0000","last_became_peered":"2023-10-08T00:31:14.143043+0000","last_unstale":"2023-10-08T00:31:15.148016+0000","last_undegraded":"2023-10-08T00:31:15.148016+0000","last_fullsized":"2023-10-08T00:31:15.148016+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:40:13.523188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635504+0000","last_change":"2023-10-08T00:31:14.635504+0000","last_active":"2023-10-08T00:31:14.635504+0000","last_peered":"2023-10-08T00:31:14.635504+0000","last_clean":"2023-10-08T00:31:14.635504+0000","last_became_active":"2023-10-08T00:31:14.635241+0000","last_became_peered":"2023-10-08T00:31:14.635241+0000","last_unstale":"2023-10-08T00:31:14.635504+0000","last_undegraded":"2023-10-08T00:31:14.635504+0000","last_fullsized":"2023-10-08T00:31:14.635504+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:39:36.732638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.628475+0000","last_change":"2023-10-08T00:31:14.146339+0000","last_active":"2023-10-08T00:31:14.628475+0000","last_peered":"2023-10-08T00:31:14.628475+0000","last_clean":"2023-10-08T00:31:14.628475+0000","last_became_active":"2023-10-08T00:31:14.146065+0000","last_became_peered":"2023-10-08T00:31:14.146065+0000","last_unstale":"2023-10-08T00:31:14.628475+0000","last_undegraded":"2023-10-08T00:31:14.628475+0000","last_fullsized":"2023-10-08T00:31:14.628475+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:11:51.735675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635637+0000","last_change":"2023-10-08T00:31:14.635637+0000","last_active":"2023-10-08T00:31:14.635637+0000","last_peered":"2023-10-08T00:31:14.635637+0000","last_clean":"2023-10-08T00:31:14.635637+0000","last_became_active":"2023-10-08T00:31:14.635160+0000","last_became_peered":"2023-10-08T00:31:14.635160+0000","last_unstale":"2023-10-08T00:31:14.635637+0000","last_undegraded":"2023-10-08T00:31:14.635637+0000","last_fullsized":"2023-10-08T00:31:14.635637+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:21.888164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.631860+0000","last_change":"2023-10-08T00:31:14.135014+0000","last_active":"2023-10-08T00:31:14.631860+0000","last_peered":"2023-10-08T00:31:14.631860+0000","last_clean":"2023-10-08T00:31:14.631860+0000","last_became_active":"2023-10-08T00:31:14.134753+0000","last_became_peered":"2023-10-08T00:31:14.134753+0000","last_unstale":"2023-10-08T00:31:14.631860+0000","last_undegraded":"2023-10-08T00:31:14.631860+0000","last_fullsized":"2023-10-08T00:31:14.631860+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:48.180515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.631780+0000","last_change":"2023-10-08T00:31:14.631780+0000","last_active":"2023-10-08T00:31:14.631780+0000","last_peered":"2023-10-08T00:31:14.631780+0000","last_clean":"2023-10-08T00:31:14.631780+0000","last_became_active":"2023-10-08T00:31:14.631534+0000","last_became_peered":"2023-10-08T00:31:14.631534+0000","last_unstale":"2023-10-08T00:31:14.631780+0000","last_undegraded":"2023-10-08T00:31:14.631780+0000","last_fullsized":"2023-10-08T00:31:14.631780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:00:54.864295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.138790+0000","last_change":"2023-10-08T00:31:14.136802+0000","last_active":"2023-10-08T00:31:14.138790+0000","last_peered":"2023-10-08T00:31:14.138790+0000","last_clean":"2023-10-08T00:31:14.138790+0000","last_became_active":"2023-10-08T00:31:14.136579+0000","last_became_peered":"2023-10-08T00:31:14.136579+0000","last_unstale":"2023-10-08T00:31:14.138790+0000","last_undegraded":"2023-10-08T00:31:14.138790+0000","last_fullsized":"2023-10-08T00:31:14.138790+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:54.540074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639056+0000","last_change":"2023-10-08T00:31:14.639056+0000","last_active":"2023-10-08T00:31:14.639056+0000","last_peered":"2023-10-08T00:31:14.639056+0000","last_clean":"2023-10-08T00:31:14.639056+0000","last_became_active":"2023-10-08T00:31:14.637659+0000","last_became_peered":"2023-10-08T00:31:14.637659+0000","last_unstale":"2023-10-08T00:31:14.639056+0000","last_undegraded":"2023-10-08T00:31:14.639056+0000","last_fullsized":"2023-10-08T00:31:14.639056+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:04:47.481758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.149217+0000","last_change":"2023-10-08T00:31:14.148068+0000","last_active":"2023-10-08T00:31:14.149217+0000","last_peered":"2023-10-08T00:31:14.149217+0000","last_clean":"2023-10-08T00:31:14.149217+0000","last_became_active":"2023-10-08T00:31:14.147748+0000","last_became_peered":"2023-10-08T00:31:14.147748+0000","last_unstale":"2023-10-08T00:31:14.149217+0000","last_undegraded":"2023-10-08T00:31:14.149217+0000","last_fullsized":"2023-10-08T00:31:14.149217+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:37:16.985156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.642560+0000","last_change":"2023-10-08T00:31:14.642560+0000","last_active":"2023-10-08T00:31:14.642560+0000","last_peered":"2023-10-08T00:31:14.642560+0000","last_clean":"2023-10-08T00:31:14.642560+0000","last_became_active":"2023-10-08T00:31:14.642232+0000","last_became_peered":"2023-10-08T00:31:14.642232+0000","last_unstale":"2023-10-08T00:31:14.642560+0000","last_undegraded":"2023-10-08T00:31:14.642560+0000","last_fullsized":"2023-10-08T00:31:14.642560+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:26:57.132900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.144853+0000","last_change":"2023-10-08T00:31:14.143347+0000","last_active":"2023-10-08T00:31:14.144853+0000","last_peered":"2023-10-08T00:31:14.144853+0000","last_clean":"2023-10-08T00:31:14.144853+0000","last_became_active":"2023-10-08T00:31:14.143021+0000","last_became_peered":"2023-10-08T00:31:14.143021+0000","last_unstale":"2023-10-08T00:31:14.144853+0000","last_undegraded":"2023-10-08T00:31:14.144853+0000","last_fullsized":"2023-10-08T00:31:14.144853+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:50:23.559843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641278+0000","last_change":"2023-10-08T00:31:14.641278+0000","last_active":"2023-10-08T00:31:14.641278+0000","last_peered":"2023-10-08T00:31:14.641278+0000","last_clean":"2023-10-08T00:31:14.641278+0000","last_became_active":"2023-10-08T00:31:14.640759+0000","last_became_peered":"2023-10-08T00:31:14.640759+0000","last_unstale":"2023-10-08T00:31:14.641278+0000","last_undegraded":"2023-10-08T00:31:14.641278+0000","last_fullsized":"2023-10-08T00:31:14.641278+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:15:30.149788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.137388+0000","last_change":"2023-10-08T00:31:14.134442+0000","last_active":"2023-10-08T00:31:14.137388+0000","last_peered":"2023-10-08T00:31:14.137388+0000","last_clean":"2023-10-08T00:31:14.137388+0000","last_became_active":"2023-10-08T00:31:14.134162+0000","last_became_peered":"2023-10-08T00:31:14.134162+0000","last_unstale":"2023-10-08T00:31:14.137388+0000","last_undegraded":"2023-10-08T00:31:14.137388+0000","last_fullsized":"2023-10-08T00:31:14.137388+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:47.053198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638397+0000","last_change":"2023-10-08T00:31:14.638397+0000","last_active":"2023-10-08T00:31:14.638397+0000","last_peered":"2023-10-08T00:31:14.638397+0000","last_clean":"2023-10-08T00:31:14.638397+0000","last_became_active":"2023-10-08T00:31:14.638132+0000","last_became_peered":"2023-10-08T00:31:14.638132+0000","last_unstale":"2023-10-08T00:31:14.638397+0000","last_undegraded":"2023-10-08T00:31:14.638397+0000","last_fullsized":"2023-10-08T00:31:14.638397+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:30.392525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"101'3","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.146497+0000","last_change":"2023-10-08T00:31:14.142998+0000","last_active":"2023-10-08T00:31:15.146497+0000","last_peered":"2023-10-08T00:31:15.146497+0000","last_clean":"2023-10-08T00:31:15.146497+0000","last_became_active":"2023-10-08T00:31:14.142698+0000","last_became_peered":"2023-10-08T00:31:14.142698+0000","last_unstale":"2023-10-08T00:31:15.146497+0000","last_undegraded":"2023-10-08T00:31:15.146497+0000","last_fullsized":"2023-10-08T00:31:15.146497+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:46:26.030069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641164+0000","last_change":"2023-10-08T00:31:14.641164+0000","last_active":"2023-10-08T00:31:14.641164+0000","last_peered":"2023-10-08T00:31:14.641164+0000","last_clean":"2023-10-08T00:31:14.641164+0000","last_became_active":"2023-10-08T00:31:14.640797+0000","last_became_peered":"2023-10-08T00:31:14.640797+0000","last_unstale":"2023-10-08T00:31:14.641164+0000","last_undegraded":"2023-10-08T00:31:14.641164+0000","last_fullsized":"2023-10-08T00:31:14.641164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:55.543913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"101'6","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.147383+0000","last_change":"2023-10-08T00:31:14.142461+0000","last_active":"2023-10-08T00:31:15.147383+0000","last_peered":"2023-10-08T00:31:15.147383+0000","last_clean":"2023-10-08T00:31:15.147383+0000","last_became_active":"2023-10-08T00:31:14.142179+0000","last_became_peered":"2023-10-08T00:31:14.142179+0000","last_unstale":"2023-10-08T00:31:15.147383+0000","last_undegraded":"2023-10-08T00:31:15.147383+0000","last_fullsized":"2023-10-08T00:31:15.147383+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:01:29.388687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635746+0000","last_change":"2023-10-08T00:31:14.635746+0000","last_active":"2023-10-08T00:31:14.635746+0000","last_peered":"2023-10-08T00:31:14.635746+0000","last_clean":"2023-10-08T00:31:14.635746+0000","last_became_active":"2023-10-08T00:31:14.635473+0000","last_became_peered":"2023-10-08T00:31:14.635473+0000","last_unstale":"2023-10-08T00:31:14.635746+0000","last_undegraded":"2023-10-08T00:31:14.635746+0000","last_fullsized":"2023-10-08T00:31:14.635746+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:37:17.988995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148723+0000","last_change":"2023-10-08T00:31:14.142396+0000","last_active":"2023-10-08T00:31:15.148723+0000","last_peered":"2023-10-08T00:31:15.148723+0000","last_clean":"2023-10-08T00:31:15.148723+0000","last_became_active":"2023-10-08T00:31:14.141982+0000","last_became_peered":"2023-10-08T00:31:14.141982+0000","last_unstale":"2023-10-08T00:31:15.148723+0000","last_undegraded":"2023-10-08T00:31:15.148723+0000","last_fullsized":"2023-10-08T00:31:15.148723+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:00:47.187596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639795+0000","last_change":"2023-10-08T00:31:14.639795+0000","last_active":"2023-10-08T00:31:14.639795+0000","last_peered":"2023-10-08T00:31:14.639795+0000","last_clean":"2023-10-08T00:31:14.639795+0000","last_became_active":"2023-10-08T00:31:14.639543+0000","last_became_peered":"2023-10-08T00:31:14.639543+0000","last_unstale":"2023-10-08T00:31:14.639795+0000","last_undegraded":"2023-10-08T00:31:14.639795+0000","last_fullsized":"2023-10-08T00:31:14.639795+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:41.469959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.139322+0000","last_change":"2023-10-08T00:31:14.137549+0000","last_active":"2023-10-08T00:31:14.139322+0000","last_peered":"2023-10-08T00:31:14.139322+0000","last_clean":"2023-10-08T00:31:14.139322+0000","last_became_active":"2023-10-08T00:31:14.137244+0000","last_became_peered":"2023-10-08T00:31:14.137244+0000","last_unstale":"2023-10-08T00:31:14.139322+0000","last_undegraded":"2023-10-08T00:31:14.139322+0000","last_fullsized":"2023-10-08T00:31:14.139322+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:10.136838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639277+0000","last_change":"2023-10-08T00:31:14.639277+0000","last_active":"2023-10-08T00:31:14.639277+0000","last_peered":"2023-10-08T00:31:14.639277+0000","last_clean":"2023-10-08T00:31:14.639277+0000","last_became_active":"2023-10-08T00:31:14.637966+0000","last_became_peered":"2023-10-08T00:31:14.637966+0000","last_unstale":"2023-10-08T00:31:14.639277+0000","last_undegraded":"2023-10-08T00:31:14.639277+0000","last_fullsized":"2023-10-08T00:31:14.639277+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:39.609469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"101'8","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.149155+0000","last_change":"2023-10-08T00:31:14.147157+0000","last_active":"2023-10-08T00:31:15.149155+0000","last_peered":"2023-10-08T00:31:15.149155+0000","last_clean":"2023-10-08T00:31:15.149155+0000","last_became_active":"2023-10-08T00:31:14.146865+0000","last_became_peered":"2023-10-08T00:31:14.146865+0000","last_unstale":"2023-10-08T00:31:15.149155+0000","last_undegraded":"2023-10-08T00:31:15.149155+0000","last_fullsized":"2023-10-08T00:31:15.149155+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:30.114197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637336+0000","last_change":"2023-10-08T00:31:14.637336+0000","last_active":"2023-10-08T00:31:14.637336+0000","last_peered":"2023-10-08T00:31:14.637336+0000","last_clean":"2023-10-08T00:31:14.637336+0000","last_became_active":"2023-10-08T00:31:14.637073+0000","last_became_peered":"2023-10-08T00:31:14.637073+0000","last_unstale":"2023-10-08T00:31:14.637336+0000","last_undegraded":"2023-10-08T00:31:14.637336+0000","last_fullsized":"2023-10-08T00:31:14.637336+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:03:18.418636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.631275+0000","last_change":"2023-10-08T00:31:14.139724+0000","last_active":"2023-10-08T00:31:14.631275+0000","last_peered":"2023-10-08T00:31:14.631275+0000","last_clean":"2023-10-08T00:31:14.631275+0000","last_became_active":"2023-10-08T00:31:14.139243+0000","last_became_peered":"2023-10-08T00:31:14.139243+0000","last_unstale":"2023-10-08T00:31:14.631275+0000","last_undegraded":"2023-10-08T00:31:14.631275+0000","last_fullsized":"2023-10-08T00:31:14.631275+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:19.505044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640814+0000","last_change":"2023-10-08T00:31:14.640814+0000","last_active":"2023-10-08T00:31:14.640814+0000","last_peered":"2023-10-08T00:31:14.640814+0000","last_clean":"2023-10-08T00:31:14.640814+0000","last_became_active":"2023-10-08T00:31:14.640552+0000","last_became_peered":"2023-10-08T00:31:14.640552+0000","last_unstale":"2023-10-08T00:31:14.640814+0000","last_undegraded":"2023-10-08T00:31:14.640814+0000","last_fullsized":"2023-10-08T00:31:14.640814+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:01:45.958938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.149335+0000","last_change":"2023-10-08T00:31:14.129589+0000","last_active":"2023-10-08T00:31:15.149335+0000","last_peered":"2023-10-08T00:31:15.149335+0000","last_clean":"2023-10-08T00:31:15.149335+0000","last_became_active":"2023-10-08T00:31:14.129298+0000","last_became_peered":"2023-10-08T00:31:14.129298+0000","last_unstale":"2023-10-08T00:31:15.149335+0000","last_undegraded":"2023-10-08T00:31:15.149335+0000","last_fullsized":"2023-10-08T00:31:15.149335+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:57.306116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641965+0000","last_change":"2023-10-08T00:31:14.641965+0000","last_active":"2023-10-08T00:31:14.641965+0000","last_peered":"2023-10-08T00:31:14.641965+0000","last_clean":"2023-10-08T00:31:14.641965+0000","last_became_active":"2023-10-08T00:31:14.641470+0000","last_became_peered":"2023-10-08T00:31:14.641470+0000","last_unstale":"2023-10-08T00:31:14.641965+0000","last_undegraded":"2023-10-08T00:31:14.641965+0000","last_fullsized":"2023-10-08T00:31:14.641965+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:22.813458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"101'1","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633258+0000","last_change":"2023-10-08T00:31:14.138672+0000","last_active":"2023-10-08T00:31:14.633258+0000","last_peered":"2023-10-08T00:31:14.633258+0000","last_clean":"2023-10-08T00:31:14.633258+0000","last_became_active":"2023-10-08T00:31:14.138414+0000","last_became_peered":"2023-10-08T00:31:14.138414+0000","last_unstale":"2023-10-08T00:31:14.633258+0000","last_undegraded":"2023-10-08T00:31:14.633258+0000","last_fullsized":"2023-10-08T00:31:14.633258+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:44:54.540074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.643064+0000","last_change":"2023-10-08T00:31:14.643064+0000","last_active":"2023-10-08T00:31:14.643064+0000","last_peered":"2023-10-08T00:31:14.643064+0000","last_clean":"2023-10-08T00:31:14.643064+0000","last_became_active":"2023-10-08T00:31:14.642584+0000","last_became_peered":"2023-10-08T00:31:14.642584+0000","last_unstale":"2023-10-08T00:31:14.643064+0000","last_undegraded":"2023-10-08T00:31:14.643064+0000","last_fullsized":"2023-10-08T00:31:14.643064+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:13.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148962+0000","last_change":"2023-10-08T00:31:14.148391+0000","last_active":"2023-10-08T00:31:14.148962+0000","last_peered":"2023-10-08T00:31:14.148962+0000","last_clean":"2023-10-08T00:31:14.148962+0000","last_became_active":"2023-10-08T00:31:14.148136+0000","last_became_peered":"2023-10-08T00:31:14.148136+0000","last_unstale":"2023-10-08T00:31:14.148962+0000","last_undegraded":"2023-10-08T00:31:14.148962+0000","last_fullsized":"2023-10-08T00:31:14.148962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:06:43.309508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638884+0000","last_change":"2023-10-08T00:31:14.638884+0000","last_active":"2023-10-08T00:31:14.638884+0000","last_peered":"2023-10-08T00:31:14.638884+0000","last_clean":"2023-10-08T00:31:14.638884+0000","last_became_active":"2023-10-08T00:31:14.638624+0000","last_became_peered":"2023-10-08T00:31:14.638624+0000","last_unstale":"2023-10-08T00:31:14.638884+0000","last_undegraded":"2023-10-08T00:31:14.638884+0000","last_fullsized":"2023-10-08T00:31:14.638884+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:20.508882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.148270+0000","last_change":"2023-10-08T00:31:14.142240+0000","last_active":"2023-10-08T00:31:15.148270+0000","last_peered":"2023-10-08T00:31:15.148270+0000","last_clean":"2023-10-08T00:31:15.148270+0000","last_became_active":"2023-10-08T00:31:14.141615+0000","last_became_peered":"2023-10-08T00:31:14.141615+0000","last_unstale":"2023-10-08T00:31:15.148270+0000","last_undegraded":"2023-10-08T00:31:15.148270+0000","last_fullsized":"2023-10-08T00:31:15.148270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:03:17.414797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637220+0000","last_change":"2023-10-08T00:31:14.637220+0000","last_active":"2023-10-08T00:31:14.637220+0000","last_peered":"2023-10-08T00:31:14.637220+0000","last_clean":"2023-10-08T00:31:14.637220+0000","last_became_active":"2023-10-08T00:31:14.636906+0000","last_became_peered":"2023-10-08T00:31:14.636906+0000","last_unstale":"2023-10-08T00:31:14.637220+0000","last_undegraded":"2023-10-08T00:31:14.637220+0000","last_fullsized":"2023-10-08T00:31:14.637220+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:26:25.703773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.144911+0000","last_change":"2023-10-08T00:31:14.143904+0000","last_active":"2023-10-08T00:31:14.144911+0000","last_peered":"2023-10-08T00:31:14.144911+0000","last_clean":"2023-10-08T00:31:14.144911+0000","last_became_active":"2023-10-08T00:31:14.143634+0000","last_became_peered":"2023-10-08T00:31:14.143634+0000","last_unstale":"2023-10-08T00:31:14.144911+0000","last_undegraded":"2023-10-08T00:31:14.144911+0000","last_fullsized":"2023-10-08T00:31:14.144911+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:57:47.854753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.633871+0000","last_change":"2023-10-08T00:31:14.633871+0000","last_active":"2023-10-08T00:31:14.633871+0000","last_peered":"2023-10-08T00:31:14.633871+0000","last_clean":"2023-10-08T00:31:14.633871+0000","last_became_active":"2023-10-08T00:31:14.633594+0000","last_became_peered":"2023-10-08T00:31:14.633594+0000","last_unstale":"2023-10-08T00:31:14.633871+0000","last_undegraded":"2023-10-08T00:31:14.633871+0000","last_fullsized":"2023-10-08T00:31:14.633871+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:06.967746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.142638+0000","last_change":"2023-10-08T00:31:14.141101+0000","last_active":"2023-10-08T00:31:14.142638+0000","last_peered":"2023-10-08T00:31:14.142638+0000","last_clean":"2023-10-08T00:31:14.142638+0000","last_became_active":"2023-10-08T00:31:14.140770+0000","last_became_peered":"2023-10-08T00:31:14.140770+0000","last_unstale":"2023-10-08T00:31:14.142638+0000","last_undegraded":"2023-10-08T00:31:14.142638+0000","last_fullsized":"2023-10-08T00:31:14.142638+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:17:03.063711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.639780+0000","last_change":"2023-10-08T00:31:14.639780+0000","last_active":"2023-10-08T00:31:14.639780+0000","last_peered":"2023-10-08T00:31:14.639780+0000","last_clean":"2023-10-08T00:31:14.639780+0000","last_became_active":"2023-10-08T00:31:14.639521+0000","last_became_peered":"2023-10-08T00:31:14.639521+0000","last_unstale":"2023-10-08T00:31:14.639780+0000","last_undegraded":"2023-10-08T00:31:14.639780+0000","last_fullsized":"2023-10-08T00:31:14.639780+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:22.813458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148915+0000","last_change":"2023-10-08T00:31:14.146869+0000","last_active":"2023-10-08T00:31:14.148915+0000","last_peered":"2023-10-08T00:31:14.148915+0000","last_clean":"2023-10-08T00:31:14.148915+0000","last_became_active":"2023-10-08T00:31:14.146600+0000","last_became_peered":"2023-10-08T00:31:14.146600+0000","last_unstale":"2023-10-08T00:31:14.148915+0000","last_undegraded":"2023-10-08T00:31:14.148915+0000","last_fullsized":"2023-10-08T00:31:14.148915+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:12.357387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.641167+0000","last_change":"2023-10-08T00:31:14.641167+0000","last_active":"2023-10-08T00:31:14.641167+0000","last_peered":"2023-10-08T00:31:14.641167+0000","last_clean":"2023-10-08T00:31:14.641167+0000","last_became_active":"2023-10-08T00:31:14.640842+0000","last_became_peered":"2023-10-08T00:31:14.640842+0000","last_unstale":"2023-10-08T00:31:14.641167+0000","last_undegraded":"2023-10-08T00:31:14.641167+0000","last_fullsized":"2023-10-08T00:31:14.641167+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:59:40.369723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"101'2","reported_seq":11,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:15.147633+0000","last_change":"2023-10-08T00:31:14.137790+0000","last_active":"2023-10-08T00:31:15.147633+0000","last_peered":"2023-10-08T00:31:15.147633+0000","last_clean":"2023-10-08T00:31:15.147633+0000","last_became_active":"2023-10-08T00:31:14.137498+0000","last_became_peered":"2023-10-08T00:31:14.137498+0000","last_unstale":"2023-10-08T00:31:15.147633+0000","last_undegraded":"2023-10-08T00:31:15.147633+0000","last_fullsized":"2023-10-08T00:31:15.147633+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:30:36.706413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638777+0000","last_change":"2023-10-08T00:31:14.638777+0000","last_active":"2023-10-08T00:31:14.638777+0000","last_peered":"2023-10-08T00:31:14.638777+0000","last_clean":"2023-10-08T00:31:14.638777+0000","last_became_active":"2023-10-08T00:31:14.637505+0000","last_became_peered":"2023-10-08T00:31:14.637505+0000","last_unstale":"2023-10-08T00:31:14.638777+0000","last_undegraded":"2023-10-08T00:31:14.638777+0000","last_fullsized":"2023-10-08T00:31:14.638777+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:39:54.842948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.139440+0000","last_change":"2023-10-08T00:31:14.138565+0000","last_active":"2023-10-08T00:31:14.139440+0000","last_peered":"2023-10-08T00:31:14.139440+0000","last_clean":"2023-10-08T00:31:14.139440+0000","last_became_active":"2023-10-08T00:31:14.138302+0000","last_became_peered":"2023-10-08T00:31:14.138302+0000","last_unstale":"2023-10-08T00:31:14.139440+0000","last_undegraded":"2023-10-08T00:31:14.139440+0000","last_fullsized":"2023-10-08T00:31:14.139440+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:22:04.070353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640712+0000","last_change":"2023-10-08T00:31:14.640712+0000","last_active":"2023-10-08T00:31:14.640712+0000","last_peered":"2023-10-08T00:31:14.640712+0000","last_clean":"2023-10-08T00:31:14.640712+0000","last_became_active":"2023-10-08T00:31:14.640359+0000","last_became_peered":"2023-10-08T00:31:14.640359+0000","last_unstale":"2023-10-08T00:31:14.640712+0000","last_undegraded":"2023-10-08T00:31:14.640712+0000","last_fullsized":"2023-10-08T00:31:14.640712+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:59:49.202759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148836+0000","last_change":"2023-10-08T00:31:14.142375+0000","last_active":"2023-10-08T00:31:14.148836+0000","last_peered":"2023-10-08T00:31:14.148836+0000","last_clean":"2023-10-08T00:31:14.148836+0000","last_became_active":"2023-10-08T00:31:14.142096+0000","last_became_peered":"2023-10-08T00:31:14.142096+0000","last_unstale":"2023-10-08T00:31:14.148836+0000","last_undegraded":"2023-10-08T00:31:14.148836+0000","last_fullsized":"2023-10-08T00:31:14.148836+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:40.466121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.638837+0000","last_change":"2023-10-08T00:31:14.638837+0000","last_active":"2023-10-08T00:31:14.638837+0000","last_peered":"2023-10-08T00:31:14.638837+0000","last_clean":"2023-10-08T00:31:14.638837+0000","last_became_active":"2023-10-08T00:31:14.638563+0000","last_became_peered":"2023-10-08T00:31:14.638563+0000","last_unstale":"2023-10-08T00:31:14.638837+0000","last_undegraded":"2023-10-08T00:31:14.638837+0000","last_fullsized":"2023-10-08T00:31:14.638837+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:37.241674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.142294+0000","last_change":"2023-10-08T00:31:14.141871+0000","last_active":"2023-10-08T00:31:14.142294+0000","last_peered":"2023-10-08T00:31:14.142294+0000","last_clean":"2023-10-08T00:31:14.142294+0000","last_became_active":"2023-10-08T00:31:14.140911+0000","last_became_peered":"2023-10-08T00:31:14.140911+0000","last_unstale":"2023-10-08T00:31:14.142294+0000","last_undegraded":"2023-10-08T00:31:14.142294+0000","last_fullsized":"2023-10-08T00:31:14.142294+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:20.884326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.643745+0000","last_change":"2023-10-08T00:31:14.643745+0000","last_active":"2023-10-08T00:31:14.643745+0000","last_peered":"2023-10-08T00:31:14.643745+0000","last_clean":"2023-10-08T00:31:14.643745+0000","last_became_active":"2023-10-08T00:31:14.643474+0000","last_became_peered":"2023-10-08T00:31:14.643474+0000","last_unstale":"2023-10-08T00:31:14.643745+0000","last_undegraded":"2023-10-08T00:31:14.643745+0000","last_fullsized":"2023-10-08T00:31:14.643745+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:42:04.889254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.137618+0000","last_change":"2023-10-08T00:31:14.132805+0000","last_active":"2023-10-08T00:31:14.137618+0000","last_peered":"2023-10-08T00:31:14.137618+0000","last_clean":"2023-10-08T00:31:14.137618+0000","last_became_active":"2023-10-08T00:31:14.132562+0000","last_became_peered":"2023-10-08T00:31:14.132562+0000","last_unstale":"2023-10-08T00:31:14.137618+0000","last_undegraded":"2023-10-08T00:31:14.137618+0000","last_fullsized":"2023-10-08T00:31:14.137618+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:21.149884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.635446+0000","last_change":"2023-10-08T00:31:14.635446+0000","last_active":"2023-10-08T00:31:14.635446+0000","last_peered":"2023-10-08T00:31:14.635446+0000","last_clean":"2023-10-08T00:31:14.635446+0000","last_became_active":"2023-10-08T00:31:14.634778+0000","last_became_peered":"2023-10-08T00:31:14.634778+0000","last_unstale":"2023-10-08T00:31:14.635446+0000","last_undegraded":"2023-10-08T00:31:14.635446+0000","last_fullsized":"2023-10-08T00:31:14.635446+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:59:40.369723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.145543+0000","last_change":"2023-10-08T00:31:14.145098+0000","last_active":"2023-10-08T00:31:14.145543+0000","last_peered":"2023-10-08T00:31:14.145543+0000","last_clean":"2023-10-08T00:31:14.145543+0000","last_became_active":"2023-10-08T00:31:14.144746+0000","last_became_peered":"2023-10-08T00:31:14.144746+0000","last_unstale":"2023-10-08T00:31:14.145543+0000","last_undegraded":"2023-10-08T00:31:14.145543+0000","last_fullsized":"2023-10-08T00:31:14.145543+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:19.315757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.640338+0000","last_change":"2023-10-08T00:31:14.640338+0000","last_active":"2023-10-08T00:31:14.640338+0000","last_peered":"2023-10-08T00:31:14.640338+0000","last_clean":"2023-10-08T00:31:14.640338+0000","last_became_active":"2023-10-08T00:31:14.640015+0000","last_became_peered":"2023-10-08T00:31:14.640015+0000","last_unstale":"2023-10-08T00:31:14.640338+0000","last_undegraded":"2023-10-08T00:31:14.640338+0000","last_fullsized":"2023-10-08T00:31:14.640338+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:37:17.988995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.145798+0000","last_change":"2023-10-08T00:31:14.144729+0000","last_active":"2023-10-08T00:31:14.145798+0000","last_peered":"2023-10-08T00:31:14.145798+0000","last_clean":"2023-10-08T00:31:14.145798+0000","last_became_active":"2023-10-08T00:31:14.144185+0000","last_became_peered":"2023-10-08T00:31:14.144185+0000","last_unstale":"2023-10-08T00:31:14.145798+0000","last_undegraded":"2023-10-08T00:31:14.145798+0000","last_fullsized":"2023-10-08T00:31:14.145798+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:21.149884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.637461+0000","last_change":"2023-10-08T00:31:14.637461+0000","last_active":"2023-10-08T00:31:14.637461+0000","last_peered":"2023-10-08T00:31:14.637461+0000","last_clean":"2023-10-08T00:31:14.637461+0000","last_became_active":"2023-10-08T00:31:14.637146+0000","last_became_peered":"2023-10-08T00:31:14.637146+0000","last_unstale":"2023-10-08T00:31:14.637461+0000","last_undegraded":"2023-10-08T00:31:14.637461+0000","last_fullsized":"2023-10-08T00:31:14.637461+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:02.222983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.149249+0000","last_change":"2023-10-08T00:31:14.148390+0000","last_active":"2023-10-08T00:31:14.149249+0000","last_peered":"2023-10-08T00:31:14.149249+0000","last_clean":"2023-10-08T00:31:14.149249+0000","last_became_active":"2023-10-08T00:31:14.148113+0000","last_became_peered":"2023-10-08T00:31:14.148113+0000","last_unstale":"2023-10-08T00:31:14.149249+0000","last_undegraded":"2023-10-08T00:31:14.149249+0000","last_fullsized":"2023-10-08T00:31:14.149249+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:38.605631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":8,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.636771+0000","last_change":"2023-10-08T00:31:14.636771+0000","last_active":"2023-10-08T00:31:14.636771+0000","last_peered":"2023-10-08T00:31:14.636771+0000","last_clean":"2023-10-08T00:31:14.636771+0000","last_became_active":"2023-10-08T00:31:14.636521+0000","last_became_peered":"2023-10-08T00:31:14.636521+0000","last_unstale":"2023-10-08T00:31:14.636771+0000","last_undegraded":"2023-10-08T00:31:14.636771+0000","last_fullsized":"2023-10-08T00:31:14.636771+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:14.119125+0000","last_clean_scrub_stamp":"2023-10-08T00:31:14.119125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:13.361226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.148974+0000","last_change":"2023-10-08T00:31:14.148449+0000","last_active":"2023-10-08T00:31:14.148974+0000","last_peered":"2023-10-08T00:31:14.148974+0000","last_clean":"2023-10-08T00:31:14.148974+0000","last_became_active":"2023-10-08T00:31:14.148084+0000","last_became_peered":"2023-10-08T00:31:14.148084+0000","last_unstale":"2023-10-08T00:31:14.148974+0000","last_undegraded":"2023-10-08T00:31:14.148974+0000","last_fullsized":"2023-10-08T00:31:14.148974+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:13.115286+0000","last_clean_scrub_stamp":"2023-10-08T00:31:13.115286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:05.549285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":228,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-08T00:31:14.135616+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:31:14.135616+0000","last_peered":"2023-10-08T00:31:14.135616+0000","last_clean":"2023-10-08T00:31:14.135616+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:31:14.135616+0000","last_undegraded":"2023-10-08T00:31:14.135616+0000","last_fullsized":"2023-10-08T00:31:14.135616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299104,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072736,"statfs":{"total":96636764160,"available":96330481664,"internally_reserved":0,"allocated":1859584,"data_stored":1133859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70699999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.876},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58299999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.502,"15min":0.52900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.55400000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71299999999999997,"5min":0.75,"15min":0.79000000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.86299999999999999,"15min":1.048},"last":0.42999999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":0.89400000000000002,"15min":1.0920000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.60299999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298520,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073320,"statfs":{"total":96636764160,"available":96331079680,"internally_reserved":0,"allocated":1261568,"data_stored":542973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.28100000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.77200000000000002,"15min":0.84399999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.90700000000000003,"15min":0.94499999999999995},"last":0.59599999999999997}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.80800000000000005,"15min":1.145},"last":0.495},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.749,"15min":0.873},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.78500000000000003,"15min":1.079},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.76000000000000001,"15min":0.85799999999999998},"last":0.56899999999999995}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.871,"15min":1.127},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":1.1160000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70099999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57099999999999995,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29399999999999998},"max":{"1min":0.77700000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58799999999999997,"15min":0.63500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":1.093},"last":0.40600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":543027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.64300000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52300000000000002,"5min":0.58099999999999996,"15min":0.60199999999999998},"last":0.33600000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.254,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.38600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54300000000000004,"5min":0.624,"15min":0.84699999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.433},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77000000000000002,"5min":0.90100000000000002,"15min":1.294},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.503}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":1.038},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.46300000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.874,"15min":0.879},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.97999999999999998,"15min":1.087},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303212,"kb_used_data":1828,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068628,"statfs":{"total":96636764160,"available":96326275072,"internally_reserved":0,"allocated":1871872,"data_stored":1134919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.63100000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.60699999999999998,"5min":0.60899999999999999,"15min":0.64700000000000002},"last":0.42199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.73399999999999999,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":1.242},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.63400000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.86399999999999999,"15min":1.0800000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.78800000000000003,"5min":0.91000000000000003,"15min":1.0529999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.58799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.316,"15min":0.34599999999999997},"min":{"1min":0.218,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.60899999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.38400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.28100000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34699999999999998,"15min":0.373},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48099999999999998,"5min":0.54900000000000004,"15min":0.65000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.40899999999999997},"min":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53400000000000003,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.35799999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60799999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39300000000000002,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51900000000000002,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":1.0489999999999999,"15min":1.0760000000000001},"last":0.42399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.379},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91900000000000004,"5min":0.93899999999999995,"15min":1.278},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.0880000000000001,"15min":1.137},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.95999999999999996},"last":0.41299999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.65300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93899999999999995,"5min":1,"15min":1.1259999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.343},"last":0.46800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33900000000000002,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.25},{"interface":"front","average":{"1min":0.374,"5min":0.371,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.42699999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.625},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.629},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64200000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.371,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.93300000000000005,"15min":1.712},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.64800000000000002,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.0960000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":0.873,"15min":0.873},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.5},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77200000000000002,"5min":1.002,"15min":1.002},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.82799999999999996,"15min":0.84199999999999997},"last":0.70999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.747,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":542903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.33900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.621},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.378},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67800000000000005,"5min":0.71999999999999997,"15min":0.75700000000000001},"last":0.44700000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.58199999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29199999999999998},"max":{"1min":0.749,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.55100000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72699999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.61399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.82499999999999996,"15min":0.84499999999999997},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:31:19.635 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:31:19.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:31:19.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.794+0000 7f0025e67700 1 Processor -- start 2023-10-08T00:31:19.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.794+0000 7f0025e67700 1 -- start start 2023-10-08T00:31:19.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0025e67700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f00201595d0 0x7f00200ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0025e67700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f002015d930 0x7f00200b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0025e67700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200b10f0 con 0x7f00200cf480 2023-10-08T00:31:19.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0025e67700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200cd530 con 0x7f00201595d0 2023-10-08T00:31:19.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0025e67700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002015e000 con 0x7f002015d930 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0024e65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f00201595d0 0x7f00200ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0024e65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f00201595d0 0x7f00200ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50254/0 (socket says 172.21.15.22:50254) 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.795+0000 7f0024e65700 1 -- 172.21.15.22:0/2209302782 learned_addr learned my addr 172.21.15.22:0/2209302782 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f0025666700 1 --2- 172.21.15.22:0/2209302782 >> v2:172.21.15.192:3300/0 conn(0x7f002015d930 0x7f00200b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f0024e65700 1 -- 172.21.15.22:0/2209302782 >> v2:172.21.15.192:3300/0 conn(0x7f002015d930 msgr2=0x7f00200b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f0024e65700 1 --2- 172.21.15.22:0/2209302782 >> v2:172.21.15.192:3300/0 conn(0x7f002015d930 0x7f00200b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f0024e65700 1 -- 172.21.15.22:0/2209302782 >> v1:172.21.15.192:6789/0 conn(0x7f00200cf480 legacy=0x7f002015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f0024e65700 1 -- 172.21.15.22:0/2209302782 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200cf990 con 0x7f00201595d0 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f0024e65700 1 --2- 172.21.15.22:0/2209302782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f00200ccff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f00200afc00 tx=0x7f0018009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204a290d4872292d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f001f7fe700 1 -- 172.21.15.22:0/2209302782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800e070 con 0x7f00201595d0 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f001f7fe700 1 -- 172.21.15.22:0/2209302782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800ba90 con 0x7f00201595d0 2023-10-08T00:31:19.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.796+0000 7f001f7fe700 1 -- 172.21.15.22:0/2209302782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00180092e0 con 0x7f00201595d0 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 -- 172.21.15.22:0/2209302782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 msgr2=0x7f00200ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 --2- 172.21.15.22:0/2209302782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f00200ccff0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f00200afc00 tx=0x7f0018009840 comp rx=0 tx=0).stop 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 -- 172.21.15.22:0/2209302782 shutdown_connections 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 --2- 172.21.15.22:0/2209302782 >> v2:172.21.15.192:3300/0 conn(0x7f002015d930 0x7f00200b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 --2- 172.21.15.22:0/2209302782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f00200ccff0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 -- 172.21.15.22:0/2209302782 >> 172.21.15.22:0/2209302782 conn(0x7f00200d05f0 msgr2=0x7f00200d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 -- 172.21.15.22:0/2209302782 shutdown_connections 2023-10-08T00:31:19.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.797+0000 7f0025e67700 1 -- 172.21.15.22:0/2209302782 wait complete. 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.798+0000 7f0025e67700 1 Processor -- start 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.798+0000 7f0025e67700 1 -- start start 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00200cf480 0x7f002015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f002014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f002015d930 0x7f002014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020169760 con 0x7f00201595d0 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002015c7a0 con 0x7f00200cf480 2023-10-08T00:31:19.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002015ca80 con 0x7f002015d930 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f002014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f002014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50264/0 (socket says 172.21.15.22:50264) 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 -- 172.21.15.22:0/2522988838 learned_addr learned my addr 172.21.15.22:0/2522988838 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0024e65700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00200cf480 0x7f002015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025666700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f002015d930 0x7f002014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 -- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f002015d930 msgr2=0x7f002014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f002015d930 0x7f002014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 -- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00200cf480 msgr2=0x7f002015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00200cf480 0x7f002015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:19.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 -- 172.21.15.22:0/2522988838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009ae0 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001ffff700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f002014f180 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f001400b5e0 tx=0x7f00140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400f510 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001400f6b0 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001400fa70 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.799+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00201699b0 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.800+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00201504e0 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.800+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0020169ed0 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.801+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f001401a400 con 0x7f00201595d0 2023-10-08T00:31:19.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.801+0000 7f001cff9700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f000c067290 0x7f000c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.801+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0014084520 con 0x7f00201595d0 2023-10-08T00:31:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.801+0000 7f0024e65700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f000c067290 0x7f000c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:19.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.802+0000 7f0024e65700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f000c067290 0x7f000c069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0018009880 tx=0x7f0018017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:19.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:19.805+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0020169ed0 con 0x7f00201595d0 2023-10-08T00:31:20.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.081+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0020169ed0 con 0x7f00201595d0 2023-10-08T00:31:20.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.085+0000 7f001cff9700 1 -- 172.21.15.22:0/2522988838 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0020169ed0 con 0x7f00201595d0 2023-10-08T00:31:20.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f000c067290 msgr2=0x7f000c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f000c067290 0x7f000c069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0018009880 tx=0x7f0018017000 comp rx=0 tx=0).stop 2023-10-08T00:31:20.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 msgr2=0x7f002014f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f002014f180 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f001400b5e0 tx=0x7f00140090f0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 shutdown_connections 2023-10-08T00:31:20.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f000c067290 0x7f000c069740 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f002015d930 0x7f002014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00200cf480 0x7f002015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 --2- 172.21.15.22:0/2522988838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00201595d0 0x7f002014f180 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 >> 172.21.15.22:0/2522988838 conn(0x7f00200d05f0 msgr2=0x7f00200b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:20.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 shutdown_connections 2023-10-08T00:31:20.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.087+0000 7f0025e67700 1 -- 172.21.15.22:0/2522988838 wait complete. 2023-10-08T00:31:20.091 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:31:20.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:20.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.218+0000 7f46f956f700 1 Processor -- start 2023-10-08T00:31:20.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.218+0000 7f46f956f700 1 -- start start 2023-10-08T00:31:20.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f956f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:20.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f956f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46f4069560 0x7f46f40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:20.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f956f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f415a160 con 0x7f46f4159c60 2023-10-08T00:31:20.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f956f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f4069f20 con 0x7f46f4069560 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f956f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f40d13a0 con 0x7f46f4159890 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46f4069560 0x7f46f40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f27fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f46f4159c60 0x7f46f415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39556/0 (socket says 172.21.15.22:39556) 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f27fc700 1 -- 172.21.15.22:0/1431745142 learned_addr learned my addr 172.21.15.22:0/1431745142 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.219+0000 7f46f2ffd700 1 --2- 172.21.15.22:0/1431745142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f37fe700 1 -- 172.21.15.22:0/1431745142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 msgr2=0x7f46f415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f37fe700 1 --2- 172.21.15.22:0/1431745142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f37fe700 1 -- 172.21.15.22:0/1431745142 >> v1:172.21.15.22:6789/0 conn(0x7f46f4159c60 legacy=0x7f46f415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f37fe700 1 -- 172.21.15.22:0/1431745142 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f415e140 con 0x7f46f4069560 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f1ffb700 1 -- 172.21.15.22:0/1431745142 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411412199 0 0) 0x7f46f415a160 con 0x7f46f4159c60 2023-10-08T00:31:20.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f37fe700 1 --2- 172.21.15.22:0/1431745142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40699e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f46e40098e0 tx=0x7f46e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec0608314fff42e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f1ffb700 1 -- 172.21.15.22:0/1431745142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400b640 con 0x7f46f4069560 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f1ffb700 1 -- 172.21.15.22:0/1431745142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e400b7a0 con 0x7f46f4069560 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.220+0000 7f46f1ffb700 1 -- 172.21.15.22:0/1431745142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e400bb40 con 0x7f46f4069560 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 -- 172.21.15.22:0/1431745142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 msgr2=0x7f46f40699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 --2- 172.21.15.22:0/1431745142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40699e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f46e40098e0 tx=0x7f46e40091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 -- 172.21.15.22:0/1431745142 shutdown_connections 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 --2- 172.21.15.22:0/1431745142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40699e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 --2- 172.21.15.22:0/1431745142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 -- 172.21.15.22:0/1431745142 >> 172.21.15.22:0/1431745142 conn(0x7f46f4068e20 msgr2=0x7f46f40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 -- 172.21.15.22:0/1431745142 shutdown_connections 2023-10-08T00:31:20.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.221+0000 7f46f956f700 1 -- 172.21.15.22:0/1431745142 wait complete. 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.222+0000 7f46f956f700 1 Processor -- start 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.222+0000 7f46f956f700 1 -- start start 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f4153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f4159c60 0x7f46f4147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f41533f0 con 0x7f46f4069560 2023-10-08T00:31:20.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f416d5a0 con 0x7f46f4159c60 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f416d880 con 0x7f46f4159890 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50276/0 (socket says 172.21.15.22:50276) 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 -- 172.21.15.22:0/4269205590 learned_addr learned my addr 172.21.15.22:0/4269205590 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f27fc700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f4153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f37fe700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f4159c60 0x7f46f4147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 -- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 msgr2=0x7f46f4153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f4153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 -- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f4159c60 msgr2=0x7f46f4147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f4159c60 0x7f46f4147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 -- 172.21.15.22:0/4269205590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4009420 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f27fc700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f2ffd700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40b3e30 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009ef0 tx=0x7f46ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00cc50 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec00f040 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec014480 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f416db60 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.223+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f416d230 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.224+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46f40cd2e0 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.225+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f46ec0147f0 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.225+0000 7f46eaffd700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46d4067290 0x7f46d4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.225+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46ec085630 con 0x7f46f4069560 2023-10-08T00:31:20.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.226+0000 7f46f27fc700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46d4067290 0x7f46d4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:20.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.226+0000 7f46f27fc700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46d4067290 0x7f46d4069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f46f40b2710 tx=0x7f46dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:20.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.230+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46ec052380 con 0x7f46f4069560 2023-10-08T00:31:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.470+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46f404c3c0 con 0x7f46f4069560 2023-10-08T00:31:20.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.471+0000 7f46eaffd700 1 -- 172.21.15.22:0/4269205590 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f46ec0559a0 con 0x7f46f4069560 2023-10-08T00:31:20.473 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:20.473 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":69,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:14.535940+0000","modified":"2023-10-08T00:31:18.152403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3654432591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3654432591},{"type":"v1","addr":"172.21.15.22:6835","nonce":3654432591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T00:31:20.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46d4067290 msgr2=0x7f46d4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46d4067290 0x7f46d4069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f46f40b2710 tx=0x7f46dc009040 comp rx=0 tx=0).stop 2023-10-08T00:31:20.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 msgr2=0x7f46f40b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40b3e30 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009ef0 tx=0x7f46ec00b040 comp rx=0 tx=0).stop 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 shutdown_connections 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46f4159c60 0x7f46f4147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46f4069560 0x7f46f40b3e30 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46d4067290 0x7f46d4069740 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 --2- 172.21.15.22:0/4269205590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46f4159890 0x7f46f4153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 >> 172.21.15.22:0/4269205590 conn(0x7f46f4068e20 msgr2=0x7f46f40d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 shutdown_connections 2023-10-08T00:31:20.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:20.473+0000 7f46f956f700 1 -- 172.21.15.22:0/4269205590 wait complete. 2023-10-08T00:31:20.477 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 69 2023-10-08T00:31:20.628 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:31:20.627+0000 7f274ee12700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:31:20.890 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:31:14.535940+0000', 'modified': '2023-10-08T00:31:18.152403+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6858}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6858': {'gid': 6858, 'name': 'a', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6835/3654432591', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6833', 'nonce': 3654432591}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 3654432591}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:31:20.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:31:20.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T00:31:21.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 Processor -- start 2023-10-08T00:31:21.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 -- start start 2023-10-08T00:31:21.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ea8159c60 0x7f9ea815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 0x7f9ea8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea815a160 con 0x7f9ea8159890 2023-10-08T00:31:21.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea815df50 con 0x7f9ea8159c60 2023-10-08T00:31:21.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.013+0000 7f9ead9c6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80d13a0 con 0x7f9ea815db10 2023-10-08T00:31:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 0x7f9ea8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ea8159c60 0x7f9ea815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ea8159c60 0x7f9ea815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:52356/0 (socket says 172.21.15.22:52356) 2023-10-08T00:31:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea6ffd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9ea8159890 0x7f9ea815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:53122/0 (socket says 172.21.15.22:53122) 2023-10-08T00:31:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 -- 172.21.15.22:0/3117347058 learned_addr learned my addr 172.21.15.22:0/3117347058 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 0x7f9ea8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:53190/0 (socket says 172.21.15.22:53190) 2023-10-08T00:31:21.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 -- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 msgr2=0x7f9ea8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 0x7f9ea8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 -- 172.21.15.22:0/3117347058 >> v1:172.21.15.192:6789/0 conn(0x7f9ea8159890 legacy=0x7f9ea815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 -- 172.21.15.22:0/3117347058 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea815e140 con 0x7f9ea8159c60 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 0x7f9ea8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.014+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea8159c60 0x7f9ea815d5d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9e900099b0 tx=0x7f9e90009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e646b423bea1fb1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/3117347058 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e90009ea0 con 0x7f9ea8159c60 2023-10-08T00:31:21.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/3117347058 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000b860 con 0x7f9ea8159c60 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ea5ffb700 1 -- 172.21.15.22:0/3117347058 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000bc00 con 0x7f9ea8159c60 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 -- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea8159c60 msgr2=0x7f9ea815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea8159c60 0x7f9ea815d5d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9e900099b0 tx=0x7f9e90009250 comp rx=0 tx=0).stop 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 -- 172.21.15.22:0/3117347058 shutdown_connections 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea815db10 0x7f9ea8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/3117347058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea8159c60 0x7f9ea815d5d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 -- 172.21.15.22:0/3117347058 >> 172.21.15.22:0/3117347058 conn(0x7f9ea8068e20 msgr2=0x7f9ea80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 -- 172.21.15.22:0/3117347058 shutdown_connections 2023-10-08T00:31:21.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.015+0000 7f9ead9c6700 1 -- 172.21.15.22:0/3117347058 wait complete. 2023-10-08T00:31:21.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.016+0000 7f9ead9c6700 1 Processor -- start 2023-10-08T00:31:21.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.016+0000 7f9ead9c6700 1 -- start start 2023-10-08T00:31:21.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ead9c6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 0x7f9ea814cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ead9c6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea8159c60 0x7f9ea80cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ead9c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea815db10 0x7f9ea815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ead9c6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80ce510 con 0x7f9ea8159890 2023-10-08T00:31:21.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ead9c6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80cd980 con 0x7f9ea815db10 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ead9c6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80cdc60 con 0x7f9ea8159c60 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 0x7f9ea814cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 0x7f9ea814cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50286/0 (socket says 172.21.15.22:50286) 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/1856696490 learned_addr learned my addr 172.21.15.22:0/1856696490 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea8159c60 0x7f9ea80cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.017+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea815db10 0x7f9ea815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea8159c60 msgr2=0x7f9ea80cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea8159c60 0x7f9ea80cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea815db10 msgr2=0x7f9ea815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea815db10 0x7f9ea815cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/1856696490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009420 con 0x7f9ea8159890 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea8159c60 0x7f9ea80cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea815db10 0x7f9ea815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 0x7f9ea814cc60 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cd80 tx=0x7f9ea0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9e9effd700 1 -- 172.21.15.22:0/1856696490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0005df0 con 0x7f9ea8159890 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9e9effd700 1 -- 172.21.15.22:0/1856696490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea000a960 con 0x7f9ea8159890 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900094f0 con 0x7f9ea8159890 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9e9effd700 1 -- 172.21.15.22:0/1856696490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000ad20 con 0x7f9ea8159890 2023-10-08T00:31:21.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.018+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea80ce760 con 0x7f9ea8159890 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.019+0000 7f9e9effd700 1 -- 172.21.15.22:0/1856696490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f9ea0007300 con 0x7f9ea8159890 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.020+0000 7f9e9effd700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e88067290 0x7f9e88069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.020+0000 7f9e9effd700 1 -- 172.21.15.22:0/1856696490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ea0084dc0 con 0x7f9ea8159890 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.020+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e88067290 0x7f9e88069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.021+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e88067290 0x7f9e88069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9e900099b0 tx=0x7f9e90017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.022+0000 7f9eb6cbeb80 1 Processor -- start 2023-10-08T00:31:21.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.022+0000 7f9eb6cbeb80 1 -- start start 2023-10-08T00:31:21.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885c3d00 0x55a2885a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a288575cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2884d0a70 con 0x55a2885a2f60 2023-10-08T00:31:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2884ce270 con 0x55a2885c3d00 2023-10-08T00:31:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2884ca060 con 0x55a288579a50 2023-10-08T00:31:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a288575cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a288575cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50294/0 (socket says 172.21.15.22:50294) 2023-10-08T00:31:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 -- 172.21.15.22:0/2658972260 learned_addr learned my addr 172.21.15.22:0/2658972260 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885c3d00 0x55a2885a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 -- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a288579a50 msgr2=0x55a288579e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 -- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885c3d00 msgr2=0x55a2885a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885c3d00 0x55a2885a2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 -- 172.21.15.22:0/2658972260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a288364270 con 0x55a2885a2f60 2023-10-08T00:31:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885c3d00 0x55a2885a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a288575cf0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009e30 tx=0x7f9e98008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bbb61f82768290 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9e87fff700 1 -- 172.21.15.22:0/2658972260 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98011bb0 con 0x55a2885a2f60 2023-10-08T00:31:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9e87fff700 1 -- 172.21.15.22:0/2658972260 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98011d10 con 0x55a2885a2f60 2023-10-08T00:31:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.023+0000 7f9e87fff700 1 -- 172.21.15.22:0/2658972260 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98015690 con 0x55a2885a2f60 2023-10-08T00:31:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2658972260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 msgr2=0x55a288575cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a288575cf0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009e30 tx=0x7f9e98008040 comp rx=0 tx=0).stop 2023-10-08T00:31:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2658972260 shutdown_connections 2023-10-08T00:31:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a288575cf0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2658972260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885c3d00 0x55a2885a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2658972260 >> 172.21.15.22:0/2658972260 conn(0x55a28857b370 msgr2=0x55a28857b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2658972260 shutdown_connections 2023-10-08T00:31:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.024+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2658972260 wait complete. 2023-10-08T00:31:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.025+0000 7f9eb6cbeb80 1 -- start start 2023-10-08T00:31:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.025+0000 7f9eb6cbeb80 1 Processor -- start 2023-10-08T00:31:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a2885c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a2885b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885c3d00 0x55a2885ba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a288475890 con 0x55a2885a2f60 2023-10-08T00:31:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a288490ea0 con 0x55a288579a50 2023-10-08T00:31:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a28834ce30 con 0x55a2885c3d00 2023-10-08T00:31:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 10 client.0 _ll_register_callbacks cb 0x55a28853d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:31:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a2885b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a2885b9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50296/0 (socket says 172.21.15.22:50296) 2023-10-08T00:31:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 -- 172.21.15.22:0/2403439480 learned_addr learned my addr 172.21.15.22:0/2403439480 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 -- 172.21.15.22:0/2403439480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885c3d00 msgr2=0x55a2885ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885c3d00 0x55a2885ba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 -- 172.21.15.22:0/2403439480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 msgr2=0x55a2885c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a2885c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 -- 172.21.15.22:0/2403439480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e98009a80 con 0x55a2885a2f60 2023-10-08T00:31:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a2885b9e70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80899c0 tx=0x7f9e90020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44097657824c482e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9e857fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:31:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9e857fa700 1 -- 172.21.15.22:0/2403439480 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9002d070 con 0x55a2885a2f60 2023-10-08T00:31:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9e857fa700 1 -- 172.21.15.22:0/2403439480 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e90011420 con 0x55a2885a2f60 2023-10-08T00:31:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a28856eb70 con 0x55a2885a2f60 2023-10-08T00:31:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.026+0000 7f9e857fa700 1 -- 172.21.15.22:0/2403439480 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e90020070 con 0x55a2885a2f60 2023-10-08T00:31:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 10 client.6999 fetch_fsmap learned FSMap version 69 2023-10-08T00:31:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55a288306fe0 con 0x55a2885a2f60 2023-10-08T00:31:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9e857fa700 1 -- 172.21.15.22:0/2403439480 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a28856eb70 con 0x55a2885a2f60 2023-10-08T00:31:21.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9e857fa700 1 -- 172.21.15.22:0/2403439480 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9e900117f0 con 0x55a2885a2f60 2023-10-08T00:31:21.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 10 client.6999 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T00:31:21.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 10 client.6999 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:31:21.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 20 client.6999 populate_metadata read hostname 'smithi022' 2023-10-08T00:31:21.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885bb740 0x55a2885bbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 4 client.6999 mds_command: new command op to 6858 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:31:21.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 --> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a28854baa0 con 0x55a2885bb740 2023-10-08T00:31:21.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885bb740 0x55a2885bbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885bb740 0x55a2885bbb30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35d754df40ada1a2 server_cookie=3ee2480af84737fb in_seq=0 out_seq=0 2023-10-08T00:31:21.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.027+0000 7f9e857fa700 10 client.6999 ms_handle_connect on v2:172.21.15.22:6833/3654432591 2023-10-08T00:31:21.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9e857fa700 1 -- 172.21.15.22:0/2403439480 <== mds.0 v2:172.21.15.22:6833/3654432591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a28854baa0 con 0x55a2885bb740 2023-10-08T00:31:21.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9e857fa700 10 client.6999 handle_command_reply: tid=0 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 client.6999 shutdown 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 msgr2=0x55a2885b9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a2885b9e70 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80899c0 tx=0x7f9e90020000 comp rx=0 tx=0).stop 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 shutdown_connections 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885c3d00 0x55a2885ba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a2885c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885bb740 0x55a2885bbb30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2403439480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a2885a2f60 0x55a2885b9e70 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9e857fa700 0 client.6999 ms_handle_reset on v2:172.21.15.22:6833/3654432591 2023-10-08T00:31:21.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 >> 172.21.15.22:0/2403439480 conn(0x55a28857b370 msgr2=0x55a288576850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 shutdown_connections 2023-10-08T00:31:21.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2403439480 wait complete. 2023-10-08T00:31:21.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.028+0000 7f9eb6cbeb80 20 client.6999 trim_cache size 0 max 16384 2023-10-08T00:31:21.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.045+0000 7f9eb6cbeb80 1 Processor -- start 2023-10-08T00:31:21.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.045+0000 7f9eb6cbeb80 1 -- start start 2023-10-08T00:31:21.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 0x55a288575490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885a2f60 0x55a28857a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2885a2110 con 0x55a28857b370 2023-10-08T00:31:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2885c2550 con 0x55a288579a50 2023-10-08T00:31:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a28857d100 con 0x55a2885a2f60 2023-10-08T00:31:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 0x55a288575490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 0x55a288575490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50300/0 (socket says 172.21.15.22:50300) 2023-10-08T00:31:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/2947262100 learned_addr learned my addr 172.21.15.22:0/2947262100 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885a2f60 msgr2=0x55a28857a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885a2f60 0x55a28857a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885a2f60 0x55a28857a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 msgr2=0x55a288579e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/2947262100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a288498780 con 0x55a28857b370 2023-10-08T00:31:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885a2f60 0x55a28857a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 0x55a288575490 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cfd0 tx=0x7f9ea0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a019fb619334d0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9e9cff9700 1 -- 172.21.15.22:0/2947262100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea006b070 con 0x55a28857b370 2023-10-08T00:31:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.046+0000 7f9e9cff9700 1 -- 172.21.15.22:0/2947262100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea005c780 con 0x55a28857b370 2023-10-08T00:31:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9e9cff9700 1 -- 172.21.15.22:0/2947262100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0053920 con 0x55a28857b370 2023-10-08T00:31:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2947262100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 msgr2=0x55a288575490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 0x55a288575490 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cfd0 tx=0x7f9ea0014040 comp rx=0 tx=0).stop 2023-10-08T00:31:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2947262100 shutdown_connections 2023-10-08T00:31:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a2885a2f60 0x55a28857a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a28857b370 0x55a288575490 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/2947262100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a288579a50 0x55a288579e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2947262100 >> 172.21.15.22:0/2947262100 conn(0x55a28859f8c0 msgr2=0x55a2885bbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2947262100 shutdown_connections 2023-10-08T00:31:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.047+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/2947262100 wait complete. 2023-10-08T00:31:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.048+0000 7f9eb6cbeb80 1 -- start start 2023-10-08T00:31:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.048+0000 7f9eb6cbeb80 1 Processor -- start 2023-10-08T00:31:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 0x55a2885bde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a28857b370 0x55a2885b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885a2f60 0x55a2885d9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a288626760 con 0x55a288579a50 2023-10-08T00:31:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2885e2300 con 0x55a2885a2f60 2023-10-08T00:31:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2885bd7f0 con 0x55a28857b370 2023-10-08T00:31:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 10 client.0 _ll_register_callbacks cb 0x55a28853d110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:31:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 0x55a2885bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 0x55a2885bde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50316/0 (socket says 172.21.15.22:50316) 2023-10-08T00:31:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/852323961 learned_addr learned my addr 172.21.15.22:0/852323961 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a28857b370 0x55a2885b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea77fe700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885a2f60 0x55a2885d9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a28857b370 msgr2=0x55a2885b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a28857b370 0x55a2885b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885a2f60 msgr2=0x55a2885d9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885a2f60 0x55a2885d9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 -- 172.21.15.22:0/852323961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea80ce760 con 0x55a288579a50 2023-10-08T00:31:21.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a28857b370 0x55a2885b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:21.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9ea6ffd700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 0x55a2885bde50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0055770 tx=0x7f9ea006e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c04e4f25a95970 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9e857fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:31:21.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9e857fa700 1 -- 172.21.15.22:0/852323961 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00539f0 con 0x55a288579a50 2023-10-08T00:31:21.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9e857fa700 1 -- 172.21.15.22:0/852323961 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9ea0055a40 con 0x55a288579a50 2023-10-08T00:31:21.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e98011d10 con 0x55a288579a50 2023-10-08T00:31:21.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9e857fa700 1 -- 172.21.15.22:0/852323961 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ea0054cd0 con 0x55a288579a50 2023-10-08T00:31:21.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 10 client.7005 fetch_fsmap learned FSMap version 69 2023-10-08T00:31:21.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.049+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55a28847f470 con 0x55a288579a50 2023-10-08T00:31:21.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9e857fa700 1 -- 172.21.15.22:0/852323961 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98011d10 con 0x55a288579a50 2023-10-08T00:31:21.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9e857fa700 1 -- 172.21.15.22:0/852323961 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 69) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9ea0072d20 con 0x55a288579a50 2023-10-08T00:31:21.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 10 client.7005 fetch_fsmap finished waiting for FSMap version 69 2023-10-08T00:31:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 10 client.7005 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:31:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 20 client.7005 populate_metadata read hostname 'smithi022' 2023-10-08T00:31:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885c3d00 0x55a288625880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 4 client.7005 mds_command: new command op to 6858 tid=0[{"prefix": "status"}] 2023-10-08T00:31:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 --> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a28846ce00 con 0x55a2885c3d00 2023-10-08T00:31:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885c3d00 0x55a288625880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9e857fa700 10 client.7005 ms_handle_connect on v2:172.21.15.22:6833/3654432591 2023-10-08T00:31:21.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9ea67fc700 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885c3d00 0x55a288625880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24ecae0749788c32 server_cookie=cc35cd1f0f8789eb in_seq=0 out_seq=0 2023-10-08T00:31:21.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9e857fa700 1 -- 172.21.15.22:0/852323961 <== mds.0 v2:172.21.15.22:6833/3654432591 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55a28846ce00 con 0x55a2885c3d00 2023-10-08T00:31:21.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9e857fa700 10 client.7005 handle_command_reply: tid=0 2023-10-08T00:31:21.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 1 client.7005 shutdown 2023-10-08T00:31:21.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 msgr2=0x55a2885bde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.050+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 0x55a2885bde50 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0055770 tx=0x7f9ea006e000 comp rx=0 tx=0).stop 2023-10-08T00:31:21.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 shutdown_connections 2023-10-08T00:31:21.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2885a2f60 0x55a2885d9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:6833/3654432591,v1:172.21.15.22:6835/3654432591] conn(0x55a2885c3d00 0x55a288625880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a288579a50 0x55a2885bde50 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 --2- 172.21.15.22:0/852323961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55a28857b370 0x55a2885b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9e857fa700 0 client.7005 ms_handle_reset on v2:172.21.15.22:6833/3654432591 2023-10-08T00:31:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 >> 172.21.15.22:0/852323961 conn(0x55a28859f8c0 msgr2=0x55a288579e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 shutdown_connections 2023-10-08T00:31:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 1 -- 172.21.15.22:0/852323961 wait complete. 2023-10-08T00:31:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9eb6cbeb80 20 client.7005 trim_cache size 0 max 16384 2023-10-08T00:31:21.081 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:31:21.081 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:31:21.081 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:31:21.081 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 6858, 2023-10-08T00:31:21.081 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:31:21.081 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 5.9154007220000002, 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 69, 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 102, 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 102, 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 10.990710093000001 2023-10-08T00:31:21.082 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:31:21.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e88067290 msgr2=0x7f9e88069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e88067290 0x7f9e88069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9e900099b0 tx=0x7f9e90017000 comp rx=0 tx=0).stop 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 msgr2=0x7f9ea814cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 0x7f9ea814cc60 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000cd80 tx=0x7f9ea0001b90 comp rx=0 tx=0).stop 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 shutdown_connections 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ea815db10 0x7f9ea815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ea8159890 0x7f9ea814cc60 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e88067290 0x7f9e88069740 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 --2- 172.21.15.22:0/1856696490 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ea8159c60 0x7f9ea80cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 >> 172.21.15.22:0/1856696490 conn(0x7f9ea8068e20 msgr2=0x7f9ea8158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 shutdown_connections 2023-10-08T00:31:21.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.051+0000 7f9ead9c6700 1 -- 172.21.15.22:0/1856696490 wait complete. 2023-10-08T00:31:21.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:31:21.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.203+0000 7f2ee52f6700 1 Processor -- start 2023-10-08T00:31:21.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.203+0000 7f2ee52f6700 1 -- start start 2023-10-08T00:31:21.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2ee52f6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2ee0159c10 0x7f2ee00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2ee52f6700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee0069e40 con 0x7f2ee0159840 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2ee52f6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00cfb30 con 0x7f2ee00699e0 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2ee52f6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee00cbc40 con 0x7f2ee0159c10 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2edeffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2ee0159840 0x7f2ee00cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39566/0 (socket says 172.21.15.22:39566) 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2edeffd700 1 -- 172.21.15.22:0/2283486492 learned_addr learned my addr 172.21.15.22:0/2283486492 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2ede7fc700 1 --2- 172.21.15.22:0/2283486492 >> v2:172.21.15.192:3300/0 conn(0x7f2ee0159c10 0x7f2ee00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648578631 0 0) 0x7f2ed8001110 con 0x7f2ee0159840 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003570 con 0x7f2ee0159840 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874833475 0 0) 0x7f2ee00cfb30 con 0x7f2ee00699e0 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed8001110 con 0x7f2ee00699e0 2023-10-08T00:31:21.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1007064075 0 0) 0x7f2ecc003570 con 0x7f2ee0159840 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 >> v2:172.21.15.192:3300/0 conn(0x7f2ee0159c10 msgr2=0x7f2ee00694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 --2- 172.21.15.22:0/2283486492 >> v2:172.21.15.192:3300/0 conn(0x7f2ee0159c10 0x7f2ee00694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 >> v1:172.21.15.192:6789/0 conn(0x7f2ee00699e0 legacy=0x7f2ee00b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00cbf10 con 0x7f2ee0159840 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f2ed8001600 con 0x7f2ee0159840 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 >> v1:172.21.15.22:6789/0 conn(0x7f2ee0159840 legacy=0x7f2ee00cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ecc003bf0 0x7f2ecc003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ecc004810 0x7f2ecc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.204+0000 7f2eddffb700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc005230 0x7f2ecc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00cbc40 con 0x7f2ecc004810 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc00c200 con 0x7f2ecc003bf0 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc00c3c0 con 0x7f2ecc005230 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ecc004810 0x7f2ecc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2edeffd700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ecc003bf0 0x7f2ecc003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2edf7fe700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc005230 0x7f2ecc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 -- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc005230 msgr2=0x7f2ecc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc005230 0x7f2ecc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 -- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ecc003bf0 msgr2=0x7f2ecc003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ecc003bf0 0x7f2ecc003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 -- 172.21.15.22:0/2283486492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc003570 con 0x7f2ecc004810 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2edf7fe700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc005230 0x7f2ecc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2edf7fe700 1 -- 172.21.15.22:0/2283486492 reap_dead start 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2ede7fc700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ecc004810 0x7f2ecc004c80 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2ee015a070 tx=0x7f2ec80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a96a3a1c58142b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800e710 con 0x7f2ecc004810 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800e870 con 0x7f2ecc004810 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.205+0000 7f2eddffb700 1 -- 172.21.15.22:0/2283486492 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec800ec30 con 0x7f2ecc004810 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2283486492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ecc004810 msgr2=0x7f2ecc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ecc004810 0x7f2ecc004c80 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f2ee015a070 tx=0x7f2ec80091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2283486492 shutdown_connections 2023-10-08T00:31:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2283486492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ecc004810 0x7f2ecc004c80 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2283486492 >> 172.21.15.22:0/2283486492 conn(0x7f2ee0068e10 msgr2=0x7f2ee00d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2283486492 shutdown_connections 2023-10-08T00:31:21.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.206+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2283486492 wait complete. 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.207+0000 7f2ee52f6700 1 Processor -- start 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.207+0000 7f2ee52f6700 1 -- start start 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ee52f6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc004810 0x7f2ee015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ee52f6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee015aaf0 0x7f2ee00b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ee52f6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 0x7f2ee0167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ee52f6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b2220 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ee52f6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b1610 con 0x7f2ee015aaf0 2023-10-08T00:31:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ee52f6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b18f0 con 0x7f2ecc004810 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 0x7f2ee0167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 0x7f2ee0167ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50326/0 (socket says 172.21.15.22:50326) 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 -- 172.21.15.22:0/2470477732 learned_addr learned my addr 172.21.15.22:0/2470477732 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edeffd700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc004810 0x7f2ee015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2ede7fc700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee015aaf0 0x7f2ee00b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 -- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc004810 msgr2=0x7f2ee015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc004810 0x7f2ee015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 -- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee015aaf0 msgr2=0x7f2ee00b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee015aaf0 0x7f2ee00b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 -- 172.21.15.22:0/2470477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00b1bd0 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.208+0000 7f2edf7fe700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 0x7f2ee0167ba0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0089590 tx=0x7f2ed0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.209+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00033b0 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.209+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed0003530 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.209+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee00b1eb0 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.209+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0006dd0 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.209+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee015d000 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.209+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee015d220 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.210+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2ed00018f0 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.210+0000 7f2ed6ffd700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ec0067290 0x7f2ec0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.211+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ed0083f60 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.211+0000 7f2edeffd700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ec0067290 0x7f2ec0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.211+0000 7f2edeffd700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ec0067290 0x7f2ec0069740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80010e0 tx=0x7f2ed8007a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.215+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ed0050dc0 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.454+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ee0064550 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.454+0000 7f2ed6ffd700 1 -- 172.21.15.22:0/2470477732 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ed0019070 con 0x7f2ee00b2bf0 2023-10-08T00:31:21.456 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:31:21.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ec0067290 msgr2=0x7f2ec0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ec0067290 0x7f2ec0069740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80010e0 tx=0x7f2ed8007a00 comp rx=0 tx=0).stop 2023-10-08T00:31:21.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 msgr2=0x7f2ee0167ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 0x7f2ee0167ba0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0089590 tx=0x7f2ed0009040 comp rx=0 tx=0).stop 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 shutdown_connections 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee00b2bf0 0x7f2ee0167ba0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ec0067290 0x7f2ec0069740 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ecc004810 0x7f2ee015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 --2- 172.21.15.22:0/2470477732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee015aaf0 0x7f2ee00b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 >> 172.21.15.22:0/2470477732 conn(0x7f2ee0068e10 msgr2=0x7f2ee00af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 shutdown_connections 2023-10-08T00:31:21.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:21.456+0000 7f2ee52f6700 1 -- 172.21.15.22:0/2470477732 wait complete. 2023-10-08T00:31:21.470 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:31:21.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:31:21.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:31:21.470 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:31:21.470 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:21.471 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:31:21.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:31:21.471 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:31:21.471 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:31:21.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:21.471 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:31:21.486 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:21.487 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42089sec preferred_lft 42089sec 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:31:21.488 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.489 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:21.490 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:31:21.490 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:31:21.490 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:21.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:21.490 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:31:21.551 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:31:21.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:21.553 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:31:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:31:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:31:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:31:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:31:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:31:21.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:21.611 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:31:21.611 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:31:21.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:31:21.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:31:21.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:31:21.611 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:31:21.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:21.714 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:31:21.729 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:31:21.729 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:31:21.729 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:31:21.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:21.730 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:31:21.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:21.796 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:21.852 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:31:21.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:21.853 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:21.909 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:31:21.909 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:31:21.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:21.990 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:21.991 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:22.009 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:22.010 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:22.031 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:31:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:31:22.032 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:31:22.033 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:31:22.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:22.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:31:22.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.258+0000 7f6595c17700 1 Processor -- start 2023-10-08T00:31:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.258+0000 7f6595c17700 1 -- start start 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f6595c17700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 0x7f6590140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f6595c17700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659015c2a0 con 0x7f65900c9510 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f6595c17700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659015b690 con 0x7f659006c0a0 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f6595c17700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659015b970 con 0x7f659006bcd0 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f65900c9510 0x7f65900cc1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39578/0 (socket says 172.21.15.22:39578) 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658ffff700 1 -- 172.21.15.22:0/2022515185 learned_addr learned my addr 172.21.15.22:0/2022515185 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:22.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572413497 0 0) 0x7f659015c2a0 con 0x7f65900c9510 2023-10-08T00:31:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658f7fe700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 0x7f6590140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c003570 con 0x7f65900c9510 2023-10-08T00:31:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 742634473 0 0) 0x7f657c003570 con 0x7f65900c9510 2023-10-08T00:31:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 msgr2=0x7f6590140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:22.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 0x7f6590140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 >> v1:172.21.15.192:6789/0 conn(0x7f659006c0a0 legacy=0x7f65900c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659015bc50 con 0x7f65900c9510 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f65800017f0 con 0x7f65900c9510 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.259+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 >> v1:172.21.15.22:6789/0 conn(0x7f65900c9510 legacy=0x7f65900cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c003a90 0x7f657c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 0x7f657c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657c004d50 0x7f657c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659015b970 con 0x7f657c004d50 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c00bb70 con 0x7f657c003a90 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c00bd30 con 0x7f659006bcd0 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657c004d50 0x7f657c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658f7fe700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c003a90 0x7f657c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658effd700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 0x7f657c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 -- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 msgr2=0x7f657c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659006bcd0 0x7f657c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 -- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c003a90 msgr2=0x7f657c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c003a90 0x7f657c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 -- 172.21.15.22:0/2022515185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c003570 con 0x7f657c004d50 2023-10-08T00:31:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658ffff700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657c004d50 0x7f657c0051c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f658000a900 tx=0x7f6590158030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a56514cc88f4a85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800070d0 con 0x7f657c004d50 2023-10-08T00:31:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580007230 con 0x7f657c004d50 2023-10-08T00:31:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.260+0000 7f658e7fc700 1 -- 172.21.15.22:0/2022515185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800075f0 con 0x7f657c004d50 2023-10-08T00:31:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f6595c17700 1 -- 172.21.15.22:0/2022515185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657c004d50 msgr2=0x7f657c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f6595c17700 1 --2- 172.21.15.22:0/2022515185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657c004d50 0x7f657c0051c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f658000a900 tx=0x7f6590158030 comp rx=0 tx=0).stop 2023-10-08T00:31:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f658ffff700 1 -- 172.21.15.22:0/2022515185 reap_dead start 2023-10-08T00:31:22.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f6595c17700 1 -- 172.21.15.22:0/2022515185 shutdown_connections 2023-10-08T00:31:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f6595c17700 1 -- 172.21.15.22:0/2022515185 >> 172.21.15.22:0/2022515185 conn(0x7f65900ce600 msgr2=0x7f65900cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f6595c17700 1 -- 172.21.15.22:0/2022515185 shutdown_connections 2023-10-08T00:31:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.261+0000 7f6595c17700 1 -- 172.21.15.22:0/2022515185 wait complete. 2023-10-08T00:31:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.262+0000 7f6595c17700 1 Processor -- start 2023-10-08T00:31:22.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.262+0000 7f6595c17700 1 -- start start 2023-10-08T00:31:22.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f6595c17700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c004d50 0x7f659013c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f6595c17700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 0x7f659013f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f6595c17700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659013fdb0 0x7f659013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f6595c17700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590140220 con 0x7f65900c5f80 2023-10-08T00:31:22.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f6595c17700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b2370 con 0x7f657c004d50 2023-10-08T00:31:22.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f6595c17700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b2c10 con 0x7f659013fdb0 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 0x7f659013f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 0x7f659013f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50348/0 (socket says 172.21.15.22:50348) 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 -- 172.21.15.22:0/3162470978 learned_addr learned my addr 172.21.15.22:0/3162470978 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658ffff700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659013fdb0 0x7f659013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658f7fe700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c004d50 0x7f659013c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 -- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659013fdb0 msgr2=0x7f659013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659013fdb0 0x7f659013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 -- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c004d50 msgr2=0x7f659013c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c004d50 0x7f659013c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 -- 172.21.15.22:0/3162470978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590140400 con 0x7f65900c5f80 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f658effd700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 0x7f659013f870 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6578003c10 tx=0x7f6578007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.263+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578013260 con 0x7f65900c5f80 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.264+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65780133c0 con 0x7f65900c5f80 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.264+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65900b25c0 con 0x7f65900c5f80 2023-10-08T00:31:22.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.264+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65780029e0 con 0x7f65900c5f80 2023-10-08T00:31:22.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.264+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65900c63f0 con 0x7f65900c5f80 2023-10-08T00:31:22.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.264+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659004c3c0 con 0x7f65900c5f80 2023-10-08T00:31:22.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.265+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6578002d50 con 0x7f65900c5f80 2023-10-08T00:31:22.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.265+0000 7f65877fe700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6570067290 0x7f6570069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:22.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.266+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f65780884b0 con 0x7f65900c5f80 2023-10-08T00:31:22.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.266+0000 7f658f7fe700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6570067290 0x7f6570069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:22.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.266+0000 7f658f7fe700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6570067290 0x7f6570069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6588006f00 tx=0x7f65880091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:22.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.270+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6578058da0 con 0x7f65900c5f80 2023-10-08T00:31:22.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.516+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65900b2d50 con 0x7f65900c5f80 2023-10-08T00:31:22.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.516+0000 7f65877fe700 1 -- 172.21.15.22:0/3162470978 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6578058930 con 0x7f65900c5f80 2023-10-08T00:31:22.518 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:31:22.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.518+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6570067290 msgr2=0x7f6570069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.518+0000 7f6595c17700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6570067290 0x7f6570069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f6588006f00 tx=0x7f65880091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.518+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 msgr2=0x7f659013f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.518+0000 7f6595c17700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 0x7f659013f870 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6578003c10 tx=0x7f6578007d30 comp rx=0 tx=0).stop 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 shutdown_connections 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6570067290 0x7f6570069740 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f659013fdb0 0x7f659013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f657c004d50 0x7f659013c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 --2- 172.21.15.22:0/3162470978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65900c5f80 0x7f659013f870 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 >> 172.21.15.22:0/3162470978 conn(0x7f65900ce600 msgr2=0x7f6590155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 shutdown_connections 2023-10-08T00:31:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:22.519+0000 7f6595c17700 1 -- 172.21.15.22:0/3162470978 wait complete. 2023-10-08T00:31:22.532 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:31:22.532 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:31:22.532 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:31:22.533 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:31:22.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:22.533 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:31:22.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:31:22.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:31:22.533 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:31:22.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.533 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:31:22.552 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:31:22.552 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:31:22.552 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:31:22.552 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:22.553 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42092sec preferred_lft 42092sec 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:31:22.554 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:22.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.556 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:31:22.618 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:31:22.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.622 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:31:22.680 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:31:22.680 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:31:22.680 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:31:22.680 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:31:22.680 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:31:22.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.681 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:31:22.681 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:31:22.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:31:22.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:31:22.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:31:22.681 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:31:22.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.783 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:31:22.798 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:31:22.798 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:31:22.798 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:31:22.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:22.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:31:22.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:22.863 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:22.919 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:31:22.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:22.919 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:22.973 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:31:22.973 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:31:22.973 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:23.052 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:23.052 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:23.070 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:23.070 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:23.071 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:23.071 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:23.071 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:23.071 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:23.071 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:23.071 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:23.092 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:23.092 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:23.092 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:31:23.093 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:31:23.094 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:31:23.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:23.095 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:23.160 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:31:23.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.284+0000 7f59692a7700 1 Processor -- start 2023-10-08T00:31:23.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.284+0000 7f59692a7700 1 -- start start 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.284+0000 7f59692a7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f596415a440 0x7f59640acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.284+0000 7f59692a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5964068890 0x7f59640c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59692a7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596415a9b0 con 0x7f59641563b0 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59692a7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596415ac90 con 0x7f596415a440 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59692a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596415af70 con 0x7f5964068890 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f596415a440 0x7f59640acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f5962ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f59641563b0 0x7f5964156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39584/0 (socket says 172.21.15.22:39584) 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f5962ffd700 1 -- 172.21.15.22:0/1824905296 learned_addr learned my addr 172.21.15.22:0/1824905296 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f596415a440 0x7f59640acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50362/0 (socket says 172.21.15.22:50362) 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59637fe700 1 --2- 172.21.15.22:0/1824905296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5964068890 0x7f59640c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 -- 172.21.15.22:0/1824905296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5964068890 msgr2=0x7f59640c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 --2- 172.21.15.22:0/1824905296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5964068890 0x7f59640c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 -- 172.21.15.22:0/1824905296 >> v1:172.21.15.22:6789/0 conn(0x7f59641563b0 legacy=0x7f5964156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 -- 172.21.15.22:0/1824905296 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596415b250 con 0x7f596415a440 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f5961ffb700 1 -- 172.21.15.22:0/1824905296 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261852487 0 0) 0x7f596415a9b0 con 0x7f59641563b0 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f59627fc700 1 --2- 172.21.15.22:0/1824905296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596415a440 0x7f59640acf30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f595800bb90 tx=0x7f595800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d3fadf96a89f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f5961ffb700 1 -- 172.21.15.22:0/1824905296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800db40 con 0x7f596415a440 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f5961ffb700 1 -- 172.21.15.22:0/1824905296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800dca0 con 0x7f596415a440 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.285+0000 7f5961ffb700 1 -- 172.21.15.22:0/1824905296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580196b0 con 0x7f596415a440 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 -- 172.21.15.22:0/1824905296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596415a440 msgr2=0x7f59640acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 --2- 172.21.15.22:0/1824905296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596415a440 0x7f59640acf30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f595800bb90 tx=0x7f595800b430 comp rx=0 tx=0).stop 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 -- 172.21.15.22:0/1824905296 shutdown_connections 2023-10-08T00:31:23.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 --2- 172.21.15.22:0/1824905296 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5964068890 0x7f59640c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 --2- 172.21.15.22:0/1824905296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f596415a440 0x7f59640acf30 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 -- 172.21.15.22:0/1824905296 >> 172.21.15.22:0/1824905296 conn(0x7f59640c8f90 msgr2=0x7f59640c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 -- 172.21.15.22:0/1824905296 shutdown_connections 2023-10-08T00:31:23.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.286+0000 7f59692a7700 1 -- 172.21.15.22:0/1824905296 wait complete. 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.287+0000 7f59692a7700 1 Processor -- start 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.287+0000 7f59692a7700 1 -- start start 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59692a7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5964068890 0x7f5964150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59692a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 0x7f5964165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59692a7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f596415a440 0x7f59640b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59692a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5964158df0 con 0x7f59641563b0 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59692a7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59640b0bd0 con 0x7f5964068890 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59692a7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59641584c0 con 0x7f596415a440 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 0x7f5964165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 0x7f5964165d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50368/0 (socket says 172.21.15.22:50368) 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 -- 172.21.15.22:0/2870398141 learned_addr learned my addr 172.21.15.22:0/2870398141 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59637fe700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f596415a440 0x7f59640b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f5962ffd700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5964068890 0x7f5964150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 -- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f596415a440 msgr2=0x7f59640b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f596415a440 0x7f59640b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 -- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5964068890 msgr2=0x7f5964150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5964068890 0x7f5964150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59627fc700 1 -- 172.21.15.22:0/2870398141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595800b6d0 con 0x7f59641563b0 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.288+0000 7f59637fe700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f596415a440 0x7f59640b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.289+0000 7f59627fc700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 0x7f5964165d70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f595800b2c0 tx=0x7f595801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.289+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595801d050 con 0x7f59641563b0 2023-10-08T00:31:23.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.289+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595801e040 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.289+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59641587a0 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.289+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958010a80 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.289+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964157e10 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.290+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59640718b0 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.290+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f595802d410 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.291+0000 7f594affd700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5950067290 0x7f5950069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.291+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5958014070 con 0x7f59641563b0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.291+0000 7f5962ffd700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5950067290 0x7f5950069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.291+0000 7f5962ffd700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5950067290 0x7f5950069740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f59640b0010 tx=0x7f5954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:23.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.295+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5958056260 con 0x7f59641563b0 2023-10-08T00:31:23.537 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.535+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f596406d6a0 con 0x7f59641563b0 2023-10-08T00:31:23.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.631+0000 7f594affd700 1 -- 172.21.15.22:0/2870398141 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5958059880 con 0x7f59641563b0 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5950067290 msgr2=0x7f5950069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5950067290 0x7f5950069740 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f59640b0010 tx=0x7f5954009040 comp rx=0 tx=0).stop 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 msgr2=0x7f5964165d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 0x7f5964165d70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f595800b2c0 tx=0x7f595801b000 comp rx=0 tx=0).stop 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 shutdown_connections 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5950067290 0x7f5950069740 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f596415a440 0x7f59640b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5964068890 0x7f5964150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 --2- 172.21.15.22:0/2870398141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59641563b0 0x7f5964165d70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 >> 172.21.15.22:0/2870398141 conn(0x7f59640c8f90 msgr2=0x7f59640ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:23.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 shutdown_connections 2023-10-08T00:31:23.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.633+0000 7f59692a7700 1 -- 172.21.15.22:0/2870398141 wait complete. 2023-10-08T00:31:23.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:31:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.765+0000 7f4dfcf6d700 1 Processor -- start 2023-10-08T00:31:23.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.765+0000 7f4dfcf6d700 1 -- start start 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4dfcf6d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4df815d230 0x7f4df815d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4dfcf6d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df80b2980 con 0x7f4df8159420 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4dfcf6d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df815db70 con 0x7f4df81597f0 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4dfcf6d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df80b11d0 con 0x7f4df815d230 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4df7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4df815d230 0x7f4df815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4df77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4df8159420 0x7f4df80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39592/0 (socket says 172.21.15.22:39592) 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4df77fe700 1 -- 172.21.15.22:0/1780958674 learned_addr learned my addr 172.21.15.22:0/1780958674 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4df7fff700 1 -- 172.21.15.22:0/1780958674 >> v1:172.21.15.192:6789/0 conn(0x7f4df81597f0 legacy=0x7f4df80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4df7fff700 1 -- 172.21.15.22:0/1780958674 >> v1:172.21.15.22:6789/0 conn(0x7f4df8159420 legacy=0x7f4df80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.766+0000 7f4df7fff700 1 -- 172.21.15.22:0/1780958674 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80b14b0 con 0x7f4df815d230 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4df7fff700 1 --2- 172.21.15.22:0/1780958674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df815d230 0x7f4df815d630 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009e60 tx=0x7f4df0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639d529eccc2abbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4df67fc700 1 -- 172.21.15.22:0/1780958674 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000e070 con 0x7f4df815d230 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4df67fc700 1 -- 172.21.15.22:0/1780958674 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df000bc30 con 0x7f4df815d230 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4df67fc700 1 -- 172.21.15.22:0/1780958674 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0012430 con 0x7f4df815d230 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/1780958674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df815d230 msgr2=0x7f4df815d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/1780958674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df815d230 0x7f4df815d630 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009e60 tx=0x7f4df0009780 comp rx=0 tx=0).stop 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/1780958674 shutdown_connections 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/1780958674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df815d230 0x7f4df815d630 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/1780958674 >> 172.21.15.22:0/1780958674 conn(0x7f4df80d0660 msgr2=0x7f4df80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/1780958674 shutdown_connections 2023-10-08T00:31:23.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.767+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/1780958674 wait complete. 2023-10-08T00:31:23.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.768+0000 7f4dfcf6d700 1 Processor -- start 2023-10-08T00:31:23.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 -- start start 2023-10-08T00:31:23.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df8159420 0x7f4df815c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 0x7f4df8068d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df815d230 0x7f4df8148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df8169cb0 con 0x7f4df81597f0 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80c54a0 con 0x7f4df8159420 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4dfcf6d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80c5780 con 0x7f4df815d230 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4df6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 0x7f4df8068d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4df6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 0x7f4df8068d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50382/0 (socket says 172.21.15.22:50382) 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4df6ffd700 1 -- 172.21.15.22:0/2518136117 learned_addr learned my addr 172.21.15.22:0/2518136117 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4df77fe700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df8159420 0x7f4df815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.769+0000 7f4df7fff700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df815d230 0x7f4df8148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4df6ffd700 1 -- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df815d230 msgr2=0x7f4df8148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4df6ffd700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df815d230 0x7f4df8148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4df6ffd700 1 -- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df8159420 msgr2=0x7f4df815c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4df6ffd700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df8159420 0x7f4df815c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4df6ffd700 1 -- 172.21.15.22:0/2518136117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0009a20 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4df6ffd700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 0x7f4df8068d70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c590 tx=0x7f4dec007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec011590 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec011710 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df80c5a60 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec011ad0 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.770+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df80c6020 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.771+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df80c6240 con 0x7f4df81597f0 2023-10-08T00:31:23.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.772+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4dec01b3b0 con 0x7f4df81597f0 2023-10-08T00:31:23.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.772+0000 7f4ddf7fe700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4de4067290 0x7f4de4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:23.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.772+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4dec083e20 con 0x7f4df81597f0 2023-10-08T00:31:23.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.772+0000 7f4df77fe700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4de4067290 0x7f4de4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:23.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.773+0000 7f4df77fe700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4de4067290 0x7f4de4069740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4de8007130 tx=0x7f4de8007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:23.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.776+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dec050c80 con 0x7f4df81597f0 2023-10-08T00:31:23.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.997+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4df804c3c0 con 0x7f4de4067290 2023-10-08T00:31:24.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:23.999+0000 7f4ddf7fe700 1 -- 172.21.15.22:0/2518136117 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4df804c3c0 con 0x7f4de4067290 2023-10-08T00:31:24.001 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:31:24.001 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:24.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:31:24.001 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:24.001 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:31:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.000+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4de4067290 msgr2=0x7f4de4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.000+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4de4067290 0x7f4de4069740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4de8007130 tx=0x7f4de8007eb0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.000+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 msgr2=0x7f4df8068d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.000+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 0x7f4df8068d70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c590 tx=0x7f4dec007f10 comp rx=0 tx=0).stop 2023-10-08T00:31:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 shutdown_connections 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4de4067290 0x7f4de4069740 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df815d230 0x7f4df8148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df8159420 0x7f4df815c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 --2- 172.21.15.22:0/2518136117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df81597f0 0x7f4df8068d70 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 >> 172.21.15.22:0/2518136117 conn(0x7f4df80d0660 msgr2=0x7f4df80b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 shutdown_connections 2023-10-08T00:31:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.001+0000 7f4dfcf6d700 1 -- 172.21.15.22:0/2518136117 wait complete. 2023-10-08T00:31:24.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:31:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.135+0000 7fef2a3b0700 1 Processor -- start 2023-10-08T00:31:24.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.135+0000 7fef2a3b0700 1 -- start start 2023-10-08T00:31:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef2a3b0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef2a3b0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef240b1b40 0x7fef2415d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef2a3b0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef240cfb00 con 0x7fef240b16d0 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef2a3b0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240b5c40 con 0x7fef240b4e70 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef2a3b0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240b5f20 con 0x7fef240b1b40 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef293ae700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef28bad700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fef240b16d0 0x7fef2415d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39598/0 (socket says 172.21.15.22:39598) 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef28bad700 1 -- 172.21.15.22:0/1058965646 learned_addr learned my addr 172.21.15.22:0/1058965646 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef29baf700 1 --2- 172.21.15.22:0/1058965646 >> v2:172.21.15.192:3300/0 conn(0x7fef240b1b40 0x7fef2415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef293ae700 1 -- 172.21.15.22:0/1058965646 >> v2:172.21.15.192:3300/0 conn(0x7fef240b1b40 msgr2=0x7fef2415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef293ae700 1 --2- 172.21.15.22:0/1058965646 >> v2:172.21.15.192:3300/0 conn(0x7fef240b1b40 0x7fef2415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef293ae700 1 -- 172.21.15.22:0/1058965646 >> v1:172.21.15.22:6789/0 conn(0x7fef240b16d0 legacy=0x7fef2415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef293ae700 1 -- 172.21.15.22:0/1058965646 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240b6200 con 0x7fef240b4e70 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.136+0000 7fef23fff700 1 -- 172.21.15.22:0/1058965646 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082228005 0 0) 0x7fef240cfb00 con 0x7fef240b16d0 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef293ae700 1 --2- 172.21.15.22:0/1058965646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b4e70 0x7fef240ccff0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fef24071380 tx=0x7fef1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e76e85be74701f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef23fff700 1 -- 172.21.15.22:0/1058965646 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00e070 con 0x7fef240b4e70 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef23fff700 1 -- 172.21.15.22:0/1058965646 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00bc30 con 0x7fef240b4e70 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef23fff700 1 -- 172.21.15.22:0/1058965646 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c012430 con 0x7fef240b4e70 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 -- 172.21.15.22:0/1058965646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b4e70 msgr2=0x7fef240ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/1058965646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b4e70 0x7fef240ccff0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fef24071380 tx=0x7fef1c009780 comp rx=0 tx=0).stop 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 -- 172.21.15.22:0/1058965646 shutdown_connections 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/1058965646 >> v2:172.21.15.192:3300/0 conn(0x7fef240b1b40 0x7fef2415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/1058965646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b4e70 0x7fef240ccff0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 -- 172.21.15.22:0/1058965646 >> 172.21.15.22:0/1058965646 conn(0x7fef240d10c0 msgr2=0x7fef240affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 -- 172.21.15.22:0/1058965646 shutdown_connections 2023-10-08T00:31:24.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.137+0000 7fef2a3b0700 1 -- 172.21.15.22:0/1058965646 wait complete. 2023-10-08T00:31:24.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.138+0000 7fef2a3b0700 1 Processor -- start 2023-10-08T00:31:24.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.138+0000 7fef2a3b0700 1 -- start start 2023-10-08T00:31:24.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef2a3b0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef240b16d0 0x7fef240cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef2a3b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 0x7fef2414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef2a3b0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef240b4e70 0x7fef2414bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef2a3b0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414d130 con 0x7fef240b1b40 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef2a3b0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414c2a0 con 0x7fef240b16d0 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef2a3b0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2414c520 con 0x7fef240b4e70 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.139+0000 7fef28bad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 0x7fef2414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 0x7fef2414e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50388/0 (socket says 172.21.15.22:50388) 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 -- 172.21.15.22:0/3582601175 learned_addr learned my addr 172.21.15.22:0/3582601175 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef293ae700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef240b16d0 0x7fef240cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef29baf700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef240b4e70 0x7fef2414bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 -- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef240b4e70 msgr2=0x7fef2414bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef240b4e70 0x7fef2414bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 -- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef240b16d0 msgr2=0x7fef240cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef240b16d0 0x7fef240cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 -- 172.21.15.22:0/3582601175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009a20 con 0x7fef240b1b40 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef28bad700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 0x7fef2414e850 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c7e0 tx=0x7fef18007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18005b30 con 0x7fef240b1b40 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18005c90 con 0x7fef240b1b40 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18007300 con 0x7fef240b1b40 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2414c800 con 0x7fef240b1b40 2023-10-08T00:31:24.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.140+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2414cdc0 con 0x7fef240b1b40 2023-10-08T00:31:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.141+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef24088990 con 0x7fef240b1b40 2023-10-08T00:31:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.142+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fef1801b3b0 con 0x7fef240b1b40 2023-10-08T00:31:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.142+0000 7fef217fa700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fef10067290 0x7fef10069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.142+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef18083fd0 con 0x7fef240b1b40 2023-10-08T00:31:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.142+0000 7fef293ae700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fef10067290 0x7fef10069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.143+0000 7fef293ae700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fef10067290 0x7fef10069740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fef24071380 tx=0x7fef1c019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:24.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.146+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef18050df0 con 0x7fef240b1b40 2023-10-08T00:31:24.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.341+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fef2414d270 con 0x7fef240b1b40 2023-10-08T00:31:24.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.342+0000 7fef217fa700 1 -- 172.21.15.22:0/3582601175 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef18017020 con 0x7fef240b1b40 2023-10-08T00:31:24.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fef10067290 msgr2=0x7fef10069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fef10067290 0x7fef10069740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fef24071380 tx=0x7fef1c019000 comp rx=0 tx=0).stop 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 msgr2=0x7fef2414e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 0x7fef2414e850 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c7e0 tx=0x7fef18007df0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 shutdown_connections 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fef10067290 0x7fef10069740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fef240b4e70 0x7fef2414bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef240b16d0 0x7fef240cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 --2- 172.21.15.22:0/3582601175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef240b1b40 0x7fef2414e850 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 >> 172.21.15.22:0/3582601175 conn(0x7fef240d10c0 msgr2=0x7fef24068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 shutdown_connections 2023-10-08T00:31:24.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.344+0000 7fef2a3b0700 1 -- 172.21.15.22:0/3582601175 wait complete. 2023-10-08T00:31:24.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-08T00:31:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.477+0000 7fd49c556700 1 Processor -- start 2023-10-08T00:31:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.477+0000 7fd49c556700 1 -- start start 2023-10-08T00:31:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49c556700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159c60 0x7fd49415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49c556700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd49415db10 0x7fd494069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49c556700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49415a160 con 0x7fd494159890 2023-10-08T00:31:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49c556700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940d13a0 con 0x7fd49415db10 2023-10-08T00:31:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49c556700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49415e140 con 0x7fd494159c60 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49a2f2700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd494159890 0x7fd49415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:53154/0 (socket says 172.21.15.22:53154) 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.478+0000 7fd49a2f2700 1 -- 172.21.15.22:0/3359346274 learned_addr learned my addr 172.21.15.22:0/3359346274 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd49aaf3700 1 --2- 172.21.15.22:0/3359346274 >> v2:172.21.15.192:3300/0 conn(0x7fd49415db10 0x7fd494069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd499af1700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159c60 0x7fd49415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd4992f0700 1 -- 172.21.15.22:0/3359346274 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526418723 0 0) 0x7fd49415a160 con 0x7fd494159890 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd4992f0700 1 -- 172.21.15.22:0/3359346274 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd47c003570 con 0x7fd494159890 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd49aaf3700 1 -- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159c60 msgr2=0x7fd49415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd49aaf3700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159c60 0x7fd49415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd49aaf3700 1 -- 172.21.15.22:0/3359346274 >> v1:172.21.15.192:6789/0 conn(0x7fd494159890 legacy=0x7fd49415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd49aaf3700 1 -- 172.21.15.22:0/3359346274 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49415a3d0 con 0x7fd49415db10 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd499af1700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159c60 0x7fd49415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd49aaf3700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494069560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd484009e60 tx=0x7fd484009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc234d6112f23c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd4992f0700 1 -- 172.21.15.22:0/3359346274 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400e070 con 0x7fd49415db10 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd4992f0700 1 -- 172.21.15.22:0/3359346274 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48400bab0 con 0x7fd49415db10 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.479+0000 7fd4992f0700 1 -- 172.21.15.22:0/3359346274 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400be30 con 0x7fd49415db10 2023-10-08T00:31:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 -- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 msgr2=0x7fd494069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494069560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd484009e60 tx=0x7fd484009780 comp rx=0 tx=0).stop 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 -- 172.21.15.22:0/3359346274 shutdown_connections 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494069560 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 --2- 172.21.15.22:0/3359346274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159c60 0x7fd49415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 -- 172.21.15.22:0/3359346274 >> 172.21.15.22:0/3359346274 conn(0x7fd494068e20 msgr2=0x7fd4940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 -- 172.21.15.22:0/3359346274 shutdown_connections 2023-10-08T00:31:24.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.480+0000 7fd49c556700 1 -- 172.21.15.22:0/3359346274 wait complete. 2023-10-08T00:31:24.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.481+0000 7fd49c556700 1 Processor -- start 2023-10-08T00:31:24.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.481+0000 7fd49c556700 1 -- start start 2023-10-08T00:31:24.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49c556700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159890 0x7fd49414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49c556700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 0x7fd494155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49c556700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49c556700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49414d330 con 0x7fd494159c60 2023-10-08T00:31:24.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49c556700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940b4340 con 0x7fd49415db10 2023-10-08T00:31:24.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49c556700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940b3730 con 0x7fd494159890 2023-10-08T00:31:24.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 0x7fd494155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 0x7fd494155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50398/0 (socket says 172.21.15.22:50398) 2023-10-08T00:31:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 -- 172.21.15.22:0/2535047355 learned_addr learned my addr 172.21.15.22:0/2535047355 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49a2f2700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159890 0x7fd49414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49aaf3700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 -- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159890 msgr2=0x7fd49414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159890 0x7fd49414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 -- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 msgr2=0x7fd494156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 -- 172.21.15.22:0/2535047355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009420 con 0x7fd494159c60 2023-10-08T00:31:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49a2f2700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159890 0x7fd49414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd49aaf3700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.482+0000 7fd499af1700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 0x7fd494155c30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd48800ec80 tx=0x7fd4880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.483+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800ca60 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.483+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48800cbc0 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.483+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd484009a20 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.483+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd488013470 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.483+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940b3cf0 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.484+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4940b44f0 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.484+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fd488013820 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.484+0000 7fd4927fc700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd480067290 0x7fd480069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.485+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd488084db0 con 0x7fd494159c60 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.485+0000 7fd49a2f2700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd480067290 0x7fd480069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.485+0000 7fd49a2f2700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd480067290 0x7fd480069740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0058d0 tx=0x7fd48c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.489+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4880556a0 con 0x7fd494159c60 2023-10-08T00:31:24.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.711+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fd49404c3c0 con 0x7fd480067290 2023-10-08T00:31:24.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:31:24.718+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:31:24.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:31:24.718+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:31:24.718 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:31:24.718+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:31:24.719 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:31:24.718+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:31:24.719 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:31:24.718+0000 7f7d5e472700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T00:31:24.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.723+0000 7fd4927fc700 1 -- 172.21.15.22:0/2535047355 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+472 (secure 0 0 0) 0x7fd49404c3c0 con 0x7fd480067290 2023-10-08T00:31:24.724 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "mon_addrs": [ 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6789", 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6789", 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.192:6790" 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": { 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "data": [ 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": 365977698304, 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_data", 2023-10-08T00:31:24.725 INFO:teuthology.orchestra.run.smithi022.stdout: "used": 0 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": [ 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "avail": 365977698304, 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs_metadata", 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: "used": 65536 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:24.726 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:31:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd480067290 msgr2=0x7fd480069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd480067290 0x7fd480069740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0058d0 tx=0x7fd48c009040 comp rx=0 tx=0).stop 2023-10-08T00:31:24.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 msgr2=0x7fd494155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 0x7fd494155c30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd48800ec80 tx=0x7fd4880091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 shutdown_connections 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49415db10 0x7fd494156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd480067290 0x7fd480069740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd494159890 0x7fd49414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 --2- 172.21.15.22:0/2535047355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd494159c60 0x7fd494155c30 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 >> 172.21.15.22:0/2535047355 conn(0x7fd494068e20 msgr2=0x7fd4941536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 shutdown_connections 2023-10-08T00:31:24.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:24.725+0000 7fd49c556700 1 -- 172.21.15.22:0/2535047355 wait complete. 2023-10-08T00:31:24.738 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:31:24.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:31:24.779 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:31:24.830 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:31:24.831 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:31:24.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:31:24.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:24.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:31:24.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:24.871 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:31:24.927 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:31:24.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:31:24.927 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:24.964 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:31:24.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:24.965 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:31:25.021 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:25.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.139+0000 7eff45a37700 1 Processor -- start 2023-10-08T00:31:25.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.139+0000 7eff45a37700 1 -- start start 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff45a37700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7eff40141500 0x7eff400c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff45a37700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4015c2a0 con 0x7eff4006bcd0 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff45a37700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4015b690 con 0x7eff4006c0a0 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff45a37700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4015b970 con 0x7eff40141500 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7eff4006bcd0 0x7eff40140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39614/0 (socket says 172.21.15.22:39614) 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3effd700 1 -- 172.21.15.22:0/2484144214 learned_addr learned my addr 172.21.15.22:0/2484144214 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3e7fc700 1 --2- 172.21.15.22:0/2484144214 >> v2:172.21.15.192:3300/0 conn(0x7eff40141500 0x7eff400c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953777826 0 0) 0x7eff4015c2a0 con 0x7eff4006bcd0 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff28003570 con 0x7eff4006bcd0 2023-10-08T00:31:25.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965754425 0 0) 0x7eff4015b690 con 0x7eff4006c0a0 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4015c2a0 con 0x7eff4006c0a0 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849642281 0 0) 0x7eff28003570 con 0x7eff4006bcd0 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3e7fc700 1 -- 172.21.15.22:0/2484144214 >> v1:172.21.15.192:6789/0 conn(0x7eff4006c0a0 legacy=0x7eff400c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3e7fc700 1 -- 172.21.15.22:0/2484144214 >> v1:172.21.15.22:6789/0 conn(0x7eff4006bcd0 legacy=0x7eff40140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.140+0000 7eff3e7fc700 1 -- 172.21.15.22:0/2484144214 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4015bc50 con 0x7eff40141500 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff3e7fc700 1 --2- 172.21.15.22:0/2484144214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff400c8e00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff340098e0 tx=0x7eff340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9de617576276f34d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30001470 con 0x7eff40141500 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34011420 con 0x7eff40141500 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff3dffb700 1 -- 172.21.15.22:0/2484144214 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340117c0 con 0x7eff40141500 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 -- 172.21.15.22:0/2484144214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 msgr2=0x7eff400c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 --2- 172.21.15.22:0/2484144214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff400c8e00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7eff340098e0 tx=0x7eff340091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 -- 172.21.15.22:0/2484144214 shutdown_connections 2023-10-08T00:31:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 --2- 172.21.15.22:0/2484144214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff400c8e00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 -- 172.21.15.22:0/2484144214 >> 172.21.15.22:0/2484144214 conn(0x7eff400ce600 msgr2=0x7eff400cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 -- 172.21.15.22:0/2484144214 shutdown_connections 2023-10-08T00:31:25.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.141+0000 7eff45a37700 1 -- 172.21.15.22:0/2484144214 wait complete. 2023-10-08T00:31:25.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.142+0000 7eff45a37700 1 Processor -- start 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 -- start start 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4006bcd0 0x7eff4013c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 0x7eff4013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff4013fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4016cb10 con 0x7eff4006c0a0 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4016c680 con 0x7eff40141500 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff45a37700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4016bd50 con 0x7eff4006bcd0 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff3e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 0x7eff4013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff3e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 0x7eff4013f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50410/0 (socket says 172.21.15.22:50410) 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.143+0000 7eff3e7fc700 1 -- 172.21.15.22:0/1507380415 learned_addr learned my addr 172.21.15.22:0/1507380415 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:25.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3effd700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4006bcd0 0x7eff4013c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3f7fe700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff4013fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3e7fc700 1 -- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4006bcd0 msgr2=0x7eff4013c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3e7fc700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4006bcd0 0x7eff4013c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3e7fc700 1 -- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 msgr2=0x7eff4013fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3e7fc700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff4013fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3e7fc700 1 -- 172.21.15.22:0/1507380415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009420 con 0x7eff4006c0a0 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3f7fe700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff4013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff3e7fc700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 0x7eff4013f7b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7eff40069220 tx=0x7eff34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3401cc90 con 0x7eff4006c0a0 2023-10-08T00:31:25.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3401cdf0 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4016c030 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3401a6a0 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.144+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4013c5b0 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.145+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4016c830 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.145+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7eff3401aa90 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.146+0000 7eff26ffd700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff2c067290 0x7eff2c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.146+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7eff34086070 con 0x7eff4006c0a0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.146+0000 7eff3effd700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff2c067290 0x7eff2c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.147+0000 7eff3effd700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff2c067290 0x7eff2c069740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff300015a0 tx=0x7eff30000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.151+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff4016c830 con 0x7eff4006c0a0 2023-10-08T00:31:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.389+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff400b3040 con 0x7eff4006c0a0 2023-10-08T00:31:25.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.390+0000 7eff26ffd700 1 -- 172.21.15.22:0/1507380415 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4605 (secure 0 0 0) 0x7eff34052ed0 con 0x7eff4006c0a0 2023-10-08T00:31:25.392 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:25.392 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:14.535940+0000","modified":"2023-10-08T00:31:18.152403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3654432591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3654432591},{"type":"v1","addr":"172.21.15.22:6835","nonce":3654432591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T00:31:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff2c067290 msgr2=0x7eff2c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff2c067290 0x7eff2c069740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7eff300015a0 tx=0x7eff30000bc0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 msgr2=0x7eff4013f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 0x7eff4013f7b0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7eff40069220 tx=0x7eff34016000 comp rx=0 tx=0).stop 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 shutdown_connections 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff40141500 0x7eff4013fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff2c067290 0x7eff2c069740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff4006bcd0 0x7eff4013c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 --2- 172.21.15.22:0/1507380415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff4006c0a0 0x7eff4013f7b0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 >> 172.21.15.22:0/1507380415 conn(0x7eff400ce600 msgr2=0x7eff400c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 shutdown_connections 2023-10-08T00:31:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.392+0000 7eff45a37700 1 -- 172.21.15.22:0/1507380415 wait complete. 2023-10-08T00:31:25.395 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 70 2023-10-08T00:31:25.406 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:25.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 Processor -- start 2023-10-08T00:31:25.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 -- start start 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f27f4159890 0x7f27f415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27f4159c60 0x7f27f415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f415df50 con 0x7f27f4159890 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f415a160 con 0x7f27f4159c60 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.524+0000 7f27f99ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40d13a0 con 0x7f27f415db10 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f27f4159890 0x7f27f415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f27f4159890 0x7f27f415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50420/0 (socket says 172.21.15.22:50420) 2023-10-08T00:31:25.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 -- 172.21.15.22:0/2138484391 learned_addr learned my addr 172.21.15.22:0/2138484391 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f27fc700 1 --2- 172.21.15.22:0/2138484391 >> v2:172.21.15.192:3300/0 conn(0x7f27f4159c60 0x7f27f415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 -- 172.21.15.22:0/2138484391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 msgr2=0x7f27f4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f37fe700 1 --2- 172.21.15.22:0/2138484391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 --2- 172.21.15.22:0/2138484391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 -- 172.21.15.22:0/2138484391 >> v2:172.21.15.192:3300/0 conn(0x7f27f4159c60 msgr2=0x7f27f415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 --2- 172.21.15.22:0/2138484391 >> v2:172.21.15.192:3300/0 conn(0x7f27f4159c60 0x7f27f415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 -- 172.21.15.22:0/2138484391 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f415e140 con 0x7f27f4159890 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f27fc700 1 --2- 172.21.15.22:0/2138484391 >> v2:172.21.15.192:3300/0 conn(0x7f27f4159c60 0x7f27f415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f2ffd700 1 --2- 172.21.15.22:0/2138484391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f415abd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f27f40b67f0 tx=0x7f27e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d5d4b9cfac0c76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f1ffb700 1 -- 172.21.15.22:0/2138484391 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400e070 con 0x7f27f4159890 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f1ffb700 1 -- 172.21.15.22:0/2138484391 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400ba50 con 0x7f27f4159890 2023-10-08T00:31:25.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.525+0000 7f27f1ffb700 1 -- 172.21.15.22:0/2138484391 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40092e0 con 0x7f27f4159890 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 -- 172.21.15.22:0/2138484391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 msgr2=0x7f27f415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 --2- 172.21.15.22:0/2138484391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f415abd0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f27f40b67f0 tx=0x7f27e4009840 comp rx=0 tx=0).stop 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 -- 172.21.15.22:0/2138484391 shutdown_connections 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 --2- 172.21.15.22:0/2138484391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f415abd0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 --2- 172.21.15.22:0/2138484391 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 --2- 172.21.15.22:0/2138484391 >> v2:172.21.15.192:3300/0 conn(0x7f27f4159c60 0x7f27f415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 -- 172.21.15.22:0/2138484391 >> 172.21.15.22:0/2138484391 conn(0x7f27f4068e20 msgr2=0x7f27f40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 -- 172.21.15.22:0/2138484391 shutdown_connections 2023-10-08T00:31:25.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.526+0000 7f27f99ef700 1 -- 172.21.15.22:0/2138484391 wait complete. 2023-10-08T00:31:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.527+0000 7f27f99ef700 1 Processor -- start 2023-10-08T00:31:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.527+0000 7f27f99ef700 1 -- start start 2023-10-08T00:31:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f99ef700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f99ef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27f4159c60 0x7f27f40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f99ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f99ef700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f414d7b0 con 0x7f27f4159890 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f99ef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40cf1f0 con 0x7f27f4159c60 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f99ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40cf4d0 con 0x7f27f415db10 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50426/0 (socket says 172.21.15.22:50426) 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 -- 172.21.15.22:0/8135635 learned_addr learned my addr 172.21.15.22:0/8135635 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f37fe700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f27fc700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27f4159c60 0x7f27f40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 -- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 msgr2=0x7f27f4152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 -- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27f4159c60 msgr2=0x7f27f40b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27f4159c60 0x7f27f40b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 -- 172.21.15.22:0/8135635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e4009ae0 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.528+0000 7f27f2ffd700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f414d270 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009fd0 tx=0x7f27e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.529+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4008a00 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.529+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4008b60 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.529+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f40cf7b0 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.529+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4026460 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.529+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f40cfd70 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.529+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f404c3c0 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.530+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f27e4003040 con 0x7f27f4159890 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.530+0000 7f27eaffd700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27d4067290 0x7f27d4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.530+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f27e4086a00 con 0x7f27f4159890 2023-10-08T00:31:25.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.530+0000 7f27f27fc700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27d4067290 0x7f27d4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.531+0000 7f27f27fc700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27d4067290 0x7f27d4069740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f27f4069e70 tx=0x7f27dc006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.535+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27e4053800 con 0x7f27f4159890 2023-10-08T00:31:25.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.643+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f27e4053bd0 con 0x7f27f4159890 2023-10-08T00:31:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.745+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27f406a5b0 con 0x7f27f4159890 2023-10-08T00:31:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.746+0000 7f27eaffd700 1 -- 172.21.15.22:0/8135635 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f27e4069c60 con 0x7f27f4159890 2023-10-08T00:31:25.748 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:25.748 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":102,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:15.622465+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:12.943014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:13.503263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:25.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27d4067290 msgr2=0x7f27d4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27d4067290 0x7f27d4069740 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f27f4069e70 tx=0x7f27dc006f90 comp rx=0 tx=0).stop 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 msgr2=0x7f27f414d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f414d270 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009fd0 tx=0x7f27e4018000 comp rx=0 tx=0).stop 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 shutdown_connections 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27d4067290 0x7f27d4069740 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f27f415db10 0x7f27f4152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f27f4159890 0x7f27f414d270 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 --2- 172.21.15.22:0/8135635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27f4159c60 0x7f27f40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 >> 172.21.15.22:0/8135635 conn(0x7f27f4068e20 msgr2=0x7f27f4158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 shutdown_connections 2023-10-08T00:31:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.748+0000 7f27f99ef700 1 -- 172.21.15.22:0/8135635 wait complete. 2023-10-08T00:31:25.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:31:12.943014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:31:13.503263+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:31:25.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:31:25.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.883+0000 7f857b59e700 1 Processor -- start 2023-10-08T00:31:25.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.883+0000 7f857b59e700 1 -- start start 2023-10-08T00:31:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b16d0 0x7f857c0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857b59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f857c0b33b0 0x7f857c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857b59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c0b2080 con 0x7f857c0b4e70 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857b59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0cfb00 con 0x7f857c0b33b0 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0b5c40 con 0x7f857c0b16d0 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857a59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f857c0b4e70 0x7f857c0ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39626/0 (socket says 172.21.15.22:39626) 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857a59c700 1 -- 172.21.15.22:0/3018626100 learned_addr learned my addr 172.21.15.22:0/3018626100 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f8579d9b700 1 --2- 172.21.15.22:0/3018626100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b16d0 0x7f857c0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857ad9d700 1 --2- 172.21.15.22:0/3018626100 >> v2:172.21.15.192:3300/0 conn(0x7f857c0b33b0 0x7f857c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857959a700 1 -- 172.21.15.22:0/3018626100 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642886315 0 0) 0x7f857c0b2080 con 0x7f857c0b4e70 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.884+0000 7f857959a700 1 -- 172.21.15.22:0/3018626100 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8564003570 con 0x7f857c0b4e70 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f8579d9b700 1 -- 172.21.15.22:0/3018626100 >> v2:172.21.15.192:3300/0 conn(0x7f857c0b33b0 msgr2=0x7f857c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f8579d9b700 1 --2- 172.21.15.22:0/3018626100 >> v2:172.21.15.192:3300/0 conn(0x7f857c0b33b0 0x7f857c0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f8579d9b700 1 -- 172.21.15.22:0/3018626100 >> v1:172.21.15.22:6789/0 conn(0x7f857c0b4e70 legacy=0x7f857c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f8579d9b700 1 -- 172.21.15.22:0/3018626100 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0b5f20 con 0x7f857c0b16d0 2023-10-08T00:31:25.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f8579d9b700 1 --2- 172.21.15.22:0/3018626100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b16d0 0x7f857c0b1b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85700098e0 tx=0x7f85700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79a5c0b47b87d6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f857959a700 1 -- 172.21.15.22:0/3018626100 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011630 con 0x7f857c0b16d0 2023-10-08T00:31:25.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f857959a700 1 -- 172.21.15.22:0/3018626100 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570011790 con 0x7f857c0b16d0 2023-10-08T00:31:25.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f857959a700 1 -- 172.21.15.22:0/3018626100 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570011b30 con 0x7f857c0b16d0 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f857b59e700 1 -- 172.21.15.22:0/3018626100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b16d0 msgr2=0x7f857c0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.885+0000 7f857b59e700 1 --2- 172.21.15.22:0/3018626100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b16d0 0x7f857c0b1b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85700098e0 tx=0x7f85700091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.886+0000 7f857b59e700 1 -- 172.21.15.22:0/3018626100 shutdown_connections 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.886+0000 7f857b59e700 1 --2- 172.21.15.22:0/3018626100 >> v2:172.21.15.192:3300/0 conn(0x7f857c0b33b0 0x7f857c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.886+0000 7f857b59e700 1 --2- 172.21.15.22:0/3018626100 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b16d0 0x7f857c0b1b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.886+0000 7f857b59e700 1 -- 172.21.15.22:0/3018626100 >> 172.21.15.22:0/3018626100 conn(0x7f857c0d10c0 msgr2=0x7f857c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.886+0000 7f857b59e700 1 -- 172.21.15.22:0/3018626100 shutdown_connections 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.886+0000 7f857b59e700 1 -- 172.21.15.22:0/3018626100 wait complete. 2023-10-08T00:31:25.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.887+0000 7f857b59e700 1 Processor -- start 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.887+0000 7f857b59e700 1 -- start start 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.887+0000 7f857b59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c0b16d0 0x7f857c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.887+0000 7f857b59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b33b0 0x7f857c169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 0x7f857c15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857b59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c1586d0 con 0x7f857c0b4e70 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857b59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0cab10 con 0x7f857c0b16d0 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857b59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0cadf0 con 0x7f857c0b33b0 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 0x7f857c15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 0x7f857c15d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50428/0 (socket says 172.21.15.22:50428) 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 -- 172.21.15.22:0/2788211337 learned_addr learned my addr 172.21.15.22:0/2788211337 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:25.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857a59c700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c0b16d0 0x7f857c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f8579d9b700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b33b0 0x7f857c169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 -- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b33b0 msgr2=0x7f857c169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b33b0 0x7f857c169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 -- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c0b16d0 msgr2=0x7f857c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c0b16d0 0x7f857c158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 -- 172.21.15.22:0/2788211337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570009420 con 0x7f857c0b4e70 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f8579d9b700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b33b0 0x7f857c169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857ad9d700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 0x7f857c15d4c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f857400ea50 tx=0x7f85740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857400c920 con 0x7f857c0b4e70 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857400caa0 con 0x7f857c0b4e70 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c0cb0d0 con 0x7f857c0b4e70 2023-10-08T00:31:25.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857400ce60 con 0x7f857c0b4e70 2023-10-08T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.888+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0cb690 con 0x7f857c0b4e70 2023-10-08T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.889+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857c0cb880 con 0x7f857c0b4e70 2023-10-08T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.890+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8574013680 con 0x7f857c0b4e70 2023-10-08T00:31:25.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.890+0000 7f856a7fc700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f855c067320 0x7f855c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:25.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.890+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8574085090 con 0x7f857c0b4e70 2023-10-08T00:31:25.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.890+0000 7f857a59c700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f855c067320 0x7f855c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:25.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.891+0000 7f857a59c700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f855c067320 0x7f855c0697d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f856c005c50 tx=0x7f856c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:25.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:25.894+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8574051d20 con 0x7f857c0b4e70 2023-10-08T00:31:26.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.085+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f857c04bb80 con 0x7f857c0b4e70 2023-10-08T00:31:26.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.086+0000 7f856a7fc700 1 -- 172.21.15.22:0/2788211337 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8574055340 con 0x7f857c0b4e70 2023-10-08T00:31:26.087 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:31:26.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f855c067320 msgr2=0x7f855c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f855c067320 0x7f855c0697d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f856c005c50 tx=0x7f856c009040 comp rx=0 tx=0).stop 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 msgr2=0x7f857c15d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 0x7f857c15d4c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f857400ea50 tx=0x7f85740091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 shutdown_connections 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f857c0b4e70 0x7f857c15d4c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857c0b16d0 0x7f857c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f855c067320 0x7f855c0697d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 --2- 172.21.15.22:0/2788211337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f857c0b33b0 0x7f857c169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 >> 172.21.15.22:0/2788211337 conn(0x7f857c0d10c0 msgr2=0x7f857c069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 shutdown_connections 2023-10-08T00:31:26.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.088+0000 7f857b59e700 1 -- 172.21.15.22:0/2788211337 wait complete. 2023-10-08T00:31:26.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:31:26.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 Processor -- start 2023-10-08T00:31:26.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 -- start start 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbce0159890 0x7fbce015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159c60 0x7fbce015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbce015db10 0x7fbce0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce015a160 con 0x7fbce015db10 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00d13a0 con 0x7fbce0159890 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.224+0000 7fbce530d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015e140 con 0x7fbce0159c60 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbce015db10 0x7fbce0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbce015db10 0x7fbce0069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50436/0 (socket says 172.21.15.22:50436) 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3516476155 learned_addr learned my addr 172.21.15.22:0/3516476155 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdeffd700 1 --2- 172.21.15.22:0/3516476155 >> v2:172.21.15.192:3300/0 conn(0x7fbce0159890 0x7fbce015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcde7fc700 1 --2- 172.21.15.22:0/3516476155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159c60 0x7fbce015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3516476155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159c60 msgr2=0x7fbce015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 --2- 172.21.15.22:0/3516476155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159c60 0x7fbce015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3516476155 >> v2:172.21.15.192:3300/0 conn(0x7fbce0159890 msgr2=0x7fbce015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 --2- 172.21.15.22:0/3516476155 >> v2:172.21.15.192:3300/0 conn(0x7fbce0159890 0x7fbce015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3516476155 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce015a3d0 con 0x7fbce015db10 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdeffd700 1 --2- 172.21.15.22:0/3516476155 >> v2:172.21.15.192:3300/0 conn(0x7fbce0159890 0x7fbce015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcdf7fe700 1 --2- 172.21.15.22:0/3516476155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce0069560 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fbce00d1090 tx=0x7fbcd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5eb3a4fd4d94774 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcddffb700 1 -- 172.21.15.22:0/3516476155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800b860 con 0x7fbce015db10 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcddffb700 1 -- 172.21.15.22:0/3516476155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800b9c0 con 0x7fbce015db10 2023-10-08T00:31:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.225+0000 7fbcddffb700 1 -- 172.21.15.22:0/3516476155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800bd60 con 0x7fbce015db10 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 -- 172.21.15.22:0/3516476155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 msgr2=0x7fbce0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 --2- 172.21.15.22:0/3516476155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce0069560 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fbce00d1090 tx=0x7fbcd8009250 comp rx=0 tx=0).stop 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 -- 172.21.15.22:0/3516476155 shutdown_connections 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 --2- 172.21.15.22:0/3516476155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce0069560 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 --2- 172.21.15.22:0/3516476155 >> v2:172.21.15.192:3300/0 conn(0x7fbce0159890 0x7fbce015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 --2- 172.21.15.22:0/3516476155 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159c60 0x7fbce015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 -- 172.21.15.22:0/3516476155 >> 172.21.15.22:0/3516476155 conn(0x7fbce0068e20 msgr2=0x7fbce00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 -- 172.21.15.22:0/3516476155 shutdown_connections 2023-10-08T00:31:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.226+0000 7fbce530d700 1 -- 172.21.15.22:0/3516476155 wait complete. 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.227+0000 7fbce530d700 1 Processor -- start 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.227+0000 7fbce530d700 1 -- start start 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbce530d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159890 0x7fbce015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbce530d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159c60 0x7fbce0152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbce530d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbce530d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015f470 con 0x7fbce015db10 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbce530d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015fe40 con 0x7fbce0159c60 2023-10-08T00:31:26.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbce530d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015e860 con 0x7fbce0159890 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce014c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50452/0 (socket says 172.21.15.22:50452) 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3818801584 learned_addr learned my addr 172.21.15.22:0/3818801584 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdeffd700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159890 0x7fbce015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcde7fc700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159c60 0x7fbce0152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159890 msgr2=0x7fbce015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159890 0x7fbce015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159c60 msgr2=0x7fbce0152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159c60 0x7fbce0152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.228+0000 7fbcdf7fe700 1 -- 172.21.15.22:0/3818801584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd80094f0 con 0x7fbce015db10 2023-10-08T00:31:26.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.229+0000 7fbcdf7fe700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce014c400 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80090b0 tx=0x7fbcd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.229+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8011e60 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.229+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd801f070 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.229+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce015eb40 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.229+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd801a870 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.229+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce015f100 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.230+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce015f5e0 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.230+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbcd801ac20 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.231+0000 7fbcd6ffd700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbcc0067320 0x7fbcc00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.231+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbcd8021070 con 0x7fbce015db10 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.231+0000 7fbcdeffd700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbcc0067320 0x7fbcc00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.231+0000 7fbcdeffd700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbcc0067320 0x7fbcc00697d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0007740 tx=0x7fbcd00099d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.235+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcd8053820 con 0x7fbce015db10 2023-10-08T00:31:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.430+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbce004c3c0 con 0x7fbce015db10 2023-10-08T00:31:26.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.431+0000 7fbcd6ffd700 1 -- 172.21.15.22:0/3818801584 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbcd802b0a0 con 0x7fbce015db10 2023-10-08T00:31:26.433 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbcc0067320 msgr2=0x7fbcc00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbcc0067320 0x7fbcc00697d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0007740 tx=0x7fbcd00099d0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 msgr2=0x7fbce014c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce014c400 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80090b0 tx=0x7fbcd8017000 comp rx=0 tx=0).stop 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 shutdown_connections 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbce015db10 0x7fbce014c400 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbcc0067320 0x7fbcc00697d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbce0159890 0x7fbce015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 --2- 172.21.15.22:0/3818801584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0159c60 0x7fbce0152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 >> 172.21.15.22:0/3818801584 conn(0x7fbce0068e20 msgr2=0x7fbce01582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:26.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 shutdown_connections 2023-10-08T00:31:26.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.433+0000 7fbce530d700 1 -- 172.21.15.22:0/3818801584 wait complete. 2023-10-08T00:31:26.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:31:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.567+0000 7fbab69da700 1 Processor -- start 2023-10-08T00:31:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.567+0000 7fbab69da700 1 -- start start 2023-10-08T00:31:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab69da700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbab0159c60 0x7fbab015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab69da700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbab015db10 0x7fbab0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab69da700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab015a160 con 0x7fbab0159890 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab69da700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab015df50 con 0x7fbab015db10 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab69da700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab00d13a0 con 0x7fbab0159c60 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbab015db10 0x7fbab0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbab015db10 0x7fbab0069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50456/0 (socket says 172.21.15.22:50456) 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 -- 172.21.15.22:0/24281897 learned_addr learned my addr 172.21.15.22:0/24281897 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbaaf7fe700 1 --2- 172.21.15.22:0/24281897 >> v2:172.21.15.192:3300/0 conn(0x7fbab0159c60 0x7fbab015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 -- 172.21.15.22:0/24281897 >> v2:172.21.15.192:3300/0 conn(0x7fbab0159c60 msgr2=0x7fbab015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 --2- 172.21.15.22:0/24281897 >> v2:172.21.15.192:3300/0 conn(0x7fbab0159c60 0x7fbab015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 -- 172.21.15.22:0/24281897 >> v1:172.21.15.192:6789/0 conn(0x7fbab0159890 legacy=0x7fbab015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 -- 172.21.15.22:0/24281897 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab015e140 con 0x7fbab015db10 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbab4f77700 1 --2- 172.21.15.22:0/24281897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab015db10 0x7fbab0069560 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fbab00b67f0 tx=0x7fbaa8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe013eb20fa1695 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbaaeffd700 1 -- 172.21.15.22:0/24281897 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800b820 con 0x7fbab015db10 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbaaeffd700 1 -- 172.21.15.22:0/24281897 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa800b980 con 0x7fbab015db10 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.568+0000 7fbaaeffd700 1 -- 172.21.15.22:0/24281897 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800bd20 con 0x7fbab015db10 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 -- 172.21.15.22:0/24281897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab015db10 msgr2=0x7fbab0069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 --2- 172.21.15.22:0/24281897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab015db10 0x7fbab0069560 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fbab00b67f0 tx=0x7fbaa8009250 comp rx=0 tx=0).stop 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 -- 172.21.15.22:0/24281897 shutdown_connections 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 --2- 172.21.15.22:0/24281897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab015db10 0x7fbab0069560 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 --2- 172.21.15.22:0/24281897 >> v2:172.21.15.192:3300/0 conn(0x7fbab0159c60 0x7fbab015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 -- 172.21.15.22:0/24281897 >> 172.21.15.22:0/24281897 conn(0x7fbab0068e20 msgr2=0x7fbab00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 -- 172.21.15.22:0/24281897 shutdown_connections 2023-10-08T00:31:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.569+0000 7fbab69da700 1 -- 172.21.15.22:0/24281897 wait complete. 2023-10-08T00:31:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.570+0000 7fbab69da700 1 Processor -- start 2023-10-08T00:31:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.570+0000 7fbab69da700 1 -- start start 2023-10-08T00:31:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab69da700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 0x7fbab0140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab69da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab0159c60 0x7fbab00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab69da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab015db10 0x7fbab00b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab69da700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00b4010 con 0x7fbab0159890 2023-10-08T00:31:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab69da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00b1e60 con 0x7fbab015db10 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab69da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab00cd5e0 con 0x7fbab0159c60 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 0x7fbab0140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 0x7fbab0140c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50462/0 (socket says 172.21.15.22:50462) 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 -- 172.21.15.22:0/1778470796 learned_addr learned my addr 172.21.15.22:0/1778470796 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbab4f77700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab015db10 0x7fbab00b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaf7fe700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab0159c60 0x7fbab00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 -- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab0159c60 msgr2=0x7fbab00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab0159c60 0x7fbab00b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 -- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab015db10 msgr2=0x7fbab00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab015db10 0x7fbab00b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 -- 172.21.15.22:0/1778470796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80094f0 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.571+0000 7fbaaffff700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 0x7fbab0140c60 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000bbb0 tx=0x7fbaa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.572+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00092e0 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.572+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa000c630 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.572+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa000c9f0 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.572+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab00b15c0 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.572+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab01411a0 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.573+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab004c3c0 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.573+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbaa0012070 con 0x7fbab0159890 2023-10-08T00:31:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.573+0000 7fbaa7fff700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba90067320 0x7fba900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.574+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaa00848e0 con 0x7fbab0159890 2023-10-08T00:31:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.574+0000 7fbaaf7fe700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba90067320 0x7fba900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.574+0000 7fbaaf7fe700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba90067320 0x7fba900697d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbab00cad90 tx=0x7fba98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.578+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaa0051570 con 0x7fbab0159890 2023-10-08T00:31:26.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.772+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbab00b0120 con 0x7fbab0159890 2023-10-08T00:31:26.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.773+0000 7fbaa7fff700 1 -- 172.21.15.22:0/1778470796 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbaa0054b90 con 0x7fbab0159890 2023-10-08T00:31:26.775 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba90067320 msgr2=0x7fba900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba90067320 0x7fba900697d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbab00cad90 tx=0x7fba98008040 comp rx=0 tx=0).stop 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 msgr2=0x7fbab0140c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 0x7fbab0140c60 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbaa000bbb0 tx=0x7fbaa0009840 comp rx=0 tx=0).stop 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 shutdown_connections 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbab015db10 0x7fbab00b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbab0159890 0x7fbab0140c60 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fba90067320 0x7fba900697d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 --2- 172.21.15.22:0/1778470796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbab0159c60 0x7fbab00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 >> 172.21.15.22:0/1778470796 conn(0x7fbab0068e20 msgr2=0x7fbab0152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:26.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 shutdown_connections 2023-10-08T00:31:26.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.775+0000 7fbab69da700 1 -- 172.21.15.22:0/1778470796 wait complete. 2023-10-08T00:31:26.788 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:26.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.906+0000 7f1c0e7e3700 1 Processor -- start 2023-10-08T00:31:26.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.906+0000 7f1c0e7e3700 1 -- start start 2023-10-08T00:31:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0e7e3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 0x7f1c08159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0e7e3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c080cfe20 con 0x7f1c080b1e50 2023-10-08T00:31:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0e7e3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c080cf210 con 0x7f1c080ceaa0 2023-10-08T00:31:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0e7e3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080cf4f0 con 0x7f1c081593b0 2023-10-08T00:31:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0dfe2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1c080b1e50 0x7f1c080b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43112/0 (socket says 172.21.15.22:43112) 2023-10-08T00:31:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0dfe2700 1 -- 172.21.15.22:0/1749429029 learned_addr learned my addr 172.21.15.22:0/1749429029 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c0d7e1700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 0x7f1c08159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542761900 0 0) 0x7f1c080cfe20 con 0x7f1c080b1e50 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.907+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf0003570 con 0x7f1c080b1e50 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108093509 0 0) 0x7f1bf0003570 con 0x7f1c080b1e50 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 msgr2=0x7f1c08159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 0x7f1c08159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 >> v1:172.21.15.192:6789/0 conn(0x7f1c080ceaa0 legacy=0x7f1c080b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c080cf7d0 con 0x7f1c080b1e50 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f1bf8001470 con 0x7f1c080b1e50 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 >> v1:172.21.15.22:6789/0 conn(0x7f1c080b1e50 legacy=0x7f1c080b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 0x7f1bf0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1bf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf0004d50 0x7f1bf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c080cf4f0 con 0x7f1bf0004010 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0014400 con 0x7f1bf0004d50 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00145c0 con 0x7f1c081593b0 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1bf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0d7e1700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 0x7f1bf0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0dfe2700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf0004d50 0x7f1bf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 -- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 msgr2=0x7f1bf0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c081593b0 0x7f1bf0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 -- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf0004d50 msgr2=0x7f1bf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf0004d50 0x7f1bf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 -- 172.21.15.22:0/1749429029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0003570 con 0x7f1bf0004010 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.908+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1bf0004810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001880 tx=0x7f1bfc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d61d3494d667202 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc012420 con 0x7f1bf0004010 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc012580 con 0x7f1bf0004010 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c07fff700 1 -- 172.21.15.22:0/1749429029 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc012920 con 0x7f1bf0004010 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/1749429029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 msgr2=0x7f1bf0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/1749429029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1bf0004810 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc001880 tx=0x7f1bfc007d30 comp rx=0 tx=0).stop 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0dfe2700 1 -- 172.21.15.22:0/1749429029 reap_dead start 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/1749429029 shutdown_connections 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/1749429029 >> 172.21.15.22:0/1749429029 conn(0x7f1c080d1130 msgr2=0x7f1c080b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/1749429029 shutdown_connections 2023-10-08T00:31:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.909+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/1749429029 wait complete. 2023-10-08T00:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.910+0000 7f1c0e7e3700 1 Processor -- start 2023-10-08T00:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.910+0000 7f1c0e7e3700 1 -- start start 2023-10-08T00:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0e7e3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1c081690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0e7e3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c08166c80 0x7f1c081665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0e7e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c08152160 0x7f1c0815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0e7e3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0816a050 con 0x7f1bf0004010 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0e7e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0814b800 con 0x7f1c08152160 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0e7e3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c081697b0 con 0x7f1c08166c80 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0d7e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1c081690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0d7e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1c081690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50072/0 (socket says 172.21.15.22:50072) 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0d7e1700 1 -- 172.21.15.22:0/3224041470 learned_addr learned my addr 172.21.15.22:0/3224041470 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c08166c80 0x7f1c081665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.911+0000 7f1c0dfe2700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c08152160 0x7f1c0815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0d7e1700 1 -- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c08166c80 msgr2=0x7f1c081665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0d7e1700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c08166c80 0x7f1c081665c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0d7e1700 1 -- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c08152160 msgr2=0x7f1c0815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0d7e1700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c08152160 0x7f1c0815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0d7e1700 1 -- 172.21.15.22:0/3224041470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08169a90 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c08166c80 0x7f1c081665c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0dfe2700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c08152160 0x7f1c0815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0d7e1700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1c081690b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1c00011f80 tx=0x7f1c0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0000e040 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0000f040 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c08169d70 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c00015430 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.912+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c081525b0 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.913+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0804c3c0 con 0x7f1bf0004010 2023-10-08T00:31:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.913+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1c000157e0 con 0x7f1bf0004010 2023-10-08T00:31:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.914+0000 7f1c057fa700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bf4067320 0x7f1bf40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.914+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c00085b30 con 0x7f1bf0004010 2023-10-08T00:31:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.914+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bf4067320 0x7f1bf40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.914+0000 7f1c0cfe0700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bf4067320 0x7f1bf40697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc008fd0 tx=0x7f1bfc015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:26.918+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c000526b0 con 0x7f1bf0004010 2023-10-08T00:31:27.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.157+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c080cfab0 con 0x7f1bf0004010 2023-10-08T00:31:27.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.157+0000 7f1c057fa700 1 -- 172.21.15.22:0/3224041470 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f1c00055cd0 con 0x7f1bf0004010 2023-10-08T00:31:27.159 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:27.159 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:14.535940+0000","modified":"2023-10-08T00:31:18.152403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3654432591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3654432591},{"type":"v1","addr":"172.21.15.22:6835","nonce":3654432591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T00:31:27.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bf4067320 msgr2=0x7f1bf40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bf4067320 0x7f1bf40697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc008fd0 tx=0x7f1bfc015000 comp rx=0 tx=0).stop 2023-10-08T00:31:27.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 msgr2=0x7f1c081690b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1c081690b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1c00011f80 tx=0x7f1c0000b040 comp rx=0 tx=0).stop 2023-10-08T00:31:27.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 shutdown_connections 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c08152160 0x7f1c0815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bf0004010 0x7f1c081690b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bf4067320 0x7f1bf40697d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 --2- 172.21.15.22:0/3224041470 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1c08166c80 0x7f1c081665c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 >> 172.21.15.22:0/3224041470 conn(0x7f1c080d1130 msgr2=0x7f1c081499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 shutdown_connections 2023-10-08T00:31:27.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.159+0000 7f1c0e7e3700 1 -- 172.21.15.22:0/3224041470 wait complete. 2023-10-08T00:31:27.163 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 70 2023-10-08T00:31:27.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:27.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.291+0000 7f1bd7427700 1 Processor -- start 2023-10-08T00:31:27.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.291+0000 7f1bd7427700 1 -- start start 2023-10-08T00:31:27.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd7427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd01597f0 0x7f1bd00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd7427700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1bd015d230 0x7f1bd015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd7427700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd015dbd0 con 0x7f1bd0159420 2023-10-08T00:31:27.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd7427700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd00b11d0 con 0x7f1bd015d230 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd7427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00b14b0 con 0x7f1bd01597f0 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1bd015d230 0x7f1bd015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1bd015d230 0x7f1bd015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50074/0 (socket says 172.21.15.22:50074) 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 -- 172.21.15.22:0/240346801 learned_addr learned my addr 172.21.15.22:0/240346801 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd5c24700 1 --2- 172.21.15.22:0/240346801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd01597f0 0x7f1bd00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 -- 172.21.15.22:0/240346801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd01597f0 msgr2=0x7f1bd00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 --2- 172.21.15.22:0/240346801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd01597f0 0x7f1bd00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 -- 172.21.15.22:0/240346801 >> v1:172.21.15.192:6789/0 conn(0x7f1bd0159420 legacy=0x7f1bd00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.292+0000 7f1bd6c26700 1 -- 172.21.15.22:0/240346801 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00b1790 con 0x7f1bd015d230 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd6c26700 1 --2- 172.21.15.22:0/240346801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd015d690 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009f20 tx=0x7f1bc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6252fc92e37bb5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd5423700 1 -- 172.21.15.22:0/240346801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000e070 con 0x7f1bd015d230 2023-10-08T00:31:27.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd5423700 1 -- 172.21.15.22:0/240346801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc000ba80 con 0x7f1bd015d230 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd5423700 1 -- 172.21.15.22:0/240346801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00092e0 con 0x7f1bd015d230 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 -- 172.21.15.22:0/240346801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 msgr2=0x7f1bd015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 --2- 172.21.15.22:0/240346801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd015d690 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009f20 tx=0x7f1bc0009840 comp rx=0 tx=0).stop 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 -- 172.21.15.22:0/240346801 shutdown_connections 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 --2- 172.21.15.22:0/240346801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd015d690 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 --2- 172.21.15.22:0/240346801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd01597f0 0x7f1bd00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 -- 172.21.15.22:0/240346801 >> 172.21.15.22:0/240346801 conn(0x7f1bd00d0660 msgr2=0x7f1bd00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 -- 172.21.15.22:0/240346801 shutdown_connections 2023-10-08T00:31:27.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.293+0000 7f1bd7427700 1 -- 172.21.15.22:0/240346801 wait complete. 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.294+0000 7f1bd7427700 1 Processor -- start 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.294+0000 7f1bd7427700 1 -- start start 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd7427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd0159420 0x7f1bd016ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd7427700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd01597f0 0x7f1bd0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd7427700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd0154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd7427700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd016a6d0 con 0x7f1bd015d230 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd7427700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0157be0 con 0x7f1bd01597f0 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd7427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0157ec0 con 0x7f1bd0159420 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd6c26700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd0154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd6c26700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd0154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50078/0 (socket says 172.21.15.22:50078) 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd6c26700 1 -- 172.21.15.22:0/2545372318 learned_addr learned my addr 172.21.15.22:0/2545372318 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd6425700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd0159420 0x7f1bd016ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.295+0000 7f1bd5c24700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd01597f0 0x7f1bd0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd6c26700 1 -- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd0159420 msgr2=0x7f1bd016ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd6c26700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd0159420 0x7f1bd016ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd6c26700 1 -- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd01597f0 msgr2=0x7f1bd0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd6c26700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd01597f0 0x7f1bd0157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd6c26700 1 -- 172.21.15.22:0/2545372318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0009ae0 con 0x7f1bd015d230 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd6c26700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd0154250 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b6c0 tx=0x7f1bc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00032f0 con 0x7f1bd015d230 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc0008d20 con 0x7f1bd015d230 2023-10-08T00:31:27.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd016a080 con 0x7f1bd015d230 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0025670 con 0x7f1bd015d230 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.296+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd0157870 con 0x7f1bd015d230 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.297+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd016a880 con 0x7f1bd015d230 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.297+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1bc0003040 con 0x7f1bd015d230 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.298+0000 7f1bce7fc700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bbc067320 0x7f1bbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.298+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bc00869b0 con 0x7f1bd015d230 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.298+0000 7f1bd6425700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bbc067320 0x7f1bbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.298+0000 7f1bd6425700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bbc067320 0x7f1bbc0697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0155110 tx=0x7f1bc8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:27.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.302+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bd016a880 con 0x7f1bd015d230 2023-10-08T00:31:27.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.495+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bd004c3c0 con 0x7f1bd015d230 2023-10-08T00:31:27.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.496+0000 7f1bce7fc700 1 -- 172.21.15.22:0/2545372318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f1bc0053530 con 0x7f1bd015d230 2023-10-08T00:31:27.498 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:27.498 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":102,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:15.622465+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:12.943014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:13.503263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:27.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bbc067320 msgr2=0x7f1bbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bbc067320 0x7f1bbc0697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0155110 tx=0x7f1bc8009040 comp rx=0 tx=0).stop 2023-10-08T00:31:27.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 msgr2=0x7f1bd0154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd0154250 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b6c0 tx=0x7f1bc0018000 comp rx=0 tx=0).stop 2023-10-08T00:31:27.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 shutdown_connections 2023-10-08T00:31:27.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bd015d230 0x7f1bd0154250 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1bbc067320 0x7f1bbc0697d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bd0159420 0x7f1bd016ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 --2- 172.21.15.22:0/2545372318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd01597f0 0x7f1bd0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 >> 172.21.15.22:0/2545372318 conn(0x7f1bd00d0660 msgr2=0x7f1bd0155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:27.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 shutdown_connections 2023-10-08T00:31:27.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.498+0000 7f1bd7427700 1 -- 172.21.15.22:0/2545372318 wait complete. 2023-10-08T00:31:27.512 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:31:27.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:27.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.630+0000 7fb8472bf700 1 Processor -- start 2023-10-08T00:31:27.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.630+0000 7fb8472bf700 1 -- start start 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8472bf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8472bf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8401597f0 0x7fb8400b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8472bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb84015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8472bf700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84015dbb0 con 0x7fb840159420 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8472bf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400b11d0 con 0x7fb8401597f0 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8472bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b14b0 con 0x7fb84015d230 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50092/0 (socket says 172.21.15.22:50092) 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 -- 172.21.15.22:0/1014984899 learned_addr learned my addr 172.21.15.22:0/1014984899 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:27.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb846abe700 1 --2- 172.21.15.22:0/1014984899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb84015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb845abc700 1 --2- 172.21.15.22:0/1014984899 >> v2:172.21.15.192:3300/0 conn(0x7fb8401597f0 0x7fb8400b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 -- 172.21.15.22:0/1014984899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 msgr2=0x7fb84015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 --2- 172.21.15.22:0/1014984899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb84015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 -- 172.21.15.22:0/1014984899 >> v2:172.21.15.192:3300/0 conn(0x7fb8401597f0 msgr2=0x7fb8400b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 --2- 172.21.15.22:0/1014984899 >> v2:172.21.15.192:3300/0 conn(0x7fb8401597f0 0x7fb8400b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 -- 172.21.15.22:0/1014984899 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400b1790 con 0x7fb840159420 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb845abc700 1 --2- 172.21.15.22:0/1014984899 >> v2:172.21.15.192:3300/0 conn(0x7fb8401597f0 0x7fb8400b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.631+0000 7fb8462bd700 1 --2- 172.21.15.22:0/1014984899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400b5f40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb840089750 tx=0x7fb83c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72980d26eeb08010 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8452bb700 1 -- 172.21.15.22:0/1014984899 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00b860 con 0x7fb840159420 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8452bb700 1 -- 172.21.15.22:0/1014984899 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00b9c0 con 0x7fb840159420 2023-10-08T00:31:27.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8452bb700 1 -- 172.21.15.22:0/1014984899 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00bd60 con 0x7fb840159420 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 -- 172.21.15.22:0/1014984899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 msgr2=0x7fb8400b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 --2- 172.21.15.22:0/1014984899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400b5f40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fb840089750 tx=0x7fb83c009250 comp rx=0 tx=0).stop 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 -- 172.21.15.22:0/1014984899 shutdown_connections 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 --2- 172.21.15.22:0/1014984899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 --2- 172.21.15.22:0/1014984899 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb84015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 --2- 172.21.15.22:0/1014984899 >> v2:172.21.15.192:3300/0 conn(0x7fb8401597f0 0x7fb8400b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 -- 172.21.15.22:0/1014984899 >> 172.21.15.22:0/1014984899 conn(0x7fb8400d0660 msgr2=0x7fb8400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 -- 172.21.15.22:0/1014984899 shutdown_connections 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.632+0000 7fb8472bf700 1 -- 172.21.15.22:0/1014984899 wait complete. 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.633+0000 7fb8472bf700 1 Processor -- start 2023-10-08T00:31:27.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.633+0000 7fb8472bf700 1 -- start start 2023-10-08T00:31:27.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8472bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb840159420 0x7fb84014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8472bf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 0x7fb8401421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8472bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb840157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8472bf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84016a400 con 0x7fb8401597f0 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8472bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84015eed0 con 0x7fb840159420 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8472bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb840169ad0 con 0x7fb84015d230 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb845abc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 0x7fb8401421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb845abc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 0x7fb8401421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50098/0 (socket says 172.21.15.22:50098) 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb845abc700 1 -- 172.21.15.22:0/985042532 learned_addr learned my addr 172.21.15.22:0/985042532 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb8462bd700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb840159420 0x7fb84014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.634+0000 7fb846abe700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb840157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb845abc700 1 -- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 msgr2=0x7fb840157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb845abc700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb840157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb845abc700 1 -- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb840159420 msgr2=0x7fb84014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb845abc700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb840159420 0x7fb84014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb845abc700 1 -- 172.21.15.22:0/985042532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0094f0 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb845abc700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 0x7fb8401421b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb83000e8a0 tx=0x7fb830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830013410 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830013570 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb840169db0 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830013930 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.635+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb840169750 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.636+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84016a5b0 con 0x7fb8401597f0 2023-10-08T00:31:27.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.636+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb830013ca0 con 0x7fb8401597f0 2023-10-08T00:31:27.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.637+0000 7fb8367fc700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb824067320 0x7fb8240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:27.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.637+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8300849a0 con 0x7fb8401597f0 2023-10-08T00:31:27.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.637+0000 7fb8462bd700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb824067320 0x7fb8240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:27.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.637+0000 7fb8462bd700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb824067320 0x7fb8240697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb840089750 tx=0x7fb83c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:27.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.641+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb84016a5b0 con 0x7fb8401597f0 2023-10-08T00:31:27.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.878+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb84004c3c0 con 0x7fb8401597f0 2023-10-08T00:31:27.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.879+0000 7fb8367fc700 1 -- 172.21.15.22:0/985042532 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fb83005a070 con 0x7fb8401597f0 2023-10-08T00:31:27.881 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:27.881 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:14.535940+0000","modified":"2023-10-08T00:31:18.152403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3654432591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3654432591},{"type":"v1","addr":"172.21.15.22:6835","nonce":3654432591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb824067320 msgr2=0x7fb8240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb824067320 0x7fb8240697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb840089750 tx=0x7fb83c017000 comp rx=0 tx=0).stop 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 msgr2=0x7fb8401421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 0x7fb8401421b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fb83000e8a0 tx=0x7fb830008040 comp rx=0 tx=0).stop 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 shutdown_connections 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb824067320 0x7fb8240697d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb840157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb840159420 0x7fb84014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 --2- 172.21.15.22:0/985042532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8401597f0 0x7fb8401421b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 >> 172.21.15.22:0/985042532 conn(0x7fb8400d0660 msgr2=0x7fb8400ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 shutdown_connections 2023-10-08T00:31:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:27.881+0000 7fb8472bf700 1 -- 172.21.15.22:0/985042532 wait complete. 2023-10-08T00:31:27.884 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 70 2023-10-08T00:31:27.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:28.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.012+0000 7ff2d84ed700 1 Processor -- start 2023-10-08T00:31:28.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.012+0000 7ff2d84ed700 1 -- start start 2023-10-08T00:31:28.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.013+0000 7ff2d84ed700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2d0159c60 0x7ff2d015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.013+0000 7ff2d84ed700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d015a160 con 0x7ff2d015db10 2023-10-08T00:31:28.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.013+0000 7ff2d84ed700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d00d13a0 con 0x7ff2d0159890 2023-10-08T00:31:28.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.013+0000 7ff2d84ed700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d015df50 con 0x7ff2d0159c60 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.013+0000 7ff2d6a8a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff2d015db10 0x7ff2d0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43124/0 (socket says 172.21.15.22:43124) 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.013+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/3922033996 learned_addr learned my addr 172.21.15.22:0/3922033996 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5a88700 1 --2- 172.21.15.22:0/3922033996 >> v2:172.21.15.192:3300/0 conn(0x7ff2d0159c60 0x7ff2d015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116974029 0 0) 0x7ff2d015a160 con 0x7ff2d015db10 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2bc003570 con 0x7ff2d015db10 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421658169 0 0) 0x7ff2bc003570 con 0x7ff2d015db10 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 >> v2:172.21.15.192:3300/0 conn(0x7ff2d0159c60 msgr2=0x7ff2d015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 --2- 172.21.15.22:0/3922033996 >> v2:172.21.15.192:3300/0 conn(0x7ff2d0159c60 0x7ff2d015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 >> v1:172.21.15.192:6789/0 conn(0x7ff2d0159890 legacy=0x7ff2d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d015e140 con 0x7ff2d015db10 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7ff2c80017f0 con 0x7ff2d015db10 2023-10-08T00:31:28.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 >> v1:172.21.15.22:6789/0 conn(0x7ff2d015db10 legacy=0x7ff2d0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc003a60 0x7ff2bc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2bc004810 0x7ff2bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2bc0051c0 0x7ff2bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc00c0a0 con 0x7ff2bc0051c0 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc00c210 con 0x7ff2bc003a60 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc00c3d0 con 0x7ff2bc004810 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2bc0051c0 0x7ff2bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d5a88700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2bc004810 0x7ff2bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.014+0000 7ff2d6289700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc003a60 0x7ff2bc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2bc004810 msgr2=0x7ff2bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2bc004810 0x7ff2bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc003a60 msgr2=0x7ff2bc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc003a60 0x7ff2bc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/3922033996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc003570 con 0x7ff2bc0051c0 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/3922033996 reap_dead start 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2bc0051c0 0x7ff2bc00ba60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800a930 tx=0x7ff2c80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10ddd28a6305999 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80070d0 con 0x7ff2bc0051c0 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c8007230 con 0x7ff2bc0051c0 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d5287700 1 -- 172.21.15.22:0/3922033996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80075d0 con 0x7ff2bc0051c0 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d84ed700 1 -- 172.21.15.22:0/3922033996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2bc0051c0 msgr2=0x7ff2bc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.015+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2bc0051c0 0x7ff2bc00ba60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800a930 tx=0x7ff2c80021d0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.016+0000 7ff2d84ed700 1 -- 172.21.15.22:0/3922033996 shutdown_connections 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.016+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/3922033996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2bc0051c0 0x7ff2bc00ba60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.016+0000 7ff2d84ed700 1 -- 172.21.15.22:0/3922033996 >> 172.21.15.22:0/3922033996 conn(0x7ff2d0068e20 msgr2=0x7ff2d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:28.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.016+0000 7ff2d84ed700 1 -- 172.21.15.22:0/3922033996 shutdown_connections 2023-10-08T00:31:28.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.016+0000 7ff2d84ed700 1 -- 172.21.15.22:0/3922033996 wait complete. 2023-10-08T00:31:28.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 Processor -- start 2023-10-08T00:31:28.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 -- start start 2023-10-08T00:31:28.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc0051c0 0x7ff2d01525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2d01516f0 0x7ff2d015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 0x7ff2d015d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00cd160 con 0x7ff2d015cd80 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0152df0 con 0x7ff2bc0051c0 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d84ed700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00cd400 con 0x7ff2d01516f0 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d6a8a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 0x7ff2d015d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.017+0000 7ff2d6a8a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 0x7ff2d015d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50122/0 (socket says 172.21.15.22:50122) 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/2400389595 learned_addr learned my addr 172.21.15.22:0/2400389595 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6289700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc0051c0 0x7ff2d01525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d5a88700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2d01516f0 0x7ff2d015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2d01516f0 msgr2=0x7ff2d015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2d01516f0 0x7ff2d015c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc0051c0 msgr2=0x7ff2d01525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc0051c0 0x7ff2d01525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 -- 172.21.15.22:0/2400389595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00cd6e0 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d6a8a700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 0x7ff2d015d200 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8000f80 tx=0x7ff2c8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c801d420 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c801d5a0 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c801d960 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d0152b10 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.018+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d014d7d0 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.019+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d00cd920 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.019+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff2c8026400 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.020+0000 7ff2c67fc700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff2b4067320 0x7ff2b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.020+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2c80870e0 con 0x7ff2d015cd80 2023-10-08T00:31:28.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.020+0000 7ff2d6289700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff2b4067320 0x7ff2b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.020+0000 7ff2d6289700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff2b4067320 0x7ff2b40697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc007e40 tx=0x7ff2cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.024+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2d00cd920 con 0x7ff2d015cd80 2023-10-08T00:31:28.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.263+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2d00cd920 con 0x7ff2d015cd80 2023-10-08T00:31:28.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.263+0000 7ff2c67fc700 1 -- 172.21.15.22:0/2400389595 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4605 (secure 0 0 0) 0x7ff2d00cd920 con 0x7ff2d015cd80 2023-10-08T00:31:28.265 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:28.265 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":70,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:14.535940+0000","modified":"2023-10-08T00:31:18.152403+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6858},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6858":{"gid":6858,"name":"a","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/3654432591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3654432591},{"type":"v1","addr":"172.21.15.22:6835","nonce":3654432591}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T00:31:28.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff2b4067320 msgr2=0x7ff2b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff2b4067320 0x7ff2b40697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc007e40 tx=0x7ff2cc009040 comp rx=0 tx=0).stop 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 msgr2=0x7ff2d015d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 0x7ff2d015d200 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8000f80 tx=0x7ff2c8016000 comp rx=0 tx=0).stop 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 shutdown_connections 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2d015cd80 0x7ff2d015d200 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2bc0051c0 0x7ff2d01525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff2b4067320 0x7ff2b40697d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 --2- 172.21.15.22:0/2400389595 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2d01516f0 0x7ff2d015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 >> 172.21.15.22:0/2400389595 conn(0x7ff2d0068e20 msgr2=0x7ff2d00d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 shutdown_connections 2023-10-08T00:31:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.266+0000 7ff2d84ed700 1 -- 172.21.15.22:0/2400389595 wait complete. 2023-10-08T00:31:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 70 2023-10-08T00:31:28.279 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:28.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.396+0000 7f3da2b2d700 1 Processor -- start 2023-10-08T00:31:28.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.397+0000 7f3da2b2d700 1 -- start start 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.397+0000 7f3da2b2d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d9c159890 0x7f3d9c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.397+0000 7f3da2b2d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3d9c159c60 0x7f3d9c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.397+0000 7f3da2b2d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9c15a160 con 0x7f3d9c15db10 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.397+0000 7f3da2b2d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c15df50 con 0x7f3d9c159c60 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.397+0000 7f3da2b2d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d9c0d13a0 con 0x7f3d9c159890 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3da10ca700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3d9c15db10 0x7f3d9c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43132/0 (socket says 172.21.15.22:43132) 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3d9c159c60 0x7f3d9c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3da10ca700 1 -- 172.21.15.22:0/1720896528 learned_addr learned my addr 172.21.15.22:0/1720896528 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3da08c9700 1 --2- 172.21.15.22:0/1720896528 >> v2:172.21.15.192:3300/0 conn(0x7f3d9c159890 0x7f3d9c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9b7fe700 1 -- 172.21.15.22:0/1720896528 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196502179 0 0) 0x7f3d9c15a160 con 0x7f3d9c15db10 2023-10-08T00:31:28.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9b7fe700 1 -- 172.21.15.22:0/1720896528 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d88003570 con 0x7f3d9c15db10 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1720896528 >> v2:172.21.15.192:3300/0 conn(0x7f3d9c159890 msgr2=0x7f3d9c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9bfff700 1 --2- 172.21.15.22:0/1720896528 >> v2:172.21.15.192:3300/0 conn(0x7f3d9c159890 0x7f3d9c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1720896528 >> v1:172.21.15.22:6789/0 conn(0x7f3d9c15db10 legacy=0x7f3d9c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1720896528 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c15e140 con 0x7f3d9c159c60 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9bfff700 1 --2- 172.21.15.22:0/1720896528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c15d5d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0d1090 tx=0x7f3d840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d18803db2b6947c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9b7fe700 1 -- 172.21.15.22:0/1720896528 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011630 con 0x7f3d9c159c60 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9b7fe700 1 -- 172.21.15.22:0/1720896528 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d840117b0 con 0x7f3d9c159c60 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.398+0000 7f3d9b7fe700 1 -- 172.21.15.22:0/1720896528 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011b70 con 0x7f3d9c159c60 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1720896528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 msgr2=0x7f3d9c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1720896528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c15d5d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0d1090 tx=0x7f3d840091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1720896528 shutdown_connections 2023-10-08T00:31:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1720896528 >> v2:172.21.15.192:3300/0 conn(0x7f3d9c159890 0x7f3d9c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1720896528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c15d5d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1720896528 >> 172.21.15.22:0/1720896528 conn(0x7f3d9c068e20 msgr2=0x7f3d9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1720896528 shutdown_connections 2023-10-08T00:31:28.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.399+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1720896528 wait complete. 2023-10-08T00:31:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.400+0000 7f3da2b2d700 1 Processor -- start 2023-10-08T00:31:28.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.400+0000 7f3da2b2d700 1 -- start start 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da2b2d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d9c159890 0x7f3d9c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da2b2d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da2b2d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d9c15db10 0x7f3d9c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da2b2d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0b40f0 con 0x7f3d9c159c60 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da2b2d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0ca880 con 0x7f3d9c159890 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da2b2d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c0c9c70 con 0x7f3d9c15db10 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c0c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50134/0 (socket says 172.21.15.22:50134) 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1558487749 learned_addr learned my addr 172.21.15.22:0/1558487749 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da08c9700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d9c159890 0x7f3d9c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da10ca700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d9c15db10 0x7f3d9c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d9c15db10 msgr2=0x7f3d9c0c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d9c15db10 0x7f3d9c0c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d9c159890 msgr2=0x7f3d9c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d9c159890 0x7f3d9c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3d9bfff700 1 -- 172.21.15.22:0/1558487749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84009420 con 0x7f3d9c159c60 2023-10-08T00:31:28.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.401+0000 7f3da10ca700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d9c15db10 0x7f3d9c0c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.402+0000 7f3d9bfff700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c0c78a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3d84013000 tx=0x7f3d84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.402+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8401f070 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.402+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84000bc0 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.402+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84011b70 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.402+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9c0c9f50 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.402+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9c0ca510 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.403+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9c04c3c0 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.403+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3d84023070 con 0x7f3d9c159c60 2023-10-08T00:31:28.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.404+0000 7f3d98ff9700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d7c067320 0x7f3d7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.404+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d84085fc0 con 0x7f3d9c159c60 2023-10-08T00:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.404+0000 7f3da08c9700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d7c067320 0x7f3d7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.404+0000 7f3da08c9700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d7c067320 0x7f3d7c0697d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400f570 tx=0x7f3d9400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.408+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d84052c10 con 0x7f3d9c159c60 2023-10-08T00:31:28.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.601+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d9c06a5b0 con 0x7f3d9c159c60 2023-10-08T00:31:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.601+0000 7f3d98ff9700 1 -- 172.21.15.22:0/1558487749 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f3d8402a090 con 0x7f3d9c159c60 2023-10-08T00:31:28.603 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:28.603 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":102,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:15.622465+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:12.943014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:13.503263+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d7c067320 msgr2=0x7f3d7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d7c067320 0x7f3d7c0697d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400f570 tx=0x7f3d9400b040 comp rx=0 tx=0).stop 2023-10-08T00:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 msgr2=0x7f3d9c0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c0c78a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f3d84013000 tx=0x7f3d84017000 comp rx=0 tx=0).stop 2023-10-08T00:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 shutdown_connections 2023-10-08T00:31:28.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d7c067320 0x7f3d7c0697d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d9c15db10 0x7f3d9c0c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d9c159890 0x7f3d9c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 --2- 172.21.15.22:0/1558487749 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d9c159c60 0x7f3d9c0c78a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.603+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 >> 172.21.15.22:0/1558487749 conn(0x7f3d9c068e20 msgr2=0x7f3d9c15b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.604+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 shutdown_connections 2023-10-08T00:31:28.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.604+0000 7f3da2b2d700 1 -- 172.21.15.22:0/1558487749 wait complete. 2023-10-08T00:31:28.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:31:28.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.736+0000 7fcff30f5700 1 Processor -- start 2023-10-08T00:31:28.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff30f5700 1 -- start start 2023-10-08T00:31:28.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff30f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec159c60 0x7fcfec15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff30f5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcfec15db10 0x7fcfec069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff30f5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec15a160 con 0x7fcfec159890 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff30f5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec0d13a0 con 0x7fcfec15db10 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff30f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec15e140 con 0x7fcfec159c60 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff0e91700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcfec159890 0x7fcfec15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43144/0 (socket says 172.21.15.22:43144) 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.737+0000 7fcff0e91700 1 -- 172.21.15.22:0/156427208 learned_addr learned my addr 172.21.15.22:0/156427208 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfebfff700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec159c60 0x7fcfec15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcff1692700 1 --2- 172.21.15.22:0/156427208 >> v2:172.21.15.192:3300/0 conn(0x7fcfec15db10 0x7fcfec069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344774234 0 0) 0x7fcfec15a160 con 0x7fcfec159890 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfd4003570 con 0x7fcfec159890 2023-10-08T00:31:28.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1770394430 0 0) 0x7fcfd4003570 con 0x7fcfec159890 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec159c60 msgr2=0x7fcfec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec159c60 0x7fcfec15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 >> v2:172.21.15.192:3300/0 conn(0x7fcfec15db10 msgr2=0x7fcfec069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/156427208 >> v2:172.21.15.192:3300/0 conn(0x7fcfec15db10 0x7fcfec069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec15a3d0 con 0x7fcfec159890 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fcfdc001470 con 0x7fcfec159890 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 >> v1:172.21.15.22:6789/0 conn(0x7fcfec159890 legacy=0x7fcfec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfd4003a60 0x7fcfd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfd4004810 0x7fcfd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfd40051c0 0x7fcfd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0d13a0 con 0x7fcfd40051c0 2023-10-08T00:31:28.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec15e140 con 0x7fcfd4003a60 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd400bfa0 con 0x7fcfd4004810 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfebfff700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec159c60 0x7fcfec15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcff1692700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfd40051c0 0x7fcfd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcff0e91700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfd4003a60 0x7fcfd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.738+0000 7fcfebfff700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfd4004810 0x7fcfd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 -- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfd4004810 msgr2=0x7fcfd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfd4004810 0x7fcfd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 -- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfd4003a60 msgr2=0x7fcfd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfd4003a60 0x7fcfd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 -- 172.21.15.22:0/156427208 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4003570 con 0x7fcfd40051c0 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfd40051c0 0x7fcfd400ba60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400e210 tx=0x7fcfe400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cef46a54e5388dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400eac0 con 0x7fcfd40051c0 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400f040 con 0x7fcfd40051c0 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcfeb7fe700 1 -- 172.21.15.22:0/156427208 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400ee70 con 0x7fcfd40051c0 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff30f5700 1 -- 172.21.15.22:0/156427208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfd40051c0 msgr2=0x7fcfd400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff30f5700 1 --2- 172.21.15.22:0/156427208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfd40051c0 0x7fcfd400ba60 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400e210 tx=0x7fcfe400b040 comp rx=0 tx=0).stop 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff1692700 1 -- 172.21.15.22:0/156427208 reap_dead start 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff30f5700 1 -- 172.21.15.22:0/156427208 shutdown_connections 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff30f5700 1 -- 172.21.15.22:0/156427208 >> 172.21.15.22:0/156427208 conn(0x7fcfec068e20 msgr2=0x7fcfec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff30f5700 1 -- 172.21.15.22:0/156427208 shutdown_connections 2023-10-08T00:31:28.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.739+0000 7fcff30f5700 1 -- 172.21.15.22:0/156427208 wait complete. 2023-10-08T00:31:28.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.741+0000 7fcff30f5700 1 Processor -- start 2023-10-08T00:31:28.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.741+0000 7fcff30f5700 1 -- start start 2023-10-08T00:31:28.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec168f60 0x7fcfec0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 0x7fcfec16cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfec0cd670 0x7fcfec16d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec154510 con 0x7fcfec169330 2023-10-08T00:31:28.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1547f0 con 0x7fcfec0cd670 2023-10-08T00:31:28.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec154ad0 con 0x7fcfec168f60 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 0x7fcfec16cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 0x7fcfec16cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50150/0 (socket says 172.21.15.22:50150) 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 -- 172.21.15.22:0/2363223260 learned_addr learned my addr 172.21.15.22:0/2363223260 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff0e91700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec168f60 0x7fcfec0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff1692700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfec0cd670 0x7fcfec16d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 -- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec168f60 msgr2=0x7fcfec0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec168f60 0x7fcfec0cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 -- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfec0cd670 msgr2=0x7fcfec16d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfec0cd670 0x7fcfec16d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 -- 172.21.15.22:0/2363223260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec154db0 con 0x7fcfec169330 2023-10-08T00:31:28.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff1692700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfec0cd670 0x7fcfec16d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfebfff700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 0x7fcfec16cc90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0011940 tx=0x7fcfe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0015670 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe00157d0 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec155090 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.742+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0015b90 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.743+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec158a50 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.743+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec155400 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.744+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcfe000f470 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.744+0000 7fcfe8ff9700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcfd8067320 0x7fcfd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.744+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcfe0085410 con 0x7fcfec169330 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.744+0000 7fcff0e91700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcfd8067320 0x7fcfd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:28.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.745+0000 7fcff0e91700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcfd8067320 0x7fcfd80697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0079e0 tx=0x7fcfdc001e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:28.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.749+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfe0052150 con 0x7fcfec169330 2023-10-08T00:31:28.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.986+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcfec04c3c0 con 0x7fcfec169330 2023-10-08T00:31:28.988 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:31:28.987+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:31:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.991+0000 7fcfe8ff9700 1 -- 172.21.15.22:0/2363223260 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcfe0055770 con 0x7fcfec169330 2023-10-08T00:31:28.993 INFO:tasks.ceph.mds.a.smithi022.stderr: -770> 2023-10-08T00:31:20.627+0000 7f274ee12700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcfd8067320 msgr2=0x7fcfd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcfd8067320 0x7fcfd80697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0079e0 tx=0x7fcfdc001e90 comp rx=0 tx=0).stop 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 msgr2=0x7fcfec16cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 0x7fcfec16cc90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0011940 tx=0x7fcfe0008040 comp rx=0 tx=0).stop 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 shutdown_connections 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfec0cd670 0x7fcfec16d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcfd8067320 0x7fcfd80697d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcfec168f60 0x7fcfec0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 --2- 172.21.15.22:0/2363223260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcfec169330 0x7fcfec16cc90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 >> 172.21.15.22:0/2363223260 conn(0x7fcfec068e20 msgr2=0x7fcfec15aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 shutdown_connections 2023-10-08T00:31:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:28.993+0000 7fcff30f5700 1 -- 172.21.15.22:0/2363223260 wait complete. 2023-10-08T00:31:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:31:29.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:31:29.019 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:31:29.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.132+0000 7f1f4f025700 1 Processor -- start 2023-10-08T00:31:29.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.132+0000 7f1f4f025700 1 -- start start 2023-10-08T00:31:29.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f4f025700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1f48156690 0x7f1f480ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f4f025700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f480af480 0x7f1f480694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f4f025700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f48157e30 con 0x7f1f48156a60 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f4f025700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4806aa00 con 0x7f1f480af480 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f4f025700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f480699e0 con 0x7f1f48156690 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f480af480 0x7f1f480694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f480af480 0x7f1f480694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50176/0 (socket says 172.21.15.22:50176) 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 -- 172.21.15.22:0/2232000785 learned_addr learned my addr 172.21.15.22:0/2232000785 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f4cdc1700 1 --2- 172.21.15.22:0/2232000785 >> v2:172.21.15.192:3300/0 conn(0x7f1f48156690 0x7f1f480ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 -- 172.21.15.22:0/2232000785 >> v2:172.21.15.192:3300/0 conn(0x7f1f48156690 msgr2=0x7f1f480ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 --2- 172.21.15.22:0/2232000785 >> v2:172.21.15.192:3300/0 conn(0x7f1f48156690 0x7f1f480ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 -- 172.21.15.22:0/2232000785 >> v1:172.21.15.192:6789/0 conn(0x7f1f48156a60 legacy=0x7f1f480c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 -- 172.21.15.22:0/2232000785 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f481578b0 con 0x7f1f480af480 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.133+0000 7f1f47fff700 1 --2- 172.21.15.22:0/2232000785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f480af480 0x7f1f480694a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f1f480c97d0 tx=0x7f1f34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5d51344989d1ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f477fe700 1 -- 172.21.15.22:0/2232000785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34009e70 con 0x7f1f480af480 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f477fe700 1 -- 172.21.15.22:0/2232000785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400b860 con 0x7f1f480af480 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f477fe700 1 -- 172.21.15.22:0/2232000785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400bc20 con 0x7f1f480af480 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 -- 172.21.15.22:0/2232000785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f480af480 msgr2=0x7f1f480694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 --2- 172.21.15.22:0/2232000785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f480af480 0x7f1f480694a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f1f480c97d0 tx=0x7f1f34009250 comp rx=0 tx=0).stop 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 -- 172.21.15.22:0/2232000785 shutdown_connections 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 --2- 172.21.15.22:0/2232000785 >> v2:172.21.15.192:3300/0 conn(0x7f1f48156690 0x7f1f480ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 --2- 172.21.15.22:0/2232000785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f480af480 0x7f1f480694a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 -- 172.21.15.22:0/2232000785 >> 172.21.15.22:0/2232000785 conn(0x7f1f480c9870 msgr2=0x7f1f480c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:29.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 -- 172.21.15.22:0/2232000785 shutdown_connections 2023-10-08T00:31:29.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.134+0000 7f1f4f025700 1 -- 172.21.15.22:0/2232000785 wait complete. 2023-10-08T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.135+0000 7f1f4f025700 1 Processor -- start 2023-10-08T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.135+0000 7f1f4f025700 1 -- start start 2023-10-08T00:31:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4f025700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f480af480 0x7f1f481537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4f025700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f48156690 0x7f1f480c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4f025700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 0x7f1f480cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4f025700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48167ad0 con 0x7f1f48156a60 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4f025700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480c52f0 con 0x7f1f480af480 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4f025700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f480c55d0 con 0x7f1f48156690 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4d5c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 0x7f1f480cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4d5c2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 0x7f1f480cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50180/0 (socket says 172.21.15.22:50180) 2023-10-08T00:31:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4d5c2700 1 -- 172.21.15.22:0/4143869593 learned_addr learned my addr 172.21.15.22:0/4143869593 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f4cdc1700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f480af480 0x7f1f481537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.136+0000 7f1f47fff700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f48156690 0x7f1f480c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4d5c2700 1 -- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f48156690 msgr2=0x7f1f480c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4d5c2700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f48156690 0x7f1f480c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4d5c2700 1 -- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f480af480 msgr2=0x7f1f481537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4d5c2700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f480af480 0x7f1f481537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4d5c2700 1 -- 172.21.15.22:0/4143869593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340094f0 con 0x7f1f48156a60 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4cdc1700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f480af480 0x7f1f481537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4d5c2700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 0x7f1f480cb740 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c8e0 tx=0x7f1f40001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40012630 con 0x7f1f48156a60 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f40012790 con 0x7f1f48156a60 2023-10-08T00:31:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f480c58b0 con 0x7f1f48156a60 2023-10-08T00:31:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40012b50 con 0x7f1f48156a60 2023-10-08T00:31:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.137+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f48153d30 con 0x7f1f48156a60 2023-10-08T00:31:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.138+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f48167c50 con 0x7f1f48156a60 2023-10-08T00:31:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.138+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1f4001a3a0 con 0x7f1f48156a60 2023-10-08T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.139+0000 7f1f44ff9700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f2c067320 0x7f1f2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.139+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f1f40084e40 con 0x7f1f48156a60 2023-10-08T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.139+0000 7f1f4cdc1700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f2c067320 0x7f1f2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.139+0000 7f1f4cdc1700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f2c067320 0x7f1f2c0697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c011480 tx=0x7f1f3c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:29.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.143+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f48167c50 con 0x7f1f48156a60 2023-10-08T00:31:29.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.383+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1f48167c50 con 0x7f1f48156a60 2023-10-08T00:31:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.991+0000 7f1f44ff9700 1 -- 172.21.15.22:0/4143869593 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1f48167c50 con 0x7f1f48156a60 2023-10-08T00:31:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f2c067320 msgr2=0x7f1f2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f2c067320 0x7f1f2c0697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c011480 tx=0x7f1f3c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 msgr2=0x7f1f480cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 0x7f1f480cb740 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000c8e0 tx=0x7f1f40001710 comp rx=0 tx=0).stop 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 shutdown_connections 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f48156a60 0x7f1f480cb740 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f480af480 0x7f1f481537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f2c067320 0x7f1f2c0697d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 --2- 172.21.15.22:0/4143869593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f48156690 0x7f1f480c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 >> 172.21.15.22:0/4143869593 conn(0x7f1f480c9870 msgr2=0x7f1f481556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 shutdown_connections 2023-10-08T00:31:29.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:29.995+0000 7f1f4f025700 1 -- 172.21.15.22:0/4143869593 wait complete. 2023-10-08T00:31:30.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:31:30.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.183+0000 7f25753e0700 1 Processor -- start 2023-10-08T00:31:30.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.183+0000 7f25753e0700 1 -- start start 2023-10-08T00:31:30.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f25753e0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25700b03c0 0x7f25700cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:30.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f25753e0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700cfa00 con 0x7f25700b0790 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f25753e0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700cb580 con 0x7f25701591e0 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f25753e0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700cf160 con 0x7f25700b03c0 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f256f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f25700b0790 0x7f25700b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43148/0 (socket says 172.21.15.22:43148) 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f256f7fe700 1 -- 172.21.15.22:0/3694696240 learned_addr learned my addr 172.21.15.22:0/3694696240 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.184+0000 7f256ffff700 1 --2- 172.21.15.22:0/3694696240 >> v2:172.21.15.192:3300/0 conn(0x7f25700b03c0 0x7f25700cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884630813 0 0) 0x7f25700cfa00 con 0x7f25700b0790 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f255c003570 con 0x7f25700b0790 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765198627 0 0) 0x7f25700cb580 con 0x7f25701591e0 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25700cfa00 con 0x7f25701591e0 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256ffff700 1 -- 172.21.15.22:0/3694696240 >> v1:172.21.15.192:6789/0 conn(0x7f25701591e0 legacy=0x7f2570159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256ffff700 1 -- 172.21.15.22:0/3694696240 >> v1:172.21.15.22:6789/0 conn(0x7f25700b0790 legacy=0x7f25700b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2326601252 0 0) 0x7f255c003570 con 0x7f25700b0790 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256ffff700 1 -- 172.21.15.22:0/3694696240 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700cf440 con 0x7f25700b03c0 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256ffff700 1 --2- 172.21.15.22:0/3694696240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f25700cea70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2558009910 tx=0x7f25580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebae9e677b8c844e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560001470 con 0x7f25700b03c0 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558011420 con 0x7f25700b03c0 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.185+0000 7f256effd700 1 -- 172.21.15.22:0/3694696240 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580117c0 con 0x7f25700b03c0 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 -- 172.21.15.22:0/3694696240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 msgr2=0x7f25700cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 --2- 172.21.15.22:0/3694696240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f25700cea70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2558009910 tx=0x7f25580091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 -- 172.21.15.22:0/3694696240 shutdown_connections 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 --2- 172.21.15.22:0/3694696240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f25700cea70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 -- 172.21.15.22:0/3694696240 >> 172.21.15.22:0/3694696240 conn(0x7f2570063230 msgr2=0x7f2570063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 -- 172.21.15.22:0/3694696240 shutdown_connections 2023-10-08T00:31:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.186+0000 7f25753e0700 1 -- 172.21.15.22:0/3694696240 wait complete. 2023-10-08T00:31:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.187+0000 7f25753e0700 1 Processor -- start 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.187+0000 7f25753e0700 1 -- start start 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f25753e0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f2570157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f25753e0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25700b0790 0x7f257015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f25753e0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 0x7f25700c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f25753e0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700b37d0 con 0x7f25701591e0 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f25753e0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700c5aa0 con 0x7f25700b03c0 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f25753e0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700c5d80 con 0x7f25700b0790 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f2574bdf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 0x7f25700c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f2574bdf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 0x7f25700c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50192/0 (socket says 172.21.15.22:50192) 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f2574bdf700 1 -- 172.21.15.22:0/1178411380 learned_addr learned my addr 172.21.15.22:0/1178411380 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:30.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f256ffff700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f2570157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.188+0000 7f256f7fe700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25700b0790 0x7f257015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2574bdf700 1 -- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25700b0790 msgr2=0x7f257015a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2574bdf700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25700b0790 0x7f257015a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2574bdf700 1 -- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 msgr2=0x7f2570157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2574bdf700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f2570157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2574bdf700 1 -- 172.21.15.22:0/1178411380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558009420 con 0x7f25701591e0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2574bdf700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 0x7f25700c6940 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f256800c860 tx=0x7f2568002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568002030 con 0x7f25701591e0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25680021b0 con 0x7f25701591e0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25700c6060 con 0x7f25701591e0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568012630 con 0x7f25701591e0 2023-10-08T00:31:30.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.189+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2570158210 con 0x7f25701591e0 2023-10-08T00:31:30.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.190+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25700b3980 con 0x7f25701591e0 2023-10-08T00:31:30.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.190+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f25680129e0 con 0x7f25701591e0 2023-10-08T00:31:30.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.191+0000 7f2567fff700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2550067320 0x7f25500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:30.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.191+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2568084bb0 con 0x7f25701591e0 2023-10-08T00:31:30.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.191+0000 7f256ffff700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2550067320 0x7f25500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:30.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.192+0000 7f256ffff700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2550067320 0x7f25500697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f25580093f0 tx=0x7f2558016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.195+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25700b3980 con 0x7f25701591e0 2023-10-08T00:31:30.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.388+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25700b3980 con 0x7f25701591e0 2023-10-08T00:31:30.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:30.996+0000 7f2567fff700 1 -- 172.21.15.22:0/1178411380 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 181+0+0 (secure 0 0 0) 0x7f25700b3980 con 0x7f25701591e0 2023-10-08T00:31:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2550067320 msgr2=0x7f25500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2550067320 0x7f25500697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f25580093f0 tx=0x7f2558016000 comp rx=0 tx=0).stop 2023-10-08T00:31:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 msgr2=0x7f25700c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 0x7f25700c6940 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f256800c860 tx=0x7f2568002700 comp rx=0 tx=0).stop 2023-10-08T00:31:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 shutdown_connections 2023-10-08T00:31:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25701591e0 0x7f25700c6940 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25700b03c0 0x7f2570157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2550067320 0x7f25500697d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 --2- 172.21.15.22:0/1178411380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25700b0790 0x7f257015a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 >> 172.21.15.22:0/1178411380 conn(0x7f2570063230 msgr2=0x7f2570069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 shutdown_connections 2023-10-08T00:31:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.000+0000 7f25753e0700 1 -- 172.21.15.22:0/1178411380 wait complete. 2023-10-08T00:31:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:31:31.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:31:31.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.146+0000 7fde9d122700 1 Processor -- start 2023-10-08T00:31:31.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.146+0000 7fde9d122700 1 -- start start 2023-10-08T00:31:31.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.146+0000 7fde9d122700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde98159ec0 0x7fde980b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:31.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde9d122700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980b5b00 con 0x7fde980b53d0 2023-10-08T00:31:31.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde9d122700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde980b5da0 con 0x7fde980cf350 2023-10-08T00:31:31.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde9d122700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde980b6080 con 0x7fde98159ec0 2023-10-08T00:31:31.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde9659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fde980b53d0 0x7fde980cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43156/0 (socket says 172.21.15.22:43156) 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde9659c700 1 -- 172.21.15.22:0/375398479 learned_addr learned my addr 172.21.15.22:0/375398479 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde96d9d700 1 --2- 172.21.15.22:0/375398479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde98159ec0 0x7fde980b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088931050 0 0) 0x7fde980b5b00 con 0x7fde980b53d0 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde84003570 con 0x7fde980b53d0 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416646933 0 0) 0x7fde980b5da0 con 0x7fde980cf350 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde980b5b00 con 0x7fde980cf350 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde96d9d700 1 -- 172.21.15.22:0/375398479 >> v1:172.21.15.192:6789/0 conn(0x7fde980cf350 legacy=0x7fde980cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402963212 0 0) 0x7fde84003570 con 0x7fde980b53d0 2023-10-08T00:31:31.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde96d9d700 1 -- 172.21.15.22:0/375398479 >> v1:172.21.15.22:6789/0 conn(0x7fde980b53d0 legacy=0x7fde980cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde96d9d700 1 -- 172.21.15.22:0/375398479 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde980cc100 con 0x7fde98159ec0 2023-10-08T00:31:31.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.147+0000 7fde96d9d700 1 --2- 172.21.15.22:0/375398479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde98159ec0 0x7fde980b4e90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde88009900 tx=0x7fde88009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ecd6f16473c6a51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:31.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80001470 con 0x7fde98159ec0 2023-10-08T00:31:31.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88011420 con 0x7fde98159ec0 2023-10-08T00:31:31.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde95d9b700 1 -- 172.21.15.22:0/375398479 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880117c0 con 0x7fde98159ec0 2023-10-08T00:31:31.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 -- 172.21.15.22:0/375398479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde98159ec0 msgr2=0x7fde980b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 --2- 172.21.15.22:0/375398479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde98159ec0 0x7fde980b4e90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fde88009900 tx=0x7fde88009120 comp rx=0 tx=0).stop 2023-10-08T00:31:31.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 -- 172.21.15.22:0/375398479 shutdown_connections 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 --2- 172.21.15.22:0/375398479 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde98159ec0 0x7fde980b4e90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 -- 172.21.15.22:0/375398479 >> 172.21.15.22:0/375398479 conn(0x7fde980999f0 msgr2=0x7fde980b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 -- 172.21.15.22:0/375398479 shutdown_connections 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.148+0000 7fde9d122700 1 -- 172.21.15.22:0/375398479 wait complete. 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.149+0000 7fde9d122700 1 Processor -- start 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.149+0000 7fde9d122700 1 -- start start 2023-10-08T00:31:31.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9d122700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde980b53d0 0x7fde981530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9d122700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde980cf350 0x7fde981505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9d122700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 0x7fde980cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9d122700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde98150af0 con 0x7fde98159ec0 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9d122700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde980ca310 con 0x7fde980cf350 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9d122700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde98156ca0 con 0x7fde980b53d0 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 0x7fde980cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 0x7fde980cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50200/0 (socket says 172.21.15.22:50200) 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9759e700 1 -- 172.21.15.22:0/306421194 learned_addr learned my addr 172.21.15.22:0/306421194 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde9659c700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde980cf350 0x7fde981505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.150+0000 7fde96d9d700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde980b53d0 0x7fde981530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:31.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9759e700 1 -- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde980b53d0 msgr2=0x7fde981530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9759e700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde980b53d0 0x7fde981530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9759e700 1 -- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde980cf350 msgr2=0x7fde981505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:31.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9759e700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde980cf350 0x7fde981505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:31.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9759e700 1 -- 172.21.15.22:0/306421194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880093c0 con 0x7fde98159ec0 2023-10-08T00:31:31.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9759e700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 0x7fde980cc800 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c860 tx=0x7fde90002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:31.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90002030 con 0x7fde98159ec0 2023-10-08T00:31:31.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde900021b0 con 0x7fde98159ec0 2023-10-08T00:31:31.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90012630 con 0x7fde98159ec0 2023-10-08T00:31:31.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde981537d0 con 0x7fde98159ec0 2023-10-08T00:31:31.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.151+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde98153d90 con 0x7fde98159ec0 2023-10-08T00:31:31.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.152+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde98156ea0 con 0x7fde98159ec0 2023-10-08T00:31:31.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.152+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fde900129e0 con 0x7fde98159ec0 2023-10-08T00:31:31.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.153+0000 7fde8effd700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:31.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.153+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5353+0+0 (secure 0 0 0) 0x7fde90084970 con 0x7fde98159ec0 2023-10-08T00:31:31.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.153+0000 7fde96d9d700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:31.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.154+0000 7fde96d9d700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fde88009160 tx=0x7fde88016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:31.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.157+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde98156ea0 con 0x7fde98159ec0 2023-10-08T00:31:31.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.350+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde98063c90 con 0x7fde98159ec0 2023-10-08T00:31:31.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:31:31.806 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:31:32.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:31.999+0000 7fde8effd700 1 -- 172.21.15.22:0/306421194 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 169+0+0 (secure 0 0 0) 0x7fde90051760 con 0x7fde98159ec0 2023-10-08T00:31:32.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.006+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 msgr2=0x7fde780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.006+0000 7fde9d122700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fde88009160 tx=0x7fde88016000 comp rx=0 tx=0).stop 2023-10-08T00:31:32.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.006+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 msgr2=0x7fde980cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.006+0000 7fde9d122700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 0x7fde980cc800 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fde9000c860 tx=0x7fde90002700 comp rx=0 tx=0).stop 2023-10-08T00:31:32.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.007+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 shutdown_connections 2023-10-08T00:31:32.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.007+0000 7fde9d122700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde98159ec0 0x7fde980cc800 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.007+0000 7fde9d122700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.007+0000 7fde9d122700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde980b53d0 0x7fde981530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.007+0000 7fde9d122700 1 --2- 172.21.15.22:0/306421194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde980cf350 0x7fde981505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.007+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 >> 172.21.15.22:0/306421194 conn(0x7fde980999f0 msgr2=0x7fde980b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.008+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 shutdown_connections 2023-10-08T00:31:32.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.008+0000 7fde9d122700 1 -- 172.21.15.22:0/306421194 wait complete. 2023-10-08T00:31:32.011 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:31:32.026 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:31:32.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.146+0000 7f46bf59e700 1 Processor -- start 2023-10-08T00:31:32.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.146+0000 7f46bf59e700 1 -- start start 2023-10-08T00:31:32.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bf59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46c00c93a0 0x7f46c006c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00c9770 0x7f46c00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bf59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00af490 con 0x7f46c00cb400 2023-10-08T00:31:32.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bf59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00af770 con 0x7f46c00c93a0 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00afa50 con 0x7f46c00c9770 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46be59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f46c00c93a0 0x7f46c006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f46c00cb400 0x7f46c00c7fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43164/0 (socket says 172.21.15.22:43164) 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.147+0000 7f46bed9d700 1 -- 172.21.15.22:0/1824890677 learned_addr learned my addr 172.21.15.22:0/1824890677 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bdd9b700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00c9770 0x7f46c00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46be59c700 1 -- 172.21.15.22:0/1824890677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00c9770 msgr2=0x7f46c00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46be59c700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00c9770 0x7f46c00caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46be59c700 1 -- 172.21.15.22:0/1824890677 >> v1:172.21.15.22:6789/0 conn(0x7f46c00cb400 legacy=0x7f46c00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46be59c700 1 -- 172.21.15.22:0/1824890677 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00c7ab0 con 0x7f46c00c93a0 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bd59a700 1 -- 172.21.15.22:0/1824890677 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988956952 0 0) 0x7f46c00af490 con 0x7f46c00cb400 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bdd9b700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00c9770 0x7f46c00caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:32.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46be59c700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c93a0 0x7f46c006c980 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f46b00098e0 tx=0x7f46b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c93bb0a7ba5db1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bd59a700 1 -- 172.21.15.22:0/1824890677 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0009e80 con 0x7f46c00c93a0 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bd59a700 1 -- 172.21.15.22:0/1824890677 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000b860 con 0x7f46c00c93a0 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bd59a700 1 -- 172.21.15.22:0/1824890677 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000bbe0 con 0x7f46c00c93a0 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bf59e700 1 -- 172.21.15.22:0/1824890677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c93a0 msgr2=0x7f46c006c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.148+0000 7f46bf59e700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c93a0 0x7f46c006c980 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f46b00098e0 tx=0x7f46b00091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.149+0000 7f46bf59e700 1 -- 172.21.15.22:0/1824890677 shutdown_connections 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.149+0000 7f46bf59e700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c93a0 0x7f46c006c980 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.149+0000 7f46bf59e700 1 --2- 172.21.15.22:0/1824890677 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00c9770 0x7f46c00caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.149+0000 7f46bf59e700 1 -- 172.21.15.22:0/1824890677 >> 172.21.15.22:0/1824890677 conn(0x7f46c00cddc0 msgr2=0x7f46c00c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.149+0000 7f46bf59e700 1 -- 172.21.15.22:0/1824890677 shutdown_connections 2023-10-08T00:31:32.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.149+0000 7f46bf59e700 1 -- 172.21.15.22:0/1824890677 wait complete. 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 Processor -- start 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 -- start start 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46c00c93a0 0x7f46c01428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 0x7f46c00b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00cb400 0x7f46c00b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00c4ae0 con 0x7f46c00c9770 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0157ec0 con 0x7f46c00c93a0 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bf59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00c44d0 con 0x7f46c00cb400 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.150+0000 7f46bdd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 0x7f46c00b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 0x7f46c00b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50220/0 (socket says 172.21.15.22:50220) 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 -- 172.21.15.22:0/3599311574 learned_addr learned my addr 172.21.15.22:0/3599311574 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bed9d700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00cb400 0x7f46c00b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 -- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00cb400 msgr2=0x7f46c00b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00cb400 0x7f46c00b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46be59c700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46c00c93a0 0x7f46c01428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 -- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46c00c93a0 msgr2=0x7f46c01428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46c00c93a0 0x7f46c01428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 -- 172.21.15.22:0/3599311574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0009420 con 0x7f46c00c9770 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bed9d700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00cb400 0x7f46c00b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46be59c700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46c00c93a0 0x7f46c01428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bdd9b700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 0x7f46c00b20a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c830 tx=0x7f46b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4005a00 con 0x7f46c00c9770 2023-10-08T00:31:32.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4005b60 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0157be0 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011600 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.151+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0142e30 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.152+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c00c4c50 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.153+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f46b40119f0 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.153+0000 7f46ae7fc700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46a0067320 0x7f46a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.153+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f46b4084a50 con 0x7f46c00c9770 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.153+0000 7f46be59c700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46a0067320 0x7f46a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.154+0000 7f46be59c700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46a0067320 0x7f46a00697d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f46c0169180 tx=0x7f46b0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:32.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.157+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46b40518d0 con 0x7f46c00c9770 2023-10-08T00:31:32.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.352+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f46c006b500 con 0x7f46c00c9770 2023-10-08T00:31:32.357 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.355+0000 7f46ae7fc700 1 -- 172.21.15.22:0/3599311574 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46b4054ef0 con 0x7f46c00c9770 2023-10-08T00:31:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46a0067320 msgr2=0x7f46a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46a0067320 0x7f46a00697d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f46c0169180 tx=0x7f46b0017000 comp rx=0 tx=0).stop 2023-10-08T00:31:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 msgr2=0x7f46c00b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 0x7f46c00b20a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c830 tx=0x7f46b4008040 comp rx=0 tx=0).stop 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 shutdown_connections 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f46a0067320 0x7f46a00697d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46c00cb400 0x7f46c00b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46c00c93a0 0x7f46c01428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 --2- 172.21.15.22:0/3599311574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46c00c9770 0x7f46c00b20a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.357+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 >> 172.21.15.22:0/3599311574 conn(0x7f46c00cddc0 msgr2=0x7f46c0154200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.358+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 shutdown_connections 2023-10-08T00:31:32.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.358+0000 7f46bf59e700 1 -- 172.21.15.22:0/3599311574 wait complete. 2023-10-08T00:31:32.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-08T00:31:32.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.494+0000 7fd6d950e700 1 Processor -- start 2023-10-08T00:31:32.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.494+0000 7fd6d950e700 1 -- start start 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d950e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d406c0a0 0x7fd6d40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d950e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6d415df50 0x7fd6d415e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d950e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d415d7e0 con 0x7fd6d406bcd0 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d950e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d415dac0 con 0x7fd6d415df50 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d950e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d415aa30 con 0x7fd6d406c0a0 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6d415df50 0x7fd6d415e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6d415df50 0x7fd6d415e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50222/0 (socket says 172.21.15.22:50222) 2023-10-08T00:31:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 -- 172.21.15.22:0/1306757241 learned_addr learned my addr 172.21.15.22:0/1306757241 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d27fc700 1 --2- 172.21.15.22:0/1306757241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d406c0a0 0x7fd6d40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 -- 172.21.15.22:0/1306757241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d406c0a0 msgr2=0x7fd6d40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 --2- 172.21.15.22:0/1306757241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d406c0a0 0x7fd6d40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 -- 172.21.15.22:0/1306757241 >> v1:172.21.15.192:6789/0 conn(0x7fd6d406bcd0 legacy=0x7fd6d415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 -- 172.21.15.22:0/1306757241 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d415ad10 con 0x7fd6d415df50 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d37fe700 1 --2- 172.21.15.22:0/1306757241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d415df50 0x7fd6d415e3c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009f20 tx=0x7fd6cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcbed17a3489ec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d1ffb700 1 -- 172.21.15.22:0/1306757241 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00e070 con 0x7fd6d415df50 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.495+0000 7fd6d1ffb700 1 -- 172.21.15.22:0/1306757241 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00b9d0 con 0x7fd6d415df50 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d1ffb700 1 -- 172.21.15.22:0/1306757241 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0092e0 con 0x7fd6d415df50 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 -- 172.21.15.22:0/1306757241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d415df50 msgr2=0x7fd6d415e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 --2- 172.21.15.22:0/1306757241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d415df50 0x7fd6d415e3c0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009f20 tx=0x7fd6cc009840 comp rx=0 tx=0).stop 2023-10-08T00:31:32.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 -- 172.21.15.22:0/1306757241 shutdown_connections 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 --2- 172.21.15.22:0/1306757241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d415df50 0x7fd6d415e3c0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 --2- 172.21.15.22:0/1306757241 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d406c0a0 0x7fd6d40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 -- 172.21.15.22:0/1306757241 >> 172.21.15.22:0/1306757241 conn(0x7fd6d40ce600 msgr2=0x7fd6d40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 -- 172.21.15.22:0/1306757241 shutdown_connections 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.496+0000 7fd6d950e700 1 -- 172.21.15.22:0/1306757241 wait complete. 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.497+0000 7fd6d950e700 1 Processor -- start 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.497+0000 7fd6d950e700 1 -- start start 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d950e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d406bcd0 0x7fd6d4158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d950e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 0x7fd6d415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d950e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d415df50 0x7fd6d4157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d950e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c6be0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d950e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4158e90 con 0x7fd6d406bcd0 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d950e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4159170 con 0x7fd6d415df50 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d27fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 0x7fd6d415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d27fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 0x7fd6d415a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50236/0 (socket says 172.21.15.22:50236) 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d27fc700 1 -- 172.21.15.22:0/3972161243 learned_addr learned my addr 172.21.15.22:0/3972161243 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d2ffd700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d406bcd0 0x7fd6d4158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d37fe700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d415df50 0x7fd6d4157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d27fc700 1 -- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d415df50 msgr2=0x7fd6d4157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.498+0000 7fd6d27fc700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d415df50 0x7fd6d4157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6d27fc700 1 -- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d406bcd0 msgr2=0x7fd6d4158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6d27fc700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d406bcd0 0x7fd6d4158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6d27fc700 1 -- 172.21.15.22:0/3972161243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc009ae0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6d27fc700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 0x7fd6d415a320 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800e930 tx=0x7fd6c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8013680 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80137e0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4159450 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8013b80 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.499+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d4157ab0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.500+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40c69b0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.500+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd6c800c3e0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.501+0000 7fd6baffd700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6c0067320 0x7fd6c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.501+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd6c80849f0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.501+0000 7fd6d2ffd700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6c0067320 0x7fd6c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:32.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.501+0000 7fd6d2ffd700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6c0067320 0x7fd6c00697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40039e0 tx=0x7fd6c4007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:32.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.505+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6d40c69b0 con 0x7fd6d406c0a0 2023-10-08T00:31:32.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.772+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7fd6d40c69b0 con 0x7fd6d406c0a0 2023-10-08T00:31:33.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:32.998+0000 7fd6baffd700 1 -- 172.21.15.22:0/3972161243 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v321) v1 ==== 156+0+0 (secure 0 0 0) 0x7fd6d40c69b0 con 0x7fd6d406c0a0 2023-10-08T00:31:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6c0067320 msgr2=0x7fd6c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:33.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6c0067320 0x7fd6c00697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40039e0 tx=0x7fd6c4007ec0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 msgr2=0x7fd6d415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 0x7fd6d415a320 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800e930 tx=0x7fd6c80091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 shutdown_connections 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6c0067320 0x7fd6c00697d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6d415df50 0x7fd6d4157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d406bcd0 0x7fd6d4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 --2- 172.21.15.22:0/3972161243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d406c0a0 0x7fd6d415a320 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 >> 172.21.15.22:0/3972161243 conn(0x7fd6d40ce600 msgr2=0x7fd6d406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 shutdown_connections 2023-10-08T00:31:33.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.001+0000 7fd6d950e700 1 -- 172.21.15.22:0/3972161243 wait complete. 2023-10-08T00:31:33.015 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command without subvolume group ... ok 2023-10-08T00:31:33.015 INFO:tasks.cephfs_test_runner:Starting test: test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) That the existing and the newly created volumes can be listed and 2023-10-08T00:31:33.015 INFO:tasks.cephfs_test_runner:test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:31:33.016 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-08T00:31:33.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.134+0000 7fd593db5700 1 Processor -- start 2023-10-08T00:31:33.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.134+0000 7fd593db5700 1 -- start start 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd593db5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159890 0x7fd58c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd593db5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd58c159c60 0x7fd58c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd593db5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c15a160 con 0x7fd58c15db10 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd593db5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c0d13a0 con 0x7fd58c159c60 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd593db5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c15e140 con 0x7fd58c159890 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591350700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd58c159c60 0x7fd58c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd592352700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd58c15db10 0x7fd58c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43174/0 (socket says 172.21.15.22:43174) 2023-10-08T00:31:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd592352700 1 -- 172.21.15.22:0/2090946251 learned_addr learned my addr 172.21.15.22:0/2090946251 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591b51700 1 --2- 172.21.15.22:0/2090946251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159890 0x7fd58c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591350700 1 -- 172.21.15.22:0/2090946251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159890 msgr2=0x7fd58c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591350700 1 --2- 172.21.15.22:0/2090946251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159890 0x7fd58c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591350700 1 -- 172.21.15.22:0/2090946251 >> v1:172.21.15.22:6789/0 conn(0x7fd58c15db10 legacy=0x7fd58c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591350700 1 -- 172.21.15.22:0/2090946251 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c15a3d0 con 0x7fd58c159c60 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd590b4f700 1 -- 172.21.15.22:0/2090946251 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190329927 0 0) 0x7fd58c15a160 con 0x7fd58c15db10 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd591350700 1 --2- 172.21.15.22:0/2090946251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c159c60 0x7fd58c15d5d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306830bdcf1005e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.135+0000 7fd590b4f700 1 -- 172.21.15.22:0/2090946251 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c009e80 con 0x7fd58c159c60 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd590b4f700 1 -- 172.21.15.22:0/2090946251 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c00b860 con 0x7fd58c159c60 2023-10-08T00:31:33.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd590b4f700 1 -- 172.21.15.22:0/2090946251 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57c00bbe0 con 0x7fd58c159c60 2023-10-08T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 -- 172.21.15.22:0/2090946251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c159c60 msgr2=0x7fd58c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 --2- 172.21.15.22:0/2090946251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c159c60 0x7fd58c15d5d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0098e0 tx=0x7fd57c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 -- 172.21.15.22:0/2090946251 shutdown_connections 2023-10-08T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 --2- 172.21.15.22:0/2090946251 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159890 0x7fd58c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 --2- 172.21.15.22:0/2090946251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c159c60 0x7fd58c15d5d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 -- 172.21.15.22:0/2090946251 >> 172.21.15.22:0/2090946251 conn(0x7fd58c068e20 msgr2=0x7fd58c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 -- 172.21.15.22:0/2090946251 shutdown_connections 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.136+0000 7fd593db5700 1 -- 172.21.15.22:0/2090946251 wait complete. 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.137+0000 7fd593db5700 1 Processor -- start 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.137+0000 7fd593db5700 1 -- start start 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd593db5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c159890 0x7fd58c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd593db5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159c60 0x7fd58c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd593db5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 0x7fd58c16d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd593db5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0cfeb0 con 0x7fd58c15db10 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd593db5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c15b9d0 con 0x7fd58c159890 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd593db5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c15bcb0 con 0x7fd58c159c60 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 0x7fd58c16d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:33.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 0x7fd58c16d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50252/0 (socket says 172.21.15.22:50252) 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 -- 172.21.15.22:0/2364116015 learned_addr learned my addr 172.21.15.22:0/2364116015 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd591350700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159c60 0x7fd58c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd591b51700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c159890 0x7fd58c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 -- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159c60 msgr2=0x7fd58c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159c60 0x7fd58c0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 -- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c159890 msgr2=0x7fd58c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c159890 0x7fd58c0cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:33.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd592352700 1 -- 172.21.15.22:0/2364116015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009420 con 0x7fd58c15db10 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.138+0000 7fd591350700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159c60 0x7fd58c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.139+0000 7fd592352700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 0x7fd58c16d330 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd58400cbf0 tx=0x7fd5840019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.139+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58400a9c0 con 0x7fd58c15db10 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.139+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400ab20 con 0x7fd58c15db10 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.139+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c15bf90 con 0x7fd58c15db10 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.139+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840070f0 con 0x7fd58c15db10 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.139+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c15c550 con 0x7fd58c15db10 2023-10-08T00:31:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.140+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c15c740 con 0x7fd58c15db10 2023-10-08T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.140+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd584007520 con 0x7fd58c15db10 2023-10-08T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.140+0000 7fd581ffb700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd570067320 0x7fd5700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.141+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd584084dc0 con 0x7fd58c15db10 2023-10-08T00:31:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.141+0000 7fd591b51700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd570067320 0x7fd5700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.141+0000 7fd591b51700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd570067320 0x7fd5700697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd588006fd0 tx=0x7fd588008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.145+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd584051d50 con 0x7fd58c15db10 2023-10-08T00:31:33.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.419+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7fd58c04c3c0 con 0x7fd58c15db10 2023-10-08T00:31:34.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:33.999+0000 7fd581ffb700 1 -- 172.21.15.22:0/2364116015 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v322) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd584055370 con 0x7fd58c15db10 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd570067320 msgr2=0x7fd5700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd570067320 0x7fd5700697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd588006fd0 tx=0x7fd588008040 comp rx=0 tx=0).stop 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 msgr2=0x7fd58c16d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 0x7fd58c16d330 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd58400cbf0 tx=0x7fd5840019b0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 shutdown_connections 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd58c15db10 0x7fd58c16d330 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd58c159890 0x7fd58c0cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd570067320 0x7fd5700697d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 --2- 172.21.15.22:0/2364116015 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd58c159c60 0x7fd58c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 >> 172.21.15.22:0/2364116015 conn(0x7fd58c068e20 msgr2=0x7fd58c158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:34.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 shutdown_connections 2023-10-08T00:31:34.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.002+0000 7fd593db5700 1 -- 172.21.15.22:0/2364116015 wait complete. 2023-10-08T00:31:34.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:31:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.142+0000 7fd6bd484700 1 Processor -- start 2023-10-08T00:31:34.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.142+0000 7fd6bd484700 1 -- start start 2023-10-08T00:31:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.142+0000 7fd6bd484700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 0x7fd6b80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.142+0000 7fd6bd484700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b8069ee0 con 0x7fd6b8159890 2023-10-08T00:31:34.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.142+0000 7fd6bd484700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b815a160 con 0x7fd6b8159c60 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.142+0000 7fd6bd484700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80d13a0 con 0x7fd6b8069560 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd6b8159890 0x7fd6b815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43176/0 (socket says 172.21.15.22:43176) 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b6ffd700 1 -- 172.21.15.22:0/1491591031 learned_addr learned my addr 172.21.15.22:0/1491591031 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b77fe700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 0x7fd6b80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397662005 0 0) 0x7fd6b8069ee0 con 0x7fd6b8159890 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a4003570 con 0x7fd6b8159890 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470185648 0 0) 0x7fd6a4003570 con 0x7fd6b8159890 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 msgr2=0x7fd6b80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 0x7fd6b80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 >> v1:172.21.15.192:6789/0 conn(0x7fd6b8159c60 legacy=0x7fd6b815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b815e140 con 0x7fd6b8159890 2023-10-08T00:31:34.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fd6a8001470 con 0x7fd6b8159890 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 >> v1:172.21.15.22:6789/0 conn(0x7fd6b8159890 legacy=0x7fd6b815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4004810 0x7fd6a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 0x7fd6a40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80d13a0 con 0x7fd6a4003a90 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a400bb90 con 0x7fd6a4004810 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a400bd50 con 0x7fd6b8069560 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b77fe700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 0x7fd6a40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.143+0000 7fd6b67fc700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4004810 0x7fd6a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b6ffd700 1 -- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 msgr2=0x7fd6a40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:34.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b8069560 0x7fd6a40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b6ffd700 1 -- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4004810 msgr2=0x7fd6a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4004810 0x7fd6a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b6ffd700 1 -- 172.21.15.22:0/1491591031 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4003570 con 0x7fd6a4003a90 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c3c0 tx=0x7fd6a8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec20027fa28bbbb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800cc90 con 0x7fd6a4003a90 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a800cdf0 con 0x7fd6a4003a90 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b5ffb700 1 -- 172.21.15.22:0/1491591031 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8005b50 con 0x7fd6a4003a90 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6bd484700 1 -- 172.21.15.22:0/1491591031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a4003a90 msgr2=0x7fd6a4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6bd484700 1 --2- 172.21.15.22:0/1491591031 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6a4003a90 0x7fd6a4003ea0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c3c0 tx=0x7fd6a8001e50 comp rx=0 tx=0).stop 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6b77fe700 1 -- 172.21.15.22:0/1491591031 reap_dead start 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6bd484700 1 -- 172.21.15.22:0/1491591031 shutdown_connections 2023-10-08T00:31:34.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.144+0000 7fd6bd484700 1 -- 172.21.15.22:0/1491591031 >> 172.21.15.22:0/1491591031 conn(0x7fd6b8068e20 msgr2=0x7fd6b80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:34.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.145+0000 7fd6bd484700 1 -- 172.21.15.22:0/1491591031 shutdown_connections 2023-10-08T00:31:34.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.145+0000 7fd6bd484700 1 -- 172.21.15.22:0/1491591031 wait complete. 2023-10-08T00:31:34.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 Processor -- start 2023-10-08T00:31:34.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 -- start start 2023-10-08T00:31:34.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4003a90 0x7fd6b80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b80cfc10 0x7fd6b814c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 0x7fd6b8151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8152120 con 0x7fd6b8151740 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b5400 con 0x7fd6a4003a90 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.146+0000 7fd6bd484700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b47f0 con 0x7fd6b80cfc10 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 0x7fd6b8151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 0x7fd6b8151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50262/0 (socket says 172.21.15.22:50262) 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 -- 172.21.15.22:0/4013871971 learned_addr learned my addr 172.21.15.22:0/4013871971 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4003a90 0x7fd6b80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b67fc700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b80cfc10 0x7fd6b814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 -- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b80cfc10 msgr2=0x7fd6b814c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b80cfc10 0x7fd6b814c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 -- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4003a90 msgr2=0x7fd6b80b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4003a90 0x7fd6b80b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 -- 172.21.15.22:0/4013871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b80b4ad0 con 0x7fd6b8151740 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4003a90 0x7fd6b80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:34.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6b77fe700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 0x7fd6b8151be0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80d03b0 tx=0x7fd6b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000e040 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b000f040 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b80b4db0 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000fe20 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.147+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b80b4490 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.148+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b80b5570 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.149+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd6b0015640 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.149+0000 7fd6aeffd700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd698067320 0x7fd6980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.149+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd6b00852c0 con 0x7fd6b8151740 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.149+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd698067320 0x7fd6980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.150+0000 7fd6b6ffd700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd698067320 0x7fd6980697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8000f60 tx=0x7fd6a8015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:34.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.153+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6b0052140 con 0x7fd6b8151740 2023-10-08T00:31:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.347+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd6b804c3c0 con 0x7fd6b8151740 2023-10-08T00:31:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.351+0000 7fd6aeffd700 1 -- 172.21.15.22:0/4013871971 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd6b0055760 con 0x7fd6b8151740 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd698067320 msgr2=0x7fd6980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd698067320 0x7fd6980697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8000f60 tx=0x7fd6a8015000 comp rx=0 tx=0).stop 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 msgr2=0x7fd6b8151be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 0x7fd6b8151be0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80d03b0 tx=0x7fd6b000b040 comp rx=0 tx=0).stop 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 shutdown_connections 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b8151740 0x7fd6b8151be0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6a4003a90 0x7fd6b80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd698067320 0x7fd6980697d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 --2- 172.21.15.22:0/4013871971 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6b80cfc10 0x7fd6b814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 >> 172.21.15.22:0/4013871971 conn(0x7fd6b8068e20 msgr2=0x7fd6b8152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 shutdown_connections 2023-10-08T00:31:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.353+0000 7fd6bd484700 1 -- 172.21.15.22:0/4013871971 wait complete. 2023-10-08T00:31:34.367 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:31:34.367 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:31:34.408 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:31:34.459 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:31:34.459 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:31:34.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:34.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.577+0000 7fb1f98c3700 1 Processor -- start 2023-10-08T00:31:34.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.577+0000 7fb1f98c3700 1 -- start start 2023-10-08T00:31:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f98c3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1f40cd0f0 0x7fb1f41598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f98c3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1f4159de0 0x7fb1f415a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f98c3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f40d01f0 con 0x7fb1f41594d0 2023-10-08T00:31:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f98c3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f40cd540 con 0x7fb1f4159de0 2023-10-08T00:31:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f98c3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f40cf5e0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f2ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb1f41594d0 0x7fb1f40b5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43192/0 (socket says 172.21.15.22:43192) 2023-10-08T00:31:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f2ffd700 1 -- 172.21.15.22:0/551644218 learned_addr learned my addr 172.21.15.22:0/551644218 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f37fe700 1 --2- 172.21.15.22:0/551644218 >> v2:172.21.15.22:3300/0 conn(0x7fb1f4159de0 0x7fb1f415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f27fc700 1 --2- 172.21.15.22:0/551644218 >> v2:172.21.15.192:3300/0 conn(0x7fb1f40cd0f0 0x7fb1f41598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f1ffb700 1 -- 172.21.15.22:0/551644218 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971676921 0 0) 0x7fb1f40d01f0 con 0x7fb1f41594d0 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f1ffb700 1 -- 172.21.15.22:0/551644218 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e0003570 con 0x7fb1f41594d0 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.578+0000 7fb1f37fe700 1 -- 172.21.15.22:0/551644218 >> v2:172.21.15.192:3300/0 conn(0x7fb1f40cd0f0 msgr2=0x7fb1f41598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f37fe700 1 --2- 172.21.15.22:0/551644218 >> v2:172.21.15.192:3300/0 conn(0x7fb1f40cd0f0 0x7fb1f41598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f37fe700 1 -- 172.21.15.22:0/551644218 >> v1:172.21.15.22:6789/0 conn(0x7fb1f41594d0 legacy=0x7fb1f40b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f37fe700 1 -- 172.21.15.22:0/551644218 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40cf8c0 con 0x7fb1f4159de0 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f37fe700 1 --2- 172.21.15.22:0/551644218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f4159de0 0x7fb1f415a220 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4064810 tx=0x7fb1e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5cc946d7d2d97a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f1ffb700 1 -- 172.21.15.22:0/551644218 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400e070 con 0x7fb1f4159de0 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f1ffb700 1 -- 172.21.15.22:0/551644218 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e400bb60 con 0x7fb1f4159de0 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f1ffb700 1 -- 172.21.15.22:0/551644218 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4012430 con 0x7fb1f4159de0 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 -- 172.21.15.22:0/551644218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f4159de0 msgr2=0x7fb1f415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/551644218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f4159de0 0x7fb1f415a220 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4064810 tx=0x7fb1e4009780 comp rx=0 tx=0).stop 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 -- 172.21.15.22:0/551644218 shutdown_connections 2023-10-08T00:31:34.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/551644218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f4159de0 0x7fb1f415a220 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/551644218 >> v2:172.21.15.192:3300/0 conn(0x7fb1f40cd0f0 0x7fb1f41598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 -- 172.21.15.22:0/551644218 >> 172.21.15.22:0/551644218 conn(0x7fb1f40d05f0 msgr2=0x7fb1f40d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:34.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 -- 172.21.15.22:0/551644218 shutdown_connections 2023-10-08T00:31:34.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.579+0000 7fb1f98c3700 1 -- 172.21.15.22:0/551644218 wait complete. 2023-10-08T00:31:34.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 Processor -- start 2023-10-08T00:31:34.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 -- start start 2023-10-08T00:31:34.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 0x7fb1f4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f41594d0 0x7fb1f414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f4159de0 0x7fb1f4154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f414fb10 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.581+0000 7fb1f98c3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41554f0 con 0x7fb1f41594d0 2023-10-08T00:31:34.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f98c3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41524d0 con 0x7fb1f4159de0 2023-10-08T00:31:34.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 0x7fb1f4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 0x7fb1f4151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50278/0 (socket says 172.21.15.22:50278) 2023-10-08T00:31:34.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 -- 172.21.15.22:0/3270325385 learned_addr learned my addr 172.21.15.22:0/3270325385 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f27fc700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f41594d0 0x7fb1f414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f37fe700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f4159de0 0x7fb1f4154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 -- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f4159de0 msgr2=0x7fb1f4154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f4159de0 0x7fb1f4154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 -- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f41594d0 msgr2=0x7fb1f414f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f41594d0 0x7fb1f414f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 -- 172.21.15.22:0/3270325385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009a20 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f37fe700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f4159de0 0x7fb1f4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f2ffd700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 0x7fb1f4151e30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00c7c0 tx=0x7fb1ec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec005b30 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ec005cb0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f41527b0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec007320 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.582+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f4152d70 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.583+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f404c3c0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.584+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb1ec01b3b0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.584+0000 7fb1eaffd700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb1d4067320 0x7fb1d40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.584+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb1ec083ea0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.584+0000 7fb1f27fc700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb1d4067320 0x7fb1d40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:34.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.585+0000 7fb1f27fc700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb1d4067320 0x7fb1d40697d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4153220 tx=0x7fb1dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:34.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.588+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1ec050e30 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.827+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1f40cfba0 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.828+0000 7fb1eaffd700 1 -- 172.21.15.22:0/3270325385 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3532 (secure 0 0 0) 0x7fb1ec017020 con 0x7fb1f40cd0f0 2023-10-08T00:31:34.830 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:34.830 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5834,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3285961473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3285961473},{"type":"v1","addr":"172.21.15.192:6836","nonce":3285961473}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2959913993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2959913993},{"type":"v1","addr":"172.21.15.192:6837","nonce":2959913993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":6855,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1035429174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1035429174},{"type":"v1","addr":"172.21.15.22:6834","nonce":1035429174}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64},{"gid":7128,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/223345994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":223345994},{"type":"v1","addr":"172.21.15.22:6835","nonce":223345994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-10-08T00:31:34.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.829+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb1d4067320 msgr2=0x7fb1d40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.829+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb1d4067320 0x7fb1d40697d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4153220 tx=0x7fb1dc008040 comp rx=0 tx=0).stop 2023-10-08T00:31:34.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.829+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 msgr2=0x7fb1f4151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:34.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.829+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 0x7fb1f4151e30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec00c7c0 tx=0x7fb1ec007e00 comp rx=0 tx=0).stop 2023-10-08T00:31:34.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 shutdown_connections 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb1d4067320 0x7fb1d40697d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1f4159de0 0x7fb1f4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1f40cd0f0 0x7fb1f4151e30 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 --2- 172.21.15.22:0/3270325385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1f41594d0 0x7fb1f414f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 >> 172.21.15.22:0/3270325385 conn(0x7fb1f40d05f0 msgr2=0x7fb1f40d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 shutdown_connections 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:34.830+0000 7fb1f98c3700 1 -- 172.21.15.22:0/3270325385 wait complete. 2023-10-08T00:31:34.833 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 72 2023-10-08T00:31:34.844 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:31:34.845 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:31:34.845 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:31:34.845 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:34.845 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:31:34.846 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:31:34.846 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:31:34.846 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:34.846 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:31:34.847 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:31:34.847 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:31:34.847 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:34.847 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:31:34.848 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:31:34.848 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:31:34.848 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:31:34.856 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:31:34.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:31:34.857 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:31:34.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:31:34.858 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:31:34.858 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:31:34.859 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:31:34.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:31:34.899 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:31:34.899 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:34.899 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:31:34.900 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:34.901 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:31:34.902 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:34.902 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:31:34.902 DEBUG:teuthology.parallel:result is None 2023-10-08T00:31:34.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:31:34.975 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:31:34.975 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:31:34.981 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:31:34.981 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:31:35.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.031+0000 7f8bd73fe700 1 Processor -- start 2023-10-08T00:31:35.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.032+0000 7f8bd73fe700 1 -- start start 2023-10-08T00:31:35.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.032+0000 7f8bd73fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006bcd0 0x7f8bd00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:35.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.032+0000 7f8bd73fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bd015df50 0x7f8bd015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:35.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.032+0000 7f8bd73fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd015d7e0 con 0x7f8bd006c0a0 2023-10-08T00:31:35.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.032+0000 7f8bd73fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd015dac0 con 0x7f8bd015df50 2023-10-08T00:31:35.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.032+0000 7f8bd73fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd015aa30 con 0x7f8bd006bcd0 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd599b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bd015df50 0x7f8bd015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd4999700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8bd006c0a0 0x7f8bd015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:57504/0 (socket says 172.21.15.22:57504) 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd519a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006bcd0 0x7f8bd00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd4999700 1 -- 172.21.15.22:0/4092745292 learned_addr learned my addr 172.21.15.22:0/4092745292 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bcffff700 1 -- 172.21.15.22:0/4092745292 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686346632 0 0) 0x7f8bd015d7e0 con 0x7f8bd006c0a0 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bcffff700 1 -- 172.21.15.22:0/4092745292 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb8003570 con 0x7f8bd006c0a0 2023-10-08T00:31:35.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd599b700 1 -- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006bcd0 msgr2=0x7f8bd00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd599b700 1 --2- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006bcd0 0x7f8bd00caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd599b700 1 -- 172.21.15.22:0/4092745292 >> v1:172.21.15.192:6789/0 conn(0x7f8bd006c0a0 legacy=0x7f8bd015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd599b700 1 -- 172.21.15.22:0/4092745292 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd015ad10 con 0x7f8bd015df50 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bd599b700 1 --2- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd015e3b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009e60 tx=0x7f8bc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995e15dbfa644e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bcffff700 1 -- 172.21.15.22:0/4092745292 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc000e070 con 0x7f8bd015df50 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bcffff700 1 -- 172.21.15.22:0/4092745292 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc000bab0 con 0x7f8bd015df50 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.033+0000 7f8bcffff700 1 -- 172.21.15.22:0/4092745292 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc000be50 con 0x7f8bd015df50 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 -- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 msgr2=0x7f8bd015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd015e3b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009e60 tx=0x7f8bc0009780 comp rx=0 tx=0).stop 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 -- 172.21.15.22:0/4092745292 shutdown_connections 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd015e3b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:35.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/4092745292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006bcd0 0x7f8bd00caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:35.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 -- 172.21.15.22:0/4092745292 >> 172.21.15.22:0/4092745292 conn(0x7f8bd00ce600 msgr2=0x7f8bd00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:35.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 -- 172.21.15.22:0/4092745292 shutdown_connections 2023-10-08T00:31:35.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.034+0000 7f8bd73fe700 1 -- 172.21.15.22:0/4092745292 wait complete. 2023-10-08T00:31:35.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.035+0000 7f8bd73fe700 1 Processor -- start 2023-10-08T00:31:35.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.035+0000 7f8bd73fe700 1 -- start start 2023-10-08T00:31:35.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd73fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 0x7f8bd00b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:35.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd73fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006c0a0 0x7f8bd0159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:35.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd73fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd0159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd73fe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd015eec0 con 0x7f8bd006bcd0 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd73fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd015f1a0 con 0x7f8bd015df50 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd73fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd015f480 con 0x7f8bd006c0a0 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 0x7f8bd00b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 0x7f8bd00b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50304/0 (socket says 172.21.15.22:50304) 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 -- 172.21.15.22:0/2259582584 learned_addr learned my addr 172.21.15.22:0/2259582584 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd4999700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006c0a0 0x7f8bd0159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd599b700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:35.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 -- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006c0a0 msgr2=0x7f8bd0159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006c0a0 0x7f8bd0159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 -- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 msgr2=0x7f8bd0159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd0159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.036+0000 7f8bd519a700 1 -- 172.21.15.22:0/2259582584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009a20 con 0x7f8bd006bcd0 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.037+0000 7f8bd519a700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 0x7f8bd00b2890 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800e930 tx=0x7f8bc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.037+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8013680 con 0x7f8bd006bcd0 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.037+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc80137e0 con 0x7f8bd006bcd0 2023-10-08T00:31:35.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.037+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd015f760 con 0x7f8bd006bcd0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.037+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8013b80 con 0x7f8bd006bcd0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.037+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd00b2e50 con 0x7f8bd006bcd0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.038+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd015fdb0 con 0x7f8bd006bcd0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.038+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8bc800c3e0 con 0x7f8bd006bcd0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.039+0000 7f8bcd7fa700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bbc067320 0x7f8bbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.039+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8bc8084a60 con 0x7f8bd006bcd0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.039+0000 7f8bd4999700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bbc067320 0x7f8bbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:35.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.039+0000 7f8bd4999700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bbc067320 0x7f8bbc0697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8bd015a1a0 tx=0x7f8bc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:35.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.043+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bc80519b0 con 0x7f8bd006bcd0 2023-10-08T00:31:35.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-08T00:31:35.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-08T00:31:35.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T00:31:35.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-08T00:31:35.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:35.251+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8bd004c3c0 con 0x7f8bd006bcd0 2023-10-08T00:31:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.018+0000 7f8bcd7fa700 1 -- 172.21.15.22:0/2259582584 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8bc8054fd0 con 0x7f8bd006bcd0 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bbc067320 msgr2=0x7f8bbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bbc067320 0x7f8bbc0697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8bd015a1a0 tx=0x7f8bc4009040 comp rx=0 tx=0).stop 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 msgr2=0x7f8bd00b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 0x7f8bd00b2890 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800e930 tx=0x7f8bc80091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 shutdown_connections 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd015df50 0x7f8bd0159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bd006bcd0 0x7f8bd00b2890 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8bbc067320 0x7f8bbc0697d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 --2- 172.21.15.22:0/2259582584 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8bd006c0a0 0x7f8bd0159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 >> 172.21.15.22:0/2259582584 conn(0x7f8bd00ce600 msgr2=0x7f8bd0069480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:36.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 shutdown_connections 2023-10-08T00:31:36.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.020+0000 7f8bd73fe700 1 -- 172.21.15.22:0/2259582584 wait complete. 2023-10-08T00:31:36.025 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:31:36.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:31:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.161+0000 7f2efe8f3700 1 Processor -- start 2023-10-08T00:31:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.161+0000 7f2efe8f3700 1 -- start start 2023-10-08T00:31:36.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2efe8f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 0x7f2ef80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2efe8f3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef8069ee0 con 0x7f2ef8159890 2023-10-08T00:31:36.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2efe8f3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef815a160 con 0x7f2ef8159c60 2023-10-08T00:31:36.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2efe8f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80d13a0 con 0x7f2ef8069560 2023-10-08T00:31:36.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2ef7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2ef8159890 0x7f2ef815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43224/0 (socket says 172.21.15.22:43224) 2023-10-08T00:31:36.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2ef7fff700 1 -- 172.21.15.22:0/2439646610 learned_addr learned my addr 172.21.15.22:0/2439646610 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.162+0000 7f2efce90700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 0x7f2ef80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825739226 0 0) 0x7f2ef8069ee0 con 0x7f2ef8159890 2023-10-08T00:31:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee4003570 con 0x7f2ef8159890 2023-10-08T00:31:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3864707556 0 0) 0x7f2ee4003570 con 0x7f2ef8159890 2023-10-08T00:31:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 msgr2=0x7f2ef80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 0x7f2ef80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 >> v1:172.21.15.192:6789/0 conn(0x7f2ef8159c60 legacy=0x7f2ef815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef815e140 con 0x7f2ef8159890 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f2ee0001470 con 0x7f2ef8159890 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 >> v1:172.21.15.22:6789/0 conn(0x7f2ef8159890 legacy=0x7f2ef815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ee4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 0x7f2ee4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee4004d50 0x7f2ee40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80d13a0 con 0x7f2ee4003a90 2023-10-08T00:31:36.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400bba0 con 0x7f2ee4004d50 2023-10-08T00:31:36.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee400bd60 con 0x7f2ef8069560 2023-10-08T00:31:36.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ee4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef77fe700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 0x7f2ee4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2efce90700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee4004d50 0x7f2ee40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef7fff700 1 -- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 msgr2=0x7f2ee4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef8069560 0x7f2ee4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef7fff700 1 -- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee4004d50 msgr2=0x7f2ee40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ee4004d50 0x7f2ee40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.163+0000 7f2ef7fff700 1 -- 172.21.15.22:0/2439646610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4003570 con 0x7f2ee4003a90 2023-10-08T00:31:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ee4003ea0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c3c0 tx=0x7f2ee0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cf134e7abe1dc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000cc90 con 0x7f2ee4003a90 2023-10-08T00:31:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000cdf0 con 0x7f2ee4003a90 2023-10-08T00:31:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2ef6ffd700 1 -- 172.21.15.22:0/2439646610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0005b50 con 0x7f2ee4003a90 2023-10-08T00:31:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efe8f3700 1 -- 172.21.15.22:0/2439646610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 msgr2=0x7f2ee4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/2439646610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ee4003ea0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c3c0 tx=0x7f2ee0001e50 comp rx=0 tx=0).stop 2023-10-08T00:31:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efce90700 1 -- 172.21.15.22:0/2439646610 reap_dead start 2023-10-08T00:31:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efe8f3700 1 -- 172.21.15.22:0/2439646610 shutdown_connections 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efe8f3700 1 -- 172.21.15.22:0/2439646610 >> 172.21.15.22:0/2439646610 conn(0x7f2ef8068e20 msgr2=0x7f2ef80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efe8f3700 1 -- 172.21.15.22:0/2439646610 shutdown_connections 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.164+0000 7f2efe8f3700 1 -- 172.21.15.22:0/2439646610 wait complete. 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.165+0000 7f2efe8f3700 1 Processor -- start 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 -- start start 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ef80c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef80b60e0 0x7f2ef8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef816da90 0x7f2ef816dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef80c8670 con 0x7f2ee4003a90 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef816d360 con 0x7f2ef80b60e0 2023-10-08T00:31:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2efe8f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef816d600 con 0x7f2ef816da90 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ef80c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2ef7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ef80c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50314/0 (socket says 172.21.15.22:50314) 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2ef7fff700 1 -- 172.21.15.22:0/504695925 learned_addr learned my addr 172.21.15.22:0/504695925 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.166+0000 7f2ef77fe700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef80b60e0 0x7f2ef8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2efce90700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef816da90 0x7f2ef816dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2ef7fff700 1 -- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef816da90 msgr2=0x7f2ef816dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef816da90 0x7f2ef816dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2ef7fff700 1 -- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef80b60e0 msgr2=0x7f2ef8156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef80b60e0 0x7f2ef8156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2ef7fff700 1 -- 172.21.15.22:0/504695925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef80ca330 con 0x7f2ee4003a90 2023-10-08T00:31:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2ef7fff700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ef80c9a50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c9b0 tx=0x7f2ee0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000cc90 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000c9e0 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0007510 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef80ca610 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.167+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef80c9f90 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.168+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef80cac20 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.168+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2ee0019030 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.169+0000 7f2eeffff700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ed8067320 0x7f2ed80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.169+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2ee0085f60 con 0x7f2ee4003a90 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.169+0000 7f2ef77fe700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ed8067320 0x7f2ed80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.170+0000 7f2ef77fe700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ed8067320 0x7f2ed80697d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2ef815d4f0 tx=0x7f2ee8007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.174+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ef80cac20 con 0x7f2ee4003a90 2023-10-08T00:31:36.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.450+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2ef80cac20 con 0x7f2ee4003a90 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.450+0000 7f2eeffff700 1 -- 172.21.15.22:0/504695925 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2ef80cac20 con 0x7f2ee4003a90 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.451 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:36.452 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.454 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.455 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.456 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:31:36.457 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:31:36.460 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:31:36.461 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.463 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:31:36.464 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.465 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:36.466 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:31:36.467 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ed8067320 msgr2=0x7f2ed80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ed8067320 0x7f2ed80697d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2ef815d4f0 tx=0x7f2ee8007d10 comp rx=0 tx=0).stop 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 msgr2=0x7f2ef80c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ef80c9a50 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c9b0 tx=0x7f2ee0015000 comp rx=0 tx=0).stop 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 shutdown_connections 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ed8067320 0x7f2ed80697d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ef816da90 0x7f2ef816dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ee4003a90 0x7f2ef80c9a50 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 --2- 172.21.15.22:0/504695925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ef80b60e0 0x7f2ef8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 >> 172.21.15.22:0/504695925 conn(0x7f2ef8068e20 msgr2=0x7f2ef815d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:36.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 shutdown_connections 2023-10-08T00:31:36.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.452+0000 7f2efe8f3700 1 -- 172.21.15.22:0/504695925 wait complete. 2023-10-08T00:31:36.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:36.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.588+0000 7fb7a33e2700 1 Processor -- start 2023-10-08T00:31:36.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.588+0000 7fb7a33e2700 1 -- start start 2023-10-08T00:31:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a33e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159c60 0x7fb79c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a33e2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb79c15db10 0x7fb79c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a33e2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79c15a160 con 0x7fb79c159890 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a33e2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79c0d13a0 con 0x7fb79c15db10 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a33e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c15e140 con 0x7fb79c159c60 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a197f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb79c15db10 0x7fb79c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a117e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb79c159890 0x7fb79c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43232/0 (socket says 172.21.15.22:43232) 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.589+0000 7fb7a117e700 1 -- 172.21.15.22:0/3429971473 learned_addr learned my addr 172.21.15.22:0/3429971473 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb7a097d700 1 --2- 172.21.15.22:0/3429971473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159c60 0x7fb79c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb7a197f700 1 -- 172.21.15.22:0/3429971473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159c60 msgr2=0x7fb79c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb7a197f700 1 --2- 172.21.15.22:0/3429971473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159c60 0x7fb79c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb7a197f700 1 -- 172.21.15.22:0/3429971473 >> v1:172.21.15.22:6789/0 conn(0x7fb79c159890 legacy=0x7fb79c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb79bfff700 1 -- 172.21.15.22:0/3429971473 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786555956 0 0) 0x7fb79c15a160 con 0x7fb79c159890 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb7a197f700 1 -- 172.21.15.22:0/3429971473 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c15a3d0 con 0x7fb79c15db10 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb7a197f700 1 --2- 172.21.15.22:0/3429971473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c15db10 0x7fb79c069560 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb7940098e0 tx=0x7fb7940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf52c18b46f9786 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb79bfff700 1 -- 172.21.15.22:0/3429971473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794009e80 con 0x7fb79c15db10 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb79bfff700 1 -- 172.21.15.22:0/3429971473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79400b860 con 0x7fb79c15db10 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.590+0000 7fb79bfff700 1 -- 172.21.15.22:0/3429971473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400bbe0 con 0x7fb79c15db10 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 -- 172.21.15.22:0/3429971473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c15db10 msgr2=0x7fb79c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/3429971473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c15db10 0x7fb79c069560 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fb7940098e0 tx=0x7fb7940091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 -- 172.21.15.22:0/3429971473 shutdown_connections 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/3429971473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c15db10 0x7fb79c069560 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/3429971473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159c60 0x7fb79c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 -- 172.21.15.22:0/3429971473 >> 172.21.15.22:0/3429971473 conn(0x7fb79c068e20 msgr2=0x7fb79c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:36.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 -- 172.21.15.22:0/3429971473 shutdown_connections 2023-10-08T00:31:36.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.591+0000 7fb7a33e2700 1 -- 172.21.15.22:0/3429971473 wait complete. 2023-10-08T00:31:36.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.592+0000 7fb7a33e2700 1 Processor -- start 2023-10-08T00:31:36.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.592+0000 7fb7a33e2700 1 -- start start 2023-10-08T00:31:36.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159890 0x7fb79c14c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 0x7fb79c149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15db10 0x7fb79c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c152540 con 0x7fb79c159c60 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c151930 con 0x7fb79c15db10 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c151c10 con 0x7fb79c159890 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 0x7fb79c149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 0x7fb79c149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50328/0 (socket says 172.21.15.22:50328) 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 -- 172.21.15.22:0/2884903999 learned_addr learned my addr 172.21.15.22:0/2884903999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a197f700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15db10 0x7fb79c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a117e700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159890 0x7fb79c14c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 -- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159890 msgr2=0x7fb79c14c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159890 0x7fb79c14c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 -- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15db10 msgr2=0x7fb79c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15db10 0x7fb79c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 -- 172.21.15.22:0/2884903999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794009420 con 0x7fb79c159c60 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a117e700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159890 0x7fb79c14c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a097d700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 0x7fb79c149e50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb79000d890 tx=0x7fb790008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7900125f0 con 0x7fb79c159c60 2023-10-08T00:31:36.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb790012770 con 0x7fb79c159c60 2023-10-08T00:31:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c151ef0 con 0x7fb79c159c60 2023-10-08T00:31:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790012b30 con 0x7fb79c159c60 2023-10-08T00:31:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.593+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c14c930 con 0x7fb79c159c60 2023-10-08T00:31:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.594+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c1526f0 con 0x7fb79c159c60 2023-10-08T00:31:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.595+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb79001e460 con 0x7fb79c159c60 2023-10-08T00:31:36.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.595+0000 7fb7997fa700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb788067350 0x7fb788069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.595+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb790084fc0 con 0x7fb79c159c60 2023-10-08T00:31:36.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.595+0000 7fb7a117e700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb788067350 0x7fb788069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.596+0000 7fb7a117e700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb788067350 0x7fb788069800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb78c001560 tx=0x7fb78c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.599+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb79c1526f0 con 0x7fb79c159c60 2023-10-08T00:31:36.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.798+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb79c1526f0 con 0x7fb79c159c60 2023-10-08T00:31:36.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.798+0000 7fb7997fa700 1 -- 172.21.15.22:0/2884903999 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+12144 (secure 0 0 0) 0x7fb79c1526f0 con 0x7fb79c159c60 2023-10-08T00:31:36.799 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:36.799 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":110,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:36.016758+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:36.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb788067350 msgr2=0x7fb788069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb788067350 0x7fb788069800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb78c001560 tx=0x7fb78c009040 comp rx=0 tx=0).stop 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 msgr2=0x7fb79c149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 0x7fb79c149e50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb79000d890 tx=0x7fb790008040 comp rx=0 tx=0).stop 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 shutdown_connections 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb79c15db10 0x7fb79c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb788067350 0x7fb788069800 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb79c159890 0x7fb79c14c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 --2- 172.21.15.22:0/2884903999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c159c60 0x7fb79c149e50 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 >> 172.21.15.22:0/2884903999 conn(0x7fb79c068e20 msgr2=0x7fb79c14d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:36.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 shutdown_connections 2023-10-08T00:31:36.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.801+0000 7fb7a33e2700 1 -- 172.21.15.22:0/2884903999 wait complete. 2023-10-08T00:31:36.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:31:36.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:31:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.938+0000 7f355c733700 1 Processor -- start 2023-10-08T00:31:36.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.938+0000 7f355c733700 1 -- start start 2023-10-08T00:31:36.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.938+0000 7f355c733700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f35540637d0 0x7f355406b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.938+0000 7f355c733700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540ac450 con 0x7f355406a2b0 2023-10-08T00:31:36.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f355c733700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3554069d00 con 0x7f355406b160 2023-10-08T00:31:36.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f355c733700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540693d0 con 0x7f35540637d0 2023-10-08T00:31:36.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f355acd0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f355406a2b0 0x7f355406a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52488/0 (socket says 172.21.15.22:52488) 2023-10-08T00:31:36.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f355acd0700 1 -- 172.21.15.22:0/1255329817 learned_addr learned my addr 172.21.15.22:0/1255329817 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:36.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f3559cce700 1 --2- 172.21.15.22:0/1255329817 >> v2:172.21.15.192:3300/0 conn(0x7f35540637d0 0x7f355406b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869331732 0 0) 0x7f35540ac450 con 0x7f355406a2b0 2023-10-08T00:31:36.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353c003570 con 0x7f355406a2b0 2023-10-08T00:31:36.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 788006044 0 0) 0x7f353c003570 con 0x7f355406a2b0 2023-10-08T00:31:36.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 >> v2:172.21.15.192:3300/0 conn(0x7f35540637d0 msgr2=0x7f355406b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 --2- 172.21.15.22:0/1255329817 >> v2:172.21.15.192:3300/0 conn(0x7f35540637d0 0x7f355406b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 >> v1:172.21.15.192:6789/0 conn(0x7f355406b160 legacy=0x7f3554068cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554068830 con 0x7f355406a2b0 2023-10-08T00:31:36.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f35440017f0 con 0x7f355406a2b0 2023-10-08T00:31:36.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 >> v1:172.21.15.22:6789/0 conn(0x7f355406a2b0 legacy=0x7f355406a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f353c003a60 0x7f353c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f353c004810 0x7f353c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c0051c0 0x7f353c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540693d0 con 0x7f353c004810 2023-10-08T00:31:36.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00c1e0 con 0x7f353c0051c0 2023-10-08T00:31:36.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00c3a0 con 0x7f353c003a60 2023-10-08T00:31:36.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.939+0000 7f3559cce700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f353c004810 0x7f353c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f355acd0700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c0051c0 0x7f353c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f355a4cf700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f353c003a60 0x7f353c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f3559cce700 1 -- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f353c003a60 msgr2=0x7f353c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f3559cce700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f353c003a60 0x7f353c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f3559cce700 1 -- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c0051c0 msgr2=0x7f353c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:36.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f3559cce700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c0051c0 0x7f353c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f3559cce700 1 -- 172.21.15.22:0/1255329817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c003570 con 0x7f353c004810 2023-10-08T00:31:36.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f355acd0700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c0051c0 0x7f353c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f355acd0700 1 -- 172.21.15.22:0/1255329817 reap_dead start 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f3559cce700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f353c004810 0x7f353c004c80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f3548006f00 tx=0x7f35480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3f507f7080dec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800e710 con 0x7f353c004810 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354800e870 con 0x7f353c004810 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.940+0000 7f35594cd700 1 -- 172.21.15.22:0/1255329817 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800ec30 con 0x7f353c004810 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 -- 172.21.15.22:0/1255329817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f353c004810 msgr2=0x7f353c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f353c004810 0x7f353c004c80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f3548006f00 tx=0x7f35480091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 -- 172.21.15.22:0/1255329817 shutdown_connections 2023-10-08T00:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 --2- 172.21.15.22:0/1255329817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f353c004810 0x7f353c004c80 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 -- 172.21.15.22:0/1255329817 >> 172.21.15.22:0/1255329817 conn(0x7f355406ded0 msgr2=0x7f355406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 -- 172.21.15.22:0/1255329817 shutdown_connections 2023-10-08T00:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.941+0000 7f355c733700 1 -- 172.21.15.22:0/1255329817 wait complete. 2023-10-08T00:31:36.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.942+0000 7f355c733700 1 Processor -- start 2023-10-08T00:31:36.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.942+0000 7f355c733700 1 -- start start 2023-10-08T00:31:36.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c004810 0x7f3554150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35541424d0 0x7f3554169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 0x7f355416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355414f7f0 con 0x7f3554142940 2023-10-08T00:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540b0b10 con 0x7f353c004810 2023-10-08T00:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540b0df0 con 0x7f35541424d0 2023-10-08T00:31:36.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 0x7f355416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 0x7f355416a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53750/0 (socket says 172.21.15.22:53750) 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 -- 172.21.15.22:0/2747198264 learned_addr learned my addr 172.21.15.22:0/2747198264 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f3559cce700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35541424d0 0x7f3554169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355a4cf700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c004810 0x7f3554150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 -- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35541424d0 msgr2=0x7f3554169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35541424d0 0x7f3554169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 -- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c004810 msgr2=0x7f3554150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c004810 0x7f3554150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 -- 172.21.15.22:0/2747198264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540b10d0 con 0x7f3554142940 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f3559cce700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35541424d0 0x7f3554169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355acd0700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 0x7f355416a520 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f35540abdd0 tx=0x7f355415afa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400ebc0 con 0x7f3554142940 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400ed20 con 0x7f3554142940 2023-10-08T00:31:36.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35540b13b0 con 0x7f3554142940 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.943+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544013670 con 0x7f3554142940 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.944+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3554151530 con 0x7f3554142940 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.945+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355404c3c0 con 0x7f3554142940 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.945+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3544013a20 con 0x7f3554142940 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.945+0000 7f35527fc700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3540067320 0x7f35400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.945+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3544084ea0 con 0x7f3554142940 2023-10-08T00:31:36.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.946+0000 7f355a4cf700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3540067320 0x7f35400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.946+0000 7f355a4cf700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3540067320 0x7f35400697d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f354c000f60 tx=0x7f354c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:36.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:36.949+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3544051e80 con 0x7f3554142940 2023-10-08T00:31:37.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.141+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3554069740 con 0x7f3554142940 2023-10-08T00:31:37.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.141+0000 7f35527fc700 1 -- 172.21.15.22:0/2747198264 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35440554a0 con 0x7f3554142940 2023-10-08T00:31:37.143 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:31:37.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3540067320 msgr2=0x7f35400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3540067320 0x7f35400697d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f354c000f60 tx=0x7f354c009040 comp rx=0 tx=0).stop 2023-10-08T00:31:37.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 msgr2=0x7f355416a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 0x7f355416a520 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f35540abdd0 tx=0x7f355415afa0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 shutdown_connections 2023-10-08T00:31:37.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3554142940 0x7f355416a520 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f353c004810 0x7f3554150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3540067320 0x7f35400697d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 --2- 172.21.15.22:0/2747198264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f35541424d0 0x7f3554169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 >> 172.21.15.22:0/2747198264 conn(0x7f355406ded0 msgr2=0x7f35540ac820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:37.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 shutdown_connections 2023-10-08T00:31:37.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.143+0000 7f355c733700 1 -- 172.21.15.22:0/2747198264 wait complete. 2023-10-08T00:31:37.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:31:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.276+0000 7fdd6db63700 1 Processor -- start 2023-10-08T00:31:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.276+0000 7fdd6db63700 1 -- start start 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd6db63700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdd680b1e50 0x7fdd68159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd6db63700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680cfe20 con 0x7fdd680ceaa0 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd6db63700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680cf210 con 0x7fdd681593b0 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd6db63700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd680cf4f0 con 0x7fdd680b1e50 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd6d362700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdd680ceaa0 0x7fdd680b3420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52494/0 (socket says 172.21.15.22:52494) 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd6d362700 1 -- 172.21.15.22:0/678676618 learned_addr learned my addr 172.21.15.22:0/678676618 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd67fff700 1 --2- 172.21.15.22:0/678676618 >> v2:172.21.15.192:3300/0 conn(0x7fdd680b1e50 0x7fdd68159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730716626 0 0) 0x7fdd680cfe20 con 0x7fdd680ceaa0 2023-10-08T00:31:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.277+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd58003570 con 0x7fdd680ceaa0 2023-10-08T00:31:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217445263 0 0) 0x7fdd58003570 con 0x7fdd680ceaa0 2023-10-08T00:31:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 >> v2:172.21.15.192:3300/0 conn(0x7fdd680b1e50 msgr2=0x7fdd68159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 --2- 172.21.15.22:0/678676618 >> v2:172.21.15.192:3300/0 conn(0x7fdd680b1e50 0x7fdd68159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 >> v1:172.21.15.192:6789/0 conn(0x7fdd681593b0 legacy=0x7fdd680b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd680cf7d0 con 0x7fdd680ceaa0 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fdd600017f0 con 0x7fdd680ceaa0 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 >> v1:172.21.15.22:6789/0 conn(0x7fdd680ceaa0 legacy=0x7fdd680b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd58003a60 0x7fdd58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58004810 0x7fdd58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd580051c0 0x7fdd5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680cf4f0 con 0x7fdd58003a60 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5800c130 con 0x7fdd580051c0 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5800c2f0 con 0x7fdd58004810 2023-10-08T00:31:37.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd58003a60 0x7fdd58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6d362700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd580051c0 0x7fdd5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd67fff700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58004810 0x7fdd58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 -- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58004810 msgr2=0x7fdd58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58004810 0x7fdd58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 -- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd580051c0 msgr2=0x7fdd5800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd580051c0 0x7fdd5800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6d362700 1 -- 172.21.15.22:0/678676618 reap_dead start 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 -- 172.21.15.22:0/678676618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58003570 con 0x7fdd58003a60 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd58003a60 0x7fdd58003e30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c001970 tx=0x7fdd5c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0cc1320e8ccad3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00c5d0 con 0x7fdd58003a60 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.278+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00c750 con 0x7fdd58003a60 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd677fe700 1 -- 172.21.15.22:0/678676618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00cb10 con 0x7fdd58003a60 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 -- 172.21.15.22:0/678676618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd58003a60 msgr2=0x7fdd58003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd58003a60 0x7fdd58003e30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c001970 tx=0x7fdd5c007d10 comp rx=0 tx=0).stop 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 -- 172.21.15.22:0/678676618 shutdown_connections 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 --2- 172.21.15.22:0/678676618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd58003a60 0x7fdd58003e30 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 -- 172.21.15.22:0/678676618 >> 172.21.15.22:0/678676618 conn(0x7fdd680d1130 msgr2=0x7fdd680b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 -- 172.21.15.22:0/678676618 shutdown_connections 2023-10-08T00:31:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.279+0000 7fdd6db63700 1 -- 172.21.15.22:0/678676618 wait complete. 2023-10-08T00:31:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.280+0000 7fdd6db63700 1 Processor -- start 2023-10-08T00:31:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.280+0000 7fdd6db63700 1 -- start start 2023-10-08T00:31:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6db63700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58003a60 0x7fdd6814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6db63700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 0x7fdd68154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6db63700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd68156420 0x7fdd68156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6db63700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6815a110 con 0x7fdd68154640 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6db63700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd681509c0 con 0x7fdd68156420 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6db63700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68156d90 con 0x7fdd58003a60 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 0x7fdd68154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 0x7fdd68154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53762/0 (socket says 172.21.15.22:53762) 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 -- 172.21.15.22:0/737251594 learned_addr learned my addr 172.21.15.22:0/737251594 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58003a60 0x7fdd6814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6d362700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd68156420 0x7fdd68156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 -- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58003a60 msgr2=0x7fdd6814d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58003a60 0x7fdd6814d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 -- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd68156420 msgr2=0x7fdd68156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd68156420 0x7fdd68156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd67fff700 1 -- 172.21.15.22:0/737251594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68159820 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58003a60 0x7fdd6814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.281+0000 7fdd6d362700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd68156420 0x7fdd68156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.282+0000 7fdd67fff700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 0x7fdd68154ab0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdd54011d40 tx=0x7fdd540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.282+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400fac0 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.282+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400fc20 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.282+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6814ddc0 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.282+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54014440 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.282+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd68159da0 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.283+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6804c3c0 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.283+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdd54014a80 con 0x7fdd68154640 2023-10-08T00:31:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.284+0000 7fdd64ff9700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd4c067320 0x7fdd4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.284+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdd54018030 con 0x7fdd68154640 2023-10-08T00:31:37.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.284+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd4c067320 0x7fdd4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.284+0000 7fdd6cb61700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd4c067320 0x7fdd4c0697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000ff0 tx=0x7fdd5c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:37.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.288+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd54052600 con 0x7fdd68154640 2023-10-08T00:31:37.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.484+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd680cfab0 con 0x7fdd68154640 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.484+0000 7fdd64ff9700 1 -- 172.21.15.22:0/737251594 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdd54022090 con 0x7fdd68154640 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:37.485 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:31:37.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd4c067320 msgr2=0x7fdd4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd4c067320 0x7fdd4c0697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000ff0 tx=0x7fdd5c015000 comp rx=0 tx=0).stop 2023-10-08T00:31:37.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 msgr2=0x7fdd68154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 0x7fdd68154ab0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdd54011d40 tx=0x7fdd540091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 shutdown_connections 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd68156420 0x7fdd68156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd4c067320 0x7fdd4c0697d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd58003a60 0x7fdd6814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 --2- 172.21.15.22:0/737251594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd68154640 0x7fdd68154ab0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 >> 172.21.15.22:0/737251594 conn(0x7fdd680d1130 msgr2=0x7fdd680af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:37.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.486+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 shutdown_connections 2023-10-08T00:31:37.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.487+0000 7fdd6db63700 1 -- 172.21.15.22:0/737251594 wait complete. 2023-10-08T00:31:37.499 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:31:37.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:31:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.622+0000 7f7e9d88f700 1 Processor -- start 2023-10-08T00:31:37.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.622+0000 7f7e9d88f700 1 -- start start 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e9d88f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e98159ec0 0x7f7e980b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e9d88f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e980b53d0 0x7f7e980cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e9d88f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980b5b00 con 0x7f7e980cce40 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e9d88f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980b5850 con 0x7f7e98159ec0 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e9d88f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980b5da0 con 0x7f7e980b53d0 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e98159ec0 0x7f7e980b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7e98159ec0 0x7f7e980b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53774/0 (socket says 172.21.15.22:53774) 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 -- 172.21.15.22:0/2404624247 learned_addr learned my addr 172.21.15.22:0/2404624247 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e967fc700 1 --2- 172.21.15.22:0/2404624247 >> v2:172.21.15.192:3300/0 conn(0x7f7e980b53d0 0x7f7e980cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 -- 172.21.15.22:0/2404624247 >> v2:172.21.15.192:3300/0 conn(0x7f7e980b53d0 msgr2=0x7f7e980cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:37.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 --2- 172.21.15.22:0/2404624247 >> v2:172.21.15.192:3300/0 conn(0x7f7e980b53d0 0x7f7e980cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 -- 172.21.15.22:0/2404624247 >> v1:172.21.15.192:6789/0 conn(0x7f7e980cce40 legacy=0x7f7e980cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 -- 172.21.15.22:0/2404624247 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980b6080 con 0x7f7e98159ec0 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.623+0000 7f7e96ffd700 1 --2- 172.21.15.22:0/2404624247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98159ec0 0x7f7e980b4e90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b64d0 tx=0x7f7e90009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e854fe66a83711 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e95ffb700 1 -- 172.21.15.22:0/2404624247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90005c10 con 0x7f7e98159ec0 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e95ffb700 1 -- 172.21.15.22:0/2404624247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90005d70 con 0x7f7e98159ec0 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e95ffb700 1 -- 172.21.15.22:0/2404624247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9000b840 con 0x7f7e98159ec0 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 -- 172.21.15.22:0/2404624247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98159ec0 msgr2=0x7f7e980b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/2404624247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98159ec0 0x7f7e980b4e90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b64d0 tx=0x7f7e90009220 comp rx=0 tx=0).stop 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 -- 172.21.15.22:0/2404624247 shutdown_connections 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/2404624247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e98159ec0 0x7f7e980b4e90 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/2404624247 >> v2:172.21.15.192:3300/0 conn(0x7f7e980b53d0 0x7f7e980cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 -- 172.21.15.22:0/2404624247 >> 172.21.15.22:0/2404624247 conn(0x7f7e980999f0 msgr2=0x7f7e980b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 -- 172.21.15.22:0/2404624247 shutdown_connections 2023-10-08T00:31:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.624+0000 7f7e9d88f700 1 -- 172.21.15.22:0/2404624247 wait complete. 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.625+0000 7f7e9d88f700 1 Processor -- start 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.625+0000 7f7e9d88f700 1 -- start start 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e9d88f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 0x7f7e9816dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e9d88f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e980cce40 0x7f7e9806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e9d88f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e98159ec0 0x7f7e9814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e9d88f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9816e120 con 0x7f7e980b53d0 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e9d88f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9806a2e0 con 0x7f7e98159ec0 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e9d88f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9806acb0 con 0x7f7e980cce40 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e96ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 0x7f7e9816dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e96ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 0x7f7e9816dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53780/0 (socket says 172.21.15.22:53780) 2023-10-08T00:31:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e96ffd700 1 -- 172.21.15.22:0/861599469 learned_addr learned my addr 172.21.15.22:0/861599469 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e967fc700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e980cce40 0x7f7e9806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.626+0000 7f7e977fe700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e98159ec0 0x7f7e9814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e96ffd700 1 -- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e980cce40 msgr2=0x7f7e9806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e96ffd700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e980cce40 0x7f7e9806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e96ffd700 1 -- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e98159ec0 msgr2=0x7f7e9814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e96ffd700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e98159ec0 0x7f7e9814b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e96ffd700 1 -- 172.21.15.22:0/861599469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009480 con 0x7f7e980b53d0 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e96ffd700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 0x7f7e9816dbe0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7e900030c0 tx=0x7f7e90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e90011a10 con 0x7f7e980b53d0 2023-10-08T00:31:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e90011b90 con 0x7f7e980b53d0 2023-10-08T00:31:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980696d0 con 0x7f7e980b53d0 2023-10-08T00:31:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9001d430 con 0x7f7e980b53d0 2023-10-08T00:31:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.627+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e98069c90 con 0x7f7e980b53d0 2023-10-08T00:31:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.628+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e98063c90 con 0x7f7e980b53d0 2023-10-08T00:31:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.628+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7e9001d820 con 0x7f7e980b53d0 2023-10-08T00:31:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.629+0000 7f7e8effd700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e78067320 0x7f7e780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.629+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7e90086b40 con 0x7f7e980b53d0 2023-10-08T00:31:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.629+0000 7f7e967fc700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e78067320 0x7f7e780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.630+0000 7f7e967fc700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e78067320 0x7f7e780697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7e9815f7a0 tx=0x7f7e80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.633+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e90053b20 con 0x7f7e980b53d0 2023-10-08T00:31:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:37.826+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7e9806a5c0 con 0x7f7e980b53d0 2023-10-08T00:31:38.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.027+0000 7f7e8effd700 1 -- 172.21.15.22:0/861599469 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7e90057140 con 0x7f7e980b53d0 2023-10-08T00:31:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.031+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e78067320 msgr2=0x7f7e780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.031+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e78067320 0x7f7e780697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7e9815f7a0 tx=0x7f7e80008040 comp rx=0 tx=0).stop 2023-10-08T00:31:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.031+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 msgr2=0x7f7e9816dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:38.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.031+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 0x7f7e9816dbe0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f7e900030c0 tx=0x7f7e90015000 comp rx=0 tx=0).stop 2023-10-08T00:31:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.032+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 shutdown_connections 2023-10-08T00:31:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.032+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e98159ec0 0x7f7e9814b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.032+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e980b53d0 0x7f7e9816dbe0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.032+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e78067320 0x7f7e780697d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.032+0000 7f7e9d88f700 1 --2- 172.21.15.22:0/861599469 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7e980cce40 0x7f7e9806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.032+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 >> 172.21.15.22:0/861599469 conn(0x7f7e980999f0 msgr2=0x7f7e980b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.033+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 shutdown_connections 2023-10-08T00:31:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.034+0000 7f7e9d88f700 1 -- 172.21.15.22:0/861599469 wait complete. 2023-10-08T00:31:38.035 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:31:38.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:31:38.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.172+0000 7f6f2c6ee700 1 Processor -- start 2023-10-08T00:31:38.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.172+0000 7f6f2c6ee700 1 -- start start 2023-10-08T00:31:38.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f2c6ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f24069c70 0x7f6f240cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:38.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f2c6ee700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240ce380 con 0x7f6f240af320 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f2c6ee700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240cec20 con 0x7f6f24159950 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f2c6ee700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240afa90 con 0x7f6f24069c70 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f29c89700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f24069c70 0x7f6f240cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f2ac8b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6f240af320 0x7f6f240cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52500/0 (socket says 172.21.15.22:52500) 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.173+0000 7f6f2ac8b700 1 -- 172.21.15.22:0/3898687100 learned_addr learned my addr 172.21.15.22:0/3898687100 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29c89700 1 -- 172.21.15.22:0/3898687100 >> v1:172.21.15.192:6789/0 conn(0x7f6f24159950 legacy=0x7f6f24069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29c89700 1 -- 172.21.15.22:0/3898687100 >> v1:172.21.15.22:6789/0 conn(0x7f6f240af320 legacy=0x7f6f240cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29c89700 1 -- 172.21.15.22:0/3898687100 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240ce5d0 con 0x7f6f24069c70 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29488700 1 -- 172.21.15.22:0/3898687100 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885590238 0 0) 0x7f6f240ce380 con 0x7f6f240af320 2023-10-08T00:31:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29c89700 1 --2- 172.21.15.22:0/3898687100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f240cbb90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6f180098e0 tx=0x7f6f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408ceb8cc54644ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29488700 1 -- 172.21.15.22:0/3898687100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18009e80 con 0x7f6f24069c70 2023-10-08T00:31:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29488700 1 -- 172.21.15.22:0/3898687100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800b820 con 0x7f6f24069c70 2023-10-08T00:31:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f29488700 1 -- 172.21.15.22:0/3898687100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800bba0 con 0x7f6f24069c70 2023-10-08T00:31:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/3898687100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 msgr2=0x7f6f240cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.174+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/3898687100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f240cbb90 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6f180098e0 tx=0x7f6f180091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.175+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/3898687100 shutdown_connections 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.175+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/3898687100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f240cbb90 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.175+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/3898687100 >> 172.21.15.22:0/3898687100 conn(0x7f6f24068e00 msgr2=0x7f6f240d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.175+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/3898687100 shutdown_connections 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.175+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/3898687100 wait complete. 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.176+0000 7f6f2c6ee700 1 Processor -- start 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.176+0000 7f6f2c6ee700 1 -- start start 2023-10-08T00:31:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.176+0000 7f6f2c6ee700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f2414d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.176+0000 7f6f2c6ee700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f240af320 0x7f6f240b0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2c6ee700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24159950 0x7f6f240b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2c6ee700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b5990 con 0x7f6f24069c70 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2c6ee700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240b5e20 con 0x7f6f24159950 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2c6ee700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f24155f30 con 0x7f6f240af320 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f2414d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f2414d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53802/0 (socket says 172.21.15.22:53802) 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 -- 172.21.15.22:0/2145421846 learned_addr learned my addr 172.21.15.22:0/2145421846 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2ac8b700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24159950 0x7f6f240b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f29c89700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f240af320 0x7f6f240b0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 -- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f240af320 msgr2=0x7f6f240b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f240af320 0x7f6f240b0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 -- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24159950 msgr2=0x7f6f240b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24159950 0x7f6f240b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 -- 172.21.15.22:0/2145421846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009420 con 0x7f6f24069c70 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2a48a700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f2414d090 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b5e0 tx=0x7f6f1c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00f510 con 0x7f6f24069c70 2023-10-08T00:31:38.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00f670 con 0x7f6f24069c70 2023-10-08T00:31:38.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00fa30 con 0x7f6f24069c70 2023-10-08T00:31:38.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f240b4d80 con 0x7f6f24069c70 2023-10-08T00:31:38.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.177+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f240b5340 con 0x7f6f24069c70 2023-10-08T00:31:38.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.178+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f240b5c70 con 0x7f6f24069c70 2023-10-08T00:31:38.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.179+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6f1c024430 con 0x7f6f24069c70 2023-10-08T00:31:38.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.179+0000 7f6f227fc700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f10067320 0x7f6f100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:38.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.179+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6f1c0850a0 con 0x7f6f24069c70 2023-10-08T00:31:38.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.180+0000 7f6f29c89700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f10067320 0x7f6f100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:38.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.180+0000 7f6f29c89700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f10067320 0x7f6f100697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6f180030c0 tx=0x7f6f18016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:38.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.183+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f1c052140 con 0x7f6f24069c70 2023-10-08T00:31:38.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:38.377+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6f240718b0 con 0x7f6f24069c70 2023-10-08T00:31:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.034+0000 7f6f227fc700 1 -- 172.21.15.22:0/2145421846 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6f1c055760 con 0x7f6f24069c70 2023-10-08T00:31:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.040+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f10067320 msgr2=0x7f6f100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.040+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f10067320 0x7f6f100697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6f180030c0 tx=0x7f6f18016000 comp rx=0 tx=0).stop 2023-10-08T00:31:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.040+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 msgr2=0x7f6f2414d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.040+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f2414d090 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b5e0 tx=0x7f6f1c009120 comp rx=0 tx=0).stop 2023-10-08T00:31:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.041+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 shutdown_connections 2023-10-08T00:31:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.041+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f24159950 0x7f6f240b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.041+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f24069c70 0x7f6f2414d090 secure :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b5e0 tx=0x7f6f1c009120 comp rx=0 tx=0).stop 2023-10-08T00:31:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.041+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f10067320 0x7f6f100697d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.041+0000 7f6f2c6ee700 1 --2- 172.21.15.22:0/2145421846 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f240af320 0x7f6f240b0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.041+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 >> 172.21.15.22:0/2145421846 conn(0x7f6f24068e00 msgr2=0x7f6f24069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.042+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 shutdown_connections 2023-10-08T00:31:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.042+0000 7f6f2c6ee700 1 -- 172.21.15.22:0/2145421846 wait complete. 2023-10-08T00:31:39.051 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:31:39.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:31:39.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.190+0000 7fbeef120700 1 Processor -- start 2023-10-08T00:31:39.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.190+0000 7fbeef120700 1 -- start start 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeef120700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeef120700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbee80b1b40 0x7fbee815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeef120700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee80cfb00 con 0x7fbee80b16d0 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeef120700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee80b5c40 con 0x7fbee80b1b40 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeef120700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80b5f20 con 0x7fbee80b4e70 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee91f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbee80b1b40 0x7fbee815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee91f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbee80b1b40 0x7fbee815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53818/0 (socket says 172.21.15.22:53818) 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee91f700 1 -- 172.21.15.22:0/1193506428 learned_addr learned my addr 172.21.15.22:0/1193506428 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee11e700 1 --2- 172.21.15.22:0/1193506428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee91f700 1 -- 172.21.15.22:0/1193506428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 msgr2=0x7fbee80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee91f700 1 --2- 172.21.15.22:0/1193506428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.191+0000 7fbeee91f700 1 -- 172.21.15.22:0/1193506428 >> v1:172.21.15.192:6789/0 conn(0x7fbee80b16d0 legacy=0x7fbee815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeee91f700 1 -- 172.21.15.22:0/1193506428 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee80b6200 con 0x7fbee80b1b40 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeee91f700 1 --2- 172.21.15.22:0/1193506428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b1b40 0x7fbee815d950 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009f20 tx=0x7fbed8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9226bd40120cd5f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeed11c700 1 -- 172.21.15.22:0/1193506428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed800e070 con 0x7fbee80b1b40 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeed11c700 1 -- 172.21.15.22:0/1193506428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed800b9d0 con 0x7fbee80b1b40 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeed11c700 1 -- 172.21.15.22:0/1193506428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80092e0 con 0x7fbee80b1b40 2023-10-08T00:31:39.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 -- 172.21.15.22:0/1193506428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b1b40 msgr2=0x7fbee815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 --2- 172.21.15.22:0/1193506428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b1b40 0x7fbee815d950 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fbed8009f20 tx=0x7fbed8009840 comp rx=0 tx=0).stop 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 -- 172.21.15.22:0/1193506428 shutdown_connections 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 --2- 172.21.15.22:0/1193506428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b1b40 0x7fbee815d950 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 --2- 172.21.15.22:0/1193506428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 -- 172.21.15.22:0/1193506428 >> 172.21.15.22:0/1193506428 conn(0x7fbee80d10c0 msgr2=0x7fbee80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 -- 172.21.15.22:0/1193506428 shutdown_connections 2023-10-08T00:31:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.192+0000 7fbeef120700 1 -- 172.21.15.22:0/1193506428 wait complete. 2023-10-08T00:31:39.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.193+0000 7fbeef120700 1 Processor -- start 2023-10-08T00:31:39.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 -- start start 2023-10-08T00:31:39.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 0x7fbee80c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:39.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee80b1b40 0x7fbee8156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:39.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:39.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee8144be0 con 0x7fbee80b16d0 2023-10-08T00:31:39.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80c7060 con 0x7fbee80b1b40 2023-10-08T00:31:39.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeef120700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee80c6730 con 0x7fbee80b4e70 2023-10-08T00:31:39.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeee11e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 0x7fbee80c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:39.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeee11e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 0x7fbee80c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53826/0 (socket says 172.21.15.22:53826) 2023-10-08T00:31:39.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeee11e700 1 -- 172.21.15.22:0/2679874999 learned_addr learned my addr 172.21.15.22:0/2679874999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:39.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeee91f700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:39.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.194+0000 7fbeed91d700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee80b1b40 0x7fbee8156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:39.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeee11e700 1 -- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 msgr2=0x7fbee80cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:39.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeee11e700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeee11e700 1 -- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee80b1b40 msgr2=0x7fbee8156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:39.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeee11e700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee80b1b40 0x7fbee8156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:39.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeee11e700 1 -- 172.21.15.22:0/2679874999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed8009ae0 con 0x7fbee80b16d0 2023-10-08T00:31:39.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeee11e700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 0x7fbee80c9760 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fbee000e930 tx=0x7fbee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:39.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0013680 con 0x7fbee80b16d0 2023-10-08T00:31:39.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee00137e0 con 0x7fbee80b16d0 2023-10-08T00:31:39.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee80c6a10 con 0x7fbee80b16d0 2023-10-08T00:31:39.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0013b80 con 0x7fbee80b16d0 2023-10-08T00:31:39.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.195+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee80cbfb0 con 0x7fbee80b16d0 2023-10-08T00:31:39.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.196+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee80c7340 con 0x7fbee80b16d0 2023-10-08T00:31:39.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.197+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbee001c450 con 0x7fbee80b16d0 2023-10-08T00:31:39.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.197+0000 7fbee67fc700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbed4067320 0x7fbed40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:39.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.197+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fbee0084c70 con 0x7fbee80b16d0 2023-10-08T00:31:39.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.197+0000 7fbeed91d700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbed4067320 0x7fbed40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:39.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.198+0000 7fbeed91d700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbed4067320 0x7fbed40697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbee815eb90 tx=0x7fbedc007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:39.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.202+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbee0051960 con 0x7fbee80b16d0 2023-10-08T00:31:39.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:39.443+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbee804bb80 con 0x7fbee80b16d0 2023-10-08T00:31:40.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.034+0000 7fbee67fc700 1 -- 172.21.15.22:0/2679874999 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbee0054f80 con 0x7fbee80b16d0 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbed4067320 msgr2=0x7fbed40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbed4067320 0x7fbed40697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbee815eb90 tx=0x7fbedc007ec0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 msgr2=0x7fbee80c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 0x7fbee80c9760 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fbee000e930 tx=0x7fbee00091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 shutdown_connections 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbed4067320 0x7fbed40697d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbee80b4e70 0x7fbee80cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbee80b16d0 0x7fbee80c9760 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 --2- 172.21.15.22:0/2679874999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbee80b1b40 0x7fbee8156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 >> 172.21.15.22:0/2679874999 conn(0x7fbee80d10c0 msgr2=0x7fbee8159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 shutdown_connections 2023-10-08T00:31:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.038+0000 7fbeef120700 1 -- 172.21.15.22:0/2679874999 wait complete. 2023-10-08T00:31:40.042 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 18 and data pool 19 2023-10-08T00:31:40.055 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:40.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.174+0000 7f460cc59700 1 Processor -- start 2023-10-08T00:31:40.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.174+0000 7f460cc59700 1 -- start start 2023-10-08T00:31:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.175+0000 7f460cc59700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4608068550 0x7f4608068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.175+0000 7f460cc59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460815e010 0x7f460806f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.175+0000 7f460cc59700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460806ec70 con 0x7f460806f640 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.175+0000 7f460cc59700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080b3430 con 0x7f4608068550 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.175+0000 7f460cc59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b2e70 con 0x7f460815e010 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4608068550 0x7f4608068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4608068550 0x7f4608068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53834/0 (socket says 172.21.15.22:53834) 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 -- 172.21.15.22:0/3703333415 learned_addr learned my addr 172.21.15.22:0/3703333415 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f4605d9b700 1 --2- 172.21.15.22:0/3703333415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460815e010 0x7f460806f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 -- 172.21.15.22:0/3703333415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460815e010 msgr2=0x7f460806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 --2- 172.21.15.22:0/3703333415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460815e010 0x7f460806f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 -- 172.21.15.22:0/3703333415 >> v1:172.21.15.192:6789/0 conn(0x7f460806f640 legacy=0x7f460806a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 -- 172.21.15.22:0/3703333415 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080b3150 con 0x7f4608068550 2023-10-08T00:31:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460659c700 1 --2- 172.21.15.22:0/3703333415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f4608068920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4600009f20 tx=0x7f4600009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c35bc9b874720 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460559a700 1 -- 172.21.15.22:0/3703333415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460000e070 con 0x7f4608068550 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460559a700 1 -- 172.21.15.22:0/3703333415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460000ba80 con 0x7f4608068550 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.176+0000 7f460559a700 1 -- 172.21.15.22:0/3703333415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000092e0 con 0x7f4608068550 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 -- 172.21.15.22:0/3703333415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 msgr2=0x7f4608068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 --2- 172.21.15.22:0/3703333415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f4608068920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4600009f20 tx=0x7f4600009840 comp rx=0 tx=0).stop 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 -- 172.21.15.22:0/3703333415 shutdown_connections 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 --2- 172.21.15.22:0/3703333415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f4608068920 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 --2- 172.21.15.22:0/3703333415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460815e010 0x7f460806f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 -- 172.21.15.22:0/3703333415 >> 172.21.15.22:0/3703333415 conn(0x7f46080cd480 msgr2=0x7f46080cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 -- 172.21.15.22:0/3703333415 shutdown_connections 2023-10-08T00:31:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.177+0000 7f460cc59700 1 -- 172.21.15.22:0/3703333415 wait complete. 2023-10-08T00:31:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.178+0000 7f460cc59700 1 Processor -- start 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.178+0000 7f460cc59700 1 -- start start 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f460816afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460806f640 0x7f460813efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f460815e010 0x7f46080ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460814b4e0 con 0x7f4608068550 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460814a8d0 con 0x7f460815e010 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460814abb0 con 0x7f460806f640 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f460816afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f460816afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53844/0 (socket says 172.21.15.22:53844) 2023-10-08T00:31:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 -- 172.21.15.22:0/3657327361 learned_addr learned my addr 172.21.15.22:0/3657327361 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 -- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460806f640 msgr2=0x7f460813efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460806f640 0x7f460813efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 -- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f460815e010 msgr2=0x7f46080ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f460815e010 0x7f46080ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 -- 172.21.15.22:0/3657327361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4600009ae0 con 0x7f4608068550 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460659c700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f460816afc0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4600009430 tx=0x7f4600018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600008b70 con 0x7f4608068550 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600008cd0 con 0x7f4608068550 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000266b0 con 0x7f4608068550 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460814ae90 con 0x7f4608068550 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.179+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460813f520 con 0x7f4608068550 2023-10-08T00:31:40.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.180+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460804c3c0 con 0x7f4608068550 2023-10-08T00:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.181+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4600003040 con 0x7f4608068550 2023-10-08T00:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.181+0000 7f45fe7fc700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45e8067320 0x7f45e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.181+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46000865e0 con 0x7f4608068550 2023-10-08T00:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.181+0000 7f4605d9b700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45e8067320 0x7f45e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.182+0000 7f4605d9b700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45e8067320 0x7f45e80697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f460816af70 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.185+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4600053160 con 0x7f4608068550 2023-10-08T00:31:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.380+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f460806e900 con 0x7f4608068550 2023-10-08T00:31:40.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.381+0000 7f45fe7fc700 1 -- 172.21.15.22:0/3657327361 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f4600056780 con 0x7f4608068550 2023-10-08T00:31:40.382 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:40.382 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":113,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:39.444492+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:37.857153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:38.408003+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45e8067320 msgr2=0x7f45e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45e8067320 0x7f45e80697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f460816af70 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2023-10-08T00:31:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 msgr2=0x7f460816afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f460816afc0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4600009430 tx=0x7f4600018000 comp rx=0 tx=0).stop 2023-10-08T00:31:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 shutdown_connections 2023-10-08T00:31:40.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f460815e010 0x7f46080ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4608068550 0x7f460816afc0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45e8067320 0x7f45e80697d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 --2- 172.21.15.22:0/3657327361 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f460806f640 0x7f460813efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 >> 172.21.15.22:0/3657327361 conn(0x7f46080cd480 msgr2=0x7f460815d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 shutdown_connections 2023-10-08T00:31:40.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.383+0000 7f460cc59700 1 -- 172.21.15.22:0/3657327361 wait complete. 2023-10-08T00:31:40.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:40.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.514+0000 7f255bbb2700 1 Processor -- start 2023-10-08T00:31:40.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.515+0000 7f255bbb2700 1 -- start start 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.515+0000 7f255bbb2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2554159c60 0x7f255415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.515+0000 7f255bbb2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f255415db10 0x7f2554069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.515+0000 7f255bbb2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255415a160 con 0x7f2554159890 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.515+0000 7f255bbb2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255415df50 con 0x7f255415db10 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.515+0000 7f255bbb2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540d13a0 con 0x7f2554159c60 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f255415db10 0x7f2554069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f255415db10 0x7f2554069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53860/0 (socket says 172.21.15.22:53860) 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 -- 172.21.15.22:0/1435207732 learned_addr learned my addr 172.21.15.22:0/1435207732 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:40.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255914d700 1 --2- 172.21.15.22:0/1435207732 >> v2:172.21.15.192:3300/0 conn(0x7f2554159c60 0x7f255415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 -- 172.21.15.22:0/1435207732 >> v2:172.21.15.192:3300/0 conn(0x7f2554159c60 msgr2=0x7f255415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 --2- 172.21.15.22:0/1435207732 >> v2:172.21.15.192:3300/0 conn(0x7f2554159c60 0x7f255415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 -- 172.21.15.22:0/1435207732 >> v1:172.21.15.192:6789/0 conn(0x7f2554159890 legacy=0x7f255415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 -- 172.21.15.22:0/1435207732 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255415e140 con 0x7f255415db10 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255a14f700 1 --2- 172.21.15.22:0/1435207732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f255415db10 0x7f2554069560 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f25540b67f0 tx=0x7f254c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f7d453174d42e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255894c700 1 -- 172.21.15.22:0/1435207732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00b860 con 0x7f255415db10 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255894c700 1 -- 172.21.15.22:0/1435207732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c00b9c0 con 0x7f255415db10 2023-10-08T00:31:40.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.516+0000 7f255894c700 1 -- 172.21.15.22:0/1435207732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00bd60 con 0x7f255415db10 2023-10-08T00:31:40.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 -- 172.21.15.22:0/1435207732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f255415db10 msgr2=0x7f2554069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 --2- 172.21.15.22:0/1435207732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f255415db10 0x7f2554069560 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f25540b67f0 tx=0x7f254c009250 comp rx=0 tx=0).stop 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 -- 172.21.15.22:0/1435207732 shutdown_connections 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 --2- 172.21.15.22:0/1435207732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f255415db10 0x7f2554069560 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 --2- 172.21.15.22:0/1435207732 >> v2:172.21.15.192:3300/0 conn(0x7f2554159c60 0x7f255415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 -- 172.21.15.22:0/1435207732 >> 172.21.15.22:0/1435207732 conn(0x7f2554068e20 msgr2=0x7f25540d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 -- 172.21.15.22:0/1435207732 shutdown_connections 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.517+0000 7f255bbb2700 1 -- 172.21.15.22:0/1435207732 wait complete. 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.518+0000 7f255bbb2700 1 Processor -- start 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.518+0000 7f255bbb2700 1 -- start start 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255bbb2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 0x7f2554152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255bbb2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554159c60 0x7f25540ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255bbb2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f255415db10 0x7f255415c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255bbb2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540cf730 con 0x7f2554159890 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255bbb2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540cd560 con 0x7f2554159c60 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255bbb2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540cf170 con 0x7f255415db10 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 0x7f2554152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 0x7f2554152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53862/0 (socket says 172.21.15.22:53862) 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 -- 172.21.15.22:0/378361689 learned_addr learned my addr 172.21.15.22:0/378361689 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255914d700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554159c60 0x7f25540ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255a14f700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f255415db10 0x7f255415c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 -- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f255415db10 msgr2=0x7f255415c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f255415db10 0x7f255415c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 -- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554159c60 msgr2=0x7f25540ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554159c60 0x7f25540ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.519+0000 7f255994e700 1 -- 172.21.15.22:0/378361689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0094f0 con 0x7f2554159890 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.520+0000 7f255994e700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 0x7f2554152560 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f254400cb10 tx=0x7f25440017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.520+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400ce20 con 0x7f2554159890 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.520+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400a7e0 con 0x7f2554159890 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.520+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25540cf450 con 0x7f2554159890 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.520+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400aba0 con 0x7f2554159890 2023-10-08T00:31:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.520+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540cd9f0 con 0x7f2554159890 2023-10-08T00:31:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.521+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255404c3c0 con 0x7f2554159890 2023-10-08T00:31:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.521+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2544003030 con 0x7f2554159890 2023-10-08T00:31:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.522+0000 7f2551ffb700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2540067320 0x7f25400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.522+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2544084c00 con 0x7f2554159890 2023-10-08T00:31:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.522+0000 7f255914d700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2540067320 0x7f25400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.522+0000 7f255914d700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2540067320 0x7f25400697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f25540b5640 tx=0x7f2548008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.526+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2544051890 con 0x7f2554159890 2023-10-08T00:31:40.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.722+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25540cd3b0 con 0x7f2554159890 2023-10-08T00:31:40.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.723+0000 7f2551ffb700 1 -- 172.21.15.22:0/378361689 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f2544054eb0 con 0x7f2554159890 2023-10-08T00:31:40.723 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:40.723 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":114,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:40.626945+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:37.857153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:38.408003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2540067320 msgr2=0x7f25400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2540067320 0x7f25400697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f25540b5640 tx=0x7f2548008040 comp rx=0 tx=0).stop 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 msgr2=0x7f2554152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 0x7f2554152560 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f254400cb10 tx=0x7f25440017b0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 shutdown_connections 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2540067320 0x7f25400697d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f255415db10 0x7f255415c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2554159890 0x7f2554152560 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 --2- 172.21.15.22:0/378361689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2554159c60 0x7f25540ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 >> 172.21.15.22:0/378361689 conn(0x7f2554068e20 msgr2=0x7f25541583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 shutdown_connections 2023-10-08T00:31:40.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.725+0000 7f255bbb2700 1 -- 172.21.15.22:0/378361689 wait complete. 2023-10-08T00:31:40.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:31:40.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.860+0000 7f01955f4700 1 Processor -- start 2023-10-08T00:31:40.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.860+0000 7f01955f4700 1 -- start start 2023-10-08T00:31:40.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f01955f4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0190069560 0x7f01900699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f01955f4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0190069ee0 con 0x7f0190159c60 2023-10-08T00:31:40.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f01955f4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019015a160 con 0x7f0190159890 2023-10-08T00:31:40.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f01955f4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900d13a0 con 0x7f0190069560 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018e7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0190159c60 0x7f019015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52506/0 (socket says 172.21.15.22:52506) 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018e7fc700 1 -- 172.21.15.22:0/3051453654 learned_addr learned my addr 172.21.15.22:0/3051453654 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018f7fe700 1 --2- 172.21.15.22:0/3051453654 >> v2:172.21.15.22:3300/0 conn(0x7f0190069560 0x7f01900699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018dffb700 1 -- 172.21.15.22:0/3051453654 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448319037 0 0) 0x7f0190069ee0 con 0x7f0190159c60 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018dffb700 1 -- 172.21.15.22:0/3051453654 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f017c003570 con 0x7f0190159c60 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018f7fe700 1 -- 172.21.15.22:0/3051453654 >> v1:172.21.15.192:6789/0 conn(0x7f0190159890 legacy=0x7f019015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018f7fe700 1 -- 172.21.15.22:0/3051453654 >> v1:172.21.15.22:6789/0 conn(0x7f0190159c60 legacy=0x7f019015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018f7fe700 1 -- 172.21.15.22:0/3051453654 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019015e140 con 0x7f0190069560 2023-10-08T00:31:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.861+0000 7f018f7fe700 1 --2- 172.21.15.22:0/3051453654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190069560 0x7f01900699a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e60 tx=0x7f0180009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fcad7d67d3200c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f018dffb700 1 -- 172.21.15.22:0/3051453654 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000e070 con 0x7f0190069560 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f018dffb700 1 -- 172.21.15.22:0/3051453654 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018000bb60 con 0x7f0190069560 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f018dffb700 1 -- 172.21.15.22:0/3051453654 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180012430 con 0x7f0190069560 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 -- 172.21.15.22:0/3051453654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190069560 msgr2=0x7f01900699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 --2- 172.21.15.22:0/3051453654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190069560 0x7f01900699a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e60 tx=0x7f0180009780 comp rx=0 tx=0).stop 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 -- 172.21.15.22:0/3051453654 shutdown_connections 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 --2- 172.21.15.22:0/3051453654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190069560 0x7f01900699a0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 -- 172.21.15.22:0/3051453654 >> 172.21.15.22:0/3051453654 conn(0x7f0190068e20 msgr2=0x7f01900d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 -- 172.21.15.22:0/3051453654 shutdown_connections 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.862+0000 7f01955f4700 1 -- 172.21.15.22:0/3051453654 wait complete. 2023-10-08T00:31:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.863+0000 7f01955f4700 1 Processor -- start 2023-10-08T00:31:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.863+0000 7f01955f4700 1 -- start start 2023-10-08T00:31:40.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f01955f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0190069560 0x7f0190151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f01955f4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 0x7f01900cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f01955f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0190159c60 0x7f01900b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f01955f4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019016a250 con 0x7f0190159890 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f01955f4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190169640 con 0x7f0190069560 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f01955f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0190169920 con 0x7f0190159c60 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f018e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 0x7f01900cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f018e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 0x7f01900cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53882/0 (socket says 172.21.15.22:53882) 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f018e7fc700 1 -- 172.21.15.22:0/653256560 learned_addr learned my addr 172.21.15.22:0/653256560 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f018effd700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0190069560 0x7f0190151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.864+0000 7f018f7fe700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0190159c60 0x7f01900b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f018e7fc700 1 -- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0190159c60 msgr2=0x7f01900b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f018e7fc700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0190159c60 0x7f01900b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f018e7fc700 1 -- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0190069560 msgr2=0x7f0190151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f018e7fc700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0190069560 0x7f0190151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f018e7fc700 1 -- 172.21.15.22:0/653256560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180009a20 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f018e7fc700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 0x7f01900cfa70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f017800c590 tx=0x7f0178007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178005b30 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0178005cb0 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0190169c00 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178007320 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.865+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01900b6110 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.866+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019016a3c0 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.866+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f017801b3b0 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.867+0000 7f0186ffd700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0170067320 0x7f01700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.867+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01780840f0 con 0x7f0190159890 2023-10-08T00:31:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.867+0000 7f018effd700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0170067320 0x7f01700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.867+0000 7f018effd700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0170067320 0x7f01700697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f01900c7170 tx=0x7f0188009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:40.871+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0178050d80 con 0x7f0190159890 2023-10-08T00:31:41.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:41.110+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f019004c3c0 con 0x7f0190159890 2023-10-08T00:31:41.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-08T00:31:41.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-08T00:31:41.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T00:31:41.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-08T00:31:42.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.059+0000 7f0186ffd700 1 -- 172.21.15.22:0/653256560 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f01780543a0 con 0x7f0190159890 2023-10-08T00:31:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.061+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0170067320 msgr2=0x7f01700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:42.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.061+0000 7f01955f4700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0170067320 0x7f01700697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f01900c7170 tx=0x7f0188009040 comp rx=0 tx=0).stop 2023-10-08T00:31:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.061+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 msgr2=0x7f01900cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.061+0000 7f01955f4700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 0x7f01900cfa70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f017800c590 tx=0x7f0178007e00 comp rx=0 tx=0).stop 2023-10-08T00:31:42.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 shutdown_connections 2023-10-08T00:31:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0170067320 0x7f01700697d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0190159c60 0x7f01900b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0190069560 0x7f0190151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 --2- 172.21.15.22:0/653256560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0190159890 0x7f01900cfa70 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 >> 172.21.15.22:0/653256560 conn(0x7f0190068e20 msgr2=0x7f019015aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:42.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 shutdown_connections 2023-10-08T00:31:42.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.062+0000 7f01955f4700 1 -- 172.21.15.22:0/653256560 wait complete. 2023-10-08T00:31:42.077 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:31:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.206+0000 7f90a3f4b700 1 Processor -- start 2023-10-08T00:31:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.206+0000 7f90a3f4b700 1 -- start start 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a3f4b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c06e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a3f4b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f909c069e80 0x7f909c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a3f4b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c06eb90 con 0x7f909c0c70b0 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a3f4b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c06ee70 con 0x7f909c069e80 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a3f4b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c06f150 con 0x7f909c155eb0 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a24e8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f909c069e80 0x7f909c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a1ce7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c06e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a14e6700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f909c0c70b0 0x7f909c069770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49762/0 (socket says 172.21.15.22:49762) 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.207+0000 7f90a14e6700 1 -- 172.21.15.22:0/4118599486 learned_addr learned my addr 172.21.15.22:0/4118599486 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a1ce7700 1 -- 172.21.15.22:0/4118599486 >> v2:172.21.15.192:3300/0 conn(0x7f909c069e80 msgr2=0x7f909c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a1ce7700 1 --2- 172.21.15.22:0/4118599486 >> v2:172.21.15.192:3300/0 conn(0x7f909c069e80 0x7f909c0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a1ce7700 1 -- 172.21.15.22:0/4118599486 >> v1:172.21.15.192:6789/0 conn(0x7f909c0c70b0 legacy=0x7f909c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a1ce7700 1 -- 172.21.15.22:0/4118599486 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c06f430 con 0x7f909c155eb0 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a24e8700 1 --2- 172.21.15.22:0/4118599486 >> v2:172.21.15.192:3300/0 conn(0x7f909c069e80 0x7f909c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a1ce7700 1 --2- 172.21.15.22:0/4118599486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c06e240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9094009e60 tx=0x7f9094009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=defe2aef8574ae9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a0ce5700 1 -- 172.21.15.22:0/4118599486 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400e070 con 0x7f909c155eb0 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a0ce5700 1 -- 172.21.15.22:0/4118599486 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400bb60 con 0x7f909c155eb0 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a0ce5700 1 -- 172.21.15.22:0/4118599486 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094012430 con 0x7f909c155eb0 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.208+0000 7f90a3f4b700 1 -- 172.21.15.22:0/4118599486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 msgr2=0x7f909c06e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/4118599486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c06e240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9094009e60 tx=0x7f9094009780 comp rx=0 tx=0).stop 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 -- 172.21.15.22:0/4118599486 shutdown_connections 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/4118599486 >> v2:172.21.15.192:3300/0 conn(0x7f909c069e80 0x7f909c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/4118599486 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c06e240 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 -- 172.21.15.22:0/4118599486 >> 172.21.15.22:0/4118599486 conn(0x7f909c068e10 msgr2=0x7f909c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 -- 172.21.15.22:0/4118599486 shutdown_connections 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.209+0000 7f90a3f4b700 1 -- 172.21.15.22:0/4118599486 wait complete. 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.210+0000 7f90a3f4b700 1 Processor -- start 2023-10-08T00:31:42.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.210+0000 7f90a3f4b700 1 -- start start 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.210+0000 7f90a3f4b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f909c069e80 0x7f909c149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.210+0000 7f90a3f4b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 0x7f909c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a3f4b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a3f4b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c149770 con 0x7f909c0c70b0 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a3f4b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0c4c10 con 0x7f909c069e80 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a3f4b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c159e70 con 0x7f909c155eb0 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 0x7f909c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 0x7f909c0ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53896/0 (socket says 172.21.15.22:53896) 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 -- 172.21.15.22:0/2887318133 learned_addr learned my addr 172.21.15.22:0/2887318133 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a1ce7700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f909c069e80 0x7f909c149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a24e8700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 -- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 msgr2=0x7f909c0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 -- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f909c069e80 msgr2=0x7f909c149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f909c069e80 0x7f909c149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 -- 172.21.15.22:0/2887318133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c009420 con 0x7f909c0c70b0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a14e6700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 0x7f909c0ca4c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f909000c7c0 tx=0x7f9090007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090005b30 con 0x7f909c0c70b0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090005c90 con 0x7f909c0c70b0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9094009a20 con 0x7f909c0c70b0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.211+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090004a80 con 0x7f909c0c70b0 2023-10-08T00:31:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.212+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c15a430 con 0x7f909c0c70b0 2023-10-08T00:31:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.212+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0c4da0 con 0x7f909c0c70b0 2023-10-08T00:31:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.213+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f90900070d0 con 0x7f909c0c70b0 2023-10-08T00:31:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.213+0000 7f9099ffb700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9088067320 0x7f90880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.213+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f9090083fd0 con 0x7f909c0c70b0 2023-10-08T00:31:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.213+0000 7f90a1ce7700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9088067320 0x7f90880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:42.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.214+0000 7f90a1ce7700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9088067320 0x7f90880697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f90940097c0 tx=0x7f9094019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.217+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f909004b5a0 con 0x7f909c0c70b0 2023-10-08T00:31:42.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:42.457+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f909c04c3c0 con 0x7f909c0c70b0 2023-10-08T00:31:43.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.067+0000 7f9099ffb700 1 -- 172.21.15.22:0/2887318133 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9090050ca0 con 0x7f909c0c70b0 2023-10-08T00:31:43.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9088067320 msgr2=0x7f90880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9088067320 0x7f90880697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f90940097c0 tx=0x7f9094019000 comp rx=0 tx=0).stop 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 msgr2=0x7f909c0ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 0x7f909c0ca4c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f909000c7c0 tx=0x7f9090007f70 comp rx=0 tx=0).stop 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 shutdown_connections 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9088067320 0x7f90880697d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f909c155eb0 0x7f909c0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f909c069e80 0x7f909c149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 --2- 172.21.15.22:0/2887318133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f909c0c70b0 0x7f909c0ca4c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 >> 172.21.15.22:0/2887318133 conn(0x7f909c068e10 msgr2=0x7f909c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 shutdown_connections 2023-10-08T00:31:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.070+0000 7f90a3f4b700 1 -- 172.21.15.22:0/2887318133 wait complete. 2023-10-08T00:31:43.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.208+0000 7f8724f2d700 1 Processor -- start 2023-10-08T00:31:43.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.208+0000 7f8724f2d700 1 -- start start 2023-10-08T00:31:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f8724f2d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8720159890 0x7f872015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f8724f2d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 0x7f87200699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f8724f2d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8720069ee0 con 0x7f8720159c60 2023-10-08T00:31:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f8724f2d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872015a160 con 0x7f8720159890 2023-10-08T00:31:43.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f8724f2d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200d13a0 con 0x7f8720069560 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f871ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 0x7f87200699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f871e59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8720159890 0x7f872015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f871dd9b700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8720159c60 0x7f872015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49778/0 (socket says 172.21.15.22:49778) 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f871dd9b700 1 -- 172.21.15.22:0/4236097893 learned_addr learned my addr 172.21.15.22:0/4236097893 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f871ed9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 0x7f87200699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:49172/0 (socket says 172.21.15.22:49172) 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.209+0000 7f871e59c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8720159890 0x7f872015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:37688/0 (socket says 172.21.15.22:37688) 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871d59a700 1 -- 172.21.15.22:0/4236097893 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025796450 0 0) 0x7f8720069ee0 con 0x7f8720159c60 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871d59a700 1 -- 172.21.15.22:0/4236097893 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f870c003570 con 0x7f8720159c60 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871e59c700 1 -- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 msgr2=0x7f87200699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871e59c700 1 --2- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 0x7f87200699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871e59c700 1 -- 172.21.15.22:0/4236097893 >> v1:172.21.15.192:6789/0 conn(0x7f8720159c60 legacy=0x7f872015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871e59c700 1 -- 172.21.15.22:0/4236097893 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872015e140 con 0x7f8720159890 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871ed9d700 1 --2- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 0x7f87200699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871e59c700 1 --2- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720159890 0x7f872015abd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87180098e0 tx=0x7f87180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a34b2e6ead4456 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871d59a700 1 -- 172.21.15.22:0/4236097893 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718011630 con 0x7f8720159890 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871d59a700 1 -- 172.21.15.22:0/4236097893 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718011790 con 0x7f8720159890 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.210+0000 7f871d59a700 1 -- 172.21.15.22:0/4236097893 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718011b30 con 0x7f8720159890 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 -- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720159890 msgr2=0x7f872015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 --2- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720159890 0x7f872015abd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87180098e0 tx=0x7f87180091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 -- 172.21.15.22:0/4236097893 shutdown_connections 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 --2- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720069560 0x7f87200699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 --2- 172.21.15.22:0/4236097893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720159890 0x7f872015abd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 -- 172.21.15.22:0/4236097893 >> 172.21.15.22:0/4236097893 conn(0x7f8720068e20 msgr2=0x7f87200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 -- 172.21.15.22:0/4236097893 shutdown_connections 2023-10-08T00:31:43.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.211+0000 7f8724f2d700 1 -- 172.21.15.22:0/4236097893 wait complete. 2023-10-08T00:31:43.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.212+0000 7f8724f2d700 1 Processor -- start 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.212+0000 7f8724f2d700 1 -- start start 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720069560 0x7f8720143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 0x7f87200cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720159c60 0x7f872016ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200ce470 con 0x7f8720159890 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87200ce750 con 0x7f8720069560 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200cea30 con 0x7f8720159c60 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 0x7f87200cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 0x7f87200cf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53906/0 (socket says 172.21.15.22:53906) 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 -- 172.21.15.22:0/3152321224 learned_addr learned my addr 172.21.15.22:0/3152321224 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:43.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871ed9d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720159c60 0x7f872016ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871e59c700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720069560 0x7f8720143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 -- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720159c60 msgr2=0x7f872016ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720159c60 0x7f872016ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 -- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720069560 msgr2=0x7f8720143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720069560 0x7f8720143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 -- 172.21.15.22:0/3152321224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009a20 con 0x7f8720159890 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871e59c700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720069560 0x7f8720143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:43.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871ed9d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720159c60 0x7f872016ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f871dd9b700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 0x7f87200cf510 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f870800c7c0 tx=0x7f8708007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708005b30 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708005c90 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8718009420 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708007340 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.213+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87200ceff0 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.214+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87200cf210 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.215+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f870801b400 con 0x7f8720159890 2023-10-08T00:31:43.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.215+0000 7f87167fc700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8700067320 0x7f87000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.215+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f8708084650 con 0x7f8720159890 2023-10-08T00:31:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.216+0000 7f871e59c700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8700067320 0x7f87000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.216+0000 7f871e59c700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8700067320 0x7f87000697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f87180091e0 tx=0x7f8718017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.220+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8708051420 con 0x7f8720159890 2023-10-08T00:31:43.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.458+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87200cfa50 con 0x7f8720159890 2023-10-08T00:31:43.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.458+0000 7f87167fc700 1 -- 172.21.15.22:0/3152321224 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8708054a40 con 0x7f8720159890 2023-10-08T00:31:43.459 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:43.459 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1568259552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1568259552},{"type":"v1","addr":"172.21.15.192:6837","nonce":1568259552}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3522181155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3522181155},{"type":"v1","addr":"172.21.15.22:6834","nonce":3522181155}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:39.444812+0000","modified":"2023-10-08T00:31:43.058497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7200":{"gid":7200,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/1343084597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1343084597},{"type":"v1","addr":"172.21.15.22:6835","nonce":1343084597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T00:31:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8700067320 msgr2=0x7f87000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8700067320 0x7f87000697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f87180091e0 tx=0x7f8718017000 comp rx=0 tx=0).stop 2023-10-08T00:31:43.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 msgr2=0x7f87200cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 0x7f87200cf510 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f870800c7c0 tx=0x7f8708007e00 comp rx=0 tx=0).stop 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 shutdown_connections 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8700067320 0x7f87000697d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8720159c60 0x7f872016ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8720069560 0x7f8720143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 --2- 172.21.15.22:0/3152321224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8720159890 0x7f87200cf510 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 >> 172.21.15.22:0/3152321224 conn(0x7f8720068e20 msgr2=0x7f872015bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 shutdown_connections 2023-10-08T00:31:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.460+0000 7f8724f2d700 1 -- 172.21.15.22:0/3152321224 wait complete. 2023-10-08T00:31:43.463 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 78 2023-10-08T00:31:43.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:31:43.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.591+0000 7fa806787700 1 Processor -- start 2023-10-08T00:31:43.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.591+0000 7fa806787700 1 -- start start 2023-10-08T00:31:43.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa806787700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159c60 0x7fa80015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa806787700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa80015db10 0x7fa800069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa806787700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80015a160 con 0x7fa800159890 2023-10-08T00:31:43.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa806787700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000d13a0 con 0x7fa80015db10 2023-10-08T00:31:43.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa806787700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80015e140 con 0x7fa800159c60 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa804d24700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa80015db10 0x7fa800069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa7fffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa800159890 0x7fa80015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52512/0 (socket says 172.21.15.22:52512) 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.592+0000 7fa7fffff700 1 -- 172.21.15.22:0/2251574412 learned_addr learned my addr 172.21.15.22:0/2251574412 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa7ff7fe700 1 --2- 172.21.15.22:0/2251574412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159c60 0x7fa80015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa804d24700 1 -- 172.21.15.22:0/2251574412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159c60 msgr2=0x7fa80015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa804d24700 1 --2- 172.21.15.22:0/2251574412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159c60 0x7fa80015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa804d24700 1 -- 172.21.15.22:0/2251574412 >> v1:172.21.15.22:6789/0 conn(0x7fa800159890 legacy=0x7fa80015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa804d24700 1 -- 172.21.15.22:0/2251574412 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80015a3d0 con 0x7fa80015db10 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa7feffd700 1 -- 172.21.15.22:0/2251574412 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69887051 0 0) 0x7fa80015a160 con 0x7fa800159890 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa804d24700 1 --2- 172.21.15.22:0/2251574412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa800069560 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009e60 tx=0x7fa7f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9d20b56d2ebac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa7feffd700 1 -- 172.21.15.22:0/2251574412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800e070 con 0x7fa80015db10 2023-10-08T00:31:43.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa7feffd700 1 -- 172.21.15.22:0/2251574412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800bc30 con 0x7fa80015db10 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa7feffd700 1 -- 172.21.15.22:0/2251574412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8012430 con 0x7fa80015db10 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa806787700 1 -- 172.21.15.22:0/2251574412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 msgr2=0x7fa800069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa806787700 1 --2- 172.21.15.22:0/2251574412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa800069560 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009e60 tx=0x7fa7f8009780 comp rx=0 tx=0).stop 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa806787700 1 -- 172.21.15.22:0/2251574412 shutdown_connections 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa806787700 1 --2- 172.21.15.22:0/2251574412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa800069560 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.593+0000 7fa806787700 1 --2- 172.21.15.22:0/2251574412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159c60 0x7fa80015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.594+0000 7fa806787700 1 -- 172.21.15.22:0/2251574412 >> 172.21.15.22:0/2251574412 conn(0x7fa800068e20 msgr2=0x7fa8000d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.594+0000 7fa806787700 1 -- 172.21.15.22:0/2251574412 shutdown_connections 2023-10-08T00:31:43.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.594+0000 7fa806787700 1 -- 172.21.15.22:0/2251574412 wait complete. 2023-10-08T00:31:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.595+0000 7fa806787700 1 Processor -- start 2023-10-08T00:31:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.595+0000 7fa806787700 1 -- start start 2023-10-08T00:31:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.595+0000 7fa806787700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159890 0x7fa800151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.595+0000 7fa806787700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa800159c60 0x7fa8001538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa806787700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa8000cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa806787700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800153df0 con 0x7fa80015db10 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa806787700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000b60a0 con 0x7fa800159c60 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa806787700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800154bf0 con 0x7fa800159890 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa8000cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa8000cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53926/0 (socket says 172.21.15.22:53926) 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 -- 172.21.15.22:0/1055961857 learned_addr learned my addr 172.21.15.22:0/1055961857 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa7fffff700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159890 0x7fa800151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 -- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159890 msgr2=0x7fa800151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159890 0x7fa800151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 -- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa800159c60 msgr2=0x7fa8001538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa7ff7fe700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa800159c60 0x7fa8001538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa800159c60 0x7fa8001538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 -- 172.21.15.22:0/1055961857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009a20 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa7ff7fe700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa800159c60 0x7fa8001538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa804d24700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa8000cf350 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa8000899c0 tx=0x7fa7f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8012e10 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f801d630 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8000cdea0 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f801d9f0 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.596+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800154090 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.597+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80004c3c0 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.598+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7f8024070 con 0x7fa80015db10 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.598+0000 7fa7e7fff700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa7ec067320 0x7fa7ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.598+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa7f8087510 con 0x7fa80015db10 2023-10-08T00:31:43.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.598+0000 7fa7fffff700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa7ec067320 0x7fa7ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.599+0000 7fa7fffff700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa7ec067320 0x7fa7ec0697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0007fd0 tx=0x7fa7f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.602+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7f8054210 con 0x7fa80015db10 2023-10-08T00:31:43.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.798+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa80006a5b0 con 0x7fa80015db10 2023-10-08T00:31:43.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.799+0000 7fa7e7fff700 1 -- 172.21.15.22:0/1055961857 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+15462 (secure 0 0 0) 0x7fa7f8057830 con 0x7fa80015db10 2023-10-08T00:31:43.799 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:43.799 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":116,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:31:42.630175+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:37.857153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:38.408003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.22","mappings":[{"from":2,"to":0}]},{"pgid":"19.32","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:31:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa7ec067320 msgr2=0x7fa7ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa7ec067320 0x7fa7ec0697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0007fd0 tx=0x7fa7f0009040 comp rx=0 tx=0).stop 2023-10-08T00:31:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 msgr2=0x7fa8000cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa8000cf350 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa8000899c0 tx=0x7fa7f8019000 comp rx=0 tx=0).stop 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 shutdown_connections 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80015db10 0x7fa8000cf350 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa7ec067320 0x7fa7ec0697d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa800159890 0x7fa800151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 --2- 172.21.15.22:0/1055961857 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa800159c60 0x7fa8001538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.800+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 >> 172.21.15.22:0/1055961857 conn(0x7fa800068e20 msgr2=0x7fa80015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.801+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 shutdown_connections 2023-10-08T00:31:43.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.801+0000 7fa806787700 1 -- 172.21.15.22:0/1055961857 wait complete. 2023-10-08T00:31:43.813 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:31:43.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.932+0000 7f1da2e86700 1 Processor -- start 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.932+0000 7f1da2e86700 1 -- start start 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.932+0000 7f1da2e86700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d9c159890 0x7f1d9c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.932+0000 7f1da2e86700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c069560 0x7f1d9c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da2e86700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c069ee0 con 0x7f1d9c159c60 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da2e86700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c15a160 con 0x7f1d9c159890 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da2e86700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0d13a0 con 0x7f1d9c069560 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d9c159890 0x7f1d9c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d9c159890 0x7f1d9c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53934/0 (socket says 172.21.15.22:53934) 2023-10-08T00:31:43.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 -- 172.21.15.22:0/2583138733 learned_addr learned my addr 172.21.15.22:0/2583138733 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da1423700 1 --2- 172.21.15.22:0/2583138733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c069560 0x7f1d9c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 -- 172.21.15.22:0/2583138733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c069560 msgr2=0x7f1d9c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 --2- 172.21.15.22:0/2583138733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c069560 0x7f1d9c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 -- 172.21.15.22:0/2583138733 >> v1:172.21.15.192:6789/0 conn(0x7f1d9c159c60 legacy=0x7f1d9c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 -- 172.21.15.22:0/2583138733 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c15e140 con 0x7f1d9c159890 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1da0c22700 1 --2- 172.21.15.22:0/2583138733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159890 0x7f1d9c15abd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009f20 tx=0x7f1d94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c460d260506ab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1d9b7fe700 1 -- 172.21.15.22:0/2583138733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400e070 con 0x7f1d9c159890 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1d9b7fe700 1 -- 172.21.15.22:0/2583138733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400ba80 con 0x7f1d9c159890 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.933+0000 7f1d9b7fe700 1 -- 172.21.15.22:0/2583138733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940092e0 con 0x7f1d9c159890 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 -- 172.21.15.22:0/2583138733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159890 msgr2=0x7f1d9c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2583138733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159890 0x7f1d9c15abd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009f20 tx=0x7f1d94009840 comp rx=0 tx=0).stop 2023-10-08T00:31:43.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 -- 172.21.15.22:0/2583138733 shutdown_connections 2023-10-08T00:31:43.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2583138733 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c069560 0x7f1d9c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2583138733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159890 0x7f1d9c15abd0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 -- 172.21.15.22:0/2583138733 >> 172.21.15.22:0/2583138733 conn(0x7f1d9c068e20 msgr2=0x7f1d9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:43.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 -- 172.21.15.22:0/2583138733 shutdown_connections 2023-10-08T00:31:43.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.934+0000 7f1da2e86700 1 -- 172.21.15.22:0/2583138733 wait complete. 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.935+0000 7f1da2e86700 1 Processor -- start 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.935+0000 7f1da2e86700 1 -- start start 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da2e86700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d9c069560 0x7f1d9c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da2e86700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c159890 0x7f1d9c0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da2e86700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 0x7f1d9c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da2e86700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c14d330 con 0x7f1d9c159c60 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da2e86700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0ca380 con 0x7f1d9c069560 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da2e86700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0c8b00 con 0x7f1d9c159890 2023-10-08T00:31:43.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 0x7f1d9c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 0x7f1d9c1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53950/0 (socket says 172.21.15.22:53950) 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 -- 172.21.15.22:0/2387409681 learned_addr learned my addr 172.21.15.22:0/2387409681 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1d9bfff700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c159890 0x7f1d9c0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da0c22700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d9c069560 0x7f1d9c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 -- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c159890 msgr2=0x7f1d9c0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c159890 0x7f1d9c0c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 -- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d9c069560 msgr2=0x7f1d9c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:43.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d9c069560 0x7f1d9c14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.936+0000 7f1da1423700 1 -- 172.21.15.22:0/2387409681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009ae0 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.937+0000 7f1da1423700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 0x7f1d9c1524b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00d860 tx=0x7f1d8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.937+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0125f0 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.937+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c012790 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.937+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0c9770 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.937+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c012b50 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.937+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0c9d30 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.938+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0ca530 con 0x7f1d9c159c60 2023-10-08T00:31:43.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.938+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1d8c013480 con 0x7f1d9c159c60 2023-10-08T00:31:43.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.939+0000 7f1d98ff9700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d88067320 0x7f1d880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:43.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.939+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1d8c084f20 con 0x7f1d9c159c60 2023-10-08T00:31:43.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.939+0000 7f1da0c22700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d88067320 0x7f1d880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:43.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.939+0000 7f1da0c22700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d88067320 0x7f1d880697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009880 tx=0x7f1d94018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:43.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:43.943+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d9c0ca530 con 0x7f1d9c159c60 2023-10-08T00:31:44.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.131+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d9c0ca710 con 0x7f1d88067320 2023-10-08T00:31:44.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.140+0000 7f1d98ff9700 1 -- 172.21.15.22:0/2387409681 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289765 (secure 0 0 0) 0x7f1d9c0ca710 con 0x7f1d88067320 2023-10-08T00:31:44.144 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d88067320 msgr2=0x7f1d880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d88067320 0x7f1d880697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009880 tx=0x7f1d94018000 comp rx=0 tx=0).stop 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 msgr2=0x7f1d9c1524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 0x7f1d9c1524b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00d860 tx=0x7f1d8c008040 comp rx=0 tx=0).stop 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 shutdown_connections 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d9c159c60 0x7f1d9c1524b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d9c069560 0x7f1d9c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1d88067320 0x7f1d880697d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 --2- 172.21.15.22:0/2387409681 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1d9c159890 0x7f1d9c0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 >> 172.21.15.22:0/2387409681 conn(0x7f1d9c068e20 msgr2=0x7f1d9c15c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:44.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 shutdown_connections 2023-10-08T00:31:44.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.144+0000 7f1da2e86700 1 -- 172.21.15.22:0/2387409681 wait complete. 2023-10-08T00:31:44.148 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:31:44.156 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2023-10-08T00:31:42.634865+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419216,"kb_used_data":12240,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752555504,"statfs":{"total":773094113280,"available":770616836096,"internally_reserved":0,"allocated":12533760,"data_stored":6073394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.599338"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643306+0000","last_change":"2023-10-08T00:31:39.643306+0000","last_active":"2023-10-08T00:31:39.643306+0000","last_peered":"2023-10-08T00:31:39.643306+0000","last_clean":"2023-10-08T00:31:39.643306+0000","last_became_active":"2023-10-08T00:31:39.643060+0000","last_became_peered":"2023-10-08T00:31:39.643060+0000","last_unstale":"2023-10-08T00:31:39.643306+0000","last_undegraded":"2023-10-08T00:31:39.643306+0000","last_fullsized":"2023-10-08T00:31:39.643306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:06.378361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641311+0000","last_change":"2023-10-08T00:31:39.641311+0000","last_active":"2023-10-08T00:31:39.641311+0000","last_peered":"2023-10-08T00:31:39.641311+0000","last_clean":"2023-10-08T00:31:39.641311+0000","last_became_active":"2023-10-08T00:31:39.641051+0000","last_became_peered":"2023-10-08T00:31:39.641051+0000","last_unstale":"2023-10-08T00:31:39.641311+0000","last_undegraded":"2023-10-08T00:31:39.641311+0000","last_fullsized":"2023-10-08T00:31:39.641311+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:01:19.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642075+0000","last_change":"2023-10-08T00:31:39.642075+0000","last_active":"2023-10-08T00:31:39.642075+0000","last_peered":"2023-10-08T00:31:39.642075+0000","last_clean":"2023-10-08T00:31:39.642075+0000","last_became_active":"2023-10-08T00:31:39.641779+0000","last_became_peered":"2023-10-08T00:31:39.641779+0000","last_unstale":"2023-10-08T00:31:39.642075+0000","last_undegraded":"2023-10-08T00:31:39.642075+0000","last_fullsized":"2023-10-08T00:31:39.642075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:04.257195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642880+0000","last_change":"2023-10-08T00:31:39.642880+0000","last_active":"2023-10-08T00:31:39.642880+0000","last_peered":"2023-10-08T00:31:39.642880+0000","last_clean":"2023-10-08T00:31:39.642880+0000","last_became_active":"2023-10-08T00:31:39.642606+0000","last_became_peered":"2023-10-08T00:31:39.642606+0000","last_unstale":"2023-10-08T00:31:39.642880+0000","last_undegraded":"2023-10-08T00:31:39.642880+0000","last_fullsized":"2023-10-08T00:31:39.642880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:52.787966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641526+0000","last_change":"2023-10-08T00:31:39.641526+0000","last_active":"2023-10-08T00:31:39.641526+0000","last_peered":"2023-10-08T00:31:39.641526+0000","last_clean":"2023-10-08T00:31:39.641526+0000","last_became_active":"2023-10-08T00:31:39.641241+0000","last_became_peered":"2023-10-08T00:31:39.641241+0000","last_unstale":"2023-10-08T00:31:39.641526+0000","last_undegraded":"2023-10-08T00:31:39.641526+0000","last_fullsized":"2023-10-08T00:31:39.641526+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:03.509035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644765+0000","last_change":"2023-10-08T00:31:39.644765+0000","last_active":"2023-10-08T00:31:39.644765+0000","last_peered":"2023-10-08T00:31:39.644765+0000","last_clean":"2023-10-08T00:31:39.644765+0000","last_became_active":"2023-10-08T00:31:39.644225+0000","last_became_peered":"2023-10-08T00:31:39.644225+0000","last_unstale":"2023-10-08T00:31:39.644765+0000","last_undegraded":"2023-10-08T00:31:39.644765+0000","last_fullsized":"2023-10-08T00:31:39.644765+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:08.763078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643583+0000","last_change":"2023-10-08T00:31:39.643583+0000","last_active":"2023-10-08T00:31:39.643583+0000","last_peered":"2023-10-08T00:31:39.643583+0000","last_clean":"2023-10-08T00:31:39.643583+0000","last_became_active":"2023-10-08T00:31:39.643281+0000","last_became_peered":"2023-10-08T00:31:39.643281+0000","last_unstale":"2023-10-08T00:31:39.643583+0000","last_undegraded":"2023-10-08T00:31:39.643583+0000","last_fullsized":"2023-10-08T00:31:39.643583+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:55:14.885537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644010+0000","last_change":"2023-10-08T00:31:39.644010+0000","last_active":"2023-10-08T00:31:39.644010+0000","last_peered":"2023-10-08T00:31:39.644010+0000","last_clean":"2023-10-08T00:31:39.644010+0000","last_became_active":"2023-10-08T00:31:39.643772+0000","last_became_peered":"2023-10-08T00:31:39.643772+0000","last_unstale":"2023-10-08T00:31:39.644010+0000","last_undegraded":"2023-10-08T00:31:39.644010+0000","last_fullsized":"2023-10-08T00:31:39.644010+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:54.482199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.647771+0000","last_change":"2023-10-08T00:31:39.647771+0000","last_active":"2023-10-08T00:31:39.647771+0000","last_peered":"2023-10-08T00:31:39.647771+0000","last_clean":"2023-10-08T00:31:39.647771+0000","last_became_active":"2023-10-08T00:31:39.647416+0000","last_became_peered":"2023-10-08T00:31:39.647416+0000","last_unstale":"2023-10-08T00:31:39.647771+0000","last_undegraded":"2023-10-08T00:31:39.647771+0000","last_fullsized":"2023-10-08T00:31:39.647771+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:00:14.111161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641209+0000","last_change":"2023-10-08T00:31:39.641209+0000","last_active":"2023-10-08T00:31:39.641209+0000","last_peered":"2023-10-08T00:31:39.641209+0000","last_clean":"2023-10-08T00:31:39.641209+0000","last_became_active":"2023-10-08T00:31:39.640928+0000","last_became_peered":"2023-10-08T00:31:39.640928+0000","last_unstale":"2023-10-08T00:31:39.641209+0000","last_undegraded":"2023-10-08T00:31:39.641209+0000","last_fullsized":"2023-10-08T00:31:39.641209+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:00:14.111161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.638907+0000","last_change":"2023-10-08T00:31:39.638907+0000","last_active":"2023-10-08T00:31:39.638907+0000","last_peered":"2023-10-08T00:31:39.638907+0000","last_clean":"2023-10-08T00:31:39.638907+0000","last_became_active":"2023-10-08T00:31:39.638647+0000","last_became_peered":"2023-10-08T00:31:39.638647+0000","last_unstale":"2023-10-08T00:31:39.638907+0000","last_undegraded":"2023-10-08T00:31:39.638907+0000","last_fullsized":"2023-10-08T00:31:39.638907+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:39.715676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642015+0000","last_change":"2023-10-08T00:31:39.642015+0000","last_active":"2023-10-08T00:31:39.642015+0000","last_peered":"2023-10-08T00:31:39.642015+0000","last_clean":"2023-10-08T00:31:39.642015+0000","last_became_active":"2023-10-08T00:31:39.641752+0000","last_became_peered":"2023-10-08T00:31:39.641752+0000","last_unstale":"2023-10-08T00:31:39.642015+0000","last_undegraded":"2023-10-08T00:31:39.642015+0000","last_fullsized":"2023-10-08T00:31:39.642015+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:27.131385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642467+0000","last_change":"2023-10-08T00:31:39.642467+0000","last_active":"2023-10-08T00:31:39.642467+0000","last_peered":"2023-10-08T00:31:39.642467+0000","last_clean":"2023-10-08T00:31:39.642467+0000","last_became_active":"2023-10-08T00:31:39.642142+0000","last_became_peered":"2023-10-08T00:31:39.642142+0000","last_unstale":"2023-10-08T00:31:39.642467+0000","last_undegraded":"2023-10-08T00:31:39.642467+0000","last_fullsized":"2023-10-08T00:31:39.642467+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:25:54.998698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643185+0000","last_change":"2023-10-08T00:31:39.643185+0000","last_active":"2023-10-08T00:31:39.643185+0000","last_peered":"2023-10-08T00:31:39.643185+0000","last_clean":"2023-10-08T00:31:39.643185+0000","last_became_active":"2023-10-08T00:31:39.642938+0000","last_became_peered":"2023-10-08T00:31:39.642938+0000","last_unstale":"2023-10-08T00:31:39.643185+0000","last_undegraded":"2023-10-08T00:31:39.643185+0000","last_fullsized":"2023-10-08T00:31:39.643185+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:20.500938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646545+0000","last_change":"2023-10-08T00:31:39.646545+0000","last_active":"2023-10-08T00:31:39.646545+0000","last_peered":"2023-10-08T00:31:39.646545+0000","last_clean":"2023-10-08T00:31:39.646545+0000","last_became_active":"2023-10-08T00:31:39.646286+0000","last_became_peered":"2023-10-08T00:31:39.646286+0000","last_unstale":"2023-10-08T00:31:39.646545+0000","last_undegraded":"2023-10-08T00:31:39.646545+0000","last_fullsized":"2023-10-08T00:31:39.646545+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:55:44.686142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644715+0000","last_change":"2023-10-08T00:31:39.644715+0000","last_active":"2023-10-08T00:31:39.644715+0000","last_peered":"2023-10-08T00:31:39.644715+0000","last_clean":"2023-10-08T00:31:39.644715+0000","last_became_active":"2023-10-08T00:31:39.643956+0000","last_became_peered":"2023-10-08T00:31:39.643956+0000","last_unstale":"2023-10-08T00:31:39.644715+0000","last_undegraded":"2023-10-08T00:31:39.644715+0000","last_fullsized":"2023-10-08T00:31:39.644715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:27.928976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639069+0000","last_change":"2023-10-08T00:31:39.639069+0000","last_active":"2023-10-08T00:31:39.639069+0000","last_peered":"2023-10-08T00:31:39.639069+0000","last_clean":"2023-10-08T00:31:39.639069+0000","last_became_active":"2023-10-08T00:31:39.638598+0000","last_became_peered":"2023-10-08T00:31:39.638598+0000","last_unstale":"2023-10-08T00:31:39.639069+0000","last_undegraded":"2023-10-08T00:31:39.639069+0000","last_fullsized":"2023-10-08T00:31:39.639069+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:29.195272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641847+0000","last_change":"2023-10-08T00:31:39.641847+0000","last_active":"2023-10-08T00:31:39.641847+0000","last_peered":"2023-10-08T00:31:39.641847+0000","last_clean":"2023-10-08T00:31:39.641847+0000","last_became_active":"2023-10-08T00:31:39.641599+0000","last_became_peered":"2023-10-08T00:31:39.641599+0000","last_unstale":"2023-10-08T00:31:39.641847+0000","last_undegraded":"2023-10-08T00:31:39.641847+0000","last_fullsized":"2023-10-08T00:31:39.641847+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:48.054362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.648576+0000","last_change":"2023-10-08T00:31:39.648576+0000","last_active":"2023-10-08T00:31:39.648576+0000","last_peered":"2023-10-08T00:31:39.648576+0000","last_clean":"2023-10-08T00:31:39.648576+0000","last_became_active":"2023-10-08T00:31:39.648391+0000","last_became_peered":"2023-10-08T00:31:39.648391+0000","last_unstale":"2023-10-08T00:31:39.648576+0000","last_undegraded":"2023-10-08T00:31:39.648576+0000","last_fullsized":"2023-10-08T00:31:39.648576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:16.931366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.635477+0000","last_change":"2023-10-08T00:31:39.635477+0000","last_active":"2023-10-08T00:31:39.635477+0000","last_peered":"2023-10-08T00:31:39.635477+0000","last_clean":"2023-10-08T00:31:39.635477+0000","last_became_active":"2023-10-08T00:31:39.635205+0000","last_became_peered":"2023-10-08T00:31:39.635205+0000","last_unstale":"2023-10-08T00:31:39.635477+0000","last_undegraded":"2023-10-08T00:31:39.635477+0000","last_fullsized":"2023-10-08T00:31:39.635477+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:14:04.446597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646979+0000","last_change":"2023-10-08T00:31:39.646979+0000","last_active":"2023-10-08T00:31:39.646979+0000","last_peered":"2023-10-08T00:31:39.646979+0000","last_clean":"2023-10-08T00:31:39.646979+0000","last_became_active":"2023-10-08T00:31:39.646727+0000","last_became_peered":"2023-10-08T00:31:39.646727+0000","last_unstale":"2023-10-08T00:31:39.646979+0000","last_undegraded":"2023-10-08T00:31:39.646979+0000","last_fullsized":"2023-10-08T00:31:39.646979+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:33.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.636099+0000","last_change":"2023-10-08T00:31:39.636099+0000","last_active":"2023-10-08T00:31:39.636099+0000","last_peered":"2023-10-08T00:31:39.636099+0000","last_clean":"2023-10-08T00:31:39.636099+0000","last_became_active":"2023-10-08T00:31:39.635829+0000","last_became_peered":"2023-10-08T00:31:39.635829+0000","last_unstale":"2023-10-08T00:31:39.636099+0000","last_undegraded":"2023-10-08T00:31:39.636099+0000","last_fullsized":"2023-10-08T00:31:39.636099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:24:37.168327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642530+0000","last_change":"2023-10-08T00:31:39.642530+0000","last_active":"2023-10-08T00:31:39.642530+0000","last_peered":"2023-10-08T00:31:39.642530+0000","last_clean":"2023-10-08T00:31:39.642530+0000","last_became_active":"2023-10-08T00:31:39.642132+0000","last_became_peered":"2023-10-08T00:31:39.642132+0000","last_unstale":"2023-10-08T00:31:39.642530+0000","last_undegraded":"2023-10-08T00:31:39.642530+0000","last_fullsized":"2023-10-08T00:31:39.642530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:20.530616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640219+0000","last_change":"2023-10-08T00:31:39.640219+0000","last_active":"2023-10-08T00:31:39.640219+0000","last_peered":"2023-10-08T00:31:39.640219+0000","last_clean":"2023-10-08T00:31:39.640219+0000","last_became_active":"2023-10-08T00:31:39.639977+0000","last_became_peered":"2023-10-08T00:31:39.639977+0000","last_unstale":"2023-10-08T00:31:39.640219+0000","last_undegraded":"2023-10-08T00:31:39.640219+0000","last_fullsized":"2023-10-08T00:31:39.640219+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:06:29.352848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640000+0000","last_change":"2023-10-08T00:31:39.640000+0000","last_active":"2023-10-08T00:31:39.640000+0000","last_peered":"2023-10-08T00:31:39.640000+0000","last_clean":"2023-10-08T00:31:39.640000+0000","last_became_active":"2023-10-08T00:31:39.639712+0000","last_became_peered":"2023-10-08T00:31:39.639712+0000","last_unstale":"2023-10-08T00:31:39.640000+0000","last_undegraded":"2023-10-08T00:31:39.640000+0000","last_fullsized":"2023-10-08T00:31:39.640000+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:52.791927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643480+0000","last_change":"2023-10-08T00:31:39.643480+0000","last_active":"2023-10-08T00:31:39.643480+0000","last_peered":"2023-10-08T00:31:39.643480+0000","last_clean":"2023-10-08T00:31:39.643480+0000","last_became_active":"2023-10-08T00:31:39.643204+0000","last_became_peered":"2023-10-08T00:31:39.643204+0000","last_unstale":"2023-10-08T00:31:39.643480+0000","last_undegraded":"2023-10-08T00:31:39.643480+0000","last_fullsized":"2023-10-08T00:31:39.643480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:59:42.198359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642321+0000","last_change":"2023-10-08T00:31:39.642321+0000","last_active":"2023-10-08T00:31:39.642321+0000","last_peered":"2023-10-08T00:31:39.642321+0000","last_clean":"2023-10-08T00:31:39.642321+0000","last_became_active":"2023-10-08T00:31:39.642029+0000","last_became_peered":"2023-10-08T00:31:39.642029+0000","last_unstale":"2023-10-08T00:31:39.642321+0000","last_undegraded":"2023-10-08T00:31:39.642321+0000","last_fullsized":"2023-10-08T00:31:39.642321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:47.721860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.647599+0000","last_change":"2023-10-08T00:31:39.647599+0000","last_active":"2023-10-08T00:31:39.647599+0000","last_peered":"2023-10-08T00:31:39.647599+0000","last_clean":"2023-10-08T00:31:39.647599+0000","last_became_active":"2023-10-08T00:31:39.646573+0000","last_became_peered":"2023-10-08T00:31:39.646573+0000","last_unstale":"2023-10-08T00:31:39.647599+0000","last_undegraded":"2023-10-08T00:31:39.647599+0000","last_fullsized":"2023-10-08T00:31:39.647599+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:49.746952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646486+0000","last_change":"2023-10-08T00:31:39.646486+0000","last_active":"2023-10-08T00:31:39.646486+0000","last_peered":"2023-10-08T00:31:39.646486+0000","last_clean":"2023-10-08T00:31:39.646486+0000","last_became_active":"2023-10-08T00:31:39.646200+0000","last_became_peered":"2023-10-08T00:31:39.646200+0000","last_unstale":"2023-10-08T00:31:39.646486+0000","last_undegraded":"2023-10-08T00:31:39.646486+0000","last_fullsized":"2023-10-08T00:31:39.646486+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:49.746952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646680+0000","last_change":"2023-10-08T00:31:39.646680+0000","last_active":"2023-10-08T00:31:39.646680+0000","last_peered":"2023-10-08T00:31:39.646680+0000","last_clean":"2023-10-08T00:31:39.646680+0000","last_became_active":"2023-10-08T00:31:39.646411+0000","last_became_peered":"2023-10-08T00:31:39.646411+0000","last_unstale":"2023-10-08T00:31:39.646680+0000","last_undegraded":"2023-10-08T00:31:39.646680+0000","last_fullsized":"2023-10-08T00:31:39.646680+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:45.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645243+0000","last_change":"2023-10-08T00:31:39.645243+0000","last_active":"2023-10-08T00:31:39.645243+0000","last_peered":"2023-10-08T00:31:39.645243+0000","last_clean":"2023-10-08T00:31:39.645243+0000","last_became_active":"2023-10-08T00:31:39.644777+0000","last_became_peered":"2023-10-08T00:31:39.644777+0000","last_unstale":"2023-10-08T00:31:39.645243+0000","last_undegraded":"2023-10-08T00:31:39.645243+0000","last_fullsized":"2023-10-08T00:31:39.645243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:21:48.871265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639223+0000","last_change":"2023-10-08T00:31:39.639223+0000","last_active":"2023-10-08T00:31:39.639223+0000","last_peered":"2023-10-08T00:31:39.639223+0000","last_clean":"2023-10-08T00:31:39.639223+0000","last_became_active":"2023-10-08T00:31:39.638661+0000","last_became_peered":"2023-10-08T00:31:39.638661+0000","last_unstale":"2023-10-08T00:31:39.639223+0000","last_undegraded":"2023-10-08T00:31:39.639223+0000","last_fullsized":"2023-10-08T00:31:39.639223+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:52.791927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644294+0000","last_change":"2023-10-08T00:31:39.644294+0000","last_active":"2023-10-08T00:31:39.644294+0000","last_peered":"2023-10-08T00:31:39.644294+0000","last_clean":"2023-10-08T00:31:39.644294+0000","last_became_active":"2023-10-08T00:31:39.643720+0000","last_became_peered":"2023-10-08T00:31:39.643720+0000","last_unstale":"2023-10-08T00:31:39.644294+0000","last_undegraded":"2023-10-08T00:31:39.644294+0000","last_fullsized":"2023-10-08T00:31:39.644294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:23.701448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"113'4","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.044730+0000","last_change":"2023-10-08T00:31:39.056888+0000","last_active":"2023-10-08T00:31:40.044730+0000","last_peered":"2023-10-08T00:31:40.044730+0000","last_clean":"2023-10-08T00:31:40.044730+0000","last_became_active":"2023-10-08T00:31:39.056637+0000","last_became_peered":"2023-10-08T00:31:39.056637+0000","last_unstale":"2023-10-08T00:31:40.044730+0000","last_undegraded":"2023-10-08T00:31:40.044730+0000","last_fullsized":"2023-10-08T00:31:40.044730+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:46:49.897298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643028+0000","last_change":"2023-10-08T00:31:39.643028+0000","last_active":"2023-10-08T00:31:39.643028+0000","last_peered":"2023-10-08T00:31:39.643028+0000","last_clean":"2023-10-08T00:31:39.643028+0000","last_became_active":"2023-10-08T00:31:39.642752+0000","last_became_peered":"2023-10-08T00:31:39.642752+0000","last_unstale":"2023-10-08T00:31:39.643028+0000","last_undegraded":"2023-10-08T00:31:39.643028+0000","last_fullsized":"2023-10-08T00:31:39.643028+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:01:19.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639734+0000","last_change":"2023-10-08T00:31:39.049366+0000","last_active":"2023-10-08T00:31:39.639734+0000","last_peered":"2023-10-08T00:31:39.639734+0000","last_clean":"2023-10-08T00:31:39.639734+0000","last_became_active":"2023-10-08T00:31:39.048799+0000","last_became_peered":"2023-10-08T00:31:39.048799+0000","last_unstale":"2023-10-08T00:31:39.639734+0000","last_undegraded":"2023-10-08T00:31:39.639734+0000","last_fullsized":"2023-10-08T00:31:39.639734+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:12.559507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.648826+0000","last_change":"2023-10-08T00:31:39.648826+0000","last_active":"2023-10-08T00:31:39.648826+0000","last_peered":"2023-10-08T00:31:39.648826+0000","last_clean":"2023-10-08T00:31:39.648826+0000","last_became_active":"2023-10-08T00:31:39.648560+0000","last_became_peered":"2023-10-08T00:31:39.648560+0000","last_unstale":"2023-10-08T00:31:39.648826+0000","last_undegraded":"2023-10-08T00:31:39.648826+0000","last_fullsized":"2023-10-08T00:31:39.648826+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:32:25.362376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.039934+0000","last_change":"2023-10-08T00:31:39.047461+0000","last_active":"2023-10-08T00:31:40.039934+0000","last_peered":"2023-10-08T00:31:40.039934+0000","last_clean":"2023-10-08T00:31:40.039934+0000","last_became_active":"2023-10-08T00:31:39.047182+0000","last_became_peered":"2023-10-08T00:31:39.047182+0000","last_unstale":"2023-10-08T00:31:40.039934+0000","last_undegraded":"2023-10-08T00:31:40.039934+0000","last_fullsized":"2023-10-08T00:31:40.039934+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:22:22.873906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640094+0000","last_change":"2023-10-08T00:31:39.640094+0000","last_active":"2023-10-08T00:31:39.640094+0000","last_peered":"2023-10-08T00:31:39.640094+0000","last_clean":"2023-10-08T00:31:39.640094+0000","last_became_active":"2023-10-08T00:31:39.639802+0000","last_became_peered":"2023-10-08T00:31:39.639802+0000","last_unstale":"2023-10-08T00:31:39.640094+0000","last_undegraded":"2023-10-08T00:31:39.640094+0000","last_fullsized":"2023-10-08T00:31:39.640094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:58:48.020945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.042685+0000","last_change":"2023-10-08T00:31:39.048714+0000","last_active":"2023-10-08T00:31:40.042685+0000","last_peered":"2023-10-08T00:31:40.042685+0000","last_clean":"2023-10-08T00:31:40.042685+0000","last_became_active":"2023-10-08T00:31:39.048431+0000","last_became_peered":"2023-10-08T00:31:39.048431+0000","last_unstale":"2023-10-08T00:31:40.042685+0000","last_undegraded":"2023-10-08T00:31:40.042685+0000","last_fullsized":"2023-10-08T00:31:40.042685+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:55:43.681072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640895+0000","last_change":"2023-10-08T00:31:39.640895+0000","last_active":"2023-10-08T00:31:39.640895+0000","last_peered":"2023-10-08T00:31:39.640895+0000","last_clean":"2023-10-08T00:31:39.640895+0000","last_became_active":"2023-10-08T00:31:39.640602+0000","last_became_peered":"2023-10-08T00:31:39.640602+0000","last_unstale":"2023-10-08T00:31:39.640895+0000","last_undegraded":"2023-10-08T00:31:39.640895+0000","last_fullsized":"2023-10-08T00:31:39.640895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:52.525395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.628666+0000","last_change":"2023-10-08T00:31:39.047564+0000","last_active":"2023-10-08T00:31:39.628666+0000","last_peered":"2023-10-08T00:31:39.628666+0000","last_clean":"2023-10-08T00:31:39.628666+0000","last_became_active":"2023-10-08T00:31:39.047295+0000","last_became_peered":"2023-10-08T00:31:39.047295+0000","last_unstale":"2023-10-08T00:31:39.628666+0000","last_undegraded":"2023-10-08T00:31:39.628666+0000","last_fullsized":"2023-10-08T00:31:39.628666+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:58:25.720809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639072+0000","last_change":"2023-10-08T00:31:39.639072+0000","last_active":"2023-10-08T00:31:39.639072+0000","last_peered":"2023-10-08T00:31:39.639072+0000","last_clean":"2023-10-08T00:31:39.639072+0000","last_became_active":"2023-10-08T00:31:39.638748+0000","last_became_peered":"2023-10-08T00:31:39.638748+0000","last_unstale":"2023-10-08T00:31:39.639072+0000","last_undegraded":"2023-10-08T00:31:39.639072+0000","last_fullsized":"2023-10-08T00:31:39.639072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:48:08.894138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.632839+0000","last_change":"2023-10-08T00:31:39.056913+0000","last_active":"2023-10-08T00:31:39.632839+0000","last_peered":"2023-10-08T00:31:39.632839+0000","last_clean":"2023-10-08T00:31:39.632839+0000","last_became_active":"2023-10-08T00:31:39.056589+0000","last_became_peered":"2023-10-08T00:31:39.056589+0000","last_unstale":"2023-10-08T00:31:39.632839+0000","last_undegraded":"2023-10-08T00:31:39.632839+0000","last_fullsized":"2023-10-08T00:31:39.632839+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:55:13.880468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645202+0000","last_change":"2023-10-08T00:31:39.645202+0000","last_active":"2023-10-08T00:31:39.645202+0000","last_peered":"2023-10-08T00:31:39.645202+0000","last_clean":"2023-10-08T00:31:39.645202+0000","last_became_active":"2023-10-08T00:31:39.644643+0000","last_became_peered":"2023-10-08T00:31:39.644643+0000","last_unstale":"2023-10-08T00:31:39.645202+0000","last_undegraded":"2023-10-08T00:31:39.645202+0000","last_fullsized":"2023-10-08T00:31:39.645202+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:59.943326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.050924+0000","last_change":"2023-10-08T00:31:39.050132+0000","last_active":"2023-10-08T00:31:39.050924+0000","last_peered":"2023-10-08T00:31:39.050924+0000","last_clean":"2023-10-08T00:31:39.050924+0000","last_became_active":"2023-10-08T00:31:39.049876+0000","last_became_peered":"2023-10-08T00:31:39.049876+0000","last_unstale":"2023-10-08T00:31:39.050924+0000","last_undegraded":"2023-10-08T00:31:39.050924+0000","last_fullsized":"2023-10-08T00:31:39.050924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:56.568902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.637825+0000","last_change":"2023-10-08T00:31:39.637825+0000","last_active":"2023-10-08T00:31:39.637825+0000","last_peered":"2023-10-08T00:31:39.637825+0000","last_clean":"2023-10-08T00:31:39.637825+0000","last_became_active":"2023-10-08T00:31:39.637584+0000","last_became_peered":"2023-10-08T00:31:39.637584+0000","last_unstale":"2023-10-08T00:31:39.637825+0000","last_undegraded":"2023-10-08T00:31:39.637825+0000","last_fullsized":"2023-10-08T00:31:39.637825+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:59.943326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.056509+0000","last_change":"2023-10-08T00:31:39.053666+0000","last_active":"2023-10-08T00:31:39.056509+0000","last_peered":"2023-10-08T00:31:39.056509+0000","last_clean":"2023-10-08T00:31:39.056509+0000","last_became_active":"2023-10-08T00:31:39.053094+0000","last_became_peered":"2023-10-08T00:31:39.053094+0000","last_unstale":"2023-10-08T00:31:39.056509+0000","last_undegraded":"2023-10-08T00:31:39.056509+0000","last_fullsized":"2023-10-08T00:31:39.056509+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:48.741883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640107+0000","last_change":"2023-10-08T00:31:39.640107+0000","last_active":"2023-10-08T00:31:39.640107+0000","last_peered":"2023-10-08T00:31:39.640107+0000","last_clean":"2023-10-08T00:31:39.640107+0000","last_became_active":"2023-10-08T00:31:39.639830+0000","last_became_peered":"2023-10-08T00:31:39.639830+0000","last_unstale":"2023-10-08T00:31:39.640107+0000","last_undegraded":"2023-10-08T00:31:39.640107+0000","last_fullsized":"2023-10-08T00:31:39.640107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:13.564577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.052688+0000","last_change":"2023-10-08T00:31:39.051977+0000","last_active":"2023-10-08T00:31:39.052688+0000","last_peered":"2023-10-08T00:31:39.052688+0000","last_clean":"2023-10-08T00:31:39.052688+0000","last_became_active":"2023-10-08T00:31:39.050871+0000","last_became_peered":"2023-10-08T00:31:39.050871+0000","last_unstale":"2023-10-08T00:31:39.052688+0000","last_undegraded":"2023-10-08T00:31:39.052688+0000","last_fullsized":"2023-10-08T00:31:39.052688+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:30.871079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.647588+0000","last_change":"2023-10-08T00:31:39.647588+0000","last_active":"2023-10-08T00:31:39.647588+0000","last_peered":"2023-10-08T00:31:39.647588+0000","last_clean":"2023-10-08T00:31:39.647588+0000","last_became_active":"2023-10-08T00:31:39.646899+0000","last_became_peered":"2023-10-08T00:31:39.646899+0000","last_unstale":"2023-10-08T00:31:39.647588+0000","last_undegraded":"2023-10-08T00:31:39.647588+0000","last_fullsized":"2023-10-08T00:31:39.647588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:19.751351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057801+0000","last_change":"2023-10-08T00:31:39.054187+0000","last_active":"2023-10-08T00:31:39.057801+0000","last_peered":"2023-10-08T00:31:39.057801+0000","last_clean":"2023-10-08T00:31:39.057801+0000","last_became_active":"2023-10-08T00:31:39.053888+0000","last_became_peered":"2023-10-08T00:31:39.053888+0000","last_unstale":"2023-10-08T00:31:39.057801+0000","last_undegraded":"2023-10-08T00:31:39.057801+0000","last_fullsized":"2023-10-08T00:31:39.057801+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:05.605732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640542+0000","last_change":"2023-10-08T00:31:39.640542+0000","last_active":"2023-10-08T00:31:39.640542+0000","last_peered":"2023-10-08T00:31:39.640542+0000","last_clean":"2023-10-08T00:31:39.640542+0000","last_became_active":"2023-10-08T00:31:39.640169+0000","last_became_peered":"2023-10-08T00:31:39.640169+0000","last_unstale":"2023-10-08T00:31:39.640542+0000","last_undegraded":"2023-10-08T00:31:39.640542+0000","last_fullsized":"2023-10-08T00:31:39.640542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:48.054362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"113'3","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.044088+0000","last_change":"2023-10-08T00:31:39.049093+0000","last_active":"2023-10-08T00:31:40.044088+0000","last_peered":"2023-10-08T00:31:40.044088+0000","last_clean":"2023-10-08T00:31:40.044088+0000","last_became_active":"2023-10-08T00:31:39.048774+0000","last_became_peered":"2023-10-08T00:31:39.048774+0000","last_unstale":"2023-10-08T00:31:40.044088+0000","last_undegraded":"2023-10-08T00:31:40.044088+0000","last_fullsized":"2023-10-08T00:31:40.044088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:20:18.193086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644592+0000","last_change":"2023-10-08T00:31:39.644592+0000","last_active":"2023-10-08T00:31:39.644592+0000","last_peered":"2023-10-08T00:31:39.644592+0000","last_clean":"2023-10-08T00:31:39.644592+0000","last_became_active":"2023-10-08T00:31:39.644313+0000","last_became_peered":"2023-10-08T00:31:39.644313+0000","last_unstale":"2023-10-08T00:31:39.644592+0000","last_undegraded":"2023-10-08T00:31:39.644592+0000","last_fullsized":"2023-10-08T00:31:39.644592+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:14:04.446597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"113'6","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.043164+0000","last_change":"2023-10-08T00:31:39.051371+0000","last_active":"2023-10-08T00:31:40.043164+0000","last_peered":"2023-10-08T00:31:40.043164+0000","last_clean":"2023-10-08T00:31:40.043164+0000","last_became_active":"2023-10-08T00:31:39.051116+0000","last_became_peered":"2023-10-08T00:31:39.051116+0000","last_unstale":"2023-10-08T00:31:40.043164+0000","last_undegraded":"2023-10-08T00:31:40.043164+0000","last_fullsized":"2023-10-08T00:31:40.043164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:51.782897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640512+0000","last_change":"2023-10-08T00:31:39.640512+0000","last_active":"2023-10-08T00:31:39.640512+0000","last_peered":"2023-10-08T00:31:39.640512+0000","last_clean":"2023-10-08T00:31:39.640512+0000","last_became_active":"2023-10-08T00:31:39.640245+0000","last_became_peered":"2023-10-08T00:31:39.640245+0000","last_unstale":"2023-10-08T00:31:39.640512+0000","last_undegraded":"2023-10-08T00:31:39.640512+0000","last_fullsized":"2023-10-08T00:31:39.640512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:39.815155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.050540+0000","last_change":"2023-10-08T00:31:39.049325+0000","last_active":"2023-10-08T00:31:39.050540+0000","last_peered":"2023-10-08T00:31:39.050540+0000","last_clean":"2023-10-08T00:31:39.050540+0000","last_became_active":"2023-10-08T00:31:39.049005+0000","last_became_peered":"2023-10-08T00:31:39.049005+0000","last_unstale":"2023-10-08T00:31:39.050540+0000","last_undegraded":"2023-10-08T00:31:39.050540+0000","last_fullsized":"2023-10-08T00:31:39.050540+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:39:23.911713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645490+0000","last_change":"2023-10-08T00:31:39.645490+0000","last_active":"2023-10-08T00:31:39.645490+0000","last_peered":"2023-10-08T00:31:39.645490+0000","last_clean":"2023-10-08T00:31:39.645490+0000","last_became_active":"2023-10-08T00:31:39.645233+0000","last_became_peered":"2023-10-08T00:31:39.645233+0000","last_unstale":"2023-10-08T00:31:39.645490+0000","last_undegraded":"2023-10-08T00:31:39.645490+0000","last_fullsized":"2023-10-08T00:31:39.645490+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:29.195272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057507+0000","last_change":"2023-10-08T00:31:39.055513+0000","last_active":"2023-10-08T00:31:39.057507+0000","last_peered":"2023-10-08T00:31:39.057507+0000","last_clean":"2023-10-08T00:31:39.057507+0000","last_became_active":"2023-10-08T00:31:39.055180+0000","last_became_peered":"2023-10-08T00:31:39.055180+0000","last_unstale":"2023-10-08T00:31:39.057507+0000","last_undegraded":"2023-10-08T00:31:39.057507+0000","last_fullsized":"2023-10-08T00:31:39.057507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:44.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639876+0000","last_change":"2023-10-08T00:31:39.639876+0000","last_active":"2023-10-08T00:31:39.639876+0000","last_peered":"2023-10-08T00:31:39.639876+0000","last_clean":"2023-10-08T00:31:39.639876+0000","last_became_active":"2023-10-08T00:31:39.639563+0000","last_became_peered":"2023-10-08T00:31:39.639563+0000","last_unstale":"2023-10-08T00:31:39.639876+0000","last_undegraded":"2023-10-08T00:31:39.639876+0000","last_fullsized":"2023-10-08T00:31:39.639876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:40:01.641040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"113'8","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.044463+0000","last_change":"2023-10-08T00:31:39.056161+0000","last_active":"2023-10-08T00:31:40.044463+0000","last_peered":"2023-10-08T00:31:40.044463+0000","last_clean":"2023-10-08T00:31:40.044463+0000","last_became_active":"2023-10-08T00:31:39.055624+0000","last_became_peered":"2023-10-08T00:31:39.055624+0000","last_unstale":"2023-10-08T00:31:40.044463+0000","last_undegraded":"2023-10-08T00:31:40.044463+0000","last_fullsized":"2023-10-08T00:31:40.044463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:48.741883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643082+0000","last_change":"2023-10-08T00:31:39.643082+0000","last_active":"2023-10-08T00:31:39.643082+0000","last_peered":"2023-10-08T00:31:39.643082+0000","last_clean":"2023-10-08T00:31:39.643082+0000","last_became_active":"2023-10-08T00:31:39.642817+0000","last_became_peered":"2023-10-08T00:31:39.642817+0000","last_unstale":"2023-10-08T00:31:39.643082+0000","last_undegraded":"2023-10-08T00:31:39.643082+0000","last_fullsized":"2023-10-08T00:31:39.643082+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:20.500938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640463+0000","last_change":"2023-10-08T00:31:39.050662+0000","last_active":"2023-10-08T00:31:39.640463+0000","last_peered":"2023-10-08T00:31:39.640463+0000","last_clean":"2023-10-08T00:31:39.640463+0000","last_became_active":"2023-10-08T00:31:39.050401+0000","last_became_peered":"2023-10-08T00:31:39.050401+0000","last_unstale":"2023-10-08T00:31:39.640463+0000","last_undegraded":"2023-10-08T00:31:39.640463+0000","last_fullsized":"2023-10-08T00:31:39.640463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:37.213105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646921+0000","last_change":"2023-10-08T00:31:39.646921+0000","last_active":"2023-10-08T00:31:39.646921+0000","last_peered":"2023-10-08T00:31:39.646921+0000","last_clean":"2023-10-08T00:31:39.646921+0000","last_became_active":"2023-10-08T00:31:39.646642+0000","last_became_peered":"2023-10-08T00:31:39.646642+0000","last_unstale":"2023-10-08T00:31:39.646921+0000","last_undegraded":"2023-10-08T00:31:39.646921+0000","last_fullsized":"2023-10-08T00:31:39.646921+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:52.787966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.042331+0000","last_change":"2023-10-08T00:31:39.050587+0000","last_active":"2023-10-08T00:31:40.042331+0000","last_peered":"2023-10-08T00:31:40.042331+0000","last_clean":"2023-10-08T00:31:40.042331+0000","last_became_active":"2023-10-08T00:31:39.050281+0000","last_became_peered":"2023-10-08T00:31:39.050281+0000","last_unstale":"2023-10-08T00:31:40.042331+0000","last_undegraded":"2023-10-08T00:31:40.042331+0000","last_fullsized":"2023-10-08T00:31:40.042331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:58:47.015876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643943+0000","last_change":"2023-10-08T00:31:39.643943+0000","last_active":"2023-10-08T00:31:39.643943+0000","last_peered":"2023-10-08T00:31:39.643943+0000","last_clean":"2023-10-08T00:31:39.643943+0000","last_became_active":"2023-10-08T00:31:39.643649+0000","last_became_peered":"2023-10-08T00:31:39.643649+0000","last_unstale":"2023-10-08T00:31:39.643943+0000","last_undegraded":"2023-10-08T00:31:39.643943+0000","last_fullsized":"2023-10-08T00:31:39.643943+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:46:59.950525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.631420+0000","last_change":"2023-10-08T00:31:39.048303+0000","last_active":"2023-10-08T00:31:39.631420+0000","last_peered":"2023-10-08T00:31:39.631420+0000","last_clean":"2023-10-08T00:31:39.631420+0000","last_became_active":"2023-10-08T00:31:39.048019+0000","last_became_peered":"2023-10-08T00:31:39.048019+0000","last_unstale":"2023-10-08T00:31:39.631420+0000","last_undegraded":"2023-10-08T00:31:39.631420+0000","last_fullsized":"2023-10-08T00:31:39.631420+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:03.252126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.636916+0000","last_change":"2023-10-08T00:31:39.636916+0000","last_active":"2023-10-08T00:31:39.636916+0000","last_peered":"2023-10-08T00:31:39.636916+0000","last_clean":"2023-10-08T00:31:39.636916+0000","last_became_active":"2023-10-08T00:31:39.636192+0000","last_became_peered":"2023-10-08T00:31:39.636192+0000","last_unstale":"2023-10-08T00:31:39.636916+0000","last_undegraded":"2023-10-08T00:31:39.636916+0000","last_fullsized":"2023-10-08T00:31:39.636916+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:54.482199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.051007+0000","last_change":"2023-10-08T00:31:39.045678+0000","last_active":"2023-10-08T00:31:39.051007+0000","last_peered":"2023-10-08T00:31:39.051007+0000","last_clean":"2023-10-08T00:31:39.051007+0000","last_became_active":"2023-10-08T00:31:39.045408+0000","last_became_peered":"2023-10-08T00:31:39.045408+0000","last_unstale":"2023-10-08T00:31:39.051007+0000","last_undegraded":"2023-10-08T00:31:39.051007+0000","last_fullsized":"2023-10-08T00:31:39.051007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.243768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642691+0000","last_change":"2023-10-08T00:31:39.642691+0000","last_active":"2023-10-08T00:31:39.642691+0000","last_peered":"2023-10-08T00:31:39.642691+0000","last_clean":"2023-10-08T00:31:39.642691+0000","last_became_active":"2023-10-08T00:31:39.642397+0000","last_became_peered":"2023-10-08T00:31:39.642397+0000","last_unstale":"2023-10-08T00:31:39.642691+0000","last_undegraded":"2023-10-08T00:31:39.642691+0000","last_fullsized":"2023-10-08T00:31:39.642691+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:54.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.041589+0000","last_change":"2023-10-08T00:31:39.050279+0000","last_active":"2023-10-08T00:31:40.041589+0000","last_peered":"2023-10-08T00:31:40.041589+0000","last_clean":"2023-10-08T00:31:40.041589+0000","last_became_active":"2023-10-08T00:31:39.049657+0000","last_became_peered":"2023-10-08T00:31:39.049657+0000","last_unstale":"2023-10-08T00:31:40.041589+0000","last_undegraded":"2023-10-08T00:31:40.041589+0000","last_fullsized":"2023-10-08T00:31:40.041589+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:46.716791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644014+0000","last_change":"2023-10-08T00:31:39.644014+0000","last_active":"2023-10-08T00:31:39.644014+0000","last_peered":"2023-10-08T00:31:39.644014+0000","last_clean":"2023-10-08T00:31:39.644014+0000","last_became_active":"2023-10-08T00:31:39.643301+0000","last_became_peered":"2023-10-08T00:31:39.643301+0000","last_unstale":"2023-10-08T00:31:39.644014+0000","last_undegraded":"2023-10-08T00:31:39.644014+0000","last_fullsized":"2023-10-08T00:31:39.644014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:04.519929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.056808+0000","last_change":"2023-10-08T00:31:39.052937+0000","last_active":"2023-10-08T00:31:39.056808+0000","last_peered":"2023-10-08T00:31:39.056808+0000","last_clean":"2023-10-08T00:31:39.056808+0000","last_became_active":"2023-10-08T00:31:39.052607+0000","last_became_peered":"2023-10-08T00:31:39.052607+0000","last_unstale":"2023-10-08T00:31:39.056808+0000","last_undegraded":"2023-10-08T00:31:39.056808+0000","last_fullsized":"2023-10-08T00:31:39.056808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:27.640927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.635482+0000","last_change":"2023-10-08T00:31:39.635482+0000","last_active":"2023-10-08T00:31:39.635482+0000","last_peered":"2023-10-08T00:31:39.635482+0000","last_clean":"2023-10-08T00:31:39.635482+0000","last_became_active":"2023-10-08T00:31:39.635231+0000","last_became_peered":"2023-10-08T00:31:39.635231+0000","last_unstale":"2023-10-08T00:31:39.635482+0000","last_undegraded":"2023-10-08T00:31:39.635482+0000","last_fullsized":"2023-10-08T00:31:39.635482+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:27.131385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057719+0000","last_change":"2023-10-08T00:31:39.053495+0000","last_active":"2023-10-08T00:31:39.057719+0000","last_peered":"2023-10-08T00:31:39.057719+0000","last_clean":"2023-10-08T00:31:39.057719+0000","last_became_active":"2023-10-08T00:31:39.053073+0000","last_became_peered":"2023-10-08T00:31:39.053073+0000","last_unstale":"2023-10-08T00:31:39.057719+0000","last_undegraded":"2023-10-08T00:31:39.057719+0000","last_fullsized":"2023-10-08T00:31:39.057719+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:46:54.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645049+0000","last_change":"2023-10-08T00:31:39.645049+0000","last_active":"2023-10-08T00:31:39.645049+0000","last_peered":"2023-10-08T00:31:39.645049+0000","last_clean":"2023-10-08T00:31:39.645049+0000","last_became_active":"2023-10-08T00:31:39.644443+0000","last_became_peered":"2023-10-08T00:31:39.644443+0000","last_unstale":"2023-10-08T00:31:39.645049+0000","last_undegraded":"2023-10-08T00:31:39.645049+0000","last_fullsized":"2023-10-08T00:31:39.645049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:18.154355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.053563+0000","last_change":"2023-10-08T00:31:39.049104+0000","last_active":"2023-10-08T00:31:39.053563+0000","last_peered":"2023-10-08T00:31:39.053563+0000","last_clean":"2023-10-08T00:31:39.053563+0000","last_became_active":"2023-10-08T00:31:39.048780+0000","last_became_peered":"2023-10-08T00:31:39.048780+0000","last_unstale":"2023-10-08T00:31:39.053563+0000","last_undegraded":"2023-10-08T00:31:39.053563+0000","last_fullsized":"2023-10-08T00:31:39.053563+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:24.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645027+0000","last_change":"2023-10-08T00:31:39.645027+0000","last_active":"2023-10-08T00:31:39.645027+0000","last_peered":"2023-10-08T00:31:39.645027+0000","last_clean":"2023-10-08T00:31:39.645027+0000","last_became_active":"2023-10-08T00:31:39.644003+0000","last_became_peered":"2023-10-08T00:31:39.644003+0000","last_unstale":"2023-10-08T00:31:39.645027+0000","last_undegraded":"2023-10-08T00:31:39.645027+0000","last_fullsized":"2023-10-08T00:31:39.645027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:51:53.672847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.042034+0000","last_change":"2023-10-08T00:31:39.053393+0000","last_active":"2023-10-08T00:31:40.042034+0000","last_peered":"2023-10-08T00:31:40.042034+0000","last_clean":"2023-10-08T00:31:40.042034+0000","last_became_active":"2023-10-08T00:31:39.053127+0000","last_became_peered":"2023-10-08T00:31:39.053127+0000","last_unstale":"2023-10-08T00:31:40.042034+0000","last_undegraded":"2023-10-08T00:31:40.042034+0000","last_fullsized":"2023-10-08T00:31:40.042034+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:44.736790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646634+0000","last_change":"2023-10-08T00:31:39.646634+0000","last_active":"2023-10-08T00:31:39.646634+0000","last_peered":"2023-10-08T00:31:39.646634+0000","last_clean":"2023-10-08T00:31:39.646634+0000","last_became_active":"2023-10-08T00:31:39.646314+0000","last_became_peered":"2023-10-08T00:31:39.646314+0000","last_unstale":"2023-10-08T00:31:39.646634+0000","last_undegraded":"2023-10-08T00:31:39.646634+0000","last_fullsized":"2023-10-08T00:31:39.646634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:26.155826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.053250+0000","last_change":"2023-10-08T00:31:39.052080+0000","last_active":"2023-10-08T00:31:39.053250+0000","last_peered":"2023-10-08T00:31:39.053250+0000","last_clean":"2023-10-08T00:31:39.053250+0000","last_became_active":"2023-10-08T00:31:39.051784+0000","last_became_peered":"2023-10-08T00:31:39.051784+0000","last_unstale":"2023-10-08T00:31:39.053250+0000","last_undegraded":"2023-10-08T00:31:39.053250+0000","last_fullsized":"2023-10-08T00:31:39.053250+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:05.605732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641204+0000","last_change":"2023-10-08T00:31:39.641204+0000","last_active":"2023-10-08T00:31:39.641204+0000","last_peered":"2023-10-08T00:31:39.641204+0000","last_clean":"2023-10-08T00:31:39.641204+0000","last_became_active":"2023-10-08T00:31:39.640952+0000","last_became_peered":"2023-10-08T00:31:39.640952+0000","last_unstale":"2023-10-08T00:31:39.641204+0000","last_undegraded":"2023-10-08T00:31:39.641204+0000","last_fullsized":"2023-10-08T00:31:39.641204+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:51:53.672847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.056452+0000","last_change":"2023-10-08T00:31:39.052821+0000","last_active":"2023-10-08T00:31:39.056452+0000","last_peered":"2023-10-08T00:31:39.056452+0000","last_clean":"2023-10-08T00:31:39.056452+0000","last_became_active":"2023-10-08T00:31:39.052514+0000","last_became_peered":"2023-10-08T00:31:39.052514+0000","last_unstale":"2023-10-08T00:31:39.056452+0000","last_undegraded":"2023-10-08T00:31:39.056452+0000","last_fullsized":"2023-10-08T00:31:39.056452+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:51.782897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642999+0000","last_change":"2023-10-08T00:31:39.642999+0000","last_active":"2023-10-08T00:31:39.642999+0000","last_peered":"2023-10-08T00:31:39.642999+0000","last_clean":"2023-10-08T00:31:39.642999+0000","last_became_active":"2023-10-08T00:31:39.642599+0000","last_became_peered":"2023-10-08T00:31:39.642599+0000","last_unstale":"2023-10-08T00:31:39.642999+0000","last_undegraded":"2023-10-08T00:31:39.642999+0000","last_fullsized":"2023-10-08T00:31:39.642999+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:03.732301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.043577+0000","last_change":"2023-10-08T00:31:39.040095+0000","last_active":"2023-10-08T00:31:39.043577+0000","last_peered":"2023-10-08T00:31:39.043577+0000","last_clean":"2023-10-08T00:31:39.043577+0000","last_became_active":"2023-10-08T00:31:39.039830+0000","last_became_peered":"2023-10-08T00:31:39.039830+0000","last_unstale":"2023-10-08T00:31:39.043577+0000","last_undegraded":"2023-10-08T00:31:39.043577+0000","last_fullsized":"2023-10-08T00:31:39.043577+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:27:07.857258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.648857+0000","last_change":"2023-10-08T00:31:39.648857+0000","last_active":"2023-10-08T00:31:39.648857+0000","last_peered":"2023-10-08T00:31:39.648857+0000","last_clean":"2023-10-08T00:31:39.648857+0000","last_became_active":"2023-10-08T00:31:39.648585+0000","last_became_peered":"2023-10-08T00:31:39.648585+0000","last_unstale":"2023-10-08T00:31:39.648857+0000","last_undegraded":"2023-10-08T00:31:39.648857+0000","last_fullsized":"2023-10-08T00:31:39.648857+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:54:24.166510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057178+0000","last_change":"2023-10-08T00:31:39.055403+0000","last_active":"2023-10-08T00:31:39.057178+0000","last_peered":"2023-10-08T00:31:39.057178+0000","last_clean":"2023-10-08T00:31:39.057178+0000","last_became_active":"2023-10-08T00:31:39.055107+0000","last_became_peered":"2023-10-08T00:31:39.055107+0000","last_unstale":"2023-10-08T00:31:39.057178+0000","last_undegraded":"2023-10-08T00:31:39.057178+0000","last_fullsized":"2023-10-08T00:31:39.057178+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:18.746281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644128+0000","last_change":"2023-10-08T00:31:39.644128+0000","last_active":"2023-10-08T00:31:39.644128+0000","last_peered":"2023-10-08T00:31:39.644128+0000","last_clean":"2023-10-08T00:31:39.644128+0000","last_became_active":"2023-10-08T00:31:39.643865+0000","last_became_peered":"2023-10-08T00:31:39.643865+0000","last_unstale":"2023-10-08T00:31:39.644128+0000","last_undegraded":"2023-10-08T00:31:39.644128+0000","last_fullsized":"2023-10-08T00:31:39.644128+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:58:26.725879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.051434+0000","last_change":"2023-10-08T00:31:39.049850+0000","last_active":"2023-10-08T00:31:39.051434+0000","last_peered":"2023-10-08T00:31:39.051434+0000","last_clean":"2023-10-08T00:31:39.051434+0000","last_became_active":"2023-10-08T00:31:39.049552+0000","last_became_peered":"2023-10-08T00:31:39.049552+0000","last_unstale":"2023-10-08T00:31:39.051434+0000","last_undegraded":"2023-10-08T00:31:39.051434+0000","last_fullsized":"2023-10-08T00:31:39.051434+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:06:15.339259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645079+0000","last_change":"2023-10-08T00:31:39.645079+0000","last_active":"2023-10-08T00:31:39.645079+0000","last_peered":"2023-10-08T00:31:39.645079+0000","last_clean":"2023-10-08T00:31:39.645079+0000","last_became_active":"2023-10-08T00:31:39.644256+0000","last_became_peered":"2023-10-08T00:31:39.644256+0000","last_unstale":"2023-10-08T00:31:39.645079+0000","last_undegraded":"2023-10-08T00:31:39.645079+0000","last_fullsized":"2023-10-08T00:31:39.645079+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:31:17.441761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057029+0000","last_change":"2023-10-08T00:31:39.053317+0000","last_active":"2023-10-08T00:31:39.057029+0000","last_peered":"2023-10-08T00:31:39.057029+0000","last_clean":"2023-10-08T00:31:39.057029+0000","last_became_active":"2023-10-08T00:31:39.052776+0000","last_became_peered":"2023-10-08T00:31:39.052776+0000","last_unstale":"2023-10-08T00:31:39.057029+0000","last_undegraded":"2023-10-08T00:31:39.057029+0000","last_fullsized":"2023-10-08T00:31:39.057029+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:09.173454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641840+0000","last_change":"2023-10-08T00:31:39.641840+0000","last_active":"2023-10-08T00:31:39.641840+0000","last_peered":"2023-10-08T00:31:39.641840+0000","last_clean":"2023-10-08T00:31:39.641840+0000","last_became_active":"2023-10-08T00:31:39.641562+0000","last_became_peered":"2023-10-08T00:31:39.641562+0000","last_unstale":"2023-10-08T00:31:39.641840+0000","last_undegraded":"2023-10-08T00:31:39.641840+0000","last_fullsized":"2023-10-08T00:31:39.641840+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:03.732301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.044707+0000","last_change":"2023-10-08T00:31:39.042894+0000","last_active":"2023-10-08T00:31:39.044707+0000","last_peered":"2023-10-08T00:31:39.044707+0000","last_clean":"2023-10-08T00:31:39.044707+0000","last_became_active":"2023-10-08T00:31:39.042641+0000","last_became_peered":"2023-10-08T00:31:39.042641+0000","last_unstale":"2023-10-08T00:31:39.044707+0000","last_undegraded":"2023-10-08T00:31:39.044707+0000","last_fullsized":"2023-10-08T00:31:39.044707+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:04:13.358577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644907+0000","last_change":"2023-10-08T00:31:39.644907+0000","last_active":"2023-10-08T00:31:39.644907+0000","last_peered":"2023-10-08T00:31:39.644907+0000","last_clean":"2023-10-08T00:31:39.644907+0000","last_became_active":"2023-10-08T00:31:39.643357+0000","last_became_peered":"2023-10-08T00:31:39.643357+0000","last_unstale":"2023-10-08T00:31:39.644907+0000","last_undegraded":"2023-10-08T00:31:39.644907+0000","last_fullsized":"2023-10-08T00:31:39.644907+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:02:39.126796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.041040+0000","last_change":"2023-10-08T00:31:39.057478+0000","last_active":"2023-10-08T00:31:40.041040+0000","last_peered":"2023-10-08T00:31:40.041040+0000","last_clean":"2023-10-08T00:31:40.041040+0000","last_became_active":"2023-10-08T00:31:39.057108+0000","last_became_peered":"2023-10-08T00:31:39.057108+0000","last_unstale":"2023-10-08T00:31:40.041040+0000","last_undegraded":"2023-10-08T00:31:40.041040+0000","last_fullsized":"2023-10-08T00:31:40.041040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:27.640927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.046050+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:31:39.046050+0000","last_peered":"2023-10-08T00:31:39.046050+0000","last_clean":"2023-10-08T00:31:39.046050+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:31:39.046050+0000","last_undegraded":"2023-10-08T00:31:39.046050+0000","last_fullsized":"2023-10-08T00:31:39.046050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1201642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70699999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.876},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.502,"15min":0.52900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.55400000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71299999999999997,"5min":0.75,"15min":0.79000000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.86299999999999999,"15min":1.048},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":0.89400000000000002,"15min":1.0920000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.60299999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298680,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073160,"statfs":{"total":96636764160,"available":96330915840,"internally_reserved":0,"allocated":1425408,"data_stored":612810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.28100000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.77200000000000002,"15min":0.84399999999999997},"last":0.315},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.90700000000000003,"15min":0.94499999999999995},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.80800000000000005,"15min":1.145},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.749,"15min":0.873},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.78500000000000003,"15min":1.079},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.76000000000000001,"15min":0.85799999999999998},"last":0.5}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.871,"15min":1.127},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":1.1160000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70099999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57099999999999995,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29399999999999998},"max":{"1min":0.77700000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58799999999999997,"15min":0.63500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":1.093},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":611274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.64300000000000002},"last":0.307},{"interface":"front","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52300000000000002,"5min":0.58099999999999996,"15min":0.60199999999999998},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.254,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28799999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.376},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54300000000000004,"5min":0.624,"15min":0.84699999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77000000000000002,"5min":0.90100000000000002,"15min":1.294},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":1.038},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.874,"15min":0.879},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.97999999999999998,"15min":1.087},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1201642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.34899999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.308},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.63100000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.37},{"interface":"front","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.60699999999999998,"5min":0.60899999999999999,"15min":0.64700000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.73399999999999999,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":1.242},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.86399999999999999,"15min":1.0800000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.78800000000000003,"5min":0.91000000000000003,"15min":1.0529999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.316,"15min":0.34599999999999997},"min":{"1min":0.218,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.60899999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.38400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.35099999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34699999999999998,"15min":0.373},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48099999999999998,"5min":0.54900000000000004,"15min":0.65000000000000002},"last":0.377},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.40899999999999997},"min":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53400000000000003,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60799999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39300000000000002,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51900000000000002,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":1.0489999999999999,"15min":1.0760000000000001},"last":0.505}]},{"osd":5,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91900000000000004,"5min":0.93899999999999995,"15min":1.278},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.0880000000000001,"15min":1.137},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.95999999999999996},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.65300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93899999999999995,"5min":1,"15min":1.1259999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.343},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33900000000000002,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.308},{"interface":"front","average":{"1min":0.374,"5min":0.371,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.37}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.42699999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":611344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64200000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.371,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.63500000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.93300000000000005,"15min":1.712},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.64800000000000002,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.0960000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":0.873,"15min":0.873},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.5},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77200000000000002,"5min":1.002,"15min":1.002},"last":0.73999999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.75},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.82799999999999996,"15min":0.84199999999999997},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.747,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.621},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67800000000000005,"5min":0.71999999999999997,"15min":0.75700000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.58199999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.495},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82999999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29199999999999998},"max":{"1min":0.749,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.437},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.55100000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.30499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72699999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38300000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.61399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.82499999999999996,"15min":0.84499999999999997},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:31:44.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:31:44.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.315+0000 7f231d6e1700 1 Processor -- start 2023-10-08T00:31:44.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.315+0000 7f231d6e1700 1 -- start start 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f231d6e1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 0x7f231815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f231d6e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 0x7f231815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f231d6e1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231815a160 con 0x7f231815db10 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f231d6e1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23180d13a0 con 0x7f2318159890 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f231d6e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231815e140 con 0x7f2318159c60 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f2316ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 0x7f231815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23167fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 0x7f231815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23177fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f231815db10 0x7f2318069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49788/0 (socket says 172.21.15.22:49788) 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f2316ffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 0x7f231815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:37736/0 (socket says 172.21.15.22:37736) 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23167fc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 0x7f231815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:49224/0 (socket says 172.21.15.22:49224) 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23177fe700 1 -- 172.21.15.22:0/1701566743 learned_addr learned my addr 172.21.15.22:0/1701566743 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23167fc700 1 -- 172.21.15.22:0/1701566743 >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 msgr2=0x7f231815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23167fc700 1 --2- 172.21.15.22:0/1701566743 >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 0x7f231815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23167fc700 1 -- 172.21.15.22:0/1701566743 >> v1:172.21.15.192:6789/0 conn(0x7f231815db10 legacy=0x7f2318069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f23167fc700 1 -- 172.21.15.22:0/1701566743 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231815a3d0 con 0x7f2318159c60 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.316+0000 7f2316ffd700 1 --2- 172.21.15.22:0/1701566743 >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 0x7f231815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f23167fc700 1 --2- 172.21.15.22:0/1701566743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 0x7f231815d5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f230c0098e0 tx=0x7f230c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa25244a3051171b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f2315ffb700 1 -- 172.21.15.22:0/1701566743 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00b640 con 0x7f2318159c60 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f2315ffb700 1 -- 172.21.15.22:0/1701566743 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c00b7a0 con 0x7f2318159c60 2023-10-08T00:31:44.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f2315ffb700 1 -- 172.21.15.22:0/1701566743 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00bb40 con 0x7f2318159c60 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 -- 172.21.15.22:0/1701566743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 msgr2=0x7f231815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 --2- 172.21.15.22:0/1701566743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 0x7f231815d5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f230c0098e0 tx=0x7f230c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 -- 172.21.15.22:0/1701566743 shutdown_connections 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 --2- 172.21.15.22:0/1701566743 >> v2:172.21.15.192:3300/0 conn(0x7f2318159890 0x7f231815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 --2- 172.21.15.22:0/1701566743 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159c60 0x7f231815d5d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 -- 172.21.15.22:0/1701566743 >> 172.21.15.22:0/1701566743 conn(0x7f2318068e20 msgr2=0x7f23180d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 -- 172.21.15.22:0/1701566743 shutdown_connections 2023-10-08T00:31:44.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.317+0000 7f231d6e1700 1 -- 172.21.15.22:0/1701566743 wait complete. 2023-10-08T00:31:44.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.318+0000 7f231d6e1700 1 Processor -- start 2023-10-08T00:31:44.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 -- start start 2023-10-08T00:31:44.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159890 0x7f23180b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2318159c60 0x7f23180cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 0x7f23181506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180cd1f0 con 0x7f231815db10 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318151ca0 con 0x7f2318159c60 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f231d6e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2318151f80 con 0x7f2318159890 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f23177fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 0x7f23181506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f23177fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 0x7f23181506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53962/0 (socket says 172.21.15.22:53962) 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f23177fe700 1 -- 172.21.15.22:0/3751199678 learned_addr learned my addr 172.21.15.22:0/3751199678 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f23167fc700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2318159c60 0x7f23180cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.319+0000 7f2316ffd700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159890 0x7f23180b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f23177fe700 1 -- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159890 msgr2=0x7f23180b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f23177fe700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159890 0x7f23180b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f23177fe700 1 -- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2318159c60 msgr2=0x7f23180cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f23177fe700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2318159c60 0x7f23180cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f23177fe700 1 -- 172.21.15.22:0/3751199678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009420 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f23177fe700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 0x7f23181506b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f231000cbc0 tx=0x7f23100019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000a7e0 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000a940 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c009420 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000acc0 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.320+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318152540 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.321+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180cd360 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.322+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2310007300 con 0x7f231815db10 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.322+0000 7f22feffd700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304067320 0x7f23040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.322+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2310084f60 con 0x7f231815db10 2023-10-08T00:31:44.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.322+0000 7f2316ffd700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304067320 0x7f23040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.323+0000 7f2316ffd700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304067320 0x7f23040697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2308009f40 tx=0x7f23080091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:44.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.326+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2310051ba0 con 0x7f231815db10 2023-10-08T00:31:44.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.515+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f231804c3c0 con 0x7f2304067320 2023-10-08T00:31:44.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.523+0000 7f22feffd700 1 -- 172.21.15.22:0/3751199678 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289765 (secure 0 0 0) 0x7f231804c3c0 con 0x7f2304067320 2023-10-08T00:31:44.527 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:44.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304067320 msgr2=0x7f23040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304067320 0x7f23040697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2308009f40 tx=0x7f23080091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 msgr2=0x7f23181506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 0x7f23181506b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f231000cbc0 tx=0x7f23100019c0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 shutdown_connections 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f231815db10 0x7f23181506b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.526+0000 7f231d6e1700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2304067320 0x7f23040697d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.527+0000 7f231d6e1700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2318159890 0x7f23180b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.527+0000 7f231d6e1700 1 --2- 172.21.15.22:0/3751199678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2318159c60 0x7f23180cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.527+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 >> 172.21.15.22:0/3751199678 conn(0x7f2318068e20 msgr2=0x7f2318157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.527+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 shutdown_connections 2023-10-08T00:31:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.527+0000 7f231d6e1700 1 -- 172.21.15.22:0/3751199678 wait complete. 2023-10-08T00:31:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:31:44.539 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2023-10-08T00:31:44.481221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419216,"kb_used_data":12240,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752555504,"statfs":{"total":773094113280,"available":770616836096,"internally_reserved":0,"allocated":12533760,"data_stored":6073394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.852487"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643306+0000","last_change":"2023-10-08T00:31:39.643306+0000","last_active":"2023-10-08T00:31:39.643306+0000","last_peered":"2023-10-08T00:31:39.643306+0000","last_clean":"2023-10-08T00:31:39.643306+0000","last_became_active":"2023-10-08T00:31:39.643060+0000","last_became_peered":"2023-10-08T00:31:39.643060+0000","last_unstale":"2023-10-08T00:31:39.643306+0000","last_undegraded":"2023-10-08T00:31:39.643306+0000","last_fullsized":"2023-10-08T00:31:39.643306+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:06.378361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641311+0000","last_change":"2023-10-08T00:31:39.641311+0000","last_active":"2023-10-08T00:31:39.641311+0000","last_peered":"2023-10-08T00:31:39.641311+0000","last_clean":"2023-10-08T00:31:39.641311+0000","last_became_active":"2023-10-08T00:31:39.641051+0000","last_became_peered":"2023-10-08T00:31:39.641051+0000","last_unstale":"2023-10-08T00:31:39.641311+0000","last_undegraded":"2023-10-08T00:31:39.641311+0000","last_fullsized":"2023-10-08T00:31:39.641311+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:01:19.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642075+0000","last_change":"2023-10-08T00:31:39.642075+0000","last_active":"2023-10-08T00:31:39.642075+0000","last_peered":"2023-10-08T00:31:39.642075+0000","last_clean":"2023-10-08T00:31:39.642075+0000","last_became_active":"2023-10-08T00:31:39.641779+0000","last_became_peered":"2023-10-08T00:31:39.641779+0000","last_unstale":"2023-10-08T00:31:39.642075+0000","last_undegraded":"2023-10-08T00:31:39.642075+0000","last_fullsized":"2023-10-08T00:31:39.642075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:04.257195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642880+0000","last_change":"2023-10-08T00:31:39.642880+0000","last_active":"2023-10-08T00:31:39.642880+0000","last_peered":"2023-10-08T00:31:39.642880+0000","last_clean":"2023-10-08T00:31:39.642880+0000","last_became_active":"2023-10-08T00:31:39.642606+0000","last_became_peered":"2023-10-08T00:31:39.642606+0000","last_unstale":"2023-10-08T00:31:39.642880+0000","last_undegraded":"2023-10-08T00:31:39.642880+0000","last_fullsized":"2023-10-08T00:31:39.642880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:52.787966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641526+0000","last_change":"2023-10-08T00:31:39.641526+0000","last_active":"2023-10-08T00:31:39.641526+0000","last_peered":"2023-10-08T00:31:39.641526+0000","last_clean":"2023-10-08T00:31:39.641526+0000","last_became_active":"2023-10-08T00:31:39.641241+0000","last_became_peered":"2023-10-08T00:31:39.641241+0000","last_unstale":"2023-10-08T00:31:39.641526+0000","last_undegraded":"2023-10-08T00:31:39.641526+0000","last_fullsized":"2023-10-08T00:31:39.641526+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:03.509035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644765+0000","last_change":"2023-10-08T00:31:39.644765+0000","last_active":"2023-10-08T00:31:39.644765+0000","last_peered":"2023-10-08T00:31:39.644765+0000","last_clean":"2023-10-08T00:31:39.644765+0000","last_became_active":"2023-10-08T00:31:39.644225+0000","last_became_peered":"2023-10-08T00:31:39.644225+0000","last_unstale":"2023-10-08T00:31:39.644765+0000","last_undegraded":"2023-10-08T00:31:39.644765+0000","last_fullsized":"2023-10-08T00:31:39.644765+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:08.763078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643583+0000","last_change":"2023-10-08T00:31:39.643583+0000","last_active":"2023-10-08T00:31:39.643583+0000","last_peered":"2023-10-08T00:31:39.643583+0000","last_clean":"2023-10-08T00:31:39.643583+0000","last_became_active":"2023-10-08T00:31:39.643281+0000","last_became_peered":"2023-10-08T00:31:39.643281+0000","last_unstale":"2023-10-08T00:31:39.643583+0000","last_undegraded":"2023-10-08T00:31:39.643583+0000","last_fullsized":"2023-10-08T00:31:39.643583+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:55:14.885537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644010+0000","last_change":"2023-10-08T00:31:39.644010+0000","last_active":"2023-10-08T00:31:39.644010+0000","last_peered":"2023-10-08T00:31:39.644010+0000","last_clean":"2023-10-08T00:31:39.644010+0000","last_became_active":"2023-10-08T00:31:39.643772+0000","last_became_peered":"2023-10-08T00:31:39.643772+0000","last_unstale":"2023-10-08T00:31:39.644010+0000","last_undegraded":"2023-10-08T00:31:39.644010+0000","last_fullsized":"2023-10-08T00:31:39.644010+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:54.482199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.647771+0000","last_change":"2023-10-08T00:31:39.647771+0000","last_active":"2023-10-08T00:31:39.647771+0000","last_peered":"2023-10-08T00:31:39.647771+0000","last_clean":"2023-10-08T00:31:39.647771+0000","last_became_active":"2023-10-08T00:31:39.647416+0000","last_became_peered":"2023-10-08T00:31:39.647416+0000","last_unstale":"2023-10-08T00:31:39.647771+0000","last_undegraded":"2023-10-08T00:31:39.647771+0000","last_fullsized":"2023-10-08T00:31:39.647771+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:00:14.111161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641209+0000","last_change":"2023-10-08T00:31:39.641209+0000","last_active":"2023-10-08T00:31:39.641209+0000","last_peered":"2023-10-08T00:31:39.641209+0000","last_clean":"2023-10-08T00:31:39.641209+0000","last_became_active":"2023-10-08T00:31:39.640928+0000","last_became_peered":"2023-10-08T00:31:39.640928+0000","last_unstale":"2023-10-08T00:31:39.641209+0000","last_undegraded":"2023-10-08T00:31:39.641209+0000","last_fullsized":"2023-10-08T00:31:39.641209+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:00:14.111161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.638907+0000","last_change":"2023-10-08T00:31:39.638907+0000","last_active":"2023-10-08T00:31:39.638907+0000","last_peered":"2023-10-08T00:31:39.638907+0000","last_clean":"2023-10-08T00:31:39.638907+0000","last_became_active":"2023-10-08T00:31:39.638647+0000","last_became_peered":"2023-10-08T00:31:39.638647+0000","last_unstale":"2023-10-08T00:31:39.638907+0000","last_undegraded":"2023-10-08T00:31:39.638907+0000","last_fullsized":"2023-10-08T00:31:39.638907+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:39.715676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642015+0000","last_change":"2023-10-08T00:31:39.642015+0000","last_active":"2023-10-08T00:31:39.642015+0000","last_peered":"2023-10-08T00:31:39.642015+0000","last_clean":"2023-10-08T00:31:39.642015+0000","last_became_active":"2023-10-08T00:31:39.641752+0000","last_became_peered":"2023-10-08T00:31:39.641752+0000","last_unstale":"2023-10-08T00:31:39.642015+0000","last_undegraded":"2023-10-08T00:31:39.642015+0000","last_fullsized":"2023-10-08T00:31:39.642015+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:27.131385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642467+0000","last_change":"2023-10-08T00:31:39.642467+0000","last_active":"2023-10-08T00:31:39.642467+0000","last_peered":"2023-10-08T00:31:39.642467+0000","last_clean":"2023-10-08T00:31:39.642467+0000","last_became_active":"2023-10-08T00:31:39.642142+0000","last_became_peered":"2023-10-08T00:31:39.642142+0000","last_unstale":"2023-10-08T00:31:39.642467+0000","last_undegraded":"2023-10-08T00:31:39.642467+0000","last_fullsized":"2023-10-08T00:31:39.642467+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:25:54.998698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643185+0000","last_change":"2023-10-08T00:31:39.643185+0000","last_active":"2023-10-08T00:31:39.643185+0000","last_peered":"2023-10-08T00:31:39.643185+0000","last_clean":"2023-10-08T00:31:39.643185+0000","last_became_active":"2023-10-08T00:31:39.642938+0000","last_became_peered":"2023-10-08T00:31:39.642938+0000","last_unstale":"2023-10-08T00:31:39.643185+0000","last_undegraded":"2023-10-08T00:31:39.643185+0000","last_fullsized":"2023-10-08T00:31:39.643185+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:20.500938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646545+0000","last_change":"2023-10-08T00:31:39.646545+0000","last_active":"2023-10-08T00:31:39.646545+0000","last_peered":"2023-10-08T00:31:39.646545+0000","last_clean":"2023-10-08T00:31:39.646545+0000","last_became_active":"2023-10-08T00:31:39.646286+0000","last_became_peered":"2023-10-08T00:31:39.646286+0000","last_unstale":"2023-10-08T00:31:39.646545+0000","last_undegraded":"2023-10-08T00:31:39.646545+0000","last_fullsized":"2023-10-08T00:31:39.646545+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:55:44.686142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644715+0000","last_change":"2023-10-08T00:31:39.644715+0000","last_active":"2023-10-08T00:31:39.644715+0000","last_peered":"2023-10-08T00:31:39.644715+0000","last_clean":"2023-10-08T00:31:39.644715+0000","last_became_active":"2023-10-08T00:31:39.643956+0000","last_became_peered":"2023-10-08T00:31:39.643956+0000","last_unstale":"2023-10-08T00:31:39.644715+0000","last_undegraded":"2023-10-08T00:31:39.644715+0000","last_fullsized":"2023-10-08T00:31:39.644715+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:27.928976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639069+0000","last_change":"2023-10-08T00:31:39.639069+0000","last_active":"2023-10-08T00:31:39.639069+0000","last_peered":"2023-10-08T00:31:39.639069+0000","last_clean":"2023-10-08T00:31:39.639069+0000","last_became_active":"2023-10-08T00:31:39.638598+0000","last_became_peered":"2023-10-08T00:31:39.638598+0000","last_unstale":"2023-10-08T00:31:39.639069+0000","last_undegraded":"2023-10-08T00:31:39.639069+0000","last_fullsized":"2023-10-08T00:31:39.639069+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:29.195272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641847+0000","last_change":"2023-10-08T00:31:39.641847+0000","last_active":"2023-10-08T00:31:39.641847+0000","last_peered":"2023-10-08T00:31:39.641847+0000","last_clean":"2023-10-08T00:31:39.641847+0000","last_became_active":"2023-10-08T00:31:39.641599+0000","last_became_peered":"2023-10-08T00:31:39.641599+0000","last_unstale":"2023-10-08T00:31:39.641847+0000","last_undegraded":"2023-10-08T00:31:39.641847+0000","last_fullsized":"2023-10-08T00:31:39.641847+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:48.054362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.648576+0000","last_change":"2023-10-08T00:31:39.648576+0000","last_active":"2023-10-08T00:31:39.648576+0000","last_peered":"2023-10-08T00:31:39.648576+0000","last_clean":"2023-10-08T00:31:39.648576+0000","last_became_active":"2023-10-08T00:31:39.648391+0000","last_became_peered":"2023-10-08T00:31:39.648391+0000","last_unstale":"2023-10-08T00:31:39.648576+0000","last_undegraded":"2023-10-08T00:31:39.648576+0000","last_fullsized":"2023-10-08T00:31:39.648576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:16.931366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.635477+0000","last_change":"2023-10-08T00:31:39.635477+0000","last_active":"2023-10-08T00:31:39.635477+0000","last_peered":"2023-10-08T00:31:39.635477+0000","last_clean":"2023-10-08T00:31:39.635477+0000","last_became_active":"2023-10-08T00:31:39.635205+0000","last_became_peered":"2023-10-08T00:31:39.635205+0000","last_unstale":"2023-10-08T00:31:39.635477+0000","last_undegraded":"2023-10-08T00:31:39.635477+0000","last_fullsized":"2023-10-08T00:31:39.635477+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:14:04.446597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646979+0000","last_change":"2023-10-08T00:31:39.646979+0000","last_active":"2023-10-08T00:31:39.646979+0000","last_peered":"2023-10-08T00:31:39.646979+0000","last_clean":"2023-10-08T00:31:39.646979+0000","last_became_active":"2023-10-08T00:31:39.646727+0000","last_became_peered":"2023-10-08T00:31:39.646727+0000","last_unstale":"2023-10-08T00:31:39.646979+0000","last_undegraded":"2023-10-08T00:31:39.646979+0000","last_fullsized":"2023-10-08T00:31:39.646979+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:13:33.998786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.636099+0000","last_change":"2023-10-08T00:31:39.636099+0000","last_active":"2023-10-08T00:31:39.636099+0000","last_peered":"2023-10-08T00:31:39.636099+0000","last_clean":"2023-10-08T00:31:39.636099+0000","last_became_active":"2023-10-08T00:31:39.635829+0000","last_became_peered":"2023-10-08T00:31:39.635829+0000","last_unstale":"2023-10-08T00:31:39.636099+0000","last_undegraded":"2023-10-08T00:31:39.636099+0000","last_fullsized":"2023-10-08T00:31:39.636099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:24:37.168327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642530+0000","last_change":"2023-10-08T00:31:39.642530+0000","last_active":"2023-10-08T00:31:39.642530+0000","last_peered":"2023-10-08T00:31:39.642530+0000","last_clean":"2023-10-08T00:31:39.642530+0000","last_became_active":"2023-10-08T00:31:39.642132+0000","last_became_peered":"2023-10-08T00:31:39.642132+0000","last_unstale":"2023-10-08T00:31:39.642530+0000","last_undegraded":"2023-10-08T00:31:39.642530+0000","last_fullsized":"2023-10-08T00:31:39.642530+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:20.530616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640219+0000","last_change":"2023-10-08T00:31:39.640219+0000","last_active":"2023-10-08T00:31:39.640219+0000","last_peered":"2023-10-08T00:31:39.640219+0000","last_clean":"2023-10-08T00:31:39.640219+0000","last_became_active":"2023-10-08T00:31:39.639977+0000","last_became_peered":"2023-10-08T00:31:39.639977+0000","last_unstale":"2023-10-08T00:31:39.640219+0000","last_undegraded":"2023-10-08T00:31:39.640219+0000","last_fullsized":"2023-10-08T00:31:39.640219+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:06:29.352848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640000+0000","last_change":"2023-10-08T00:31:39.640000+0000","last_active":"2023-10-08T00:31:39.640000+0000","last_peered":"2023-10-08T00:31:39.640000+0000","last_clean":"2023-10-08T00:31:39.640000+0000","last_became_active":"2023-10-08T00:31:39.639712+0000","last_became_peered":"2023-10-08T00:31:39.639712+0000","last_unstale":"2023-10-08T00:31:39.640000+0000","last_undegraded":"2023-10-08T00:31:39.640000+0000","last_fullsized":"2023-10-08T00:31:39.640000+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:52.791927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643480+0000","last_change":"2023-10-08T00:31:39.643480+0000","last_active":"2023-10-08T00:31:39.643480+0000","last_peered":"2023-10-08T00:31:39.643480+0000","last_clean":"2023-10-08T00:31:39.643480+0000","last_became_active":"2023-10-08T00:31:39.643204+0000","last_became_peered":"2023-10-08T00:31:39.643204+0000","last_unstale":"2023-10-08T00:31:39.643480+0000","last_undegraded":"2023-10-08T00:31:39.643480+0000","last_fullsized":"2023-10-08T00:31:39.643480+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:59:42.198359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642321+0000","last_change":"2023-10-08T00:31:39.642321+0000","last_active":"2023-10-08T00:31:39.642321+0000","last_peered":"2023-10-08T00:31:39.642321+0000","last_clean":"2023-10-08T00:31:39.642321+0000","last_became_active":"2023-10-08T00:31:39.642029+0000","last_became_peered":"2023-10-08T00:31:39.642029+0000","last_unstale":"2023-10-08T00:31:39.642321+0000","last_undegraded":"2023-10-08T00:31:39.642321+0000","last_fullsized":"2023-10-08T00:31:39.642321+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:47.721860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.647599+0000","last_change":"2023-10-08T00:31:39.647599+0000","last_active":"2023-10-08T00:31:39.647599+0000","last_peered":"2023-10-08T00:31:39.647599+0000","last_clean":"2023-10-08T00:31:39.647599+0000","last_became_active":"2023-10-08T00:31:39.646573+0000","last_became_peered":"2023-10-08T00:31:39.646573+0000","last_unstale":"2023-10-08T00:31:39.647599+0000","last_undegraded":"2023-10-08T00:31:39.647599+0000","last_fullsized":"2023-10-08T00:31:39.647599+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:49.746952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646486+0000","last_change":"2023-10-08T00:31:39.646486+0000","last_active":"2023-10-08T00:31:39.646486+0000","last_peered":"2023-10-08T00:31:39.646486+0000","last_clean":"2023-10-08T00:31:39.646486+0000","last_became_active":"2023-10-08T00:31:39.646200+0000","last_became_peered":"2023-10-08T00:31:39.646200+0000","last_unstale":"2023-10-08T00:31:39.646486+0000","last_undegraded":"2023-10-08T00:31:39.646486+0000","last_fullsized":"2023-10-08T00:31:39.646486+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:49.746952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646680+0000","last_change":"2023-10-08T00:31:39.646680+0000","last_active":"2023-10-08T00:31:39.646680+0000","last_peered":"2023-10-08T00:31:39.646680+0000","last_clean":"2023-10-08T00:31:39.646680+0000","last_became_active":"2023-10-08T00:31:39.646411+0000","last_became_peered":"2023-10-08T00:31:39.646411+0000","last_unstale":"2023-10-08T00:31:39.646680+0000","last_undegraded":"2023-10-08T00:31:39.646680+0000","last_fullsized":"2023-10-08T00:31:39.646680+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:45.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645243+0000","last_change":"2023-10-08T00:31:39.645243+0000","last_active":"2023-10-08T00:31:39.645243+0000","last_peered":"2023-10-08T00:31:39.645243+0000","last_clean":"2023-10-08T00:31:39.645243+0000","last_became_active":"2023-10-08T00:31:39.644777+0000","last_became_peered":"2023-10-08T00:31:39.644777+0000","last_unstale":"2023-10-08T00:31:39.645243+0000","last_undegraded":"2023-10-08T00:31:39.645243+0000","last_fullsized":"2023-10-08T00:31:39.645243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:21:48.871265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639223+0000","last_change":"2023-10-08T00:31:39.639223+0000","last_active":"2023-10-08T00:31:39.639223+0000","last_peered":"2023-10-08T00:31:39.639223+0000","last_clean":"2023-10-08T00:31:39.639223+0000","last_became_active":"2023-10-08T00:31:39.638661+0000","last_became_peered":"2023-10-08T00:31:39.638661+0000","last_unstale":"2023-10-08T00:31:39.639223+0000","last_undegraded":"2023-10-08T00:31:39.639223+0000","last_fullsized":"2023-10-08T00:31:39.639223+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:52.791927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644294+0000","last_change":"2023-10-08T00:31:39.644294+0000","last_active":"2023-10-08T00:31:39.644294+0000","last_peered":"2023-10-08T00:31:39.644294+0000","last_clean":"2023-10-08T00:31:39.644294+0000","last_became_active":"2023-10-08T00:31:39.643720+0000","last_became_peered":"2023-10-08T00:31:39.643720+0000","last_unstale":"2023-10-08T00:31:39.644294+0000","last_undegraded":"2023-10-08T00:31:39.644294+0000","last_fullsized":"2023-10-08T00:31:39.644294+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:44:23.701448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"113'4","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.044730+0000","last_change":"2023-10-08T00:31:39.056888+0000","last_active":"2023-10-08T00:31:40.044730+0000","last_peered":"2023-10-08T00:31:40.044730+0000","last_clean":"2023-10-08T00:31:40.044730+0000","last_became_active":"2023-10-08T00:31:39.056637+0000","last_became_peered":"2023-10-08T00:31:39.056637+0000","last_unstale":"2023-10-08T00:31:40.044730+0000","last_undegraded":"2023-10-08T00:31:40.044730+0000","last_fullsized":"2023-10-08T00:31:40.044730+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:46:49.897298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643028+0000","last_change":"2023-10-08T00:31:39.643028+0000","last_active":"2023-10-08T00:31:39.643028+0000","last_peered":"2023-10-08T00:31:39.643028+0000","last_clean":"2023-10-08T00:31:39.643028+0000","last_became_active":"2023-10-08T00:31:39.642752+0000","last_became_peered":"2023-10-08T00:31:39.642752+0000","last_unstale":"2023-10-08T00:31:39.643028+0000","last_undegraded":"2023-10-08T00:31:39.643028+0000","last_fullsized":"2023-10-08T00:31:39.643028+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:01:19.772697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639734+0000","last_change":"2023-10-08T00:31:39.049366+0000","last_active":"2023-10-08T00:31:39.639734+0000","last_peered":"2023-10-08T00:31:39.639734+0000","last_clean":"2023-10-08T00:31:39.639734+0000","last_became_active":"2023-10-08T00:31:39.048799+0000","last_became_peered":"2023-10-08T00:31:39.048799+0000","last_unstale":"2023-10-08T00:31:39.639734+0000","last_undegraded":"2023-10-08T00:31:39.639734+0000","last_fullsized":"2023-10-08T00:31:39.639734+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:12.559507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.648826+0000","last_change":"2023-10-08T00:31:39.648826+0000","last_active":"2023-10-08T00:31:39.648826+0000","last_peered":"2023-10-08T00:31:39.648826+0000","last_clean":"2023-10-08T00:31:39.648826+0000","last_became_active":"2023-10-08T00:31:39.648560+0000","last_became_peered":"2023-10-08T00:31:39.648560+0000","last_unstale":"2023-10-08T00:31:39.648826+0000","last_undegraded":"2023-10-08T00:31:39.648826+0000","last_fullsized":"2023-10-08T00:31:39.648826+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:32:25.362376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.039934+0000","last_change":"2023-10-08T00:31:39.047461+0000","last_active":"2023-10-08T00:31:40.039934+0000","last_peered":"2023-10-08T00:31:40.039934+0000","last_clean":"2023-10-08T00:31:40.039934+0000","last_became_active":"2023-10-08T00:31:39.047182+0000","last_became_peered":"2023-10-08T00:31:39.047182+0000","last_unstale":"2023-10-08T00:31:40.039934+0000","last_undegraded":"2023-10-08T00:31:40.039934+0000","last_fullsized":"2023-10-08T00:31:40.039934+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:22:22.873906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640094+0000","last_change":"2023-10-08T00:31:39.640094+0000","last_active":"2023-10-08T00:31:39.640094+0000","last_peered":"2023-10-08T00:31:39.640094+0000","last_clean":"2023-10-08T00:31:39.640094+0000","last_became_active":"2023-10-08T00:31:39.639802+0000","last_became_peered":"2023-10-08T00:31:39.639802+0000","last_unstale":"2023-10-08T00:31:39.640094+0000","last_undegraded":"2023-10-08T00:31:39.640094+0000","last_fullsized":"2023-10-08T00:31:39.640094+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:58:48.020945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.042685+0000","last_change":"2023-10-08T00:31:39.048714+0000","last_active":"2023-10-08T00:31:40.042685+0000","last_peered":"2023-10-08T00:31:40.042685+0000","last_clean":"2023-10-08T00:31:40.042685+0000","last_became_active":"2023-10-08T00:31:39.048431+0000","last_became_peered":"2023-10-08T00:31:39.048431+0000","last_unstale":"2023-10-08T00:31:40.042685+0000","last_undegraded":"2023-10-08T00:31:40.042685+0000","last_fullsized":"2023-10-08T00:31:40.042685+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:55:43.681072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640895+0000","last_change":"2023-10-08T00:31:39.640895+0000","last_active":"2023-10-08T00:31:39.640895+0000","last_peered":"2023-10-08T00:31:39.640895+0000","last_clean":"2023-10-08T00:31:39.640895+0000","last_became_active":"2023-10-08T00:31:39.640602+0000","last_became_peered":"2023-10-08T00:31:39.640602+0000","last_unstale":"2023-10-08T00:31:39.640895+0000","last_undegraded":"2023-10-08T00:31:39.640895+0000","last_fullsized":"2023-10-08T00:31:39.640895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:59:52.525395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.628666+0000","last_change":"2023-10-08T00:31:39.047564+0000","last_active":"2023-10-08T00:31:39.628666+0000","last_peered":"2023-10-08T00:31:39.628666+0000","last_clean":"2023-10-08T00:31:39.628666+0000","last_became_active":"2023-10-08T00:31:39.047295+0000","last_became_peered":"2023-10-08T00:31:39.047295+0000","last_unstale":"2023-10-08T00:31:39.628666+0000","last_undegraded":"2023-10-08T00:31:39.628666+0000","last_fullsized":"2023-10-08T00:31:39.628666+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:58:25.720809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639072+0000","last_change":"2023-10-08T00:31:39.639072+0000","last_active":"2023-10-08T00:31:39.639072+0000","last_peered":"2023-10-08T00:31:39.639072+0000","last_clean":"2023-10-08T00:31:39.639072+0000","last_became_active":"2023-10-08T00:31:39.638748+0000","last_became_peered":"2023-10-08T00:31:39.638748+0000","last_unstale":"2023-10-08T00:31:39.639072+0000","last_undegraded":"2023-10-08T00:31:39.639072+0000","last_fullsized":"2023-10-08T00:31:39.639072+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:48:08.894138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.632839+0000","last_change":"2023-10-08T00:31:39.056913+0000","last_active":"2023-10-08T00:31:39.632839+0000","last_peered":"2023-10-08T00:31:39.632839+0000","last_clean":"2023-10-08T00:31:39.632839+0000","last_became_active":"2023-10-08T00:31:39.056589+0000","last_became_peered":"2023-10-08T00:31:39.056589+0000","last_unstale":"2023-10-08T00:31:39.632839+0000","last_undegraded":"2023-10-08T00:31:39.632839+0000","last_fullsized":"2023-10-08T00:31:39.632839+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:55:13.880468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645202+0000","last_change":"2023-10-08T00:31:39.645202+0000","last_active":"2023-10-08T00:31:39.645202+0000","last_peered":"2023-10-08T00:31:39.645202+0000","last_clean":"2023-10-08T00:31:39.645202+0000","last_became_active":"2023-10-08T00:31:39.644643+0000","last_became_peered":"2023-10-08T00:31:39.644643+0000","last_unstale":"2023-10-08T00:31:39.645202+0000","last_undegraded":"2023-10-08T00:31:39.645202+0000","last_fullsized":"2023-10-08T00:31:39.645202+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:59.943326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.050924+0000","last_change":"2023-10-08T00:31:39.050132+0000","last_active":"2023-10-08T00:31:39.050924+0000","last_peered":"2023-10-08T00:31:39.050924+0000","last_clean":"2023-10-08T00:31:39.050924+0000","last_became_active":"2023-10-08T00:31:39.049876+0000","last_became_peered":"2023-10-08T00:31:39.049876+0000","last_unstale":"2023-10-08T00:31:39.050924+0000","last_undegraded":"2023-10-08T00:31:39.050924+0000","last_fullsized":"2023-10-08T00:31:39.050924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:19:56.568902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.637825+0000","last_change":"2023-10-08T00:31:39.637825+0000","last_active":"2023-10-08T00:31:39.637825+0000","last_peered":"2023-10-08T00:31:39.637825+0000","last_clean":"2023-10-08T00:31:39.637825+0000","last_became_active":"2023-10-08T00:31:39.637584+0000","last_became_peered":"2023-10-08T00:31:39.637584+0000","last_unstale":"2023-10-08T00:31:39.637825+0000","last_undegraded":"2023-10-08T00:31:39.637825+0000","last_fullsized":"2023-10-08T00:31:39.637825+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:49:59.943326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.056509+0000","last_change":"2023-10-08T00:31:39.053666+0000","last_active":"2023-10-08T00:31:39.056509+0000","last_peered":"2023-10-08T00:31:39.056509+0000","last_clean":"2023-10-08T00:31:39.056509+0000","last_became_active":"2023-10-08T00:31:39.053094+0000","last_became_peered":"2023-10-08T00:31:39.053094+0000","last_unstale":"2023-10-08T00:31:39.056509+0000","last_undegraded":"2023-10-08T00:31:39.056509+0000","last_fullsized":"2023-10-08T00:31:39.056509+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:48.741883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640107+0000","last_change":"2023-10-08T00:31:39.640107+0000","last_active":"2023-10-08T00:31:39.640107+0000","last_peered":"2023-10-08T00:31:39.640107+0000","last_clean":"2023-10-08T00:31:39.640107+0000","last_became_active":"2023-10-08T00:31:39.639830+0000","last_became_peered":"2023-10-08T00:31:39.639830+0000","last_unstale":"2023-10-08T00:31:39.640107+0000","last_undegraded":"2023-10-08T00:31:39.640107+0000","last_fullsized":"2023-10-08T00:31:39.640107+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:18:13.564577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.052688+0000","last_change":"2023-10-08T00:31:39.051977+0000","last_active":"2023-10-08T00:31:39.052688+0000","last_peered":"2023-10-08T00:31:39.052688+0000","last_clean":"2023-10-08T00:31:39.052688+0000","last_became_active":"2023-10-08T00:31:39.050871+0000","last_became_peered":"2023-10-08T00:31:39.050871+0000","last_unstale":"2023-10-08T00:31:39.052688+0000","last_undegraded":"2023-10-08T00:31:39.052688+0000","last_fullsized":"2023-10-08T00:31:39.052688+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:43:30.871079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.647588+0000","last_change":"2023-10-08T00:31:39.647588+0000","last_active":"2023-10-08T00:31:39.647588+0000","last_peered":"2023-10-08T00:31:39.647588+0000","last_clean":"2023-10-08T00:31:39.647588+0000","last_became_active":"2023-10-08T00:31:39.646899+0000","last_became_peered":"2023-10-08T00:31:39.646899+0000","last_unstale":"2023-10-08T00:31:39.647588+0000","last_undegraded":"2023-10-08T00:31:39.647588+0000","last_fullsized":"2023-10-08T00:31:39.647588+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:19.751351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057801+0000","last_change":"2023-10-08T00:31:39.054187+0000","last_active":"2023-10-08T00:31:39.057801+0000","last_peered":"2023-10-08T00:31:39.057801+0000","last_clean":"2023-10-08T00:31:39.057801+0000","last_became_active":"2023-10-08T00:31:39.053888+0000","last_became_peered":"2023-10-08T00:31:39.053888+0000","last_unstale":"2023-10-08T00:31:39.057801+0000","last_undegraded":"2023-10-08T00:31:39.057801+0000","last_fullsized":"2023-10-08T00:31:39.057801+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:05.605732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640542+0000","last_change":"2023-10-08T00:31:39.640542+0000","last_active":"2023-10-08T00:31:39.640542+0000","last_peered":"2023-10-08T00:31:39.640542+0000","last_clean":"2023-10-08T00:31:39.640542+0000","last_became_active":"2023-10-08T00:31:39.640169+0000","last_became_peered":"2023-10-08T00:31:39.640169+0000","last_unstale":"2023-10-08T00:31:39.640542+0000","last_undegraded":"2023-10-08T00:31:39.640542+0000","last_fullsized":"2023-10-08T00:31:39.640542+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:13:48.054362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"113'3","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.044088+0000","last_change":"2023-10-08T00:31:39.049093+0000","last_active":"2023-10-08T00:31:40.044088+0000","last_peered":"2023-10-08T00:31:40.044088+0000","last_clean":"2023-10-08T00:31:40.044088+0000","last_became_active":"2023-10-08T00:31:39.048774+0000","last_became_peered":"2023-10-08T00:31:39.048774+0000","last_unstale":"2023-10-08T00:31:40.044088+0000","last_undegraded":"2023-10-08T00:31:40.044088+0000","last_fullsized":"2023-10-08T00:31:40.044088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:20:18.193086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644592+0000","last_change":"2023-10-08T00:31:39.644592+0000","last_active":"2023-10-08T00:31:39.644592+0000","last_peered":"2023-10-08T00:31:39.644592+0000","last_clean":"2023-10-08T00:31:39.644592+0000","last_became_active":"2023-10-08T00:31:39.644313+0000","last_became_peered":"2023-10-08T00:31:39.644313+0000","last_unstale":"2023-10-08T00:31:39.644592+0000","last_undegraded":"2023-10-08T00:31:39.644592+0000","last_fullsized":"2023-10-08T00:31:39.644592+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:14:04.446597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"113'6","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.043164+0000","last_change":"2023-10-08T00:31:39.051371+0000","last_active":"2023-10-08T00:31:40.043164+0000","last_peered":"2023-10-08T00:31:40.043164+0000","last_clean":"2023-10-08T00:31:40.043164+0000","last_became_active":"2023-10-08T00:31:39.051116+0000","last_became_peered":"2023-10-08T00:31:39.051116+0000","last_unstale":"2023-10-08T00:31:40.043164+0000","last_undegraded":"2023-10-08T00:31:40.043164+0000","last_fullsized":"2023-10-08T00:31:40.043164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:51.782897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640512+0000","last_change":"2023-10-08T00:31:39.640512+0000","last_active":"2023-10-08T00:31:39.640512+0000","last_peered":"2023-10-08T00:31:39.640512+0000","last_clean":"2023-10-08T00:31:39.640512+0000","last_became_active":"2023-10-08T00:31:39.640245+0000","last_became_peered":"2023-10-08T00:31:39.640245+0000","last_unstale":"2023-10-08T00:31:39.640512+0000","last_undegraded":"2023-10-08T00:31:39.640512+0000","last_fullsized":"2023-10-08T00:31:39.640512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:46:39.815155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.050540+0000","last_change":"2023-10-08T00:31:39.049325+0000","last_active":"2023-10-08T00:31:39.050540+0000","last_peered":"2023-10-08T00:31:39.050540+0000","last_clean":"2023-10-08T00:31:39.050540+0000","last_became_active":"2023-10-08T00:31:39.049005+0000","last_became_peered":"2023-10-08T00:31:39.049005+0000","last_unstale":"2023-10-08T00:31:39.050540+0000","last_undegraded":"2023-10-08T00:31:39.050540+0000","last_fullsized":"2023-10-08T00:31:39.050540+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:39:23.911713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645490+0000","last_change":"2023-10-08T00:31:39.645490+0000","last_active":"2023-10-08T00:31:39.645490+0000","last_peered":"2023-10-08T00:31:39.645490+0000","last_clean":"2023-10-08T00:31:39.645490+0000","last_became_active":"2023-10-08T00:31:39.645233+0000","last_became_peered":"2023-10-08T00:31:39.645233+0000","last_unstale":"2023-10-08T00:31:39.645490+0000","last_undegraded":"2023-10-08T00:31:39.645490+0000","last_fullsized":"2023-10-08T00:31:39.645490+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:29.195272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057507+0000","last_change":"2023-10-08T00:31:39.055513+0000","last_active":"2023-10-08T00:31:39.057507+0000","last_peered":"2023-10-08T00:31:39.057507+0000","last_clean":"2023-10-08T00:31:39.057507+0000","last_became_active":"2023-10-08T00:31:39.055180+0000","last_became_peered":"2023-10-08T00:31:39.055180+0000","last_unstale":"2023-10-08T00:31:39.057507+0000","last_undegraded":"2023-10-08T00:31:39.057507+0000","last_fullsized":"2023-10-08T00:31:39.057507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:38:44.013877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.639876+0000","last_change":"2023-10-08T00:31:39.639876+0000","last_active":"2023-10-08T00:31:39.639876+0000","last_peered":"2023-10-08T00:31:39.639876+0000","last_clean":"2023-10-08T00:31:39.639876+0000","last_became_active":"2023-10-08T00:31:39.639563+0000","last_became_peered":"2023-10-08T00:31:39.639563+0000","last_unstale":"2023-10-08T00:31:39.639876+0000","last_undegraded":"2023-10-08T00:31:39.639876+0000","last_fullsized":"2023-10-08T00:31:39.639876+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:40:01.641040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"113'8","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.044463+0000","last_change":"2023-10-08T00:31:39.056161+0000","last_active":"2023-10-08T00:31:40.044463+0000","last_peered":"2023-10-08T00:31:40.044463+0000","last_clean":"2023-10-08T00:31:40.044463+0000","last_became_active":"2023-10-08T00:31:39.055624+0000","last_became_peered":"2023-10-08T00:31:39.055624+0000","last_unstale":"2023-10-08T00:31:40.044463+0000","last_undegraded":"2023-10-08T00:31:40.044463+0000","last_fullsized":"2023-10-08T00:31:40.044463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:21:48.741883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643082+0000","last_change":"2023-10-08T00:31:39.643082+0000","last_active":"2023-10-08T00:31:39.643082+0000","last_peered":"2023-10-08T00:31:39.643082+0000","last_clean":"2023-10-08T00:31:39.643082+0000","last_became_active":"2023-10-08T00:31:39.642817+0000","last_became_peered":"2023-10-08T00:31:39.642817+0000","last_unstale":"2023-10-08T00:31:39.643082+0000","last_undegraded":"2023-10-08T00:31:39.643082+0000","last_fullsized":"2023-10-08T00:31:39.643082+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:45:20.500938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.640463+0000","last_change":"2023-10-08T00:31:39.050662+0000","last_active":"2023-10-08T00:31:39.640463+0000","last_peered":"2023-10-08T00:31:39.640463+0000","last_clean":"2023-10-08T00:31:39.640463+0000","last_became_active":"2023-10-08T00:31:39.050401+0000","last_became_peered":"2023-10-08T00:31:39.050401+0000","last_unstale":"2023-10-08T00:31:39.640463+0000","last_undegraded":"2023-10-08T00:31:39.640463+0000","last_fullsized":"2023-10-08T00:31:39.640463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:37.213105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646921+0000","last_change":"2023-10-08T00:31:39.646921+0000","last_active":"2023-10-08T00:31:39.646921+0000","last_peered":"2023-10-08T00:31:39.646921+0000","last_clean":"2023-10-08T00:31:39.646921+0000","last_became_active":"2023-10-08T00:31:39.646642+0000","last_became_peered":"2023-10-08T00:31:39.646642+0000","last_unstale":"2023-10-08T00:31:39.646921+0000","last_undegraded":"2023-10-08T00:31:39.646921+0000","last_fullsized":"2023-10-08T00:31:39.646921+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:52.787966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.042331+0000","last_change":"2023-10-08T00:31:39.050587+0000","last_active":"2023-10-08T00:31:40.042331+0000","last_peered":"2023-10-08T00:31:40.042331+0000","last_clean":"2023-10-08T00:31:40.042331+0000","last_became_active":"2023-10-08T00:31:39.050281+0000","last_became_peered":"2023-10-08T00:31:39.050281+0000","last_unstale":"2023-10-08T00:31:40.042331+0000","last_undegraded":"2023-10-08T00:31:40.042331+0000","last_fullsized":"2023-10-08T00:31:40.042331+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:58:47.015876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.643943+0000","last_change":"2023-10-08T00:31:39.643943+0000","last_active":"2023-10-08T00:31:39.643943+0000","last_peered":"2023-10-08T00:31:39.643943+0000","last_clean":"2023-10-08T00:31:39.643943+0000","last_became_active":"2023-10-08T00:31:39.643649+0000","last_became_peered":"2023-10-08T00:31:39.643649+0000","last_unstale":"2023-10-08T00:31:39.643943+0000","last_undegraded":"2023-10-08T00:31:39.643943+0000","last_fullsized":"2023-10-08T00:31:39.643943+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:46:59.950525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"113'1","reported_seq":10,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.631420+0000","last_change":"2023-10-08T00:31:39.048303+0000","last_active":"2023-10-08T00:31:39.631420+0000","last_peered":"2023-10-08T00:31:39.631420+0000","last_clean":"2023-10-08T00:31:39.631420+0000","last_became_active":"2023-10-08T00:31:39.048019+0000","last_became_peered":"2023-10-08T00:31:39.048019+0000","last_unstale":"2023-10-08T00:31:39.631420+0000","last_undegraded":"2023-10-08T00:31:39.631420+0000","last_fullsized":"2023-10-08T00:31:39.631420+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:03.252126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.636916+0000","last_change":"2023-10-08T00:31:39.636916+0000","last_active":"2023-10-08T00:31:39.636916+0000","last_peered":"2023-10-08T00:31:39.636916+0000","last_clean":"2023-10-08T00:31:39.636916+0000","last_became_active":"2023-10-08T00:31:39.636192+0000","last_became_peered":"2023-10-08T00:31:39.636192+0000","last_unstale":"2023-10-08T00:31:39.636916+0000","last_undegraded":"2023-10-08T00:31:39.636916+0000","last_fullsized":"2023-10-08T00:31:39.636916+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:39:54.482199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.051007+0000","last_change":"2023-10-08T00:31:39.045678+0000","last_active":"2023-10-08T00:31:39.051007+0000","last_peered":"2023-10-08T00:31:39.051007+0000","last_clean":"2023-10-08T00:31:39.051007+0000","last_became_active":"2023-10-08T00:31:39.045408+0000","last_became_peered":"2023-10-08T00:31:39.045408+0000","last_unstale":"2023-10-08T00:31:39.051007+0000","last_undegraded":"2023-10-08T00:31:39.051007+0000","last_fullsized":"2023-10-08T00:31:39.051007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:53.243768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642691+0000","last_change":"2023-10-08T00:31:39.642691+0000","last_active":"2023-10-08T00:31:39.642691+0000","last_peered":"2023-10-08T00:31:39.642691+0000","last_clean":"2023-10-08T00:31:39.642691+0000","last_became_active":"2023-10-08T00:31:39.642397+0000","last_became_peered":"2023-10-08T00:31:39.642397+0000","last_unstale":"2023-10-08T00:31:39.642691+0000","last_undegraded":"2023-10-08T00:31:39.642691+0000","last_fullsized":"2023-10-08T00:31:39.642691+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:27:54.248838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.041589+0000","last_change":"2023-10-08T00:31:39.050279+0000","last_active":"2023-10-08T00:31:40.041589+0000","last_peered":"2023-10-08T00:31:40.041589+0000","last_clean":"2023-10-08T00:31:40.041589+0000","last_became_active":"2023-10-08T00:31:39.049657+0000","last_became_peered":"2023-10-08T00:31:39.049657+0000","last_unstale":"2023-10-08T00:31:40.041589+0000","last_undegraded":"2023-10-08T00:31:40.041589+0000","last_fullsized":"2023-10-08T00:31:40.041589+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:58:46.716791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644014+0000","last_change":"2023-10-08T00:31:39.644014+0000","last_active":"2023-10-08T00:31:39.644014+0000","last_peered":"2023-10-08T00:31:39.644014+0000","last_clean":"2023-10-08T00:31:39.644014+0000","last_became_active":"2023-10-08T00:31:39.643301+0000","last_became_peered":"2023-10-08T00:31:39.643301+0000","last_unstale":"2023-10-08T00:31:39.644014+0000","last_undegraded":"2023-10-08T00:31:39.644014+0000","last_fullsized":"2023-10-08T00:31:39.644014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:04.519929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.056808+0000","last_change":"2023-10-08T00:31:39.052937+0000","last_active":"2023-10-08T00:31:39.056808+0000","last_peered":"2023-10-08T00:31:39.056808+0000","last_clean":"2023-10-08T00:31:39.056808+0000","last_became_active":"2023-10-08T00:31:39.052607+0000","last_became_peered":"2023-10-08T00:31:39.052607+0000","last_unstale":"2023-10-08T00:31:39.056808+0000","last_undegraded":"2023-10-08T00:31:39.056808+0000","last_fullsized":"2023-10-08T00:31:39.056808+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:27.640927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.635482+0000","last_change":"2023-10-08T00:31:39.635482+0000","last_active":"2023-10-08T00:31:39.635482+0000","last_peered":"2023-10-08T00:31:39.635482+0000","last_clean":"2023-10-08T00:31:39.635482+0000","last_became_active":"2023-10-08T00:31:39.635231+0000","last_became_peered":"2023-10-08T00:31:39.635231+0000","last_unstale":"2023-10-08T00:31:39.635482+0000","last_undegraded":"2023-10-08T00:31:39.635482+0000","last_fullsized":"2023-10-08T00:31:39.635482+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:58:27.131385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057719+0000","last_change":"2023-10-08T00:31:39.053495+0000","last_active":"2023-10-08T00:31:39.057719+0000","last_peered":"2023-10-08T00:31:39.057719+0000","last_clean":"2023-10-08T00:31:39.057719+0000","last_became_active":"2023-10-08T00:31:39.053073+0000","last_became_peered":"2023-10-08T00:31:39.053073+0000","last_unstale":"2023-10-08T00:31:39.057719+0000","last_undegraded":"2023-10-08T00:31:39.057719+0000","last_fullsized":"2023-10-08T00:31:39.057719+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:46:54.886307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645049+0000","last_change":"2023-10-08T00:31:39.645049+0000","last_active":"2023-10-08T00:31:39.645049+0000","last_peered":"2023-10-08T00:31:39.645049+0000","last_clean":"2023-10-08T00:31:39.645049+0000","last_became_active":"2023-10-08T00:31:39.644443+0000","last_became_peered":"2023-10-08T00:31:39.644443+0000","last_unstale":"2023-10-08T00:31:39.645049+0000","last_undegraded":"2023-10-08T00:31:39.645049+0000","last_fullsized":"2023-10-08T00:31:39.645049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:18.154355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.053563+0000","last_change":"2023-10-08T00:31:39.049104+0000","last_active":"2023-10-08T00:31:39.053563+0000","last_peered":"2023-10-08T00:31:39.053563+0000","last_clean":"2023-10-08T00:31:39.053563+0000","last_became_active":"2023-10-08T00:31:39.048780+0000","last_became_peered":"2023-10-08T00:31:39.048780+0000","last_unstale":"2023-10-08T00:31:39.053563+0000","last_undegraded":"2023-10-08T00:31:39.053563+0000","last_fullsized":"2023-10-08T00:31:39.053563+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:24.721108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645027+0000","last_change":"2023-10-08T00:31:39.645027+0000","last_active":"2023-10-08T00:31:39.645027+0000","last_peered":"2023-10-08T00:31:39.645027+0000","last_clean":"2023-10-08T00:31:39.645027+0000","last_became_active":"2023-10-08T00:31:39.644003+0000","last_became_peered":"2023-10-08T00:31:39.644003+0000","last_unstale":"2023-10-08T00:31:39.645027+0000","last_undegraded":"2023-10-08T00:31:39.645027+0000","last_fullsized":"2023-10-08T00:31:39.645027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:51:53.672847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.042034+0000","last_change":"2023-10-08T00:31:39.053393+0000","last_active":"2023-10-08T00:31:40.042034+0000","last_peered":"2023-10-08T00:31:40.042034+0000","last_clean":"2023-10-08T00:31:40.042034+0000","last_became_active":"2023-10-08T00:31:39.053127+0000","last_became_peered":"2023-10-08T00:31:39.053127+0000","last_unstale":"2023-10-08T00:31:40.042034+0000","last_undegraded":"2023-10-08T00:31:40.042034+0000","last_fullsized":"2023-10-08T00:31:40.042034+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:43:44.736790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.646634+0000","last_change":"2023-10-08T00:31:39.646634+0000","last_active":"2023-10-08T00:31:39.646634+0000","last_peered":"2023-10-08T00:31:39.646634+0000","last_clean":"2023-10-08T00:31:39.646634+0000","last_became_active":"2023-10-08T00:31:39.646314+0000","last_became_peered":"2023-10-08T00:31:39.646314+0000","last_unstale":"2023-10-08T00:31:39.646634+0000","last_undegraded":"2023-10-08T00:31:39.646634+0000","last_fullsized":"2023-10-08T00:31:39.646634+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:22:26.155826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.053250+0000","last_change":"2023-10-08T00:31:39.052080+0000","last_active":"2023-10-08T00:31:39.053250+0000","last_peered":"2023-10-08T00:31:39.053250+0000","last_clean":"2023-10-08T00:31:39.053250+0000","last_became_active":"2023-10-08T00:31:39.051784+0000","last_became_peered":"2023-10-08T00:31:39.051784+0000","last_unstale":"2023-10-08T00:31:39.053250+0000","last_undegraded":"2023-10-08T00:31:39.053250+0000","last_fullsized":"2023-10-08T00:31:39.053250+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:37:05.605732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641204+0000","last_change":"2023-10-08T00:31:39.641204+0000","last_active":"2023-10-08T00:31:39.641204+0000","last_peered":"2023-10-08T00:31:39.641204+0000","last_clean":"2023-10-08T00:31:39.641204+0000","last_became_active":"2023-10-08T00:31:39.640952+0000","last_became_peered":"2023-10-08T00:31:39.640952+0000","last_unstale":"2023-10-08T00:31:39.641204+0000","last_undegraded":"2023-10-08T00:31:39.641204+0000","last_fullsized":"2023-10-08T00:31:39.641204+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:51:53.672847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.056452+0000","last_change":"2023-10-08T00:31:39.052821+0000","last_active":"2023-10-08T00:31:39.056452+0000","last_peered":"2023-10-08T00:31:39.056452+0000","last_clean":"2023-10-08T00:31:39.056452+0000","last_became_active":"2023-10-08T00:31:39.052514+0000","last_became_peered":"2023-10-08T00:31:39.052514+0000","last_unstale":"2023-10-08T00:31:39.056452+0000","last_undegraded":"2023-10-08T00:31:39.056452+0000","last_fullsized":"2023-10-08T00:31:39.056452+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:51.782897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.642999+0000","last_change":"2023-10-08T00:31:39.642999+0000","last_active":"2023-10-08T00:31:39.642999+0000","last_peered":"2023-10-08T00:31:39.642999+0000","last_clean":"2023-10-08T00:31:39.642999+0000","last_became_active":"2023-10-08T00:31:39.642599+0000","last_became_peered":"2023-10-08T00:31:39.642599+0000","last_unstale":"2023-10-08T00:31:39.642999+0000","last_undegraded":"2023-10-08T00:31:39.642999+0000","last_fullsized":"2023-10-08T00:31:39.642999+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:03.732301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.043577+0000","last_change":"2023-10-08T00:31:39.040095+0000","last_active":"2023-10-08T00:31:39.043577+0000","last_peered":"2023-10-08T00:31:39.043577+0000","last_clean":"2023-10-08T00:31:39.043577+0000","last_became_active":"2023-10-08T00:31:39.039830+0000","last_became_peered":"2023-10-08T00:31:39.039830+0000","last_unstale":"2023-10-08T00:31:39.043577+0000","last_undegraded":"2023-10-08T00:31:39.043577+0000","last_fullsized":"2023-10-08T00:31:39.043577+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:27:07.857258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.648857+0000","last_change":"2023-10-08T00:31:39.648857+0000","last_active":"2023-10-08T00:31:39.648857+0000","last_peered":"2023-10-08T00:31:39.648857+0000","last_clean":"2023-10-08T00:31:39.648857+0000","last_became_active":"2023-10-08T00:31:39.648585+0000","last_became_peered":"2023-10-08T00:31:39.648585+0000","last_unstale":"2023-10-08T00:31:39.648857+0000","last_undegraded":"2023-10-08T00:31:39.648857+0000","last_fullsized":"2023-10-08T00:31:39.648857+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:54:24.166510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057178+0000","last_change":"2023-10-08T00:31:39.055403+0000","last_active":"2023-10-08T00:31:39.057178+0000","last_peered":"2023-10-08T00:31:39.057178+0000","last_clean":"2023-10-08T00:31:39.057178+0000","last_became_active":"2023-10-08T00:31:39.055107+0000","last_became_peered":"2023-10-08T00:31:39.055107+0000","last_unstale":"2023-10-08T00:31:39.057178+0000","last_undegraded":"2023-10-08T00:31:39.057178+0000","last_fullsized":"2023-10-08T00:31:39.057178+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:18.746281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644128+0000","last_change":"2023-10-08T00:31:39.644128+0000","last_active":"2023-10-08T00:31:39.644128+0000","last_peered":"2023-10-08T00:31:39.644128+0000","last_clean":"2023-10-08T00:31:39.644128+0000","last_became_active":"2023-10-08T00:31:39.643865+0000","last_became_peered":"2023-10-08T00:31:39.643865+0000","last_unstale":"2023-10-08T00:31:39.644128+0000","last_undegraded":"2023-10-08T00:31:39.644128+0000","last_fullsized":"2023-10-08T00:31:39.644128+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:58:26.725879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.051434+0000","last_change":"2023-10-08T00:31:39.049850+0000","last_active":"2023-10-08T00:31:39.051434+0000","last_peered":"2023-10-08T00:31:39.051434+0000","last_clean":"2023-10-08T00:31:39.051434+0000","last_became_active":"2023-10-08T00:31:39.049552+0000","last_became_peered":"2023-10-08T00:31:39.049552+0000","last_unstale":"2023-10-08T00:31:39.051434+0000","last_undegraded":"2023-10-08T00:31:39.051434+0000","last_fullsized":"2023-10-08T00:31:39.051434+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:06:15.339259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.645079+0000","last_change":"2023-10-08T00:31:39.645079+0000","last_active":"2023-10-08T00:31:39.645079+0000","last_peered":"2023-10-08T00:31:39.645079+0000","last_clean":"2023-10-08T00:31:39.645079+0000","last_became_active":"2023-10-08T00:31:39.644256+0000","last_became_peered":"2023-10-08T00:31:39.644256+0000","last_unstale":"2023-10-08T00:31:39.645079+0000","last_undegraded":"2023-10-08T00:31:39.645079+0000","last_fullsized":"2023-10-08T00:31:39.645079+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:31:17.441761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.057029+0000","last_change":"2023-10-08T00:31:39.053317+0000","last_active":"2023-10-08T00:31:39.057029+0000","last_peered":"2023-10-08T00:31:39.057029+0000","last_clean":"2023-10-08T00:31:39.057029+0000","last_became_active":"2023-10-08T00:31:39.052776+0000","last_became_peered":"2023-10-08T00:31:39.052776+0000","last_unstale":"2023-10-08T00:31:39.057029+0000","last_undegraded":"2023-10-08T00:31:39.057029+0000","last_fullsized":"2023-10-08T00:31:39.057029+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:38:09.173454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.641840+0000","last_change":"2023-10-08T00:31:39.641840+0000","last_active":"2023-10-08T00:31:39.641840+0000","last_peered":"2023-10-08T00:31:39.641840+0000","last_clean":"2023-10-08T00:31:39.641840+0000","last_became_active":"2023-10-08T00:31:39.641562+0000","last_became_peered":"2023-10-08T00:31:39.641562+0000","last_unstale":"2023-10-08T00:31:39.641840+0000","last_undegraded":"2023-10-08T00:31:39.641840+0000","last_fullsized":"2023-10-08T00:31:39.641840+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:03.732301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.044707+0000","last_change":"2023-10-08T00:31:39.042894+0000","last_active":"2023-10-08T00:31:39.044707+0000","last_peered":"2023-10-08T00:31:39.044707+0000","last_clean":"2023-10-08T00:31:39.044707+0000","last_became_active":"2023-10-08T00:31:39.042641+0000","last_became_peered":"2023-10-08T00:31:39.042641+0000","last_unstale":"2023-10-08T00:31:39.044707+0000","last_undegraded":"2023-10-08T00:31:39.044707+0000","last_fullsized":"2023-10-08T00:31:39.044707+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:04:13.358577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":8,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.644907+0000","last_change":"2023-10-08T00:31:39.644907+0000","last_active":"2023-10-08T00:31:39.644907+0000","last_peered":"2023-10-08T00:31:39.644907+0000","last_clean":"2023-10-08T00:31:39.644907+0000","last_became_active":"2023-10-08T00:31:39.643357+0000","last_became_peered":"2023-10-08T00:31:39.643357+0000","last_unstale":"2023-10-08T00:31:39.644907+0000","last_undegraded":"2023-10-08T00:31:39.644907+0000","last_fullsized":"2023-10-08T00:31:39.644907+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:39.027527+0000","last_clean_scrub_stamp":"2023-10-08T00:31:39.027527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:02:39.126796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"113'2","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T00:31:40.041040+0000","last_change":"2023-10-08T00:31:39.057478+0000","last_active":"2023-10-08T00:31:40.041040+0000","last_peered":"2023-10-08T00:31:40.041040+0000","last_clean":"2023-10-08T00:31:40.041040+0000","last_became_active":"2023-10-08T00:31:39.057108+0000","last_became_peered":"2023-10-08T00:31:39.057108+0000","last_unstale":"2023-10-08T00:31:40.041040+0000","last_undegraded":"2023-10-08T00:31:40.041040+0000","last_fullsized":"2023-10-08T00:31:40.041040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:31:38.022457+0000","last_clean_scrub_stamp":"2023-10-08T00:31:38.022457+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:39:27.640927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":237,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T00:31:39.046050+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:31:39.046050+0000","last_peered":"2023-10-08T00:31:39.046050+0000","last_clean":"2023-10-08T00:31:39.046050+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:31:39.046050+0000","last_undegraded":"2023-10-08T00:31:39.046050+0000","last_fullsized":"2023-10-08T00:31:39.046050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1201642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70699999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66200000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54600000000000004,"15min":0.55700000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80100000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80200000000000005,"5min":0.876,"15min":0.876},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55400000000000005,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.73999999999999999,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.502,"15min":0.52900000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54100000000000004,"15min":0.55400000000000005},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.71299999999999997,"5min":0.75,"15min":0.79000000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55700000000000005,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78500000000000003,"5min":0.86299999999999999,"15min":1.048},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.86799999999999999,"5min":0.89400000000000002,"15min":1.0920000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58799999999999997,"15min":0.60299999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298680,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073160,"statfs":{"total":96636764160,"available":96330915840,"internally_reserved":0,"allocated":1425408,"data_stored":612810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.49399999999999999,"15min":0.51100000000000001},"min":{"1min":0.28100000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61499999999999999,"5min":0.77200000000000002,"15min":0.84399999999999997},"last":0.315},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.37,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72599999999999998,"5min":0.90700000000000003,"15min":0.94499999999999995},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52900000000000003,"15min":0.56299999999999994},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69799999999999995,"5min":0.80800000000000005,"15min":1.145},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52400000000000002,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.749,"15min":0.873},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54700000000000004,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74399999999999999,"5min":0.78500000000000003,"15min":1.079},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54600000000000004,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.311,"15min":0.311},"max":{"1min":0.65000000000000002,"5min":0.76000000000000001,"15min":0.85799999999999998},"last":0.5}]},{"osd":3,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.68700000000000006,"5min":0.871,"15min":1.127},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56999999999999995,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":1.1160000000000001},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47699999999999998,"15min":0.52100000000000002},"min":{"1min":0.311,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70099999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57099999999999995,"15min":0.623},"min":{"1min":0.41099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.90500000000000003,"15min":0.93700000000000006},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.29399999999999998},"max":{"1min":0.77700000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.746,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Oct 8 00:30:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.33300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.75900000000000001,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.58799999999999997,"15min":0.63500000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81200000000000006,"5min":0.878,"15min":1.093},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":611274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.33500000000000002},"min":{"1min":0.221,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48399999999999999,"5min":0.50800000000000001,"15min":0.64300000000000002},"last":0.307},{"interface":"front","average":{"1min":0.379,"5min":0.35199999999999998,"15min":0.34699999999999998},"min":{"1min":0.27700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.52300000000000002,"5min":0.58099999999999996,"15min":0.60199999999999998},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35899999999999999,"15min":0.36899999999999999},"min":{"1min":0.254,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53300000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.378},"min":{"1min":0.27600000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28799999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.433,"15min":0.41899999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58499999999999996,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.376},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39400000000000002,"15min":0.39800000000000002},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.54300000000000004,"5min":0.624,"15min":0.84699999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.34999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76900000000000002,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.39200000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77000000000000002,"5min":0.90100000000000002,"15min":1.294},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.439,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78000000000000003,"5min":0.86899999999999999,"15min":1.038},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.83599999999999997,"5min":0.874,"15min":0.879},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81799999999999995,"5min":0.97999999999999998,"15min":1.087},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303344,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068496,"statfs":{"total":96636764160,"available":96326139904,"internally_reserved":0,"allocated":2007040,"data_stored":1201642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.32900000000000001,"15min":0.35999999999999999},"min":{"1min":0.245,"5min":0.216,"15min":0.216},"max":{"1min":0.47899999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51400000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.34899999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.27900000000000003,"5min":0.245,"15min":0.245},"max":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.308},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.379,"15min":0.39300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53600000000000003,"5min":0.58799999999999997,"15min":0.63100000000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35599999999999998,"15min":0.377},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.37},{"interface":"front","average":{"1min":0.432,"5min":0.41199999999999998,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.60699999999999998,"5min":0.60899999999999999,"15min":0.64700000000000002},"last":0.33900000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.41699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76800000000000002,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.73399999999999999,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.65900000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.33600000000000002},"max":{"1min":0.79400000000000004,"5min":0.88100000000000001,"15min":1.242},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.61899999999999999,"15min":0.622},"min":{"1min":0.45100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.71599999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58399999999999996,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.752,"5min":0.86399999999999999,"15min":1.0800000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.441,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83299999999999996,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.78800000000000003,"5min":0.91000000000000003,"15min":1.0529999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.77700000000000002,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.316,"15min":0.34599999999999997},"min":{"1min":0.218,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.502,"5min":0.502,"15min":0.60899999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34399999999999997,"15min":0.38400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.35099999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34699999999999998,"15min":0.373},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48099999999999998,"5min":0.54900000000000004,"15min":0.65000000000000002},"last":0.377},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.36099999999999999,"15min":0.40899999999999997},"min":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53400000000000003,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34399999999999997,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.56299999999999994,"5min":0.59699999999999998,"15min":0.60799999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.39300000000000002,"15min":0.42899999999999999},"min":{"1min":0.28599999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.51900000000000002,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.58599999999999997},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59199999999999997,"15min":0.64200000000000002},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90400000000000003,"5min":1.0489999999999999,"15min":1.0760000000000001},"last":0.505}]},{"osd":5,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.45200000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.621,"15min":0.67300000000000004},"min":{"1min":0.44600000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91900000000000004,"5min":0.93899999999999995,"15min":1.278},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.65400000000000003},"min":{"1min":0.39200000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.87,"5min":1.0880000000000001,"15min":1.137},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59099999999999997,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85699999999999998,"5min":0.85899999999999999,"15min":0.95999999999999996},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.65300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93899999999999995,"5min":1,"15min":1.1259999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":1.343},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574936,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33900000000000002,"15min":0.34599999999999997},"min":{"1min":0.22700000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.34699999999999998},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.51900000000000002,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.308},{"interface":"front","average":{"1min":0.374,"5min":0.371,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.54100000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.37}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.42699999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.41999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61499999999999999,"15min":0.63100000000000001},"min":{"1min":0.436,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.95499999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.627},"min":{"1min":0.443,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.47299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.64100000000000001},"min":{"1min":0.44800000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":611344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.501,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.753,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.51300000000000001,"15min":0.53000000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66100000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.36899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.64200000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53100000000000003,"15min":0.54000000000000004},"min":{"1min":0.371,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.63500000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56399999999999995,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68400000000000005,"5min":0.93300000000000005,"15min":1.712},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.34399999999999997},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.64800000000000002,"15min":0.59999999999999998},"min":{"1min":0.40000000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":6.0960000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73899999999999999,"5min":0.873,"15min":0.873},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.5},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.39100000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.77200000000000002,"5min":1.002,"15min":1.002},"last":0.73999999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64000000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.75},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.55800000000000005,"15min":0.57599999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75900000000000001,"5min":0.82799999999999996,"15min":0.84199999999999997},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:30:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.71099999999999997,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.60799999999999998,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.747,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53000000000000003,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73499999999999999,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.52700000000000002,"15min":0.52200000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.621},"min":{"1min":0.34000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.54200000000000004,"15min":0.55800000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67800000000000005,"5min":0.71999999999999997,"15min":0.75700000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.55200000000000005,"15min":0.58199999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.747,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.495},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.82999999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58999999999999997,"15min":0.66800000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.69099999999999995,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29199999999999998},"max":{"1min":0.749,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.437},{"interface":"front","average":{"1min":0.505,"5min":0.51100000000000001,"15min":0.55100000000000005},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.69299999999999995,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.30499999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72699999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54800000000000004,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38300000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:31:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54200000000000004,"15min":0.59599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58199999999999996,"15min":0.61399999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.82499999999999996,"15min":0.84499999999999997},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:31:44.546 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:31:44.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:31:44.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.705+0000 7f084c120700 1 Processor -- start 2023-10-08T00:31:44.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.706+0000 7f084c120700 1 -- start start 2023-10-08T00:31:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.706+0000 7f084c120700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0844159950 0x7f08440cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.706+0000 7f084c120700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08440af320 0x7f0844069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.706+0000 7f084c120700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440ce380 con 0x7f0844069aa0 2023-10-08T00:31:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.706+0000 7f084c120700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08440cec20 con 0x7f08440af320 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.706+0000 7f084c120700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0844069ee0 con 0x7f0844159950 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f08496bb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08440af320 0x7f0844069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f084a6bd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0844069aa0 0x7f084415d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52526/0 (socket says 172.21.15.22:52526) 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f084a6bd700 1 -- 172.21.15.22:0/1596750376 learned_addr learned my addr 172.21.15.22:0/1596750376 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f0849ebc700 1 --2- 172.21.15.22:0/1596750376 >> v2:172.21.15.192:3300/0 conn(0x7f0844159950 0x7f08440cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f08496bb700 1 -- 172.21.15.22:0/1596750376 >> v2:172.21.15.192:3300/0 conn(0x7f0844159950 msgr2=0x7f08440cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f08496bb700 1 --2- 172.21.15.22:0/1596750376 >> v2:172.21.15.192:3300/0 conn(0x7f0844159950 0x7f08440cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f08496bb700 1 -- 172.21.15.22:0/1596750376 >> v1:172.21.15.22:6789/0 conn(0x7f0844069aa0 legacy=0x7f084415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f08496bb700 1 -- 172.21.15.22:0/1596750376 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440afa90 con 0x7f08440af320 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f0848eba700 1 -- 172.21.15.22:0/1596750376 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072132307 0 0) 0x7f08440ce380 con 0x7f0844069aa0 2023-10-08T00:31:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f0849ebc700 1 --2- 172.21.15.22:0/1596750376 >> v2:172.21.15.192:3300/0 conn(0x7f0844159950 0x7f08440cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f08496bb700 1 --2- 172.21.15.22:0/1596750376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08440af320 0x7f0844069560 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f08440896e0 tx=0x7f08380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109b19072aa423b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f0848eba700 1 -- 172.21.15.22:0/1596750376 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800b6b0 con 0x7f08440af320 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f0848eba700 1 -- 172.21.15.22:0/1596750376 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083800b810 con 0x7f08440af320 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.707+0000 7f0848eba700 1 -- 172.21.15.22:0/1596750376 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800bbb0 con 0x7f08440af320 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 -- 172.21.15.22:0/1596750376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08440af320 msgr2=0x7f0844069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 --2- 172.21.15.22:0/1596750376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08440af320 0x7f0844069560 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f08440896e0 tx=0x7f08380091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 -- 172.21.15.22:0/1596750376 shutdown_connections 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 --2- 172.21.15.22:0/1596750376 >> v2:172.21.15.192:3300/0 conn(0x7f0844159950 0x7f08440cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 --2- 172.21.15.22:0/1596750376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08440af320 0x7f0844069560 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 -- 172.21.15.22:0/1596750376 >> 172.21.15.22:0/1596750376 conn(0x7f0844068e00 msgr2=0x7f08440d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:44.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 -- 172.21.15.22:0/1596750376 shutdown_connections 2023-10-08T00:31:44.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.708+0000 7f084c120700 1 -- 172.21.15.22:0/1596750376 wait complete. 2023-10-08T00:31:44.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.709+0000 7f084c120700 1 Processor -- start 2023-10-08T00:31:44.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.709+0000 7f084c120700 1 -- start start 2023-10-08T00:31:44.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0844069aa0 0x7f084414d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08440af320 0x7f08440c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 0x7f08440c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b42d0 con 0x7f0844159950 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b45b0 con 0x7f08440af320 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440b4890 con 0x7f0844069aa0 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 0x7f08440c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 0x7f08440c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53988/0 (socket says 172.21.15.22:53988) 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 -- 172.21.15.22:0/2170809429 learned_addr learned my addr 172.21.15.22:0/2170809429 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f08496bb700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08440af320 0x7f08440c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f0849ebc700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0844069aa0 0x7f084414d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 -- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0844069aa0 msgr2=0x7f084414d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0844069aa0 0x7f084414d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 -- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08440af320 msgr2=0x7f08440c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08440af320 0x7f08440c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 -- 172.21.15.22:0/2170809429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838009420 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f08496bb700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08440af320 0x7f08440c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084a6bd700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 0x7f08440c7da0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f083400c7e0 tx=0x7f0834007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834005c00 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0834005d60 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834004a80 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.710+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08440b4b70 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.711+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08440b3f30 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.712+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084414e780 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.712+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0834005030 con 0x7f0844159950 2023-10-08T00:31:44.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.712+0000 7f0841ffb700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0830067320 0x7f08300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:44.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.712+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f0834084120 con 0x7f0844159950 2023-10-08T00:31:44.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.712+0000 7f0849ebc700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0830067320 0x7f08300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:44.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.713+0000 7f0849ebc700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0830067320 0x7f08300697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f083c00d380 tx=0x7f083c007500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:44.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.717+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f083404b5a0 con 0x7f0844159950 2023-10-08T00:31:44.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.990+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f08440718b0 con 0x7f0844159950 2023-10-08T00:31:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.994+0000 7f0841ffb700 1 -- 172.21.15.22:0/2170809429 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0834050d70 con 0x7f0844159950 2023-10-08T00:31:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0830067320 msgr2=0x7f08300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0830067320 0x7f08300697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f083c00d380 tx=0x7f083c007500 comp rx=0 tx=0).stop 2023-10-08T00:31:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 msgr2=0x7f08440c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 0x7f08440c7da0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f083400c7e0 tx=0x7f0834007d90 comp rx=0 tx=0).stop 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 shutdown_connections 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0844159950 0x7f08440c7da0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0830067320 0x7f08300697d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0844069aa0 0x7f084414d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 --2- 172.21.15.22:0/2170809429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08440af320 0x7f08440c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 >> 172.21.15.22:0/2170809429 conn(0x7f0844068e00 msgr2=0x7f08440b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 shutdown_connections 2023-10-08T00:31:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:44.996+0000 7f084c120700 1 -- 172.21.15.22:0/2170809429 wait complete. 2023-10-08T00:31:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:31:45.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:31:45.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.127+0000 7f97c5921700 1 Processor -- start 2023-10-08T00:31:45.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.127+0000 7f97c5921700 1 -- start start 2023-10-08T00:31:45.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.127+0000 7f97c5921700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 0x7f97c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97c5921700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0069560 0x7f97c00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97c5921700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c0069ee0 con 0x7f97c0159c60 2023-10-08T00:31:45.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97c5921700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c015a160 con 0x7f97c0159890 2023-10-08T00:31:45.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97c5921700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00d13a0 con 0x7f97c0069560 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97beffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 0x7f97c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97bf7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0069560 0x7f97c00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97beffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 0x7f97c015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:37786/0 (socket says 172.21.15.22:37786) 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97beffd700 1 -- 172.21.15.22:0/1493430356 learned_addr learned my addr 172.21.15.22:0/1493430356 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97be7fc700 1 --1- 172.21.15.22:0/1493430356 >> v1:172.21.15.192:6789/0 conn(0x7f97c0159c60 0x7f97c015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:49794/0 (socket says 172.21.15.22:49794) 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1493430356 >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 msgr2=0x7f97c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97bf7fe700 1 --2- 172.21.15.22:0/1493430356 >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 0x7f97c015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1493430356 >> v1:172.21.15.192:6789/0 conn(0x7f97c0159c60 legacy=0x7f97c015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1493430356 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c015e140 con 0x7f97c0069560 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.128+0000 7f97beffd700 1 --2- 172.21.15.22:0/1493430356 >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 0x7f97c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97bf7fe700 1 --2- 172.21.15.22:0/1493430356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0069560 0x7f97c00699a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009e60 tx=0x7f97b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cc48781422783a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97bdffb700 1 -- 172.21.15.22:0/1493430356 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800e070 con 0x7f97c0069560 2023-10-08T00:31:45.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97bdffb700 1 -- 172.21.15.22:0/1493430356 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800bb60 con 0x7f97c0069560 2023-10-08T00:31:45.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97bdffb700 1 -- 172.21.15.22:0/1493430356 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8012430 con 0x7f97c0069560 2023-10-08T00:31:45.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 -- 172.21.15.22:0/1493430356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0069560 msgr2=0x7f97c00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 --2- 172.21.15.22:0/1493430356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0069560 0x7f97c00699a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97b8009e60 tx=0x7f97b8009780 comp rx=0 tx=0).stop 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 -- 172.21.15.22:0/1493430356 shutdown_connections 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 --2- 172.21.15.22:0/1493430356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0069560 0x7f97c00699a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 --2- 172.21.15.22:0/1493430356 >> v2:172.21.15.192:3300/0 conn(0x7f97c0159890 0x7f97c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 -- 172.21.15.22:0/1493430356 >> 172.21.15.22:0/1493430356 conn(0x7f97c0068e20 msgr2=0x7f97c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 -- 172.21.15.22:0/1493430356 shutdown_connections 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.129+0000 7f97c5921700 1 -- 172.21.15.22:0/1493430356 wait complete. 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 Processor -- start 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 -- start start 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c0069560 0x7f97c014d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0159890 0x7f97c00c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 0x7f97c00c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00c7de0 con 0x7f97c0159c60 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cd0c0 con 0x7f97c0069560 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97c5921700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cd3a0 con 0x7f97c0159890 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97bf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 0x7f97c00c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97bf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 0x7f97c00c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54000/0 (socket says 172.21.15.22:54000) 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.131+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1234483284 learned_addr learned my addr 172.21.15.22:0/1234483284 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97beffd700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c0069560 0x7f97c014d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97be7fc700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0159890 0x7f97c00c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0159890 msgr2=0x7f97c00c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97bf7fe700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0159890 0x7f97c00c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c0069560 msgr2=0x7f97c014d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97bf7fe700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c0069560 0x7f97c014d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97bf7fe700 1 -- 172.21.15.22:0/1234483284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00094f0 con 0x7f97c0159c60 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97bf7fe700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 0x7f97c00c5590 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f97c0070e20 tx=0x7f97b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8012ea0 con 0x7f97c0159c60 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b8027470 con 0x7f97c0159c60 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b8027810 con 0x7f97c0159c60 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8009a20 con 0x7f97c0159c60 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.132+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c00cd960 con 0x7f97c0159c60 2023-10-08T00:31:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.133+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c004c3c0 con 0x7f97c0159c60 2023-10-08T00:31:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.133+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f97b8024070 con 0x7f97c0159c60 2023-10-08T00:31:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.134+0000 7f97b6ffd700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a0067320 0x7f97a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.134+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f97b8087600 con 0x7f97c0159c60 2023-10-08T00:31:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.134+0000 7f97beffd700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a0067320 0x7f97a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.135+0000 7f97beffd700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a0067320 0x7f97a00697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f97b0006d20 tx=0x7f97b0009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.138+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97b8054350 con 0x7f97c0159c60 2023-10-08T00:31:45.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.375+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97c006a5b0 con 0x7f97c0159c60 2023-10-08T00:31:45.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.376+0000 7f97b6ffd700 1 -- 172.21.15.22:0/1234483284 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f97b8057970 con 0x7f97c0159c60 2023-10-08T00:31:45.377 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:31:45.378 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":78,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1568259552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1568259552},{"type":"v1","addr":"172.21.15.192:6837","nonce":1568259552}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7197,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3522181155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3522181155},{"type":"v1","addr":"172.21.15.22:6834","nonce":3522181155}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:39.444812+0000","modified":"2023-10-08T00:31:43.058497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7200":{"gid":7200,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/1343084597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1343084597},{"type":"v1","addr":"172.21.15.22:6835","nonce":1343084597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a0067320 msgr2=0x7f97a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a0067320 0x7f97a00697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f97b0006d20 tx=0x7f97b0009250 comp rx=0 tx=0).stop 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 msgr2=0x7f97c00c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 0x7f97c00c5590 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f97c0070e20 tx=0x7f97b8019000 comp rx=0 tx=0).stop 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 shutdown_connections 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c0159c60 0x7f97c00c5590 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c0069560 0x7f97c014d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a0067320 0x7f97a00697d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 --2- 172.21.15.22:0/1234483284 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c0159890 0x7f97c00c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 >> 172.21.15.22:0/1234483284 conn(0x7f97c0068e20 msgr2=0x7f97c0156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 shutdown_connections 2023-10-08T00:31:45.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.378+0000 7f97c5921700 1 -- 172.21.15.22:0/1234483284 wait complete. 2023-10-08T00:31:45.380 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 78 2023-10-08T00:31:45.632 INFO:tasks.ceph.mds.c.smithi022.stderr:2023-10-08T00:31:45.632+0000 7f9c334a7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:31:45.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:31:39.444812+0000', 'modified': '2023-10-08T00:31:43.058497+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7200}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7200': {'gid': 7200, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6835/1343084597', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6833', 'nonce': 1343084597}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 1343084597}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:31:45.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:31:45.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T00:31:45.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.916+0000 7f63299d1700 1 Processor -- start 2023-10-08T00:31:45.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.916+0000 7f63299d1700 1 -- start start 2023-10-08T00:31:45.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.916+0000 7f63299d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 0x7f63241645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.916+0000 7f63299d1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240cfb30 con 0x7f6324159840 2023-10-08T00:31:45.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.916+0000 7f63299d1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240cbc40 con 0x7f6324159c10 2023-10-08T00:31:45.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.916+0000 7f63299d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63240cbf10 con 0x7f6324069bb0 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6322ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6324159840 0x7f63240cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52532/0 (socket says 172.21.15.22:52532) 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6322ffd700 1 -- 172.21.15.22:0/2920075956 learned_addr learned my addr 172.21.15.22:0/2920075956 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f63237fe700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 0x7f63241645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944085071 0 0) 0x7f63240cfb30 con 0x7f6324159840 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6310003570 con 0x7f6324159840 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1341130175 0 0) 0x7f6310003570 con 0x7f6324159840 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 msgr2=0x7f63241645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 0x7f63241645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 >> v1:172.21.15.192:6789/0 conn(0x7f6324159c10 legacy=0x7f63240694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63240cf4e0 con 0x7f6324159840 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f63140017f0 con 0x7f6324159840 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 >> v1:172.21.15.22:6789/0 conn(0x7f6324159840 legacy=0x7f63240cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f6310003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6310004810 0x7f6310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 0x7f6310005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63240cbf10 con 0x7f6310003a90 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631000bb90 con 0x7f6310004810 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631000bd50 con 0x7f6324069bb0 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f6322ffd700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f6310003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f63237fe700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 0x7f6310005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.917+0000 7f63227fc700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6310004810 0x7f6310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6322ffd700 1 -- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 msgr2=0x7f6310005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6322ffd700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6324069bb0 0x7f6310005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6322ffd700 1 -- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6310004810 msgr2=0x7f6310004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6322ffd700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6310004810 0x7f6310004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6322ffd700 1 -- 172.21.15.22:0/2920075956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310003570 con 0x7f6310003a90 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f63227fc700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6310004810 0x7f6310004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6322ffd700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f6310003e60 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f631400a950 tx=0x7f63140021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af33e205b1aae6fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63140070d0 con 0x7f6310003a90 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314007250 con 0x7f6310003a90 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f6321ffb700 1 -- 172.21.15.22:0/2920075956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314007610 con 0x7f6310003a90 2023-10-08T00:31:45.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f63299d1700 1 -- 172.21.15.22:0/2920075956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 msgr2=0x7f6310003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f63299d1700 1 --2- 172.21.15.22:0/2920075956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f6310003e60 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f631400a950 tx=0x7f63140021f0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f63237fe700 1 -- 172.21.15.22:0/2920075956 reap_dead start 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f63299d1700 1 -- 172.21.15.22:0/2920075956 shutdown_connections 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.918+0000 7f63299d1700 1 -- 172.21.15.22:0/2920075956 >> 172.21.15.22:0/2920075956 conn(0x7f6324068e10 msgr2=0x7f63240d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.919+0000 7f63299d1700 1 -- 172.21.15.22:0/2920075956 shutdown_connections 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.919+0000 7f63299d1700 1 -- 172.21.15.22:0/2920075956 wait complete. 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 Processor -- start 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 -- start start 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f63241691a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6324140bf0 0x7f6324141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63240b40d0 0x7f63240b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241415a0 con 0x7f6310003a90 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241503c0 con 0x7f6324140bf0 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.920+0000 7f63299d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632414f7b0 con 0x7f63240b40d0 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f63241691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f63241691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54008/0 (socket says 172.21.15.22:54008) 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 -- 172.21.15.22:0/3317708448 learned_addr learned my addr 172.21.15.22:0/3317708448 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f63237fe700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63240b40d0 0x7f63240b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f63227fc700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6324140bf0 0x7f6324141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 -- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63240b40d0 msgr2=0x7f63240b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63240b40d0 0x7f63240b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 -- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6324140bf0 msgr2=0x7f6324141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6324140bf0 0x7f6324141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 -- 172.21.15.22:0/3317708448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632414fa90 con 0x7f6310003a90 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f6322ffd700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f63241691a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f631400a410 tx=0x7f6314015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f631affd700 1 -- 172.21.15.22:0/3317708448 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314012610 con 0x7f6310003a90 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f631affd700 1 -- 172.21.15.22:0/3317708448 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314012770 con 0x7f6310003a90 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632414fd70 con 0x7f6310003a90 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f631affd700 1 -- 172.21.15.22:0/3317708448 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314012920 con 0x7f6310003a90 2023-10-08T00:31:45.929 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.921+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63241696e0 con 0x7f6310003a90 2023-10-08T00:31:45.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.923+0000 7f631affd700 1 -- 172.21.15.22:0/3317708448 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6314024020 con 0x7f6310003a90 2023-10-08T00:31:45.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.923+0000 7f631affd700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6304067320 0x7f63040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.923+0000 7f631affd700 1 -- 172.21.15.22:0/3317708448 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6314086e20 con 0x7f6310003a90 2023-10-08T00:31:45.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.923+0000 7f63227fc700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6304067320 0x7f63040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.924+0000 7f63227fc700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6304067320 0x7f63040697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f630c007fd0 tx=0x7f630c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.925+0000 7f6332cc9b80 1 Processor -- start 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.925+0000 7f6332cc9b80 1 -- start start 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e254c7d00 0x562e254a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25479cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e253d4a70 con 0x562e2547da50 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e253d2270 con 0x562e254c7d00 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e253ce060 con 0x562e254a6f60 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54020/0 (socket says 172.21.15.22:54020) 2023-10-08T00:31:45.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 -- 172.21.15.22:0/1282631851 learned_addr learned my addr 172.21.15.22:0/1282631851 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f63227fc700 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e254c7d00 0x562e254a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f63237fe700 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25479cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 -- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 msgr2=0x562e25479cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25479cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 -- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e254c7d00 msgr2=0x562e254a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e254c7d00 0x562e254a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.926+0000 7f6322ffd700 1 -- 172.21.15.22:0/1282631851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e25268270 con 0x562e2547da50 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 0x562e2547de20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6314084df0 tx=0x7f6314020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9685a3efe5879951 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6303fff700 1 -- 172.21.15.22:0/1282631851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314058000 con 0x562e2547da50 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6303fff700 1 -- 172.21.15.22:0/1282631851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314057900 con 0x562e2547da50 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6303fff700 1 -- 172.21.15.22:0/1282631851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631405ab50 con 0x562e2547da50 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1282631851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 msgr2=0x562e2547de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 0x562e2547de20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6314084df0 tx=0x7f6314020040 comp rx=0 tx=0).stop 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1282631851 shutdown_connections 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25479cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1282631851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e254c7d00 0x562e254a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.927+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1282631851 >> 172.21.15.22:0/1282631851 conn(0x562e2547f370 msgr2=0x562e2547f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.928+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1282631851 shutdown_connections 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.928+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1282631851 wait complete. 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.928+0000 7f6332cc9b80 1 -- start start 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.928+0000 7f6332cc9b80 1 Processor -- start 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e254d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e254c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e25379890 con 0x562e254c7d00 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e25394ea0 con 0x562e2547da50 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e25250e30 con 0x562e254a6f60 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6332cc9b80 10 client.0 _ll_register_callbacks cb 0x562e25441110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f63237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e254c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f63237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e254c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54028/0 (socket says 172.21.15.22:54028) 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f63237fe700 1 -- 172.21.15.22:0/3761037172 learned_addr learned my addr 172.21.15.22:0/3761037172 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f6322ffd700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.929+0000 7f63227fc700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e254d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63237fe700 1 -- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 msgr2=0x562e254d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63237fe700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e254d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63237fe700 1 -- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 msgr2=0x562e254abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63237fe700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63237fe700 1 -- 172.21.15.22:0/3761037172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63241696e0 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63237fe700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e254c1a70 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6324069fb0 tx=0x7f631c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5024f7f815d06cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63017fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63017fa700 1 -- 172.21.15.22:0/3761037172 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c015760 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63017fa700 1 -- 172.21.15.22:0/3761037172 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f631c0158c0 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e25472b70 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63017fa700 1 -- 172.21.15.22:0/3761037172 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f631c015c90 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 10 client.7332 fetch_fsmap learned FSMap version 78 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562e2520afe0 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63017fa700 1 -- 172.21.15.22:0/3761037172 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e25472b70 con 0x562e254c7d00 2023-10-08T00:31:45.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f63017fa700 1 -- 172.21.15.22:0/3761037172 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f631c011070 con 0x562e254c7d00 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 10 client.7332 fetch_fsmap finished waiting for FSMap version 78 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 10 client.7332 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 20 client.7332 populate_metadata read hostname 'smithi022' 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e254c7850 0x562e254be370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 4 client.7332 mds_command: new command op to 7200 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.930+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 --> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e2544faa0 con 0x562e254c7850 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.931+0000 7f6322ffd700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e254c7850 0x562e254be370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.931+0000 7f63017fa700 10 client.7332 ms_handle_connect on v2:172.21.15.22:6833/1343084597 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.931+0000 7f6322ffd700 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e254c7850 0x562e254be370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40afbca1a0547422 server_cookie=4d6070f737b0625d in_seq=0 out_seq=0 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.931+0000 7f63017fa700 1 -- 172.21.15.22:0/3761037172 <== mds.0 v2:172.21.15.22:6833/1343084597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562e2544faa0 con 0x562e254c7850 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.931+0000 7f63017fa700 10 client.7332 handle_command_reply: tid=0 2023-10-08T00:31:45.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.931+0000 7f6332cc9b80 1 client.7332 shutdown 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 msgr2=0x562e254c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e254c1a70 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6324069fb0 tx=0x7f631c008040 comp rx=0 tx=0).stop 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 shutdown_connections 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e254c7850 0x562e254be370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e254c1a70 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/3761037172 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e254d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f63017fa700 0 client.7332 ms_handle_reset on v2:172.21.15.22:6833/1343084597 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 >> 172.21.15.22:0/3761037172 conn(0x562e2547f370 msgr2=0x562e25478c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 shutdown_connections 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 1 -- 172.21.15.22:0/3761037172 wait complete. 2023-10-08T00:31:45.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.932+0000 7f6332cc9b80 20 client.7332 trim_cache size 0 max 16384 2023-10-08T00:31:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.949+0000 7f6332cc9b80 1 Processor -- start 2023-10-08T00:31:45.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.949+0000 7f6332cc9b80 1 -- start start 2023-10-08T00:31:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 0x562e254c0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254c7d00 0x562e254c3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e25479fb0 con 0x562e254a6f60 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e2547ccd0 con 0x562e2547da50 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e254c15c0 con 0x562e254c7d00 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 0x562e254c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 0x562e254c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54032/0 (socket says 172.21.15.22:54032) 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 -- 172.21.15.22:0/1771455103 learned_addr learned my addr 172.21.15.22:0/1771455103 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63237fe700 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254c7d00 0x562e254c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 -- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254c7d00 msgr2=0x562e254c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254c7d00 0x562e254c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 -- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 msgr2=0x562e2547de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 -- 172.21.15.22:0/1771455103 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e2539c780 con 0x562e254a6f60 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63237fe700 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254c7d00 0x562e254c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f63227fc700 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 0x562e254c0170 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f630c001a30 tx=0x7f630c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae265470f44cfb7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6318ff9700 1 -- 172.21.15.22:0/1771455103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c001df0 con 0x562e254a6f60 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6318ff9700 1 -- 172.21.15.22:0/1771455103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c014890 con 0x562e254a6f60 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.950+0000 7f6318ff9700 1 -- 172.21.15.22:0/1771455103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c014a00 con 0x562e254a6f60 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1771455103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 msgr2=0x562e254c0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 0x562e254c0170 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f630c001a30 tx=0x7f630c015000 comp rx=0 tx=0).stop 2023-10-08T00:31:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1771455103 shutdown_connections 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254c7d00 0x562e254c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e2547de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1771455103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254a6f60 0x562e254c0170 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1771455103 >> 172.21.15.22:0/1771455103 conn(0x562e2547f370 msgr2=0x562e254764b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1771455103 shutdown_connections 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.951+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1771455103 wait complete. 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 -- start start 2023-10-08T00:31:45.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 Processor -- start 2023-10-08T00:31:45.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254baf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25506b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e2551d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e2547b1e0 con 0x562e254c7d00 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e254c00f0 con 0x562e2547da50 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.952+0000 7f6332cc9b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e2547e510 con 0x562e254a6f60 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f6332cc9b80 10 client.0 _ll_register_callbacks cb 0x562e25441110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e2551d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e2551d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54036/0 (socket says 172.21.15.22:54036) 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 -- 172.21.15.22:0/1121568306 learned_addr learned my addr 172.21.15.22:0/1121568306 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:45.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254baf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63227fc700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25506b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 -- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 msgr2=0x562e25506b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25506b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 -- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 msgr2=0x562e254baf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254baf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 -- 172.21.15.22:0/1121568306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c00f040 con 0x562e254c7d00 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63237fe700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e2551d910 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x562e254a64c0 tx=0x7f631c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8049022bf1393234 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63017fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63017fa700 1 -- 172.21.15.22:0/1121568306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c015e40 con 0x562e254c7d00 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6314057900 con 0x562e254c7d00 2023-10-08T00:31:45.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63017fa700 1 -- 172.21.15.22:0/1121568306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f631c009e40 con 0x562e254c7d00 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f63017fa700 1 -- 172.21.15.22:0/1121568306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f631c020bc0 con 0x562e254c7d00 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f6332cc9b80 10 client.7338 fetch_fsmap learned FSMap version 78 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.953+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562e25383470 con 0x562e254c7d00 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f63017fa700 1 -- 172.21.15.22:0/1121568306 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314057900 con 0x562e254c7d00 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f63017fa700 1 -- 172.21.15.22:0/1121568306 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 78) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f631c020d20 con 0x562e254c7d00 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 10 client.7338 fetch_fsmap finished waiting for FSMap version 78 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 10 client.7338 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 20 client.7338 populate_metadata read hostname 'smithi022' 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e2547a330 0x562e2547a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 4 client.7338 mds_command: new command op to 7200 tid=0[{"prefix": "status"}] 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 --> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562e25370e00 con 0x562e2547a330 2023-10-08T00:31:45.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e2547a330 0x562e2547a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f63017fa700 10 client.7338 ms_handle_connect on v2:172.21.15.22:6833/1343084597 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6322ffd700 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e2547a330 0x562e2547a700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bed82c87c96c288 server_cookie=a89da74aea3076d4 in_seq=0 out_seq=0 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f63017fa700 1 -- 172.21.15.22:0/1121568306 <== mds.0 v2:172.21.15.22:6833/1343084597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x562e25370e00 con 0x562e2547a330 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f63017fa700 10 client.7338 handle_command_reply: tid=0 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 1 client.7338 shutdown 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 msgr2=0x562e2551d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.954+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e2551d910 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x562e254a64c0 tx=0x7f631c01e000 comp rx=0 tx=0).stop 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 shutdown_connections 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:6833/1343084597,v1:172.21.15.22:6835/1343084597] conn(0x562e2547a330 0x562e2547a700 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562e254c7d00 0x562e2551d910 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63017fa700 0 client.7338 ms_handle_reset on v2:172.21.15.22:6833/1343084597 2023-10-08T00:31:45.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e2547da50 0x562e254baf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 --2- 172.21.15.22:0/1121568306 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x562e254a6f60 0x562e25506b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 >> 172.21.15.22:0/1121568306 conn(0x562e2547f370 msgr2=0x562e254bf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 shutdown_connections 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 1 -- 172.21.15.22:0/1121568306 wait complete. 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f6332cc9b80 20 client.7338 trim_cache size 0 max 16384 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:31:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 7200, 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 5.9215022309999998, 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 78, 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 116, 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 116, 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 10.978087460999999 2023-10-08T00:31:45.964 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6304067320 msgr2=0x7f63040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6304067320 0x7f63040697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f630c007fd0 tx=0x7f630c009040 comp rx=0 tx=0).stop 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 msgr2=0x7f63241691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f63241691a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f631400a410 tx=0x7f6314015000 comp rx=0 tx=0).stop 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 shutdown_connections 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6304067320 0x7f63040697d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f63240b40d0 0x7f63240b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6310003a90 0x7f63241691a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 --2- 172.21.15.22:0/3317708448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6324140bf0 0x7f6324141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:45.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 >> 172.21.15.22:0/3317708448 conn(0x7f6324068e10 msgr2=0x7f63240c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:45.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 shutdown_connections 2023-10-08T00:31:45.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:45.955+0000 7f63299d1700 1 -- 172.21.15.22:0/3317708448 wait complete. 2023-10-08T00:31:45.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:31:46.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.086+0000 7fa4e8f3a700 1 Processor -- start 2023-10-08T00:31:46.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.086+0000 7fa4e8f3a700 1 -- start start 2023-10-08T00:31:46.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e8f3a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4e4068920 0x7fa4e406f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:46.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e8f3a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e406ec70 con 0x7fa4e4068550 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e8f3a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e40b2e70 con 0x7fa4e406f640 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e8f3a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e4068d90 con 0x7fa4e4068920 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4e4068920 0x7fa4e406f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e259c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa4e4068550 0x7fa4e415e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52544/0 (socket says 172.21.15.22:52544) 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e1d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa4e4068920 0x7fa4e406f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54048/0 (socket says 172.21.15.22:54048) 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.087+0000 7fa4e259c700 1 -- 172.21.15.22:0/2062550057 learned_addr learned my addr 172.21.15.22:0/2062550057 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e1d9b700 1 -- 172.21.15.22:0/2062550057 >> v1:172.21.15.192:6789/0 conn(0x7fa4e406f640 legacy=0x7fa4e4159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e1d9b700 1 -- 172.21.15.22:0/2062550057 >> v1:172.21.15.22:6789/0 conn(0x7fa4e4068550 legacy=0x7fa4e415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e1d9b700 1 -- 172.21.15.22:0/2062550057 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e40b3150 con 0x7fa4e4068920 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e1d9b700 1 --2- 172.21.15.22:0/2062550057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e4068920 0x7fa4e406f100 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0098e0 tx=0x7fa4cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c13e61a2c8a618 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:46.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e159a700 1 -- 172.21.15.22:0/2062550057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc009e80 con 0x7fa4e4068920 2023-10-08T00:31:46.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e159a700 1 -- 172.21.15.22:0/2062550057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc00b820 con 0x7fa4e4068920 2023-10-08T00:31:46.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e159a700 1 -- 172.21.15.22:0/2062550057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc00bba0 con 0x7fa4e4068920 2023-10-08T00:31:46.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/2062550057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e4068920 msgr2=0x7fa4e406f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:46.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.088+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/2062550057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e4068920 0x7fa4e406f100 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc0098e0 tx=0x7fa4cc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.089+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/2062550057 shutdown_connections 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.089+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/2062550057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e4068920 0x7fa4e406f100 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.089+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/2062550057 >> 172.21.15.22:0/2062550057 conn(0x7fa4e40cd480 msgr2=0x7fa4e40cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.089+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/2062550057 shutdown_connections 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.089+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/2062550057 wait complete. 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.090+0000 7fa4e8f3a700 1 Processor -- start 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.090+0000 7fa4e8f3a700 1 -- start start 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.090+0000 7fa4e8f3a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4e4068550 0x7fa4e413efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.090+0000 7fa4e8f3a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4e4068920 0x7fa4e41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e8f3a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 0x7fa4e4154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e8f3a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e414ec40 con 0x7fa4e406f640 2023-10-08T00:31:46.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e8f3a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e414e050 con 0x7fa4e4068550 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e8f3a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e414e310 con 0x7fa4e4068920 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 0x7fa4e4154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 0x7fa4e4154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54050/0 (socket says 172.21.15.22:54050) 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 -- 172.21.15.22:0/3880107669 learned_addr learned my addr 172.21.15.22:0/3880107669 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e259c700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4e4068550 0x7fa4e413efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e1d9b700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4e4068920 0x7fa4e41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 -- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4e4068920 msgr2=0x7fa4e41503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4e4068920 0x7fa4e41503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 -- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4e4068550 msgr2=0x7fa4e413efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4e4068550 0x7fa4e413efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 -- 172.21.15.22:0/3880107669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc009420 con 0x7fa4e406f640 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e2d9d700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 0x7fa4e4154f50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c5b0 tx=0x7fa4dc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc011590 con 0x7fa4e406f640 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc011710 con 0x7fa4e406f640 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e414e5f0 con 0x7fa4e406f640 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc011ad0 con 0x7fa4e406f640 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.091+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e4150920 con 0x7fa4e406f640 2023-10-08T00:31:46.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.092+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e404c3c0 con 0x7fa4e406f640 2023-10-08T00:31:46.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.093+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa4dc01c460 con 0x7fa4e406f640 2023-10-08T00:31:46.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.093+0000 7fa4da7fc700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa4c4067320 0x7fa4c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:46.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.093+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fa4dc0849a0 con 0x7fa4e406f640 2023-10-08T00:31:46.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.093+0000 7fa4e259c700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa4c4067320 0x7fa4c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:46.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.094+0000 7fa4e259c700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa4c4067320 0x7fa4c40697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40ace50 tx=0x7fa4d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:46.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.097+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4dc0515f0 con 0x7fa4e406f640 2023-10-08T00:31:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.334+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa4e4158f90 con 0x7fa4e406f640 2023-10-08T00:31:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.334+0000 7fa4da7fc700 1 -- 172.21.15.22:0/3880107669 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa4dc054c10 con 0x7fa4e406f640 2023-10-08T00:31:46.335 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa4c4067320 msgr2=0x7fa4c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa4c4067320 0x7fa4c40697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40ace50 tx=0x7fa4d4009040 comp rx=0 tx=0).stop 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 msgr2=0x7fa4e4154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 0x7fa4e4154f50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c5b0 tx=0x7fa4dc007f60 comp rx=0 tx=0).stop 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 shutdown_connections 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4e406f640 0x7fa4e4154f50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4e4068550 0x7fa4e413efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa4c4067320 0x7fa4c40697d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 --2- 172.21.15.22:0/3880107669 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa4e4068920 0x7fa4e41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 >> 172.21.15.22:0/3880107669 conn(0x7fa4e40cd480 msgr2=0x7fa4e40b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 shutdown_connections 2023-10-08T00:31:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:46.336+0000 7fa4e8f3a700 1 -- 172.21.15.22:0/3880107669 wait complete. 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:31:46.349 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:31:46.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.350 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:31:46.365 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:31:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:31:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:31:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42064sec preferred_lft 42064sec 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:31:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:46.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.369 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:31:46.429 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:31:46.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.430 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:31:46.487 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:31:46.488 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:31:46.488 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:31:46.488 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:31:46.488 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:31:46.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:31:46.489 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:31:46.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:31:46.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:31:46.489 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:31:46.489 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:31:46.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.592 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:31:46.607 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:31:46.608 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:31:46.608 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:31:46.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:31:46.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:46.675 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:46.731 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:31:46.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:46.732 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:46.785 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:31:46.785 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:31:46.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:46.866 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:46.908 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:46.908 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:46.908 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:46.908 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:46.908 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:46.908 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:46.909 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:46.909 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:46.909 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:31:46.909 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:31:46.909 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:31:46.911 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:31:46.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:46.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:31:46.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:31:47.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 Processor -- start 2023-10-08T00:31:47.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 -- start start 2023-10-08T00:31:47.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 0x7f7b9c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c15a160 con 0x7f7b9c159890 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c15df50 con 0x7f7b9c159c60 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.138+0000 7f7ba26a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0d13a0 con 0x7f7b9c15db10 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7b9b7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 0x7f7b9c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:41748/0 (socket says 172.21.15.22:41748) 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7b9bfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7b9c159890 0x7f7b9c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:59092/0 (socket says 172.21.15.22:59092) 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 -- 172.21.15.22:0/4159569082 learned_addr learned my addr 172.21.15.22:0/4159569082 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:47.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7b9b7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 0x7f7b9c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:35952/0 (socket says 172.21.15.22:35952) 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 -- 172.21.15.22:0/4159569082 >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 msgr2=0x7f7b9c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 --2- 172.21.15.22:0/4159569082 >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 0x7f7b9c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 -- 172.21.15.22:0/4159569082 >> v1:172.21.15.192:6789/0 conn(0x7f7b9c159890 legacy=0x7f7b9c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 -- 172.21.15.22:0/4159569082 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c15e140 con 0x7f7b9c15db10 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7b9affd700 1 -- 172.21.15.22:0/4159569082 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031035940 0 0) 0x7f7b9c15a160 con 0x7f7b9c159890 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7b9b7fe700 1 --2- 172.21.15.22:0/4159569082 >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 0x7f7b9c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.139+0000 7f7ba0c46700 1 --2- 172.21.15.22:0/4159569082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c069560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009f20 tx=0x7f7b94009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82dde3fd5fd06e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7b9affd700 1 -- 172.21.15.22:0/4159569082 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400e070 con 0x7f7b9c15db10 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7b9affd700 1 -- 172.21.15.22:0/4159569082 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9400b9d0 con 0x7f7b9c15db10 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7b9affd700 1 -- 172.21.15.22:0/4159569082 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940092e0 con 0x7f7b9c15db10 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 -- 172.21.15.22:0/4159569082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 msgr2=0x7f7b9c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:47.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/4159569082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c069560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009f20 tx=0x7f7b94009840 comp rx=0 tx=0).stop 2023-10-08T00:31:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 -- 172.21.15.22:0/4159569082 shutdown_connections 2023-10-08T00:31:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/4159569082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c069560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/4159569082 >> v2:172.21.15.192:3300/0 conn(0x7f7b9c159c60 0x7f7b9c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 -- 172.21.15.22:0/4159569082 >> 172.21.15.22:0/4159569082 conn(0x7f7b9c068e20 msgr2=0x7f7b9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 -- 172.21.15.22:0/4159569082 shutdown_connections 2023-10-08T00:31:47.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.140+0000 7f7ba26a9700 1 -- 172.21.15.22:0/4159569082 wait complete. 2023-10-08T00:31:47.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.141+0000 7f7ba26a9700 1 Processor -- start 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.141+0000 7f7ba26a9700 1 -- start start 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba26a9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b9c159890 0x7f7b9c152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba26a9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 0x7f7b9c0b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba26a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba26a9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0b6380 con 0x7f7b9c159c60 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba26a9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c169d30 con 0x7f7b9c159890 2023-10-08T00:31:47.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba26a9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c16a010 con 0x7f7b9c15db10 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7b9b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 0x7f7b9c0b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7b9b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 0x7f7b9c0b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44350/0 (socket says 172.21.15.22:44350) 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7b9b7fe700 1 -- 172.21.15.22:0/135353229 learned_addr learned my addr 172.21.15.22:0/135353229 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7b9bfff700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b9c159890 0x7f7b9c152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.142+0000 7f7ba0c46700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b9b7fe700 1 -- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 msgr2=0x7f7b9c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b9b7fe700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b9b7fe700 1 -- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b9c159890 msgr2=0x7f7b9c152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b9b7fe700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b9c159890 0x7f7b9c152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b9b7fe700 1 -- 172.21.15.22:0/135353229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c009420 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b9b7fe700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 0x7f7b9c0b5900 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00ec80 tx=0x7f7b8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00c920 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c00ca80 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b94009ae0 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c00ce00 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.143+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c16a5d0 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.144+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c16a7f0 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.145+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7b8c013680 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.145+0000 7f7b93fff700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7b7c067320 0x7f7b7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.145+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7b8c085060 con 0x7f7b9c159c60 2023-10-08T00:31:47.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.145+0000 7f7b9bfff700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7b7c067320 0x7f7b7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.146+0000 7f7b9bfff700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7b7c067320 0x7f7b7c0697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007fd0 tx=0x7f7b84007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:47.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.149+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b8c051cb0 con 0x7f7b9c159c60 2023-10-08T00:31:47.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.387+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b9c04c3c0 con 0x7f7b9c159c60 2023-10-08T00:31:47.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.388+0000 7f7b93fff700 1 -- 172.21.15.22:0/135353229 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7b8c0552d0 con 0x7f7b9c159c60 2023-10-08T00:31:47.448 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:31:47.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7b7c067320 msgr2=0x7f7b7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7b7c067320 0x7f7b7c0697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7b84007fd0 tx=0x7f7b84007d50 comp rx=0 tx=0).stop 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 msgr2=0x7f7b9c0b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 0x7f7b9c0b5900 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c00ec80 tx=0x7f7b8c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 shutdown_connections 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7b7c067320 0x7f7b7c0697d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7b9c15db10 0x7f7b9c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b9c159890 0x7f7b9c152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 --2- 172.21.15.22:0/135353229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b9c159c60 0x7f7b9c0b5900 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:47.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 >> 172.21.15.22:0/135353229 conn(0x7f7b9c068e20 msgr2=0x7f7b9c156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:47.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 shutdown_connections 2023-10-08T00:31:47.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:47.390+0000 7f7ba26a9700 1 -- 172.21.15.22:0/135353229 wait complete. 2023-10-08T00:31:47.451 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:31:47.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:31:47.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:31:47.452 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:31:47.452 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:47.452 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:31:47.452 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:31:47.452 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:31:47.452 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:31:47.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:47.452 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:31:47.471 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:31:47.471 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:31:47.472 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:31:47.473 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42067sec preferred_lft 42067sec 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.474 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:31:47.475 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:31:47.476 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:31:47.476 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:31:47.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:47.476 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:31:47.541 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:31:47.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:47.543 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:31:47.600 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:31:47.601 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:31:47.601 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:31:47.601 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:31:47.601 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:31:47.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:47.601 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:31:47.601 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:31:47.602 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:31:47.602 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:31:47.602 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:31:47.602 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:31:47.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:47.707 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:31:47.722 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:31:47.722 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:31:47.723 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:31:47.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:47.723 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:31:47.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:47.788 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:47.844 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:31:47.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:31:47.845 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:47.899 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:31:47.899 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:31:47.899 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:47.978 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:47.978 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:47.997 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:48.018 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:31:48.019 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:31:48.021 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:31:48.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:31:48.021 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:31:48.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:31:48.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.216+0000 7f2aef377700 1 Processor -- start 2023-10-08T00:31:48.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.217+0000 7f2aef377700 1 -- start start 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.217+0000 7f2aef377700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ae8159ec0 0x7f2ae80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.217+0000 7f2aef377700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2ae80b53d0 0x7f2ae80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.217+0000 7f2aef377700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae80b5b00 con 0x7f2ae80cce40 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.217+0000 7f2aef377700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80b5850 con 0x7f2ae8159ec0 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.217+0000 7f2aef377700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80b5da0 con 0x7f2ae80b53d0 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed113700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ae8159ec0 0x7f2ae80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed914700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2ae80cce40 0x7f2ae80cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47082/0 (socket says 172.21.15.22:47082) 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed914700 1 -- 172.21.15.22:0/3759845041 learned_addr learned my addr 172.21.15.22:0/3759845041 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aec912700 1 --2- 172.21.15.22:0/3759845041 >> v2:172.21.15.192:3300/0 conn(0x7f2ae80b53d0 0x7f2ae80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed113700 1 -- 172.21.15.22:0/3759845041 >> v2:172.21.15.192:3300/0 conn(0x7f2ae80b53d0 msgr2=0x7f2ae80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:48.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed113700 1 --2- 172.21.15.22:0/3759845041 >> v2:172.21.15.192:3300/0 conn(0x7f2ae80b53d0 0x7f2ae80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed113700 1 -- 172.21.15.22:0/3759845041 >> v1:172.21.15.22:6789/0 conn(0x7f2ae80cce40 legacy=0x7f2ae80cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed113700 1 -- 172.21.15.22:0/3759845041 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80b6080 con 0x7f2ae8159ec0 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2ae7fff700 1 -- 172.21.15.22:0/3759845041 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428353868 0 0) 0x7f2ae80b5b00 con 0x7f2ae80cce40 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aec912700 1 --2- 172.21.15.22:0/3759845041 >> v2:172.21.15.192:3300/0 conn(0x7f2ae80b53d0 0x7f2ae80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2aed113700 1 --2- 172.21.15.22:0/3759845041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae8159ec0 0x7f2ae80b4e90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80b64d0 tx=0x7f2ad8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc9669dbfbbec86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2ae7fff700 1 -- 172.21.15.22:0/3759845041 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800e070 con 0x7f2ae8159ec0 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2ae7fff700 1 -- 172.21.15.22:0/3759845041 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad800bc30 con 0x7f2ae8159ec0 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.218+0000 7f2ae7fff700 1 -- 172.21.15.22:0/3759845041 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8012430 con 0x7f2ae8159ec0 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 -- 172.21.15.22:0/3759845041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae8159ec0 msgr2=0x7f2ae80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 --2- 172.21.15.22:0/3759845041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae8159ec0 0x7f2ae80b4e90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80b64d0 tx=0x7f2ad8009780 comp rx=0 tx=0).stop 2023-10-08T00:31:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 -- 172.21.15.22:0/3759845041 shutdown_connections 2023-10-08T00:31:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 --2- 172.21.15.22:0/3759845041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae8159ec0 0x7f2ae80b4e90 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 --2- 172.21.15.22:0/3759845041 >> v2:172.21.15.192:3300/0 conn(0x7f2ae80b53d0 0x7f2ae80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 -- 172.21.15.22:0/3759845041 >> 172.21.15.22:0/3759845041 conn(0x7f2ae80999f0 msgr2=0x7f2ae80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 -- 172.21.15.22:0/3759845041 shutdown_connections 2023-10-08T00:31:48.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.219+0000 7f2aef377700 1 -- 172.21.15.22:0/3759845041 wait complete. 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.220+0000 7f2aef377700 1 Processor -- start 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.220+0000 7f2aef377700 1 -- start start 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aef377700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 0x7f2ae8156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aef377700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ae80cce40 0x7f2ae809c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aef377700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ae8159ec0 0x7f2ae809a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aef377700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae809cd30 con 0x7f2ae80b53d0 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aef377700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae809d010 con 0x7f2ae80cce40 2023-10-08T00:31:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aef377700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae809d2f0 con 0x7f2ae8159ec0 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 0x7f2ae8156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 0x7f2ae8156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44378/0 (socket says 172.21.15.22:44378) 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 -- 172.21.15.22:0/2832457186 learned_addr learned my addr 172.21.15.22:0/2832457186 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aec912700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ae80cce40 0x7f2ae809c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed914700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ae8159ec0 0x7f2ae809a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 -- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ae8159ec0 msgr2=0x7f2ae809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ae8159ec0 0x7f2ae809a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 -- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ae80cce40 msgr2=0x7f2ae809c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ae80cce40 0x7f2ae809c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.221+0000 7f2aed113700 1 -- 172.21.15.22:0/2832457186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad8009a20 con 0x7f2ae80b53d0 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.222+0000 7f2aed113700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 0x7f2ae8156a10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8013000 tx=0x7f2ad8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.222+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8012e90 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.222+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8027470 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.222+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8027830 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.222+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae8069400 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.222+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8156f50 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.223+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae80698a0 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.223+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2ad8024070 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.224+0000 7f2ae57fa700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ad4067320 0x7f2ad40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.224+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f2ad8087350 con 0x7f2ae80b53d0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.224+0000 7f2aec912700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ad4067320 0x7f2ad40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.224+0000 7f2aec912700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ad4067320 0x7f2ad40697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2adc006f00 tx=0x7f2adc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.228+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ad8053fa0 con 0x7f2ae80b53d0 2023-10-08T00:31:48.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.465+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ae8063c90 con 0x7f2ae80b53d0 2023-10-08T00:31:48.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.642+0000 7f2ae57fa700 1 -- 172.21.15.22:0/2832457186 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 136+0+0 (secure 0 0 0) 0x7f2ad80575c0 con 0x7f2ae80b53d0 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ad4067320 msgr2=0x7f2ad40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ad4067320 0x7f2ad40697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2adc006f00 tx=0x7f2adc008040 comp rx=0 tx=0).stop 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 msgr2=0x7f2ae8156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 0x7f2ae8156a10 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8013000 tx=0x7f2ad8019000 comp rx=0 tx=0).stop 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 shutdown_connections 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2ad4067320 0x7f2ad40697d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ae8159ec0 0x7f2ae809a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ae80b53d0 0x7f2ae8156a10 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 --2- 172.21.15.22:0/2832457186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ae80cce40 0x7f2ae809c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 >> 172.21.15.22:0/2832457186 conn(0x7f2ae80999f0 msgr2=0x7f2ae80ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:48.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 shutdown_connections 2023-10-08T00:31:48.647 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.644+0000 7f2aef377700 1 -- 172.21.15.22:0/2832457186 wait complete. 2023-10-08T00:31:48.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:31:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.776+0000 7f9812582700 1 Processor -- start 2023-10-08T00:31:48.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 -- start start 2023-10-08T00:31:48.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f980c159890 0x7f980c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c159c60 0x7f980c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f980c15db10 0x7f980c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c15a160 con 0x7f980c15db10 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0d13a0 con 0x7f980c159890 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9812582700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c15e140 con 0x7f980c159c60 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.777+0000 7f9810b1f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f980c15db10 0x7f980c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f980c15db10 0x7f980c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44382/0 (socket says 172.21.15.22:44382) 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 -- 172.21.15.22:0/3859953670 learned_addr learned my addr 172.21.15.22:0/3859953670 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f980bfff700 1 --2- 172.21.15.22:0/3859953670 >> v2:172.21.15.192:3300/0 conn(0x7f980c159890 0x7f980c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f980b7fe700 1 --2- 172.21.15.22:0/3859953670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c159c60 0x7f980c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 -- 172.21.15.22:0/3859953670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c159c60 msgr2=0x7f980c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 --2- 172.21.15.22:0/3859953670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c159c60 0x7f980c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 -- 172.21.15.22:0/3859953670 >> v2:172.21.15.192:3300/0 conn(0x7f980c159890 msgr2=0x7f980c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 --2- 172.21.15.22:0/3859953670 >> v2:172.21.15.192:3300/0 conn(0x7f980c159890 0x7f980c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 -- 172.21.15.22:0/3859953670 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c15a3d0 con 0x7f980c15db10 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f980bfff700 1 --2- 172.21.15.22:0/3859953670 >> v2:172.21.15.192:3300/0 conn(0x7f980c159890 0x7f980c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f9810b1f700 1 --2- 172.21.15.22:0/3859953670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c15db10 0x7f980c069560 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f980c0d1090 tx=0x7f9804009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4674fbb83adcb88 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f980affd700 1 -- 172.21.15.22:0/3859953670 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400e070 con 0x7f980c15db10 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f980affd700 1 -- 172.21.15.22:0/3859953670 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400ba20 con 0x7f980c15db10 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.778+0000 7f980affd700 1 -- 172.21.15.22:0/3859953670 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98040092e0 con 0x7f980c15db10 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 -- 172.21.15.22:0/3859953670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c15db10 msgr2=0x7f980c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 --2- 172.21.15.22:0/3859953670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c15db10 0x7f980c069560 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f980c0d1090 tx=0x7f9804009840 comp rx=0 tx=0).stop 2023-10-08T00:31:48.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 -- 172.21.15.22:0/3859953670 shutdown_connections 2023-10-08T00:31:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 --2- 172.21.15.22:0/3859953670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c15db10 0x7f980c069560 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 --2- 172.21.15.22:0/3859953670 >> v2:172.21.15.192:3300/0 conn(0x7f980c159890 0x7f980c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 --2- 172.21.15.22:0/3859953670 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c159c60 0x7f980c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 -- 172.21.15.22:0/3859953670 >> 172.21.15.22:0/3859953670 conn(0x7f980c068e20 msgr2=0x7f980c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 -- 172.21.15.22:0/3859953670 shutdown_connections 2023-10-08T00:31:48.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.779+0000 7f9812582700 1 -- 172.21.15.22:0/3859953670 wait complete. 2023-10-08T00:31:48.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.780+0000 7f9812582700 1 Processor -- start 2023-10-08T00:31:48.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.780+0000 7f9812582700 1 -- start start 2023-10-08T00:31:48.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9812582700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c159890 0x7f980c14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9812582700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 0x7f980c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9812582700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c15db10 0x7f980c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9812582700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c14fd10 con 0x7f980c159c60 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9812582700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0b0760 con 0x7f980c159890 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9812582700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0b2540 con 0x7f980c15db10 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 0x7f980c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 0x7f980c0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44384/0 (socket says 172.21.15.22:44384) 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 -- 172.21.15.22:0/309605141 learned_addr learned my addr 172.21.15.22:0/309605141 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980bfff700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c159890 0x7f980c14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f9810b1f700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c15db10 0x7f980c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 -- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c15db10 msgr2=0x7f980c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c15db10 0x7f980c0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 -- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c159890 msgr2=0x7f980c14f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c159890 0x7f980c14f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 -- 172.21.15.22:0/309605141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804009ae0 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.781+0000 7f980b7fe700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 0x7f980c0b1cf0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00ec50 tx=0x7f97fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.782+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc009690 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.782+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00c850 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.782+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c0b0a00 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.782+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00cc10 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.782+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c0b2230 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.782+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c04c3c0 con 0x7f980c159c60 2023-10-08T00:31:48.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.784+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f97fc013470 con 0x7f980c159c60 2023-10-08T00:31:48.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.784+0000 7f9803fff700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97ec067320 0x7f97ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:48.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.784+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f97fc085640 con 0x7f980c159c60 2023-10-08T00:31:48.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.784+0000 7f980bfff700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97ec067320 0x7f97ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:48.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.785+0000 7f980bfff700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97ec067320 0x7f97ec0697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f97f4006f00 tx=0x7f97f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:48.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:48.787+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97fc052310 con 0x7f980c159c60 2023-10-08T00:31:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.007+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f980c06a5b0 con 0x7f97ec067320 2023-10-08T00:31:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.009+0000 7f9803fff700 1 -- 172.21.15.22:0/309605141 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f980c06a5b0 con 0x7f97ec067320 2023-10-08T00:31:49.009 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:31:49.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:49.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:31:49.010 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:49.010 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97ec067320 msgr2=0x7f97ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97ec067320 0x7f97ec0697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f97f4006f00 tx=0x7f97f4008040 comp rx=0 tx=0).stop 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 msgr2=0x7f980c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 0x7f980c0b1cf0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00ec50 tx=0x7f97fc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 shutdown_connections 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97ec067320 0x7f97ec0697d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f980c15db10 0x7f980c0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f980c159890 0x7f980c14f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 --2- 172.21.15.22:0/309605141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c159c60 0x7f980c0b1cf0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 >> 172.21.15.22:0/309605141 conn(0x7f980c068e20 msgr2=0x7f980c156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:49.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 shutdown_connections 2023-10-08T00:31:49.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.011+0000 7f9812582700 1 -- 172.21.15.22:0/309605141 wait complete. 2023-10-08T00:31:49.024 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:31:49.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.145+0000 7f2895c40700 1 Processor -- start 2023-10-08T00:31:49.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.145+0000 7f2895c40700 1 -- start start 2023-10-08T00:31:49.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2895c40700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2890153900 0x7f28900c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2895c40700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28900c9db0 0x7f289006a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2895c40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890157130 0x7f289006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2895c40700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289006e150 con 0x7f2890153900 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2895c40700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900c7800 con 0x7f28900c9db0 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2895c40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c7ae0 con 0x7f2890157130 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2894c3e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2890153900 0x7f28900c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2894c3e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2890153900 0x7f28900c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44388/0 (socket says 172.21.15.22:44388) 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2894c3e700 1 -- 172.21.15.22:0/3237808312 learned_addr learned my addr 172.21.15.22:0/3237808312 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f288ffff700 1 --2- 172.21.15.22:0/3237808312 >> v2:172.21.15.192:3300/0 conn(0x7f28900c9db0 0x7f289006a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f2894c3e700 1 -- 172.21.15.22:0/3237808312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890157130 msgr2=0x7f289006a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.146+0000 7f289543f700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890157130 0x7f289006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2894c3e700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890157130 0x7f289006a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2894c3e700 1 -- 172.21.15.22:0/3237808312 >> v2:172.21.15.192:3300/0 conn(0x7f28900c9db0 msgr2=0x7f289006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2894c3e700 1 --2- 172.21.15.22:0/3237808312 >> v2:172.21.15.192:3300/0 conn(0x7f28900c9db0 0x7f289006a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2894c3e700 1 -- 172.21.15.22:0/3237808312 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900c7dc0 con 0x7f2890153900 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f288ffff700 1 --2- 172.21.15.22:0/3237808312 >> v2:172.21.15.192:3300/0 conn(0x7f28900c9db0 0x7f289006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f289543f700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890157130 0x7f289006a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2894c3e700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890153900 0x7f28900c6f00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f28900aed40 tx=0x7f2880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c461721ca19d6f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f288f7fe700 1 -- 172.21.15.22:0/3237808312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000b860 con 0x7f2890153900 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f288f7fe700 1 -- 172.21.15.22:0/3237808312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000b9c0 con 0x7f2890153900 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f288f7fe700 1 -- 172.21.15.22:0/3237808312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000bd60 con 0x7f2890153900 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 -- 172.21.15.22:0/3237808312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890153900 msgr2=0x7f28900c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890153900 0x7f28900c6f00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f28900aed40 tx=0x7f2880009250 comp rx=0 tx=0).stop 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 -- 172.21.15.22:0/3237808312 shutdown_connections 2023-10-08T00:31:49.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890153900 0x7f28900c6f00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 --2- 172.21.15.22:0/3237808312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890157130 0x7f289006a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 --2- 172.21.15.22:0/3237808312 >> v2:172.21.15.192:3300/0 conn(0x7f28900c9db0 0x7f289006a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 -- 172.21.15.22:0/3237808312 >> 172.21.15.22:0/3237808312 conn(0x7f28900cc1e0 msgr2=0x7f28900cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 -- 172.21.15.22:0/3237808312 shutdown_connections 2023-10-08T00:31:49.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.147+0000 7f2895c40700 1 -- 172.21.15.22:0/3237808312 wait complete. 2023-10-08T00:31:49.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.149+0000 7f2895c40700 1 Processor -- start 2023-10-08T00:31:49.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.149+0000 7f2895c40700 1 -- start start 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.149+0000 7f2895c40700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28900c9db0 0x7f2890143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.149+0000 7f2895c40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890153900 0x7f28900ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.149+0000 7f2895c40700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 0x7f28900ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f2895c40700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c6030 con 0x7f2890157130 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f2895c40700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900ac050 con 0x7f28900c9db0 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f2895c40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900c5700 con 0x7f2890153900 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 0x7f28900ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 0x7f28900ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44400/0 (socket says 172.21.15.22:44400) 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 -- 172.21.15.22:0/3668855370 learned_addr learned my addr 172.21.15.22:0/3668855370 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f288ffff700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890153900 0x7f28900ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f2894c3e700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28900c9db0 0x7f2890143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 -- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890153900 msgr2=0x7f28900ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890153900 0x7f28900ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 -- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28900c9db0 msgr2=0x7f2890143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28900c9db0 0x7f2890143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 -- 172.21.15.22:0/3668855370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800094f0 con 0x7f2890157130 2023-10-08T00:31:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f289543f700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 0x7f28900ac890 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f288800a380 tx=0x7f2888007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800ae10 con 0x7f2890157130 2023-10-08T00:31:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800d650 con 0x7f2890157130 2023-10-08T00:31:49.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28900c59e0 con 0x7f2890157130 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800da10 con 0x7f2890157130 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.150+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28900ad070 con 0x7f2890157130 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.151+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289006bd40 con 0x7f2890157130 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.152+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f288801e3b0 con 0x7f2890157130 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.152+0000 7f288cff9700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2870067320 0x7f28700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.152+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f28880856c0 con 0x7f2890157130 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.152+0000 7f2894c3e700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2870067320 0x7f28700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.153+0000 7f2894c3e700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2870067320 0x7f28700697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f28900aed40 tx=0x7f2880017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.156+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2888052310 con 0x7f2890157130 2023-10-08T00:31:49.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.350+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f289006dd20 con 0x7f2890157130 2023-10-08T00:31:49.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.350+0000 7f288cff9700 1 -- 172.21.15.22:0/3668855370 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2888055930 con 0x7f2890157130 2023-10-08T00:31:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2870067320 msgr2=0x7f28700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2870067320 0x7f28700697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f28900aed40 tx=0x7f2880017000 comp rx=0 tx=0).stop 2023-10-08T00:31:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 msgr2=0x7f28900ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 0x7f28900ac890 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f288800a380 tx=0x7f2888007900 comp rx=0 tx=0).stop 2023-10-08T00:31:49.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 shutdown_connections 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2890157130 0x7f28900ac890 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28900c9db0 0x7f2890143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2870067320 0x7f28700697d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 --2- 172.21.15.22:0/3668855370 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2890153900 0x7f28900ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 >> 172.21.15.22:0/3668855370 conn(0x7f28900cc1e0 msgr2=0x7f289014d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 shutdown_connections 2023-10-08T00:31:49.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.352+0000 7f2895c40700 1 -- 172.21.15.22:0/3668855370 wait complete. 2023-10-08T00:31:49.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:31:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.484+0000 7fba0f1ba700 1 Processor -- start 2023-10-08T00:31:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.484+0000 7fba0f1ba700 1 -- start start 2023-10-08T00:31:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0f1ba700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba08159890 0x7fba0815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0f1ba700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba08159c60 0x7fba0815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0f1ba700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0815a160 con 0x7fba0815db10 2023-10-08T00:31:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0f1ba700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0815df50 con 0x7fba08159c60 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0f1ba700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba080d13a0 con 0x7fba08159890 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba07fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba08159c60 0x7fba0815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0d757700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fba0815db10 0x7fba08069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47090/0 (socket says 172.21.15.22:47090) 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0d757700 1 -- 172.21.15.22:0/1696592295 learned_addr learned my addr 172.21.15.22:0/1696592295 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.485+0000 7fba0cf56700 1 --2- 172.21.15.22:0/1696592295 >> v2:172.21.15.192:3300/0 conn(0x7fba08159890 0x7fba0815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba07fff700 1 -- 172.21.15.22:0/1696592295 >> v2:172.21.15.192:3300/0 conn(0x7fba08159890 msgr2=0x7fba0815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba07fff700 1 --2- 172.21.15.22:0/1696592295 >> v2:172.21.15.192:3300/0 conn(0x7fba08159890 0x7fba0815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba07fff700 1 -- 172.21.15.22:0/1696592295 >> v1:172.21.15.22:6789/0 conn(0x7fba0815db10 legacy=0x7fba08069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba07fff700 1 -- 172.21.15.22:0/1696592295 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0815e140 con 0x7fba08159c60 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba077fe700 1 -- 172.21.15.22:0/1696592295 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837859659 0 0) 0x7fba0815a160 con 0x7fba0815db10 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba07fff700 1 --2- 172.21.15.22:0/1696592295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0815d5d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fba080d1090 tx=0x7fb9f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23297dc7655bd7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba077fe700 1 -- 172.21.15.22:0/1696592295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800e070 con 0x7fba08159c60 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba077fe700 1 -- 172.21.15.22:0/1696592295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f800bb60 con 0x7fba08159c60 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba077fe700 1 -- 172.21.15.22:0/1696592295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8012430 con 0x7fba08159c60 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba0f1ba700 1 -- 172.21.15.22:0/1696592295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 msgr2=0x7fba0815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/1696592295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0815d5d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fba080d1090 tx=0x7fb9f8009780 comp rx=0 tx=0).stop 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba0f1ba700 1 -- 172.21.15.22:0/1696592295 shutdown_connections 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/1696592295 >> v2:172.21.15.192:3300/0 conn(0x7fba08159890 0x7fba0815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/1696592295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0815d5d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.486+0000 7fba0f1ba700 1 -- 172.21.15.22:0/1696592295 >> 172.21.15.22:0/1696592295 conn(0x7fba08068e20 msgr2=0x7fba080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.487+0000 7fba0f1ba700 1 -- 172.21.15.22:0/1696592295 shutdown_connections 2023-10-08T00:31:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.487+0000 7fba0f1ba700 1 -- 172.21.15.22:0/1696592295 wait complete. 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.488+0000 7fba0f1ba700 1 Processor -- start 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.488+0000 7fba0f1ba700 1 -- start start 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba08159890 0x7fba080cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0814d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0815db10 0x7fba08152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08151ff0 con 0x7fba08159c60 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba080cdc20 con 0x7fba0815db10 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba080cdec0 con 0x7fba08159890 2023-10-08T00:31:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0814d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0814d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44410/0 (socket says 172.21.15.22:44410) 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 -- 172.21.15.22:0/779549521 learned_addr learned my addr 172.21.15.22:0/779549521 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0d757700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0815db10 0x7fba08152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0cf56700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba08159890 0x7fba080cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 -- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba08159890 msgr2=0x7fba080cec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba08159890 0x7fba080cec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 -- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0815db10 msgr2=0x7fba08152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0815db10 0x7fba08152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 -- 172.21.15.22:0/779549521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8009a20 con 0x7fba08159c60 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0d757700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0815db10 0x7fba08152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0cf56700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba08159890 0x7fba080cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba07fff700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0814d460 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009fd0 tx=0x7fb9f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8012df0 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8027470 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba08152e50 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8027830 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.489+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba080ce720 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.490+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba080ce080 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.491+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb9f8024070 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.491+0000 7fba04ff9700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9e8067320 0x7fb9e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.491+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb9f8087660 con 0x7fba08159c60 2023-10-08T00:31:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.491+0000 7fba0cf56700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9e8067320 0x7fb9e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.492+0000 7fba0cf56700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9e8067320 0x7fb9e80697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0006f00 tx=0x7fb9f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.496+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba080ce080 con 0x7fba08159c60 2023-10-08T00:31:49.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.718+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fba080ce080 con 0x7fb9e8067320 2023-10-08T00:31:49.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.720+0000 7fba04ff9700 1 -- 172.21.15.22:0/779549521 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fba080ce080 con 0x7fb9e8067320 2023-10-08T00:31:49.720 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:31:49.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:49.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:31:49.721 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:31:49.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9e8067320 msgr2=0x7fb9e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9e8067320 0x7fb9e80697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0006f00 tx=0x7fb9f0008040 comp rx=0 tx=0).stop 2023-10-08T00:31:49.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 msgr2=0x7fba0814d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0814d460 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009fd0 tx=0x7fb9f8019000 comp rx=0 tx=0).stop 2023-10-08T00:31:49.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 shutdown_connections 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba0815db10 0x7fba08152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9e8067320 0x7fb9e80697d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba08159890 0x7fba080cec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 --2- 172.21.15.22:0/779549521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba08159c60 0x7fba0814d460 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 >> 172.21.15.22:0/779549521 conn(0x7fba08068e20 msgr2=0x7fba08069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 shutdown_connections 2023-10-08T00:31:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.722+0000 7fba0f1ba700 1 -- 172.21.15.22:0/779549521 wait complete. 2023-10-08T00:31:49.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000825526 2023-10-08T00:31:49.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.856+0000 7f1291488700 1 Processor -- start 2023-10-08T00:31:49.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.856+0000 7f1291488700 1 -- start start 2023-10-08T00:31:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f1291488700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f128c159c60 0x7f128c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f1291488700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 0x7f128c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f1291488700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128c15a160 con 0x7f128c159890 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f1291488700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128c15df50 con 0x7f128c159c60 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f1291488700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0d13a0 con 0x7f128c15db10 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 0x7f128c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128a7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f128c159c60 0x7f128c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 0x7f128c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:41824/0 (socket says 172.21.15.22:41824) 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128a7fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f128c159c60 0x7f128c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:36048/0 (socket says 172.21.15.22:36048) 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128b7fe700 1 -- 172.21.15.22:0/3534173982 learned_addr learned my addr 172.21.15.22:0/3534173982 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128affd700 1 --1- 172.21.15.22:0/3534173982 >> v1:172.21.15.192:6789/0 conn(0x7f128c159890 0x7f128c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:59096/0 (socket says 172.21.15.22:59096) 2023-10-08T00:31:49.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128a7fc700 1 -- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 msgr2=0x7f128c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.857+0000 7f128a7fc700 1 --2- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 0x7f128c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f128a7fc700 1 -- 172.21.15.22:0/3534173982 >> v1:172.21.15.192:6789/0 conn(0x7f128c159890 legacy=0x7f128c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f128a7fc700 1 -- 172.21.15.22:0/3534173982 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c15e140 con 0x7f128c159c60 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1289ffb700 1 -- 172.21.15.22:0/3534173982 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816382282 0 0) 0x7f128c15a160 con 0x7f128c159890 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f128b7fe700 1 --2- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 0x7f128c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f128a7fc700 1 --2- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c159c60 0x7f128c15d5d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f12740098e0 tx=0x7f12740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7750bca64de17e43 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1289ffb700 1 -- 172.21.15.22:0/3534173982 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400b640 con 0x7f128c159c60 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1289ffb700 1 -- 172.21.15.22:0/3534173982 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400b7a0 con 0x7f128c159c60 2023-10-08T00:31:49.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1289ffb700 1 -- 172.21.15.22:0/3534173982 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bb40 con 0x7f128c159c60 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1291488700 1 -- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c159c60 msgr2=0x7f128c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1291488700 1 --2- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c159c60 0x7f128c15d5d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f12740098e0 tx=0x7f12740091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1291488700 1 -- 172.21.15.22:0/3534173982 shutdown_connections 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1291488700 1 --2- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c15db10 0x7f128c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1291488700 1 --2- 172.21.15.22:0/3534173982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c159c60 0x7f128c15d5d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.858+0000 7f1291488700 1 -- 172.21.15.22:0/3534173982 >> 172.21.15.22:0/3534173982 conn(0x7f128c068e20 msgr2=0x7f128c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.859+0000 7f1291488700 1 -- 172.21.15.22:0/3534173982 shutdown_connections 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.859+0000 7f1291488700 1 -- 172.21.15.22:0/3534173982 wait complete. 2023-10-08T00:31:49.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 Processor -- start 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 -- start start 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 0x7f128c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c159c60 0x7f128c14c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c15db10 0x7f128c14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c14d770 con 0x7f128c159890 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c0b09e0 con 0x7f128c15db10 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.860+0000 7f1291488700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128c14ced0 con 0x7f128c159c60 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 0x7f128c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 0x7f128c14b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44416/0 (socket says 172.21.15.22:44416) 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 -- 172.21.15.22:0/1421564542 learned_addr learned my addr 172.21.15.22:0/1421564542 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 -- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c159c60 msgr2=0x7f128c14c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128b7fe700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c15db10 0x7f128c14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128a7fc700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c159c60 0x7f128c14c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c159c60 0x7f128c14c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 -- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c15db10 msgr2=0x7f128c14c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c15db10 0x7f128c14c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 -- 172.21.15.22:0/1421564542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0094f0 con 0x7f128c159890 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128b7fe700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c15db10 0x7f128c14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128a7fc700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c159c60 0x7f128c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f128affd700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 0x7f128c14b5f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f128400cd30 tx=0x7f1284001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284005df0 con 0x7f128c159890 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128400a960 con 0x7f128c159890 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128400ad20 con 0x7f128c159890 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1274009420 con 0x7f128c159890 2023-10-08T00:31:49.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.861+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c14d490 con 0x7f128c159890 2023-10-08T00:31:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.862+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c04c3c0 con 0x7f128c159890 2023-10-08T00:31:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.863+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1284007300 con 0x7f128c159890 2023-10-08T00:31:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.863+0000 7f1282ffd700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f126c067320 0x7f126c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:49.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.863+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1284084e40 con 0x7f128c159890 2023-10-08T00:31:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.863+0000 7f128a7fc700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f126c067320 0x7f126c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.864+0000 7f128a7fc700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f126c067320 0x7f126c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f128c156f40 tx=0x7f1274017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:49.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:49.867+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1284051b10 con 0x7f128c159890 2023-10-08T00:31:50.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:50.089+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000825526", "target": ["mon-mgr", ""]}) v1 -- 0x7f128c15a6a0 con 0x7f126c067320 2023-10-08T00:31:52.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.681+0000 7f1282ffd700 1 -- 172.21.15.22:0/1421564542 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f128c15a6a0 con 0x7f126c067320 2023-10-08T00:31:52.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f126c067320 msgr2=0x7f126c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f126c067320 0x7f126c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f128c156f40 tx=0x7f1274017000 comp rx=0 tx=0).stop 2023-10-08T00:31:52.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 msgr2=0x7f128c14b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 0x7f128c14b5f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f128400cd30 tx=0x7f1284001af0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 shutdown_connections 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f128c15db10 0x7f128c14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f128c159890 0x7f128c14b5f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f126c067320 0x7f126c0697d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 --2- 172.21.15.22:0/1421564542 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f128c159c60 0x7f128c14c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.689+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 >> 172.21.15.22:0/1421564542 conn(0x7f128c068e20 msgr2=0x7f128c15fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:52.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.690+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 shutdown_connections 2023-10-08T00:31:52.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.690+0000 7f1291488700 1 -- 172.21.15.22:0/1421564542 wait complete. 2023-10-08T00:31:52.695 INFO:teuthology.orchestra.run.smithi022.stderr:Volume created successfully (no MDS daemons created) 2023-10-08T00:31:52.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000825527 2023-10-08T00:31:52.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.834+0000 7f7efecbd700 1 Processor -- start 2023-10-08T00:31:52.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.834+0000 7f7efecbd700 1 -- start start 2023-10-08T00:31:52.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efecbd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159890 0x7f7ef815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efecbd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef815a160 con 0x7f7ef8069560 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efecbd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80d13a0 con 0x7f7ef8159c60 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efecbd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef815e140 con 0x7f7ef8159890 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efd25a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7ef8069560 0x7f7ef80ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47092/0 (socket says 172.21.15.22:47092) 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efd25a700 1 -- 172.21.15.22:0/1827047090 learned_addr learned my addr 172.21.15.22:0/1827047090 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efca59700 1 --2- 172.21.15.22:0/1827047090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159890 0x7f7ef815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301495976 0 0) 0x7f7ef815a160 con 0x7f7ef8069560 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee4003570 con 0x7f7ef8069560 2023-10-08T00:31:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028202681 0 0) 0x7f7ef80d13a0 con 0x7f7ef8159c60 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef815a160 con 0x7f7ef8159c60 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efca59700 1 -- 172.21.15.22:0/1827047090 >> v1:172.21.15.192:6789/0 conn(0x7f7ef8159c60 legacy=0x7f7ef815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efca59700 1 -- 172.21.15.22:0/1827047090 >> v1:172.21.15.22:6789/0 conn(0x7f7ef8069560 legacy=0x7f7ef80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.835+0000 7f7efca59700 1 -- 172.21.15.22:0/1827047090 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef815a3d0 con 0x7f7ef8159890 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efca59700 1 --2- 172.21.15.22:0/1827047090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159890 0x7f7ef815abd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009910 tx=0x7f7ee00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ddd856bdd502bb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011630 con 0x7f7ef8159890 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0011790 con 0x7f7ef8159890 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7ef77fe700 1 -- 172.21.15.22:0/1827047090 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0011b30 con 0x7f7ef8159890 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 -- 172.21.15.22:0/1827047090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159890 msgr2=0x7f7ef815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 --2- 172.21.15.22:0/1827047090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159890 0x7f7ef815abd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009910 tx=0x7f7ee00091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 -- 172.21.15.22:0/1827047090 shutdown_connections 2023-10-08T00:31:52.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 --2- 172.21.15.22:0/1827047090 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159890 0x7f7ef815abd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 -- 172.21.15.22:0/1827047090 >> 172.21.15.22:0/1827047090 conn(0x7f7ef8068e20 msgr2=0x7f7ef80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:52.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 -- 172.21.15.22:0/1827047090 shutdown_connections 2023-10-08T00:31:52.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.836+0000 7f7efecbd700 1 -- 172.21.15.22:0/1827047090 wait complete. 2023-10-08T00:31:52.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.837+0000 7f7efecbd700 1 Processor -- start 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 -- start start 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef8069560 0x7f7ef8169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 0x7f7ef816a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159c60 0x7f7ef80b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef816ae30 con 0x7f7ef8159890 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80b3fe0 con 0x7f7ef8069560 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7efecbd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80b42c0 con 0x7f7ef8159c60 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7ef7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 0x7f7ef816a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:52.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7ef7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 0x7f7ef816a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44418/0 (socket says 172.21.15.22:44418) 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.838+0000 7f7ef7fff700 1 -- 172.21.15.22:0/3947358216 learned_addr learned my addr 172.21.15.22:0/3947358216 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7efca59700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef8069560 0x7f7ef8169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7efd25a700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159c60 0x7f7ef80b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef7fff700 1 -- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159c60 msgr2=0x7f7ef80b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef7fff700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159c60 0x7f7ef80b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef7fff700 1 -- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef8069560 msgr2=0x7f7ef8169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef7fff700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef8069560 0x7f7ef8169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef7fff700 1 -- 172.21.15.22:0/3947358216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009420 con 0x7f7ef8159890 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef7fff700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 0x7f7ef816a8f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800c590 tx=0x7f7ee8007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:52.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8010510 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8010690 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef80b45a0 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8010a50 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.839+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef80b3ca0 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.840+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef804c3c0 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.841+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7ee8012440 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.841+0000 7f7ef4ff9700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed8067320 0x7f7ed80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.841+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6661+0+0 (secure 0 0 0) 0x7f7ee80844b0 con 0x7f7ef8159890 2023-10-08T00:31:52.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.841+0000 7f7efca59700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed8067320 0x7f7ed80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:52.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.842+0000 7f7efca59700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed8067320 0x7f7ed80697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7ef815e070 tx=0x7f7ee0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:52.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:52.846+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ee804b5a0 con 0x7f7ef8159890 2023-10-08T00:31:53.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:53.064+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000825527", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ef806a5b0 con 0x7f7ed8067320 2023-10-08T00:31:55.633 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:31:55.632+0000 7f9aca068700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:31:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.677+0000 7f7ef4ff9700 1 -- 172.21.15.22:0/3947358216 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f7ef806a5b0 con 0x7f7ed8067320 2023-10-08T00:31:55.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed8067320 msgr2=0x7f7ed80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed8067320 0x7f7ed80697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7ef815e070 tx=0x7f7ee0017000 comp rx=0 tx=0).stop 2023-10-08T00:31:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 msgr2=0x7f7ef816a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 0x7f7ef816a8f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800c590 tx=0x7f7ee8007de0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 shutdown_connections 2023-10-08T00:31:55.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7ed8067320 0x7f7ed80697d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ef8159c60 0x7f7ef80b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ef8069560 0x7f7ef8169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 --2- 172.21.15.22:0/3947358216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef8159890 0x7f7ef816a8f0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 >> 172.21.15.22:0/3947358216 conn(0x7f7ef8068e20 msgr2=0x7f7ef815bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 shutdown_connections 2023-10-08T00:31:55.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.681+0000 7f7efecbd700 1 -- 172.21.15.22:0/3947358216 wait complete. 2023-10-08T00:31:55.685 INFO:teuthology.orchestra.run.smithi022.stderr:Volume created successfully (no MDS daemons created) 2023-10-08T00:31:55.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:31:55.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 Processor -- start 2023-10-08T00:31:55.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 -- start start 2023-10-08T00:31:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f140806bcd0 0x7f14080caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f140815df50 0x7f140815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140815d7e0 con 0x7f140806c0a0 2023-10-08T00:31:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140815dac0 con 0x7f140806bcd0 2023-10-08T00:31:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.831+0000 7f140ec16700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140815aa30 con 0x7f140815df50 2023-10-08T00:31:55.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140c9b2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f140806bcd0 0x7f14080caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f1407fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f140806c0a0 0x7f140815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47102/0 (socket says 172.21.15.22:47102) 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f1407fff700 1 -- 172.21.15.22:0/4162058257 learned_addr learned my addr 172.21.15.22:0/4162058257 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140d1b3700 1 --2- 172.21.15.22:0/4162058257 >> v2:172.21.15.192:3300/0 conn(0x7f140815df50 0x7f140815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140c9b2700 1 -- 172.21.15.22:0/4162058257 >> v2:172.21.15.192:3300/0 conn(0x7f140815df50 msgr2=0x7f140815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140c9b2700 1 --2- 172.21.15.22:0/4162058257 >> v2:172.21.15.192:3300/0 conn(0x7f140815df50 0x7f140815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140c9b2700 1 -- 172.21.15.22:0/4162058257 >> v1:172.21.15.22:6789/0 conn(0x7f140806c0a0 legacy=0x7f140815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140c9b2700 1 -- 172.21.15.22:0/4162058257 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140815ad10 con 0x7f140806bcd0 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f14077fe700 1 -- 172.21.15.22:0/4162058257 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646603175 0 0) 0x7f140815d7e0 con 0x7f140806c0a0 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140d1b3700 1 --2- 172.21.15.22:0/4162058257 >> v2:172.21.15.192:3300/0 conn(0x7f140815df50 0x7f140815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f140c9b2700 1 --2- 172.21.15.22:0/4162058257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080caa90 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f140815d720 tx=0x7f13fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84aac5673c631866 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:55.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f14077fe700 1 -- 172.21.15.22:0/4162058257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00b6b0 con 0x7f140806bcd0 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f14077fe700 1 -- 172.21.15.22:0/4162058257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00b810 con 0x7f140806bcd0 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.832+0000 7f14077fe700 1 -- 172.21.15.22:0/4162058257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00bbb0 con 0x7f140806bcd0 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 -- 172.21.15.22:0/4162058257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 msgr2=0x7f14080caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 --2- 172.21.15.22:0/4162058257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080caa90 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f140815d720 tx=0x7f13fc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 -- 172.21.15.22:0/4162058257 shutdown_connections 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 --2- 172.21.15.22:0/4162058257 >> v2:172.21.15.192:3300/0 conn(0x7f140815df50 0x7f140815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 --2- 172.21.15.22:0/4162058257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080caa90 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 -- 172.21.15.22:0/4162058257 >> 172.21.15.22:0/4162058257 conn(0x7f14080ce600 msgr2=0x7f14080cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 -- 172.21.15.22:0/4162058257 shutdown_connections 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.833+0000 7f140ec16700 1 -- 172.21.15.22:0/4162058257 wait complete. 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.834+0000 7f140ec16700 1 Processor -- start 2023-10-08T00:31:55.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.834+0000 7f140ec16700 1 -- start start 2023-10-08T00:31:55.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140ec16700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:55.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140ec16700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f140806c0a0 0x7f1408156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:55.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140ec16700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f140815df50 0x7f14081539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:55.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140ec16700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408158700 con 0x7f140806bcd0 2023-10-08T00:31:55.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140ec16700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408156650 con 0x7f140806c0a0 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140ec16700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140816e2d0 con 0x7f140815df50 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44440/0 (socket says 172.21.15.22:44440) 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 -- 172.21.15.22:0/4264357400 learned_addr learned my addr 172.21.15.22:0/4264357400 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f1407fff700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f140806c0a0 0x7f1408156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140d1b3700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f140815df50 0x7f14081539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 -- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f140815df50 msgr2=0x7f14081539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f140815df50 0x7f14081539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 -- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f140806c0a0 msgr2=0x7f1408156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f140806c0a0 0x7f1408156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 -- 172.21.15.22:0/4264357400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc009420 con 0x7f140806bcd0 2023-10-08T00:31:55.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140d1b3700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f140815df50 0x7f14081539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:31:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.835+0000 7f140c9b2700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080b4010 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1408069220 tx=0x7f13fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.836+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00b980 con 0x7f140806bcd0 2023-10-08T00:31:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.836+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00bb00 con 0x7f140806bcd0 2023-10-08T00:31:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.836+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1408157dd0 con 0x7f140806bcd0 2023-10-08T00:31:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.836+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc025670 con 0x7f140806bcd0 2023-10-08T00:31:55.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.836+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1408158390 con 0x7f140806bcd0 2023-10-08T00:31:55.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.837+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140804c3c0 con 0x7f140806bcd0 2023-10-08T00:31:55.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.837+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f13fc023070 con 0x7f140806bcd0 2023-10-08T00:31:55.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.838+0000 7f1404ff9700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f13ec067320 0x7f13ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:55.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.838+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 7559+0+0 (secure 0 0 0) 0x7f13fc086870 con 0x7f140806bcd0 2023-10-08T00:31:55.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.838+0000 7f1407fff700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f13ec067320 0x7f13ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:55.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.838+0000 7f1407fff700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f13ec067320 0x7f13ec0697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1408155670 tx=0x7f13f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:55.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:55.842+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13fc052dc0 con 0x7f140806bcd0 2023-10-08T00:31:56.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.061+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1408158840 con 0x7f13ec067320 2023-10-08T00:31:56.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.062+0000 7f1404ff9700 1 -- 172.21.15.22:0/4264357400 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+151 (secure 0 0 0) 0x7f13f400cd90 con 0x7f13ec067320 2023-10-08T00:31:56.063 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:31:56.063 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:56.063 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volume_0000000000825526" 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volume_0000000000825527" 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:31:56.064 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:31:56.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f13ec067320 msgr2=0x7f13ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f13ec067320 0x7f13ec0697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1408155670 tx=0x7f13f4009040 comp rx=0 tx=0).stop 2023-10-08T00:31:56.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 msgr2=0x7f14080b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080b4010 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1408069220 tx=0x7f13fc017000 comp rx=0 tx=0).stop 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 shutdown_connections 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f13ec067320 0x7f13ec0697d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f140815df50 0x7f14081539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f140806bcd0 0x7f14080b4010 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 --2- 172.21.15.22:0/4264357400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f140806c0a0 0x7f1408156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 >> 172.21.15.22:0/4264357400 conn(0x7f14080ce600 msgr2=0x7f140815cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 shutdown_connections 2023-10-08T00:31:56.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.064+0000 7f140ec16700 1 -- 172.21.15.22:0/4264357400 wait complete. 2023-10-08T00:31:56.078 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000825526 --yes-i-really-mean-it 2023-10-08T00:31:56.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.200+0000 7fbdab238700 1 Processor -- start 2023-10-08T00:31:56.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.200+0000 7fbdab238700 1 -- start start 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbdab238700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 0x7fbda415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbdab238700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda415a160 con 0x7fbda4069560 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbdab238700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40d13a0 con 0x7fbda4159c60 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbdab238700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda415e140 con 0x7fbda4159890 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda97d5700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbda4069560 0x7fbda40ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47110/0 (socket says 172.21.15.22:47110) 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda97d5700 1 -- 172.21.15.22:0/3545709653 learned_addr learned my addr 172.21.15.22:0/3545709653 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022177065 0 0) 0x7fbda415a160 con 0x7fbda4069560 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd90003570 con 0x7fbda4069560 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 0x7fbda415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 51434482 0 0) 0x7fbd90003570 con 0x7fbda4069560 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 msgr2=0x7fbda415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 0x7fbda415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 >> v1:172.21.15.192:6789/0 conn(0x7fbda4159c60 legacy=0x7fbda415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda415a3d0 con 0x7fbda4069560 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fbd9c0017f0 con 0x7fbda4069560 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 >> v1:172.21.15.22:6789/0 conn(0x7fbda4069560 legacy=0x7fbda40ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd90003a90 0x7fbd90003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 0x7fbd90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90004d50 0x7fbd900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda415e140 con 0x7fbd90003a90 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9000bb70 con 0x7fbd90004d50 2023-10-08T00:31:56.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.201+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9000bd30 con 0x7fbda4159890 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd90003a90 0x7fbd90003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda97d5700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90004d50 0x7fbd900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda3fff700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 0x7fbd90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 -- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 msgr2=0x7fbd90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda4159890 0x7fbd90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 -- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90004d50 msgr2=0x7fbd900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90004d50 0x7fbd900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 -- 172.21.15.22:0/3545709653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90003570 con 0x7fbd90003a90 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda97d5700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90004d50 0x7fbd900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd90003a90 0x7fbd90003ea0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009c00 tx=0x7fbd940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7d701d0aa5593c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:56.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400e710 con 0x7fbd90003a90 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9400e870 con 0x7fbd90003a90 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.202+0000 7fbda37fe700 1 -- 172.21.15.22:0/3545709653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400ec30 con 0x7fbd90003a90 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbdab238700 1 -- 172.21.15.22:0/3545709653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd90003a90 msgr2=0x7fbd90003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbdab238700 1 --2- 172.21.15.22:0/3545709653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd90003a90 0x7fbd90003ea0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009c00 tx=0x7fbd940091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbda97d5700 1 -- 172.21.15.22:0/3545709653 reap_dead start 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbdab238700 1 -- 172.21.15.22:0/3545709653 shutdown_connections 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbdab238700 1 -- 172.21.15.22:0/3545709653 >> 172.21.15.22:0/3545709653 conn(0x7fbda4068e20 msgr2=0x7fbda40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbdab238700 1 -- 172.21.15.22:0/3545709653 shutdown_connections 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.203+0000 7fbdab238700 1 -- 172.21.15.22:0/3545709653 wait complete. 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.204+0000 7fbdab238700 1 Processor -- start 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.204+0000 7fbdab238700 1 -- start start 2023-10-08T00:31:56.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbdab238700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90003a90 0x7fbda40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbdab238700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda40ca4e0 0x7fbda4169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbdab238700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 0x7fbda40cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbdab238700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40c85d0 con 0x7fbda416a4a0 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbdab238700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40c82a0 con 0x7fbd90003a90 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbdab238700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda416a930 con 0x7fbda40ca4e0 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 0x7fbda40cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 0x7fbda40cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44458/0 (socket says 172.21.15.22:44458) 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 -- 172.21.15.22:0/1498601283 learned_addr learned my addr 172.21.15.22:0/1498601283 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90003a90 0x7fbda40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda3fff700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda40ca4e0 0x7fbda4169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 -- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda40ca4e0 msgr2=0x7fbda4169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda40ca4e0 0x7fbda4169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 -- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90003a90 msgr2=0x7fbda40cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90003a90 0x7fbda40cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 -- 172.21.15.22:0/1498601283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda416ac10 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.205+0000 7fbda97d5700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 0x7fbda40cf430 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c001370 tx=0x7fbd9c002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.206+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00eb10 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.206+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00ec90 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.206+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda416aef0 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.206+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c013420 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.206+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda40cf970 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.207+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda404c3c0 con 0x7fbda416a4a0 2023-10-08T00:31:56.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.207+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbd9c013790 con 0x7fbda416a4a0 2023-10-08T00:31:56.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.207+0000 7fbda0ff9700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbd84067320 0x7fbd840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:56.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.208+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 7559+0+0 (secure 0 0 0) 0x7fbd9c0859b0 con 0x7fbda416a4a0 2023-10-08T00:31:56.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.208+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbd84067320 0x7fbd840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:56.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.208+0000 7fbda8fd4700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbd84067320 0x7fbd840697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbd940091e0 tx=0x7fbd9401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:56.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.212+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd9c051f00 con 0x7fbda416a4a0 2023-10-08T00:31:56.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:56.435+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000825526", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fbda40c8710 con 0x7fbd84067320 2023-10-08T00:31:56.440 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:31:56.439+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:31:56.445 INFO:tasks.ceph.mds.a.smithi022.stderr: -37> 2023-10-08T00:31:55.632+0000 7f9aca068700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:31:56.464 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:31:59.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.482+0000 7fbda0ff9700 1 -- 172.21.15.22:0/1498601283 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fbda40c8710 con 0x7fbd84067320 2023-10-08T00:31:59.486 INFO:teuthology.orchestra.run.smithi022.stdout:metadata pool: cephfs.volume_0000000000825526.meta data pool: ['cephfs.volume_0000000000825526.data'] removed 2023-10-08T00:31:59.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbd84067320 msgr2=0x7fbd840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:59.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbd84067320 0x7fbd840697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbd940091e0 tx=0x7fbd9401a000 comp rx=0 tx=0).stop 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 msgr2=0x7fbda40cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 0x7fbda40cf430 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c001370 tx=0x7fbd9c002160 comp rx=0 tx=0).stop 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 shutdown_connections 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbda416a4a0 0x7fbda40cf430 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd90003a90 0x7fbda40cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbd84067320 0x7fbd840697d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 --2- 172.21.15.22:0/1498601283 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbda40ca4e0 0x7fbda4169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.486+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 >> 172.21.15.22:0/1498601283 conn(0x7fbda4068e20 msgr2=0x7fbda415cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.487+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 shutdown_connections 2023-10-08T00:31:59.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.487+0000 7fbdab238700 1 -- 172.21.15.22:0/1498601283 wait complete. 2023-10-08T00:31:59.502 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000825527 --yes-i-really-mean-it 2023-10-08T00:31:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.630+0000 7f906f59e700 1 Processor -- start 2023-10-08T00:31:59.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.630+0000 7f906f59e700 1 -- start start 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.631+0000 7f906f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90700b4e70 0x7f90700ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.631+0000 7f906f59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90700b16d0 0x7f90700b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906f59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700b2080 con 0x7f907015d240 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906f59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90700cfb00 con 0x7f90700b16d0 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90700b5c40 con 0x7f90700b4e70 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906dd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90700b16d0 0x7f90700b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906ed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f907015d240 0x7f907015d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51222/0 (socket says 172.21.15.22:51222) 2023-10-08T00:31:59.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906ed9d700 1 -- 172.21.15.22:0/1755789248 learned_addr learned my addr 172.21.15.22:0/1755789248 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906e59c700 1 --2- 172.21.15.22:0/1755789248 >> v2:172.21.15.192:3300/0 conn(0x7f90700b4e70 0x7f90700ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906dd9b700 1 -- 172.21.15.22:0/1755789248 >> v2:172.21.15.192:3300/0 conn(0x7f90700b4e70 msgr2=0x7f90700ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906dd9b700 1 --2- 172.21.15.22:0/1755789248 >> v2:172.21.15.192:3300/0 conn(0x7f90700b4e70 0x7f90700ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906dd9b700 1 -- 172.21.15.22:0/1755789248 >> v1:172.21.15.22:6789/0 conn(0x7f907015d240 legacy=0x7f907015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906dd9b700 1 -- 172.21.15.22:0/1755789248 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90700b5f20 con 0x7f90700b16d0 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906d59a700 1 -- 172.21.15.22:0/1755789248 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191660733 0 0) 0x7f90700b2080 con 0x7f907015d240 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906dd9b700 1 --2- 172.21.15.22:0/1755789248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90700b16d0 0x7f90700b1b40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9070064910 tx=0x7f90640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4df7f5b26d5358 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906d59a700 1 -- 172.21.15.22:0/1755789248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064011630 con 0x7f90700b16d0 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906d59a700 1 -- 172.21.15.22:0/1755789248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064011790 con 0x7f90700b16d0 2023-10-08T00:31:59.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.632+0000 7f906d59a700 1 -- 172.21.15.22:0/1755789248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064011b30 con 0x7f90700b16d0 2023-10-08T00:31:59.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 -- 172.21.15.22:0/1755789248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90700b16d0 msgr2=0x7f90700b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:59.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 --2- 172.21.15.22:0/1755789248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90700b16d0 0x7f90700b1b40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9070064910 tx=0x7f90640091a0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 -- 172.21.15.22:0/1755789248 shutdown_connections 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 --2- 172.21.15.22:0/1755789248 >> v2:172.21.15.192:3300/0 conn(0x7f90700b4e70 0x7f90700ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 --2- 172.21.15.22:0/1755789248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90700b16d0 0x7f90700b1b40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 -- 172.21.15.22:0/1755789248 >> 172.21.15.22:0/1755789248 conn(0x7f90700d10c0 msgr2=0x7f90700affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 -- 172.21.15.22:0/1755789248 shutdown_connections 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.633+0000 7f906f59e700 1 -- 172.21.15.22:0/1755789248 wait complete. 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.634+0000 7f906f59e700 1 Processor -- start 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.634+0000 7f906f59e700 1 -- start start 2023-10-08T00:31:59.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90700b16d0 0x7f90700c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90700b4e70 0x7f9070169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 0x7f907015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906f59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907016ac80 con 0x7f907015d240 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907016d750 con 0x7f90700b16d0 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907016a6c0 con 0x7f90700b4e70 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 0x7f907015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 0x7f907015e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37596/0 (socket says 172.21.15.22:37596) 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 -- 172.21.15.22:0/1998028354 learned_addr learned my addr 172.21.15.22:0/1998028354 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906e59c700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90700b16d0 0x7f90700c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906dd9b700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90700b4e70 0x7f9070169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:59.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 -- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90700b4e70 msgr2=0x7f9070169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90700b4e70 0x7f9070169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 -- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90700b16d0 msgr2=0x7f90700c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90700b16d0 0x7f90700c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.635+0000 7f906ed9d700 1 -- 172.21.15.22:0/1998028354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064009420 con 0x7f907015d240 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.636+0000 7f906ed9d700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 0x7f907015e630 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f906800cbf0 tx=0x7f90680019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.636+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800a8b0 con 0x7f907015d240 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.636+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906800aa10 con 0x7f907015d240 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.636+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907016a9a0 con 0x7f907015d240 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.636+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800add0 con 0x7f907015d240 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.636+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90700c86f0 con 0x7f907015d240 2023-10-08T00:31:59.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.637+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907016d240 con 0x7f907015d240 2023-10-08T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.637+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9068007300 con 0x7f907015d240 2023-10-08T00:31:59.641 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.637+0000 7f905e7fc700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9050067320 0x7f90500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.638+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6747+0+0 (secure 0 0 0) 0x7f90680852f0 con 0x7f907015d240 2023-10-08T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.638+0000 7f906e59c700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9050067320 0x7f90500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:31:59.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.638+0000 7f906e59c700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9050067320 0x7f90500697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9060009db0 tx=0x7f90600091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:31:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.642+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f907016d240 con 0x7f907015d240 2023-10-08T00:31:59.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:31:59.863+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000825527", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f907016d240 con 0x7f9050067320 2023-10-08T00:31:59.868 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:31:59.868+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:31:59.900 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:32:01.869 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:32:01.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:32:02.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.883+0000 7f905e7fc700 1 -- 172.21.15.22:0/1998028354 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7f907016d240 con 0x7f9050067320 2023-10-08T00:32:02.884 INFO:teuthology.orchestra.run.smithi022.stdout:metadata pool: cephfs.volume_0000000000825527.meta data pool: ['cephfs.volume_0000000000825527.data'] removed 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9050067320 msgr2=0x7f90500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9050067320 0x7f90500697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9060009db0 tx=0x7f90600091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 msgr2=0x7f907015e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 0x7f907015e630 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f906800cbf0 tx=0x7f90680019b0 comp rx=0 tx=0).stop 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 shutdown_connections 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f907015d240 0x7f907015e630 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90700b16d0 0x7f90700c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9050067320 0x7f90500697d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 --2- 172.21.15.22:0/1998028354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90700b4e70 0x7f9070169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:02.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 >> 172.21.15.22:0/1998028354 conn(0x7f90700d10c0 msgr2=0x7f90700b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:02.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 shutdown_connections 2023-10-08T00:32:02.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:02.888+0000 7f906f59e700 1 -- 172.21.15.22:0/1998028354 wait complete. 2023-10-08T00:32:02.903 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:32:02.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:02.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:02.994 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:32:02.994 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:32:02.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:32:02.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:03.044 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:32:03.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:03.044 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:32:03.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:32:03.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:32:03.061 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:03.107 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:32:03.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:03.107 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:32:03.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:03.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.243+0000 7fa663bd0700 1 Processor -- start 2023-10-08T00:32:03.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.243+0000 7fa663bd0700 1 -- start start 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa663bd0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa65c159890 0x7fa65c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa663bd0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa65c159c60 0x7fa65c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa663bd0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c15db10 0x7fa65c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa663bd0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c15df50 con 0x7fa65c159890 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa663bd0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c15a160 con 0x7fa65c159c60 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa663bd0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0d13a0 con 0x7fa65c15db10 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa65c159890 0x7fa65c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa65c159890 0x7fa65c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37612/0 (socket says 172.21.15.22:37612) 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 -- 172.21.15.22:0/2262185065 learned_addr learned my addr 172.21.15.22:0/2262185065 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66216d700 1 --2- 172.21.15.22:0/2262185065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c15db10 0x7fa65c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66116b700 1 --2- 172.21.15.22:0/2262185065 >> v2:172.21.15.192:3300/0 conn(0x7fa65c159c60 0x7fa65c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 -- 172.21.15.22:0/2262185065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c15db10 msgr2=0x7fa65c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 --2- 172.21.15.22:0/2262185065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c15db10 0x7fa65c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 -- 172.21.15.22:0/2262185065 >> v2:172.21.15.192:3300/0 conn(0x7fa65c159c60 msgr2=0x7fa65c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 --2- 172.21.15.22:0/2262185065 >> v2:172.21.15.192:3300/0 conn(0x7fa65c159c60 0x7fa65c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.244+0000 7fa66196c700 1 -- 172.21.15.22:0/2262185065 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c15e140 con 0x7fa65c159890 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa66196c700 1 --2- 172.21.15.22:0/2262185065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c159890 0x7fa65c15abd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0b67f0 tx=0x7fa654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa59ba6dc85a00bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa66096a700 1 -- 172.21.15.22:0/2262185065 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400b640 con 0x7fa65c159890 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa66096a700 1 -- 172.21.15.22:0/2262185065 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400b7a0 con 0x7fa65c159890 2023-10-08T00:32:03.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa66096a700 1 -- 172.21.15.22:0/2262185065 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400bb60 con 0x7fa65c159890 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 -- 172.21.15.22:0/2262185065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c159890 msgr2=0x7fa65c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 --2- 172.21.15.22:0/2262185065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c159890 0x7fa65c15abd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0b67f0 tx=0x7fa654009250 comp rx=0 tx=0).stop 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 -- 172.21.15.22:0/2262185065 shutdown_connections 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 --2- 172.21.15.22:0/2262185065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c159890 0x7fa65c15abd0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 --2- 172.21.15.22:0/2262185065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c15db10 0x7fa65c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 --2- 172.21.15.22:0/2262185065 >> v2:172.21.15.192:3300/0 conn(0x7fa65c159c60 0x7fa65c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 -- 172.21.15.22:0/2262185065 >> 172.21.15.22:0/2262185065 conn(0x7fa65c068e20 msgr2=0x7fa65c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 -- 172.21.15.22:0/2262185065 shutdown_connections 2023-10-08T00:32:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.245+0000 7fa663bd0700 1 -- 172.21.15.22:0/2262185065 wait complete. 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 Processor -- start 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 -- start start 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65c159890 0x7fa65c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c159c60 0x7fa65c0c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 0x7fa65c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c153650 con 0x7fa65c15db10 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0c9dd0 con 0x7fa65c159890 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa663bd0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0b3630 con 0x7fa65c159c60 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa66216d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 0x7fa65c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa66216d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 0x7fa65c0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37628/0 (socket says 172.21.15.22:37628) 2023-10-08T00:32:03.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.247+0000 7fa66216d700 1 -- 172.21.15.22:0/1224145898 learned_addr learned my addr 172.21.15.22:0/1224145898 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66116b700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c159c60 0x7fa65c0c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66196c700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65c159890 0x7fa65c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66216d700 1 -- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c159c60 msgr2=0x7fa65c0c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66216d700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c159c60 0x7fa65c0c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66216d700 1 -- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65c159890 msgr2=0x7fa65c0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66216d700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65c159890 0x7fa65c0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66216d700 1 -- 172.21.15.22:0/1224145898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540094f0 con 0x7fa65c15db10 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66116b700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c159c60 0x7fa65c0c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66196c700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65c159890 0x7fa65c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa66216d700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 0x7fa65c0c9750 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009e90 tx=0x7fa64c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00cc20 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c00f040 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c014480 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c0b3910 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.248+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c0b3ed0 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.249+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c04c3c0 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.250+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa64c014830 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.250+0000 7fa659ffb700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa648067320 0x7fa6480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.250+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa64c085800 con 0x7fa65c15db10 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.250+0000 7fa66196c700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa648067320 0x7fa6480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.251+0000 7fa66196c700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa648067320 0x7fa6480697d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0b67f0 tx=0x7fa654017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.254+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa64c055db0 con 0x7fa65c15db10 2023-10-08T00:32:03.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.494+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa65c06a5b0 con 0x7fa65c15db10 2023-10-08T00:32:03.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.495+0000 7fa659ffb700 1 -- 172.21.15.22:0/1224145898 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fa64c055940 con 0x7fa65c15db10 2023-10-08T00:32:03.495 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:03.495 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2226811664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2226811664},{"type":"v1","addr":"172.21.15.192:6837","nonce":2226811664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4060208673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4060208673},{"type":"v1","addr":"172.21.15.22:6834","nonce":4060208673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:39.444812+0000","modified":"2023-10-08T00:31:43.058497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7200":{"gid":7200,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/1343084597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1343084597},{"type":"v1","addr":"172.21.15.22:6835","nonce":1343084597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T00:32:03.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa648067320 msgr2=0x7fa6480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa648067320 0x7fa6480697d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0b67f0 tx=0x7fa654017000 comp rx=0 tx=0).stop 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 msgr2=0x7fa65c0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 0x7fa65c0c9750 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009e90 tx=0x7fa64c00b040 comp rx=0 tx=0).stop 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 shutdown_connections 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa65c15db10 0x7fa65c0c9750 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa65c159890 0x7fa65c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa648067320 0x7fa6480697d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 --2- 172.21.15.22:0/1224145898 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa65c159c60 0x7fa65c0c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 >> 172.21.15.22:0/1224145898 conn(0x7fa65c068e20 msgr2=0x7fa65c0c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 shutdown_connections 2023-10-08T00:32:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.497+0000 7fa663bd0700 1 -- 172.21.15.22:0/1224145898 wait complete. 2023-10-08T00:32:03.499 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 88 2023-10-08T00:32:03.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 Processor -- start 2023-10-08T00:32:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 -- start start 2023-10-08T00:32:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f6815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3f68159c60 0x7f3f6815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6815a160 con 0x7f3f6815db10 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f680d13a0 con 0x7f3f68159c60 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.628+0000 7f3f6e701700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6815e140 con 0x7f3f68159890 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3f68159c60 0x7f3f6815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3f68159c60 0x7f3f6815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37638/0 (socket says 172.21.15.22:37638) 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 -- 172.21.15.22:0/2865711535 learned_addr learned my addr 172.21.15.22:0/2865711535 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f67fff700 1 --2- 172.21.15.22:0/2865711535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f6815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 -- 172.21.15.22:0/2865711535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 msgr2=0x7f3f6815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 --2- 172.21.15.22:0/2865711535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f6815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 -- 172.21.15.22:0/2865711535 >> v1:172.21.15.192:6789/0 conn(0x7f3f6815db10 legacy=0x7f3f68069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 -- 172.21.15.22:0/2865711535 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6815a3d0 con 0x7f3f68159c60 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f677fe700 1 --2- 172.21.15.22:0/2865711535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f6815d5d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0099b0 tx=0x7f3f5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7efb9a61762040 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f66ffd700 1 -- 172.21.15.22:0/2865711535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00b820 con 0x7f3f68159c60 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f66ffd700 1 -- 172.21.15.22:0/2865711535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00b980 con 0x7f3f68159c60 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.629+0000 7f3f66ffd700 1 -- 172.21.15.22:0/2865711535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00bd20 con 0x7f3f68159c60 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 -- 172.21.15.22:0/2865711535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 msgr2=0x7f3f6815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 --2- 172.21.15.22:0/2865711535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f6815d5d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0099b0 tx=0x7f3f5c009250 comp rx=0 tx=0).stop 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 -- 172.21.15.22:0/2865711535 shutdown_connections 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 --2- 172.21.15.22:0/2865711535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f6815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 --2- 172.21.15.22:0/2865711535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f6815d5d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 -- 172.21.15.22:0/2865711535 >> 172.21.15.22:0/2865711535 conn(0x7f3f68068e20 msgr2=0x7f3f680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 -- 172.21.15.22:0/2865711535 shutdown_connections 2023-10-08T00:32:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.630+0000 7f3f6e701700 1 -- 172.21.15.22:0/2865711535 wait complete. 2023-10-08T00:32:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.631+0000 7f3f6e701700 1 Processor -- start 2023-10-08T00:32:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.631+0000 7f3f6e701700 1 -- start start 2023-10-08T00:32:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6e701700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f680ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6e701700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f68140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6e701700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f6815db10 0x7f3f680cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6e701700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680c7f90 con 0x7f3f68159c60 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6e701700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680cfee0 con 0x7f3f6815db10 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6e701700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f680cfc00 con 0x7f3f68159890 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f68140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f68140dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37642/0 (socket says 172.21.15.22:37642) 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 -- 172.21.15.22:0/832404199 learned_addr learned my addr 172.21.15.22:0/832404199 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f6cc9e700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f6815db10 0x7f3f680cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f67fff700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f680ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 -- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 msgr2=0x7f3f680ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f680ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 -- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f6815db10 msgr2=0x7f3f680cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f6815db10 0x7f3f680cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 -- 172.21.15.22:0/832404199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0094f0 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f67fff700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f680ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f677fe700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f68140dc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009290 tx=0x7f3f5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c011d70 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.632+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c020070 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.633+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f680c7940 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.633+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c01b6a0 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.633+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f68141300 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.634+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f680c8100 con 0x7f3f68159c60 2023-10-08T00:32:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.634+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3f5c022030 con 0x7f3f68159c60 2023-10-08T00:32:03.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.634+0000 7f3f4ffff700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f54067320 0x7f3f540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.634+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f3f5c0866b0 con 0x7f3f68159c60 2023-10-08T00:32:03.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.634+0000 7f3f67fff700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f54067320 0x7f3f540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.638 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.635+0000 7f3f67fff700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f54067320 0x7f3f540697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3f58008a80 tx=0x7f3f58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.639+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f5c053470 con 0x7f3f68159c60 2023-10-08T00:32:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.837+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f680c80d0 con 0x7f3f68159c60 2023-10-08T00:32:03.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.838+0000 7f3f4ffff700 1 -- 172.21.15.22:0/832404199 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15723 (secure 0 0 0) 0x7f3f5c056a90 con 0x7f3f68159c60 2023-10-08T00:32:03.838 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:03.839 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":129,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:02.873287+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:37.857153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:38.408003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.22","mappings":[{"from":2,"to":0}]},{"pgid":"19.32","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6834/3522181155":"2023-10-09T00:31:56.440155+0000","172.21.15.192:6837/1568259552":"2023-10-09T00:31:59.868602+0000","172.21.15.192:6835/1568259552":"2023-10-09T00:31:59.868602+0000","172.21.15.22:6832/3522181155":"2023-10-09T00:31:56.440155+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f54067320 msgr2=0x7f3f540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f54067320 0x7f3f540697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3f58008a80 tx=0x7f3f58008040 comp rx=0 tx=0).stop 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 msgr2=0x7f3f68140dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f68140dc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009290 tx=0x7f3f5c016000 comp rx=0 tx=0).stop 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 shutdown_connections 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f6815db10 0x7f3f680cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f54067320 0x7f3f540697d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3f68159890 0x7f3f680ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 --2- 172.21.15.22:0/832404199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f68159c60 0x7f3f68140dc0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 >> 172.21.15.22:0/832404199 conn(0x7f3f68068e20 msgr2=0x7f3f68069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:03.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 shutdown_connections 2023-10-08T00:32:03.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.840+0000 7f3f6e701700 1 -- 172.21.15.22:0/832404199 wait complete. 2023-10-08T00:32:03.853 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:31:37.857153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:31:38.408003+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:32:03.853 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:32:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.975+0000 7f6ede418700 1 Processor -- start 2023-10-08T00:32:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.975+0000 7f6ede418700 1 -- start start 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ede418700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ed806aa40 0x7f6ed80cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ede418700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ed80c91e0 0x7f6ed8160390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ede418700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80cc210 con 0x7f6ed806bac0 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ede418700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80cc4f0 con 0x7f6ed80c91e0 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ede418700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80cc7d0 con 0x7f6ed806aa40 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ed80c91e0 0x7f6ed8160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ed80c91e0 0x7f6ed8160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37644/0 (socket says 172.21.15.22:37644) 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 -- 172.21.15.22:0/4130075941 learned_addr learned my addr 172.21.15.22:0/4130075941 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ed7fff700 1 --2- 172.21.15.22:0/4130075941 >> v2:172.21.15.192:3300/0 conn(0x7f6ed806aa40 0x7f6ed80cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 -- 172.21.15.22:0/4130075941 >> v2:172.21.15.192:3300/0 conn(0x7f6ed806aa40 msgr2=0x7f6ed80cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 --2- 172.21.15.22:0/4130075941 >> v2:172.21.15.192:3300/0 conn(0x7f6ed806aa40 0x7f6ed80cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 -- 172.21.15.22:0/4130075941 >> v1:172.21.15.192:6789/0 conn(0x7f6ed806bac0 legacy=0x7f6ed806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 -- 172.21.15.22:0/4130075941 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80ccab0 con 0x7f6ed80c91e0 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6ed7fff700 1 --2- 172.21.15.22:0/4130075941 >> v2:172.21.15.192:3300/0 conn(0x7f6ed806aa40 0x7f6ed80cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.976+0000 7f6edc9b5700 1 --2- 172.21.15.22:0/4130075941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8160390 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806e570 tx=0x7f6ed0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c61600548495353 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ed6ffd700 1 -- 172.21.15.22:0/4130075941 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000e070 con 0x7f6ed80c91e0 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ed6ffd700 1 -- 172.21.15.22:0/4130075941 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000ba50 con 0x7f6ed80c91e0 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ed6ffd700 1 -- 172.21.15.22:0/4130075941 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00092e0 con 0x7f6ed80c91e0 2023-10-08T00:32:03.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 -- 172.21.15.22:0/4130075941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed80c91e0 msgr2=0x7f6ed8160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 --2- 172.21.15.22:0/4130075941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8160390 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806e570 tx=0x7f6ed0009840 comp rx=0 tx=0).stop 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 -- 172.21.15.22:0/4130075941 shutdown_connections 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 --2- 172.21.15.22:0/4130075941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8160390 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 --2- 172.21.15.22:0/4130075941 >> v2:172.21.15.192:3300/0 conn(0x7f6ed806aa40 0x7f6ed80cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 -- 172.21.15.22:0/4130075941 >> 172.21.15.22:0/4130075941 conn(0x7f6ed80cd670 msgr2=0x7f6ed80cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 -- 172.21.15.22:0/4130075941 shutdown_connections 2023-10-08T00:32:03.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.977+0000 7f6ede418700 1 -- 172.21.15.22:0/4130075941 wait complete. 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.978+0000 7f6ede418700 1 Processor -- start 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 -- start start 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 0x7f6ed80c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ed806bac0 0x7f6ed8155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80c5b10 con 0x7f6ed806aa40 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80c5df0 con 0x7f6ed80c91e0 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ede418700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80c60d0 con 0x7f6ed806bac0 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.979+0000 7f6ed7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 0x7f6ed80c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 0x7f6ed80c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37654/0 (socket says 172.21.15.22:37654) 2023-10-08T00:32:03.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 -- 172.21.15.22:0/1718035864 learned_addr learned my addr 172.21.15.22:0/1718035864 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6edc9b5700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed77fe700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ed806bac0 0x7f6ed8155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 -- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ed806bac0 msgr2=0x7f6ed8155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ed806bac0 0x7f6ed8155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 -- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c91e0 msgr2=0x7f6ed8155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 -- 172.21.15.22:0/1718035864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009ae0 con 0x7f6ed806aa40 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ed7fff700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 0x7f6ed80c5130 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0010c00 tx=0x7f6ec0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0005a00 con 0x7f6ed806aa40 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0005b60 con 0x7f6ed806aa40 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed80b07d0 con 0x7f6ed806aa40 2023-10-08T00:32:03.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00099b0 con 0x7f6ed806aa40 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.980+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed8152b20 con 0x7f6ed806aa40 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.982+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed804c3c0 con 0x7f6ed806aa40 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.982+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6ec0006020 con 0x7f6ed806aa40 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.982+0000 7f6ecffff700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6eb8067350 0x7f6eb8069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.982+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6ec00874a0 con 0x7f6ed806aa40 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.982+0000 7f6ed77fe700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6eb8067350 0x7f6eb8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:03.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.983+0000 7f6ed77fe700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6eb8067350 0x7f6eb8069800 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806e1e0 tx=0x7f6ec8007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:03.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:03.986+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ec0054050 con 0x7f6ed806aa40 2023-10-08T00:32:04.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.179+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ed80c7cb0 con 0x7f6ed806aa40 2023-10-08T00:32:04.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.179+0000 7f6ecffff700 1 -- 172.21.15.22:0/1718035864 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ec0057670 con 0x7f6ed806aa40 2023-10-08T00:32:04.180 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:32:04.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6eb8067350 msgr2=0x7f6eb8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6eb8067350 0x7f6eb8069800 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6ed806e1e0 tx=0x7f6ec8007ec0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 msgr2=0x7f6ed80c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 0x7f6ed80c5130 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0010c00 tx=0x7f6ec0008040 comp rx=0 tx=0).stop 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 shutdown_connections 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c91e0 0x7f6ed8155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ed806aa40 0x7f6ed80c5130 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6eb8067350 0x7f6eb8069800 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 --2- 172.21.15.22:0/1718035864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ed806bac0 0x7f6ed8155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 >> 172.21.15.22:0/1718035864 conn(0x7f6ed80cd670 msgr2=0x7f6ed8150070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 shutdown_connections 2023-10-08T00:32:04.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.181+0000 7f6ede418700 1 -- 172.21.15.22:0/1718035864 wait complete. 2023-10-08T00:32:04.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:32:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.315+0000 7fa5f500f700 1 Processor -- start 2023-10-08T00:32:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.315+0000 7fa5f500f700 1 -- start start 2023-10-08T00:32:04.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5f500f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5f500f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa5f0069d60 0x7fa5f00c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5f500f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa5f00c81f0 0x7fa5f0068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5f500f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00c8670 con 0x7fa5f0069d60 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5f500f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f006bdb0 con 0x7fa5f00c81f0 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5f500f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00cb370 con 0x7fa5f00aca80 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5ee59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa5f0069d60 0x7fa5f00c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5ee59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa5f0069d60 0x7fa5f00c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37668/0 (socket says 172.21.15.22:37668) 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5ee59c700 1 -- 172.21.15.22:0/879779884 learned_addr learned my addr 172.21.15.22:0/879779884 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.316+0000 7fa5eed9d700 1 --2- 172.21.15.22:0/879779884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ef59e700 1 --2- 172.21.15.22:0/879779884 >> v2:172.21.15.192:3300/0 conn(0x7fa5f00c81f0 0x7fa5f0068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ee59c700 1 -- 172.21.15.22:0/879779884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 msgr2=0x7fa5f006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ee59c700 1 --2- 172.21.15.22:0/879779884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f006aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ee59c700 1 -- 172.21.15.22:0/879779884 >> v2:172.21.15.192:3300/0 conn(0x7fa5f00c81f0 msgr2=0x7fa5f0068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ee59c700 1 --2- 172.21.15.22:0/879779884 >> v2:172.21.15.192:3300/0 conn(0x7fa5f00c81f0 0x7fa5f0068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ee59c700 1 -- 172.21.15.22:0/879779884 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0159f60 con 0x7fa5f0069d60 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ef59e700 1 --2- 172.21.15.22:0/879779884 >> v2:172.21.15.192:3300/0 conn(0x7fa5f00c81f0 0x7fa5f0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5ee59c700 1 --2- 172.21.15.22:0/879779884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f0069d60 0x7fa5f00c7cb0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa5f006d520 tx=0x7fa5d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be236331121ccb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5edd9b700 1 -- 172.21.15.22:0/879779884 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800b860 con 0x7fa5f0069d60 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5edd9b700 1 -- 172.21.15.22:0/879779884 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d800b9c0 con 0x7fa5f0069d60 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5edd9b700 1 -- 172.21.15.22:0/879779884 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800bd60 con 0x7fa5f0069d60 2023-10-08T00:32:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 -- 172.21.15.22:0/879779884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f0069d60 msgr2=0x7fa5f00c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 --2- 172.21.15.22:0/879779884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f0069d60 0x7fa5f00c7cb0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa5f006d520 tx=0x7fa5d8009250 comp rx=0 tx=0).stop 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 -- 172.21.15.22:0/879779884 shutdown_connections 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 --2- 172.21.15.22:0/879779884 >> v2:172.21.15.192:3300/0 conn(0x7fa5f00c81f0 0x7fa5f0068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 --2- 172.21.15.22:0/879779884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f006aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 --2- 172.21.15.22:0/879779884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f0069d60 0x7fa5f00c7cb0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 -- 172.21.15.22:0/879779884 >> 172.21.15.22:0/879779884 conn(0x7fa5f00cd670 msgr2=0x7fa5f00cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 -- 172.21.15.22:0/879779884 shutdown_connections 2023-10-08T00:32:04.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.317+0000 7fa5f500f700 1 -- 172.21.15.22:0/879779884 wait complete. 2023-10-08T00:32:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.319+0000 7fa5f500f700 1 Processor -- start 2023-10-08T00:32:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.319+0000 7fa5f500f700 1 -- start start 2023-10-08T00:32:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.319+0000 7fa5f500f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5f0069d60 0x7fa5f00af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.319+0000 7fa5f500f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f00adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5f500f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 0x7fa5f016ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5f500f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00afd70 con 0x7fa5f00c81f0 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5f500f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f016e2f0 con 0x7fa5f0069d60 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5f500f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0151d30 con 0x7fa5f00aca80 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 0x7fa5f016ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 0x7fa5f016ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37684/0 (socket says 172.21.15.22:37684) 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 -- 172.21.15.22:0/3052200704 learned_addr learned my addr 172.21.15.22:0/3052200704 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5eed9d700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5f0069d60 0x7fa5f00af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ee59c700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f00adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 -- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 msgr2=0x7fa5f00adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f00adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 -- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5f0069d60 msgr2=0x7fa5f00af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5f0069d60 0x7fa5f00af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 -- 172.21.15.22:0/3052200704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d80094f0 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5ef59e700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 0x7fa5f016ddb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c880 tx=0x7fa5e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8011600 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e8011760 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00afa90 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8011b20 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.320+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00ad390 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.321+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f004c3c0 con 0x7fa5f00c81f0 2023-10-08T00:32:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.322+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa5e8018350 con 0x7fa5f00c81f0 2023-10-08T00:32:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.322+0000 7fa5e6ffd700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5d0067320 0x7fa5d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.322+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa5e8084c50 con 0x7fa5f00c81f0 2023-10-08T00:32:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.322+0000 7fa5eed9d700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5d0067320 0x7fa5d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.323+0000 7fa5eed9d700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5d0067320 0x7fa5d00697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0007680 tx=0x7fa5e00098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.326+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5e80516b0 con 0x7fa5f00c81f0 2023-10-08T00:32:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.518+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5f006b510 con 0x7fa5f00c81f0 2023-10-08T00:32:04.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.519+0000 7fa5e6ffd700 1 -- 172.21.15.22:0/3052200704 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5e801e020 con 0x7fa5f00c81f0 2023-10-08T00:32:04.520 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5d0067320 msgr2=0x7fa5d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5d0067320 0x7fa5d00697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0007680 tx=0x7fa5e00098d0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 msgr2=0x7fa5f016ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 0x7fa5f016ddb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c880 tx=0x7fa5e8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 shutdown_connections 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5f00c81f0 0x7fa5f016ddb0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5f0069d60 0x7fa5f00af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa5d0067320 0x7fa5d00697d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 --2- 172.21.15.22:0/3052200704 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa5f00aca80 0x7fa5f00adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 >> 172.21.15.22:0/3052200704 conn(0x7fa5f00cd670 msgr2=0x7fa5f006a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:04.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 shutdown_connections 2023-10-08T00:32:04.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.521+0000 7fa5f500f700 1 -- 172.21.15.22:0/3052200704 wait complete. 2023-10-08T00:32:04.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:32:04.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.655+0000 7fe442b24700 1 Processor -- start 2023-10-08T00:32:04.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.655+0000 7fe442b24700 1 -- start start 2023-10-08T00:32:04.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe442b24700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe43c159890 0x7fe43c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe442b24700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe43c159c60 0x7fe43c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe442b24700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c15db10 0x7fe43c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe442b24700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c15df50 con 0x7fe43c159c60 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe442b24700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43c15a160 con 0x7fe43c159890 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe442b24700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0d13a0 con 0x7fe43c15db10 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe43c159c60 0x7fe43c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe43c159c60 0x7fe43c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37696/0 (socket says 172.21.15.22:37696) 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 -- 172.21.15.22:0/874891304 learned_addr learned my addr 172.21.15.22:0/874891304 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe4410c1700 1 --2- 172.21.15.22:0/874891304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c15db10 0x7fe43c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe4408c0700 1 --2- 172.21.15.22:0/874891304 >> v2:172.21.15.192:3300/0 conn(0x7fe43c159890 0x7fe43c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 -- 172.21.15.22:0/874891304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c15db10 msgr2=0x7fe43c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 --2- 172.21.15.22:0/874891304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c15db10 0x7fe43c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 -- 172.21.15.22:0/874891304 >> v2:172.21.15.192:3300/0 conn(0x7fe43c159890 msgr2=0x7fe43c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 --2- 172.21.15.22:0/874891304 >> v2:172.21.15.192:3300/0 conn(0x7fe43c159890 0x7fe43c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.656+0000 7fe43bfff700 1 -- 172.21.15.22:0/874891304 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c15e140 con 0x7fe43c159c60 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe43bfff700 1 --2- 172.21.15.22:0/874891304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c159c60 0x7fe43c15d5d0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0d1090 tx=0x7fe430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43df851c7fbb5bf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe43b7fe700 1 -- 172.21.15.22:0/874891304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000b860 con 0x7fe43c159c60 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe43b7fe700 1 -- 172.21.15.22:0/874891304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000b9c0 con 0x7fe43c159c60 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe43b7fe700 1 -- 172.21.15.22:0/874891304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000bd60 con 0x7fe43c159c60 2023-10-08T00:32:04.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 -- 172.21.15.22:0/874891304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c159c60 msgr2=0x7fe43c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 --2- 172.21.15.22:0/874891304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c159c60 0x7fe43c15d5d0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe43c0d1090 tx=0x7fe430009250 comp rx=0 tx=0).stop 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 -- 172.21.15.22:0/874891304 shutdown_connections 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 --2- 172.21.15.22:0/874891304 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c15db10 0x7fe43c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 --2- 172.21.15.22:0/874891304 >> v2:172.21.15.192:3300/0 conn(0x7fe43c159890 0x7fe43c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 --2- 172.21.15.22:0/874891304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c159c60 0x7fe43c15d5d0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 -- 172.21.15.22:0/874891304 >> 172.21.15.22:0/874891304 conn(0x7fe43c068e20 msgr2=0x7fe43c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 -- 172.21.15.22:0/874891304 shutdown_connections 2023-10-08T00:32:04.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.657+0000 7fe442b24700 1 -- 172.21.15.22:0/874891304 wait complete. 2023-10-08T00:32:04.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.658+0000 7fe442b24700 1 Processor -- start 2023-10-08T00:32:04.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 -- start start 2023-10-08T00:32:04.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe43c159890 0x7fe43c0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c159c60 0x7fe43c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 0x7fe43c0ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c0c78a0 con 0x7fe43c15db10 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1583d0 con 0x7fe43c159890 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.659+0000 7fe442b24700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43c1586b0 con 0x7fe43c159c60 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 0x7fe43c0ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 0x7fe43c0ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37710/0 (socket says 172.21.15.22:37710) 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 -- 172.21.15.22:0/2289385619 learned_addr learned my addr 172.21.15.22:0/2289385619 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe43bfff700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c159c60 0x7fe43c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4408c0700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe43c159890 0x7fe43c0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 -- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c159c60 msgr2=0x7fe43c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c159c60 0x7fe43c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 -- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe43c159890 msgr2=0x7fe43c0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe43c159890 0x7fe43c0c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 -- 172.21.15.22:0/2289385619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300094f0 con 0x7fe43c15db10 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe4410c1700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 0x7fe43c0ce330 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe43400ceb0 tx=0x7fe434007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43400ae40 con 0x7fe43c15db10 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe434016430 con 0x7fe43c15db10 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43c158990 con 0x7fe43c15db10 2023-10-08T00:32:04.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4340167d0 con 0x7fe43c15db10 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.660+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43c0c9ef0 con 0x7fe43c15db10 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.661+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43c04c3c0 con 0x7fe43c15db10 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.662+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe434003020 con 0x7fe43c15db10 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.662+0000 7fe438ff9700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe428067320 0x7fe4280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.662+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe434012070 con 0x7fe43c15db10 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.662+0000 7fe4408c0700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe428067320 0x7fe4280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.663+0000 7fe4408c0700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe428067320 0x7fe4280697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006fd0 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.666+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4340527d0 con 0x7fe43c15db10 2023-10-08T00:32:04.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.857+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe43c0d0e70 con 0x7fe43c15db10 2023-10-08T00:32:04.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.857+0000 7fe438ff9700 1 -- 172.21.15.22:0/2289385619 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe434055df0 con 0x7fe43c15db10 2023-10-08T00:32:04.859 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:32:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.859+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe428067320 msgr2=0x7fe4280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.859+0000 7fe442b24700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe428067320 0x7fe4280697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006fd0 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2023-10-08T00:32:04.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.859+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 msgr2=0x7fe43c0ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.859+0000 7fe442b24700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 0x7fe43c0ce330 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fe43400ceb0 tx=0x7fe434007870 comp rx=0 tx=0).stop 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 shutdown_connections 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe43c15db10 0x7fe43c0ce330 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe43c159890 0x7fe43c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe428067320 0x7fe4280697d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 --2- 172.21.15.22:0/2289385619 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe43c159c60 0x7fe43c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 >> 172.21.15.22:0/2289385619 conn(0x7fe43c068e20 msgr2=0x7fe43c069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 shutdown_connections 2023-10-08T00:32:04.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.860+0000 7fe442b24700 1 -- 172.21.15.22:0/2289385619 wait complete. 2023-10-08T00:32:04.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.991+0000 7f4d0a97b700 1 Processor -- start 2023-10-08T00:32:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.991+0000 7f4d0a97b700 1 -- start start 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d0a97b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d0a97b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04159c60 0x7f4d0415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d0a97b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d0415db10 0x7f4d04069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d0a97b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0415a160 con 0x7f4d0415db10 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d0a97b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040d13a0 con 0x7f4d04159890 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d0a97b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0415e140 con 0x7f4d04159c60 2023-10-08T00:32:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d08f18700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d0415db10 0x7f4d04069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d08f18700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d0415db10 0x7f4d04069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37724/0 (socket says 172.21.15.22:37724) 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d08f18700 1 -- 172.21.15.22:0/1075460680 learned_addr learned my addr 172.21.15.22:0/1075460680 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d037fe700 1 --2- 172.21.15.22:0/1075460680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04159c60 0x7f4d0415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.992+0000 7f4d03fff700 1 --2- 172.21.15.22:0/1075460680 >> v2:172.21.15.192:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d08f18700 1 -- 172.21.15.22:0/1075460680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04159c60 msgr2=0x7f4d0415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d08f18700 1 --2- 172.21.15.22:0/1075460680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04159c60 0x7f4d0415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d08f18700 1 -- 172.21.15.22:0/1075460680 >> v2:172.21.15.192:3300/0 conn(0x7f4d04159890 msgr2=0x7f4d0415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d08f18700 1 --2- 172.21.15.22:0/1075460680 >> v2:172.21.15.192:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d08f18700 1 -- 172.21.15.22:0/1075460680 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0415a3d0 con 0x7f4d0415db10 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d08f18700 1 --2- 172.21.15.22:0/1075460680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d0415db10 0x7f4d04069560 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4d040d1090 tx=0x7f4cfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c5cee70e10cc71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d02ffd700 1 -- 172.21.15.22:0/1075460680 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00e070 con 0x7f4d0415db10 2023-10-08T00:32:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d02ffd700 1 -- 172.21.15.22:0/1075460680 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00b970 con 0x7f4d0415db10 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d02ffd700 1 -- 172.21.15.22:0/1075460680 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0092e0 con 0x7f4d0415db10 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1075460680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d0415db10 msgr2=0x7f4d04069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1075460680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d0415db10 0x7f4d04069560 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f4d040d1090 tx=0x7f4cfc009840 comp rx=0 tx=0).stop 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1075460680 shutdown_connections 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1075460680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d0415db10 0x7f4d04069560 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1075460680 >> v2:172.21.15.192:3300/0 conn(0x7f4d04159890 0x7f4d0415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1075460680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d04159c60 0x7f4d0415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.993+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1075460680 >> 172.21.15.22:0/1075460680 conn(0x7f4d04068e20 msgr2=0x7f4d040d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.994+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1075460680 shutdown_connections 2023-10-08T00:32:04.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.994+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1075460680 wait complete. 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.995+0000 7f4d0a97b700 1 Processor -- start 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.995+0000 7f4d0a97b700 1 -- start start 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.995+0000 7f4d0a97b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d040cf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.995+0000 7f4d0a97b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d040b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.995+0000 7f4d0a97b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d0415db10 0x7f4d040b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.995+0000 7f4d0a97b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0416dda0 con 0x7f4d04159890 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d0a97b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04151f40 con 0x7f4d04159c60 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d0a97b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0416d470 con 0x7f4d0415db10 2023-10-08T00:32:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d040cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d040cf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37726/0 (socket says 172.21.15.22:37726) 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 -- 172.21.15.22:0/1855177205 learned_addr learned my addr 172.21.15.22:0/1855177205 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d037fe700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d040b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d08f18700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d0415db10 0x7f4d040b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 -- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d0415db10 msgr2=0x7f4d040b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d0415db10 0x7f4d040b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 -- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 msgr2=0x7f4d040b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d040b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 -- 172.21.15.22:0/1855177205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009ae0 con 0x7f4d04159890 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d08f18700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d0415db10 0x7f4d040b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d037fe700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d040b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d03fff700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d040cf920 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400ec80 tx=0x7f4cf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf400c9d0 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf400cb30 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0416d750 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4013470 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.996+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d040b4390 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.997+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0404c3c0 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.998+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4cf4013820 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.998+0000 7f4cfbfff700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067320 0x7f4ce40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.998+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f4cf40850e0 con 0x7f4d04159890 2023-10-08T00:32:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.998+0000 7f4d037fe700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067320 0x7f4ce40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:04.999+0000 7f4d037fe700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067320 0x7f4ce40697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4d040cad90 tx=0x7f4cec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.002+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cf4051c90 con 0x7f4d04159890 2023-10-08T00:32:05.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.240+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d0406a5b0 con 0x7f4d04159890 2023-10-08T00:32:05.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.241+0000 7f4cfbfff700 1 -- 172.21.15.22:0/1855177205 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f4cf40552b0 con 0x7f4d04159890 2023-10-08T00:32:05.241 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:05.242 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2226811664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2226811664},{"type":"v1","addr":"172.21.15.192:6837","nonce":2226811664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4060208673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4060208673},{"type":"v1","addr":"172.21.15.22:6834","nonce":4060208673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:39.444812+0000","modified":"2023-10-08T00:31:43.058497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7200":{"gid":7200,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/1343084597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1343084597},{"type":"v1","addr":"172.21.15.22:6835","nonce":1343084597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T00:32:05.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067320 msgr2=0x7f4ce40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067320 0x7f4ce40697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4d040cad90 tx=0x7f4cec008040 comp rx=0 tx=0).stop 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 msgr2=0x7f4d040cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d040cf920 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f4cf400ec80 tx=0x7f4cf40091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 shutdown_connections 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ce4067320 0x7f4ce40697d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4d0415db10 0x7f4d040b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d04159890 0x7f4d040cf920 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 --2- 172.21.15.22:0/1855177205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d04159c60 0x7f4d040b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 >> 172.21.15.22:0/1855177205 conn(0x7f4d04068e20 msgr2=0x7f4d040d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:05.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 shutdown_connections 2023-10-08T00:32:05.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.243+0000 7f4d0a97b700 1 -- 172.21.15.22:0/1855177205 wait complete. 2023-10-08T00:32:05.245 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 88 2023-10-08T00:32:05.258 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:05.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.376+0000 7fd26185e700 1 Processor -- start 2023-10-08T00:32:05.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.376+0000 7fd26185e700 1 -- start start 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd26185e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd25c1594d0 0x7fd25c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd26185e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd25c0b5fb0 0x7fd25c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd26185e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c159de0 0x7fd25c15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd26185e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0d01f0 con 0x7fd25c1594d0 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd26185e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0cf5e0 con 0x7fd25c0b5fb0 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd26185e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0cf8c0 con 0x7fd25c159de0 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd25c1594d0 0x7fd25c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd25c1594d0 0x7fd25c0cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37728/0 (socket says 172.21.15.22:37728) 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 -- 172.21.15.22:0/3860421343 learned_addr learned my addr 172.21.15.22:0/3860421343 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25b7fe700 1 --2- 172.21.15.22:0/3860421343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c159de0 0x7fd25c15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25a7fc700 1 --2- 172.21.15.22:0/3860421343 >> v2:172.21.15.192:3300/0 conn(0x7fd25c0b5fb0 0x7fd25c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 -- 172.21.15.22:0/3860421343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c159de0 msgr2=0x7fd25c15a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 --2- 172.21.15.22:0/3860421343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c159de0 0x7fd25c15a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 -- 172.21.15.22:0/3860421343 >> v2:172.21.15.192:3300/0 conn(0x7fd25c0b5fb0 msgr2=0x7fd25c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 --2- 172.21.15.22:0/3860421343 >> v2:172.21.15.192:3300/0 conn(0x7fd25c0b5fb0 0x7fd25c1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.377+0000 7fd25affd700 1 -- 172.21.15.22:0/3860421343 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0cfba0 con 0x7fd25c1594d0 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd25affd700 1 --2- 172.21.15.22:0/3860421343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cd0f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd25c089440 tx=0x7fd254009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad5493f26267e49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd259ffb700 1 -- 172.21.15.22:0/3860421343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400b860 con 0x7fd25c1594d0 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd259ffb700 1 -- 172.21.15.22:0/3860421343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25400b9c0 con 0x7fd25c1594d0 2023-10-08T00:32:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd259ffb700 1 -- 172.21.15.22:0/3860421343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400bd60 con 0x7fd25c1594d0 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 -- 172.21.15.22:0/3860421343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 msgr2=0x7fd25c0cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 --2- 172.21.15.22:0/3860421343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cd0f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd25c089440 tx=0x7fd254009250 comp rx=0 tx=0).stop 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 -- 172.21.15.22:0/3860421343 shutdown_connections 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 --2- 172.21.15.22:0/3860421343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cd0f0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 --2- 172.21.15.22:0/3860421343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c159de0 0x7fd25c15a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 --2- 172.21.15.22:0/3860421343 >> v2:172.21.15.192:3300/0 conn(0x7fd25c0b5fb0 0x7fd25c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 -- 172.21.15.22:0/3860421343 >> 172.21.15.22:0/3860421343 conn(0x7fd25c0d05f0 msgr2=0x7fd25c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 -- 172.21.15.22:0/3860421343 shutdown_connections 2023-10-08T00:32:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.378+0000 7fd26185e700 1 -- 172.21.15.22:0/3860421343 wait complete. 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 Processor -- start 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 -- start start 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c0b5fb0 0x7fd25c1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd25c159de0 0x7fd25c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0cc570 con 0x7fd25c1594d0 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c143f00 con 0x7fd25c159de0 2023-10-08T00:32:05.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.380+0000 7fd26185e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0cb960 con 0x7fd25c0b5fb0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37742/0 (socket says 172.21.15.22:37742) 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 -- 172.21.15.22:0/2903436658 learned_addr learned my addr 172.21.15.22:0/2903436658 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25affd700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c0b5fb0 0x7fd25c1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25b7fe700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd25c159de0 0x7fd25c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 -- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c0b5fb0 msgr2=0x7fd25c1439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c0b5fb0 0x7fd25c1439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 -- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd25c159de0 msgr2=0x7fd25c0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd25c159de0 0x7fd25c0c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 -- 172.21.15.22:0/2903436658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2540094f0 con 0x7fd25c1594d0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd25a7fc700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cb0b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd24400c7d0 tx=0x7fd244008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244011600 con 0x7fd25c1594d0 2023-10-08T00:32:05.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd244011760 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c0cbc40 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244011b20 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.381+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c0cc200 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.382+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c0cc720 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.383+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd2440193f0 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.383+0000 7fd252ffd700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd23c067320 0x7fd23c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.383+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fd244085180 con 0x7fd25c1594d0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.383+0000 7fd25affd700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd23c067320 0x7fd23c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.384+0000 7fd25affd700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd23c067320 0x7fd23c0697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd25c089440 tx=0x7fd254017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.387+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd25c0cc720 con 0x7fd25c1594d0 2023-10-08T00:32:05.581 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.581+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd25c04c3c0 con 0x7fd25c1594d0 2023-10-08T00:32:05.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.582+0000 7fd252ffd700 1 -- 172.21.15.22:0/2903436658 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15723 (secure 0 0 0) 0x7fd244051c20 con 0x7fd25c1594d0 2023-10-08T00:32:05.582 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:05.583 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":129,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:02.873287+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:37.857153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:38.408003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.22","mappings":[{"from":2,"to":0}]},{"pgid":"19.32","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6834/3522181155":"2023-10-09T00:31:56.440155+0000","172.21.15.192:6837/1568259552":"2023-10-09T00:31:59.868602+0000","172.21.15.192:6835/1568259552":"2023-10-09T00:31:59.868602+0000","172.21.15.22:6832/3522181155":"2023-10-09T00:31:56.440155+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd23c067320 msgr2=0x7fd23c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd23c067320 0x7fd23c0697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd25c089440 tx=0x7fd254017000 comp rx=0 tx=0).stop 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 msgr2=0x7fd25c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cb0b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd24400c7d0 tx=0x7fd244008040 comp rx=0 tx=0).stop 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 shutdown_connections 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd25c159de0 0x7fd25c0c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd23c067320 0x7fd23c0697d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd25c0b5fb0 0x7fd25c1439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 --2- 172.21.15.22:0/2903436658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd25c1594d0 0x7fd25c0cb0b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 >> 172.21.15.22:0/2903436658 conn(0x7fd25c0d05f0 msgr2=0x7fd25c0d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:05.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 shutdown_connections 2023-10-08T00:32:05.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.584+0000 7fd26185e700 1 -- 172.21.15.22:0/2903436658 wait complete. 2023-10-08T00:32:05.597 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:32:05.597 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:05.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.716+0000 7f47f6669700 1 Processor -- start 2023-10-08T00:32:05.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.716+0000 7f47f6669700 1 -- start start 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f6669700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47f006bcd0 0x7f47f00caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f6669700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f47f006c0a0 0x7f47f015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f6669700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f015d7e0 con 0x7f47f015df50 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f6669700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f015dac0 con 0x7f47f006bcd0 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f6669700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f015aa30 con 0x7f47f006c0a0 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47effff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f47f006bcd0 0x7f47f00caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f4c06700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f47f015df50 0x7f47f00c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51234/0 (socket says 172.21.15.22:51234) 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47f4c06700 1 -- 172.21.15.22:0/3959171725 learned_addr learned my addr 172.21.15.22:0/3959171725 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47ef7fe700 1 --2- 172.21.15.22:0/3959171725 >> v2:172.21.15.192:3300/0 conn(0x7f47f006c0a0 0x7f47f015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47effff700 1 -- 172.21.15.22:0/3959171725 >> v2:172.21.15.192:3300/0 conn(0x7f47f006c0a0 msgr2=0x7f47f015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47effff700 1 --2- 172.21.15.22:0/3959171725 >> v2:172.21.15.192:3300/0 conn(0x7f47f006c0a0 0x7f47f015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47effff700 1 -- 172.21.15.22:0/3959171725 >> v1:172.21.15.22:6789/0 conn(0x7f47f015df50 legacy=0x7f47f00c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47effff700 1 -- 172.21.15.22:0/3959171725 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f015ad10 con 0x7f47f006bcd0 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47eeffd700 1 -- 172.21.15.22:0/3959171725 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101762849 0 0) 0x7f47f015d7e0 con 0x7f47f015df50 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47ef7fe700 1 --2- 172.21.15.22:0/3959171725 >> v2:172.21.15.192:3300/0 conn(0x7f47f006c0a0 0x7f47f015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.717+0000 7f47effff700 1 --2- 172.21.15.22:0/3959171725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00caa90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f47f006b4e0 tx=0x7f47e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634b372930f99af2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47eeffd700 1 -- 172.21.15.22:0/3959171725 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000b6b0 con 0x7f47f006bcd0 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47eeffd700 1 -- 172.21.15.22:0/3959171725 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000b810 con 0x7f47f006bcd0 2023-10-08T00:32:05.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47eeffd700 1 -- 172.21.15.22:0/3959171725 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000bbb0 con 0x7f47f006bcd0 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 -- 172.21.15.22:0/3959171725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 msgr2=0x7f47f00caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 --2- 172.21.15.22:0/3959171725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00caa90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f47f006b4e0 tx=0x7f47e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 -- 172.21.15.22:0/3959171725 shutdown_connections 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 --2- 172.21.15.22:0/3959171725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00caa90 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 --2- 172.21.15.22:0/3959171725 >> v2:172.21.15.192:3300/0 conn(0x7f47f006c0a0 0x7f47f015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 -- 172.21.15.22:0/3959171725 >> 172.21.15.22:0/3959171725 conn(0x7f47f00ce600 msgr2=0x7f47f00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 -- 172.21.15.22:0/3959171725 shutdown_connections 2023-10-08T00:32:05.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.718+0000 7f47f6669700 1 -- 172.21.15.22:0/3959171725 wait complete. 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.719+0000 7f47f6669700 1 Processor -- start 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.719+0000 7f47f6669700 1 -- start start 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f6669700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f6669700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47f006c0a0 0x7f47f00c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f6669700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47f015df50 0x7f47f0154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f6669700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f00b1b90 con 0x7f47f006bcd0 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f6669700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f00b1de0 con 0x7f47f006c0a0 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f6669700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f00b20c0 con 0x7f47f015df50 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37756/0 (socket says 172.21.15.22:37756) 2023-10-08T00:32:05.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 -- 172.21.15.22:0/3494545432 learned_addr learned my addr 172.21.15.22:0/3494545432 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47ef7fe700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47f006c0a0 0x7f47f00c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47f4c06700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47f015df50 0x7f47f0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 -- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47f015df50 msgr2=0x7f47f0154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47f015df50 0x7f47f0154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 -- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47f006c0a0 msgr2=0x7f47f00c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47f006c0a0 0x7f47f00c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47effff700 1 -- 172.21.15.22:0/3494545432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0009420 con 0x7f47f006bcd0 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.720+0000 7f47ef7fe700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47f006c0a0 0x7f47f00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.721+0000 7f47effff700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00c78d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f47f0069220 tx=0x7f47e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.721+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000bb90 con 0x7f47f006bcd0 2023-10-08T00:32:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.721+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0011420 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.721+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f00b23a0 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.721+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e00117e0 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.721+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f00c7e10 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.722+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f0064ed0 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.722+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f47e0011c10 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.723+0000 7f47d7fff700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f47dc067320 0x7f47dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.723+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f47e00866e0 con 0x7f47f006bcd0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.723+0000 7f47ef7fe700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f47dc067320 0x7f47dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:05.726 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.723+0000 7f47ef7fe700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f47dc067320 0x7f47dc0697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47f00c98e0 tx=0x7f47e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:05.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.727+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47e0053290 con 0x7f47f006bcd0 2023-10-08T00:32:05.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.964+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47f004c3c0 con 0x7f47f006bcd0 2023-10-08T00:32:05.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.965+0000 7f47d7fff700 1 -- 172.21.15.22:0/3494545432 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f47e00568b0 con 0x7f47f006bcd0 2023-10-08T00:32:05.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:05.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2226811664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2226811664},{"type":"v1","addr":"172.21.15.192:6837","nonce":2226811664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4060208673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4060208673},{"type":"v1","addr":"172.21.15.22:6834","nonce":4060208673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:39.444812+0000","modified":"2023-10-08T00:31:43.058497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7200":{"gid":7200,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/1343084597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1343084597},{"type":"v1","addr":"172.21.15.22:6835","nonce":1343084597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T00:32:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.966+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f47dc067320 msgr2=0x7f47dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.966+0000 7f47f6669700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f47dc067320 0x7f47dc0697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f47f00c98e0 tx=0x7f47e4008040 comp rx=0 tx=0).stop 2023-10-08T00:32:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 msgr2=0x7f47f00c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00c78d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f47f0069220 tx=0x7f47e0017000 comp rx=0 tx=0).stop 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 shutdown_connections 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f47dc067320 0x7f47dc0697d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f47f015df50 0x7f47f0154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f006bcd0 0x7f47f00c78d0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 --2- 172.21.15.22:0/3494545432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47f006c0a0 0x7f47f00c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 >> 172.21.15.22:0/3494545432 conn(0x7f47f00ce600 msgr2=0x7f47f00cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 shutdown_connections 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:05.967+0000 7f47f6669700 1 -- 172.21.15.22:0/3494545432 wait complete. 2023-10-08T00:32:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 88 2023-10-08T00:32:05.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:06.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 Processor -- start 2023-10-08T00:32:06.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 -- start start 2023-10-08T00:32:06.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 0x7f61a415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61a4069560 0x7f61a40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a415a160 con 0x7f61a4159c60 2023-10-08T00:32:06.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a4069f20 con 0x7f61a4069560 2023-10-08T00:32:06.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.098+0000 7f61aad9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40d13a0 con 0x7f61a4159890 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f61a4159c60 0x7f61a415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51244/0 (socket says 172.21.15.22:51244) 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a3fff700 1 -- 172.21.15.22:0/3336593838 learned_addr learned my addr 172.21.15.22:0/3336593838 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a8b3a700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 0x7f61a415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a933b700 1 --2- 172.21.15.22:0/3336593838 >> v2:172.21.15.192:3300/0 conn(0x7f61a4069560 0x7f61a40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151923960 0 0) 0x7f61a415a160 con 0x7f61a4159c60 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6190003570 con 0x7f61a4159c60 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1321744219 0 0) 0x7f6190003570 con 0x7f61a4159c60 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 msgr2=0x7f61a415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 0x7f61a415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 >> v2:172.21.15.192:3300/0 conn(0x7f61a4069560 msgr2=0x7f61a40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 --2- 172.21.15.22:0/3336593838 >> v2:172.21.15.192:3300/0 conn(0x7f61a4069560 0x7f61a40699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a415e140 con 0x7f61a4159c60 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f61940017f0 con 0x7f61a4159c60 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 >> v1:172.21.15.22:6789/0 conn(0x7f61a4159c60 legacy=0x7f61a415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 0x7f6190003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6190003fe0 0x7f6190004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190004d50 0x7f61900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4069f20 con 0x7f6190003fe0 2023-10-08T00:32:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40d13a0 con 0x7f6190004d50 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619000ba90 con 0x7f61a4159890 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6190003fe0 0x7f6190004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a8b3a700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 0x7f6190003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.099+0000 7f61a933b700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190004d50 0x7f61900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a3fff700 1 -- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 msgr2=0x7f6190003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61a4159890 0x7f6190003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a3fff700 1 -- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190004d50 msgr2=0x7f61900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190004d50 0x7f61900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a3fff700 1 -- 172.21.15.22:0/3336593838 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190003570 con 0x7f6190003fe0 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a933b700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6190004d50 0x7f61900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6190003fe0 0x7f6190004810 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f619400a940 tx=0x7f6194002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd702535c57c5df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194012440 con 0x7f6190003fe0 2023-10-08T00:32:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61940125a0 con 0x7f6190003fe0 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a37fe700 1 -- 172.21.15.22:0/3336593838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194012960 con 0x7f6190003fe0 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61aad9e700 1 -- 172.21.15.22:0/3336593838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6190003fe0 msgr2=0x7f6190004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3336593838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6190003fe0 0x7f6190004810 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f619400a940 tx=0x7f6194002210 comp rx=0 tx=0).stop 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61a933b700 1 -- 172.21.15.22:0/3336593838 reap_dead start 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61aad9e700 1 -- 172.21.15.22:0/3336593838 shutdown_connections 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.100+0000 7f61aad9e700 1 -- 172.21.15.22:0/3336593838 >> 172.21.15.22:0/3336593838 conn(0x7f61a4068e20 msgr2=0x7f61a40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.101+0000 7f61aad9e700 1 -- 172.21.15.22:0/3336593838 shutdown_connections 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.101+0000 7f61aad9e700 1 -- 172.21.15.22:0/3336593838 wait complete. 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 Processor -- start 2023-10-08T00:32:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 -- start start 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6190003fe0 0x7f61a416cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 0x7f61a415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a40cfcf0 0x7f61a415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40c78a0 con 0x7f61a416d4e0 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a416d960 con 0x7f61a40cfcf0 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.102+0000 7f61aad9e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a416dc40 con 0x7f6190003fe0 2023-10-08T00:32:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 0x7f61a415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 0x7f61a415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37778/0 (socket says 172.21.15.22:37778) 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 -- 172.21.15.22:0/3387198639 learned_addr learned my addr 172.21.15.22:0/3387198639 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a8b3a700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6190003fe0 0x7f61a416cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a933b700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a40cfcf0 0x7f61a415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 -- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6190003fe0 msgr2=0x7f61a416cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6190003fe0 0x7f61a416cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 -- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a40cfcf0 msgr2=0x7f61a415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a40cfcf0 0x7f61a415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 -- 172.21.15.22:0/3387198639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40b3730 con 0x7f61a416d4e0 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a933b700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a40cfcf0 0x7f61a415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a3fff700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 0x7f61a415c650 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6190004730 tx=0x7f6194015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6194001f30 con 0x7f61a416d4e0 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619401f410 con 0x7f61a416d4e0 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619401f7d0 con 0x7f61a416d4e0 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a40c78a0 con 0x7f61a416d4e0 2023-10-08T00:32:06.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.103+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a414d5a0 con 0x7f61a416d4e0 2023-10-08T00:32:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.104+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a40b3590 con 0x7f61a416d4e0 2023-10-08T00:32:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.105+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f619401fb80 con 0x7f61a416d4e0 2023-10-08T00:32:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.105+0000 7f61a0ff9700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6184067320 0x7f61840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.105+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f6194086e70 con 0x7f61a416d4e0 2023-10-08T00:32:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.105+0000 7f61a8b3a700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6184067320 0x7f61840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.106+0000 7f61a8b3a700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6184067320 0x7f61840697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f618c006dc0 tx=0x7f618c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.109+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61a40b3590 con 0x7f61a416d4e0 2023-10-08T00:32:06.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.344+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61a40b3590 con 0x7f61a416d4e0 2023-10-08T00:32:06.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.344+0000 7f61a0ff9700 1 -- 172.21.15.22:0/3387198639 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f61a40b3590 con 0x7f61a416d4e0 2023-10-08T00:32:06.345 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:06.345 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":88,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2226811664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2226811664},{"type":"v1","addr":"172.21.15.192:6837","nonce":2226811664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4060208673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4060208673},{"type":"v1","addr":"172.21.15.22:6834","nonce":4060208673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:31:39.444812+0000","modified":"2023-10-08T00:31:43.058497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7200},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7200":{"gid":7200,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/1343084597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":1343084597},{"type":"v1","addr":"172.21.15.22:6835","nonce":1343084597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T00:32:06.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6184067320 msgr2=0x7f61840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6184067320 0x7f61840697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f618c006dc0 tx=0x7f618c008040 comp rx=0 tx=0).stop 2023-10-08T00:32:06.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 msgr2=0x7f61a415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 0x7f61a415c650 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f6190004730 tx=0x7f6194015000 comp rx=0 tx=0).stop 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 shutdown_connections 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a40cfcf0 0x7f61a415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6184067320 0x7f61840697d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6190003fe0 0x7f61a416cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 --2- 172.21.15.22:0/3387198639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a416d4e0 0x7f61a415c650 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 >> 172.21.15.22:0/3387198639 conn(0x7f61a4068e20 msgr2=0x7f61a4158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 shutdown_connections 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.346+0000 7f61aad9e700 1 -- 172.21.15.22:0/3387198639 wait complete. 2023-10-08T00:32:06.348 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 88 2023-10-08T00:32:06.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.477+0000 7fe9f3e37700 1 Processor -- start 2023-10-08T00:32:06.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.478+0000 7fe9f3e37700 1 -- start start 2023-10-08T00:32:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.478+0000 7fe9f3e37700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 0x7fe9ec15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.478+0000 7fe9f3e37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 0x7fe9ec15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f3e37700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec15a160 con 0x7fe9ec15db10 2023-10-08T00:32:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f3e37700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0d13a0 con 0x7fe9ec159890 2023-10-08T00:32:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f3e37700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15e140 con 0x7fe9ec159c60 2023-10-08T00:32:06.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f1bd3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 0x7fe9ec15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f13d2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 0x7fe9ec15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f1bd3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 0x7fe9ec15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:39806/0 (socket says 172.21.15.22:39806) 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f13d2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 0x7fe9ec15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:44226/0 (socket says 172.21.15.22:44226) 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f1bd3700 1 -- 172.21.15.22:0/4208578587 learned_addr learned my addr 172.21.15.22:0/4208578587 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f23d4700 1 --1- 172.21.15.22:0/4208578587 >> v1:172.21.15.192:6789/0 conn(0x7fe9ec15db10 0x7fe9ec069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:53758/0 (socket says 172.21.15.22:53758) 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f13d2700 1 -- 172.21.15.22:0/4208578587 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 msgr2=0x7fe9ec15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f13d2700 1 --2- 172.21.15.22:0/4208578587 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 0x7fe9ec15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f13d2700 1 -- 172.21.15.22:0/4208578587 >> v1:172.21.15.192:6789/0 conn(0x7fe9ec15db10 legacy=0x7fe9ec069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f13d2700 1 -- 172.21.15.22:0/4208578587 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec15a3d0 con 0x7fe9ec159c60 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.479+0000 7fe9f1bd3700 1 --2- 172.21.15.22:0/4208578587 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 0x7fe9ec15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f13d2700 1 --2- 172.21.15.22:0/4208578587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 0x7fe9ec15d5d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00098e0 tx=0x7fe9e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa75e0cb381ef05f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f0bd1700 1 -- 172.21.15.22:0/4208578587 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e000b640 con 0x7fe9ec159c60 2023-10-08T00:32:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f0bd1700 1 -- 172.21.15.22:0/4208578587 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e000b7a0 con 0x7fe9ec159c60 2023-10-08T00:32:06.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f0bd1700 1 -- 172.21.15.22:0/4208578587 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e000bb40 con 0x7fe9ec159c60 2023-10-08T00:32:06.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 -- 172.21.15.22:0/4208578587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 msgr2=0x7fe9ec15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/4208578587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 0x7fe9ec15d5d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00098e0 tx=0x7fe9e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 -- 172.21.15.22:0/4208578587 shutdown_connections 2023-10-08T00:32:06.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/4208578587 >> v2:172.21.15.192:3300/0 conn(0x7fe9ec159890 0x7fe9ec15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/4208578587 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159c60 0x7fe9ec15d5d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 -- 172.21.15.22:0/4208578587 >> 172.21.15.22:0/4208578587 conn(0x7fe9ec068e20 msgr2=0x7fe9ec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 -- 172.21.15.22:0/4208578587 shutdown_connections 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.480+0000 7fe9f3e37700 1 -- 172.21.15.22:0/4208578587 wait complete. 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.481+0000 7fe9f3e37700 1 Processor -- start 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.481+0000 7fe9f3e37700 1 -- start start 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f3e37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159890 0x7fe9ec0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f3e37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec159c60 0x7fe9ec15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f3e37700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 0x7fe9ec1421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f3e37700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0ce2b0 con 0x7fe9ec15db10 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f3e37700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15c5b0 con 0x7fe9ec159c60 2023-10-08T00:32:06.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f3e37700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cd6a0 con 0x7fe9ec159890 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f23d4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 0x7fe9ec1421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f23d4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 0x7fe9ec1421c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37788/0 (socket says 172.21.15.22:37788) 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f23d4700 1 -- 172.21.15.22:0/2460992247 learned_addr learned my addr 172.21.15.22:0/2460992247 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f1bd3700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159890 0x7fe9ec0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.482+0000 7fe9f13d2700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec159c60 0x7fe9ec15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f23d4700 1 -- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159890 msgr2=0x7fe9ec0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f23d4700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159890 0x7fe9ec0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f23d4700 1 -- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec159c60 msgr2=0x7fe9ec15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f23d4700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec159c60 0x7fe9ec15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f23d4700 1 -- 172.21.15.22:0/2460992247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc009ae0 con 0x7fe9ec15db10 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f23d4700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 0x7fe9ec1421c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c4e0 tx=0x7fe9e4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400ce90 con 0x7fe9ec15db10 2023-10-08T00:32:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4005a70 con 0x7fe9ec15db10 2023-10-08T00:32:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e0009420 con 0x7fe9ec15db10 2023-10-08T00:32:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4005e10 con 0x7fe9ec15db10 2023-10-08T00:32:06.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.483+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0cdc60 con 0x7fe9ec15db10 2023-10-08T00:32:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.484+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec0ce420 con 0x7fe9ec15db10 2023-10-08T00:32:06.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.485+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe9e40072e0 con 0x7fe9ec15db10 2023-10-08T00:32:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.485+0000 7fe9e9ffb700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe9d8067320 0x7fe9d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.485+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fe9e4084070 con 0x7fe9ec15db10 2023-10-08T00:32:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.485+0000 7fe9f1bd3700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe9d8067320 0x7fe9d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.486+0000 7fe9f1bd3700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe9d8067320 0x7fe9d80697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec153750 tx=0x7fe9dc00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.489+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9e4050c20 con 0x7fe9ec15db10 2023-10-08T00:32:06.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.683+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9ec04c3c0 con 0x7fe9ec15db10 2023-10-08T00:32:06.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.684+0000 7fe9e9ffb700 1 -- 172.21.15.22:0/2460992247 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15723 (secure 0 0 0) 0x7fe9e4017020 con 0x7fe9ec15db10 2023-10-08T00:32:06.685 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:06.685 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":129,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:02.873287+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:31:37.857153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T00:31:38.408003+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.22","mappings":[{"from":2,"to":0}]},{"pgid":"19.32","mappings":[{"from":2,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6834/3522181155":"2023-10-09T00:31:56.440155+0000","172.21.15.192:6837/1568259552":"2023-10-09T00:31:59.868602+0000","172.21.15.192:6835/1568259552":"2023-10-09T00:31:59.868602+0000","172.21.15.22:6832/3522181155":"2023-10-09T00:31:56.440155+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:06.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe9d8067320 msgr2=0x7fe9d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe9d8067320 0x7fe9d80697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec153750 tx=0x7fe9dc00b040 comp rx=0 tx=0).stop 2023-10-08T00:32:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 msgr2=0x7fe9ec1421c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 0x7fe9ec1421c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c4e0 tx=0x7fe9e4007f50 comp rx=0 tx=0).stop 2023-10-08T00:32:06.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 shutdown_connections 2023-10-08T00:32:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ec15db10 0x7fe9ec1421c0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe9d8067320 0x7fe9d80697d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe9ec159890 0x7fe9ec0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 --2- 172.21.15.22:0/2460992247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9ec159c60 0x7fe9ec15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 >> 172.21.15.22:0/2460992247 conn(0x7fe9ec068e20 msgr2=0x7fe9ec069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:06.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 shutdown_connections 2023-10-08T00:32:06.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.686+0000 7fe9f3e37700 1 -- 172.21.15.22:0/2460992247 wait complete. 2023-10-08T00:32:06.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:32:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 Processor -- start 2023-10-08T00:32:06.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 -- start start 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 0x7f8148068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f814806f810 0x7f8148159510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814806ec70 con 0x7f814815e010 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81480b3430 con 0x7f814806f810 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.821+0000 7f814d5dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814806fc90 con 0x7f8148068550 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 0x7f8148068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 0x7f8148068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:48220/0 (socket says 172.21.15.22:48220) 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f81477fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f814806f810 0x7f8148159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 -- 172.21.15.22:0/499333984 learned_addr learned my addr 172.21.15.22:0/499333984 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 -- 172.21.15.22:0/499333984 >> v2:172.21.15.192:3300/0 conn(0x7f814806f810 msgr2=0x7f8148159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 --2- 172.21.15.22:0/499333984 >> v2:172.21.15.192:3300/0 conn(0x7f814806f810 0x7f8148159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 -- 172.21.15.22:0/499333984 >> v1:172.21.15.192:6789/0 conn(0x7f814815e010 legacy=0x7f814806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 -- 172.21.15.22:0/499333984 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480b2e70 con 0x7f8148068550 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8146ffd700 1 --2- 172.21.15.22:0/499333984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 0x7f8148068920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8140009f20 tx=0x7f8140009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8818a61df4594e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.822+0000 7f8145ffb700 1 -- 172.21.15.22:0/499333984 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000e070 con 0x7f8148068550 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f8145ffb700 1 -- 172.21.15.22:0/499333984 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814000b9d0 con 0x7f8148068550 2023-10-08T00:32:06.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f8145ffb700 1 -- 172.21.15.22:0/499333984 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400092e0 con 0x7f8148068550 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 -- 172.21.15.22:0/499333984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 msgr2=0x7f8148068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 --2- 172.21.15.22:0/499333984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 0x7f8148068920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8140009f20 tx=0x7f8140009840 comp rx=0 tx=0).stop 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 -- 172.21.15.22:0/499333984 shutdown_connections 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 --2- 172.21.15.22:0/499333984 >> v2:172.21.15.192:3300/0 conn(0x7f814806f810 0x7f8148159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 --2- 172.21.15.22:0/499333984 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8148068550 0x7f8148068920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 -- 172.21.15.22:0/499333984 >> 172.21.15.22:0/499333984 conn(0x7f81480cd480 msgr2=0x7f81480cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:06.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 -- 172.21.15.22:0/499333984 shutdown_connections 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.823+0000 7f814d5dd700 1 -- 172.21.15.22:0/499333984 wait complete. 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.824+0000 7f814d5dd700 1 Processor -- start 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.824+0000 7f814d5dd700 1 -- start start 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f814d5dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8148068550 0x7f8148140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f814d5dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 0x7f81480af290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f814d5dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814815e010 0x7f81480af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f814d5dd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814816b7f0 con 0x7f814806f810 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f814d5dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814816ab60 con 0x7f8148068550 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f814d5dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8148140fc0 con 0x7f814815e010 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f81467fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 0x7f81480af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f81467fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 0x7f81480af290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45428/0 (socket says 172.21.15.22:45428) 2023-10-08T00:32:06.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f81467fc700 1 -- 172.21.15.22:0/873568809 learned_addr learned my addr 172.21.15.22:0/873568809 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f8146ffd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8148068550 0x7f8148140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.825+0000 7f81477fe700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814815e010 0x7f81480af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f81467fc700 1 -- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814815e010 msgr2=0x7f81480af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f81467fc700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814815e010 0x7f81480af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f81467fc700 1 -- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8148068550 msgr2=0x7f8148140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f81467fc700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8148068550 0x7f8148140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f81467fc700 1 -- 172.21.15.22:0/873568809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8140009ae0 con 0x7f814806f810 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f8146ffd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8148068550 0x7f8148140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f81467fc700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 0x7f81480af290 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f813000c4e0 tx=0x7f813000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130011590 con 0x7f814806f810 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130011710 con 0x7f814806f810 2023-10-08T00:32:06.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814816aec0 con 0x7f814806f810 2023-10-08T00:32:06.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130011ad0 con 0x7f814806f810 2023-10-08T00:32:06.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.826+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814816b480 con 0x7f814806f810 2023-10-08T00:32:06.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.827+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814816b9a0 con 0x7f814806f810 2023-10-08T00:32:06.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.827+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f813001b3b0 con 0x7f814806f810 2023-10-08T00:32:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.828+0000 7f813effd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128067320 0x7f81280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.828+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f81300840e0 con 0x7f814806f810 2023-10-08T00:32:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.828+0000 7f8146ffd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128067320 0x7f81280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:06.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.828+0000 7f8146ffd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128067320 0x7f81280697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8140009880 tx=0x7f8140018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:06.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:06.832+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f814816b9a0 con 0x7f814806f810 2023-10-08T00:32:07.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.073+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f814816b9a0 con 0x7f814806f810 2023-10-08T00:32:07.074 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:32:07.074+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:32:07.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.078+0000 7f813effd700 1 -- 172.21.15.22:0/873568809 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) v1 ==== 161+0+0 (secure 0 0 0) 0x7f814816b9a0 con 0x7f814806f810 2023-10-08T00:32:07.079 INFO:tasks.ceph.mds.c.smithi022.stderr: -1368> 2023-10-08T00:31:45.632+0000 7f9c334a7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128067320 msgr2=0x7f81280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128067320 0x7f81280697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8140009880 tx=0x7f8140018000 comp rx=0 tx=0).stop 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 msgr2=0x7f81480af290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 0x7f81480af290 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f813000c4e0 tx=0x7f813000c7f0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 shutdown_connections 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8128067320 0x7f81280697d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f814815e010 0x7f81480af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8148068550 0x7f8148140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 --2- 172.21.15.22:0/873568809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f814806f810 0x7f81480af290 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 >> 172.21.15.22:0/873568809 conn(0x7f81480cd480 msgr2=0x7f8148157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:07.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 shutdown_connections 2023-10-08T00:32:07.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.080+0000 7f814d5dd700 1 -- 172.21.15.22:0/873568809 wait complete. 2023-10-08T00:32:07.082 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:32:07.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:32:07.102 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:32:07.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.215+0000 7f0a6eeb7700 1 Processor -- start 2023-10-08T00:32:07.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.215+0000 7f0a6eeb7700 1 -- start start 2023-10-08T00:32:07.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.215+0000 7f0a6eeb7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a680b4e70 0x7f0a680ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:07.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6eeb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 0x7f0a6815d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:07.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6eeb7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a680cfb00 con 0x7f0a680b16d0 2023-10-08T00:32:07.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6eeb7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a680b5c40 con 0x7f0a680b4e70 2023-10-08T00:32:07.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6eeb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680b5f20 con 0x7f0a680b1b40 2023-10-08T00:32:07.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 0x7f0a6815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:07.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6deb5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0a680b4e70 0x7f0a680ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:07.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 0x7f0a6815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:48250/0 (socket says 172.21.15.22:48250) 2023-10-08T00:32:07.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 -- 172.21.15.22:0/347994850 learned_addr learned my addr 172.21.15.22:0/347994850 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:07.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 -- 172.21.15.22:0/347994850 >> v2:172.21.15.192:3300/0 conn(0x7f0a680b4e70 msgr2=0x7f0a680ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:07.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 --2- 172.21.15.22:0/347994850 >> v2:172.21.15.192:3300/0 conn(0x7f0a680b4e70 0x7f0a680ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 -- 172.21.15.22:0/347994850 >> v1:172.21.15.192:6789/0 conn(0x7f0a680b16d0 legacy=0x7f0a6815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6e6b6700 1 -- 172.21.15.22:0/347994850 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680b6200 con 0x7f0a680b1b40 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.216+0000 7f0a6deb5700 1 --2- 172.21.15.22:0/347994850 >> v2:172.21.15.192:3300/0 conn(0x7f0a680b4e70 0x7f0a680ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6e6b6700 1 --2- 172.21.15.22:0/347994850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 0x7f0a6815d950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a600099b0 tx=0x7f0a60009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b4a80fca38b2e31 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6ceb3700 1 -- 172.21.15.22:0/347994850 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60009ea0 con 0x7f0a680b1b40 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6ceb3700 1 -- 172.21.15.22:0/347994850 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6000b860 con 0x7f0a680b1b40 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6ceb3700 1 -- 172.21.15.22:0/347994850 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000bc00 con 0x7f0a680b1b40 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/347994850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 msgr2=0x7f0a6815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/347994850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 0x7f0a6815d950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0a600099b0 tx=0x7f0a60009250 comp rx=0 tx=0).stop 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/347994850 shutdown_connections 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/347994850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b1b40 0x7f0a6815d950 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/347994850 >> v2:172.21.15.192:3300/0 conn(0x7f0a680b4e70 0x7f0a680ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/347994850 >> 172.21.15.22:0/347994850 conn(0x7f0a680d10c0 msgr2=0x7f0a680affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:07.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/347994850 shutdown_connections 2023-10-08T00:32:07.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.217+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/347994850 wait complete. 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.218+0000 7f0a6eeb7700 1 Processor -- start 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.218+0000 7f0a6eeb7700 1 -- start start 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6eeb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b16d0 0x7f0a6814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6eeb7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 0x7f0a68158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6eeb7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a680b4e70 0x7f0a68159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6eeb7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680cab60 con 0x7f0a680b1b40 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6eeb7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6814c680 con 0x7f0a680b4e70 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6eeb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a680c7d70 con 0x7f0a680b16d0 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6d6b4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 0x7f0a68158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6deb5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b16d0 0x7f0a6814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6d6b4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 0x7f0a68158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45470/0 (socket says 172.21.15.22:45470) 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6d6b4700 1 -- 172.21.15.22:0/2004875853 learned_addr learned my addr 172.21.15.22:0/2004875853 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.219+0000 7f0a6e6b6700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a680b4e70 0x7f0a68159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6d6b4700 1 -- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b16d0 msgr2=0x7f0a6814c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6d6b4700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b16d0 0x7f0a6814c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6d6b4700 1 -- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a680b4e70 msgr2=0x7f0a68159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6d6b4700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a680b4e70 0x7f0a68159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6d6b4700 1 -- 172.21.15.22:0/2004875853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58009a20 con 0x7f0a680b1b40 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6d6b4700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 0x7f0a68158bf0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c510 tx=0x7f0a5c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c011590 con 0x7f0a680b1b40 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c011710 con 0x7f0a680b1b40 2023-10-08T00:32:07.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a600094f0 con 0x7f0a680b1b40 2023-10-08T00:32:07.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c011ad0 con 0x7f0a680b1b40 2023-10-08T00:32:07.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.220+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a680c7720 con 0x7f0a680b1b40 2023-10-08T00:32:07.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.221+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a680c7580 con 0x7f0a680b1b40 2023-10-08T00:32:07.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.221+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a5c01b3b0 con 0x7f0a680b1b40 2023-10-08T00:32:07.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.222+0000 7f0a65ffb700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a54067320 0x7f0a540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:07.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.222+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f0a5c084140 con 0x7f0a680b1b40 2023-10-08T00:32:07.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.222+0000 7f0a6deb5700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a54067320 0x7f0a540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:07.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.223+0000 7f0a6deb5700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a54067320 0x7f0a540697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009fd0 tx=0x7f0a5800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:07.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.226+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a680c7580 con 0x7f0a680b1b40 2023-10-08T00:32:07.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:07.469+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a680c7580 con 0x7f0a680b1b40 2023-10-08T00:32:08.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.078+0000 7f0a65ffb700 1 -- 172.21.15.22:0/2004875853 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a680c7580 con 0x7f0a680b1b40 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a54067320 msgr2=0x7f0a540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a54067320 0x7f0a540697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009fd0 tx=0x7f0a5800b040 comp rx=0 tx=0).stop 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 msgr2=0x7f0a68158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 0x7f0a68158bf0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00c510 tx=0x7f0a5c00c820 comp rx=0 tx=0).stop 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 shutdown_connections 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a680b4e70 0x7f0a68159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a54067320 0x7f0a540697d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a680b16d0 0x7f0a6814c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 --2- 172.21.15.22:0/2004875853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a680b1b40 0x7f0a68158bf0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 >> 172.21.15.22:0/2004875853 conn(0x7f0a680d10c0 msgr2=0x7f0a680b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:08.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 shutdown_connections 2023-10-08T00:32:08.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.080+0000 7f0a6eeb7700 1 -- 172.21.15.22:0/2004875853 wait complete. 2023-10-08T00:32:08.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:32:08.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.259+0000 7eff6f740700 1 Processor -- start 2023-10-08T00:32:08.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.260+0000 7eff6f740700 1 -- start start 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.260+0000 7eff6f740700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7eff68159ec0 0x7eff680b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.260+0000 7eff6f740700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff680b53d0 0x7eff680cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.260+0000 7eff6f740700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff680b5b00 con 0x7eff680cce40 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.260+0000 7eff6f740700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff680b5850 con 0x7eff68159ec0 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.260+0000 7eff6f740700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff680b5da0 con 0x7eff680b53d0 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6dcdd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7eff680cce40 0x7eff680cd2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37596/0 (socket says 172.21.15.22:37596) 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6dcdd700 1 -- 172.21.15.22:0/559733057 learned_addr learned my addr 172.21.15.22:0/559733057 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:08.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6ccdb700 1 --2- 172.21.15.22:0/559733057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff680b53d0 0x7eff680cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6d4dc700 1 --2- 172.21.15.22:0/559733057 >> v2:172.21.15.192:3300/0 conn(0x7eff68159ec0 0x7eff680b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff67fff700 1 -- 172.21.15.22:0/559733057 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931976115 0 0) 0x7eff680b5b00 con 0x7eff680cce40 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff67fff700 1 -- 172.21.15.22:0/559733057 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff50003570 con 0x7eff680cce40 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6ccdb700 1 -- 172.21.15.22:0/559733057 >> v2:172.21.15.192:3300/0 conn(0x7eff68159ec0 msgr2=0x7eff680b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6ccdb700 1 --2- 172.21.15.22:0/559733057 >> v2:172.21.15.192:3300/0 conn(0x7eff68159ec0 0x7eff680b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6ccdb700 1 -- 172.21.15.22:0/559733057 >> v1:172.21.15.22:6789/0 conn(0x7eff680cce40 legacy=0x7eff680cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff67fff700 1 -- 172.21.15.22:0/559733057 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446608159 0 0) 0x7eff50003570 con 0x7eff680cce40 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6ccdb700 1 -- 172.21.15.22:0/559733057 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680b6080 con 0x7eff680b53d0 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff6ccdb700 1 --2- 172.21.15.22:0/559733057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff680b53d0 0x7eff680cc900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0098e0 tx=0x7eff5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf55da793da02513 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:08.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.261+0000 7eff67fff700 1 -- 172.21.15.22:0/559733057 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580017f0 con 0x7eff680b53d0 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff67fff700 1 -- 172.21.15.22:0/559733057 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c011420 con 0x7eff680b53d0 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff67fff700 1 -- 172.21.15.22:0/559733057 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c0117a0 con 0x7eff680b53d0 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 -- 172.21.15.22:0/559733057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff680b53d0 msgr2=0x7eff680cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 --2- 172.21.15.22:0/559733057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff680b53d0 0x7eff680cc900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0098e0 tx=0x7eff5c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 -- 172.21.15.22:0/559733057 shutdown_connections 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 --2- 172.21.15.22:0/559733057 >> v2:172.21.15.192:3300/0 conn(0x7eff68159ec0 0x7eff680b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 --2- 172.21.15.22:0/559733057 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff680b53d0 0x7eff680cc900 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 -- 172.21.15.22:0/559733057 >> 172.21.15.22:0/559733057 conn(0x7eff680999f0 msgr2=0x7eff680b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 -- 172.21.15.22:0/559733057 shutdown_connections 2023-10-08T00:32:08.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.262+0000 7eff6f740700 1 -- 172.21.15.22:0/559733057 wait complete. 2023-10-08T00:32:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.263+0000 7eff6f740700 1 Processor -- start 2023-10-08T00:32:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.263+0000 7eff6f740700 1 -- start start 2023-10-08T00:32:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6f740700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 0x7eff68069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6f740700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff680cce40 0x7eff681570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:08.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6f740700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff68159ec0 0x7eff680c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6f740700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6806a250 con 0x7eff680b53d0 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6f740700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68157600 con 0x7eff680cce40 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6f740700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6809c0f0 con 0x7eff68159ec0 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6d4dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 0x7eff68069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6d4dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 0x7eff68069d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45484/0 (socket says 172.21.15.22:45484) 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6d4dc700 1 -- 172.21.15.22:0/738871748 learned_addr learned my addr 172.21.15.22:0/738871748 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6dcdd700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff68159ec0 0x7eff680c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.264+0000 7eff6ccdb700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff680cce40 0x7eff681570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:08.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6d4dc700 1 -- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff68159ec0 msgr2=0x7eff680c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6d4dc700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff68159ec0 0x7eff680c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6d4dc700 1 -- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff680cce40 msgr2=0x7eff681570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6d4dc700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff680cce40 0x7eff681570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6d4dc700 1 -- 172.21.15.22:0/738871748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009420 con 0x7eff680b53d0 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6d4dc700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 0x7eff68069d10 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7eff6000ecb0 tx=0x7eff60009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000c850 con 0x7eff680b53d0 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6000c9b0 con 0x7eff680b53d0 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6809cf50 con 0x7eff680b53d0 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000cd30 con 0x7eff680b53d0 2023-10-08T00:32:08.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.265+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6809c900 con 0x7eff680b53d0 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.266+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff68063c90 con 0x7eff680b53d0 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.267+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff60013680 con 0x7eff680b53d0 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.267+0000 7eff657fa700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff54067320 0x7eff540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.267+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6021+0+0 (secure 0 0 0) 0x7eff600853b0 con 0x7eff680b53d0 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.267+0000 7eff6ccdb700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff54067320 0x7eff540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.268+0000 7eff6ccdb700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff54067320 0x7eff540697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0091e0 tx=0x7eff5c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:08.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.271+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff60051f00 con 0x7eff680b53d0 2023-10-08T00:32:08.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:08.464+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7eff680718b0 con 0x7eff680b53d0 2023-10-08T00:32:09.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.083+0000 7eff657fa700 1 -- 172.21.15.22:0/738871748 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) v1 ==== 181+0+0 (secure 0 0 0) 0x7eff60055520 con 0x7eff680b53d0 2023-10-08T00:32:09.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.087+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff54067320 msgr2=0x7eff540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:09.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.087+0000 7eff6f740700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff54067320 0x7eff540697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0091e0 tx=0x7eff5c016000 comp rx=0 tx=0).stop 2023-10-08T00:32:09.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.087+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 msgr2=0x7eff68069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:09.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.087+0000 7eff6f740700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 0x7eff68069d10 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7eff6000ecb0 tx=0x7eff60009120 comp rx=0 tx=0).stop 2023-10-08T00:32:09.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 shutdown_connections 2023-10-08T00:32:09.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff54067320 0x7eff540697d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff68159ec0 0x7eff680c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff680b53d0 0x7eff68069d10 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 --2- 172.21.15.22:0/738871748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff680cce40 0x7eff681570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 >> 172.21.15.22:0/738871748 conn(0x7eff680999f0 msgr2=0x7eff680cf270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 shutdown_connections 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.088+0000 7eff6f740700 1 -- 172.21.15.22:0/738871748 wait complete. 2023-10-08T00:32:09.089 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:32:09.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:32:09.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.228+0000 7fc1a5958700 1 Processor -- start 2023-10-08T00:32:09.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.228+0000 7fc1a5958700 1 -- start start 2023-10-08T00:32:09.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc1a5958700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc1a0140c90 0x7fc1a0141060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc1a5958700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1750 0x7fc1a00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc1a5958700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a00cd2e0 con 0x7fc1a00b1ba0 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc1a5958700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a00cc6d0 con 0x7fc1a0140c90 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc1a5958700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00cc9b0 con 0x7fc1a00b1750 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc19effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc1a0140c90 0x7fc1a0141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc19effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc1a0140c90 0x7fc1a0141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45496/0 (socket says 172.21.15.22:45496) 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc19effd700 1 -- 172.21.15.22:0/1873971817 learned_addr learned my addr 172.21.15.22:0/1873971817 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.229+0000 7fc19e7fc700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1750 0x7fc1a00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19effd700 1 -- 172.21.15.22:0/1873971817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1750 msgr2=0x7fc1a00cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:09.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19effd700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1750 0x7fc1a00cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19effd700 1 -- 172.21.15.22:0/1873971817 >> v1:172.21.15.192:6789/0 conn(0x7fc1a00b1ba0 legacy=0x7fc1a00b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19effd700 1 -- 172.21.15.22:0/1873971817 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a00ccc90 con 0x7fc1a0140c90 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19e7fc700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1750 0x7fc1a00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19effd700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a0141060 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc1980099b0 tx=0x7fc198009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56db4078cd5fedab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19dffb700 1 -- 172.21.15.22:0/1873971817 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800b860 con 0x7fc1a0140c90 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19dffb700 1 -- 172.21.15.22:0/1873971817 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19800b9c0 con 0x7fc1a0140c90 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc19dffb700 1 -- 172.21.15.22:0/1873971817 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19800bd60 con 0x7fc1a0140c90 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 -- 172.21.15.22:0/1873971817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 msgr2=0x7fc1a0141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a0141060 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc1980099b0 tx=0x7fc198009250 comp rx=0 tx=0).stop 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 -- 172.21.15.22:0/1873971817 shutdown_connections 2023-10-08T00:32:09.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a0141060 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 --2- 172.21.15.22:0/1873971817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1750 0x7fc1a00cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 -- 172.21.15.22:0/1873971817 >> 172.21.15.22:0/1873971817 conn(0x7fc1a006d1e0 msgr2=0x7fc1a006d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:09.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.230+0000 7fc1a5958700 1 -- 172.21.15.22:0/1873971817 shutdown_connections 2023-10-08T00:32:09.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.231+0000 7fc1a5958700 1 -- 172.21.15.22:0/1873971817 wait complete. 2023-10-08T00:32:09.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.232+0000 7fc1a5958700 1 Processor -- start 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.232+0000 7fc1a5958700 1 -- start start 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1a00b1750 0x7fc1a00b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1ba0 0x7fc1a00ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a00c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00b27f0 con 0x7fc1a0140c90 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00aea00 con 0x7fc1a00b1750 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a00aece0 con 0x7fc1a00b1ba0 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a00c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a00c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45510/0 (socket says 172.21.15.22:45510) 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 -- 172.21.15.22:0/3731809977 learned_addr learned my addr 172.21.15.22:0/3731809977 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:09.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19e7fc700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1ba0 0x7fc1a00ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19effd700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1a00b1750 0x7fc1a00b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 -- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1ba0 msgr2=0x7fc1a00ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1ba0 0x7fc1a00ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 -- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1a00b1750 msgr2=0x7fc1a00b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1a00b1750 0x7fc1a00b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 -- 172.21.15.22:0/3731809977 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1980094f0 con 0x7fc1a0140c90 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc19f7fe700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a00c9810 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c8e0 tx=0x7fc190001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000ce80 con 0x7fc1a0140c90 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19000a7e0 con 0x7fc1a0140c90 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a00b2130 con 0x7fc1a0140c90 2023-10-08T00:32:09.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19000ab80 con 0x7fc1a0140c90 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.233+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a00ae680 con 0x7fc1a0140c90 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.234+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a004c3c0 con 0x7fc1a0140c90 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.235+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc190012420 con 0x7fc1a0140c90 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.235+0000 7fc196ffd700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc180067320 0x7fc1800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.235+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5583+0+0 (secure 0 0 0) 0x7fc190084ee0 con 0x7fc1a0140c90 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.236+0000 7fc19effd700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc180067320 0x7fc1800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:09.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.236+0000 7fc19effd700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc180067320 0x7fc1800697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc1980099b0 tx=0x7fc198017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:09.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.240+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc190051bb0 con 0x7fc1a0140c90 2023-10-08T00:32:09.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:09.434+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1a00ccf70 con 0x7fc1a0140c90 2023-10-08T00:32:10.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.086+0000 7fc196ffd700 1 -- 172.21.15.22:0/3731809977 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc1900551d0 con 0x7fc1a0140c90 2023-10-08T00:32:10.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.092+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc180067320 msgr2=0x7fc1800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.092+0000 7fc1a5958700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc180067320 0x7fc1800697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc1980099b0 tx=0x7fc198017000 comp rx=0 tx=0).stop 2023-10-08T00:32:10.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.092+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 msgr2=0x7fc1a00c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.092+0000 7fc1a5958700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a00c9810 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc19000c8e0 tx=0x7fc190001710 comp rx=0 tx=0).stop 2023-10-08T00:32:10.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 shutdown_connections 2023-10-08T00:32:10.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1a0140c90 0x7fc1a00c9810 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc1a00b1750 0x7fc1a00b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc180067320 0x7fc1800697d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 --2- 172.21.15.22:0/3731809977 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1a00b1ba0 0x7fc1a00ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 >> 172.21.15.22:0/3731809977 conn(0x7fc1a006d1e0 msgr2=0x7fc1a0156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:10.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.093+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 shutdown_connections 2023-10-08T00:32:10.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.095+0000 7fc1a5958700 1 -- 172.21.15.22:0/3731809977 wait complete. 2023-10-08T00:32:10.097 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:32:10.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:32:10.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.244+0000 7fc69451a700 1 Processor -- start 2023-10-08T00:32:10.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.244+0000 7fc69451a700 1 -- start start 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc69451a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 0x7fc68c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc69451a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c069ee0 con 0x7fc68c159c60 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc69451a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c15a160 con 0x7fc68c159890 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc69451a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0d13a0 con 0x7fc68c069560 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc691ab5700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc68c159c60 0x7fc68c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37612/0 (socket says 172.21.15.22:37612) 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc691ab5700 1 -- 172.21.15.22:0/3953275901 learned_addr learned my addr 172.21.15.22:0/3953275901 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 0x7fc68c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447588743 0 0) 0x7fc68c069ee0 con 0x7fc68c159c60 2023-10-08T00:32:10.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc674003570 con 0x7fc68c159c60 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2210332181 0 0) 0x7fc674003570 con 0x7fc68c159c60 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 msgr2=0x7fc68c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 0x7fc68c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 >> v1:172.21.15.192:6789/0 conn(0x7fc68c159890 legacy=0x7fc68c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c15e140 con 0x7fc68c159c60 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fc680001470 con 0x7fc68c159c60 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 >> v1:172.21.15.22:6789/0 conn(0x7fc68c159c60 legacy=0x7fc68c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674003a90 0x7fc674003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 0x7fc674004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc674004d50 0x7fc6740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0d13a0 con 0x7fc674004d50 2023-10-08T00:32:10.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67400bba0 con 0x7fc674003a90 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.245+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67400bd60 con 0x7fc68c069560 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc674004d50 0x7fc6740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc6922b6700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674003a90 0x7fc674003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc691ab5700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 0x7fc674004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 -- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 msgr2=0x7fc674004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c069560 0x7fc674004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 -- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674003a90 msgr2=0x7fc674003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674003a90 0x7fc674003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 -- 172.21.15.22:0/3953275901 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674003570 con 0x7fc674004d50 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc674004d50 0x7fc6740051c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fc68400e210 tx=0x7fc68400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbc9abdd1b6613d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:10.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400eac0 con 0x7fc674004d50 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68400f040 con 0x7fc674004d50 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.246+0000 7fc6912b4700 1 -- 172.21.15.22:0/3953275901 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400ee70 con 0x7fc674004d50 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc69451a700 1 -- 172.21.15.22:0/3953275901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc674004d50 msgr2=0x7fc6740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc69451a700 1 --2- 172.21.15.22:0/3953275901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc674004d50 0x7fc6740051c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fc68400e210 tx=0x7fc68400b040 comp rx=0 tx=0).stop 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc692ab7700 1 -- 172.21.15.22:0/3953275901 reap_dead start 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc69451a700 1 -- 172.21.15.22:0/3953275901 shutdown_connections 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc69451a700 1 -- 172.21.15.22:0/3953275901 >> 172.21.15.22:0/3953275901 conn(0x7fc68c068e20 msgr2=0x7fc68c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc69451a700 1 -- 172.21.15.22:0/3953275901 shutdown_connections 2023-10-08T00:32:10.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.247+0000 7fc69451a700 1 -- 172.21.15.22:0/3953275901 wait complete. 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.248+0000 7fc69451a700 1 Processor -- start 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.248+0000 7fc69451a700 1 -- start start 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc69451a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674004d50 0x7fc68c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc69451a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c158bf0 0x7fc68c14d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc69451a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 0x7fc68c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc69451a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0cfbf0 con 0x7fc68c0cf210 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc69451a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0b6400 con 0x7fc674004d50 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc69451a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0b5290 con 0x7fc68c158bf0 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 0x7fc68c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 0x7fc68c0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45528/0 (socket says 172.21.15.22:45528) 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 -- 172.21.15.22:0/3865058232 learned_addr learned my addr 172.21.15.22:0/3865058232 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc691ab5700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c158bf0 0x7fc68c14d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc6922b6700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674004d50 0x7fc68c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 -- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c158bf0 msgr2=0x7fc68c14d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c158bf0 0x7fc68c14d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 -- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674004d50 msgr2=0x7fc68c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674004d50 0x7fc68c0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 -- 172.21.15.22:0/3865058232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0b36c0 con 0x7fc68c0cf210 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc6922b6700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674004d50 0x7fc68c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc692ab7700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 0x7fc68c0cf6b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fc684016000 tx=0x7fc68401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68401e640 con 0x7fc68c0cf210 2023-10-08T00:32:10.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684022070 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.249+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68401ea50 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.250+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c0b39a0 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.250+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c0b3f60 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.250+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c0b4150 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.251+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc684003040 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.251+0000 7fc68a7fc700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc678067320 0x7fc6780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.251+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fc684024070 con 0x7fc68c0cf210 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.252+0000 7fc6922b6700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc678067320 0x7fc6780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.252+0000 7fc6922b6700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc678067320 0x7fc6780697d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc68c06a070 tx=0x7fc67c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:10.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.256+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc684053510 con 0x7fc68c0cf210 2023-10-08T00:32:10.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.450+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc68c04c3c0 con 0x7fc68c0cf210 2023-10-08T00:32:10.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.453+0000 7fc68a7fc700 1 -- 172.21.15.22:0/3865058232 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc684056b30 con 0x7fc68c0cf210 2023-10-08T00:32:10.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.455+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc678067320 msgr2=0x7fc6780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.455+0000 7fc69451a700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc678067320 0x7fc6780697d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc68c06a070 tx=0x7fc67c009040 comp rx=0 tx=0).stop 2023-10-08T00:32:10.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.455+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 msgr2=0x7fc68c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.455+0000 7fc69451a700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 0x7fc68c0cf6b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fc684016000 tx=0x7fc68401a000 comp rx=0 tx=0).stop 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 shutdown_connections 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc68c0cf210 0x7fc68c0cf6b0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc674004d50 0x7fc68c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc678067320 0x7fc6780697d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 --2- 172.21.15.22:0/3865058232 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc68c158bf0 0x7fc68c14d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 >> 172.21.15.22:0/3865058232 conn(0x7fc68c068e20 msgr2=0x7fc68c0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 shutdown_connections 2023-10-08T00:32:10.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.456+0000 7fc69451a700 1 -- 172.21.15.22:0/3865058232 wait complete. 2023-10-08T00:32:10.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-08T00:32:10.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.587+0000 7fb847513700 1 Processor -- start 2023-10-08T00:32:10.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.587+0000 7fb847513700 1 -- start start 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb847513700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb847513700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400b2980 con 0x7fb84015d230 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb847513700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400b11d0 con 0x7fb8401597f0 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb847513700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400b14b0 con 0x7fb840159420 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb846511700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb846d12700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb84015d230 0x7fb84015d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37626/0 (socket says 172.21.15.22:37626) 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb846d12700 1 -- 172.21.15.22:0/1206437855 learned_addr learned my addr 172.21.15.22:0/1206437855 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:10.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb846511700 1 -- 172.21.15.22:0/1206437855 >> v1:172.21.15.192:6789/0 conn(0x7fb8401597f0 legacy=0x7fb8400b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb846511700 1 -- 172.21.15.22:0/1206437855 >> v1:172.21.15.22:6789/0 conn(0x7fb84015d230 legacy=0x7fb84015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb846511700 1 -- 172.21.15.22:0/1206437855 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400b1790 con 0x7fb840159420 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.588+0000 7fb84550f700 1 -- 172.21.15.22:0/1206437855 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966794403 0 0) 0x7fb8400b2980 con 0x7fb84015d230 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb846511700 1 --2- 172.21.15.22:0/1206437855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400b5f40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fb8300098e0 tx=0x7fb8300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70616338d1ee94ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb84550f700 1 -- 172.21.15.22:0/1206437855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830009e80 con 0x7fb840159420 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb84550f700 1 -- 172.21.15.22:0/1206437855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83000b820 con 0x7fb840159420 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb84550f700 1 -- 172.21.15.22:0/1206437855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000bba0 con 0x7fb840159420 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 -- 172.21.15.22:0/1206437855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 msgr2=0x7fb8400b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 --2- 172.21.15.22:0/1206437855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400b5f40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fb8300098e0 tx=0x7fb8300091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 -- 172.21.15.22:0/1206437855 shutdown_connections 2023-10-08T00:32:10.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 --2- 172.21.15.22:0/1206437855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400b5f40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 -- 172.21.15.22:0/1206437855 >> 172.21.15.22:0/1206437855 conn(0x7fb8400d0660 msgr2=0x7fb8400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 -- 172.21.15.22:0/1206437855 shutdown_connections 2023-10-08T00:32:10.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.589+0000 7fb847513700 1 -- 172.21.15.22:0/1206437855 wait complete. 2023-10-08T00:32:10.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.590+0000 7fb847513700 1 Processor -- start 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 -- start start 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8401597f0 0x7fb84016a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb8400c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c80e0 con 0x7fb840159420 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84016bf70 con 0x7fb8401597f0 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb847513700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c5940 con 0x7fb84015d230 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb846511700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb846511700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45536/0 (socket says 172.21.15.22:45536) 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.591+0000 7fb846511700 1 -- 172.21.15.22:0/4013096783 learned_addr learned my addr 172.21.15.22:0/4013096783 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846d12700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb8400c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb845d10700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8401597f0 0x7fb84016a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846511700 1 -- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 msgr2=0x7fb8400c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846511700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb8400c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846511700 1 -- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8401597f0 msgr2=0x7fb84016a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846511700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8401597f0 0x7fb84016a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846511700 1 -- 172.21.15.22:0/4013096783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830009420 con 0x7fb840159420 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846d12700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb8400c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb845d10700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8401597f0 0x7fb84016a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb846511700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400c5400 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fb840089340 tx=0x7fb830016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000bae0 con 0x7fb840159420 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830020070 con 0x7fb840159420 2023-10-08T00:32:10.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83001b6a0 con 0x7fb840159420 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84016ac20 con 0x7fb840159420 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.592+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84016b640 con 0x7fb840159420 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.593+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84004c3c0 con 0x7fb840159420 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.593+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb830022030 con 0x7fb840159420 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.594+0000 7fb83e7fc700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c067320 0x7fb82c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.594+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fb830086930 con 0x7fb840159420 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.594+0000 7fb845d10700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c067320 0x7fb82c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.595+0000 7fb845d10700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c067320 0x7fb82c0697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb84016ae10 tx=0x7fb834009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:10.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.598+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb830053920 con 0x7fb840159420 2023-10-08T00:32:10.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:10.871+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7fb84004c3c0 con 0x7fb840159420 2023-10-08T00:32:11.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.096+0000 7fb83e7fc700 1 -- 172.21.15.22:0/4013096783 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v357) v1 ==== 131+0+0 (secure 0 0 0) 0x7fb830056f40 con 0x7fb840159420 2023-10-08T00:32:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c067320 msgr2=0x7fb82c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c067320 0x7fb82c0697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb84016ae10 tx=0x7fb834009040 comp rx=0 tx=0).stop 2023-10-08T00:32:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 msgr2=0x7fb8400c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400c5400 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fb840089340 tx=0x7fb830016000 comp rx=0 tx=0).stop 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 shutdown_connections 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb82c067320 0x7fb82c0697d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb84015d230 0x7fb8400c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb840159420 0x7fb8400c5400 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.098+0000 7fb847513700 1 --2- 172.21.15.22:0/4013096783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8401597f0 0x7fb84016a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.099+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 >> 172.21.15.22:0/4013096783 conn(0x7fb8400d0660 msgr2=0x7fb840156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.099+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 shutdown_connections 2023-10-08T00:32:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.099+0000 7fb847513700 1 -- 172.21.15.22:0/4013096783 wait complete. 2023-10-08T00:32:11.112 INFO:tasks.cephfs_test_runner:That the existing and the newly created volumes can be listed and ... ok 2023-10-08T00:32:11.112 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) That volume, its file system and pools, can be renamed. 2023-10-08T00:32:11.112 INFO:tasks.cephfs_test_runner:test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:32:11.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-08T00:32:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.232+0000 7f211a39f700 1 Processor -- start 2023-10-08T00:32:11.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.232+0000 7f211a39f700 1 -- start start 2023-10-08T00:32:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f211a39f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114142ea0 0x7f21140b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f211a39f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f21140ad870 0x7f211406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f211a39f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21140b40f0 con 0x7f21140b3b70 2023-10-08T00:32:11.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f211a39f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2114069640 con 0x7f21140ad870 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f211a39f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2114069920 con 0x7f2114142ea0 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f2118b9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f21140ad870 0x7f211406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f2119b9e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f21140b3b70 0x7f211406cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37630/0 (socket says 172.21.15.22:37630) 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f2118b9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f21140ad870 0x7f211406b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45538/0 (socket says 172.21.15.22:45538) 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f2119b9e700 1 -- 172.21.15.22:0/4179263685 learned_addr learned my addr 172.21.15.22:0/4179263685 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.233+0000 7f211939d700 1 --2- 172.21.15.22:0/4179263685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114142ea0 0x7f21140b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2118b9c700 1 -- 172.21.15.22:0/4179263685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114142ea0 msgr2=0x7f21140b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2118b9c700 1 --2- 172.21.15.22:0/4179263685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114142ea0 0x7f21140b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2118b9c700 1 -- 172.21.15.22:0/4179263685 >> v1:172.21.15.22:6789/0 conn(0x7f21140b3b70 legacy=0x7f211406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2113fff700 1 -- 172.21.15.22:0/4179263685 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247064050 0 0) 0x7f21140b40f0 con 0x7f21140b3b70 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2118b9c700 1 -- 172.21.15.22:0/4179263685 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114069c00 con 0x7f21140ad870 2023-10-08T00:32:11.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2118b9c700 1 --2- 172.21.15.22:0/4179263685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140ad870 0x7f211406b9e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f21080098e0 tx=0x7f21080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31936be4c4d51c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2113fff700 1 -- 172.21.15.22:0/4179263685 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800b640 con 0x7f21140ad870 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2113fff700 1 -- 172.21.15.22:0/4179263685 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800b7a0 con 0x7f21140ad870 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f2113fff700 1 -- 172.21.15.22:0/4179263685 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800bb40 con 0x7f21140ad870 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f211a39f700 1 -- 172.21.15.22:0/4179263685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140ad870 msgr2=0x7f211406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f211a39f700 1 --2- 172.21.15.22:0/4179263685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140ad870 0x7f211406b9e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f21080098e0 tx=0x7f21080091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.234+0000 7f211a39f700 1 -- 172.21.15.22:0/4179263685 shutdown_connections 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.235+0000 7f211a39f700 1 --2- 172.21.15.22:0/4179263685 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114142ea0 0x7f21140b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.235+0000 7f211a39f700 1 --2- 172.21.15.22:0/4179263685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21140ad870 0x7f211406b9e0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.235+0000 7f211a39f700 1 -- 172.21.15.22:0/4179263685 >> 172.21.15.22:0/4179263685 conn(0x7f21140ce430 msgr2=0x7f21140ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.235+0000 7f211a39f700 1 -- 172.21.15.22:0/4179263685 shutdown_connections 2023-10-08T00:32:11.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.235+0000 7f211a39f700 1 -- 172.21.15.22:0/4179263685 wait complete. 2023-10-08T00:32:11.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.236+0000 7f211a39f700 1 Processor -- start 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.236+0000 7f211a39f700 1 -- start start 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21140b3b70 0x7f21140c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 0x7f21140af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114158c70 0x7f21141590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211413dbb0 con 0x7f2114142ea0 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21140c8530 con 0x7f21140b3b70 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2114159610 con 0x7f2114158c70 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 0x7f21140af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 0x7f21140af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45544/0 (socket says 172.21.15.22:45544) 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 -- 172.21.15.22:0/2619942016 learned_addr learned my addr 172.21.15.22:0/2619942016 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211939d700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21140b3b70 0x7f21140c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:11.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2119b9e700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114158c70 0x7f21141590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 -- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114158c70 msgr2=0x7f21141590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114158c70 0x7f21141590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 -- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21140b3b70 msgr2=0x7f21140c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21140b3b70 0x7f21140c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 -- 172.21.15.22:0/2619942016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009420 con 0x7f2114142ea0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211939d700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21140b3b70 0x7f21140c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f2118b9c700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 0x7f21140af740 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f211406f0d0 tx=0x7f2108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800bb20 con 0x7f2114142ea0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108011420 con 0x7f2114142ea0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080117c0 con 0x7f2114142ea0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.237+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211413b640 con 0x7f2114142ea0 2023-10-08T00:32:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.238+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211413bc00 con 0x7f2114142ea0 2023-10-08T00:32:11.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.238+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211404c3c0 con 0x7f2114142ea0 2023-10-08T00:32:11.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.239+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2108011b70 con 0x7f2114142ea0 2023-10-08T00:32:11.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.239+0000 7f21117fa700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2100067320 0x7f21000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:11.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.239+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f2108086100 con 0x7f2114142ea0 2023-10-08T00:32:11.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.240+0000 7f211939d700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2100067320 0x7f21000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:11.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.240+0000 7f211939d700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2100067320 0x7f21000697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2104007640 tx=0x7f210400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:11.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.244+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2108052fe0 con 0x7f2114142ea0 2023-10-08T00:32:11.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:11.517+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f2114143270 con 0x7f2114142ea0 2023-10-08T00:32:12.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.097+0000 7f21117fa700 1 -- 172.21.15.22:0/2619942016 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v358) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2108056600 con 0x7f2114142ea0 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2100067320 msgr2=0x7f21000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2100067320 0x7f21000697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2104007640 tx=0x7f210400b040 comp rx=0 tx=0).stop 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 msgr2=0x7f21140af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 0x7f21140af740 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f211406f0d0 tx=0x7f2108017000 comp rx=0 tx=0).stop 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 shutdown_connections 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2100067320 0x7f21000697d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2114158c70 0x7f21141590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21140b3b70 0x7f21140c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 --2- 172.21.15.22:0/2619942016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2114142ea0 0x7f21140af740 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 >> 172.21.15.22:0/2619942016 conn(0x7f21140ce430 msgr2=0x7f21140cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 shutdown_connections 2023-10-08T00:32:12.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.100+0000 7f211a39f700 1 -- 172.21.15.22:0/2619942016 wait complete. 2023-10-08T00:32:12.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.239+0000 7f9e99b2c700 1 Processor -- start 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.239+0000 7f9e99b2c700 1 -- start start 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e99b2c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e940c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e99b2c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e9406c0a0 0x7f9e940c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e99b2c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9415c2a0 con 0x7f9e9406bcd0 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e99b2c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e940c9880 con 0x7f9e9406c0a0 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e99b2c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9415b690 con 0x7f9e94141500 2023-10-08T00:32:12.245 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e9406c0a0 0x7f9e940c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e9406c0a0 0x7f9e940c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45554/0 (socket says 172.21.15.22:45554) 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 -- 172.21.15.22:0/4065315981 learned_addr learned my addr 172.21.15.22:0/4065315981 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e92ffd700 1 --2- 172.21.15.22:0/4065315981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e940c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 -- 172.21.15.22:0/4065315981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 msgr2=0x7f9e940c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 --2- 172.21.15.22:0/4065315981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e940c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 -- 172.21.15.22:0/4065315981 >> v1:172.21.15.192:6789/0 conn(0x7f9e9406bcd0 legacy=0x7f9e94140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 -- 172.21.15.22:0/4065315981 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9415b970 con 0x7f9e9406c0a0 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e93fff700 1 --2- 172.21.15.22:0/4065315981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e940c9340 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009f20 tx=0x7f9e8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6847bb21d97fef64 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.240+0000 7f9e927fc700 1 -- 172.21.15.22:0/4065315981 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00e070 con 0x7f9e9406c0a0 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e927fc700 1 -- 172.21.15.22:0/4065315981 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8c00ba40 con 0x7f9e9406c0a0 2023-10-08T00:32:12.246 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e927fc700 1 -- 172.21.15.22:0/4065315981 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0092e0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 -- 172.21.15.22:0/4065315981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 msgr2=0x7f9e940c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/4065315981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e940c9340 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c009f20 tx=0x7f9e8c009840 comp rx=0 tx=0).stop 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 -- 172.21.15.22:0/4065315981 shutdown_connections 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/4065315981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e940c9340 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/4065315981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e940c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 -- 172.21.15.22:0/4065315981 >> 172.21.15.22:0/4065315981 conn(0x7f9e940ce600 msgr2=0x7f9e940cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 -- 172.21.15.22:0/4065315981 shutdown_connections 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.241+0000 7f9e99b2c700 1 -- 172.21.15.22:0/4065315981 wait complete. 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.242+0000 7f9e99b2c700 1 Processor -- start 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.242+0000 7f9e99b2c700 1 -- start start 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e99b2c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9406bcd0 0x7f9e94157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e99b2c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e9413e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e99b2c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e9413ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e99b2c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940c56b0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e99b2c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940c6510 con 0x7f9e9406bcd0 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e99b2c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9413f260 con 0x7f9e94141500 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e9413e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e9413e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45562/0 (socket says 172.21.15.22:45562) 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 -- 172.21.15.22:0/770700367 learned_addr learned my addr 172.21.15.22:0/770700367 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e937fe700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9406bcd0 0x7f9e94157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e93fff700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e9413ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 -- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 msgr2=0x7f9e9413ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e9413ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 -- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9406bcd0 msgr2=0x7f9e94157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9406bcd0 0x7f9e94157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e92ffd700 1 -- 172.21.15.22:0/770700367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009ae0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.243+0000 7f9e93fff700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e9413ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.244+0000 7f9e92ffd700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e9413e7e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800d890 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.244+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880125f0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.244+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88012750 con 0x7f9e9406c0a0 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.244+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e940c5900 con 0x7f9e9406c0a0 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.244+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88012b10 con 0x7f9e9406c0a0 2023-10-08T00:32:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.244+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e940c5ec0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.245+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e940c66a0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.245+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9e8801e460 con 0x7f9e9406c0a0 2023-10-08T00:32:12.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.246+0000 7f9e7b7fe700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e80067320 0x7f9e800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.246+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f9e88084fc0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.246+0000 7f9e937fe700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e80067320 0x7f9e800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.247+0000 7f9e937fe700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e80067320 0x7f9e800697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9e84003a30 tx=0x7f9e84007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:12.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.250+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e88051ea0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.443+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9e9415bc50 con 0x7f9e9406c0a0 2023-10-08T00:32:12.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.447+0000 7f9e7b7fe700 1 -- 172.21.15.22:0/770700367 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9e880554c0 con 0x7f9e9406c0a0 2023-10-08T00:32:12.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e80067320 msgr2=0x7f9e800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e80067320 0x7f9e800697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9e84003a30 tx=0x7f9e84007ea0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 msgr2=0x7f9e9413e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e9413e7e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f9e8800d890 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 shutdown_connections 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9e80067320 0x7f9e800697d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9e94141500 0x7f9e9413ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e9406bcd0 0x7f9e94157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 --2- 172.21.15.22:0/770700367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e9406c0a0 0x7f9e9413e7e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 >> 172.21.15.22:0/770700367 conn(0x7f9e940ce600 msgr2=0x7f9e940c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:12.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 shutdown_connections 2023-10-08T00:32:12.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.449+0000 7f9e99b2c700 1 -- 172.21.15.22:0/770700367 wait complete. 2023-10-08T00:32:12.461 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:32:12.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:12.504 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:12.545 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:32:12.546 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:32:12.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.665+0000 7fa6b788f700 1 Processor -- start 2023-10-08T00:32:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.665+0000 7fa6b788f700 1 -- start start 2023-10-08T00:32:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b788f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa6b0159c60 0x7fa6b015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b788f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b015a160 con 0x7fa6b015db10 2023-10-08T00:32:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b788f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00d13a0 con 0x7fa6b0159890 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b788f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b015df50 con 0x7fa6b0159c60 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b4e2a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa6b0159c60 0x7fa6b015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b5e2c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa6b015db10 0x7fa6b0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37634/0 (socket says 172.21.15.22:37634) 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b5e2c700 1 -- 172.21.15.22:0/3833687808 learned_addr learned my addr 172.21.15.22:0/3833687808 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b4e2a700 1 -- 172.21.15.22:0/3833687808 >> v1:172.21.15.192:6789/0 conn(0x7fa6b0159890 legacy=0x7fa6b015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b4e2a700 1 -- 172.21.15.22:0/3833687808 >> v1:172.21.15.22:6789/0 conn(0x7fa6b015db10 legacy=0x7fa6b0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b4e2a700 1 -- 172.21.15.22:0/3833687808 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b015e140 con 0x7fa6b0159c60 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6affff700 1 -- 172.21.15.22:0/3833687808 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912899899 0 0) 0x7fa6b015a160 con 0x7fa6b015db10 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6b4e2a700 1 --2- 172.21.15.22:0/3833687808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159c60 0x7fa6b015d5d0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40098e0 tx=0x7fa6a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccf258b141b1248 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6affff700 1 -- 172.21.15.22:0/3833687808 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4009e80 con 0x7fa6b0159c60 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6affff700 1 -- 172.21.15.22:0/3833687808 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a400b820 con 0x7fa6b0159c60 2023-10-08T00:32:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.666+0000 7fa6affff700 1 -- 172.21.15.22:0/3833687808 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400bba0 con 0x7fa6b0159c60 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 -- 172.21.15.22:0/3833687808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159c60 msgr2=0x7fa6b015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 --2- 172.21.15.22:0/3833687808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159c60 0x7fa6b015d5d0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40098e0 tx=0x7fa6a40091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 -- 172.21.15.22:0/3833687808 shutdown_connections 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 --2- 172.21.15.22:0/3833687808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159c60 0x7fa6b015d5d0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 -- 172.21.15.22:0/3833687808 >> 172.21.15.22:0/3833687808 conn(0x7fa6b0068e20 msgr2=0x7fa6b00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 -- 172.21.15.22:0/3833687808 shutdown_connections 2023-10-08T00:32:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.667+0000 7fa6b788f700 1 -- 172.21.15.22:0/3833687808 wait complete. 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.668+0000 7fa6b788f700 1 Processor -- start 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.668+0000 7fa6b788f700 1 -- start start 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b788f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 0x7fa6b01474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b788f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6b0159c60 0x7fa6b00cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b788f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6b015db10 0x7fa6b00b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b788f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b016db40 con 0x7fa6b0159890 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b788f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b016cf70 con 0x7fa6b0159c60 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b788f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b016d210 con 0x7fa6b015db10 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 0x7fa6b01474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 0x7fa6b01474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45576/0 (socket says 172.21.15.22:45576) 2023-10-08T00:32:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 -- 172.21.15.22:0/722820222 learned_addr learned my addr 172.21.15.22:0/722820222 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b4e2a700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6b0159c60 0x7fa6b00cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 -- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6b015db10 msgr2=0x7fa6b00b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6b015db10 0x7fa6b00b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 -- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6b0159c60 msgr2=0x7fa6b00cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6b0159c60 0x7fa6b00cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 -- 172.21.15.22:0/722820222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a4009420 con 0x7fa6b0159890 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b4e2a700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6b0159c60 0x7fa6b00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.669+0000 7fa6b562b700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 0x7fa6b01474b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000bc30 tx=0x7fa6a0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.670+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000c9b0 con 0x7fa6b0159890 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.670+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000cb50 con 0x7fa6b0159890 2023-10-08T00:32:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.670+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b016d4f0 con 0x7fa6b0159890 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.670+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0014410 con 0x7fa6b0159890 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.670+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b00cf130 con 0x7fa6b0159890 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.671+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b004c3c0 con 0x7fa6b0159890 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.671+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa6a0014800 con 0x7fa6b0159890 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.671+0000 7fa6ad7fa700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa69c067320 0x7fa69c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.671+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5111+0+0 (secure 0 0 0) 0x7fa6a0084ad0 con 0x7fa6b0159890 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.672+0000 7fa6b4e2a700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa69c067320 0x7fa69c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.672+0000 7fa6b4e2a700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa69c067320 0x7fa69c0697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40030c0 tx=0x7fa6a4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.676+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6a004c5a0 con 0x7fa6b0159890 2023-10-08T00:32:12.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.914+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6b006a5b0 con 0x7fa6b0159890 2023-10-08T00:32:12.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.914+0000 7fa6ad7fa700 1 -- 172.21.15.22:0/722820222 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fa6a00519b0 con 0x7fa6b0159890 2023-10-08T00:32:12.915 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:12.915 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":90,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2715656479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2715656479},{"type":"v1","addr":"172.21.15.192:6836","nonce":2715656479}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":6769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2226811664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2226811664},{"type":"v1","addr":"172.21.15.192:6837","nonce":2226811664}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7413,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4060208673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4060208673},{"type":"v1","addr":"172.21.15.22:6834","nonce":4060208673}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":7500,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/56564350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":56564350},{"type":"v1","addr":"172.21.15.22:6835","nonce":56564350}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":90}],"filesystems":[]} 2023-10-08T00:32:12.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa69c067320 msgr2=0x7fa69c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa69c067320 0x7fa69c0697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40030c0 tx=0x7fa6a4016000 comp rx=0 tx=0).stop 2023-10-08T00:32:12.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 msgr2=0x7fa6b01474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:12.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 0x7fa6b01474b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000bc30 tx=0x7fa6a0009820 comp rx=0 tx=0).stop 2023-10-08T00:32:12.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 shutdown_connections 2023-10-08T00:32:12.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa69c067320 0x7fa69c0697d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa6b015db10 0x7fa6b00b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6b0159890 0x7fa6b01474b0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 --2- 172.21.15.22:0/722820222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6b0159c60 0x7fa6b00cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 >> 172.21.15.22:0/722820222 conn(0x7fa6b0068e20 msgr2=0x7fa6b01574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 shutdown_connections 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:12.916+0000 7fa6b788f700 1 -- 172.21.15.22:0/722820222 wait complete. 2023-10-08T00:32:12.918 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 90 2023-10-08T00:32:12.929 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:32:12.929 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:32:12.929 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:32:12.930 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:12.930 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:32:12.930 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:32:12.930 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:32:12.930 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:12.930 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:32:12.930 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:32:12.931 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:32:12.931 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:12.931 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:32:12.931 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:32:12.931 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:32:12.931 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:12.938 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:32:12.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:32:12.939 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:32:12.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:32:12.941 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:32:12.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:32:12.942 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:32:12.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:32:12.981 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:32:12.981 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:12.982 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:32:12.982 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:12.985 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:32:12.985 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:32:12.986 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:12.986 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:12.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:32:13.057 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:32:13.057 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:32:13.058 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:32:13.057+0000 7fe8672c3700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T00:32:13.064 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:32:13.064 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:32:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.114+0000 7f2b2ebfd700 1 Processor -- start 2023-10-08T00:32:13.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.114+0000 7f2b2ebfd700 1 -- start start 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2ebfd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b28159420 0x7f2b280b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2ebfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b2815d230 0x7f2b2815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2ebfd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b280b2980 con 0x7f2b281597f0 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2ebfd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2815dbb0 con 0x7f2b28159420 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2ebfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b11d0 con 0x7f2b2815d230 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2d3fa700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2b281597f0 0x7f2b280b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37650/0 (socket says 172.21.15.22:37650) 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2d3fa700 1 -- 172.21.15.22:0/105519737 learned_addr learned my addr 172.21.15.22:0/105519737 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2e3fc700 1 --2- 172.21.15.22:0/105519737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b2815d230 0x7f2b2815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.115+0000 7f2b2dbfb700 1 --2- 172.21.15.22:0/105519737 >> v2:172.21.15.192:3300/0 conn(0x7f2b28159420 0x7f2b280b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2cbf9700 1 -- 172.21.15.22:0/105519737 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166015461 0 0) 0x7f2b280b2980 con 0x7f2b281597f0 2023-10-08T00:32:13.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2cbf9700 1 -- 172.21.15.22:0/105519737 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b14003570 con 0x7f2b281597f0 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/105519737 >> v2:172.21.15.192:3300/0 conn(0x7f2b28159420 msgr2=0x7f2b280b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2e3fc700 1 --2- 172.21.15.22:0/105519737 >> v2:172.21.15.192:3300/0 conn(0x7f2b28159420 0x7f2b280b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/105519737 >> v1:172.21.15.22:6789/0 conn(0x7f2b281597f0 legacy=0x7f2b280b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/105519737 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280b14b0 con 0x7f2b2815d230 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2dbfb700 1 --2- 172.21.15.22:0/105519737 >> v2:172.21.15.192:3300/0 conn(0x7f2b28159420 0x7f2b280b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2e3fc700 1 --2- 172.21.15.22:0/105519737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b2815d230 0x7f2b2815d670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009e60 tx=0x7f2b20009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b999cea15b3b940 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2cbf9700 1 -- 172.21.15.22:0/105519737 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000e070 con 0x7f2b2815d230 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2cbf9700 1 -- 172.21.15.22:0/105519737 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000bab0 con 0x7f2b2815d230 2023-10-08T00:32:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.116+0000 7f2b2cbf9700 1 -- 172.21.15.22:0/105519737 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2000be70 con 0x7f2b2815d230 2023-10-08T00:32:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/105519737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b2815d230 msgr2=0x7f2b2815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/105519737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b2815d230 0x7f2b2815d670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009e60 tx=0x7f2b20009780 comp rx=0 tx=0).stop 2023-10-08T00:32:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/105519737 shutdown_connections 2023-10-08T00:32:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/105519737 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b2815d230 0x7f2b2815d670 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:13.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/105519737 >> v2:172.21.15.192:3300/0 conn(0x7f2b28159420 0x7f2b280b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/105519737 >> 172.21.15.22:0/105519737 conn(0x7f2b280d0660 msgr2=0x7f2b280d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/105519737 shutdown_connections 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.117+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/105519737 wait complete. 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.118+0000 7f2b2ebfd700 1 Processor -- start 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.118+0000 7f2b2ebfd700 1 -- start start 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2ebfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b28159420 0x7f2b28154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2ebfd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b281597f0 0x7f2b2815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:13.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2ebfd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 0x7f2b280b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2ebfd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815c010 con 0x7f2b2815d230 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2ebfd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815c2f0 con 0x7f2b281597f0 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2ebfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815c5d0 con 0x7f2b28159420 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 0x7f2b280b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 0x7f2b280b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45616/0 (socket says 172.21.15.22:45616) 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/3668791522 learned_addr learned my addr 172.21.15.22:0/3668791522 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2dbfb700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b28159420 0x7f2b28154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2d3fa700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b281597f0 0x7f2b2815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b28159420 msgr2=0x7f2b28154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b28159420 0x7f2b28154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b281597f0 msgr2=0x7f2b2815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:13.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b281597f0 0x7f2b2815b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 -- 172.21.15.22:0/3668791522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24009420 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b2e3fc700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 0x7f2b280b4e20 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2b280b1310 tx=0x7f2b20019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20027470 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.119+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b200275f0 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.120+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b20009a20 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.120+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b200279b0 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.120+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2815cb90 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.121+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2815cdb0 con 0x7f2b2815d230 2023-10-08T00:32:13.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.121+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2b20024070 con 0x7f2b2815d230 2023-10-08T00:32:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.121+0000 7f2b1dffb700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b0c067320 0x7f2b0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.121+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f2b20087430 con 0x7f2b2815d230 2023-10-08T00:32:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.122+0000 7f2b2dbfb700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b0c067320 0x7f2b0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:13.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.122+0000 7f2b2dbfb700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b0c067320 0x7f2b0c0697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2b240093f0 tx=0x7f2b24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:13.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.126+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b20054310 con 0x7f2b2815d230 2023-10-08T00:32:13.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:13.331+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2b2804c3c0 con 0x7f2b2815d230 2023-10-08T00:32:14.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.112+0000 7f2b1dffb700 1 -- 172.21.15.22:0/3668791522 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2b20057930 con 0x7f2b2815d230 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b0c067320 msgr2=0x7f2b0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b0c067320 0x7f2b0c0697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2b240093f0 tx=0x7f2b24008040 comp rx=0 tx=0).stop 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 msgr2=0x7f2b280b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 0x7f2b280b4e20 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2b280b1310 tx=0x7f2b20019000 comp rx=0 tx=0).stop 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 shutdown_connections 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b2815d230 0x7f2b280b4e20 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2b0c067320 0x7f2b0c0697d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2b28159420 0x7f2b28154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 --2- 172.21.15.22:0/3668791522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b281597f0 0x7f2b2815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 >> 172.21.15.22:0/3668791522 conn(0x7f2b280d0660 msgr2=0x7f2b28069660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 shutdown_connections 2023-10-08T00:32:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.115+0000 7f2b2ebfd700 1 -- 172.21.15.22:0/3668791522 wait complete. 2023-10-08T00:32:14.117 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:32:14.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:32:14.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.257+0000 7ff2a359e700 1 Processor -- start 2023-10-08T00:32:14.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.257+0000 7ff2a359e700 1 -- start start 2023-10-08T00:32:14.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2a4159420 0x7ff2a40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a359e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40b2980 con 0x7ff2a41597f0 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40b11d0 con 0x7ff2a415d230 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a359e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40b14b0 con 0x7ff2a4159420 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2a4159420 0x7ff2a40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a1d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff2a41597f0 0x7ff2a40b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37664/0 (socket says 172.21.15.22:37664) 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a1d9b700 1 -- 172.21.15.22:0/2970730684 learned_addr learned my addr 172.21.15.22:0/2970730684 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a259c700 1 -- 172.21.15.22:0/2970730684 >> v1:172.21.15.192:6789/0 conn(0x7ff2a415d230 legacy=0x7ff2a415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a259c700 1 -- 172.21.15.22:0/2970730684 >> v1:172.21.15.22:6789/0 conn(0x7ff2a41597f0 legacy=0x7ff2a40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a159a700 1 -- 172.21.15.22:0/2970730684 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382663754 0 0) 0x7ff2a40b2980 con 0x7ff2a41597f0 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a259c700 1 -- 172.21.15.22:0/2970730684 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40b1790 con 0x7ff2a4159420 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a259c700 1 --2- 172.21.15.22:0/2970730684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a4159420 0x7ff2a40b5f40 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0098e0 tx=0x7ff29c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2822f3e27ce81371 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:14.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a159a700 1 -- 172.21.15.22:0/2970730684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c009e80 con 0x7ff2a4159420 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.258+0000 7ff2a159a700 1 -- 172.21.15.22:0/2970730684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00b820 con 0x7ff2a4159420 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a159a700 1 -- 172.21.15.22:0/2970730684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00bba0 con 0x7ff2a4159420 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 -- 172.21.15.22:0/2970730684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a4159420 msgr2=0x7ff2a40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2970730684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a4159420 0x7ff2a40b5f40 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0098e0 tx=0x7ff29c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 -- 172.21.15.22:0/2970730684 shutdown_connections 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2970730684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a4159420 0x7ff2a40b5f40 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 -- 172.21.15.22:0/2970730684 >> 172.21.15.22:0/2970730684 conn(0x7ff2a40d0660 msgr2=0x7ff2a40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 -- 172.21.15.22:0/2970730684 shutdown_connections 2023-10-08T00:32:14.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.259+0000 7ff2a359e700 1 -- 172.21.15.22:0/2970730684 wait complete. 2023-10-08T00:32:14.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.260+0000 7ff2a359e700 1 Processor -- start 2023-10-08T00:32:14.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.260+0000 7ff2a359e700 1 -- start start 2023-10-08T00:32:14.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2a4159420 0x7ff2a4141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 0x7ff2a40b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415d230 0x7ff2a40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a359e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415c3b0 con 0x7ff2a41597f0 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415b7a0 con 0x7ff2a415d230 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a415ba80 con 0x7ff2a4159420 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 0x7ff2a40b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 0x7ff2a40b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45622/0 (socket says 172.21.15.22:45622) 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 -- 172.21.15.22:0/2849351961 learned_addr learned my addr 172.21.15.22:0/2849351961 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a259c700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2a4159420 0x7ff2a4141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a2d9d700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415d230 0x7ff2a40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 -- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2a4159420 msgr2=0x7ff2a4141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2a4159420 0x7ff2a4141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 -- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415d230 msgr2=0x7ff2a40b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415d230 0x7ff2a40b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.261+0000 7ff2a1d9b700 1 -- 172.21.15.22:0/2849351961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009420 con 0x7ff2a41597f0 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.262+0000 7ff2a1d9b700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 0x7ff2a40b5900 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c810 tx=0x7ff28c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.262+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c005c00 con 0x7ff2a41597f0 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.262+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c005d60 con 0x7ff2a41597f0 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.262+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a415bd60 con 0x7ff2a41597f0 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.262+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c007300 con 0x7ff2a41597f0 2023-10-08T00:32:14.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.262+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a4154280 con 0x7ff2a41597f0 2023-10-08T00:32:14.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.263+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a415c560 con 0x7ff2a41597f0 2023-10-08T00:32:14.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.263+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff28c01b3b0 con 0x7ff2a41597f0 2023-10-08T00:32:14.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.263+0000 7ff29a7fc700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff284067320 0x7ff2840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.264+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff28c083de0 con 0x7ff2a41597f0 2023-10-08T00:32:14.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.264+0000 7ff2a259c700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff284067320 0x7ff2840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.264+0000 7ff2a259c700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff284067320 0x7ff2840697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0030c0 tx=0x7ff29c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:14.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.268+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2a415c560 con 0x7ff2a41597f0 2023-10-08T00:32:14.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.541+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff2a404c3c0 con 0x7ff2a41597f0 2023-10-08T00:32:14.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.541+0000 7ff29a7fc700 1 -- 172.21.15.22:0/2849351961 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff28c017020 con 0x7ff2a41597f0 2023-10-08T00:32:14.542 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:14.543 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:32:14.543 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:32:14.543 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.543 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:32:14.543 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:32:14.544 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.544 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.544 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:14.544 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:14.544 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.546 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:32:14.547 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.548 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.549 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:32:14.550 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.551 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.552 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:32:14.553 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.554 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:32:14.555 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:14.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:14.557 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:32:14.559 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:32:14.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff284067320 msgr2=0x7ff2840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff284067320 0x7ff2840697d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0030c0 tx=0x7ff29c016000 comp rx=0 tx=0).stop 2023-10-08T00:32:14.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 msgr2=0x7ff2a40b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 0x7ff2a40b5900 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00c810 tx=0x7ff28c007db0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 shutdown_connections 2023-10-08T00:32:14.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415d230 0x7ff2a40b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff284067320 0x7ff2840697d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff2a4159420 0x7ff2a4141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 --2- 172.21.15.22:0/2849351961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a41597f0 0x7ff2a40b5900 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 >> 172.21.15.22:0/2849351961 conn(0x7ff2a40d0660 msgr2=0x7ff2a40b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:14.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 shutdown_connections 2023-10-08T00:32:14.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.543+0000 7ff2a359e700 1 -- 172.21.15.22:0/2849351961 wait complete. 2023-10-08T00:32:14.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.682+0000 7efde6033700 1 Processor -- start 2023-10-08T00:32:14.683 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.682+0000 7efde6033700 1 -- start start 2023-10-08T00:32:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efde6033700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efde0155c10 0x7efde0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efde6033700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde00ac6d0 0x7efde00b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efde6033700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00acac0 con 0x7efde00ac230 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efde6033700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00ad930 con 0x7efde0155c10 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efde6033700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00acd20 con 0x7efde00ac6d0 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efddeffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efde00ac230 0x7efde01568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37680/0 (socket says 172.21.15.22:37680) 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.683+0000 7efddeffd700 1 -- 172.21.15.22:0/2855342163 learned_addr learned my addr 172.21.15.22:0/2855342163 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddf7fe700 1 --2- 172.21.15.22:0/2855342163 >> v2:172.21.15.192:3300/0 conn(0x7efde0155c10 0x7efde0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddffff700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde00ac6d0 0x7efde00b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efdde7fc700 1 -- 172.21.15.22:0/2855342163 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970439719 0 0) 0x7efde00acac0 con 0x7efde00ac230 2023-10-08T00:32:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efdde7fc700 1 -- 172.21.15.22:0/2855342163 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc8003570 con 0x7efde00ac230 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddf7fe700 1 -- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde00ac6d0 msgr2=0x7efde00b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddf7fe700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde00ac6d0 0x7efde00b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddf7fe700 1 -- 172.21.15.22:0/2855342163 >> v1:172.21.15.22:6789/0 conn(0x7efde00ac230 legacy=0x7efde01568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddf7fe700 1 -- 172.21.15.22:0/2855342163 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00ad000 con 0x7efde0155c10 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddffff700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde00ac6d0 0x7efde00b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efddf7fe700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde0155c10 0x7efde0155fe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efde00acc50 tx=0x7efdd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60784db2728a36a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efdde7fc700 1 -- 172.21.15.22:0/2855342163 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011630 con 0x7efde0155c10 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efdde7fc700 1 -- 172.21.15.22:0/2855342163 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0011790 con 0x7efde0155c10 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.684+0000 7efdde7fc700 1 -- 172.21.15.22:0/2855342163 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011b50 con 0x7efde0155c10 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 -- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde0155c10 msgr2=0x7efde0155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde0155c10 0x7efde0155fe0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7efde00acc50 tx=0x7efdd00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 -- 172.21.15.22:0/2855342163 shutdown_connections 2023-10-08T00:32:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde00ac6d0 0x7efde00b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 --2- 172.21.15.22:0/2855342163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde0155c10 0x7efde0155fe0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 -- 172.21.15.22:0/2855342163 >> 172.21.15.22:0/2855342163 conn(0x7efde006a320 msgr2=0x7efde00cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 -- 172.21.15.22:0/2855342163 shutdown_connections 2023-10-08T00:32:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.685+0000 7efde6033700 1 -- 172.21.15.22:0/2855342163 wait complete. 2023-10-08T00:32:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.686+0000 7efde6033700 1 Processor -- start 2023-10-08T00:32:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.686+0000 7efde6033700 1 -- start start 2023-10-08T00:32:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efde6033700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde00ac230 0x7efde014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efde6033700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 0x7efde00c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efde6033700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde0155c10 0x7efde00ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efde6033700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde006de60 con 0x7efde00ac6d0 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efde6033700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0157fd0 con 0x7efde00ac230 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efde6033700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0157730 con 0x7efde0155c10 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efddeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 0x7efde00c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efddeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 0x7efde00c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45632/0 (socket says 172.21.15.22:45632) 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efddeffd700 1 -- 172.21.15.22:0/1062198802 learned_addr learned my addr 172.21.15.22:0/1062198802 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efddf7fe700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde00ac230 0x7efde014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.687+0000 7efddffff700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde0155c10 0x7efde00ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efddeffd700 1 -- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde0155c10 msgr2=0x7efde00ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efddeffd700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde0155c10 0x7efde00ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efddeffd700 1 -- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde00ac230 msgr2=0x7efde014d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efddeffd700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde00ac230 0x7efde014d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efddeffd700 1 -- 172.21.15.22:0/1062198802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009a20 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efddeffd700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 0x7efde00c9ff0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c7c0 tx=0x7efdd4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd4005b30 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4005cb0 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd0009420 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd4007320 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.688+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde0157cf0 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.689+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde006dc30 con 0x7efde00ac6d0 2023-10-08T00:32:14.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.689+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efdd401b3b0 con 0x7efde00ac6d0 2023-10-08T00:32:14.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.690+0000 7efdc77fe700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efdcc067320 0x7efdcc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:14.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.690+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efdd4083d60 con 0x7efde00ac6d0 2023-10-08T00:32:14.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.690+0000 7efddf7fe700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efdcc067320 0x7efdcc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:14.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.691+0000 7efddf7fe700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efdcc067320 0x7efdcc0697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efde00acc50 tx=0x7efdd0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:14.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.694+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efde006dc30 con 0x7efde00ac6d0 2023-10-08T00:32:14.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.888+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efde006dc30 con 0x7efde00ac6d0 2023-10-08T00:32:14.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.889+0000 7efdc77fe700 1 -- 172.21.15.22:0/1062198802 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+12144 (secure 0 0 0) 0x7efde006dc30 con 0x7efde00ac6d0 2023-10-08T00:32:14.889 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:14.889 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":137,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:14.110512+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:14.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efdcc067320 msgr2=0x7efdcc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efdcc067320 0x7efdcc0697d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efde00acc50 tx=0x7efdd0016000 comp rx=0 tx=0).stop 2023-10-08T00:32:14.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 msgr2=0x7efde00c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:14.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 0x7efde00c9ff0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c7c0 tx=0x7efdd4007e00 comp rx=0 tx=0).stop 2023-10-08T00:32:14.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 shutdown_connections 2023-10-08T00:32:14.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efdcc067320 0x7efdcc0697d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efde0155c10 0x7efde00ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efde00ac230 0x7efde014d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 --2- 172.21.15.22:0/1062198802 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efde00ac6d0 0x7efde00c9ff0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:14.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.890+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 >> 172.21.15.22:0/1062198802 conn(0x7efde006a320 msgr2=0x7efde01549e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:14.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.891+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 shutdown_connections 2023-10-08T00:32:14.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:14.891+0000 7efde6033700 1 -- 172.21.15.22:0/1062198802 wait complete. 2023-10-08T00:32:14.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:32:14.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:32:15.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.024+0000 7f28ec8c5700 1 Processor -- start 2023-10-08T00:32:15.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.024+0000 7f28ec8c5700 1 -- start start 2023-10-08T00:32:15.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.025+0000 7f28ec8c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e806bcd0 0x7f28e8140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.025+0000 7f28ec8c5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80c9510 0x7f28e8141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.025+0000 7f28ec8c5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e815c2a0 con 0x7f28e806c0a0 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.025+0000 7f28ec8c5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e815b690 con 0x7f28e80c9510 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.025+0000 7f28ec8c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815b970 con 0x7f28e806bcd0 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e6d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28e80c9510 0x7f28e8141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e5d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f28e806c0a0 0x7f28e80c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37684/0 (socket says 172.21.15.22:37684) 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e5d9b700 1 -- 172.21.15.22:0/3926551818 learned_addr learned my addr 172.21.15.22:0/3926551818 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e659c700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e806bcd0 0x7f28e8140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e6d9d700 1 -- 172.21.15.22:0/3926551818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e806bcd0 msgr2=0x7f28e8140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:15.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e6d9d700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e806bcd0 0x7f28e8140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e6d9d700 1 -- 172.21.15.22:0/3926551818 >> v1:172.21.15.22:6789/0 conn(0x7f28e806c0a0 legacy=0x7f28e80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e6d9d700 1 -- 172.21.15.22:0/3926551818 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e815bc50 con 0x7f28e80c9510 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e659c700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e806bcd0 0x7f28e8140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e6d9d700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80c9510 0x7f28e8141330 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009e60 tx=0x7f28e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1510bac9a695806 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e559a700 1 -- 172.21.15.22:0/3926551818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000e070 con 0x7f28e80c9510 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e559a700 1 -- 172.21.15.22:0/3926551818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000bc30 con 0x7f28e80c9510 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.026+0000 7f28e559a700 1 -- 172.21.15.22:0/3926551818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0012430 con 0x7f28e80c9510 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3926551818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80c9510 msgr2=0x7f28e8141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80c9510 0x7f28e8141330 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009e60 tx=0x7f28e0009780 comp rx=0 tx=0).stop 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3926551818 shutdown_connections 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e80c9510 0x7f28e8141330 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3926551818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e806bcd0 0x7f28e8140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3926551818 >> 172.21.15.22:0/3926551818 conn(0x7f28e80ce600 msgr2=0x7f28e80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:15.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3926551818 shutdown_connections 2023-10-08T00:32:15.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.027+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3926551818 wait complete. 2023-10-08T00:32:15.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.028+0000 7f28ec8c5700 1 Processor -- start 2023-10-08T00:32:15.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.028+0000 7f28ec8c5700 1 -- start start 2023-10-08T00:32:15.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 0x7f28e80c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e806c0a0 0x7f28e80b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c9510 0x7f28e80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b4290 con 0x7f28e806bcd0 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8069700 con 0x7f28e806c0a0 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b39f0 con 0x7f28e80c9510 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 0x7f28e80c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 0x7f28e80c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45644/0 (socket says 172.21.15.22:45644) 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 -- 172.21.15.22:0/3243861877 learned_addr learned my addr 172.21.15.22:0/3243861877 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 -- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c9510 msgr2=0x7f28e80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c9510 0x7f28e80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 -- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e806c0a0 msgr2=0x7f28e80b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e806c0a0 0x7f28e80b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 -- 172.21.15.22:0/3243861877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009a20 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28e659c700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 0x7f28e80c6bd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f28d800c850 tx=0x7f28d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8011600 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d8011760 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8011b00 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e80b3cd0 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.029+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e80c7110 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.030+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e80694d0 con 0x7f28e806bcd0 2023-10-08T00:32:15.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.031+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f28d80073b0 con 0x7f28e806bcd0 2023-10-08T00:32:15.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.031+0000 7f28de7fc700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28c8067320 0x7f28c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.031+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f28d8084a50 con 0x7f28e806bcd0 2023-10-08T00:32:15.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.031+0000 7f28e5d9b700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28c8067320 0x7f28c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.032+0000 7f28e5d9b700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28c8067320 0x7f28c80697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f28e816d2a0 tx=0x7f28d0007b30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.035+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28e80694d0 con 0x7f28e806bcd0 2023-10-08T00:32:15.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.230+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28e80694d0 con 0x7f28e806bcd0 2023-10-08T00:32:15.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.230+0000 7f28de7fc700 1 -- 172.21.15.22:0/3243861877 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28d801e0a0 con 0x7f28e806bcd0 2023-10-08T00:32:15.231 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:32:15.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28c8067320 msgr2=0x7f28c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28c8067320 0x7f28c80697d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f28e816d2a0 tx=0x7f28d0007b30 comp rx=0 tx=0).stop 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 msgr2=0x7f28e80c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 0x7f28e80c6bd0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f28d800c850 tx=0x7f28d8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 shutdown_connections 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f28c8067320 0x7f28c80697d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28e80c9510 0x7f28e80b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28e806bcd0 0x7f28e80c6bd0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 --2- 172.21.15.22:0/3243861877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e806c0a0 0x7f28e80b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 >> 172.21.15.22:0/3243861877 conn(0x7f28e80ce600 msgr2=0x7f28e80cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:15.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 shutdown_connections 2023-10-08T00:32:15.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.232+0000 7f28ec8c5700 1 -- 172.21.15.22:0/3243861877 wait complete. 2023-10-08T00:32:15.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:32:15.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.363+0000 7f97cadfe700 1 Processor -- start 2023-10-08T00:32:15.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.363+0000 7f97cadfe700 1 -- start start 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97cadfe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f97c4159840 0x7f97c40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97cadfe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97c40cba70 0x7f97c40694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97cadfe700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c40cfb30 con 0x7f97c4159c10 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97cadfe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40cbf10 con 0x7f97c40cba70 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97cadfe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c40cf4e0 con 0x7f97c4159840 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f97c40cba70 0x7f97c40694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c939b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f97c4159c10 0x7f97c40ce330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37686/0 (socket says 172.21.15.22:37686) 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c939b700 1 -- 172.21.15.22:0/3634231648 learned_addr learned my addr 172.21.15.22:0/3634231648 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c8b9a700 1 --2- 172.21.15.22:0/3634231648 >> v2:172.21.15.192:3300/0 conn(0x7f97c4159840 0x7f97c40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c3fff700 1 -- 172.21.15.22:0/3634231648 >> v2:172.21.15.192:3300/0 conn(0x7f97c4159840 msgr2=0x7f97c40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c3fff700 1 --2- 172.21.15.22:0/3634231648 >> v2:172.21.15.192:3300/0 conn(0x7f97c4159840 0x7f97c40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c3fff700 1 -- 172.21.15.22:0/3634231648 >> v1:172.21.15.22:6789/0 conn(0x7f97c4159c10 legacy=0x7f97c40ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c3fff700 1 -- 172.21.15.22:0/3634231648 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c40cf7c0 con 0x7f97c40cba70 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c37fe700 1 -- 172.21.15.22:0/3634231648 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139642424 0 0) 0x7f97c40cfb30 con 0x7f97c4159c10 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.364+0000 7f97c3fff700 1 --2- 172.21.15.22:0/3634231648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c40cba70 0x7f97c40694a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098e0 tx=0x7f97b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f355bb3735b16b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97c37fe700 1 -- 172.21.15.22:0/3634231648 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0009e80 con 0x7f97c40cba70 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97c37fe700 1 -- 172.21.15.22:0/3634231648 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b000b820 con 0x7f97c40cba70 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97c37fe700 1 -- 172.21.15.22:0/3634231648 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000bba0 con 0x7f97c40cba70 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 -- 172.21.15.22:0/3634231648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c40cba70 msgr2=0x7f97c40694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 --2- 172.21.15.22:0/3634231648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c40cba70 0x7f97c40694a0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f97b00098e0 tx=0x7f97b00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 -- 172.21.15.22:0/3634231648 shutdown_connections 2023-10-08T00:32:15.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 --2- 172.21.15.22:0/3634231648 >> v2:172.21.15.192:3300/0 conn(0x7f97c4159840 0x7f97c40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 --2- 172.21.15.22:0/3634231648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c40cba70 0x7f97c40694a0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 -- 172.21.15.22:0/3634231648 >> 172.21.15.22:0/3634231648 conn(0x7f97c4068e10 msgr2=0x7f97c40d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 -- 172.21.15.22:0/3634231648 shutdown_connections 2023-10-08T00:32:15.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.365+0000 7f97cadfe700 1 -- 172.21.15.22:0/3634231648 wait complete. 2023-10-08T00:32:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.366+0000 7f97cadfe700 1 Processor -- start 2023-10-08T00:32:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.366+0000 7f97cadfe700 1 -- start start 2023-10-08T00:32:15.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97cadfe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c40cba70 0x7f97c415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97cadfe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c4159840 0x7f97c4149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97cadfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 0x7f97c40b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97cadfe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c415a5e0 con 0x7f97c4159c10 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97cadfe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b5470 con 0x7f97c4159840 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97cadfe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c40b4860 con 0x7f97c40cba70 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97c939b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 0x7f97c40b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97c939b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 0x7f97c40b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45658/0 (socket says 172.21.15.22:45658) 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97c939b700 1 -- 172.21.15.22:0/2113868551 learned_addr learned my addr 172.21.15.22:0/2113868551 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97c8b9a700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c40cba70 0x7f97c415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.367+0000 7f97c3fff700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c4159840 0x7f97c4149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c939b700 1 -- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c40cba70 msgr2=0x7f97c415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c939b700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c40cba70 0x7f97c415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c939b700 1 -- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c4159840 msgr2=0x7f97c4149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c939b700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c4159840 0x7f97c4149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c939b700 1 -- 172.21.15.22:0/2113868551 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0009420 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c939b700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 0x7f97c40b1d70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00cbc0 tx=0x7f97bc001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00a7e0 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc00a940 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00ad00 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c40b4b40 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.368+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c40b5100 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.369+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c4064550 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.369+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f97bc007300 con 0x7f97c4159c10 2023-10-08T00:32:15.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.370+0000 7f97c0ff9700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a8067350 0x7f97a8069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.370+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f97bc084bd0 con 0x7f97c4159c10 2023-10-08T00:32:15.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.370+0000 7f97c8b9a700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a8067350 0x7f97a8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.370+0000 7f97c8b9a700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a8067350 0x7f97a8069800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f97b8006fd0 tx=0x7f97b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.374+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97bc051bf0 con 0x7f97c4159c10 2023-10-08T00:32:15.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.570+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f97c404c3c0 con 0x7f97c4159c10 2023-10-08T00:32:15.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.570+0000 7f97c0ff9700 1 -- 172.21.15.22:0/2113868551 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v137) v1 ==== 84+0+65 (secure 0 0 0) 0x7f97bc084e60 con 0x7f97c4159c10 2023-10-08T00:32:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:15.571 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:32:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:15.571 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:32:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:32:15.572 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:15.572 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:32:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a8067350 msgr2=0x7f97a8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a8067350 0x7f97a8069800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f97b8006fd0 tx=0x7f97b8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 msgr2=0x7f97c40b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 0x7f97c40b1d70 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00cbc0 tx=0x7f97bc001980 comp rx=0 tx=0).stop 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 shutdown_connections 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f97c4159c10 0x7f97c40b1d70 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f97a8067350 0x7f97a8069800 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f97c40cba70 0x7f97c415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 --2- 172.21.15.22:0/2113868551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97c4159840 0x7f97c4149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.572+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 >> 172.21.15.22:0/2113868551 conn(0x7f97c4068e10 msgr2=0x7f97c40cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:15.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.573+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 shutdown_connections 2023-10-08T00:32:15.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.573+0000 7f97cadfe700 1 -- 172.21.15.22:0/2113868551 wait complete. 2023-10-08T00:32:15.585 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:32:15.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:32:15.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.709+0000 7f60f1d46700 1 Processor -- start 2023-10-08T00:32:15.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.709+0000 7f60f1d46700 1 -- start start 2023-10-08T00:32:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60f1d46700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60ec143490 0x7f60ec0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60f1d46700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f60ec0b4580 0x7f60ec0699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60f1d46700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ec0ccee0 con 0x7f60ec1430c0 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60f1d46700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec0cf410 con 0x7f60ec143490 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60f1d46700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ec0cf6f0 con 0x7f60ec0b4580 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60ec143490 0x7f60ec0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60ec143490 0x7f60ec0694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45670/0 (socket says 172.21.15.22:45670) 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 -- 172.21.15.22:0/2201958522 learned_addr learned my addr 172.21.15.22:0/2201958522 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60ebfff700 1 --2- 172.21.15.22:0/2201958522 >> v2:172.21.15.192:3300/0 conn(0x7f60ec0b4580 0x7f60ec0699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 -- 172.21.15.22:0/2201958522 >> v2:172.21.15.192:3300/0 conn(0x7f60ec0b4580 msgr2=0x7f60ec0699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:15.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 --2- 172.21.15.22:0/2201958522 >> v2:172.21.15.192:3300/0 conn(0x7f60ec0b4580 0x7f60ec0699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 -- 172.21.15.22:0/2201958522 >> v1:172.21.15.192:6789/0 conn(0x7f60ec1430c0 legacy=0x7f60ec0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 -- 172.21.15.22:0/2201958522 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec0cf9d0 con 0x7f60ec143490 2023-10-08T00:32:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60eaffd700 1 --2- 172.21.15.22:0/2201958522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0694a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0ce3d0 tx=0x7f60e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06d4e908ecffd24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.710+0000 7f60ea7fc700 1 -- 172.21.15.22:0/2201958522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000b820 con 0x7f60ec143490 2023-10-08T00:32:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60ea7fc700 1 -- 172.21.15.22:0/2201958522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000b980 con 0x7f60ec143490 2023-10-08T00:32:15.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60ea7fc700 1 -- 172.21.15.22:0/2201958522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000bd20 con 0x7f60ec143490 2023-10-08T00:32:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 -- 172.21.15.22:0/2201958522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 msgr2=0x7f60ec0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2201958522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0694a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0ce3d0 tx=0x7f60e0009250 comp rx=0 tx=0).stop 2023-10-08T00:32:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 -- 172.21.15.22:0/2201958522 shutdown_connections 2023-10-08T00:32:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2201958522 >> v2:172.21.15.192:3300/0 conn(0x7f60ec0b4580 0x7f60ec0699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2201958522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0694a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 -- 172.21.15.22:0/2201958522 >> 172.21.15.22:0/2201958522 conn(0x7f60ec068e60 msgr2=0x7f60ec0b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 -- 172.21.15.22:0/2201958522 shutdown_connections 2023-10-08T00:32:15.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.711+0000 7f60f1d46700 1 -- 172.21.15.22:0/2201958522 wait complete. 2023-10-08T00:32:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.712+0000 7f60f1d46700 1 Processor -- start 2023-10-08T00:32:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.712+0000 7f60f1d46700 1 -- start start 2023-10-08T00:32:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60f1d46700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60ec0b4580 0x7f60ec159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60f1d46700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec1430c0 0x7f60ec0c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60f1d46700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60f1d46700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec1595a0 con 0x7f60ec143490 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60f1d46700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0c5a10 con 0x7f60ec1430c0 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60f1d46700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec0c5cf0 con 0x7f60ec0b4580 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60ebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60ebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45682/0 (socket says 172.21.15.22:45682) 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60ebfff700 1 -- 172.21.15.22:0/2865711431 learned_addr learned my addr 172.21.15.22:0/2865711431 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60eaffd700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec1430c0 0x7f60ec0c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.713+0000 7f60eb7fe700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60ec0b4580 0x7f60ec159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60ebfff700 1 -- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60ec0b4580 msgr2=0x7f60ec159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60ebfff700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60ec0b4580 0x7f60ec159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60ebfff700 1 -- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec1430c0 msgr2=0x7f60ec0c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60ebfff700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec1430c0 0x7f60ec0c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60ebfff700 1 -- 172.21.15.22:0/2865711431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00094f0 con 0x7f60ec143490 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60ebfff700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0b49e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009fa0 tx=0x7f60e4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400ebc0 con 0x7f60ec143490 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400ed20 con 0x7f60ec143490 2023-10-08T00:32:15.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ec0c5fd0 con 0x7f60ec143490 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4014670 con 0x7f60ec143490 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.714+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ec0c6590 con 0x7f60ec143490 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.715+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ec064550 con 0x7f60ec143490 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.716+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f60e40149e0 con 0x7f60ec143490 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.716+0000 7f60d37fe700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f60d8067320 0x7f60d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.716+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f60e4084fc0 con 0x7f60ec143490 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.716+0000 7f60eb7fe700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f60d8067320 0x7f60d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.717+0000 7f60eb7fe700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f60d8067320 0x7f60d80697d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f60dc006fd0 tx=0x7f60dc0090f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:15.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.720+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60e4051fa0 con 0x7f60ec143490 2023-10-08T00:32:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:15.913+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60ec04c3c0 con 0x7f60ec143490 2023-10-08T00:32:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.119+0000 7f60d37fe700 1 -- 172.21.15.22:0/2865711431 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v138) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60e40555c0 con 0x7f60ec143490 2023-10-08T00:32:16.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.123+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f60d8067320 msgr2=0x7f60d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:16.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.123+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f60d8067320 0x7f60d80697d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f60dc006fd0 tx=0x7f60dc0090f0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.123+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 msgr2=0x7f60ec0b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:16.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.123+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0b49e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009fa0 tx=0x7f60e4009900 comp rx=0 tx=0).stop 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 shutdown_connections 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60ec143490 0x7f60ec0b49e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f60d8067320 0x7f60d80697d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f60ec0b4580 0x7f60ec159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 --2- 172.21.15.22:0/2865711431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec1430c0 0x7f60ec0c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 >> 172.21.15.22:0/2865711431 conn(0x7f60ec068e60 msgr2=0x7f60ec140df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.125+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 shutdown_connections 2023-10-08T00:32:16.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.126+0000 7f60f1d46700 1 -- 172.21.15.22:0/2865711431 wait complete. 2023-10-08T00:32:16.127 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:32:16.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:32:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.268+0000 7fa166762700 1 Processor -- start 2023-10-08T00:32:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.268+0000 7fa166762700 1 -- start start 2023-10-08T00:32:16.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa166762700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa160159950 0x7fa1600cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa166762700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1600af320 0x7fa160069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa166762700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600ce380 con 0x7fa160069aa0 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa166762700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160069f20 con 0x7fa160159950 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa166762700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600cec20 con 0x7fa1600af320 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa160159950 0x7fa1600cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa164cff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa160069aa0 0x7fa16015d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37690/0 (socket says 172.21.15.22:37690) 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa164cff700 1 -- 172.21.15.22:0/1852353691 learned_addr learned my addr 172.21.15.22:0/1852353691 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15f7fe700 1 --2- 172.21.15.22:0/1852353691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1600af320 0x7fa160069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15ffff700 1 -- 172.21.15.22:0/1852353691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1600af320 msgr2=0x7fa160069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15ffff700 1 --2- 172.21.15.22:0/1852353691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1600af320 0x7fa160069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15ffff700 1 -- 172.21.15.22:0/1852353691 >> v1:172.21.15.22:6789/0 conn(0x7fa160069aa0 legacy=0x7fa16015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15ffff700 1 -- 172.21.15.22:0/1852353691 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600afa90 con 0x7fa160159950 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15effd700 1 -- 172.21.15.22:0/1852353691 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240241199 0 0) 0x7fa1600ce380 con 0x7fa160069aa0 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15ffff700 1 --2- 172.21.15.22:0/1852353691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa1600cbb90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa1500098e0 tx=0x7fa1500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493852e37cb3b1f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.269+0000 7fa15effd700 1 -- 172.21.15.22:0/1852353691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000b640 con 0x7fa160159950 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa15effd700 1 -- 172.21.15.22:0/1852353691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15000b7a0 con 0x7fa160159950 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa15effd700 1 -- 172.21.15.22:0/1852353691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000bb40 con 0x7fa160159950 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 -- 172.21.15.22:0/1852353691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 msgr2=0x7fa1600cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 --2- 172.21.15.22:0/1852353691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa1600cbb90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa1500098e0 tx=0x7fa1500091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 -- 172.21.15.22:0/1852353691 shutdown_connections 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 --2- 172.21.15.22:0/1852353691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa1600cbb90 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 --2- 172.21.15.22:0/1852353691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa1600af320 0x7fa160069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 -- 172.21.15.22:0/1852353691 >> 172.21.15.22:0/1852353691 conn(0x7fa160068e00 msgr2=0x7fa1600d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 -- 172.21.15.22:0/1852353691 shutdown_connections 2023-10-08T00:32:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.270+0000 7fa166762700 1 -- 172.21.15.22:0/1852353691 wait complete. 2023-10-08T00:32:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.271+0000 7fa166762700 1 Processor -- start 2023-10-08T00:32:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.271+0000 7fa166762700 1 -- start start 2023-10-08T00:32:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa166762700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa160069aa0 0x7fa1600c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa166762700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1600af320 0x7fa16015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa166762700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa16015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa166762700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600c7ca0 con 0x7fa160159950 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa166762700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600ca920 con 0x7fa1600af320 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa166762700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b3e70 con 0x7fa160069aa0 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa16015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa16015eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45686/0 (socket says 172.21.15.22:45686) 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 -- 172.21.15.22:0/468101540 learned_addr learned my addr 172.21.15.22:0/468101540 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa15ffff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa160069aa0 0x7fa1600c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa15f7fe700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1600af320 0x7fa16015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:16.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 -- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa160069aa0 msgr2=0x7fa1600c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa160069aa0 0x7fa1600c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 -- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1600af320 msgr2=0x7fa16015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1600af320 0x7fa16015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa164cff700 1 -- 172.21.15.22:0/468101540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150009420 con 0x7fa160159950 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa15ffff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa160069aa0 0x7fa1600c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.272+0000 7fa15f7fe700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1600af320 0x7fa16015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.273+0000 7fa164cff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa16015eb70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa15800ccc0 tx=0x7fa158001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.273+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800ab30 con 0x7fa160159950 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.273+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800ac90 con 0x7fa160159950 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.273+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158007340 con 0x7fa160159950 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.273+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16016a340 con 0x7fa160159950 2023-10-08T00:32:16.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.273+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1600ca640 con 0x7fa160159950 2023-10-08T00:32:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.274+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600718b0 con 0x7fa160159950 2023-10-08T00:32:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.274+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa158007730 con 0x7fa160159950 2023-10-08T00:32:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.275+0000 7fa157fff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa140067320 0x7fa1400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.275+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa158084ea0 con 0x7fa160159950 2023-10-08T00:32:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.275+0000 7fa15ffff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa140067320 0x7fa1400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:16.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.276+0000 7fa15ffff700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa140067320 0x7fa1400697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa1500093f0 tx=0x7fa150017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:16.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.280+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa158051d90 con 0x7fa160159950 2023-10-08T00:32:16.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:16.473+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa1600ce630 con 0x7fa160159950 2023-10-08T00:32:17.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.126+0000 7fa157fff700 1 -- 172.21.15.22:0/468101540 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v139) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa1580553b0 con 0x7fa160159950 2023-10-08T00:32:17.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.135+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa140067320 msgr2=0x7fa1400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:17.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.135+0000 7fa166762700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa140067320 0x7fa1400697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa1500093f0 tx=0x7fa150017000 comp rx=0 tx=0).stop 2023-10-08T00:32:17.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.135+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 msgr2=0x7fa16015eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:17.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.135+0000 7fa166762700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa16015eb70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa15800ccc0 tx=0x7fa158001a80 comp rx=0 tx=0).stop 2023-10-08T00:32:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.137+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 shutdown_connections 2023-10-08T00:32:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.137+0000 7fa166762700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa160159950 0x7fa16015eb70 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.137+0000 7fa166762700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa140067320 0x7fa1400697d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.137+0000 7fa166762700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa160069aa0 0x7fa1600c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.137+0000 7fa166762700 1 --2- 172.21.15.22:0/468101540 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1600af320 0x7fa16015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.137+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 >> 172.21.15.22:0/468101540 conn(0x7fa160068e00 msgr2=0x7fa1600b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:17.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.139+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 shutdown_connections 2023-10-08T00:32:17.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.140+0000 7fa166762700 1 -- 172.21.15.22:0/468101540 wait complete. 2023-10-08T00:32:17.143 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:32:17.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:32:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.285+0000 7fc282209700 1 Processor -- start 2023-10-08T00:32:17.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.285+0000 7fc282209700 1 -- start start 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.285+0000 7fc282209700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc27c159890 0x7fc27c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc282209700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc27c069560 0x7fc27c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc282209700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c069ee0 con 0x7fc27c159c60 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc282209700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c15a160 con 0x7fc27c069560 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc282209700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c0d13a0 con 0x7fc27c159890 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc27c069560 0x7fc27c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc27c069560 0x7fc27c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43946/0 (socket says 172.21.15.22:43946) 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 -- 172.21.15.22:0/2180222133 learned_addr learned my addr 172.21.15.22:0/2180222133 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27b7fe700 1 --2- 172.21.15.22:0/2180222133 >> v2:172.21.15.192:3300/0 conn(0x7fc27c159890 0x7fc27c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:17.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 -- 172.21.15.22:0/2180222133 >> v2:172.21.15.192:3300/0 conn(0x7fc27c159890 msgr2=0x7fc27c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 --2- 172.21.15.22:0/2180222133 >> v2:172.21.15.192:3300/0 conn(0x7fc27c159890 0x7fc27c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 -- 172.21.15.22:0/2180222133 >> v1:172.21.15.192:6789/0 conn(0x7fc27c159c60 legacy=0x7fc27c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 -- 172.21.15.22:0/2180222133 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c15e140 con 0x7fc27c069560 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27b7fe700 1 --2- 172.21.15.22:0/2180222133 >> v2:172.21.15.192:3300/0 conn(0x7fc27c159890 0x7fc27c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27bfff700 1 --2- 172.21.15.22:0/2180222133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c069560 0x7fc27c0699a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0d1090 tx=0x7fc274009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2d70f543f0a919 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27a7fc700 1 -- 172.21.15.22:0/2180222133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400e070 con 0x7fc27c069560 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27a7fc700 1 -- 172.21.15.22:0/2180222133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400ba10 con 0x7fc27c069560 2023-10-08T00:32:17.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.286+0000 7fc27a7fc700 1 -- 172.21.15.22:0/2180222133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740092e0 con 0x7fc27c069560 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 -- 172.21.15.22:0/2180222133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c069560 msgr2=0x7fc27c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 --2- 172.21.15.22:0/2180222133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c069560 0x7fc27c0699a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fc27c0d1090 tx=0x7fc274009840 comp rx=0 tx=0).stop 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 -- 172.21.15.22:0/2180222133 shutdown_connections 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 --2- 172.21.15.22:0/2180222133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c069560 0x7fc27c0699a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 --2- 172.21.15.22:0/2180222133 >> v2:172.21.15.192:3300/0 conn(0x7fc27c159890 0x7fc27c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 -- 172.21.15.22:0/2180222133 >> 172.21.15.22:0/2180222133 conn(0x7fc27c068e20 msgr2=0x7fc27c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:17.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 -- 172.21.15.22:0/2180222133 shutdown_connections 2023-10-08T00:32:17.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.287+0000 7fc282209700 1 -- 172.21.15.22:0/2180222133 wait complete. 2023-10-08T00:32:17.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.288+0000 7fc282209700 1 Processor -- start 2023-10-08T00:32:17.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.288+0000 7fc282209700 1 -- start start 2023-10-08T00:32:17.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc282209700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc27c069560 0x7fc27c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc282209700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc27c159890 0x7fc27c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc282209700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 0x7fc27c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc282209700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0b1b20 con 0x7fc27c159c60 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc282209700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0ca700 con 0x7fc27c159890 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc282209700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c0c9e60 con 0x7fc27c069560 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 0x7fc27c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:17.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 0x7fc27c0c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43950/0 (socket says 172.21.15.22:43950) 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 -- 172.21.15.22:0/4188772183 learned_addr learned my addr 172.21.15.22:0/4188772183 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27b7fe700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc27c069560 0x7fc27c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27affd700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc27c159890 0x7fc27c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 -- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc27c069560 msgr2=0x7fc27c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc27c069560 0x7fc27c154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 -- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc27c159890 msgr2=0x7fc27c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc27c159890 0x7fc27c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:17.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.289+0000 7fc27bfff700 1 -- 172.21.15.22:0/4188772183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009ae0 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.290+0000 7fc27bfff700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 0x7fc27c0c97c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc274009fd0 tx=0x7fc274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.290+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2740032f0 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.290+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274012d30 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.290+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c0ca140 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.290+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274012ea0 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.290+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c0b36a0 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.291+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c04c3c0 con 0x7fc27c159c60 2023-10-08T00:32:17.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.291+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc27401d940 con 0x7fc27c159c60 2023-10-08T00:32:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.292+0000 7fc2737fe700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc25c067320 0x7fc25c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.292+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fc274086500 con 0x7fc27c159c60 2023-10-08T00:32:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.292+0000 7fc27b7fe700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc25c067320 0x7fc25c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.292+0000 7fc27b7fe700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc25c067320 0x7fc25c0697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00adc0 tx=0x7fc26c006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:17.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.296+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2740530e0 con 0x7fc27c159c60 2023-10-08T00:32:17.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:17.532+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc27c06a5b0 con 0x7fc27c159c60 2023-10-08T00:32:18.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.149+0000 7fc2737fe700 1 -- 172.21.15.22:0/4188772183 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v92) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc274056700 con 0x7fc27c159c60 2023-10-08T00:32:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.158+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc25c067320 msgr2=0x7fc25c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.158+0000 7fc282209700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc25c067320 0x7fc25c0697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc26c00adc0 tx=0x7fc26c006f90 comp rx=0 tx=0).stop 2023-10-08T00:32:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.158+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 msgr2=0x7fc27c0c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.158+0000 7fc282209700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 0x7fc27c0c97c0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fc274009fd0 tx=0x7fc274017000 comp rx=0 tx=0).stop 2023-10-08T00:32:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.168+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 shutdown_connections 2023-10-08T00:32:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.168+0000 7fc282209700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc27c159c60 0x7fc27c0c97c0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.168+0000 7fc282209700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc25c067320 0x7fc25c0697d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.168+0000 7fc282209700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc27c069560 0x7fc27c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.168+0000 7fc282209700 1 --2- 172.21.15.22:0/4188772183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc27c159890 0x7fc27c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.168+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 >> 172.21.15.22:0/4188772183 conn(0x7fc27c068e20 msgr2=0x7fc27c157250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:18.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.170+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 shutdown_connections 2023-10-08T00:32:18.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.170+0000 7fc282209700 1 -- 172.21.15.22:0/4188772183 wait complete. 2023-10-08T00:32:18.174 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 24 and data pool 25 2023-10-08T00:32:18.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.310+0000 7f20c4fcb700 1 Processor -- start 2023-10-08T00:32:18.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.310+0000 7f20c4fcb700 1 -- start start 2023-10-08T00:32:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20c4fcb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20c4fcb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20c0159c60 0x7f20c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20c4fcb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c015a160 con 0x7f20c015db10 2023-10-08T00:32:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20c4fcb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c00d13a0 con 0x7f20c0159c60 2023-10-08T00:32:18.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20c4fcb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c015e140 con 0x7f20c0159890 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20be59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bdd9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20c0159c60 0x7f20c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20be59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60826/0 (socket says 172.21.15.22:60826) 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bed9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f20c015db10 0x7f20c0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:56842/0 (socket says 172.21.15.22:56842) 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20be59c700 1 -- 172.21.15.22:0/3570388876 learned_addr learned my addr 172.21.15.22:0/3570388876 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bdd9b700 1 -- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 msgr2=0x7f20c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bdd9b700 1 --2- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bdd9b700 1 -- 172.21.15.22:0/3570388876 >> v1:172.21.15.192:6789/0 conn(0x7f20c015db10 legacy=0x7f20c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bd59a700 1 -- 172.21.15.22:0/3570388876 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798393350 0 0) 0x7f20c015a160 con 0x7f20c015db10 2023-10-08T00:32:18.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20bdd9b700 1 -- 172.21.15.22:0/3570388876 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c015a3d0 con 0x7f20c0159c60 2023-10-08T00:32:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.311+0000 7f20be59c700 1 --2- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20bdd9b700 1 --2- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c0159c60 0x7f20c015d5d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20a80098e0 tx=0x7f20a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c79a542babbcfb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20bd59a700 1 -- 172.21.15.22:0/3570388876 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800b640 con 0x7f20c0159c60 2023-10-08T00:32:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20bd59a700 1 -- 172.21.15.22:0/3570388876 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800b7a0 con 0x7f20c0159c60 2023-10-08T00:32:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20bd59a700 1 -- 172.21.15.22:0/3570388876 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800bb40 con 0x7f20c0159c60 2023-10-08T00:32:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 -- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c0159c60 msgr2=0x7f20c015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c0159c60 0x7f20c015d5d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20a80098e0 tx=0x7f20a80091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 -- 172.21.15.22:0/3570388876 shutdown_connections 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/3570388876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c0159c60 0x7f20c015d5d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 -- 172.21.15.22:0/3570388876 >> 172.21.15.22:0/3570388876 conn(0x7f20c0068e20 msgr2=0x7f20c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 -- 172.21.15.22:0/3570388876 shutdown_connections 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.312+0000 7f20c4fcb700 1 -- 172.21.15.22:0/3570388876 wait complete. 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.313+0000 7f20c4fcb700 1 Processor -- start 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 -- start start 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c01524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 0x7f20c00cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c015db10 0x7f20c00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c016df30 con 0x7f20c0159c60 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c016d340 con 0x7f20c015db10 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20c4fcb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c016d600 con 0x7f20c0159890 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20bdd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 0x7f20c00cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20be59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c01524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20bed9d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c015db10 0x7f20c00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20be59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c01524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60832/0 (socket says 172.21.15.22:60832) 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20bdd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 0x7f20c00cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43960/0 (socket says 172.21.15.22:43960) 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.314+0000 7f20be59c700 1 -- 172.21.15.22:0/2124121712 learned_addr learned my addr 172.21.15.22:0/2124121712 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20be59c700 1 -- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c015db10 msgr2=0x7f20c00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20be59c700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c015db10 0x7f20c00b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20be59c700 1 -- 172.21.15.22:0/2124121712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 msgr2=0x7f20c00cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20be59c700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 0x7f20c00cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20be59c700 1 -- 172.21.15.22:0/2124121712 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00094f0 con 0x7f20c0159890 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20bdd9b700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 0x7f20c00cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20be59c700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c01524d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f20b000ec50 tx=0x7f20b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b000c850 con 0x7f20c0159890 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b000c9b0 con 0x7f20c0159890 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b000cd50 con 0x7f20c0159890 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a8009420 con 0x7f20c0159890 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.315+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c016dbc0 con 0x7f20c0159890 2023-10-08T00:32:18.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.316+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c004c3c0 con 0x7f20c0159890 2023-10-08T00:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.317+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f20b0005a00 con 0x7f20c0159890 2023-10-08T00:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.317+0000 7f20b67fc700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20a0067320 0x7f20a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.317+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20b0084dd0 con 0x7f20c0159890 2023-10-08T00:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.317+0000 7f20bdd9b700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20a0067320 0x7f20a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.318+0000 7f20bdd9b700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20a0067320 0x7f20a00697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f20c015a090 tx=0x7f20a8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.321+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20b0051aa0 con 0x7f20c0159890 2023-10-08T00:32:18.515 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.515+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c00d09c0 con 0x7f20c0159890 2023-10-08T00:32:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.516+0000 7f20b67fc700 1 -- 172.21.15.22:0/2124121712 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f20b0021090 con 0x7f20c0159890 2023-10-08T00:32:18.517 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:18.517 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":140,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:17.533580+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:16.504058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20a0067320 msgr2=0x7f20a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20a0067320 0x7f20a00697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f20c015a090 tx=0x7f20a8017000 comp rx=0 tx=0).stop 2023-10-08T00:32:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 msgr2=0x7f20c01524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c01524d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f20b000ec50 tx=0x7f20b0009250 comp rx=0 tx=0).stop 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 shutdown_connections 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20c015db10 0x7f20c00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20a0067320 0x7f20a00697d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20c0159890 0x7f20c01524d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 --2- 172.21.15.22:0/2124121712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20c0159c60 0x7f20c00cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.518+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 >> 172.21.15.22:0/2124121712 conn(0x7f20c0068e20 msgr2=0x7f20c0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.519+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 shutdown_connections 2023-10-08T00:32:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.519+0000 7f20c4fcb700 1 -- 172.21.15.22:0/2124121712 wait complete. 2023-10-08T00:32:18.531 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:18.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.650+0000 7f318e420700 1 Processor -- start 2023-10-08T00:32:18.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.650+0000 7f318e420700 1 -- start start 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f318e420700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3188159890 0x7f318815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f318e420700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3188159c60 0x7f318815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f318e420700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318815a160 con 0x7f318815db10 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f318e420700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318815df50 con 0x7f3188159890 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f318e420700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31880d13a0 con 0x7f3188159c60 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3188159890 0x7f318815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3188159890 0x7f318815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43970/0 (socket says 172.21.15.22:43970) 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 -- 172.21.15.22:0/3495700578 learned_addr learned my addr 172.21.15.22:0/3495700578 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:18.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f31877fe700 1 --2- 172.21.15.22:0/3495700578 >> v2:172.21.15.192:3300/0 conn(0x7f3188159c60 0x7f318815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 -- 172.21.15.22:0/3495700578 >> v2:172.21.15.192:3300/0 conn(0x7f3188159c60 msgr2=0x7f318815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 --2- 172.21.15.22:0/3495700578 >> v2:172.21.15.192:3300/0 conn(0x7f3188159c60 0x7f318815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 -- 172.21.15.22:0/3495700578 >> v1:172.21.15.192:6789/0 conn(0x7f318815db10 legacy=0x7f3188069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 -- 172.21.15.22:0/3495700578 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318815e140 con 0x7f3188159890 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3187fff700 1 --2- 172.21.15.22:0/3495700578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159890 0x7f318815abd0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f31880b67f0 tx=0x7f3178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732ab84ba6a9a6b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3186ffd700 1 -- 172.21.15.22:0/3495700578 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3178009e70 con 0x7f3188159890 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3186ffd700 1 -- 172.21.15.22:0/3495700578 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317800b860 con 0x7f3188159890 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.651+0000 7f3186ffd700 1 -- 172.21.15.22:0/3495700578 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317800bc00 con 0x7f3188159890 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 -- 172.21.15.22:0/3495700578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159890 msgr2=0x7f318815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 --2- 172.21.15.22:0/3495700578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159890 0x7f318815abd0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f31880b67f0 tx=0x7f3178009250 comp rx=0 tx=0).stop 2023-10-08T00:32:18.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 -- 172.21.15.22:0/3495700578 shutdown_connections 2023-10-08T00:32:18.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 --2- 172.21.15.22:0/3495700578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159890 0x7f318815abd0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 --2- 172.21.15.22:0/3495700578 >> v2:172.21.15.192:3300/0 conn(0x7f3188159c60 0x7f318815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 -- 172.21.15.22:0/3495700578 >> 172.21.15.22:0/3495700578 conn(0x7f3188068e20 msgr2=0x7f31880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:18.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 -- 172.21.15.22:0/3495700578 shutdown_connections 2023-10-08T00:32:18.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.652+0000 7f318e420700 1 -- 172.21.15.22:0/3495700578 wait complete. 2023-10-08T00:32:18.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.653+0000 7f318e420700 1 Processor -- start 2023-10-08T00:32:18.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.653+0000 7f318e420700 1 -- start start 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318e420700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3188159890 0x7f31880b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318e420700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 0x7f31880cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318e420700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318815db10 0x7f31880cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318e420700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880b5970 con 0x7f3188159c60 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318e420700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880ca2b0 con 0x7f318815db10 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318e420700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31880cdb40 con 0x7f3188159890 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 0x7f31880cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 0x7f31880cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43972/0 (socket says 172.21.15.22:43972) 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 -- 172.21.15.22:0/580331517 learned_addr learned my addr 172.21.15.22:0/580331517 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f3187fff700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3188159890 0x7f31880b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f318c9bd700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318815db10 0x7f31880cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 -- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3188159890 msgr2=0x7f31880b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3188159890 0x7f31880b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 -- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318815db10 msgr2=0x7f31880cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318815db10 0x7f31880cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.654+0000 7f31877fe700 1 -- 172.21.15.22:0/580331517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31780094f0 con 0x7f3188159c60 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.655+0000 7f31877fe700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 0x7f31880cd0c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f317c00ec80 tx=0x7f317c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.655+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00c850 con 0x7f3188159c60 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.655+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c00c9b0 con 0x7f3188159c60 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.655+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31880b4d50 con 0x7f3188159c60 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.655+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00cd50 con 0x7f3188159c60 2023-10-08T00:32:18.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.655+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31880b5590 con 0x7f3188159c60 2023-10-08T00:32:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.656+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318804c3c0 con 0x7f3188159c60 2023-10-08T00:32:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.657+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f317c013680 con 0x7f3188159c60 2023-10-08T00:32:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.657+0000 7f316ffff700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3174067320 0x7f31740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.657+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f317c084ea0 con 0x7f3188159c60 2023-10-08T00:32:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.657+0000 7f3187fff700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3174067320 0x7f31740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.658+0000 7f3187fff700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3174067320 0x7f31740697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f31880b67f0 tx=0x7f3178017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.662+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f317c051b30 con 0x7f3188159c60 2023-10-08T00:32:18.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.855+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f318806a5b0 con 0x7f3188159c60 2023-10-08T00:32:18.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.856+0000 7f316ffff700 1 -- 172.21.15.22:0/580331517 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f317c055150 con 0x7f3188159c60 2023-10-08T00:32:18.856 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:18.857 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":140,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:17.533580+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:16.504058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:18.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3174067320 msgr2=0x7f31740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3174067320 0x7f31740697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f31880b67f0 tx=0x7f3178017000 comp rx=0 tx=0).stop 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 msgr2=0x7f31880cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 0x7f31880cd0c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f317c00ec80 tx=0x7f317c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 shutdown_connections 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f318815db10 0x7f31880cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3174067320 0x7f31740697d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3188159890 0x7f31880b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 --2- 172.21.15.22:0/580331517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3188159c60 0x7f31880cd0c0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 >> 172.21.15.22:0/580331517 conn(0x7f3188068e20 msgr2=0x7f31880b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:18.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 shutdown_connections 2023-10-08T00:32:18.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.858+0000 7f318e420700 1 -- 172.21.15.22:0/580331517 wait complete. 2023-10-08T00:32:18.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:32:18.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.992+0000 7f4b0cabb700 1 Processor -- start 2023-10-08T00:32:18.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.992+0000 7f4b0cabb700 1 -- start start 2023-10-08T00:32:18.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.993+0000 7f4b0cabb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b08159890 0x7f4b0815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.993+0000 7f4b0cabb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.993+0000 7f4b0cabb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b08069ee0 con 0x7f4b08159c60 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.993+0000 7f4b0cabb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b0815a160 con 0x7f4b08159890 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.993+0000 7f4b0cabb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080d13a0 con 0x7f4b08069560 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b08159890 0x7f4b0815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b08159890 0x7f4b0815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43980/0 (socket says 172.21.15.22:43980) 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 -- 172.21.15.22:0/3182284217 learned_addr learned my addr 172.21.15.22:0/3182284217 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b06d9d700 1 --2- 172.21.15.22:0/3182284217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 -- 172.21.15.22:0/3182284217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 msgr2=0x7f4b080699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 --2- 172.21.15.22:0/3182284217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 -- 172.21.15.22:0/3182284217 >> v1:172.21.15.192:6789/0 conn(0x7f4b08159c60 legacy=0x7f4b0815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 -- 172.21.15.22:0/3182284217 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0815e140 con 0x7f4b08159890 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0659c700 1 --2- 172.21.15.22:0/3182284217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b0815abd0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4af80099b0 tx=0x7f4af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b120d2d87f647ef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0559a700 1 -- 172.21.15.22:0/3182284217 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800b820 con 0x7f4b08159890 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0559a700 1 -- 172.21.15.22:0/3182284217 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800b980 con 0x7f4b08159890 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.994+0000 7f4b0559a700 1 -- 172.21.15.22:0/3182284217 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800bd20 con 0x7f4b08159890 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 -- 172.21.15.22:0/3182284217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 msgr2=0x7f4b0815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/3182284217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b0815abd0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4af80099b0 tx=0x7f4af8009250 comp rx=0 tx=0).stop 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 -- 172.21.15.22:0/3182284217 shutdown_connections 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/3182284217 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/3182284217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b0815abd0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 -- 172.21.15.22:0/3182284217 >> 172.21.15.22:0/3182284217 conn(0x7f4b08068e20 msgr2=0x7f4b080d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:18.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 -- 172.21.15.22:0/3182284217 shutdown_connections 2023-10-08T00:32:18.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.995+0000 7f4b0cabb700 1 -- 172.21.15.22:0/3182284217 wait complete. 2023-10-08T00:32:19.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.996+0000 7f4b0cabb700 1 Processor -- start 2023-10-08T00:32:19.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.996+0000 7f4b0cabb700 1 -- start start 2023-10-08T00:32:19.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:19.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b08169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b08159c60 0x7f4b08169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08151f70 con 0x7f4b08159890 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080b4f20 con 0x7f4b08159c60 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080b4310 con 0x7f4b08069560 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b08169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b08169950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43992/0 (socket says 172.21.15.22:43992) 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 -- 172.21.15.22:0/2223053973 learned_addr learned my addr 172.21.15.22:0/2223053973 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b06d9d700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b08159c60 0x7f4b08169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0659c700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:19.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 -- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 msgr2=0x7f4b080b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 -- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b08159c60 msgr2=0x7f4b08169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b08159c60 0x7f4b08169e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 -- 172.21.15.22:0/2223053973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80094f0 con 0x7f4b08159890 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b05d9b700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b08169950 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c600 tx=0x7f4af0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011590 con 0x7f4b08159890 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af0011710 con 0x7f4b08159890 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.997+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b080b45f0 con 0x7f4b08159890 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.998+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af0011ad0 con 0x7f4b08159890 2023-10-08T00:32:19.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.998+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b080b4bb0 con 0x7f4b08159890 2023-10-08T00:32:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.999+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0804c3c0 con 0x7f4b08159890 2023-10-08T00:32:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.999+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4af001c460 con 0x7f4b08159890 2023-10-08T00:32:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.999+0000 7f4afe7fc700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ae8067320 0x7f4ae80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.999+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4af0084a50 con 0x7f4b08159890 2023-10-08T00:32:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:18.999+0000 7f4b0659c700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ae8067320 0x7f4ae80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:19.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:19.000+0000 7f4b0659c700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ae8067320 0x7f4ae80697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4af80099b0 tx=0x7f4af8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:19.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:19.003+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4af00516e0 con 0x7f4b08159890 2023-10-08T00:32:19.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:19.250+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b0806a5b0 con 0x7f4b08159890 2023-10-08T00:32:20.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.180+0000 7f4afe7fc700 1 -- 172.21.15.22:0/2223053973 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v95) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4af0054d00 con 0x7f4b08159890 2023-10-08T00:32:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ae8067320 msgr2=0x7f4ae80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ae8067320 0x7f4ae80697d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4af80099b0 tx=0x7f4af8016000 comp rx=0 tx=0).stop 2023-10-08T00:32:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 msgr2=0x7f4b08169950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b08169950 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f4af000c600 tx=0x7f4af0007f60 comp rx=0 tx=0).stop 2023-10-08T00:32:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 shutdown_connections 2023-10-08T00:32:20.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b08159c60 0x7f4b08169e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ae8067320 0x7f4ae80697d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4b08069560 0x7f4b080b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 --2- 172.21.15.22:0/2223053973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b08159890 0x7f4b08169950 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 >> 172.21.15.22:0/2223053973 conn(0x7f4b08068e20 msgr2=0x7f4b08153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:20.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 shutdown_connections 2023-10-08T00:32:20.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.183+0000 7f4b0cabb700 1 -- 172.21.15.22:0/2223053973 wait complete. 2023-10-08T00:32:20.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:32:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.327+0000 7f532afec700 1 Processor -- start 2023-10-08T00:32:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.327+0000 7f532afec700 1 -- start start 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.328+0000 7f532afec700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5324159c10 0x7f532415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.328+0000 7f532afec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f532415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.328+0000 7f532afec700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532415c480 con 0x7f53240b5ea0 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.328+0000 7f532afec700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240b2a40 con 0x7f5324159c10 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.328+0000 7f532afec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532415d290 con 0x7f532415c910 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5323fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f53240b5ea0 0x7f5324068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46988/0 (socket says 172.21.15.22:46988) 2023-10-08T00:32:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5323fff700 1 -- 172.21.15.22:0/1943131994 learned_addr learned my addr 172.21.15.22:0/1943131994 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5329589700 1 --2- 172.21.15.22:0/1943131994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f532415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5328d88700 1 --2- 172.21.15.22:0/1943131994 >> v2:172.21.15.192:3300/0 conn(0x7f5324159c10 0x7f532415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f53237fe700 1 -- 172.21.15.22:0/1943131994 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444267514 0 0) 0x7f532415c480 con 0x7f53240b5ea0 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f53237fe700 1 -- 172.21.15.22:0/1943131994 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530c003570 con 0x7f53240b5ea0 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5329589700 1 -- 172.21.15.22:0/1943131994 >> v2:172.21.15.192:3300/0 conn(0x7f5324159c10 msgr2=0x7f532415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5329589700 1 --2- 172.21.15.22:0/1943131994 >> v2:172.21.15.192:3300/0 conn(0x7f5324159c10 0x7f532415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5329589700 1 -- 172.21.15.22:0/1943131994 >> v1:172.21.15.22:6789/0 conn(0x7f53240b5ea0 legacy=0x7f5324068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5329589700 1 -- 172.21.15.22:0/1943131994 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532415b5d0 con 0x7f532415c910 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5328d88700 1 --2- 172.21.15.22:0/1943131994 >> v2:172.21.15.192:3300/0 conn(0x7f5324159c10 0x7f532415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f5329589700 1 --2- 172.21.15.22:0/1943131994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f532415cd50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53140098e0 tx=0x7f53140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ca88fd28a5539f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:20.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f53237fe700 1 -- 172.21.15.22:0/1943131994 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011630 con 0x7f532415c910 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f53237fe700 1 -- 172.21.15.22:0/1943131994 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5314011790 con 0x7f532415c910 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.329+0000 7f53237fe700 1 -- 172.21.15.22:0/1943131994 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5314011b30 con 0x7f532415c910 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 -- 172.21.15.22:0/1943131994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 msgr2=0x7f532415cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 --2- 172.21.15.22:0/1943131994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f532415cd50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f53140098e0 tx=0x7f53140091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 -- 172.21.15.22:0/1943131994 shutdown_connections 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 --2- 172.21.15.22:0/1943131994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f532415cd50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 --2- 172.21.15.22:0/1943131994 >> v2:172.21.15.192:3300/0 conn(0x7f5324159c10 0x7f532415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 -- 172.21.15.22:0/1943131994 >> 172.21.15.22:0/1943131994 conn(0x7f5324099a20 msgr2=0x7f53240af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 -- 172.21.15.22:0/1943131994 shutdown_connections 2023-10-08T00:32:20.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.330+0000 7f532afec700 1 -- 172.21.15.22:0/1943131994 wait complete. 2023-10-08T00:32:20.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.331+0000 7f532afec700 1 Processor -- start 2023-10-08T00:32:20.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.331+0000 7f532afec700 1 -- start start 2023-10-08T00:32:20.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f532afec700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 0x7f532409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:20.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f532afec700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5324159c10 0x7f532414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f532afec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f53241697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f532afec700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240b0870 con 0x7f53240b5ea0 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f532afec700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53240c5dc0 con 0x7f5324159c10 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f532afec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240b0dd0 con 0x7f532415c910 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 0x7f532409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 0x7f532409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44000/0 (socket says 172.21.15.22:44000) 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 -- 172.21.15.22:0/1847298593 learned_addr learned my addr 172.21.15.22:0/1847298593 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5323fff700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5324159c10 0x7f532414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5329589700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f53241697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:20.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 -- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 msgr2=0x7f53241697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f53241697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 -- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5324159c10 msgr2=0x7f532414c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5324159c10 0x7f532414c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5328d88700 1 -- 172.21.15.22:0/1847298593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009a20 con 0x7f53240b5ea0 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5329589700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f53241697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.332+0000 7f5323fff700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5324159c10 0x7f532414c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.333+0000 7f5328d88700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 0x7f532409dd00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c170 tx=0x7f531c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.333+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00ce10 con 0x7f53240b5ea0 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.333+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00f040 con 0x7f53240b5ea0 2023-10-08T00:32:20.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.333+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5314009420 con 0x7f53240b5ea0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.333+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c014690 con 0x7f53240b5ea0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.333+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53240c62f0 con 0x7f53240b5ea0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.334+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532404c3c0 con 0x7f53240b5ea0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.334+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f531c014a00 con 0x7f53240b5ea0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.335+0000 7f5320ff9700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5310067320 0x7f53100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.335+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f531c085c60 con 0x7f53240b5ea0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.335+0000 7f5323fff700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5310067320 0x7f53100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:20.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.335+0000 7f5323fff700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5310067320 0x7f53100697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5318007fd0 tx=0x7f5318009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:20.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.339+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f531c0527e0 con 0x7f53240b5ea0 2023-10-08T00:32:20.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:20.579+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f532415b870 con 0x7f53240b5ea0 2023-10-08T00:32:21.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.184+0000 7f5320ff9700 1 -- 172.21.15.22:0/1847298593 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v96) v1 ==== 122+0+0 (secure 0 0 0) 0x7f531c014cb0 con 0x7f53240b5ea0 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5310067320 msgr2=0x7f53100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5310067320 0x7f53100697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5318007fd0 tx=0x7f5318009040 comp rx=0 tx=0).stop 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 msgr2=0x7f532409dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 0x7f532409dd00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f531c00c170 tx=0x7f531c00b040 comp rx=0 tx=0).stop 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 shutdown_connections 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5310067320 0x7f53100697d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f532415c910 0x7f53241697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53240b5ea0 0x7f532409dd00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 --2- 172.21.15.22:0/1847298593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5324159c10 0x7f532414c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 >> 172.21.15.22:0/1847298593 conn(0x7f5324099a20 msgr2=0x7f5324068ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:21.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 shutdown_connections 2023-10-08T00:32:21.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.187+0000 7f532afec700 1 -- 172.21.15.22:0/1847298593 wait complete. 2023-10-08T00:32:21.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:21.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.324+0000 7facdb04f700 1 Processor -- start 2023-10-08T00:32:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.324+0000 7facdb04f700 1 -- start start 2023-10-08T00:32:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facdb04f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7facd41597f0 0x7facd40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facdb04f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd40b11d0 con 0x7facd415d230 2023-10-08T00:32:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facdb04f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd40b14b0 con 0x7facd4159420 2023-10-08T00:32:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facdb04f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40b1790 con 0x7facd41597f0 2023-10-08T00:32:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facda84e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7facd415d230 0x7facd415d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46996/0 (socket says 172.21.15.22:46996) 2023-10-08T00:32:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facda84e700 1 -- 172.21.15.22:0/2515973825 learned_addr learned my addr 172.21.15.22:0/2515973825 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:21.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facd984c700 1 --2- 172.21.15.22:0/2515973825 >> v2:172.21.15.192:3300/0 conn(0x7facd41597f0 0x7facd40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565306216 0 0) 0x7facd40b11d0 con 0x7facd415d230 2023-10-08T00:32:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.325+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc0003570 con 0x7facd415d230 2023-10-08T00:32:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223424371 0 0) 0x7facd40b14b0 con 0x7facd4159420 2023-10-08T00:32:21.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd40b11d0 con 0x7facd4159420 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953142258 0 0) 0x7facc0003570 con 0x7facd415d230 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd984c700 1 -- 172.21.15.22:0/2515973825 >> v1:172.21.15.192:6789/0 conn(0x7facd4159420 legacy=0x7facd40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd984c700 1 -- 172.21.15.22:0/2515973825 >> v1:172.21.15.22:6789/0 conn(0x7facd415d230 legacy=0x7facd415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd984c700 1 -- 172.21.15.22:0/2515973825 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40b1a70 con 0x7facd41597f0 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd984c700 1 --2- 172.21.15.22:0/2515973825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40b2270 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7facc40098e0 tx=0x7facc40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f712e8161850e05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0017f0 con 0x7facd41597f0 2023-10-08T00:32:21.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc4011420 con 0x7facd41597f0 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.326+0000 7facd904b700 1 -- 172.21.15.22:0/2515973825 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc40117c0 con 0x7facd41597f0 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 -- 172.21.15.22:0/2515973825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 msgr2=0x7facd40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 --2- 172.21.15.22:0/2515973825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40b2270 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7facc40098e0 tx=0x7facc40091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 -- 172.21.15.22:0/2515973825 shutdown_connections 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 --2- 172.21.15.22:0/2515973825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40b2270 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 -- 172.21.15.22:0/2515973825 >> 172.21.15.22:0/2515973825 conn(0x7facd40d0660 msgr2=0x7facd40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 -- 172.21.15.22:0/2515973825 shutdown_connections 2023-10-08T00:32:21.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.327+0000 7facdb04f700 1 -- 172.21.15.22:0/2515973825 wait complete. 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.328+0000 7facdb04f700 1 Processor -- start 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.328+0000 7facdb04f700 1 -- start start 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd4159420 0x7facd4169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 0x7facd4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c7250 con 0x7facd415d230 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c5e60 con 0x7facd41597f0 2023-10-08T00:32:21.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40c62f0 con 0x7facd4159420 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 0x7facd4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 0x7facd4068ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44016/0 (socket says 172.21.15.22:44016) 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 -- 172.21.15.22:0/776823449 learned_addr learned my addr 172.21.15.22:0/776823449 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facd984c700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda04d700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd4159420 0x7facd4169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 -- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd4159420 msgr2=0x7facd4169c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd4159420 0x7facd4169c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 -- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 msgr2=0x7facd40c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 -- 172.21.15.22:0/776823449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4009420 con 0x7facd415d230 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facd984c700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facda84e700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 0x7facd4068ce0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7faccc00cb10 tx=0x7faccc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc004dc0 con 0x7facd415d230 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00a620 con 0x7facd415d230 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc00a9e0 con 0x7facd415d230 2023-10-08T00:32:21.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.329+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40c5530 con 0x7facd415d230 2023-10-08T00:32:21.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.330+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd40c5af0 con 0x7facd415d230 2023-10-08T00:32:21.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.330+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd40c5fd0 con 0x7facd415d230 2023-10-08T00:32:21.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.331+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faccc007150 con 0x7facd415d230 2023-10-08T00:32:21.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.331+0000 7facca7fc700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7facb8067320 0x7facb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.332+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faccc0842e0 con 0x7facd415d230 2023-10-08T00:32:21.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.332+0000 7facda04d700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7facb8067320 0x7facb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.332+0000 7facda04d700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7facb8067320 0x7facb80697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7facd0003870 tx=0x7facd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:21.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.336+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faccc050ff0 con 0x7facd415d230 2023-10-08T00:32:21.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.572+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facd404c3c0 con 0x7facd415d230 2023-10-08T00:32:21.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.573+0000 7facca7fc700 1 -- 172.21.15.22:0/776823449 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4607 (secure 0 0 0) 0x7faccc054610 con 0x7facd415d230 2023-10-08T00:32:21.574 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:21.574 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":96,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:21.179774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:21.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7facb8067320 msgr2=0x7facb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7facb8067320 0x7facb80697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7facd0003870 tx=0x7facd0009040 comp rx=0 tx=0).stop 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 msgr2=0x7facd4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 0x7facd4068ce0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7faccc00cb10 tx=0x7faccc007c70 comp rx=0 tx=0).stop 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 shutdown_connections 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7facd415d230 0x7facd4068ce0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7facb8067320 0x7facb80697d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7facd4159420 0x7facd4169c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 --2- 172.21.15.22:0/776823449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7facd41597f0 0x7facd40c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 >> 172.21.15.22:0/776823449 conn(0x7facd40d0660 msgr2=0x7facd40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 shutdown_connections 2023-10-08T00:32:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.575+0000 7facdb04f700 1 -- 172.21.15.22:0/776823449 wait complete. 2023-10-08T00:32:21.577 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 96 2023-10-08T00:32:21.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:21.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.706+0000 7fb328bf9700 1 Processor -- start 2023-10-08T00:32:21.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.706+0000 7fb328bf9700 1 -- start start 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb328bf9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 0x7fb3240b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb328bf9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240b11d0 con 0x7fb324159420 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb328bf9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240b14b0 con 0x7fb32415d230 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb328bf9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240b1790 con 0x7fb3241597f0 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb3237fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb324159420 0x7fb3240b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47006/0 (socket says 172.21.15.22:47006) 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb3237fe700 1 -- 172.21.15.22:0/2587577817 learned_addr learned my addr 172.21.15.22:0/2587577817 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:21.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb322ffd700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 0x7fb3240b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.707+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960597162 0 0) 0x7fb3240b11d0 con 0x7fb324159420 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb30c003570 con 0x7fb324159420 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1453718317 0 0) 0x7fb30c003570 con 0x7fb324159420 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 msgr2=0x7fb3240b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 0x7fb3240b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 >> v1:172.21.15.192:6789/0 conn(0x7fb32415d230 legacy=0x7fb3240b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240b1a70 con 0x7fb324159420 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fb314001470 con 0x7fb324159420 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 >> v1:172.21.15.22:6789/0 conn(0x7fb324159420 legacy=0x7fb3240b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 0x7fb30c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb30c004010 0x7fb30c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c004d50 0x7fb30c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240b1790 con 0x7fb30c004d50 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c00bbf0 con 0x7fb30c004010 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c00bdb0 con 0x7fb3241597f0 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb323fff700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c004d50 0x7fb30c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb3237fe700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 0x7fb30c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb322ffd700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb30c004010 0x7fb30c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb323fff700 1 -- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 msgr2=0x7fb30c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb323fff700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241597f0 0x7fb30c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb323fff700 1 -- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb30c004010 msgr2=0x7fb30c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb323fff700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb30c004010 0x7fb30c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.708+0000 7fb323fff700 1 -- 172.21.15.22:0/2587577817 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c003570 con 0x7fb30c004d50 2023-10-08T00:32:21.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb323fff700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c004d50 0x7fb30c0051c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb31c001f90 tx=0x7fb31c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8c9f77f64455e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c001950 con 0x7fb30c004d50 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c00c8b0 con 0x7fb30c004d50 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb3227fc700 1 -- 172.21.15.22:0/2587577817 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c00cc70 con 0x7fb30c004d50 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb328bf9700 1 -- 172.21.15.22:0/2587577817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c004d50 msgr2=0x7fb30c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb328bf9700 1 --2- 172.21.15.22:0/2587577817 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c004d50 0x7fb30c0051c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb31c001f90 tx=0x7fb31c001640 comp rx=0 tx=0).stop 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb323fff700 1 -- 172.21.15.22:0/2587577817 reap_dead start 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb328bf9700 1 -- 172.21.15.22:0/2587577817 shutdown_connections 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb328bf9700 1 -- 172.21.15.22:0/2587577817 >> 172.21.15.22:0/2587577817 conn(0x7fb3240d0660 msgr2=0x7fb3240d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb328bf9700 1 -- 172.21.15.22:0/2587577817 shutdown_connections 2023-10-08T00:32:21.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.709+0000 7fb328bf9700 1 -- 172.21.15.22:0/2587577817 wait complete. 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 Processor -- start 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 -- start start 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb324154ce0 0x7fb324169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241550b0 0x7fb32415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 0x7fb3240c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb324169e80 con 0x7fb32415be90 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415e370 con 0x7fb324154ce0 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb328bf9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32415ebf0 con 0x7fb3241550b0 2023-10-08T00:32:21.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb323fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 0x7fb3240c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb323fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 0x7fb3240c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44026/0 (socket says 172.21.15.22:44026) 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb323fff700 1 -- 172.21.15.22:0/4287602514 learned_addr learned my addr 172.21.15.22:0/4287602514 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb3237fe700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb324154ce0 0x7fb324169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.711+0000 7fb322ffd700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241550b0 0x7fb32415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb323fff700 1 -- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241550b0 msgr2=0x7fb32415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb323fff700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241550b0 0x7fb32415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb323fff700 1 -- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb324154ce0 msgr2=0x7fb324169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb323fff700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb324154ce0 0x7fb324169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb323fff700 1 -- 172.21.15.22:0/4287602514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32415c3d0 con 0x7fb32415be90 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb323fff700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 0x7fb3240c5820 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c6a0 tx=0x7fb31c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c001950 con 0x7fb32415be90 2023-10-08T00:32:21.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c00c6d0 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32415e5a0 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c01e400 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.712+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32415aa00 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.713+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32415eda0 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.713+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb31c019070 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.714+0000 7fb30b7fe700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb310067320 0x7fb3100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.714+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb31c086120 con 0x7fb32415be90 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.714+0000 7fb3237fe700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb310067320 0x7fb3100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:21.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.714+0000 7fb3237fe700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb310067320 0x7fb3100697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb3140015a0 tx=0x7fb314001e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:21.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.718+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb32415eda0 con 0x7fb32415be90 2023-10-08T00:32:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.916+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb32415eda0 con 0x7fb32415be90 2023-10-08T00:32:21.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.917+0000 7fb30b7fe700 1 -- 172.21.15.22:0/4287602514 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fb32415eda0 con 0x7fb32415be90 2023-10-08T00:32:21.917 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:21.917 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":141,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:19.146890+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:16.504058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb310067320 msgr2=0x7fb3100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb310067320 0x7fb3100697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb3140015a0 tx=0x7fb314001e50 comp rx=0 tx=0).stop 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 msgr2=0x7fb3240c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 0x7fb3240c5820 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb31c00c6a0 tx=0x7fb31c015000 comp rx=0 tx=0).stop 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 shutdown_connections 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb32415be90 0x7fb3240c5820 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb324154ce0 0x7fb324169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb310067320 0x7fb3100697d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 --2- 172.21.15.22:0/4287602514 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb3241550b0 0x7fb32415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 >> 172.21.15.22:0/4287602514 conn(0x7fb3240d0660 msgr2=0x7fb324069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 shutdown_connections 2023-10-08T00:32:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:21.919+0000 7fb328bf9700 1 -- 172.21.15.22:0/4287602514 wait complete. 2023-10-08T00:32:21.932 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:32:21.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:22.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.051+0000 7f2393d52700 1 Processor -- start 2023-10-08T00:32:22.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.051+0000 7f2393d52700 1 -- start start 2023-10-08T00:32:22.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f2393d52700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f238c0b5ea0 0x7f238c068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f2393d52700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f2393d52700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c15c480 con 0x7f238c159c10 2023-10-08T00:32:22.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f2393d52700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0b2a40 con 0x7f238c0b5ea0 2023-10-08T00:32:22.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f2393d52700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c15b870 con 0x7f238c068bb0 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f23912ed700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f238c0b5ea0 0x7f238c068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f23922ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f23922ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c15c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:60930/0 (socket says 172.21.15.22:60930) 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f2391aee700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f238c159c10 0x7f238c15b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:56870/0 (socket says 172.21.15.22:56870) 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f23912ed700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f238c0b5ea0 0x7f238c068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:45932/0 (socket says 172.21.15.22:45932) 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.052+0000 7f23922ef700 1 -- 172.21.15.22:0/1107912717 learned_addr learned my addr 172.21.15.22:0/1107912717 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f23922ef700 1 -- 172.21.15.22:0/1107912717 >> v2:172.21.15.192:3300/0 conn(0x7f238c0b5ea0 msgr2=0x7f238c068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f23922ef700 1 --2- 172.21.15.22:0/1107912717 >> v2:172.21.15.192:3300/0 conn(0x7f238c0b5ea0 0x7f238c068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f23922ef700 1 -- 172.21.15.22:0/1107912717 >> v1:172.21.15.192:6789/0 conn(0x7f238c159c10 legacy=0x7f238c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f23922ef700 1 -- 172.21.15.22:0/1107912717 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c15bb50 con 0x7f238c068bb0 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f23922ef700 1 --2- 172.21.15.22:0/1107912717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c15c910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2384009f20 tx=0x7f2384009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7286b7320ab1482c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f2390aec700 1 -- 172.21.15.22:0/1107912717 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400e070 con 0x7f238c068bb0 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f2390aec700 1 -- 172.21.15.22:0/1107912717 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238400b9d0 con 0x7f238c068bb0 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f2390aec700 1 -- 172.21.15.22:0/1107912717 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840092e0 con 0x7f238c068bb0 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f2393d52700 1 -- 172.21.15.22:0/1107912717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 msgr2=0x7f238c15c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.053+0000 7f2393d52700 1 --2- 172.21.15.22:0/1107912717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c15c910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2384009f20 tx=0x7f2384009840 comp rx=0 tx=0).stop 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.054+0000 7f2393d52700 1 -- 172.21.15.22:0/1107912717 shutdown_connections 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.054+0000 7f2393d52700 1 --2- 172.21.15.22:0/1107912717 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c15c910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.054+0000 7f2393d52700 1 --2- 172.21.15.22:0/1107912717 >> v2:172.21.15.192:3300/0 conn(0x7f238c0b5ea0 0x7f238c068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.054+0000 7f2393d52700 1 -- 172.21.15.22:0/1107912717 >> 172.21.15.22:0/1107912717 conn(0x7f238c099a20 msgr2=0x7f238c0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.054+0000 7f2393d52700 1 -- 172.21.15.22:0/1107912717 shutdown_connections 2023-10-08T00:32:22.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.054+0000 7f2393d52700 1 -- 172.21.15.22:0/1107912717 wait complete. 2023-10-08T00:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.055+0000 7f2393d52700 1 Processor -- start 2023-10-08T00:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.055+0000 7f2393d52700 1 -- start start 2023-10-08T00:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.055+0000 7f2393d52700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.055+0000 7f2393d52700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f238c0b5ea0 0x7f238c0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2393d52700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 0x7f238c0b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2393d52700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0d13a0 con 0x7f238c159c10 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2393d52700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0c6df0 con 0x7f238c0b5ea0 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2393d52700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0c85a0 con 0x7f238c068bb0 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 0x7f238c0b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 0x7f238c0b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44034/0 (socket says 172.21.15.22:44034) 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 -- 172.21.15.22:0/4159045434 learned_addr learned my addr 172.21.15.22:0/4159045434 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2391aee700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23912ed700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f238c0b5ea0 0x7f238c0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 -- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 msgr2=0x7f238c0c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c0c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 -- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f238c0b5ea0 msgr2=0x7f238c0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f238c0b5ea0 0x7f238c0b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 -- 172.21.15.22:0/4159045434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009ae0 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23912ed700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f238c0b5ea0 0x7f238c0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f23922ef700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 0x7f238c0b08b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2384009430 tx=0x7f2384018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384008bb0 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384008d10 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c16a300 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.056+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384026690 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.057+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c0c7bd0 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.057+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c0c7d60 con 0x7f238c159c10 2023-10-08T00:32:22.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.058+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2384003040 con 0x7f238c159c10 2023-10-08T00:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.058+0000 7f2389ffb700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2378067320 0x7f23780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.058+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2384086c20 con 0x7f238c159c10 2023-10-08T00:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.058+0000 7f2391aee700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2378067320 0x7f23780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.059+0000 7f2391aee700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2378067320 0x7f23780697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f237c004fd0 tx=0x7f237c007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.062+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2384053760 con 0x7f238c159c10 2023-10-08T00:32:22.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.253+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f238c04c3c0 con 0x7f2378067320 2023-10-08T00:32:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.261+0000 7f2389ffb700 1 -- 172.21.15.22:0/4159045434 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274647 (secure 0 0 0) 0x7f238c04c3c0 con 0x7f2378067320 2023-10-08T00:32:22.265 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2378067320 msgr2=0x7f23780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2378067320 0x7f23780697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f237c004fd0 tx=0x7f237c007eb0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 msgr2=0x7f238c0b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 0x7f238c0b08b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2384009430 tx=0x7f2384018000 comp rx=0 tx=0).stop 2023-10-08T00:32:22.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 shutdown_connections 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f238c159c10 0x7f238c0b08b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2378067320 0x7f23780697d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f238c068bb0 0x7f238c0c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 --2- 172.21.15.22:0/4159045434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f238c0b5ea0 0x7f238c0b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 >> 172.21.15.22:0/4159045434 conn(0x7f238c099a20 msgr2=0x7f238c09a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 shutdown_connections 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.265+0000 7f2393d52700 1 -- 172.21.15.22:0/4159045434 wait complete. 2023-10-08T00:32:22.268 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:22.277 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2023-10-08T00:32:20.489624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2425744,"kb_used_data":14672,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548976,"statfs":{"total":773094113280,"available":770610151424,"internally_reserved":0,"allocated":15024128,"data_stored":7357322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.369297"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:17.117903+0000","last_change":"2023-10-08T00:32:17.117903+0000","last_active":"2023-10-08T00:32:17.117903+0000","last_peered":"2023-10-08T00:32:17.117903+0000","last_clean":"2023-10-08T00:32:17.117903+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:17.117903+0000","last_undegraded":"2023-10-08T00:32:17.117903+0000","last_fullsized":"2023-10-08T00:32:17.117903+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:16.115946+0000","last_change":"2023-10-08T00:32:16.115946+0000","last_active":"2023-10-08T00:32:16.115946+0000","last_peered":"2023-10-08T00:32:16.115946+0000","last_clean":"2023-10-08T00:32:16.115946+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:16.115946+0000","last_undegraded":"2023-10-08T00:32:16.115946+0000","last_fullsized":"2023-10-08T00:32:16.115946+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":260,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-08T00:32:14.203927+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:14.203927+0000","last_peered":"2023-10-08T00:32:14.203927+0000","last_clean":"2023-10-08T00:32:14.203927+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:14.203927+0000","last_undegraded":"2023-10-08T00:32:14.203927+0000","last_fullsized":"2023-10-08T00:32:14.203927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1358500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.58199999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.59299999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.625}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.49399999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.51100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":773387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.622},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60199999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":773387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.317},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.373}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.38900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.621}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.746},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.46200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1363755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.50600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.63700000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.39000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.55000000000000004,"15min":0.63100000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.374},"min":{"1min":0.253,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.41999999999999998},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.60699999999999998,"15min":0.64700000000000002},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.748},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.69599999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":1.242},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.82499999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0800000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":773387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.44900000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.32400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.41699999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.72199999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.85999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574943,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":773387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.30099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.28699999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.621},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.73599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303064,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068776,"statfs":{"total":96636764160,"available":96326426624,"internally_reserved":0,"allocated":1720320,"data_stored":768132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.501},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.46400000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.57599999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.66900000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.625}]}]},{"osd":5,"up_from":13,"seq":55834574941,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":773387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.622}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.43099999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51700000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.46300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:22.286 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.435+0000 7f32414d7700 1 Processor -- start 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.435+0000 7f32414d7700 1 -- start start 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f32414d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f323c159890 0x7f323c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f32414d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c159c60 0x7f323c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f32414d7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c15a160 con 0x7f323c15db10 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f32414d7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c0d13a0 con 0x7f323c159890 2023-10-08T00:32:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f32414d7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15e140 con 0x7f323c159c60 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f323affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f323c159890 0x7f323c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f323b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f323c15db10 0x7f323c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47020/0 (socket says 172.21.15.22:47020) 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.436+0000 7f323b7fe700 1 -- 172.21.15.22:0/683040724 learned_addr learned my addr 172.21.15.22:0/683040724 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f323a7fc700 1 --2- 172.21.15.22:0/683040724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c159c60 0x7f323c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f323affd700 1 -- 172.21.15.22:0/683040724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c159c60 msgr2=0x7f323c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f323affd700 1 --2- 172.21.15.22:0/683040724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c159c60 0x7f323c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f323affd700 1 -- 172.21.15.22:0/683040724 >> v1:172.21.15.22:6789/0 conn(0x7f323c15db10 legacy=0x7f323c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f323affd700 1 -- 172.21.15.22:0/683040724 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c15a3d0 con 0x7f323c159890 2023-10-08T00:32:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f3239ffb700 1 -- 172.21.15.22:0/683040724 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782913897 0 0) 0x7f323c15a160 con 0x7f323c15db10 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f323affd700 1 --2- 172.21.15.22:0/683040724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15abd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f32340098e0 tx=0x7f32340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59650bc68c79a09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f3239ffb700 1 -- 172.21.15.22:0/683040724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323400b640 con 0x7f323c159890 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f3239ffb700 1 -- 172.21.15.22:0/683040724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323400b7a0 con 0x7f323c159890 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.437+0000 7f3239ffb700 1 -- 172.21.15.22:0/683040724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323400bb40 con 0x7f323c159890 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 -- 172.21.15.22:0/683040724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 msgr2=0x7f323c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 --2- 172.21.15.22:0/683040724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15abd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f32340098e0 tx=0x7f32340091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 -- 172.21.15.22:0/683040724 shutdown_connections 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 --2- 172.21.15.22:0/683040724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15abd0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 --2- 172.21.15.22:0/683040724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c159c60 0x7f323c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 -- 172.21.15.22:0/683040724 >> 172.21.15.22:0/683040724 conn(0x7f323c068e20 msgr2=0x7f323c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 -- 172.21.15.22:0/683040724 shutdown_connections 2023-10-08T00:32:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.438+0000 7f32414d7700 1 -- 172.21.15.22:0/683040724 wait complete. 2023-10-08T00:32:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.439+0000 7f32414d7700 1 Processor -- start 2023-10-08T00:32:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.439+0000 7f32414d7700 1 -- start start 2023-10-08T00:32:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f32414d7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f32414d7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f323c159c60 0x7f323c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f32414d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c15db10 0x7f323c14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f32414d7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15c850 con 0x7f323c159890 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f32414d7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15bc40 con 0x7f323c159c60 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f32414d7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15bf20 con 0x7f323c15db10 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44054/0 (socket says 172.21.15.22:44054) 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 -- 172.21.15.22:0/1234252158 learned_addr learned my addr 172.21.15.22:0/1234252158 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 -- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c15db10 msgr2=0x7f323c14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c15db10 0x7f323c14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 -- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f323c159c60 msgr2=0x7f323c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f323c159c60 0x7f323c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 -- 172.21.15.22:0/1234252158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234009420 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f323affd700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15cce0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f323c0899c0 tx=0x7f3234017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.440+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323400bb20 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.441+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234011420 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.441+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c15c200 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.441+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340117c0 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.441+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c0ce550 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.441+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c04c3c0 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.442+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3234011b70 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.442+0000 7f3232ffd700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f321c067320 0x7f321c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.442+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3234086390 con 0x7f323c159890 2023-10-08T00:32:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.443+0000 7f323a7fc700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f321c067320 0x7f321c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.443+0000 7f323a7fc700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f321c067320 0x7f321c0697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f323c158d70 tx=0x7f32240091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.447+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3234052fe0 con 0x7f323c159890 2023-10-08T00:32:22.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.634+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f323c15c090 con 0x7f321c067320 2023-10-08T00:32:22.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.643+0000 7f3232ffd700 1 -- 172.21.15.22:0/1234252158 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289773 (secure 0 0 0) 0x7f323c15c090 con 0x7f321c067320 2023-10-08T00:32:22.648 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:22.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f321c067320 msgr2=0x7f321c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f321c067320 0x7f321c0697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f323c158d70 tx=0x7f32240091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 msgr2=0x7f323c15cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15cce0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f323c0899c0 tx=0x7f3234017000 comp rx=0 tx=0).stop 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 shutdown_connections 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f321c067320 0x7f321c0697d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f323c15db10 0x7f323c14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f323c159890 0x7f323c15cce0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 --2- 172.21.15.22:0/1234252158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f323c159c60 0x7f323c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.645+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 >> 172.21.15.22:0/1234252158 conn(0x7f323c068e20 msgr2=0x7f323c0b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:22.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.646+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 shutdown_connections 2023-10-08T00:32:22.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.646+0000 7f32414d7700 1 -- 172.21.15.22:0/1234252158 wait complete. 2023-10-08T00:32:22.652 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:22.658 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2023-10-08T00:32:22.490053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426216,"kb_used_data":15144,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548504,"statfs":{"total":773094113280,"available":770609668096,"internally_reserved":0,"allocated":15507456,"data_stored":7573396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001246"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178317+0000","last_change":"2023-10-08T00:32:18.175472+0000","last_active":"2023-10-08T00:32:18.178317+0000","last_peered":"2023-10-08T00:32:18.178317+0000","last_clean":"2023-10-08T00:32:18.178317+0000","last_became_active":"2023-10-08T00:32:18.175190+0000","last_became_peered":"2023-10-08T00:32:18.175190+0000","last_unstale":"2023-10-08T00:32:18.178317+0000","last_undegraded":"2023-10-08T00:32:18.178317+0000","last_fullsized":"2023-10-08T00:32:18.178317+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:47:03.418395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167107+0000","last_change":"2023-10-08T00:32:18.163773+0000","last_active":"2023-10-08T00:32:18.167107+0000","last_peered":"2023-10-08T00:32:18.167107+0000","last_clean":"2023-10-08T00:32:18.167107+0000","last_became_active":"2023-10-08T00:32:18.163470+0000","last_became_peered":"2023-10-08T00:32:18.163470+0000","last_unstale":"2023-10-08T00:32:18.167107+0000","last_undegraded":"2023-10-08T00:32:18.167107+0000","last_fullsized":"2023-10-08T00:32:18.167107+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:59:56.442897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170801+0000","last_change":"2023-10-08T00:32:18.167348+0000","last_active":"2023-10-08T00:32:18.170801+0000","last_peered":"2023-10-08T00:32:18.170801+0000","last_clean":"2023-10-08T00:32:18.170801+0000","last_became_active":"2023-10-08T00:32:18.165705+0000","last_became_peered":"2023-10-08T00:32:18.165705+0000","last_unstale":"2023-10-08T00:32:18.170801+0000","last_undegraded":"2023-10-08T00:32:18.170801+0000","last_fullsized":"2023-10-08T00:32:18.170801+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:21.910522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167119+0000","last_change":"2023-10-08T00:32:18.164220+0000","last_active":"2023-10-08T00:32:18.167119+0000","last_peered":"2023-10-08T00:32:18.167119+0000","last_clean":"2023-10-08T00:32:18.167119+0000","last_became_active":"2023-10-08T00:32:18.163989+0000","last_became_peered":"2023-10-08T00:32:18.163989+0000","last_unstale":"2023-10-08T00:32:18.167119+0000","last_undegraded":"2023-10-08T00:32:18.167119+0000","last_fullsized":"2023-10-08T00:32:18.167119+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:26.108419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170809+0000","last_change":"2023-10-08T00:32:18.168352+0000","last_active":"2023-10-08T00:32:18.170809+0000","last_peered":"2023-10-08T00:32:18.170809+0000","last_clean":"2023-10-08T00:32:18.170809+0000","last_became_active":"2023-10-08T00:32:18.167917+0000","last_became_peered":"2023-10-08T00:32:18.167917+0000","last_unstale":"2023-10-08T00:32:18.170809+0000","last_undegraded":"2023-10-08T00:32:18.170809+0000","last_fullsized":"2023-10-08T00:32:18.170809+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:01:28.155625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174138+0000","last_change":"2023-10-08T00:32:18.173750+0000","last_active":"2023-10-08T00:32:18.174138+0000","last_peered":"2023-10-08T00:32:18.174138+0000","last_clean":"2023-10-08T00:32:18.174138+0000","last_became_active":"2023-10-08T00:32:18.173412+0000","last_became_peered":"2023-10-08T00:32:18.173412+0000","last_unstale":"2023-10-08T00:32:18.174138+0000","last_undegraded":"2023-10-08T00:32:18.174138+0000","last_fullsized":"2023-10-08T00:32:18.174138+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:14:22.591559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170200+0000","last_change":"2023-10-08T00:32:18.168205+0000","last_active":"2023-10-08T00:32:18.170200+0000","last_peered":"2023-10-08T00:32:18.170200+0000","last_clean":"2023-10-08T00:32:18.170200+0000","last_became_active":"2023-10-08T00:32:18.167626+0000","last_became_peered":"2023-10-08T00:32:18.167626+0000","last_unstale":"2023-10-08T00:32:18.170200+0000","last_undegraded":"2023-10-08T00:32:18.170200+0000","last_fullsized":"2023-10-08T00:32:18.170200+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:31.634816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.177992+0000","last_change":"2023-10-08T00:32:18.177232+0000","last_active":"2023-10-08T00:32:18.177992+0000","last_peered":"2023-10-08T00:32:18.177992+0000","last_clean":"2023-10-08T00:32:18.177992+0000","last_became_active":"2023-10-08T00:32:18.176731+0000","last_became_peered":"2023-10-08T00:32:18.176731+0000","last_unstale":"2023-10-08T00:32:18.177992+0000","last_undegraded":"2023-10-08T00:32:18.177992+0000","last_fullsized":"2023-10-08T00:32:18.177992+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:17:56.246330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167459+0000","last_change":"2023-10-08T00:32:18.166245+0000","last_active":"2023-10-08T00:32:18.167459+0000","last_peered":"2023-10-08T00:32:18.167459+0000","last_clean":"2023-10-08T00:32:18.167459+0000","last_became_active":"2023-10-08T00:32:18.165948+0000","last_became_peered":"2023-10-08T00:32:18.165948+0000","last_unstale":"2023-10-08T00:32:18.167459+0000","last_undegraded":"2023-10-08T00:32:18.167459+0000","last_fullsized":"2023-10-08T00:32:18.167459+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:25.649519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.172080+0000","last_change":"2023-10-08T00:32:18.161354+0000","last_active":"2023-10-08T00:32:18.172080+0000","last_peered":"2023-10-08T00:32:18.172080+0000","last_clean":"2023-10-08T00:32:18.172080+0000","last_became_active":"2023-10-08T00:32:18.161086+0000","last_became_peered":"2023-10-08T00:32:18.161086+0000","last_unstale":"2023-10-08T00:32:18.172080+0000","last_undegraded":"2023-10-08T00:32:18.172080+0000","last_fullsized":"2023-10-08T00:32:18.172080+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:21:20.204038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178218+0000","last_change":"2023-10-08T00:32:18.173369+0000","last_active":"2023-10-08T00:32:18.178218+0000","last_peered":"2023-10-08T00:32:18.178218+0000","last_clean":"2023-10-08T00:32:18.178218+0000","last_became_active":"2023-10-08T00:32:18.173062+0000","last_became_peered":"2023-10-08T00:32:18.173062+0000","last_unstale":"2023-10-08T00:32:18.178218+0000","last_undegraded":"2023-10-08T00:32:18.178218+0000","last_fullsized":"2023-10-08T00:32:18.178218+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:08:12.338583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174746+0000","last_change":"2023-10-08T00:32:18.171423+0000","last_active":"2023-10-08T00:32:18.174746+0000","last_peered":"2023-10-08T00:32:18.174746+0000","last_clean":"2023-10-08T00:32:18.174746+0000","last_became_active":"2023-10-08T00:32:18.171145+0000","last_became_peered":"2023-10-08T00:32:18.171145+0000","last_unstale":"2023-10-08T00:32:18.174746+0000","last_undegraded":"2023-10-08T00:32:18.174746+0000","last_fullsized":"2023-10-08T00:32:18.174746+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:15:11.871158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167067+0000","last_change":"2023-10-08T00:32:18.158482+0000","last_active":"2023-10-08T00:32:18.167067+0000","last_peered":"2023-10-08T00:32:18.167067+0000","last_clean":"2023-10-08T00:32:18.167067+0000","last_became_active":"2023-10-08T00:32:18.158165+0000","last_became_peered":"2023-10-08T00:32:18.158165+0000","last_unstale":"2023-10-08T00:32:18.167067+0000","last_undegraded":"2023-10-08T00:32:18.167067+0000","last_fullsized":"2023-10-08T00:32:18.167067+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:25.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167030+0000","last_change":"2023-10-08T00:32:18.166001+0000","last_active":"2023-10-08T00:32:18.167030+0000","last_peered":"2023-10-08T00:32:18.167030+0000","last_clean":"2023-10-08T00:32:18.167030+0000","last_became_active":"2023-10-08T00:32:18.165754+0000","last_became_peered":"2023-10-08T00:32:18.165754+0000","last_unstale":"2023-10-08T00:32:18.167030+0000","last_undegraded":"2023-10-08T00:32:18.167030+0000","last_fullsized":"2023-10-08T00:32:18.167030+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:01.870338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174706+0000","last_change":"2023-10-08T00:32:18.171380+0000","last_active":"2023-10-08T00:32:18.174706+0000","last_peered":"2023-10-08T00:32:18.174706+0000","last_clean":"2023-10-08T00:32:18.174706+0000","last_became_active":"2023-10-08T00:32:18.171087+0000","last_became_peered":"2023-10-08T00:32:18.171087+0000","last_unstale":"2023-10-08T00:32:18.174706+0000","last_undegraded":"2023-10-08T00:32:18.174706+0000","last_fullsized":"2023-10-08T00:32:18.174706+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:57:50.557957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175916+0000","last_change":"2023-10-08T00:32:18.168847+0000","last_active":"2023-10-08T00:32:18.175916+0000","last_peered":"2023-10-08T00:32:18.175916+0000","last_clean":"2023-10-08T00:32:18.175916+0000","last_became_active":"2023-10-08T00:32:18.167957+0000","last_became_peered":"2023-10-08T00:32:18.167957+0000","last_unstale":"2023-10-08T00:32:18.175916+0000","last_undegraded":"2023-10-08T00:32:18.175916+0000","last_fullsized":"2023-10-08T00:32:18.175916+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:05:37.389589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170469+0000","last_change":"2023-10-08T00:32:18.167208+0000","last_active":"2023-10-08T00:32:18.170469+0000","last_peered":"2023-10-08T00:32:18.170469+0000","last_clean":"2023-10-08T00:32:18.170469+0000","last_became_active":"2023-10-08T00:32:18.166927+0000","last_became_peered":"2023-10-08T00:32:18.166927+0000","last_unstale":"2023-10-08T00:32:18.170469+0000","last_undegraded":"2023-10-08T00:32:18.170469+0000","last_fullsized":"2023-10-08T00:32:18.170469+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:25.291926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175779+0000","last_change":"2023-10-08T00:32:18.171199+0000","last_active":"2023-10-08T00:32:18.175779+0000","last_peered":"2023-10-08T00:32:18.175779+0000","last_clean":"2023-10-08T00:32:18.175779+0000","last_became_active":"2023-10-08T00:32:18.170942+0000","last_became_peered":"2023-10-08T00:32:18.170942+0000","last_unstale":"2023-10-08T00:32:18.175779+0000","last_undegraded":"2023-10-08T00:32:18.175779+0000","last_fullsized":"2023-10-08T00:32:18.175779+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:07.019608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171634+0000","last_change":"2023-10-08T00:32:18.168331+0000","last_active":"2023-10-08T00:32:18.171634+0000","last_peered":"2023-10-08T00:32:18.171634+0000","last_clean":"2023-10-08T00:32:18.171634+0000","last_became_active":"2023-10-08T00:32:18.166373+0000","last_became_peered":"2023-10-08T00:32:18.166373+0000","last_unstale":"2023-10-08T00:32:18.171634+0000","last_undegraded":"2023-10-08T00:32:18.171634+0000","last_fullsized":"2023-10-08T00:32:18.171634+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:23:44.361621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.164082+0000","last_change":"2023-10-08T00:32:18.161937+0000","last_active":"2023-10-08T00:32:18.164082+0000","last_peered":"2023-10-08T00:32:18.164082+0000","last_clean":"2023-10-08T00:32:18.164082+0000","last_became_active":"2023-10-08T00:32:18.159050+0000","last_became_peered":"2023-10-08T00:32:18.159050+0000","last_unstale":"2023-10-08T00:32:18.164082+0000","last_undegraded":"2023-10-08T00:32:18.164082+0000","last_fullsized":"2023-10-08T00:32:18.164082+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:01.670998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170790+0000","last_change":"2023-10-08T00:32:18.168173+0000","last_active":"2023-10-08T00:32:18.170790+0000","last_peered":"2023-10-08T00:32:18.170790+0000","last_clean":"2023-10-08T00:32:18.170790+0000","last_became_active":"2023-10-08T00:32:18.167562+0000","last_became_peered":"2023-10-08T00:32:18.167562+0000","last_unstale":"2023-10-08T00:32:18.170790+0000","last_undegraded":"2023-10-08T00:32:18.170790+0000","last_fullsized":"2023-10-08T00:32:18.170790+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:15.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171599+0000","last_change":"2023-10-08T00:32:18.166982+0000","last_active":"2023-10-08T00:32:18.171599+0000","last_peered":"2023-10-08T00:32:18.171599+0000","last_clean":"2023-10-08T00:32:18.171599+0000","last_became_active":"2023-10-08T00:32:18.166540+0000","last_became_peered":"2023-10-08T00:32:18.166540+0000","last_unstale":"2023-10-08T00:32:18.171599+0000","last_undegraded":"2023-10-08T00:32:18.171599+0000","last_fullsized":"2023-10-08T00:32:18.171599+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:10.073572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.168684+0000","last_change":"2023-10-08T00:32:18.163224+0000","last_active":"2023-10-08T00:32:18.168684+0000","last_peered":"2023-10-08T00:32:18.168684+0000","last_clean":"2023-10-08T00:32:18.168684+0000","last_became_active":"2023-10-08T00:32:18.162974+0000","last_became_peered":"2023-10-08T00:32:18.162974+0000","last_unstale":"2023-10-08T00:32:18.168684+0000","last_undegraded":"2023-10-08T00:32:18.168684+0000","last_fullsized":"2023-10-08T00:32:18.168684+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:30:19.088589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174547+0000","last_change":"2023-10-08T00:32:18.163673+0000","last_active":"2023-10-08T00:32:18.174547+0000","last_peered":"2023-10-08T00:32:18.174547+0000","last_clean":"2023-10-08T00:32:18.174547+0000","last_became_active":"2023-10-08T00:32:18.163249+0000","last_became_peered":"2023-10-08T00:32:18.163249+0000","last_unstale":"2023-10-08T00:32:18.174547+0000","last_undegraded":"2023-10-08T00:32:18.174547+0000","last_fullsized":"2023-10-08T00:32:18.174547+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:50.581112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167217+0000","last_change":"2023-10-08T00:32:18.160909+0000","last_active":"2023-10-08T00:32:18.167217+0000","last_peered":"2023-10-08T00:32:18.167217+0000","last_clean":"2023-10-08T00:32:18.167217+0000","last_became_active":"2023-10-08T00:32:18.159655+0000","last_became_peered":"2023-10-08T00:32:18.159655+0000","last_unstale":"2023-10-08T00:32:18.167217+0000","last_undegraded":"2023-10-08T00:32:18.167217+0000","last_fullsized":"2023-10-08T00:32:18.167217+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:51.199179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.169921+0000","last_change":"2023-10-08T00:32:18.159334+0000","last_active":"2023-10-08T00:32:18.169921+0000","last_peered":"2023-10-08T00:32:18.169921+0000","last_clean":"2023-10-08T00:32:18.169921+0000","last_became_active":"2023-10-08T00:32:18.159054+0000","last_became_peered":"2023-10-08T00:32:18.159054+0000","last_unstale":"2023-10-08T00:32:18.169921+0000","last_undegraded":"2023-10-08T00:32:18.169921+0000","last_fullsized":"2023-10-08T00:32:18.169921+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:14:12.716846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.176618+0000","last_change":"2023-10-08T00:32:18.175707+0000","last_active":"2023-10-08T00:32:18.176618+0000","last_peered":"2023-10-08T00:32:18.176618+0000","last_clean":"2023-10-08T00:32:18.176618+0000","last_became_active":"2023-10-08T00:32:18.175467+0000","last_became_peered":"2023-10-08T00:32:18.175467+0000","last_unstale":"2023-10-08T00:32:18.176618+0000","last_undegraded":"2023-10-08T00:32:18.176618+0000","last_fullsized":"2023-10-08T00:32:18.176618+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:49:59.852713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.168527+0000","last_change":"2023-10-08T00:32:18.163227+0000","last_active":"2023-10-08T00:32:18.168527+0000","last_peered":"2023-10-08T00:32:18.168527+0000","last_clean":"2023-10-08T00:32:18.168527+0000","last_became_active":"2023-10-08T00:32:18.162955+0000","last_became_peered":"2023-10-08T00:32:18.162955+0000","last_unstale":"2023-10-08T00:32:18.168527+0000","last_undegraded":"2023-10-08T00:32:18.168527+0000","last_fullsized":"2023-10-08T00:32:18.168527+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:25.649519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174688+0000","last_change":"2023-10-08T00:32:18.171275+0000","last_active":"2023-10-08T00:32:18.174688+0000","last_peered":"2023-10-08T00:32:18.174688+0000","last_clean":"2023-10-08T00:32:18.174688+0000","last_became_active":"2023-10-08T00:32:18.171021+0000","last_became_peered":"2023-10-08T00:32:18.171021+0000","last_unstale":"2023-10-08T00:32:18.174688+0000","last_undegraded":"2023-10-08T00:32:18.174688+0000","last_fullsized":"2023-10-08T00:32:18.174688+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:36.353779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175833+0000","last_change":"2023-10-08T00:32:18.171570+0000","last_active":"2023-10-08T00:32:18.175833+0000","last_peered":"2023-10-08T00:32:18.175833+0000","last_clean":"2023-10-08T00:32:18.175833+0000","last_became_active":"2023-10-08T00:32:18.171331+0000","last_became_peered":"2023-10-08T00:32:18.171331+0000","last_unstale":"2023-10-08T00:32:18.175833+0000","last_undegraded":"2023-10-08T00:32:18.175833+0000","last_fullsized":"2023-10-08T00:32:18.175833+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:22:15.567546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.172946+0000","last_change":"2023-10-08T00:32:18.169952+0000","last_active":"2023-10-08T00:32:18.172946+0000","last_peered":"2023-10-08T00:32:18.172946+0000","last_clean":"2023-10-08T00:32:18.172946+0000","last_became_active":"2023-10-08T00:32:18.169648+0000","last_became_peered":"2023-10-08T00:32:18.169648+0000","last_unstale":"2023-10-08T00:32:18.172946+0000","last_undegraded":"2023-10-08T00:32:18.172946+0000","last_fullsized":"2023-10-08T00:32:18.172946+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:06:15.173127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.161483+0000","last_change":"2023-10-08T00:32:18.157642+0000","last_active":"2023-10-08T00:32:18.161483+0000","last_peered":"2023-10-08T00:32:18.161483+0000","last_clean":"2023-10-08T00:32:18.161483+0000","last_became_active":"2023-10-08T00:32:18.157379+0000","last_became_peered":"2023-10-08T00:32:18.157379+0000","last_unstale":"2023-10-08T00:32:18.161483+0000","last_undegraded":"2023-10-08T00:32:18.161483+0000","last_fullsized":"2023-10-08T00:32:18.161483+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:51.942301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.172514+0000","last_change":"2023-10-08T00:32:18.168763+0000","last_active":"2023-10-08T00:32:18.172514+0000","last_peered":"2023-10-08T00:32:18.172514+0000","last_clean":"2023-10-08T00:32:18.172514+0000","last_became_active":"2023-10-08T00:32:18.167972+0000","last_became_peered":"2023-10-08T00:32:18.167972+0000","last_unstale":"2023-10-08T00:32:18.172514+0000","last_undegraded":"2023-10-08T00:32:18.172514+0000","last_fullsized":"2023-10-08T00:32:18.172514+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:39.282470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"140'4","reported_seq":14,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178413+0000","last_change":"2023-10-08T00:32:17.133270+0000","last_active":"2023-10-08T00:32:18.178413+0000","last_peered":"2023-10-08T00:32:18.178413+0000","last_clean":"2023-10-08T00:32:18.178413+0000","last_became_active":"2023-10-08T00:32:17.133000+0000","last_became_peered":"2023-10-08T00:32:17.133000+0000","last_unstale":"2023-10-08T00:32:18.178413+0000","last_undegraded":"2023-10-08T00:32:18.178413+0000","last_fullsized":"2023-10-08T00:32:18.178413+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:25.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.160774+0000","last_change":"2023-10-08T00:32:18.157209+0000","last_active":"2023-10-08T00:32:18.160774+0000","last_peered":"2023-10-08T00:32:18.160774+0000","last_clean":"2023-10-08T00:32:18.160774+0000","last_became_active":"2023-10-08T00:32:18.156407+0000","last_became_peered":"2023-10-08T00:32:18.156407+0000","last_unstale":"2023-10-08T00:32:18.160774+0000","last_undegraded":"2023-10-08T00:32:18.160774+0000","last_fullsized":"2023-10-08T00:32:18.160774+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:20.658183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175270+0000","last_change":"2023-10-08T00:32:17.134430+0000","last_active":"2023-10-08T00:32:18.175270+0000","last_peered":"2023-10-08T00:32:18.175270+0000","last_clean":"2023-10-08T00:32:18.175270+0000","last_became_active":"2023-10-08T00:32:17.134164+0000","last_became_peered":"2023-10-08T00:32:17.134164+0000","last_unstale":"2023-10-08T00:32:18.175270+0000","last_undegraded":"2023-10-08T00:32:18.175270+0000","last_fullsized":"2023-10-08T00:32:18.175270+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:07:19.732285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.168355+0000","last_change":"2023-10-08T00:32:18.157097+0000","last_active":"2023-10-08T00:32:18.168355+0000","last_peered":"2023-10-08T00:32:18.168355+0000","last_clean":"2023-10-08T00:32:18.168355+0000","last_became_active":"2023-10-08T00:32:18.156807+0000","last_became_peered":"2023-10-08T00:32:18.156807+0000","last_unstale":"2023-10-08T00:32:18.168355+0000","last_undegraded":"2023-10-08T00:32:18.168355+0000","last_fullsized":"2023-10-08T00:32:18.168355+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:34:34.252367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171936+0000","last_change":"2023-10-08T00:32:17.142698+0000","last_active":"2023-10-08T00:32:18.171936+0000","last_peered":"2023-10-08T00:32:18.171936+0000","last_clean":"2023-10-08T00:32:18.171936+0000","last_became_active":"2023-10-08T00:32:17.142404+0000","last_became_peered":"2023-10-08T00:32:17.142404+0000","last_unstale":"2023-10-08T00:32:18.171936+0000","last_undegraded":"2023-10-08T00:32:18.171936+0000","last_fullsized":"2023-10-08T00:32:18.171936+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:32:30.632859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.165511+0000","last_change":"2023-10-08T00:32:18.162940+0000","last_active":"2023-10-08T00:32:18.165511+0000","last_peered":"2023-10-08T00:32:18.165511+0000","last_clean":"2023-10-08T00:32:18.165511+0000","last_became_active":"2023-10-08T00:32:18.162658+0000","last_became_peered":"2023-10-08T00:32:18.162658+0000","last_unstale":"2023-10-08T00:32:18.165511+0000","last_undegraded":"2023-10-08T00:32:18.165511+0000","last_fullsized":"2023-10-08T00:32:18.165511+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:51.942301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.176456+0000","last_change":"2023-10-08T00:32:17.135807+0000","last_active":"2023-10-08T00:32:18.176456+0000","last_peered":"2023-10-08T00:32:18.176456+0000","last_clean":"2023-10-08T00:32:18.176456+0000","last_became_active":"2023-10-08T00:32:17.135546+0000","last_became_peered":"2023-10-08T00:32:17.135546+0000","last_unstale":"2023-10-08T00:32:18.176456+0000","last_undegraded":"2023-10-08T00:32:18.176456+0000","last_fullsized":"2023-10-08T00:32:18.176456+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:06.677011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171577+0000","last_change":"2023-10-08T00:32:18.160922+0000","last_active":"2023-10-08T00:32:18.171577+0000","last_peered":"2023-10-08T00:32:18.171577+0000","last_clean":"2023-10-08T00:32:18.171577+0000","last_became_active":"2023-10-08T00:32:18.160632+0000","last_became_peered":"2023-10-08T00:32:18.160632+0000","last_unstale":"2023-10-08T00:32:18.171577+0000","last_undegraded":"2023-10-08T00:32:18.171577+0000","last_fullsized":"2023-10-08T00:32:18.171577+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:07:59.656125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.173469+0000","last_change":"2023-10-08T00:32:17.139003+0000","last_active":"2023-10-08T00:32:18.173469+0000","last_peered":"2023-10-08T00:32:18.173469+0000","last_clean":"2023-10-08T00:32:18.173469+0000","last_became_active":"2023-10-08T00:32:17.138731+0000","last_became_peered":"2023-10-08T00:32:17.138731+0000","last_unstale":"2023-10-08T00:32:18.173469+0000","last_undegraded":"2023-10-08T00:32:18.173469+0000","last_fullsized":"2023-10-08T00:32:18.173469+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:34.880836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.172717+0000","last_change":"2023-10-08T00:32:18.167946+0000","last_active":"2023-10-08T00:32:18.172717+0000","last_peered":"2023-10-08T00:32:18.172717+0000","last_clean":"2023-10-08T00:32:18.172717+0000","last_became_active":"2023-10-08T00:32:18.167537+0000","last_became_peered":"2023-10-08T00:32:18.167537+0000","last_unstale":"2023-10-08T00:32:18.172717+0000","last_undegraded":"2023-10-08T00:32:18.172717+0000","last_fullsized":"2023-10-08T00:32:18.172717+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:23.678141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174161+0000","last_change":"2023-10-08T00:32:17.132183+0000","last_active":"2023-10-08T00:32:18.174161+0000","last_peered":"2023-10-08T00:32:18.174161+0000","last_clean":"2023-10-08T00:32:18.174161+0000","last_became_active":"2023-10-08T00:32:17.131894+0000","last_became_peered":"2023-10-08T00:32:17.131894+0000","last_unstale":"2023-10-08T00:32:18.174161+0000","last_undegraded":"2023-10-08T00:32:18.174161+0000","last_fullsized":"2023-10-08T00:32:18.174161+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:27.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170292+0000","last_change":"2023-10-08T00:32:18.168386+0000","last_active":"2023-10-08T00:32:18.170292+0000","last_peered":"2023-10-08T00:32:18.170292+0000","last_clean":"2023-10-08T00:32:18.170292+0000","last_became_active":"2023-10-08T00:32:18.167953+0000","last_became_peered":"2023-10-08T00:32:18.167953+0000","last_unstale":"2023-10-08T00:32:18.170292+0000","last_undegraded":"2023-10-08T00:32:18.170292+0000","last_fullsized":"2023-10-08T00:32:18.170292+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:26:32.855036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.159995+0000","last_change":"2023-10-08T00:32:17.139447+0000","last_active":"2023-10-08T00:32:18.159995+0000","last_peered":"2023-10-08T00:32:18.159995+0000","last_clean":"2023-10-08T00:32:18.159995+0000","last_became_active":"2023-10-08T00:32:17.139202+0000","last_became_peered":"2023-10-08T00:32:17.139202+0000","last_unstale":"2023-10-08T00:32:18.159995+0000","last_undegraded":"2023-10-08T00:32:18.159995+0000","last_fullsized":"2023-10-08T00:32:18.159995+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:18:24.326132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.168999+0000","last_change":"2023-10-08T00:32:18.165940+0000","last_active":"2023-10-08T00:32:18.168999+0000","last_peered":"2023-10-08T00:32:18.168999+0000","last_clean":"2023-10-08T00:32:18.168999+0000","last_became_active":"2023-10-08T00:32:18.165647+0000","last_became_peered":"2023-10-08T00:32:18.165647+0000","last_unstale":"2023-10-08T00:32:18.168999+0000","last_undegraded":"2023-10-08T00:32:18.168999+0000","last_fullsized":"2023-10-08T00:32:18.168999+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:22:20.527718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.151472+0000","last_change":"2023-10-08T00:32:17.136424+0000","last_active":"2023-10-08T00:32:18.151472+0000","last_peered":"2023-10-08T00:32:18.151472+0000","last_clean":"2023-10-08T00:32:18.151472+0000","last_became_active":"2023-10-08T00:32:17.136130+0000","last_became_peered":"2023-10-08T00:32:17.136130+0000","last_unstale":"2023-10-08T00:32:18.151472+0000","last_undegraded":"2023-10-08T00:32:18.151472+0000","last_fullsized":"2023-10-08T00:32:18.151472+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:01:53.726420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175776+0000","last_change":"2023-10-08T00:32:18.172882+0000","last_active":"2023-10-08T00:32:18.175776+0000","last_peered":"2023-10-08T00:32:18.175776+0000","last_clean":"2023-10-08T00:32:18.175776+0000","last_became_active":"2023-10-08T00:32:18.172570+0000","last_became_peered":"2023-10-08T00:32:18.172570+0000","last_unstale":"2023-10-08T00:32:18.175776+0000","last_undegraded":"2023-10-08T00:32:18.175776+0000","last_fullsized":"2023-10-08T00:32:18.175776+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:21:53.281499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.153469+0000","last_change":"2023-10-08T00:32:17.137885+0000","last_active":"2023-10-08T00:32:18.153469+0000","last_peered":"2023-10-08T00:32:18.153469+0000","last_clean":"2023-10-08T00:32:18.153469+0000","last_became_active":"2023-10-08T00:32:17.137573+0000","last_became_peered":"2023-10-08T00:32:17.137573+0000","last_unstale":"2023-10-08T00:32:18.153469+0000","last_undegraded":"2023-10-08T00:32:18.153469+0000","last_fullsized":"2023-10-08T00:32:18.153469+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:35:05.870586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171383+0000","last_change":"2023-10-08T00:32:18.168336+0000","last_active":"2023-10-08T00:32:18.171383+0000","last_peered":"2023-10-08T00:32:18.171383+0000","last_clean":"2023-10-08T00:32:18.171383+0000","last_became_active":"2023-10-08T00:32:18.167747+0000","last_became_peered":"2023-10-08T00:32:18.167747+0000","last_unstale":"2023-10-08T00:32:18.171383+0000","last_undegraded":"2023-10-08T00:32:18.171383+0000","last_fullsized":"2023-10-08T00:32:18.171383+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:50:51.199179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"140'3","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.177392+0000","last_change":"2023-10-08T00:32:17.135417+0000","last_active":"2023-10-08T00:32:18.177392+0000","last_peered":"2023-10-08T00:32:18.177392+0000","last_clean":"2023-10-08T00:32:18.177392+0000","last_became_active":"2023-10-08T00:32:17.135111+0000","last_became_peered":"2023-10-08T00:32:17.135111+0000","last_unstale":"2023-10-08T00:32:18.177392+0000","last_undegraded":"2023-10-08T00:32:18.177392+0000","last_fullsized":"2023-10-08T00:32:18.177392+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:44:43.981122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171614+0000","last_change":"2023-10-08T00:32:18.166102+0000","last_active":"2023-10-08T00:32:18.171614+0000","last_peered":"2023-10-08T00:32:18.171614+0000","last_clean":"2023-10-08T00:32:18.171614+0000","last_became_active":"2023-10-08T00:32:18.165817+0000","last_became_peered":"2023-10-08T00:32:18.165817+0000","last_unstale":"2023-10-08T00:32:18.171614+0000","last_undegraded":"2023-10-08T00:32:18.171614+0000","last_fullsized":"2023-10-08T00:32:18.171614+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:08.487494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"140'6","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178742+0000","last_change":"2023-10-08T00:32:17.135315+0000","last_active":"2023-10-08T00:32:18.178742+0000","last_peered":"2023-10-08T00:32:18.178742+0000","last_clean":"2023-10-08T00:32:18.178742+0000","last_became_active":"2023-10-08T00:32:17.134951+0000","last_became_peered":"2023-10-08T00:32:17.134951+0000","last_unstale":"2023-10-08T00:32:18.178742+0000","last_undegraded":"2023-10-08T00:32:18.178742+0000","last_fullsized":"2023-10-08T00:32:18.178742+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:31:27.553419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170750+0000","last_change":"2023-10-08T00:32:18.167131+0000","last_active":"2023-10-08T00:32:18.170750+0000","last_peered":"2023-10-08T00:32:18.170750+0000","last_clean":"2023-10-08T00:32:18.170750+0000","last_became_active":"2023-10-08T00:32:18.166875+0000","last_became_peered":"2023-10-08T00:32:18.166875+0000","last_unstale":"2023-10-08T00:32:18.170750+0000","last_undegraded":"2023-10-08T00:32:18.170750+0000","last_fullsized":"2023-10-08T00:32:18.170750+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:48:20.648776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.176037+0000","last_change":"2023-10-08T00:32:17.139467+0000","last_active":"2023-10-08T00:32:18.176037+0000","last_peered":"2023-10-08T00:32:18.176037+0000","last_clean":"2023-10-08T00:32:18.176037+0000","last_became_active":"2023-10-08T00:32:17.139224+0000","last_became_peered":"2023-10-08T00:32:17.139224+0000","last_unstale":"2023-10-08T00:32:18.176037+0000","last_undegraded":"2023-10-08T00:32:18.176037+0000","last_fullsized":"2023-10-08T00:32:18.176037+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:27.077149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170025+0000","last_change":"2023-10-08T00:32:18.163052+0000","last_active":"2023-10-08T00:32:18.170025+0000","last_peered":"2023-10-08T00:32:18.170025+0000","last_clean":"2023-10-08T00:32:18.170025+0000","last_became_active":"2023-10-08T00:32:18.157836+0000","last_became_peered":"2023-10-08T00:32:18.157836+0000","last_unstale":"2023-10-08T00:32:18.170025+0000","last_undegraded":"2023-10-08T00:32:18.170025+0000","last_fullsized":"2023-10-08T00:32:18.170025+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:15:02.211499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.150400+0000","last_change":"2023-10-08T00:32:17.139235+0000","last_active":"2023-10-08T00:32:18.150400+0000","last_peered":"2023-10-08T00:32:18.150400+0000","last_clean":"2023-10-08T00:32:18.150400+0000","last_became_active":"2023-10-08T00:32:17.138758+0000","last_became_peered":"2023-10-08T00:32:17.138758+0000","last_unstale":"2023-10-08T00:32:18.150400+0000","last_undegraded":"2023-10-08T00:32:18.150400+0000","last_fullsized":"2023-10-08T00:32:18.150400+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:11:46.314410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167973+0000","last_change":"2023-10-08T00:32:18.166856+0000","last_active":"2023-10-08T00:32:18.167973+0000","last_peered":"2023-10-08T00:32:18.167973+0000","last_clean":"2023-10-08T00:32:18.167973+0000","last_became_active":"2023-10-08T00:32:18.166627+0000","last_became_peered":"2023-10-08T00:32:18.166627+0000","last_unstale":"2023-10-08T00:32:18.167973+0000","last_undegraded":"2023-10-08T00:32:18.167973+0000","last_fullsized":"2023-10-08T00:32:18.167973+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:01:28.155625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.161128+0000","last_change":"2023-10-08T00:32:17.137438+0000","last_active":"2023-10-08T00:32:18.161128+0000","last_peered":"2023-10-08T00:32:18.161128+0000","last_clean":"2023-10-08T00:32:18.161128+0000","last_became_active":"2023-10-08T00:32:17.137134+0000","last_became_peered":"2023-10-08T00:32:17.137134+0000","last_unstale":"2023-10-08T00:32:18.161128+0000","last_undegraded":"2023-10-08T00:32:18.161128+0000","last_fullsized":"2023-10-08T00:32:18.161128+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:29.179946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.162116+0000","last_change":"2023-10-08T00:32:18.157959+0000","last_active":"2023-10-08T00:32:18.162116+0000","last_peered":"2023-10-08T00:32:18.162116+0000","last_clean":"2023-10-08T00:32:18.162116+0000","last_became_active":"2023-10-08T00:32:18.157699+0000","last_became_peered":"2023-10-08T00:32:18.157699+0000","last_unstale":"2023-10-08T00:32:18.162116+0000","last_undegraded":"2023-10-08T00:32:18.162116+0000","last_fullsized":"2023-10-08T00:32:18.162116+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:06.542698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"140'8","reported_seq":18,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178129+0000","last_change":"2023-10-08T00:32:17.141552+0000","last_active":"2023-10-08T00:32:18.178129+0000","last_peered":"2023-10-08T00:32:18.178129+0000","last_clean":"2023-10-08T00:32:18.178129+0000","last_became_active":"2023-10-08T00:32:17.141280+0000","last_became_peered":"2023-10-08T00:32:17.141280+0000","last_unstale":"2023-10-08T00:32:18.178129+0000","last_undegraded":"2023-10-08T00:32:18.178129+0000","last_fullsized":"2023-10-08T00:32:18.178129+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:09:29.179946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.172101+0000","last_change":"2023-10-08T00:32:18.165512+0000","last_active":"2023-10-08T00:32:18.172101+0000","last_peered":"2023-10-08T00:32:18.172101+0000","last_clean":"2023-10-08T00:32:18.172101+0000","last_became_active":"2023-10-08T00:32:18.165198+0000","last_became_peered":"2023-10-08T00:32:18.165198+0000","last_unstale":"2023-10-08T00:32:18.172101+0000","last_undegraded":"2023-10-08T00:32:18.172101+0000","last_fullsized":"2023-10-08T00:32:18.172101+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:15.865544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.173945+0000","last_change":"2023-10-08T00:32:17.136958+0000","last_active":"2023-10-08T00:32:18.173945+0000","last_peered":"2023-10-08T00:32:18.173945+0000","last_clean":"2023-10-08T00:32:18.173945+0000","last_became_active":"2023-10-08T00:32:17.136688+0000","last_became_peered":"2023-10-08T00:32:17.136688+0000","last_unstale":"2023-10-08T00:32:18.173945+0000","last_undegraded":"2023-10-08T00:32:18.173945+0000","last_fullsized":"2023-10-08T00:32:18.173945+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:15:44.080371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.165391+0000","last_change":"2023-10-08T00:32:18.162403+0000","last_active":"2023-10-08T00:32:18.165391+0000","last_peered":"2023-10-08T00:32:18.165391+0000","last_clean":"2023-10-08T00:32:18.165391+0000","last_became_active":"2023-10-08T00:32:18.161984+0000","last_became_peered":"2023-10-08T00:32:18.161984+0000","last_unstale":"2023-10-08T00:32:18.165391+0000","last_undegraded":"2023-10-08T00:32:18.165391+0000","last_fullsized":"2023-10-08T00:32:18.165391+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:20:57.086834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.172185+0000","last_change":"2023-10-08T00:32:17.134026+0000","last_active":"2023-10-08T00:32:18.172185+0000","last_peered":"2023-10-08T00:32:18.172185+0000","last_clean":"2023-10-08T00:32:18.172185+0000","last_became_active":"2023-10-08T00:32:17.133677+0000","last_became_peered":"2023-10-08T00:32:17.133677+0000","last_unstale":"2023-10-08T00:32:18.172185+0000","last_undegraded":"2023-10-08T00:32:18.172185+0000","last_fullsized":"2023-10-08T00:32:18.172185+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:53.086853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.176003+0000","last_change":"2023-10-08T00:32:18.172101+0000","last_active":"2023-10-08T00:32:18.176003+0000","last_peered":"2023-10-08T00:32:18.176003+0000","last_clean":"2023-10-08T00:32:18.176003+0000","last_became_active":"2023-10-08T00:32:18.171837+0000","last_became_peered":"2023-10-08T00:32:18.171837+0000","last_unstale":"2023-10-08T00:32:18.176003+0000","last_undegraded":"2023-10-08T00:32:18.176003+0000","last_fullsized":"2023-10-08T00:32:18.176003+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:07.678968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175733+0000","last_change":"2023-10-08T00:32:17.139904+0000","last_active":"2023-10-08T00:32:18.175733+0000","last_peered":"2023-10-08T00:32:18.175733+0000","last_clean":"2023-10-08T00:32:18.175733+0000","last_became_active":"2023-10-08T00:32:17.139687+0000","last_became_peered":"2023-10-08T00:32:17.139687+0000","last_unstale":"2023-10-08T00:32:18.175733+0000","last_undegraded":"2023-10-08T00:32:18.175733+0000","last_fullsized":"2023-10-08T00:32:18.175733+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:13:53.086853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167075+0000","last_change":"2023-10-08T00:32:18.163676+0000","last_active":"2023-10-08T00:32:18.167075+0000","last_peered":"2023-10-08T00:32:18.167075+0000","last_clean":"2023-10-08T00:32:18.167075+0000","last_became_active":"2023-10-08T00:32:18.163402+0000","last_became_peered":"2023-10-08T00:32:18.163402+0000","last_unstale":"2023-10-08T00:32:18.167075+0000","last_undegraded":"2023-10-08T00:32:18.167075+0000","last_fullsized":"2023-10-08T00:32:18.167075+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:01.670998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.155119+0000","last_change":"2023-10-08T00:32:17.141535+0000","last_active":"2023-10-08T00:32:18.155119+0000","last_peered":"2023-10-08T00:32:18.155119+0000","last_clean":"2023-10-08T00:32:18.155119+0000","last_became_active":"2023-10-08T00:32:17.141245+0000","last_became_peered":"2023-10-08T00:32:17.141245+0000","last_unstale":"2023-10-08T00:32:18.155119+0000","last_undegraded":"2023-10-08T00:32:18.155119+0000","last_fullsized":"2023-10-08T00:32:18.155119+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:51:30.453106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.162496+0000","last_change":"2023-10-08T00:32:18.159604+0000","last_active":"2023-10-08T00:32:18.162496+0000","last_peered":"2023-10-08T00:32:18.162496+0000","last_clean":"2023-10-08T00:32:18.162496+0000","last_became_active":"2023-10-08T00:32:18.159322+0000","last_became_peered":"2023-10-08T00:32:18.159322+0000","last_unstale":"2023-10-08T00:32:18.162496+0000","last_undegraded":"2023-10-08T00:32:18.162496+0000","last_fullsized":"2023-10-08T00:32:18.162496+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:00:50.581112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.165164+0000","last_change":"2023-10-08T00:32:17.138334+0000","last_active":"2023-10-08T00:32:18.165164+0000","last_peered":"2023-10-08T00:32:18.165164+0000","last_clean":"2023-10-08T00:32:18.165164+0000","last_became_active":"2023-10-08T00:32:17.137840+0000","last_became_peered":"2023-10-08T00:32:17.137840+0000","last_unstale":"2023-10-08T00:32:18.165164+0000","last_undegraded":"2023-10-08T00:32:18.165164+0000","last_fullsized":"2023-10-08T00:32:18.165164+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:51.980001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170162+0000","last_change":"2023-10-08T00:32:18.167604+0000","last_active":"2023-10-08T00:32:18.170162+0000","last_peered":"2023-10-08T00:32:18.170162+0000","last_clean":"2023-10-08T00:32:18.170162+0000","last_became_active":"2023-10-08T00:32:18.164590+0000","last_became_peered":"2023-10-08T00:32:18.164590+0000","last_unstale":"2023-10-08T00:32:18.170162+0000","last_undegraded":"2023-10-08T00:32:18.170162+0000","last_fullsized":"2023-10-08T00:32:18.170162+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:22.777034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.153339+0000","last_change":"2023-10-08T00:32:17.140001+0000","last_active":"2023-10-08T00:32:18.153339+0000","last_peered":"2023-10-08T00:32:18.153339+0000","last_clean":"2023-10-08T00:32:18.153339+0000","last_became_active":"2023-10-08T00:32:17.139639+0000","last_became_peered":"2023-10-08T00:32:17.139639+0000","last_unstale":"2023-10-08T00:32:18.153339+0000","last_undegraded":"2023-10-08T00:32:18.153339+0000","last_fullsized":"2023-10-08T00:32:18.153339+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:13.915171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.175436+0000","last_change":"2023-10-08T00:32:18.171759+0000","last_active":"2023-10-08T00:32:18.175436+0000","last_peered":"2023-10-08T00:32:18.175436+0000","last_clean":"2023-10-08T00:32:18.175436+0000","last_became_active":"2023-10-08T00:32:18.170944+0000","last_became_peered":"2023-10-08T00:32:18.170944+0000","last_unstale":"2023-10-08T00:32:18.175436+0000","last_undegraded":"2023-10-08T00:32:18.175436+0000","last_fullsized":"2023-10-08T00:32:18.175436+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:59:30.636028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.155335+0000","last_change":"2023-10-08T00:32:17.138336+0000","last_active":"2023-10-08T00:32:18.155335+0000","last_peered":"2023-10-08T00:32:18.155335+0000","last_clean":"2023-10-08T00:32:18.155335+0000","last_became_active":"2023-10-08T00:32:17.138028+0000","last_became_peered":"2023-10-08T00:32:17.138028+0000","last_unstale":"2023-10-08T00:32:18.155335+0000","last_undegraded":"2023-10-08T00:32:18.155335+0000","last_fullsized":"2023-10-08T00:32:18.155335+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:15:01.209543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.169620+0000","last_change":"2023-10-08T00:32:18.164051+0000","last_active":"2023-10-08T00:32:18.169620+0000","last_peered":"2023-10-08T00:32:18.169620+0000","last_clean":"2023-10-08T00:32:18.169620+0000","last_became_active":"2023-10-08T00:32:18.163781+0000","last_became_peered":"2023-10-08T00:32:18.163781+0000","last_unstale":"2023-10-08T00:32:18.169620+0000","last_undegraded":"2023-10-08T00:32:18.169620+0000","last_fullsized":"2023-10-08T00:32:18.169620+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:50:13.198070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.156197+0000","last_change":"2023-10-08T00:32:17.136551+0000","last_active":"2023-10-08T00:32:18.156197+0000","last_peered":"2023-10-08T00:32:18.156197+0000","last_clean":"2023-10-08T00:32:18.156197+0000","last_became_active":"2023-10-08T00:32:17.136233+0000","last_became_peered":"2023-10-08T00:32:17.136233+0000","last_unstale":"2023-10-08T00:32:18.156197+0000","last_undegraded":"2023-10-08T00:32:18.156197+0000","last_fullsized":"2023-10-08T00:32:18.156197+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:16:34.880836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.163544+0000","last_change":"2023-10-08T00:32:18.161857+0000","last_active":"2023-10-08T00:32:18.163544+0000","last_peered":"2023-10-08T00:32:18.163544+0000","last_clean":"2023-10-08T00:32:18.163544+0000","last_became_active":"2023-10-08T00:32:18.161584+0000","last_became_peered":"2023-10-08T00:32:18.161584+0000","last_unstale":"2023-10-08T00:32:18.163544+0000","last_undegraded":"2023-10-08T00:32:18.163544+0000","last_fullsized":"2023-10-08T00:32:18.163544+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:20:57.086834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"140'2","reported_seq":12,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.176024+0000","last_change":"2023-10-08T00:32:17.144345+0000","last_active":"2023-10-08T00:32:18.176024+0000","last_peered":"2023-10-08T00:32:18.176024+0000","last_clean":"2023-10-08T00:32:18.176024+0000","last_became_active":"2023-10-08T00:32:17.144071+0000","last_became_peered":"2023-10-08T00:32:17.144071+0000","last_unstale":"2023-10-08T00:32:18.176024+0000","last_undegraded":"2023-10-08T00:32:18.176024+0000","last_fullsized":"2023-10-08T00:32:18.176024+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:32:01.158405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.171630+0000","last_change":"2023-10-08T00:32:18.168970+0000","last_active":"2023-10-08T00:32:18.171630+0000","last_peered":"2023-10-08T00:32:18.171630+0000","last_clean":"2023-10-08T00:32:18.171630+0000","last_became_active":"2023-10-08T00:32:18.168575+0000","last_became_peered":"2023-10-08T00:32:18.168575+0000","last_unstale":"2023-10-08T00:32:18.171630+0000","last_undegraded":"2023-10-08T00:32:18.171630+0000","last_fullsized":"2023-10-08T00:32:18.171630+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:39.282470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.149988+0000","last_change":"2023-10-08T00:32:17.141755+0000","last_active":"2023-10-08T00:32:18.149988+0000","last_peered":"2023-10-08T00:32:18.149988+0000","last_clean":"2023-10-08T00:32:18.149988+0000","last_became_active":"2023-10-08T00:32:17.141473+0000","last_became_peered":"2023-10-08T00:32:17.141473+0000","last_unstale":"2023-10-08T00:32:18.149988+0000","last_undegraded":"2023-10-08T00:32:18.149988+0000","last_fullsized":"2023-10-08T00:32:18.149988+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:12:40.063286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174622+0000","last_change":"2023-10-08T00:32:18.170519+0000","last_active":"2023-10-08T00:32:18.174622+0000","last_peered":"2023-10-08T00:32:18.174622+0000","last_clean":"2023-10-08T00:32:18.174622+0000","last_became_active":"2023-10-08T00:32:18.170258+0000","last_became_peered":"2023-10-08T00:32:18.170258+0000","last_unstale":"2023-10-08T00:32:18.174622+0000","last_undegraded":"2023-10-08T00:32:18.174622+0000","last_fullsized":"2023-10-08T00:32:18.174622+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:56:48.042724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.149943+0000","last_change":"2023-10-08T00:32:17.141063+0000","last_active":"2023-10-08T00:32:18.149943+0000","last_peered":"2023-10-08T00:32:18.149943+0000","last_clean":"2023-10-08T00:32:18.149943+0000","last_became_active":"2023-10-08T00:32:17.140793+0000","last_became_peered":"2023-10-08T00:32:17.140793+0000","last_unstale":"2023-10-08T00:32:18.149943+0000","last_undegraded":"2023-10-08T00:32:18.149943+0000","last_fullsized":"2023-10-08T00:32:18.149943+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:06.817516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.174343+0000","last_change":"2023-10-08T00:32:18.168555+0000","last_active":"2023-10-08T00:32:18.174343+0000","last_peered":"2023-10-08T00:32:18.174343+0000","last_clean":"2023-10-08T00:32:18.174343+0000","last_became_active":"2023-10-08T00:32:18.168310+0000","last_became_peered":"2023-10-08T00:32:18.168310+0000","last_unstale":"2023-10-08T00:32:18.174343+0000","last_undegraded":"2023-10-08T00:32:18.174343+0000","last_fullsized":"2023-10-08T00:32:18.174343+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:03.285305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.161250+0000","last_change":"2023-10-08T00:32:17.130954+0000","last_active":"2023-10-08T00:32:18.161250+0000","last_peered":"2023-10-08T00:32:18.161250+0000","last_clean":"2023-10-08T00:32:18.161250+0000","last_became_active":"2023-10-08T00:32:17.130659+0000","last_became_peered":"2023-10-08T00:32:17.130659+0000","last_unstale":"2023-10-08T00:32:18.161250+0000","last_undegraded":"2023-10-08T00:32:18.161250+0000","last_fullsized":"2023-10-08T00:32:18.161250+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:42:15.661821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178331+0000","last_change":"2023-10-08T00:32:18.175875+0000","last_active":"2023-10-08T00:32:18.178331+0000","last_peered":"2023-10-08T00:32:18.178331+0000","last_clean":"2023-10-08T00:32:18.178331+0000","last_became_active":"2023-10-08T00:32:18.175108+0000","last_became_peered":"2023-10-08T00:32:18.175108+0000","last_unstale":"2023-10-08T00:32:18.178331+0000","last_undegraded":"2023-10-08T00:32:18.178331+0000","last_fullsized":"2023-10-08T00:32:18.178331+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:39.282470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.156235+0000","last_change":"2023-10-08T00:32:17.135695+0000","last_active":"2023-10-08T00:32:18.156235+0000","last_peered":"2023-10-08T00:32:18.156235+0000","last_clean":"2023-10-08T00:32:18.156235+0000","last_became_active":"2023-10-08T00:32:17.134606+0000","last_became_peered":"2023-10-08T00:32:17.134606+0000","last_unstale":"2023-10-08T00:32:18.156235+0000","last_undegraded":"2023-10-08T00:32:18.156235+0000","last_fullsized":"2023-10-08T00:32:18.156235+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:11:13.915171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.178452+0000","last_change":"2023-10-08T00:32:18.175995+0000","last_active":"2023-10-08T00:32:18.178452+0000","last_peered":"2023-10-08T00:32:18.178452+0000","last_clean":"2023-10-08T00:32:18.178452+0000","last_became_active":"2023-10-08T00:32:18.175620+0000","last_became_peered":"2023-10-08T00:32:18.175620+0000","last_unstale":"2023-10-08T00:32:18.178452+0000","last_undegraded":"2023-10-08T00:32:18.178452+0000","last_fullsized":"2023-10-08T00:32:18.178452+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:30:27.630644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.156454+0000","last_change":"2023-10-08T00:32:17.131964+0000","last_active":"2023-10-08T00:32:18.156454+0000","last_peered":"2023-10-08T00:32:18.156454+0000","last_clean":"2023-10-08T00:32:18.156454+0000","last_became_active":"2023-10-08T00:32:17.131518+0000","last_became_peered":"2023-10-08T00:32:17.131518+0000","last_unstale":"2023-10-08T00:32:18.156454+0000","last_undegraded":"2023-10-08T00:32:18.156454+0000","last_fullsized":"2023-10-08T00:32:18.156454+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:41.206706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.167161+0000","last_change":"2023-10-08T00:32:18.160672+0000","last_active":"2023-10-08T00:32:18.167161+0000","last_peered":"2023-10-08T00:32:18.167161+0000","last_clean":"2023-10-08T00:32:18.167161+0000","last_became_active":"2023-10-08T00:32:18.160408+0000","last_became_peered":"2023-10-08T00:32:18.160408+0000","last_unstale":"2023-10-08T00:32:18.167161+0000","last_undegraded":"2023-10-08T00:32:18.167161+0000","last_fullsized":"2023-10-08T00:32:18.167161+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:36:48.357181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.152930+0000","last_change":"2023-10-08T00:32:17.134373+0000","last_active":"2023-10-08T00:32:18.152930+0000","last_peered":"2023-10-08T00:32:18.152930+0000","last_clean":"2023-10-08T00:32:18.152930+0000","last_became_active":"2023-10-08T00:32:17.134117+0000","last_became_peered":"2023-10-08T00:32:17.134117+0000","last_unstale":"2023-10-08T00:32:18.152930+0000","last_undegraded":"2023-10-08T00:32:18.152930+0000","last_fullsized":"2023-10-08T00:32:18.152930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:15:56.381078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.162051+0000","last_change":"2023-10-08T00:32:18.158960+0000","last_active":"2023-10-08T00:32:18.162051+0000","last_peered":"2023-10-08T00:32:18.162051+0000","last_clean":"2023-10-08T00:32:18.162051+0000","last_became_active":"2023-10-08T00:32:18.158676+0000","last_became_peered":"2023-10-08T00:32:18.158676+0000","last_unstale":"2023-10-08T00:32:18.162051+0000","last_undegraded":"2023-10-08T00:32:18.162051+0000","last_fullsized":"2023-10-08T00:32:18.162051+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:01.870338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.154750+0000","last_change":"2023-10-08T00:32:17.144085+0000","last_active":"2023-10-08T00:32:18.154750+0000","last_peered":"2023-10-08T00:32:18.154750+0000","last_clean":"2023-10-08T00:32:18.154750+0000","last_became_active":"2023-10-08T00:32:17.143825+0000","last_became_peered":"2023-10-08T00:32:17.143825+0000","last_unstale":"2023-10-08T00:32:18.154750+0000","last_undegraded":"2023-10-08T00:32:18.154750+0000","last_fullsized":"2023-10-08T00:32:18.154750+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:14:11.714889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.170877+0000","last_change":"2023-10-08T00:32:18.160717+0000","last_active":"2023-10-08T00:32:18.170877+0000","last_peered":"2023-10-08T00:32:18.170877+0000","last_clean":"2023-10-08T00:32:18.170877+0000","last_became_active":"2023-10-08T00:32:18.160301+0000","last_became_peered":"2023-10-08T00:32:18.160301+0000","last_unstale":"2023-10-08T00:32:18.170877+0000","last_undegraded":"2023-10-08T00:32:18.170877+0000","last_fullsized":"2023-10-08T00:32:18.170877+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:17.117903+0000","last_clean_scrub_stamp":"2023-10-08T00:32:17.117903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:25:42.390935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.161464+0000","last_change":"2023-10-08T00:32:17.136114+0000","last_active":"2023-10-08T00:32:18.161464+0000","last_peered":"2023-10-08T00:32:18.161464+0000","last_clean":"2023-10-08T00:32:18.161464+0000","last_became_active":"2023-10-08T00:32:17.135866+0000","last_became_peered":"2023-10-08T00:32:17.135866+0000","last_unstale":"2023-10-08T00:32:18.161464+0000","last_undegraded":"2023-10-08T00:32:18.161464+0000","last_fullsized":"2023-10-08T00:32:18.161464+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:16.115946+0000","last_clean_scrub_stamp":"2023-10-08T00:32:16.115946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:42:15.661821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":264,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-10-08T00:32:18.160001+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:18.160001+0000","last_peered":"2023-10-08T00:32:18.160001+0000","last_clean":"2023-10-08T00:32:18.160001+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:18.160001+0000","last_undegraded":"2023-10-08T00:32:18.160001+0000","last_fullsized":"2023-10-08T00:32:18.160001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303712,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068128,"statfs":{"total":96636764160,"available":96325763072,"internally_reserved":0,"allocated":2383872,"data_stored":1388978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.72199999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65500000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.68700000000000006}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.501}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":798506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.31},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.46400000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.64100000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.623}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1794048,"data_stored":800042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.35799999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.46899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.75},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.89500000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.82199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303708,"kb_used_data":2324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068132,"statfs":{"total":96636764160,"available":96325767168,"internally_reserved":0,"allocated":2379776,"data_stored":1388896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.50600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.63700000000000001},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.249},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.39000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.55000000000000004,"15min":0.63100000000000001},"last":0.28999999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.374},"min":{"1min":0.253,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.41999999999999998},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.60699999999999998,"15min":0.64700000000000002},"last":0.36199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":1.242},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.57099999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51900000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574941,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1794048,"data_stored":799172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.25800000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.34399999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.503}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.54200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1794048,"data_stored":798700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.38700000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.438}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.66000000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.56299999999999994}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.48399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.497},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574943,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303140,"kb_used_data":1756,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068700,"statfs":{"total":96636764160,"available":96326348800,"internally_reserved":0,"allocated":1798144,"data_stored":800596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.498}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.378},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.56100000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.441}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.45200000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.48499999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.54200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":798506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.376}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.49399999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.442}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.32200000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52600000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:22.665 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:32:22.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:32:22.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.823+0000 7f7c0c123700 1 Processor -- start 2023-10-08T00:32:22.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.824+0000 7f7c0c123700 1 -- start start 2023-10-08T00:32:22.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0c123700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cca50 0x7f7c040caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0c123700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7c0415df40 0x7f7c0415e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0c123700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c04157c50 con 0x7f7c040cce20 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0c123700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0415d7d0 con 0x7f7c0415df40 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0c123700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0415aa20 con 0x7f7c040cca50 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7c0415df40 0x7f7c0415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7c0415df40 0x7f7c0415e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44064/0 (socket says 172.21.15.22:44064) 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 -- 172.21.15.22:0/3164818554 learned_addr learned my addr 172.21.15.22:0/3164818554 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c09ebf700 1 --2- 172.21.15.22:0/3164818554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cca50 0x7f7c040caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 -- 172.21.15.22:0/3164818554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cca50 msgr2=0x7f7c040caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 --2- 172.21.15.22:0/3164818554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cca50 0x7f7c040caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 -- 172.21.15.22:0/3164818554 >> v1:172.21.15.192:6789/0 conn(0x7f7c040cce20 legacy=0x7f7c0415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 -- 172.21.15.22:0/3164818554 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0415ad00 con 0x7f7c0415df40 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c0a6c0700 1 --2- 172.21.15.22:0/3164818554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c0415df40 0x7f7c0415e380 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40099b0 tx=0x7f7bf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12e16574cc3feba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c08ebd700 1 -- 172.21.15.22:0/3164818554 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400b860 con 0x7f7c0415df40 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c08ebd700 1 -- 172.21.15.22:0/3164818554 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf400b9c0 con 0x7f7c0415df40 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.825+0000 7f7c08ebd700 1 -- 172.21.15.22:0/3164818554 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400bd60 con 0x7f7c0415df40 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 -- 172.21.15.22:0/3164818554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c0415df40 msgr2=0x7f7c0415e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 --2- 172.21.15.22:0/3164818554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c0415df40 0x7f7c0415e380 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40099b0 tx=0x7f7bf4009250 comp rx=0 tx=0).stop 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 -- 172.21.15.22:0/3164818554 shutdown_connections 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 --2- 172.21.15.22:0/3164818554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c0415df40 0x7f7c0415e380 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 --2- 172.21.15.22:0/3164818554 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cca50 0x7f7c040caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 -- 172.21.15.22:0/3164818554 >> 172.21.15.22:0/3164818554 conn(0x7f7c040ce5c0 msgr2=0x7f7c040ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 -- 172.21.15.22:0/3164818554 shutdown_connections 2023-10-08T00:32:22.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.826+0000 7f7c0c123700 1 -- 172.21.15.22:0/3164818554 wait complete. 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.827+0000 7f7c0c123700 1 Processor -- start 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.827+0000 7f7c0c123700 1 -- start start 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0c123700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 0x7f7c040b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0c123700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cce20 0x7f7c04143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0c123700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c0415df40 0x7f7c04158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0c123700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c86c0 con 0x7f7c040cca50 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0c123700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c7ab0 con 0x7f7c0415df40 2023-10-08T00:32:22.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0c123700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040c7d90 con 0x7f7c040cce20 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 0x7f7c040b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 0x7f7c040b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44080/0 (socket says 172.21.15.22:44080) 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 -- 172.21.15.22:0/2398149322 learned_addr learned my addr 172.21.15.22:0/2398149322 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c096be700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cce20 0x7f7c04143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0a6c0700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c0415df40 0x7f7c04158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 -- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cce20 msgr2=0x7f7c04143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cce20 0x7f7c04143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 -- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c0415df40 msgr2=0x7f7c04158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c0415df40 0x7f7c04158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 -- 172.21.15.22:0/2398149322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40094f0 con 0x7f7c040cca50 2023-10-08T00:32:22.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c0a6c0700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c0415df40 0x7f7c04158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.828+0000 7f7c09ebf700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 0x7f7c040b1ac0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009fa0 tx=0x7f7bfc009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.829+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00ec70 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.829+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00edd0 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.829+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c040c8070 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.829+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc014670 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.829+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c040c7780 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.830+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c040c89a0 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.830+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7bfc0149e0 con 0x7f7c040cca50 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.831+0000 7f7c01ffb700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bf0067320 0x7f7bf00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:22.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.831+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bfc085320 con 0x7f7c040cca50 2023-10-08T00:32:22.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.831+0000 7f7c096be700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bf0067320 0x7f7bf00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:22.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.832+0000 7f7c096be700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bf0067320 0x7f7bf00697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7c0416d400 tx=0x7f7bf8007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:22.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:22.835+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bfc051fb0 con 0x7f7c040cca50 2023-10-08T00:32:23.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.107+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7c040718b0 con 0x7f7c040cca50 2023-10-08T00:32:23.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.111+0000 7f7c01ffb700 1 -- 172.21.15.22:0/2398149322 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7bfc0099c0 con 0x7f7c040cca50 2023-10-08T00:32:23.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bf0067320 msgr2=0x7f7bf00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bf0067320 0x7f7bf00697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7c0416d400 tx=0x7f7bf8007ec0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 msgr2=0x7f7c040b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 0x7f7c040b1ac0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009fa0 tx=0x7f7bfc009880 comp rx=0 tx=0).stop 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 shutdown_connections 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c0415df40 0x7f7c04158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c040cca50 0x7f7c040b1ac0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bf0067320 0x7f7bf00697d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 --2- 172.21.15.22:0/2398149322 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7c040cce20 0x7f7c04143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 >> 172.21.15.22:0/2398149322 conn(0x7f7c040ce5c0 msgr2=0x7f7c040c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.113+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 shutdown_connections 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.114+0000 7f7c0c123700 1 -- 172.21.15.22:0/2398149322 wait complete. 2023-10-08T00:32:23.115 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:32:23.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:23.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.247+0000 7f308820b700 1 Processor -- start 2023-10-08T00:32:23.248 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f308820b700 1 -- start start 2023-10-08T00:32:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f308820b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3080159890 0x7f308015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f308820b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3080069560 0x7f30800699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f308820b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3080069ee0 con 0x7f3080159c60 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f308820b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308015a160 con 0x7f3080159890 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f308820b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800d13a0 con 0x7f3080069560 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.248+0000 7f3085fa7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3080159890 0x7f308015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3080159890 0x7f308015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44090/0 (socket says 172.21.15.22:44090) 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 -- 172.21.15.22:0/1218710743 learned_addr learned my addr 172.21.15.22:0/1218710743 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f30867a8700 1 --2- 172.21.15.22:0/1218710743 >> v2:172.21.15.192:3300/0 conn(0x7f3080069560 0x7f30800699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 -- 172.21.15.22:0/1218710743 >> v2:172.21.15.192:3300/0 conn(0x7f3080069560 msgr2=0x7f30800699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 --2- 172.21.15.22:0/1218710743 >> v2:172.21.15.192:3300/0 conn(0x7f3080069560 0x7f30800699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 -- 172.21.15.22:0/1218710743 >> v1:172.21.15.192:6789/0 conn(0x7f3080159c60 legacy=0x7f308015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 -- 172.21.15.22:0/1218710743 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308015e140 con 0x7f3080159890 2023-10-08T00:32:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3085fa7700 1 --2- 172.21.15.22:0/1218710743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159890 0x7f308015abd0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f308006a890 tx=0x7f3078009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648601e1a1b49f0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3084fa5700 1 -- 172.21.15.22:0/1218710743 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307800e070 con 0x7f3080159890 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3084fa5700 1 -- 172.21.15.22:0/1218710743 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307800ba50 con 0x7f3080159890 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.249+0000 7f3084fa5700 1 -- 172.21.15.22:0/1218710743 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780092e0 con 0x7f3080159890 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 -- 172.21.15.22:0/1218710743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159890 msgr2=0x7f308015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 --2- 172.21.15.22:0/1218710743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159890 0x7f308015abd0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f308006a890 tx=0x7f3078009840 comp rx=0 tx=0).stop 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 -- 172.21.15.22:0/1218710743 shutdown_connections 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 --2- 172.21.15.22:0/1218710743 >> v2:172.21.15.192:3300/0 conn(0x7f3080069560 0x7f30800699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 --2- 172.21.15.22:0/1218710743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080159890 0x7f308015abd0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 -- 172.21.15.22:0/1218710743 >> 172.21.15.22:0/1218710743 conn(0x7f3080068e20 msgr2=0x7f30800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 -- 172.21.15.22:0/1218710743 shutdown_connections 2023-10-08T00:32:23.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.250+0000 7f308820b700 1 -- 172.21.15.22:0/1218710743 wait complete. 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.251+0000 7f308820b700 1 Processor -- start 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.251+0000 7f308820b700 1 -- start start 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 0x7f3080169890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159890 0x7f30800b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3080159c60 0x7f30800b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308016d7a0 con 0x7f3080069560 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30800cedc0 con 0x7f3080159c60 2023-10-08T00:32:23.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308016da60 con 0x7f3080159890 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 0x7f3080169890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 0x7f3080169890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44102/0 (socket says 172.21.15.22:44102) 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 -- 172.21.15.22:0/1194084068 learned_addr learned my addr 172.21.15.22:0/1194084068 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 -- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159890 msgr2=0x7f30800b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159890 0x7f30800b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 -- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3080159c60 msgr2=0x7f30800b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3080159c60 0x7f30800b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 -- 172.21.15.22:0/1194084068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3078009ae0 con 0x7f3080069560 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f3085fa7700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 0x7f3080169890 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f3080070e20 tx=0x7f3078018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078008ac0 con 0x7f3080069560 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078008c40 con 0x7f3080069560 2023-10-08T00:32:23.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308016dd40 con 0x7f3080069560 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.252+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078026460 con 0x7f3080069560 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.253+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308016e540 con 0x7f3080069560 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.253+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308016e240 con 0x7f3080069560 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.254+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3078003040 con 0x7f3080069560 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.254+0000 7f307dffb700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c067320 0x7f306c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.254+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3078086d80 con 0x7f3080069560 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.255+0000 7f30857a6700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c067320 0x7f306c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:23.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.255+0000 7f30857a6700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c067320 0x7f306c0697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f30800b3b90 tx=0x7f3074007ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:23.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.258+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3078053970 con 0x7f3080069560 2023-10-08T00:32:23.461 INFO:tasks.ceph.mds.b.smithi192.stderr:2023-10-08T00:32:23.461+0000 7f7c7f176700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.497+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f308004c3c0 con 0x7f3080069560 2023-10-08T00:32:23.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.498+0000 7f307dffb700 1 -- 172.21.15.22:0/1194084068 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4607 (secure 0 0 0) 0x7f3078021090 con 0x7f3080069560 2023-10-08T00:32:23.498 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:23.499 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":96,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:21.179774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c067320 msgr2=0x7f306c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c067320 0x7f306c0697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f30800b3b90 tx=0x7f3074007ab0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 msgr2=0x7f3080169890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 0x7f3080169890 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f3080070e20 tx=0x7f3078018000 comp rx=0 tx=0).stop 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 shutdown_connections 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3080159c60 0x7f30800b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3080069560 0x7f3080169890 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f306c067320 0x7f306c0697d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 --2- 172.21.15.22:0/1194084068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3080159890 0x7f30800b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 >> 172.21.15.22:0/1194084068 conn(0x7f3080068e20 msgr2=0x7f3080154760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 shutdown_connections 2023-10-08T00:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:23.500+0000 7f308820b700 1 -- 172.21.15.22:0/1194084068 wait complete. 2023-10-08T00:32:23.502 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 96 2023-10-08T00:32:23.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:32:17.533894+0000', 'modified': '2023-10-08T00:32:21.179774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7581}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7581': {'gid': 7581, 'name': 'b', 'rank': 0, 'incarnation': 92, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/1659415509', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 1659415509}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 1659415509}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:32:23.917 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:32:23.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T00:32:24.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.041+0000 7f72eedfa700 1 Processor -- start 2023-10-08T00:32:24.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.041+0000 7f72eedfa700 1 -- start start 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72eedfa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72e806bcd0 0x7f72e8140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72eedfa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e80c9510 0x7f72e8141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72eedfa700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e815c2a0 con 0x7f72e806c0a0 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72eedfa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e815b690 con 0x7f72e806bcd0 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72eedfa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e815b970 con 0x7f72e80c9510 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72e7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f72e806c0a0 0x7f72e80c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47030/0 (socket says 172.21.15.22:47030) 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72e7fff700 1 -- 172.21.15.22:0/3648152170 learned_addr learned my addr 172.21.15.22:0/3648152170 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72ecb96700 1 --2- 172.21.15.22:0/3648152170 >> v2:172.21.15.192:3300/0 conn(0x7f72e806bcd0 0x7f72e8140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.042+0000 7f72ed397700 1 --2- 172.21.15.22:0/3648152170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e80c9510 0x7f72e8141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72e77fe700 1 -- 172.21.15.22:0/3648152170 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323345875 0 0) 0x7f72e815c2a0 con 0x7f72e806c0a0 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72e77fe700 1 -- 172.21.15.22:0/3648152170 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d4003570 con 0x7f72e806c0a0 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72ed397700 1 -- 172.21.15.22:0/3648152170 >> v2:172.21.15.192:3300/0 conn(0x7f72e806bcd0 msgr2=0x7f72e8140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72ed397700 1 --2- 172.21.15.22:0/3648152170 >> v2:172.21.15.192:3300/0 conn(0x7f72e806bcd0 0x7f72e8140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72ed397700 1 -- 172.21.15.22:0/3648152170 >> v1:172.21.15.22:6789/0 conn(0x7f72e806c0a0 legacy=0x7f72e80c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72e77fe700 1 -- 172.21.15.22:0/3648152170 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3100366549 0 0) 0x7f72d4003570 con 0x7f72e806c0a0 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72ed397700 1 -- 172.21.15.22:0/3648152170 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e815bc50 con 0x7f72e80c9510 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72ecb96700 1 --2- 172.21.15.22:0/3648152170 >> v2:172.21.15.192:3300/0 conn(0x7f72e806bcd0 0x7f72e8140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72ed397700 1 --2- 172.21.15.22:0/3648152170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e80c9510 0x7f72e8141330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f72d80098e0 tx=0x7f72d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff7288997316cde server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72e77fe700 1 -- 172.21.15.22:0/3648152170 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0001470 con 0x7f72e80c9510 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72e77fe700 1 -- 172.21.15.22:0/3648152170 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d8011420 con 0x7f72e80c9510 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.043+0000 7f72e77fe700 1 -- 172.21.15.22:0/3648152170 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d80117c0 con 0x7f72e80c9510 2023-10-08T00:32:24.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 -- 172.21.15.22:0/3648152170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e80c9510 msgr2=0x7f72e8141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 --2- 172.21.15.22:0/3648152170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e80c9510 0x7f72e8141330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f72d80098e0 tx=0x7f72d80091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 -- 172.21.15.22:0/3648152170 shutdown_connections 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 --2- 172.21.15.22:0/3648152170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e80c9510 0x7f72e8141330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 --2- 172.21.15.22:0/3648152170 >> v2:172.21.15.192:3300/0 conn(0x7f72e806bcd0 0x7f72e8140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 -- 172.21.15.22:0/3648152170 >> 172.21.15.22:0/3648152170 conn(0x7f72e80ce600 msgr2=0x7f72e80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 -- 172.21.15.22:0/3648152170 shutdown_connections 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.044+0000 7f72eedfa700 1 -- 172.21.15.22:0/3648152170 wait complete. 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.045+0000 7f72eedfa700 1 Processor -- start 2023-10-08T00:32:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.045+0000 7f72eedfa700 1 -- start start 2023-10-08T00:32:24.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72eedfa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e806bcd0 0x7f72e813a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72eedfa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 0x7f72e8167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72eedfa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72e80c9510 0x7f72e80b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72eedfa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e813a550 con 0x7f72e806c0a0 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72eedfa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8168db0 con 0x7f72e80c9510 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72eedfa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e81687f0 con 0x7f72e806bcd0 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 0x7f72e8167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 0x7f72e8167df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44110/0 (socket says 172.21.15.22:44110) 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 -- 172.21.15.22:0/1159903983 learned_addr learned my addr 172.21.15.22:0/1159903983 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:24.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e806bcd0 0x7f72e813a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72ed397700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72e80c9510 0x7f72e80b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 -- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e806bcd0 msgr2=0x7f72e813a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e806bcd0 0x7f72e813a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 -- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72e80c9510 msgr2=0x7f72e80b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72e80c9510 0x7f72e80b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 -- 172.21.15.22:0/1159903983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009a20 con 0x7f72e806c0a0 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72ed397700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72e80c9510 0x7f72e80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.046+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 0x7f72e8167df0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cb90 tx=0x7f72d0001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.047+0000 7f72e4ff9700 1 -- 172.21.15.22:0/1159903983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0007150 con 0x7f72e806c0a0 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.047+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d8009420 con 0x7f72e806c0a0 2023-10-08T00:32:24.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.047+0000 7f72e4ff9700 1 -- 172.21.15.22:0/1159903983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00072d0 con 0x7f72e806c0a0 2023-10-08T00:32:24.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.047+0000 7f72e4ff9700 1 -- 172.21.15.22:0/1159903983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0007690 con 0x7f72e806c0a0 2023-10-08T00:32:24.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.047+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e80c7760 con 0x7f72e806c0a0 2023-10-08T00:32:24.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.048+0000 7f72e4ff9700 1 -- 172.21.15.22:0/1159903983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f72d0004a40 con 0x7f72e806c0a0 2023-10-08T00:32:24.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.048+0000 7f72e4ff9700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72c8067320 0x7f72c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.049+0000 7f72e4ff9700 1 -- 172.21.15.22:0/1159903983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72d00844b0 con 0x7f72e806c0a0 2023-10-08T00:32:24.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.049+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72c8067320 0x7f72c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.049+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72c8067320 0x7f72c80697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009fd0 tx=0x7f72e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.050+0000 7f72f80f2b80 1 Processor -- start 2023-10-08T00:32:24.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.050+0000 7f72f80f2b80 1 -- start start 2023-10-08T00:32:24.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 0x555f65faae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fd3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65fd3f60 0x555f65fa6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f65f01a70 con 0x555f65faaa50 2023-10-08T00:32:24.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f65eff270 con 0x555f65fd3f60 2023-10-08T00:32:24.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f65efb060 con 0x555f65ff4d00 2023-10-08T00:32:24.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 0x555f65faae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 0x555f65faae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44114/0 (socket says 172.21.15.22:44114) 2023-10-08T00:32:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 -- 172.21.15.22:0/2116983932 learned_addr learned my addr 172.21.15.22:0/2116983932 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72e7fff700 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fd3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ed397700 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65fd3f60 0x555f65fa6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 -- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 msgr2=0x555f65fd3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fd3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 -- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65fd3f60 msgr2=0x555f65fa6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65fd3f60 0x555f65fa6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 -- 172.21.15.22:0/2116983932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f65d95270 con 0x555f65faaa50 2023-10-08T00:32:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ed397700 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65fd3f60 0x555f65fa6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.051+0000 7f72ecb96700 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 0x555f65faae20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f72e0015960 tx=0x7f72e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65db50c5abbc1a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72ddffb700 1 -- 172.21.15.22:0/2116983932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e000e040 con 0x555f65faaa50 2023-10-08T00:32:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72ddffb700 1 -- 172.21.15.22:0/2116983932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e001b070 con 0x555f65faaa50 2023-10-08T00:32:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72ddffb700 1 -- 172.21.15.22:0/2116983932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e0017ae0 con 0x555f65faaa50 2023-10-08T00:32:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 -- 172.21.15.22:0/2116983932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 msgr2=0x555f65faae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 0x555f65faae20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f72e0015960 tx=0x7f72e0016000 comp rx=0 tx=0).stop 2023-10-08T00:32:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 -- 172.21.15.22:0/2116983932 shutdown_connections 2023-10-08T00:32:24.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65fd3f60 0x555f65fa6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65faaa50 0x555f65faae20 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/2116983932 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fd3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 -- 172.21.15.22:0/2116983932 >> 172.21.15.22:0/2116983932 conn(0x555f65fac370 msgr2=0x555f65fac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 -- 172.21.15.22:0/2116983932 shutdown_connections 2023-10-08T00:32:24.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.052+0000 7f72f80f2b80 1 -- 172.21.15.22:0/2116983932 wait complete. 2023-10-08T00:32:24.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.053+0000 7f72f80f2b80 1 -- start start 2023-10-08T00:32:24.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.053+0000 7f72f80f2b80 1 Processor -- start 2023-10-08T00:32:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65feeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65fd3f60 0x555f65fd9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 0x555f66004410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f65ea6890 con 0x555f65ff4d00 2023-10-08T00:32:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f65ec1ea0 con 0x555f65faaa50 2023-10-08T00:32:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f65d7de30 con 0x555f65fd3f60 2023-10-08T00:32:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72f80f2b80 10 client.0 _ll_register_callbacks cb 0x555f65f6e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:32:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 0x555f66004410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 0x555f66004410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44128/0 (socket says 172.21.15.22:44128) 2023-10-08T00:32:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 -- 172.21.15.22:0/1522372141 learned_addr learned my addr 172.21.15.22:0/1522372141 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65feeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65fd3f60 0x555f65fd9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 -- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65fd3f60 msgr2=0x555f65fd9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65fd3f60 0x555f65fd9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 -- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 msgr2=0x555f65feeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65feeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.054+0000 7f72ed397700 1 -- 172.21.15.22:0/1522372141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e00155e0 con 0x555f65ff4d00 2023-10-08T00:32:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72ed397700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 0x555f66004410 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f72d8003080 tx=0x7f72d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3865d11ce7710688 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:32:24.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1522372141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8022070 con 0x555f65ff4d00 2023-10-08T00:32:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1522372141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72d800b790 con 0x555f65ff4d00 2023-10-08T00:32:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f65f9fb70 con 0x555f65ff4d00 2023-10-08T00:32:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1522372141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72d800bb60 con 0x555f65ff4d00 2023-10-08T00:32:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 10 client.7713 fetch_fsmap learned FSMap version 96 2023-10-08T00:32:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x555f65d37fe0 con 0x555f65ff4d00 2023-10-08T00:32:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1522372141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f65f9fb70 con 0x555f65ff4d00 2023-10-08T00:32:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1522372141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 96) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f72d8018070 con 0x555f65ff4d00 2023-10-08T00:32:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 10 client.7713 fetch_fsmap finished waiting for FSMap version 96 2023-10-08T00:32:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 10 client.7713 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T00:32:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 20 client.7713 populate_metadata read hostname 'smithi022' 2023-10-08T00:32:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f65fa7780 0x555f65fa7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 4 client.7713 mds_command: new command op to 7581 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:32:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 --> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f65f7caa0 con 0x555f65fa7780 2023-10-08T00:32:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.055+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f65fa7780 0x555f65fa7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.056+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f65fa7780 0x555f65fa7b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=311eda4afca0305d server_cookie=cbd9c383dc0271bf in_seq=0 out_seq=0 2023-10-08T00:32:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.056+0000 7f72c6ffd700 10 client.7713 ms_handle_connect on v2:172.21.15.192:6835/1659415509 2023-10-08T00:32:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.056+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1522372141 <== mds.0 v2:172.21.15.192:6835/1659415509 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x555f65f7caa0 con 0x555f65fa7780 2023-10-08T00:32:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.056+0000 7f72c6ffd700 10 client.7713 handle_command_reply: tid=0 2023-10-08T00:32:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.056+0000 7f72f80f2b80 1 client.7713 shutdown 2023-10-08T00:32:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 msgr2=0x555f66004410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 0x555f66004410 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f72d8003080 tx=0x7f72d8016000 comp rx=0 tx=0).stop 2023-10-08T00:32:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 shutdown_connections 2023-10-08T00:32:24.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f65fa7780 0x555f65fa7b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65ff4d00 0x555f66004410 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65feeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1522372141 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65fd3f60 0x555f65fd9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72c6ffd700 0 client.7713 ms_handle_reset on v2:172.21.15.192:6835/1659415509 2023-10-08T00:32:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 >> 172.21.15.22:0/1522372141 conn(0x555f65fac370 msgr2=0x555f65fab2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 shutdown_connections 2023-10-08T00:32:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1522372141 wait complete. 2023-10-08T00:32:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.057+0000 7f72f80f2b80 20 client.7713 trim_cache size 0 max 16384 2023-10-08T00:32:24.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.074+0000 7f72f80f2b80 1 Processor -- start 2023-10-08T00:32:24.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.074+0000 7f72f80f2b80 1 -- start start 2023-10-08T00:32:24.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fefa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65fd3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65faafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f65fa5fc0 con 0x555f65fd3f60 2023-10-08T00:32:24.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f66004ca0 con 0x555f65faaa50 2023-10-08T00:32:24.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f66000a70 con 0x555f65ff4d00 2023-10-08T00:32:24.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65fd3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65fd3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44140/0 (socket says 172.21.15.22:44140) 2023-10-08T00:32:24.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 -- 172.21.15.22:0/1674303338 learned_addr learned my addr 172.21.15.22:0/1674303338 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:24.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fefa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 -- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 msgr2=0x555f65faafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65faafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 -- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 msgr2=0x555f65fefa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fefa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 -- 172.21.15.22:0/1674303338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f65fa8d40 con 0x555f65fd3f60 2023-10-08T00:32:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65fd3670 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cb60 tx=0x7f72d001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d6f70d52916282 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72de7fc700 1 -- 172.21.15.22:0/1674303338 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d006b200 con 0x555f65fd3f60 2023-10-08T00:32:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72de7fc700 1 -- 172.21.15.22:0/1674303338 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d005bda0 con 0x555f65fd3f60 2023-10-08T00:32:24.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.075+0000 7f72de7fc700 1 -- 172.21.15.22:0/1674303338 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d005a0c0 con 0x555f65fd3f60 2023-10-08T00:32:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1674303338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 msgr2=0x555f65fd3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65fd3670 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cb60 tx=0x7f72d001f040 comp rx=0 tx=0).stop 2023-10-08T00:32:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1674303338 shutdown_connections 2023-10-08T00:32:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65faafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fefa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1674303338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65fd3670 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1674303338 >> 172.21.15.22:0/1674303338 conn(0x555f65fac370 msgr2=0x555f65fac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1674303338 shutdown_connections 2023-10-08T00:32:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1674303338 wait complete. 2023-10-08T00:32:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.076+0000 7f72f80f2b80 1 -- start start 2023-10-08T00:32:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 Processor -- start 2023-10-08T00:32:24.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fe80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65faae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f65fefa90 con 0x555f65fd3f60 2023-10-08T00:32:24.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f66057e30 con 0x555f65faaa50 2023-10-08T00:32:24.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f66057b50 con 0x555f65ff4d00 2023-10-08T00:32:24.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72f80f2b80 10 client.0 _ll_register_callbacks cb 0x555f65f6e110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:32:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72e7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65faae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72e7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65faae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44156/0 (socket says 172.21.15.22:44156) 2023-10-08T00:32:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.077+0000 7f72e7fff700 1 -- 172.21.15.22:0/1348786574 learned_addr learned my addr 172.21.15.22:0/1348786574 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fe80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72ed397700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72e7fff700 1 -- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 msgr2=0x555f65fab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72e7fff700 1 -- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 msgr2=0x555f65fe80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fe80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72e7fff700 1 -- 172.21.15.22:0/1348786574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e80c7760 con 0x555f65fd3f60 2023-10-08T00:32:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72e7fff700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65faae20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cb60 tx=0x7f72d0057030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5e19a250535743 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:32:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1348786574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0052f40 con 0x555f65fd3f60 2023-10-08T00:32:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1348786574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72d0055060 con 0x555f65fd3f60 2023-10-08T00:32:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f65fd0e30 con 0x555f65fd3f60 2023-10-08T00:32:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1348786574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72d00542f0 con 0x555f65fd3f60 2023-10-08T00:32:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 10 client.7719 fetch_fsmap learned FSMap version 96 2023-10-08T00:32:24.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x555f65ec9780 con 0x555f65fd3f60 2023-10-08T00:32:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1348786574 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f65fd0e30 con 0x555f65fd3f60 2023-10-08T00:32:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1348786574 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 96) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f72d005b910 con 0x555f65fd3f60 2023-10-08T00:32:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 10 client.7719 fetch_fsmap finished waiting for FSMap version 96 2023-10-08T00:32:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 10 client.7719 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T00:32:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 20 client.7719 populate_metadata read hostname 'smithi022' 2023-10-08T00:32:24.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f6605a740 0x555f6605ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 4 client.7719 mds_command: new command op to 7581 tid=0[{"prefix": "status"}] 2023-10-08T00:32:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.078+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 --> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f72e001b070 con 0x555f6605a740 2023-10-08T00:32:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f6605a740 0x555f6605ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72c6ffd700 10 client.7719 ms_handle_connect on v2:172.21.15.192:6835/1659415509 2023-10-08T00:32:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72ecb96700 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f6605a740 0x555f6605ab10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26ea6c57356adee server_cookie=9beda25facca7b3d in_seq=0 out_seq=0 2023-10-08T00:32:24.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72c6ffd700 1 -- 172.21.15.22:0/1348786574 <== mds.0 v2:172.21.15.192:6835/1659415509 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f72e001b070 con 0x555f6605a740 2023-10-08T00:32:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72c6ffd700 10 client.7719 handle_command_reply: tid=0 2023-10-08T00:32:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 client.7719 shutdown 2023-10-08T00:32:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 msgr2=0x555f65faae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65faae20 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cb60 tx=0x7f72d0057030 comp rx=0 tx=0).stop 2023-10-08T00:32:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 shutdown_connections 2023-10-08T00:32:24.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:6835/1659415509,v1:172.21.15.192:6837/1659415509] conn(0x555f6605a740 0x555f6605ab10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x555f65ff4d00 0x555f65fab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555f65faaa50 0x555f65fe80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.079+0000 7f72c6ffd700 0 client.7719 ms_handle_reset on v2:172.21.15.192:6835/1659415509 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72f80f2b80 1 --2- 172.21.15.22:0/1348786574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555f65fd3f60 0x555f65faae20 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 >> 172.21.15.22:0/1348786574 conn(0x555f65fac370 msgr2=0x555f65fa6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 shutdown_connections 2023-10-08T00:32:24.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72f80f2b80 1 -- 172.21.15.22:0/1348786574 wait complete. 2023-10-08T00:32:24.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72f80f2b80 20 client.7719 trim_cache size 0 max 16384 2023-10-08T00:32:24.108 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:32:24.108 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:32:24.108 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 7581, 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 5.9329534339999999, 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 96, 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 141, 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 141, 2023-10-08T00:32:24.109 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 11.014149967 2023-10-08T00:32:24.110 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72c8067320 msgr2=0x7f72c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72c8067320 0x7f72c80697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009fd0 tx=0x7f72e000b040 comp rx=0 tx=0).stop 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 msgr2=0x7f72e8167df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 0x7f72e8167df0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f72d000cb90 tx=0x7f72d0001ad0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 shutdown_connections 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72e80c9510 0x7f72e80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72c8067320 0x7f72c80697d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72e806bcd0 0x7f72e813a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 --2- 172.21.15.22:0/1159903983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72e806c0a0 0x7f72e8167df0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 >> 172.21.15.22:0/1159903983 conn(0x7f72e80ce600 msgr2=0x7f72e80c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 shutdown_connections 2023-10-08T00:32:24.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.080+0000 7f72eedfa700 1 -- 172.21.15.22:0/1159903983 wait complete. 2023-10-08T00:32:24.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:32:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.231+0000 7f9f3d45e700 1 Processor -- start 2023-10-08T00:32:24.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.231+0000 7f9f3d45e700 1 -- start start 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f3d45e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f38159890 0x7f9f3815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f3d45e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3815a160 con 0x7f9f38069560 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f3d45e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380d13a0 con 0x7f9f38159c60 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f3d45e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3815e140 con 0x7f9f38159890 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f36ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f38159890 0x7f9f3815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f377fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9f38069560 0x7f9f380ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47042/0 (socket says 172.21.15.22:47042) 2023-10-08T00:32:24.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f377fe700 1 -- 172.21.15.22:0/3418812312 learned_addr learned my addr 172.21.15.22:0/3418812312 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f36ffd700 1 -- 172.21.15.22:0/3418812312 >> v1:172.21.15.192:6789/0 conn(0x7f9f38159c60 legacy=0x7f9f3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f36ffd700 1 -- 172.21.15.22:0/3418812312 >> v1:172.21.15.22:6789/0 conn(0x7f9f38069560 legacy=0x7f9f380ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f36ffd700 1 -- 172.21.15.22:0/3418812312 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3815a3d0 con 0x7f9f38159890 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f36ffd700 1 --2- 172.21.15.22:0/3418812312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f3815abd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9f280098e0 tx=0x7f9f280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53cd3bc43f21535 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f35ffb700 1 -- 172.21.15.22:0/3418812312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28009e80 con 0x7f9f38159890 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f35ffb700 1 -- 172.21.15.22:0/3418812312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2800b860 con 0x7f9f38159890 2023-10-08T00:32:24.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.232+0000 7f9f35ffb700 1 -- 172.21.15.22:0/3418812312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2800bbe0 con 0x7f9f38159890 2023-10-08T00:32:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 -- 172.21.15.22:0/3418812312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 msgr2=0x7f9f3815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/3418812312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f3815abd0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9f280098e0 tx=0x7f9f280091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 -- 172.21.15.22:0/3418812312 shutdown_connections 2023-10-08T00:32:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/3418812312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f3815abd0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 -- 172.21.15.22:0/3418812312 >> 172.21.15.22:0/3418812312 conn(0x7f9f38068e20 msgr2=0x7f9f380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 -- 172.21.15.22:0/3418812312 shutdown_connections 2023-10-08T00:32:24.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.233+0000 7f9f3d45e700 1 -- 172.21.15.22:0/3418812312 wait complete. 2023-10-08T00:32:24.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.234+0000 7f9f3d45e700 1 Processor -- start 2023-10-08T00:32:24.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.234+0000 7f9f3d45e700 1 -- start start 2023-10-08T00:32:24.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f3d45e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f38069560 0x7f9f381514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f3d45e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f381561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f3d45e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f38159c60 0x7f9f380c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f3d45e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38151a00 con 0x7f9f38159890 2023-10-08T00:32:24.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f3d45e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380b3590 con 0x7f9f38069560 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f3d45e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3816a7a0 con 0x7f9f38159c60 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f381561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f381561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44178/0 (socket says 172.21.15.22:44178) 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 -- 172.21.15.22:0/2623039437 learned_addr learned my addr 172.21.15.22:0/2623039437 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f36ffd700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f38069560 0x7f9f381514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f377fe700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f38159c60 0x7f9f380c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 -- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f38159c60 msgr2=0x7f9f380c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f38159c60 0x7f9f380c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 -- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f38069560 msgr2=0x7f9f381514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.235+0000 7f9f367fc700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f38069560 0x7f9f381514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f367fc700 1 -- 172.21.15.22:0/2623039437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28009420 con 0x7f9f38159890 2023-10-08T00:32:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f377fe700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f38159c60 0x7f9f380c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f367fc700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f381561d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00c590 tx=0x7f9f2c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c011590 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c011730 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3816aa80 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c011af0 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.236+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3816b040 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.237+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380b2aa0 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.237+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9f2c012420 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.238+0000 7f9f1effd700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f24067320 0x7f9f240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.238+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f2c083f10 con 0x7f9f38159890 2023-10-08T00:32:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.238+0000 7f9f36ffd700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f24067320 0x7f9f240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:24.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.238+0000 7f9f36ffd700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f24067320 0x7f9f240697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9f280093f0 tx=0x7f9f28017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:24.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.242+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f2c04b5a0 con 0x7f9f38159890 2023-10-08T00:32:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.479+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f3804c3c0 con 0x7f9f38159890 2023-10-08T00:32:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.480+0000 7f9f1effd700 1 -- 172.21.15.22:0/2623039437 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9f2c017070 con 0x7f9f38159890 2023-10-08T00:32:24.480 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:32:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f24067320 msgr2=0x7f9f240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f24067320 0x7f9f240697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9f280093f0 tx=0x7f9f28017000 comp rx=0 tx=0).stop 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 msgr2=0x7f9f381561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f381561d0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00c590 tx=0x7f9f2c007f30 comp rx=0 tx=0).stop 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 shutdown_connections 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f24067320 0x7f9f240697d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f38159c60 0x7f9f380c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f38069560 0x7f9f381514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 --2- 172.21.15.22:0/2623039437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f38159890 0x7f9f381561d0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 >> 172.21.15.22:0/2623039437 conn(0x7f9f38068e20 msgr2=0x7f9f380b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 shutdown_connections 2023-10-08T00:32:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:24.482+0000 7f9f3d45e700 1 -- 172.21.15.22:0/2623039437 wait complete. 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:32:24.495 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:32:24.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:24.496 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:24.511 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42026sec preferred_lft 42026sec 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:24.512 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.513 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:24.514 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:32:24.514 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:32:24.514 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:24.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:24.514 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:32:24.575 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:32:24.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:24.576 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:32:24.633 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:32:24.633 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:32:24.633 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:32:24.633 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:32:24.633 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:32:24.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:24.634 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:32:24.634 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:32:24.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:32:24.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:32:24.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:32:24.634 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:32:24.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:24.736 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:32:24.752 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:32:24.752 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:32:24.752 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:32:24.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:24.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:32:24.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:24.818 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:24.872 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:32:24.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:24.873 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:24.928 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:32:24.928 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:32:24.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:25.009 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:25.009 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:25.028 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:25.028 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:25.028 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:32:25.029 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:32:25.029 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:32:25.029 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:32:25.029 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:32:25.029 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:32:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:32:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:32:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:32:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:32:25.053 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:32:25.053 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:32:25.053 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:32:25.053 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:32:25.053 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:32:25.055 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:32:25.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.055 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:25.121 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:32:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.282+0000 7f2c68ba9700 1 Processor -- start 2023-10-08T00:32:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.282+0000 7f2c68ba9700 1 -- start start 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.283+0000 7f2c68ba9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c64159890 0x7f2c6415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.283+0000 7f2c68ba9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2c64159c60 0x7f2c6415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.283+0000 7f2c68ba9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6415db10 0x7f2c64069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.283+0000 7f2c68ba9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6415df50 con 0x7f2c64159890 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.283+0000 7f2c68ba9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6415a160 con 0x7f2c64159c60 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.283+0000 7f2c68ba9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640d13a0 con 0x7f2c6415db10 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c64159890 0x7f2c6415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c64159890 0x7f2c6415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44188/0 (socket says 172.21.15.22:44188) 2023-10-08T00:32:25.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 -- 172.21.15.22:0/3172474143 learned_addr learned my addr 172.21.15.22:0/3172474143 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c62d9d700 1 --2- 172.21.15.22:0/3172474143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6415db10 0x7f2c64069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c61d9b700 1 --2- 172.21.15.22:0/3172474143 >> v2:172.21.15.192:3300/0 conn(0x7f2c64159c60 0x7f2c6415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 -- 172.21.15.22:0/3172474143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6415db10 msgr2=0x7f2c64069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 --2- 172.21.15.22:0/3172474143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6415db10 0x7f2c64069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 -- 172.21.15.22:0/3172474143 >> v2:172.21.15.192:3300/0 conn(0x7f2c64159c60 msgr2=0x7f2c6415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 --2- 172.21.15.22:0/3172474143 >> v2:172.21.15.192:3300/0 conn(0x7f2c64159c60 0x7f2c6415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 -- 172.21.15.22:0/3172474143 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6415e140 con 0x7f2c64159890 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6259c700 1 --2- 172.21.15.22:0/3172474143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159890 0x7f2c6415abd0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f2c640b67f0 tx=0x7f2c5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a54f3eb75993ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6159a700 1 -- 172.21.15.22:0/3172474143 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00b640 con 0x7f2c64159890 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6159a700 1 -- 172.21.15.22:0/3172474143 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00b7a0 con 0x7f2c64159890 2023-10-08T00:32:25.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.284+0000 7f2c6159a700 1 -- 172.21.15.22:0/3172474143 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00bb60 con 0x7f2c64159890 2023-10-08T00:32:25.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 -- 172.21.15.22:0/3172474143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159890 msgr2=0x7f2c6415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:25.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/3172474143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159890 0x7f2c6415abd0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f2c640b67f0 tx=0x7f2c5c009250 comp rx=0 tx=0).stop 2023-10-08T00:32:25.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 -- 172.21.15.22:0/3172474143 shutdown_connections 2023-10-08T00:32:25.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/3172474143 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159890 0x7f2c6415abd0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/3172474143 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c6415db10 0x7f2c64069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/3172474143 >> v2:172.21.15.192:3300/0 conn(0x7f2c64159c60 0x7f2c6415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 -- 172.21.15.22:0/3172474143 >> 172.21.15.22:0/3172474143 conn(0x7f2c64068e20 msgr2=0x7f2c640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 -- 172.21.15.22:0/3172474143 shutdown_connections 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.285+0000 7f2c68ba9700 1 -- 172.21.15.22:0/3172474143 wait complete. 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.286+0000 7f2c68ba9700 1 Processor -- start 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.286+0000 7f2c68ba9700 1 -- start start 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c68ba9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c64159890 0x7f2c640b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c68ba9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 0x7f2c640c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c68ba9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6415db10 0x7f2c640c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c68ba9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c64153650 con 0x7f2c64159c60 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c68ba9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c9dd0 con 0x7f2c6415db10 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c68ba9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640b3630 con 0x7f2c64159890 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 0x7f2c640c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 0x7f2c640c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44200/0 (socket says 172.21.15.22:44200) 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 -- 172.21.15.22:0/1569908606 learned_addr learned my addr 172.21.15.22:0/1569908606 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c6259c700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c64159890 0x7f2c640b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c62d9d700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6415db10 0x7f2c640c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 -- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c64159890 msgr2=0x7f2c640b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c64159890 0x7f2c640b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 -- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6415db10 msgr2=0x7f2c640c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6415db10 0x7f2c640c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 -- 172.21.15.22:0/1569908606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0094f0 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c61d9b700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 0x7f2c640c9210 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00ec80 tx=0x7f2c4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.287+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00c9d0 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.288+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c00cb30 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.288+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640b3910 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.288+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c013470 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.288+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c640b3ed0 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.288+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6404c3c0 con 0x7f2c64159c60 2023-10-08T00:32:25.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.289+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2c4c013820 con 0x7f2c64159c60 2023-10-08T00:32:25.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.289+0000 7f2c5a7fc700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c44067320 0x7f2c440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:25.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.289+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2c4c085000 con 0x7f2c64159c60 2023-10-08T00:32:25.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.290+0000 7f2c6259c700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c44067320 0x7f2c440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:25.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.290+0000 7f2c6259c700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c44067320 0x7f2c440697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2c640b67f0 tx=0x7f2c5c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:25.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.294+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c4c051c90 con 0x7f2c64159c60 2023-10-08T00:32:25.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.531+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c6406a5b0 con 0x7f2c64159c60 2023-10-08T00:32:25.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.532+0000 7f2c5a7fc700 1 -- 172.21.15.22:0/1569908606 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2c4c0552b0 con 0x7f2c64159c60 2023-10-08T00:32:25.532 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:32:25.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c44067320 msgr2=0x7f2c440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c44067320 0x7f2c440697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2c640b67f0 tx=0x7f2c5c017000 comp rx=0 tx=0).stop 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 msgr2=0x7f2c640c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 0x7f2c640c9210 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00ec80 tx=0x7f2c4c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 shutdown_connections 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c6415db10 0x7f2c640c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c44067320 0x7f2c440697d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c64159890 0x7f2c640b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 --2- 172.21.15.22:0/1569908606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c64159c60 0x7f2c640c9210 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 >> 172.21.15.22:0/1569908606 conn(0x7f2c64068e20 msgr2=0x7f2c640c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:25.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 shutdown_connections 2023-10-08T00:32:25.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:25.534+0000 7f2c68ba9700 1 -- 172.21.15.22:0/1569908606 wait complete. 2023-10-08T00:32:25.546 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:32:25.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:32:25.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:32:25.547 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:32:25.547 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:25.547 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:32:25.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:32:25.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:32:25.547 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:32:25.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.547 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:32:25.565 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:32:25.565 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:32:25.566 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42029sec preferred_lft 42029sec 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.567 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:25.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.569 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:32:25.633 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:32:25.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.634 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:32:25.691 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:32:25.691 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:32:25.691 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:32:25.692 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:32:25.692 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:32:25.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.692 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:32:25.692 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:32:25.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:32:25.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:32:25.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:32:25.692 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:32:25.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.797 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:32:25.811 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:32:25.812 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:32:25.812 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:32:25.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:25.812 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:32:25.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:25.877 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:25.931 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:32:25.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:25.932 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:25.986 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:32:25.986 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:32:25.986 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:26.065 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:26.065 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:26.083 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:32:26.084 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:32:26.105 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:32:26.106 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:32:26.108 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:32:26.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:26.108 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:26.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:32:26.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 Processor -- start 2023-10-08T00:32:26.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 -- start start 2023-10-08T00:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59b8159ec0 0x7f59b80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59b80b53d0 0x7f59b80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b80b5b00 con 0x7f59b80cce40 2023-10-08T00:32:26.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b80b5850 con 0x7f59b80b53d0 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.308+0000 7f59bf0a2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b80b5da0 con 0x7f59b8159ec0 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59b80b53d0 0x7f59b80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59bd63f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f59b80cce40 0x7f59b80cd260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47056/0 (socket says 172.21.15.22:47056) 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59bd63f700 1 -- 172.21.15.22:0/981420464 learned_addr learned my addr 172.21.15.22:0/981420464 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59bce3e700 1 --2- 172.21.15.22:0/981420464 >> v2:172.21.15.192:3300/0 conn(0x7f59b8159ec0 0x7f59b80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b7fff700 1 -- 172.21.15.22:0/981420464 >> v2:172.21.15.192:3300/0 conn(0x7f59b8159ec0 msgr2=0x7f59b80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b7fff700 1 --2- 172.21.15.22:0/981420464 >> v2:172.21.15.192:3300/0 conn(0x7f59b8159ec0 0x7f59b80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b7fff700 1 -- 172.21.15.22:0/981420464 >> v1:172.21.15.22:6789/0 conn(0x7f59b80cce40 legacy=0x7f59b80cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b7fff700 1 -- 172.21.15.22:0/981420464 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80b6080 con 0x7f59b80b53d0 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b77fe700 1 -- 172.21.15.22:0/981420464 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267984024 0 0) 0x7f59b80b5b00 con 0x7f59b80cce40 2023-10-08T00:32:26.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b7fff700 1 --2- 172.21.15.22:0/981420464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b80b53d0 0x7f59b80cc900 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f59b8089120 tx=0x7f59a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4e6982c2a99e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b77fe700 1 -- 172.21.15.22:0/981420464 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800e070 con 0x7f59b80b53d0 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b77fe700 1 -- 172.21.15.22:0/981420464 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a800bb60 con 0x7f59b80b53d0 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.309+0000 7f59b77fe700 1 -- 172.21.15.22:0/981420464 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8012430 con 0x7f59b80b53d0 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 -- 172.21.15.22:0/981420464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b80b53d0 msgr2=0x7f59b80cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/981420464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b80b53d0 0x7f59b80cc900 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f59b8089120 tx=0x7f59a8009780 comp rx=0 tx=0).stop 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 -- 172.21.15.22:0/981420464 shutdown_connections 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/981420464 >> v2:172.21.15.192:3300/0 conn(0x7f59b8159ec0 0x7f59b80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/981420464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b80b53d0 0x7f59b80cc900 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 -- 172.21.15.22:0/981420464 >> 172.21.15.22:0/981420464 conn(0x7f59b80999f0 msgr2=0x7f59b80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 -- 172.21.15.22:0/981420464 shutdown_connections 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.310+0000 7f59bf0a2700 1 -- 172.21.15.22:0/981420464 wait complete. 2023-10-08T00:32:26.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.311+0000 7f59bf0a2700 1 Processor -- start 2023-10-08T00:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.311+0000 7f59bf0a2700 1 -- start start 2023-10-08T00:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bf0a2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59b80b53d0 0x7f59b814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bf0a2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59b80cce40 0x7f59b809ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bf0a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 0x7f59b809d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bf0a2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b809bf00 con 0x7f59b8159ec0 2023-10-08T00:32:26.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bf0a2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b814b7e0 con 0x7f59b80b53d0 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bf0a2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b809b2f0 con 0x7f59b80cce40 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 0x7f59b809d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 0x7f59b809d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44220/0 (socket says 172.21.15.22:44220) 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 -- 172.21.15.22:0/282377787 learned_addr learned my addr 172.21.15.22:0/282377787 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59b7fff700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59b80cce40 0x7f59b809ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bce3e700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59b80b53d0 0x7f59b814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 -- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59b80cce40 msgr2=0x7f59b809ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59b80cce40 0x7f59b809ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 -- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59b80b53d0 msgr2=0x7f59b814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59b80b53d0 0x7f59b814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.312+0000 7f59bd63f700 1 -- 172.21.15.22:0/282377787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8009a20 con 0x7f59b8159ec0 2023-10-08T00:32:26.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.313+0000 7f59bd63f700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 0x7f59b809d230 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f59a000c7e0 tx=0x7f59a0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.313+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0005c00 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.313+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0005d60 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.313+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b809b5d0 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.313+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0004a80 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.313+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b809bb90 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.314+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b80cab60 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.314+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f59a0005030 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.315+0000 7f59b4ff9700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5998067320 0x7f59980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.315+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59a00840e0 con 0x7f59b8159ec0 2023-10-08T00:32:26.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.315+0000 7f59bce3e700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5998067320 0x7f59980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:26.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.315+0000 7f59bce3e700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5998067320 0x7f59980697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d30 tx=0x7f59b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:26.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.319+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59a004b5a0 con 0x7f59b8159ec0 2023-10-08T00:32:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:26.562+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f59b8063c90 con 0x7f59b8159ec0 2023-10-08T00:32:27.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.205+0000 7f59b4ff9700 1 -- 172.21.15.22:0/282377787 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 136+0+0 (secure 0 0 0) 0x7f59a0050d70 con 0x7f59b8159ec0 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5998067320 msgr2=0x7f59980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5998067320 0x7f59980697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d30 tx=0x7f59b0008040 comp rx=0 tx=0).stop 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 msgr2=0x7f59b809d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 0x7f59b809d230 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f59a000c7e0 tx=0x7f59a0007d90 comp rx=0 tx=0).stop 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 shutdown_connections 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59b8159ec0 0x7f59b809d230 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59b80b53d0 0x7f59b814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5998067320 0x7f59980697d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 --2- 172.21.15.22:0/282377787 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59b80cce40 0x7f59b809ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 >> 172.21.15.22:0/282377787 conn(0x7f59b80999f0 msgr2=0x7f59b8159240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:27.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 shutdown_connections 2023-10-08T00:32:27.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.208+0000 7f59bf0a2700 1 -- 172.21.15.22:0/282377787 wait complete. 2023-10-08T00:32:27.223 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:32:27.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.350+0000 7f91a5fe0700 1 Processor -- start 2023-10-08T00:32:27.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.350+0000 7f91a5fe0700 1 -- start start 2023-10-08T00:32:27.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f91a5fe0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 0x7f91a015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f91a5fe0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 0x7f91a00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f91a5fe0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a0069ee0 con 0x7f91a0159c60 2023-10-08T00:32:27.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f91a5fe0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a015a160 con 0x7f91a0159890 2023-10-08T00:32:27.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f91a5fe0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00d13a0 con 0x7f91a0069560 2023-10-08T00:32:27.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 0x7f91a00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 0x7f91a015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 0x7f91a015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:46034/0 (socket says 172.21.15.22:46034) 2023-10-08T00:32:27.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919f7fe700 1 -- 172.21.15.22:0/1226160209 learned_addr learned my addr 172.21.15.22:0/1226160209 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:27.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919effd700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f91a0159c60 0x7f91a015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:58888/0 (socket says 172.21.15.22:58888) 2023-10-08T00:32:27.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 0x7f91a00699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47034/0 (socket says 172.21.15.22:47034) 2023-10-08T00:32:27.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919ffff700 1 -- 172.21.15.22:0/1226160209 >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 msgr2=0x7f91a015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:27.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919ffff700 1 --2- 172.21.15.22:0/1226160209 >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 0x7f91a015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919ffff700 1 -- 172.21.15.22:0/1226160209 >> v1:172.21.15.192:6789/0 conn(0x7f91a0159c60 legacy=0x7f91a015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919e7fc700 1 -- 172.21.15.22:0/1226160209 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022939542 0 0) 0x7f91a0069ee0 con 0x7f91a0159c60 2023-10-08T00:32:27.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919ffff700 1 -- 172.21.15.22:0/1226160209 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a015e140 con 0x7f91a0069560 2023-10-08T00:32:27.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.351+0000 7f919f7fe700 1 --2- 172.21.15.22:0/1226160209 >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 0x7f91a015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:27.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f919ffff700 1 --2- 172.21.15.22:0/1226160209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 0x7f91a00699a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91980098e0 tx=0x7f91980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26363412c8512f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:27.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f919e7fc700 1 -- 172.21.15.22:0/1226160209 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800b640 con 0x7f91a0069560 2023-10-08T00:32:27.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f919e7fc700 1 -- 172.21.15.22:0/1226160209 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800b7a0 con 0x7f91a0069560 2023-10-08T00:32:27.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f919e7fc700 1 -- 172.21.15.22:0/1226160209 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800bb40 con 0x7f91a0069560 2023-10-08T00:32:27.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 -- 172.21.15.22:0/1226160209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 msgr2=0x7f91a00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/1226160209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 0x7f91a00699a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f91980098e0 tx=0x7f91980091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 -- 172.21.15.22:0/1226160209 shutdown_connections 2023-10-08T00:32:27.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/1226160209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0069560 0x7f91a00699a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/1226160209 >> v2:172.21.15.192:3300/0 conn(0x7f91a0159890 0x7f91a015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 -- 172.21.15.22:0/1226160209 >> 172.21.15.22:0/1226160209 conn(0x7f91a0068e20 msgr2=0x7f91a00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 -- 172.21.15.22:0/1226160209 shutdown_connections 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.352+0000 7f91a5fe0700 1 -- 172.21.15.22:0/1226160209 wait complete. 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 Processor -- start 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 -- start start 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 0x7f91a015d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a0159890 0x7f91a00b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0159c60 0x7f91a015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015c4f0 con 0x7f91a0069560 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015c7d0 con 0x7f91a0159890 2023-10-08T00:32:27.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f91a5fe0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015cab0 con 0x7f91a0159c60 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.354+0000 7f919f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 0x7f91a015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 0x7f91a015d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49974/0 (socket says 172.21.15.22:49974) 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 -- 172.21.15.22:0/4149772317 learned_addr learned my addr 172.21.15.22:0/4149772317 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919effd700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a0159890 0x7f91a00b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919ffff700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0159c60 0x7f91a015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 -- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0159c60 msgr2=0x7f91a015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0159c60 0x7f91a015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 -- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a0159890 msgr2=0x7f91a00b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a0159890 0x7f91a00b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 -- 172.21.15.22:0/4149772317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190009ae0 con 0x7f91a0069560 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f919f7fe700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 0x7f91a015d590 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f919000c170 tx=0x7f919000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:27.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000caa0 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919000f040 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9198009420 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919000ce30 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.355+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a015d070 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.356+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a015d3e0 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.357+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9190014690 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.357+0000 7f91977fe700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9180067320 0x7f91800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.357+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91900853f0 con 0x7f91a0069560 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.357+0000 7f919effd700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9180067320 0x7f91800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.362 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.358+0000 7f919effd700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9180067320 0x7f91800697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9188007fd0 tx=0x7f9188007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:27.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.361+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9190051f70 con 0x7f91a0069560 2023-10-08T00:32:27.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.587+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a015c940 con 0x7f9180067320 2023-10-08T00:32:27.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.589+0000 7f91977fe700 1 -- 172.21.15.22:0/4149772317 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f91a015c940 con 0x7f9180067320 2023-10-08T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:27.590 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:32:27.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9180067320 msgr2=0x7f91800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9180067320 0x7f91800697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9188007fd0 tx=0x7f9188007d50 comp rx=0 tx=0).stop 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 msgr2=0x7f91a015d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 0x7f91a015d590 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f919000c170 tx=0x7f919000b040 comp rx=0 tx=0).stop 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 shutdown_connections 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9180067320 0x7f91800697d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91a0159c60 0x7f91a015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91a0069560 0x7f91a015d590 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 --2- 172.21.15.22:0/4149772317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a0159890 0x7f91a00b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 >> 172.21.15.22:0/4149772317 conn(0x7f91a0068e20 msgr2=0x7f91a0157980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:27.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 shutdown_connections 2023-10-08T00:32:27.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.591+0000 7f91a5fe0700 1 -- 172.21.15.22:0/4149772317 wait complete. 2023-10-08T00:32:27.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:32:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.725+0000 7fd42059f700 1 Processor -- start 2023-10-08T00:32:27.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.725+0000 7fd42059f700 1 -- start start 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd42059f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd41806bcd0 0x7fd418140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd42059f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806c0a0 0x7fd418141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd42059f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4180c8e00 0x7fd4180c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd42059f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41815c2a0 con 0x7fd4180c8e00 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd42059f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41815b690 con 0x7fd41806bcd0 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd42059f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41815b970 con 0x7fd41806c0a0 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4180c8e00 0x7fd4180c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4180c8e00 0x7fd4180c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49984/0 (socket says 172.21.15.22:49984) 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 -- 172.21.15.22:0/19585012 learned_addr learned my addr 172.21.15.22:0/19585012 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41e33b700 1 --2- 172.21.15.22:0/19585012 >> v2:172.21.15.192:3300/0 conn(0x7fd41806bcd0 0x7fd418140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41db3a700 1 --2- 172.21.15.22:0/19585012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806c0a0 0x7fd418141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 -- 172.21.15.22:0/19585012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806c0a0 msgr2=0x7fd418141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 --2- 172.21.15.22:0/19585012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806c0a0 0x7fd418141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 -- 172.21.15.22:0/19585012 >> v2:172.21.15.192:3300/0 conn(0x7fd41806bcd0 msgr2=0x7fd418140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 --2- 172.21.15.22:0/19585012 >> v2:172.21.15.192:3300/0 conn(0x7fd41806bcd0 0x7fd418140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 -- 172.21.15.22:0/19585012 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41815bc50 con 0x7fd4180c8e00 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.726+0000 7fd41eb3c700 1 --2- 172.21.15.22:0/19585012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4180c8e00 0x7fd4180c9260 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd4180cafd0 tx=0x7fd410009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361726fc7ba53545 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd41d339700 1 -- 172.21.15.22:0/19585012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41000e070 con 0x7fd4180c8e00 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd41d339700 1 -- 172.21.15.22:0/19585012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41000b970 con 0x7fd4180c8e00 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd41d339700 1 -- 172.21.15.22:0/19585012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100092e0 con 0x7fd4180c8e00 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 -- 172.21.15.22:0/19585012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4180c8e00 msgr2=0x7fd4180c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 --2- 172.21.15.22:0/19585012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4180c8e00 0x7fd4180c9260 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd4180cafd0 tx=0x7fd410009840 comp rx=0 tx=0).stop 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 -- 172.21.15.22:0/19585012 shutdown_connections 2023-10-08T00:32:27.729 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 --2- 172.21.15.22:0/19585012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4180c8e00 0x7fd4180c9260 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 --2- 172.21.15.22:0/19585012 >> v2:172.21.15.192:3300/0 conn(0x7fd41806bcd0 0x7fd418140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 --2- 172.21.15.22:0/19585012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806c0a0 0x7fd418141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 -- 172.21.15.22:0/19585012 >> 172.21.15.22:0/19585012 conn(0x7fd4180ce600 msgr2=0x7fd4180cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:27.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 -- 172.21.15.22:0/19585012 shutdown_connections 2023-10-08T00:32:27.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.727+0000 7fd42059f700 1 -- 172.21.15.22:0/19585012 wait complete. 2023-10-08T00:32:27.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.728+0000 7fd42059f700 1 Processor -- start 2023-10-08T00:32:27.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.728+0000 7fd42059f700 1 -- start start 2023-10-08T00:32:27.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd42059f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806bcd0 0x7fd41813ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd42059f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 0x7fd4180b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd42059f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4180c8e00 0x7fd4180c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd42059f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41806a150 con 0x7fd41806c0a0 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd42059f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd418069540 con 0x7fd4180c8e00 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd42059f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd418069820 con 0x7fd41806bcd0 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 0x7fd4180b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 0x7fd4180b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49988/0 (socket says 172.21.15.22:49988) 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 -- 172.21.15.22:0/1554733248 learned_addr learned my addr 172.21.15.22:0/1554733248 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41e33b700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806bcd0 0x7fd41813ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41eb3c700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4180c8e00 0x7fd4180c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 -- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806bcd0 msgr2=0x7fd41813ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806bcd0 0x7fd41813ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 -- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4180c8e00 msgr2=0x7fd4180c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4180c8e00 0x7fd4180c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.729+0000 7fd41db3a700 1 -- 172.21.15.22:0/1554733248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410009ae0 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.730+0000 7fd41db3a700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 0x7fd4180b21f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd40800ec80 tx=0x7fd4080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.730+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40800c9d0 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.730+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40800cb30 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.730+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd418069b00 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.730+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408013470 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.730+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4180b2730 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.731+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41804c3c0 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.731+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd408013820 con 0x7fd41806c0a0 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.732+0000 7fd40e7fc700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd3fc067320 0x7fd3fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:27.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.732+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd408085060 con 0x7fd41806c0a0 2023-10-08T00:32:27.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.732+0000 7fd41e33b700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd3fc067320 0x7fd3fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:27.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.732+0000 7fd41e33b700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd3fc067320 0x7fd3fc0697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd414009d40 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:27.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.736+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd408051cf0 con 0x7fd41806c0a0 2023-10-08T00:32:27.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.930+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd41806c9d0 con 0x7fd41806c0a0 2023-10-08T00:32:27.930 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.930+0000 7fd40e7fc700 1 -- 172.21.15.22:0/1554733248 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd408055310 con 0x7fd41806c0a0 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd3fc067320 msgr2=0x7fd3fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd3fc067320 0x7fd3fc0697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd414009d40 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 msgr2=0x7fd4180b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 0x7fd4180b21f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd40800ec80 tx=0x7fd4080091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 shutdown_connections 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4180c8e00 0x7fd4180c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd3fc067320 0x7fd3fc0697d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd41806bcd0 0x7fd41813ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 --2- 172.21.15.22:0/1554733248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd41806c0a0 0x7fd4180b21f0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 >> 172.21.15.22:0/1554733248 conn(0x7fd4180ce600 msgr2=0x7fd4180c3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 shutdown_connections 2023-10-08T00:32:27.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:27.932+0000 7fd42059f700 1 -- 172.21.15.22:0/1554733248 wait complete. 2023-10-08T00:32:27.945 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:32:27.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:32:27.945 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:27.988 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:32:27.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:27.988 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:32:28.044 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:32:28.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:32:28.044 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:28.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:32:28.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:28.085 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:32:28.142 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:32:28.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:28.142 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T00:32:28.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:32:28.158 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T00:32:28.158 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:32:28.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:28.158 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T00:32:28.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:32:28.199 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T00:32:28.199 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000556960 --yes-i-really-mean-it 2023-10-08T00:32:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.321+0000 7f9fc3cce700 1 Processor -- start 2023-10-08T00:32:28.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.322+0000 7f9fc3cce700 1 -- start start 2023-10-08T00:32:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.322+0000 7f9fc3cce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9fbc159ec0 0x7f9fbc0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc3cce700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0b5b00 con 0x7f9fbc0cf350 2023-10-08T00:32:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc3cce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0b5850 con 0x7f9fbc0b53d0 2023-10-08T00:32:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc3cce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc0b5da0 con 0x7f9fbc159ec0 2023-10-08T00:32:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc226b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9fbc0cf350 0x7f9fbc0cd010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46012/0 (socket says 172.21.15.22:46012) 2023-10-08T00:32:28.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc226b700 1 -- 172.21.15.22:0/3712091813 learned_addr learned my addr 172.21.15.22:0/3712091813 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc1a6a700 1 --2- 172.21.15.22:0/3712091813 >> v2:172.21.15.192:3300/0 conn(0x7f9fbc159ec0 0x7f9fbc0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545903511 0 0) 0x7f9fbc0b5b00 con 0x7f9fbc0cf350 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fa8003570 con 0x7f9fbc0cf350 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255332797 0 0) 0x7f9fa8003570 con 0x7f9fbc0cf350 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 >> v2:172.21.15.192:3300/0 conn(0x7f9fbc159ec0 msgr2=0x7f9fbc0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 --2- 172.21.15.22:0/3712091813 >> v2:172.21.15.192:3300/0 conn(0x7f9fbc159ec0 0x7f9fbc0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 >> v1:172.21.15.192:6789/0 conn(0x7f9fbc0b53d0 legacy=0x7f9fbc0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0b6080 con 0x7f9fbc0cf350 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f9fb40017f0 con 0x7f9fbc0cf350 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 >> v1:172.21.15.22:6789/0 conn(0x7f9fbc0cf350 legacy=0x7f9fbc0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa8003a60 0x7f9fa8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fa8004810 0x7f9fa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa80051c0 0x7f9fa800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0b5da0 con 0x7f9fa80051c0 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa800c0d0 con 0x7f9fa8003a60 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.323+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa800c290 con 0x7f9fa8004810 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc1a6a700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa8003a60 0x7f9fa8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa80051c0 0x7f9fa800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc1269700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fa8004810 0x7f9fa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 -- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fa8004810 msgr2=0x7f9fa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fa8004810 0x7f9fa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 -- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa8003a60 msgr2=0x7f9fa8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa8003a60 0x7f9fa8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 -- 172.21.15.22:0/3712091813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8003570 con 0x7f9fa80051c0 2023-10-08T00:32:28.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc1269700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fa8004810 0x7f9fa8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 -- 172.21.15.22:0/3712091813 reap_dead start 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc226b700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa80051c0 0x7f9fa800ba60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400a930 tx=0x7f9fb40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35db08fd26eacaac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40070d0 con 0x7f9fa80051c0 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4007230 con 0x7f9fa80051c0 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.324+0000 7f9fc0a68700 1 -- 172.21.15.22:0/3712091813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40075d0 con 0x7f9fa80051c0 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3712091813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa80051c0 msgr2=0x7f9fa800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa80051c0 0x7f9fa800ba60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400a930 tx=0x7f9fb40021d0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3712091813 shutdown_connections 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3712091813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fa80051c0 0x7f9fa800ba60 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3712091813 >> 172.21.15.22:0/3712091813 conn(0x7f9fbc0999f0 msgr2=0x7f9fbc0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3712091813 shutdown_connections 2023-10-08T00:32:28.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.325+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3712091813 wait complete. 2023-10-08T00:32:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.326+0000 7f9fc3cce700 1 Processor -- start 2023-10-08T00:32:28.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.326+0000 7f9fc3cce700 1 -- start start 2023-10-08T00:32:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.326+0000 7f9fc3cce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa80051c0 0x7f9fbc150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.326+0000 7f9fc3cce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 0x7f9fbc06a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc3cce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fbc06a800 0x7f9fbc169760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc3cce700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc06aca0 con 0x7f9fbc155130 2023-10-08T00:32:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc3cce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc152c80 con 0x7f9fa80051c0 2023-10-08T00:32:28.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc3cce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc069690 con 0x7f9fbc06a800 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 0x7f9fbc06a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 0x7f9fbc06a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49996/0 (socket says 172.21.15.22:49996) 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 -- 172.21.15.22:0/3963778297 learned_addr learned my addr 172.21.15.22:0/3963778297 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1a6a700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa80051c0 0x7f9fbc150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc226b700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fbc06a800 0x7f9fbc169760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 -- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fbc06a800 msgr2=0x7f9fbc169760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fbc06a800 0x7f9fbc169760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 -- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa80051c0 msgr2=0x7f9fbc150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa80051c0 0x7f9fbc150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:28.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 -- 172.21.15.22:0/3963778297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0690d0 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1a6a700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa80051c0 0x7f9fbc150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc1269700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 0x7f9fbc06a2c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00e580 tx=0x7f9fac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac011460 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac010040 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fbc0693b0 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0117d0 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.327+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc151740 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.329+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc152ad0 con 0x7f9fbc155130 2023-10-08T00:32:28.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.329+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9fac011b40 con 0x7f9fbc155130 2023-10-08T00:32:28.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.329+0000 7f9fb1ffb700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9fa0067320 0x7f9fa00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:28.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.329+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9fac083fa0 con 0x7f9fbc155130 2023-10-08T00:32:28.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.329+0000 7f9fc1a6a700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9fa0067320 0x7f9fa00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:28.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.330+0000 7f9fc1a6a700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9fa0067320 0x7f9fa00697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80090f0 tx=0x7f9fb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:28.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.334+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fac04d5a0 con 0x7f9fbc155130 2023-10-08T00:32:28.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:28.558+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000556960", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9fbc063c90 con 0x7f9fa0067320 2023-10-08T00:32:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.227+0000 7f9fb1ffb700 1 -- 172.21.15.22:0/3963778297 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7f9fbc063c90 con 0x7f9fa0067320 2023-10-08T00:32:31.228 INFO:teuthology.orchestra.run.smithi022.stdout:FS volume 'cephfs' renamed to 'volume_0000000000556960' 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9fa0067320 msgr2=0x7f9fa00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9fa0067320 0x7f9fa00697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80090f0 tx=0x7f9fb8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 msgr2=0x7f9fbc06a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 0x7f9fbc06a2c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00e580 tx=0x7f9fac009040 comp rx=0 tx=0).stop 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 shutdown_connections 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9fa0067320 0x7f9fa00697d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9fbc06a800 0x7f9fbc169760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fa80051c0 0x7f9fbc150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 --2- 172.21.15.22:0/3963778297 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9fbc155130 0x7f9fbc06a2c0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 >> 172.21.15.22:0/3963778297 conn(0x7f9fbc0999f0 msgr2=0x7f9fbc151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 shutdown_connections 2023-10-08T00:32:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.229+0000 7f9fc3cce700 1 -- 172.21.15.22:0/3963778297 wait complete. 2023-10-08T00:32:31.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:32:31.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.372+0000 7f026c0eb700 1 Processor -- start 2023-10-08T00:32:31.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.372+0000 7f026c0eb700 1 -- start start 2023-10-08T00:32:31.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f026c0eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f026415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f026c0eb700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026415a160 con 0x7f0264159890 2023-10-08T00:32:31.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f026c0eb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02640d13a0 con 0x7f026415db10 2023-10-08T00:32:31.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f026c0eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026415e140 con 0x7f0264159c60 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f0269e87700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0264159890 0x7f026415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46028/0 (socket says 172.21.15.22:46028) 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f0269e87700 1 -- 172.21.15.22:0/3398224474 learned_addr learned my addr 172.21.15.22:0/3398224474 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.373+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941099643 0 0) 0x7f026415a160 con 0x7f0264159890 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269686700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f026415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f024c003570 con 0x7f0264159890 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2692782223 0 0) 0x7f024c003570 con 0x7f0264159890 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 msgr2=0x7f026415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f026415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 >> v1:172.21.15.192:6789/0 conn(0x7f026415db10 legacy=0x7f0264069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026415a3d0 con 0x7f0264159890 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f02540017f0 con 0x7f0264159890 2023-10-08T00:32:31.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 >> v1:172.21.15.22:6789/0 conn(0x7f0264159890 legacy=0x7f026415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f024c003a90 0x7f024c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c004810 0x7f024c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f024c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026415e140 con 0x7f024c003a90 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c00bb60 con 0x7f024c004810 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c00bd20 con 0x7f0264159c60 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f024c003a90 0x7f024c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269686700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c004810 0x7f024c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f026a688700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f024c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 -- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 msgr2=0x7f024c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f024c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 -- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c004810 msgr2=0x7f024c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c004810 0x7f024c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 -- 172.21.15.22:0/3398224474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c003570 con 0x7f024c003a90 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f026a688700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0264159c60 0x7f024c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.374+0000 7f0269e87700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f024c003a90 0x7f024c003ea0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f025400a930 tx=0x7f02540021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1b1f0a56bc153d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540070d0 con 0x7f024c003a90 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254007230 con 0x7f024c003a90 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f0268e85700 1 -- 172.21.15.22:0/3398224474 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540075d0 con 0x7f024c003a90 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026c0eb700 1 -- 172.21.15.22:0/3398224474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f024c003a90 msgr2=0x7f024c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026c0eb700 1 --2- 172.21.15.22:0/3398224474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f024c003a90 0x7f024c003ea0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f025400a930 tx=0x7f02540021d0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026a688700 1 -- 172.21.15.22:0/3398224474 reap_dead start 2023-10-08T00:32:31.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026c0eb700 1 -- 172.21.15.22:0/3398224474 shutdown_connections 2023-10-08T00:32:31.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026c0eb700 1 -- 172.21.15.22:0/3398224474 >> 172.21.15.22:0/3398224474 conn(0x7f0264068e20 msgr2=0x7f02640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:31.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026c0eb700 1 -- 172.21.15.22:0/3398224474 shutdown_connections 2023-10-08T00:32:31.380 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.375+0000 7f026c0eb700 1 -- 172.21.15.22:0/3398224474 wait complete. 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.376+0000 7f026c0eb700 1 Processor -- start 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.376+0000 7f026c0eb700 1 -- start start 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026c0eb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c003a90 0x7f0264158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026c0eb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 0x7f02640ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026c0eb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02640b5c40 0x7f02640b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026c0eb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640c8f50 con 0x7f02640b46c0 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026c0eb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02640b57b0 con 0x7f024c003a90 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026c0eb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02640b4ba0 con 0x7f02640b5c40 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 0x7f02640ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 0x7f02640ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50020/0 (socket says 172.21.15.22:50020) 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 -- 172.21.15.22:0/1026780993 learned_addr learned my addr 172.21.15.22:0/1026780993 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269e87700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c003a90 0x7f0264158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f026a688700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02640b5c40 0x7f02640b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 -- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02640b5c40 msgr2=0x7f02640b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02640b5c40 0x7f02640b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 -- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c003a90 msgr2=0x7f0264158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c003a90 0x7f0264158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269686700 1 -- 172.21.15.22:0/1026780993 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02640b4e80 con 0x7f02640b46c0 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.377+0000 7f0269e87700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c003a90 0x7f0264158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.378+0000 7f0269686700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 0x7f02640ca4f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f02580119c0 tx=0x7f0258008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.378+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800f6d0 con 0x7f02640b46c0 2023-10-08T00:32:31.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.378+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025800f830 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.378+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02640b5160 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.378+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800fbf0 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.378+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0264158cb0 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.379+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02640b5940 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.380+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0258015460 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.380+0000 7f0261ffb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0250067320 0x7f02500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.380+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f0258084ea0 con 0x7f02640b46c0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.380+0000 7f0269e87700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0250067320 0x7f02500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.381+0000 7f0269e87700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0250067320 0x7f02500697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f025400a3f0 tx=0x7f0254016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:31.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.384+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0258051ae0 con 0x7f02640b46c0 2023-10-08T00:32:31.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.608+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f026404c3c0 con 0x7f0250067320 2023-10-08T00:32:31.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.610+0000 7f0261ffb700 1 -- 172.21.15.22:0/1026780993 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f026404c3c0 con 0x7f0250067320 2023-10-08T00:32:31.610 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:32:31.611 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:31.611 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volume_0000000000556960" 2023-10-08T00:32:31.611 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:31.611 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:32:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0250067320 msgr2=0x7f02500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0250067320 0x7f02500697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f025400a3f0 tx=0x7f0254016000 comp rx=0 tx=0).stop 2023-10-08T00:32:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 msgr2=0x7f02640ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 0x7f02640ca4f0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f02580119c0 tx=0x7f0258008040 comp rx=0 tx=0).stop 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 shutdown_connections 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0250067320 0x7f02500697d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02640b5c40 0x7f02640b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f024c003a90 0x7f0264158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 --2- 172.21.15.22:0/1026780993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02640b46c0 0x7f02640ca4f0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 >> 172.21.15.22:0/1026780993 conn(0x7f0264068e20 msgr2=0x7f02640c6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 shutdown_connections 2023-10-08T00:32:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.612+0000 7f026c0eb700 1 -- 172.21.15.22:0/1026780993 wait complete. 2023-10-08T00:32:31.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:31.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.744+0000 7f561ab3f700 1 Processor -- start 2023-10-08T00:32:31.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.744+0000 7f561ab3f700 1 -- start start 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.744+0000 7f561ab3f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 0x7f561415b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.744+0000 7f561ab3f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f56140b5ea0 0x7f5614068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f561ab3f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561415c480 con 0x7f5614068bb0 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f561ab3f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140b2a40 con 0x7f56140b5ea0 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f561ab3f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561415b5d0 con 0x7f5614159c10 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f56188db700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 0x7f561415b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f5613fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f56140b5ea0 0x7f5614068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f56188db700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 0x7f561415b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47118/0 (socket says 172.21.15.22:47118) 2023-10-08T00:32:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f56188db700 1 -- 172.21.15.22:0/2761240833 learned_addr learned my addr 172.21.15.22:0/2761240833 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f5613fff700 1 --2- 172.21.15.22:0/2761240833 >> v2:172.21.15.192:3300/0 conn(0x7f56140b5ea0 0x7f5614068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:46112/0 (socket says 172.21.15.22:46112) 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f56190dc700 1 --1- 172.21.15.22:0/2761240833 >> v1:172.21.15.192:6789/0 conn(0x7f5614068bb0 0x7f561415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:58906/0 (socket says 172.21.15.22:58906) 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f5613fff700 1 -- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 msgr2=0x7f561415b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f5613fff700 1 --2- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 0x7f561415b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f5613fff700 1 -- 172.21.15.22:0/2761240833 >> v1:172.21.15.192:6789/0 conn(0x7f5614068bb0 legacy=0x7f561415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f56137fe700 1 -- 172.21.15.22:0/2761240833 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273514172 0 0) 0x7f561415c480 con 0x7f5614068bb0 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f5613fff700 1 -- 172.21.15.22:0/2761240833 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561415b870 con 0x7f56140b5ea0 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.745+0000 7f56188db700 1 --2- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 0x7f561415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f5613fff700 1 --2- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56140b5ea0 0x7f5614068670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5604009e60 tx=0x7f5604009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d50dbc1f9d3feaa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f56137fe700 1 -- 172.21.15.22:0/2761240833 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400e070 con 0x7f56140b5ea0 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f56137fe700 1 -- 172.21.15.22:0/2761240833 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400bb60 con 0x7f56140b5ea0 2023-10-08T00:32:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f56137fe700 1 -- 172.21.15.22:0/2761240833 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604012430 con 0x7f56140b5ea0 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 -- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56140b5ea0 msgr2=0x7f5614068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 --2- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56140b5ea0 0x7f5614068670 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5604009e60 tx=0x7f5604009780 comp rx=0 tx=0).stop 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 -- 172.21.15.22:0/2761240833 shutdown_connections 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 --2- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5614159c10 0x7f561415b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 --2- 172.21.15.22:0/2761240833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56140b5ea0 0x7f5614068670 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 -- 172.21.15.22:0/2761240833 >> 172.21.15.22:0/2761240833 conn(0x7f5614099a20 msgr2=0x7f56140af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 -- 172.21.15.22:0/2761240833 shutdown_connections 2023-10-08T00:32:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.746+0000 7f561ab3f700 1 -- 172.21.15.22:0/2761240833 wait complete. 2023-10-08T00:32:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.747+0000 7f561ab3f700 1 Processor -- start 2023-10-08T00:32:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 -- start start 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5614068bb0 0x7f561414c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56140b5ea0 0x7f56140c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 0x7f561414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140c6eb0 con 0x7f5614159c10 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140c7150 con 0x7f5614068bb0 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f561ab3f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140c7430 con 0x7f56140b5ea0 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f56190dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 0x7f561414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f56190dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 0x7f561414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50030/0 (socket says 172.21.15.22:50030) 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.748+0000 7f56190dc700 1 -- 172.21.15.22:0/1644620916 learned_addr learned my addr 172.21.15.22:0/1644620916 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f5613fff700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56140b5ea0 0x7f56140c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56188db700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5614068bb0 0x7f561414c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56190dc700 1 -- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56140b5ea0 msgr2=0x7f56140c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56190dc700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56140b5ea0 0x7f56140c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56190dc700 1 -- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5614068bb0 msgr2=0x7f561414c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56190dc700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5614068bb0 0x7f561414c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56190dc700 1 -- 172.21.15.22:0/1644620916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0094f0 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f56190dc700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 0x7f561414ca80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f560c001eb0 tx=0x7f560c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c005a70 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c005bf0 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5604009a20 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0070d0 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.749+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56140c79f0 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.750+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561404c3c0 con 0x7f5614159c10 2023-10-08T00:32:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.750+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f560c0074c0 con 0x7f5614159c10 2023-10-08T00:32:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.751+0000 7f5610ff9700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f55f4067320 0x7f55f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.751+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f560c084030 con 0x7f5614159c10 2023-10-08T00:32:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.751+0000 7f56188db700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f55f4067320 0x7f55f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.752+0000 7f56188db700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f55f4067320 0x7f55f40697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f55fc006d20 tx=0x7f55fc009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.755+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f560c050c70 con 0x7f5614159c10 2023-10-08T00:32:31.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:32:31.937 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:32:31.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.994+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56140c7be0 con 0x7f5614159c10 2023-10-08T00:32:31.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.995+0000 7f5610ff9700 1 -- 172.21.15.22:0/1644620916 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4624 (secure 0 0 0) 0x7f560c017020 con 0x7f5614159c10 2023-10-08T00:32:31.995 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:31.995 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:29.205783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000556960","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f55f4067320 msgr2=0x7f55f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f55f4067320 0x7f55f40697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f55fc006d20 tx=0x7f55fc009250 comp rx=0 tx=0).stop 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 msgr2=0x7f561414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 0x7f561414ca80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f560c001eb0 tx=0x7f560c007d10 comp rx=0 tx=0).stop 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 shutdown_connections 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5614159c10 0x7f561414ca80 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5614068bb0 0x7f561414c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f55f4067320 0x7f55f40697d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 --2- 172.21.15.22:0/1644620916 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f56140b5ea0 0x7f56140c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:31.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 >> 172.21.15.22:0/1644620916 conn(0x7f5614099a20 msgr2=0x7f561409a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:31.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 shutdown_connections 2023-10-08T00:32:31.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:31.997+0000 7f561ab3f700 1 -- 172.21.15.22:0/1644620916 wait complete. 2023-10-08T00:32:31.999 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 98 2023-10-08T00:32:32.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:32.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.169+0000 7f3cff9bf700 1 Processor -- start 2023-10-08T00:32:32.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.169+0000 7f3cff9bf700 1 -- start start 2023-10-08T00:32:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cff9bf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cf806bcd0 0x7f3cf80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cff9bf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3cf806c0a0 0x7f3cf815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cff9bf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf815d7e0 con 0x7f3cf815df50 2023-10-08T00:32:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cff9bf700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf815dac0 con 0x7f3cf806c0a0 2023-10-08T00:32:32.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cff9bf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf815aa30 con 0x7f3cf806bcd0 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cfcf5a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3cf806c0a0 0x7f3cf815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cfcf5a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3cf806c0a0 0x7f3cf815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50038/0 (socket says 172.21.15.22:50038) 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.170+0000 7f3cfcf5a700 1 -- 172.21.15.22:0/3288936401 learned_addr learned my addr 172.21.15.22:0/3288936401 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfd75b700 1 --2- 172.21.15.22:0/3288936401 >> v2:172.21.15.192:3300/0 conn(0x7f3cf806bcd0 0x7f3cf80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfcf5a700 1 -- 172.21.15.22:0/3288936401 >> v2:172.21.15.192:3300/0 conn(0x7f3cf806bcd0 msgr2=0x7f3cf80caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfcf5a700 1 --2- 172.21.15.22:0/3288936401 >> v2:172.21.15.192:3300/0 conn(0x7f3cf806bcd0 0x7f3cf80caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfcf5a700 1 -- 172.21.15.22:0/3288936401 >> v1:172.21.15.192:6789/0 conn(0x7f3cf815df50 legacy=0x7f3cf80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfcf5a700 1 -- 172.21.15.22:0/3288936401 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf815ad10 con 0x7f3cf806c0a0 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfd75b700 1 --2- 172.21.15.22:0/3288936401 >> v2:172.21.15.192:3300/0 conn(0x7f3cf806bcd0 0x7f3cf80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3cfcf5a700 1 --2- 172.21.15.22:0/3288936401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806c0a0 0x7f3cf815a1e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80691a0 tx=0x7f3ce8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d9d314dffb7981 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3ceffff700 1 -- 172.21.15.22:0/3288936401 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800b820 con 0x7f3cf806c0a0 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3ceffff700 1 -- 172.21.15.22:0/3288936401 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce800b980 con 0x7f3cf806c0a0 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.171+0000 7f3ceffff700 1 -- 172.21.15.22:0/3288936401 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800bd40 con 0x7f3cf806c0a0 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3288936401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806c0a0 msgr2=0x7f3cf815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3288936401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806c0a0 0x7f3cf815a1e0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80691a0 tx=0x7f3ce8009250 comp rx=0 tx=0).stop 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3288936401 shutdown_connections 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3288936401 >> v2:172.21.15.192:3300/0 conn(0x7f3cf806bcd0 0x7f3cf80caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3288936401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806c0a0 0x7f3cf815a1e0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3288936401 >> 172.21.15.22:0/3288936401 conn(0x7f3cf80ce600 msgr2=0x7f3cf80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3288936401 shutdown_connections 2023-10-08T00:32:32.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.172+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3288936401 wait complete. 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.173+0000 7f3cff9bf700 1 Processor -- start 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.173+0000 7f3cff9bf700 1 -- start start 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 0x7f3cf8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf806c0a0 0x7f3cf816a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf815df50 0x7f3cf80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80b2ee0 con 0x7f3cf806bcd0 2023-10-08T00:32:32.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf816a370 con 0x7f3cf806c0a0 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8169d40 con 0x7f3cf815df50 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 0x7f3cf8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 0x7f3cf8152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50048/0 (socket says 172.21.15.22:50048) 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 -- 172.21.15.22:0/3628736342 learned_addr learned my addr 172.21.15.22:0/3628736342 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfdf5c700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf815df50 0x7f3cf80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfcf5a700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf806c0a0 0x7f3cf816a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 -- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf815df50 msgr2=0x7f3cf80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf815df50 0x7f3cf80b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 -- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf806c0a0 msgr2=0x7f3cf816a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf806c0a0 0x7f3cf816a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 -- 172.21.15.22:0/3628736342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80094f0 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfcf5a700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf806c0a0 0x7f3cf816a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cfd75b700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 0x7f3cf8152d10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400c850 tx=0x7f3cf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011600 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4011760 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf80b3110 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4011b00 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.174+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf816a000 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.176+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf804c3c0 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.176+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3cf40073b0 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.176+0000 7f3ced7fa700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cdc067320 0x7f3cdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.176+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f3cf4084d20 con 0x7f3cf806bcd0 2023-10-08T00:32:32.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.177+0000 7f3cfcf5a700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cdc067320 0x7f3cdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.177+0000 7f3cfcf5a700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cdc067320 0x7f3cdc0697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80691a0 tx=0x7f3ce8016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.181+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cf40552e0 con 0x7f3cf806bcd0 2023-10-08T00:32:32.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.377+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cf815aff0 con 0x7f3cf806bcd0 2023-10-08T00:32:32.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.378+0000 7f3ced7fa700 1 -- 172.21.15.22:0/3628736342 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f3cf401e090 con 0x7f3cf806bcd0 2023-10-08T00:32:32.380 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:32.380 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":144,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:31.217847+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000556960.meta","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000556960"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000556960.data","create_time":"2023-10-08T00:32:16.504058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000556960"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cdc067320 msgr2=0x7f3cdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cdc067320 0x7f3cdc0697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80691a0 tx=0x7f3ce8016000 comp rx=0 tx=0).stop 2023-10-08T00:32:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 msgr2=0x7f3cf8152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 0x7f3cf8152d10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400c850 tx=0x7f3cf4008040 comp rx=0 tx=0).stop 2023-10-08T00:32:32.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 shutdown_connections 2023-10-08T00:32:32.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cdc067320 0x7f3cdc0697d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf815df50 0x7f3cf80b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf806bcd0 0x7f3cf8152d10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 --2- 172.21.15.22:0/3628736342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf806c0a0 0x7f3cf816a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 >> 172.21.15.22:0/3628736342 conn(0x7f3cf80ce600 msgr2=0x7f3cf8156130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:32.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 shutdown_connections 2023-10-08T00:32:32.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.380+0000 7f3cff9bf700 1 -- 172.21.15.22:0/3628736342 wait complete. 2023-10-08T00:32:32.393 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:32:32.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:32.438 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:32.478 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:32:32.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:32.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.596+0000 7f43e4856700 1 Processor -- start 2023-10-08T00:32:32.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.597+0000 7f43e4856700 1 -- start start 2023-10-08T00:32:32.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.597+0000 7f43e4856700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43e0159890 0x7f43e015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.597+0000 7f43e4856700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f43e0069560 0x7f43e00699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.597+0000 7f43e4856700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e0069ee0 con 0x7f43e0159c60 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.597+0000 7f43e4856700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e015a160 con 0x7f43e0069560 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43e4856700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e00d13a0 con 0x7f43e0159890 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ded9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f43e0069560 0x7f43e00699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ddd9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f43e0159c60 0x7f43e015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46042/0 (socket says 172.21.15.22:46042) 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ddd9b700 1 -- 172.21.15.22:0/3425436006 learned_addr learned my addr 172.21.15.22:0/3425436006 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43de59c700 1 --2- 172.21.15.22:0/3425436006 >> v2:172.21.15.192:3300/0 conn(0x7f43e0159890 0x7f43e015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ded9d700 1 -- 172.21.15.22:0/3425436006 >> v2:172.21.15.192:3300/0 conn(0x7f43e0159890 msgr2=0x7f43e015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ded9d700 1 --2- 172.21.15.22:0/3425436006 >> v2:172.21.15.192:3300/0 conn(0x7f43e0159890 0x7f43e015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ded9d700 1 -- 172.21.15.22:0/3425436006 >> v1:172.21.15.22:6789/0 conn(0x7f43e0159c60 legacy=0x7f43e015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ded9d700 1 -- 172.21.15.22:0/3425436006 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e015e140 con 0x7f43e0069560 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43dd59a700 1 -- 172.21.15.22:0/3425436006 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997781228 0 0) 0x7f43e0069ee0 con 0x7f43e0159c60 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43ded9d700 1 --2- 172.21.15.22:0/3425436006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00699a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f43e00d1090 tx=0x7f43d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b6823d1568cff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43dd59a700 1 -- 172.21.15.22:0/3425436006 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d000e070 con 0x7f43e0069560 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43dd59a700 1 -- 172.21.15.22:0/3425436006 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d000bc30 con 0x7f43e0069560 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.598+0000 7f43dd59a700 1 -- 172.21.15.22:0/3425436006 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d0012430 con 0x7f43e0069560 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 -- 172.21.15.22:0/3425436006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 msgr2=0x7f43e00699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 --2- 172.21.15.22:0/3425436006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00699a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f43e00d1090 tx=0x7f43d0009780 comp rx=0 tx=0).stop 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 -- 172.21.15.22:0/3425436006 shutdown_connections 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 --2- 172.21.15.22:0/3425436006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00699a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 --2- 172.21.15.22:0/3425436006 >> v2:172.21.15.192:3300/0 conn(0x7f43e0159890 0x7f43e015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 -- 172.21.15.22:0/3425436006 >> 172.21.15.22:0/3425436006 conn(0x7f43e0068e20 msgr2=0x7f43e00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:32.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 -- 172.21.15.22:0/3425436006 shutdown_connections 2023-10-08T00:32:32.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.599+0000 7f43e4856700 1 -- 172.21.15.22:0/3425436006 wait complete. 2023-10-08T00:32:32.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.600+0000 7f43e4856700 1 Processor -- start 2023-10-08T00:32:32.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.600+0000 7f43e4856700 1 -- start start 2023-10-08T00:32:32.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43e4856700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43e4856700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43e0159890 0x7f43e016d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43e4856700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e0159c60 0x7f43e00b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43e4856700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015b600 con 0x7f43e0069560 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43e4856700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e016df30 con 0x7f43e0159c60 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43e4856700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e00b2030 con 0x7f43e0159890 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50066/0 (socket says 172.21.15.22:50066) 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 -- 172.21.15.22:0/1418282453 learned_addr learned my addr 172.21.15.22:0/1418282453 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43ded9d700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e0159c60 0x7f43e00b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43ddd9b700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43e0159890 0x7f43e016d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 -- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43e0159890 msgr2=0x7f43e016d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43e0159890 0x7f43e016d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 -- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e0159c60 msgr2=0x7f43e00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e0159c60 0x7f43e00b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 -- 172.21.15.22:0/1418282453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0009a20 con 0x7f43e0069560 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43ddd9b700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43e0159890 0x7f43e016d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.601+0000 7f43de59c700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00b3590 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f43d800d890 tx=0x7f43d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.602+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80125f0 con 0x7f43e0069560 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.602+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d8012750 con 0x7f43e0069560 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.602+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e016d690 con 0x7f43e0069560 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.602+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8012ad0 con 0x7f43e0069560 2023-10-08T00:32:32.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.602+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e016dc50 con 0x7f43e0069560 2023-10-08T00:32:32.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.602+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e004c3c0 con 0x7f43e0069560 2023-10-08T00:32:32.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.603+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f43d801e460 con 0x7f43e0069560 2023-10-08T00:32:32.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.603+0000 7f43d67fc700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f43c0067320 0x7f43c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.604+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f43d80852e0 con 0x7f43e0069560 2023-10-08T00:32:32.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.604+0000 7f43ddd9b700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f43c0067320 0x7f43c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.604+0000 7f43ddd9b700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f43c0067320 0x7f43c00697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f43c8001890 tx=0x7f43c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.608+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43d8051f20 con 0x7f43e0069560 2023-10-08T00:32:32.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.845+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43e015da40 con 0x7f43e0069560 2023-10-08T00:32:32.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.846+0000 7f43d67fc700 1 -- 172.21.15.22:0/1418282453 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4624 (secure 0 0 0) 0x7f43d8055540 con 0x7f43e0069560 2023-10-08T00:32:32.846 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:32.846 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:29.205783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000556960","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:32.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f43c0067320 msgr2=0x7f43c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f43c0067320 0x7f43c00697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f43c8001890 tx=0x7f43c8009040 comp rx=0 tx=0).stop 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 msgr2=0x7f43e00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00b3590 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f43d800d890 tx=0x7f43d8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 shutdown_connections 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e0159c60 0x7f43e00b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43e0069560 0x7f43e00b3590 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f43c0067320 0x7f43c00697d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 --2- 172.21.15.22:0/1418282453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f43e0159890 0x7f43e016d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 >> 172.21.15.22:0/1418282453 conn(0x7f43e0068e20 msgr2=0x7f43e0070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 shutdown_connections 2023-10-08T00:32:32.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.848+0000 7f43e4856700 1 -- 172.21.15.22:0/1418282453 wait complete. 2023-10-08T00:32:32.850 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 98 2023-10-08T00:32:32.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:32.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.980+0000 7fd7ff40f700 1 Processor -- start 2023-10-08T00:32:32.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.980+0000 7fd7ff40f700 1 -- start start 2023-10-08T00:32:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7ff40f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7ff40f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7f8069560 0x7fd7f80699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7ff40f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f815a160 con 0x7fd7f8159c60 2023-10-08T00:32:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7ff40f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f8069f20 con 0x7fd7f8069560 2023-10-08T00:32:32.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7ff40f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80d13a0 con 0x7fd7f8159890 2023-10-08T00:32:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd9ac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7f8069560 0x7fd7f80699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd1ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd1ab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:47174/0 (socket says 172.21.15.22:47174) 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fc9aa700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd7f8159c60 0x7fd7f815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:58924/0 (socket says 172.21.15.22:58924) 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd9ac700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7f8069560 0x7fd7f80699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:46174/0 (socket says 172.21.15.22:46174) 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd1ab700 1 -- 172.21.15.22:0/2982415437 learned_addr learned my addr 172.21.15.22:0/2982415437 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd9ac700 1 -- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 msgr2=0x7fd7f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd9ac700 1 --2- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd9ac700 1 -- 172.21.15.22:0/2982415437 >> v1:172.21.15.192:6789/0 conn(0x7fd7f8159c60 legacy=0x7fd7f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7f7fff700 1 -- 172.21.15.22:0/2982415437 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284519553 0 0) 0x7fd7f815a160 con 0x7fd7f8159c60 2023-10-08T00:32:32.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.981+0000 7fd7fd9ac700 1 -- 172.21.15.22:0/2982415437 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f815e140 con 0x7fd7f8069560 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7fd9ac700 1 --2- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8069560 0x7fd7f80699e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00098e0 tx=0x7fd7f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67ac076cffe012 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7f7fff700 1 -- 172.21.15.22:0/2982415437 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000b640 con 0x7fd7f8069560 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7f7fff700 1 -- 172.21.15.22:0/2982415437 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000b7a0 con 0x7fd7f8069560 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7f7fff700 1 -- 172.21.15.22:0/2982415437 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000bb40 con 0x7fd7f8069560 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 -- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8069560 msgr2=0x7fd7f80699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8069560 0x7fd7f80699e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00098e0 tx=0x7fd7f00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 -- 172.21.15.22:0/2982415437 shutdown_connections 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8069560 0x7fd7f80699e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/2982415437 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 -- 172.21.15.22:0/2982415437 >> 172.21.15.22:0/2982415437 conn(0x7fd7f8068e20 msgr2=0x7fd7f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:32.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.982+0000 7fd7ff40f700 1 -- 172.21.15.22:0/2982415437 shutdown_connections 2023-10-08T00:32:32.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.983+0000 7fd7ff40f700 1 -- 172.21.15.22:0/2982415437 wait complete. 2023-10-08T00:32:32.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 Processor -- start 2023-10-08T00:32:32.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 -- start start 2023-10-08T00:32:32.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 0x7fd7f80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f80b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8159c60 0x7fd7f80b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f815d420 con 0x7fd7f8069560 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f815c380 con 0x7fd7f8159c60 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.984+0000 7fd7ff40f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f815c660 con 0x7fd7f8159890 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 0x7fd7f80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 0x7fd7f80c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50070/0 (socket says 172.21.15.22:50070) 2023-10-08T00:32:32.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 -- 172.21.15.22:0/4041923453 learned_addr learned my addr 172.21.15.22:0/4041923453 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd9ac700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8159c60 0x7fd7f80b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fc9aa700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f80b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 -- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 msgr2=0x7fd7f80b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f80b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 -- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8159c60 msgr2=0x7fd7f80b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8159c60 0x7fd7f80b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 -- 172.21.15.22:0/4041923453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0009420 con 0x7fd7f8069560 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7fd1ab700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 0x7fd7f80c6960 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009ed0 tx=0x7fd7e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800c960 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e800f040 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f815c940 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800ccd0 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.985+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f815cf00 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.986+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f815d0f0 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.987+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd7e8014690 con 0x7fd7f8069560 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.987+0000 7fd7f57fa700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067350 0x7fd7e4069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:32.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.987+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd7e8085270 con 0x7fd7f8069560 2023-10-08T00:32:32.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.988+0000 7fd7fc9aa700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067350 0x7fd7e4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:32.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.988+0000 7fd7fc9aa700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067350 0x7fd7e4069800 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd7f815bbc0 tx=0x7fd7ec007ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:32.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:32.992+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e8051da0 con 0x7fd7f8069560 2023-10-08T00:32:33.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.186+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7f804c3c0 con 0x7fd7f8069560 2023-10-08T00:32:33.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.187+0000 7fd7f57fa700 1 -- 172.21.15.22:0/4041923453 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+15442 (secure 0 0 0) 0x7fd7e80553c0 con 0x7fd7f8069560 2023-10-08T00:32:33.188 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:33.188 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":144,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:31.217847+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000556960.meta","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000556960"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000556960.data","create_time":"2023-10-08T00:32:16.504058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000556960"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:33.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.189+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067350 msgr2=0x7fd7e4069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.189+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067350 0x7fd7e4069800 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd7f815bbc0 tx=0x7fd7ec007ef0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.189+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 msgr2=0x7fd7f80c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.189+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 0x7fd7f80c6960 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009ed0 tx=0x7fd7e800b040 comp rx=0 tx=0).stop 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 shutdown_connections 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7f8159c60 0x7fd7f80b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f8069560 0x7fd7f80c6960 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7e4067350 0x7fd7e4069800 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 --2- 172.21.15.22:0/4041923453 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd7f8159890 0x7fd7f80b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 >> 172.21.15.22:0/4041923453 conn(0x7fd7f8068e20 msgr2=0x7fd7f8155100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 shutdown_connections 2023-10-08T00:32:33.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.190+0000 7fd7ff40f700 1 -- 172.21.15.22:0/4041923453 wait complete. 2023-10-08T00:32:33.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs.volume_0000000000556960.meta', 'create_time': '2023-10-08T00:32:15.944112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000556960'}}}, {'pool': 25, 'pool_name': 'cephfs.volume_0000000000556960.data', 'create_time': '2023-10-08T00:32:16.504058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000556960'}}}] 2023-10-08T00:32:33.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:32:33.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.325+0000 7f9200394700 1 Processor -- start 2023-10-08T00:32:33.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.325+0000 7f9200394700 1 -- start start 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.325+0000 7f9200394700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159890 0x7f91f815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.325+0000 7f9200394700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91f8159c60 0x7f91f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f9200394700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f815a160 con 0x7f91f815db10 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f9200394700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f80d13a0 con 0x7f91f8159c60 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f9200394700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f815e140 con 0x7f91f8159890 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91f8159c60 0x7f91f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f91f8159c60 0x7f91f815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50076/0 (socket says 172.21.15.22:50076) 2023-10-08T00:32:33.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 -- 172.21.15.22:0/2417029293 learned_addr learned my addr 172.21.15.22:0/2417029293 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fe130700 1 --2- 172.21.15.22:0/2417029293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159890 0x7f91f815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 -- 172.21.15.22:0/2417029293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159890 msgr2=0x7f91f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 --2- 172.21.15.22:0/2417029293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159890 0x7f91f815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 -- 172.21.15.22:0/2417029293 >> v1:172.21.15.192:6789/0 conn(0x7f91f815db10 legacy=0x7f91f8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 -- 172.21.15.22:0/2417029293 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f815a3d0 con 0x7f91f8159c60 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd92f700 1 --2- 172.21.15.22:0/2417029293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159c60 0x7f91f815d5d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f91e80099b0 tx=0x7f91e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d160fe61a838d3f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd12e700 1 -- 172.21.15.22:0/2417029293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800b860 con 0x7f91f8159c60 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd12e700 1 -- 172.21.15.22:0/2417029293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e800b9c0 con 0x7f91f8159c60 2023-10-08T00:32:33.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.326+0000 7f91fd12e700 1 -- 172.21.15.22:0/2417029293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800bd60 con 0x7f91f8159c60 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 -- 172.21.15.22:0/2417029293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159c60 msgr2=0x7f91f815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 --2- 172.21.15.22:0/2417029293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159c60 0x7f91f815d5d0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f91e80099b0 tx=0x7f91e8009250 comp rx=0 tx=0).stop 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 -- 172.21.15.22:0/2417029293 shutdown_connections 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 --2- 172.21.15.22:0/2417029293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159890 0x7f91f815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 --2- 172.21.15.22:0/2417029293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159c60 0x7f91f815d5d0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 -- 172.21.15.22:0/2417029293 >> 172.21.15.22:0/2417029293 conn(0x7f91f8068e20 msgr2=0x7f91f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 -- 172.21.15.22:0/2417029293 shutdown_connections 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.327+0000 7f9200394700 1 -- 172.21.15.22:0/2417029293 wait complete. 2023-10-08T00:32:33.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.328+0000 7f9200394700 1 Processor -- start 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.328+0000 7f9200394700 1 -- start start 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f9200394700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 0x7f91f814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f9200394700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159c60 0x7f91f80b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f9200394700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91f815db10 0x7f91f81539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f9200394700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80b64b0 con 0x7f91f8159890 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f9200394700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f816df80 con 0x7f91f815db10 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f9200394700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f816d3b0 con 0x7f91f8159c60 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 0x7f91f814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 0x7f91f814ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50092/0 (socket says 172.21.15.22:50092) 2023-10-08T00:32:33.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 -- 172.21.15.22:0/2487787730 learned_addr learned my addr 172.21.15.22:0/2487787730 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:33.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe931700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91f815db10 0x7f91f81539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fd92f700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159c60 0x7f91f80b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 -- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159c60 msgr2=0x7f91f80b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159c60 0x7f91f80b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 -- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91f815db10 msgr2=0x7f91f81539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91f815db10 0x7f91f81539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 -- 172.21.15.22:0/2487787730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80094f0 con 0x7f91f8159890 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.329+0000 7f91fe130700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 0x7f91f814ca00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f91f400d8c0 tx=0x7f91f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.330+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400de60 con 0x7f91f8159890 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.330+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f400b780 con 0x7f91f8159890 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.330+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f816d650 con 0x7f91f8159890 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.330+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f400bb20 con 0x7f91f8159890 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.330+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f816dc10 con 0x7f91f8159890 2023-10-08T00:32:33.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.331+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f804c3c0 con 0x7f91f8159890 2023-10-08T00:32:33.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.331+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f91f401e460 con 0x7f91f8159890 2023-10-08T00:32:33.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.331+0000 7f91ee7fc700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91dc067320 0x7f91dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.331+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f91f40852d0 con 0x7f91f8159890 2023-10-08T00:32:33.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.331+0000 7f91fd92f700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91dc067320 0x7f91dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.332+0000 7f91fd92f700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91dc067320 0x7f91dc0697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f91e80099b0 tx=0x7f91e8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:33.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.335+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91f4051f10 con 0x7f91f8159890 2023-10-08T00:32:33.527 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.527+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91f806a5b0 con 0x7f91f8159890 2023-10-08T00:32:33.528 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.527+0000 7f91ee7fc700 1 -- 172.21.15.22:0/2487787730 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91f4055530 con 0x7f91f8159890 2023-10-08T00:32:33.528 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:32:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91dc067320 msgr2=0x7f91dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91dc067320 0x7f91dc0697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f91e80099b0 tx=0x7f91e8017000 comp rx=0 tx=0).stop 2023-10-08T00:32:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 msgr2=0x7f91f814ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.530 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 0x7f91f814ca00 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f91f400d8c0 tx=0x7f91f4008040 comp rx=0 tx=0).stop 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 shutdown_connections 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91f815db10 0x7f91f81539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f8159890 0x7f91f814ca00 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91dc067320 0x7f91dc0697d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 --2- 172.21.15.22:0/2487787730 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f91f8159c60 0x7f91f80b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 >> 172.21.15.22:0/2487787730 conn(0x7f91f8068e20 msgr2=0x7f91f80cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 shutdown_connections 2023-10-08T00:32:33.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.529+0000 7f9200394700 1 -- 172.21.15.22:0/2487787730 wait complete. 2023-10-08T00:32:33.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000556960.meta pg_num 2023-10-08T00:32:33.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.663+0000 7f4af2d45700 1 Processor -- start 2023-10-08T00:32:33.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.663+0000 7f4af2d45700 1 -- start start 2023-10-08T00:32:33.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af2d45700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4aec159890 0x7f4aec15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af2d45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec159c60 0x7f4aec15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af2d45700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec15a160 con 0x7f4aec15db10 2023-10-08T00:32:33.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af2d45700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec0d13a0 con 0x7f4aec159890 2023-10-08T00:32:33.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af2d45700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec15e140 con 0x7f4aec159c60 2023-10-08T00:32:33.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af0ae1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4aec159890 0x7f4aec15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af0ae1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4aec159890 0x7f4aec15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50104/0 (socket says 172.21.15.22:50104) 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.664+0000 7f4af0ae1700 1 -- 172.21.15.22:0/327015653 learned_addr learned my addr 172.21.15.22:0/327015653 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4aebfff700 1 --2- 172.21.15.22:0/327015653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec159c60 0x7f4aec15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af0ae1700 1 -- 172.21.15.22:0/327015653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec159c60 msgr2=0x7f4aec15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af0ae1700 1 --2- 172.21.15.22:0/327015653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec159c60 0x7f4aec15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af0ae1700 1 -- 172.21.15.22:0/327015653 >> v1:172.21.15.192:6789/0 conn(0x7f4aec15db10 legacy=0x7f4aec069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af0ae1700 1 -- 172.21.15.22:0/327015653 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec15a3d0 con 0x7f4aec159890 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af0ae1700 1 --2- 172.21.15.22:0/327015653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159890 0x7f4aec15abd0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0099b0 tx=0x7f4adc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6afe78f728ec8f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4aeb7fe700 1 -- 172.21.15.22:0/327015653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00b860 con 0x7f4aec159890 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4aeb7fe700 1 -- 172.21.15.22:0/327015653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc00b9c0 con 0x7f4aec159890 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4aeb7fe700 1 -- 172.21.15.22:0/327015653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00bd60 con 0x7f4aec159890 2023-10-08T00:32:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af2d45700 1 -- 172.21.15.22:0/327015653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159890 msgr2=0x7f4aec15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.665+0000 7f4af2d45700 1 --2- 172.21.15.22:0/327015653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159890 0x7f4aec15abd0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0099b0 tx=0x7f4adc009250 comp rx=0 tx=0).stop 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.666+0000 7f4af2d45700 1 -- 172.21.15.22:0/327015653 shutdown_connections 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.666+0000 7f4af2d45700 1 --2- 172.21.15.22:0/327015653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159890 0x7f4aec15abd0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.666+0000 7f4af2d45700 1 --2- 172.21.15.22:0/327015653 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec159c60 0x7f4aec15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.666+0000 7f4af2d45700 1 -- 172.21.15.22:0/327015653 >> 172.21.15.22:0/327015653 conn(0x7f4aec068e20 msgr2=0x7f4aec0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.666+0000 7f4af2d45700 1 -- 172.21.15.22:0/327015653 shutdown_connections 2023-10-08T00:32:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.666+0000 7f4af2d45700 1 -- 172.21.15.22:0/327015653 wait complete. 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.667+0000 7f4af2d45700 1 Processor -- start 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.667+0000 7f4af2d45700 1 -- start start 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4aec159890 0x7f4aec14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 0x7f4aec14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec15db10 0x7f4aec0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0b39a0 con 0x7f4aec159c60 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0ce340 con 0x7f4aec159890 2023-10-08T00:32:33.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0b5d90 con 0x7f4aec15db10 2023-10-08T00:32:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 0x7f4aec14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 0x7f4aec14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50112/0 (socket says 172.21.15.22:50112) 2023-10-08T00:32:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 -- 172.21.15.22:0/2201202944 learned_addr learned my addr 172.21.15.22:0/2201202944 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af0ae1700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4aec159890 0x7f4aec14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af12e2700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec15db10 0x7f4aec0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 -- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec15db10 msgr2=0x7f4aec0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec15db10 0x7f4aec0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 -- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4aec159890 msgr2=0x7f4aec14c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4aec159890 0x7f4aec14c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 -- 172.21.15.22:0/2201202944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0094f0 con 0x7f4aec159c60 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af12e2700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec15db10 0x7f4aec0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4aebfff700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 0x7f4aec14f300 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000d860 tx=0x7f4ae0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00125f0 con 0x7f4aec159c60 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0012750 con 0x7f4aec159c60 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec0b6070 con 0x7f4aec159c60 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0012af0 con 0x7f4aec159c60 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.668+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec0b3630 con 0x7f4aec159c60 2023-10-08T00:32:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.669+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aec0b3b50 con 0x7f4aec159c60 2023-10-08T00:32:33.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.670+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4ae001e460 con 0x7f4aec159c60 2023-10-08T00:32:33.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.670+0000 7f4ae8ff9700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad8067320 0x7f4ad80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:33.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.670+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f4ae00852b0 con 0x7f4aec159c60 2023-10-08T00:32:33.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.670+0000 7f4af0ae1700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad8067320 0x7f4ad80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:33.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.671+0000 7f4af0ae1700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad8067320 0x7f4ad80697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0099b0 tx=0x7f4adc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:33.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.674+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4aec0b3b50 con 0x7f4aec159c60 2023-10-08T00:32:33.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.867+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000556960.meta", "var": "pg_num"} v 0) v1 -- 0x7f4aec04c3c0 con 0x7f4aec159c60 2023-10-08T00:32:33.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.868+0000 7f4ae8ff9700 1 -- 172.21.15.22:0/2201202944 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000556960.meta", "var": "pg_num"}]=0 v144) v1 ==== 124+0+11 (secure 0 0 0) 0x7f4ae00556f0 con 0x7f4aec159c60 2023-10-08T00:32:33.869 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad8067320 msgr2=0x7f4ad80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad8067320 0x7f4ad80697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0099b0 tx=0x7f4adc017000 comp rx=0 tx=0).stop 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 msgr2=0x7f4aec14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 0x7f4aec14f300 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000d860 tx=0x7f4ae0008040 comp rx=0 tx=0).stop 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 shutdown_connections 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ad8067320 0x7f4ad80697d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4aec15db10 0x7f4aec0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4aec159890 0x7f4aec14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.871 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 --2- 172.21.15.22:0/2201202944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aec159c60 0x7f4aec14f300 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 >> 172.21.15.22:0/2201202944 conn(0x7f4aec068e20 msgr2=0x7f4aec0b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 shutdown_connections 2023-10-08T00:32:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:33.870+0000 7f4af2d45700 1 -- 172.21.15.22:0/2201202944 wait complete. 2023-10-08T00:32:33.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000556960.data pg_num 2023-10-08T00:32:34.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.004+0000 7f9158b2d700 1 Processor -- start 2023-10-08T00:32:34.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.004+0000 7f9158b2d700 1 -- start start 2023-10-08T00:32:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f9158b2d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f915406bcd0 0x7f91540caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f9158b2d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915415d7e0 con 0x7f915406c0a0 2023-10-08T00:32:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f9158b2d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915415dac0 con 0x7f915415df50 2023-10-08T00:32:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f9158b2d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915415aa30 con 0x7f915406bcd0 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f915259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f915406bcd0 0x7f91540caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f9151d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f915406c0a0 0x7f915415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46048/0 (socket says 172.21.15.22:46048) 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.005+0000 7f9151d9b700 1 -- 172.21.15.22:0/3764235633 learned_addr learned my addr 172.21.15.22:0/3764235633 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915259c700 1 -- 172.21.15.22:0/3764235633 >> v1:172.21.15.192:6789/0 conn(0x7f915415df50 legacy=0x7f91540c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915259c700 1 -- 172.21.15.22:0/3764235633 >> v1:172.21.15.22:6789/0 conn(0x7f915406c0a0 legacy=0x7f915415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915259c700 1 -- 172.21.15.22:0/3764235633 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915415ad10 con 0x7f915406bcd0 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915259c700 1 --2- 172.21.15.22:0/3764235633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406bcd0 0x7f91540caa90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f914c009e60 tx=0x7f914c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb4d37cfe817ca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915159a700 1 -- 172.21.15.22:0/3764235633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00e070 con 0x7f915406bcd0 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915159a700 1 -- 172.21.15.22:0/3764235633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00bc30 con 0x7f915406bcd0 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f915159a700 1 -- 172.21.15.22:0/3764235633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c012430 con 0x7f915406bcd0 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f9158b2d700 1 -- 172.21.15.22:0/3764235633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406bcd0 msgr2=0x7f91540caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.006+0000 7f9158b2d700 1 --2- 172.21.15.22:0/3764235633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406bcd0 0x7f91540caa90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f914c009e60 tx=0x7f914c009780 comp rx=0 tx=0).stop 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.007+0000 7f9158b2d700 1 -- 172.21.15.22:0/3764235633 shutdown_connections 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.007+0000 7f9158b2d700 1 --2- 172.21.15.22:0/3764235633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406bcd0 0x7f91540caa90 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.007+0000 7f9158b2d700 1 -- 172.21.15.22:0/3764235633 >> 172.21.15.22:0/3764235633 conn(0x7f91540ce600 msgr2=0x7f91540cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:34.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.007+0000 7f9158b2d700 1 -- 172.21.15.22:0/3764235633 shutdown_connections 2023-10-08T00:32:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.007+0000 7f9158b2d700 1 -- 172.21.15.22:0/3764235633 wait complete. 2023-10-08T00:32:34.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 Processor -- start 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 -- start start 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f915406bcd0 0x7f915416a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 0x7f91541483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f915415df50 0x7f9154154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915416ad60 con 0x7f915406c0a0 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9154154a60 con 0x7f915406bcd0 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9158b2d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9154153e50 con 0x7f915415df50 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.008+0000 7f9151d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 0x7f91541483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 0x7f91541483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50124/0 (socket says 172.21.15.22:50124) 2023-10-08T00:32:34.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 -- 172.21.15.22:0/2151247329 learned_addr learned my addr 172.21.15.22:0/2151247329 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f915259c700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f915406bcd0 0x7f915416a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9152d9d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f915415df50 0x7f9154154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 -- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f915415df50 msgr2=0x7f9154154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f915415df50 0x7f9154154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 -- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f915406bcd0 msgr2=0x7f915416a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f915406bcd0 0x7f915416a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 -- 172.21.15.22:0/2151247329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009a20 con 0x7f915406c0a0 2023-10-08T00:32:34.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9151d9b700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 0x7f91541483d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c560 tx=0x7f913c001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c005b30 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c005c90 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9154154130 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c007320 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.009+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91541546f0 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.010+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9154154bd0 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.011+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f913c01b3b0 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.011+0000 7f914a7fc700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9134067320 0x7f91340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.011+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f913c084030 con 0x7f915406c0a0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.011+0000 7f915259c700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9134067320 0x7f91340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.012+0000 7f915259c700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9134067320 0x7f91340697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9154156020 tx=0x7f914c019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.015+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f913c050c70 con 0x7f915406c0a0 2023-10-08T00:32:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.210+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000556960.data", "var": "pg_num"} v 0) v1 -- 0x7f915404c3c0 con 0x7f915406c0a0 2023-10-08T00:32:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.211+0000 7f914a7fc700 1 -- 172.21.15.22:0/2151247329 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000556960.data", "var": "pg_num"}]=0 v144) v1 ==== 124+0+11 (secure 0 0 0) 0x7f913c017020 con 0x7f915406c0a0 2023-10-08T00:32:34.211 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:32:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9134067320 msgr2=0x7f91340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9134067320 0x7f91340697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9154156020 tx=0x7f914c019000 comp rx=0 tx=0).stop 2023-10-08T00:32:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 msgr2=0x7f91541483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 0x7f91541483d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c560 tx=0x7f913c001020 comp rx=0 tx=0).stop 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 shutdown_connections 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9134067320 0x7f91340697d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f915415df50 0x7f9154154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f915406bcd0 0x7f915416a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 --2- 172.21.15.22:0/2151247329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915406c0a0 0x7f91541483d0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 >> 172.21.15.22:0/2151247329 conn(0x7f91540ce600 msgr2=0x7f915406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 shutdown_connections 2023-10-08T00:32:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.213+0000 7f9158b2d700 1 -- 172.21.15.22:0/2151247329 wait complete. 2023-10-08T00:32:34.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:34.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.344+0000 7f7eb8ae4700 1 Processor -- start 2023-10-08T00:32:34.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.344+0000 7f7eb8ae4700 1 -- start start 2023-10-08T00:32:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb8ae4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7eb4159890 0x7f7eb415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb8ae4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb8ae4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb415a160 con 0x7f7eb415db10 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb8ae4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40d13a0 con 0x7f7eb4159890 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb8ae4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb415e140 con 0x7f7eb4159c60 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb2d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7eb415db10 0x7f7eb4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46054/0 (socket says 172.21.15.22:46054) 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb2d9d700 1 -- 172.21.15.22:0/1215487359 learned_addr learned my addr 172.21.15.22:0/1215487359 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb259c700 1 --2- 172.21.15.22:0/1215487359 >> v2:172.21.15.192:3300/0 conn(0x7f7eb4159890 0x7f7eb415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.345+0000 7f7eb1d9b700 1 --2- 172.21.15.22:0/1215487359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb159a700 1 -- 172.21.15.22:0/1215487359 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290066456 0 0) 0x7f7eb415a160 con 0x7f7eb415db10 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb159a700 1 -- 172.21.15.22:0/1215487359 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea0003570 con 0x7f7eb415db10 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb1d9b700 1 -- 172.21.15.22:0/1215487359 >> v2:172.21.15.192:3300/0 conn(0x7f7eb4159890 msgr2=0x7f7eb415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb1d9b700 1 --2- 172.21.15.22:0/1215487359 >> v2:172.21.15.192:3300/0 conn(0x7f7eb4159890 0x7f7eb415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb1d9b700 1 -- 172.21.15.22:0/1215487359 >> v1:172.21.15.22:6789/0 conn(0x7f7eb415db10 legacy=0x7f7eb4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb1d9b700 1 -- 172.21.15.22:0/1215487359 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb415a3d0 con 0x7f7eb4159c60 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb259c700 1 --2- 172.21.15.22:0/1215487359 >> v2:172.21.15.192:3300/0 conn(0x7f7eb4159890 0x7f7eb415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb1d9b700 1 --2- 172.21.15.22:0/1215487359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb415d5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098e0 tx=0x7f7e9c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13cc4215bedcb252 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb159a700 1 -- 172.21.15.22:0/1215487359 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011630 con 0x7f7eb4159c60 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb159a700 1 -- 172.21.15.22:0/1215487359 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c011790 con 0x7f7eb4159c60 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.346+0000 7f7eb159a700 1 -- 172.21.15.22:0/1215487359 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011b30 con 0x7f7eb4159c60 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/1215487359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 msgr2=0x7f7eb415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/1215487359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb415d5d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c0098e0 tx=0x7f7e9c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/1215487359 shutdown_connections 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/1215487359 >> v2:172.21.15.192:3300/0 conn(0x7f7eb4159890 0x7f7eb415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/1215487359 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb415d5d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/1215487359 >> 172.21.15.22:0/1215487359 conn(0x7f7eb4068e20 msgr2=0x7f7eb40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/1215487359 shutdown_connections 2023-10-08T00:32:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.347+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/1215487359 wait complete. 2023-10-08T00:32:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.348+0000 7f7eb8ae4700 1 Processor -- start 2023-10-08T00:32:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.348+0000 7f7eb8ae4700 1 -- start start 2023-10-08T00:32:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 0x7f7eb41441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb40ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb415db10 0x7f7eb4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cf430 con 0x7f7eb4159890 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cf710 con 0x7f7eb415db10 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40cf9f0 con 0x7f7eb4159c60 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 0x7f7eb41441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 0x7f7eb41441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50130/0 (socket says 172.21.15.22:50130) 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 -- 172.21.15.22:0/2168903459 learned_addr learned my addr 172.21.15.22:0/2168903459 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb2d9d700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb415db10 0x7f7eb4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb1d9b700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb40ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 -- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 msgr2=0x7f7eb40ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb40ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 -- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb415db10 msgr2=0x7f7eb4157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb415db10 0x7f7eb4157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 -- 172.21.15.22:0/2168903459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac009420 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb259c700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 0x7f7eb41441e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ec80 tx=0x7f7eac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00c920 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00ca80 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c009420 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.349+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00ce00 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.350+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb4144720 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.350+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40cd2f0 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.351+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7eac013680 con 0x7f7eb4159890 2023-10-08T00:32:34.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.351+0000 7f7eaa7fc700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e94067320 0x7f7e940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.352+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f7eac0850e0 con 0x7f7eb4159890 2023-10-08T00:32:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.352+0000 7f7eb1d9b700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e94067320 0x7f7e940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.352+0000 7f7eb1d9b700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e94067320 0x7f7e940697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7eb415a090 tx=0x7f7e9c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.356+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7eac051ce0 con 0x7f7eb4159890 2023-10-08T00:32:34.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.598+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb404c3c0 con 0x7f7eb4159890 2023-10-08T00:32:34.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.598+0000 7f7eaa7fc700 1 -- 172.21.15.22:0/2168903459 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4624 (secure 0 0 0) 0x7f7eac055300 con 0x7f7eb4159890 2023-10-08T00:32:34.599 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:34.599 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:29.205783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000556960","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:34.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e94067320 msgr2=0x7f7e940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e94067320 0x7f7e940697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7eb415a090 tx=0x7f7e9c017000 comp rx=0 tx=0).stop 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 msgr2=0x7f7eb41441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 0x7f7eb41441e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00ec80 tx=0x7f7eac0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 shutdown_connections 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7eb415db10 0x7f7eb4157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7eb4159890 0x7f7eb41441e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7e94067320 0x7f7e940697d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 --2- 172.21.15.22:0/2168903459 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7eb4159c60 0x7f7eb40ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 >> 172.21.15.22:0/2168903459 conn(0x7f7eb4068e20 msgr2=0x7f7eb40b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:34.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 shutdown_connections 2023-10-08T00:32:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.601+0000 7f7eb8ae4700 1 -- 172.21.15.22:0/2168903459 wait complete. 2023-10-08T00:32:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 98 2023-10-08T00:32:34.613 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:34.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.732+0000 7f6adcda9700 1 Processor -- start 2023-10-08T00:32:34.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.732+0000 7f6adcda9700 1 -- start start 2023-10-08T00:32:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6adcda9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ad81597f0 0x7f6ad80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6adcda9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6adcda9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad815dbb0 con 0x7f6ad8159420 2023-10-08T00:32:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6adcda9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad80b11d0 con 0x7f6ad81597f0 2023-10-08T00:32:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6adcda9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80b14b0 con 0x7f6ad815d230 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ad81597f0 0x7f6ad80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ad81597f0 0x7f6ad80b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50138/0 (socket says 172.21.15.22:50138) 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/1964540402 learned_addr learned my addr 172.21.15.22:0/1964540402 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad7fff700 1 --2- 172.21.15.22:0/1964540402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/1964540402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 msgr2=0x7f6ad815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/1964540402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/1964540402 >> v1:172.21.15.192:6789/0 conn(0x7f6ad8159420 legacy=0x7f6ad80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.733+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/1964540402 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80b1790 con 0x7f6ad81597f0 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/1964540402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad80b2270 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0099b0 tx=0x7f6acc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2535b2b93f9f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6ad67fc700 1 -- 172.21.15.22:0/1964540402 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc009ea0 con 0x7f6ad81597f0 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6ad67fc700 1 -- 172.21.15.22:0/1964540402 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc00b860 con 0x7f6ad81597f0 2023-10-08T00:32:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6ad67fc700 1 -- 172.21.15.22:0/1964540402 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00bc00 con 0x7f6ad81597f0 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 -- 172.21.15.22:0/1964540402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 msgr2=0x7f6ad80b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 --2- 172.21.15.22:0/1964540402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad80b2270 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6acc0099b0 tx=0x7f6acc009250 comp rx=0 tx=0).stop 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 -- 172.21.15.22:0/1964540402 shutdown_connections 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 --2- 172.21.15.22:0/1964540402 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 --2- 172.21.15.22:0/1964540402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad80b2270 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 -- 172.21.15.22:0/1964540402 >> 172.21.15.22:0/1964540402 conn(0x7f6ad80d0660 msgr2=0x7f6ad80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 -- 172.21.15.22:0/1964540402 shutdown_connections 2023-10-08T00:32:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.734+0000 7f6adcda9700 1 -- 172.21.15.22:0/1964540402 wait complete. 2023-10-08T00:32:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.735+0000 7f6adcda9700 1 Processor -- start 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 -- start start 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ad8159420 0x7f6ad8146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad8155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad81560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80c5400 con 0x7f6ad81597f0 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad816be20 con 0x7f6ad8159420 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6adcda9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad8146690 con 0x7f6ad815d230 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6ad6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad8155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6ad6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad8155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50152/0 (socket says 172.21.15.22:50152) 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.736+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/3999295050 learned_addr learned my addr 172.21.15.22:0/3999295050 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ad8159420 0x7f6ad8146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.740 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad7fff700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad81560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 msgr2=0x7f6ad81560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad81560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ad8159420 msgr2=0x7f6ad8146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ad8159420 0x7f6ad8146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/3999295050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0094f0 con 0x7f6ad81597f0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad8155ba0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8089340 tx=0x7f6acc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00bbe0 con 0x7f6ad81597f0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc011420 con 0x7f6ad81597f0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad816b210 con 0x7f6ad81597f0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0117c0 con 0x7f6ad81597f0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.737+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad816b7d0 con 0x7f6ad81597f0 2023-10-08T00:32:34.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.738+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad816bf90 con 0x7f6ad81597f0 2023-10-08T00:32:34.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.738+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6acc011bf0 con 0x7f6ad81597f0 2023-10-08T00:32:34.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.739+0000 7f6abf7fe700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ac4067320 0x7f6ac40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:34.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.739+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6acc086650 con 0x7f6ad81597f0 2023-10-08T00:32:34.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.739+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ac4067320 0x7f6ac40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:34.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.740+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ac4067320 0x7f6ac40697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8003860 tx=0x7f6ac8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:34.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.743+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6acc053290 con 0x7f6ad81597f0 2023-10-08T00:32:34.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.939+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ad804c3c0 con 0x7f6ad81597f0 2023-10-08T00:32:34.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.940+0000 7f6abf7fe700 1 -- 172.21.15.22:0/3999295050 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f6acc0568b0 con 0x7f6ad81597f0 2023-10-08T00:32:34.940 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:34.940 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":144,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:31.217847+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000556960.meta","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000556960"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000556960.data","create_time":"2023-10-08T00:32:16.504058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000556960"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:34.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ac4067320 msgr2=0x7f6ac40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ac4067320 0x7f6ac40697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8003860 tx=0x7f6ac8009040 comp rx=0 tx=0).stop 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 msgr2=0x7f6ad8155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad8155ba0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8089340 tx=0x7f6acc017000 comp rx=0 tx=0).stop 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 shutdown_connections 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6ac4067320 0x7f6ac40697d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ad815d230 0x7f6ad81560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ad8159420 0x7f6ad8146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 --2- 172.21.15.22:0/3999295050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad81597f0 0x7f6ad8155ba0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 >> 172.21.15.22:0/3999295050 conn(0x7f6ad80d0660 msgr2=0x7f6ad8155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 shutdown_connections 2023-10-08T00:32:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:34.942+0000 7f6adcda9700 1 -- 172.21.15.22:0/3999295050 wait complete. 2023-10-08T00:32:34.955 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000556960 and related pools 2023-10-08T00:32:34.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.073+0000 7f57df331700 1 Processor -- start 2023-10-08T00:32:35.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.073+0000 7f57df331700 1 -- start start 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57df331700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57d81593b0 0x7f57d8159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57df331700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57d80ceaa0 0x7f57d80b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57df331700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d80b6570 con 0x7f57d80b1740 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57df331700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80cfe20 con 0x7f57d80ceaa0 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57df331700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d80cf210 con 0x7f57d81593b0 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57d80ceaa0 0x7f57d80b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57d80ceaa0 0x7f57d80b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50158/0 (socket says 172.21.15.22:50158) 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2961830921 learned_addr learned my addr 172.21.15.22:0/2961830921 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:35.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57de32f700 1 --2- 172.21.15.22:0/2961830921 >> v2:172.21.15.192:3300/0 conn(0x7f57d81593b0 0x7f57d8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2961830921 >> v2:172.21.15.192:3300/0 conn(0x7f57d81593b0 msgr2=0x7f57d8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 --2- 172.21.15.22:0/2961830921 >> v2:172.21.15.192:3300/0 conn(0x7f57d81593b0 0x7f57d8159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2961830921 >> v1:172.21.15.192:6789/0 conn(0x7f57d80b1740 legacy=0x7f57d80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2961830921 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d80cf4f0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57de32f700 1 --2- 172.21.15.22:0/2961830921 >> v2:172.21.15.192:3300/0 conn(0x7f57d81593b0 0x7f57d8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.074+0000 7f57ddb2e700 1 --2- 172.21.15.22:0/2961830921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d80b6030 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f57d8070d60 tx=0x7f57cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e69d640333cba0f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57dd32d700 1 -- 172.21.15.22:0/2961830921 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00b860 con 0x7f57d80ceaa0 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57dd32d700 1 -- 172.21.15.22:0/2961830921 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc00b9c0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57dd32d700 1 -- 172.21.15.22:0/2961830921 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00bd60 con 0x7f57d80ceaa0 2023-10-08T00:32:35.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 -- 172.21.15.22:0/2961830921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 msgr2=0x7f57d80b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 --2- 172.21.15.22:0/2961830921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d80b6030 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f57d8070d60 tx=0x7f57cc009250 comp rx=0 tx=0).stop 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 -- 172.21.15.22:0/2961830921 shutdown_connections 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 --2- 172.21.15.22:0/2961830921 >> v2:172.21.15.192:3300/0 conn(0x7f57d81593b0 0x7f57d8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 --2- 172.21.15.22:0/2961830921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d80b6030 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 -- 172.21.15.22:0/2961830921 >> 172.21.15.22:0/2961830921 conn(0x7f57d80d1130 msgr2=0x7f57d80b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 -- 172.21.15.22:0/2961830921 shutdown_connections 2023-10-08T00:32:35.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.075+0000 7f57df331700 1 -- 172.21.15.22:0/2961830921 wait complete. 2023-10-08T00:32:35.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.076+0000 7f57df331700 1 Processor -- start 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.076+0000 7f57df331700 1 -- start start 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57df331700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d80b1740 0x7f57d80685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57df331700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d816c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57df331700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d81593b0 0x7f57d816c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57df331700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d816cdc0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57df331700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8169cc0 con 0x7f57d80b1740 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57df331700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8169fa0 con 0x7f57d81593b0 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57ddb2e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d816c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57ddb2e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d816c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50172/0 (socket says 172.21.15.22:50172) 2023-10-08T00:32:35.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2849701604 learned_addr learned my addr 172.21.15.22:0/2849701604 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57de32f700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d80b1740 0x7f57d80685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.077+0000 7f57deb30700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d81593b0 0x7f57d816c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d81593b0 msgr2=0x7f57d816c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57ddb2e700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d81593b0 0x7f57d816c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d80b1740 msgr2=0x7f57d80685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57ddb2e700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d80b1740 0x7f57d80685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57ddb2e700 1 -- 172.21.15.22:0/2849701604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc0094f0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57ddb2e700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d816c340 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009290 tx=0x7f57cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc011e40 con 0x7f57d80ceaa0 2023-10-08T00:32:35.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc01a450 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d816a280 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc01a810 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.078+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d81699f0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.079+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d816a770 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.080+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f57cc01abc0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.080+0000 7f57d67fc700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c40672f0 0x7f57c40697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.080+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f57cc086230 con 0x7f57d80ceaa0 2023-10-08T00:32:35.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.080+0000 7f57de32f700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c40672f0 0x7f57c40697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.081+0000 7f57de32f700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c40672f0 0x7f57c40697a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f57d0006f00 tx=0x7f57d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.084+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57cc052e70 con 0x7f57d80ceaa0 2023-10-08T00:32:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.329+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57d804c3c0 con 0x7f57d80ceaa0 2023-10-08T00:32:35.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.329+0000 7f57d67fc700 1 -- 172.21.15.22:0/2849701604 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4624 (secure 0 0 0) 0x7f57cc056490 con 0x7f57d80ceaa0 2023-10-08T00:32:35.330 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:35.330 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:29.205783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000556960","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c40672f0 msgr2=0x7f57c40697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c40672f0 0x7f57c40697a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f57d0006f00 tx=0x7f57d0008040 comp rx=0 tx=0).stop 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 msgr2=0x7f57d816c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d816c340 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009290 tx=0x7f57cc017000 comp rx=0 tx=0).stop 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 shutdown_connections 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57c40672f0 0x7f57c40697a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d81593b0 0x7f57d816c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d80b1740 0x7f57d80685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 --2- 172.21.15.22:0/2849701604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d80ceaa0 0x7f57d816c340 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 >> 172.21.15.22:0/2849701604 conn(0x7f57d80d1130 msgr2=0x7f57d80b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 shutdown_connections 2023-10-08T00:32:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.331+0000 7f57df331700 1 -- 172.21.15.22:0/2849701604 wait complete. 2023-10-08T00:32:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 98 2023-10-08T00:32:35.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:35.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.462+0000 7f18e551a700 1 Processor -- start 2023-10-08T00:32:35.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.462+0000 7f18e551a700 1 -- start start 2023-10-08T00:32:35.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18e551a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18e00cd0f0 0x7f18e01598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18e551a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 0x7f18e015a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18e551a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00d01f0 con 0x7f18e01594d0 2023-10-08T00:32:35.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18e551a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00cd540 con 0x7f18e00cd0f0 2023-10-08T00:32:35.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18e551a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00cf5e0 con 0x7f18e0159de0 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18deffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f18e01594d0 0x7f18e00b5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46062/0 (socket says 172.21.15.22:46062) 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18deffd700 1 -- 172.21.15.22:0/3307739536 learned_addr learned my addr 172.21.15.22:0/3307739536 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463122921 0 0) 0x7f18e00d01f0 con 0x7f18e01594d0 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18cc003570 con 0x7f18e01594d0 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18de7fc700 1 --2- 172.21.15.22:0/3307739536 >> v2:172.21.15.192:3300/0 conn(0x7f18e00cd0f0 0x7f18e01598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.463+0000 7f18df7fe700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 0x7f18e015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049836062 0 0) 0x7f18cc003570 con 0x7f18e01594d0 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 msgr2=0x7f18e015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 0x7f18e015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 >> v2:172.21.15.192:3300/0 conn(0x7f18e00cd0f0 msgr2=0x7f18e01598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:35.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 --2- 172.21.15.22:0/3307739536 >> v2:172.21.15.192:3300/0 conn(0x7f18e00cd0f0 0x7f18e01598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00cf8c0 con 0x7f18e01594d0 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f18d8001470 con 0x7f18e01594d0 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 >> v1:172.21.15.22:6789/0 conn(0x7f18e01594d0 legacy=0x7f18e00b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc003a60 0x7f18cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 0x7f18cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18cc004d50 0x7f18cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00cd540 con 0x7f18cc004d50 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00cf5e0 con 0x7f18cc003a60 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc00ba60 con 0x7f18e0159de0 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18cc004d50 0x7f18cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18de7fc700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 0x7f18cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18deffd700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc003a60 0x7f18cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 -- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 msgr2=0x7f18cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0159de0 0x7f18cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 -- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc003a60 msgr2=0x7f18cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc003a60 0x7f18cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 -- 172.21.15.22:0/3307739536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc003570 con 0x7f18cc004d50 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18df7fe700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18cc004d50 0x7f18cc0051c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f18d000e210 tx=0x7f18d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fbeef7241e2283 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.464+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000ea60 con 0x7f18cc004d50 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000f040 con 0x7f18cc004d50 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18ddffb700 1 -- 172.21.15.22:0/3307739536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000ee10 con 0x7f18cc004d50 2023-10-08T00:32:35.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18e551a700 1 -- 172.21.15.22:0/3307739536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18cc004d50 msgr2=0x7f18cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18e551a700 1 --2- 172.21.15.22:0/3307739536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18cc004d50 0x7f18cc0051c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f18d000e210 tx=0x7f18d000b040 comp rx=0 tx=0).stop 2023-10-08T00:32:35.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18df7fe700 1 -- 172.21.15.22:0/3307739536 reap_dead start 2023-10-08T00:32:35.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18e551a700 1 -- 172.21.15.22:0/3307739536 shutdown_connections 2023-10-08T00:32:35.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18e551a700 1 -- 172.21.15.22:0/3307739536 >> 172.21.15.22:0/3307739536 conn(0x7f18e00d05f0 msgr2=0x7f18e00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:35.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18e551a700 1 -- 172.21.15.22:0/3307739536 shutdown_connections 2023-10-08T00:32:35.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.465+0000 7f18e551a700 1 -- 172.21.15.22:0/3307739536 wait complete. 2023-10-08T00:32:35.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.466+0000 7f18e551a700 1 Processor -- start 2023-10-08T00:32:35.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.466+0000 7f18e551a700 1 -- start start 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18e551a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc004d50 0x7f18e0143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18e551a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 0x7f18e015f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18e551a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0169d80 0x7f18e016a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18e551a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e016d3c0 con 0x7f18e015f350 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18e551a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e015fd00 con 0x7f18cc004d50 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18e551a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e016dc20 con 0x7f18e0169d80 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18de7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 0x7f18e015f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18de7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 0x7f18e015f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50188/0 (socket says 172.21.15.22:50188) 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18de7fc700 1 -- 172.21.15.22:0/1223450955 learned_addr learned my addr 172.21.15.22:0/1223450955 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:35.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18df7fe700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0169d80 0x7f18e016a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18deffd700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc004d50 0x7f18e0143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18de7fc700 1 -- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0169d80 msgr2=0x7f18e016a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.467+0000 7f18de7fc700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0169d80 0x7f18e016a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18de7fc700 1 -- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc004d50 msgr2=0x7f18e0143fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18de7fc700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc004d50 0x7f18e0143fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18de7fc700 1 -- 172.21.15.22:0/1223450955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e016ab40 con 0x7f18e015f350 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18de7fc700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 0x7f18e015f7c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f18c8006ac0 tx=0x7f18c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8011ec0 con 0x7f18e015f350 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800f940 con 0x7f18e015f350 2023-10-08T00:32:35.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e016d5d0 con 0x7f18e015f350 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800fcc0 con 0x7f18e015f350 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.468+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0144520 con 0x7f18e015f350 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.469+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e016ddd0 con 0x7f18e015f350 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.469+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f18c8014650 con 0x7f18e015f350 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.470+0000 7f18d6ffd700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f18c0067320 0x7f18c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.470+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f18c8018030 con 0x7f18e015f350 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.470+0000 7f18deffd700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f18c0067320 0x7f18c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.470+0000 7f18deffd700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f18c0067320 0x7f18c00697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f18d80079e0 tx=0x7f18e00d0160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.474+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18e016ddd0 con 0x7f18e015f350 2023-10-08T00:32:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.710+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18e016dd90 con 0x7f18e015f350 2023-10-08T00:32:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.711+0000 7f18d6ffd700 1 -- 172.21.15.22:0/1223450955 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4624 (secure 0 0 0) 0x7f18c80521b0 con 0x7f18e015f350 2023-10-08T00:32:35.712 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:35.712 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:17.533894+0000","modified":"2023-10-08T00:32:29.205783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7581},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7581":{"gid":7581,"name":"b","rank":0,"incarnation":92,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/1659415509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1659415509},{"type":"v1","addr":"172.21.15.192:6837","nonce":1659415509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000556960","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T00:32:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f18c0067320 msgr2=0x7f18c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f18c0067320 0x7f18c00697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f18d80079e0 tx=0x7f18e00d0160 comp rx=0 tx=0).stop 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 msgr2=0x7f18e015f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 0x7f18e015f7c0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f18c8006ac0 tx=0x7f18c80091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 shutdown_connections 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f18c0067320 0x7f18c00697d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18e0169d80 0x7f18e016a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18cc004d50 0x7f18e0143fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 --2- 172.21.15.22:0/1223450955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18e015f350 0x7f18e015f7c0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 >> 172.21.15.22:0/1223450955 conn(0x7f18e00d05f0 msgr2=0x7f18e00b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 shutdown_connections 2023-10-08T00:32:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.713+0000 7f18e551a700 1 -- 172.21.15.22:0/1223450955 wait complete. 2023-10-08T00:32:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 98 2023-10-08T00:32:35.726 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.843+0000 7fde932c6700 1 Processor -- start 2023-10-08T00:32:35.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.844+0000 7fde932c6700 1 -- start start 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.844+0000 7fde932c6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde8c06bcd0 0x7fde8c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde932c6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde932c6700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c15d7e0 con 0x7fde8c06c0a0 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde932c6700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c15dac0 con 0x7fde8c06bcd0 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde932c6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c15aa30 con 0x7fde8c15df50 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde90861700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fde8c06c0a0 0x7fde8c15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46078/0 (socket says 172.21.15.22:46078) 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91062700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fde8c06bcd0 0x7fde8c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde90861700 1 -- 172.21.15.22:0/3281282020 learned_addr learned my addr 172.21.15.22:0/3281282020 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91863700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91062700 1 -- 172.21.15.22:0/3281282020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 msgr2=0x7fde8c15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:35.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91062700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91062700 1 -- 172.21.15.22:0/3281282020 >> v1:172.21.15.22:6789/0 conn(0x7fde8c06c0a0 legacy=0x7fde8c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91062700 1 -- 172.21.15.22:0/3281282020 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c15ad10 con 0x7fde8c06bcd0 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde8bfff700 1 -- 172.21.15.22:0/3281282020 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960661879 0 0) 0x7fde8c15d7e0 con 0x7fde8c06c0a0 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91863700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde91062700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0caa90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fde84009e60 tx=0x7fde84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e549b9ed01922ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde8bfff700 1 -- 172.21.15.22:0/3281282020 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8400e070 con 0x7fde8c06bcd0 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde8bfff700 1 -- 172.21.15.22:0/3281282020 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8400bc30 con 0x7fde8c06bcd0 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.845+0000 7fde8bfff700 1 -- 172.21.15.22:0/3281282020 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde84012430 con 0x7fde8c06bcd0 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 -- 172.21.15.22:0/3281282020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06bcd0 msgr2=0x7fde8c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0caa90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fde84009e60 tx=0x7fde84009780 comp rx=0 tx=0).stop 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 -- 172.21.15.22:0/3281282020 shutdown_connections 2023-10-08T00:32:35.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 --2- 172.21.15.22:0/3281282020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0caa90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 -- 172.21.15.22:0/3281282020 >> 172.21.15.22:0/3281282020 conn(0x7fde8c0ce600 msgr2=0x7fde8c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 -- 172.21.15.22:0/3281282020 shutdown_connections 2023-10-08T00:32:35.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.846+0000 7fde932c6700 1 -- 172.21.15.22:0/3281282020 wait complete. 2023-10-08T00:32:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.847+0000 7fde932c6700 1 Processor -- start 2023-10-08T00:32:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.847+0000 7fde932c6700 1 -- start start 2023-10-08T00:32:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde932c6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde932c6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 0x7fde8c149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde932c6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde932c6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c16e5a0 con 0x7fde8c06c0a0 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde932c6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c14a1a0 con 0x7fde8c06bcd0 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde932c6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c0b41f0 con 0x7fde8c15df50 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 0x7fde8c149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 0x7fde8c149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50204/0 (socket says 172.21.15.22:50204) 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 -- 172.21.15.22:0/4106951184 learned_addr learned my addr 172.21.15.22:0/4106951184 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde91062700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde91863700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 -- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 msgr2=0x7fde8c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 -- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde8c06bcd0 msgr2=0x7fde8c0b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:35.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.848+0000 7fde90861700 1 -- 172.21.15.22:0/4106951184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009a20 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.849+0000 7fde90861700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 0x7fde8c149c60 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fde8000c5b0 tx=0x7fde80001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.849+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80005b30 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.849+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80005c90 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.849+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c16e2c0 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.849+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80007300 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.849+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c0b3f10 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.850+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c0b3a90 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.850+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fde8001b3b0 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.851+0000 7fde897fa700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.851+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fde80084230 con 0x7fde8c06c0a0 2023-10-08T00:32:35.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.851+0000 7fde91062700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:35.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.851+0000 7fde91062700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fde840099a0 tx=0x7fde84019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:35.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:35.855+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde8c0b3a90 con 0x7fde8c06c0a0 2023-10-08T00:32:36.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.047+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde8c0b3a90 con 0x7fde8c06c0a0 2023-10-08T00:32:36.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.048+0000 7fde897fa700 1 -- 172.21.15.22:0/4106951184 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+15442 (secure 0 0 0) 0x7fde8c0b3a90 con 0x7fde8c06c0a0 2023-10-08T00:32:36.050 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:36.050 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":144,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:31.217847+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000556960.meta","create_time":"2023-10-08T00:32:15.944112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000556960"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000556960.data","create_time":"2023-10-08T00:32:16.504058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000556960"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 msgr2=0x7fde780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fde840099a0 tx=0x7fde84019000 comp rx=0 tx=0).stop 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 msgr2=0x7fde8c149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 0x7fde8c149c60 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fde8000c5b0 tx=0x7fde80001070 comp rx=0 tx=0).stop 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 shutdown_connections 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fde78067320 0x7fde780697d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fde8c15df50 0x7fde8c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fde8c06bcd0 0x7fde8c0b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 --2- 172.21.15.22:0/4106951184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde8c06c0a0 0x7fde8c149c60 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 >> 172.21.15.22:0/4106951184 conn(0x7fde8c0ce600 msgr2=0x7fde8c157370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:36.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 shutdown_connections 2023-10-08T00:32:36.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.050+0000 7fde932c6700 1 -- 172.21.15.22:0/4106951184 wait complete. 2023-10-08T00:32:36.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000556960 2023-10-08T00:32:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.182+0000 7fafcbc69700 1 Processor -- start 2023-10-08T00:32:36.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.182+0000 7fafcbc69700 1 -- start start 2023-10-08T00:32:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafcbc69700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fafc4159890 0x7fafc415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafcbc69700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fafc4159c60 0x7fafc415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafcbc69700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc415a160 con 0x7fafc415db10 2023-10-08T00:32:36.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafcbc69700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc415df50 con 0x7fafc4159c60 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafcbc69700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40d13a0 con 0x7fafc4159890 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafca206700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fafc415db10 0x7fafc4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46090/0 (socket says 172.21.15.22:46090) 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafca206700 1 -- 172.21.15.22:0/4132333836 learned_addr learned my addr 172.21.15.22:0/4132333836 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.183+0000 7fafc9204700 1 --2- 172.21.15.22:0/4132333836 >> v2:172.21.15.22:3300/0 conn(0x7fafc4159c60 0x7fafc415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9a05700 1 --2- 172.21.15.22:0/4132333836 >> v2:172.21.15.192:3300/0 conn(0x7fafc4159890 0x7fafc415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc8a03700 1 -- 172.21.15.22:0/4132333836 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061494340 0 0) 0x7fafc415a160 con 0x7fafc415db10 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc8a03700 1 -- 172.21.15.22:0/4132333836 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac003570 con 0x7fafc415db10 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9204700 1 -- 172.21.15.22:0/4132333836 >> v2:172.21.15.192:3300/0 conn(0x7fafc4159890 msgr2=0x7fafc415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9204700 1 --2- 172.21.15.22:0/4132333836 >> v2:172.21.15.192:3300/0 conn(0x7fafc4159890 0x7fafc415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9204700 1 -- 172.21.15.22:0/4132333836 >> v1:172.21.15.22:6789/0 conn(0x7fafc415db10 legacy=0x7fafc4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9204700 1 -- 172.21.15.22:0/4132333836 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc415e140 con 0x7fafc4159c60 2023-10-08T00:32:36.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9a05700 1 --2- 172.21.15.22:0/4132333836 >> v2:172.21.15.192:3300/0 conn(0x7fafc4159890 0x7fafc415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc9204700 1 --2- 172.21.15.22:0/4132333836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159c60 0x7fafc415d5d0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fafc40d1090 tx=0x7fafb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17be14c121915e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc8a03700 1 -- 172.21.15.22:0/4132333836 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8011630 con 0x7fafc4159c60 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc8a03700 1 -- 172.21.15.22:0/4132333836 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb8011790 con 0x7fafc4159c60 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.184+0000 7fafc8a03700 1 -- 172.21.15.22:0/4132333836 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8011b30 con 0x7fafc4159c60 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 -- 172.21.15.22:0/4132333836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159c60 msgr2=0x7fafc415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 --2- 172.21.15.22:0/4132333836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159c60 0x7fafc415d5d0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fafc40d1090 tx=0x7fafb80091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 -- 172.21.15.22:0/4132333836 shutdown_connections 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 --2- 172.21.15.22:0/4132333836 >> v2:172.21.15.192:3300/0 conn(0x7fafc4159890 0x7fafc415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 --2- 172.21.15.22:0/4132333836 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159c60 0x7fafc415d5d0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 -- 172.21.15.22:0/4132333836 >> 172.21.15.22:0/4132333836 conn(0x7fafc4068e20 msgr2=0x7fafc40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:36.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 -- 172.21.15.22:0/4132333836 shutdown_connections 2023-10-08T00:32:36.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.185+0000 7fafcbc69700 1 -- 172.21.15.22:0/4132333836 wait complete. 2023-10-08T00:32:36.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.186+0000 7fafcbc69700 1 Processor -- start 2023-10-08T00:32:36.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.186+0000 7fafcbc69700 1 -- start start 2023-10-08T00:32:36.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 0x7fafc4150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafc4159c60 0x7fafc416d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc415db10 0x7fafc416d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4154670 con 0x7fafc4159890 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4153d40 con 0x7fafc415db10 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4154020 con 0x7fafc4159c60 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 0x7fafc4150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 0x7fafc4150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50216/0 (socket says 172.21.15.22:50216) 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 -- 172.21.15.22:0/2794738727 learned_addr learned my addr 172.21.15.22:0/2794738727 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafca206700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc415db10 0x7fafc416d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9204700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafc4159c60 0x7fafc416d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 -- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafc4159c60 msgr2=0x7fafc416d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafc4159c60 0x7fafc416d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 -- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc415db10 msgr2=0x7fafc416d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc415db10 0x7fafc416d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 -- 172.21.15.22:0/2794738727 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb8009420 con 0x7fafc4159890 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9204700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafc4159c60 0x7fafc416d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafca206700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc415db10 0x7fafc416d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc9a05700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 0x7fafc4150ec0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fafb400d1d0 tx=0x7fafb4009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400de70 con 0x7fafc4159890 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400f040 con 0x7fafc4159890 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc4154300 con 0x7fafc4159890 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.187+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4015670 con 0x7fafc4159890 2023-10-08T00:32:36.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.188+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc4151400 con 0x7fafc4159890 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.189+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc404c3c0 con 0x7fafc4159890 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.189+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fafb4015a60 con 0x7fafc4159890 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.189+0000 7fafc1ffb700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fafb0067320 0x7fafb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.190+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fafb4085350 con 0x7fafc4159890 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.190+0000 7fafc9204700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fafb0067320 0x7fafb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.190+0000 7fafc9204700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fafb0067320 0x7fafb00697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fafc40d00d0 tx=0x7fafb8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:36.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.194+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafb404e5a0 con 0x7fafc4159890 2023-10-08T00:32:36.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.433+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000556960"} v 0) v1 -- 0x7fafc40b0120 con 0x7fafc4159890 2023-10-08T00:32:36.437 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:32:36.433+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:32:36.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.437+0000 7fafc1ffb700 1 -- 172.21.15.22:0/2794738727 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000556960"}]=0 volume_0000000000556960 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) v1 ==== 195+0+0 (secure 0 0 0) 0x7fafb4051ea0 con 0x7fafc4159890 2023-10-08T00:32:36.440 INFO:tasks.ceph.mds.b.smithi192.stderr: -743> 2023-10-08T00:32:23.461+0000 7f7c7f176700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fafb0067320 msgr2=0x7fafb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fafb0067320 0x7fafb00697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fafc40d00d0 tx=0x7fafb8017000 comp rx=0 tx=0).stop 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 msgr2=0x7fafc4150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 0x7fafc4150ec0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fafb400d1d0 tx=0x7fafb4009a90 comp rx=0 tx=0).stop 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 shutdown_connections 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc415db10 0x7fafc416d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fafc4159890 0x7fafc4150ec0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fafb0067320 0x7fafb00697d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 --2- 172.21.15.22:0/2794738727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fafc4159c60 0x7fafc416d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 >> 172.21.15.22:0/2794738727 conn(0x7fafc4068e20 msgr2=0x7fafc4152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 shutdown_connections 2023-10-08T00:32:36.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.439+0000 7fafcbc69700 1 -- 172.21.15.22:0/2794738727 wait complete. 2023-10-08T00:32:36.444 INFO:teuthology.orchestra.run.smithi022.stderr:volume_0000000000556960 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:32:36.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000556960 --yes-i-really-mean-it 2023-10-08T00:32:36.462 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:32:36.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.573+0000 7f24ae59d700 1 Processor -- start 2023-10-08T00:32:36.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.573+0000 7f24ae59d700 1 -- start start 2023-10-08T00:32:36.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24ae59d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b16d0 0x7f24a80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.576 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24ae59d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24a80b33b0 0x7f24a80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24ae59d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a80b2080 con 0x7f24a80b4e70 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24ae59d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80cfb00 con 0x7f24a80b33b0 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24ae59d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80b5c40 con 0x7f24a80b16d0 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24add9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24a80b33b0 0x7f24a80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24add9c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f24a80b33b0 0x7f24a80b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50218/0 (socket says 172.21.15.22:50218) 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24add9c700 1 -- 172.21.15.22:0/2506553417 learned_addr learned my addr 172.21.15.22:0/2506553417 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.574+0000 7f24acd9a700 1 --2- 172.21.15.22:0/2506553417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b16d0 0x7f24a80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24add9c700 1 -- 172.21.15.22:0/2506553417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b16d0 msgr2=0x7f24a80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24add9c700 1 --2- 172.21.15.22:0/2506553417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b16d0 0x7f24a80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24a7fff700 1 -- 172.21.15.22:0/2506553417 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745795015 0 0) 0x7f24a80b2080 con 0x7f24a80b4e70 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24add9c700 1 -- 172.21.15.22:0/2506553417 >> v1:172.21.15.192:6789/0 conn(0x7f24a80b4e70 legacy=0x7f24a80ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.577 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24add9c700 1 -- 172.21.15.22:0/2506553417 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80b5f20 con 0x7f24a80b33b0 2023-10-08T00:32:36.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24add9c700 1 --2- 172.21.15.22:0/2506553417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b33b0 0x7f24a80b3830 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2498009f20 tx=0x7f2498009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58cfef2213a4f5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:36.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24a7fff700 1 -- 172.21.15.22:0/2506553417 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800e070 con 0x7f24a80b33b0 2023-10-08T00:32:36.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24a7fff700 1 -- 172.21.15.22:0/2506553417 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800b9d0 con 0x7f24a80b33b0 2023-10-08T00:32:36.578 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24a7fff700 1 -- 172.21.15.22:0/2506553417 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24980092e0 con 0x7f24a80b33b0 2023-10-08T00:32:36.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24ae59d700 1 -- 172.21.15.22:0/2506553417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b33b0 msgr2=0x7f24a80b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24ae59d700 1 --2- 172.21.15.22:0/2506553417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b33b0 0x7f24a80b3830 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f2498009f20 tx=0x7f2498009840 comp rx=0 tx=0).stop 2023-10-08T00:32:36.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24ae59d700 1 -- 172.21.15.22:0/2506553417 shutdown_connections 2023-10-08T00:32:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24ae59d700 1 --2- 172.21.15.22:0/2506553417 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b33b0 0x7f24a80b3830 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24ae59d700 1 --2- 172.21.15.22:0/2506553417 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b16d0 0x7f24a80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.575+0000 7f24ae59d700 1 -- 172.21.15.22:0/2506553417 >> 172.21.15.22:0/2506553417 conn(0x7f24a80d10c0 msgr2=0x7f24a80affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:36.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.576+0000 7f24ae59d700 1 -- 172.21.15.22:0/2506553417 shutdown_connections 2023-10-08T00:32:36.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.576+0000 7f24ae59d700 1 -- 172.21.15.22:0/2506553417 wait complete. 2023-10-08T00:32:36.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.577+0000 7f24ae59d700 1 Processor -- start 2023-10-08T00:32:36.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.577+0000 7f24ae59d700 1 -- start start 2023-10-08T00:32:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.577+0000 7f24ae59d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 0x7f24a80ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.577+0000 7f24ae59d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a80b33b0 0x7f24a8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ae59d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b4e70 0x7f24a8068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.585 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ae59d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c6660 con 0x7f24a80b16d0 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ae59d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a816dfa0 con 0x7f24a80b33b0 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ae59d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80c5d30 con 0x7f24a80b4e70 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 0x7f24a80ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 0x7f24a80ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50220/0 (socket says 172.21.15.22:50220) 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 -- 172.21.15.22:0/1969815118 learned_addr learned my addr 172.21.15.22:0/1969815118 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24acd9a700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a80b33b0 0x7f24a8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24add9c700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b4e70 0x7f24a8068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 -- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b4e70 msgr2=0x7f24a8068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b4e70 0x7f24a8068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 -- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a80b33b0 msgr2=0x7f24a8068a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a80b33b0 0x7f24a8068a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 -- 172.21.15.22:0/1969815118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498009ae0 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ad59b700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 0x7f24a80ca250 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f24a000c530 tx=0x7f24a000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0011590 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0011710 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0011ad0 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a80c6010 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.578+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80ca790 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.579+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a8088990 con 0x7f24a80b16d0 2023-10-08T00:32:36.587 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.580+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24a001b3b0 con 0x7f24a80b16d0 2023-10-08T00:32:36.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.580+0000 7f24a57fa700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067320 0x7f24940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:36.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.580+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f24a00841f0 con 0x7f24a80b16d0 2023-10-08T00:32:36.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.580+0000 7f24acd9a700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067320 0x7f24940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:36.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.581+0000 7f24acd9a700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067320 0x7f24940697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f24a80c7b40 tx=0x7f249c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:36.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.584+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24a0050de0 con 0x7f24a80b16d0 2023-10-08T00:32:36.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:36.822+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000556960", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f24a804bb80 con 0x7f24a80b16d0 2023-10-08T00:32:37.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.440+0000 7f24a57fa700 1 -- 172.21.15.22:0/1969815118 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000556960", "yes_i_really_mean_it": true}]=0 v100) v1 ==== 121+0+0 (secure 0 0 0) 0x7f24a00170c0 con 0x7f24a80b16d0 2023-10-08T00:32:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067320 msgr2=0x7f24940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067320 0x7f24940697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f24a80c7b40 tx=0x7f249c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 msgr2=0x7f24a80ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 0x7f24a80ca250 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f24a000c530 tx=0x7f24a000c840 comp rx=0 tx=0).stop 2023-10-08T00:32:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 shutdown_connections 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2494067320 0x7f24940697d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24a80b4e70 0x7f24a8068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24a80b16d0 0x7f24a80ca250 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 --2- 172.21.15.22:0/1969815118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24a80b33b0 0x7f24a8068a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 >> 172.21.15.22:0/1969815118 conn(0x7f24a80d10c0 msgr2=0x7f24a8158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 shutdown_connections 2023-10-08T00:32:37.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.442+0000 7f24ae59d700 1 -- 172.21.15.22:0/1969815118 wait complete. 2023-10-08T00:32:37.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000556960.meta cephfs.volume_0000000000556960.meta --yes-i-really-really-mean-it 2023-10-08T00:32:37.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.587+0000 7f9defe2b700 1 Processor -- start 2023-10-08T00:32:37.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.588+0000 7f9defe2b700 1 -- start start 2023-10-08T00:32:37.591 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.588+0000 7f9defe2b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9de8159ec0 0x7f9de80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.588+0000 7f9defe2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de80b53d0 0x7f9de80cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.588+0000 7f9defe2b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de80b5b00 con 0x7f9de80cce40 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.588+0000 7f9defe2b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de80b5850 con 0x7f9de8159ec0 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.588+0000 7f9defe2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80b5da0 con 0x7f9de80b53d0 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9de8159ec0 0x7f9de80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9de8159ec0 0x7f9de80b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52874/0 (socket says 172.21.15.22:52874) 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 -- 172.21.15.22:0/182996301 learned_addr learned my addr 172.21.15.22:0/182996301 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9ded3c6700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de80b53d0 0x7f9de80cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 -- 172.21.15.22:0/182996301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de80b53d0 msgr2=0x7f9de80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:37.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de80b53d0 0x7f9de80cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 -- 172.21.15.22:0/182996301 >> v1:172.21.15.192:6789/0 conn(0x7f9de80cce40 legacy=0x7f9de80cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 -- 172.21.15.22:0/182996301 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de80b6080 con 0x7f9de8159ec0 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9ded3c6700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de80b53d0 0x7f9de80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9dedbc7700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8159ec0 0x7f9de80b4e90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009990 tx=0x7f9de0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2efc41bcaeb52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9decbc5700 1 -- 172.21.15.22:0/182996301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0005c10 con 0x7f9de8159ec0 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9decbc5700 1 -- 172.21.15.22:0/182996301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0005d70 con 0x7f9de8159ec0 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.589+0000 7f9decbc5700 1 -- 172.21.15.22:0/182996301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000b840 con 0x7f9de8159ec0 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 -- 172.21.15.22:0/182996301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8159ec0 msgr2=0x7f9de80b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:37.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8159ec0 0x7f9de80b4e90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009990 tx=0x7f9de0009220 comp rx=0 tx=0).stop 2023-10-08T00:32:37.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 -- 172.21.15.22:0/182996301 shutdown_connections 2023-10-08T00:32:37.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8159ec0 0x7f9de80b4e90 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 --2- 172.21.15.22:0/182996301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de80b53d0 0x7f9de80cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 -- 172.21.15.22:0/182996301 >> 172.21.15.22:0/182996301 conn(0x7f9de80999f0 msgr2=0x7f9de80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:37.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 -- 172.21.15.22:0/182996301 shutdown_connections 2023-10-08T00:32:37.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.590+0000 7f9defe2b700 1 -- 172.21.15.22:0/182996301 wait complete. 2023-10-08T00:32:37.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.591+0000 7f9defe2b700 1 Processor -- start 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.591+0000 7f9defe2b700 1 -- start start 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9defe2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de80b53d0 0x7f9de8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9defe2b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 0x7f9de815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9defe2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de8159ec0 0x7f9de8154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9defe2b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8155510 con 0x7f9de80cce40 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9defe2b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8154900 con 0x7f9de80b53d0 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9defe2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8154be0 con 0x7f9de8159ec0 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 0x7f9de815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 0x7f9de815d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52884/0 (socket says 172.21.15.22:52884) 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 -- 172.21.15.22:0/857124658 learned_addr learned my addr 172.21.15.22:0/857124658 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:37.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9dedbc7700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de80b53d0 0x7f9de8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9dee3c8700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de8159ec0 0x7f9de8154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 -- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de8159ec0 msgr2=0x7f9de8154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de8159ec0 0x7f9de8154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 -- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de80b53d0 msgr2=0x7f9de8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de80b53d0 0x7f9de8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 -- 172.21.15.22:0/857124658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0009480 con 0x7f9de80cce40 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9dedbc7700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de80b53d0 0x7f9de8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9dee3c8700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de8159ec0 0x7f9de8154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.592+0000 7f9ded3c6700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 0x7f9de815d4e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00c850 tx=0x7f9ddc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.593+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc011600 con 0x7f9de80cce40 2023-10-08T00:32:37.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.593+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc011760 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.593+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de8154ec0 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.593+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc011b00 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.593+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de8154560 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.594+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de8063c90 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.594+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9ddc0073b0 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.594+0000 7f9de5ffb700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9dd4067320 0x7f9dd40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.594+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f9ddc084da0 con 0x7f9de80cce40 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.595+0000 7f9dedbc7700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9dd4067320 0x7f9dd40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:37.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.595+0000 7f9dedbc7700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9dd4067320 0x7f9dd40697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9de00030c0 tx=0x7f9de0015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:37.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.599+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ddc055310 con 0x7f9de80cce40 2023-10-08T00:32:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:37.794+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000556960.meta", "pool2": "cephfs.volume_0000000000556960.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9de80718b0 con 0x7f9de80cce40 2023-10-08T00:32:38.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.445+0000 7f9de5ffb700 1 -- 172.21.15.22:0/857124658 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000556960.meta", "pool2": "cephfs.volume_0000000000556960.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000556960.meta' removed v146) v1 ==== 241+0+0 (secure 0 0 0) 0x7f9ddc01e100 con 0x7f9de80cce40 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9dd4067320 msgr2=0x7f9dd40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9dd4067320 0x7f9dd40697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9de00030c0 tx=0x7f9de0015000 comp rx=0 tx=0).stop 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 msgr2=0x7f9de815d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 0x7f9de815d4e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00c850 tx=0x7f9ddc008040 comp rx=0 tx=0).stop 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 shutdown_connections 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9dd4067320 0x7f9dd40697d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9de8159ec0 0x7f9de8154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9de80b53d0 0x7f9de8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 --2- 172.21.15.22:0/857124658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de80cce40 0x7f9de815d4e0 secure :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00c850 tx=0x7f9ddc008040 comp rx=0 tx=0).stop 2023-10-08T00:32:38.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 >> 172.21.15.22:0/857124658 conn(0x7f9de80999f0 msgr2=0x7f9de80ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:38.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 shutdown_connections 2023-10-08T00:32:38.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.449+0000 7f9defe2b700 1 -- 172.21.15.22:0/857124658 wait complete. 2023-10-08T00:32:38.453 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs.volume_0000000000556960.meta' removed 2023-10-08T00:32:38.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000556960.data cephfs.volume_0000000000556960.data --yes-i-really-really-mean-it 2023-10-08T00:32:38.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.599+0000 7f1e6a933700 1 Processor -- start 2023-10-08T00:32:38.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.599+0000 7f1e6a933700 1 -- start start 2023-10-08T00:32:38.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e6a933700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e64159ec0 0x7f1e640b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e6a933700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640b5b00 con 0x7f1e640b53d0 2023-10-08T00:32:38.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e6a933700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e640b5850 con 0x7f1e640cf350 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e6a933700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e640b5da0 con 0x7f1e64159ec0 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e637fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1e640b53d0 0x7f1e640cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49388/0 (socket says 172.21.15.22:49388) 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e637fe700 1 -- 172.21.15.22:0/119518408 learned_addr learned my addr 172.21.15.22:0/119518408 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e63fff700 1 --2- 172.21.15.22:0/119518408 >> v2:172.21.15.192:3300/0 conn(0x7f1e64159ec0 0x7f1e640b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017953988 0 0) 0x7f1e640b5b00 con 0x7f1e640b53d0 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e50003570 con 0x7f1e640b53d0 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418918776 0 0) 0x7f1e50003570 con 0x7f1e640b53d0 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 >> v2:172.21.15.192:3300/0 conn(0x7f1e64159ec0 msgr2=0x7f1e640b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:38.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 --2- 172.21.15.22:0/119518408 >> v2:172.21.15.192:3300/0 conn(0x7f1e64159ec0 0x7f1e640b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 >> v1:172.21.15.192:6789/0 conn(0x7f1e640cf350 legacy=0x7f1e640cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640b6080 con 0x7f1e640b53d0 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f1e54001470 con 0x7f1e640b53d0 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 >> v1:172.21.15.22:6789/0 conn(0x7f1e640b53d0 legacy=0x7f1e640cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e50003a60 0x7f1e50003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e50004810 0x7f1e50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.600+0000 7f1e62ffd700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e500051c0 0x7f1e5000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e640b5da0 con 0x7f1e50003a60 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5000c0d0 con 0x7f1e500051c0 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5000c290 con 0x7f1e50004810 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e50003a60 0x7f1e50003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e637fe700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e50004810 0x7f1e50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e68ed0700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e500051c0 0x7f1e5000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 -- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e50004810 msgr2=0x7f1e50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:38.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e50004810 0x7f1e50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 -- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e500051c0 msgr2=0x7f1e5000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e500051c0 0x7f1e5000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 -- 172.21.15.22:0/119518408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50003570 con 0x7f1e50003a60 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e68ed0700 1 -- 172.21.15.22:0/119518408 reap_dead start 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e63fff700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e50003a60 0x7f1e50003e70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009bf0 tx=0x7f1e4c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ead534e4fbd0a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c005a00 con 0x7f1e50003a60 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c005b60 con 0x7f1e50003a60 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.601+0000 7f1e62ffd700 1 -- 172.21.15.22:0/119518408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00e710 con 0x7f1e50003a60 2023-10-08T00:32:38.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 -- 172.21.15.22:0/119518408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e50003a60 msgr2=0x7f1e50003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e50003a60 0x7f1e50003e70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009bf0 tx=0x7f1e4c009120 comp rx=0 tx=0).stop 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 -- 172.21.15.22:0/119518408 shutdown_connections 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 --2- 172.21.15.22:0/119518408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e50003a60 0x7f1e50003e70 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 -- 172.21.15.22:0/119518408 >> 172.21.15.22:0/119518408 conn(0x7f1e640999f0 msgr2=0x7f1e640b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 -- 172.21.15.22:0/119518408 shutdown_connections 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.602+0000 7f1e6a933700 1 -- 172.21.15.22:0/119518408 wait complete. 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.603+0000 7f1e6a933700 1 Processor -- start 2023-10-08T00:32:38.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.603+0000 7f1e6a933700 1 -- start start 2023-10-08T00:32:38.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e50003a60 0x7f1e64152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e64153140 0x7f1e64169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 0x7f1e6416a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e641535b0 con 0x7f1e6416a3e0 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64155290 con 0x7f1e50003a60 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64155570 con 0x7f1e64153140 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 0x7f1e6416a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 0x7f1e6416a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52904/0 (socket says 172.21.15.22:52904) 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 -- 172.21.15.22:0/3594601571 learned_addr learned my addr 172.21.15.22:0/3594601571 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:38.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e637fe700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e64153140 0x7f1e64169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e63fff700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e50003a60 0x7f1e64152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 -- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e64153140 msgr2=0x7f1e64169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e64153140 0x7f1e64169ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 -- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e50003a60 msgr2=0x7f1e64152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e50003a60 0x7f1e64152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 -- 172.21.15.22:0/3594601571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64155850 con 0x7f1e6416a3e0 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e63fff700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e50003a60 0x7f1e64152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:38.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e637fe700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e64153140 0x7f1e64169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e68ed0700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 0x7f1e6416a830 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f1e640d06d0 tx=0x7f1e5c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c006db0 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c003030 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e64155b30 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.604+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0033f0 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.605+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6414f840 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.605+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e64063c90 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.606+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1e5c001790 con 0x7f1e6416a3e0 2023-10-08T00:32:38.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.606+0000 7f1e5bfff700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1e44067320 0x7f1e440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.606+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5394+0+0 (secure 0 0 0) 0x7f1e5c083ae0 con 0x7f1e6416a3e0 2023-10-08T00:32:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.606+0000 7f1e63fff700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1e44067320 0x7f1e440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.607+0000 7f1e63fff700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1e44067320 0x7f1e440697d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1e6416d200 tx=0x7f1e4c019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:38.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.610+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e5c0508a0 con 0x7f1e6416a3e0 2023-10-08T00:32:38.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:38.803+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000556960.data", "pool2": "cephfs.volume_0000000000556960.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e64155e60 con 0x7f1e6416a3e0 2023-10-08T00:32:39.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.449+0000 7f1e5bfff700 1 -- 172.21.15.22:0/3594601571 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000556960.data", "pool2": "cephfs.volume_0000000000556960.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000556960.data' removed v147) v1 ==== 241+0+0 (secure 0 0 0) 0x7f1e5c01d020 con 0x7f1e6416a3e0 2023-10-08T00:32:39.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.452+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1e44067320 msgr2=0x7f1e440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.452+0000 7f1e6a933700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1e44067320 0x7f1e440697d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1e6416d200 tx=0x7f1e4c019000 comp rx=0 tx=0).stop 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 msgr2=0x7f1e6416a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 0x7f1e6416a830 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f1e640d06d0 tx=0x7f1e5c009040 comp rx=0 tx=0).stop 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 shutdown_connections 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e6416a3e0 0x7f1e6416a830 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e50003a60 0x7f1e64152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1e44067320 0x7f1e440697d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 --2- 172.21.15.22:0/3594601571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e64153140 0x7f1e64169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 >> 172.21.15.22:0/3594601571 conn(0x7f1e640999f0 msgr2=0x7f1e64152250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 shutdown_connections 2023-10-08T00:32:39.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.453+0000 7f1e6a933700 1 -- 172.21.15.22:0/3594601571 wait complete. 2023-10-08T00:32:39.456 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs.volume_0000000000556960.data' removed 2023-10-08T00:32:39.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:32:39.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.591+0000 7f9b887c1700 1 Processor -- start 2023-10-08T00:32:39.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.592+0000 7f9b887c1700 1 -- start start 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.592+0000 7f9b887c1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9b80159890 0x7f9b8015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.592+0000 7f9b887c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 0x7f9b8015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b887c1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8015a160 con 0x7f9b8015db10 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b887c1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b800d13a0 con 0x7f9b80159890 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b887c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8015e140 con 0x7f9b80159c60 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b86d5e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9b8015db10 0x7f9b80069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49396/0 (socket says 172.21.15.22:49396) 2023-10-08T00:32:39.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b86d5e700 1 -- 172.21.15.22:0/2626116423 learned_addr learned my addr 172.21.15.22:0/2626116423 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b85d5c700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 0x7f9b8015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8655d700 1 --2- 172.21.15.22:0/2626116423 >> v2:172.21.15.192:3300/0 conn(0x7f9b80159890 0x7f9b8015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726192753 0 0) 0x7f9b8015a160 con 0x7f9b8015db10 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b68003570 con 0x7f9b8015db10 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992607084 0 0) 0x7f9b68003570 con 0x7f9b8015db10 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 msgr2=0x7f9b8015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 0x7f9b8015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 >> v2:172.21.15.192:3300/0 conn(0x7f9b80159890 msgr2=0x7f9b8015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 --2- 172.21.15.22:0/2626116423 >> v2:172.21.15.192:3300/0 conn(0x7f9b80159890 0x7f9b8015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8015a3d0 con 0x7f9b8015db10 2023-10-08T00:32:39.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f9b780017f0 con 0x7f9b8015db10 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 >> v1:172.21.15.22:6789/0 conn(0x7f9b8015db10 legacy=0x7f9b80069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 0x7f9b68003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b68003fe0 0x7f9b68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800d13a0 con 0x7f9b68004d50 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8015e140 con 0x7f9b68003fe0 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6800ba90 con 0x7f9b80159c60 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.593+0000 7f9b86d5e700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b8655d700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 0x7f9b68003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b85d5c700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b68003fe0 0x7f9b68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b86d5e700 1 -- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 msgr2=0x7f9b68003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:39.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b86d5e700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b80159c60 0x7f9b68003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b86d5e700 1 -- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b68003fe0 msgr2=0x7f9b68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b86d5e700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b68003fe0 0x7f9b68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b86d5e700 1 -- 172.21.15.22:0/2626116423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68003570 con 0x7f9b68004d50 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b86d5e700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b680051c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800a970 tx=0x7f9b78002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e565129708fd24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012440 con 0x7f9b68004d50 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780125c0 con 0x7f9b68004d50 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b8555b700 1 -- 172.21.15.22:0/2626116423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012980 con 0x7f9b68004d50 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.594+0000 7f9b887c1700 1 -- 172.21.15.22:0/2626116423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 msgr2=0x7f9b680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.595+0000 7f9b887c1700 1 --2- 172.21.15.22:0/2626116423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b680051c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800a970 tx=0x7f9b78002210 comp rx=0 tx=0).stop 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.595+0000 7f9b86d5e700 1 -- 172.21.15.22:0/2626116423 reap_dead start 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.595+0000 7f9b887c1700 1 -- 172.21.15.22:0/2626116423 shutdown_connections 2023-10-08T00:32:39.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.595+0000 7f9b887c1700 1 -- 172.21.15.22:0/2626116423 >> 172.21.15.22:0/2626116423 conn(0x7f9b80068e20 msgr2=0x7f9b800d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:39.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.595+0000 7f9b887c1700 1 -- 172.21.15.22:0/2626116423 shutdown_connections 2023-10-08T00:32:39.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.595+0000 7f9b887c1700 1 -- 172.21.15.22:0/2626116423 wait complete. 2023-10-08T00:32:39.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 Processor -- start 2023-10-08T00:32:39.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 -- start start 2023-10-08T00:32:39.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b800cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b800c78a0 0x7f9b800b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b800b3cc0 0x7f9b800b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b80142760 con 0x7f9b68004d50 2023-10-08T00:32:39.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800cf1f0 con 0x7f9b800c78a0 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.596+0000 7f9b887c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b800cabd0 con 0x7f9b800b3cc0 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b800cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b800cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52920/0 (socket says 172.21.15.22:52920) 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 -- 172.21.15.22:0/1263801299 learned_addr learned my addr 172.21.15.22:0/1263801299 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b86d5e700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b800b3cc0 0x7f9b800b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b85d5c700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b800c78a0 0x7f9b800b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 -- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b800b3cc0 msgr2=0x7f9b800b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b800b3cc0 0x7f9b800b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 -- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b800c78a0 msgr2=0x7f9b800b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b800c78a0 0x7f9b800b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 -- 172.21.15.22:0/1263801299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800cebe0 con 0x7f9b68004d50 2023-10-08T00:32:39.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b8655d700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b800cf680 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006ac0 tx=0x7f9b700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70011ec0 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7000f940 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b800ca8f0 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7000fcc0 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.597+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b800b5ed0 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.598+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800cf4d0 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.599+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9b70014650 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.599+0000 7f9b7e7fc700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9b6c067320 0x7f9b6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.599+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9b70018030 con 0x7f9b68004d50 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.599+0000 7f9b85d5c700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9b6c067320 0x7f9b6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.600+0000 7f9b85d5c700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9b6c067320 0x7f9b6c0697d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9b800b36f0 tx=0x7f9b740091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:39.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.603+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b700521e0 con 0x7f9b68004d50 2023-10-08T00:32:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.798+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9b8004c3c0 con 0x7f9b68004d50 2023-10-08T00:32:39.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.802+0000 7f9b7e7fc700 1 -- 172.21.15.22:0/1263801299 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9b70055800 con 0x7f9b68004d50 2023-10-08T00:32:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9b6c067320 msgr2=0x7f9b6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9b6c067320 0x7f9b6c0697d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9b800b36f0 tx=0x7f9b740091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 msgr2=0x7f9b800cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b800cf680 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006ac0 tx=0x7f9b700091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 shutdown_connections 2023-10-08T00:32:39.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9b6c067320 0x7f9b6c0697d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9b800b3cc0 0x7f9b800b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9b68004d50 0x7f9b800cf680 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 --2- 172.21.15.22:0/1263801299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b800c78a0 0x7f9b800b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 >> 172.21.15.22:0/1263801299 conn(0x7f9b80068e20 msgr2=0x7f9b801431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 shutdown_connections 2023-10-08T00:32:39.807 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.804+0000 7f9b887c1700 1 -- 172.21.15.22:0/1263801299 wait complete. 2023-10-08T00:32:39.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-08T00:32:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.935+0000 7f2809ebf700 1 Processor -- start 2023-10-08T00:32:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.935+0000 7f2809ebf700 1 -- start start 2023-10-08T00:32:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2809ebf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f280406c0f0 0x7f2804159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2809ebf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28040b3810 0x7f28040b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2809ebf700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2804143420 con 0x7f2804143050 2023-10-08T00:32:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2809ebf700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280406a1e0 con 0x7f28040b3810 2023-10-08T00:32:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2809ebf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040695d0 con 0x7f280406c0f0 2023-10-08T00:32:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f28096be700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f28040b3810 0x7f28040b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2808ebd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2804143050 0x7f280406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49410/0 (socket says 172.21.15.22:49410) 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.936+0000 7f2808ebd700 1 -- 172.21.15.22:0/1944490050 learned_addr learned my addr 172.21.15.22:0/1944490050 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2803fff700 1 --2- 172.21.15.22:0/1944490050 >> v2:172.21.15.192:3300/0 conn(0x7f280406c0f0 0x7f2804159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28096be700 1 -- 172.21.15.22:0/1944490050 >> v2:172.21.15.192:3300/0 conn(0x7f280406c0f0 msgr2=0x7f2804159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28096be700 1 --2- 172.21.15.22:0/1944490050 >> v2:172.21.15.192:3300/0 conn(0x7f280406c0f0 0x7f2804159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28096be700 1 -- 172.21.15.22:0/1944490050 >> v1:172.21.15.22:6789/0 conn(0x7f2804143050 legacy=0x7f280406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28096be700 1 -- 172.21.15.22:0/1944490050 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040698b0 con 0x7f28040b3810 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28096be700 1 --2- 172.21.15.22:0/1944490050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28040b3810 0x7f28040b3c30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f280406ca20 tx=0x7f27f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbf5083d383a408 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28037fe700 1 -- 172.21.15.22:0/1944490050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400b6b0 con 0x7f28040b3810 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28037fe700 1 -- 172.21.15.22:0/1944490050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f400b810 con 0x7f28040b3810 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f28037fe700 1 -- 172.21.15.22:0/1944490050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400bbb0 con 0x7f28040b3810 2023-10-08T00:32:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2809ebf700 1 -- 172.21.15.22:0/1944490050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28040b3810 msgr2=0x7f28040b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2809ebf700 1 --2- 172.21.15.22:0/1944490050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28040b3810 0x7f28040b3c30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f280406ca20 tx=0x7f27f40091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2809ebf700 1 -- 172.21.15.22:0/1944490050 shutdown_connections 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2809ebf700 1 --2- 172.21.15.22:0/1944490050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28040b3810 0x7f28040b3c30 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2809ebf700 1 --2- 172.21.15.22:0/1944490050 >> v2:172.21.15.192:3300/0 conn(0x7f280406c0f0 0x7f2804159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.937+0000 7f2809ebf700 1 -- 172.21.15.22:0/1944490050 >> 172.21.15.22:0/1944490050 conn(0x7f28040ce430 msgr2=0x7f28040ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.938+0000 7f2809ebf700 1 -- 172.21.15.22:0/1944490050 shutdown_connections 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.938+0000 7f2809ebf700 1 -- 172.21.15.22:0/1944490050 wait complete. 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.939+0000 7f2809ebf700 1 Processor -- start 2023-10-08T00:32:39.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.939+0000 7f2809ebf700 1 -- start start 2023-10-08T00:32:39.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.939+0000 7f2809ebf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 0x7f280416d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28040b3810 0x7f280416d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2804143050 0x7f280415e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804159730 con 0x7f280406c0f0 2023-10-08T00:32:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280416b890 con 0x7f2804143050 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280415b4b0 con 0x7f28040b3810 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 0x7f280416d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 0x7f280416d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52938/0 (socket says 172.21.15.22:52938) 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 -- 172.21.15.22:0/2410426356 learned_addr learned my addr 172.21.15.22:0/2410426356 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f28096be700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2804143050 0x7f280415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2803fff700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28040b3810 0x7f280416d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 -- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28040b3810 msgr2=0x7f280416d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28040b3810 0x7f280416d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 -- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2804143050 msgr2=0x7f280415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2804143050 0x7f280415e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 -- 172.21.15.22:0/2410426356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4009420 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2808ebd700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 0x7f280416d390 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c910 tx=0x7f27fc0016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc005d80 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00a590 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280416af60 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00a950 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.940+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280416b520 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.941+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280404c3c0 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.942+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f27fc00ad40 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.942+0000 7f2800ff9700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27f0067320 0x7f27f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.942+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f27fc0846f0 con 0x7f280406c0f0 2023-10-08T00:32:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.942+0000 7f2803fff700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27f0067320 0x7f27f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.943+0000 7f2803fff700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27f0067320 0x7f27f00697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f28040c90b0 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:39.946+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27fc0517b0 con 0x7f280406c0f0 2023-10-08T00:32:40.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.222+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f2804069b90 con 0x7f280406c0f0 2023-10-08T00:32:40.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.450+0000 7f2800ff9700 1 -- 172.21.15.22:0/2410426356 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v386) v1 ==== 135+0+0 (secure 0 0 0) 0x7f27fc054dd0 con 0x7f280406c0f0 2023-10-08T00:32:40.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27f0067320 msgr2=0x7f27f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:40.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27f0067320 0x7f27f00697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f28040c90b0 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:40.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 msgr2=0x7f280416d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:40.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 0x7f280416d390 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c910 tx=0x7f27fc0016e0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 shutdown_connections 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2804143050 0x7f280415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280406c0f0 0x7f280416d390 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f27f0067320 0x7f27f00697d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 --2- 172.21.15.22:0/2410426356 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28040b3810 0x7f280416d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 >> 172.21.15.22:0/2410426356 conn(0x7f28040ce430 msgr2=0x7f280413f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 shutdown_connections 2023-10-08T00:32:40.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.452+0000 7f2809ebf700 1 -- 172.21.15.22:0/2410426356 wait complete. 2023-10-08T00:32:40.466 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. ... ok 2023-10-08T00:32:40.466 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) That renaming volume fails without --yes-i-really-mean-it flag. 2023-10-08T00:32:40.466 INFO:tasks.cephfs_test_runner:test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:32:40.467 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-08T00:32:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.585+0000 7f3526c43700 1 Processor -- start 2023-10-08T00:32:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.585+0000 7f3526c43700 1 -- start start 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f3526c43700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3520159c60 0x7f352015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f3526c43700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f352015db10 0x7f3520069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f3526c43700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352015a160 con 0x7f3520159890 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f3526c43700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352015df50 con 0x7f3520159c60 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f3526c43700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35200d13a0 con 0x7f352015db10 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3520159c60 0x7f352015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f35249df700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3520159890 0x7f352015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49418/0 (socket says 172.21.15.22:49418) 2023-10-08T00:32:40.588 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3520159c60 0x7f352015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52950/0 (socket says 172.21.15.22:52950) 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f35249df700 1 -- 172.21.15.22:0/1097289579 learned_addr learned my addr 172.21.15.22:0/1097289579 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f35251e0700 1 --2- 172.21.15.22:0/1097289579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f352015db10 0x7f3520069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 -- 172.21.15.22:0/1097289579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f352015db10 msgr2=0x7f3520069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 --2- 172.21.15.22:0/1097289579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f352015db10 0x7f3520069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 -- 172.21.15.22:0/1097289579 >> v1:172.21.15.22:6789/0 conn(0x7f3520159890 legacy=0x7f352015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 -- 172.21.15.22:0/1097289579 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352015e140 con 0x7f3520159c60 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351f7fe700 1 -- 172.21.15.22:0/1097289579 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197758648 0 0) 0x7f352015a160 con 0x7f3520159890 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351ffff700 1 --2- 172.21.15.22:0/1097289579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3520159c60 0x7f352015d5d0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f350c0098e0 tx=0x7f350c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ddc2cc7acb652a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.586+0000 7f351f7fe700 1 -- 172.21.15.22:0/1097289579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c009e80 con 0x7f3520159c60 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f351f7fe700 1 -- 172.21.15.22:0/1097289579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c00b860 con 0x7f3520159c60 2023-10-08T00:32:40.589 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f351f7fe700 1 -- 172.21.15.22:0/1097289579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00bbe0 con 0x7f3520159c60 2023-10-08T00:32:40.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 -- 172.21.15.22:0/1097289579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3520159c60 msgr2=0x7f352015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:40.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 --2- 172.21.15.22:0/1097289579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3520159c60 0x7f352015d5d0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f350c0098e0 tx=0x7f350c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 -- 172.21.15.22:0/1097289579 shutdown_connections 2023-10-08T00:32:40.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 --2- 172.21.15.22:0/1097289579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f352015db10 0x7f3520069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 --2- 172.21.15.22:0/1097289579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3520159c60 0x7f352015d5d0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 -- 172.21.15.22:0/1097289579 >> 172.21.15.22:0/1097289579 conn(0x7f3520068e20 msgr2=0x7f35200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 -- 172.21.15.22:0/1097289579 shutdown_connections 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.587+0000 7f3526c43700 1 -- 172.21.15.22:0/1097289579 wait complete. 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.588+0000 7f3526c43700 1 Processor -- start 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.588+0000 7f3526c43700 1 -- start start 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f3526c43700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3520159890 0x7f3520145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f3526c43700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3520159c60 0x7f35200c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f3526c43700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 0x7f3520146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f3526c43700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200c6770 con 0x7f352015db10 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f3526c43700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3520152600 con 0x7f3520159890 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f3526c43700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35200c5f10 con 0x7f3520159c60 2023-10-08T00:32:40.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f35251e0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 0x7f3520146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f35251e0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 0x7f3520146350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52954/0 (socket says 172.21.15.22:52954) 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f35251e0700 1 -- 172.21.15.22:0/3643868541 learned_addr learned my addr 172.21.15.22:0/3643868541 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f351ffff700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3520159c60 0x7f35200c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.589+0000 7f35249df700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3520159890 0x7f3520145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f35251e0700 1 -- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3520159c60 msgr2=0x7f35200c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f35251e0700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3520159c60 0x7f35200c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f35251e0700 1 -- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3520159890 msgr2=0x7f3520145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f35251e0700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3520159890 0x7f3520145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f35251e0700 1 -- 172.21.15.22:0/3643868541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009420 con 0x7f352015db10 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f35251e0700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 0x7f3520146350 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f3518007f20 tx=0x7f3518009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351800eb90 con 0x7f352015db10 2023-10-08T00:32:40.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351800ed10 con 0x7f352015db10 2023-10-08T00:32:40.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3520151ff0 con 0x7f352015db10 2023-10-08T00:32:40.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518014670 con 0x7f352015db10 2023-10-08T00:32:40.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.590+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35200c61b0 con 0x7f352015db10 2023-10-08T00:32:40.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.591+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3520152790 con 0x7f352015db10 2023-10-08T00:32:40.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.591+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f35180149e0 con 0x7f352015db10 2023-10-08T00:32:40.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.592+0000 7f351cff9700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3504067320 0x7f35040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:40.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.592+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3518084f70 con 0x7f352015db10 2023-10-08T00:32:40.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.592+0000 7f35249df700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3504067320 0x7f35040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:40.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.593+0000 7f35249df700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3504067320 0x7f35040697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3514007fd0 tx=0x7f3514007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:40.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.596+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3518051f00 con 0x7f352015db10 2023-10-08T00:32:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:40.869+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f352004c3c0 con 0x7f352015db10 2023-10-08T00:32:41.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.454+0000 7f351cff9700 1 -- 172.21.15.22:0/3643868541 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v387) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3518055520 con 0x7f352015db10 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3504067320 msgr2=0x7f35040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3504067320 0x7f35040697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3514007fd0 tx=0x7f3514007d30 comp rx=0 tx=0).stop 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 msgr2=0x7f3520146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 0x7f3520146350 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f3518007f20 tx=0x7f3518009860 comp rx=0 tx=0).stop 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 shutdown_connections 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f352015db10 0x7f3520146350 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3520159890 0x7f3520145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3504067320 0x7f35040697d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 --2- 172.21.15.22:0/3643868541 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3520159c60 0x7f35200c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 >> 172.21.15.22:0/3643868541 conn(0x7f3520068e20 msgr2=0x7f3520156e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 shutdown_connections 2023-10-08T00:32:41.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.456+0000 7f3526c43700 1 -- 172.21.15.22:0/3643868541 wait complete. 2023-10-08T00:32:41.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:32:41.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.591+0000 7f01c0eb6700 1 Processor -- start 2023-10-08T00:32:41.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.591+0000 7f01c0eb6700 1 -- start start 2023-10-08T00:32:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.592+0000 7f01c0eb6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 0x7f01bc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.592+0000 7f01c0eb6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f01bc15df50 0x7f01bc15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.592+0000 7f01c0eb6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc15d7e0 con 0x7f01bc06bcd0 2023-10-08T00:32:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.592+0000 7f01c0eb6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc15dac0 con 0x7f01bc15df50 2023-10-08T00:32:41.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.592+0000 7f01c0eb6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc15aa30 con 0x7f01bc06c0a0 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01bad9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f01bc15df50 0x7f01bc15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01b9d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 0x7f01bc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01b9d9b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 0x7f01bc0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:49772/0 (socket says 172.21.15.22:49772) 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01bad9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f01bc15df50 0x7f01bc15e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:43622/0 (socket says 172.21.15.22:43622) 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01b9d9b700 1 -- 172.21.15.22:0/1057102878 learned_addr learned my addr 172.21.15.22:0/1057102878 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01bad9d700 1 -- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 msgr2=0x7f01bc0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01bad9d700 1 --2- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 0x7f01bc0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01bad9d700 1 -- 172.21.15.22:0/1057102878 >> v1:172.21.15.192:6789/0 conn(0x7f01bc06bcd0 legacy=0x7f01bc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01b959a700 1 -- 172.21.15.22:0/1057102878 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123357809 0 0) 0x7f01bc15d7e0 con 0x7f01bc06bcd0 2023-10-08T00:32:41.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01bad9d700 1 -- 172.21.15.22:0/1057102878 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc15ad10 con 0x7f01bc15df50 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.593+0000 7f01b9d9b700 1 --2- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 0x7f01bc0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01bad9d700 1 --2- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc15df50 0x7f01bc15e3c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009e60 tx=0x7f01ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51d7b2440893ae34 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01b959a700 1 -- 172.21.15.22:0/1057102878 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00e070 con 0x7f01bc15df50 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01b959a700 1 -- 172.21.15.22:0/1057102878 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac00bb60 con 0x7f01bc15df50 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01b959a700 1 -- 172.21.15.22:0/1057102878 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac012430 con 0x7f01bc15df50 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 -- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc15df50 msgr2=0x7f01bc15e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc15df50 0x7f01bc15e3c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009e60 tx=0x7f01ac009780 comp rx=0 tx=0).stop 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 -- 172.21.15.22:0/1057102878 shutdown_connections 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc15df50 0x7f01bc15e3c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/1057102878 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06c0a0 0x7f01bc0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 -- 172.21.15.22:0/1057102878 >> 172.21.15.22:0/1057102878 conn(0x7f01bc0ce600 msgr2=0x7f01bc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:41.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 -- 172.21.15.22:0/1057102878 shutdown_connections 2023-10-08T00:32:41.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.594+0000 7f01c0eb6700 1 -- 172.21.15.22:0/1057102878 wait complete. 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 Processor -- start 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 -- start start 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06bcd0 0x7f01bc0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc06c0a0 0x7f01bc149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 0x7f01bc158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0c7190 con 0x7f01bc15df50 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0c6580 con 0x7f01bc06c0a0 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01c0eb6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0c6860 con 0x7f01bc06bcd0 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.596+0000 7f01bad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 0x7f01bc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 0x7f01bc158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52962/0 (socket says 172.21.15.22:52962) 2023-10-08T00:32:41.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 -- 172.21.15.22:0/2951097034 learned_addr learned my addr 172.21.15.22:0/2951097034 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01b9d9b700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc06c0a0 0x7f01bc149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01ba59c700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06bcd0 0x7f01bc0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 -- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06bcd0 msgr2=0x7f01bc0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06bcd0 0x7f01bc0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 -- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc06c0a0 msgr2=0x7f01bc149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc06c0a0 0x7f01bc149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 -- 172.21.15.22:0/2951097034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40094f0 con 0x7f01bc15df50 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01bad9d700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 0x7f01bc158db0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f01bc069220 tx=0x7f01ac019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac012e60 con 0x7f01bc15df50 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac025440 con 0x7f01bc15df50 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac009a20 con 0x7f01bc15df50 2023-10-08T00:32:41.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0257e0 con 0x7f01bc15df50 2023-10-08T00:32:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.597+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc0c6e20 con 0x7f01bc15df50 2023-10-08T00:32:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.598+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc04c3c0 con 0x7f01bc15df50 2023-10-08T00:32:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.599+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f01ac003050 con 0x7f01bc15df50 2023-10-08T00:32:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.599+0000 7f01b27fc700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f019c067320 0x7f019c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:41.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.599+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f01ac086730 con 0x7f01bc15df50 2023-10-08T00:32:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.599+0000 7f01ba59c700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f019c067320 0x7f019c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:41.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.600+0000 7f01ba59c700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f019c067320 0x7f019c0697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f01b4003a40 tx=0x7f01b4007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:41.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.603+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01ac0535b0 con 0x7f01bc15df50 2023-10-08T00:32:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.795+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f01bc15aff0 con 0x7f01bc15df50 2023-10-08T00:32:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.799+0000 7f01b27fc700 1 -- 172.21.15.22:0/2951097034 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f01ac056bd0 con 0x7f01bc15df50 2023-10-08T00:32:41.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.800+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f019c067320 msgr2=0x7f019c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.800+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f019c067320 0x7f019c0697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f01b4003a40 tx=0x7f01b4007ec0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.800+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 msgr2=0x7f01bc158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.800+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 0x7f01bc158db0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f01bc069220 tx=0x7f01ac019000 comp rx=0 tx=0).stop 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 shutdown_connections 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01bc15df50 0x7f01bc158db0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f019c067320 0x7f019c0697d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f01bc06bcd0 0x7f01bc0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 --2- 172.21.15.22:0/2951097034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f01bc06c0a0 0x7f01bc149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 >> 172.21.15.22:0/2951097034 conn(0x7f01bc0ce600 msgr2=0x7f01bc069970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 shutdown_connections 2023-10-08T00:32:41.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:41.801+0000 7f01c0eb6700 1 -- 172.21.15.22:0/2951097034 wait complete. 2023-10-08T00:32:41.814 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:32:41.814 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:41.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:32:41.893 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:32:41.894 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:32:41.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:42.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.012+0000 7ff6caa90700 1 Processor -- start 2023-10-08T00:32:42.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.012+0000 7ff6caa90700 1 -- start start 2023-10-08T00:32:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6caa90700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c40b3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6caa90700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40b40f0 con 0x7ff6c406c0f0 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6caa90700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c4069640 con 0x7ff6c40ad870 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6caa90700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4069920 con 0x7ff6c4142ea0 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6ca28f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff6c406c0f0 0x7ff6c406a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49426/0 (socket says 172.21.15.22:49426) 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6ca28f700 1 -- 172.21.15.22:0/2681407446 learned_addr learned my addr 172.21.15.22:0/2681407446 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6c9a8e700 1 --2- 172.21.15.22:0/2681407446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c40b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195683576 0 0) 0x7ff6c40b40f0 con 0x7ff6c406c0f0 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.013+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ac003570 con 0x7ff6c406c0f0 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264041540 0 0) 0x7ff6c4069640 con 0x7ff6c40ad870 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c40b40f0 con 0x7ff6c40ad870 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3171772893 0 0) 0x7ff6ac003570 con 0x7ff6c406c0f0 2023-10-08T00:32:42.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/2681407446 >> v1:172.21.15.192:6789/0 conn(0x7ff6c40ad870 legacy=0x7ff6c406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/2681407446 >> v1:172.21.15.22:6789/0 conn(0x7ff6c406c0f0 legacy=0x7ff6c406a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/2681407446 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4069c00 con 0x7ff6c4142ea0 2023-10-08T00:32:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c9a8e700 1 --2- 172.21.15.22:0/2681407446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c40b3630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009910 tx=0x7ff6bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4df9e67e6b30b2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40017f0 con 0x7ff6c4142ea0 2023-10-08T00:32:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc011420 con 0x7ff6c4142ea0 2023-10-08T00:32:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.014+0000 7ff6c8a8c700 1 -- 172.21.15.22:0/2681407446 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0117a0 con 0x7ff6c4142ea0 2023-10-08T00:32:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 -- 172.21.15.22:0/2681407446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 msgr2=0x7ff6c40b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 --2- 172.21.15.22:0/2681407446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c40b3630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009910 tx=0x7ff6bc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 -- 172.21.15.22:0/2681407446 shutdown_connections 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 --2- 172.21.15.22:0/2681407446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c40b3630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 -- 172.21.15.22:0/2681407446 >> 172.21.15.22:0/2681407446 conn(0x7ff6c40ce430 msgr2=0x7ff6c40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 -- 172.21.15.22:0/2681407446 shutdown_connections 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.015+0000 7ff6caa90700 1 -- 172.21.15.22:0/2681407446 wait complete. 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 Processor -- start 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 -- start start 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 0x7ff6c40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c413e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c4141910 0x7ff6c40cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415d480 con 0x7ff6c406c0f0 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415d760 con 0x7ff6c4141910 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.016+0000 7ff6caa90700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c415da40 con 0x7ff6c4142ea0 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 0x7ff6c40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 0x7ff6c40c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52972/0 (socket says 172.21.15.22:52972) 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/3830120004 learned_addr learned my addr 172.21.15.22:0/3830120004 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c928d700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c413e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6ca28f700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c4141910 0x7ff6c40cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 msgr2=0x7ff6c413e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c413e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c4141910 msgr2=0x7ff6c40cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c4141910 0x7ff6c40cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 -- 172.21.15.22:0/3830120004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc009420 con 0x7ff6c406c0f0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c928d700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c413e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c9a8e700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 0x7ff6c40c75e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009860 tx=0x7ff6bc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc01cc50 con 0x7ff6c406c0f0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc01cdb0 con 0x7ff6c406c0f0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c415dd20 con 0x7ff6c406c0f0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc01a6a0 con 0x7ff6c406c0f0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.017+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c413e730 con 0x7ff6c406c0f0 2023-10-08T00:32:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.018+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c404c3c0 con 0x7ff6c406c0f0 2023-10-08T00:32:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.019+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff6bc01aad0 con 0x7ff6c406c0f0 2023-10-08T00:32:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.019+0000 7ff6c1ffb700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff6b00673a0 0x7ff6b0069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.019+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff6bc086310 con 0x7ff6c406c0f0 2023-10-08T00:32:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.020+0000 7ff6c928d700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff6b00673a0 0x7ff6b0069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.020+0000 7ff6c928d700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff6b00673a0 0x7ff6b0069850 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40ca660 tx=0x7ff6b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.024+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6bc053260 con 0x7ff6c406c0f0 2023-10-08T00:32:42.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.261+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6c413fe40 con 0x7ff6c406c0f0 2023-10-08T00:32:42.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.261+0000 7ff6c1ffb700 1 -- 172.21.15.22:0/3830120004 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+3537 (secure 0 0 0) 0x7ff6bc056880 con 0x7ff6c406c0f0 2023-10-08T00:32:42.263 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:42.263 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":100,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6880,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3211320162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3211320162},{"type":"v1","addr":"172.21.15.192:6836","nonce":3211320162}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7114,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1766813988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1766813988},{"type":"v1","addr":"172.21.15.192:6837","nonce":1766813988}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":7566,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/1550999544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":1550999544},{"type":"v1","addr":"172.21.15.22:6834","nonce":1550999544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3769528778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3769528778},{"type":"v1","addr":"172.21.15.22:6835","nonce":3769528778}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":91}],"filesystems":[]} 2023-10-08T00:32:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff6b00673a0 msgr2=0x7ff6b0069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff6b00673a0 0x7ff6b0069850 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40ca660 tx=0x7ff6b8009040 comp rx=0 tx=0).stop 2023-10-08T00:32:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 msgr2=0x7ff6c40c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 0x7ff6c40c75e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009860 tx=0x7ff6bc016000 comp rx=0 tx=0).stop 2023-10-08T00:32:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 shutdown_connections 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6c4141910 0x7ff6c40cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6c406c0f0 0x7ff6c40c75e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff6b00673a0 0x7ff6b0069850 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 --2- 172.21.15.22:0/3830120004 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff6c4142ea0 0x7ff6c413e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 >> 172.21.15.22:0/3830120004 conn(0x7ff6c40ce430 msgr2=0x7ff6c4142190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.263+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 shutdown_connections 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.264+0000 7ff6caa90700 1 -- 172.21.15.22:0/3830120004 wait complete. 2023-10-08T00:32:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 100 2023-10-08T00:32:42.277 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:32:42.278 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:32:42.278 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:32:42.278 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:42.278 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:32:42.278 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:32:42.279 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:32:42.279 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:42.279 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:32:42.279 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:32:42.279 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:32:42.279 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:42.280 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:32:42.280 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:32:42.280 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:32:42.280 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:32:42.287 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:32:42.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:32:42.287 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:32:42.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:32:42.290 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:32:42.290 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:32:42.291 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:32:42.291 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:32:42.329 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:32:42.330 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:42.330 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:32:42.331 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:42.332 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:32:42.333 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:42.333 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:32:42.333 DEBUG:teuthology.parallel:result is None 2023-10-08T00:32:42.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:32:42.406 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:32:42.406 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:32:42.413 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:32:42.414 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:32:42.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.457+0000 7f1f00b35700 1 Processor -- start 2023-10-08T00:32:42.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.457+0000 7f1f00b35700 1 -- start start 2023-10-08T00:32:42.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.458+0000 7f1f00b35700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1efc15dba0 0x7f1efc06ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.458+0000 7f1f00b35700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0c74b0 con 0x7f1efc159b10 2023-10-08T00:32:42.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.458+0000 7f1f00b35700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1efc0c8700 con 0x7f1efc15d730 2023-10-08T00:32:42.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.458+0000 7f1f00b35700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1efc0c9070 con 0x7f1efc15dba0 2023-10-08T00:32:42.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.458+0000 7f1efa59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1efc159b10 0x7f1efc0cb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49438/0 (socket says 172.21.15.22:49438) 2023-10-08T00:32:42.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.459+0000 7f1efa59c700 1 -- 172.21.15.22:0/562365222 learned_addr learned my addr 172.21.15.22:0/562365222 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:42.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.459+0000 7f1efad9d700 1 --2- 172.21.15.22:0/562365222 >> v2:172.21.15.192:3300/0 conn(0x7f1efc15dba0 0x7f1efc06ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.459+0000 7f1efad9d700 1 -- 172.21.15.22:0/562365222 >> v1:172.21.15.192:6789/0 conn(0x7f1efc15d730 legacy=0x7f1efc06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.459+0000 7f1efad9d700 1 -- 172.21.15.22:0/562365222 >> v1:172.21.15.22:6789/0 conn(0x7f1efc159b10 legacy=0x7f1efc0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.459+0000 7f1efad9d700 1 -- 172.21.15.22:0/562365222 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0c80f0 con 0x7f1efc15dba0 2023-10-08T00:32:42.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.459+0000 7f1efad9d700 1 --2- 172.21.15.22:0/562365222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc15dba0 0x7f1efc06ab20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009e60 tx=0x7f1ef4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe930649d2bb86a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:42.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.462+0000 7f1ef959a700 1 -- 172.21.15.22:0/562365222 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef400e070 con 0x7f1efc15dba0 2023-10-08T00:32:42.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1ef959a700 1 -- 172.21.15.22:0/562365222 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef400bcc0 con 0x7f1efc15dba0 2023-10-08T00:32:42.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1ef959a700 1 -- 172.21.15.22:0/562365222 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4012680 con 0x7f1efc15dba0 2023-10-08T00:32:42.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 -- 172.21.15.22:0/562365222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc15dba0 msgr2=0x7f1efc06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 --2- 172.21.15.22:0/562365222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc15dba0 0x7f1efc06ab20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009e60 tx=0x7f1ef4009780 comp rx=0 tx=0).stop 2023-10-08T00:32:42.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 -- 172.21.15.22:0/562365222 shutdown_connections 2023-10-08T00:32:42.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 --2- 172.21.15.22:0/562365222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc15dba0 0x7f1efc06ab20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 -- 172.21.15.22:0/562365222 >> 172.21.15.22:0/562365222 conn(0x7f1efc0c9870 msgr2=0x7f1efc0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:42.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 -- 172.21.15.22:0/562365222 shutdown_connections 2023-10-08T00:32:42.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.463+0000 7f1f00b35700 1 -- 172.21.15.22:0/562365222 wait complete. 2023-10-08T00:32:42.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.465+0000 7f1f00b35700 1 Processor -- start 2023-10-08T00:32:42.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.465+0000 7f1f00b35700 1 -- start start 2023-10-08T00:32:42.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1f00b35700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc159b10 0x7f1efc0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1f00b35700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1efc15d730 0x7f1efc0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1f00b35700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 0x7f1efc0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1f00b35700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc15b8c0 con 0x7f1efc15dba0 2023-10-08T00:32:42.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1f00b35700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc15c160 con 0x7f1efc159b10 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1f00b35700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc0c7110 con 0x7f1efc15d730 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 0x7f1efc0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 0x7f1efc0b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53030/0 (socket says 172.21.15.22:53030) 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 -- 172.21.15.22:0/2683024723 learned_addr learned my addr 172.21.15.22:0/2683024723 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efa59c700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc159b10 0x7f1efc0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1ef9d9b700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1efc15d730 0x7f1efc0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 -- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1efc15d730 msgr2=0x7f1efc0afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1efc15d730 0x7f1efc0afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 -- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc159b10 msgr2=0x7f1efc0c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc159b10 0x7f1efc0c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.466+0000 7f1efad9d700 1 -- 172.21.15.22:0/2683024723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef4009a20 con 0x7f1efc15dba0 2023-10-08T00:32:42.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.467+0000 7f1efad9d700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 0x7f1efc0b0340 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1efc06cc50 tx=0x7f1ef4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:42.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.468+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef401d630 con 0x7f1efc15dba0 2023-10-08T00:32:42.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.468+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef401d7d0 con 0x7f1efc15dba0 2023-10-08T00:32:42.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.468+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc15bb10 con 0x7f1efc15dba0 2023-10-08T00:32:42.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.468+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef401db90 con 0x7f1efc15dba0 2023-10-08T00:32:42.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.468+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc149d50 con 0x7f1efc15dba0 2023-10-08T00:32:42.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.469+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc15c2d0 con 0x7f1efc15dba0 2023-10-08T00:32:42.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.469+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1ef4024070 con 0x7f1efc15dba0 2023-10-08T00:32:42.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.470+0000 7f1eea7fc700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1edc067320 0x7f1edc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:42.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.470+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1ef40872d0 con 0x7f1efc15dba0 2023-10-08T00:32:42.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.470+0000 7f1efa59c700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1edc067320 0x7f1edc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:42.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.471+0000 7f1efa59c700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1edc067320 0x7f1edc0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1eec007130 tx=0x7f1eec007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:42.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.474+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ef4054260 con 0x7f1efc15dba0 2023-10-08T00:32:42.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:42.686+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1efc04c3c0 con 0x7f1efc15dba0 2023-10-08T00:32:43.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.471+0000 7f1eea7fc700 1 -- 172.21.15.22:0/2683024723 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ef4057880 con 0x7f1efc15dba0 2023-10-08T00:32:43.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1edc067320 msgr2=0x7f1edc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1edc067320 0x7f1edc0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1eec007130 tx=0x7f1eec007eb0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 msgr2=0x7f1efc0b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 0x7f1efc0b0340 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1efc06cc50 tx=0x7f1ef4019000 comp rx=0 tx=0).stop 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 shutdown_connections 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1efc15dba0 0x7f1efc0b0340 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1efc159b10 0x7f1efc0c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1edc067320 0x7f1edc0697d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 --2- 172.21.15.22:0/2683024723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1efc15d730 0x7f1efc0afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.474+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 >> 172.21.15.22:0/2683024723 conn(0x7f1efc0c9870 msgr2=0x7f1efc1579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.475+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 shutdown_connections 2023-10-08T00:32:43.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.475+0000 7f1f00b35700 1 -- 172.21.15.22:0/2683024723 wait complete. 2023-10-08T00:32:43.478 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:32:43.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:32:43.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.615+0000 7f1861ad9700 1 Processor -- start 2023-10-08T00:32:43.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.615+0000 7f1861ad9700 1 -- start start 2023-10-08T00:32:43.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f1861ad9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c1593b0 0x7f185c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f1861ad9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f185c0ceaa0 0x7f185c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f1861ad9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f185c0b1740 0x7f185c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f1861ad9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0b2100 con 0x7f185c0ceaa0 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f1861ad9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0b6570 con 0x7f185c0b1740 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f1861ad9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0cfe20 con 0x7f185c1593b0 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f185bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f185c0ceaa0 0x7f185c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f185bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f185c0ceaa0 0x7f185c0b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53044/0 (socket says 172.21.15.22:53044) 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f185bfff700 1 -- 172.21.15.22:0/632683849 learned_addr learned my addr 172.21.15.22:0/632683849 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.616+0000 7f18612d8700 1 --2- 172.21.15.22:0/632683849 >> v2:172.21.15.192:3300/0 conn(0x7f185c0b1740 0x7f185c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185bfff700 1 -- 172.21.15.22:0/632683849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c1593b0 msgr2=0x7f185c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185bfff700 1 --2- 172.21.15.22:0/632683849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c1593b0 0x7f185c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185bfff700 1 -- 172.21.15.22:0/632683849 >> v2:172.21.15.192:3300/0 conn(0x7f185c0b1740 msgr2=0x7f185c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185bfff700 1 --2- 172.21.15.22:0/632683849 >> v2:172.21.15.192:3300/0 conn(0x7f185c0b1740 0x7f185c0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185bfff700 1 -- 172.21.15.22:0/632683849 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0cf210 con 0x7f185c0ceaa0 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f18612d8700 1 --2- 172.21.15.22:0/632683849 >> v2:172.21.15.192:3300/0 conn(0x7f185c0b1740 0x7f185c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185bfff700 1 --2- 172.21.15.22:0/632683849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c0ceaa0 0x7f185c0b6030 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f185c0b24b0 tx=0x7f184c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e2d1c3baeb69ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185b7fe700 1 -- 172.21.15.22:0/632683849 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c00e070 con 0x7f185c0ceaa0 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185b7fe700 1 -- 172.21.15.22:0/632683849 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c00ba50 con 0x7f185c0ceaa0 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f185b7fe700 1 -- 172.21.15.22:0/632683849 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0092e0 con 0x7f185c0ceaa0 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 -- 172.21.15.22:0/632683849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c0ceaa0 msgr2=0x7f185c0b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 --2- 172.21.15.22:0/632683849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c0ceaa0 0x7f185c0b6030 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f185c0b24b0 tx=0x7f184c009840 comp rx=0 tx=0).stop 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 -- 172.21.15.22:0/632683849 shutdown_connections 2023-10-08T00:32:43.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 --2- 172.21.15.22:0/632683849 >> v2:172.21.15.192:3300/0 conn(0x7f185c0b1740 0x7f185c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 --2- 172.21.15.22:0/632683849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c1593b0 0x7f185c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 --2- 172.21.15.22:0/632683849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c0ceaa0 0x7f185c0b6030 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 -- 172.21.15.22:0/632683849 >> 172.21.15.22:0/632683849 conn(0x7f185c0d1130 msgr2=0x7f185c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 -- 172.21.15.22:0/632683849 shutdown_connections 2023-10-08T00:32:43.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.617+0000 7f1861ad9700 1 -- 172.21.15.22:0/632683849 wait complete. 2023-10-08T00:32:43.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.619+0000 7f1861ad9700 1 Processor -- start 2023-10-08T00:32:43.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.619+0000 7f1861ad9700 1 -- start start 2023-10-08T00:32:43.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.619+0000 7f1861ad9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c0b1740 0x7f185c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.619+0000 7f1861ad9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0ceaa0 0x7f185c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.619+0000 7f1861ad9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 0x7f185c169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1861ad9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15ac90 con 0x7f185c1593b0 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1861ad9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15af30 con 0x7f185c0ceaa0 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1861ad9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15b210 con 0x7f185c0b1740 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 0x7f185c169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 0x7f185c169af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53054/0 (socket says 172.21.15.22:53054) 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 -- 172.21.15.22:0/3850893762 learned_addr learned my addr 172.21.15.22:0/3850893762 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f185bfff700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0ceaa0 0x7f185c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1860ad7700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c0b1740 0x7f185c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 -- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c0b1740 msgr2=0x7f185c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c0b1740 0x7f185c15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 -- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0ceaa0 msgr2=0x7f185c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0ceaa0 0x7f185c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 -- 172.21.15.22:0/3850893762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c009ae0 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1860ad7700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c0b1740 0x7f185c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f18612d8700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 0x7f185c169af0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f184400c880 tx=0x7f1844008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011600 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1844011780 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c15b4f0 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844011b40 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.620+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c15bab0 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.621+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c15bca0 con 0x7f185c1593b0 2023-10-08T00:32:43.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.622+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1844022350 con 0x7f185c1593b0 2023-10-08T00:32:43.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.622+0000 7f1858ff9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f183c0672f0 0x7f183c0697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:43.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.622+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1844084a00 con 0x7f185c1593b0 2023-10-08T00:32:43.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.622+0000 7f1860ad7700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f183c0672f0 0x7f183c0697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:43.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.623+0000 7f1860ad7700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f183c0672f0 0x7f183c0697a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1854006fd0 tx=0x7f1854008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:43.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.626+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18440518d0 con 0x7f185c1593b0 2023-10-08T00:32:43.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.898+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f185c04c3c0 con 0x7f185c1593b0 2023-10-08T00:32:43.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.899+0000 7f1858ff9700 1 -- 172.21.15.22:0/3850893762 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1844015090 con 0x7f185c1593b0 2023-10-08T00:32:43.900 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:43.901 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.902 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:32:43.903 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:32:43.904 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:32:43.905 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:32:43.906 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:32:43.907 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.908 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.909 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.910 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.911 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.911 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.911 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.911 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:32:43.911 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.912 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:32:43.914 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:32:43.915 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.915 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:32:43.915 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:32:43.915 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.916 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:32:43.917 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:32:43.918 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:32:43.919 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:32:43.920 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:32:43.921 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.922 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:43.922 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:32:43.922 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:32:43.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f183c0672f0 msgr2=0x7f183c0697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f183c0672f0 0x7f183c0697a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1854006fd0 tx=0x7f1854008040 comp rx=0 tx=0).stop 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 msgr2=0x7f185c169af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 0x7f185c169af0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f184400c880 tx=0x7f1844008040 comp rx=0 tx=0).stop 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 shutdown_connections 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f185c1593b0 0x7f185c169af0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f183c0672f0 0x7f183c0697a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f185c0b1740 0x7f185c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.924 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 --2- 172.21.15.22:0/3850893762 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0ceaa0 0x7f185c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:43.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 >> 172.21.15.22:0/3850893762 conn(0x7f185c0d1130 msgr2=0x7f185c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:43.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 shutdown_connections 2023-10-08T00:32:43.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:43.901+0000 7f1861ad9700 1 -- 172.21.15.22:0/3850893762 wait complete. 2023-10-08T00:32:43.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:44.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.043+0000 7f6ab513c700 1 Processor -- start 2023-10-08T00:32:44.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.043+0000 7f6ab513c700 1 -- start start 2023-10-08T00:32:44.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6ab00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6ab513c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ab015d230 0x7f6ab015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6ab513c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab015dbd0 con 0x7f6ab01597f0 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6ab513c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00b2980 con 0x7f6ab015d230 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6ab513c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b11d0 con 0x7f6ab0159420 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6aaf7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6ab01597f0 0x7f6ab00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49442/0 (socket says 172.21.15.22:49442) 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/519490903 learned_addr learned my addr 172.21.15.22:0/519490903 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6aaffff700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6ab00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6ab493b700 1 --2- 172.21.15.22:0/519490903 >> v2:172.21.15.192:3300/0 conn(0x7f6ab015d230 0x7f6ab015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595180103 0 0) 0x7f6a98001110 con 0x7f6ab01597f0 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.044+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c003570 con 0x7f6ab01597f0 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893898834 0 0) 0x7f6a9c003570 con 0x7f6ab01597f0 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 msgr2=0x7f6ab00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6ab00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 >> v2:172.21.15.192:3300/0 conn(0x7f6ab015d230 msgr2=0x7f6ab015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 --2- 172.21.15.22:0/519490903 >> v2:172.21.15.192:3300/0 conn(0x7f6ab015d230 0x7f6ab015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00b14b0 con 0x7f6ab01597f0 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f6a98001600 con 0x7f6ab01597f0 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaffff700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6ab00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 >> v1:172.21.15.22:6789/0 conn(0x7f6ab01597f0 legacy=0x7f6ab00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6a9c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c003fa0 0x7f6a9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c004d50 0x7f6a9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b2980 con 0x7f6a9c004d50 2023-10-08T00:32:44.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b11d0 con 0x7f6a9c003fa0 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c00ba60 con 0x7f6ab0159420 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 --2- 172.21.15.22:0/519490903 >> v2:172.21.15.192:3300/0 conn(0x7f6ab015d230 0x7f6ab015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c004d50 0x7f6a9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaffff700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6a9c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaf7fe700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c003fa0 0x7f6a9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 -- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 msgr2=0x7f6a9c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0159420 0x7f6a9c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 -- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c003fa0 msgr2=0x7f6a9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c003fa0 0x7f6a9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 -- 172.21.15.22:0/519490903 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0009420 con 0x7f6a9c004d50 2023-10-08T00:32:44.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6ab493b700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c004d50 0x7f6a9c0051c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800e3c0 tx=0x7f6aa800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17b55874a6e8772 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.045+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa800ec70 con 0x7f6a9c004d50 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa800f040 con 0x7f6a9c004d50 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6aaeffd700 1 -- 172.21.15.22:0/519490903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8014480 con 0x7f6a9c004d50 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab513c700 1 -- 172.21.15.22:0/519490903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c004d50 msgr2=0x7f6a9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab513c700 1 --2- 172.21.15.22:0/519490903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a9c004d50 0x7f6a9c0051c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800e3c0 tx=0x7f6aa800b040 comp rx=0 tx=0).stop 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab493b700 1 -- 172.21.15.22:0/519490903 reap_dead start 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab513c700 1 -- 172.21.15.22:0/519490903 shutdown_connections 2023-10-08T00:32:44.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab513c700 1 -- 172.21.15.22:0/519490903 >> 172.21.15.22:0/519490903 conn(0x7f6ab00d0660 msgr2=0x7f6ab00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab513c700 1 -- 172.21.15.22:0/519490903 shutdown_connections 2023-10-08T00:32:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.046+0000 7f6ab513c700 1 -- 172.21.15.22:0/519490903 wait complete. 2023-10-08T00:32:44.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.047+0000 7f6ab513c700 1 Processor -- start 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.047+0000 7f6ab513c700 1 -- start start 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c004d50 0x7f6ab00ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 0x7f6ab00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab513c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0169e80 0x7f6ab016a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab513c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00b54b0 con 0x7f6ab00b4b00 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab513c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab016b7c0 con 0x7f6a9c004d50 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab513c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab016abb0 con 0x7f6ab0169e80 2023-10-08T00:32:44.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 0x7f6ab00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 0x7f6ab00b4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53072/0 (socket says 172.21.15.22:53072) 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/1703645706 learned_addr learned my addr 172.21.15.22:0/1703645706 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaffff700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c004d50 0x7f6ab00ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6ab493b700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0169e80 0x7f6ab016a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0169e80 msgr2=0x7f6ab016a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0169e80 0x7f6ab016a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c004d50 msgr2=0x7f6ab00ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c004d50 0x7f6ab00ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.048+0000 7f6aaf7fe700 1 -- 172.21.15.22:0/1703645706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab016ae90 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.049+0000 7f6aaf7fe700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 0x7f6ab00b4f70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f6a98007370 tx=0x7f6a98007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.049+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a98018030 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.049+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a98007750 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.049+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab016b170 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.049+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9800fb00 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.049+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab00ca7d0 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.050+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab004c3c0 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.050+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a9801b070 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.051+0000 7f6aa7fff700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a90067320 0x7f6a900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.051+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6a98019070 con 0x7f6ab00b4b00 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.051+0000 7f6aaffff700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a90067320 0x7f6a900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.051+0000 7f6aaffff700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a90067320 0x7f6a900697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6ab006a170 tx=0x7f6aa00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.055+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a98051610 con 0x7f6ab00b4b00 2023-10-08T00:32:44.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.248+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ab015dbd0 con 0x7f6ab00b4b00 2023-10-08T00:32:44.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.249+0000 7f6aa7fff700 1 -- 172.21.15.22:0/1703645706 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f6ab015dbd0 con 0x7f6ab00b4b00 2023-10-08T00:32:44.250 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:44.251 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":152,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:43.468605+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":139,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a90067320 msgr2=0x7f6a900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a90067320 0x7f6a900697d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6ab006a170 tx=0x7f6aa00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 msgr2=0x7f6ab00b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 0x7f6ab00b4f70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f6a98007370 tx=0x7f6a98007a80 comp rx=0 tx=0).stop 2023-10-08T00:32:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 shutdown_connections 2023-10-08T00:32:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6a90067320 0x7f6a900697d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6ab0169e80 0x7f6ab016a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a9c004d50 0x7f6ab00ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 --2- 172.21.15.22:0/1703645706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ab00b4b00 0x7f6ab00b4f70 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 >> 172.21.15.22:0/1703645706 conn(0x7f6ab00d0660 msgr2=0x7f6ab00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 shutdown_connections 2023-10-08T00:32:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.251+0000 7f6ab513c700 1 -- 172.21.15.22:0/1703645706 wait complete. 2023-10-08T00:32:44.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:32:44.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:32:44.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.386+0000 7f017eaf5700 1 Processor -- start 2023-10-08T00:32:44.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.386+0000 7f017eaf5700 1 -- start start 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f017eaf5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0178069560 0x7f01780699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f017eaf5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0178069ee0 con 0x7f0178159c60 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f017eaf5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017815a160 con 0x7f0178159890 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f017eaf5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780d13a0 con 0x7f0178069560 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f0177fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0178159c60 0x7f017815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49452/0 (socket says 172.21.15.22:49452) 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f0177fff700 1 -- 172.21.15.22:0/2764795307 learned_addr learned my addr 172.21.15.22:0/2764795307 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:44.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f017d092700 1 --2- 172.21.15.22:0/2764795307 >> v2:172.21.15.192:3300/0 conn(0x7f0178069560 0x7f01780699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f01777fe700 1 -- 172.21.15.22:0/2764795307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371288758 0 0) 0x7f0178069ee0 con 0x7f0178159c60 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f01777fe700 1 -- 172.21.15.22:0/2764795307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0160003570 con 0x7f0178159c60 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.387+0000 7f017d092700 1 -- 172.21.15.22:0/2764795307 >> v1:172.21.15.192:6789/0 conn(0x7f0178159890 legacy=0x7f017815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f01777fe700 1 -- 172.21.15.22:0/2764795307 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285139337 0 0) 0x7f017815a160 con 0x7f0178159890 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017d092700 1 -- 172.21.15.22:0/2764795307 >> v1:172.21.15.22:6789/0 conn(0x7f0178159c60 legacy=0x7f017815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017d092700 1 -- 172.21.15.22:0/2764795307 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017815e140 con 0x7f0178069560 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017d092700 1 --2- 172.21.15.22:0/2764795307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780699a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0170009e60 tx=0x7f0170009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=986aaaa7a42bb473 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f01777fe700 1 -- 172.21.15.22:0/2764795307 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000e070 con 0x7f0178069560 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f01777fe700 1 -- 172.21.15.22:0/2764795307 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017000bb60 con 0x7f0178069560 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f01777fe700 1 -- 172.21.15.22:0/2764795307 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170012430 con 0x7f0178069560 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017eaf5700 1 -- 172.21.15.22:0/2764795307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 msgr2=0x7f01780699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017eaf5700 1 --2- 172.21.15.22:0/2764795307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780699a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0170009e60 tx=0x7f0170009780 comp rx=0 tx=0).stop 2023-10-08T00:32:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017eaf5700 1 -- 172.21.15.22:0/2764795307 shutdown_connections 2023-10-08T00:32:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017eaf5700 1 --2- 172.21.15.22:0/2764795307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780699a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.388+0000 7f017eaf5700 1 -- 172.21.15.22:0/2764795307 >> 172.21.15.22:0/2764795307 conn(0x7f0178068e20 msgr2=0x7f01780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.389+0000 7f017eaf5700 1 -- 172.21.15.22:0/2764795307 shutdown_connections 2023-10-08T00:32:44.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.389+0000 7f017eaf5700 1 -- 172.21.15.22:0/2764795307 wait complete. 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 Processor -- start 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 -- start start 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0178159890 0x7f01781472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 0x7f017815b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780cfec0 con 0x7f0178159c60 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178147830 con 0x7f0178069560 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.390+0000 7f017eaf5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780c9e30 con 0x7f0178159890 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 0x7f017815b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 0x7f017815b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53074/0 (socket says 172.21.15.22:53074) 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 -- 172.21.15.22:0/987442084 learned_addr learned my addr 172.21.15.22:0/987442084 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f0177fff700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0178159890 0x7f01781472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017c891700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 -- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0178159890 msgr2=0x7f01781472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0178159890 0x7f01781472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 -- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 msgr2=0x7f01780ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 -- 172.21.15.22:0/987442084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009a20 con 0x7f0178159c60 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017d092700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 0x7f017815b4d0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f017806a070 tx=0x7f0170019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170026480 con 0x7f0178159c60 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0170026640 con 0x7f0178159c60 2023-10-08T00:32:44.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170026a00 con 0x7f0178159c60 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01780cf900 con 0x7f0178159c60 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.391+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01780c9ac0 con 0x7f0178159c60 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.392+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017804c3c0 con 0x7f0178159c60 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.393+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f017001c400 con 0x7f0178159c60 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.393+0000 7f0174ff9700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0164067320 0x7f01640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.393+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f01700868f0 con 0x7f0178159c60 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.393+0000 7f017c891700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0164067320 0x7f01640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.394+0000 7f017c891700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0164067320 0x7f01640697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0168007fd0 tx=0x7f0168007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.397+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01700537c0 con 0x7f0178159c60 2023-10-08T00:32:44.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.588+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f017806a5b0 con 0x7f0178159c60 2023-10-08T00:32:44.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.589+0000 7f0174ff9700 1 -- 172.21.15.22:0/987442084 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7f017002b0a0 con 0x7f0178159c60 2023-10-08T00:32:44.590 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:32:44.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0164067320 msgr2=0x7f01640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0164067320 0x7f01640697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0168007fd0 tx=0x7f0168007d30 comp rx=0 tx=0).stop 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 msgr2=0x7f017815b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 0x7f017815b4d0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f017806a070 tx=0x7f0170019000 comp rx=0 tx=0).stop 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 shutdown_connections 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0178159c60 0x7f017815b4d0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0178069560 0x7f01780ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0164067320 0x7f01640697d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 --2- 172.21.15.22:0/987442084 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0178159890 0x7f01781472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 >> 172.21.15.22:0/987442084 conn(0x7f0178068e20 msgr2=0x7f01780cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:44.593 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 shutdown_connections 2023-10-08T00:32:44.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.591+0000 7f017eaf5700 1 -- 172.21.15.22:0/987442084 wait complete. 2023-10-08T00:32:44.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:32:44.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.722+0000 7f5933c33700 1 Processor -- start 2023-10-08T00:32:44.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.722+0000 7f5933c33700 1 -- start start 2023-10-08T00:32:44.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.723+0000 7f5933c33700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f592c159c10 0x7f592c0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.723+0000 7f5933c33700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c069e40 con 0x7f592c0699e0 2023-10-08T00:32:44.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.723+0000 7f5933c33700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592c0cfb30 con 0x7f592c159840 2023-10-08T00:32:44.730 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.723+0000 7f5933c33700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592c0cbc40 con 0x7f592c159c10 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.723+0000 7f59321d0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f592c0699e0 0x7f592c0b05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49454/0 (socket says 172.21.15.22:49454) 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.723+0000 7f59321d0700 1 -- 172.21.15.22:0/3019711224 learned_addr learned my addr 172.21.15.22:0/3019711224 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791792490 0 0) 0x7f5924001110 con 0x7f592c0699e0 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5914003570 con 0x7f592c0699e0 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59311ce700 1 --2- 172.21.15.22:0/3019711224 >> v2:172.21.15.192:3300/0 conn(0x7f592c159c10 0x7f592c0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999236282 0 0) 0x7f5914003570 con 0x7f592c0699e0 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 >> v2:172.21.15.192:3300/0 conn(0x7f592c159c10 msgr2=0x7f592c0694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 --2- 172.21.15.22:0/3019711224 >> v2:172.21.15.192:3300/0 conn(0x7f592c159c10 0x7f592c0694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 >> v1:172.21.15.192:6789/0 conn(0x7f592c159840 legacy=0x7f592c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0cbf10 con 0x7f592c0699e0 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5924001600 con 0x7f592c0699e0 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 >> v1:172.21.15.22:6789/0 conn(0x7f592c0699e0 legacy=0x7f592c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5914003a60 0x7f5914003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914004810 0x7f5914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59140052e0 0x7f591400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0cbc40 con 0x7f5914003a60 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c2a0 con 0x7f5914004810 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c460 con 0x7f59140052e0 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59319cf700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5914003a60 0x7f5914003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59311ce700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914004810 0x7f5914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59321d0700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59140052e0 0x7f591400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.724+0000 7f59319cf700 1 -- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59140052e0 msgr2=0x7f591400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59319cf700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59140052e0 0x7f591400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59319cf700 1 -- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914004810 msgr2=0x7f5914004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59319cf700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914004810 0x7f5914004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59319cf700 1 -- 172.21.15.22:0/3019711224 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914003570 con 0x7f5914003a60 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59321d0700 1 -- 172.21.15.22:0/3019711224 reap_dead start 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59319cf700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5914003a60 0x7f5914003e70 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f591c001fc0 tx=0x7f591c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3297cc604f3cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c001950 con 0x7f5914003a60 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c00c8b0 con 0x7f5914003a60 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f59309cd700 1 -- 172.21.15.22:0/3019711224 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00cc50 con 0x7f5914003a60 2023-10-08T00:32:44.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f5933c33700 1 -- 172.21.15.22:0/3019711224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5914003a60 msgr2=0x7f5914003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f5933c33700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5914003a60 0x7f5914003e70 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f591c001fc0 tx=0x7f591c001640 comp rx=0 tx=0).stop 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f5933c33700 1 -- 172.21.15.22:0/3019711224 shutdown_connections 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f5933c33700 1 --2- 172.21.15.22:0/3019711224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5914003a60 0x7f5914003e70 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.725+0000 7f5933c33700 1 -- 172.21.15.22:0/3019711224 >> 172.21.15.22:0/3019711224 conn(0x7f592c068e10 msgr2=0x7f592c0d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.726+0000 7f5933c33700 1 -- 172.21.15.22:0/3019711224 shutdown_connections 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.726+0000 7f5933c33700 1 -- 172.21.15.22:0/3019711224 wait complete. 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 Processor -- start 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 -- start start 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5914003a60 0x7f592c15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 0x7f592c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.734 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f592c16d430 0x7f592c16d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c8280 con 0x7f592c0c9df0 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c16ddc0 con 0x7f592c16d430 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f5933c33700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592c0c7fa0 con 0x7f5914003a60 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f59311ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 0x7f592c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f59311ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 0x7f592c154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53088/0 (socket says 172.21.15.22:53088) 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.727+0000 7f59311ce700 1 -- 172.21.15.22:0/1745573976 learned_addr learned my addr 172.21.15.22:0/1745573976 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59319cf700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5914003a60 0x7f592c15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59321d0700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f592c16d430 0x7f592c16d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59311ce700 1 -- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5914003a60 msgr2=0x7f592c15a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59311ce700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5914003a60 0x7f592c15a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.735 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59311ce700 1 -- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f592c16d430 msgr2=0x7f592c16d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59311ce700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f592c16d430 0x7f592c16d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59311ce700 1 -- 172.21.15.22:0/1745573976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0af970 con 0x7f592c0c9df0 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59319cf700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5914003a60 0x7f592c15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f59311ce700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 0x7f592c154660 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5920011b40 tx=0x7f59200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000fa70 con 0x7f592c0c9df0 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000fbd0 con 0x7f592c0c9df0 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c0afc50 con 0x7f592c0c9df0 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920014440 con 0x7f592c0c9df0 2023-10-08T00:32:44.736 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.728+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c16e130 con 0x7f592c0c9df0 2023-10-08T00:32:44.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.729+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c0d12a0 con 0x7f592c0c9df0 2023-10-08T00:32:44.737 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.730+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5920014830 con 0x7f592c0c9df0 2023-10-08T00:32:44.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.730+0000 7f5929ffb700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5918067320 0x7f59180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:44.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.730+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5920018030 con 0x7f592c0c9df0 2023-10-08T00:32:44.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.730+0000 7f59319cf700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5918067320 0x7f59180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:44.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.731+0000 7f59319cf700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5918067320 0x7f59180697d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f591c001390 tx=0x7f591c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:44.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.735+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5920052340 con 0x7f592c0c9df0 2023-10-08T00:32:44.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.931+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f592c0694a0 con 0x7f592c0c9df0 2023-10-08T00:32:44.932 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.931+0000 7f5929ffb700 1 -- 172.21.15.22:0/1745573976 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5920055960 con 0x7f592c0c9df0 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:32:44.933 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:32:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5918067320 msgr2=0x7f59180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5918067320 0x7f59180697d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f591c001390 tx=0x7f591c015000 comp rx=0 tx=0).stop 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 msgr2=0x7f592c154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 0x7f592c154660 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5920011b40 tx=0x7f59200091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 shutdown_connections 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f592c16d430 0x7f592c16d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5918067320 0x7f59180697d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5914003a60 0x7f592c15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 --2- 172.21.15.22:0/1745573976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f592c0c9df0 0x7f592c154660 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 >> 172.21.15.22:0/1745573976 conn(0x7f592c068e10 msgr2=0x7f592c157330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 shutdown_connections 2023-10-08T00:32:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:44.933+0000 7f5933c33700 1 -- 172.21.15.22:0/1745573976 wait complete. 2023-10-08T00:32:44.946 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:32:44.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:32:45.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.068+0000 7f3fbac31700 1 Processor -- start 2023-10-08T00:32:45.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.068+0000 7f3fbac31700 1 -- start start 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fbac31700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3fb406ab40 0x7f3fb40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fbac31700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb4068900 con 0x7f3fb4068390 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fbac31700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb4068be0 con 0x7f3fb40af8c0 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fbac31700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb4068ec0 con 0x7f3fb406ab40 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fb3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3fb4068390 0x7f3fb40c10c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49456/0 (socket says 172.21.15.22:49456) 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fb3fff700 1 -- 172.21.15.22:0/1691489429 learned_addr learned my addr 172.21.15.22:0/1691489429 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fb89cd700 1 --2- 172.21.15.22:0/1691489429 >> v2:172.21.15.192:3300/0 conn(0x7f3fb406ab40 0x7f3fb40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136566283 0 0) 0x7f3fb4068900 con 0x7f3fb4068390 2023-10-08T00:32:45.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.069+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa4003570 con 0x7f3fb4068390 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3553498296 0 0) 0x7f3fa4003570 con 0x7f3fb4068390 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 >> v2:172.21.15.192:3300/0 conn(0x7f3fb406ab40 msgr2=0x7f3fb40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 --2- 172.21.15.22:0/1691489429 >> v2:172.21.15.192:3300/0 conn(0x7f3fb406ab40 0x7f3fb40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 >> v1:172.21.15.192:6789/0 conn(0x7f3fb40af8c0 legacy=0x7f3fb4159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40691a0 con 0x7f3fb4068390 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f3fa0001470 con 0x7f3fb4068390 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 >> v1:172.21.15.22:6789/0 conn(0x7f3fb4068390 legacy=0x7f3fb40c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa4003a60 0x7f3fa4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fa4004810 0x7f3fa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa40051c0 0x7f3fa400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4068ec0 con 0x7f3fa4004810 2023-10-08T00:32:45.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa400c0d0 con 0x7f3fa4003a60 2023-10-08T00:32:45.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa400c290 con 0x7f3fa40051c0 2023-10-08T00:32:45.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fa4004810 0x7f3fa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb89cd700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa4003a60 0x7f3fa4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb91ce700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa40051c0 0x7f3fa400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 -- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa40051c0 msgr2=0x7f3fa400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa40051c0 0x7f3fa400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 -- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa4003a60 msgr2=0x7f3fa4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa4003a60 0x7f3fa4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 -- 172.21.15.22:0/1691489429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4003570 con 0x7f3fa4004810 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb91ce700 1 -- 172.21.15.22:0/1691489429 reap_dead start 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb89cd700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fa4003a60 0x7f3fa4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb3fff700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fa4004810 0x7f3fa4004c80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c3c0 tx=0x7f3fa0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36da07b6ecf99b76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000cc90 con 0x7f3fa4004810 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa000cdf0 con 0x7f3fa4004810 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.070+0000 7f3fb37fe700 1 -- 172.21.15.22:0/1691489429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0005b50 con 0x7f3fa4004810 2023-10-08T00:32:45.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 -- 172.21.15.22:0/1691489429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fa4004810 msgr2=0x7f3fa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fa4004810 0x7f3fa4004c80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3fa000c3c0 tx=0x7f3fa0001e50 comp rx=0 tx=0).stop 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 -- 172.21.15.22:0/1691489429 shutdown_connections 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 --2- 172.21.15.22:0/1691489429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fa4004810 0x7f3fa4004c80 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 -- 172.21.15.22:0/1691489429 >> 172.21.15.22:0/1691489429 conn(0x7f3fb40cd640 msgr2=0x7f3fb40cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 -- 172.21.15.22:0/1691489429 shutdown_connections 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.071+0000 7f3fbac31700 1 -- 172.21.15.22:0/1691489429 wait complete. 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.072+0000 7f3fbac31700 1 Processor -- start 2023-10-08T00:32:45.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.072+0000 7f3fbac31700 1 -- start start 2023-10-08T00:32:45.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fbac31700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa4004810 0x7f3fb415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fbac31700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb40c7810 0x7f3fb40cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fbac31700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 0x7f3fb4169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fbac31700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40ab730 con 0x7f3fb4169a80 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fbac31700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40ac2b0 con 0x7f3fb40c7810 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fbac31700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40ab980 con 0x7f3fa4004810 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb91ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 0x7f3fb4169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb91ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 0x7f3fb4169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53114/0 (socket says 172.21.15.22:53114) 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb91ce700 1 -- 172.21.15.22:0/881677917 learned_addr learned my addr 172.21.15.22:0/881677917 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb89cd700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa4004810 0x7f3fb415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb3fff700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb40c7810 0x7f3fb40cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb91ce700 1 -- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa4004810 msgr2=0x7f3fb415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.073+0000 7f3fb91ce700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa4004810 0x7f3fb415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb91ce700 1 -- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb40c7810 msgr2=0x7f3fb40cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb91ce700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb40c7810 0x7f3fb40cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb91ce700 1 -- 172.21.15.22:0/881677917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40abc60 con 0x7f3fb4169a80 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb91ce700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 0x7f3fb4169ef0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4064970 tx=0x7f3fac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0032e0 con 0x7f3fb4169a80 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac003440 con 0x7f3fb4169a80 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb40abf40 con 0x7f3fb4169a80 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0017d0 con 0x7f3fb4169a80 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.074+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb40cc910 con 0x7f3fb4169a80 2023-10-08T00:32:45.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.075+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb40ac440 con 0x7f3fb4169a80 2023-10-08T00:32:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.075+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3fac001c00 con 0x7f3fb4169a80 2023-10-08T00:32:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.076+0000 7f3fb0ff9700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f98067320 0x7f3f980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.076+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3fac0842c0 con 0x7f3fb4169a80 2023-10-08T00:32:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.076+0000 7f3fb89cd700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f98067320 0x7f3f980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.076+0000 7f3fb89cd700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f98067320 0x7f3f980697d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4061160 tx=0x7f3fa8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:45.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.080+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fac0512a0 con 0x7f3fb4169a80 2023-10-08T00:32:45.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.276+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3fb40ccb30 con 0x7f3fb4169a80 2023-10-08T00:32:45.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.643+0000 7f3fb0ff9700 1 -- 172.21.15.22:0/881677917 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v153) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3fac0548c0 con 0x7f3fb4169a80 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f98067320 msgr2=0x7f3f980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f98067320 0x7f3f980697d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4061160 tx=0x7f3fa8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 msgr2=0x7f3fb4169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 0x7f3fb4169ef0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4064970 tx=0x7f3fac009040 comp rx=0 tx=0).stop 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 shutdown_connections 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fb4169a80 0x7f3fb4169ef0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3f98067320 0x7f3f980697d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3fa4004810 0x7f3fb415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 --2- 172.21.15.22:0/881677917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3fb40c7810 0x7f3fb40cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 >> 172.21.15.22:0/881677917 conn(0x7f3fb40cd640 msgr2=0x7f3fb40b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:45.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 shutdown_connections 2023-10-08T00:32:45.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.646+0000 7f3fbac31700 1 -- 172.21.15.22:0/881677917 wait complete. 2023-10-08T00:32:45.649 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:32:45.664 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:32:45.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.790+0000 7ff3699ce700 1 Processor -- start 2023-10-08T00:32:45.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.790+0000 7ff3699ce700 1 -- start start 2023-10-08T00:32:45.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.790+0000 7ff3699ce700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff364159950 0x7ff3640cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.790+0000 7ff3699ce700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640ce380 con 0x7ff364069c70 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff3699ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640cec20 con 0x7ff3640af320 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff3699ce700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640afa90 con 0x7ff364159950 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff3637fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff364069c70 0x7ff3640cf0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49460/0 (socket says 172.21.15.22:49460) 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff3637fe700 1 -- 172.21.15.22:0/372744163 learned_addr learned my addr 172.21.15.22:0/372744163 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff362ffd700 1 --2- 172.21.15.22:0/372744163 >> v2:172.21.15.192:3300/0 conn(0x7ff364159950 0x7ff3640cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628370650 0 0) 0x7ff3640ce380 con 0x7ff364069c70 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff350003570 con 0x7ff364069c70 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3357457008 0 0) 0x7ff350003570 con 0x7ff364069c70 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 >> v2:172.21.15.192:3300/0 conn(0x7ff364159950 msgr2=0x7ff3640cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 --2- 172.21.15.22:0/372744163 >> v2:172.21.15.192:3300/0 conn(0x7ff364159950 0x7ff3640cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 >> v1:172.21.15.192:6789/0 conn(0x7ff3640af320 legacy=0x7ff364069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640ce5d0 con 0x7ff364069c70 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7ff35c0017f0 con 0x7ff364069c70 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 >> v1:172.21.15.22:6789/0 conn(0x7ff364069c70 legacy=0x7ff3640cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350003ab0 0x7ff350003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350004810 0x7ff350004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff350005210 0x7ff35000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640afa90 con 0x7ff350003ab0 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35000c1b0 con 0x7ff350005210 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35000c370 con 0x7ff350004810 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.791+0000 7ff362ffd700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350003ab0 0x7ff350003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff3637fe700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff350005210 0x7ff35000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff3627fc700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350004810 0x7ff350004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff362ffd700 1 -- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350004810 msgr2=0x7ff350004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff362ffd700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350004810 0x7ff350004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff362ffd700 1 -- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff350005210 msgr2=0x7ff35000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff362ffd700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff350005210 0x7ff35000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff3637fe700 1 -- 172.21.15.22:0/372744163 reap_dead start 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff362ffd700 1 -- 172.21.15.22:0/372744163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff350003570 con 0x7ff350003ab0 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff3627fc700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350004810 0x7ff350004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff362ffd700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350003ab0 0x7ff350003ec0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff354009c00 tx=0x7ff3540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965486c0b5661c89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400e710 con 0x7ff350003ab0 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35400e870 con 0x7ff350003ab0 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.792+0000 7ff361ffb700 1 -- 172.21.15.22:0/372744163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400ec30 con 0x7ff350003ab0 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 -- 172.21.15.22:0/372744163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350003ab0 msgr2=0x7ff350003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350003ab0 0x7ff350003ec0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff354009c00 tx=0x7ff3540091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 -- 172.21.15.22:0/372744163 shutdown_connections 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 --2- 172.21.15.22:0/372744163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff350003ab0 0x7ff350003ec0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 -- 172.21.15.22:0/372744163 >> 172.21.15.22:0/372744163 conn(0x7ff364068e00 msgr2=0x7ff3640d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 -- 172.21.15.22:0/372744163 shutdown_connections 2023-10-08T00:32:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.793+0000 7ff3699ce700 1 -- 172.21.15.22:0/372744163 wait complete. 2023-10-08T00:32:45.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.794+0000 7ff3699ce700 1 Processor -- start 2023-10-08T00:32:45.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.794+0000 7ff3699ce700 1 -- start start 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350003ab0 0x7ff3640b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 0x7ff364169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff36416a430 0x7ff36416a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640b3a90 con 0x7ff3640b54b0 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36416adc0 con 0x7ff36416a430 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640ca580 con 0x7ff350003ab0 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 0x7ff364169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 0x7ff364169ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53140/0 (socket says 172.21.15.22:53140) 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 -- 172.21.15.22:0/1292584093 learned_addr learned my addr 172.21.15.22:0/1292584093 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff362ffd700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350003ab0 0x7ff3640b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3637fe700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff36416a430 0x7ff36416a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 -- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350003ab0 msgr2=0x7ff3640b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350003ab0 0x7ff3640b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 -- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff36416a430 msgr2=0x7ff36416a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff36416a430 0x7ff36416a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 -- 172.21.15.22:0/1292584093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640b5c80 con 0x7ff3640b54b0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff362ffd700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350003ab0 0x7ff3640b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3627fc700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 0x7ff364169ef0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff34c000c00 tx=0x7ff34c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c010520 con 0x7ff3640b54b0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c010680 con 0x7ff3640b54b0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c010a40 con 0x7ff3640b54b0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.795+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3640b5f60 con 0x7ff3640b54b0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.796+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3640b5980 con 0x7ff3640b54b0 2023-10-08T00:32:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.796+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3640718b0 con 0x7ff3640b54b0 2023-10-08T00:32:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.797+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff34c014480 con 0x7ff3640b54b0 2023-10-08T00:32:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.797+0000 7ff35affd700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff344067320 0x7ff3440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.797+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5223+0+0 (secure 0 0 0) 0x7ff34c084490 con 0x7ff3640b54b0 2023-10-08T00:32:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.797+0000 7ff362ffd700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff344067320 0x7ff3440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.798+0000 7ff362ffd700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff344067320 0x7ff3440697d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff3540091e0 tx=0x7ff35401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.802+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff34c04d5a0 con 0x7ff3640b54b0 2023-10-08T00:32:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:45.994+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff3640ce8b0 con 0x7ff3640b54b0 2023-10-08T00:32:46.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.650+0000 7ff35affd700 1 -- 172.21.15.22:0/1292584093 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v154) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff34c051370 con 0x7ff3640b54b0 2023-10-08T00:32:46.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff344067320 msgr2=0x7ff3440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff344067320 0x7ff3440697d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff3540091e0 tx=0x7ff35401a000 comp rx=0 tx=0).stop 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 msgr2=0x7ff364169ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 0x7ff364169ef0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff34c000c00 tx=0x7ff34c009040 comp rx=0 tx=0).stop 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 shutdown_connections 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff36416a430 0x7ff36416a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff344067320 0x7ff3440697d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff350003ab0 0x7ff3640b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 --2- 172.21.15.22:0/1292584093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3640b54b0 0x7ff364169ef0 secure :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff34c000c00 tx=0x7ff34c009040 comp rx=0 tx=0).stop 2023-10-08T00:32:46.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.655+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 >> 172.21.15.22:0/1292584093 conn(0x7ff364068e00 msgr2=0x7ff3640cf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:46.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.657+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 shutdown_connections 2023-10-08T00:32:46.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.657+0000 7ff3699ce700 1 -- 172.21.15.22:0/1292584093 wait complete. 2023-10-08T00:32:46.671 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:32:46.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:32:46.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.811+0000 7f621f59e700 1 Processor -- start 2023-10-08T00:32:46.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.811+0000 7f621f59e700 1 -- start start 2023-10-08T00:32:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621f59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6220159a60 0x7f62200c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62200ccc00 0x7f6220069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621f59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f622006a020 0x7f62200cb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621f59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622006dfc0 con 0x7f6220159a60 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621f59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62200c9cb0 con 0x7f622006a020 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200c9f30 con 0x7f62200ccc00 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6220159a60 0x7f62200c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6220159a60 0x7f62200c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41222/0 (socket says 172.21.15.22:41222) 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 -- 172.21.15.22:0/3147198517 learned_addr learned my addr 172.21.15.22:0/3147198517 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621ed9d700 1 --2- 172.21.15.22:0/3147198517 >> v2:172.21.15.192:3300/0 conn(0x7f622006a020 0x7f62200cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621dd9b700 1 --2- 172.21.15.22:0/3147198517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62200ccc00 0x7f6220069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 -- 172.21.15.22:0/3147198517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62200ccc00 msgr2=0x7f6220069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 --2- 172.21.15.22:0/3147198517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62200ccc00 0x7f6220069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 -- 172.21.15.22:0/3147198517 >> v2:172.21.15.192:3300/0 conn(0x7f622006a020 msgr2=0x7f62200cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 --2- 172.21.15.22:0/3147198517 >> v2:172.21.15.192:3300/0 conn(0x7f622006a020 0x7f62200cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.812+0000 7f621e59c700 1 -- 172.21.15.22:0/3147198517 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62200ca470 con 0x7f6220159a60 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621e59c700 1 --2- 172.21.15.22:0/3147198517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6220159a60 0x7f62200c9770 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f62200cf6a0 tx=0x7f6218009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a317c64a51d9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621d59a700 1 -- 172.21.15.22:0/3147198517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800b8f0 con 0x7f6220159a60 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621d59a700 1 -- 172.21.15.22:0/3147198517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621800ba50 con 0x7f6220159a60 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621d59a700 1 -- 172.21.15.22:0/3147198517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800bdf0 con 0x7f6220159a60 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 -- 172.21.15.22:0/3147198517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6220159a60 msgr2=0x7f62200c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 --2- 172.21.15.22:0/3147198517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6220159a60 0x7f62200c9770 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f62200cf6a0 tx=0x7f6218009250 comp rx=0 tx=0).stop 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 -- 172.21.15.22:0/3147198517 shutdown_connections 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 --2- 172.21.15.22:0/3147198517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6220159a60 0x7f62200c9770 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 --2- 172.21.15.22:0/3147198517 >> v2:172.21.15.192:3300/0 conn(0x7f622006a020 0x7f62200cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 --2- 172.21.15.22:0/3147198517 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f62200ccc00 0x7f6220069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 -- 172.21.15.22:0/3147198517 >> 172.21.15.22:0/3147198517 conn(0x7f622006baa0 msgr2=0x7f622006bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.813+0000 7f621f59e700 1 -- 172.21.15.22:0/3147198517 shutdown_connections 2023-10-08T00:32:46.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.814+0000 7f621f59e700 1 -- 172.21.15.22:0/3147198517 wait complete. 2023-10-08T00:32:46.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 Processor -- start 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 -- start start 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f622006a020 0x7f62200b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 0x7f62200c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6220159a60 0x7f62200c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622016a0a0 con 0x7f62200ccc00 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62200b2600 con 0x7f6220159a60 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621f59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62200b42d0 con 0x7f622006a020 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 0x7f62200c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 0x7f62200c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41230/0 (socket says 172.21.15.22:41230) 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.815+0000 7f621dd9b700 1 -- 172.21.15.22:0/4162478537 learned_addr learned my addr 172.21.15.22:0/4162478537 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621e59c700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f622006a020 0x7f62200b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621ed9d700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6220159a60 0x7f62200c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621dd9b700 1 -- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f622006a020 msgr2=0x7f62200b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621dd9b700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f622006a020 0x7f62200b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621dd9b700 1 -- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6220159a60 msgr2=0x7f62200c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621dd9b700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6220159a60 0x7f62200c7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621dd9b700 1 -- 172.21.15.22:0/4162478537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62180094f0 con 0x7f62200ccc00 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621dd9b700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 0x7f62200c6c20 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f620800d8c0 tx=0x7f6208008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080125f0 con 0x7f62200ccc00 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6208012750 con 0x7f62200ccc00 2023-10-08T00:32:46.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208012af0 con 0x7f62200ccc00 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62200b19f0 con 0x7f62200ccc00 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.816+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62200b1fb0 con 0x7f62200ccc00 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.817+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62200b27b0 con 0x7f62200ccc00 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.818+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f620801e460 con 0x7f62200ccc00 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.818+0000 7f62167fc700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6200067320 0x7f62000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.818+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f6208088120 con 0x7f62200ccc00 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.818+0000 7f621e59c700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6200067320 0x7f62000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:46.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.819+0000 7f621e59c700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6200067320 0x7f62000697d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f62200cf6a0 tx=0x7f6218017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:46.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:46.823+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62200b27b0 con 0x7f62200ccc00 2023-10-08T00:32:47.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.060+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f62200b2770 con 0x7f62200ccc00 2023-10-08T00:32:47.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.652+0000 7f62167fc700 1 -- 172.21.15.22:0/4162478537 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v102) v1 ==== 174+0+0 (secure 0 0 0) 0x7f62080558c0 con 0x7f62200ccc00 2023-10-08T00:32:47.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6200067320 msgr2=0x7f62000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6200067320 0x7f62000697d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f62200cf6a0 tx=0x7f6218017000 comp rx=0 tx=0).stop 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 msgr2=0x7f62200c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 0x7f62200c6c20 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f620800d8c0 tx=0x7f6208008040 comp rx=0 tx=0).stop 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 shutdown_connections 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6220159a60 0x7f62200c7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6200067320 0x7f62000697d0 secure :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f62200cf6a0 tx=0x7f6218017000 comp rx=0 tx=0).stop 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f622006a020 0x7f62200b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 --2- 172.21.15.22:0/4162478537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62200ccc00 0x7f62200c6c20 secure :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f620800d8c0 tx=0x7f6208008040 comp rx=0 tx=0).stop 2023-10-08T00:32:47.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.660+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 >> 172.21.15.22:0/4162478537 conn(0x7f622006baa0 msgr2=0x7f6220158960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.664+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 shutdown_connections 2023-10-08T00:32:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.667+0000 7f621f59e700 1 -- 172.21.15.22:0/4162478537 wait complete. 2023-10-08T00:32:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 26 and data pool 27 2023-10-08T00:32:47.693 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:47.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.813+0000 7f65af929700 1 Processor -- start 2023-10-08T00:32:47.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.813+0000 7f65af929700 1 -- start start 2023-10-08T00:32:47.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65af929700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a8159890 0x7f65a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:47.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65af929700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65a8159c60 0x7f65a815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65af929700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a815a160 con 0x7f65a815db10 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65af929700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a80d13a0 con 0x7f65a8159c60 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65af929700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a815e140 con 0x7f65a8159890 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65acec4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f65a8159c60 0x7f65a815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65adec6700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f65a815db10 0x7f65a8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52824/0 (socket says 172.21.15.22:52824) 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65adec6700 1 -- 172.21.15.22:0/4119861917 learned_addr learned my addr 172.21.15.22:0/4119861917 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.814+0000 7f65ad6c5700 1 --2- 172.21.15.22:0/4119861917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a8159890 0x7f65a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65acec4700 1 -- 172.21.15.22:0/4119861917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a8159890 msgr2=0x7f65a815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65acec4700 1 --2- 172.21.15.22:0/4119861917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a8159890 0x7f65a815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65acec4700 1 -- 172.21.15.22:0/4119861917 >> v1:172.21.15.22:6789/0 conn(0x7f65a815db10 legacy=0x7f65a8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65a7fff700 1 -- 172.21.15.22:0/4119861917 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503817075 0 0) 0x7f65a815a160 con 0x7f65a815db10 2023-10-08T00:32:47.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65acec4700 1 -- 172.21.15.22:0/4119861917 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a815a3d0 con 0x7f65a8159c60 2023-10-08T00:32:47.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65acec4700 1 --2- 172.21.15.22:0/4119861917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159c60 0x7f65a815d5d0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f659c0098e0 tx=0x7f659c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6082355687c532 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:47.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65a7fff700 1 -- 172.21.15.22:0/4119861917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00b640 con 0x7f65a8159c60 2023-10-08T00:32:47.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65a7fff700 1 -- 172.21.15.22:0/4119861917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00b7a0 con 0x7f65a8159c60 2023-10-08T00:32:47.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.815+0000 7f65a7fff700 1 -- 172.21.15.22:0/4119861917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00bb40 con 0x7f65a8159c60 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 -- 172.21.15.22:0/4119861917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159c60 msgr2=0x7f65a815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 --2- 172.21.15.22:0/4119861917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159c60 0x7f65a815d5d0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f659c0098e0 tx=0x7f659c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 -- 172.21.15.22:0/4119861917 shutdown_connections 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 --2- 172.21.15.22:0/4119861917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a8159890 0x7f65a815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 --2- 172.21.15.22:0/4119861917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159c60 0x7f65a815d5d0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 -- 172.21.15.22:0/4119861917 >> 172.21.15.22:0/4119861917 conn(0x7f65a8068e20 msgr2=0x7f65a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 -- 172.21.15.22:0/4119861917 shutdown_connections 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.816+0000 7f65af929700 1 -- 172.21.15.22:0/4119861917 wait complete. 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.817+0000 7f65af929700 1 Processor -- start 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.817+0000 7f65af929700 1 -- start start 2023-10-08T00:32:47.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 0x7f65a80c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65a8159c60 0x7f65a8149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a815db10 0x7f65a8148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80c6160 con 0x7f65a8159890 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80c6440 con 0x7f65a8159c60 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80c6720 con 0x7f65a815db10 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 0x7f65a80c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 0x7f65a80c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41242/0 (socket says 172.21.15.22:41242) 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 -- 172.21.15.22:0/2419287168 learned_addr learned my addr 172.21.15.22:0/2419287168 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65adec6700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a815db10 0x7f65a8148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65acec4700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65a8159c60 0x7f65a8149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 -- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a815db10 msgr2=0x7f65a8148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a815db10 0x7f65a8148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 -- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65a8159c60 msgr2=0x7f65a8149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65a8159c60 0x7f65a8149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 -- 172.21.15.22:0/2419287168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009420 con 0x7f65a8159890 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65acec4700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65a8159c60 0x7f65a8149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65ad6c5700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 0x7f65a80c5830 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f6598009ef0 tx=0x7f659800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659800cc50 con 0x7f65a8159890 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659800f040 con 0x7f65a8159890 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a80c6a00 con 0x7f65a8159890 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.818+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598014480 con 0x7f65a8159890 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.819+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a80c5d70 con 0x7f65a8159890 2023-10-08T00:32:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.819+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a80893c0 con 0x7f65a8159890 2023-10-08T00:32:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.820+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f65980147f0 con 0x7f65a8159890 2023-10-08T00:32:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.820+0000 7f65a57fa700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6594067320 0x7f65940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.820+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6598085830 con 0x7f65a8159890 2023-10-08T00:32:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.820+0000 7f65acec4700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6594067320 0x7f65940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.821+0000 7f65acec4700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6594067320 0x7f65940697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f65a815a090 tx=0x7f659c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:47.825+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65980523b0 con 0x7f65a8159890 2023-10-08T00:32:48.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.020+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65a80890e0 con 0x7f65a8159890 2023-10-08T00:32:48.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.021+0000 7f65a57fa700 1 -- 172.21.15.22:0/2419287168 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f6598085090 con 0x7f65a8159890 2023-10-08T00:32:48.023 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:48.023 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":155,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:47.062881+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:45.308417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:46.026650+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:48.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.023+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6594067320 msgr2=0x7f65940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.023+0000 7f65af929700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6594067320 0x7f65940697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f65a815a090 tx=0x7f659c017000 comp rx=0 tx=0).stop 2023-10-08T00:32:48.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.023+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 msgr2=0x7f65a80c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.023+0000 7f65af929700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 0x7f65a80c5830 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f6598009ef0 tx=0x7f659800b040 comp rx=0 tx=0).stop 2023-10-08T00:32:48.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.023+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 shutdown_connections 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.023+0000 7f65af929700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6594067320 0x7f65940697d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.024+0000 7f65af929700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f65a815db10 0x7f65a8148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.024+0000 7f65af929700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65a8159890 0x7f65a80c5830 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.024+0000 7f65af929700 1 --2- 172.21.15.22:0/2419287168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65a8159c60 0x7f65a8149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.024+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 >> 172.21.15.22:0/2419287168 conn(0x7f65a8068e20 msgr2=0x7f65a815fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.024+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 shutdown_connections 2023-10-08T00:32:48.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.024+0000 7f65af929700 1 -- 172.21.15.22:0/2419287168 wait complete. 2023-10-08T00:32:48.038 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:48.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.155+0000 7fab3fb91700 1 Processor -- start 2023-10-08T00:32:48.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.155+0000 7fab3fb91700 1 -- start start 2023-10-08T00:32:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3fb91700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fab38159c60 0x7fab3815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3fb91700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab3815db10 0x7fab38069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3fb91700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3815a160 con 0x7fab38159890 2023-10-08T00:32:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3fb91700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3815df50 con 0x7fab3815db10 2023-10-08T00:32:48.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3fb91700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380d13a0 con 0x7fab38159c60 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab3815db10 0x7fab38069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab3815db10 0x7fab38069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41250/0 (socket says 172.21.15.22:41250) 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 -- 172.21.15.22:0/1239061510 learned_addr learned my addr 172.21.15.22:0/1239061510 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3d12c700 1 --2- 172.21.15.22:0/1239061510 >> v2:172.21.15.192:3300/0 conn(0x7fab38159c60 0x7fab3815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 -- 172.21.15.22:0/1239061510 >> v2:172.21.15.192:3300/0 conn(0x7fab38159c60 msgr2=0x7fab3815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 --2- 172.21.15.22:0/1239061510 >> v2:172.21.15.192:3300/0 conn(0x7fab38159c60 0x7fab3815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 -- 172.21.15.22:0/1239061510 >> v1:172.21.15.192:6789/0 conn(0x7fab38159890 legacy=0x7fab3815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:48.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3e12e700 1 -- 172.21.15.22:0/1239061510 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3815e140 con 0x7fab3815db10 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.156+0000 7fab3d12c700 1 --2- 172.21.15.22:0/1239061510 >> v2:172.21.15.192:3300/0 conn(0x7fab38159c60 0x7fab3815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3e12e700 1 --2- 172.21.15.22:0/1239061510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab3815db10 0x7fab38069560 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fab380b67f0 tx=0x7fab30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc61800ed8dd24f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3c92b700 1 -- 172.21.15.22:0/1239061510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3000e070 con 0x7fab3815db10 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3c92b700 1 -- 172.21.15.22:0/1239061510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3000ba10 con 0x7fab3815db10 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3c92b700 1 -- 172.21.15.22:0/1239061510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300092e0 con 0x7fab3815db10 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 -- 172.21.15.22:0/1239061510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab3815db10 msgr2=0x7fab38069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 --2- 172.21.15.22:0/1239061510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab3815db10 0x7fab38069560 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fab380b67f0 tx=0x7fab30009840 comp rx=0 tx=0).stop 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 -- 172.21.15.22:0/1239061510 shutdown_connections 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 --2- 172.21.15.22:0/1239061510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab3815db10 0x7fab38069560 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 --2- 172.21.15.22:0/1239061510 >> v2:172.21.15.192:3300/0 conn(0x7fab38159c60 0x7fab3815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 -- 172.21.15.22:0/1239061510 >> 172.21.15.22:0/1239061510 conn(0x7fab38068e20 msgr2=0x7fab380d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 -- 172.21.15.22:0/1239061510 shutdown_connections 2023-10-08T00:32:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.157+0000 7fab3fb91700 1 -- 172.21.15.22:0/1239061510 wait complete. 2023-10-08T00:32:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.158+0000 7fab3fb91700 1 Processor -- start 2023-10-08T00:32:48.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.158+0000 7fab3fb91700 1 -- start start 2023-10-08T00:32:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3fb91700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 0x7fab38151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3fb91700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab38159c60 0x7fab38155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3fb91700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab3815db10 0x7fab380c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3fb91700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38154420 con 0x7fab38159890 2023-10-08T00:32:48.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3fb91700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38153810 con 0x7fab3815db10 2023-10-08T00:32:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3fb91700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38153af0 con 0x7fab38159c60 2023-10-08T00:32:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3d92d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 0x7fab38151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3d92d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 0x7fab38151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41252/0 (socket says 172.21.15.22:41252) 2023-10-08T00:32:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3d92d700 1 -- 172.21.15.22:0/464282579 learned_addr learned my addr 172.21.15.22:0/464282579 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:48.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3e12e700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab3815db10 0x7fab380c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.159+0000 7fab3d12c700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab38159c60 0x7fab38155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3d92d700 1 -- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab38159c60 msgr2=0x7fab38155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3d92d700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab38159c60 0x7fab38155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3d92d700 1 -- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab3815db10 msgr2=0x7fab380c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3d92d700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab3815db10 0x7fab380c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3d92d700 1 -- 172.21.15.22:0/464282579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30009ae0 con 0x7fab38159890 2023-10-08T00:32:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3e12e700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab3815db10 0x7fab380c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3d92d700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 0x7fab38151c20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fab3400c5d0 tx=0x7fab34007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34011590 con 0x7fab38159890 2023-10-08T00:32:48.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34011710 con 0x7fab38159890 2023-10-08T00:32:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34011ad0 con 0x7fab38159890 2023-10-08T00:32:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab38153dd0 con 0x7fab38159890 2023-10-08T00:32:48.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.160+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab380cd2f0 con 0x7fab38159890 2023-10-08T00:32:48.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.161+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3804c3c0 con 0x7fab38159890 2023-10-08T00:32:48.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.162+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fab3401c460 con 0x7fab38159890 2023-10-08T00:32:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.162+0000 7fab2dffb700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab1c067320 0x7fab1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.162+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab34084a70 con 0x7fab38159890 2023-10-08T00:32:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.162+0000 7fab3d12c700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab1c067320 0x7fab1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.163+0000 7fab3d12c700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab1c067320 0x7fab1c0697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fab28006f00 tx=0x7fab28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.166+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab34051700 con 0x7fab38159890 2023-10-08T00:32:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.361+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab3806a5b0 con 0x7fab38159890 2023-10-08T00:32:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.362+0000 7fab2dffb700 1 -- 172.21.15.22:0/464282579 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fab34054d20 con 0x7fab38159890 2023-10-08T00:32:48.364 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:48.364 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":155,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:47.062881+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:45.308417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:46.026650+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab1c067320 msgr2=0x7fab1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab1c067320 0x7fab1c0697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fab28006f00 tx=0x7fab28008040 comp rx=0 tx=0).stop 2023-10-08T00:32:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 msgr2=0x7fab38151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 0x7fab38151c20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fab3400c5d0 tx=0x7fab34007f60 comp rx=0 tx=0).stop 2023-10-08T00:32:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 shutdown_connections 2023-10-08T00:32:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab3815db10 0x7fab380c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab38159890 0x7fab38151c20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab1c067320 0x7fab1c0697d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 --2- 172.21.15.22:0/464282579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab38159c60 0x7fab38155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 >> 172.21.15.22:0/464282579 conn(0x7fab38068e20 msgr2=0x7fab3815d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.364+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 shutdown_connections 2023-10-08T00:32:48.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.365+0000 7fab3fb91700 1 -- 172.21.15.22:0/464282579 wait complete. 2023-10-08T00:32:48.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:32:48.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.501+0000 7f42981e1700 1 Processor -- start 2023-10-08T00:32:48.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.501+0000 7f42981e1700 1 -- start start 2023-10-08T00:32:48.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f42981e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 0x7f429015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f42981e1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4290159c60 0x7f429015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f42981e1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429015a160 con 0x7f429015db10 2023-10-08T00:32:48.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f42981e1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42900d13a0 con 0x7f4290159c60 2023-10-08T00:32:48.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f42981e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429015e140 con 0x7f4290159890 2023-10-08T00:32:48.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f4295f7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 0x7f429015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f429577c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4290159c60 0x7f429015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f4295f7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 0x7f429015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:43394/0 (socket says 172.21.15.22:43394) 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.502+0000 7f4295f7d700 1 -- 172.21.15.22:0/3864230022 learned_addr learned my addr 172.21.15.22:0/3864230022 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4295f7d700 1 -- 172.21.15.22:0/3864230022 >> v2:172.21.15.192:3300/0 conn(0x7f4290159c60 msgr2=0x7f429015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4295f7d700 1 --2- 172.21.15.22:0/3864230022 >> v2:172.21.15.192:3300/0 conn(0x7f4290159c60 0x7f429015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4295f7d700 1 -- 172.21.15.22:0/3864230022 >> v1:172.21.15.192:6789/0 conn(0x7f429015db10 legacy=0x7f4290069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4295f7d700 1 -- 172.21.15.22:0/3864230022 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429015a3d0 con 0x7f4290159890 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f429577c700 1 --2- 172.21.15.22:0/3864230022 >> v2:172.21.15.192:3300/0 conn(0x7f4290159c60 0x7f429015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4295f7d700 1 --2- 172.21.15.22:0/3864230022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 0x7f429015abd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4280009f20 tx=0x7f4280009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3233bab7fb80d7fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4294f7b700 1 -- 172.21.15.22:0/3864230022 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428000e070 con 0x7f4290159890 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4294f7b700 1 -- 172.21.15.22:0/3864230022 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428000b9d0 con 0x7f4290159890 2023-10-08T00:32:48.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.503+0000 7f4294f7b700 1 -- 172.21.15.22:0/3864230022 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800092e0 con 0x7f4290159890 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 -- 172.21.15.22:0/3864230022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 msgr2=0x7f429015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 --2- 172.21.15.22:0/3864230022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 0x7f429015abd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4280009f20 tx=0x7f4280009840 comp rx=0 tx=0).stop 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 -- 172.21.15.22:0/3864230022 shutdown_connections 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 --2- 172.21.15.22:0/3864230022 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4290159890 0x7f429015abd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 --2- 172.21.15.22:0/3864230022 >> v2:172.21.15.192:3300/0 conn(0x7f4290159c60 0x7f429015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 -- 172.21.15.22:0/3864230022 >> 172.21.15.22:0/3864230022 conn(0x7f4290068e20 msgr2=0x7f42900d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 -- 172.21.15.22:0/3864230022 shutdown_connections 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.504+0000 7f42981e1700 1 -- 172.21.15.22:0/3864230022 wait complete. 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.505+0000 7f42981e1700 1 Processor -- start 2023-10-08T00:32:48.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.505+0000 7f42981e1700 1 -- start start 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f42981e1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4290159890 0x7f4290158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f42981e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 0x7f4290144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f42981e1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f429015db10 0x7f42900b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f42981e1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900b38d0 con 0x7f4290159c60 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f42981e1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900cf0a0 con 0x7f4290159890 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f42981e1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900cea90 con 0x7f429015db10 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 0x7f4290144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 0x7f4290144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41268/0 (socket says 172.21.15.22:41268) 2023-10-08T00:32:48.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 -- 172.21.15.22:0/2898034481 learned_addr learned my addr 172.21.15.22:0/2898034481 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f4295f7d700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4290159890 0x7f4290158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429677e700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f429015db10 0x7f42900b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 -- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f429015db10 msgr2=0x7f42900b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f429015db10 0x7f42900b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 -- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4290159890 msgr2=0x7f4290158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4290159890 0x7f4290158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 -- 172.21.15.22:0/2898034481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009420 con 0x7f4290159c60 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.506+0000 7f429577c700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 0x7f4290144a80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f428400ec80 tx=0x7f42840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.507+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428400c8e0 con 0x7f4290159c60 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.507+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428400ca40 con 0x7f4290159c60 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.507+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280009ae0 con 0x7f4290159c60 2023-10-08T00:32:48.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.507+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428400cde0 con 0x7f4290159c60 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.507+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4290158cb0 con 0x7f4290159c60 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.508+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42900cf230 con 0x7f4290159c60 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.508+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4284005a00 con 0x7f4290159c60 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.509+0000 7f428dffb700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f427c067320 0x7f427c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.509+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4284084cd0 con 0x7f4290159c60 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.509+0000 7f4295f7d700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f427c067320 0x7f427c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:48.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.509+0000 7f4295f7d700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f427c067320 0x7f427c0697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4280009880 tx=0x7f4280018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:48.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.513+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4284051960 con 0x7f4290159c60 2023-10-08T00:32:48.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:48.754+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f42900b63d0 con 0x7f4290159c60 2023-10-08T00:32:49.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.680+0000 7f428dffb700 1 -- 172.21.15.22:0/2898034481 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v105) v1 ==== 118+0+0 (secure 0 0 0) 0x7f42840210b0 con 0x7f4290159c60 2023-10-08T00:32:49.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.682+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f427c067320 msgr2=0x7f427c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:49.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.682+0000 7f42981e1700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f427c067320 0x7f427c0697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4280009880 tx=0x7f4280018000 comp rx=0 tx=0).stop 2023-10-08T00:32:49.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.682+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 msgr2=0x7f4290144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:49.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.682+0000 7f42981e1700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 0x7f4290144a80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f428400ec80 tx=0x7f42840091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.684 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 shutdown_connections 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f427c067320 0x7f427c0697d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f429015db10 0x7f42900b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4290159890 0x7f4290158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 --2- 172.21.15.22:0/2898034481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4290159c60 0x7f4290144a80 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 >> 172.21.15.22:0/2898034481 conn(0x7f4290068e20 msgr2=0x7f42900b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 shutdown_connections 2023-10-08T00:32:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.683+0000 7f42981e1700 1 -- 172.21.15.22:0/2898034481 wait complete. 2023-10-08T00:32:49.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:32:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.825+0000 7f4593eb7700 1 Processor -- start 2023-10-08T00:32:49.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.826+0000 7f4593eb7700 1 -- start start 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.826+0000 7f4593eb7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f458c159890 0x7f458c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.826+0000 7f4593eb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 0x7f458c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.826+0000 7f4593eb7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c15a160 con 0x7f458c15db10 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.826+0000 7f4593eb7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c0d13a0 con 0x7f458c159890 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.826+0000 7f4593eb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c15e140 con 0x7f458c159c60 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4592454700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f458c15db10 0x7f458c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52828/0 (socket says 172.21.15.22:52828) 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4592454700 1 -- 172.21.15.22:0/2867899069 learned_addr learned my addr 172.21.15.22:0/2867899069 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:49.831 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804921354 0 0) 0x7f458c15a160 con 0x7f458c15db10 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4591452700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 0x7f458c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4591c53700 1 --2- 172.21.15.22:0/2867899069 >> v2:172.21.15.192:3300/0 conn(0x7f458c159890 0x7f458c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4574003570 con 0x7f458c15db10 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457590869 0 0) 0x7f4574003570 con 0x7f458c15db10 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 msgr2=0x7f458c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 0x7f458c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 >> v2:172.21.15.192:3300/0 conn(0x7f458c159890 msgr2=0x7f458c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 --2- 172.21.15.22:0/2867899069 >> v2:172.21.15.192:3300/0 conn(0x7f458c159890 0x7f458c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c15a3d0 con 0x7f458c15db10 2023-10-08T00:32:49.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f45840017f0 con 0x7f458c15db10 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 >> v1:172.21.15.22:6789/0 conn(0x7f458c15db10 legacy=0x7f458c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 0x7f4574003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4574003fe0 0x7f4574004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4574004d50 0x7f45740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0d13a0 con 0x7f4574004d50 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c15e140 con 0x7f4574003fe0 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457400ba90 con 0x7f458c159c60 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4592454700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4574004d50 0x7f45740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.827+0000 7f4591452700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4574003fe0 0x7f4574004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4591c53700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 0x7f4574003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4592454700 1 -- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 msgr2=0x7f4574003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4592454700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c159c60 0x7f4574003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4592454700 1 -- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4574003fe0 msgr2=0x7f4574004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4592454700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4574003fe0 0x7f4574004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4592454700 1 -- 172.21.15.22:0/2867899069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4574003570 con 0x7f4574004d50 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4592454700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4574004d50 0x7f45740051c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f458400a970 tx=0x7f4584002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7167f354fc14f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584012440 con 0x7f4574004d50 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45840125c0 con 0x7f4574004d50 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4590c51700 1 -- 172.21.15.22:0/2867899069 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584012980 con 0x7f4574004d50 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.828+0000 7f4593eb7700 1 -- 172.21.15.22:0/2867899069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4574004d50 msgr2=0x7f45740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.829+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2867899069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4574004d50 0x7f45740051c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f458400a970 tx=0x7f4584002210 comp rx=0 tx=0).stop 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.829+0000 7f4592454700 1 -- 172.21.15.22:0/2867899069 reap_dead start 2023-10-08T00:32:49.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.829+0000 7f4593eb7700 1 -- 172.21.15.22:0/2867899069 shutdown_connections 2023-10-08T00:32:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.829+0000 7f4593eb7700 1 -- 172.21.15.22:0/2867899069 >> 172.21.15.22:0/2867899069 conn(0x7f458c068e20 msgr2=0x7f458c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.829+0000 7f4593eb7700 1 -- 172.21.15.22:0/2867899069 shutdown_connections 2023-10-08T00:32:49.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.829+0000 7f4593eb7700 1 -- 172.21.15.22:0/2867899069 wait complete. 2023-10-08T00:32:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.830+0000 7f4593eb7700 1 Processor -- start 2023-10-08T00:32:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.830+0000 7f4593eb7700 1 -- start start 2023-10-08T00:32:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.830+0000 7f4593eb7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f458c1491b0 0x7f458c0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4593eb7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c0ce740 0x7f458c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4593eb7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 0x7f458c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4593eb7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0cf860 con 0x7f458c149580 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4593eb7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0cec50 con 0x7f458c1491b0 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4593eb7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0cef30 con 0x7f458c0ce740 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 0x7f458c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 0x7f458c0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41290/0 (socket says 172.21.15.22:41290) 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 -- 172.21.15.22:0/2072097694 learned_addr learned my addr 172.21.15.22:0/2072097694 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4591c53700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f458c1491b0 0x7f458c0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 -- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c0ce740 msgr2=0x7f458c0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c0ce740 0x7f458c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 -- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f458c1491b0 msgr2=0x7f458c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:49.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f458c1491b0 0x7f458c0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 -- 172.21.15.22:0/2072097694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c0cf210 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4591c53700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f458c1491b0 0x7f458c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4592454700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 0x7f458c0b2060 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f4584002250 tx=0x7f4584015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840017b0 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45840072e0 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840076c0 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.831+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c0cf4f0 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.832+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c0cfcf0 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.832+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c0cfa10 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.833+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4584019030 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.833+0000 7f4589ffb700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4578067320 0x7f45780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.833+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4584086c00 con 0x7f458c149580 2023-10-08T00:32:49.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.834+0000 7f4591c53700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4578067320 0x7f45780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.834+0000 7f4591c53700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4578067320 0x7f45780697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f457c006f00 tx=0x7f457c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:49.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:49.838+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f458c0cfa10 con 0x7f458c149580 2023-10-08T00:32:50.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.078+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f458c0cfee0 con 0x7f458c149580 2023-10-08T00:32:50.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.685+0000 7f4589ffb700 1 -- 172.21.15.22:0/2072097694 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v106) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45840170c0 con 0x7f458c149580 2023-10-08T00:32:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4578067320 msgr2=0x7f45780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4578067320 0x7f45780697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f457c006f00 tx=0x7f457c008040 comp rx=0 tx=0).stop 2023-10-08T00:32:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 msgr2=0x7f458c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 0x7f458c0b2060 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f4584002250 tx=0x7f4584015000 comp rx=0 tx=0).stop 2023-10-08T00:32:50.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 shutdown_connections 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f458c149580 0x7f458c0b2060 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f458c1491b0 0x7f458c0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4578067320 0x7f45780697d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 --2- 172.21.15.22:0/2072097694 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f458c0ce740 0x7f458c0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 >> 172.21.15.22:0/2072097694 conn(0x7f458c068e20 msgr2=0x7f458c149a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.687+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 shutdown_connections 2023-10-08T00:32:50.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.688+0000 7f4593eb7700 1 -- 172.21.15.22:0/2072097694 wait complete. 2023-10-08T00:32:50.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.824+0000 7fd6f9d48700 1 Processor -- start 2023-10-08T00:32:50.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.824+0000 7fd6f9d48700 1 -- start start 2023-10-08T00:32:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f9d48700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6f4069560 0x7fd6f40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:50.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f9d48700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f4069ee0 con 0x7fd6f4159c60 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f9d48700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f415a160 con 0x7fd6f4159890 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f9d48700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40d13a0 con 0x7fd6f4069560 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd6f4069560 0x7fd6f40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f2ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd6f4159c60 0x7fd6f415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52844/0 (socket says 172.21.15.22:52844) 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.825+0000 7fd6f2ffd700 1 -- 172.21.15.22:0/2014200616 learned_addr learned my addr 172.21.15.22:0/2014200616 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f3fff700 1 -- 172.21.15.22:0/2014200616 >> v1:172.21.15.192:6789/0 conn(0x7fd6f4159890 legacy=0x7fd6f415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f3fff700 1 -- 172.21.15.22:0/2014200616 >> v1:172.21.15.22:6789/0 conn(0x7fd6f4159c60 legacy=0x7fd6f415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f3fff700 1 -- 172.21.15.22:0/2014200616 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f415e140 con 0x7fd6f4069560 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f27fc700 1 -- 172.21.15.22:0/2014200616 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615143732 0 0) 0x7fd6f4069ee0 con 0x7fd6f4159c60 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f3fff700 1 --2- 172.21.15.22:0/2014200616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4069560 0x7fd6f40699a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009e60 tx=0x7fd6ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bb2d525e4e0d3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:50.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f27fc700 1 -- 172.21.15.22:0/2014200616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00e070 con 0x7fd6f4069560 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f27fc700 1 -- 172.21.15.22:0/2014200616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00bc30 con 0x7fd6f4069560 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.826+0000 7fd6f27fc700 1 -- 172.21.15.22:0/2014200616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec012430 con 0x7fd6f4069560 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 -- 172.21.15.22:0/2014200616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4069560 msgr2=0x7fd6f40699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/2014200616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4069560 0x7fd6f40699a0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009e60 tx=0x7fd6ec009780 comp rx=0 tx=0).stop 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 -- 172.21.15.22:0/2014200616 shutdown_connections 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/2014200616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4069560 0x7fd6f40699a0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 -- 172.21.15.22:0/2014200616 >> 172.21.15.22:0/2014200616 conn(0x7fd6f4068e20 msgr2=0x7fd6f40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 -- 172.21.15.22:0/2014200616 shutdown_connections 2023-10-08T00:32:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.827+0000 7fd6f9d48700 1 -- 172.21.15.22:0/2014200616 wait complete. 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.828+0000 7fd6f9d48700 1 Processor -- start 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.828+0000 7fd6f9d48700 1 -- start start 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4069560 0x7fd6f41542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6f4159890 0x7fd6f40c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 0x7fd6f40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40b3800 con 0x7fd6f4159c60 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40cd5c0 con 0x7fd6f4069560 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40cd8a0 con 0x7fd6f4159890 2023-10-08T00:32:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 0x7fd6f40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 0x7fd6f40b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41308/0 (socket says 172.21.15.22:41308) 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 -- 172.21.15.22:0/3998745930 learned_addr learned my addr 172.21.15.22:0/3998745930 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 -- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6f4159890 msgr2=0x7fd6f40c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6f4159890 0x7fd6f40c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 -- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4069560 msgr2=0x7fd6f41542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4069560 0x7fd6f41542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 -- 172.21.15.22:0/3998745930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec009a20 con 0x7fd6f4159c60 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f3fff700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 0x7fd6f40b1a20 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec013000 tx=0x7fd6ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec01b630 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec01b790 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f40cdb80 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec01bb30 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.829+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f4154810 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.830+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f404c3c0 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.831+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd6ec01c400 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.831+0000 7fd6db7fe700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6e0067320 0x7fd6e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.831+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6ec086d40 con 0x7fd6f4159c60 2023-10-08T00:32:50.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.832+0000 7fd6f37fe700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6e0067320 0x7fd6e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:50.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.832+0000 7fd6f37fe700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6e0067320 0x7fd6e00697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4001730 tx=0x7fd6e4007b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:50.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:50.836+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6ec0538c0 con 0x7fd6f4159c60 2023-10-08T00:32:51.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.073+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6f406a5b0 con 0x7fd6f4159c60 2023-10-08T00:32:51.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.074+0000 7fd6db7fe700 1 -- 172.21.15.22:0/3998745930 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fd6ec02a020 con 0x7fd6f4159c60 2023-10-08T00:32:51.076 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:51.076 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":106,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:47.063189+0000","modified":"2023-10-08T00:32:50.680465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7929":{"gid":7929,"name":"d","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/1078154935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1078154935},{"type":"v1","addr":"172.21.15.192:6836","nonce":1078154935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6e0067320 msgr2=0x7fd6e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6e0067320 0x7fd6e00697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4001730 tx=0x7fd6e4007b40 comp rx=0 tx=0).stop 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 msgr2=0x7fd6f40b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 0x7fd6f40b1a20 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec013000 tx=0x7fd6ec019000 comp rx=0 tx=0).stop 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 shutdown_connections 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f4159c60 0x7fd6f40b1a20 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4069560 0x7fd6f41542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd6e0067320 0x7fd6e00697d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 --2- 172.21.15.22:0/3998745930 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd6f4159890 0x7fd6f40c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 >> 172.21.15.22:0/3998745930 conn(0x7fd6f4068e20 msgr2=0x7fd6f415aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 shutdown_connections 2023-10-08T00:32:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.076+0000 7fd6f9d48700 1 -- 172.21.15.22:0/3998745930 wait complete. 2023-10-08T00:32:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 106 2023-10-08T00:32:51.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:32:51.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.207+0000 7f1ff310c700 1 Processor -- start 2023-10-08T00:32:51.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.207+0000 7f1ff310c700 1 -- start start 2023-10-08T00:32:51.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff310c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fec159c10 0x7f1fec15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff310c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec15c910 0x7f1fec15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff310c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec15c480 con 0x7f1fec0b5ea0 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff310c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0b2a40 con 0x7f1fec159c10 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff310c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec15d290 con 0x7f1fec15c910 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff0ea8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fec159c10 0x7f1fec15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff16a9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec15c910 0x7f1fec15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff0ea8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fec159c10 0x7f1fec15b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:51504/0 (socket says 172.21.15.22:51504) 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.208+0000 7f1ff0ea8700 1 -- 172.21.15.22:0/2445944864 learned_addr learned my addr 172.21.15.22:0/2445944864 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1ff0ea8700 1 -- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec15c910 msgr2=0x7f1fec15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1ff0ea8700 1 --2- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec15c910 0x7f1fec15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1ff0ea8700 1 -- 172.21.15.22:0/2445944864 >> v1:172.21.15.192:6789/0 conn(0x7f1fec0b5ea0 legacy=0x7f1fec068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1ff0ea8700 1 -- 172.21.15.22:0/2445944864 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec15b5d0 con 0x7f1fec159c10 2023-10-08T00:32:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1ff16a9700 1 --2- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec15c910 0x7f1fec15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1ff0ea8700 1 --2- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec159c10 0x7f1fec15b090 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40099b0 tx=0x7f1fe4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72e8c3f053c346c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1feb7fe700 1 -- 172.21.15.22:0/2445944864 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4009ea0 con 0x7f1fec159c10 2023-10-08T00:32:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1feb7fe700 1 -- 172.21.15.22:0/2445944864 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400b860 con 0x7f1fec159c10 2023-10-08T00:32:51.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.209+0000 7f1feb7fe700 1 -- 172.21.15.22:0/2445944864 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400bc00 con 0x7f1fec159c10 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 -- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec159c10 msgr2=0x7f1fec15b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 --2- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec159c10 0x7f1fec15b090 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40099b0 tx=0x7f1fe4009250 comp rx=0 tx=0).stop 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 -- 172.21.15.22:0/2445944864 shutdown_connections 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 --2- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec15c910 0x7f1fec15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 --2- 172.21.15.22:0/2445944864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec159c10 0x7f1fec15b090 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 -- 172.21.15.22:0/2445944864 >> 172.21.15.22:0/2445944864 conn(0x7f1fec099a20 msgr2=0x7f1fec0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 -- 172.21.15.22:0/2445944864 shutdown_connections 2023-10-08T00:32:51.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.210+0000 7f1ff310c700 1 -- 172.21.15.22:0/2445944864 wait complete. 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.211+0000 7f1ff310c700 1 Processor -- start 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.211+0000 7f1ff310c700 1 -- start start 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff310c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b5ea0 0x7f1fec0af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff310c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec159c10 0x7f1fec15fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff310c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 0x7f1fec0ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff310c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0af5e0 con 0x7f1fec15c910 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff310c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0af8b0 con 0x7f1fec0b5ea0 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff310c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0afb90 con 0x7f1fec159c10 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 0x7f1fec0ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 0x7f1fec0ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41318/0 (socket says 172.21.15.22:41318) 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 -- 172.21.15.22:0/3698714570 learned_addr learned my addr 172.21.15.22:0/3698714570 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:51.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1febfff700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec159c10 0x7f1fec15fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff0ea8700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b5ea0 0x7f1fec0af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 -- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec159c10 msgr2=0x7f1fec15fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec159c10 0x7f1fec15fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 -- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b5ea0 msgr2=0x7f1fec0af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b5ea0 0x7f1fec0af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 -- 172.21.15.22:0/3698714570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009420 con 0x7f1fec15c910 2023-10-08T00:32:51.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.212+0000 7f1ff16a9700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 0x7f1fec0ad390 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400ea20 tx=0x7f1fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.213+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400ee60 con 0x7f1fec15c910 2023-10-08T00:32:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.213+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400c850 con 0x7f1fec15c910 2023-10-08T00:32:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.213+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe40094f0 con 0x7f1fec15c910 2023-10-08T00:32:51.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.213+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd400cc10 con 0x7f1fec15c910 2023-10-08T00:32:51.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.213+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec0b01d0 con 0x7f1fec15c910 2023-10-08T00:32:51.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.214+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec04c3c0 con 0x7f1fec15c910 2023-10-08T00:32:51.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.214+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1fd4013470 con 0x7f1fec15c910 2023-10-08T00:32:51.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.215+0000 7f1fe8ff9700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1fcc067320 0x7f1fcc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.215+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1fd4084be0 con 0x7f1fec15c910 2023-10-08T00:32:51.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.215+0000 7f1ff0ea8700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1fcc067320 0x7f1fcc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.215+0000 7f1ff0ea8700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1fcc067320 0x7f1fcc0697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40099b0 tx=0x7f1fe4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.219+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fd4051870 con 0x7f1fec15c910 2023-10-08T00:32:51.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.413+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fec15b870 con 0x7f1fec15c910 2023-10-08T00:32:51.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.413+0000 7f1fe8ff9700 1 -- 172.21.15.22:0/3698714570 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f1fd4017090 con 0x7f1fec15c910 2023-10-08T00:32:51.415 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:51.415 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":156,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:48.650458+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:45.308417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:46.026650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:32:51.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1fcc067320 msgr2=0x7f1fcc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1fcc067320 0x7f1fcc0697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1fe40099b0 tx=0x7f1fe4017000 comp rx=0 tx=0).stop 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 msgr2=0x7f1fec0ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 0x7f1fec0ad390 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400ea20 tx=0x7f1fd40091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 shutdown_connections 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fec15c910 0x7f1fec0ad390 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b5ea0 0x7f1fec0af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1fcc067320 0x7f1fcc0697d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 --2- 172.21.15.22:0/3698714570 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1fec159c10 0x7f1fec15fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 >> 172.21.15.22:0/3698714570 conn(0x7f1fec099a20 msgr2=0x7f1fec09a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 shutdown_connections 2023-10-08T00:32:51.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.416+0000 7f1ff310c700 1 -- 172.21.15.22:0/3698714570 wait complete. 2023-10-08T00:32:51.430 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:32:51.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.548+0000 7f71c5047700 1 Processor -- start 2023-10-08T00:32:51.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.548+0000 7f71c5047700 1 -- start start 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.549+0000 7f71c5047700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c00cd1e0 0x7f71c00c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.549+0000 7f71c5047700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c015c2a0 con 0x7f71c006bcd0 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.549+0000 7f71c5047700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c015b690 con 0x7f71c0141500 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.549+0000 7f71c5047700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c015b970 con 0x7f71c00cd1e0 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.549+0000 7f71bed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f71c006bcd0 0x7f71c0140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52854/0 (socket says 172.21.15.22:52854) 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.549+0000 7f71bed9d700 1 -- 172.21.15.22:0/1869621228 learned_addr learned my addr 172.21.15.22:0/1869621228 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bf59e700 1 --2- 172.21.15.22:0/1869621228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c00cd1e0 0x7f71c00c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522248983 0 0) 0x7f71c015c2a0 con 0x7f71c006bcd0 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac003570 con 0x7f71c006bcd0 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247052113 0 0) 0x7f71c015b690 con 0x7f71c0141500 2023-10-08T00:32:51.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c015c2a0 con 0x7f71c0141500 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1773842254 0 0) 0x7f71ac003570 con 0x7f71c006bcd0 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bf59e700 1 -- 172.21.15.22:0/1869621228 >> v1:172.21.15.192:6789/0 conn(0x7f71c0141500 legacy=0x7f71c00c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bf59e700 1 -- 172.21.15.22:0/1869621228 >> v1:172.21.15.22:6789/0 conn(0x7f71c006bcd0 legacy=0x7f71c0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bf59e700 1 -- 172.21.15.22:0/1869621228 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c015bc50 con 0x7f71c00cd1e0 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bf59e700 1 --2- 172.21.15.22:0/1869621228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c00cd1e0 0x7f71c00c9510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e90 tx=0x7f71b0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c356234c0af970d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b000e070 con 0x7f71c00cd1e0 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b000b870 con 0x7f71c00cd1e0 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.550+0000 7f71bdd9b700 1 -- 172.21.15.22:0/1869621228 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8001470 con 0x7f71c00cd1e0 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 -- 172.21.15.22:0/1869621228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c00cd1e0 msgr2=0x7f71c00c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 --2- 172.21.15.22:0/1869621228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c00cd1e0 0x7f71c00c9510 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009e90 tx=0x7f71b0009780 comp rx=0 tx=0).stop 2023-10-08T00:32:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 -- 172.21.15.22:0/1869621228 shutdown_connections 2023-10-08T00:32:51.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 --2- 172.21.15.22:0/1869621228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c00cd1e0 0x7f71c00c9510 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 -- 172.21.15.22:0/1869621228 >> 172.21.15.22:0/1869621228 conn(0x7f71c00ce600 msgr2=0x7f71c00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:51.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 -- 172.21.15.22:0/1869621228 shutdown_connections 2023-10-08T00:32:51.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.551+0000 7f71c5047700 1 -- 172.21.15.22:0/1869621228 wait complete. 2023-10-08T00:32:51.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.552+0000 7f71c5047700 1 Processor -- start 2023-10-08T00:32:51.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.552+0000 7f71c5047700 1 -- start start 2023-10-08T00:32:51.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71c5047700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c006bcd0 0x7f71c00b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71c5047700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c00cd1e0 0x7f71c00c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71c5047700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 0x7f71c00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71c5047700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00c6ad0 con 0x7f71c0141500 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71c5047700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0167ac0 con 0x7f71c00cd1e0 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71c5047700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00c5bf0 con 0x7f71c006bcd0 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 0x7f71c00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 0x7f71c00b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41332/0 (socket says 172.21.15.22:41332) 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 -- 172.21.15.22:0/1165534917 learned_addr learned my addr 172.21.15.22:0/1165534917 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bed9d700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c006bcd0 0x7f71c00b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71be59c700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c00cd1e0 0x7f71c00c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 -- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c006bcd0 msgr2=0x7f71c00b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c006bcd0 0x7f71c00b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 -- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c00cd1e0 msgr2=0x7f71c00c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c00cd1e0 0x7f71c00c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71bf59e700 1 -- 172.21.15.22:0/1165534917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0009a20 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.553+0000 7f71be59c700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c00cd1e0 0x7f71c00c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.554+0000 7f71bf59e700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 0x7f71c00b13a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f71c0069220 tx=0x7f71b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.554+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0012cf0 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.554+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b0012e70 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.554+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b001e680 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.554+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c00c5ec0 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.554+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c00c6480 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.555+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c00c6c40 con 0x7f71c0141500 2023-10-08T00:32:51.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.555+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f71b001ea70 con 0x7f71c0141500 2023-10-08T00:32:51.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.555+0000 7f71b6ffd700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f71a0067320 0x7f71a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.556+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71b0087190 con 0x7f71c0141500 2023-10-08T00:32:51.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.556+0000 7f71bed9d700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f71a0067320 0x7f71a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.556+0000 7f71bed9d700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f71a0067320 0x7f71a00697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f71b80011e0 tx=0x7f71b8001620 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.560+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71b0053d10 con 0x7f71c0141500 2023-10-08T00:32:51.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.749+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71c015bf30 con 0x7f71a0067320 2023-10-08T00:32:51.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.757+0000 7f71b6ffd700 1 -- 172.21.15.22:0/1165534917 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274602 (secure 0 0 0) 0x7f71c015bf30 con 0x7f71a0067320 2023-10-08T00:32:51.761 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:51.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f71a0067320 msgr2=0x7f71a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f71a0067320 0x7f71a00697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f71b80011e0 tx=0x7f71b8001620 comp rx=0 tx=0).stop 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 msgr2=0x7f71c00b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 0x7f71c00b13a0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f71c0069220 tx=0x7f71b0017000 comp rx=0 tx=0).stop 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 shutdown_connections 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71c0141500 0x7f71c00b13a0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f71a0067320 0x7f71a00697d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f71c006bcd0 0x7f71c00b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 --2- 172.21.15.22:0/1165534917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c00cd1e0 0x7f71c00c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 >> 172.21.15.22:0/1165534917 conn(0x7f71c00ce600 msgr2=0x7f71c0140100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 shutdown_connections 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.760+0000 7f71c5047700 1 -- 172.21.15.22:0/1165534917 wait complete. 2023-10-08T00:32:51.764 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:51.773 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2023-10-08T00:32:50.495936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2427272,"kb_used_data":16200,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547448,"statfs":{"total":773094113280,"available":770608586752,"internally_reserved":0,"allocated":16588800,"data_stored":8066672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.847028"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-08T00:32:43.530009+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:43.530009+0000","last_peered":"2023-10-08T00:32:43.530009+0000","last_clean":"2023-10-08T00:32:43.530009+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:43.530009+0000","last_undegraded":"2023-10-08T00:32:43.530009+0000","last_fullsized":"2023-10-08T00:32:43.530009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1451110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.373},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.59199999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.47199999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.245},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28399999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.32200000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.42699999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.62},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.54500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1451110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.50600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.63700000000000001},"last":0.27700000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.39000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.55000000000000004,"15min":0.63100000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.374},"min":{"1min":0.253,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.41999999999999998},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.60699999999999998,"15min":0.64700000000000002},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":1.242},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0800000000000001},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.307},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.503}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.46899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.62}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.65600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.74099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.435},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.755}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63800000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:51.781 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:51.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.932+0000 7f3a5e736700 1 Processor -- start 2023-10-08T00:32:51.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.932+0000 7f3a5e736700 1 -- start start 2023-10-08T00:32:51.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5e736700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a5806c0f0 0x7f3a58159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5e736700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a58143420 con 0x7f3a580b3810 2023-10-08T00:32:51.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5e736700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5806a1e0 con 0x7f3a58143050 2023-10-08T00:32:51.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5e736700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a580695d0 con 0x7f3a5806c0f0 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5df35700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3a580b3810 0x7f3a580b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52868/0 (socket says 172.21.15.22:52868) 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5df35700 1 -- 172.21.15.22:0/2685444037 learned_addr learned my addr 172.21.15.22:0/2685444037 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a5cf33700 1 --2- 172.21.15.22:0/2685444037 >> v2:172.21.15.192:3300/0 conn(0x7f3a5806c0f0 0x7f3a58159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a57fff700 1 -- 172.21.15.22:0/2685444037 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167315601 0 0) 0x7f3a58143420 con 0x7f3a580b3810 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.933+0000 7f3a57fff700 1 -- 172.21.15.22:0/2685444037 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a40003570 con 0x7f3a580b3810 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a5cf33700 1 -- 172.21.15.22:0/2685444037 >> v1:172.21.15.192:6789/0 conn(0x7f3a58143050 legacy=0x7f3a5806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a5cf33700 1 -- 172.21.15.22:0/2685444037 >> v1:172.21.15.22:6789/0 conn(0x7f3a580b3810 legacy=0x7f3a580b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a5cf33700 1 -- 172.21.15.22:0/2685444037 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a580698b0 con 0x7f3a5806c0f0 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a5cf33700 1 --2- 172.21.15.22:0/2685444037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a5806c0f0 0x7f3a58159c90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0098e0 tx=0x7f3a4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6943cf2620d2231 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a57fff700 1 -- 172.21.15.22:0/2685444037 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00b640 con 0x7f3a5806c0f0 2023-10-08T00:32:51.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a57fff700 1 -- 172.21.15.22:0/2685444037 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00b7a0 con 0x7f3a5806c0f0 2023-10-08T00:32:51.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a57fff700 1 -- 172.21.15.22:0/2685444037 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c00bb40 con 0x7f3a5806c0f0 2023-10-08T00:32:51.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a5e736700 1 -- 172.21.15.22:0/2685444037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a5806c0f0 msgr2=0x7f3a58159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.934+0000 7f3a5e736700 1 --2- 172.21.15.22:0/2685444037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a5806c0f0 0x7f3a58159c90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0098e0 tx=0x7f3a4c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.935+0000 7f3a5e736700 1 -- 172.21.15.22:0/2685444037 shutdown_connections 2023-10-08T00:32:51.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.935+0000 7f3a5e736700 1 --2- 172.21.15.22:0/2685444037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a5806c0f0 0x7f3a58159c90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.935+0000 7f3a5e736700 1 -- 172.21.15.22:0/2685444037 >> 172.21.15.22:0/2685444037 conn(0x7f3a580ce430 msgr2=0x7f3a580ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.935+0000 7f3a5e736700 1 -- 172.21.15.22:0/2685444037 shutdown_connections 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.935+0000 7f3a5e736700 1 -- 172.21.15.22:0/2685444037 wait complete. 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.936+0000 7f3a5e736700 1 Processor -- start 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.936+0000 7f3a5e736700 1 -- start start 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a5806c0f0 0x7f3a58159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a580b3810 0x7f3a5815c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 0x7f3a5813d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a580c7950 con 0x7f3a58143050 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5815f240 con 0x7f3a580b3810 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5816dbf0 con 0x7f3a5806c0f0 2023-10-08T00:32:51.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 0x7f3a5813d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 0x7f3a5813d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41344/0 (socket says 172.21.15.22:41344) 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 -- 172.21.15.22:0/3226502245 learned_addr learned my addr 172.21.15.22:0/3226502245 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5cf33700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a580b3810 0x7f3a5815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5d734700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a5806c0f0 0x7f3a58159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 -- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a5806c0f0 msgr2=0x7f3a58159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a5806c0f0 0x7f3a58159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 -- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a580b3810 msgr2=0x7f3a5815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a580b3810 0x7f3a5815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 -- 172.21.15.22:0/3226502245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c009420 con 0x7f3a58143050 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5cf33700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a580b3810 0x7f3a5815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:51.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5df35700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 0x7f3a5813d690 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001460 tx=0x7f3a48001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4800ce80 con 0x7f3a58143050 2023-10-08T00:32:51.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4800ab70 con 0x7f3a58143050 2023-10-08T00:32:51.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5816ded0 con 0x7f3a58143050 2023-10-08T00:32:51.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a480070f0 con 0x7f3a58143050 2023-10-08T00:32:51.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.937+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5815c570 con 0x7f3a58143050 2023-10-08T00:32:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.938+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5804c3c0 con 0x7f3a58143050 2023-10-08T00:32:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.939+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3a48007520 con 0x7f3a58143050 2023-10-08T00:32:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.939+0000 7f3a557fa700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a44067320 0x7f3a440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.939+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a48085140 con 0x7f3a58143050 2023-10-08T00:32:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.939+0000 7f3a5d734700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a44067320 0x7f3a440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.940+0000 7f3a5d734700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a44067320 0x7f3a440697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3a50003890 tx=0x7f3a50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:51.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:51.943+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a48051e10 con 0x7f3a58143050 2023-10-08T00:32:52.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.131+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a580adad0 con 0x7f3a44067320 2023-10-08T00:32:52.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.139+0000 7f3a557fa700 1 -- 172.21.15.22:0/3226502245 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274602 (secure 0 0 0) 0x7f3a580adad0 con 0x7f3a44067320 2023-10-08T00:32:52.145 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a44067320 msgr2=0x7f3a440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a44067320 0x7f3a440697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f3a50003890 tx=0x7f3a50009040 comp rx=0 tx=0).stop 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 msgr2=0x7f3a5813d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 0x7f3a5813d690 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3a48001460 tx=0x7f3a48001ae0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 shutdown_connections 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a58143050 0x7f3a5813d690 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3a44067320 0x7f3a440697d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3a5806c0f0 0x7f3a58159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 --2- 172.21.15.22:0/3226502245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a580b3810 0x7f3a5815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 >> 172.21.15.22:0/3226502245 conn(0x7f3a580ce430 msgr2=0x7f3a58140b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 shutdown_connections 2023-10-08T00:32:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.142+0000 7f3a5e736700 1 -- 172.21.15.22:0/3226502245 wait complete. 2023-10-08T00:32:52.149 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:52.156 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":392,"stamp":"2023-10-08T00:32:50.495936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2427272,"kb_used_data":16200,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547448,"statfs":{"total":773094113280,"available":770608586752,"internally_reserved":0,"allocated":16588800,"data_stored":8066672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.847028"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:46.643905+0000","last_change":"2023-10-08T00:32:46.643905+0000","last_active":"2023-10-08T00:32:46.643905+0000","last_peered":"2023-10-08T00:32:46.643905+0000","last_clean":"2023-10-08T00:32:46.643905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:46.643905+0000","last_undegraded":"2023-10-08T00:32:46.643905+0000","last_fullsized":"2023-10-08T00:32:46.643905+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:32:45.641806+0000","last_change":"2023-10-08T00:32:45.641806+0000","last_active":"2023-10-08T00:32:45.641806+0000","last_peered":"2023-10-08T00:32:45.641806+0000","last_clean":"2023-10-08T00:32:45.641806+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:32:45.641806+0000","last_undegraded":"2023-10-08T00:32:45.641806+0000","last_fullsized":"2023-10-08T00:32:45.641806+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":273,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-08T00:32:43.530009+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:43.530009+0000","last_peered":"2023-10-08T00:32:43.530009+0000","last_clean":"2023-10-08T00:32:43.530009+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:43.530009+0000","last_undegraded":"2023-10-08T00:32:43.530009+0000","last_fullsized":"2023-10-08T00:32:43.530009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1451110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.373},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.80000000000000004}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.59199999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.47199999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.496}]}]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.245},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.28399999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.32200000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.42699999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.62},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.54500000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303844,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067996,"statfs":{"total":96636764160,"available":96325627904,"internally_reserved":0,"allocated":2519040,"data_stored":1451110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.50600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.63700000000000001},"last":0.27700000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.39000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.55000000000000004,"15min":0.63100000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.374},"min":{"1min":0.253,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.41999999999999998},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.60699999999999998,"15min":0.64700000000000002},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":1.242},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0800000000000001},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.56000000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.68100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.307},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.39800000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.503}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.46899999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.62}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.65600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.37}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.873},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.74099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.435},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54800000000000004}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.68799999999999994}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.755}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303264,"kb_used_data":1880,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068576,"statfs":{"total":96636764160,"available":96326221824,"internally_reserved":0,"allocated":1925120,"data_stored":860742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.63800000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.623},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:52.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:52.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.314+0000 7f7552d81700 1 Processor -- start 2023-10-08T00:32:52.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.314+0000 7f7552d81700 1 -- start start 2023-10-08T00:32:52.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.314+0000 7f7552d81700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 0x7f754c1645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.314+0000 7f7552d81700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0cfb30 con 0x7f754c159840 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f7552d81700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0cbc40 con 0x7f754c159c10 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f7552d81700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0cbf10 con 0x7f754c069bb0 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f7550b1d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f754c159840 0x7f754c0cb530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52876/0 (socket says 172.21.15.22:52876) 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f7550b1d700 1 -- 172.21.15.22:0/3621479689 learned_addr learned my addr 172.21.15.22:0/3621479689 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f755131e700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 0x7f754c1645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629736368 0 0) 0x7f754c0cfb30 con 0x7f754c159840 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7538003570 con 0x7f754c159840 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 143425142 0 0) 0x7f7538003570 con 0x7f754c159840 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 msgr2=0x7f754c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 0x7f754c1645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 >> v1:172.21.15.192:6789/0 conn(0x7f754c159c10 legacy=0x7f754c0694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0cf4e0 con 0x7f754c159840 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f7544001470 con 0x7f754c159840 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 >> v1:172.21.15.22:6789/0 conn(0x7f754c159840 legacy=0x7f754c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 0x7f7538003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7538004010 0x7f7538004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7538004d50 0x7f75380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0cbf10 con 0x7f7538004d50 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753800bc70 con 0x7f7538004010 2023-10-08T00:32:52.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753800be30 con 0x7f754c069bb0 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.315+0000 7f755131e700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7538004d50 0x7f75380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f7550b1d700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 0x7f7538003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f754bfff700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7538004010 0x7f7538004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f755131e700 1 -- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 msgr2=0x7f7538003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f755131e700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c069bb0 0x7f7538003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f755131e700 1 -- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7538004010 msgr2=0x7f7538004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f755131e700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7538004010 0x7f7538004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f755131e700 1 -- 172.21.15.22:0/3621479689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538003570 con 0x7f7538004d50 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f755131e700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7538004d50 0x7f75380051c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f7534006f00 tx=0x7f75340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8443ba36e46357 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400e6e0 con 0x7f7538004d50 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753400e840 con 0x7f7538004d50 2023-10-08T00:32:52.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.316+0000 7f754b7fe700 1 -- 172.21.15.22:0/3621479689 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400ebe0 con 0x7f7538004d50 2023-10-08T00:32:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f7552d81700 1 -- 172.21.15.22:0/3621479689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7538004d50 msgr2=0x7f75380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f7552d81700 1 --2- 172.21.15.22:0/3621479689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7538004d50 0x7f75380051c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f7534006f00 tx=0x7f75340091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f755131e700 1 -- 172.21.15.22:0/3621479689 reap_dead start 2023-10-08T00:32:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f7552d81700 1 -- 172.21.15.22:0/3621479689 shutdown_connections 2023-10-08T00:32:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f7552d81700 1 -- 172.21.15.22:0/3621479689 >> 172.21.15.22:0/3621479689 conn(0x7f754c068e10 msgr2=0x7f754c0d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f7552d81700 1 -- 172.21.15.22:0/3621479689 shutdown_connections 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.317+0000 7f7552d81700 1 -- 172.21.15.22:0/3621479689 wait complete. 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.318+0000 7f7552d81700 1 Processor -- start 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.318+0000 7f7552d81700 1 -- start start 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c154b30 0x7f754c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f754c15cbc0 0x7f754c0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 0x7f754c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15bb20 con 0x7f754c15d030 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15be00 con 0x7f754c15cbc0 2023-10-08T00:32:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15c0e0 con 0x7f754c154b30 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 0x7f754c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 0x7f754c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41368/0 (socket says 172.21.15.22:41368) 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 -- 172.21.15.22:0/4070628055 learned_addr learned my addr 172.21.15.22:0/4070628055 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7550b1d700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c154b30 0x7f754c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f754bfff700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f754c15cbc0 0x7f754c0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 -- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c154b30 msgr2=0x7f754c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c154b30 0x7f754c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 -- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f754c15cbc0 msgr2=0x7f754c0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f754c15cbc0 0x7f754c0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 -- 172.21.15.22:0/4070628055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c15c3c0 con 0x7f754c15d030 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f755131e700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 0x7f754c0b55b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f7534009720 tx=0x7f753401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534022070 con 0x7f754c15d030 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753401c450 con 0x7f754c15d030 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c15c6a0 con 0x7f754c15d030 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400e6e0 con 0x7f754c15d030 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.319+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c0c7810 con 0x7f754c15d030 2023-10-08T00:32:52.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.320+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c064550 con 0x7f754c15d030 2023-10-08T00:32:52.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.321+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f753401cae0 con 0x7f754c15d030 2023-10-08T00:32:52.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.321+0000 7f7548ff9700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f752c067320 0x7f752c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.321+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7534000e40 con 0x7f754c15d030 2023-10-08T00:32:52.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.321+0000 7f7550b1d700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f752c067320 0x7f752c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.322+0000 7f7550b1d700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f752c067320 0x7f752c0697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7544001ce0 tx=0x7f7544009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:52.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.325+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75340530c0 con 0x7f754c15d030 2023-10-08T00:32:52.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.515+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f754c15bf70 con 0x7f752c067320 2023-10-08T00:32:52.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.524+0000 7f7548ff9700 1 -- 172.21.15.22:0/4070628055 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289763 (secure 0 0 0) 0x7f754c15bf70 con 0x7f752c067320 2023-10-08T00:32:52.528 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f752c067320 msgr2=0x7f752c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f752c067320 0x7f752c0697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7544001ce0 tx=0x7f7544009040 comp rx=0 tx=0).stop 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 msgr2=0x7f754c0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 0x7f754c0b55b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f7534009720 tx=0x7f753401a000 comp rx=0 tx=0).stop 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 shutdown_connections 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f754c15d030 0x7f754c0b55b0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f752c067320 0x7f752c0697d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f754c154b30 0x7f754c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 --2- 172.21.15.22:0/4070628055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f754c15cbc0 0x7f754c0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 >> 172.21.15.22:0/4070628055 conn(0x7f754c068e10 msgr2=0x7f754c0b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 shutdown_connections 2023-10-08T00:32:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.527+0000 7f7552d81700 1 -- 172.21.15.22:0/4070628055 wait complete. 2023-10-08T00:32:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:52.540 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-08T00:32:52.496340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427720,"kb_used_data":16648,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547000,"statfs":{"total":773094113280,"available":770608128000,"internally_reserved":0,"allocated":17047552,"data_stored":8272236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001274"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676494+0000","last_change":"2023-10-08T00:32:47.673182+0000","last_active":"2023-10-08T00:32:47.676494+0000","last_peered":"2023-10-08T00:32:47.676494+0000","last_clean":"2023-10-08T00:32:47.676494+0000","last_became_active":"2023-10-08T00:32:47.672899+0000","last_became_peered":"2023-10-08T00:32:47.672899+0000","last_unstale":"2023-10-08T00:32:47.676494+0000","last_undegraded":"2023-10-08T00:32:47.676494+0000","last_fullsized":"2023-10-08T00:32:47.676494+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:58.017608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677028+0000","last_change":"2023-10-08T00:32:47.670723+0000","last_active":"2023-10-08T00:32:47.677028+0000","last_peered":"2023-10-08T00:32:47.677028+0000","last_clean":"2023-10-08T00:32:47.677028+0000","last_became_active":"2023-10-08T00:32:47.669968+0000","last_became_peered":"2023-10-08T00:32:47.669968+0000","last_unstale":"2023-10-08T00:32:47.677028+0000","last_undegraded":"2023-10-08T00:32:47.677028+0000","last_fullsized":"2023-10-08T00:32:47.677028+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:22:22.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678858+0000","last_change":"2023-10-08T00:32:47.676860+0000","last_active":"2023-10-08T00:32:47.678858+0000","last_peered":"2023-10-08T00:32:47.678858+0000","last_clean":"2023-10-08T00:32:47.678858+0000","last_became_active":"2023-10-08T00:32:47.676461+0000","last_became_peered":"2023-10-08T00:32:47.676461+0000","last_unstale":"2023-10-08T00:32:47.678858+0000","last_undegraded":"2023-10-08T00:32:47.678858+0000","last_fullsized":"2023-10-08T00:32:47.678858+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:36.068700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679676+0000","last_change":"2023-10-08T00:32:47.678644+0000","last_active":"2023-10-08T00:32:47.679676+0000","last_peered":"2023-10-08T00:32:47.679676+0000","last_clean":"2023-10-08T00:32:47.679676+0000","last_became_active":"2023-10-08T00:32:47.678219+0000","last_became_peered":"2023-10-08T00:32:47.678219+0000","last_unstale":"2023-10-08T00:32:47.679676+0000","last_undegraded":"2023-10-08T00:32:47.679676+0000","last_fullsized":"2023-10-08T00:32:47.679676+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:45.197288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678876+0000","last_change":"2023-10-08T00:32:47.674271+0000","last_active":"2023-10-08T00:32:47.678876+0000","last_peered":"2023-10-08T00:32:47.678876+0000","last_clean":"2023-10-08T00:32:47.678876+0000","last_became_active":"2023-10-08T00:32:47.673950+0000","last_became_peered":"2023-10-08T00:32:47.673950+0000","last_unstale":"2023-10-08T00:32:47.678876+0000","last_undegraded":"2023-10-08T00:32:47.678876+0000","last_fullsized":"2023-10-08T00:32:47.678876+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:22:29.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676189+0000","last_change":"2023-10-08T00:32:47.666805+0000","last_active":"2023-10-08T00:32:47.676189+0000","last_peered":"2023-10-08T00:32:47.676189+0000","last_clean":"2023-10-08T00:32:47.676189+0000","last_became_active":"2023-10-08T00:32:47.666564+0000","last_became_peered":"2023-10-08T00:32:47.666564+0000","last_unstale":"2023-10-08T00:32:47.676189+0000","last_undegraded":"2023-10-08T00:32:47.676189+0000","last_fullsized":"2023-10-08T00:32:47.676189+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:26:50.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679541+0000","last_change":"2023-10-08T00:32:47.678989+0000","last_active":"2023-10-08T00:32:47.679541+0000","last_peered":"2023-10-08T00:32:47.679541+0000","last_clean":"2023-10-08T00:32:47.679541+0000","last_became_active":"2023-10-08T00:32:47.678689+0000","last_became_peered":"2023-10-08T00:32:47.678689+0000","last_unstale":"2023-10-08T00:32:47.679541+0000","last_undegraded":"2023-10-08T00:32:47.679541+0000","last_fullsized":"2023-10-08T00:32:47.679541+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:50.593389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.669515+0000","last_change":"2023-10-08T00:32:47.662839+0000","last_active":"2023-10-08T00:32:47.669515+0000","last_peered":"2023-10-08T00:32:47.669515+0000","last_clean":"2023-10-08T00:32:47.669515+0000","last_became_active":"2023-10-08T00:32:47.662534+0000","last_became_peered":"2023-10-08T00:32:47.662534+0000","last_unstale":"2023-10-08T00:32:47.669515+0000","last_undegraded":"2023-10-08T00:32:47.669515+0000","last_fullsized":"2023-10-08T00:32:47.669515+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:27.181725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681496+0000","last_change":"2023-10-08T00:32:47.675391+0000","last_active":"2023-10-08T00:32:47.681496+0000","last_peered":"2023-10-08T00:32:47.681496+0000","last_clean":"2023-10-08T00:32:47.681496+0000","last_became_active":"2023-10-08T00:32:47.675080+0000","last_became_peered":"2023-10-08T00:32:47.675080+0000","last_unstale":"2023-10-08T00:32:47.681496+0000","last_undegraded":"2023-10-08T00:32:47.681496+0000","last_fullsized":"2023-10-08T00:32:47.681496+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:25.772332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672492+0000","last_change":"2023-10-08T00:32:47.669951+0000","last_active":"2023-10-08T00:32:47.672492+0000","last_peered":"2023-10-08T00:32:47.672492+0000","last_clean":"2023-10-08T00:32:47.672492+0000","last_became_active":"2023-10-08T00:32:47.669475+0000","last_became_peered":"2023-10-08T00:32:47.669475+0000","last_unstale":"2023-10-08T00:32:47.672492+0000","last_undegraded":"2023-10-08T00:32:47.672492+0000","last_fullsized":"2023-10-08T00:32:47.672492+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:24.745892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675700+0000","last_change":"2023-10-08T00:32:47.666123+0000","last_active":"2023-10-08T00:32:47.675700+0000","last_peered":"2023-10-08T00:32:47.675700+0000","last_clean":"2023-10-08T00:32:47.675700+0000","last_became_active":"2023-10-08T00:32:47.665809+0000","last_became_peered":"2023-10-08T00:32:47.665809+0000","last_unstale":"2023-10-08T00:32:47.675700+0000","last_undegraded":"2023-10-08T00:32:47.675700+0000","last_fullsized":"2023-10-08T00:32:47.675700+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:25.580750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677543+0000","last_change":"2023-10-08T00:32:47.670748+0000","last_active":"2023-10-08T00:32:47.677543+0000","last_peered":"2023-10-08T00:32:47.677543+0000","last_clean":"2023-10-08T00:32:47.677543+0000","last_became_active":"2023-10-08T00:32:47.670489+0000","last_became_peered":"2023-10-08T00:32:47.670489+0000","last_unstale":"2023-10-08T00:32:47.677543+0000","last_undegraded":"2023-10-08T00:32:47.677543+0000","last_fullsized":"2023-10-08T00:32:47.677543+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:45.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674747+0000","last_change":"2023-10-08T00:32:47.665876+0000","last_active":"2023-10-08T00:32:47.674747+0000","last_peered":"2023-10-08T00:32:47.674747+0000","last_clean":"2023-10-08T00:32:47.674747+0000","last_became_active":"2023-10-08T00:32:47.665401+0000","last_became_peered":"2023-10-08T00:32:47.665401+0000","last_unstale":"2023-10-08T00:32:47.674747+0000","last_undegraded":"2023-10-08T00:32:47.674747+0000","last_fullsized":"2023-10-08T00:32:47.674747+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:11.916937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676167+0000","last_change":"2023-10-08T00:32:47.668418+0000","last_active":"2023-10-08T00:32:47.676167+0000","last_peered":"2023-10-08T00:32:47.676167+0000","last_clean":"2023-10-08T00:32:47.676167+0000","last_became_active":"2023-10-08T00:32:47.668119+0000","last_became_peered":"2023-10-08T00:32:47.668119+0000","last_unstale":"2023-10-08T00:32:47.676167+0000","last_undegraded":"2023-10-08T00:32:47.676167+0000","last_fullsized":"2023-10-08T00:32:47.676167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:42.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674319+0000","last_change":"2023-10-08T00:32:47.665743+0000","last_active":"2023-10-08T00:32:47.674319+0000","last_peered":"2023-10-08T00:32:47.674319+0000","last_clean":"2023-10-08T00:32:47.674319+0000","last_became_active":"2023-10-08T00:32:47.665441+0000","last_became_peered":"2023-10-08T00:32:47.665441+0000","last_unstale":"2023-10-08T00:32:47.674319+0000","last_undegraded":"2023-10-08T00:32:47.674319+0000","last_fullsized":"2023-10-08T00:32:47.674319+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:32.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679309+0000","last_change":"2023-10-08T00:32:47.678439+0000","last_active":"2023-10-08T00:32:47.679309+0000","last_peered":"2023-10-08T00:32:47.679309+0000","last_clean":"2023-10-08T00:32:47.679309+0000","last_became_active":"2023-10-08T00:32:47.678174+0000","last_became_peered":"2023-10-08T00:32:47.678174+0000","last_unstale":"2023-10-08T00:32:47.679309+0000","last_undegraded":"2023-10-08T00:32:47.679309+0000","last_fullsized":"2023-10-08T00:32:47.679309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:12:48.052333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676476+0000","last_change":"2023-10-08T00:32:47.673001+0000","last_active":"2023-10-08T00:32:47.676476+0000","last_peered":"2023-10-08T00:32:47.676476+0000","last_clean":"2023-10-08T00:32:47.676476+0000","last_became_active":"2023-10-08T00:32:47.672726+0000","last_became_peered":"2023-10-08T00:32:47.672726+0000","last_unstale":"2023-10-08T00:32:47.676476+0000","last_undegraded":"2023-10-08T00:32:47.676476+0000","last_fullsized":"2023-10-08T00:32:47.676476+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:27.005109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672459+0000","last_change":"2023-10-08T00:32:47.669731+0000","last_active":"2023-10-08T00:32:47.672459+0000","last_peered":"2023-10-08T00:32:47.672459+0000","last_clean":"2023-10-08T00:32:47.672459+0000","last_became_active":"2023-10-08T00:32:47.669154+0000","last_became_peered":"2023-10-08T00:32:47.669154+0000","last_unstale":"2023-10-08T00:32:47.672459+0000","last_undegraded":"2023-10-08T00:32:47.672459+0000","last_fullsized":"2023-10-08T00:32:47.672459+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:41.438719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678843+0000","last_change":"2023-10-08T00:32:47.677672+0000","last_active":"2023-10-08T00:32:47.678843+0000","last_peered":"2023-10-08T00:32:47.678843+0000","last_clean":"2023-10-08T00:32:47.678843+0000","last_became_active":"2023-10-08T00:32:47.677421+0000","last_became_peered":"2023-10-08T00:32:47.677421+0000","last_unstale":"2023-10-08T00:32:47.678843+0000","last_undegraded":"2023-10-08T00:32:47.678843+0000","last_fullsized":"2023-10-08T00:32:47.678843+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:47.142806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678952+0000","last_change":"2023-10-08T00:32:47.674575+0000","last_active":"2023-10-08T00:32:47.678952+0000","last_peered":"2023-10-08T00:32:47.678952+0000","last_clean":"2023-10-08T00:32:47.678952+0000","last_became_active":"2023-10-08T00:32:47.673996+0000","last_became_peered":"2023-10-08T00:32:47.673996+0000","last_unstale":"2023-10-08T00:32:47.678952+0000","last_undegraded":"2023-10-08T00:32:47.678952+0000","last_fullsized":"2023-10-08T00:32:47.678952+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:29:11.031610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.682874+0000","last_change":"2023-10-08T00:32:47.681066+0000","last_active":"2023-10-08T00:32:47.682874+0000","last_peered":"2023-10-08T00:32:47.682874+0000","last_clean":"2023-10-08T00:32:47.682874+0000","last_became_active":"2023-10-08T00:32:47.680781+0000","last_became_peered":"2023-10-08T00:32:47.680781+0000","last_unstale":"2023-10-08T00:32:47.682874+0000","last_undegraded":"2023-10-08T00:32:47.682874+0000","last_fullsized":"2023-10-08T00:32:47.682874+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:41.438719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680563+0000","last_change":"2023-10-08T00:32:47.675995+0000","last_active":"2023-10-08T00:32:47.680563+0000","last_peered":"2023-10-08T00:32:47.680563+0000","last_clean":"2023-10-08T00:32:47.680563+0000","last_became_active":"2023-10-08T00:32:47.675639+0000","last_became_peered":"2023-10-08T00:32:47.675639+0000","last_unstale":"2023-10-08T00:32:47.680563+0000","last_undegraded":"2023-10-08T00:32:47.680563+0000","last_fullsized":"2023-10-08T00:32:47.680563+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:58.411629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672619+0000","last_change":"2023-10-08T00:32:47.666851+0000","last_active":"2023-10-08T00:32:47.672619+0000","last_peered":"2023-10-08T00:32:47.672619+0000","last_clean":"2023-10-08T00:32:47.672619+0000","last_became_active":"2023-10-08T00:32:47.666588+0000","last_became_peered":"2023-10-08T00:32:47.666588+0000","last_unstale":"2023-10-08T00:32:47.672619+0000","last_undegraded":"2023-10-08T00:32:47.672619+0000","last_fullsized":"2023-10-08T00:32:47.672619+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:00.592794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.682902+0000","last_change":"2023-10-08T00:32:47.681757+0000","last_active":"2023-10-08T00:32:47.682902+0000","last_peered":"2023-10-08T00:32:47.682902+0000","last_clean":"2023-10-08T00:32:47.682902+0000","last_became_active":"2023-10-08T00:32:47.681506+0000","last_became_peered":"2023-10-08T00:32:47.681506+0000","last_unstale":"2023-10-08T00:32:47.682902+0000","last_undegraded":"2023-10-08T00:32:47.682902+0000","last_fullsized":"2023-10-08T00:32:47.682902+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:07.611237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681469+0000","last_change":"2023-10-08T00:32:47.674823+0000","last_active":"2023-10-08T00:32:47.681469+0000","last_peered":"2023-10-08T00:32:47.681469+0000","last_clean":"2023-10-08T00:32:47.681469+0000","last_became_active":"2023-10-08T00:32:47.674534+0000","last_became_peered":"2023-10-08T00:32:47.674534+0000","last_unstale":"2023-10-08T00:32:47.681469+0000","last_undegraded":"2023-10-08T00:32:47.681469+0000","last_fullsized":"2023-10-08T00:32:47.681469+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:06:06.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679485+0000","last_change":"2023-10-08T00:32:47.678551+0000","last_active":"2023-10-08T00:32:47.679485+0000","last_peered":"2023-10-08T00:32:47.679485+0000","last_clean":"2023-10-08T00:32:47.679485+0000","last_became_active":"2023-10-08T00:32:47.677776+0000","last_became_peered":"2023-10-08T00:32:47.677776+0000","last_unstale":"2023-10-08T00:32:47.679485+0000","last_undegraded":"2023-10-08T00:32:47.679485+0000","last_fullsized":"2023-10-08T00:32:47.679485+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:21.542182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677521+0000","last_change":"2023-10-08T00:32:47.670266+0000","last_active":"2023-10-08T00:32:47.677521+0000","last_peered":"2023-10-08T00:32:47.677521+0000","last_clean":"2023-10-08T00:32:47.677521+0000","last_became_active":"2023-10-08T00:32:47.669986+0000","last_became_peered":"2023-10-08T00:32:47.669986+0000","last_unstale":"2023-10-08T00:32:47.677521+0000","last_undegraded":"2023-10-08T00:32:47.677521+0000","last_fullsized":"2023-10-08T00:32:47.677521+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:36.068700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664917+0000","last_change":"2023-10-08T00:32:47.660359+0000","last_active":"2023-10-08T00:32:47.664917+0000","last_peered":"2023-10-08T00:32:47.664917+0000","last_clean":"2023-10-08T00:32:47.664917+0000","last_became_active":"2023-10-08T00:32:47.660082+0000","last_became_peered":"2023-10-08T00:32:47.660082+0000","last_unstale":"2023-10-08T00:32:47.664917+0000","last_undegraded":"2023-10-08T00:32:47.664917+0000","last_fullsized":"2023-10-08T00:32:47.664917+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:57:17.568726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679328+0000","last_change":"2023-10-08T00:32:47.676054+0000","last_active":"2023-10-08T00:32:47.679328+0000","last_peered":"2023-10-08T00:32:47.679328+0000","last_clean":"2023-10-08T00:32:47.679328+0000","last_became_active":"2023-10-08T00:32:47.675780+0000","last_became_peered":"2023-10-08T00:32:47.675780+0000","last_unstale":"2023-10-08T00:32:47.679328+0000","last_undegraded":"2023-10-08T00:32:47.679328+0000","last_fullsized":"2023-10-08T00:32:47.679328+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671536+0000","last_change":"2023-10-08T00:32:47.667554+0000","last_active":"2023-10-08T00:32:47.671536+0000","last_peered":"2023-10-08T00:32:47.671536+0000","last_clean":"2023-10-08T00:32:47.671536+0000","last_became_active":"2023-10-08T00:32:47.667300+0000","last_became_peered":"2023-10-08T00:32:47.667300+0000","last_unstale":"2023-10-08T00:32:47.671536+0000","last_undegraded":"2023-10-08T00:32:47.671536+0000","last_fullsized":"2023-10-08T00:32:47.671536+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:57:17.568726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676079+0000","last_change":"2023-10-08T00:32:47.674990+0000","last_active":"2023-10-08T00:32:47.676079+0000","last_peered":"2023-10-08T00:32:47.676079+0000","last_clean":"2023-10-08T00:32:47.676079+0000","last_became_active":"2023-10-08T00:32:47.674679+0000","last_became_peered":"2023-10-08T00:32:47.674679+0000","last_unstale":"2023-10-08T00:32:47.676079+0000","last_undegraded":"2023-10-08T00:32:47.676079+0000","last_fullsized":"2023-10-08T00:32:47.676079+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:34:36.484411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676190+0000","last_change":"2023-10-08T00:32:47.670319+0000","last_active":"2023-10-08T00:32:47.676190+0000","last_peered":"2023-10-08T00:32:47.676190+0000","last_clean":"2023-10-08T00:32:47.676190+0000","last_became_active":"2023-10-08T00:32:47.670034+0000","last_became_peered":"2023-10-08T00:32:47.670034+0000","last_unstale":"2023-10-08T00:32:47.676190+0000","last_undegraded":"2023-10-08T00:32:47.676190+0000","last_fullsized":"2023-10-08T00:32:47.676190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:42.095366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671248+0000","last_change":"2023-10-08T00:32:47.666939+0000","last_active":"2023-10-08T00:32:47.671248+0000","last_peered":"2023-10-08T00:32:47.671248+0000","last_clean":"2023-10-08T00:32:47.671248+0000","last_became_active":"2023-10-08T00:32:47.666679+0000","last_became_peered":"2023-10-08T00:32:47.666679+0000","last_unstale":"2023-10-08T00:32:47.671248+0000","last_undegraded":"2023-10-08T00:32:47.671248+0000","last_fullsized":"2023-10-08T00:32:47.671248+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:20.107114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671843+0000","last_change":"2023-10-08T00:32:46.669290+0000","last_active":"2023-10-08T00:32:47.671843+0000","last_peered":"2023-10-08T00:32:47.671843+0000","last_clean":"2023-10-08T00:32:47.671843+0000","last_became_active":"2023-10-08T00:32:46.668820+0000","last_became_peered":"2023-10-08T00:32:46.668820+0000","last_unstale":"2023-10-08T00:32:47.671843+0000","last_undegraded":"2023-10-08T00:32:47.671843+0000","last_fullsized":"2023-10-08T00:32:47.671843+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:13:07.806373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680699+0000","last_change":"2023-10-08T00:32:47.678249+0000","last_active":"2023-10-08T00:32:47.680699+0000","last_peered":"2023-10-08T00:32:47.680699+0000","last_clean":"2023-10-08T00:32:47.680699+0000","last_became_active":"2023-10-08T00:32:47.677970+0000","last_became_peered":"2023-10-08T00:32:47.677970+0000","last_unstale":"2023-10-08T00:32:47.680699+0000","last_undegraded":"2023-10-08T00:32:47.680699+0000","last_fullsized":"2023-10-08T00:32:47.680699+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:05:09.891245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674951+0000","last_change":"2023-10-08T00:32:46.670932+0000","last_active":"2023-10-08T00:32:47.674951+0000","last_peered":"2023-10-08T00:32:47.674951+0000","last_clean":"2023-10-08T00:32:47.674951+0000","last_became_active":"2023-10-08T00:32:46.670640+0000","last_became_peered":"2023-10-08T00:32:46.670640+0000","last_unstale":"2023-10-08T00:32:47.674951+0000","last_undegraded":"2023-10-08T00:32:47.674951+0000","last_fullsized":"2023-10-08T00:32:47.674951+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:56.603008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678724+0000","last_change":"2023-10-08T00:32:47.677896+0000","last_active":"2023-10-08T00:32:47.678724+0000","last_peered":"2023-10-08T00:32:47.678724+0000","last_clean":"2023-10-08T00:32:47.678724+0000","last_became_active":"2023-10-08T00:32:47.677600+0000","last_became_peered":"2023-10-08T00:32:47.677600+0000","last_unstale":"2023-10-08T00:32:47.678724+0000","last_undegraded":"2023-10-08T00:32:47.678724+0000","last_fullsized":"2023-10-08T00:32:47.678724+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:27.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676712+0000","last_change":"2023-10-08T00:32:46.672799+0000","last_active":"2023-10-08T00:32:47.676712+0000","last_peered":"2023-10-08T00:32:47.676712+0000","last_clean":"2023-10-08T00:32:47.676712+0000","last_became_active":"2023-10-08T00:32:46.672492+0000","last_became_peered":"2023-10-08T00:32:46.672492+0000","last_unstale":"2023-10-08T00:32:47.676712+0000","last_undegraded":"2023-10-08T00:32:47.676712+0000","last_fullsized":"2023-10-08T00:32:47.676712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:13:09.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676392+0000","last_change":"2023-10-08T00:32:47.674304+0000","last_active":"2023-10-08T00:32:47.676392+0000","last_peered":"2023-10-08T00:32:47.676392+0000","last_clean":"2023-10-08T00:32:47.676392+0000","last_became_active":"2023-10-08T00:32:47.674042+0000","last_became_peered":"2023-10-08T00:32:47.674042+0000","last_unstale":"2023-10-08T00:32:47.676392+0000","last_undegraded":"2023-10-08T00:32:47.676392+0000","last_fullsized":"2023-10-08T00:32:47.676392+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:18:28.129137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677187+0000","last_change":"2023-10-08T00:32:46.673978+0000","last_active":"2023-10-08T00:32:47.677187+0000","last_peered":"2023-10-08T00:32:47.677187+0000","last_clean":"2023-10-08T00:32:47.677187+0000","last_became_active":"2023-10-08T00:32:46.673703+0000","last_became_peered":"2023-10-08T00:32:46.673703+0000","last_unstale":"2023-10-08T00:32:47.677187+0000","last_undegraded":"2023-10-08T00:32:47.677187+0000","last_fullsized":"2023-10-08T00:32:47.677187+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:31:01.301020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679652+0000","last_change":"2023-10-08T00:32:47.678424+0000","last_active":"2023-10-08T00:32:47.679652+0000","last_peered":"2023-10-08T00:32:47.679652+0000","last_clean":"2023-10-08T00:32:47.679652+0000","last_became_active":"2023-10-08T00:32:47.678161+0000","last_became_peered":"2023-10-08T00:32:47.678161+0000","last_unstale":"2023-10-08T00:32:47.679652+0000","last_undegraded":"2023-10-08T00:32:47.679652+0000","last_fullsized":"2023-10-08T00:32:47.679652+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:10.988680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674522+0000","last_change":"2023-10-08T00:32:46.663730+0000","last_active":"2023-10-08T00:32:47.674522+0000","last_peered":"2023-10-08T00:32:47.674522+0000","last_clean":"2023-10-08T00:32:47.674522+0000","last_became_active":"2023-10-08T00:32:46.663100+0000","last_became_peered":"2023-10-08T00:32:46.663100+0000","last_unstale":"2023-10-08T00:32:47.674522+0000","last_undegraded":"2023-10-08T00:32:47.674522+0000","last_fullsized":"2023-10-08T00:32:47.674522+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:16:14.361359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679051+0000","last_change":"2023-10-08T00:32:47.674704+0000","last_active":"2023-10-08T00:32:47.679051+0000","last_peered":"2023-10-08T00:32:47.679051+0000","last_clean":"2023-10-08T00:32:47.679051+0000","last_became_active":"2023-10-08T00:32:47.674450+0000","last_became_peered":"2023-10-08T00:32:47.674450+0000","last_unstale":"2023-10-08T00:32:47.679051+0000","last_undegraded":"2023-10-08T00:32:47.679051+0000","last_fullsized":"2023-10-08T00:32:47.679051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:07.751699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.655966+0000","last_change":"2023-10-08T00:32:46.660631+0000","last_active":"2023-10-08T00:32:47.655966+0000","last_peered":"2023-10-08T00:32:47.655966+0000","last_clean":"2023-10-08T00:32:47.655966+0000","last_became_active":"2023-10-08T00:32:46.660477+0000","last_became_peered":"2023-10-08T00:32:46.660477+0000","last_unstale":"2023-10-08T00:32:47.655966+0000","last_undegraded":"2023-10-08T00:32:47.655966+0000","last_fullsized":"2023-10-08T00:32:47.655966+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:45.540813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679685+0000","last_change":"2023-10-08T00:32:47.678875+0000","last_active":"2023-10-08T00:32:47.679685+0000","last_peered":"2023-10-08T00:32:47.679685+0000","last_clean":"2023-10-08T00:32:47.679685+0000","last_became_active":"2023-10-08T00:32:47.678663+0000","last_became_peered":"2023-10-08T00:32:47.678663+0000","last_unstale":"2023-10-08T00:32:47.679685+0000","last_undegraded":"2023-10-08T00:32:47.679685+0000","last_fullsized":"2023-10-08T00:32:47.679685+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:25.298048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664874+0000","last_change":"2023-10-08T00:32:46.665849+0000","last_active":"2023-10-08T00:32:47.664874+0000","last_peered":"2023-10-08T00:32:47.664874+0000","last_clean":"2023-10-08T00:32:47.664874+0000","last_became_active":"2023-10-08T00:32:46.665568+0000","last_became_peered":"2023-10-08T00:32:46.665568+0000","last_unstale":"2023-10-08T00:32:47.664874+0000","last_undegraded":"2023-10-08T00:32:47.664874+0000","last_fullsized":"2023-10-08T00:32:47.664874+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:35.066601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.684642+0000","last_change":"2023-10-08T00:32:47.682353+0000","last_active":"2023-10-08T00:32:47.684642+0000","last_peered":"2023-10-08T00:32:47.684642+0000","last_clean":"2023-10-08T00:32:47.684642+0000","last_became_active":"2023-10-08T00:32:47.682103+0000","last_became_peered":"2023-10-08T00:32:47.682103+0000","last_unstale":"2023-10-08T00:32:47.684642+0000","last_undegraded":"2023-10-08T00:32:47.684642+0000","last_fullsized":"2023-10-08T00:32:47.684642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:41:47.578512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656019+0000","last_change":"2023-10-08T00:32:46.666432+0000","last_active":"2023-10-08T00:32:47.656019+0000","last_peered":"2023-10-08T00:32:47.656019+0000","last_clean":"2023-10-08T00:32:47.656019+0000","last_became_active":"2023-10-08T00:32:46.665868+0000","last_became_peered":"2023-10-08T00:32:46.665868+0000","last_unstale":"2023-10-08T00:32:47.656019+0000","last_undegraded":"2023-10-08T00:32:47.656019+0000","last_fullsized":"2023-10-08T00:32:47.656019+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.718629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676442+0000","last_change":"2023-10-08T00:32:47.667181+0000","last_active":"2023-10-08T00:32:47.676442+0000","last_peered":"2023-10-08T00:32:47.676442+0000","last_clean":"2023-10-08T00:32:47.676442+0000","last_became_active":"2023-10-08T00:32:47.666894+0000","last_became_peered":"2023-10-08T00:32:47.666894+0000","last_unstale":"2023-10-08T00:32:47.676442+0000","last_undegraded":"2023-10-08T00:32:47.676442+0000","last_fullsized":"2023-10-08T00:32:47.676442+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:45.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664665+0000","last_change":"2023-10-08T00:32:46.668790+0000","last_active":"2023-10-08T00:32:47.664665+0000","last_peered":"2023-10-08T00:32:47.664665+0000","last_clean":"2023-10-08T00:32:47.664665+0000","last_became_active":"2023-10-08T00:32:46.668522+0000","last_became_peered":"2023-10-08T00:32:46.668522+0000","last_unstale":"2023-10-08T00:32:47.664665+0000","last_undegraded":"2023-10-08T00:32:47.664665+0000","last_fullsized":"2023-10-08T00:32:47.664665+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:10.914838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679658+0000","last_change":"2023-10-08T00:32:47.678479+0000","last_active":"2023-10-08T00:32:47.679658+0000","last_peered":"2023-10-08T00:32:47.679658+0000","last_clean":"2023-10-08T00:32:47.679658+0000","last_became_active":"2023-10-08T00:32:47.678000+0000","last_became_peered":"2023-10-08T00:32:47.678000+0000","last_unstale":"2023-10-08T00:32:47.679658+0000","last_undegraded":"2023-10-08T00:32:47.679658+0000","last_fullsized":"2023-10-08T00:32:47.679658+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:32:44.947907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677130+0000","last_change":"2023-10-08T00:32:46.673405+0000","last_active":"2023-10-08T00:32:47.677130+0000","last_peered":"2023-10-08T00:32:47.677130+0000","last_clean":"2023-10-08T00:32:47.677130+0000","last_became_active":"2023-10-08T00:32:46.673098+0000","last_became_peered":"2023-10-08T00:32:46.673098+0000","last_unstale":"2023-10-08T00:32:47.677130+0000","last_undegraded":"2023-10-08T00:32:47.677130+0000","last_fullsized":"2023-10-08T00:32:47.677130+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:29:10.029510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676243+0000","last_change":"2023-10-08T00:32:47.668213+0000","last_active":"2023-10-08T00:32:47.676243+0000","last_peered":"2023-10-08T00:32:47.676243+0000","last_clean":"2023-10-08T00:32:47.676243+0000","last_became_active":"2023-10-08T00:32:47.667944+0000","last_became_peered":"2023-10-08T00:32:47.667944+0000","last_unstale":"2023-10-08T00:32:47.676243+0000","last_undegraded":"2023-10-08T00:32:47.676243+0000","last_fullsized":"2023-10-08T00:32:47.676243+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:06:27.752969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"155'6","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.685092+0000","last_change":"2023-10-08T00:32:46.673358+0000","last_active":"2023-10-08T00:32:47.685092+0000","last_peered":"2023-10-08T00:32:47.685092+0000","last_clean":"2023-10-08T00:32:47.685092+0000","last_became_active":"2023-10-08T00:32:46.672953+0000","last_became_peered":"2023-10-08T00:32:46.672953+0000","last_unstale":"2023-10-08T00:32:47.685092+0000","last_undegraded":"2023-10-08T00:32:47.685092+0000","last_fullsized":"2023-10-08T00:32:47.685092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:26.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678976+0000","last_change":"2023-10-08T00:32:47.674690+0000","last_active":"2023-10-08T00:32:47.678976+0000","last_peered":"2023-10-08T00:32:47.678976+0000","last_clean":"2023-10-08T00:32:47.678976+0000","last_became_active":"2023-10-08T00:32:47.674301+0000","last_became_peered":"2023-10-08T00:32:47.674301+0000","last_unstale":"2023-10-08T00:32:47.678976+0000","last_undegraded":"2023-10-08T00:32:47.678976+0000","last_fullsized":"2023-10-08T00:32:47.678976+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:20.292948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676408+0000","last_change":"2023-10-08T00:32:46.661747+0000","last_active":"2023-10-08T00:32:47.676408+0000","last_peered":"2023-10-08T00:32:47.676408+0000","last_clean":"2023-10-08T00:32:47.676408+0000","last_became_active":"2023-10-08T00:32:46.661498+0000","last_became_peered":"2023-10-08T00:32:46.661498+0000","last_unstale":"2023-10-08T00:32:47.676408+0000","last_undegraded":"2023-10-08T00:32:47.676408+0000","last_fullsized":"2023-10-08T00:32:47.676408+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:38.597474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675464+0000","last_change":"2023-10-08T00:32:47.672139+0000","last_active":"2023-10-08T00:32:47.675464+0000","last_peered":"2023-10-08T00:32:47.675464+0000","last_clean":"2023-10-08T00:32:47.675464+0000","last_became_active":"2023-10-08T00:32:47.671844+0000","last_became_peered":"2023-10-08T00:32:47.671844+0000","last_unstale":"2023-10-08T00:32:47.675464+0000","last_undegraded":"2023-10-08T00:32:47.675464+0000","last_fullsized":"2023-10-08T00:32:47.675464+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:07.611237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.665889+0000","last_change":"2023-10-08T00:32:46.673325+0000","last_active":"2023-10-08T00:32:47.665889+0000","last_peered":"2023-10-08T00:32:47.665889+0000","last_clean":"2023-10-08T00:32:47.665889+0000","last_became_active":"2023-10-08T00:32:46.673034+0000","last_became_peered":"2023-10-08T00:32:46.673034+0000","last_unstale":"2023-10-08T00:32:47.665889+0000","last_undegraded":"2023-10-08T00:32:47.665889+0000","last_fullsized":"2023-10-08T00:32:47.665889+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:44.389446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677904+0000","last_change":"2023-10-08T00:32:47.668678+0000","last_active":"2023-10-08T00:32:47.677904+0000","last_peered":"2023-10-08T00:32:47.677904+0000","last_clean":"2023-10-08T00:32:47.677904+0000","last_became_active":"2023-10-08T00:32:47.666776+0000","last_became_peered":"2023-10-08T00:32:47.666776+0000","last_unstale":"2023-10-08T00:32:47.677904+0000","last_undegraded":"2023-10-08T00:32:47.677904+0000","last_fullsized":"2023-10-08T00:32:47.677904+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:29.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.662066+0000","last_change":"2023-10-08T00:32:46.669108+0000","last_active":"2023-10-08T00:32:47.662066+0000","last_peered":"2023-10-08T00:32:47.662066+0000","last_clean":"2023-10-08T00:32:47.662066+0000","last_became_active":"2023-10-08T00:32:46.668858+0000","last_became_peered":"2023-10-08T00:32:46.668858+0000","last_unstale":"2023-10-08T00:32:47.662066+0000","last_undegraded":"2023-10-08T00:32:47.662066+0000","last_fullsized":"2023-10-08T00:32:47.662066+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:26:49.217424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678016+0000","last_change":"2023-10-08T00:32:47.668851+0000","last_active":"2023-10-08T00:32:47.678016+0000","last_peered":"2023-10-08T00:32:47.678016+0000","last_clean":"2023-10-08T00:32:47.678016+0000","last_became_active":"2023-10-08T00:32:47.667621+0000","last_became_peered":"2023-10-08T00:32:47.667621+0000","last_unstale":"2023-10-08T00:32:47.678016+0000","last_undegraded":"2023-10-08T00:32:47.678016+0000","last_fullsized":"2023-10-08T00:32:47.678016+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:11.179807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"155'8","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681968+0000","last_change":"2023-10-08T00:32:46.672768+0000","last_active":"2023-10-08T00:32:47.681968+0000","last_peered":"2023-10-08T00:32:47.681968+0000","last_clean":"2023-10-08T00:32:47.681968+0000","last_became_active":"2023-10-08T00:32:46.672472+0000","last_became_peered":"2023-10-08T00:32:46.672472+0000","last_unstale":"2023-10-08T00:32:47.681968+0000","last_undegraded":"2023-10-08T00:32:47.681968+0000","last_fullsized":"2023-10-08T00:32:47.681968+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.343375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680684+0000","last_change":"2023-10-08T00:32:47.675428+0000","last_active":"2023-10-08T00:32:47.680684+0000","last_peered":"2023-10-08T00:32:47.680684+0000","last_clean":"2023-10-08T00:32:47.680684+0000","last_became_active":"2023-10-08T00:32:47.675184+0000","last_became_peered":"2023-10-08T00:32:47.675184+0000","last_unstale":"2023-10-08T00:32:47.680684+0000","last_undegraded":"2023-10-08T00:32:47.680684+0000","last_fullsized":"2023-10-08T00:32:47.680684+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:25.580750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.673725+0000","last_change":"2023-10-08T00:32:46.666620+0000","last_active":"2023-10-08T00:32:47.673725+0000","last_peered":"2023-10-08T00:32:47.673725+0000","last_clean":"2023-10-08T00:32:47.673725+0000","last_became_active":"2023-10-08T00:32:46.666196+0000","last_became_peered":"2023-10-08T00:32:46.666196+0000","last_unstale":"2023-10-08T00:32:47.673725+0000","last_undegraded":"2023-10-08T00:32:47.673725+0000","last_fullsized":"2023-10-08T00:32:47.673725+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:14.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681481+0000","last_change":"2023-10-08T00:32:47.674959+0000","last_active":"2023-10-08T00:32:47.681481+0000","last_peered":"2023-10-08T00:32:47.681481+0000","last_clean":"2023-10-08T00:32:47.681481+0000","last_became_active":"2023-10-08T00:32:47.674481+0000","last_became_peered":"2023-10-08T00:32:47.674481+0000","last_unstale":"2023-10-08T00:32:47.681481+0000","last_undegraded":"2023-10-08T00:32:47.681481+0000","last_fullsized":"2023-10-08T00:32:47.681481+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:32.811307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674661+0000","last_change":"2023-10-08T00:32:46.666761+0000","last_active":"2023-10-08T00:32:47.674661+0000","last_peered":"2023-10-08T00:32:47.674661+0000","last_clean":"2023-10-08T00:32:47.674661+0000","last_became_active":"2023-10-08T00:32:46.666465+0000","last_became_peered":"2023-10-08T00:32:46.666465+0000","last_unstale":"2023-10-08T00:32:47.674661+0000","last_undegraded":"2023-10-08T00:32:47.674661+0000","last_fullsized":"2023-10-08T00:32:47.674661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:14:22.612713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675767+0000","last_change":"2023-10-08T00:32:47.668662+0000","last_active":"2023-10-08T00:32:47.675767+0000","last_peered":"2023-10-08T00:32:47.675767+0000","last_clean":"2023-10-08T00:32:47.675767+0000","last_became_active":"2023-10-08T00:32:47.668371+0000","last_became_peered":"2023-10-08T00:32:47.668371+0000","last_unstale":"2023-10-08T00:32:47.675767+0000","last_undegraded":"2023-10-08T00:32:47.675767+0000","last_fullsized":"2023-10-08T00:32:47.675767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681490+0000","last_change":"2023-10-08T00:32:46.669916+0000","last_active":"2023-10-08T00:32:47.681490+0000","last_peered":"2023-10-08T00:32:47.681490+0000","last_clean":"2023-10-08T00:32:47.681490+0000","last_became_active":"2023-10-08T00:32:46.669611+0000","last_became_peered":"2023-10-08T00:32:46.669611+0000","last_unstale":"2023-10-08T00:32:47.681490+0000","last_undegraded":"2023-10-08T00:32:47.681490+0000","last_fullsized":"2023-10-08T00:32:47.681490+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:06.749599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676419+0000","last_change":"2023-10-08T00:32:47.675010+0000","last_active":"2023-10-08T00:32:47.676419+0000","last_peered":"2023-10-08T00:32:47.676419+0000","last_clean":"2023-10-08T00:32:47.676419+0000","last_became_active":"2023-10-08T00:32:47.674706+0000","last_became_peered":"2023-10-08T00:32:47.674706+0000","last_unstale":"2023-10-08T00:32:47.676419+0000","last_undegraded":"2023-10-08T00:32:47.676419+0000","last_fullsized":"2023-10-08T00:32:47.676419+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:32.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.653191+0000","last_change":"2023-10-08T00:32:46.658980+0000","last_active":"2023-10-08T00:32:47.653191+0000","last_peered":"2023-10-08T00:32:47.653191+0000","last_clean":"2023-10-08T00:32:47.653191+0000","last_became_active":"2023-10-08T00:32:46.658689+0000","last_became_peered":"2023-10-08T00:32:46.658689+0000","last_unstale":"2023-10-08T00:32:47.653191+0000","last_undegraded":"2023-10-08T00:32:47.653191+0000","last_fullsized":"2023-10-08T00:32:47.653191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:15.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678107+0000","last_change":"2023-10-08T00:32:47.677333+0000","last_active":"2023-10-08T00:32:47.678107+0000","last_peered":"2023-10-08T00:32:47.678107+0000","last_clean":"2023-10-08T00:32:47.678107+0000","last_became_active":"2023-10-08T00:32:47.676975+0000","last_became_peered":"2023-10-08T00:32:47.676975+0000","last_unstale":"2023-10-08T00:32:47.678107+0000","last_undegraded":"2023-10-08T00:32:47.678107+0000","last_fullsized":"2023-10-08T00:32:47.678107+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:51:56.026359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677342+0000","last_change":"2023-10-08T00:32:46.665966+0000","last_active":"2023-10-08T00:32:47.677342+0000","last_peered":"2023-10-08T00:32:47.677342+0000","last_clean":"2023-10-08T00:32:47.677342+0000","last_became_active":"2023-10-08T00:32:46.665614+0000","last_became_peered":"2023-10-08T00:32:46.665614+0000","last_unstale":"2023-10-08T00:32:47.677342+0000","last_undegraded":"2023-10-08T00:32:47.677342+0000","last_fullsized":"2023-10-08T00:32:47.677342+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:26.179625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664951+0000","last_change":"2023-10-08T00:32:47.660309+0000","last_active":"2023-10-08T00:32:47.664951+0000","last_peered":"2023-10-08T00:32:47.664951+0000","last_clean":"2023-10-08T00:32:47.664951+0000","last_became_active":"2023-10-08T00:32:47.660030+0000","last_became_peered":"2023-10-08T00:32:47.660030+0000","last_unstale":"2023-10-08T00:32:47.664951+0000","last_undegraded":"2023-10-08T00:32:47.664951+0000","last_fullsized":"2023-10-08T00:32:47.664951+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:25.772332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.659392+0000","last_change":"2023-10-08T00:32:46.669868+0000","last_active":"2023-10-08T00:32:47.659392+0000","last_peered":"2023-10-08T00:32:47.659392+0000","last_clean":"2023-10-08T00:32:47.659392+0000","last_became_active":"2023-10-08T00:32:46.669596+0000","last_became_peered":"2023-10-08T00:32:46.669596+0000","last_unstale":"2023-10-08T00:32:47.659392+0000","last_undegraded":"2023-10-08T00:32:47.659392+0000","last_fullsized":"2023-10-08T00:32:47.659392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:44.195189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676873+0000","last_change":"2023-10-08T00:32:47.670312+0000","last_active":"2023-10-08T00:32:47.676873+0000","last_peered":"2023-10-08T00:32:47.676873+0000","last_clean":"2023-10-08T00:32:47.676873+0000","last_became_active":"2023-10-08T00:32:47.670028+0000","last_became_peered":"2023-10-08T00:32:47.670028+0000","last_unstale":"2023-10-08T00:32:47.676873+0000","last_undegraded":"2023-10-08T00:32:47.676873+0000","last_fullsized":"2023-10-08T00:32:47.676873+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:53.204143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.661178+0000","last_change":"2023-10-08T00:32:46.668459+0000","last_active":"2023-10-08T00:32:47.661178+0000","last_peered":"2023-10-08T00:32:47.661178+0000","last_clean":"2023-10-08T00:32:47.661178+0000","last_became_active":"2023-10-08T00:32:46.668192+0000","last_became_peered":"2023-10-08T00:32:46.668192+0000","last_unstale":"2023-10-08T00:32:47.661178+0000","last_undegraded":"2023-10-08T00:32:47.661178+0000","last_fullsized":"2023-10-08T00:32:47.661178+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:09.986581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679451+0000","last_change":"2023-10-08T00:32:47.674686+0000","last_active":"2023-10-08T00:32:47.679451+0000","last_peered":"2023-10-08T00:32:47.679451+0000","last_clean":"2023-10-08T00:32:47.679451+0000","last_became_active":"2023-10-08T00:32:47.674407+0000","last_became_peered":"2023-10-08T00:32:47.674407+0000","last_unstale":"2023-10-08T00:32:47.679451+0000","last_undegraded":"2023-10-08T00:32:47.679451+0000","last_fullsized":"2023-10-08T00:32:47.679451+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:38:32.992484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656616+0000","last_change":"2023-10-08T00:32:46.666705+0000","last_active":"2023-10-08T00:32:47.656616+0000","last_peered":"2023-10-08T00:32:47.656616+0000","last_clean":"2023-10-08T00:32:47.656616+0000","last_became_active":"2023-10-08T00:32:46.666444+0000","last_became_peered":"2023-10-08T00:32:46.666444+0000","last_unstale":"2023-10-08T00:32:47.656616+0000","last_undegraded":"2023-10-08T00:32:47.656616+0000","last_fullsized":"2023-10-08T00:32:47.656616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:52.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677879+0000","last_change":"2023-10-08T00:32:47.673032+0000","last_active":"2023-10-08T00:32:47.677879+0000","last_peered":"2023-10-08T00:32:47.677879+0000","last_clean":"2023-10-08T00:32:47.677879+0000","last_became_active":"2023-10-08T00:32:47.672762+0000","last_became_peered":"2023-10-08T00:32:47.672762+0000","last_unstale":"2023-10-08T00:32:47.677879+0000","last_undegraded":"2023-10-08T00:32:47.677879+0000","last_fullsized":"2023-10-08T00:32:47.677879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:29.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.670219+0000","last_change":"2023-10-08T00:32:46.665574+0000","last_active":"2023-10-08T00:32:47.670219+0000","last_peered":"2023-10-08T00:32:47.670219+0000","last_clean":"2023-10-08T00:32:47.670219+0000","last_became_active":"2023-10-08T00:32:46.665313+0000","last_became_peered":"2023-10-08T00:32:46.665313+0000","last_unstale":"2023-10-08T00:32:47.670219+0000","last_undegraded":"2023-10-08T00:32:47.670219+0000","last_fullsized":"2023-10-08T00:32:47.670219+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:11.060950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674291+0000","last_change":"2023-10-08T00:32:47.666582+0000","last_active":"2023-10-08T00:32:47.674291+0000","last_peered":"2023-10-08T00:32:47.674291+0000","last_clean":"2023-10-08T00:32:47.674291+0000","last_became_active":"2023-10-08T00:32:47.664148+0000","last_became_peered":"2023-10-08T00:32:47.664148+0000","last_unstale":"2023-10-08T00:32:47.674291+0000","last_undegraded":"2023-10-08T00:32:47.674291+0000","last_fullsized":"2023-10-08T00:32:47.674291+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:45.670985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.667504+0000","last_change":"2023-10-08T00:32:46.673272+0000","last_active":"2023-10-08T00:32:47.667504+0000","last_peered":"2023-10-08T00:32:47.667504+0000","last_clean":"2023-10-08T00:32:47.667504+0000","last_became_active":"2023-10-08T00:32:46.672931+0000","last_became_peered":"2023-10-08T00:32:46.672931+0000","last_unstale":"2023-10-08T00:32:47.667504+0000","last_undegraded":"2023-10-08T00:32:47.667504+0000","last_fullsized":"2023-10-08T00:32:47.667504+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:19.290848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.668367+0000","last_change":"2023-10-08T00:32:47.665147+0000","last_active":"2023-10-08T00:32:47.668367+0000","last_peered":"2023-10-08T00:32:47.668367+0000","last_clean":"2023-10-08T00:32:47.668367+0000","last_became_active":"2023-10-08T00:32:47.664772+0000","last_became_peered":"2023-10-08T00:32:47.664772+0000","last_unstale":"2023-10-08T00:32:47.668367+0000","last_undegraded":"2023-10-08T00:32:47.668367+0000","last_fullsized":"2023-10-08T00:32:47.668367+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656185+0000","last_change":"2023-10-08T00:32:46.663359+0000","last_active":"2023-10-08T00:32:47.656185+0000","last_peered":"2023-10-08T00:32:47.656185+0000","last_clean":"2023-10-08T00:32:47.656185+0000","last_became_active":"2023-10-08T00:32:46.663036+0000","last_became_peered":"2023-10-08T00:32:46.663036+0000","last_unstale":"2023-10-08T00:32:47.656185+0000","last_undegraded":"2023-10-08T00:32:47.656185+0000","last_fullsized":"2023-10-08T00:32:47.656185+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:53.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680429+0000","last_change":"2023-10-08T00:32:47.675946+0000","last_active":"2023-10-08T00:32:47.680429+0000","last_peered":"2023-10-08T00:32:47.680429+0000","last_clean":"2023-10-08T00:32:47.680429+0000","last_became_active":"2023-10-08T00:32:47.675675+0000","last_became_peered":"2023-10-08T00:32:47.675675+0000","last_unstale":"2023-10-08T00:32:47.680429+0000","last_undegraded":"2023-10-08T00:32:47.680429+0000","last_fullsized":"2023-10-08T00:32:47.680429+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:48.727986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.653093+0000","last_change":"2023-10-08T00:32:46.668428+0000","last_active":"2023-10-08T00:32:47.653093+0000","last_peered":"2023-10-08T00:32:47.653093+0000","last_clean":"2023-10-08T00:32:47.653093+0000","last_became_active":"2023-10-08T00:32:46.668140+0000","last_became_peered":"2023-10-08T00:32:46.668140+0000","last_unstale":"2023-10-08T00:32:47.653093+0000","last_undegraded":"2023-10-08T00:32:47.653093+0000","last_fullsized":"2023-10-08T00:32:47.653093+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:56.603008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679532+0000","last_change":"2023-10-08T00:32:47.678827+0000","last_active":"2023-10-08T00:32:47.679532+0000","last_peered":"2023-10-08T00:32:47.679532+0000","last_clean":"2023-10-08T00:32:47.679532+0000","last_became_active":"2023-10-08T00:32:47.678481+0000","last_became_peered":"2023-10-08T00:32:47.678481+0000","last_unstale":"2023-10-08T00:32:47.679532+0000","last_undegraded":"2023-10-08T00:32:47.679532+0000","last_fullsized":"2023-10-08T00:32:47.679532+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:29:31.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.667785+0000","last_change":"2023-10-08T00:32:46.673338+0000","last_active":"2023-10-08T00:32:47.667785+0000","last_peered":"2023-10-08T00:32:47.667785+0000","last_clean":"2023-10-08T00:32:47.667785+0000","last_became_active":"2023-10-08T00:32:46.673058+0000","last_became_peered":"2023-10-08T00:32:46.673058+0000","last_unstale":"2023-10-08T00:32:47.667785+0000","last_undegraded":"2023-10-08T00:32:47.667785+0000","last_fullsized":"2023-10-08T00:32:47.667785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:06.943375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679308+0000","last_change":"2023-10-08T00:32:47.675215+0000","last_active":"2023-10-08T00:32:47.679308+0000","last_peered":"2023-10-08T00:32:47.679308+0000","last_clean":"2023-10-08T00:32:47.679308+0000","last_became_active":"2023-10-08T00:32:47.674944+0000","last_became_peered":"2023-10-08T00:32:47.674944+0000","last_unstale":"2023-10-08T00:32:47.679308+0000","last_undegraded":"2023-10-08T00:32:47.679308+0000","last_fullsized":"2023-10-08T00:32:47.679308+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:50.184185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656827+0000","last_change":"2023-10-08T00:32:46.666673+0000","last_active":"2023-10-08T00:32:47.656827+0000","last_peered":"2023-10-08T00:32:47.656827+0000","last_clean":"2023-10-08T00:32:47.656827+0000","last_became_active":"2023-10-08T00:32:46.666395+0000","last_became_peered":"2023-10-08T00:32:46.666395+0000","last_unstale":"2023-10-08T00:32:47.656827+0000","last_undegraded":"2023-10-08T00:32:47.656827+0000","last_fullsized":"2023-10-08T00:32:47.656827+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:08.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677878+0000","last_change":"2023-10-08T00:32:47.667392+0000","last_active":"2023-10-08T00:32:47.677878+0000","last_peered":"2023-10-08T00:32:47.677878+0000","last_clean":"2023-10-08T00:32:47.677878+0000","last_became_active":"2023-10-08T00:32:47.665858+0000","last_became_peered":"2023-10-08T00:32:47.665858+0000","last_unstale":"2023-10-08T00:32:47.677878+0000","last_undegraded":"2023-10-08T00:32:47.677878+0000","last_fullsized":"2023-10-08T00:32:47.677878+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:20.107114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.663320+0000","last_change":"2023-10-08T00:32:46.669479+0000","last_active":"2023-10-08T00:32:47.663320+0000","last_peered":"2023-10-08T00:32:47.663320+0000","last_clean":"2023-10-08T00:32:47.663320+0000","last_became_active":"2023-10-08T00:32:46.668156+0000","last_became_peered":"2023-10-08T00:32:46.668156+0000","last_unstale":"2023-10-08T00:32:47.663320+0000","last_undegraded":"2023-10-08T00:32:47.663320+0000","last_fullsized":"2023-10-08T00:32:47.663320+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:49.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.668394+0000","last_change":"2023-10-08T00:32:47.664897+0000","last_active":"2023-10-08T00:32:47.668394+0000","last_peered":"2023-10-08T00:32:47.668394+0000","last_clean":"2023-10-08T00:32:47.668394+0000","last_became_active":"2023-10-08T00:32:47.664625+0000","last_became_peered":"2023-10-08T00:32:47.664625+0000","last_unstale":"2023-10-08T00:32:47.668394+0000","last_undegraded":"2023-10-08T00:32:47.668394+0000","last_fullsized":"2023-10-08T00:32:47.668394+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:36.545610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.659735+0000","last_change":"2023-10-08T00:32:46.673654+0000","last_active":"2023-10-08T00:32:47.659735+0000","last_peered":"2023-10-08T00:32:47.659735+0000","last_clean":"2023-10-08T00:32:47.659735+0000","last_became_active":"2023-10-08T00:32:46.673382+0000","last_became_peered":"2023-10-08T00:32:46.673382+0000","last_unstale":"2023-10-08T00:32:47.659735+0000","last_undegraded":"2023-10-08T00:32:47.659735+0000","last_fullsized":"2023-10-08T00:32:47.659735+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:35.543510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676146+0000","last_change":"2023-10-08T00:32:47.668384+0000","last_active":"2023-10-08T00:32:47.676146+0000","last_peered":"2023-10-08T00:32:47.676146+0000","last_clean":"2023-10-08T00:32:47.676146+0000","last_became_active":"2023-10-08T00:32:47.667752+0000","last_became_peered":"2023-10-08T00:32:47.667752+0000","last_unstale":"2023-10-08T00:32:47.676146+0000","last_undegraded":"2023-10-08T00:32:47.676146+0000","last_fullsized":"2023-10-08T00:32:47.676146+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:10:26.205684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674657+0000","last_change":"2023-10-08T00:32:46.666389+0000","last_active":"2023-10-08T00:32:47.674657+0000","last_peered":"2023-10-08T00:32:47.674657+0000","last_clean":"2023-10-08T00:32:47.674657+0000","last_became_active":"2023-10-08T00:32:46.666099+0000","last_became_peered":"2023-10-08T00:32:46.666099+0000","last_unstale":"2023-10-08T00:32:47.674657+0000","last_undegraded":"2023-10-08T00:32:47.674657+0000","last_fullsized":"2023-10-08T00:32:47.674657+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:31.809208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":277,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671464+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:47.671464+0000","last_peered":"2023-10-08T00:32:47.671464+0000","last_clean":"2023-10-08T00:32:47.671464+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:47.671464+0000","last_undegraded":"2023-10-08T00:32:47.671464+0000","last_fullsized":"2023-10-08T00:32:47.671464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303904,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067936,"statfs":{"total":96636764160,"available":96325566464,"internally_reserved":0,"allocated":2580480,"data_stored":1477765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.373},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":886415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.432},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303320,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068520,"statfs":{"total":96636764160,"available":96326164480,"internally_reserved":0,"allocated":1982464,"data_stored":885917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.375}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.746},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.85099999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1476319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.50600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.63700000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.39000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.55000000000000004,"15min":0.63100000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.374},"min":{"1min":0.253,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.41999999999999998},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.60699999999999998,"15min":0.64700000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":1.242},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0800000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81599999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.755},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":885861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.318}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.624}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.68600000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.71499999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303324,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068516,"statfs":{"total":96636764160,"available":96326160384,"internally_reserved":0,"allocated":1986560,"data_stored":886043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.441},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.378}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.621},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69799999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303332,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068508,"statfs":{"total":96636764160,"available":96326152192,"internally_reserved":0,"allocated":1994752,"data_stored":887501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.48799999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":886415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.441},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47599999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.377},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:52.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T00:32:52.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.699+0000 7fdeea0b9700 1 Processor -- start 2023-10-08T00:32:52.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.699+0000 7fdeea0b9700 1 -- start start 2023-10-08T00:32:52.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.700+0000 7fdeea0b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee40cd910 0x7fdee40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.700+0000 7fdeea0b9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee40b5b00 con 0x7fdee4159ec0 2023-10-08T00:32:52.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.700+0000 7fdeea0b9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee40b5da0 con 0x7fdee40b55a0 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.700+0000 7fdeea0b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40b6080 con 0x7fdee40cd910 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.700+0000 7fdee37fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdee4159ec0 0x7fdee40b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52880/0 (socket says 172.21.15.22:52880) 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.700+0000 7fdee37fe700 1 -- 172.21.15.22:0/1100002412 learned_addr learned my addr 172.21.15.22:0/1100002412 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623857245 0 0) 0x7fdee40b5b00 con 0x7fdee4159ec0 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee2ffd700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee40cd910 0x7fdee40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc003570 con 0x7fdee4159ec0 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887276648 0 0) 0x7fdecc003570 con 0x7fdee4159ec0 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee40cd910 msgr2=0x7fdee40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee40cd910 0x7fdee40ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 >> v1:172.21.15.192:6789/0 conn(0x7fdee40b55a0 legacy=0x7fdee40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40cc100 con 0x7fdee4159ec0 2023-10-08T00:32:52.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fded40015f0 con 0x7fdee4159ec0 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 >> v1:172.21.15.22:6789/0 conn(0x7fdee4159ec0 legacy=0x7fdee40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc003a90 0x7fdecc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdecc004810 0x7fdecc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdecc005180 0x7fdecc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee40b6080 con 0x7fdecc005180 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc00bfa0 con 0x7fdecc003a90 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc00c130 con 0x7fdecc004810 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee3fff700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdecc005180 0x7fdecc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee37fe700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc003a90 0x7fdecc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee2ffd700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdecc004810 0x7fdecc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee3fff700 1 -- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdecc004810 msgr2=0x7fdecc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee3fff700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdecc004810 0x7fdecc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee3fff700 1 -- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc003a90 msgr2=0x7fdecc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee3fff700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdecc003a90 0x7fdecc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.701+0000 7fdee3fff700 1 -- 172.21.15.22:0/1100002412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc003570 con 0x7fdecc005180 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdee3fff700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdecc005180 0x7fdecc00ba60 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdedc001ff0 tx=0x7fdedc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ceacbfa6243470 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc001950 con 0x7fdecc005180 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00c870 con 0x7fdecc005180 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdee27fc700 1 -- 172.21.15.22:0/1100002412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00cc10 con 0x7fdecc005180 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdeea0b9700 1 -- 172.21.15.22:0/1100002412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdecc005180 msgr2=0x7fdecc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/1100002412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdecc005180 0x7fdecc00ba60 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdedc001ff0 tx=0x7fdedc001640 comp rx=0 tx=0).stop 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdee3fff700 1 -- 172.21.15.22:0/1100002412 reap_dead start 2023-10-08T00:32:52.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdeea0b9700 1 -- 172.21.15.22:0/1100002412 shutdown_connections 2023-10-08T00:32:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdeea0b9700 1 -- 172.21.15.22:0/1100002412 >> 172.21.15.22:0/1100002412 conn(0x7fdee40999f0 msgr2=0x7fdee40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdeea0b9700 1 -- 172.21.15.22:0/1100002412 shutdown_connections 2023-10-08T00:32:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.702+0000 7fdeea0b9700 1 -- 172.21.15.22:0/1100002412 wait complete. 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 Processor -- start 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 -- start start 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee4144150 0x7fdee4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 0x7fdee41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee4158df0 0x7fdee41527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee406ab70 con 0x7fdee4144520 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee406ae10 con 0x7fdee4144150 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdeea0b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee406b0f0 con 0x7fdee4158df0 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdee2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 0x7fdee41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdee2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 0x7fdee41588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41390/0 (socket says 172.21.15.22:41390) 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.704+0000 7fdee2ffd700 1 -- 172.21.15.22:0/3533333083 learned_addr learned my addr 172.21.15.22:0/3533333083 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee37fe700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee4144150 0x7fdee4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee3fff700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee4158df0 0x7fdee41527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee2ffd700 1 -- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee4158df0 msgr2=0x7fdee41527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee2ffd700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee4158df0 0x7fdee41527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee2ffd700 1 -- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee4144150 msgr2=0x7fdee4155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee2ffd700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee4144150 0x7fdee4155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee2ffd700 1 -- 172.21.15.22:0/3533333083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4158390 con 0x7fdee4144520 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee3fff700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee4158df0 0x7fdee41527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdee2ffd700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 0x7fdee41588b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fded8011960 tx=0x7fded8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800f6d0 con 0x7fdee4144520 2023-10-08T00:32:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded800f850 con 0x7fdee4144520 2023-10-08T00:32:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee41518d0 con 0x7fdee4144520 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800fc10 con 0x7fdee4144520 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.705+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee4151140 con 0x7fdee4144520 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.706+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee40cbd50 con 0x7fdee4144520 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.707+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fded8015460 con 0x7fdee4144520 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.707+0000 7fdecb7fe700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fded0067320 0x7fded00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.707+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fded80853a0 con 0x7fdee4144520 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.707+0000 7fdee37fe700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fded0067320 0x7fded00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:52.714 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.708+0000 7fdee37fe700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fded0067320 0x7fded00697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fded40017a0 tx=0x7fded4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:52.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.711+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fded80520f0 con 0x7fdee4144520 2023-10-08T00:32:52.805 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-08T00:32:52.804+0000 7f5199811700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:32:52.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.981+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdee4063c90 con 0x7fdee4144520 2023-10-08T00:32:52.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.981+0000 7fdecb7fe700 1 -- 172.21.15.22:0/3533333083 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1439 (secure 0 0 0) 0x7fded8055710 con 0x7fdee4144520 2023-10-08T00:32:52.983 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:52.983 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":498,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1696724684,"num_in_osds":8,"osd_in_since":1696724677,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2485985280,"bytes_avail":770608128000,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":106,"id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"d","status":"up:active","gid":7929}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-10-08T00:32:36.493336+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T00:32:52.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fded0067320 msgr2=0x7fded00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fded0067320 0x7fded00697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fded40017a0 tx=0x7fded4009040 comp rx=0 tx=0).stop 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 msgr2=0x7fdee41588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 0x7fdee41588b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fded8011960 tx=0x7fded8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 shutdown_connections 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fded0067320 0x7fded00697d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdee4158df0 0x7fdee41527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee4144150 0x7fdee4155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 --2- 172.21.15.22:0/3533333083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdee4144520 0x7fdee41588b0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:52.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 >> 172.21.15.22:0/3533333083 conn(0x7fdee40999f0 msgr2=0x7fdee40c6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 shutdown_connections 2023-10-08T00:32:52.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:52.983+0000 7fdeea0b9700 1 -- 172.21.15.22:0/3533333083 wait complete. 2023-10-08T00:32:52.997 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T00:32:52.997 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:53.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.114+0000 7fba16e13700 1 Processor -- start 2023-10-08T00:32:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.114+0000 7fba16e13700 1 -- start start 2023-10-08T00:32:53.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba16e13700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba101597f0 0x7fba100b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:53.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba16e13700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba1015d230 0x7fba1015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:53.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba16e13700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1015db70 con 0x7fba10159420 2023-10-08T00:32:53.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba16e13700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100b11d0 con 0x7fba101597f0 2023-10-08T00:32:53.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba16e13700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba100b14b0 con 0x7fba1015d230 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15610700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba101597f0 0x7fba100b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15e11700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fba10159420 0x7fba100b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52890/0 (socket says 172.21.15.22:52890) 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15e11700 1 -- 172.21.15.22:0/200457099 learned_addr learned my addr 172.21.15.22:0/200457099 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15610700 1 -- 172.21.15.22:0/200457099 >> v2:172.21.15.192:3300/0 conn(0x7fba1015d230 msgr2=0x7fba1015d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15610700 1 --2- 172.21.15.22:0/200457099 >> v2:172.21.15.192:3300/0 conn(0x7fba1015d230 0x7fba1015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15610700 1 -- 172.21.15.22:0/200457099 >> v1:172.21.15.22:6789/0 conn(0x7fba10159420 legacy=0x7fba100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.115+0000 7fba15610700 1 -- 172.21.15.22:0/200457099 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100b1790 con 0x7fba101597f0 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba15610700 1 --2- 172.21.15.22:0/200457099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba101597f0 0x7fba100b2270 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fba1015d170 tx=0x7fba040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6a783c52517ba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba14e0f700 1 -- 172.21.15.22:0/200457099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400b6b0 con 0x7fba101597f0 2023-10-08T00:32:53.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba14e0f700 1 -- 172.21.15.22:0/200457099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0400b810 con 0x7fba101597f0 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba14e0f700 1 -- 172.21.15.22:0/200457099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400bbb0 con 0x7fba101597f0 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 -- 172.21.15.22:0/200457099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba101597f0 msgr2=0x7fba100b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 --2- 172.21.15.22:0/200457099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba101597f0 0x7fba100b2270 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fba1015d170 tx=0x7fba040091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 -- 172.21.15.22:0/200457099 shutdown_connections 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 --2- 172.21.15.22:0/200457099 >> v2:172.21.15.192:3300/0 conn(0x7fba1015d230 0x7fba1015d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 --2- 172.21.15.22:0/200457099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba101597f0 0x7fba100b2270 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 -- 172.21.15.22:0/200457099 >> 172.21.15.22:0/200457099 conn(0x7fba100d0660 msgr2=0x7fba100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 -- 172.21.15.22:0/200457099 shutdown_connections 2023-10-08T00:32:53.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.116+0000 7fba16e13700 1 -- 172.21.15.22:0/200457099 wait complete. 2023-10-08T00:32:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.117+0000 7fba16e13700 1 Processor -- start 2023-10-08T00:32:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.117+0000 7fba16e13700 1 -- start start 2023-10-08T00:32:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16e13700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba10159420 0x7fba1015c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16e13700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba101597f0 0x7fba101544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16e13700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 0x7fba10068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16e13700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015bbf0 con 0x7fba1015d230 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16e13700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015ca70 con 0x7fba101597f0 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16e13700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015afe0 con 0x7fba10159420 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16612700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 0x7fba10068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16612700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 0x7fba10068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41414/0 (socket says 172.21.15.22:41414) 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba16612700 1 -- 172.21.15.22:0/2406408654 learned_addr learned my addr 172.21.15.22:0/2406408654 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba15e11700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba10159420 0x7fba1015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.118+0000 7fba15610700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba101597f0 0x7fba101544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16612700 1 -- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba10159420 msgr2=0x7fba1015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16612700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba10159420 0x7fba1015c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16612700 1 -- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba101597f0 msgr2=0x7fba101544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16612700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba101597f0 0x7fba101544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16612700 1 -- 172.21.15.22:0/2406408654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04009420 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba15610700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba101597f0 0x7fba101544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16612700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 0x7fba10068bb0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fba0000bc30 tx=0x7fba00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000092e0 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000c6f0 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1015b2c0 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0000cad0 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.119+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1015b880 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.120+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100c5400 con 0x7fba1015d230 2023-10-08T00:32:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.120+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fba00012070 con 0x7fba1015d230 2023-10-08T00:32:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.121+0000 7fba0dffb700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9fc067320 0x7fb9fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.121+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba00084870 con 0x7fba1015d230 2023-10-08T00:32:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.121+0000 7fba15e11700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9fc067320 0x7fb9fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.121+0000 7fba15e11700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9fc067320 0x7fb9fc0697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba08007130 tx=0x7fba08007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.125+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba100c5400 con 0x7fba1015d230 2023-10-08T00:32:53.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.313+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba100c5400 con 0x7fb9fc067320 2023-10-08T00:32:53.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.322+0000 7fba0dffb700 1 -- 172.21.15.22:0/2406408654 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289763 (secure 0 0 0) 0x7fba100c5400 con 0x7fb9fc067320 2023-10-08T00:32:53.326 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9fc067320 msgr2=0x7fb9fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9fc067320 0x7fb9fc0697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fba08007130 tx=0x7fba08007eb0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 msgr2=0x7fba10068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 0x7fba10068bb0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fba0000bc30 tx=0x7fba00009840 comp rx=0 tx=0).stop 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 shutdown_connections 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1015d230 0x7fba10068bb0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9fc067320 0x7fb9fc0697d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fba10159420 0x7fba1015c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 --2- 172.21.15.22:0/2406408654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba101597f0 0x7fba101544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 >> 172.21.15.22:0/2406408654 conn(0x7fba100d0660 msgr2=0x7fba100b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:53.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 shutdown_connections 2023-10-08T00:32:53.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:53.325+0000 7fba16e13700 1 -- 172.21.15.22:0/2406408654 wait complete. 2023-10-08T00:32:53.330 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:53.338 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-08T00:32:52.496340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427720,"kb_used_data":16648,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547000,"statfs":{"total":773094113280,"available":770608128000,"internally_reserved":0,"allocated":17047552,"data_stored":8272236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001274"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676494+0000","last_change":"2023-10-08T00:32:47.673182+0000","last_active":"2023-10-08T00:32:47.676494+0000","last_peered":"2023-10-08T00:32:47.676494+0000","last_clean":"2023-10-08T00:32:47.676494+0000","last_became_active":"2023-10-08T00:32:47.672899+0000","last_became_peered":"2023-10-08T00:32:47.672899+0000","last_unstale":"2023-10-08T00:32:47.676494+0000","last_undegraded":"2023-10-08T00:32:47.676494+0000","last_fullsized":"2023-10-08T00:32:47.676494+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:58.017608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677028+0000","last_change":"2023-10-08T00:32:47.670723+0000","last_active":"2023-10-08T00:32:47.677028+0000","last_peered":"2023-10-08T00:32:47.677028+0000","last_clean":"2023-10-08T00:32:47.677028+0000","last_became_active":"2023-10-08T00:32:47.669968+0000","last_became_peered":"2023-10-08T00:32:47.669968+0000","last_unstale":"2023-10-08T00:32:47.677028+0000","last_undegraded":"2023-10-08T00:32:47.677028+0000","last_fullsized":"2023-10-08T00:32:47.677028+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:22:22.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678858+0000","last_change":"2023-10-08T00:32:47.676860+0000","last_active":"2023-10-08T00:32:47.678858+0000","last_peered":"2023-10-08T00:32:47.678858+0000","last_clean":"2023-10-08T00:32:47.678858+0000","last_became_active":"2023-10-08T00:32:47.676461+0000","last_became_peered":"2023-10-08T00:32:47.676461+0000","last_unstale":"2023-10-08T00:32:47.678858+0000","last_undegraded":"2023-10-08T00:32:47.678858+0000","last_fullsized":"2023-10-08T00:32:47.678858+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:36.068700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679676+0000","last_change":"2023-10-08T00:32:47.678644+0000","last_active":"2023-10-08T00:32:47.679676+0000","last_peered":"2023-10-08T00:32:47.679676+0000","last_clean":"2023-10-08T00:32:47.679676+0000","last_became_active":"2023-10-08T00:32:47.678219+0000","last_became_peered":"2023-10-08T00:32:47.678219+0000","last_unstale":"2023-10-08T00:32:47.679676+0000","last_undegraded":"2023-10-08T00:32:47.679676+0000","last_fullsized":"2023-10-08T00:32:47.679676+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:45.197288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678876+0000","last_change":"2023-10-08T00:32:47.674271+0000","last_active":"2023-10-08T00:32:47.678876+0000","last_peered":"2023-10-08T00:32:47.678876+0000","last_clean":"2023-10-08T00:32:47.678876+0000","last_became_active":"2023-10-08T00:32:47.673950+0000","last_became_peered":"2023-10-08T00:32:47.673950+0000","last_unstale":"2023-10-08T00:32:47.678876+0000","last_undegraded":"2023-10-08T00:32:47.678876+0000","last_fullsized":"2023-10-08T00:32:47.678876+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:22:29.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676189+0000","last_change":"2023-10-08T00:32:47.666805+0000","last_active":"2023-10-08T00:32:47.676189+0000","last_peered":"2023-10-08T00:32:47.676189+0000","last_clean":"2023-10-08T00:32:47.676189+0000","last_became_active":"2023-10-08T00:32:47.666564+0000","last_became_peered":"2023-10-08T00:32:47.666564+0000","last_unstale":"2023-10-08T00:32:47.676189+0000","last_undegraded":"2023-10-08T00:32:47.676189+0000","last_fullsized":"2023-10-08T00:32:47.676189+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:26:50.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679541+0000","last_change":"2023-10-08T00:32:47.678989+0000","last_active":"2023-10-08T00:32:47.679541+0000","last_peered":"2023-10-08T00:32:47.679541+0000","last_clean":"2023-10-08T00:32:47.679541+0000","last_became_active":"2023-10-08T00:32:47.678689+0000","last_became_peered":"2023-10-08T00:32:47.678689+0000","last_unstale":"2023-10-08T00:32:47.679541+0000","last_undegraded":"2023-10-08T00:32:47.679541+0000","last_fullsized":"2023-10-08T00:32:47.679541+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:50.593389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.669515+0000","last_change":"2023-10-08T00:32:47.662839+0000","last_active":"2023-10-08T00:32:47.669515+0000","last_peered":"2023-10-08T00:32:47.669515+0000","last_clean":"2023-10-08T00:32:47.669515+0000","last_became_active":"2023-10-08T00:32:47.662534+0000","last_became_peered":"2023-10-08T00:32:47.662534+0000","last_unstale":"2023-10-08T00:32:47.669515+0000","last_undegraded":"2023-10-08T00:32:47.669515+0000","last_fullsized":"2023-10-08T00:32:47.669515+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:27.181725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681496+0000","last_change":"2023-10-08T00:32:47.675391+0000","last_active":"2023-10-08T00:32:47.681496+0000","last_peered":"2023-10-08T00:32:47.681496+0000","last_clean":"2023-10-08T00:32:47.681496+0000","last_became_active":"2023-10-08T00:32:47.675080+0000","last_became_peered":"2023-10-08T00:32:47.675080+0000","last_unstale":"2023-10-08T00:32:47.681496+0000","last_undegraded":"2023-10-08T00:32:47.681496+0000","last_fullsized":"2023-10-08T00:32:47.681496+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:25.772332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672492+0000","last_change":"2023-10-08T00:32:47.669951+0000","last_active":"2023-10-08T00:32:47.672492+0000","last_peered":"2023-10-08T00:32:47.672492+0000","last_clean":"2023-10-08T00:32:47.672492+0000","last_became_active":"2023-10-08T00:32:47.669475+0000","last_became_peered":"2023-10-08T00:32:47.669475+0000","last_unstale":"2023-10-08T00:32:47.672492+0000","last_undegraded":"2023-10-08T00:32:47.672492+0000","last_fullsized":"2023-10-08T00:32:47.672492+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:24.745892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675700+0000","last_change":"2023-10-08T00:32:47.666123+0000","last_active":"2023-10-08T00:32:47.675700+0000","last_peered":"2023-10-08T00:32:47.675700+0000","last_clean":"2023-10-08T00:32:47.675700+0000","last_became_active":"2023-10-08T00:32:47.665809+0000","last_became_peered":"2023-10-08T00:32:47.665809+0000","last_unstale":"2023-10-08T00:32:47.675700+0000","last_undegraded":"2023-10-08T00:32:47.675700+0000","last_fullsized":"2023-10-08T00:32:47.675700+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:25.580750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677543+0000","last_change":"2023-10-08T00:32:47.670748+0000","last_active":"2023-10-08T00:32:47.677543+0000","last_peered":"2023-10-08T00:32:47.677543+0000","last_clean":"2023-10-08T00:32:47.677543+0000","last_became_active":"2023-10-08T00:32:47.670489+0000","last_became_peered":"2023-10-08T00:32:47.670489+0000","last_unstale":"2023-10-08T00:32:47.677543+0000","last_undegraded":"2023-10-08T00:32:47.677543+0000","last_fullsized":"2023-10-08T00:32:47.677543+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:45.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674747+0000","last_change":"2023-10-08T00:32:47.665876+0000","last_active":"2023-10-08T00:32:47.674747+0000","last_peered":"2023-10-08T00:32:47.674747+0000","last_clean":"2023-10-08T00:32:47.674747+0000","last_became_active":"2023-10-08T00:32:47.665401+0000","last_became_peered":"2023-10-08T00:32:47.665401+0000","last_unstale":"2023-10-08T00:32:47.674747+0000","last_undegraded":"2023-10-08T00:32:47.674747+0000","last_fullsized":"2023-10-08T00:32:47.674747+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:11.916937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676167+0000","last_change":"2023-10-08T00:32:47.668418+0000","last_active":"2023-10-08T00:32:47.676167+0000","last_peered":"2023-10-08T00:32:47.676167+0000","last_clean":"2023-10-08T00:32:47.676167+0000","last_became_active":"2023-10-08T00:32:47.668119+0000","last_became_peered":"2023-10-08T00:32:47.668119+0000","last_unstale":"2023-10-08T00:32:47.676167+0000","last_undegraded":"2023-10-08T00:32:47.676167+0000","last_fullsized":"2023-10-08T00:32:47.676167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:42.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674319+0000","last_change":"2023-10-08T00:32:47.665743+0000","last_active":"2023-10-08T00:32:47.674319+0000","last_peered":"2023-10-08T00:32:47.674319+0000","last_clean":"2023-10-08T00:32:47.674319+0000","last_became_active":"2023-10-08T00:32:47.665441+0000","last_became_peered":"2023-10-08T00:32:47.665441+0000","last_unstale":"2023-10-08T00:32:47.674319+0000","last_undegraded":"2023-10-08T00:32:47.674319+0000","last_fullsized":"2023-10-08T00:32:47.674319+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:32.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679309+0000","last_change":"2023-10-08T00:32:47.678439+0000","last_active":"2023-10-08T00:32:47.679309+0000","last_peered":"2023-10-08T00:32:47.679309+0000","last_clean":"2023-10-08T00:32:47.679309+0000","last_became_active":"2023-10-08T00:32:47.678174+0000","last_became_peered":"2023-10-08T00:32:47.678174+0000","last_unstale":"2023-10-08T00:32:47.679309+0000","last_undegraded":"2023-10-08T00:32:47.679309+0000","last_fullsized":"2023-10-08T00:32:47.679309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:12:48.052333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676476+0000","last_change":"2023-10-08T00:32:47.673001+0000","last_active":"2023-10-08T00:32:47.676476+0000","last_peered":"2023-10-08T00:32:47.676476+0000","last_clean":"2023-10-08T00:32:47.676476+0000","last_became_active":"2023-10-08T00:32:47.672726+0000","last_became_peered":"2023-10-08T00:32:47.672726+0000","last_unstale":"2023-10-08T00:32:47.676476+0000","last_undegraded":"2023-10-08T00:32:47.676476+0000","last_fullsized":"2023-10-08T00:32:47.676476+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:27.005109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672459+0000","last_change":"2023-10-08T00:32:47.669731+0000","last_active":"2023-10-08T00:32:47.672459+0000","last_peered":"2023-10-08T00:32:47.672459+0000","last_clean":"2023-10-08T00:32:47.672459+0000","last_became_active":"2023-10-08T00:32:47.669154+0000","last_became_peered":"2023-10-08T00:32:47.669154+0000","last_unstale":"2023-10-08T00:32:47.672459+0000","last_undegraded":"2023-10-08T00:32:47.672459+0000","last_fullsized":"2023-10-08T00:32:47.672459+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:41.438719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678843+0000","last_change":"2023-10-08T00:32:47.677672+0000","last_active":"2023-10-08T00:32:47.678843+0000","last_peered":"2023-10-08T00:32:47.678843+0000","last_clean":"2023-10-08T00:32:47.678843+0000","last_became_active":"2023-10-08T00:32:47.677421+0000","last_became_peered":"2023-10-08T00:32:47.677421+0000","last_unstale":"2023-10-08T00:32:47.678843+0000","last_undegraded":"2023-10-08T00:32:47.678843+0000","last_fullsized":"2023-10-08T00:32:47.678843+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:47.142806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678952+0000","last_change":"2023-10-08T00:32:47.674575+0000","last_active":"2023-10-08T00:32:47.678952+0000","last_peered":"2023-10-08T00:32:47.678952+0000","last_clean":"2023-10-08T00:32:47.678952+0000","last_became_active":"2023-10-08T00:32:47.673996+0000","last_became_peered":"2023-10-08T00:32:47.673996+0000","last_unstale":"2023-10-08T00:32:47.678952+0000","last_undegraded":"2023-10-08T00:32:47.678952+0000","last_fullsized":"2023-10-08T00:32:47.678952+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:29:11.031610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.682874+0000","last_change":"2023-10-08T00:32:47.681066+0000","last_active":"2023-10-08T00:32:47.682874+0000","last_peered":"2023-10-08T00:32:47.682874+0000","last_clean":"2023-10-08T00:32:47.682874+0000","last_became_active":"2023-10-08T00:32:47.680781+0000","last_became_peered":"2023-10-08T00:32:47.680781+0000","last_unstale":"2023-10-08T00:32:47.682874+0000","last_undegraded":"2023-10-08T00:32:47.682874+0000","last_fullsized":"2023-10-08T00:32:47.682874+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:41.438719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680563+0000","last_change":"2023-10-08T00:32:47.675995+0000","last_active":"2023-10-08T00:32:47.680563+0000","last_peered":"2023-10-08T00:32:47.680563+0000","last_clean":"2023-10-08T00:32:47.680563+0000","last_became_active":"2023-10-08T00:32:47.675639+0000","last_became_peered":"2023-10-08T00:32:47.675639+0000","last_unstale":"2023-10-08T00:32:47.680563+0000","last_undegraded":"2023-10-08T00:32:47.680563+0000","last_fullsized":"2023-10-08T00:32:47.680563+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:58.411629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672619+0000","last_change":"2023-10-08T00:32:47.666851+0000","last_active":"2023-10-08T00:32:47.672619+0000","last_peered":"2023-10-08T00:32:47.672619+0000","last_clean":"2023-10-08T00:32:47.672619+0000","last_became_active":"2023-10-08T00:32:47.666588+0000","last_became_peered":"2023-10-08T00:32:47.666588+0000","last_unstale":"2023-10-08T00:32:47.672619+0000","last_undegraded":"2023-10-08T00:32:47.672619+0000","last_fullsized":"2023-10-08T00:32:47.672619+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:00.592794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.682902+0000","last_change":"2023-10-08T00:32:47.681757+0000","last_active":"2023-10-08T00:32:47.682902+0000","last_peered":"2023-10-08T00:32:47.682902+0000","last_clean":"2023-10-08T00:32:47.682902+0000","last_became_active":"2023-10-08T00:32:47.681506+0000","last_became_peered":"2023-10-08T00:32:47.681506+0000","last_unstale":"2023-10-08T00:32:47.682902+0000","last_undegraded":"2023-10-08T00:32:47.682902+0000","last_fullsized":"2023-10-08T00:32:47.682902+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:07.611237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681469+0000","last_change":"2023-10-08T00:32:47.674823+0000","last_active":"2023-10-08T00:32:47.681469+0000","last_peered":"2023-10-08T00:32:47.681469+0000","last_clean":"2023-10-08T00:32:47.681469+0000","last_became_active":"2023-10-08T00:32:47.674534+0000","last_became_peered":"2023-10-08T00:32:47.674534+0000","last_unstale":"2023-10-08T00:32:47.681469+0000","last_undegraded":"2023-10-08T00:32:47.681469+0000","last_fullsized":"2023-10-08T00:32:47.681469+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:06:06.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679485+0000","last_change":"2023-10-08T00:32:47.678551+0000","last_active":"2023-10-08T00:32:47.679485+0000","last_peered":"2023-10-08T00:32:47.679485+0000","last_clean":"2023-10-08T00:32:47.679485+0000","last_became_active":"2023-10-08T00:32:47.677776+0000","last_became_peered":"2023-10-08T00:32:47.677776+0000","last_unstale":"2023-10-08T00:32:47.679485+0000","last_undegraded":"2023-10-08T00:32:47.679485+0000","last_fullsized":"2023-10-08T00:32:47.679485+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:21.542182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677521+0000","last_change":"2023-10-08T00:32:47.670266+0000","last_active":"2023-10-08T00:32:47.677521+0000","last_peered":"2023-10-08T00:32:47.677521+0000","last_clean":"2023-10-08T00:32:47.677521+0000","last_became_active":"2023-10-08T00:32:47.669986+0000","last_became_peered":"2023-10-08T00:32:47.669986+0000","last_unstale":"2023-10-08T00:32:47.677521+0000","last_undegraded":"2023-10-08T00:32:47.677521+0000","last_fullsized":"2023-10-08T00:32:47.677521+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:36.068700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664917+0000","last_change":"2023-10-08T00:32:47.660359+0000","last_active":"2023-10-08T00:32:47.664917+0000","last_peered":"2023-10-08T00:32:47.664917+0000","last_clean":"2023-10-08T00:32:47.664917+0000","last_became_active":"2023-10-08T00:32:47.660082+0000","last_became_peered":"2023-10-08T00:32:47.660082+0000","last_unstale":"2023-10-08T00:32:47.664917+0000","last_undegraded":"2023-10-08T00:32:47.664917+0000","last_fullsized":"2023-10-08T00:32:47.664917+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:57:17.568726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679328+0000","last_change":"2023-10-08T00:32:47.676054+0000","last_active":"2023-10-08T00:32:47.679328+0000","last_peered":"2023-10-08T00:32:47.679328+0000","last_clean":"2023-10-08T00:32:47.679328+0000","last_became_active":"2023-10-08T00:32:47.675780+0000","last_became_peered":"2023-10-08T00:32:47.675780+0000","last_unstale":"2023-10-08T00:32:47.679328+0000","last_undegraded":"2023-10-08T00:32:47.679328+0000","last_fullsized":"2023-10-08T00:32:47.679328+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671536+0000","last_change":"2023-10-08T00:32:47.667554+0000","last_active":"2023-10-08T00:32:47.671536+0000","last_peered":"2023-10-08T00:32:47.671536+0000","last_clean":"2023-10-08T00:32:47.671536+0000","last_became_active":"2023-10-08T00:32:47.667300+0000","last_became_peered":"2023-10-08T00:32:47.667300+0000","last_unstale":"2023-10-08T00:32:47.671536+0000","last_undegraded":"2023-10-08T00:32:47.671536+0000","last_fullsized":"2023-10-08T00:32:47.671536+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:57:17.568726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676079+0000","last_change":"2023-10-08T00:32:47.674990+0000","last_active":"2023-10-08T00:32:47.676079+0000","last_peered":"2023-10-08T00:32:47.676079+0000","last_clean":"2023-10-08T00:32:47.676079+0000","last_became_active":"2023-10-08T00:32:47.674679+0000","last_became_peered":"2023-10-08T00:32:47.674679+0000","last_unstale":"2023-10-08T00:32:47.676079+0000","last_undegraded":"2023-10-08T00:32:47.676079+0000","last_fullsized":"2023-10-08T00:32:47.676079+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:34:36.484411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676190+0000","last_change":"2023-10-08T00:32:47.670319+0000","last_active":"2023-10-08T00:32:47.676190+0000","last_peered":"2023-10-08T00:32:47.676190+0000","last_clean":"2023-10-08T00:32:47.676190+0000","last_became_active":"2023-10-08T00:32:47.670034+0000","last_became_peered":"2023-10-08T00:32:47.670034+0000","last_unstale":"2023-10-08T00:32:47.676190+0000","last_undegraded":"2023-10-08T00:32:47.676190+0000","last_fullsized":"2023-10-08T00:32:47.676190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:42.095366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671248+0000","last_change":"2023-10-08T00:32:47.666939+0000","last_active":"2023-10-08T00:32:47.671248+0000","last_peered":"2023-10-08T00:32:47.671248+0000","last_clean":"2023-10-08T00:32:47.671248+0000","last_became_active":"2023-10-08T00:32:47.666679+0000","last_became_peered":"2023-10-08T00:32:47.666679+0000","last_unstale":"2023-10-08T00:32:47.671248+0000","last_undegraded":"2023-10-08T00:32:47.671248+0000","last_fullsized":"2023-10-08T00:32:47.671248+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:20.107114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671843+0000","last_change":"2023-10-08T00:32:46.669290+0000","last_active":"2023-10-08T00:32:47.671843+0000","last_peered":"2023-10-08T00:32:47.671843+0000","last_clean":"2023-10-08T00:32:47.671843+0000","last_became_active":"2023-10-08T00:32:46.668820+0000","last_became_peered":"2023-10-08T00:32:46.668820+0000","last_unstale":"2023-10-08T00:32:47.671843+0000","last_undegraded":"2023-10-08T00:32:47.671843+0000","last_fullsized":"2023-10-08T00:32:47.671843+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:13:07.806373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680699+0000","last_change":"2023-10-08T00:32:47.678249+0000","last_active":"2023-10-08T00:32:47.680699+0000","last_peered":"2023-10-08T00:32:47.680699+0000","last_clean":"2023-10-08T00:32:47.680699+0000","last_became_active":"2023-10-08T00:32:47.677970+0000","last_became_peered":"2023-10-08T00:32:47.677970+0000","last_unstale":"2023-10-08T00:32:47.680699+0000","last_undegraded":"2023-10-08T00:32:47.680699+0000","last_fullsized":"2023-10-08T00:32:47.680699+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:05:09.891245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674951+0000","last_change":"2023-10-08T00:32:46.670932+0000","last_active":"2023-10-08T00:32:47.674951+0000","last_peered":"2023-10-08T00:32:47.674951+0000","last_clean":"2023-10-08T00:32:47.674951+0000","last_became_active":"2023-10-08T00:32:46.670640+0000","last_became_peered":"2023-10-08T00:32:46.670640+0000","last_unstale":"2023-10-08T00:32:47.674951+0000","last_undegraded":"2023-10-08T00:32:47.674951+0000","last_fullsized":"2023-10-08T00:32:47.674951+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:56.603008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678724+0000","last_change":"2023-10-08T00:32:47.677896+0000","last_active":"2023-10-08T00:32:47.678724+0000","last_peered":"2023-10-08T00:32:47.678724+0000","last_clean":"2023-10-08T00:32:47.678724+0000","last_became_active":"2023-10-08T00:32:47.677600+0000","last_became_peered":"2023-10-08T00:32:47.677600+0000","last_unstale":"2023-10-08T00:32:47.678724+0000","last_undegraded":"2023-10-08T00:32:47.678724+0000","last_fullsized":"2023-10-08T00:32:47.678724+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:27.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676712+0000","last_change":"2023-10-08T00:32:46.672799+0000","last_active":"2023-10-08T00:32:47.676712+0000","last_peered":"2023-10-08T00:32:47.676712+0000","last_clean":"2023-10-08T00:32:47.676712+0000","last_became_active":"2023-10-08T00:32:46.672492+0000","last_became_peered":"2023-10-08T00:32:46.672492+0000","last_unstale":"2023-10-08T00:32:47.676712+0000","last_undegraded":"2023-10-08T00:32:47.676712+0000","last_fullsized":"2023-10-08T00:32:47.676712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:13:09.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676392+0000","last_change":"2023-10-08T00:32:47.674304+0000","last_active":"2023-10-08T00:32:47.676392+0000","last_peered":"2023-10-08T00:32:47.676392+0000","last_clean":"2023-10-08T00:32:47.676392+0000","last_became_active":"2023-10-08T00:32:47.674042+0000","last_became_peered":"2023-10-08T00:32:47.674042+0000","last_unstale":"2023-10-08T00:32:47.676392+0000","last_undegraded":"2023-10-08T00:32:47.676392+0000","last_fullsized":"2023-10-08T00:32:47.676392+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:18:28.129137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677187+0000","last_change":"2023-10-08T00:32:46.673978+0000","last_active":"2023-10-08T00:32:47.677187+0000","last_peered":"2023-10-08T00:32:47.677187+0000","last_clean":"2023-10-08T00:32:47.677187+0000","last_became_active":"2023-10-08T00:32:46.673703+0000","last_became_peered":"2023-10-08T00:32:46.673703+0000","last_unstale":"2023-10-08T00:32:47.677187+0000","last_undegraded":"2023-10-08T00:32:47.677187+0000","last_fullsized":"2023-10-08T00:32:47.677187+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:31:01.301020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679652+0000","last_change":"2023-10-08T00:32:47.678424+0000","last_active":"2023-10-08T00:32:47.679652+0000","last_peered":"2023-10-08T00:32:47.679652+0000","last_clean":"2023-10-08T00:32:47.679652+0000","last_became_active":"2023-10-08T00:32:47.678161+0000","last_became_peered":"2023-10-08T00:32:47.678161+0000","last_unstale":"2023-10-08T00:32:47.679652+0000","last_undegraded":"2023-10-08T00:32:47.679652+0000","last_fullsized":"2023-10-08T00:32:47.679652+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:10.988680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674522+0000","last_change":"2023-10-08T00:32:46.663730+0000","last_active":"2023-10-08T00:32:47.674522+0000","last_peered":"2023-10-08T00:32:47.674522+0000","last_clean":"2023-10-08T00:32:47.674522+0000","last_became_active":"2023-10-08T00:32:46.663100+0000","last_became_peered":"2023-10-08T00:32:46.663100+0000","last_unstale":"2023-10-08T00:32:47.674522+0000","last_undegraded":"2023-10-08T00:32:47.674522+0000","last_fullsized":"2023-10-08T00:32:47.674522+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:16:14.361359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679051+0000","last_change":"2023-10-08T00:32:47.674704+0000","last_active":"2023-10-08T00:32:47.679051+0000","last_peered":"2023-10-08T00:32:47.679051+0000","last_clean":"2023-10-08T00:32:47.679051+0000","last_became_active":"2023-10-08T00:32:47.674450+0000","last_became_peered":"2023-10-08T00:32:47.674450+0000","last_unstale":"2023-10-08T00:32:47.679051+0000","last_undegraded":"2023-10-08T00:32:47.679051+0000","last_fullsized":"2023-10-08T00:32:47.679051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:07.751699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.655966+0000","last_change":"2023-10-08T00:32:46.660631+0000","last_active":"2023-10-08T00:32:47.655966+0000","last_peered":"2023-10-08T00:32:47.655966+0000","last_clean":"2023-10-08T00:32:47.655966+0000","last_became_active":"2023-10-08T00:32:46.660477+0000","last_became_peered":"2023-10-08T00:32:46.660477+0000","last_unstale":"2023-10-08T00:32:47.655966+0000","last_undegraded":"2023-10-08T00:32:47.655966+0000","last_fullsized":"2023-10-08T00:32:47.655966+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:45.540813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679685+0000","last_change":"2023-10-08T00:32:47.678875+0000","last_active":"2023-10-08T00:32:47.679685+0000","last_peered":"2023-10-08T00:32:47.679685+0000","last_clean":"2023-10-08T00:32:47.679685+0000","last_became_active":"2023-10-08T00:32:47.678663+0000","last_became_peered":"2023-10-08T00:32:47.678663+0000","last_unstale":"2023-10-08T00:32:47.679685+0000","last_undegraded":"2023-10-08T00:32:47.679685+0000","last_fullsized":"2023-10-08T00:32:47.679685+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:25.298048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664874+0000","last_change":"2023-10-08T00:32:46.665849+0000","last_active":"2023-10-08T00:32:47.664874+0000","last_peered":"2023-10-08T00:32:47.664874+0000","last_clean":"2023-10-08T00:32:47.664874+0000","last_became_active":"2023-10-08T00:32:46.665568+0000","last_became_peered":"2023-10-08T00:32:46.665568+0000","last_unstale":"2023-10-08T00:32:47.664874+0000","last_undegraded":"2023-10-08T00:32:47.664874+0000","last_fullsized":"2023-10-08T00:32:47.664874+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:35.066601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.684642+0000","last_change":"2023-10-08T00:32:47.682353+0000","last_active":"2023-10-08T00:32:47.684642+0000","last_peered":"2023-10-08T00:32:47.684642+0000","last_clean":"2023-10-08T00:32:47.684642+0000","last_became_active":"2023-10-08T00:32:47.682103+0000","last_became_peered":"2023-10-08T00:32:47.682103+0000","last_unstale":"2023-10-08T00:32:47.684642+0000","last_undegraded":"2023-10-08T00:32:47.684642+0000","last_fullsized":"2023-10-08T00:32:47.684642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:41:47.578512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656019+0000","last_change":"2023-10-08T00:32:46.666432+0000","last_active":"2023-10-08T00:32:47.656019+0000","last_peered":"2023-10-08T00:32:47.656019+0000","last_clean":"2023-10-08T00:32:47.656019+0000","last_became_active":"2023-10-08T00:32:46.665868+0000","last_became_peered":"2023-10-08T00:32:46.665868+0000","last_unstale":"2023-10-08T00:32:47.656019+0000","last_undegraded":"2023-10-08T00:32:47.656019+0000","last_fullsized":"2023-10-08T00:32:47.656019+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.718629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676442+0000","last_change":"2023-10-08T00:32:47.667181+0000","last_active":"2023-10-08T00:32:47.676442+0000","last_peered":"2023-10-08T00:32:47.676442+0000","last_clean":"2023-10-08T00:32:47.676442+0000","last_became_active":"2023-10-08T00:32:47.666894+0000","last_became_peered":"2023-10-08T00:32:47.666894+0000","last_unstale":"2023-10-08T00:32:47.676442+0000","last_undegraded":"2023-10-08T00:32:47.676442+0000","last_fullsized":"2023-10-08T00:32:47.676442+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:45.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664665+0000","last_change":"2023-10-08T00:32:46.668790+0000","last_active":"2023-10-08T00:32:47.664665+0000","last_peered":"2023-10-08T00:32:47.664665+0000","last_clean":"2023-10-08T00:32:47.664665+0000","last_became_active":"2023-10-08T00:32:46.668522+0000","last_became_peered":"2023-10-08T00:32:46.668522+0000","last_unstale":"2023-10-08T00:32:47.664665+0000","last_undegraded":"2023-10-08T00:32:47.664665+0000","last_fullsized":"2023-10-08T00:32:47.664665+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:10.914838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679658+0000","last_change":"2023-10-08T00:32:47.678479+0000","last_active":"2023-10-08T00:32:47.679658+0000","last_peered":"2023-10-08T00:32:47.679658+0000","last_clean":"2023-10-08T00:32:47.679658+0000","last_became_active":"2023-10-08T00:32:47.678000+0000","last_became_peered":"2023-10-08T00:32:47.678000+0000","last_unstale":"2023-10-08T00:32:47.679658+0000","last_undegraded":"2023-10-08T00:32:47.679658+0000","last_fullsized":"2023-10-08T00:32:47.679658+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:32:44.947907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677130+0000","last_change":"2023-10-08T00:32:46.673405+0000","last_active":"2023-10-08T00:32:47.677130+0000","last_peered":"2023-10-08T00:32:47.677130+0000","last_clean":"2023-10-08T00:32:47.677130+0000","last_became_active":"2023-10-08T00:32:46.673098+0000","last_became_peered":"2023-10-08T00:32:46.673098+0000","last_unstale":"2023-10-08T00:32:47.677130+0000","last_undegraded":"2023-10-08T00:32:47.677130+0000","last_fullsized":"2023-10-08T00:32:47.677130+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:29:10.029510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676243+0000","last_change":"2023-10-08T00:32:47.668213+0000","last_active":"2023-10-08T00:32:47.676243+0000","last_peered":"2023-10-08T00:32:47.676243+0000","last_clean":"2023-10-08T00:32:47.676243+0000","last_became_active":"2023-10-08T00:32:47.667944+0000","last_became_peered":"2023-10-08T00:32:47.667944+0000","last_unstale":"2023-10-08T00:32:47.676243+0000","last_undegraded":"2023-10-08T00:32:47.676243+0000","last_fullsized":"2023-10-08T00:32:47.676243+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:06:27.752969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"155'6","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.685092+0000","last_change":"2023-10-08T00:32:46.673358+0000","last_active":"2023-10-08T00:32:47.685092+0000","last_peered":"2023-10-08T00:32:47.685092+0000","last_clean":"2023-10-08T00:32:47.685092+0000","last_became_active":"2023-10-08T00:32:46.672953+0000","last_became_peered":"2023-10-08T00:32:46.672953+0000","last_unstale":"2023-10-08T00:32:47.685092+0000","last_undegraded":"2023-10-08T00:32:47.685092+0000","last_fullsized":"2023-10-08T00:32:47.685092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:26.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678976+0000","last_change":"2023-10-08T00:32:47.674690+0000","last_active":"2023-10-08T00:32:47.678976+0000","last_peered":"2023-10-08T00:32:47.678976+0000","last_clean":"2023-10-08T00:32:47.678976+0000","last_became_active":"2023-10-08T00:32:47.674301+0000","last_became_peered":"2023-10-08T00:32:47.674301+0000","last_unstale":"2023-10-08T00:32:47.678976+0000","last_undegraded":"2023-10-08T00:32:47.678976+0000","last_fullsized":"2023-10-08T00:32:47.678976+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:20.292948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676408+0000","last_change":"2023-10-08T00:32:46.661747+0000","last_active":"2023-10-08T00:32:47.676408+0000","last_peered":"2023-10-08T00:32:47.676408+0000","last_clean":"2023-10-08T00:32:47.676408+0000","last_became_active":"2023-10-08T00:32:46.661498+0000","last_became_peered":"2023-10-08T00:32:46.661498+0000","last_unstale":"2023-10-08T00:32:47.676408+0000","last_undegraded":"2023-10-08T00:32:47.676408+0000","last_fullsized":"2023-10-08T00:32:47.676408+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:38.597474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675464+0000","last_change":"2023-10-08T00:32:47.672139+0000","last_active":"2023-10-08T00:32:47.675464+0000","last_peered":"2023-10-08T00:32:47.675464+0000","last_clean":"2023-10-08T00:32:47.675464+0000","last_became_active":"2023-10-08T00:32:47.671844+0000","last_became_peered":"2023-10-08T00:32:47.671844+0000","last_unstale":"2023-10-08T00:32:47.675464+0000","last_undegraded":"2023-10-08T00:32:47.675464+0000","last_fullsized":"2023-10-08T00:32:47.675464+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:07.611237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.665889+0000","last_change":"2023-10-08T00:32:46.673325+0000","last_active":"2023-10-08T00:32:47.665889+0000","last_peered":"2023-10-08T00:32:47.665889+0000","last_clean":"2023-10-08T00:32:47.665889+0000","last_became_active":"2023-10-08T00:32:46.673034+0000","last_became_peered":"2023-10-08T00:32:46.673034+0000","last_unstale":"2023-10-08T00:32:47.665889+0000","last_undegraded":"2023-10-08T00:32:47.665889+0000","last_fullsized":"2023-10-08T00:32:47.665889+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:44.389446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677904+0000","last_change":"2023-10-08T00:32:47.668678+0000","last_active":"2023-10-08T00:32:47.677904+0000","last_peered":"2023-10-08T00:32:47.677904+0000","last_clean":"2023-10-08T00:32:47.677904+0000","last_became_active":"2023-10-08T00:32:47.666776+0000","last_became_peered":"2023-10-08T00:32:47.666776+0000","last_unstale":"2023-10-08T00:32:47.677904+0000","last_undegraded":"2023-10-08T00:32:47.677904+0000","last_fullsized":"2023-10-08T00:32:47.677904+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:29.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.662066+0000","last_change":"2023-10-08T00:32:46.669108+0000","last_active":"2023-10-08T00:32:47.662066+0000","last_peered":"2023-10-08T00:32:47.662066+0000","last_clean":"2023-10-08T00:32:47.662066+0000","last_became_active":"2023-10-08T00:32:46.668858+0000","last_became_peered":"2023-10-08T00:32:46.668858+0000","last_unstale":"2023-10-08T00:32:47.662066+0000","last_undegraded":"2023-10-08T00:32:47.662066+0000","last_fullsized":"2023-10-08T00:32:47.662066+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:26:49.217424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678016+0000","last_change":"2023-10-08T00:32:47.668851+0000","last_active":"2023-10-08T00:32:47.678016+0000","last_peered":"2023-10-08T00:32:47.678016+0000","last_clean":"2023-10-08T00:32:47.678016+0000","last_became_active":"2023-10-08T00:32:47.667621+0000","last_became_peered":"2023-10-08T00:32:47.667621+0000","last_unstale":"2023-10-08T00:32:47.678016+0000","last_undegraded":"2023-10-08T00:32:47.678016+0000","last_fullsized":"2023-10-08T00:32:47.678016+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:11.179807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"155'8","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681968+0000","last_change":"2023-10-08T00:32:46.672768+0000","last_active":"2023-10-08T00:32:47.681968+0000","last_peered":"2023-10-08T00:32:47.681968+0000","last_clean":"2023-10-08T00:32:47.681968+0000","last_became_active":"2023-10-08T00:32:46.672472+0000","last_became_peered":"2023-10-08T00:32:46.672472+0000","last_unstale":"2023-10-08T00:32:47.681968+0000","last_undegraded":"2023-10-08T00:32:47.681968+0000","last_fullsized":"2023-10-08T00:32:47.681968+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.343375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680684+0000","last_change":"2023-10-08T00:32:47.675428+0000","last_active":"2023-10-08T00:32:47.680684+0000","last_peered":"2023-10-08T00:32:47.680684+0000","last_clean":"2023-10-08T00:32:47.680684+0000","last_became_active":"2023-10-08T00:32:47.675184+0000","last_became_peered":"2023-10-08T00:32:47.675184+0000","last_unstale":"2023-10-08T00:32:47.680684+0000","last_undegraded":"2023-10-08T00:32:47.680684+0000","last_fullsized":"2023-10-08T00:32:47.680684+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:25.580750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.673725+0000","last_change":"2023-10-08T00:32:46.666620+0000","last_active":"2023-10-08T00:32:47.673725+0000","last_peered":"2023-10-08T00:32:47.673725+0000","last_clean":"2023-10-08T00:32:47.673725+0000","last_became_active":"2023-10-08T00:32:46.666196+0000","last_became_peered":"2023-10-08T00:32:46.666196+0000","last_unstale":"2023-10-08T00:32:47.673725+0000","last_undegraded":"2023-10-08T00:32:47.673725+0000","last_fullsized":"2023-10-08T00:32:47.673725+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:14.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681481+0000","last_change":"2023-10-08T00:32:47.674959+0000","last_active":"2023-10-08T00:32:47.681481+0000","last_peered":"2023-10-08T00:32:47.681481+0000","last_clean":"2023-10-08T00:32:47.681481+0000","last_became_active":"2023-10-08T00:32:47.674481+0000","last_became_peered":"2023-10-08T00:32:47.674481+0000","last_unstale":"2023-10-08T00:32:47.681481+0000","last_undegraded":"2023-10-08T00:32:47.681481+0000","last_fullsized":"2023-10-08T00:32:47.681481+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:32.811307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674661+0000","last_change":"2023-10-08T00:32:46.666761+0000","last_active":"2023-10-08T00:32:47.674661+0000","last_peered":"2023-10-08T00:32:47.674661+0000","last_clean":"2023-10-08T00:32:47.674661+0000","last_became_active":"2023-10-08T00:32:46.666465+0000","last_became_peered":"2023-10-08T00:32:46.666465+0000","last_unstale":"2023-10-08T00:32:47.674661+0000","last_undegraded":"2023-10-08T00:32:47.674661+0000","last_fullsized":"2023-10-08T00:32:47.674661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:14:22.612713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675767+0000","last_change":"2023-10-08T00:32:47.668662+0000","last_active":"2023-10-08T00:32:47.675767+0000","last_peered":"2023-10-08T00:32:47.675767+0000","last_clean":"2023-10-08T00:32:47.675767+0000","last_became_active":"2023-10-08T00:32:47.668371+0000","last_became_peered":"2023-10-08T00:32:47.668371+0000","last_unstale":"2023-10-08T00:32:47.675767+0000","last_undegraded":"2023-10-08T00:32:47.675767+0000","last_fullsized":"2023-10-08T00:32:47.675767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681490+0000","last_change":"2023-10-08T00:32:46.669916+0000","last_active":"2023-10-08T00:32:47.681490+0000","last_peered":"2023-10-08T00:32:47.681490+0000","last_clean":"2023-10-08T00:32:47.681490+0000","last_became_active":"2023-10-08T00:32:46.669611+0000","last_became_peered":"2023-10-08T00:32:46.669611+0000","last_unstale":"2023-10-08T00:32:47.681490+0000","last_undegraded":"2023-10-08T00:32:47.681490+0000","last_fullsized":"2023-10-08T00:32:47.681490+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:06.749599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676419+0000","last_change":"2023-10-08T00:32:47.675010+0000","last_active":"2023-10-08T00:32:47.676419+0000","last_peered":"2023-10-08T00:32:47.676419+0000","last_clean":"2023-10-08T00:32:47.676419+0000","last_became_active":"2023-10-08T00:32:47.674706+0000","last_became_peered":"2023-10-08T00:32:47.674706+0000","last_unstale":"2023-10-08T00:32:47.676419+0000","last_undegraded":"2023-10-08T00:32:47.676419+0000","last_fullsized":"2023-10-08T00:32:47.676419+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:32.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.653191+0000","last_change":"2023-10-08T00:32:46.658980+0000","last_active":"2023-10-08T00:32:47.653191+0000","last_peered":"2023-10-08T00:32:47.653191+0000","last_clean":"2023-10-08T00:32:47.653191+0000","last_became_active":"2023-10-08T00:32:46.658689+0000","last_became_peered":"2023-10-08T00:32:46.658689+0000","last_unstale":"2023-10-08T00:32:47.653191+0000","last_undegraded":"2023-10-08T00:32:47.653191+0000","last_fullsized":"2023-10-08T00:32:47.653191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:15.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678107+0000","last_change":"2023-10-08T00:32:47.677333+0000","last_active":"2023-10-08T00:32:47.678107+0000","last_peered":"2023-10-08T00:32:47.678107+0000","last_clean":"2023-10-08T00:32:47.678107+0000","last_became_active":"2023-10-08T00:32:47.676975+0000","last_became_peered":"2023-10-08T00:32:47.676975+0000","last_unstale":"2023-10-08T00:32:47.678107+0000","last_undegraded":"2023-10-08T00:32:47.678107+0000","last_fullsized":"2023-10-08T00:32:47.678107+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:51:56.026359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677342+0000","last_change":"2023-10-08T00:32:46.665966+0000","last_active":"2023-10-08T00:32:47.677342+0000","last_peered":"2023-10-08T00:32:47.677342+0000","last_clean":"2023-10-08T00:32:47.677342+0000","last_became_active":"2023-10-08T00:32:46.665614+0000","last_became_peered":"2023-10-08T00:32:46.665614+0000","last_unstale":"2023-10-08T00:32:47.677342+0000","last_undegraded":"2023-10-08T00:32:47.677342+0000","last_fullsized":"2023-10-08T00:32:47.677342+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:26.179625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664951+0000","last_change":"2023-10-08T00:32:47.660309+0000","last_active":"2023-10-08T00:32:47.664951+0000","last_peered":"2023-10-08T00:32:47.664951+0000","last_clean":"2023-10-08T00:32:47.664951+0000","last_became_active":"2023-10-08T00:32:47.660030+0000","last_became_peered":"2023-10-08T00:32:47.660030+0000","last_unstale":"2023-10-08T00:32:47.664951+0000","last_undegraded":"2023-10-08T00:32:47.664951+0000","last_fullsized":"2023-10-08T00:32:47.664951+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:25.772332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.659392+0000","last_change":"2023-10-08T00:32:46.669868+0000","last_active":"2023-10-08T00:32:47.659392+0000","last_peered":"2023-10-08T00:32:47.659392+0000","last_clean":"2023-10-08T00:32:47.659392+0000","last_became_active":"2023-10-08T00:32:46.669596+0000","last_became_peered":"2023-10-08T00:32:46.669596+0000","last_unstale":"2023-10-08T00:32:47.659392+0000","last_undegraded":"2023-10-08T00:32:47.659392+0000","last_fullsized":"2023-10-08T00:32:47.659392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:44.195189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676873+0000","last_change":"2023-10-08T00:32:47.670312+0000","last_active":"2023-10-08T00:32:47.676873+0000","last_peered":"2023-10-08T00:32:47.676873+0000","last_clean":"2023-10-08T00:32:47.676873+0000","last_became_active":"2023-10-08T00:32:47.670028+0000","last_became_peered":"2023-10-08T00:32:47.670028+0000","last_unstale":"2023-10-08T00:32:47.676873+0000","last_undegraded":"2023-10-08T00:32:47.676873+0000","last_fullsized":"2023-10-08T00:32:47.676873+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:53.204143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.661178+0000","last_change":"2023-10-08T00:32:46.668459+0000","last_active":"2023-10-08T00:32:47.661178+0000","last_peered":"2023-10-08T00:32:47.661178+0000","last_clean":"2023-10-08T00:32:47.661178+0000","last_became_active":"2023-10-08T00:32:46.668192+0000","last_became_peered":"2023-10-08T00:32:46.668192+0000","last_unstale":"2023-10-08T00:32:47.661178+0000","last_undegraded":"2023-10-08T00:32:47.661178+0000","last_fullsized":"2023-10-08T00:32:47.661178+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:09.986581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679451+0000","last_change":"2023-10-08T00:32:47.674686+0000","last_active":"2023-10-08T00:32:47.679451+0000","last_peered":"2023-10-08T00:32:47.679451+0000","last_clean":"2023-10-08T00:32:47.679451+0000","last_became_active":"2023-10-08T00:32:47.674407+0000","last_became_peered":"2023-10-08T00:32:47.674407+0000","last_unstale":"2023-10-08T00:32:47.679451+0000","last_undegraded":"2023-10-08T00:32:47.679451+0000","last_fullsized":"2023-10-08T00:32:47.679451+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:38:32.992484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656616+0000","last_change":"2023-10-08T00:32:46.666705+0000","last_active":"2023-10-08T00:32:47.656616+0000","last_peered":"2023-10-08T00:32:47.656616+0000","last_clean":"2023-10-08T00:32:47.656616+0000","last_became_active":"2023-10-08T00:32:46.666444+0000","last_became_peered":"2023-10-08T00:32:46.666444+0000","last_unstale":"2023-10-08T00:32:47.656616+0000","last_undegraded":"2023-10-08T00:32:47.656616+0000","last_fullsized":"2023-10-08T00:32:47.656616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:52.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677879+0000","last_change":"2023-10-08T00:32:47.673032+0000","last_active":"2023-10-08T00:32:47.677879+0000","last_peered":"2023-10-08T00:32:47.677879+0000","last_clean":"2023-10-08T00:32:47.677879+0000","last_became_active":"2023-10-08T00:32:47.672762+0000","last_became_peered":"2023-10-08T00:32:47.672762+0000","last_unstale":"2023-10-08T00:32:47.677879+0000","last_undegraded":"2023-10-08T00:32:47.677879+0000","last_fullsized":"2023-10-08T00:32:47.677879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:29.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.670219+0000","last_change":"2023-10-08T00:32:46.665574+0000","last_active":"2023-10-08T00:32:47.670219+0000","last_peered":"2023-10-08T00:32:47.670219+0000","last_clean":"2023-10-08T00:32:47.670219+0000","last_became_active":"2023-10-08T00:32:46.665313+0000","last_became_peered":"2023-10-08T00:32:46.665313+0000","last_unstale":"2023-10-08T00:32:47.670219+0000","last_undegraded":"2023-10-08T00:32:47.670219+0000","last_fullsized":"2023-10-08T00:32:47.670219+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:11.060950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674291+0000","last_change":"2023-10-08T00:32:47.666582+0000","last_active":"2023-10-08T00:32:47.674291+0000","last_peered":"2023-10-08T00:32:47.674291+0000","last_clean":"2023-10-08T00:32:47.674291+0000","last_became_active":"2023-10-08T00:32:47.664148+0000","last_became_peered":"2023-10-08T00:32:47.664148+0000","last_unstale":"2023-10-08T00:32:47.674291+0000","last_undegraded":"2023-10-08T00:32:47.674291+0000","last_fullsized":"2023-10-08T00:32:47.674291+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:45.670985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.667504+0000","last_change":"2023-10-08T00:32:46.673272+0000","last_active":"2023-10-08T00:32:47.667504+0000","last_peered":"2023-10-08T00:32:47.667504+0000","last_clean":"2023-10-08T00:32:47.667504+0000","last_became_active":"2023-10-08T00:32:46.672931+0000","last_became_peered":"2023-10-08T00:32:46.672931+0000","last_unstale":"2023-10-08T00:32:47.667504+0000","last_undegraded":"2023-10-08T00:32:47.667504+0000","last_fullsized":"2023-10-08T00:32:47.667504+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:19.290848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.668367+0000","last_change":"2023-10-08T00:32:47.665147+0000","last_active":"2023-10-08T00:32:47.668367+0000","last_peered":"2023-10-08T00:32:47.668367+0000","last_clean":"2023-10-08T00:32:47.668367+0000","last_became_active":"2023-10-08T00:32:47.664772+0000","last_became_peered":"2023-10-08T00:32:47.664772+0000","last_unstale":"2023-10-08T00:32:47.668367+0000","last_undegraded":"2023-10-08T00:32:47.668367+0000","last_fullsized":"2023-10-08T00:32:47.668367+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656185+0000","last_change":"2023-10-08T00:32:46.663359+0000","last_active":"2023-10-08T00:32:47.656185+0000","last_peered":"2023-10-08T00:32:47.656185+0000","last_clean":"2023-10-08T00:32:47.656185+0000","last_became_active":"2023-10-08T00:32:46.663036+0000","last_became_peered":"2023-10-08T00:32:46.663036+0000","last_unstale":"2023-10-08T00:32:47.656185+0000","last_undegraded":"2023-10-08T00:32:47.656185+0000","last_fullsized":"2023-10-08T00:32:47.656185+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:53.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680429+0000","last_change":"2023-10-08T00:32:47.675946+0000","last_active":"2023-10-08T00:32:47.680429+0000","last_peered":"2023-10-08T00:32:47.680429+0000","last_clean":"2023-10-08T00:32:47.680429+0000","last_became_active":"2023-10-08T00:32:47.675675+0000","last_became_peered":"2023-10-08T00:32:47.675675+0000","last_unstale":"2023-10-08T00:32:47.680429+0000","last_undegraded":"2023-10-08T00:32:47.680429+0000","last_fullsized":"2023-10-08T00:32:47.680429+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:48.727986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.653093+0000","last_change":"2023-10-08T00:32:46.668428+0000","last_active":"2023-10-08T00:32:47.653093+0000","last_peered":"2023-10-08T00:32:47.653093+0000","last_clean":"2023-10-08T00:32:47.653093+0000","last_became_active":"2023-10-08T00:32:46.668140+0000","last_became_peered":"2023-10-08T00:32:46.668140+0000","last_unstale":"2023-10-08T00:32:47.653093+0000","last_undegraded":"2023-10-08T00:32:47.653093+0000","last_fullsized":"2023-10-08T00:32:47.653093+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:56.603008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679532+0000","last_change":"2023-10-08T00:32:47.678827+0000","last_active":"2023-10-08T00:32:47.679532+0000","last_peered":"2023-10-08T00:32:47.679532+0000","last_clean":"2023-10-08T00:32:47.679532+0000","last_became_active":"2023-10-08T00:32:47.678481+0000","last_became_peered":"2023-10-08T00:32:47.678481+0000","last_unstale":"2023-10-08T00:32:47.679532+0000","last_undegraded":"2023-10-08T00:32:47.679532+0000","last_fullsized":"2023-10-08T00:32:47.679532+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:29:31.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.667785+0000","last_change":"2023-10-08T00:32:46.673338+0000","last_active":"2023-10-08T00:32:47.667785+0000","last_peered":"2023-10-08T00:32:47.667785+0000","last_clean":"2023-10-08T00:32:47.667785+0000","last_became_active":"2023-10-08T00:32:46.673058+0000","last_became_peered":"2023-10-08T00:32:46.673058+0000","last_unstale":"2023-10-08T00:32:47.667785+0000","last_undegraded":"2023-10-08T00:32:47.667785+0000","last_fullsized":"2023-10-08T00:32:47.667785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:06.943375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679308+0000","last_change":"2023-10-08T00:32:47.675215+0000","last_active":"2023-10-08T00:32:47.679308+0000","last_peered":"2023-10-08T00:32:47.679308+0000","last_clean":"2023-10-08T00:32:47.679308+0000","last_became_active":"2023-10-08T00:32:47.674944+0000","last_became_peered":"2023-10-08T00:32:47.674944+0000","last_unstale":"2023-10-08T00:32:47.679308+0000","last_undegraded":"2023-10-08T00:32:47.679308+0000","last_fullsized":"2023-10-08T00:32:47.679308+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:50.184185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656827+0000","last_change":"2023-10-08T00:32:46.666673+0000","last_active":"2023-10-08T00:32:47.656827+0000","last_peered":"2023-10-08T00:32:47.656827+0000","last_clean":"2023-10-08T00:32:47.656827+0000","last_became_active":"2023-10-08T00:32:46.666395+0000","last_became_peered":"2023-10-08T00:32:46.666395+0000","last_unstale":"2023-10-08T00:32:47.656827+0000","last_undegraded":"2023-10-08T00:32:47.656827+0000","last_fullsized":"2023-10-08T00:32:47.656827+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:08.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677878+0000","last_change":"2023-10-08T00:32:47.667392+0000","last_active":"2023-10-08T00:32:47.677878+0000","last_peered":"2023-10-08T00:32:47.677878+0000","last_clean":"2023-10-08T00:32:47.677878+0000","last_became_active":"2023-10-08T00:32:47.665858+0000","last_became_peered":"2023-10-08T00:32:47.665858+0000","last_unstale":"2023-10-08T00:32:47.677878+0000","last_undegraded":"2023-10-08T00:32:47.677878+0000","last_fullsized":"2023-10-08T00:32:47.677878+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:20.107114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.663320+0000","last_change":"2023-10-08T00:32:46.669479+0000","last_active":"2023-10-08T00:32:47.663320+0000","last_peered":"2023-10-08T00:32:47.663320+0000","last_clean":"2023-10-08T00:32:47.663320+0000","last_became_active":"2023-10-08T00:32:46.668156+0000","last_became_peered":"2023-10-08T00:32:46.668156+0000","last_unstale":"2023-10-08T00:32:47.663320+0000","last_undegraded":"2023-10-08T00:32:47.663320+0000","last_fullsized":"2023-10-08T00:32:47.663320+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:49.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.668394+0000","last_change":"2023-10-08T00:32:47.664897+0000","last_active":"2023-10-08T00:32:47.668394+0000","last_peered":"2023-10-08T00:32:47.668394+0000","last_clean":"2023-10-08T00:32:47.668394+0000","last_became_active":"2023-10-08T00:32:47.664625+0000","last_became_peered":"2023-10-08T00:32:47.664625+0000","last_unstale":"2023-10-08T00:32:47.668394+0000","last_undegraded":"2023-10-08T00:32:47.668394+0000","last_fullsized":"2023-10-08T00:32:47.668394+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:36.545610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.659735+0000","last_change":"2023-10-08T00:32:46.673654+0000","last_active":"2023-10-08T00:32:47.659735+0000","last_peered":"2023-10-08T00:32:47.659735+0000","last_clean":"2023-10-08T00:32:47.659735+0000","last_became_active":"2023-10-08T00:32:46.673382+0000","last_became_peered":"2023-10-08T00:32:46.673382+0000","last_unstale":"2023-10-08T00:32:47.659735+0000","last_undegraded":"2023-10-08T00:32:47.659735+0000","last_fullsized":"2023-10-08T00:32:47.659735+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:35.543510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676146+0000","last_change":"2023-10-08T00:32:47.668384+0000","last_active":"2023-10-08T00:32:47.676146+0000","last_peered":"2023-10-08T00:32:47.676146+0000","last_clean":"2023-10-08T00:32:47.676146+0000","last_became_active":"2023-10-08T00:32:47.667752+0000","last_became_peered":"2023-10-08T00:32:47.667752+0000","last_unstale":"2023-10-08T00:32:47.676146+0000","last_undegraded":"2023-10-08T00:32:47.676146+0000","last_fullsized":"2023-10-08T00:32:47.676146+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:10:26.205684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674657+0000","last_change":"2023-10-08T00:32:46.666389+0000","last_active":"2023-10-08T00:32:47.674657+0000","last_peered":"2023-10-08T00:32:47.674657+0000","last_clean":"2023-10-08T00:32:47.674657+0000","last_became_active":"2023-10-08T00:32:46.666099+0000","last_became_peered":"2023-10-08T00:32:46.666099+0000","last_unstale":"2023-10-08T00:32:47.674657+0000","last_undegraded":"2023-10-08T00:32:47.674657+0000","last_fullsized":"2023-10-08T00:32:47.674657+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:31.809208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":277,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671464+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:47.671464+0000","last_peered":"2023-10-08T00:32:47.671464+0000","last_clean":"2023-10-08T00:32:47.671464+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:47.671464+0000","last_undegraded":"2023-10-08T00:32:47.671464+0000","last_fullsized":"2023-10-08T00:32:47.671464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303904,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067936,"statfs":{"total":96636764160,"available":96325566464,"internally_reserved":0,"allocated":2580480,"data_stored":1477765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.436},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.373},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":886415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.432},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303320,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068520,"statfs":{"total":96636764160,"available":96326164480,"internally_reserved":0,"allocated":1982464,"data_stored":885917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.32900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.375}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.746},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.85099999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574947,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1476319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32100000000000001,"15min":0.35599999999999998},"min":{"1min":0.224,"5min":0.216,"15min":0.216},"max":{"1min":0.50600000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35399999999999998,"15min":0.35899999999999999},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.19900000000000001},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.63700000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35899999999999999,"15min":0.375},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48599999999999999,"5min":0.54700000000000004,"15min":0.58699999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.36699999999999999,"15min":0.39000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.55000000000000004,"15min":0.63100000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.374},"min":{"1min":0.253,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.48099999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40300000000000002,"15min":0.41999999999999998},"min":{"1min":0.30499999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.55700000000000005,"5min":0.60699999999999998,"15min":0.64700000000000002},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60099999999999998,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82299999999999995,"5min":0.92100000000000004,"15min":0.97499999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61299999999999999,"15min":0.622},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77600000000000002,"5min":0.86899999999999999,"15min":1.0369999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45200000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.748,"5min":0.88100000000000001,"15min":1.242},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.621},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81299999999999994,"5min":0.88300000000000001,"15min":0.90600000000000003},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58299999999999996,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.433,"15min":0.41199999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.0800000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71299999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.81599999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.61899999999999999},"min":{"1min":0.41299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.755},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.629},"min":{"1min":0.38100000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.86199999999999999,"5min":0.96199999999999997,"15min":1.1020000000000001},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":885861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.318}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.624}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.68600000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.71499999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303324,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068516,"statfs":{"total":96636764160,"available":96326160384,"internally_reserved":0,"allocated":1986560,"data_stored":886043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.441},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.378}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.621},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69799999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303332,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068508,"statfs":{"total":96636764160,"available":96326152192,"internally_reserved":0,"allocated":1994752,"data_stored":887501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.48799999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.58099999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.63100000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.59699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":886415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.441},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.40999999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47599999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.52400000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.377},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:56.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:32:56.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.479+0000 7f02849cd700 1 Processor -- start 2023-10-08T00:32:56.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.479+0000 7f02849cd700 1 -- start start 2023-10-08T00:32:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f02849cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f02800b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f02849cd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f028015d230 0x7f028015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f02849cd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028015dbd0 con 0x7f02801597f0 2023-10-08T00:32:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f02849cd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02800b2980 con 0x7f028015d230 2023-10-08T00:32:56.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f02849cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02800b11d0 con 0x7f0280159420 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f02801597f0 0x7f02800b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52902/0 (socket says 172.21.15.22:52902) 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027e59c700 1 -- 172.21.15.22:0/2451343104 learned_addr learned my addr 172.21.15.22:0/2451343104 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027ed9d700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f02800b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027f59e700 1 --2- 172.21.15.22:0/2451343104 >> v2:172.21.15.192:3300/0 conn(0x7f028015d230 0x7f028015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027dd9b700 1 -- 172.21.15.22:0/2451343104 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717364154 0 0) 0x7f0268001110 con 0x7f02801597f0 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027dd9b700 1 -- 172.21.15.22:0/2451343104 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c003570 con 0x7f02801597f0 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027f59e700 1 -- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 msgr2=0x7f02800b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027f59e700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f02800b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027dd9b700 1 -- 172.21.15.22:0/2451343104 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1547358095 0 0) 0x7f026c003570 con 0x7f02801597f0 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027f59e700 1 -- 172.21.15.22:0/2451343104 >> v1:172.21.15.22:6789/0 conn(0x7f02801597f0 legacy=0x7f02800b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027f59e700 1 -- 172.21.15.22:0/2451343104 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02800b14b0 con 0x7f028015d230 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027ed9d700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f02800b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027f59e700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028015d690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0270009e60 tx=0x7f0270009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=775271f3ae268f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027dd9b700 1 -- 172.21.15.22:0/2451343104 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000e070 con 0x7f028015d230 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027dd9b700 1 -- 172.21.15.22:0/2451343104 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000b7a0 con 0x7f028015d230 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.481+0000 7f027dd9b700 1 -- 172.21.15.22:0/2451343104 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268001600 con 0x7f028015d230 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 -- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 msgr2=0x7f028015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028015d690 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0270009e60 tx=0x7f0270009780 comp rx=0 tx=0).stop 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 -- 172.21.15.22:0/2451343104 shutdown_connections 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028015d690 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 --2- 172.21.15.22:0/2451343104 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f02800b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 -- 172.21.15.22:0/2451343104 >> 172.21.15.22:0/2451343104 conn(0x7f02800d0660 msgr2=0x7f02800d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:56.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 -- 172.21.15.22:0/2451343104 shutdown_connections 2023-10-08T00:32:56.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.482+0000 7f02849cd700 1 -- 172.21.15.22:0/2451343104 wait complete. 2023-10-08T00:32:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.483+0000 7f02849cd700 1 Processor -- start 2023-10-08T00:32:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.483+0000 7f02849cd700 1 -- start start 2023-10-08T00:32:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f02849cd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f0280069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f02849cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 0x7f028016cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f02849cd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028016d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f02849cd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028016dcc0 con 0x7f02801597f0 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f02849cd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02800c5e60 con 0x7f028015d230 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f02849cd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028016da10 con 0x7f0280159420 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 0x7f028016cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 0x7f028016cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41420/0 (socket says 172.21.15.22:41420) 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 -- 172.21.15.22:0/3381026200 learned_addr learned my addr 172.21.15.22:0/3381026200 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027ed9d700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f0280069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027f59e700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028016d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 -- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 msgr2=0x7f0280069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f0280069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 -- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 msgr2=0x7f028016d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028016d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 -- 172.21.15.22:0/3381026200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278009420 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.484+0000 7f027e59c700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 0x7f028016cf90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f026800cbc0 tx=0x7f0268001450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.485+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268007150 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.485+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02680072b0 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.485+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0270009a20 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.485+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268007670 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.485+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02800c5890 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.486+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028004c3c0 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.486+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0268004a40 con 0x7f02801597f0 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.486+0000 7f0276ffd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0260067320 0x7f02600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.487+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0268084260 con 0x7f02801597f0 2023-10-08T00:32:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.487+0000 7f027ed9d700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0260067320 0x7f02600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.487+0000 7f027ed9d700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0260067320 0x7f02600697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0278009f40 tx=0x7f02780091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:56.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.491+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0268050f70 con 0x7f02801597f0 2023-10-08T00:32:56.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.680+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f028015dbd0 con 0x7f0260067320 2023-10-08T00:32:56.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.689+0000 7f0276ffd700 1 -- 172.21.15.22:0/3381026200 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289611 (secure 0 0 0) 0x7f028015dbd0 con 0x7f0260067320 2023-10-08T00:32:56.693 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0260067320 msgr2=0x7f02600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0260067320 0x7f02600697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0278009f40 tx=0x7f02780091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 msgr2=0x7f028016cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 0x7f028016cf90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f026800cbc0 tx=0x7f0268001450 comp rx=0 tx=0).stop 2023-10-08T00:32:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 shutdown_connections 2023-10-08T00:32:56.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f028015d230 0x7f028016d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0260067320 0x7f02600697d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0280159420 0x7f0280069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 --2- 172.21.15.22:0/3381026200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02801597f0 0x7f028016cf90 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 >> 172.21.15.22:0/3381026200 conn(0x7f02800d0660 msgr2=0x7f0280156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 shutdown_connections 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.691+0000 7f02849cd700 1 -- 172.21.15.22:0/3381026200 wait complete. 2023-10-08T00:32:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:32:56.705 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":395,"stamp":"2023-10-08T00:32:56.497225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427720,"kb_used_data":16648,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547000,"statfs":{"total":773094113280,"available":770608128000,"internally_reserved":0,"allocated":17047552,"data_stored":8272236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.842109"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676494+0000","last_change":"2023-10-08T00:32:47.673182+0000","last_active":"2023-10-08T00:32:47.676494+0000","last_peered":"2023-10-08T00:32:47.676494+0000","last_clean":"2023-10-08T00:32:47.676494+0000","last_became_active":"2023-10-08T00:32:47.672899+0000","last_became_peered":"2023-10-08T00:32:47.672899+0000","last_unstale":"2023-10-08T00:32:47.676494+0000","last_undegraded":"2023-10-08T00:32:47.676494+0000","last_fullsized":"2023-10-08T00:32:47.676494+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:57:58.017608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677028+0000","last_change":"2023-10-08T00:32:47.670723+0000","last_active":"2023-10-08T00:32:47.677028+0000","last_peered":"2023-10-08T00:32:47.677028+0000","last_clean":"2023-10-08T00:32:47.677028+0000","last_became_active":"2023-10-08T00:32:47.669968+0000","last_became_peered":"2023-10-08T00:32:47.669968+0000","last_unstale":"2023-10-08T00:32:47.677028+0000","last_undegraded":"2023-10-08T00:32:47.677028+0000","last_fullsized":"2023-10-08T00:32:47.677028+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:22:22.807501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678858+0000","last_change":"2023-10-08T00:32:47.676860+0000","last_active":"2023-10-08T00:32:47.678858+0000","last_peered":"2023-10-08T00:32:47.678858+0000","last_clean":"2023-10-08T00:32:47.678858+0000","last_became_active":"2023-10-08T00:32:47.676461+0000","last_became_peered":"2023-10-08T00:32:47.676461+0000","last_unstale":"2023-10-08T00:32:47.678858+0000","last_undegraded":"2023-10-08T00:32:47.678858+0000","last_fullsized":"2023-10-08T00:32:47.678858+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:36.068700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679676+0000","last_change":"2023-10-08T00:32:47.678644+0000","last_active":"2023-10-08T00:32:47.679676+0000","last_peered":"2023-10-08T00:32:47.679676+0000","last_clean":"2023-10-08T00:32:47.679676+0000","last_became_active":"2023-10-08T00:32:47.678219+0000","last_became_peered":"2023-10-08T00:32:47.678219+0000","last_unstale":"2023-10-08T00:32:47.679676+0000","last_undegraded":"2023-10-08T00:32:47.679676+0000","last_fullsized":"2023-10-08T00:32:47.679676+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:45.197288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678876+0000","last_change":"2023-10-08T00:32:47.674271+0000","last_active":"2023-10-08T00:32:47.678876+0000","last_peered":"2023-10-08T00:32:47.678876+0000","last_clean":"2023-10-08T00:32:47.678876+0000","last_became_active":"2023-10-08T00:32:47.673950+0000","last_became_peered":"2023-10-08T00:32:47.673950+0000","last_unstale":"2023-10-08T00:32:47.678876+0000","last_undegraded":"2023-10-08T00:32:47.678876+0000","last_fullsized":"2023-10-08T00:32:47.678876+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:22:29.546818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676189+0000","last_change":"2023-10-08T00:32:47.666805+0000","last_active":"2023-10-08T00:32:47.676189+0000","last_peered":"2023-10-08T00:32:47.676189+0000","last_clean":"2023-10-08T00:32:47.676189+0000","last_became_active":"2023-10-08T00:32:47.666564+0000","last_became_peered":"2023-10-08T00:32:47.666564+0000","last_unstale":"2023-10-08T00:32:47.676189+0000","last_undegraded":"2023-10-08T00:32:47.676189+0000","last_fullsized":"2023-10-08T00:32:47.676189+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:26:50.219524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679541+0000","last_change":"2023-10-08T00:32:47.678989+0000","last_active":"2023-10-08T00:32:47.679541+0000","last_peered":"2023-10-08T00:32:47.679541+0000","last_clean":"2023-10-08T00:32:47.679541+0000","last_became_active":"2023-10-08T00:32:47.678689+0000","last_became_peered":"2023-10-08T00:32:47.678689+0000","last_unstale":"2023-10-08T00:32:47.679541+0000","last_undegraded":"2023-10-08T00:32:47.679541+0000","last_fullsized":"2023-10-08T00:32:47.679541+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:50.593389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.669515+0000","last_change":"2023-10-08T00:32:47.662839+0000","last_active":"2023-10-08T00:32:47.669515+0000","last_peered":"2023-10-08T00:32:47.669515+0000","last_clean":"2023-10-08T00:32:47.669515+0000","last_became_active":"2023-10-08T00:32:47.662534+0000","last_became_peered":"2023-10-08T00:32:47.662534+0000","last_unstale":"2023-10-08T00:32:47.669515+0000","last_undegraded":"2023-10-08T00:32:47.669515+0000","last_fullsized":"2023-10-08T00:32:47.669515+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:27.181725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681496+0000","last_change":"2023-10-08T00:32:47.675391+0000","last_active":"2023-10-08T00:32:47.681496+0000","last_peered":"2023-10-08T00:32:47.681496+0000","last_clean":"2023-10-08T00:32:47.681496+0000","last_became_active":"2023-10-08T00:32:47.675080+0000","last_became_peered":"2023-10-08T00:32:47.675080+0000","last_unstale":"2023-10-08T00:32:47.681496+0000","last_undegraded":"2023-10-08T00:32:47.681496+0000","last_fullsized":"2023-10-08T00:32:47.681496+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:25.772332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672492+0000","last_change":"2023-10-08T00:32:47.669951+0000","last_active":"2023-10-08T00:32:47.672492+0000","last_peered":"2023-10-08T00:32:47.672492+0000","last_clean":"2023-10-08T00:32:47.672492+0000","last_became_active":"2023-10-08T00:32:47.669475+0000","last_became_peered":"2023-10-08T00:32:47.669475+0000","last_unstale":"2023-10-08T00:32:47.672492+0000","last_undegraded":"2023-10-08T00:32:47.672492+0000","last_fullsized":"2023-10-08T00:32:47.672492+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:24.745892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675700+0000","last_change":"2023-10-08T00:32:47.666123+0000","last_active":"2023-10-08T00:32:47.675700+0000","last_peered":"2023-10-08T00:32:47.675700+0000","last_clean":"2023-10-08T00:32:47.675700+0000","last_became_active":"2023-10-08T00:32:47.665809+0000","last_became_peered":"2023-10-08T00:32:47.665809+0000","last_unstale":"2023-10-08T00:32:47.675700+0000","last_undegraded":"2023-10-08T00:32:47.675700+0000","last_fullsized":"2023-10-08T00:32:47.675700+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:25.580750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677543+0000","last_change":"2023-10-08T00:32:47.670748+0000","last_active":"2023-10-08T00:32:47.677543+0000","last_peered":"2023-10-08T00:32:47.677543+0000","last_clean":"2023-10-08T00:32:47.677543+0000","last_became_active":"2023-10-08T00:32:47.670489+0000","last_became_peered":"2023-10-08T00:32:47.670489+0000","last_unstale":"2023-10-08T00:32:47.677543+0000","last_undegraded":"2023-10-08T00:32:47.677543+0000","last_fullsized":"2023-10-08T00:32:47.677543+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:45.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674747+0000","last_change":"2023-10-08T00:32:47.665876+0000","last_active":"2023-10-08T00:32:47.674747+0000","last_peered":"2023-10-08T00:32:47.674747+0000","last_clean":"2023-10-08T00:32:47.674747+0000","last_became_active":"2023-10-08T00:32:47.665401+0000","last_became_peered":"2023-10-08T00:32:47.665401+0000","last_unstale":"2023-10-08T00:32:47.674747+0000","last_undegraded":"2023-10-08T00:32:47.674747+0000","last_fullsized":"2023-10-08T00:32:47.674747+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:11.916937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676167+0000","last_change":"2023-10-08T00:32:47.668418+0000","last_active":"2023-10-08T00:32:47.676167+0000","last_peered":"2023-10-08T00:32:47.676167+0000","last_clean":"2023-10-08T00:32:47.676167+0000","last_became_active":"2023-10-08T00:32:47.668119+0000","last_became_peered":"2023-10-08T00:32:47.668119+0000","last_unstale":"2023-10-08T00:32:47.676167+0000","last_undegraded":"2023-10-08T00:32:47.676167+0000","last_fullsized":"2023-10-08T00:32:47.676167+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:19:42.649976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674319+0000","last_change":"2023-10-08T00:32:47.665743+0000","last_active":"2023-10-08T00:32:47.674319+0000","last_peered":"2023-10-08T00:32:47.674319+0000","last_clean":"2023-10-08T00:32:47.674319+0000","last_became_active":"2023-10-08T00:32:47.665441+0000","last_became_peered":"2023-10-08T00:32:47.665441+0000","last_unstale":"2023-10-08T00:32:47.674319+0000","last_undegraded":"2023-10-08T00:32:47.674319+0000","last_fullsized":"2023-10-08T00:32:47.674319+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:32.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679309+0000","last_change":"2023-10-08T00:32:47.678439+0000","last_active":"2023-10-08T00:32:47.679309+0000","last_peered":"2023-10-08T00:32:47.679309+0000","last_clean":"2023-10-08T00:32:47.679309+0000","last_became_active":"2023-10-08T00:32:47.678174+0000","last_became_peered":"2023-10-08T00:32:47.678174+0000","last_unstale":"2023-10-08T00:32:47.679309+0000","last_undegraded":"2023-10-08T00:32:47.679309+0000","last_fullsized":"2023-10-08T00:32:47.679309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:12:48.052333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676476+0000","last_change":"2023-10-08T00:32:47.673001+0000","last_active":"2023-10-08T00:32:47.676476+0000","last_peered":"2023-10-08T00:32:47.676476+0000","last_clean":"2023-10-08T00:32:47.676476+0000","last_became_active":"2023-10-08T00:32:47.672726+0000","last_became_peered":"2023-10-08T00:32:47.672726+0000","last_unstale":"2023-10-08T00:32:47.676476+0000","last_undegraded":"2023-10-08T00:32:47.676476+0000","last_fullsized":"2023-10-08T00:32:47.676476+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:27.005109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672459+0000","last_change":"2023-10-08T00:32:47.669731+0000","last_active":"2023-10-08T00:32:47.672459+0000","last_peered":"2023-10-08T00:32:47.672459+0000","last_clean":"2023-10-08T00:32:47.672459+0000","last_became_active":"2023-10-08T00:32:47.669154+0000","last_became_peered":"2023-10-08T00:32:47.669154+0000","last_unstale":"2023-10-08T00:32:47.672459+0000","last_undegraded":"2023-10-08T00:32:47.672459+0000","last_fullsized":"2023-10-08T00:32:47.672459+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:41.438719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678843+0000","last_change":"2023-10-08T00:32:47.677672+0000","last_active":"2023-10-08T00:32:47.678843+0000","last_peered":"2023-10-08T00:32:47.678843+0000","last_clean":"2023-10-08T00:32:47.678843+0000","last_became_active":"2023-10-08T00:32:47.677421+0000","last_became_peered":"2023-10-08T00:32:47.677421+0000","last_unstale":"2023-10-08T00:32:47.678843+0000","last_undegraded":"2023-10-08T00:32:47.678843+0000","last_fullsized":"2023-10-08T00:32:47.678843+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:34:47.142806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678952+0000","last_change":"2023-10-08T00:32:47.674575+0000","last_active":"2023-10-08T00:32:47.678952+0000","last_peered":"2023-10-08T00:32:47.678952+0000","last_clean":"2023-10-08T00:32:47.678952+0000","last_became_active":"2023-10-08T00:32:47.673996+0000","last_became_peered":"2023-10-08T00:32:47.673996+0000","last_unstale":"2023-10-08T00:32:47.678952+0000","last_undegraded":"2023-10-08T00:32:47.678952+0000","last_fullsized":"2023-10-08T00:32:47.678952+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:29:11.031610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.682874+0000","last_change":"2023-10-08T00:32:47.681066+0000","last_active":"2023-10-08T00:32:47.682874+0000","last_peered":"2023-10-08T00:32:47.682874+0000","last_clean":"2023-10-08T00:32:47.682874+0000","last_became_active":"2023-10-08T00:32:47.680781+0000","last_became_peered":"2023-10-08T00:32:47.680781+0000","last_unstale":"2023-10-08T00:32:47.682874+0000","last_undegraded":"2023-10-08T00:32:47.682874+0000","last_fullsized":"2023-10-08T00:32:47.682874+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:35:41.438719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680563+0000","last_change":"2023-10-08T00:32:47.675995+0000","last_active":"2023-10-08T00:32:47.680563+0000","last_peered":"2023-10-08T00:32:47.680563+0000","last_clean":"2023-10-08T00:32:47.680563+0000","last_became_active":"2023-10-08T00:32:47.675639+0000","last_became_peered":"2023-10-08T00:32:47.675639+0000","last_unstale":"2023-10-08T00:32:47.680563+0000","last_undegraded":"2023-10-08T00:32:47.680563+0000","last_fullsized":"2023-10-08T00:32:47.680563+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:53:58.411629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.672619+0000","last_change":"2023-10-08T00:32:47.666851+0000","last_active":"2023-10-08T00:32:47.672619+0000","last_peered":"2023-10-08T00:32:47.672619+0000","last_clean":"2023-10-08T00:32:47.672619+0000","last_became_active":"2023-10-08T00:32:47.666588+0000","last_became_peered":"2023-10-08T00:32:47.666588+0000","last_unstale":"2023-10-08T00:32:47.672619+0000","last_undegraded":"2023-10-08T00:32:47.672619+0000","last_fullsized":"2023-10-08T00:32:47.672619+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:38:00.592794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.682902+0000","last_change":"2023-10-08T00:32:47.681757+0000","last_active":"2023-10-08T00:32:47.682902+0000","last_peered":"2023-10-08T00:32:47.682902+0000","last_clean":"2023-10-08T00:32:47.682902+0000","last_became_active":"2023-10-08T00:32:47.681506+0000","last_became_peered":"2023-10-08T00:32:47.681506+0000","last_unstale":"2023-10-08T00:32:47.682902+0000","last_undegraded":"2023-10-08T00:32:47.682902+0000","last_fullsized":"2023-10-08T00:32:47.682902+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:07.611237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681469+0000","last_change":"2023-10-08T00:32:47.674823+0000","last_active":"2023-10-08T00:32:47.681469+0000","last_peered":"2023-10-08T00:32:47.681469+0000","last_clean":"2023-10-08T00:32:47.681469+0000","last_became_active":"2023-10-08T00:32:47.674534+0000","last_became_peered":"2023-10-08T00:32:47.674534+0000","last_unstale":"2023-10-08T00:32:47.681469+0000","last_undegraded":"2023-10-08T00:32:47.681469+0000","last_fullsized":"2023-10-08T00:32:47.681469+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:06:06.915592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679485+0000","last_change":"2023-10-08T00:32:47.678551+0000","last_active":"2023-10-08T00:32:47.679485+0000","last_peered":"2023-10-08T00:32:47.679485+0000","last_clean":"2023-10-08T00:32:47.679485+0000","last_became_active":"2023-10-08T00:32:47.677776+0000","last_became_peered":"2023-10-08T00:32:47.677776+0000","last_unstale":"2023-10-08T00:32:47.679485+0000","last_undegraded":"2023-10-08T00:32:47.679485+0000","last_fullsized":"2023-10-08T00:32:47.679485+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:57:21.542182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677521+0000","last_change":"2023-10-08T00:32:47.670266+0000","last_active":"2023-10-08T00:32:47.677521+0000","last_peered":"2023-10-08T00:32:47.677521+0000","last_clean":"2023-10-08T00:32:47.677521+0000","last_became_active":"2023-10-08T00:32:47.669986+0000","last_became_peered":"2023-10-08T00:32:47.669986+0000","last_unstale":"2023-10-08T00:32:47.677521+0000","last_undegraded":"2023-10-08T00:32:47.677521+0000","last_fullsized":"2023-10-08T00:32:47.677521+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:36.068700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664917+0000","last_change":"2023-10-08T00:32:47.660359+0000","last_active":"2023-10-08T00:32:47.664917+0000","last_peered":"2023-10-08T00:32:47.664917+0000","last_clean":"2023-10-08T00:32:47.664917+0000","last_became_active":"2023-10-08T00:32:47.660082+0000","last_became_peered":"2023-10-08T00:32:47.660082+0000","last_unstale":"2023-10-08T00:32:47.664917+0000","last_undegraded":"2023-10-08T00:32:47.664917+0000","last_fullsized":"2023-10-08T00:32:47.664917+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:57:17.568726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679328+0000","last_change":"2023-10-08T00:32:47.676054+0000","last_active":"2023-10-08T00:32:47.679328+0000","last_peered":"2023-10-08T00:32:47.679328+0000","last_clean":"2023-10-08T00:32:47.679328+0000","last_became_active":"2023-10-08T00:32:47.675780+0000","last_became_peered":"2023-10-08T00:32:47.675780+0000","last_unstale":"2023-10-08T00:32:47.679328+0000","last_undegraded":"2023-10-08T00:32:47.679328+0000","last_fullsized":"2023-10-08T00:32:47.679328+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671536+0000","last_change":"2023-10-08T00:32:47.667554+0000","last_active":"2023-10-08T00:32:47.671536+0000","last_peered":"2023-10-08T00:32:47.671536+0000","last_clean":"2023-10-08T00:32:47.671536+0000","last_became_active":"2023-10-08T00:32:47.667300+0000","last_became_peered":"2023-10-08T00:32:47.667300+0000","last_unstale":"2023-10-08T00:32:47.671536+0000","last_undegraded":"2023-10-08T00:32:47.671536+0000","last_fullsized":"2023-10-08T00:32:47.671536+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:57:17.568726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676079+0000","last_change":"2023-10-08T00:32:47.674990+0000","last_active":"2023-10-08T00:32:47.676079+0000","last_peered":"2023-10-08T00:32:47.676079+0000","last_clean":"2023-10-08T00:32:47.676079+0000","last_became_active":"2023-10-08T00:32:47.674679+0000","last_became_peered":"2023-10-08T00:32:47.674679+0000","last_unstale":"2023-10-08T00:32:47.676079+0000","last_undegraded":"2023-10-08T00:32:47.676079+0000","last_fullsized":"2023-10-08T00:32:47.676079+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:34:36.484411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676190+0000","last_change":"2023-10-08T00:32:47.670319+0000","last_active":"2023-10-08T00:32:47.676190+0000","last_peered":"2023-10-08T00:32:47.676190+0000","last_clean":"2023-10-08T00:32:47.676190+0000","last_became_active":"2023-10-08T00:32:47.670034+0000","last_became_peered":"2023-10-08T00:32:47.670034+0000","last_unstale":"2023-10-08T00:32:47.676190+0000","last_undegraded":"2023-10-08T00:32:47.676190+0000","last_fullsized":"2023-10-08T00:32:47.676190+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:34:42.095366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671248+0000","last_change":"2023-10-08T00:32:47.666939+0000","last_active":"2023-10-08T00:32:47.671248+0000","last_peered":"2023-10-08T00:32:47.671248+0000","last_clean":"2023-10-08T00:32:47.671248+0000","last_became_active":"2023-10-08T00:32:47.666679+0000","last_became_peered":"2023-10-08T00:32:47.666679+0000","last_unstale":"2023-10-08T00:32:47.671248+0000","last_undegraded":"2023-10-08T00:32:47.671248+0000","last_fullsized":"2023-10-08T00:32:47.671248+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:20.107114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"155'4","reported_seq":14,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671843+0000","last_change":"2023-10-08T00:32:46.669290+0000","last_active":"2023-10-08T00:32:47.671843+0000","last_peered":"2023-10-08T00:32:47.671843+0000","last_clean":"2023-10-08T00:32:47.671843+0000","last_became_active":"2023-10-08T00:32:46.668820+0000","last_became_peered":"2023-10-08T00:32:46.668820+0000","last_unstale":"2023-10-08T00:32:47.671843+0000","last_undegraded":"2023-10-08T00:32:47.671843+0000","last_fullsized":"2023-10-08T00:32:47.671843+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:13:07.806373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680699+0000","last_change":"2023-10-08T00:32:47.678249+0000","last_active":"2023-10-08T00:32:47.680699+0000","last_peered":"2023-10-08T00:32:47.680699+0000","last_clean":"2023-10-08T00:32:47.680699+0000","last_became_active":"2023-10-08T00:32:47.677970+0000","last_became_peered":"2023-10-08T00:32:47.677970+0000","last_unstale":"2023-10-08T00:32:47.680699+0000","last_undegraded":"2023-10-08T00:32:47.680699+0000","last_fullsized":"2023-10-08T00:32:47.680699+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:05:09.891245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674951+0000","last_change":"2023-10-08T00:32:46.670932+0000","last_active":"2023-10-08T00:32:47.674951+0000","last_peered":"2023-10-08T00:32:47.674951+0000","last_clean":"2023-10-08T00:32:47.674951+0000","last_became_active":"2023-10-08T00:32:46.670640+0000","last_became_peered":"2023-10-08T00:32:46.670640+0000","last_unstale":"2023-10-08T00:32:47.674951+0000","last_undegraded":"2023-10-08T00:32:47.674951+0000","last_fullsized":"2023-10-08T00:32:47.674951+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:56.603008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678724+0000","last_change":"2023-10-08T00:32:47.677896+0000","last_active":"2023-10-08T00:32:47.678724+0000","last_peered":"2023-10-08T00:32:47.678724+0000","last_clean":"2023-10-08T00:32:47.678724+0000","last_became_active":"2023-10-08T00:32:47.677600+0000","last_became_peered":"2023-10-08T00:32:47.677600+0000","last_unstale":"2023-10-08T00:32:47.678724+0000","last_undegraded":"2023-10-08T00:32:47.678724+0000","last_fullsized":"2023-10-08T00:32:47.678724+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:27.383345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676712+0000","last_change":"2023-10-08T00:32:46.672799+0000","last_active":"2023-10-08T00:32:47.676712+0000","last_peered":"2023-10-08T00:32:47.676712+0000","last_clean":"2023-10-08T00:32:47.676712+0000","last_became_active":"2023-10-08T00:32:46.672492+0000","last_became_peered":"2023-10-08T00:32:46.672492+0000","last_unstale":"2023-10-08T00:32:47.676712+0000","last_undegraded":"2023-10-08T00:32:47.676712+0000","last_fullsized":"2023-10-08T00:32:47.676712+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:13:09.589145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676392+0000","last_change":"2023-10-08T00:32:47.674304+0000","last_active":"2023-10-08T00:32:47.676392+0000","last_peered":"2023-10-08T00:32:47.676392+0000","last_clean":"2023-10-08T00:32:47.676392+0000","last_became_active":"2023-10-08T00:32:47.674042+0000","last_became_peered":"2023-10-08T00:32:47.674042+0000","last_unstale":"2023-10-08T00:32:47.676392+0000","last_undegraded":"2023-10-08T00:32:47.676392+0000","last_fullsized":"2023-10-08T00:32:47.676392+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:18:28.129137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677187+0000","last_change":"2023-10-08T00:32:46.673978+0000","last_active":"2023-10-08T00:32:47.677187+0000","last_peered":"2023-10-08T00:32:47.677187+0000","last_clean":"2023-10-08T00:32:47.677187+0000","last_became_active":"2023-10-08T00:32:46.673703+0000","last_became_peered":"2023-10-08T00:32:46.673703+0000","last_unstale":"2023-10-08T00:32:47.677187+0000","last_undegraded":"2023-10-08T00:32:47.677187+0000","last_fullsized":"2023-10-08T00:32:47.677187+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:31:01.301020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679652+0000","last_change":"2023-10-08T00:32:47.678424+0000","last_active":"2023-10-08T00:32:47.679652+0000","last_peered":"2023-10-08T00:32:47.679652+0000","last_clean":"2023-10-08T00:32:47.679652+0000","last_became_active":"2023-10-08T00:32:47.678161+0000","last_became_peered":"2023-10-08T00:32:47.678161+0000","last_unstale":"2023-10-08T00:32:47.679652+0000","last_undegraded":"2023-10-08T00:32:47.679652+0000","last_fullsized":"2023-10-08T00:32:47.679652+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:10.988680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674522+0000","last_change":"2023-10-08T00:32:46.663730+0000","last_active":"2023-10-08T00:32:47.674522+0000","last_peered":"2023-10-08T00:32:47.674522+0000","last_clean":"2023-10-08T00:32:47.674522+0000","last_became_active":"2023-10-08T00:32:46.663100+0000","last_became_peered":"2023-10-08T00:32:46.663100+0000","last_unstale":"2023-10-08T00:32:47.674522+0000","last_undegraded":"2023-10-08T00:32:47.674522+0000","last_fullsized":"2023-10-08T00:32:47.674522+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:16:14.361359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679051+0000","last_change":"2023-10-08T00:32:47.674704+0000","last_active":"2023-10-08T00:32:47.679051+0000","last_peered":"2023-10-08T00:32:47.679051+0000","last_clean":"2023-10-08T00:32:47.679051+0000","last_became_active":"2023-10-08T00:32:47.674450+0000","last_became_peered":"2023-10-08T00:32:47.674450+0000","last_unstale":"2023-10-08T00:32:47.679051+0000","last_undegraded":"2023-10-08T00:32:47.679051+0000","last_fullsized":"2023-10-08T00:32:47.679051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:07.751699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.655966+0000","last_change":"2023-10-08T00:32:46.660631+0000","last_active":"2023-10-08T00:32:47.655966+0000","last_peered":"2023-10-08T00:32:47.655966+0000","last_clean":"2023-10-08T00:32:47.655966+0000","last_became_active":"2023-10-08T00:32:46.660477+0000","last_became_peered":"2023-10-08T00:32:46.660477+0000","last_unstale":"2023-10-08T00:32:47.655966+0000","last_undegraded":"2023-10-08T00:32:47.655966+0000","last_fullsized":"2023-10-08T00:32:47.655966+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:45.540813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679685+0000","last_change":"2023-10-08T00:32:47.678875+0000","last_active":"2023-10-08T00:32:47.679685+0000","last_peered":"2023-10-08T00:32:47.679685+0000","last_clean":"2023-10-08T00:32:47.679685+0000","last_became_active":"2023-10-08T00:32:47.678663+0000","last_became_peered":"2023-10-08T00:32:47.678663+0000","last_unstale":"2023-10-08T00:32:47.679685+0000","last_undegraded":"2023-10-08T00:32:47.679685+0000","last_fullsized":"2023-10-08T00:32:47.679685+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:25.298048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664874+0000","last_change":"2023-10-08T00:32:46.665849+0000","last_active":"2023-10-08T00:32:47.664874+0000","last_peered":"2023-10-08T00:32:47.664874+0000","last_clean":"2023-10-08T00:32:47.664874+0000","last_became_active":"2023-10-08T00:32:46.665568+0000","last_became_peered":"2023-10-08T00:32:46.665568+0000","last_unstale":"2023-10-08T00:32:47.664874+0000","last_undegraded":"2023-10-08T00:32:47.664874+0000","last_fullsized":"2023-10-08T00:32:47.664874+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:35:35.066601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.684642+0000","last_change":"2023-10-08T00:32:47.682353+0000","last_active":"2023-10-08T00:32:47.684642+0000","last_peered":"2023-10-08T00:32:47.684642+0000","last_clean":"2023-10-08T00:32:47.684642+0000","last_became_active":"2023-10-08T00:32:47.682103+0000","last_became_peered":"2023-10-08T00:32:47.682103+0000","last_unstale":"2023-10-08T00:32:47.684642+0000","last_undegraded":"2023-10-08T00:32:47.684642+0000","last_fullsized":"2023-10-08T00:32:47.684642+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:41:47.578512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656019+0000","last_change":"2023-10-08T00:32:46.666432+0000","last_active":"2023-10-08T00:32:47.656019+0000","last_peered":"2023-10-08T00:32:47.656019+0000","last_clean":"2023-10-08T00:32:47.656019+0000","last_became_active":"2023-10-08T00:32:46.665868+0000","last_became_peered":"2023-10-08T00:32:46.665868+0000","last_unstale":"2023-10-08T00:32:47.656019+0000","last_undegraded":"2023-10-08T00:32:47.656019+0000","last_fullsized":"2023-10-08T00:32:47.656019+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:38:25.718629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676442+0000","last_change":"2023-10-08T00:32:47.667181+0000","last_active":"2023-10-08T00:32:47.676442+0000","last_peered":"2023-10-08T00:32:47.676442+0000","last_clean":"2023-10-08T00:32:47.676442+0000","last_became_active":"2023-10-08T00:32:47.666894+0000","last_became_peered":"2023-10-08T00:32:47.666894+0000","last_unstale":"2023-10-08T00:32:47.676442+0000","last_undegraded":"2023-10-08T00:32:47.676442+0000","last_fullsized":"2023-10-08T00:32:47.676442+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:45.391546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664665+0000","last_change":"2023-10-08T00:32:46.668790+0000","last_active":"2023-10-08T00:32:47.664665+0000","last_peered":"2023-10-08T00:32:47.664665+0000","last_clean":"2023-10-08T00:32:47.664665+0000","last_became_active":"2023-10-08T00:32:46.668522+0000","last_became_peered":"2023-10-08T00:32:46.668522+0000","last_unstale":"2023-10-08T00:32:47.664665+0000","last_undegraded":"2023-10-08T00:32:47.664665+0000","last_fullsized":"2023-10-08T00:32:47.664665+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:26:10.914838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679658+0000","last_change":"2023-10-08T00:32:47.678479+0000","last_active":"2023-10-08T00:32:47.679658+0000","last_peered":"2023-10-08T00:32:47.679658+0000","last_clean":"2023-10-08T00:32:47.679658+0000","last_became_active":"2023-10-08T00:32:47.678000+0000","last_became_peered":"2023-10-08T00:32:47.678000+0000","last_unstale":"2023-10-08T00:32:47.679658+0000","last_undegraded":"2023-10-08T00:32:47.679658+0000","last_fullsized":"2023-10-08T00:32:47.679658+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:32:44.947907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"155'3","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677130+0000","last_change":"2023-10-08T00:32:46.673405+0000","last_active":"2023-10-08T00:32:47.677130+0000","last_peered":"2023-10-08T00:32:47.677130+0000","last_clean":"2023-10-08T00:32:47.677130+0000","last_became_active":"2023-10-08T00:32:46.673098+0000","last_became_peered":"2023-10-08T00:32:46.673098+0000","last_unstale":"2023-10-08T00:32:47.677130+0000","last_undegraded":"2023-10-08T00:32:47.677130+0000","last_fullsized":"2023-10-08T00:32:47.677130+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:29:10.029510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676243+0000","last_change":"2023-10-08T00:32:47.668213+0000","last_active":"2023-10-08T00:32:47.676243+0000","last_peered":"2023-10-08T00:32:47.676243+0000","last_clean":"2023-10-08T00:32:47.676243+0000","last_became_active":"2023-10-08T00:32:47.667944+0000","last_became_peered":"2023-10-08T00:32:47.667944+0000","last_unstale":"2023-10-08T00:32:47.676243+0000","last_undegraded":"2023-10-08T00:32:47.676243+0000","last_fullsized":"2023-10-08T00:32:47.676243+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:06:27.752969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"155'6","reported_seq":16,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.685092+0000","last_change":"2023-10-08T00:32:46.673358+0000","last_active":"2023-10-08T00:32:47.685092+0000","last_peered":"2023-10-08T00:32:47.685092+0000","last_clean":"2023-10-08T00:32:47.685092+0000","last_became_active":"2023-10-08T00:32:46.672953+0000","last_became_peered":"2023-10-08T00:32:46.672953+0000","last_unstale":"2023-10-08T00:32:47.685092+0000","last_undegraded":"2023-10-08T00:32:47.685092+0000","last_fullsized":"2023-10-08T00:32:47.685092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:07:26.335179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678976+0000","last_change":"2023-10-08T00:32:47.674690+0000","last_active":"2023-10-08T00:32:47.678976+0000","last_peered":"2023-10-08T00:32:47.678976+0000","last_clean":"2023-10-08T00:32:47.678976+0000","last_became_active":"2023-10-08T00:32:47.674301+0000","last_became_peered":"2023-10-08T00:32:47.674301+0000","last_unstale":"2023-10-08T00:32:47.678976+0000","last_undegraded":"2023-10-08T00:32:47.678976+0000","last_fullsized":"2023-10-08T00:32:47.678976+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:20.292948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676408+0000","last_change":"2023-10-08T00:32:46.661747+0000","last_active":"2023-10-08T00:32:47.676408+0000","last_peered":"2023-10-08T00:32:47.676408+0000","last_clean":"2023-10-08T00:32:47.676408+0000","last_became_active":"2023-10-08T00:32:46.661498+0000","last_became_peered":"2023-10-08T00:32:46.661498+0000","last_unstale":"2023-10-08T00:32:47.676408+0000","last_undegraded":"2023-10-08T00:32:47.676408+0000","last_fullsized":"2023-10-08T00:32:47.676408+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:38.597474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675464+0000","last_change":"2023-10-08T00:32:47.672139+0000","last_active":"2023-10-08T00:32:47.675464+0000","last_peered":"2023-10-08T00:32:47.675464+0000","last_clean":"2023-10-08T00:32:47.675464+0000","last_became_active":"2023-10-08T00:32:47.671844+0000","last_became_peered":"2023-10-08T00:32:47.671844+0000","last_unstale":"2023-10-08T00:32:47.675464+0000","last_undegraded":"2023-10-08T00:32:47.675464+0000","last_fullsized":"2023-10-08T00:32:47.675464+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:07.611237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.665889+0000","last_change":"2023-10-08T00:32:46.673325+0000","last_active":"2023-10-08T00:32:47.665889+0000","last_peered":"2023-10-08T00:32:47.665889+0000","last_clean":"2023-10-08T00:32:47.665889+0000","last_became_active":"2023-10-08T00:32:46.673034+0000","last_became_peered":"2023-10-08T00:32:46.673034+0000","last_unstale":"2023-10-08T00:32:47.665889+0000","last_undegraded":"2023-10-08T00:32:47.665889+0000","last_fullsized":"2023-10-08T00:32:47.665889+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:44:44.389446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677904+0000","last_change":"2023-10-08T00:32:47.668678+0000","last_active":"2023-10-08T00:32:47.677904+0000","last_peered":"2023-10-08T00:32:47.677904+0000","last_clean":"2023-10-08T00:32:47.677904+0000","last_became_active":"2023-10-08T00:32:47.666776+0000","last_became_peered":"2023-10-08T00:32:47.666776+0000","last_unstale":"2023-10-08T00:32:47.677904+0000","last_undegraded":"2023-10-08T00:32:47.677904+0000","last_fullsized":"2023-10-08T00:32:47.677904+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:29.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.662066+0000","last_change":"2023-10-08T00:32:46.669108+0000","last_active":"2023-10-08T00:32:47.662066+0000","last_peered":"2023-10-08T00:32:47.662066+0000","last_clean":"2023-10-08T00:32:47.662066+0000","last_became_active":"2023-10-08T00:32:46.668858+0000","last_became_peered":"2023-10-08T00:32:46.668858+0000","last_unstale":"2023-10-08T00:32:47.662066+0000","last_undegraded":"2023-10-08T00:32:47.662066+0000","last_fullsized":"2023-10-08T00:32:47.662066+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:26:49.217424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678016+0000","last_change":"2023-10-08T00:32:47.668851+0000","last_active":"2023-10-08T00:32:47.678016+0000","last_peered":"2023-10-08T00:32:47.678016+0000","last_clean":"2023-10-08T00:32:47.678016+0000","last_became_active":"2023-10-08T00:32:47.667621+0000","last_became_peered":"2023-10-08T00:32:47.667621+0000","last_unstale":"2023-10-08T00:32:47.678016+0000","last_undegraded":"2023-10-08T00:32:47.678016+0000","last_fullsized":"2023-10-08T00:32:47.678016+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:11.179807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"155'8","reported_seq":18,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681968+0000","last_change":"2023-10-08T00:32:46.672768+0000","last_active":"2023-10-08T00:32:47.681968+0000","last_peered":"2023-10-08T00:32:47.681968+0000","last_clean":"2023-10-08T00:32:47.681968+0000","last_became_active":"2023-10-08T00:32:46.672472+0000","last_became_peered":"2023-10-08T00:32:46.672472+0000","last_unstale":"2023-10-08T00:32:47.681968+0000","last_undegraded":"2023-10-08T00:32:47.681968+0000","last_fullsized":"2023-10-08T00:32:47.681968+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:05:36.343375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680684+0000","last_change":"2023-10-08T00:32:47.675428+0000","last_active":"2023-10-08T00:32:47.680684+0000","last_peered":"2023-10-08T00:32:47.680684+0000","last_clean":"2023-10-08T00:32:47.680684+0000","last_became_active":"2023-10-08T00:32:47.675184+0000","last_became_peered":"2023-10-08T00:32:47.675184+0000","last_unstale":"2023-10-08T00:32:47.680684+0000","last_undegraded":"2023-10-08T00:32:47.680684+0000","last_fullsized":"2023-10-08T00:32:47.680684+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:25.580750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.673725+0000","last_change":"2023-10-08T00:32:46.666620+0000","last_active":"2023-10-08T00:32:47.673725+0000","last_peered":"2023-10-08T00:32:47.673725+0000","last_clean":"2023-10-08T00:32:47.673725+0000","last_became_active":"2023-10-08T00:32:46.666196+0000","last_became_peered":"2023-10-08T00:32:46.666196+0000","last_unstale":"2023-10-08T00:32:47.673725+0000","last_undegraded":"2023-10-08T00:32:47.673725+0000","last_fullsized":"2023-10-08T00:32:47.673725+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:11:14.615992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681481+0000","last_change":"2023-10-08T00:32:47.674959+0000","last_active":"2023-10-08T00:32:47.681481+0000","last_peered":"2023-10-08T00:32:47.681481+0000","last_clean":"2023-10-08T00:32:47.681481+0000","last_became_active":"2023-10-08T00:32:47.674481+0000","last_became_peered":"2023-10-08T00:32:47.674481+0000","last_unstale":"2023-10-08T00:32:47.681481+0000","last_undegraded":"2023-10-08T00:32:47.681481+0000","last_fullsized":"2023-10-08T00:32:47.681481+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:32.811307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674661+0000","last_change":"2023-10-08T00:32:46.666761+0000","last_active":"2023-10-08T00:32:47.674661+0000","last_peered":"2023-10-08T00:32:47.674661+0000","last_clean":"2023-10-08T00:32:47.674661+0000","last_became_active":"2023-10-08T00:32:46.666465+0000","last_became_peered":"2023-10-08T00:32:46.666465+0000","last_unstale":"2023-10-08T00:32:47.674661+0000","last_undegraded":"2023-10-08T00:32:47.674661+0000","last_fullsized":"2023-10-08T00:32:47.674661+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:14:22.612713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.675767+0000","last_change":"2023-10-08T00:32:47.668662+0000","last_active":"2023-10-08T00:32:47.675767+0000","last_peered":"2023-10-08T00:32:47.675767+0000","last_clean":"2023-10-08T00:32:47.675767+0000","last_became_active":"2023-10-08T00:32:47.668371+0000","last_became_peered":"2023-10-08T00:32:47.668371+0000","last_unstale":"2023-10-08T00:32:47.675767+0000","last_undegraded":"2023-10-08T00:32:47.675767+0000","last_fullsized":"2023-10-08T00:32:47.675767+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.681490+0000","last_change":"2023-10-08T00:32:46.669916+0000","last_active":"2023-10-08T00:32:47.681490+0000","last_peered":"2023-10-08T00:32:47.681490+0000","last_clean":"2023-10-08T00:32:47.681490+0000","last_became_active":"2023-10-08T00:32:46.669611+0000","last_became_peered":"2023-10-08T00:32:46.669611+0000","last_unstale":"2023-10-08T00:32:47.681490+0000","last_undegraded":"2023-10-08T00:32:47.681490+0000","last_fullsized":"2023-10-08T00:32:47.681490+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:06.749599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676419+0000","last_change":"2023-10-08T00:32:47.675010+0000","last_active":"2023-10-08T00:32:47.676419+0000","last_peered":"2023-10-08T00:32:47.676419+0000","last_clean":"2023-10-08T00:32:47.676419+0000","last_became_active":"2023-10-08T00:32:47.674706+0000","last_became_peered":"2023-10-08T00:32:47.674706+0000","last_unstale":"2023-10-08T00:32:47.676419+0000","last_undegraded":"2023-10-08T00:32:47.676419+0000","last_fullsized":"2023-10-08T00:32:47.676419+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:04:32.593873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.653191+0000","last_change":"2023-10-08T00:32:46.658980+0000","last_active":"2023-10-08T00:32:47.653191+0000","last_peered":"2023-10-08T00:32:47.653191+0000","last_clean":"2023-10-08T00:32:47.653191+0000","last_became_active":"2023-10-08T00:32:46.658689+0000","last_became_peered":"2023-10-08T00:32:46.658689+0000","last_unstale":"2023-10-08T00:32:47.653191+0000","last_undegraded":"2023-10-08T00:32:47.653191+0000","last_fullsized":"2023-10-08T00:32:47.653191+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:12:15.840270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.678107+0000","last_change":"2023-10-08T00:32:47.677333+0000","last_active":"2023-10-08T00:32:47.678107+0000","last_peered":"2023-10-08T00:32:47.678107+0000","last_clean":"2023-10-08T00:32:47.678107+0000","last_became_active":"2023-10-08T00:32:47.676975+0000","last_became_peered":"2023-10-08T00:32:47.676975+0000","last_unstale":"2023-10-08T00:32:47.678107+0000","last_undegraded":"2023-10-08T00:32:47.678107+0000","last_fullsized":"2023-10-08T00:32:47.678107+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:51:56.026359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677342+0000","last_change":"2023-10-08T00:32:46.665966+0000","last_active":"2023-10-08T00:32:47.677342+0000","last_peered":"2023-10-08T00:32:47.677342+0000","last_clean":"2023-10-08T00:32:47.677342+0000","last_became_active":"2023-10-08T00:32:46.665614+0000","last_became_peered":"2023-10-08T00:32:46.665614+0000","last_unstale":"2023-10-08T00:32:47.677342+0000","last_undegraded":"2023-10-08T00:32:47.677342+0000","last_fullsized":"2023-10-08T00:32:47.677342+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:26.179625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.664951+0000","last_change":"2023-10-08T00:32:47.660309+0000","last_active":"2023-10-08T00:32:47.664951+0000","last_peered":"2023-10-08T00:32:47.664951+0000","last_clean":"2023-10-08T00:32:47.664951+0000","last_became_active":"2023-10-08T00:32:47.660030+0000","last_became_peered":"2023-10-08T00:32:47.660030+0000","last_unstale":"2023-10-08T00:32:47.664951+0000","last_undegraded":"2023-10-08T00:32:47.664951+0000","last_fullsized":"2023-10-08T00:32:47.664951+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:18:25.772332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.659392+0000","last_change":"2023-10-08T00:32:46.669868+0000","last_active":"2023-10-08T00:32:47.659392+0000","last_peered":"2023-10-08T00:32:47.659392+0000","last_clean":"2023-10-08T00:32:47.659392+0000","last_became_active":"2023-10-08T00:32:46.669596+0000","last_became_peered":"2023-10-08T00:32:46.669596+0000","last_unstale":"2023-10-08T00:32:47.659392+0000","last_undegraded":"2023-10-08T00:32:47.659392+0000","last_fullsized":"2023-10-08T00:32:47.659392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:44.195189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676873+0000","last_change":"2023-10-08T00:32:47.670312+0000","last_active":"2023-10-08T00:32:47.676873+0000","last_peered":"2023-10-08T00:32:47.676873+0000","last_clean":"2023-10-08T00:32:47.676873+0000","last_became_active":"2023-10-08T00:32:47.670028+0000","last_became_peered":"2023-10-08T00:32:47.670028+0000","last_unstale":"2023-10-08T00:32:47.676873+0000","last_undegraded":"2023-10-08T00:32:47.676873+0000","last_fullsized":"2023-10-08T00:32:47.676873+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:10:53.204143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.661178+0000","last_change":"2023-10-08T00:32:46.668459+0000","last_active":"2023-10-08T00:32:47.661178+0000","last_peered":"2023-10-08T00:32:47.661178+0000","last_clean":"2023-10-08T00:32:47.661178+0000","last_became_active":"2023-10-08T00:32:46.668192+0000","last_became_peered":"2023-10-08T00:32:46.668192+0000","last_unstale":"2023-10-08T00:32:47.661178+0000","last_undegraded":"2023-10-08T00:32:47.661178+0000","last_fullsized":"2023-10-08T00:32:47.661178+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:09.986581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679451+0000","last_change":"2023-10-08T00:32:47.674686+0000","last_active":"2023-10-08T00:32:47.679451+0000","last_peered":"2023-10-08T00:32:47.679451+0000","last_clean":"2023-10-08T00:32:47.679451+0000","last_became_active":"2023-10-08T00:32:47.674407+0000","last_became_peered":"2023-10-08T00:32:47.674407+0000","last_unstale":"2023-10-08T00:32:47.679451+0000","last_undegraded":"2023-10-08T00:32:47.679451+0000","last_fullsized":"2023-10-08T00:32:47.679451+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:38:32.992484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656616+0000","last_change":"2023-10-08T00:32:46.666705+0000","last_active":"2023-10-08T00:32:47.656616+0000","last_peered":"2023-10-08T00:32:47.656616+0000","last_clean":"2023-10-08T00:32:47.656616+0000","last_became_active":"2023-10-08T00:32:46.666444+0000","last_became_peered":"2023-10-08T00:32:46.666444+0000","last_unstale":"2023-10-08T00:32:47.656616+0000","last_undegraded":"2023-10-08T00:32:47.656616+0000","last_fullsized":"2023-10-08T00:32:47.656616+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:52.255420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677879+0000","last_change":"2023-10-08T00:32:47.673032+0000","last_active":"2023-10-08T00:32:47.677879+0000","last_peered":"2023-10-08T00:32:47.677879+0000","last_clean":"2023-10-08T00:32:47.677879+0000","last_became_active":"2023-10-08T00:32:47.672762+0000","last_became_peered":"2023-10-08T00:32:47.672762+0000","last_unstale":"2023-10-08T00:32:47.677879+0000","last_undegraded":"2023-10-08T00:32:47.677879+0000","last_fullsized":"2023-10-08T00:32:47.677879+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:08:29.182127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"155'2","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.670219+0000","last_change":"2023-10-08T00:32:46.665574+0000","last_active":"2023-10-08T00:32:47.670219+0000","last_peered":"2023-10-08T00:32:47.670219+0000","last_clean":"2023-10-08T00:32:47.670219+0000","last_became_active":"2023-10-08T00:32:46.665313+0000","last_became_peered":"2023-10-08T00:32:46.665313+0000","last_unstale":"2023-10-08T00:32:47.670219+0000","last_undegraded":"2023-10-08T00:32:47.670219+0000","last_fullsized":"2023-10-08T00:32:47.670219+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:11.060950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674291+0000","last_change":"2023-10-08T00:32:47.666582+0000","last_active":"2023-10-08T00:32:47.674291+0000","last_peered":"2023-10-08T00:32:47.674291+0000","last_clean":"2023-10-08T00:32:47.674291+0000","last_became_active":"2023-10-08T00:32:47.664148+0000","last_became_peered":"2023-10-08T00:32:47.664148+0000","last_unstale":"2023-10-08T00:32:47.674291+0000","last_undegraded":"2023-10-08T00:32:47.674291+0000","last_fullsized":"2023-10-08T00:32:47.674291+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:28:45.670985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"156'1","reported_seq":11,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-08T00:32:48.657882+0000","last_change":"2023-10-08T00:32:46.673272+0000","last_active":"2023-10-08T00:32:48.657882+0000","last_peered":"2023-10-08T00:32:48.657882+0000","last_clean":"2023-10-08T00:32:48.657882+0000","last_became_active":"2023-10-08T00:32:46.672931+0000","last_became_peered":"2023-10-08T00:32:46.672931+0000","last_unstale":"2023-10-08T00:32:48.657882+0000","last_undegraded":"2023-10-08T00:32:48.657882+0000","last_fullsized":"2023-10-08T00:32:48.657882+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:26:19.290848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.668367+0000","last_change":"2023-10-08T00:32:47.665147+0000","last_active":"2023-10-08T00:32:47.668367+0000","last_peered":"2023-10-08T00:32:47.668367+0000","last_clean":"2023-10-08T00:32:47.668367+0000","last_became_active":"2023-10-08T00:32:47.664772+0000","last_became_peered":"2023-10-08T00:32:47.664772+0000","last_unstale":"2023-10-08T00:32:47.668367+0000","last_undegraded":"2023-10-08T00:32:47.668367+0000","last_fullsized":"2023-10-08T00:32:47.668367+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:01:38.013496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656185+0000","last_change":"2023-10-08T00:32:46.663359+0000","last_active":"2023-10-08T00:32:47.656185+0000","last_peered":"2023-10-08T00:32:47.656185+0000","last_clean":"2023-10-08T00:32:47.656185+0000","last_became_active":"2023-10-08T00:32:46.663036+0000","last_became_peered":"2023-10-08T00:32:46.663036+0000","last_unstale":"2023-10-08T00:32:47.656185+0000","last_undegraded":"2023-10-08T00:32:47.656185+0000","last_fullsized":"2023-10-08T00:32:47.656185+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:01:53.489786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.680429+0000","last_change":"2023-10-08T00:32:47.675946+0000","last_active":"2023-10-08T00:32:47.680429+0000","last_peered":"2023-10-08T00:32:47.680429+0000","last_clean":"2023-10-08T00:32:47.680429+0000","last_became_active":"2023-10-08T00:32:47.675675+0000","last_became_peered":"2023-10-08T00:32:47.675675+0000","last_unstale":"2023-10-08T00:32:47.680429+0000","last_undegraded":"2023-10-08T00:32:47.680429+0000","last_fullsized":"2023-10-08T00:32:47.680429+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:59:48.727986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.653093+0000","last_change":"2023-10-08T00:32:46.668428+0000","last_active":"2023-10-08T00:32:47.653093+0000","last_peered":"2023-10-08T00:32:47.653093+0000","last_clean":"2023-10-08T00:32:47.653093+0000","last_became_active":"2023-10-08T00:32:46.668140+0000","last_became_peered":"2023-10-08T00:32:46.668140+0000","last_unstale":"2023-10-08T00:32:47.653093+0000","last_undegraded":"2023-10-08T00:32:47.653093+0000","last_fullsized":"2023-10-08T00:32:47.653093+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:13:56.603008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679532+0000","last_change":"2023-10-08T00:32:47.678827+0000","last_active":"2023-10-08T00:32:47.679532+0000","last_peered":"2023-10-08T00:32:47.679532+0000","last_clean":"2023-10-08T00:32:47.679532+0000","last_became_active":"2023-10-08T00:32:47.678481+0000","last_became_peered":"2023-10-08T00:32:47.678481+0000","last_unstale":"2023-10-08T00:32:47.679532+0000","last_undegraded":"2023-10-08T00:32:47.679532+0000","last_fullsized":"2023-10-08T00:32:47.679532+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:29:31.131209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.667785+0000","last_change":"2023-10-08T00:32:46.673338+0000","last_active":"2023-10-08T00:32:47.667785+0000","last_peered":"2023-10-08T00:32:47.667785+0000","last_clean":"2023-10-08T00:32:47.667785+0000","last_became_active":"2023-10-08T00:32:46.673058+0000","last_became_peered":"2023-10-08T00:32:46.673058+0000","last_unstale":"2023-10-08T00:32:47.667785+0000","last_undegraded":"2023-10-08T00:32:47.667785+0000","last_fullsized":"2023-10-08T00:32:47.667785+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:06.943375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.679308+0000","last_change":"2023-10-08T00:32:47.675215+0000","last_active":"2023-10-08T00:32:47.679308+0000","last_peered":"2023-10-08T00:32:47.679308+0000","last_clean":"2023-10-08T00:32:47.679308+0000","last_became_active":"2023-10-08T00:32:47.674944+0000","last_became_peered":"2023-10-08T00:32:47.674944+0000","last_unstale":"2023-10-08T00:32:47.679308+0000","last_undegraded":"2023-10-08T00:32:47.679308+0000","last_fullsized":"2023-10-08T00:32:47.679308+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:50.184185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.656827+0000","last_change":"2023-10-08T00:32:46.666673+0000","last_active":"2023-10-08T00:32:47.656827+0000","last_peered":"2023-10-08T00:32:47.656827+0000","last_clean":"2023-10-08T00:32:47.656827+0000","last_became_active":"2023-10-08T00:32:46.666395+0000","last_became_peered":"2023-10-08T00:32:46.666395+0000","last_unstale":"2023-10-08T00:32:47.656827+0000","last_undegraded":"2023-10-08T00:32:47.656827+0000","last_fullsized":"2023-10-08T00:32:47.656827+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:08.055754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.677878+0000","last_change":"2023-10-08T00:32:47.667392+0000","last_active":"2023-10-08T00:32:47.677878+0000","last_peered":"2023-10-08T00:32:47.677878+0000","last_clean":"2023-10-08T00:32:47.677878+0000","last_became_active":"2023-10-08T00:32:47.665858+0000","last_became_peered":"2023-10-08T00:32:47.665858+0000","last_unstale":"2023-10-08T00:32:47.677878+0000","last_undegraded":"2023-10-08T00:32:47.677878+0000","last_fullsized":"2023-10-08T00:32:47.677878+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:20.107114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.663320+0000","last_change":"2023-10-08T00:32:46.669479+0000","last_active":"2023-10-08T00:32:47.663320+0000","last_peered":"2023-10-08T00:32:47.663320+0000","last_clean":"2023-10-08T00:32:47.663320+0000","last_became_active":"2023-10-08T00:32:46.668156+0000","last_became_peered":"2023-10-08T00:32:46.668156+0000","last_unstale":"2023-10-08T00:32:47.663320+0000","last_undegraded":"2023-10-08T00:32:47.663320+0000","last_fullsized":"2023-10-08T00:32:47.663320+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:11:49.182086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.668394+0000","last_change":"2023-10-08T00:32:47.664897+0000","last_active":"2023-10-08T00:32:47.668394+0000","last_peered":"2023-10-08T00:32:47.668394+0000","last_clean":"2023-10-08T00:32:47.668394+0000","last_became_active":"2023-10-08T00:32:47.664625+0000","last_became_peered":"2023-10-08T00:32:47.664625+0000","last_unstale":"2023-10-08T00:32:47.668394+0000","last_undegraded":"2023-10-08T00:32:47.668394+0000","last_fullsized":"2023-10-08T00:32:47.668394+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:36.545610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.659735+0000","last_change":"2023-10-08T00:32:46.673654+0000","last_active":"2023-10-08T00:32:47.659735+0000","last_peered":"2023-10-08T00:32:47.659735+0000","last_clean":"2023-10-08T00:32:47.659735+0000","last_became_active":"2023-10-08T00:32:46.673382+0000","last_became_peered":"2023-10-08T00:32:46.673382+0000","last_unstale":"2023-10-08T00:32:47.659735+0000","last_undegraded":"2023-10-08T00:32:47.659735+0000","last_fullsized":"2023-10-08T00:32:47.659735+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:35.543510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.676146+0000","last_change":"2023-10-08T00:32:47.668384+0000","last_active":"2023-10-08T00:32:47.676146+0000","last_peered":"2023-10-08T00:32:47.676146+0000","last_clean":"2023-10-08T00:32:47.676146+0000","last_became_active":"2023-10-08T00:32:47.667752+0000","last_became_peered":"2023-10-08T00:32:47.667752+0000","last_unstale":"2023-10-08T00:32:47.676146+0000","last_undegraded":"2023-10-08T00:32:47.676146+0000","last_fullsized":"2023-10-08T00:32:47.676146+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:46.643905+0000","last_clean_scrub_stamp":"2023-10-08T00:32:46.643905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:10:26.205684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"155'1","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.674657+0000","last_change":"2023-10-08T00:32:46.666389+0000","last_active":"2023-10-08T00:32:47.674657+0000","last_peered":"2023-10-08T00:32:47.674657+0000","last_clean":"2023-10-08T00:32:47.674657+0000","last_became_active":"2023-10-08T00:32:46.666099+0000","last_became_peered":"2023-10-08T00:32:46.666099+0000","last_unstale":"2023-10-08T00:32:47.674657+0000","last_undegraded":"2023-10-08T00:32:47.674657+0000","last_fullsized":"2023-10-08T00:32:47.674657+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:32:45.641806+0000","last_clean_scrub_stamp":"2023-10-08T00:32:45.641806+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:23:31.809208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":277,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-08T00:32:47.671464+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:32:47.671464+0000","last_peered":"2023-10-08T00:32:47.671464+0000","last_clean":"2023-10-08T00:32:47.671464+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:32:47.671464+0000","last_undegraded":"2023-10-08T00:32:47.671464+0000","last_fullsized":"2023-10-08T00:32:47.671464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303904,"kb_used_data":2520,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067936,"statfs":{"total":96636764160,"available":96325566464,"internally_reserved":0,"allocated":2580480,"data_stored":1477765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33900000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.56000000000000005}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.628},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.55400000000000005},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.71599999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52100000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.372,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58999999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.82399999999999995,"5min":0.875,"15min":0.875},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.308,"15min":0.308},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.55000000000000004}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.499,"15min":0.52700000000000002},"min":{"1min":0.29999999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80200000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.34599999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.79000000000000004},"last":0.498},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55100000000000005,"15min":0.58299999999999996},"min":{"1min":0.35199999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72299999999999998,"5min":0.86299999999999999,"15min":1.048},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.60199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.751,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":886415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48499999999999999,"15min":0.50700000000000001},"min":{"1min":0.315,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.436},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52700000000000002,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.145},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.34399999999999997,"5min":0.29899999999999999,"15min":0.29299999999999998},"max":{"1min":0.68100000000000005,"5min":0.74399999999999999,"15min":0.873},"last":0.499}]},{"osd":2,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.33300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.079},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.57199999999999995},"min":{"1min":0.33500000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.59199999999999997},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.59899999999999998},"min":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.1160000000000001},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.50700000000000001,"15min":0.52700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.6440000000000001,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":4.5460000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.56100000000000005,"15min":0.55200000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":3.8370000000000002,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.60399999999999998},"min":{"1min":0.371,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.1520000000000001,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56200000000000006,"15min":0.59099999999999997},"min":{"1min":0.34599999999999997,"5min":0.309,"15min":0.309},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.59599999999999997,"15min":0.63600000000000001},"min":{"1min":0.40600000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.72399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303320,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068520,"statfs":{"total":96636764160,"available":96326164480,"internally_reserved":0,"allocated":1982464,"data_stored":885917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32100000000000001,"15min":0.33300000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.41299999999999998,"5min":0.499,"15min":0.64300000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.26100000000000001,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.28299999999999997,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59699999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.375,"15min":0.379},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54200000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.44500000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.434,"15min":0.42099999999999999},"min":{"1min":0.309,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.59399999999999997,"5min":0.66100000000000003,"15min":0.67200000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.52300000000000002,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60899999999999999,"15min":0.628},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":1.218,"15min":1.218},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.62,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82099999999999995,"5min":0.83599999999999997,"15min":1.0569999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.34999999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.871,"15min":1.294},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84999999999999998,"5min":0.86899999999999999,"15min":1.038},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.79100000000000004,"5min":1.278,"15min":1.278},"last":0.68999999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.60299999999999998},"min":{"1min":0.39400000000000002,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.82099999999999995,"5min":0.874,"15min":0.879},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89000000000000001,"5min":0.89900000000000002,"15min":1.087},"last":0.75800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303896,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067944,"statfs":{"total":96636764160,"available":96325574656,"internally_reserved":0,"allocated":2572288,"data_stored":1476319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.63700000000000001},"last":0.623}]},{"osd":2,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.375,"15min":0.379},"min":{"1min":0.249,"5min":0.245,"15min":0.245},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.63100000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.36199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.877,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.81100000000000005,"5min":0.88100000000000001,"15min":1.242},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83699999999999997,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.745}]},{"osd":6,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.80500000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574948,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":885861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.31900000000000001,"15min":0.34499999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.60899999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.38},"min":{"1min":0.245,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.443,"5min":0.59699999999999998,"15min":0.96799999999999997},"last":0.315}]},{"osd":1,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.371},"min":{"1min":0.25900000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.436,"5min":0.52300000000000002,"15min":0.65000000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.36099999999999999,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.47799999999999998,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.49399999999999999,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.42599999999999999},"min":{"1min":0.31,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55800000000000005,"5min":0.59299999999999997,"15min":0.70199999999999996},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55300000000000005,"15min":0.58299999999999996},"min":{"1min":0.47799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.79100000000000004},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58399999999999996,"15min":0.63600000000000001},"min":{"1min":0.42399999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77300000000000002,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.47899999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.629},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.77900000000000003,"5min":0.89700000000000002,"15min":0.93400000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.62,"15min":0.66800000000000004},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":1.278},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.64800000000000002},"min":{"1min":0.48399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":1.137},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.61699999999999999},"min":{"1min":0.41299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81599999999999995,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.52400000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:31:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.65700000000000003},"min":{"1min":0.46100000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.80800000000000005,"5min":0.94299999999999995,"15min":1.343},"last":0.49299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303324,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068516,"statfs":{"total":96636764160,"available":96326160384,"internally_reserved":0,"allocated":1986560,"data_stored":886043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33700000000000002,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.36599999999999999,"15min":0.36199999999999999},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.51000000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.311}]},{"osd":1,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33400000000000002,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.48999999999999999,"5min":0.55100000000000005,"15min":0.66000000000000003},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.372},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54700000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"last":0.34200000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.39700000000000002,"15min":0.40600000000000003},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.629,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.61599999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.37}]},{"osd":4,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95199999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.63100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.628,"15min":0.63},"min":{"1min":0.42799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.627,"15min":0.63800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.628},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.624,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303332,"kb_used_data":1948,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068508,"statfs":{"total":96636764160,"available":96326152192,"internally_reserved":0,"allocated":1994752,"data_stored":887501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.5,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.70899999999999996,"5min":0.753,"15min":0.91600000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72599999999999998,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.753,"5min":0.83999999999999997,"15min":0.84199999999999997},"last":0.56000000000000005}]},{"osd":2,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.712},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.60399999999999998,"5min":1.21,"15min":1.21},"last":0.58499999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.65100000000000002,"15min":0.59999999999999998},"min":{"1min":0.41299999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77200000000000002,"5min":0.873,"15min":0.873},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.499},"min":{"1min":0.312,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.67700000000000005,"5min":0.78000000000000003,"15min":0.83099999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":1.002},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.75,"5min":0.80100000000000005,"15min":0.84899999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.57299999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.82599999999999996,"15min":0.84199999999999997},"last":0.46000000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":0.873,"15min":0.88100000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.60099999999999998,"15min":0.61699999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.80800000000000005,"15min":0.97499999999999998},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303316,"kb_used_data":1932,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068524,"statfs":{"total":96636764160,"available":96326168576,"internally_reserved":0,"allocated":1978368,"data_stored":886415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.497},"min":{"1min":0.29699999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71899999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.624},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.61299999999999999},"min":{"1min":0.378,"5min":0.318,"15min":0.318},"max":{"1min":0.70099999999999996,"5min":0.78900000000000003,"15min":2.4169999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53300000000000003,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.75700000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.57699999999999996},"min":{"1min":0.41199999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55100000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.63900000000000001,"15min":0.58599999999999997},"min":{"1min":0.38300000000000001,"5min":0.38,"15min":0.32900000000000001},"max":{"1min":7.2800000000000002,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.65900000000000003},"min":{"1min":0.44800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72799999999999998,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.59899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.5,"15min":0.54600000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.29199999999999998},"max":{"1min":0.65100000000000002,"5min":0.749,"15min":0.78700000000000003},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.50900000000000001,"15min":0.54600000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.753,"5min":0.77300000000000002,"15min":0.80100000000000005},"last":0.36199999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.33700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.505},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55000000000000004,"15min":0.59199999999999997},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.74199999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38100000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.66600000000000004,"5min":0.79900000000000004,"15min":0.85199999999999998},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58899999999999997,"15min":0.60999999999999999},"min":{"1min":0.40699999999999997,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:32:56.714 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:32:56.714 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:32:56.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.873+0000 7f9ec90ba700 1 Processor -- start 2023-10-08T00:32:56.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.873+0000 7f9ec90ba700 1 -- start start 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec90ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 0x7f9ec40caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec90ba700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec4157c50 con 0x7f9ec40cca50 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec90ba700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec415d7d0 con 0x7f9ec415df40 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec90ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415aa20 con 0x7f9ec40cce20 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec2d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9ec40cca50 0x7f9ec415a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52528/0 (socket says 172.21.15.22:52528) 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec2d9d700 1 -- 172.21.15.22:0/2986274764 learned_addr learned my addr 172.21.15.22:0/2986274764 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 0x7f9ec40caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498752357 0 0) 0x7f9eb4001110 con 0x7f9ec40cca50 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb0003570 con 0x7f9ec40cca50 2023-10-08T00:32:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118419283 0 0) 0x7f9eb0003570 con 0x7f9ec40cca50 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 msgr2=0x7f9ec40caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 0x7f9ec40caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 >> v1:172.21.15.192:6789/0 conn(0x7f9ec415df40 legacy=0x7f9ec406ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec415ad00 con 0x7f9ec40cca50 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f9eb4001600 con 0x7f9ec40cca50 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 >> v1:172.21.15.22:6789/0 conn(0x7f9ec40cca50 legacy=0x7f9ec415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 0x7f9eb0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9eb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9eb0004d50 0x7f9eb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415aa20 con 0x7f9eb0004010 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000bbf0 con 0x7f9eb0004d50 2023-10-08T00:32:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.874+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb000bdb0 con 0x7f9ec40cce20 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9eb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ec2d9d700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 0x7f9eb0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ec359e700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9eb0004d50 0x7f9eb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 -- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 msgr2=0x7f9eb0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec40cce20 0x7f9eb0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 -- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9eb0004d50 msgr2=0x7f9eb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9eb0004d50 0x7f9eb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 -- 172.21.15.22:0/2986274764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0003570 con 0x7f9eb0004010 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ec359e700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9eb0004d50 0x7f9eb00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9eb0004810 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f9eac006f00 tx=0x7f9eac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38274d4257e6199f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00e710 con 0x7f9eb0004010 2023-10-08T00:32:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac00e870 con 0x7f9eb0004010 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.875+0000 7f9ec259c700 1 -- 172.21.15.22:0/2986274764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00ec30 con 0x7f9eb0004010 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec90ba700 1 -- 172.21.15.22:0/2986274764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 msgr2=0x7f9eb0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/2986274764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9eb0004810 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f9eac006f00 tx=0x7f9eac0091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec359e700 1 -- 172.21.15.22:0/2986274764 reap_dead start 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec90ba700 1 -- 172.21.15.22:0/2986274764 shutdown_connections 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec90ba700 1 -- 172.21.15.22:0/2986274764 >> 172.21.15.22:0/2986274764 conn(0x7f9ec40ce5c0 msgr2=0x7f9ec40ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec90ba700 1 -- 172.21.15.22:0/2986274764 shutdown_connections 2023-10-08T00:32:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.876+0000 7f9ec90ba700 1 -- 172.21.15.22:0/2986274764 wait complete. 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.877+0000 7f9ec90ba700 1 Processor -- start 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.877+0000 7f9ec90ba700 1 -- start start 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9ec40c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b2a10 0x7f9ec40b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec416d830 0x7f9ec416dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec416e210 con 0x7f9eb0004010 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c5250 con 0x7f9ec40b2a10 2023-10-08T00:32:56.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40b2e80 con 0x7f9ec416d830 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9ec40c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9ec40c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36534/0 (socket says 172.21.15.22:36534) 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 -- 172.21.15.22:0/1511626999 learned_addr learned my addr 172.21.15.22:0/1511626999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b2a10 0x7f9ec40b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec359e700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec416d830 0x7f9ec416dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 -- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec416d830 msgr2=0x7f9ec416dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec416d830 0x7f9ec416dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 -- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b2a10 msgr2=0x7f9ec40b2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b2a10 0x7f9ec40b2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 -- 172.21.15.22:0/1511626999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40b3160 con 0x7f9eb0004010 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b2a10 0x7f9ec40b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:56.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec359e700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec416d830 0x7f9ec416dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec2d9d700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9ec40c4d10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40073f0 tx=0x7f9eb4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4018030 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb400f8d0 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec40b3440 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400fc70 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.878+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec40b3a00 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.879+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec40718b0 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.880+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9eb401b070 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.880+0000 7f9ebaffd700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ea4067320 0x7f9ea40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.880+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9eb4019070 con 0x7f9eb0004010 2023-10-08T00:32:56.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.880+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ea4067320 0x7f9ea40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.881+0000 7f9ebbfff700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ea4067320 0x7f9ea40697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9eac006ed0 tx=0x7f9eac01a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:56.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:56.884+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9eb4051670 con 0x7f9eb0004010 2023-10-08T00:32:57.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.157+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9ec4157c50 con 0x7f9eb0004010 2023-10-08T00:32:57.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.161+0000 7f9ebaffd700 1 -- 172.21.15.22:0/1511626999 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9ec4157c50 con 0x7f9eb0004010 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ea4067320 msgr2=0x7f9ea40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ea4067320 0x7f9ea40697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9eac006ed0 tx=0x7f9eac01a000 comp rx=0 tx=0).stop 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 msgr2=0x7f9ec40c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9ec40c4d10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40073f0 tx=0x7f9eb4007a50 comp rx=0 tx=0).stop 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 shutdown_connections 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ea4067320 0x7f9ea40697d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ec416d830 0x7f9ec416dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9eb0004010 0x7f9ec40c4d10 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 --2- 172.21.15.22:0/1511626999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b2a10 0x7f9ec40b2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 >> 172.21.15.22:0/1511626999 conn(0x7f9ec40ce5c0 msgr2=0x7f9ec41572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:57.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 shutdown_connections 2023-10-08T00:32:57.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.164+0000 7f9ec90ba700 1 -- 172.21.15.22:0/1511626999 wait complete. 2023-10-08T00:32:57.166 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:32:57.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:32:57.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.295+0000 7fd1ee647700 1 Processor -- start 2023-10-08T00:32:57.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.295+0000 7fd1ee647700 1 -- start start 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ee647700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e8159420 0x7fd1e80b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ee647700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1e815d230 0x7fd1e815d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ee647700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e815dbd0 con 0x7fd1e81597f0 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ee647700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e80b2980 con 0x7fd1e815d230 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ee647700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80b11d0 con 0x7fd1e8159420 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1e815d230 0x7fd1e815d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1e815d230 0x7fd1e815d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36536/0 (socket says 172.21.15.22:36536) 2023-10-08T00:32:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 -- 172.21.15.22:0/2529438650 learned_addr learned my addr 172.21.15.22:0/2529438650 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ed645700 1 --2- 172.21.15.22:0/2529438650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e8159420 0x7fd1e80b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 -- 172.21.15.22:0/2529438650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e8159420 msgr2=0x7fd1e80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 --2- 172.21.15.22:0/2529438650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e8159420 0x7fd1e80b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 -- 172.21.15.22:0/2529438650 >> v1:172.21.15.192:6789/0 conn(0x7fd1e81597f0 legacy=0x7fd1e80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.296+0000 7fd1ede46700 1 -- 172.21.15.22:0/2529438650 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80b14b0 con 0x7fd1e815d230 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ede46700 1 --2- 172.21.15.22:0/2529438650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e815d230 0x7fd1e815d690 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009f20 tx=0x7fd1d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb11f090414e13f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1e7fff700 1 -- 172.21.15.22:0/2529438650 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800e070 con 0x7fd1e815d230 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1e7fff700 1 -- 172.21.15.22:0/2529438650 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800ba40 con 0x7fd1e815d230 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1e7fff700 1 -- 172.21.15.22:0/2529438650 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80092e0 con 0x7fd1e815d230 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 -- 172.21.15.22:0/2529438650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e815d230 msgr2=0x7fd1e815d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 --2- 172.21.15.22:0/2529438650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e815d230 0x7fd1e815d690 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009f20 tx=0x7fd1d8009840 comp rx=0 tx=0).stop 2023-10-08T00:32:57.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 -- 172.21.15.22:0/2529438650 shutdown_connections 2023-10-08T00:32:57.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 --2- 172.21.15.22:0/2529438650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e815d230 0x7fd1e815d690 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 --2- 172.21.15.22:0/2529438650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e8159420 0x7fd1e80b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 -- 172.21.15.22:0/2529438650 >> 172.21.15.22:0/2529438650 conn(0x7fd1e80d0660 msgr2=0x7fd1e80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:57.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 -- 172.21.15.22:0/2529438650 shutdown_connections 2023-10-08T00:32:57.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.297+0000 7fd1ee647700 1 -- 172.21.15.22:0/2529438650 wait complete. 2023-10-08T00:32:57.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.298+0000 7fd1ee647700 1 Processor -- start 2023-10-08T00:32:57.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 -- start start 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 0x7fd1e815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1e81597f0 0x7fd1e8153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e815d230 0x7fd1e814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8155970 con 0x7fd1e8159420 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8155160 con 0x7fd1e81597f0 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ee647700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e815cee0 con 0x7fd1e815d230 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.299+0000 7fd1ed645700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 0x7fd1e815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 0x7fd1e815c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36540/0 (socket says 172.21.15.22:36540) 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 -- 172.21.15.22:0/3852932142 learned_addr learned my addr 172.21.15.22:0/3852932142 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:57.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ede46700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e815d230 0x7fd1e814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ece44700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1e81597f0 0x7fd1e8153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 -- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e815d230 msgr2=0x7fd1e814acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e815d230 0x7fd1e814acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 -- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1e81597f0 msgr2=0x7fd1e8153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1e81597f0 0x7fd1e8153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 -- 172.21.15.22:0/3852932142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d8009ae0 con 0x7fd1e8159420 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ed645700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 0x7fd1e815c9a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000d890 tx=0x7fd1e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00125f0 con 0x7fd1e8159420 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e0012770 con 0x7fd1e8159420 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0012b30 con 0x7fd1e8159420 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e81553b0 con 0x7fd1e8159420 2023-10-08T00:32:57.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.300+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e8159e00 con 0x7fd1e8159420 2023-10-08T00:32:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.301+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e8159c40 con 0x7fd1e8159420 2023-10-08T00:32:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.302+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1e001e460 con 0x7fd1e8159420 2023-10-08T00:32:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.302+0000 7fd1e57fa700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1d4067320 0x7fd1d40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.302+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1e00853c0 con 0x7fd1e8159420 2023-10-08T00:32:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.302+0000 7fd1ece44700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1d4067320 0x7fd1d40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:57.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.303+0000 7fd1ece44700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1d4067320 0x7fd1d40697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8154540 tx=0x7fd1dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:57.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.307+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1e0055ae0 con 0x7fd1e8159420 2023-10-08T00:32:57.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.542+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1e804c3c0 con 0x7fd1e8159420 2023-10-08T00:32:57.543 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.543+0000 7fd1e57fa700 1 -- 172.21.15.22:0/3852932142 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fd1e0055670 con 0x7fd1e8159420 2023-10-08T00:32:57.544 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:32:57.544 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":106,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:47.063189+0000","modified":"2023-10-08T00:32:50.680465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7929":{"gid":7929,"name":"d","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/1078154935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1078154935},{"type":"v1","addr":"172.21.15.192:6836","nonce":1078154935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1d4067320 msgr2=0x7fd1d40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1d4067320 0x7fd1d40697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8154540 tx=0x7fd1dc009040 comp rx=0 tx=0).stop 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 msgr2=0x7fd1e815c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 0x7fd1e815c9a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000d890 tx=0x7fd1e0008040 comp rx=0 tx=0).stop 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 shutdown_connections 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd1d4067320 0x7fd1d40697d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd1e815d230 0x7fd1e814acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1e8159420 0x7fd1e815c9a0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 --2- 172.21.15.22:0/3852932142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd1e81597f0 0x7fd1e8153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 >> 172.21.15.22:0/3852932142 conn(0x7fd1e80d0660 msgr2=0x7fd1e80d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:57.546 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 shutdown_connections 2023-10-08T00:32:57.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:57.545+0000 7fd1ee647700 1 -- 172.21.15.22:0/3852932142 wait complete. 2023-10-08T00:32:57.547 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 106 2023-10-08T00:32:57.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:32:47.063189+0000', 'modified': '2023-10-08T00:32:50.680465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7929}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7929': {'gid': 7929, 'name': 'd', 'rank': 0, 'incarnation': 102, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6836/1078154935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 1078154935}, {'type': 'v1', 'addr': '172.21.15.192:6836', 'nonce': 1078154935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:32:57.960 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:32:57.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T00:32:58.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.086+0000 7f1e14cfb700 1 Processor -- start 2023-10-08T00:32:58.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.086+0000 7f1e14cfb700 1 -- start start 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e14cfb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e10159420 0x7f1e100b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e14cfb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e1015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e14cfb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e100b2980 con 0x7f1e101597f0 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e14cfb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1015dbb0 con 0x7f1e10159420 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e14cfb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b11d0 con 0x7f1e1015d230 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e1015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e0f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e10159420 0x7f1e100b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e1015d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:56838/0 (socket says 172.21.15.22:56838) 2023-10-08T00:32:58.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.087+0000 7f1e0ffff700 1 -- 172.21.15.22:0/1293237725 learned_addr learned my addr 172.21.15.22:0/1293237725 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0ffff700 1 -- 172.21.15.22:0/1293237725 >> v2:172.21.15.192:3300/0 conn(0x7f1e10159420 msgr2=0x7f1e100b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/1293237725 >> v2:172.21.15.192:3300/0 conn(0x7f1e10159420 0x7f1e100b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0ffff700 1 -- 172.21.15.22:0/1293237725 >> v1:172.21.15.192:6789/0 conn(0x7f1e101597f0 legacy=0x7f1e100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0ffff700 1 -- 172.21.15.22:0/1293237725 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100b14b0 con 0x7f1e1015d230 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/1293237725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e1015d670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009f20 tx=0x7f1e08009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=854f4d469d79be2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0e7fc700 1 -- 172.21.15.22:0/1293237725 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800e070 con 0x7f1e1015d230 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0e7fc700 1 -- 172.21.15.22:0/1293237725 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800b9d0 con 0x7f1e1015d230 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.088+0000 7f1e0e7fc700 1 -- 172.21.15.22:0/1293237725 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080092e0 con 0x7f1e1015d230 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 -- 172.21.15.22:0/1293237725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 msgr2=0x7f1e1015d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/1293237725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e1015d670 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009f20 tx=0x7f1e08009840 comp rx=0 tx=0).stop 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 -- 172.21.15.22:0/1293237725 shutdown_connections 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/1293237725 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e1015d670 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/1293237725 >> v2:172.21.15.192:3300/0 conn(0x7f1e10159420 0x7f1e100b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 -- 172.21.15.22:0/1293237725 >> 172.21.15.22:0/1293237725 conn(0x7f1e100d0660 msgr2=0x7f1e100d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 -- 172.21.15.22:0/1293237725 shutdown_connections 2023-10-08T00:32:58.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.089+0000 7f1e14cfb700 1 -- 172.21.15.22:0/1293237725 wait complete. 2023-10-08T00:32:58.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.090+0000 7f1e14cfb700 1 Processor -- start 2023-10-08T00:32:58.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.090+0000 7f1e14cfb700 1 -- start start 2023-10-08T00:32:58.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e14cfb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 0x7f1e1014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e14cfb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e101597f0 0x7f1e10150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e14cfb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e101542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e14cfb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10151db0 con 0x7f1e10159420 2023-10-08T00:32:58.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e14cfb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101511a0 con 0x7f1e101597f0 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e14cfb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10151480 con 0x7f1e1015d230 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 0x7f1e1014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 0x7f1e1014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36550/0 (socket says 172.21.15.22:36550) 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3450106024 learned_addr learned my addr 172.21.15.22:0/3450106024 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e101597f0 0x7f1e10150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 msgr2=0x7f1e101542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e101542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e101542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e101597f0 msgr2=0x7f1e10150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e101597f0 0x7f1e10150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3450106024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08009ae0 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e101597f0 0x7f1e10150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e101542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.091+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 0x7f1e1014f510 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000ec80 tx=0x7f1e000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.092+0000 7f1df77fe700 1 -- 172.21.15.22:0/3450106024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000c9d0 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.092+0000 7f1df77fe700 1 -- 172.21.15.22:0/3450106024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000cb30 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.092+0000 7f1df77fe700 1 -- 172.21.15.22:0/3450106024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00013470 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.092+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e10151760 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.092+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1014fa50 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.093+0000 7f1df77fe700 1 -- 172.21.15.22:0/3450106024 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1e00013820 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.094+0000 7f1df77fe700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1dfc067320 0x7f1dfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.094+0000 7f1df77fe700 1 -- 172.21.15.22:0/3450106024 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e00085060 con 0x7f1e10159420 2023-10-08T00:32:58.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.094+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1dfc067320 0x7f1dfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.094+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1dfc067320 0x7f1dfc0697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1e10158b00 tx=0x7f1e04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.095+0000 7f1e1f255b80 1 Processor -- start 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 -- start start 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa52480 0x5631faa317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa52850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa07b80 0x5631faa07ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631fa95ea70 con 0x5631faa055f0 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631fa95c270 con 0x5631faa52480 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631fa958060 con 0x5631faa07b80 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa52850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa52850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36552/0 (socket says 172.21.15.22:36552) 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e0effd700 1 -- 172.21.15.22:0/459088507 learned_addr learned my addr 172.21.15.22:0/459088507 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa07b80 0x5631faa07ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.096+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa52480 0x5631faa317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1e0effd700 1 -- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa07b80 msgr2=0x5631faa07ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1e0effd700 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa07b80 0x5631faa07ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1e0effd700 1 -- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa52480 msgr2=0x5631faa317d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1e0effd700 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa52480 0x5631faa317d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1e0effd700 1 -- 172.21.15.22:0/459088507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631fa7f2270 con 0x5631faa055f0 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1e0effd700 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa52850 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400d8a0 tx=0x7f1e04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1b56557b1516c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1df4ff9700 1 -- 172.21.15.22:0/459088507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04006a30 con 0x5631faa055f0 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1df4ff9700 1 -- 172.21.15.22:0/459088507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04006b90 con 0x5631faa055f0 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.097+0000 7f1df4ff9700 1 -- 172.21.15.22:0/459088507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007050 con 0x5631faa055f0 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 -- 172.21.15.22:0/459088507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 msgr2=0x5631faa52850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa52850 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400d8a0 tx=0x7f1e04014000 comp rx=0 tx=0).stop 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 -- 172.21.15.22:0/459088507 shutdown_connections 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa07b80 0x5631faa07ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa52480 0x5631faa317d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/459088507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa52850 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 -- 172.21.15.22:0/459088507 >> 172.21.15.22:0/459088507 conn(0x5631faa090c0 msgr2=0x5631faa098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 -- 172.21.15.22:0/459088507 shutdown_connections 2023-10-08T00:32:58.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 -- 172.21.15.22:0/459088507 wait complete. 2023-10-08T00:32:58.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 -- start start 2023-10-08T00:32:58.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.098+0000 7f1e1f255b80 1 Processor -- start 2023-10-08T00:32:58.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa2e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa07b80 0x5631faa29c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa52480 0x5631faa34030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631fa903890 con 0x5631faa055f0 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631fa91eea0 con 0x5631faa07b80 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631fa7dae30 con 0x5631faa52480 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e1f255b80 10 client.0 _ll_register_callbacks cb 0x5631fa9cb2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e0f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa2e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e0f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa2e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36562/0 (socket says 172.21.15.22:36562) 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3584788575 learned_addr learned my addr 172.21.15.22:0/3584788575 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa07b80 0x5631faa29c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.099+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa52480 0x5631faa34030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa52480 msgr2=0x5631faa34030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa52480 0x5631faa34030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa07b80 msgr2=0x5631faa29c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa07b80 0x5631faa29c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0f7fe700 1 -- 172.21.15.22:0/3584788575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100b2980 con 0x5631faa055f0 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa52480 0x5631faa34030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa2e0f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1e00051eb0 tx=0x7f1e00051d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eaf5f01fc51da7b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1dedffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1dedffb700 1 -- 172.21.15.22:0/3584788575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0005c950 con 0x5631faa055f0 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1dedffb700 1 -- 172.21.15.22:0/3584788575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e000550b0 con 0x5631faa055f0 2023-10-08T00:32:58.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631fa9fccd0 con 0x5631faa055f0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1dedffb700 1 -- 172.21.15.22:0/3584788575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e0005c6d0 con 0x5631faa055f0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 10 client.8073 fetch_fsmap learned FSMap version 106 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x5631fa794fe0 con 0x5631faa055f0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1dedffb700 1 -- 172.21.15.22:0/3584788575 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631fa9fccd0 con 0x5631faa055f0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1dedffb700 1 -- 172.21.15.22:0/3584788575 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e0005cba0 con 0x5631faa055f0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 10 client.8073 fetch_fsmap finished waiting for FSMap version 106 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 10 client.8073 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 20 client.8073 populate_metadata read hostname 'smithi022' 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa61dd0 0x5631faa621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 4 client.8073 mds_command: new command op to 7929 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.100+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 --> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631fa9d9aa0 con 0x5631faa61dd0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.101+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa61dd0 0x5631faa621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.101+0000 7f1dedffb700 10 client.8073 ms_handle_connect on v2:172.21.15.192:6834/1078154935 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.101+0000 7f1e0effd700 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa61dd0 0x5631faa621a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4548595610ab2 server_cookie=3e391862b3fc78be in_seq=0 out_seq=0 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1dedffb700 1 -- 172.21.15.22:0/3584788575 <== mds.0 v2:172.21.15.192:6834/1078154935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5631fa9d9aa0 con 0x5631faa61dd0 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1dedffb700 10 client.8073 handle_command_reply: tid=0 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 client.8073 shutdown 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 msgr2=0x5631faa2e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa2e0f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1e00051eb0 tx=0x7f1e00051d80 comp rx=0 tx=0).stop 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 shutdown_connections 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa61dd0 0x5631faa621a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa52480 0x5631faa34030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa055f0 0x5631faa2e0f0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/3584788575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa07b80 0x5631faa29c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1dedffb700 0 client.8073 ms_handle_reset on v2:172.21.15.192:6834/1078154935 2023-10-08T00:32:58.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 >> 172.21.15.22:0/3584788575 conn(0x5631faa090c0 msgr2=0x5631faa07ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 shutdown_connections 2023-10-08T00:32:58.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 1 -- 172.21.15.22:0/3584788575 wait complete. 2023-10-08T00:32:58.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.102+0000 7f1e1f255b80 20 client.8073 trim_cache size 0 max 16384 2023-10-08T00:32:58.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 Processor -- start 2023-10-08T00:32:58.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 -- start start 2023-10-08T00:32:58.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa090c0 0x5631faaa9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa055f0 0x5631faa2ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631faa07f50 con 0x5631faa07b80 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631fa9e0410 con 0x5631faa055f0 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.119+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631faa4f230 con 0x5631faa090c0 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36570/0 (socket says 172.21.15.22:36570) 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 -- 172.21.15.22:0/4036988377 learned_addr learned my addr 172.21.15.22:0/4036988377 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa090c0 0x5631faaa9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0effd700 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa055f0 0x5631faa2ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 -- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa090c0 msgr2=0x5631faaa9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa090c0 0x5631faaa9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 -- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa055f0 msgr2=0x5631faa2ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa055f0 0x5631faa2ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 -- 172.21.15.22:0/4036988377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631fa926780 con 0x5631faa07b80 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0effd700 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa055f0 0x5631faa2ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa513e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b1310 tx=0x7f1e08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6be5e0bdd2a6e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1df57fa700 1 -- 172.21.15.22:0/4036988377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08023070 con 0x5631faa07b80 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1df57fa700 1 -- 172.21.15.22:0/4036988377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0801e580 con 0x5631faa07b80 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.120+0000 7f1df57fa700 1 -- 172.21.15.22:0/4036988377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0801e920 con 0x5631faa07b80 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 -- 172.21.15.22:0/4036988377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 msgr2=0x5631faa513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa513e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f1e100b1310 tx=0x7f1e08018000 comp rx=0 tx=0).stop 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 -- 172.21.15.22:0/4036988377 shutdown_connections 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa513e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa090c0 0x5631faaa9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/4036988377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa055f0 0x5631faa2ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 -- 172.21.15.22:0/4036988377 >> 172.21.15.22:0/4036988377 conn(0x5631faa30ef0 msgr2=0x5631faa04a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 -- 172.21.15.22:0/4036988377 shutdown_connections 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 -- 172.21.15.22:0/4036988377 wait complete. 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 -- start start 2023-10-08T00:32:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.121+0000 7f1e1f255b80 1 Processor -- start 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa055f0 0x5631faa25da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa32620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa090c0 0x5631faa2bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631faa2c9f0 con 0x5631faa07b80 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631faa28af0 con 0x5631faa090c0 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631faa32b60 con 0x5631faa055f0 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e1f255b80 10 client.0 _ll_register_callbacks cb 0x5631fa9cb2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa32620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa32620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36582/0 (socket says 172.21.15.22:36582) 2023-10-08T00:32:58.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 -- 172.21.15.22:0/2696910231 learned_addr learned my addr 172.21.15.22:0/2696910231 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa055f0 0x5631faa25da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0ffff700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa090c0 0x5631faa2bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 -- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa055f0 msgr2=0x5631faa25da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa055f0 0x5631faa25da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 -- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa090c0 msgr2=0x5631faa2bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa090c0 0x5631faa2bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.122+0000 7f1e0effd700 1 -- 172.21.15.22:0/2696910231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100b14b0 con 0x5631faa07b80 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e0effd700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa32620 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400d740 tx=0x7f1e04016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a201c32dbb898f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1dedffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1dedffb700 1 -- 172.21.15.22:0/2696910231 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04032070 con 0x5631faa07b80 2023-10-08T00:32:58.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1dedffb700 1 -- 172.21.15.22:0/2696910231 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e04006f10 con 0x5631faa07b80 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e04006b90 con 0x5631faa07b80 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1dedffb700 1 -- 172.21.15.22:0/2696910231 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e040075d0 con 0x5631faa07b80 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 10 client.8079 fetch_fsmap learned FSMap version 106 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x5631fa90d470 con 0x5631faa07b80 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1dedffb700 1 -- 172.21.15.22:0/2696910231 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e04006b90 con 0x5631faa07b80 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1dedffb700 1 -- 172.21.15.22:0/2696910231 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 106) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e0400d8d0 con 0x5631faa07b80 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 10 client.8079 fetch_fsmap finished waiting for FSMap version 106 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 10 client.8079 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 20 client.8079 populate_metadata read hostname 'smithi022' 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa52480 0x5631faa700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 4 client.8079 mds_command: new command op to 7929 tid=0[{"prefix": "status"}] 2023-10-08T00:32:58.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 --> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5631fa8fae00 con 0x5631faa52480 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.123+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa52480 0x5631faa700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e0f7fe700 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa52480 0x5631faa700a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34bec2f4dce979e server_cookie=f948f8aee65d416d in_seq=0 out_seq=0 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1dedffb700 10 client.8079 ms_handle_connect on v2:172.21.15.192:6834/1078154935 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1dedffb700 1 -- 172.21.15.22:0/2696910231 <== mds.0 v2:172.21.15.192:6834/1078154935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5631fa8fae00 con 0x5631faa52480 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1dedffb700 10 client.8079 handle_command_reply: tid=0 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 client.8079 shutdown 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 msgr2=0x5631faa32620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa32620 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400d740 tx=0x7f1e04016040 comp rx=0 tx=0).stop 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 shutdown_connections 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:6834/1078154935,v1:172.21.15.192:6836/1078154935] conn(0x5631faa52480 0x5631faa700a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631faa090c0 0x5631faa2bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x5631faa055f0 0x5631faa25da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1dedffb700 0 client.8079 ms_handle_reset on v2:172.21.15.192:6834/1078154935 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 --2- 172.21.15.22:0/2696910231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631faa07b80 0x5631faa32620 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 >> 172.21.15.22:0/2696910231 conn(0x5631faa30ef0 msgr2=0x5631faa33d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 shutdown_connections 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 1 -- 172.21.15.22:0/2696910231 wait complete. 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.124+0000 7f1e1f255b80 20 client.8079 trim_cache size 0 max 16384 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:32:58.132 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 7929, 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.474030905999999, 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 106, 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 156, 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 156, 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 15.709325542 2023-10-08T00:32:58.133 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:32:58.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1dfc067320 msgr2=0x7f1dfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1dfc067320 0x7f1dfc0697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1e10158b00 tx=0x7f1e04009040 comp rx=0 tx=0).stop 2023-10-08T00:32:58.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 msgr2=0x7f1e1014f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 0x7f1e1014f510 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000ec80 tx=0x7f1e000091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 shutdown_connections 2023-10-08T00:32:58.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1dfc067320 0x7f1dfc0697d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e1015d230 0x7f1e101542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10159420 0x7f1e1014f510 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 --2- 172.21.15.22:0/3450106024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e101597f0 0x7f1e10150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 >> 172.21.15.22:0/3450106024 conn(0x7f1e100d0660 msgr2=0x7f1e10156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 shutdown_connections 2023-10-08T00:32:58.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.125+0000 7f1e14cfb700 1 -- 172.21.15.22:0/3450106024 wait complete. 2023-10-08T00:32:58.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:32:58.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.256+0000 7fd4ca72d700 1 Processor -- start 2023-10-08T00:32:58.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.256+0000 7fd4ca72d700 1 -- start start 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4ca72d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd4c4159c60 0x7fd4c415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4ca72d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4c415db10 0x7fd4c4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4ca72d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c415a160 con 0x7fd4c4159890 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4ca72d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c415df50 con 0x7fd4c415db10 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4ca72d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c40d13a0 con 0x7fd4c4159c60 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4c8cca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4c415db10 0x7fd4c4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4c8cca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd4c415db10 0x7fd4c4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36584/0 (socket says 172.21.15.22:36584) 2023-10-08T00:32:58.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4c8cca700 1 -- 172.21.15.22:0/1595398158 learned_addr learned my addr 172.21.15.22:0/1595398158 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.257+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/1595398158 >> v2:172.21.15.192:3300/0 conn(0x7fd4c4159c60 0x7fd4c415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c8cca700 1 -- 172.21.15.22:0/1595398158 >> v2:172.21.15.192:3300/0 conn(0x7fd4c4159c60 msgr2=0x7fd4c415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c8cca700 1 --2- 172.21.15.22:0/1595398158 >> v2:172.21.15.192:3300/0 conn(0x7fd4c4159c60 0x7fd4c415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c8cca700 1 -- 172.21.15.22:0/1595398158 >> v1:172.21.15.192:6789/0 conn(0x7fd4c4159890 legacy=0x7fd4c415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c8cca700 1 -- 172.21.15.22:0/1595398158 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c415e140 con 0x7fd4c415db10 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c8cca700 1 --2- 172.21.15.22:0/1595398158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c415db10 0x7fd4c4069560 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40b67f0 tx=0x7fd4bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63ad02da58b33f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1595398158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc00e070 con 0x7fd4c415db10 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1595398158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc00ba10 con 0x7fd4c415db10 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4c2ffd700 1 -- 172.21.15.22:0/1595398158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0092e0 con 0x7fd4c415db10 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 -- 172.21.15.22:0/1595398158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c415db10 msgr2=0x7fd4c4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/1595398158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c415db10 0x7fd4c4069560 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40b67f0 tx=0x7fd4bc009840 comp rx=0 tx=0).stop 2023-10-08T00:32:58.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 -- 172.21.15.22:0/1595398158 shutdown_connections 2023-10-08T00:32:58.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/1595398158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c415db10 0x7fd4c4069560 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/1595398158 >> v2:172.21.15.192:3300/0 conn(0x7fd4c4159c60 0x7fd4c415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 -- 172.21.15.22:0/1595398158 >> 172.21.15.22:0/1595398158 conn(0x7fd4c4068e20 msgr2=0x7fd4c40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 -- 172.21.15.22:0/1595398158 shutdown_connections 2023-10-08T00:32:58.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.258+0000 7fd4ca72d700 1 -- 172.21.15.22:0/1595398158 wait complete. 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.259+0000 7fd4ca72d700 1 Processor -- start 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 -- start start 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 0x7fd4c40b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c4159c60 0x7fd4c40b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c415db10 0x7fd4c40cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c4151470 con 0x7fd4c4159890 2023-10-08T00:32:58.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c416de20 con 0x7fd4c4159c60 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4ca72d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40b1f10 con 0x7fd4c415db10 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.260+0000 7fd4c3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 0x7fd4c40b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 0x7fd4c40b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36598/0 (socket says 172.21.15.22:36598) 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 -- 172.21.15.22:0/820517724 learned_addr learned my addr 172.21.15.22:0/820517724 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c8cca700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c415db10 0x7fd4c40cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 -- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c415db10 msgr2=0x7fd4c40cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c4159c60 0x7fd4c40b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c415db10 0x7fd4c40cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 -- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c4159c60 msgr2=0x7fd4c40b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c4159c60 0x7fd4c40b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 -- 172.21.15.22:0/820517724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc009ae0 con 0x7fd4c4159890 2023-10-08T00:32:58.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4c3fff700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 0x7fd4c40b23d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400b600 tx=0x7fd4b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400f510 con 0x7fd4c4159890 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400f670 con 0x7fd4c4159890 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400fa30 con 0x7fd4c4159890 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c416d4f0 con 0x7fd4c4159890 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.261+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c416dab0 con 0x7fd4c4159890 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.262+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c404c3c0 con 0x7fd4c4159890 2023-10-08T00:32:58.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.263+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4b401a400 con 0x7fd4c4159890 2023-10-08T00:32:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.263+0000 7fd4abfff700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0067320 0x7fd4b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.263+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd4b4084820 con 0x7fd4c4159890 2023-10-08T00:32:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.263+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0067320 0x7fd4b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:58.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.264+0000 7fd4c37fe700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0067320 0x7fd4b00697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4152f90 tx=0x7fd4b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:58.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.267+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b40514b0 con 0x7fd4c4159890 2023-10-08T00:32:58.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.510+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4c414cd40 con 0x7fd4c4159890 2023-10-08T00:32:58.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.510+0000 7fd4abfff700 1 -- 172.21.15.22:0/820517724 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd4b4054ad0 con 0x7fd4c4159890 2023-10-08T00:32:58.511 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:32:58.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0067320 msgr2=0x7fd4b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0067320 0x7fd4b00697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4152f90 tx=0x7fd4b8008040 comp rx=0 tx=0).stop 2023-10-08T00:32:58.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 msgr2=0x7fd4c40b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:58.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 0x7fd4c40b23d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400b600 tx=0x7fd4b40091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 shutdown_connections 2023-10-08T00:32:58.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd4b0067320 0x7fd4b00697d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd4c415db10 0x7fd4c40cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4c4159890 0x7fd4c40b23d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 --2- 172.21.15.22:0/820517724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4c4159c60 0x7fd4c40b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:58.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.512+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 >> 172.21.15.22:0/820517724 conn(0x7fd4c4068e20 msgr2=0x7fd4c414d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:58.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.513+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 shutdown_connections 2023-10-08T00:32:58.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:58.513+0000 7fd4ca72d700 1 -- 172.21.15.22:0/820517724 wait complete. 2023-10-08T00:32:58.525 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:32:58.525 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:32:58.525 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:32:58.525 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:32:58.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:58.526 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:32:58.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:32:58.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:32:58.526 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:32:58.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:58.526 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:32:58.542 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:32:58.542 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:32:58.542 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 41992sec preferred_lft 41992sec 2023-10-08T00:32:58.543 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.544 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:58.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:58.546 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:32:58.606 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:32:58.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:58.607 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:32:58.664 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:32:58.664 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:32:58.664 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:32:58.664 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:32:58.664 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:32:58.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:58.665 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:32:58.665 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:32:58.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:32:58.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:32:58.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:32:58.665 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:32:58.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:58.767 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:32:58.782 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:32:58.782 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:32:58.782 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:32:58.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:58.782 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:32:58.848 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:58.848 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:58.904 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:32:58.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:58.904 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:58.959 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:32:58.959 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:32:58.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:59.041 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:59.041 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:32:59.060 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:32:59.061 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:32:59.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:32:59.084 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:32:59.084 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:32:59.085 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:32:59.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:32:59.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:32:59.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.310+0000 7f5ad0c70700 1 Processor -- start 2023-10-08T00:32:59.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.310+0000 7f5ad0c70700 1 -- start start 2023-10-08T00:32:59.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.310+0000 7f5ad0c70700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:59.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.310+0000 7f5ad0c70700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5acc159c60 0x7f5acc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ad0c70700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc15a160 con 0x7f5acc15db10 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ad0c70700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc0d13a0 con 0x7f5acc159c60 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ad0c70700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc15e140 con 0x7f5acc159890 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac9d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5acc159c60 0x7f5acc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5acad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5acc15db10 0x7f5acc069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52536/0 (socket says 172.21.15.22:52536) 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5acad9d700 1 -- 172.21.15.22:0/1617491190 learned_addr learned my addr 172.21.15.22:0/1617491190 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:32:59.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5aca59c700 1 --2- 172.21.15.22:0/1617491190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/1617491190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 msgr2=0x7f5acc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac9d9b700 1 --2- 172.21.15.22:0/1617491190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/1617491190 >> v1:172.21.15.22:6789/0 conn(0x7f5acc15db10 legacy=0x7f5acc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/1617491190 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc15a3d0 con 0x7f5acc159c60 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac959a700 1 -- 172.21.15.22:0/1617491190 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381914748 0 0) 0x7f5acc15a160 con 0x7f5acc15db10 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac9d9b700 1 --2- 172.21.15.22:0/1617491190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc15d5d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098e0 tx=0x7f5ac00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17ba0ba30ff7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:59.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac959a700 1 -- 172.21.15.22:0/1617491190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0009e80 con 0x7f5acc159c60 2023-10-08T00:32:59.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac959a700 1 -- 172.21.15.22:0/1617491190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac000b860 con 0x7f5acc159c60 2023-10-08T00:32:59.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.311+0000 7f5ac959a700 1 -- 172.21.15.22:0/1617491190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000bbe0 con 0x7f5acc159c60 2023-10-08T00:32:59.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 -- 172.21.15.22:0/1617491190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 msgr2=0x7f5acc15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:59.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/1617491190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc15d5d0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00098e0 tx=0x7f5ac00091a0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 -- 172.21.15.22:0/1617491190 shutdown_connections 2023-10-08T00:32:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/1617491190 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/1617491190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc15d5d0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 -- 172.21.15.22:0/1617491190 >> 172.21.15.22:0/1617491190 conn(0x7f5acc068e20 msgr2=0x7f5acc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 -- 172.21.15.22:0/1617491190 shutdown_connections 2023-10-08T00:32:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.312+0000 7f5ad0c70700 1 -- 172.21.15.22:0/1617491190 wait complete. 2023-10-08T00:32:59.317 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.313+0000 7f5ad0c70700 1 Processor -- start 2023-10-08T00:32:59.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.313+0000 7f5ad0c70700 1 -- start start 2023-10-08T00:32:59.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ad0c70700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:59.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ad0c70700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:59.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ad0c70700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5acc15db10 0x7f5acc0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:59.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ad0c70700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0ce7a0 con 0x7f5acc159c60 2023-10-08T00:32:59.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ad0c70700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0cea40 con 0x7f5acc15db10 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ad0c70700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0ced20 con 0x7f5acc159890 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc1471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36618/0 (socket says 172.21.15.22:36618) 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/2601729021 learned_addr learned my addr 172.21.15.22:0/2601729021 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5aca59c700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5acad9d700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5acc15db10 0x7f5acc0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:59.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 msgr2=0x7f5acc0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:59.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5acc15db10 msgr2=0x7f5acc0c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:59.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5acc15db10 0x7f5acc0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 -- 172.21.15.22:0/2601729021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0009420 con 0x7f5acc159c60 2023-10-08T00:32:59.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5aca59c700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:32:59.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.314+0000 7f5ac9d9b700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc1471f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0013000 tx=0x7f5ac0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:59.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.315+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac000bbe0 con 0x7f5acc159c60 2023-10-08T00:32:59.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.315+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0011420 con 0x7f5acc159c60 2023-10-08T00:32:59.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.315+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc0cf000 con 0x7f5acc159c60 2023-10-08T00:32:59.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.315+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00117e0 con 0x7f5acc159c60 2023-10-08T00:32:59.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.315+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc147730 con 0x7f5acc159c60 2023-10-08T00:32:59.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.316+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc0cf240 con 0x7f5acc159c60 2023-10-08T00:32:59.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.316+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5ac0011bd0 con 0x7f5acc159c60 2023-10-08T00:32:59.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.316+0000 7f5aba7fc700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5aac067320 0x7f5aac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:32:59.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.317+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ac00866b0 con 0x7f5acc159c60 2023-10-08T00:32:59.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.317+0000 7f5aca59c700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5aac067320 0x7f5aac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:32:59.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.317+0000 7f5aca59c700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5aac067320 0x7f5aac0697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5abc006fd0 tx=0x7f5abc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:32:59.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.321+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5acc0cf240 con 0x7f5acc159c60 2023-10-08T00:32:59.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.560+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5acc0cf240 con 0x7f5acc159c60 2023-10-08T00:32:59.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.561+0000 7f5aba7fc700 1 -- 172.21.15.22:0/2601729021 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5acc0cf240 con 0x7f5acc159c60 2023-10-08T00:32:59.561 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:32:59.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5aac067320 msgr2=0x7f5aac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:59.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5aac067320 0x7f5aac0697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5abc006fd0 tx=0x7f5abc008040 comp rx=0 tx=0).stop 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 msgr2=0x7f5acc1471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc1471f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0013000 tx=0x7f5ac0017000 comp rx=0 tx=0).stop 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 shutdown_connections 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5acc15db10 0x7f5acc0c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5aac067320 0x7f5aac0697d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5acc159890 0x7f5acc0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 --2- 172.21.15.22:0/2601729021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5acc159c60 0x7f5acc1471f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 >> 172.21.15.22:0/2601729021 conn(0x7f5acc068e20 msgr2=0x7f5acc152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 shutdown_connections 2023-10-08T00:32:59.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:32:59.563+0000 7f5ad0c70700 1 -- 172.21.15.22:0/2601729021 wait complete. 2023-10-08T00:32:59.575 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:32:59.575 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:32:59.576 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:32:59.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.576 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:32:59.595 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:32:59.595 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:32:59.595 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:32:59.595 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.595 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:32:59.595 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:59.596 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 41995sec preferred_lft 41995sec 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:32:59.597 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:32:59.598 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.598 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:32:59.598 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:32:59.598 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:32:59.598 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:32:59.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.599 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:32:59.663 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:32:59.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.665 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:32:59.724 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:32:59.724 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:32:59.724 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:32:59.724 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:32:59.724 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:32:59.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.724 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:32:59.725 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:32:59.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:32:59.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:32:59.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:32:59.725 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:32:59.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.832 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:32:59.847 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:32:59.848 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:32:59.848 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:32:59.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:32:59.848 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:32:59.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:59.914 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:32:59.969 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:32:59.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:32:59.969 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:00.023 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:33:00.024 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:33:00.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:00.104 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:00.104 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:33:00.123 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:33:00.144 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:00.144 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:00.144 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:33:00.144 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:33:00.145 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:33:00.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:33:00.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:00.146 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:00.211 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:33:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.344+0000 7f122293b700 1 Processor -- start 2023-10-08T00:33:00.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.344+0000 7f122293b700 1 -- start start 2023-10-08T00:33:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.345+0000 7f122293b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.345+0000 7f122293b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f121c0cf350 0x7f121c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.345+0000 7f122293b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121c0b5b00 con 0x7f121c0b53d0 2023-10-08T00:33:00.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.345+0000 7f122293b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121c0b5da0 con 0x7f121c0cf350 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.345+0000 7f122293b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c0b6080 con 0x7f121c159ec0 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.345+0000 7f1220ed8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f121c0cf350 0x7f121c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f121c0cf350 0x7f121c0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36624/0 (socket says 172.21.15.22:36624) 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 -- 172.21.15.22:0/3462498759 learned_addr learned my addr 172.21.15.22:0/3462498759 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f121bfff700 1 --2- 172.21.15.22:0/3462498759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 -- 172.21.15.22:0/3462498759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 msgr2=0x7f121c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 --2- 172.21.15.22:0/3462498759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 -- 172.21.15.22:0/3462498759 >> v1:172.21.15.192:6789/0 conn(0x7f121c0b53d0 legacy=0x7f121c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 -- 172.21.15.22:0/3462498759 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0cc100 con 0x7f121c0cf350 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f1220ed8700 1 --2- 172.21.15.22:0/3462498759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0cf350 0x7f121c0cd010 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1214009f20 tx=0x7f1214009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84373fa57d8c6981 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f121affd700 1 -- 172.21.15.22:0/3462498759 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121400e070 con 0x7f121c0cf350 2023-10-08T00:33:00.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f121affd700 1 -- 172.21.15.22:0/3462498759 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121400b9d0 con 0x7f121c0cf350 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.346+0000 7f121affd700 1 -- 172.21.15.22:0/3462498759 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12140092e0 con 0x7f121c0cf350 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 -- 172.21.15.22:0/3462498759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0cf350 msgr2=0x7f121c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 --2- 172.21.15.22:0/3462498759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0cf350 0x7f121c0cd010 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1214009f20 tx=0x7f1214009840 comp rx=0 tx=0).stop 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 -- 172.21.15.22:0/3462498759 shutdown_connections 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 --2- 172.21.15.22:0/3462498759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0cf350 0x7f121c0cd010 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 --2- 172.21.15.22:0/3462498759 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 -- 172.21.15.22:0/3462498759 >> 172.21.15.22:0/3462498759 conn(0x7f121c0999f0 msgr2=0x7f121c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 -- 172.21.15.22:0/3462498759 shutdown_connections 2023-10-08T00:33:00.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.347+0000 7f122293b700 1 -- 172.21.15.22:0/3462498759 wait complete. 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.348+0000 7f122293b700 1 Processor -- start 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.348+0000 7f122293b700 1 -- start start 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f122293b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 0x7f121c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f122293b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121c0cf350 0x7f121c0c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f122293b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f122293b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c09e490 con 0x7f121c0b53d0 2023-10-08T00:33:00.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f122293b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121c06af00 con 0x7f121c0cf350 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f122293b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121c16d8c0 con 0x7f121c159ec0 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 0x7f121c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 0x7f121c153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36626/0 (socket says 172.21.15.22:36626) 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 -- 172.21.15.22:0/128887405 learned_addr learned my addr 172.21.15.22:0/128887405 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f1220ed8700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121b7fe700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121c0cf350 0x7f121c0c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 -- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 msgr2=0x7f121c0c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 -- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121c0cf350 msgr2=0x7f121c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121c0cf350 0x7f121c0c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 -- 172.21.15.22:0/128887405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1214009ae0 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f121bfff700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 0x7f121c153670 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f120c00ea00 tx=0x7f120c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.349+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00c6a0 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.350+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00c800 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.350+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121c16dd50 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.350+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00cb80 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.350+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121c16d270 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.351+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121c16dba0 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.351+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f120c013470 con 0x7f121c0b53d0 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.351+0000 7f1213fff700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11fc067320 0x7f11fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.351+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f120c085230 con 0x7f121c0b53d0 2023-10-08T00:33:00.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.352+0000 7f121b7fe700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11fc067320 0x7f11fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.352+0000 7f121b7fe700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11fc067320 0x7f11fc0697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f121c0c6d70 tx=0x7f1204007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:00.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.356+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f120c051ec0 con 0x7f121c0b53d0 2023-10-08T00:33:00.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.594+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f121c063c90 con 0x7f121c0b53d0 2023-10-08T00:33:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.712+0000 7f1213fff700 1 -- 172.21.15.22:0/128887405 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v107) v1 ==== 136+0+0 (secure 0 0 0) 0x7f120c0554e0 con 0x7f121c0b53d0 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11fc067320 msgr2=0x7f11fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11fc067320 0x7f11fc0697d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f121c0c6d70 tx=0x7f1204007ec0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 msgr2=0x7f121c153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 0x7f121c153670 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f120c00ea00 tx=0x7f120c009120 comp rx=0 tx=0).stop 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 shutdown_connections 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11fc067320 0x7f11fc0697d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121c159ec0 0x7f121c0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f121c0b53d0 0x7f121c153670 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 --2- 172.21.15.22:0/128887405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121c0cf350 0x7f121c0c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 >> 172.21.15.22:0/128887405 conn(0x7f121c0999f0 msgr2=0x7f121c0c6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 shutdown_connections 2023-10-08T00:33:00.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.714+0000 7f122293b700 1 -- 172.21.15.22:0/128887405 wait complete. 2023-10-08T00:33:00.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:33:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.849+0000 7fdd60875700 1 Processor -- start 2023-10-08T00:33:00.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.849+0000 7fdd60875700 1 -- start start 2023-10-08T00:33:00.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd60875700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdd5c15d230 0x7fdd5c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd60875700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c0b2980 con 0x7fdd5c159420 2023-10-08T00:33:00.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd60875700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c15db70 con 0x7fdd5c1597f0 2023-10-08T00:33:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd60875700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0b11d0 con 0x7fdd5c15d230 2023-10-08T00:33:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd5bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdd5c15d230 0x7fdd5c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd5b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdd5c159420 0x7fdd5c0b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52540/0 (socket says 172.21.15.22:52540) 2023-10-08T00:33:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.850+0000 7fdd5b7fe700 1 -- 172.21.15.22:0/3159451793 learned_addr learned my addr 172.21.15.22:0/3159451793 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5bfff700 1 -- 172.21.15.22:0/3159451793 >> v1:172.21.15.192:6789/0 conn(0x7fdd5c1597f0 legacy=0x7fdd5c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5bfff700 1 -- 172.21.15.22:0/3159451793 >> v1:172.21.15.22:6789/0 conn(0x7fdd5c159420 legacy=0x7fdd5c0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5a7fc700 1 -- 172.21.15.22:0/3159451793 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562010016 0 0) 0x7fdd5c0b2980 con 0x7fdd5c159420 2023-10-08T00:33:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5bfff700 1 -- 172.21.15.22:0/3159451793 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0b14b0 con 0x7fdd5c15d230 2023-10-08T00:33:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5bfff700 1 --2- 172.21.15.22:0/3159451793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c15d230 0x7fdd5c15d630 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009e60 tx=0x7fdd54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b516a6f97000b790 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5a7fc700 1 -- 172.21.15.22:0/3159451793 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400e070 con 0x7fdd5c15d230 2023-10-08T00:33:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5a7fc700 1 -- 172.21.15.22:0/3159451793 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400bc30 con 0x7fdd5c15d230 2023-10-08T00:33:00.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd5a7fc700 1 -- 172.21.15.22:0/3159451793 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54012430 con 0x7fdd5c15d230 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 -- 172.21.15.22:0/3159451793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c15d230 msgr2=0x7fdd5c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 --2- 172.21.15.22:0/3159451793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c15d230 0x7fdd5c15d630 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fdd54009e60 tx=0x7fdd54009780 comp rx=0 tx=0).stop 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 -- 172.21.15.22:0/3159451793 shutdown_connections 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 --2- 172.21.15.22:0/3159451793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c15d230 0x7fdd5c15d630 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 -- 172.21.15.22:0/3159451793 >> 172.21.15.22:0/3159451793 conn(0x7fdd5c0d0660 msgr2=0x7fdd5c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 -- 172.21.15.22:0/3159451793 shutdown_connections 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.851+0000 7fdd60875700 1 -- 172.21.15.22:0/3159451793 wait complete. 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 Processor -- start 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 -- start start 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 0x7fdd5c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5c1597f0 0x7fdd5c0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd5c15d230 0x7fdd5c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c15c190 con 0x7fdd5c159420 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c15ac00 con 0x7fdd5c15d230 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.853+0000 7fdd60875700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c15b860 con 0x7fdd5c1597f0 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 0x7fdd5c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 0x7fdd5c155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36638/0 (socket says 172.21.15.22:36638) 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 -- 172.21.15.22:0/1975159412 learned_addr learned my addr 172.21.15.22:0/1975159412 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 -- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5c1597f0 msgr2=0x7fdd5c0c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5c1597f0 0x7fdd5c0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 -- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd5c15d230 msgr2=0x7fdd5c0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd5c15d230 0x7fdd5c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:00.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 -- 172.21.15.22:0/1975159412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54009a20 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd5b7fe700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 0x7fdd5c155160 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c7e0 tx=0x7fdd4c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c005b30 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c005c90 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c15bb40 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c007300 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.854+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c1556a0 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.855+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c04c3c0 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.856+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdd4c01b400 con 0x7fdd5c159420 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.856+0000 7fdd437fe700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd48067320 0x7fdd480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:00.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.856+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd4c084700 con 0x7fdd5c159420 2023-10-08T00:33:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.856+0000 7fdd5affd700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd48067320 0x7fdd480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.857+0000 7fdd5affd700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd48067320 0x7fdd480697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0b60a0 tx=0x7fdd50007b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:00.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:00.860+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd4c051490 con 0x7fdd5c159420 2023-10-08T00:33:01.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.082+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd5c065870 con 0x7fdd48067320 2023-10-08T00:33:01.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.084+0000 7fdd437fe700 1 -- 172.21.15.22:0/1975159412 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdd5c065870 con 0x7fdd48067320 2023-10-08T00:33:01.084 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:33:01.085 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:01.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:33:01.085 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:01.085 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:33:01.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd48067320 msgr2=0x7fdd480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd48067320 0x7fdd480697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0b60a0 tx=0x7fdd50007b40 comp rx=0 tx=0).stop 2023-10-08T00:33:01.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 msgr2=0x7fdd5c155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 0x7fdd5c155160 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c7e0 tx=0x7fdd4c007df0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 shutdown_connections 2023-10-08T00:33:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd5c15d230 0x7fdd5c0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdd5c159420 0x7fdd5c155160 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdd48067320 0x7fdd480697d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.089 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 --2- 172.21.15.22:0/1975159412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdd5c1597f0 0x7fdd5c0c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 >> 172.21.15.22:0/1975159412 conn(0x7fdd5c0d0660 msgr2=0x7fdd5c069070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 shutdown_connections 2023-10-08T00:33:01.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.086+0000 7fdd60875700 1 -- 172.21.15.22:0/1975159412 wait complete. 2023-10-08T00:33:01.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:33:01.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.221+0000 7f857bbd1700 1 Processor -- start 2023-10-08T00:33:01.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.222+0000 7f857bbd1700 1 -- start start 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.222+0000 7f857bbd1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8574159890 0x7f857415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.222+0000 7f857bbd1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574069560 0x7f85740699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.222+0000 7f857bbd1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8574069ee0 con 0x7f8574159c60 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.222+0000 7f857bbd1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857415a160 con 0x7f8574159890 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.222+0000 7f857bbd1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740d13a0 con 0x7f8574069560 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857916c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8574159c60 0x7f857415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52544/0 (socket says 172.21.15.22:52544) 2023-10-08T00:33:01.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857916c700 1 -- 172.21.15.22:0/3840730403 learned_addr learned my addr 172.21.15.22:0/3840730403 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857996d700 1 --2- 172.21.15.22:0/3840730403 >> v2:172.21.15.192:3300/0 conn(0x7f8574159890 0x7f857415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857a16e700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574069560 0x7f85740699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857896b700 1 -- 172.21.15.22:0/3840730403 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939235375 0 0) 0x7f8574069ee0 con 0x7f8574159c60 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857896b700 1 -- 172.21.15.22:0/3840730403 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f855c003570 con 0x7f8574159c60 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857996d700 1 -- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574069560 msgr2=0x7f85740699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857996d700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574069560 0x7f85740699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857996d700 1 -- 172.21.15.22:0/3840730403 >> v1:172.21.15.22:6789/0 conn(0x7f8574159c60 legacy=0x7f857415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857996d700 1 -- 172.21.15.22:0/3840730403 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857415e140 con 0x7f8574159890 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857a16e700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574069560 0x7f85740699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857996d700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f857415abd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8564009e60 tx=0x7f8564009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311bec8efc204402 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857896b700 1 -- 172.21.15.22:0/3840730403 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400e070 con 0x7f8574159890 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857896b700 1 -- 172.21.15.22:0/3840730403 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400bab0 con 0x7f8574159890 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.223+0000 7f857896b700 1 -- 172.21.15.22:0/3840730403 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400be70 con 0x7f8574159890 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 -- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 msgr2=0x7f857415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f857415abd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8564009e60 tx=0x7f8564009780 comp rx=0 tx=0).stop 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 -- 172.21.15.22:0/3840730403 shutdown_connections 2023-10-08T00:33:01.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574069560 0x7f85740699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 --2- 172.21.15.22:0/3840730403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f857415abd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 -- 172.21.15.22:0/3840730403 >> 172.21.15.22:0/3840730403 conn(0x7f8574068e20 msgr2=0x7f85740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:01.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 -- 172.21.15.22:0/3840730403 shutdown_connections 2023-10-08T00:33:01.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.224+0000 7f857bbd1700 1 -- 172.21.15.22:0/3840730403 wait complete. 2023-10-08T00:33:01.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.225+0000 7f857bbd1700 1 Processor -- start 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.225+0000 7f857bbd1700 1 -- start start 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857bbd1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 0x7f85740b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857bbd1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f85740b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857bbd1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574159c60 0x7f85740b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857bbd1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740caa40 con 0x7f8574069560 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857bbd1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85740ce770 con 0x7f8574159890 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857bbd1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85740cde40 con 0x7f8574159c60 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 0x7f85740b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 0x7f85740b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36650/0 (socket says 172.21.15.22:36650) 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 -- 172.21.15.22:0/765060056 learned_addr learned my addr 172.21.15.22:0/765060056 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857916c700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f85740b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857a16e700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574159c60 0x7f85740b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 -- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574159c60 msgr2=0x7f85740b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574159c60 0x7f85740b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 -- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 msgr2=0x7f85740b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f85740b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 -- 172.21.15.22:0/765060056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c009420 con 0x7f8574069560 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f857996d700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 0x7f85740b6050 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f85640097c0 tx=0x7f8564019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.226+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8564012d00 con 0x7f8574069560 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.227+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8564012e80 con 0x7f8574069560 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.227+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85640276c0 con 0x7f8574069560 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.227+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8564009a20 con 0x7f8574069560 2023-10-08T00:33:01.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.227+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85740ce400 con 0x7f8574069560 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.228+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f857404c3c0 con 0x7f8574069560 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.228+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8564024070 con 0x7f8574069560 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.228+0000 7f8571ffb700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8560067320 0x7f85600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.229+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8564087220 con 0x7f8574069560 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.229+0000 7f857916c700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8560067320 0x7f85600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.229+0000 7f857916c700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8560067320 0x7f85600697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f85740c8f60 tx=0x7f8568009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:01.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.233+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8564053eb0 con 0x7f8574069560 2023-10-08T00:33:01.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.427+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f857406a5b0 con 0x7f8574069560 2023-10-08T00:33:01.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.427+0000 7f8571ffb700 1 -- 172.21.15.22:0/765060056 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85640574d0 con 0x7f8574069560 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8560067320 msgr2=0x7f85600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8560067320 0x7f85600697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f85740c8f60 tx=0x7f8568009040 comp rx=0 tx=0).stop 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 msgr2=0x7f85740b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 0x7f85740b6050 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f85640097c0 tx=0x7f8564019000 comp rx=0 tx=0).stop 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 shutdown_connections 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8560067320 0x7f85600697d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8574159c60 0x7f85740b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8574069560 0x7f85740b6050 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 --2- 172.21.15.22:0/765060056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574159890 0x7f85740b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 >> 172.21.15.22:0/765060056 conn(0x7f8574068e20 msgr2=0x7f8574158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 shutdown_connections 2023-10-08T00:33:01.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.429+0000 7f857bbd1700 1 -- 172.21.15.22:0/765060056 wait complete. 2023-10-08T00:33:01.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000569725 2023-10-08T00:33:01.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.563+0000 7f4e7f594700 1 Processor -- start 2023-10-08T00:33:01.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.563+0000 7f4e7f594700 1 -- start start 2023-10-08T00:33:01.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7f594700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e780b4e70 0x7f4e780ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7f594700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b16d0 0x7f4e780b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7f594700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e780b2080 con 0x7f4e7815d240 2023-10-08T00:33:01.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7f594700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e780cfb00 con 0x7f4e780b4e70 2023-10-08T00:33:01.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7f594700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780b5c40 con 0x7f4e780b16d0 2023-10-08T00:33:01.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7e592700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e780b4e70 0x7f4e780ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7ed93700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4e7815d240 0x7f4e7815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52560/0 (socket says 172.21.15.22:52560) 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7ed93700 1 -- 172.21.15.22:0/818930105 learned_addr learned my addr 172.21.15.22:0/818930105 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7dd91700 1 --2- 172.21.15.22:0/818930105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b16d0 0x7f4e780b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7e592700 1 -- 172.21.15.22:0/818930105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b16d0 msgr2=0x7f4e780b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7e592700 1 --2- 172.21.15.22:0/818930105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b16d0 0x7f4e780b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7e592700 1 -- 172.21.15.22:0/818930105 >> v1:172.21.15.22:6789/0 conn(0x7f4e7815d240 legacy=0x7f4e7815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7e592700 1 -- 172.21.15.22:0/818930105 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e780b5f20 con 0x7f4e780b4e70 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.564+0000 7f4e7d590700 1 -- 172.21.15.22:0/818930105 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739862443 0 0) 0x7f4e780b2080 con 0x7f4e7815d240 2023-10-08T00:33:01.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7e592700 1 --2- 172.21.15.22:0/818930105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e780b4e70 0x7f4e780ccff0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4e700098e0 tx=0x7f4e700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c610caf9db8560 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7d590700 1 -- 172.21.15.22:0/818930105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e70009e80 con 0x7f4e780b4e70 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7d590700 1 -- 172.21.15.22:0/818930105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7000b860 con 0x7f4e780b4e70 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7d590700 1 -- 172.21.15.22:0/818930105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000bbe0 con 0x7f4e780b4e70 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 -- 172.21.15.22:0/818930105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e780b4e70 msgr2=0x7f4e780ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 --2- 172.21.15.22:0/818930105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e780b4e70 0x7f4e780ccff0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f4e700098e0 tx=0x7f4e700091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 -- 172.21.15.22:0/818930105 shutdown_connections 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 --2- 172.21.15.22:0/818930105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e780b4e70 0x7f4e780ccff0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 --2- 172.21.15.22:0/818930105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b16d0 0x7f4e780b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 -- 172.21.15.22:0/818930105 >> 172.21.15.22:0/818930105 conn(0x7f4e780d10c0 msgr2=0x7f4e780affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:01.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 -- 172.21.15.22:0/818930105 shutdown_connections 2023-10-08T00:33:01.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.565+0000 7f4e7f594700 1 -- 172.21.15.22:0/818930105 wait complete. 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 Processor -- start 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 -- start start 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e780b16d0 0x7f4e780a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b4e70 0x7f4e780ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e7815d240 0x7f4e781698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780c9690 con 0x7f4e7815d240 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780af8f0 con 0x7f4e780b16d0 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7f594700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780c98e0 con 0x7f4e780b4e70 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7ed93700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e7815d240 0x7f4e781698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7ed93700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e7815d240 0x7f4e781698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36664/0 (socket says 172.21.15.22:36664) 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.567+0000 7f4e7ed93700 1 -- 172.21.15.22:0/2192297785 learned_addr learned my addr 172.21.15.22:0/2192297785 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7e592700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e780b16d0 0x7f4e780a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7dd91700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b4e70 0x7f4e780ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7ed93700 1 -- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b4e70 msgr2=0x7f4e780ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7ed93700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b4e70 0x7f4e780ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7ed93700 1 -- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e780b16d0 msgr2=0x7f4e780a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7ed93700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e780b16d0 0x7f4e780a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7ed93700 1 -- 172.21.15.22:0/2192297785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e70009420 con 0x7f4e7815d240 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7dd91700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4e780b4e70 0x7f4e780ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7ed93700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e7815d240 0x7f4e781698e0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800cbf0 tx=0x7f4e680019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:01.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800a9c0 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6800ab20 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7f594700 1 -- 172.21.15.22:0/2192297785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e780c9bc0 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680070f0 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.568+0000 7f4e7f594700 1 -- 172.21.15.22:0/2192297785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e780ca180 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.569+0000 7f4e7f594700 1 -- 172.21.15.22:0/2192297785 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e78088990 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.569+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4e68007520 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.570+0000 7f4e767fc700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e64067320 0x7f4e640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.570+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e68085070 con 0x7f4e7815d240 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.570+0000 7f4e7e592700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e64067320 0x7f4e640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:01.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.571+0000 7f4e7e592700 1 --2- 172.21.15.22:0/2192297785 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4e64067320 0x7f4e640697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4e700091e0 tx=0x7f4e70017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:01.575 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.574+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e68051d80 con 0x7f4e7815d240 2023-10-08T00:33:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.797+0000 7f4e7f594700 1 -- 172.21.15.22:0/2192297785 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000569725", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e7804bb80 con 0x7f4e64067320 2023-10-08T00:33:01.799 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:33:01.798+0000 7f7d5e472700 -1 mgr.server reply reply (1) Operation not permitted WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-08T00:33:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:01.799+0000 7f4e767fc700 1 -- 172.21.15.22:0/2192297785 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: -1 WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue.) v1 ==== 283+0+0 (secure 0 0 0) 0x7f4e7804bb80 con 0x7f4e64067320 2023-10-08T00:33:01.801 INFO:teuthology.orchestra.run.smithi022.stderr:Error EPERM: WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-08T00:33:01.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:33:01.804 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:33:01.804 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:01.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:01.887 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:33:01.887 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:33:01.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:33:01.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:33:01.931 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:33:01.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:01.931 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:33:01.986 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:33:01.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:33:01.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:02.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:33:02.029 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:33:02.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:02.030 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:33:02.030 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:33:02.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:02.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.206+0000 7f224294a700 1 Processor -- start 2023-10-08T00:33:02.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.206+0000 7f224294a700 1 -- start start 2023-10-08T00:33:02.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f224294a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f224294a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 0x7f223c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f224294a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c15a160 con 0x7f223c159890 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f224294a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0d13a0 con 0x7f223c15db10 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f224294a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15e140 con 0x7f223c159c60 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f2240ee7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 0x7f223c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f2240ee7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 0x7f223c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:50262/0 (socket says 172.21.15.22:50262) 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:56974/0 (socket says 172.21.15.22:56974) 2023-10-08T00:33:02.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.207+0000 7f2240ee7700 1 -- 172.21.15.22:0/1460546170 learned_addr learned my addr 172.21.15.22:0/1460546170 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223b7fe700 1 -- 172.21.15.22:0/1460546170 >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 msgr2=0x7f223c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223b7fe700 1 --2- 172.21.15.22:0/1460546170 >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 0x7f223c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223b7fe700 1 -- 172.21.15.22:0/1460546170 >> v1:172.21.15.192:6789/0 conn(0x7f223c159890 legacy=0x7f223c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223b7fe700 1 -- 172.21.15.22:0/1460546170 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c15a3d0 con 0x7f223c159c60 2023-10-08T00:33:02.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f2240ee7700 1 --2- 172.21.15.22:0/1460546170 >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 0x7f223c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223b7fe700 1 --2- 172.21.15.22:0/1460546170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c15d5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f22300098e0 tx=0x7f22300091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d2a571598cdcdee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223affd700 1 -- 172.21.15.22:0/1460546170 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000b640 con 0x7f223c159c60 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223affd700 1 -- 172.21.15.22:0/1460546170 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223000b7a0 con 0x7f223c159c60 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f223affd700 1 -- 172.21.15.22:0/1460546170 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000bb40 con 0x7f223c159c60 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f224294a700 1 -- 172.21.15.22:0/1460546170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 msgr2=0x7f223c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.208+0000 7f224294a700 1 --2- 172.21.15.22:0/1460546170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c15d5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f22300098e0 tx=0x7f22300091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.209+0000 7f224294a700 1 -- 172.21.15.22:0/1460546170 shutdown_connections 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.209+0000 7f224294a700 1 --2- 172.21.15.22:0/1460546170 >> v2:172.21.15.192:3300/0 conn(0x7f223c15db10 0x7f223c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.209+0000 7f224294a700 1 --2- 172.21.15.22:0/1460546170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c15d5d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.209+0000 7f224294a700 1 -- 172.21.15.22:0/1460546170 >> 172.21.15.22:0/1460546170 conn(0x7f223c068e20 msgr2=0x7f223c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.209+0000 7f224294a700 1 -- 172.21.15.22:0/1460546170 shutdown_connections 2023-10-08T00:33:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.209+0000 7f224294a700 1 -- 172.21.15.22:0/1460546170 wait complete. 2023-10-08T00:33:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.210+0000 7f224294a700 1 Processor -- start 2023-10-08T00:33:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.210+0000 7f224294a700 1 -- start start 2023-10-08T00:33:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223c159890 0x7f223c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 0x7f223c1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0c7b10 con 0x7f223c15db10 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b5260 con 0x7f223c159890 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b5540 con 0x7f223c159c60 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 0x7f223c1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 0x7f223c1471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36676/0 (socket says 172.21.15.22:36676) 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 -- 172.21.15.22:0/1734132893 learned_addr learned my addr 172.21.15.22:0/1734132893 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f223b7fe700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f223bfff700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223c159890 0x7f223c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 -- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 msgr2=0x7f223c0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c0ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 -- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223c159890 msgr2=0x7f223c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223c159890 0x7f223c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 -- 172.21.15.22:0/1734132893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009ae0 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2240ee7700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 0x7f223c1471f0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2234009f30 tx=0x7f223400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234018070 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400f040 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2230009420 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.211+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400cb70 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.212+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c0b5b00 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.213+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c04c3c0 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.213+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2234003020 con 0x7f223c15db10 2023-10-08T00:33:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.213+0000 7f2223fff700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2228067320 0x7f22280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.213+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2234085120 con 0x7f223c15db10 2023-10-08T00:33:02.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.213+0000 7f223bfff700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2228067320 0x7f22280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.214+0000 7f223bfff700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2228067320 0x7f22280697d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f222c003aa0 tx=0x7f222c000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.217+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2234051ca0 con 0x7f223c15db10 2023-10-08T00:33:02.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.455+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223c06a5b0 con 0x7f223c15db10 2023-10-08T00:33:02.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.455+0000 7f2223fff700 1 -- 172.21.15.22:0/1734132893 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f22340552c0 con 0x7f223c15db10 2023-10-08T00:33:02.456 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:02.456 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":107,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:47.063189+0000","modified":"2023-10-08T00:32:50.680465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7929":{"gid":7929,"name":"d","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/1078154935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1078154935},{"type":"v1","addr":"172.21.15.192:6836","nonce":1078154935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-08T00:33:02.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2228067320 msgr2=0x7f22280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2228067320 0x7f22280697d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f222c003aa0 tx=0x7f222c000bc0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 msgr2=0x7f223c1471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 0x7f223c1471f0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2234009f30 tx=0x7f223400b040 comp rx=0 tx=0).stop 2023-10-08T00:33:02.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 shutdown_connections 2023-10-08T00:33:02.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f223c15db10 0x7f223c1471f0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f223c159890 0x7f223c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2228067320 0x7f22280697d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 --2- 172.21.15.22:0/1734132893 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f223c159c60 0x7f223c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 >> 172.21.15.22:0/1734132893 conn(0x7f223c068e20 msgr2=0x7f223c15d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 shutdown_connections 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.457+0000 7f224294a700 1 -- 172.21.15.22:0/1734132893 wait complete. 2023-10-08T00:33:02.459 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 107 2023-10-08T00:33:02.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:02.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.589+0000 7fb065c99700 1 Processor -- start 2023-10-08T00:33:02.590 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.589+0000 7fb065c99700 1 -- start start 2023-10-08T00:33:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb065c99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb060159c60 0x7fb06015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb065c99700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb06015db10 0x7fb060069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb065c99700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06015a160 con 0x7fb060159890 2023-10-08T00:33:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb065c99700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0600d13a0 con 0x7fb06015db10 2023-10-08T00:33:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb065c99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015e140 con 0x7fb060159c60 2023-10-08T00:33:02.594 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb05f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb060159890 0x7fb06015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52562/0 (socket says 172.21.15.22:52562) 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb05f7fe700 1 -- 172.21.15.22:0/1562318790 learned_addr learned my addr 172.21.15.22:0/1562318790 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb05ffff700 1 --2- 172.21.15.22:0/1562318790 >> v2:172.21.15.192:3300/0 conn(0x7fb06015db10 0x7fb060069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.590+0000 7fb05effd700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb060159c60 0x7fb06015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738951926 0 0) 0x7fb06015a160 con 0x7fb060159890 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb048003570 con 0x7fb060159890 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2990424482 0 0) 0x7fb048003570 con 0x7fb060159890 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb060159c60 msgr2=0x7fb06015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb060159c60 0x7fb06015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 >> v2:172.21.15.192:3300/0 conn(0x7fb06015db10 msgr2=0x7fb060069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 --2- 172.21.15.22:0/1562318790 >> v2:172.21.15.192:3300/0 conn(0x7fb06015db10 0x7fb060069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06015a3d0 con 0x7fb060159890 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fb050001470 con 0x7fb060159890 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 >> v1:172.21.15.22:6789/0 conn(0x7fb060159890 legacy=0x7fb06015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb048003a60 0x7fb048003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb048004810 0x7fb048004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0480051c0 0x7fb04800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600d13a0 con 0x7fb0480051c0 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06015e140 con 0x7fb048003a60 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04800bfa0 con 0x7fb048004810 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05ffff700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0480051c0 0x7fb04800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05effd700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb060159c60 0x7fb06015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05f7fe700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb048003a60 0x7fb048003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05ffff700 1 -- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb048004810 msgr2=0x7fb048004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05ffff700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb048004810 0x7fb048004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05ffff700 1 -- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb048003a60 msgr2=0x7fb048003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05ffff700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb048003a60 0x7fb048003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.591+0000 7fb05ffff700 1 -- 172.21.15.22:0/1562318790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048003570 con 0x7fb0480051c0 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb05ffff700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0480051c0 0x7fb04800ba60 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e210 tx=0x7fb05800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9ea98e0ca20136 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800eac0 con 0x7fb0480051c0 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800f040 con 0x7fb0480051c0 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb05e7fc700 1 -- 172.21.15.22:0/1562318790 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800ee70 con 0x7fb0480051c0 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb065c99700 1 -- 172.21.15.22:0/1562318790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0480051c0 msgr2=0x7fb04800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb065c99700 1 --2- 172.21.15.22:0/1562318790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0480051c0 0x7fb04800ba60 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb05800e210 tx=0x7fb05800b040 comp rx=0 tx=0).stop 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb05ffff700 1 -- 172.21.15.22:0/1562318790 reap_dead start 2023-10-08T00:33:02.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb065c99700 1 -- 172.21.15.22:0/1562318790 shutdown_connections 2023-10-08T00:33:02.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb065c99700 1 -- 172.21.15.22:0/1562318790 >> 172.21.15.22:0/1562318790 conn(0x7fb060068e20 msgr2=0x7fb0600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:02.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb065c99700 1 -- 172.21.15.22:0/1562318790 shutdown_connections 2023-10-08T00:33:02.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.592+0000 7fb065c99700 1 -- 172.21.15.22:0/1562318790 wait complete. 2023-10-08T00:33:02.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.593+0000 7fb065c99700 1 Processor -- start 2023-10-08T00:33:02.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.593+0000 7fb065c99700 1 -- start start 2023-10-08T00:33:02.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb065c99700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 0x7fb060158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb065c99700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb060147520 0x7fb0600b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb065c99700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0600b46c0 0x7fb0600b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb065c99700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb060157240 con 0x7fb060147150 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb065c99700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600b6480 con 0x7fb060147520 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb065c99700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0600b4ea0 con 0x7fb0600b46c0 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb05f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 0x7fb060158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb05f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 0x7fb060158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36698/0 (socket says 172.21.15.22:36698) 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb05f7fe700 1 -- 172.21.15.22:0/3006621429 learned_addr learned my addr 172.21.15.22:0/3006621429 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb05effd700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb060147520 0x7fb0600b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.594+0000 7fb05ffff700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0600b46c0 0x7fb0600b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb05f7fe700 1 -- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0600b46c0 msgr2=0x7fb0600b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb05f7fe700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0600b46c0 0x7fb0600b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb05f7fe700 1 -- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb060147520 msgr2=0x7fb0600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb05f7fe700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb060147520 0x7fb0600b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb05f7fe700 1 -- 172.21.15.22:0/3006621429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0600b5180 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb05f7fe700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 0x7fb060158610 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fb05000eb60 tx=0x7fb050001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000a760 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050010040 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0600b5460 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05000ab30 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.595+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0600b5a20 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.596+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0600b5c40 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.596+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb05001d3b0 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.597+0000 7fb0477fe700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb04c067320 0x7fb04c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.597+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb050084300 con 0x7fb060147150 2023-10-08T00:33:02.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.597+0000 7fb05effd700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb04c067320 0x7fb04c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.597+0000 7fb05effd700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb04c067320 0x7fb04c0697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb0601562b0 tx=0x7fb0540091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.601+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb050050e80 con 0x7fb060147150 2023-10-08T00:33:02.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.801+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb06004c3c0 con 0x7fb060147150 2023-10-08T00:33:02.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.801+0000 7fb0477fe700 1 -- 172.21.15.22:0/3006621429 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fb050019090 con 0x7fb060147150 2023-10-08T00:33:02.802 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:02.802 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":156,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:48.650458+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:45.308417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:46.026650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:02.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb04c067320 msgr2=0x7fb04c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb04c067320 0x7fb04c0697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb0601562b0 tx=0x7fb0540091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 msgr2=0x7fb060158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 0x7fb060158610 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fb05000eb60 tx=0x7fb050001df0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 shutdown_connections 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb04c067320 0x7fb04c0697d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb0600b46c0 0x7fb0600b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb060147150 0x7fb060158610 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 --2- 172.21.15.22:0/3006621429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb060147520 0x7fb0600b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 >> 172.21.15.22:0/3006621429 conn(0x7fb060068e20 msgr2=0x7fb060152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 shutdown_connections 2023-10-08T00:33:02.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.803+0000 7fb065c99700 1 -- 172.21.15.22:0/3006621429 wait complete. 2023-10-08T00:33:02.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:32:45.308417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:32:46.026650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:33:02.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:33:02.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.937+0000 7f8af8565700 1 Processor -- start 2023-10-08T00:33:02.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.937+0000 7f8af8565700 1 -- start start 2023-10-08T00:33:02.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af8565700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8af0159890 0x7f8af015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af8565700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af0159c60 0x7f8af015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af8565700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af015a160 con 0x7f8af015db10 2023-10-08T00:33:02.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af8565700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00d13a0 con 0x7f8af0159890 2023-10-08T00:33:02.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af8565700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af015e140 con 0x7f8af0159c60 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af6301700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8af0159890 0x7f8af015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af6301700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8af0159890 0x7f8af015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36710/0 (socket says 172.21.15.22:36710) 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.938+0000 7f8af6301700 1 -- 172.21.15.22:0/4142009955 learned_addr learned my addr 172.21.15.22:0/4142009955 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af5b00700 1 --2- 172.21.15.22:0/4142009955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af0159c60 0x7f8af015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af6301700 1 -- 172.21.15.22:0/4142009955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af0159c60 msgr2=0x7f8af015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af6301700 1 --2- 172.21.15.22:0/4142009955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af0159c60 0x7f8af015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af6301700 1 -- 172.21.15.22:0/4142009955 >> v1:172.21.15.192:6789/0 conn(0x7f8af015db10 legacy=0x7f8af0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af6301700 1 -- 172.21.15.22:0/4142009955 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af015a3d0 con 0x7f8af0159890 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af6301700 1 --2- 172.21.15.22:0/4142009955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159890 0x7f8af015abd0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009f20 tx=0x7f8ae0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6556d4bfb9f92e0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af52ff700 1 -- 172.21.15.22:0/4142009955 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae000e070 con 0x7f8af0159890 2023-10-08T00:33:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af52ff700 1 -- 172.21.15.22:0/4142009955 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000ba40 con 0x7f8af0159890 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.939+0000 7f8af52ff700 1 -- 172.21.15.22:0/4142009955 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00092e0 con 0x7f8af0159890 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 -- 172.21.15.22:0/4142009955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159890 msgr2=0x7f8af015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 --2- 172.21.15.22:0/4142009955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159890 0x7f8af015abd0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009f20 tx=0x7f8ae0009840 comp rx=0 tx=0).stop 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 -- 172.21.15.22:0/4142009955 shutdown_connections 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 --2- 172.21.15.22:0/4142009955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159890 0x7f8af015abd0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 --2- 172.21.15.22:0/4142009955 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af0159c60 0x7f8af015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 -- 172.21.15.22:0/4142009955 >> 172.21.15.22:0/4142009955 conn(0x7f8af0068e20 msgr2=0x7f8af00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 -- 172.21.15.22:0/4142009955 shutdown_connections 2023-10-08T00:33:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.940+0000 7f8af8565700 1 -- 172.21.15.22:0/4142009955 wait complete. 2023-10-08T00:33:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 Processor -- start 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 -- start start 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af0159890 0x7f8af014bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 0x7f8af00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af015db10 0x7f8af01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00cfb00 con 0x7f8af0159c60 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00cf820 con 0x7f8af0159890 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.941+0000 7f8af8565700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af015eb40 con 0x7f8af015db10 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 0x7f8af00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 0x7f8af00cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36718/0 (socket says 172.21.15.22:36718) 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 -- 172.21.15.22:0/3254610723 learned_addr learned my addr 172.21.15.22:0/3254610723 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af6301700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af0159890 0x7f8af014bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af6b02700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af015db10 0x7f8af01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 -- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af015db10 msgr2=0x7f8af01523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af015db10 0x7f8af01523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 -- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af0159890 msgr2=0x7f8af014bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af0159890 0x7f8af014bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 -- 172.21.15.22:0/3254610723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae0009ae0 con 0x7f8af0159c60 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af5b00700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 0x7f8af00cee80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c850 tx=0x7f8ae4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011600 con 0x7f8af0159c60 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4011760 con 0x7f8af0159c60 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af015ee20 con 0x7f8af0159c60 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4011b20 con 0x7f8af0159c60 2023-10-08T00:33:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.942+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af014c180 con 0x7f8af0159c60 2023-10-08T00:33:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.943+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af015f340 con 0x7f8af0159c60 2023-10-08T00:33:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.944+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8ae40193f0 con 0x7f8af0159c60 2023-10-08T00:33:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.944+0000 7f8aee7fc700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8adc067320 0x7f8adc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.944+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ae4085270 con 0x7f8af0159c60 2023-10-08T00:33:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.944+0000 7f8af6301700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8adc067320 0x7f8adc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.945+0000 7f8af6301700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8adc067320 0x7f8adc0697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009880 tx=0x7f8ae0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:02.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:02.948+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8af015f340 con 0x7f8af0159c60 2023-10-08T00:33:03.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.144+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8af015f340 con 0x7f8af0159c60 2023-10-08T00:33:03.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.144+0000 7f8aee7fc700 1 -- 172.21.15.22:0/3254610723 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v156) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8af015f340 con 0x7f8af0159c60 2023-10-08T00:33:03.145 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8adc067320 msgr2=0x7f8adc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8adc067320 0x7f8adc0697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009880 tx=0x7f8ae0017000 comp rx=0 tx=0).stop 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 msgr2=0x7f8af00cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 0x7f8af00cee80 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c850 tx=0x7f8ae4008040 comp rx=0 tx=0).stop 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 shutdown_connections 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8adc067320 0x7f8adc0697d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8af015db10 0x7f8af01523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8af0159890 0x7f8af014bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 --2- 172.21.15.22:0/3254610723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8af0159c60 0x7f8af00cee80 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 >> 172.21.15.22:0/3254610723 conn(0x7f8af0068e20 msgr2=0x7f8af00b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:03.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 shutdown_connections 2023-10-08T00:33:03.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.146+0000 7f8af8565700 1 -- 172.21.15.22:0/3254610723 wait complete. 2023-10-08T00:33:03.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:33:03.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.279+0000 7f52bd9a4700 1 Processor -- start 2023-10-08T00:33:03.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.279+0000 7f52bd9a4700 1 -- start start 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52bd9a4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52b8159890 0x7f52b815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52bd9a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52bd9a4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b815a160 con 0x7f52b815db10 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52bd9a4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80d13a0 con 0x7f52b8159890 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52bd9a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b815e140 con 0x7f52b8159c60 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52b77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f52b815db10 0x7f52b8069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52564/0 (socket says 172.21.15.22:52564) 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52b6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f52b8159890 0x7f52b815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.280+0000 7f52b77fe700 1 -- 172.21.15.22:0/1821383700 learned_addr learned my addr 172.21.15.22:0/1821383700 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b67fc700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b6ffd700 1 -- 172.21.15.22:0/1821383700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 msgr2=0x7f52b815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:03.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b6ffd700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b6ffd700 1 -- 172.21.15.22:0/1821383700 >> v1:172.21.15.22:6789/0 conn(0x7f52b815db10 legacy=0x7f52b8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b6ffd700 1 -- 172.21.15.22:0/1821383700 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b815a3d0 con 0x7f52b8159890 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b67fc700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b6ffd700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b815abd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f52b00098e0 tx=0x7f52b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f147a2c1e7021bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b5ffb700 1 -- 172.21.15.22:0/1821383700 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0009e80 con 0x7f52b8159890 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b5ffb700 1 -- 172.21.15.22:0/1821383700 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000b860 con 0x7f52b8159890 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52b5ffb700 1 -- 172.21.15.22:0/1821383700 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000bbe0 con 0x7f52b8159890 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52bd9a4700 1 -- 172.21.15.22:0/1821383700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 msgr2=0x7f52b815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.281+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b815abd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f52b00098e0 tx=0x7f52b00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.282+0000 7f52bd9a4700 1 -- 172.21.15.22:0/1821383700 shutdown_connections 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.282+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b815abd0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.282+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/1821383700 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.282+0000 7f52bd9a4700 1 -- 172.21.15.22:0/1821383700 >> 172.21.15.22:0/1821383700 conn(0x7f52b8068e20 msgr2=0x7f52b80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:03.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.282+0000 7f52bd9a4700 1 -- 172.21.15.22:0/1821383700 shutdown_connections 2023-10-08T00:33:03.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.282+0000 7f52bd9a4700 1 -- 172.21.15.22:0/1821383700 wait complete. 2023-10-08T00:33:03.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.283+0000 7f52bd9a4700 1 Processor -- start 2023-10-08T00:33:03.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.283+0000 7f52bd9a4700 1 -- start start 2023-10-08T00:33:03.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b81472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b815db10 0x7f52b80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8169cf0 con 0x7f52b8159890 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8169f90 con 0x7f52b815db10 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b816a270 con 0x7f52b8159c60 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b81472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b81472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36722/0 (socket says 172.21.15.22:36722) 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 -- 172.21.15.22:0/3841596631 learned_addr learned my addr 172.21.15.22:0/3841596631 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b67fc700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b77fe700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b815db10 0x7f52b80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 -- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 msgr2=0x7f52b80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 -- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b815db10 msgr2=0x7f52b80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b815db10 0x7f52b80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 -- 172.21.15.22:0/3841596631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b0009420 con 0x7f52b8159890 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52b6ffd700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b81472f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f52b80899c0 tx=0x7f52b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b000bbe0 con 0x7f52b8159890 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0011420 con 0x7f52b8159890 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b816a550 con 0x7f52b8159890 2023-10-08T00:33:03.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00117e0 con 0x7f52b8159890 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.284+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8147830 con 0x7f52b8159890 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.285+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b816aa70 con 0x7f52b8159890 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.286+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f52b0011bd0 con 0x7f52b8159890 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.286+0000 7f52aeffd700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5298067320 0x7f52980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.286+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52b0086800 con 0x7f52b8159890 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.286+0000 7f52b67fc700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5298067320 0x7f52980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.287+0000 7f52b67fc700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5298067320 0x7f52980697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f52b815a090 tx=0x7f52a0006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.291+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52b816aa70 con 0x7f52b8159890 2023-10-08T00:33:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.483+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52b816aa70 con 0x7f52b8159890 2023-10-08T00:33:03.484 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.484+0000 7f52aeffd700 1 -- 172.21.15.22:0/3841596631 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v156) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52b816aa70 con 0x7f52b8159890 2023-10-08T00:33:03.484 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5298067320 msgr2=0x7f52980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5298067320 0x7f52980697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f52b815a090 tx=0x7f52a0006f90 comp rx=0 tx=0).stop 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 msgr2=0x7f52b81472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b81472f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f52b80899c0 tx=0x7f52b0017000 comp rx=0 tx=0).stop 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 shutdown_connections 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52b815db10 0x7f52b80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.485+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52b8159890 0x7f52b81472f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.486+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5298067320 0x7f52980697d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.486+0000 7f52bd9a4700 1 --2- 172.21.15.22:0/3841596631 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f52b8159c60 0x7f52b80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.486+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 >> 172.21.15.22:0/3841596631 conn(0x7f52b8068e20 msgr2=0x7f52b81541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:03.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.486+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 shutdown_connections 2023-10-08T00:33:03.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.486+0000 7f52bd9a4700 1 -- 172.21.15.22:0/3841596631 wait complete. 2023-10-08T00:33:03.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:33:03.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.621+0000 7fe0a9557700 1 Processor -- start 2023-10-08T00:33:03.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.621+0000 7fe0a9557700 1 -- start start 2023-10-08T00:33:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a9557700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0a4159c60 0x7fe0a415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a9557700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0a415db10 0x7fe0a4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a9557700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a415a160 con 0x7fe0a4159890 2023-10-08T00:33:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a9557700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a415df50 con 0x7fe0a4159c60 2023-10-08T00:33:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a9557700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a40d13a0 con 0x7fe0a415db10 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a27fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0a4159c60 0x7fe0a415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a2ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe0a4159890 0x7fe0a415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52576/0 (socket says 172.21.15.22:52576) 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a2ffd700 1 -- 172.21.15.22:0/2685891523 learned_addr learned my addr 172.21.15.22:0/2685891523 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.622+0000 7fe0a37fe700 1 --2- 172.21.15.22:0/2685891523 >> v2:172.21.15.192:3300/0 conn(0x7fe0a415db10 0x7fe0a4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a27fc700 1 -- 172.21.15.22:0/2685891523 >> v2:172.21.15.192:3300/0 conn(0x7fe0a415db10 msgr2=0x7fe0a4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a27fc700 1 --2- 172.21.15.22:0/2685891523 >> v2:172.21.15.192:3300/0 conn(0x7fe0a415db10 0x7fe0a4069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a27fc700 1 -- 172.21.15.22:0/2685891523 >> v1:172.21.15.22:6789/0 conn(0x7fe0a4159890 legacy=0x7fe0a415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a27fc700 1 -- 172.21.15.22:0/2685891523 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a415e140 con 0x7fe0a4159c60 2023-10-08T00:33:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a37fe700 1 --2- 172.21.15.22:0/2685891523 >> v2:172.21.15.192:3300/0 conn(0x7fe0a415db10 0x7fe0a4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a27fc700 1 --2- 172.21.15.22:0/2685891523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159c60 0x7fe0a415d5d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe0a406a890 tx=0x7fe08c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5fc7e70cfdbac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a1ffb700 1 -- 172.21.15.22:0/2685891523 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00b6b0 con 0x7fe0a4159c60 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a1ffb700 1 -- 172.21.15.22:0/2685891523 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c00b810 con 0x7fe0a4159c60 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a1ffb700 1 -- 172.21.15.22:0/2685891523 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00bbb0 con 0x7fe0a4159c60 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 -- 172.21.15.22:0/2685891523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159c60 msgr2=0x7fe0a415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2685891523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159c60 0x7fe0a415d5d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe0a406a890 tx=0x7fe08c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 -- 172.21.15.22:0/2685891523 shutdown_connections 2023-10-08T00:33:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2685891523 >> v2:172.21.15.192:3300/0 conn(0x7fe0a415db10 0x7fe0a4069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2685891523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159c60 0x7fe0a415d5d0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 -- 172.21.15.22:0/2685891523 >> 172.21.15.22:0/2685891523 conn(0x7fe0a4068e20 msgr2=0x7fe0a40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 -- 172.21.15.22:0/2685891523 shutdown_connections 2023-10-08T00:33:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.623+0000 7fe0a9557700 1 -- 172.21.15.22:0/2685891523 wait complete. 2023-10-08T00:33:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 Processor -- start 2023-10-08T00:33:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 -- start start 2023-10-08T00:33:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 0x7fe0a40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a4159c60 0x7fe0a4157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0a415db10 0x7fe0a4157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40b6260 con 0x7fe0a4159890 2023-10-08T00:33:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40b55e0 con 0x7fe0a4159c60 2023-10-08T00:33:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a9557700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40b58c0 con 0x7fe0a415db10 2023-10-08T00:33:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.625+0000 7fe0a2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 0x7fe0a40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.631 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 0x7fe0a40b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36734/0 (socket says 172.21.15.22:36734) 2023-10-08T00:33:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 -- 172.21.15.22:0/2360454027 learned_addr learned my addr 172.21.15.22:0/2360454027 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a27fc700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a4159c60 0x7fe0a4157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a37fe700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0a415db10 0x7fe0a4157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 -- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0a415db10 msgr2=0x7fe0a4157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0a415db10 0x7fe0a4157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 -- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a4159c60 msgr2=0x7fe0a4157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a4159c60 0x7fe0a4157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 -- 172.21.15.22:0/2360454027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c009420 con 0x7fe0a4159890 2023-10-08T00:33:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a27fc700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a4159c60 0x7fe0a4157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a2ffd700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 0x7fe0a40b4b00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe09400cd30 tx=0x7fe094001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe094004bb0 con 0x7fe0a4159890 2023-10-08T00:33:03.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe094004d10 con 0x7fe0a4159890 2023-10-08T00:33:03.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a40b5ba0 con 0x7fe0a4159890 2023-10-08T00:33:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400adc0 con 0x7fe0a4159890 2023-10-08T00:33:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.626+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a41521a0 con 0x7fe0a4159890 2023-10-08T00:33:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.627+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a404c3c0 con 0x7fe0a4159890 2023-10-08T00:33:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.628+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe094007300 con 0x7fe0a4159890 2023-10-08T00:33:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.628+0000 7fe09affd700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe084067320 0x7fe0840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.628+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe094084660 con 0x7fe0a4159890 2023-10-08T00:33:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.628+0000 7fe0a27fc700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe084067320 0x7fe0840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.629+0000 7fe0a27fc700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe084067320 0x7fe0840697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0093f0 tx=0x7fe08c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.633+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe094051370 con 0x7fe0a4159890 2023-10-08T00:33:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.829+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0a406a5b0 con 0x7fe0a4159890 2023-10-08T00:33:03.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.829+0000 7fe09affd700 1 -- 172.21.15.22:0/2360454027 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v156) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe094054990 con 0x7fe0a4159890 2023-10-08T00:33:03.830 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:33:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe084067320 msgr2=0x7fe0840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe084067320 0x7fe0840697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0093f0 tx=0x7fe08c017000 comp rx=0 tx=0).stop 2023-10-08T00:33:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 msgr2=0x7fe0a40b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 0x7fe0a40b4b00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe09400cd30 tx=0x7fe094001ad0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 shutdown_connections 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe084067320 0x7fe0840697d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe0a415db10 0x7fe0a4157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0a4159890 0x7fe0a40b4b00 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 --2- 172.21.15.22:0/2360454027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a4159c60 0x7fe0a4157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 >> 172.21.15.22:0/2360454027 conn(0x7fe0a4068e20 msgr2=0x7fe0a4153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 shutdown_connections 2023-10-08T00:33:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.831+0000 7fe0a9557700 1 -- 172.21.15.22:0/2360454027 wait complete. 2023-10-08T00:33:03.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:03.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.963+0000 7f1aff093700 1 Processor -- start 2023-10-08T00:33:03.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.963+0000 7f1aff093700 1 -- start start 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.963+0000 7f1aff093700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1af8159890 0x7f1af815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.963+0000 7f1aff093700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1aff093700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1af815db10 0x7f1af8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1aff093700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af815a160 con 0x7f1af8159890 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1aff093700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af80d13a0 con 0x7f1af815db10 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1aff093700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af815e140 con 0x7f1af8159c60 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1af8159890 0x7f1af815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1af8159890 0x7f1af815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36736/0 (socket says 172.21.15.22:36736) 2023-10-08T00:33:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 -- 172.21.15.22:0/1281364301 learned_addr learned my addr 172.21.15.22:0/1281364301 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1af7fff700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 -- 172.21.15.22:0/1281364301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 msgr2=0x7f1af815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afd630700 1 --2- 172.21.15.22:0/1281364301 >> v2:172.21.15.192:3300/0 conn(0x7f1af815db10 0x7f1af8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 -- 172.21.15.22:0/1281364301 >> v2:172.21.15.192:3300/0 conn(0x7f1af815db10 msgr2=0x7f1af8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 --2- 172.21.15.22:0/1281364301 >> v2:172.21.15.192:3300/0 conn(0x7f1af815db10 0x7f1af8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 -- 172.21.15.22:0/1281364301 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af815a3d0 con 0x7f1af8159890 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afd630700 1 --2- 172.21.15.22:0/1281364301 >> v2:172.21.15.192:3300/0 conn(0x7f1af815db10 0x7f1af8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1af7fff700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1afce2f700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af815abd0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1af8089b50 tx=0x7f1ae0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e787b70cdfea0ebd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1af77fe700 1 -- 172.21.15.22:0/1281364301 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000b860 con 0x7f1af8159890 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1af77fe700 1 -- 172.21.15.22:0/1281364301 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000b9c0 con 0x7f1af8159890 2023-10-08T00:33:03.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.964+0000 7f1af77fe700 1 -- 172.21.15.22:0/1281364301 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000bd60 con 0x7f1af8159890 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 -- 172.21.15.22:0/1281364301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 msgr2=0x7f1af815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af815abd0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1af8089b50 tx=0x7f1ae0009250 comp rx=0 tx=0).stop 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 -- 172.21.15.22:0/1281364301 shutdown_connections 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af815abd0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 --2- 172.21.15.22:0/1281364301 >> v2:172.21.15.192:3300/0 conn(0x7f1af815db10 0x7f1af8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 --2- 172.21.15.22:0/1281364301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 -- 172.21.15.22:0/1281364301 >> 172.21.15.22:0/1281364301 conn(0x7f1af8068e20 msgr2=0x7f1af80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 -- 172.21.15.22:0/1281364301 shutdown_connections 2023-10-08T00:33:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.965+0000 7f1aff093700 1 -- 172.21.15.22:0/1281364301 wait complete. 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.966+0000 7f1aff093700 1 Processor -- start 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.966+0000 7f1aff093700 1 -- start start 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1aff093700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1aff093700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1aff093700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815db10 0x7f1af8153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1aff093700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80cd0c0 con 0x7f1af8159890 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1aff093700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af815cf60 con 0x7f1af815db10 2023-10-08T00:33:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1aff093700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80cd310 con 0x7f1af8159c60 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36752/0 (socket says 172.21.15.22:36752) 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 -- 172.21.15.22:0/2040679227 learned_addr learned my addr 172.21.15.22:0/2040679227 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afd630700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815db10 0x7f1af8153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1af7fff700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 -- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 msgr2=0x7f1af8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 -- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815db10 msgr2=0x7f1af8153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815db10 0x7f1af8153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 -- 172.21.15.22:0/2040679227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00094f0 con 0x7f1af8159890 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1af7fff700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.967+0000 7f1afce2f700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af814b3c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1af8070e20 tx=0x7f1ae0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.968+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0024440 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.968+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00245a0 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.968+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af80cd5f0 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.968+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0024960 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.968+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af814b900 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.969+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af80cdb10 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.969+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1ae001a420 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.970+0000 7f1af4ff9700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ad8067320 0x7f1ad80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.970+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ae0086ad0 con 0x7f1af8159890 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.970+0000 7f1af7fff700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ad8067320 0x7f1ad80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.970+0000 7f1af7fff700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ad8067320 0x7f1ad80697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1af81510c0 tx=0x7f1ae8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:03.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:03.974+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1af80cdb10 con 0x7f1af8159890 2023-10-08T00:33:04.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.214+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1af80cdb10 con 0x7f1af8159890 2023-10-08T00:33:04.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.215+0000 7f1af4ff9700 1 -- 172.21.15.22:0/2040679227 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f1af80cdb10 con 0x7f1af8159890 2023-10-08T00:33:04.216 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:04.216 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":107,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:47.063189+0000","modified":"2023-10-08T00:32:50.680465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7929":{"gid":7929,"name":"d","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/1078154935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1078154935},{"type":"v1","addr":"172.21.15.192:6836","nonce":1078154935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-08T00:33:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ad8067320 msgr2=0x7f1ad80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ad8067320 0x7f1ad80697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1af81510c0 tx=0x7f1ae8008040 comp rx=0 tx=0).stop 2023-10-08T00:33:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 msgr2=0x7f1af814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af814b3c0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1af8070e20 tx=0x7f1ae0017000 comp rx=0 tx=0).stop 2023-10-08T00:33:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 shutdown_connections 2023-10-08T00:33:04.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815db10 0x7f1af8153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af8159890 0x7f1af814b3c0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ad8067320 0x7f1ad80697d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 --2- 172.21.15.22:0/2040679227 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af8159c60 0x7f1af8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 >> 172.21.15.22:0/2040679227 conn(0x7f1af8068e20 msgr2=0x7f1af814d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 shutdown_connections 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.217+0000 7f1aff093700 1 -- 172.21.15.22:0/2040679227 wait complete. 2023-10-08T00:33:04.219 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 107 2023-10-08T00:33:04.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:04.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.348+0000 7fcc8759e700 1 Processor -- start 2023-10-08T00:33:04.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.348+0000 7fcc8759e700 1 -- start start 2023-10-08T00:33:04.352 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc8759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcc881597f0 0x7fcc880b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc8759e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880b11d0 con 0x7fcc8815d230 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc8759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880b14b0 con 0x7fcc88159420 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc8759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc880b1790 con 0x7fcc881597f0 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc86d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcc8815d230 0x7fcc8815d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52592/0 (socket says 172.21.15.22:52592) 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc86d9d700 1 -- 172.21.15.22:0/1584183274 learned_addr learned my addr 172.21.15.22:0/1584183274 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/1584183274 >> v2:172.21.15.192:3300/0 conn(0x7fcc881597f0 0x7fcc880b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832418657 0 0) 0x7fcc880b11d0 con 0x7fcc8815d230 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.349+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc74003570 con 0x7fcc8815d230 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3240579136 0 0) 0x7fcc74003570 con 0x7fcc8815d230 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 >> v2:172.21.15.192:3300/0 conn(0x7fcc881597f0 msgr2=0x7fcc880b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 --2- 172.21.15.22:0/1584183274 >> v2:172.21.15.192:3300/0 conn(0x7fcc881597f0 0x7fcc880b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.353 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 >> v1:172.21.15.192:6789/0 conn(0x7fcc88159420 legacy=0x7fcc880b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880b1a70 con 0x7fcc8815d230 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fcc780017f0 con 0x7fcc8815d230 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 >> v1:172.21.15.22:6789/0 conn(0x7fcc8815d230 legacy=0x7fcc8815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74003a60 0x7fcc74003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc74004810 0x7fcc74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc740051c0 0x7fcc7400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880b1790 con 0x7fcc74004810 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7400c0d0 con 0x7fcc74003a60 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7400c290 con 0x7fcc740051c0 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc74004810 0x7fcc74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.354 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8659c700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74003a60 0x7fcc74003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc86d9d700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc740051c0 0x7fcc7400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 -- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc740051c0 msgr2=0x7fcc7400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc740051c0 0x7fcc7400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 -- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74003a60 msgr2=0x7fcc74003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74003a60 0x7fcc74003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 -- 172.21.15.22:0/1584183274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74003570 con 0x7fcc74004810 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc86d9d700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc740051c0 0x7fcc7400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc86d9d700 1 -- 172.21.15.22:0/1584183274 reap_dead start 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc74004810 0x7fcc74004c80 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcc88159c70 tx=0x7fcc700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2ef957592d2f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000e710 con 0x7fcc74004810 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000e870 con 0x7fcc74004810 2023-10-08T00:33:04.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.350+0000 7fcc8559a700 1 -- 172.21.15.22:0/1584183274 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000ec30 con 0x7fcc74004810 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 -- 172.21.15.22:0/1584183274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc74004810 msgr2=0x7fcc74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc74004810 0x7fcc74004c80 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcc88159c70 tx=0x7fcc700091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 -- 172.21.15.22:0/1584183274 shutdown_connections 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 --2- 172.21.15.22:0/1584183274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc74004810 0x7fcc74004c80 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 -- 172.21.15.22:0/1584183274 >> 172.21.15.22:0/1584183274 conn(0x7fcc880d0660 msgr2=0x7fcc880d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 -- 172.21.15.22:0/1584183274 shutdown_connections 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.351+0000 7fcc8759e700 1 -- 172.21.15.22:0/1584183274 wait complete. 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.352+0000 7fcc8759e700 1 Processor -- start 2023-10-08T00:33:04.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.352+0000 7fcc8759e700 1 -- start start 2023-10-08T00:33:04.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74004810 0x7fcc880c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 0x7fcc8816d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc8816d9d0 0x7fcc880c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8816cd20 con 0x7fcc880b5ac0 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8816d000 con 0x7fcc74004810 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880cbd00 con 0x7fcc8816d9d0 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 0x7fcc8816d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 0x7fcc8816d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36770/0 (socket says 172.21.15.22:36770) 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 -- 172.21.15.22:0/3935634810 learned_addr learned my addr 172.21.15.22:0/3935634810 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8659c700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74004810 0x7fcc880c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc86d9d700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc8816d9d0 0x7fcc880c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 -- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc8816d9d0 msgr2=0x7fcc880c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc8816d9d0 0x7fcc880c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 -- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74004810 msgr2=0x7fcc880c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74004810 0x7fcc880c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 -- 172.21.15.22:0/3935634810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880cbfe0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc86d9d700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc8816d9d0 0x7fcc880c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc85d9b700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 0x7fcc8816d490 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000e4b0 tx=0x7fcc7001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc70022070 con 0x7fcc880b5ac0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7000e9e0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc880cc2c0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.353+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7000e710 con 0x7fcc880b5ac0 2023-10-08T00:33:04.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.354+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc880c78e0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.354+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8804c3c0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.355+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcc7001c450 con 0x7fcc880b5ac0 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.355+0000 7fcc7e7fc700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc68067320 0x7fcc680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.355+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc700867c0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.355+0000 7fcc8659c700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc68067320 0x7fcc680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.356+0000 7fcc8659c700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc68067320 0x7fcc680697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc80000c00 tx=0x7fcc80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:04.361 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.359+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc700534d0 con 0x7fcc880b5ac0 2023-10-08T00:33:04.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.553+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc880b1d50 con 0x7fcc880b5ac0 2023-10-08T00:33:04.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.554+0000 7fcc7e7fc700 1 -- 172.21.15.22:0/3935634810 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15364 (secure 0 0 0) 0x7fcc70056a70 con 0x7fcc880b5ac0 2023-10-08T00:33:04.554 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:04.554 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":156,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:48.650458+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:45.308417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:46.026650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:04.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.555+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc68067320 msgr2=0x7fcc680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.555+0000 7fcc8759e700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc68067320 0x7fcc680697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcc80000c00 tx=0x7fcc80009040 comp rx=0 tx=0).stop 2023-10-08T00:33:04.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.555+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 msgr2=0x7fcc8816d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.555+0000 7fcc8759e700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 0x7fcc8816d490 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000e4b0 tx=0x7fcc7001a000 comp rx=0 tx=0).stop 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 shutdown_connections 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc68067320 0x7fcc680697d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc8816d9d0 0x7fcc880c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc74004810 0x7fcc880c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 --2- 172.21.15.22:0/3935634810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc880b5ac0 0x7fcc8816d490 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 >> 172.21.15.22:0/3935634810 conn(0x7fcc880d0660 msgr2=0x7fcc88069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 shutdown_connections 2023-10-08T00:33:04.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.556+0000 7fcc8759e700 1 -- 172.21.15.22:0/3935634810 wait complete. 2023-10-08T00:33:04.568 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:33:04.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:04.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.688+0000 7ff022ff3700 1 Processor -- start 2023-10-08T00:33:04.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.688+0000 7ff022ff3700 1 -- start start 2023-10-08T00:33:04.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff022ff3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff01c159c60 0x7ff01c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff022ff3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff022ff3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c15a160 con 0x7ff01c159890 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff022ff3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c15df50 con 0x7ff01c159c60 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff022ff3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0d13a0 con 0x7ff01c15db10 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff01c159c60 0x7ff01c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff020d8f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff01c159890 0x7ff01c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52608/0 (socket says 172.21.15.22:52608) 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff020d8f700 1 -- 172.21.15.22:0/3073967365 learned_addr learned my addr 172.21.15.22:0/3073967365 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff021590700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01bfff700 1 -- 172.21.15.22:0/3073967365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 msgr2=0x7ff01c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01bfff700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01bfff700 1 -- 172.21.15.22:0/3073967365 >> v1:172.21.15.22:6789/0 conn(0x7ff01c159890 legacy=0x7ff01c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01b7fe700 1 -- 172.21.15.22:0/3073967365 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521966404 0 0) 0x7ff01c15a160 con 0x7ff01c159890 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01bfff700 1 -- 172.21.15.22:0/3073967365 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c15e140 con 0x7ff01c159c60 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff021590700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01bfff700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159c60 0x7ff01c15d5d0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098e0 tx=0x7ff0040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e28b4c40c4c1b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01b7fe700 1 -- 172.21.15.22:0/3073967365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff004009e80 con 0x7ff01c159c60 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01b7fe700 1 -- 172.21.15.22:0/3073967365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00400b860 con 0x7ff01c159c60 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.689+0000 7ff01b7fe700 1 -- 172.21.15.22:0/3073967365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400bbe0 con 0x7ff01c159c60 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 -- 172.21.15.22:0/3073967365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159c60 msgr2=0x7ff01c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159c60 0x7ff01c15d5d0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098e0 tx=0x7ff0040091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 -- 172.21.15.22:0/3073967365 shutdown_connections 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 --2- 172.21.15.22:0/3073967365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159c60 0x7ff01c15d5d0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 -- 172.21.15.22:0/3073967365 >> 172.21.15.22:0/3073967365 conn(0x7ff01c068e20 msgr2=0x7ff01c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:04.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 -- 172.21.15.22:0/3073967365 shutdown_connections 2023-10-08T00:33:04.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.690+0000 7ff022ff3700 1 -- 172.21.15.22:0/3073967365 wait complete. 2023-10-08T00:33:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.691+0000 7ff022ff3700 1 Processor -- start 2023-10-08T00:33:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.691+0000 7ff022ff3700 1 -- start start 2023-10-08T00:33:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff022ff3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 0x7ff01c0b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff022ff3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c159c60 0x7ff01c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff022ff3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff022ff3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b36c0 con 0x7ff01c159890 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff022ff3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b39a0 con 0x7ff01c159c60 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff022ff3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0b0ff0 con 0x7ff01c15db10 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 0x7ff01c0b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 0x7ff01c0b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36794/0 (socket says 172.21.15.22:36794) 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 -- 172.21.15.22:0/1581904457 learned_addr learned my addr 172.21.15.22:0/1581904457 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff021590700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff01bfff700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c159c60 0x7ff01c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 -- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 msgr2=0x7ff01c0cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c0cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 -- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c159c60 msgr2=0x7ff01c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c159c60 0x7ff01c0cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.692+0000 7ff020d8f700 1 -- 172.21.15.22:0/1581904457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004009420 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.693+0000 7ff020d8f700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 0x7ff01c0b1ad0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00cd80 tx=0x7ff00c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.693+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c00aa60 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.693+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c00abc0 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.693+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c0b12d0 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.693+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c0070f0 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.693+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c0cfad0 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.694+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c04c3c0 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.694+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff00c0074e0 con 0x7ff01c159890 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.695+0000 7ff018ff9700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feffc067320 0x7feffc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:04.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.695+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff00c085000 con 0x7ff01c159890 2023-10-08T00:33:04.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.695+0000 7ff01bfff700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feffc067320 0x7feffc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:04.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.695+0000 7ff01bfff700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feffc067320 0x7feffc0697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff0040091e0 tx=0x7ff004017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:04.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.699+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff00c051d10 con 0x7ff01c159890 2023-10-08T00:33:04.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.938+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff01c06a5b0 con 0x7ff01c159890 2023-10-08T00:33:04.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.938+0000 7ff018ff9700 1 -- 172.21.15.22:0/1581904457 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4610 (secure 0 0 0) 0x7ff00c001c20 con 0x7ff01c159890 2023-10-08T00:33:04.941 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:04.942 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":107,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:47.063189+0000","modified":"2023-10-08T00:32:50.680465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7929":{"gid":7929,"name":"d","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/1078154935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1078154935},{"type":"v1","addr":"172.21.15.192:6836","nonce":1078154935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feffc067320 msgr2=0x7feffc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feffc067320 0x7feffc0697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff0040091e0 tx=0x7ff004017000 comp rx=0 tx=0).stop 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 msgr2=0x7ff01c0b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 0x7ff01c0b1ad0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00cd80 tx=0x7ff00c001ae0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 shutdown_connections 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feffc067320 0x7feffc0697d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff01c15db10 0x7ff01c0cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff01c159890 0x7ff01c0b1ad0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 --2- 172.21.15.22:0/1581904457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c159c60 0x7ff01c0cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:04.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 >> 172.21.15.22:0/1581904457 conn(0x7ff01c068e20 msgr2=0x7ff01c155310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:04.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 shutdown_connections 2023-10-08T00:33:04.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:04.940+0000 7ff022ff3700 1 -- 172.21.15.22:0/1581904457 wait complete. 2023-10-08T00:33:04.944 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 107 2023-10-08T00:33:04.953 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.072+0000 7fbf9c098700 1 Processor -- start 2023-10-08T00:33:05.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.072+0000 7fbf9c098700 1 -- start start 2023-10-08T00:33:05.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf9c098700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf94159890 0x7fbf9415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf9c098700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94069560 0x7fbf940699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf9c098700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf94069ee0 con 0x7fbf94159c60 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf9c098700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9415a160 con 0x7fbf94159890 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf9c098700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940d13a0 con 0x7fbf94069560 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf94159890 0x7fbf9415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf94159890 0x7fbf9415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36796/0 (socket says 172.21.15.22:36796) 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 -- 172.21.15.22:0/1515484990 learned_addr learned my addr 172.21.15.22:0/1515484990 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf9a635700 1 --2- 172.21.15.22:0/1515484990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94069560 0x7fbf940699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 -- 172.21.15.22:0/1515484990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94069560 msgr2=0x7fbf940699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 --2- 172.21.15.22:0/1515484990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94069560 0x7fbf940699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 -- 172.21.15.22:0/1515484990 >> v1:172.21.15.192:6789/0 conn(0x7fbf94159c60 legacy=0x7fbf9415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 -- 172.21.15.22:0/1515484990 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9415e140 con 0x7fbf94159890 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf99e34700 1 --2- 172.21.15.22:0/1515484990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf9415abd0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009f20 tx=0x7fbf84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7616605915c72619 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf98e32700 1 -- 172.21.15.22:0/1515484990 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400e070 con 0x7fbf94159890 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf98e32700 1 -- 172.21.15.22:0/1515484990 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400b9d0 con 0x7fbf94159890 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.073+0000 7fbf98e32700 1 -- 172.21.15.22:0/1515484990 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840092e0 con 0x7fbf94159890 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 -- 172.21.15.22:0/1515484990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 msgr2=0x7fbf9415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 --2- 172.21.15.22:0/1515484990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf9415abd0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009f20 tx=0x7fbf84009840 comp rx=0 tx=0).stop 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 -- 172.21.15.22:0/1515484990 shutdown_connections 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 --2- 172.21.15.22:0/1515484990 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94069560 0x7fbf940699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 --2- 172.21.15.22:0/1515484990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf9415abd0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 -- 172.21.15.22:0/1515484990 >> 172.21.15.22:0/1515484990 conn(0x7fbf94068e20 msgr2=0x7fbf940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:05.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 -- 172.21.15.22:0/1515484990 shutdown_connections 2023-10-08T00:33:05.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.074+0000 7fbf9c098700 1 -- 172.21.15.22:0/1515484990 wait complete. 2023-10-08T00:33:05.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.075+0000 7fbf9c098700 1 Processor -- start 2023-10-08T00:33:05.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.075+0000 7fbf9c098700 1 -- start start 2023-10-08T00:33:05.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9c098700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94069560 0x7fbf9414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9c098700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf940c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9c098700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94159c60 0x7fbf941524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9c098700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9414d330 con 0x7fbf94159890 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9c098700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940ca380 con 0x7fbf94069560 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9c098700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940c8b00 con 0x7fbf94159c60 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf940c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf940c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36812/0 (socket says 172.21.15.22:36812) 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 -- 172.21.15.22:0/2899615771 learned_addr learned my addr 172.21.15.22:0/2899615771 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf9a635700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94159c60 0x7fbf941524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99e34700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94069560 0x7fbf9414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 -- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94159c60 msgr2=0x7fbf941524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94159c60 0x7fbf941524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 -- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94069560 msgr2=0x7fbf9414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94069560 0x7fbf9414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 -- 172.21.15.22:0/2899615771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009ae0 con 0x7fbf94159890 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.076+0000 7fbf99633700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf940c8eb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c590 tx=0x7fbf8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.077+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88011590 con 0x7fbf94159890 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.077+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88011710 con 0x7fbf94159890 2023-10-08T00:33:05.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.077+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf940c9770 con 0x7fbf94159890 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.077+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88011ad0 con 0x7fbf94159890 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.077+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf940c9d30 con 0x7fbf94159890 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.078+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf940ca530 con 0x7fbf94159890 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.078+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbf8801c440 con 0x7fbf94159890 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.079+0000 7fbf91ffb700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf80067320 0x7fbf800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.079+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf88084050 con 0x7fbf94159890 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.079+0000 7fbf99e34700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf80067320 0x7fbf800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.079+0000 7fbf99e34700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf80067320 0x7fbf800697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009880 tx=0x7fbf84018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.083+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf940ca530 con 0x7fbf94159890 2023-10-08T00:33:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.323+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf940ca6f0 con 0x7fbf94159890 2023-10-08T00:33:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.324+0000 7fbf91ffb700 1 -- 172.21.15.22:0/2899615771 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fbf88017070 con 0x7fbf94159890 2023-10-08T00:33:05.324 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:05.325 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":107,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:32:47.063189+0000","modified":"2023-10-08T00:32:50.680465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7929":{"gid":7929,"name":"d","rank":0,"incarnation":102,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/1078154935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1078154935},{"type":"v1","addr":"172.21.15.192:6836","nonce":1078154935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-08T00:33:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf80067320 msgr2=0x7fbf800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf80067320 0x7fbf800697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbf84009880 tx=0x7fbf84018000 comp rx=0 tx=0).stop 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 msgr2=0x7fbf940c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf940c8eb0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c590 tx=0x7fbf8800c8a0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 shutdown_connections 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbf80067320 0x7fbf800697d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbf94159c60 0x7fbf941524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbf94069560 0x7fbf9414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 --2- 172.21.15.22:0/2899615771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf94159890 0x7fbf940c8eb0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 >> 172.21.15.22:0/2899615771 conn(0x7fbf94068e20 msgr2=0x7fbf9415c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 shutdown_connections 2023-10-08T00:33:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.326+0000 7fbf9c098700 1 -- 172.21.15.22:0/2899615771 wait complete. 2023-10-08T00:33:05.328 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 107 2023-10-08T00:33:05.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:05.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.457+0000 7f57d50f4700 1 Processor -- start 2023-10-08T00:33:05.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.457+0000 7f57d50f4700 1 -- start start 2023-10-08T00:33:05.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d50f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d50f4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57d015d230 0x7f57d015d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d50f4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d015dbd0 con 0x7f57d01597f0 2023-10-08T00:33:05.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d50f4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00b2980 con 0x7f57d015d230 2023-10-08T00:33:05.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d50f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00b11d0 con 0x7f57d0159420 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d48f3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57d015d230 0x7f57d015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d48f3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57d015d230 0x7f57d015d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36826/0 (socket says 172.21.15.22:36826) 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d48f3700 1 -- 172.21.15.22:0/1898787937 learned_addr learned my addr 172.21.15.22:0/1898787937 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57cffff700 1 --2- 172.21.15.22:0/1898787937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.458+0000 7f57d48f3700 1 -- 172.21.15.22:0/1898787937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 msgr2=0x7f57d00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d48f3700 1 --2- 172.21.15.22:0/1898787937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d48f3700 1 -- 172.21.15.22:0/1898787937 >> v1:172.21.15.192:6789/0 conn(0x7f57d01597f0 legacy=0x7f57d00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d48f3700 1 -- 172.21.15.22:0/1898787937 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00b14b0 con 0x7f57d015d230 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d48f3700 1 --2- 172.21.15.22:0/1898787937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d015d230 0x7f57d015d690 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009f20 tx=0x7f57c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53694966fd0048ee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57ceffd700 1 -- 172.21.15.22:0/1898787937 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800e070 con 0x7f57d015d230 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57ceffd700 1 -- 172.21.15.22:0/1898787937 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c800b9d0 con 0x7f57d015d230 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57ceffd700 1 -- 172.21.15.22:0/1898787937 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80092e0 con 0x7f57d015d230 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 -- 172.21.15.22:0/1898787937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d015d230 msgr2=0x7f57d015d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1898787937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d015d230 0x7f57d015d690 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f57c8009f20 tx=0x7f57c8009840 comp rx=0 tx=0).stop 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 -- 172.21.15.22:0/1898787937 shutdown_connections 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1898787937 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d015d230 0x7f57d015d690 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1898787937 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 -- 172.21.15.22:0/1898787937 >> 172.21.15.22:0/1898787937 conn(0x7f57d00d0660 msgr2=0x7f57d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 -- 172.21.15.22:0/1898787937 shutdown_connections 2023-10-08T00:33:05.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.459+0000 7f57d50f4700 1 -- 172.21.15.22:0/1898787937 wait complete. 2023-10-08T00:33:05.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 Processor -- start 2023-10-08T00:33:05.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 -- start start 2023-10-08T00:33:05.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d015b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 0x7f57d0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d015d230 0x7f57d015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d016a590 con 0x7f57d01597f0 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0169a10 con 0x7f57d015d230 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.461+0000 7f57d50f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0169cf0 con 0x7f57d0159420 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 0x7f57d0153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 0x7f57d0153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36840/0 (socket says 172.21.15.22:36840) 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 -- 172.21.15.22:0/1646266135 learned_addr learned my addr 172.21.15.22:0/1646266135 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57d48f3700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d015d230 0x7f57d015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cffff700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d015b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 -- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 msgr2=0x7f57d015b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d015b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 -- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d015d230 msgr2=0x7f57d015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d015d230 0x7f57d015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 -- 172.21.15.22:0/1646266135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8009ae0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57d48f3700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d015d230 0x7f57d015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57cf7fe700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 0x7f57d0153c60 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c590 tx=0x7f57c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011590 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40116f0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d0169fd0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011ab0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.462+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d015a6b0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.463+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d004c3c0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.464+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f57c401b3b0 con 0x7f57d01597f0 2023-10-08T00:33:05.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.464+0000 7f57b7fff700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57bc067320 0x7f57bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.464+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f57c4084010 con 0x7f57d01597f0 2023-10-08T00:33:05.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.464+0000 7f57cffff700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57bc067320 0x7f57bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.465+0000 7f57cffff700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57bc067320 0x7f57bc0697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009d40 tx=0x7f57c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.468+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57c4050ca0 con 0x7f57d01597f0 2023-10-08T00:33:05.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.662+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57d015dbd0 con 0x7f57d01597f0 2023-10-08T00:33:05.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.662+0000 7f57b7fff700 1 -- 172.21.15.22:0/1646266135 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f57d015dbd0 con 0x7f57d01597f0 2023-10-08T00:33:05.663 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:05.663 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":156,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:32:48.650458+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:32:45.308417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-08T00:32:46.026650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57bc067320 msgr2=0x7f57bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57bc067320 0x7f57bc0697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009d40 tx=0x7f57c0008040 comp rx=0 tx=0).stop 2023-10-08T00:33:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 msgr2=0x7f57d0153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 0x7f57d0153c60 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c590 tx=0x7f57c400c950 comp rx=0 tx=0).stop 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 shutdown_connections 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57d015d230 0x7f57d015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f57bc067320 0x7f57bc0697d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f57d0159420 0x7f57d015b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.664+0000 7f57d50f4700 1 --2- 172.21.15.22:0/1646266135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57d01597f0 0x7f57d0153c60 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.665+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 >> 172.21.15.22:0/1646266135 conn(0x7f57d00d0660 msgr2=0x7f57d0158280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.665+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 shutdown_connections 2023-10-08T00:33:05.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.665+0000 7f57d50f4700 1 -- 172.21.15.22:0/1646266135 wait complete. 2023-10-08T00:33:05.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:33:05.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.797+0000 7fa26482f700 1 Processor -- start 2023-10-08T00:33:05.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.798+0000 7fa26482f700 1 -- start start 2023-10-08T00:33:05.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.798+0000 7fa26482f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 0x7fa2600699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.798+0000 7fa26482f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa260069ee0 con 0x7fa260159890 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.798+0000 7fa26482f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015a160 con 0x7fa260159c60 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.798+0000 7fa26482f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600d13a0 con 0x7fa260069560 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa260159890 0x7fa26015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:52618/0 (socket says 172.21.15.22:52618) 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25e59c700 1 -- 172.21.15.22:0/2652183044 learned_addr learned my addr 172.21.15.22:0/2652183044 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25ed9d700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 0x7fa2600699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378276120 0 0) 0x7fa260069ee0 con 0x7fa260159890 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa24c003570 con 0x7fa260159890 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1020117422 0 0) 0x7fa24c003570 con 0x7fa260159890 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 msgr2=0x7fa2600699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:05.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 0x7fa2600699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 >> v1:172.21.15.192:6789/0 conn(0x7fa260159c60 legacy=0x7fa26015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26015e140 con 0x7fa260159890 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fa258001470 con 0x7fa260159890 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 >> v1:172.21.15.22:6789/0 conn(0x7fa260159890 legacy=0x7fa26015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa24c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 0x7fa24c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa24c004d50 0x7fa24c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600d13a0 con 0x7fa24c003a90 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c00bba0 con 0x7fa24c004d50 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c00bd60 con 0x7fa260069560 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.799+0000 7fa25e59c700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa24c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.803 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25dd9b700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 0x7fa24c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25ed9d700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa24c004d50 0x7fa24c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25e59c700 1 -- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 msgr2=0x7fa24c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25e59c700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa260069560 0x7fa24c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25e59c700 1 -- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa24c004d50 msgr2=0x7fa24c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25e59c700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa24c004d50 0x7fa24c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25e59c700 1 -- 172.21.15.22:0/2652183044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c003570 con 0x7fa24c003a90 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25e59c700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa24c003ea0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c3c0 tx=0x7fa258001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a6a32747a91a40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800cc90 con 0x7fa24c003a90 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800cdf0 con 0x7fa24c003a90 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25d59a700 1 -- 172.21.15.22:0/2652183044 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258005b50 con 0x7fa24c003a90 2023-10-08T00:33:05.804 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa26482f700 1 -- 172.21.15.22:0/2652183044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 msgr2=0x7fa24c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa26482f700 1 --2- 172.21.15.22:0/2652183044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa24c003ea0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c3c0 tx=0x7fa258001e50 comp rx=0 tx=0).stop 2023-10-08T00:33:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.800+0000 7fa25ed9d700 1 -- 172.21.15.22:0/2652183044 reap_dead start 2023-10-08T00:33:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.801+0000 7fa26482f700 1 -- 172.21.15.22:0/2652183044 shutdown_connections 2023-10-08T00:33:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.801+0000 7fa26482f700 1 -- 172.21.15.22:0/2652183044 >> 172.21.15.22:0/2652183044 conn(0x7fa260068e20 msgr2=0x7fa2600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.801+0000 7fa26482f700 1 -- 172.21.15.22:0/2652183044 shutdown_connections 2023-10-08T00:33:05.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.801+0000 7fa26482f700 1 -- 172.21.15.22:0/2652183044 wait complete. 2023-10-08T00:33:05.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 Processor -- start 2023-10-08T00:33:05.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 -- start start 2023-10-08T00:33:05.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa260155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2600b3590 0x7fa26015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2600b3a00 0x7fa2600c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c66f0 con 0x7fa24c003a90 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600ca460 con 0x7fa2600b3590 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa26482f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600ca740 con 0x7fa2600b3a00 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.802+0000 7fa25e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa260155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa260155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36858/0 (socket says 172.21.15.22:36858) 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 -- 172.21.15.22:0/365427515 learned_addr learned my addr 172.21.15.22:0/365427515 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25dd9b700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2600b3590 0x7fa26015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 -- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2600b3a00 msgr2=0x7fa2600c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25ed9d700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2600b3a00 0x7fa2600c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2600b3a00 0x7fa2600c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 -- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2600b3590 msgr2=0x7fa26015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2600b3590 0x7fa26015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 -- 172.21.15.22:0/365427515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26015be10 con 0x7fa24c003a90 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25dd9b700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2600b3590 0x7fa26015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa25e59c700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa260155a60 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00bb70 tx=0x7fa258015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800cc90 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800c9e0 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26015c0f0 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258007510 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.803+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2600ca0c0 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.804+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26004c3c0 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.804+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa258019030 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.805+0000 7fa2567fc700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa240067320 0x7fa2400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.805+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2580863a0 con 0x7fa24c003a90 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.805+0000 7fa25dd9b700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa240067320 0x7fa2400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:05.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.806+0000 7fa25dd9b700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa240067320 0x7fa2400697d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa2600c5a30 tx=0x7fa248009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:05.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:05.809+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa258053030 con 0x7fa24c003a90 2023-10-08T00:33:06.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.048+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa2600c66f0 con 0x7fa24c003a90 2023-10-08T00:33:06.048 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:33:06.048+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:33:06.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.052+0000 7fa2567fc700 1 -- 172.21.15.22:0/365427515 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v108) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa258056650 con 0x7fa24c003a90 2023-10-08T00:33:06.054 INFO:tasks.ceph.mds.d.smithi192.stderr: -704> 2023-10-08T00:32:52.804+0000 7f5199811700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa240067320 msgr2=0x7fa2400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa240067320 0x7fa2400697d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa2600c5a30 tx=0x7fa248009040 comp rx=0 tx=0).stop 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 msgr2=0x7fa260155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa260155a60 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00bb70 tx=0x7fa258015000 comp rx=0 tx=0).stop 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 shutdown_connections 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa240067320 0x7fa2400697d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2600b3a00 0x7fa2600c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa24c003a90 0x7fa260155a60 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 --2- 172.21.15.22:0/365427515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2600b3590 0x7fa26015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 >> 172.21.15.22:0/365427515 conn(0x7fa260068e20 msgr2=0x7fa26015fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:06.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 shutdown_connections 2023-10-08T00:33:06.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.054+0000 7fa26482f700 1 -- 172.21.15.22:0/365427515 wait complete. 2023-10-08T00:33:06.056 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:33:06.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:33:06.075 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:33:06.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.188+0000 7f12158c1700 1 Processor -- start 2023-10-08T00:33:06.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.188+0000 7f12158c1700 1 -- start start 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f12158c1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1210159c60 0x7f121015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f12158c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121015db10 0x7f1210069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f12158c1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121015a160 con 0x7f1210159890 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f12158c1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f121015df50 con 0x7f1210159c60 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f12158c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100d13a0 con 0x7f121015db10 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f120e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1210159c60 0x7f121015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:06.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f120e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1210159c60 0x7f121015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36868/0 (socket says 172.21.15.22:36868) 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.189+0000 7f120e7fc700 1 -- 172.21.15.22:0/370515124 learned_addr learned my addr 172.21.15.22:0/370515124 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120f7fe700 1 --2- 172.21.15.22:0/370515124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121015db10 0x7f1210069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120e7fc700 1 -- 172.21.15.22:0/370515124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121015db10 msgr2=0x7f1210069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120e7fc700 1 --2- 172.21.15.22:0/370515124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121015db10 0x7f1210069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120e7fc700 1 -- 172.21.15.22:0/370515124 >> v1:172.21.15.192:6789/0 conn(0x7f1210159890 legacy=0x7f121015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120e7fc700 1 -- 172.21.15.22:0/370515124 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121015e140 con 0x7f1210159c60 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120e7fc700 1 --2- 172.21.15.22:0/370515124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f121015d5d0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f11f80099b0 tx=0x7f11f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cdf93afc14f0d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:06.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120dffb700 1 -- 172.21.15.22:0/370515124 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8009ea0 con 0x7f1210159c60 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120dffb700 1 -- 172.21.15.22:0/370515124 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800b860 con 0x7f1210159c60 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.190+0000 7f120dffb700 1 -- 172.21.15.22:0/370515124 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bc00 con 0x7f1210159c60 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 -- 172.21.15.22:0/370515124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 msgr2=0x7f121015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 --2- 172.21.15.22:0/370515124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f121015d5d0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f11f80099b0 tx=0x7f11f8009250 comp rx=0 tx=0).stop 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 -- 172.21.15.22:0/370515124 shutdown_connections 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 --2- 172.21.15.22:0/370515124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f121015db10 0x7f1210069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 --2- 172.21.15.22:0/370515124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f121015d5d0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 -- 172.21.15.22:0/370515124 >> 172.21.15.22:0/370515124 conn(0x7f1210068e20 msgr2=0x7f12100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 -- 172.21.15.22:0/370515124 shutdown_connections 2023-10-08T00:33:06.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.191+0000 7f12158c1700 1 -- 172.21.15.22:0/370515124 wait complete. 2023-10-08T00:33:06.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.192+0000 7f12158c1700 1 Processor -- start 2023-10-08T00:33:06.197 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.192+0000 7f12158c1700 1 -- start start 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1210159890 0x7f1210151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f12100b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121015db10 0x7f12100c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1210152900 con 0x7f1210159c60 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12100b0d30 con 0x7f121015db10 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12100ca4c0 con 0x7f1210159890 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f12100b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f12100b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36878/0 (socket says 172.21.15.22:36878) 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 -- 172.21.15.22:0/4064214527 learned_addr learned my addr 172.21.15.22:0/4064214527 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:06.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120f7fe700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121015db10 0x7f12100c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120effd700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1210159890 0x7f1210151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 -- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1210159890 msgr2=0x7f1210151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1210159890 0x7f1210151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 -- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121015db10 msgr2=0x7f12100c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121015db10 0x7f12100c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 -- 172.21.15.22:0/4064214527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80094f0 con 0x7f1210159c60 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120f7fe700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121015db10 0x7f12100c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:06.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f120e7fc700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f12100b11c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f12100899c0 tx=0x7f11f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800bbe0 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8011420 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12100b06e0 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80117c0 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.193+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12100b1700 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.194+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12100b0540 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.195+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f11f8011bf0 con 0x7f1210159c60 2023-10-08T00:33:06.200 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.195+0000 7f1206ffd700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11f0067320 0x7f11f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:06.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.195+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f11f80862a0 con 0x7f1210159c60 2023-10-08T00:33:06.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.195+0000 7f120effd700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11f0067320 0x7f11f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:06.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.196+0000 7f120effd700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11f0067320 0x7f11f00697d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1208003860 tx=0x7f1208009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:06.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.199+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12100b0540 con 0x7f1210159c60 2023-10-08T00:33:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:06.436+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f12100b0540 con 0x7f1210159c60 2023-10-08T00:33:07.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.056+0000 7f1206ffd700 1 -- 172.21.15.22:0/4064214527 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v109) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12100b0540 con 0x7f1210159c60 2023-10-08T00:33:07.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.058+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11f0067320 msgr2=0x7f11f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:07.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.058+0000 7f12158c1700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11f0067320 0x7f11f00697d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1208003860 tx=0x7f1208009040 comp rx=0 tx=0).stop 2023-10-08T00:33:07.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.058+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 msgr2=0x7f12100b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.058+0000 7f12158c1700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f12100b11c0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f12100899c0 tx=0x7f11f8017000 comp rx=0 tx=0).stop 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 shutdown_connections 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f121015db10 0x7f12100c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11f0067320 0x7f11f00697d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1210159890 0x7f1210151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 --2- 172.21.15.22:0/4064214527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1210159c60 0x7f12100b11c0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 >> 172.21.15.22:0/4064214527 conn(0x7f1210068e20 msgr2=0x7f12100cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 shutdown_connections 2023-10-08T00:33:07.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.059+0000 7f12158c1700 1 -- 172.21.15.22:0/4064214527 wait complete. 2023-10-08T00:33:07.075 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:33:07.205 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.205+0000 7f30d5f09700 1 Processor -- start 2023-10-08T00:33:07.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.205+0000 7f30d5f09700 1 -- start start 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30d5f09700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30d00cd910 0x7f30d00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30d5f09700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d00b5b00 con 0x7f30d0159ec0 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30d5f09700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d00b5da0 con 0x7f30d00b55a0 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30d5f09700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d00b6080 con 0x7f30d00cd910 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ceffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30d00cd910 0x7f30d00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30cf7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f30d0159ec0 0x7f30d00b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37090/0 (socket says 172.21.15.22:37090) 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30cf7fe700 1 -- 172.21.15.22:0/1357522800 learned_addr learned my addr 172.21.15.22:0/1357522800 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ceffd700 1 -- 172.21.15.22:0/1357522800 >> v1:172.21.15.192:6789/0 conn(0x7f30d00b55a0 legacy=0x7f30d00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ceffd700 1 -- 172.21.15.22:0/1357522800 >> v1:172.21.15.22:6789/0 conn(0x7f30d0159ec0 legacy=0x7f30d00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:07.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ceffd700 1 -- 172.21.15.22:0/1357522800 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d00cc100 con 0x7f30d00cd910 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ce7fc700 1 -- 172.21.15.22:0/1357522800 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854926230 0 0) 0x7f30d00b5b00 con 0x7f30d0159ec0 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ceffd700 1 --2- 172.21.15.22:0/1357522800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00cd910 0x7f30d00ce340 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009910 tx=0x7f30c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0dac330714494e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.206+0000 7f30ce7fc700 1 -- 172.21.15.22:0/1357522800 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c400b7e0 con 0x7f30d00cd910 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30ce7fc700 1 -- 172.21.15.22:0/1357522800 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c400b940 con 0x7f30d00cd910 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30ce7fc700 1 -- 172.21.15.22:0/1357522800 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c400bce0 con 0x7f30d00cd910 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 -- 172.21.15.22:0/1357522800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00cd910 msgr2=0x7f30d00ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 --2- 172.21.15.22:0/1357522800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00cd910 0x7f30d00ce340 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009910 tx=0x7f30c40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 -- 172.21.15.22:0/1357522800 shutdown_connections 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 --2- 172.21.15.22:0/1357522800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00cd910 0x7f30d00ce340 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 -- 172.21.15.22:0/1357522800 >> 172.21.15.22:0/1357522800 conn(0x7f30d00999f0 msgr2=0x7f30d00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 -- 172.21.15.22:0/1357522800 shutdown_connections 2023-10-08T00:33:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.207+0000 7f30d5f09700 1 -- 172.21.15.22:0/1357522800 wait complete. 2023-10-08T00:33:07.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.208+0000 7f30d5f09700 1 Processor -- start 2023-10-08T00:33:07.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.208+0000 7f30d5f09700 1 -- start start 2023-10-08T00:33:07.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30d5f09700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 0x7f30d0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:07.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30d5f09700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d0159ec0 0x7f30d013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:07.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30d5f09700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30d0158de0 0x7f30d00c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30d5f09700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d01566c0 con 0x7f30d00b55a0 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30d5f09700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d0158020 con 0x7f30d0159ec0 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30d5f09700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d0158300 con 0x7f30d0158de0 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 0x7f30d0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 0x7f30d0156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37258/0 (socket says 172.21.15.22:37258) 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 -- 172.21.15.22:0/2367878065 learned_addr learned my addr 172.21.15.22:0/2367878065 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30ceffd700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d0159ec0 0x7f30d013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cffff700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30d0158de0 0x7f30d00c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 -- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30d0158de0 msgr2=0x7f30d00c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30d0158de0 0x7f30d00c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 -- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d0159ec0 msgr2=0x7f30d013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.209+0000 7f30cf7fe700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d0159ec0 0x7f30d013e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30cf7fe700 1 -- 172.21.15.22:0/2367878065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009420 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30cf7fe700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 0x7f30d0156180 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f30c000cb60 tx=0x7f30c00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0005d80 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c000a5a0 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d01585e0 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000a960 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.210+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d0158970 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.211+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d0158b00 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.211+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30c000acd0 con 0x7f30d00b55a0 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.212+0000 7f30b77fe700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30bc067320 0x7f30bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.212+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f30c0084690 con 0x7f30d00b55a0 2023-10-08T00:33:07.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.212+0000 7f30ceffd700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30bc067320 0x7f30bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:07.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.212+0000 7f30ceffd700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30bc067320 0x7f30bc0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f30d00c75d0 tx=0x7f30c4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:07.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.216+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30d0158b00 con 0x7f30d00b55a0 2023-10-08T00:33:07.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:07.410+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30d0063c90 con 0x7f30d00b55a0 2023-10-08T00:33:08.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.058+0000 7f30b77fe700 1 -- 172.21.15.22:0/2367878065 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 181+0+0 (secure 0 0 0) 0x7f30c00180d0 con 0x7f30d00b55a0 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30bc067320 msgr2=0x7f30bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30bc067320 0x7f30bc0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f30d00c75d0 tx=0x7f30c4016000 comp rx=0 tx=0).stop 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 msgr2=0x7f30d0156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 0x7f30d0156180 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f30c000cb60 tx=0x7f30c00017b0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 shutdown_connections 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30bc067320 0x7f30bc0697d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30d0158de0 0x7f30d00c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30d00b55a0 0x7f30d0156180 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 --2- 172.21.15.22:0/2367878065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d0159ec0 0x7f30d013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 >> 172.21.15.22:0/2367878065 conn(0x7f30d00999f0 msgr2=0x7f30d0151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 shutdown_connections 2023-10-08T00:33:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.061+0000 7f30d5f09700 1 -- 172.21.15.22:0/2367878065 wait complete. 2023-10-08T00:33:08.063 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:33:08.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:33:08.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.203+0000 7f5dd8daa700 1 Processor -- start 2023-10-08T00:33:08.204 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.203+0000 7f5dd8daa700 1 -- start start 2023-10-08T00:33:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd8daa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd8daa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5dd40b0790 0x7f5dd40b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd8daa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5dd41591e0 0x7f5dd4159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd8daa700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd40cfa00 con 0x7f5dd41591e0 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd8daa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd40cb580 con 0x7f5dd40b0790 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd8daa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40b2de0 con 0x7f5dd40b03c0 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5dd41591e0 0x7f5dd4159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5dd41591e0 0x7f5dd4159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37260/0 (socket says 172.21.15.22:37260) 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 -- 172.21.15.22:0/3462030518 learned_addr learned my addr 172.21.15.22:0/3462030518 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd37fe700 1 --2- 172.21.15.22:0/3462030518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd2ffd700 1 --2- 172.21.15.22:0/3462030518 >> v2:172.21.15.192:3300/0 conn(0x7f5dd40b0790 0x7f5dd40b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 -- 172.21.15.22:0/3462030518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 msgr2=0x7f5dd40cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 --2- 172.21.15.22:0/3462030518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 -- 172.21.15.22:0/3462030518 >> v2:172.21.15.192:3300/0 conn(0x7f5dd40b0790 msgr2=0x7f5dd40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.204+0000 7f5dd3fff700 1 --2- 172.21.15.22:0/3462030518 >> v2:172.21.15.192:3300/0 conn(0x7f5dd40b0790 0x7f5dd40b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd3fff700 1 -- 172.21.15.22:0/3462030518 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40cf160 con 0x7f5dd41591e0 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd3fff700 1 --2- 172.21.15.22:0/3462030518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd41591e0 0x7f5dd4159620 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4067fa0 tx=0x7f5dcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9350032f86c49ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd27fc700 1 -- 172.21.15.22:0/3462030518 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00e070 con 0x7f5dd41591e0 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd27fc700 1 -- 172.21.15.22:0/3462030518 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00ba50 con 0x7f5dd41591e0 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd27fc700 1 -- 172.21.15.22:0/3462030518 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0092e0 con 0x7f5dd41591e0 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3462030518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd41591e0 msgr2=0x7f5dd4159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3462030518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd41591e0 0x7f5dd4159620 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4067fa0 tx=0x7f5dcc009840 comp rx=0 tx=0).stop 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3462030518 shutdown_connections 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3462030518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd41591e0 0x7f5dd4159620 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3462030518 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3462030518 >> v2:172.21.15.192:3300/0 conn(0x7f5dd40b0790 0x7f5dd40b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3462030518 >> 172.21.15.22:0/3462030518 conn(0x7f5dd4063230 msgr2=0x7f5dd4063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:08.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3462030518 shutdown_connections 2023-10-08T00:33:08.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.205+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3462030518 wait complete. 2023-10-08T00:33:08.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 Processor -- start 2023-10-08T00:33:08.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 -- start start 2023-10-08T00:33:08.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 0x7f5dd40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd41591e0 0x7f5dd4157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c5d60 con 0x7f5dd40b0790 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.207+0000 7f5dd8daa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c5150 con 0x7f5dd41591e0 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd8daa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40c5430 con 0x7f5dd40b03c0 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 0x7f5dd40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 0x7f5dd40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37274/0 (socket says 172.21.15.22:37274) 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 -- 172.21.15.22:0/3679048640 learned_addr learned my addr 172.21.15.22:0/3679048640 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd3fff700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd41591e0 0x7f5dd4157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd37fe700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 -- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 msgr2=0x7f5dd40c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 -- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd41591e0 msgr2=0x7f5dd4157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd41591e0 0x7f5dd4157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 -- 172.21.15.22:0/3679048640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc009ae0 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd2ffd700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 0x7f5dd40c9e80 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800d890 tx=0x7f5dc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800b690 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc800b7f0 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd40c5710 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800bb70 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.208+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd40c9a60 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.209+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd40c9c50 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.210+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5dc801e460 con 0x7f5dd40b0790 2023-10-08T00:33:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.210+0000 7f5dbb7fe700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dc0067320 0x7f5dc00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:08.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.210+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f5dc8085290 con 0x7f5dd40b0790 2023-10-08T00:33:08.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.211+0000 7f5dd37fe700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dc0067320 0x7f5dc00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:08.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.211+0000 7f5dd37fe700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dc0067320 0x7f5dc00697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4006fd0 tx=0x7f5dc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:08.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.215+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dc8052080 con 0x7f5dd40b0790 2023-10-08T00:33:08.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:08.408+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5dd404c3c0 con 0x7f5dd40b0790 2023-10-08T00:33:09.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.065+0000 7f5dbb7fe700 1 -- 172.21.15.22:0/3679048640 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5dc80556a0 con 0x7f5dd40b0790 2023-10-08T00:33:09.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dc0067320 msgr2=0x7f5dc00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dc0067320 0x7f5dc00697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4006fd0 tx=0x7f5dc4008040 comp rx=0 tx=0).stop 2023-10-08T00:33:09.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 msgr2=0x7f5dd40c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 0x7f5dd40c9e80 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800d890 tx=0x7f5dc8008040 comp rx=0 tx=0).stop 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 shutdown_connections 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd41591e0 0x7f5dd4157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dc0067320 0x7f5dc00697d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5dd40b03c0 0x7f5dd40c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 --2- 172.21.15.22:0/3679048640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5dd40b0790 0x7f5dd40c9e80 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 >> 172.21.15.22:0/3679048640 conn(0x7f5dd4063230 msgr2=0x7f5dd40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:09.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.070+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 shutdown_connections 2023-10-08T00:33:09.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.071+0000 7f5dd8daa700 1 -- 172.21.15.22:0/3679048640 wait complete. 2023-10-08T00:33:09.074 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:33:09.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:33:09.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.214+0000 7f471b8f8700 1 Processor -- start 2023-10-08T00:33:09.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.215+0000 7f471b8f8700 1 -- start start 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.215+0000 7f471b8f8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4714159c60 0x7f471415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.215+0000 7f471b8f8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f471415db10 0x7f4714069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.215+0000 7f471b8f8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471415a160 con 0x7f4714159890 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.215+0000 7f471b8f8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471415df50 con 0x7f471415db10 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.215+0000 7f471b8f8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47140d13a0 con 0x7f4714159c60 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f471415db10 0x7f4714069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f471415db10 0x7f4714069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37278/0 (socket says 172.21.15.22:37278) 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 -- 172.21.15.22:0/3148442245 learned_addr learned my addr 172.21.15.22:0/3148442245 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4718e93700 1 --2- 172.21.15.22:0/3148442245 >> v2:172.21.15.192:3300/0 conn(0x7f4714159c60 0x7f471415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 -- 172.21.15.22:0/3148442245 >> v2:172.21.15.192:3300/0 conn(0x7f4714159c60 msgr2=0x7f471415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 --2- 172.21.15.22:0/3148442245 >> v2:172.21.15.192:3300/0 conn(0x7f4714159c60 0x7f471415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 -- 172.21.15.22:0/3148442245 >> v1:172.21.15.192:6789/0 conn(0x7f4714159890 legacy=0x7f471415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 -- 172.21.15.22:0/3148442245 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471415e140 con 0x7f471415db10 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4719e95700 1 --2- 172.21.15.22:0/3148442245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f4714069560 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f47140b67f0 tx=0x7f4704009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b31ae332881c778 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4713fff700 1 -- 172.21.15.22:0/3148442245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400e070 con 0x7f471415db10 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4713fff700 1 -- 172.21.15.22:0/3148442245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400ba10 con 0x7f471415db10 2023-10-08T00:33:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.216+0000 7f4713fff700 1 -- 172.21.15.22:0/3148442245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040092e0 con 0x7f471415db10 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 -- 172.21.15.22:0/3148442245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 msgr2=0x7f4714069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3148442245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f4714069560 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f47140b67f0 tx=0x7f4704009840 comp rx=0 tx=0).stop 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 -- 172.21.15.22:0/3148442245 shutdown_connections 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3148442245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f4714069560 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3148442245 >> v2:172.21.15.192:3300/0 conn(0x7f4714159c60 0x7f471415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 -- 172.21.15.22:0/3148442245 >> 172.21.15.22:0/3148442245 conn(0x7f4714068e20 msgr2=0x7f47140d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 -- 172.21.15.22:0/3148442245 shutdown_connections 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.217+0000 7f471b8f8700 1 -- 172.21.15.22:0/3148442245 wait complete. 2023-10-08T00:33:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.218+0000 7f471b8f8700 1 Processor -- start 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.218+0000 7f471b8f8700 1 -- start start 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f471b8f8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4714159890 0x7f471414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f471b8f8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714159c60 0x7f471414ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f471b8f8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f471414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f471b8f8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714158070 con 0x7f471415db10 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f471b8f8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140c6310 con 0x7f4714159c60 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f471b8f8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140c65f0 con 0x7f4714159890 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f471414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f471414b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37286/0 (socket says 172.21.15.22:37286) 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 -- 172.21.15.22:0/3509031659 learned_addr learned my addr 172.21.15.22:0/3509031659 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4718e93700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714159c60 0x7f471414ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719694700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4714159890 0x7f471414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 -- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4714159890 msgr2=0x7f471414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4714159890 0x7f471414a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 -- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714159c60 msgr2=0x7f471414ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714159c60 0x7f471414ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.219+0000 7f4719e95700 1 -- 172.21.15.22:0/3509031659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009ae0 con 0x7f471415db10 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.220+0000 7f4719e95700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f471414b0c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f4714070e20 tx=0x7f4704017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.220+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400bee0 con 0x7f471415db10 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.220+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47040032f0 con 0x7f471415db10 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.220+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47140c68d0 con 0x7f471415db10 2023-10-08T00:33:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.220+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470401d650 con 0x7f471415db10 2023-10-08T00:33:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.220+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140c6e90 con 0x7f471415db10 2023-10-08T00:33:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.221+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471404c3c0 con 0x7f471415db10 2023-10-08T00:33:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.221+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f470401da40 con 0x7f471415db10 2023-10-08T00:33:09.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.222+0000 7f47117fa700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4700067320 0x7f47000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.222+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4704086320 con 0x7f471415db10 2023-10-08T00:33:09.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.222+0000 7f4719694700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4700067320 0x7f47000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.222+0000 7f4719694700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4700067320 0x7f47000697d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f470c003870 tx=0x7f470c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:09.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.226+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47040531a0 con 0x7f471415db10 2023-10-08T00:33:09.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.424+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4714153490 con 0x7f471415db10 2023-10-08T00:33:09.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.427+0000 7f47117fa700 1 -- 172.21.15.22:0/3509031659 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4704012e60 con 0x7f471415db10 2023-10-08T00:33:09.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4700067320 msgr2=0x7f47000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4700067320 0x7f47000697d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f470c003870 tx=0x7f470c009040 comp rx=0 tx=0).stop 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 msgr2=0x7f471414b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f471414b0c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f4714070e20 tx=0x7f4704017000 comp rx=0 tx=0).stop 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 shutdown_connections 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f471415db10 0x7f471414b0c0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4700067320 0x7f47000697d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4714159890 0x7f471414a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 --2- 172.21.15.22:0/3509031659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4714159c60 0x7f471414ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 >> 172.21.15.22:0/3509031659 conn(0x7f4714068e20 msgr2=0x7f47141584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:09.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 shutdown_connections 2023-10-08T00:33:09.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.429+0000 7f471b8f8700 1 -- 172.21.15.22:0/3509031659 wait complete. 2023-10-08T00:33:09.441 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-08T00:33:09.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.560+0000 7f1f42427700 1 Processor -- start 2023-10-08T00:33:09.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.560+0000 7f1f42427700 1 -- start start 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f42427700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f3c159890 0x7f1f3c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f42427700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1f3c159c60 0x7f1f3c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f42427700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c15a160 con 0x7f1f3c15db10 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f42427700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c15df50 con 0x7f1f3c159890 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f42427700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0d13a0 con 0x7f1f3c159c60 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1f3c159890 0x7f1f3c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f409c4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1f3c15db10 0x7f1f3c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37102/0 (socket says 172.21.15.22:37102) 2023-10-08T00:33:09.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f409c4700 1 -- 172.21.15.22:0/3950335327 learned_addr learned my addr 172.21.15.22:0/3950335327 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3b7fe700 1 --2- 172.21.15.22:0/3950335327 >> v2:172.21.15.192:3300/0 conn(0x7f1f3c159c60 0x7f1f3c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3bfff700 1 -- 172.21.15.22:0/3950335327 >> v2:172.21.15.192:3300/0 conn(0x7f1f3c159c60 msgr2=0x7f1f3c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3bfff700 1 --2- 172.21.15.22:0/3950335327 >> v2:172.21.15.192:3300/0 conn(0x7f1f3c159c60 0x7f1f3c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3bfff700 1 -- 172.21.15.22:0/3950335327 >> v1:172.21.15.22:6789/0 conn(0x7f1f3c15db10 legacy=0x7f1f3c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3affd700 1 -- 172.21.15.22:0/3950335327 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530267172 0 0) 0x7f1f3c15a160 con 0x7f1f3c15db10 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3bfff700 1 -- 172.21.15.22:0/3950335327 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c15e140 con 0x7f1f3c159890 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3bfff700 1 --2- 172.21.15.22:0/3950335327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c159890 0x7f1f3c15abd0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0b67f0 tx=0x7f1f2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e664c4f429f2eba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.561+0000 7f1f3affd700 1 -- 172.21.15.22:0/3950335327 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00b6b0 con 0x7f1f3c159890 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f3affd700 1 -- 172.21.15.22:0/3950335327 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00b810 con 0x7f1f3c159890 2023-10-08T00:33:09.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f3affd700 1 -- 172.21.15.22:0/3950335327 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00bbb0 con 0x7f1f3c159890 2023-10-08T00:33:09.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 -- 172.21.15.22:0/3950335327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c159890 msgr2=0x7f1f3c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 --2- 172.21.15.22:0/3950335327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c159890 0x7f1f3c15abd0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0b67f0 tx=0x7f1f2c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 -- 172.21.15.22:0/3950335327 shutdown_connections 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 --2- 172.21.15.22:0/3950335327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c159890 0x7f1f3c15abd0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 --2- 172.21.15.22:0/3950335327 >> v2:172.21.15.192:3300/0 conn(0x7f1f3c159c60 0x7f1f3c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 -- 172.21.15.22:0/3950335327 >> 172.21.15.22:0/3950335327 conn(0x7f1f3c068e20 msgr2=0x7f1f3c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 -- 172.21.15.22:0/3950335327 shutdown_connections 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.562+0000 7f1f42427700 1 -- 172.21.15.22:0/3950335327 wait complete. 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.563+0000 7f1f42427700 1 Processor -- start 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.563+0000 7f1f42427700 1 -- start start 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f42427700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f3c159890 0x7f1f3c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f42427700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f3c159c60 0x7f1f3c16b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f42427700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 0x7f1f3c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f42427700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cde30 con 0x7f1f3c15db10 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f42427700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cd260 con 0x7f1f3c159890 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f42427700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cd500 con 0x7f1f3c159c60 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f409c4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 0x7f1f3c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f409c4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 0x7f1f3c0cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37310/0 (socket says 172.21.15.22:37310) 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f409c4700 1 -- 172.21.15.22:0/2581655691 learned_addr learned my addr 172.21.15.22:0/2581655691 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f3bfff700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f3c159890 0x7f1f3c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f3b7fe700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f3c159c60 0x7f1f3c16b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.564+0000 7f1f409c4700 1 -- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f3c159c60 msgr2=0x7f1f3c16b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f409c4700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f3c159c60 0x7f1f3c16b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f409c4700 1 -- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f3c159890 msgr2=0x7f1f3c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f409c4700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f3c159890 0x7f1f3c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f409c4700 1 -- 172.21.15.22:0/2581655691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c009420 con 0x7f1f3c15db10 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f3b7fe700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f3c159c60 0x7f1f3c16b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f409c4700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 0x7f1f3c0cf300 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400cbf0 tx=0x7f1f340019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400a910 con 0x7f1f3c15db10 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400aa70 con 0x7f1f3c15db10 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0cd7e0 con 0x7f1f3c15db10 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400ae30 con 0x7f1f3c15db10 2023-10-08T00:33:09.568 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.565+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c0cf840 con 0x7f1f3c15db10 2023-10-08T00:33:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.566+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c04c3c0 con 0x7f1f3c15db10 2023-10-08T00:33:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.566+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1f34007300 con 0x7f1f3c15db10 2023-10-08T00:33:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.567+0000 7f1f23fff700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f280673a0 0x7f1f28069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:09.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.567+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1f34084d60 con 0x7f1f3c15db10 2023-10-08T00:33:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.567+0000 7f1f3bfff700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f280673a0 0x7f1f28069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:09.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.567+0000 7f1f3bfff700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f280673a0 0x7f1f28069850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0093f0 tx=0x7f1f2c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:09.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.571+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f34051d30 con 0x7f1f3c15db10 2023-10-08T00:33:09.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:09.845+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f1f3c06a5b0 con 0x7f1f3c15db10 2023-10-08T00:33:10.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.070+0000 7f1f23fff700 1 -- 172.21.15.22:0/2581655691 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v414) v1 ==== 167+0+0 (secure 0 0 0) 0x7f1f34055350 con 0x7f1f3c15db10 2023-10-08T00:33:10.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f280673a0 msgr2=0x7f1f28069850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f280673a0 0x7f1f28069850 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0093f0 tx=0x7f1f2c017000 comp rx=0 tx=0).stop 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 msgr2=0x7f1f3c0cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 0x7f1f3c0cf300 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400cbf0 tx=0x7f1f340019b0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 shutdown_connections 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f3c15db10 0x7f1f3c0cf300 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f3c159890 0x7f1f3c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1f280673a0 0x7f1f28069850 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 --2- 172.21.15.22:0/2581655691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1f3c159c60 0x7f1f3c16b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.074 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 >> 172.21.15.22:0/2581655691 conn(0x7f1f3c068e20 msgr2=0x7f1f3c152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 shutdown_connections 2023-10-08T00:33:10.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.073+0000 7f1f42427700 1 -- 172.21.15.22:0/2581655691 wait complete. 2023-10-08T00:33:10.086 INFO:tasks.cephfs_test_runner:That renaming volume fails without --yes-i-really-mean-it flag. ... ok 2023-10-08T00:33:10.086 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) That renaming a volume with more than one data pool does not change 2023-10-08T00:33:10.086 INFO:tasks.cephfs_test_runner:test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:33:10.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-08T00:33:10.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.205+0000 7fdacebbd700 1 Processor -- start 2023-10-08T00:33:10.206 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.205+0000 7fdacebbd700 1 -- start start 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.206+0000 7fdacebbd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac815d230 0x7fdac815d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.206+0000 7fdacebbd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac80b2980 con 0x7fdac8159420 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.206+0000 7fdacebbd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac815dbb0 con 0x7fdac81597f0 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.206+0000 7fdacebbd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80b11d0 con 0x7fdac815d230 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.206+0000 7fdacdbbb700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdac8159420 0x7fdac80b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37112/0 (socket says 172.21.15.22:37112) 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.206+0000 7fdacdbbb700 1 -- 172.21.15.22:0/1506230129 learned_addr learned my addr 172.21.15.22:0/1506230129 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdace3bc700 1 --2- 172.21.15.22:0/1506230129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac815d230 0x7fdac815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991931010 0 0) 0x7fdac80b2980 con 0x7fdac8159420 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab0003570 con 0x7fdac8159420 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812148301 0 0) 0x7fdac815dbb0 con 0x7fdac81597f0 2023-10-08T00:33:10.208 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac80b2980 con 0x7fdac81597f0 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdace3bc700 1 -- 172.21.15.22:0/1506230129 >> v1:172.21.15.192:6789/0 conn(0x7fdac81597f0 legacy=0x7fdac80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdace3bc700 1 -- 172.21.15.22:0/1506230129 >> v1:172.21.15.22:6789/0 conn(0x7fdac8159420 legacy=0x7fdac80b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 798332186 0 0) 0x7fdab0003570 con 0x7fdac8159420 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdace3bc700 1 -- 172.21.15.22:0/1506230129 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80b14b0 con 0x7fdac815d230 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdace3bc700 1 --2- 172.21.15.22:0/1506230129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac815d230 0x7fdac815d670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009e90 tx=0x7fdac0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1536241e562263ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000e070 con 0x7fdac815d230 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000b870 con 0x7fdac815d230 2023-10-08T00:33:10.209 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.207+0000 7fdaccbb9700 1 -- 172.21.15.22:0/1506230129 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8001470 con 0x7fdac815d230 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 -- 172.21.15.22:0/1506230129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac815d230 msgr2=0x7fdac815d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 --2- 172.21.15.22:0/1506230129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac815d230 0x7fdac815d670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdac0009e90 tx=0x7fdac0009780 comp rx=0 tx=0).stop 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 -- 172.21.15.22:0/1506230129 shutdown_connections 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 --2- 172.21.15.22:0/1506230129 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac815d230 0x7fdac815d670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 -- 172.21.15.22:0/1506230129 >> 172.21.15.22:0/1506230129 conn(0x7fdac80d0660 msgr2=0x7fdac80d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 -- 172.21.15.22:0/1506230129 shutdown_connections 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.208+0000 7fdacebbd700 1 -- 172.21.15.22:0/1506230129 wait complete. 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.209+0000 7fdacebbd700 1 Processor -- start 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.209+0000 7fdacebbd700 1 -- start start 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacebbd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac8159420 0x7fdac81676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:10.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacebbd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 0x7fdac816a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacebbd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac815d230 0x7fdac80c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacebbd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac816aa40 con 0x7fdac81597f0 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacebbd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac815c900 con 0x7fdac815d230 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacebbd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c8080 con 0x7fdac8159420 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 0x7fdac816a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 0x7fdac816a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37324/0 (socket says 172.21.15.22:37324) 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 -- 172.21.15.22:0/2887156376 learned_addr learned my addr 172.21.15.22:0/2887156376 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdace3bc700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac815d230 0x7fdac80c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacdbbb700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac8159420 0x7fdac81676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 -- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac8159420 msgr2=0x7fdac81676f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac8159420 0x7fdac81676f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 -- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac815d230 msgr2=0x7fdac80c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac815d230 0x7fdac80c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 -- 172.21.15.22:0/2887156376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0009a20 con 0x7fdac81597f0 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdace3bc700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac815d230 0x7fdac80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.210+0000 7fdacd3ba700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 0x7fdac816a500 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c7c0 tx=0x7fdabc007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.211+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0015f0 con 0x7fdac81597f0 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.211+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc001770 con 0x7fdac81597f0 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.211+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac816b110 con 0x7fdac81597f0 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.211+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc001b30 con 0x7fdac81597f0 2023-10-08T00:33:10.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.211+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac816b6d0 con 0x7fdac81597f0 2023-10-08T00:33:10.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.212+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac804c3c0 con 0x7fdac81597f0 2023-10-08T00:33:10.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.212+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdabc0123e0 con 0x7fdac81597f0 2023-10-08T00:33:10.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.213+0000 7fdac5ffb700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdab4067320 0x7fdab40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:10.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.213+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdabc084560 con 0x7fdac81597f0 2023-10-08T00:33:10.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.213+0000 7fdacdbbb700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdab4067320 0x7fdab40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:10.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.213+0000 7fdacdbbb700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdab4067320 0x7fdab40697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdac80b0a30 tx=0x7fdab8000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:10.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.217+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdabc051600 con 0x7fdac81597f0 2023-10-08T00:33:10.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:10.496+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7fdac80b1790 con 0x7fdac81597f0 2023-10-08T00:33:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.074+0000 7fdac5ffb700 1 -- 172.21.15.22:0/2887156376 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v415) v1 ==== 166+0+0 (secure 0 0 0) 0x7fdabc0180e0 con 0x7fdac81597f0 2023-10-08T00:33:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.076+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdab4067320 msgr2=0x7fdab40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.076+0000 7fdacebbd700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdab4067320 0x7fdab40697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdac80b0a30 tx=0x7fdab8000bc0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.076+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 msgr2=0x7fdac816a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.076+0000 7fdacebbd700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 0x7fdac816a500 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdabc00c7c0 tx=0x7fdabc007da0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 shutdown_connections 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac815d230 0x7fdac80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdab4067320 0x7fdab40697d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdac8159420 0x7fdac81676f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 --2- 172.21.15.22:0/2887156376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdac81597f0 0x7fdac816a500 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 >> 172.21.15.22:0/2887156376 conn(0x7fdac80d0660 msgr2=0x7fdac80b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 shutdown_connections 2023-10-08T00:33:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.077+0000 7fdacebbd700 1 -- 172.21.15.22:0/2887156376 wait complete. 2023-10-08T00:33:11.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:33:11.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.214+0000 7f298d833700 1 Processor -- start 2023-10-08T00:33:11.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.214+0000 7f298d833700 1 -- start start 2023-10-08T00:33:11.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f298d833700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f29880cca60 0x7f298815d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f298d833700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2988150b50 con 0x7f29880cd0f0 2023-10-08T00:33:11.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f298d833700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880cede0 con 0x7f29880cc690 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f298d833700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29880b2260 con 0x7f29880cca60 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f29877fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f29880cd0f0 0x7f29880cf270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37122/0 (socket says 172.21.15.22:37122) 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f29877fe700 1 -- 172.21.15.22:0/2649366550 learned_addr learned my addr 172.21.15.22:0/2649366550 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f29867fc700 1 --2- 172.21.15.22:0/2649366550 >> v2:172.21.15.192:3300/0 conn(0x7f29880cca60 0x7f298815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701268519 0 0) 0x7f2988150b50 con 0x7f29880cd0f0 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.215+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2974003570 con 0x7f29880cd0f0 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929906319 0 0) 0x7f29880cede0 con 0x7f29880cc690 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2988150b50 con 0x7f29880cc690 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182184008 0 0) 0x7f2974003570 con 0x7f29880cd0f0 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 >> v2:172.21.15.192:3300/0 conn(0x7f29880cca60 msgr2=0x7f298815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:11.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 --2- 172.21.15.22:0/2649366550 >> v2:172.21.15.192:3300/0 conn(0x7f29880cca60 0x7f298815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 >> v1:172.21.15.192:6789/0 conn(0x7f29880cc690 legacy=0x7f29880b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880b2540 con 0x7f29880cd0f0 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f2978001470 con 0x7f29880cd0f0 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 >> v1:172.21.15.22:6789/0 conn(0x7f29880cd0f0 legacy=0x7f29880cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f2974004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2974004810 0x7f2974004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2974005210 0x7f297400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880b2260 con 0x7f2974003c40 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297400c130 con 0x7f2974004810 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297400c2c0 con 0x7f2974005210 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f29867fc700 1 --2- 172.21.15.22:0/2649366550 >> v2:172.21.15.192:3300/0 conn(0x7f29880cca60 0x7f298815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:11.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f2974004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f29877fe700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2974005210 0x7f297400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f29867fc700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2974004810 0x7f2974004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 -- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2974005210 msgr2=0x7f297400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2974005210 0x7f297400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 -- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2974004810 msgr2=0x7f2974004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2974004810 0x7f2974004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 -- 172.21.15.22:0/2649366550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974003570 con 0x7f2974003c40 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f29877fe700 1 -- 172.21.15.22:0/2649366550 reap_dead start 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.216+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f2974004030 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2980002140 tx=0x7f29800017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3879cc2926aefdba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980001ad0 con 0x7f2974003c40 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298000c940 con 0x7f2974003c40 2023-10-08T00:33:11.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f2985ffb700 1 -- 172.21.15.22:0/2649366550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000cce0 con 0x7f2974003c40 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 -- 172.21.15.22:0/2649366550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 msgr2=0x7f2974004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f2974004030 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f2980002140 tx=0x7f29800017c0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 -- 172.21.15.22:0/2649366550 shutdown_connections 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 --2- 172.21.15.22:0/2649366550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f2974004030 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 -- 172.21.15.22:0/2649366550 >> 172.21.15.22:0/2649366550 conn(0x7f29880d0630 msgr2=0x7f29880d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 -- 172.21.15.22:0/2649366550 shutdown_connections 2023-10-08T00:33:11.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.217+0000 7f298d833700 1 -- 172.21.15.22:0/2649366550 wait complete. 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.218+0000 7f298d833700 1 Processor -- start 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.218+0000 7f298d833700 1 -- start start 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f298d833700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f298814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f298d833700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f298814f890 0x7f298814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f298d833700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2988159aa0 0x7f2988159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f298d833700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2988151da0 con 0x7f2974003c40 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f298d833700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298815a460 con 0x7f2988159aa0 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f298d833700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2988158cc0 con 0x7f298814f890 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f298814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f298814f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37340/0 (socket says 172.21.15.22:37340) 2023-10-08T00:33:11.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 -- 172.21.15.22:0/2773289974 learned_addr learned my addr 172.21.15.22:0/2773289974 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f29867fc700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f298814f890 0x7f298814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f29877fe700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2988159aa0 0x7f2988159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 -- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f298814f890 msgr2=0x7f298814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f298814f890 0x7f298814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 -- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2988159aa0 msgr2=0x7f2988159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.219+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2988159aa0 0x7f2988159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f2986ffd700 1 -- 172.21.15.22:0/2773289974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988158390 con 0x7f2974003c40 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f29877fe700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2988159aa0 0x7f2988159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f2986ffd700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f298814f060 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f29740057b0 tx=0x7f2980015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2980001ad0 con 0x7f2974003c40 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298001e610 con 0x7f2974003c40 2023-10-08T00:33:11.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2988158670 con 0x7f2974003c40 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298001e9f0 con 0x7f2974003c40 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.220+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298814e810 con 0x7f2974003c40 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.221+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29880889d0 con 0x7f2974003c40 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.221+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2980019030 con 0x7f2974003c40 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.222+0000 7f297effd700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2968067320 0x7f29680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.222+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2980086880 con 0x7f2974003c40 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.222+0000 7f29867fc700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2968067320 0x7f29680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.223+0000 7f29867fc700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2968067320 0x7f29680697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f29880b1270 tx=0x7f2970008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:11.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.226+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29800538d0 con 0x7f2974003c40 2023-10-08T00:33:11.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.421+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f29880b2820 con 0x7f2974003c40 2023-10-08T00:33:11.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.424+0000 7f297effd700 1 -- 172.21.15.22:0/2773289974 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2980007d30 con 0x7f2974003c40 2023-10-08T00:33:11.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2968067320 msgr2=0x7f29680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2968067320 0x7f29680697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f29880b1270 tx=0x7f2970008040 comp rx=0 tx=0).stop 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 msgr2=0x7f298814f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f298814f060 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f29740057b0 tx=0x7f2980015000 comp rx=0 tx=0).stop 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 shutdown_connections 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2988159aa0 0x7f2988159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2974003c40 0x7f298814f060 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2968067320 0x7f29680697d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 --2- 172.21.15.22:0/2773289974 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f298814f890 0x7f298814e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 >> 172.21.15.22:0/2773289974 conn(0x7f29880d0630 msgr2=0x7f2988150010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 shutdown_connections 2023-10-08T00:33:11.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.427+0000 7f298d833700 1 -- 172.21.15.22:0/2773289974 wait complete. 2023-10-08T00:33:11.440 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:33:11.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:11.476 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:11.527 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:33:11.527 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:33:11.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:11.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.645+0000 7faf8cff3700 1 Processor -- start 2023-10-08T00:33:11.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.645+0000 7faf8cff3700 1 -- start start 2023-10-08T00:33:11.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.646+0000 7faf8cff3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf8806b520 0x7faf880cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.646+0000 7faf8cff3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880cc210 con 0x7faf8806aa40 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.646+0000 7faf8cff3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880cc4f0 con 0x7faf880c91e0 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.646+0000 7faf8cff3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880cc7d0 con 0x7faf8806b520 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf86d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf8806b520 0x7faf880cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf8659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7faf8806aa40 0x7faf8806bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37132/0 (socket says 172.21.15.22:37132) 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf8659c700 1 -- 172.21.15.22:0/4075896086 learned_addr learned my addr 172.21.15.22:0/4075896086 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf86d9d700 1 -- 172.21.15.22:0/4075896086 >> v1:172.21.15.192:6789/0 conn(0x7faf880c91e0 legacy=0x7faf8806ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf86d9d700 1 -- 172.21.15.22:0/4075896086 >> v1:172.21.15.22:6789/0 conn(0x7faf8806aa40 legacy=0x7faf8806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf86d9d700 1 -- 172.21.15.22:0/4075896086 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880ccab0 con 0x7faf8806b520 2023-10-08T00:33:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf8559a700 1 -- 172.21.15.22:0/4075896086 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492456549 0 0) 0x7faf880cc210 con 0x7faf8806aa40 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf86d9d700 1 --2- 172.21.15.22:0/4075896086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806b520 0x7faf880cbc00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7faf780098e0 tx=0x7faf780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f341d44480aa34f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf8559a700 1 -- 172.21.15.22:0/4075896086 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78009e80 con 0x7faf8806b520 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf8559a700 1 -- 172.21.15.22:0/4075896086 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800b820 con 0x7faf8806b520 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.647+0000 7faf8559a700 1 -- 172.21.15.22:0/4075896086 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800bba0 con 0x7faf8806b520 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 -- 172.21.15.22:0/4075896086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806b520 msgr2=0x7faf880cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 --2- 172.21.15.22:0/4075896086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806b520 0x7faf880cbc00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7faf780098e0 tx=0x7faf780091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 -- 172.21.15.22:0/4075896086 shutdown_connections 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 --2- 172.21.15.22:0/4075896086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806b520 0x7faf880cbc00 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 -- 172.21.15.22:0/4075896086 >> 172.21.15.22:0/4075896086 conn(0x7faf880cd670 msgr2=0x7faf880cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 -- 172.21.15.22:0/4075896086 shutdown_connections 2023-10-08T00:33:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.648+0000 7faf8cff3700 1 -- 172.21.15.22:0/4075896086 wait complete. 2023-10-08T00:33:11.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.649+0000 7faf8cff3700 1 Processor -- start 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.649+0000 7faf8cff3700 1 -- start start 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 0x7faf8814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806b520 0x7faf88157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf880c91e0 0x7faf881580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8814e270 con 0x7faf8806aa40 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8814e7e0 con 0x7faf880c91e0 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880b1e90 con 0x7faf8806b520 2023-10-08T00:33:11.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 0x7faf8814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 0x7faf8814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37352/0 (socket says 172.21.15.22:37352) 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 -- 172.21.15.22:0/2160943226 learned_addr learned my addr 172.21.15.22:0/2160943226 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf86d9d700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf880c91e0 0x7faf881580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf85d9b700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806b520 0x7faf88157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 -- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806b520 msgr2=0x7faf88157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806b520 0x7faf88157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 -- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf880c91e0 msgr2=0x7faf881580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf880c91e0 0x7faf881580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 -- 172.21.15.22:0/2160943226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009420 con 0x7faf8806aa40 2023-10-08T00:33:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf86d9d700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf880c91e0 0x7faf881580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8659c700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 0x7faf8814dd30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7faf8000ed70 tx=0x7faf80001840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80005d80 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000cb70 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800070f0 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.650+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf880c7780 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.651+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf880b1840 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.651+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8804c3c0 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.652+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faf80007460 con 0x7faf8806aa40 2023-10-08T00:33:11.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.652+0000 7faf7e7fc700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf68067320 0x7faf680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:11.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.652+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7faf800873b0 con 0x7faf8806aa40 2023-10-08T00:33:11.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.652+0000 7faf85d9b700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf68067320 0x7faf680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:11.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.653+0000 7faf85d9b700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf68067320 0x7faf680697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faf88169c80 tx=0x7faf70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:11.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.656+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf800542b0 con 0x7faf8806aa40 2023-10-08T00:33:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.896+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf880c7cb0 con 0x7faf8806aa40 2023-10-08T00:33:11.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.897+0000 7faf7e7fc700 1 -- 172.21.15.22:0/2160943226 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+3534 (secure 0 0 0) 0x7faf8001fde0 con 0x7faf8806aa40 2023-10-08T00:33:11.898 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:11.898 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":109,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2161300315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2161300315},{"type":"v1","addr":"172.21.15.192:6837","nonce":2161300315}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7402,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/753722618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":753722618},{"type":"v1","addr":"172.21.15.192:6836","nonce":753722618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":109},{"gid":7917,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/423092431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":423092431},{"type":"v1","addr":"172.21.15.22:6834","nonce":423092431}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3006401407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":3006401407},{"type":"v1","addr":"172.21.15.22:6835","nonce":3006401407}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[]} 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf68067320 msgr2=0x7faf680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf68067320 0x7faf680697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faf88169c80 tx=0x7faf70008040 comp rx=0 tx=0).stop 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 msgr2=0x7faf8814dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 0x7faf8814dd30 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7faf8000ed70 tx=0x7faf80001840 comp rx=0 tx=0).stop 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 shutdown_connections 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf880c91e0 0x7faf881580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf8806aa40 0x7faf8814dd30 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7faf68067320 0x7faf680697d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 --2- 172.21.15.22:0/2160943226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faf8806b520 0x7faf88157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:11.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 >> 172.21.15.22:0/2160943226 conn(0x7faf880cd670 msgr2=0x7faf88150320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:11.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 shutdown_connections 2023-10-08T00:33:11.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:11.899+0000 7faf8cff3700 1 -- 172.21.15.22:0/2160943226 wait complete. 2023-10-08T00:33:11.901 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 109 2023-10-08T00:33:11.912 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:33:11.912 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:33:11.912 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:33:11.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:11.913 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:33:11.913 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:33:11.913 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:33:11.913 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:11.913 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:33:11.913 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:33:11.913 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:33:11.913 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:11.914 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:33:11.914 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:33:11.914 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:33:11.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:11.920 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:33:11.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:33:11.921 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:33:11.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:33:11.924 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:33:11.924 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:33:11.925 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:33:11.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:33:11.964 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:33:11.964 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:11.965 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:33:11.965 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:11.966 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:33:11.966 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:11.967 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:33:11.967 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:11.967 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:33:12.041 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:33:12.041 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:33:12.050 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:33:12.050 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:33:12.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.097+0000 7f2c5dd85700 1 Processor -- start 2023-10-08T00:33:12.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.097+0000 7f2c5dd85700 1 -- start start 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5dd85700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c5806c2c0 0x7f2c580b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5dd85700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2c580b23d0 0x7f2c581581d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5dd85700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5806eaf0 con 0x7f2c58156590 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5dd85700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5815ab00 con 0x7f2c5806c2c0 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5dd85700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5815b080 con 0x7f2c580b23d0 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c5806c2c0 0x7f2c580b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:12.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c5806c2c0 0x7f2c580b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37384/0 (socket says 172.21.15.22:37384) 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 -- 172.21.15.22:0/3268845893 learned_addr learned my addr 172.21.15.22:0/3268845893 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5cd83700 1 --1- 172.21.15.22:0/3268845893 >> v1:172.21.15.22:6789/0 conn(0x7f2c58156590 0x7f2c580b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37156/0 (socket says 172.21.15.22:37156) 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c5d584700 1 --2- 172.21.15.22:0/3268845893 >> v2:172.21.15.192:3300/0 conn(0x7f2c580b23d0 0x7f2c581581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 -- 172.21.15.22:0/3268845893 >> v2:172.21.15.192:3300/0 conn(0x7f2c580b23d0 msgr2=0x7f2c581581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 --2- 172.21.15.22:0/3268845893 >> v2:172.21.15.192:3300/0 conn(0x7f2c580b23d0 0x7f2c581581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 -- 172.21.15.22:0/3268845893 >> v1:172.21.15.22:6789/0 conn(0x7f2c58156590 legacy=0x7f2c580b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 -- 172.21.15.22:0/3268845893 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580afa70 con 0x7f2c5806c2c0 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c577fe700 1 -- 172.21.15.22:0/3268845893 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585213620 0 0) 0x7f2c5806eaf0 con 0x7f2c58156590 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c57fff700 1 --2- 172.21.15.22:0/3268845893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c580b1e90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f2c58063630 tx=0x7f2c44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc021b650ca3fbf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.098+0000 7f2c577fe700 1 -- 172.21.15.22:0/3268845893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44009e70 con 0x7f2c5806c2c0 2023-10-08T00:33:12.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c577fe700 1 -- 172.21.15.22:0/3268845893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400b860 con 0x7f2c5806c2c0 2023-10-08T00:33:12.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c577fe700 1 -- 172.21.15.22:0/3268845893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400bc00 con 0x7f2c5806c2c0 2023-10-08T00:33:12.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 -- 172.21.15.22:0/3268845893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 msgr2=0x7f2c580b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:12.102 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/3268845893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c580b1e90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f2c58063630 tx=0x7f2c44009250 comp rx=0 tx=0).stop 2023-10-08T00:33:12.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 -- 172.21.15.22:0/3268845893 shutdown_connections 2023-10-08T00:33:12.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/3268845893 >> v2:172.21.15.192:3300/0 conn(0x7f2c580b23d0 0x7f2c581581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:12.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/3268845893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c580b1e90 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:12.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 -- 172.21.15.22:0/3268845893 >> 172.21.15.22:0/3268845893 conn(0x7f2c5806ddb0 msgr2=0x7f2c5806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:12.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 -- 172.21.15.22:0/3268845893 shutdown_connections 2023-10-08T00:33:12.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.099+0000 7f2c5dd85700 1 -- 172.21.15.22:0/3268845893 wait complete. 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.100+0000 7f2c5dd85700 1 Processor -- start 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 -- start start 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c58152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c580b23d0 0x7f2c580c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c58156590 0x7f2c581581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581668c0 con 0x7f2c5806c2c0 2023-10-08T00:33:12.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c37a0 con 0x7f2c58156590 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5dd85700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c3a80 con 0x7f2c580b23d0 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.101+0000 7f2c5cd83700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c58152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c58152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37400/0 (socket says 172.21.15.22:37400) 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 -- 172.21.15.22:0/1926161525 learned_addr learned my addr 172.21.15.22:0/1926161525 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c57fff700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c580b23d0 0x7f2c580c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5d584700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c58156590 0x7f2c581581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 -- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c580b23d0 msgr2=0x7f2c580c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c580b23d0 0x7f2c580c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 -- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c58156590 msgr2=0x7f2c581581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c58156590 0x7f2c581581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:12.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 -- 172.21.15.22:0/1926161525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440094f0 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5cd83700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c58152840 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c5b0 tx=0x7f2c4c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c005a70 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c005bd0 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0070d0 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c580c3d60 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.102+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c580c3370 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.103+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c580c4280 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.104+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2c4c007480 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.104+0000 7f2c54ff9700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c3c067320 0x7f2c3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.104+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2c4c083e90 con 0x7f2c5806c2c0 2023-10-08T00:33:12.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.104+0000 7f2c57fff700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c3c067320 0x7f2c3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:12.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.105+0000 7f2c57fff700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c3c067320 0x7f2c3c0697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2c58063630 tx=0x7f2c44017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:12.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.108+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c580c4280 con 0x7f2c5806c2c0 2023-10-08T00:33:12.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:12.317+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2c580c4280 con 0x7f2c5806c2c0 2023-10-08T00:33:13.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.092+0000 7f2c54ff9700 1 -- 172.21.15.22:0/1926161525 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2c580c4280 con 0x7f2c5806c2c0 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c3c067320 msgr2=0x7f2c3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c3c067320 0x7f2c3c0697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2c58063630 tx=0x7f2c44017000 comp rx=0 tx=0).stop 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 msgr2=0x7f2c58152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c58152840 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c5b0 tx=0x7f2c4c001040 comp rx=0 tx=0).stop 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 shutdown_connections 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c58156590 0x7f2c581581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c5806c2c0 0x7f2c58152840 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2c3c067320 0x7f2c3c0697d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 --2- 172.21.15.22:0/1926161525 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2c580b23d0 0x7f2c580c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 >> 172.21.15.22:0/1926161525 conn(0x7f2c5806ddb0 msgr2=0x7f2c581534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:13.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 shutdown_connections 2023-10-08T00:33:13.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.094+0000 7f2c5dd85700 1 -- 172.21.15.22:0/1926161525 wait complete. 2023-10-08T00:33:13.096 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:33:13.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:33:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.230+0000 7f29f3f92700 1 Processor -- start 2023-10-08T00:33:13.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.230+0000 7f29f3f92700 1 -- start start 2023-10-08T00:33:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f3f92700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29ec068550 0x7f29ec068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f3f92700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f29ec15e010 0x7f29ec06f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f3f92700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec06ec70 con 0x7f29ec06f640 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f3f92700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0b3430 con 0x7f29ec068550 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f3f92700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0b2e70 con 0x7f29ec15e010 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f1d2e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29ec068550 0x7f29ec068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f252f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f29ec06f640 0x7f29ec06a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37164/0 (socket says 172.21.15.22:37164) 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f252f700 1 -- 172.21.15.22:0/280665690 learned_addr learned my addr 172.21.15.22:0/280665690 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.231+0000 7f29f152d700 1 --2- 172.21.15.22:0/280665690 >> v2:172.21.15.192:3300/0 conn(0x7f29ec15e010 0x7f29ec06f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f1d2e700 1 -- 172.21.15.22:0/280665690 >> v2:172.21.15.192:3300/0 conn(0x7f29ec15e010 msgr2=0x7f29ec06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f1d2e700 1 --2- 172.21.15.22:0/280665690 >> v2:172.21.15.192:3300/0 conn(0x7f29ec15e010 0x7f29ec06f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f1d2e700 1 -- 172.21.15.22:0/280665690 >> v1:172.21.15.22:6789/0 conn(0x7f29ec06f640 legacy=0x7f29ec06a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f1d2e700 1 -- 172.21.15.22:0/280665690 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0b3150 con 0x7f29ec068550 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f0d2c700 1 -- 172.21.15.22:0/280665690 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806915511 0 0) 0x7f29ec06ec70 con 0x7f29ec06f640 2023-10-08T00:33:13.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f1d2e700 1 --2- 172.21.15.22:0/280665690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec068920 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06d310 tx=0x7f29e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a685eec32be7855e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:13.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f0d2c700 1 -- 172.21.15.22:0/280665690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400b6b0 con 0x7f29ec068550 2023-10-08T00:33:13.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f0d2c700 1 -- 172.21.15.22:0/280665690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400b810 con 0x7f29ec068550 2023-10-08T00:33:13.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f0d2c700 1 -- 172.21.15.22:0/280665690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400bbb0 con 0x7f29ec068550 2023-10-08T00:33:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f3f92700 1 -- 172.21.15.22:0/280665690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 msgr2=0x7f29ec068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.232+0000 7f29f3f92700 1 --2- 172.21.15.22:0/280665690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec068920 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06d310 tx=0x7f29e40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.233+0000 7f29f3f92700 1 -- 172.21.15.22:0/280665690 shutdown_connections 2023-10-08T00:33:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.233+0000 7f29f3f92700 1 --2- 172.21.15.22:0/280665690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec068920 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.233+0000 7f29f3f92700 1 --2- 172.21.15.22:0/280665690 >> v2:172.21.15.192:3300/0 conn(0x7f29ec15e010 0x7f29ec06f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.233+0000 7f29f3f92700 1 -- 172.21.15.22:0/280665690 >> 172.21.15.22:0/280665690 conn(0x7f29ec0cd480 msgr2=0x7f29ec0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.233+0000 7f29f3f92700 1 -- 172.21.15.22:0/280665690 shutdown_connections 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.233+0000 7f29f3f92700 1 -- 172.21.15.22:0/280665690 wait complete. 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 Processor -- start 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 -- start start 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ec06f640 0x7f29ec0ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ec15e010 0x7f29ec15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0ab4e0 con 0x7f29ec068550 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0aa940 con 0x7f29ec06f640 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.234+0000 7f29f3f92700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0aabb0 con 0x7f29ec15e010 2023-10-08T00:33:13.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37410/0 (socket says 172.21.15.22:37410) 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 -- 172.21.15.22:0/785841575 learned_addr learned my addr 172.21.15.22:0/785841575 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f152d700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ec06f640 0x7f29ec0ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f252f700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ec15e010 0x7f29ec15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 -- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ec15e010 msgr2=0x7f29ec15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ec15e010 0x7f29ec15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 -- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ec06f640 msgr2=0x7f29ec0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ec06f640 0x7f29ec0ab970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 -- 172.21.15.22:0/785841575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009420 con 0x7f29ec068550 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f1d2e700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec152080 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0ce220 tx=0x7f29e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011420 con 0x7f29ec068550 2023-10-08T00:33:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4011580 con 0x7f29ec068550 2023-10-08T00:33:13.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec0aae90 con 0x7f29ec068550 2023-10-08T00:33:13.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011940 con 0x7f29ec068550 2023-10-08T00:33:13.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.235+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec0abeb0 con 0x7f29ec068550 2023-10-08T00:33:13.239 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.236+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec0ab7c0 con 0x7f29ec068550 2023-10-08T00:33:13.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.237+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f29e4011d30 con 0x7f29ec068550 2023-10-08T00:33:13.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.237+0000 7f29e9ffb700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f29d8067320 0x7f29d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.237+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f29e4085e50 con 0x7f29ec068550 2023-10-08T00:33:13.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.237+0000 7f29f152d700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f29d8067320 0x7f29d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.238+0000 7f29f152d700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f29d8067320 0x7f29d80697d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0cd250 tx=0x7f29e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:13.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.242+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29e4052e30 con 0x7f29ec068550 2023-10-08T00:33:13.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.512+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f29ec1525c0 con 0x7f29ec068550 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.512+0000 7f29e9ffb700 1 -- 172.21.15.22:0/785841575 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f29e4015090 con 0x7f29ec068550 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.513 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.514 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.515 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.516 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:33:13.517 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.518 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.519 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:33:13.520 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.521 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.522 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:33:13.523 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:33:13.523 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.523 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.523 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:33:13.526 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.527 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.528 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.529 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:33:13.530 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:33:13.531 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f29d8067320 msgr2=0x7f29d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f29d8067320 0x7f29d80697d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0cd250 tx=0x7f29e0008040 comp rx=0 tx=0).stop 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 msgr2=0x7f29ec152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec152080 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0ce220 tx=0x7f29e4017000 comp rx=0 tx=0).stop 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 shutdown_connections 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f29d8067320 0x7f29d80697d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f29ec15e010 0x7f29ec15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29ec068550 0x7f29ec152080 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 --2- 172.21.15.22:0/785841575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ec06f640 0x7f29ec0ab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.533 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 >> 172.21.15.22:0/785841575 conn(0x7f29ec0cd480 msgr2=0x7f29ec156140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:13.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 shutdown_connections 2023-10-08T00:33:13.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.514+0000 7f29f3f92700 1 -- 172.21.15.22:0/785841575 wait complete. 2023-10-08T00:33:13.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:13.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.653+0000 7f057eb7d700 1 Processor -- start 2023-10-08T00:33:13.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.653+0000 7f057eb7d700 1 -- start start 2023-10-08T00:33:13.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057eb7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 0x7f05780b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057eb7d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05780b11d0 con 0x7f0578159420 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057eb7d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05780b14b0 con 0x7f057815d230 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057eb7d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05780b1790 con 0x7f05781597f0 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057db7b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0578159420 0x7f05780b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37166/0 (socket says 172.21.15.22:37166) 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057db7b700 1 -- 172.21.15.22:0/2092601672 learned_addr learned my addr 172.21.15.22:0/2092601672 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057d37a700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 0x7f05780b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189299684 0 0) 0x7f05780b11d0 con 0x7f0578159420 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.654+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0560003570 con 0x7f0578159420 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649365389 0 0) 0x7f05780b14b0 con 0x7f057815d230 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05780b11d0 con 0x7f057815d230 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3964746657 0 0) 0x7f0560003570 con 0x7f0578159420 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 msgr2=0x7f05780b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 0x7f05780b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 >> v1:172.21.15.192:6789/0 conn(0x7f057815d230 legacy=0x7f05780b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780b1a70 con 0x7f0578159420 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f0570001470 con 0x7f0578159420 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 >> v1:172.21.15.22:6789/0 conn(0x7f0578159420 legacy=0x7f05780b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f0560004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 0x7f0560004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0560004d50 0x7f05600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780b1790 con 0x7f0560003c20 2023-10-08T00:33:13.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056000bbf0 con 0x7f0560004d50 2023-10-08T00:33:13.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056000bd60 con 0x7f05781597f0 2023-10-08T00:33:13.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f0560004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057d37a700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 0x7f0560004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057e37c700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0560004d50 0x7f05600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 -- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 msgr2=0x7f0560004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05781597f0 0x7f0560004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 -- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0560004d50 msgr2=0x7f05600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0560004d50 0x7f05600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 -- 172.21.15.22:0/2092601672 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560003570 con 0x7f0560003c20 2023-10-08T00:33:13.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057e37c700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0560004d50 0x7f05600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057db7b700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f0560004010 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0570007fd0 tx=0x7f0570001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e97b21517fbf2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000cae0 con 0x7f0560003c20 2023-10-08T00:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057000cc60 con 0x7f0560003c20 2023-10-08T00:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.655+0000 7f057cb79700 1 -- 172.21.15.22:0/2092601672 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570005920 con 0x7f0560003c20 2023-10-08T00:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057eb7d700 1 -- 172.21.15.22:0/2092601672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 msgr2=0x7f0560004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057eb7d700 1 --2- 172.21.15.22:0/2092601672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f0560004010 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0570007fd0 tx=0x7f0570001d40 comp rx=0 tx=0).stop 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057e37c700 1 -- 172.21.15.22:0/2092601672 reap_dead start 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057eb7d700 1 -- 172.21.15.22:0/2092601672 shutdown_connections 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057eb7d700 1 -- 172.21.15.22:0/2092601672 >> 172.21.15.22:0/2092601672 conn(0x7f05780d0660 msgr2=0x7f05780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057eb7d700 1 -- 172.21.15.22:0/2092601672 shutdown_connections 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.656+0000 7f057eb7d700 1 -- 172.21.15.22:0/2092601672 wait complete. 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.657+0000 7f057eb7d700 1 Processor -- start 2023-10-08T00:33:13.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.657+0000 7f057eb7d700 1 -- start start 2023-10-08T00:33:13.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057eb7d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f057816dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057eb7d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05780c7000 0x7f0578153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057eb7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f057815ab90 0x7f0578069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057eb7d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057816e0f0 con 0x7f0560003c20 2023-10-08T00:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057eb7d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05780c5400 con 0x7f05780c7000 2023-10-08T00:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057eb7d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0578154ac0 con 0x7f057815ab90 2023-10-08T00:33:13.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f057816dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f057816dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37424/0 (socket says 172.21.15.22:37424) 2023-10-08T00:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 -- 172.21.15.22:0/613679310 learned_addr learned my addr 172.21.15.22:0/613679310 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057d37a700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05780c7000 0x7f0578153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057e37c700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f057815ab90 0x7f0578069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 -- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f057815ab90 msgr2=0x7f0578069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f057815ab90 0x7f0578069510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 -- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05780c7000 msgr2=0x7f0578153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05780c7000 0x7f0578153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.658+0000 7f057db7b700 1 -- 172.21.15.22:0/613679310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057815b090 con 0x7f0560003c20 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.659+0000 7f057db7b700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f057816dbb0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f057000c7a0 tx=0x7f0570015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.659+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570024070 con 0x7f0560003c20 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.659+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570000bc0 con 0x7f0560003c20 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.659+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057815b370 con 0x7f0560003c20 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.659+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570005cd0 con 0x7f0560003c20 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.659+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057815b930 con 0x7f0560003c20 2023-10-08T00:33:13.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.660+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05780c56e0 con 0x7f0560003c20 2023-10-08T00:33:13.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.660+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0570004a40 con 0x7f0560003c20 2023-10-08T00:33:13.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.661+0000 7f0575ffb700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0564067320 0x7f05640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:13.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.661+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0570085500 con 0x7f0560003c20 2023-10-08T00:33:13.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.661+0000 7f057d37a700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0564067320 0x7f05640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:13.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.662+0000 7f057d37a700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0564067320 0x7f05640697d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0578157eb0 tx=0x7f056c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:13.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.665+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0570052650 con 0x7f0560003c20 2023-10-08T00:33:13.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.859+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f057804c3c0 con 0x7f0560003c20 2023-10-08T00:33:13.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.859+0000 7f0575ffb700 1 -- 172.21.15.22:0/613679310 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f0570055c70 con 0x7f0560003c20 2023-10-08T00:33:13.860 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:13.860 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":164,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:13.090046+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0564067320 msgr2=0x7f05640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0564067320 0x7f05640697d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0578157eb0 tx=0x7f056c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 msgr2=0x7f057816dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f057816dbb0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f057000c7a0 tx=0x7f0570015000 comp rx=0 tx=0).stop 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 shutdown_connections 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0564067320 0x7f05640697d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f057815ab90 0x7f0578069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0560003c20 0x7f057816dbb0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 --2- 172.21.15.22:0/613679310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05780c7000 0x7f0578153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 >> 172.21.15.22:0/613679310 conn(0x7f05780d0660 msgr2=0x7f05780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 shutdown_connections 2023-10-08T00:33:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.862+0000 7f057eb7d700 1 -- 172.21.15.22:0/613679310 wait complete. 2023-10-08T00:33:13.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:33:13.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:33:13.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.997+0000 7f3704473700 1 Processor -- start 2023-10-08T00:33:13.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.997+0000 7f3704473700 1 -- start start 2023-10-08T00:33:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3704473700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36fc159890 0x7f36fc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3704473700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3704473700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc069ee0 con 0x7f36fc159c60 2023-10-08T00:33:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3704473700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc15a160 con 0x7f36fc159890 2023-10-08T00:33:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3704473700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc0d13a0 con 0x7f36fc069560 2023-10-08T00:33:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f370220f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36fc159890 0x7f36fc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:48892/0 (socket says 172.21.15.22:48892) 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3701a0e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f36fc159c60 0x7f36fc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:47008/0 (socket says 172.21.15.22:47008) 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f370220f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36fc159890 0x7f36fc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:51436/0 (socket says 172.21.15.22:51436) 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 -- 172.21.15.22:0/89205667 learned_addr learned my addr 172.21.15.22:0/89205667 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 -- 172.21.15.22:0/89205667 >> v2:172.21.15.192:3300/0 conn(0x7f36fc159890 msgr2=0x7f36fc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 --2- 172.21.15.22:0/89205667 >> v2:172.21.15.192:3300/0 conn(0x7f36fc159890 0x7f36fc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 -- 172.21.15.22:0/89205667 >> v1:172.21.15.192:6789/0 conn(0x7f36fc159c60 legacy=0x7f36fc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 -- 172.21.15.22:0/89205667 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc15e140 con 0x7f36fc069560 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.998+0000 7f3702a10700 1 --2- 172.21.15.22:0/89205667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc0699a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36f40099b0 tx=0x7f36f4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6af18d7088adfc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f370120d700 1 -- 172.21.15.22:0/89205667 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f4009ea0 con 0x7f36fc069560 2023-10-08T00:33:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f370120d700 1 -- 172.21.15.22:0/89205667 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400b860 con 0x7f36fc069560 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f370120d700 1 -- 172.21.15.22:0/89205667 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400bc00 con 0x7f36fc069560 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 -- 172.21.15.22:0/89205667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 msgr2=0x7f36fc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 --2- 172.21.15.22:0/89205667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc0699a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36f40099b0 tx=0x7f36f4009250 comp rx=0 tx=0).stop 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 -- 172.21.15.22:0/89205667 shutdown_connections 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 --2- 172.21.15.22:0/89205667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc0699a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 --2- 172.21.15.22:0/89205667 >> v2:172.21.15.192:3300/0 conn(0x7f36fc159890 0x7f36fc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 -- 172.21.15.22:0/89205667 >> 172.21.15.22:0/89205667 conn(0x7f36fc068e20 msgr2=0x7f36fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 -- 172.21.15.22:0/89205667 shutdown_connections 2023-10-08T00:33:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:13.999+0000 7f3704473700 1 -- 172.21.15.22:0/89205667 wait complete. 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.000+0000 7f3704473700 1 Processor -- start 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.000+0000 7f3704473700 1 -- start start 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3704473700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3704473700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 0x7f36fc1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3704473700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36fc159c60 0x7f36fc0b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3704473700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1512e0 con 0x7f36fc159890 2023-10-08T00:33:14.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3704473700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc151e60 con 0x7f36fc159c60 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3704473700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc151530 con 0x7f36fc069560 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3701a0e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 0x7f36fc1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3701a0e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 0x7f36fc1496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37438/0 (socket says 172.21.15.22:37438) 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3701a0e700 1 -- 172.21.15.22:0/2671356278 learned_addr learned my addr 172.21.15.22:0/2671356278 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f3702a10700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36fc159c60 0x7f36fc0b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.001+0000 7f370220f700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3701a0e700 1 -- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 msgr2=0x7f36fc1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3701a0e700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc1522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3701a0e700 1 -- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36fc159c60 msgr2=0x7f36fc0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3701a0e700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36fc159c60 0x7f36fc0b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3701a0e700 1 -- 172.21.15.22:0/2671356278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40094f0 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3701a0e700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 0x7f36fc1496d0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c7f0 tx=0x7f36f0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0005a70 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f0005bf0 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc151810 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f00070d0 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.002+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc149c10 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.003+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc151ff0 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.003+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f36f0007480 con 0x7f36fc159890 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.004+0000 7f36fa7fc700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36e8067320 0x7f36e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.004+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f36f0083d40 con 0x7f36fc159890 2023-10-08T00:33:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.004+0000 7f370220f700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36e8067320 0x7f36e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.004+0000 7f370220f700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36e8067320 0x7f36e80697d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00f570 tx=0x7f36ec00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.008+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36f0050d20 con 0x7f36fc159890 2023-10-08T00:33:14.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.199+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36fc04c3c0 con 0x7f36fc159890 2023-10-08T00:33:14.199 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.199+0000 7f36fa7fc700 1 -- 172.21.15.22:0/2671356278 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36f0017020 con 0x7f36fc159890 2023-10-08T00:33:14.200 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:33:14.201 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36e8067320 msgr2=0x7f36e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36e8067320 0x7f36e80697d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00f570 tx=0x7f36ec00b040 comp rx=0 tx=0).stop 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 msgr2=0x7f36fc1496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 0x7f36fc1496d0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f36f000c7f0 tx=0x7f36f0007f70 comp rx=0 tx=0).stop 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 shutdown_connections 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36fc159c60 0x7f36fc0b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f36e8067320 0x7f36e80697d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f36fc069560 0x7f36fc1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 --2- 172.21.15.22:0/2671356278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36fc159890 0x7f36fc1496d0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.202 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 >> 172.21.15.22:0/2671356278 conn(0x7f36fc068e20 msgr2=0x7f36fc1540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:14.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 shutdown_connections 2023-10-08T00:33:14.203 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.201+0000 7f3704473700 1 -- 172.21.15.22:0/2671356278 wait complete. 2023-10-08T00:33:14.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:33:14.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.332+0000 7fa2e4d23700 1 Processor -- start 2023-10-08T00:33:14.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.332+0000 7fa2e4d23700 1 -- start start 2023-10-08T00:33:14.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2e4d23700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e0068550 0x7fa2e0068920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2e4d23700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2e015e010 0x7fa2e006f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2e4d23700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2e006f640 0x7fa2e006a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2e4d23700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00b3430 con 0x7fa2e006f640 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2e4d23700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e006ec70 con 0x7fa2e015e010 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2e4d23700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00b2e70 con 0x7fa2e0068550 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.333+0000 7fa2ded9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2e006f640 0x7fa2e006a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2e006f640 0x7fa2e006a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37444/0 (socket says 172.21.15.22:37444) 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 -- 172.21.15.22:0/2961686152 learned_addr learned my addr 172.21.15.22:0/2961686152 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ddd9b700 1 --2- 172.21.15.22:0/2961686152 >> v2:172.21.15.192:3300/0 conn(0x7fa2e015e010 0x7fa2e006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2de59c700 1 --2- 172.21.15.22:0/2961686152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e0068550 0x7fa2e0068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 -- 172.21.15.22:0/2961686152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e0068550 msgr2=0x7fa2e0068920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 --2- 172.21.15.22:0/2961686152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e0068550 0x7fa2e0068920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 -- 172.21.15.22:0/2961686152 >> v2:172.21.15.192:3300/0 conn(0x7fa2e015e010 msgr2=0x7fa2e006f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 --2- 172.21.15.22:0/2961686152 >> v2:172.21.15.192:3300/0 conn(0x7fa2e015e010 0x7fa2e006f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 -- 172.21.15.22:0/2961686152 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00b3150 con 0x7fa2e006f640 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2ded9d700 1 --2- 172.21.15.22:0/2961686152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e006a7e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fa2e006b9a0 tx=0x7fa2d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6461da8917d8e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2dd59a700 1 -- 172.21.15.22:0/2961686152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800b860 con 0x7fa2e006f640 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2dd59a700 1 -- 172.21.15.22:0/2961686152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d800b9c0 con 0x7fa2e006f640 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.334+0000 7fa2dd59a700 1 -- 172.21.15.22:0/2961686152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800bd60 con 0x7fa2e006f640 2023-10-08T00:33:14.337 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 -- 172.21.15.22:0/2961686152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 msgr2=0x7fa2e006a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/2961686152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e006a7e0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fa2e006b9a0 tx=0x7fa2d8009250 comp rx=0 tx=0).stop 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 -- 172.21.15.22:0/2961686152 shutdown_connections 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/2961686152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e006a7e0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/2961686152 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e0068550 0x7fa2e0068920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/2961686152 >> v2:172.21.15.192:3300/0 conn(0x7fa2e015e010 0x7fa2e006f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 -- 172.21.15.22:0/2961686152 >> 172.21.15.22:0/2961686152 conn(0x7fa2e00cd480 msgr2=0x7fa2e00cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:14.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 -- 172.21.15.22:0/2961686152 shutdown_connections 2023-10-08T00:33:14.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.335+0000 7fa2e4d23700 1 -- 172.21.15.22:0/2961686152 wait complete. 2023-10-08T00:33:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.336+0000 7fa2e4d23700 1 Processor -- start 2023-10-08T00:33:14.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.336+0000 7fa2e4d23700 1 -- start start 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0068550 0x7fa2e015ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e014c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e015e010 0x7fa2e00aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e015d230 con 0x7fa2e006f640 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e014cbd0 con 0x7fa2e0068550 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00abf50 con 0x7fa2e015e010 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e014c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e014c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37452/0 (socket says 172.21.15.22:37452) 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 -- 172.21.15.22:0/3985111583 learned_addr learned my addr 172.21.15.22:0/3985111583 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:14.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2de59c700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0068550 0x7fa2e015ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ded9d700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e015e010 0x7fa2e00aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 -- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e015e010 msgr2=0x7fa2e00aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e015e010 0x7fa2e00aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 -- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0068550 msgr2=0x7fa2e015ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0068550 0x7fa2e015ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 -- 172.21.15.22:0/3985111583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80094f0 con 0x7fa2e006f640 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2ddd9b700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e014c690 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c8b0 tx=0x7fa2c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8011600 con 0x7fa2e006f640 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8011760 con 0x7fa2e006f640 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8011b00 con 0x7fa2e006f640 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e00ac1a0 con 0x7fa2e006f640 2023-10-08T00:33:14.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.337+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e00ac760 con 0x7fa2e006f640 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.339+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e004c3c0 con 0x7fa2e006f640 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.339+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa2c8018360 con 0x7fa2e006f640 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.339+0000 7fa2d67fc700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa2c0067320 0x7fa2c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.339+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa2c80846f0 con 0x7fa2e006f640 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.339+0000 7fa2de59c700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa2c0067320 0x7fa2c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.340+0000 7fa2de59c700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa2c0067320 0x7fa2c00697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000e4d0 tx=0x7fa2d0007680 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.344+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2c8055050 con 0x7fa2e006f640 2023-10-08T00:33:14.538 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.538+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa2e015d9c0 con 0x7fa2e006f640 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.538+0000 7fa2d67fc700 1 -- 172.21.15.22:0/3985111583 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa2c801e060 con 0x7fa2e006f640 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:14.539 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa2c0067320 msgr2=0x7fa2c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa2c0067320 0x7fa2c00697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000e4d0 tx=0x7fa2d0007680 comp rx=0 tx=0).stop 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 msgr2=0x7fa2e014c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e014c690 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800c8b0 tx=0x7fa2c8008040 comp rx=0 tx=0).stop 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 shutdown_connections 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa2c0067320 0x7fa2c00697d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa2e015e010 0x7fa2e00aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2e0068550 0x7fa2e015ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 --2- 172.21.15.22:0/3985111583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2e006f640 0x7fa2e014c690 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 >> 172.21.15.22:0/3985111583 conn(0x7fa2e00cd480 msgr2=0x7fa2e0153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:14.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 shutdown_connections 2023-10-08T00:33:14.542 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.540+0000 7fa2e4d23700 1 -- 172.21.15.22:0/3985111583 wait complete. 2023-10-08T00:33:14.552 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:33:14.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:33:14.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.677+0000 7fced24d5700 1 Processor -- start 2023-10-08T00:33:14.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.677+0000 7fced24d5700 1 -- start start 2023-10-08T00:33:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fced24d5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcecc1597b0 0x7fcecc0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fced24d5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcecc159b80 0x7fcecc06a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fced24d5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06ac30 con 0x7fcecc06a7f0 2023-10-08T00:33:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fced24d5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc068390 con 0x7fcecc159b80 2023-10-08T00:33:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fced24d5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc0ac530 con 0x7fcecc1597b0 2023-10-08T00:33:14.680 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcecc159b80 0x7fcecc06a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcecc159b80 0x7fcecc06a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37462/0 (socket says 172.21.15.22:37462) 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 -- 172.21.15.22:0/1097606284 learned_addr learned my addr 172.21.15.22:0/1097606284 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fced0a72700 1 --1- 172.21.15.22:0/1097606284 >> v1:172.21.15.22:6789/0 conn(0x7fcecc06a7f0 0x7fcecc068d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37174/0 (socket says 172.21.15.22:37174) 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecbfff700 1 --2- 172.21.15.22:0/1097606284 >> v2:172.21.15.192:3300/0 conn(0x7fcecc1597b0 0x7fcecc0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 -- 172.21.15.22:0/1097606284 >> v2:172.21.15.192:3300/0 conn(0x7fcecc1597b0 msgr2=0x7fcecc0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 --2- 172.21.15.22:0/1097606284 >> v2:172.21.15.192:3300/0 conn(0x7fcecc1597b0 0x7fcecc0af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 -- 172.21.15.22:0/1097606284 >> v1:172.21.15.22:6789/0 conn(0x7fcecc06a7f0 legacy=0x7fcecc068d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 -- 172.21.15.22:0/1097606284 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0aa680 con 0x7fcecc159b80 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.678+0000 7fcecb7fe700 1 --2- 172.21.15.22:0/1097606284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc06a2b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fcec00099b0 tx=0x7fcec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0a8847aacb08d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fcecaffd700 1 -- 172.21.15.22:0/1097606284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000b820 con 0x7fcecc159b80 2023-10-08T00:33:14.681 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fcecaffd700 1 -- 172.21.15.22:0/1097606284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec000b980 con 0x7fcecc159b80 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fcecaffd700 1 -- 172.21.15.22:0/1097606284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000bd20 con 0x7fcecc159b80 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 -- 172.21.15.22:0/1097606284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 msgr2=0x7fcecc06a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 --2- 172.21.15.22:0/1097606284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc06a2b0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fcec00099b0 tx=0x7fcec0009250 comp rx=0 tx=0).stop 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 -- 172.21.15.22:0/1097606284 shutdown_connections 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 --2- 172.21.15.22:0/1097606284 >> v2:172.21.15.192:3300/0 conn(0x7fcecc1597b0 0x7fcecc0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 --2- 172.21.15.22:0/1097606284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc06a2b0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 -- 172.21.15.22:0/1097606284 >> 172.21.15.22:0/1097606284 conn(0x7fcecc0cd880 msgr2=0x7fcecc0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 -- 172.21.15.22:0/1097606284 shutdown_connections 2023-10-08T00:33:14.682 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.679+0000 7fced24d5700 1 -- 172.21.15.22:0/1097606284 wait complete. 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.680+0000 7fced24d5700 1 Processor -- start 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.680+0000 7fced24d5700 1 -- start start 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced24d5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc06a7f0 0x7fcecc14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced24d5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcecc1597b0 0x7fcecc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced24d5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced24d5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0c3df0 con 0x7fcecc159b80 2023-10-08T00:33:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced24d5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc14bf40 con 0x7fcecc06a7f0 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced24d5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0c31e0 con 0x7fcecc1597b0 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced0a72700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced0a72700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc0b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37466/0 (socket says 172.21.15.22:37466) 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.681+0000 7fced0a72700 1 -- 172.21.15.22:0/2763035438 learned_addr learned my addr 172.21.15.22:0/2763035438 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fcecbfff700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc06a7f0 0x7fcecc14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fcecb7fe700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcecc1597b0 0x7fcecc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced0a72700 1 -- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcecc1597b0 msgr2=0x7fcecc0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced0a72700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcecc1597b0 0x7fcecc0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced0a72700 1 -- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc06a7f0 msgr2=0x7fcecc14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced0a72700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc06a7f0 0x7fcecc14ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced0a72700 1 -- 172.21.15.22:0/2763035438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec00094f0 con 0x7fcecc159b80 2023-10-08T00:33:14.686 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fcecbfff700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc06a7f0 0x7fcecc14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced0a72700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc0b0d20 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fcec400cd00 tx=0x7fcec4001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4005df0 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400a960 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400ad00 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc0c34c0 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.682+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc0c3a80 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.683+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcecc0718b0 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.683+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcec4007300 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.684+0000 7fceb3fff700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fceb8067320 0x7fceb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.684+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcec4084a60 con 0x7fcecc159b80 2023-10-08T00:33:14.687 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.684+0000 7fcecbfff700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fceb8067320 0x7fceb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.685+0000 7fcecbfff700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fceb8067320 0x7fceb80697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcebc006fd0 tx=0x7fcebc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.688+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcec4051ac0 con 0x7fcecc159b80 2023-10-08T00:33:14.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:14.883+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcecc0aa960 con 0x7fcecc159b80 2023-10-08T00:33:15.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.653+0000 7fceb3fff700 1 -- 172.21.15.22:0/2763035438 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcec400ae60 con 0x7fcecc159b80 2023-10-08T00:33:15.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fceb8067320 msgr2=0x7fceb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fceb8067320 0x7fceb80697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fcebc006fd0 tx=0x7fcebc008040 comp rx=0 tx=0).stop 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 msgr2=0x7fcecc0b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc0b0d20 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fcec400cd00 tx=0x7fcec4001b10 comp rx=0 tx=0).stop 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 shutdown_connections 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcecc159b80 0x7fcecc0b0d20 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcecc06a7f0 0x7fcecc14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fceb8067320 0x7fceb80697d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 --2- 172.21.15.22:0/2763035438 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcecc1597b0 0x7fcecc0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 >> 172.21.15.22:0/2763035438 conn(0x7fcecc0cd880 msgr2=0x7fcecc1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:15.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 shutdown_connections 2023-10-08T00:33:15.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.657+0000 7fced24d5700 1 -- 172.21.15.22:0/2763035438 wait complete. 2023-10-08T00:33:15.662 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:33:15.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:33:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.804+0000 7f9f2914e700 1 Processor -- start 2023-10-08T00:33:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.804+0000 7f9f2914e700 1 -- start start 2023-10-08T00:33:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2914e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f240cbb90 0x7f9f240af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2914e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240af860 con 0x7f9f24159950 2023-10-08T00:33:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2914e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f240ce380 con 0x7f9f24069c70 2023-10-08T00:33:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2914e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240cec20 con 0x7f9f240cbb90 2023-10-08T00:33:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f240cbb90 0x7f9f240af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9f240cbb90 0x7f9f240af320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37468/0 (socket says 172.21.15.22:37468) 2023-10-08T00:33:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2359e700 1 -- 172.21.15.22:0/1885626889 learned_addr learned my addr 172.21.15.22:0/1885626889 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2359e700 1 -- 172.21.15.22:0/1885626889 >> v1:172.21.15.192:6789/0 conn(0x7f9f24069c70 legacy=0x7f9f240cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2359e700 1 -- 172.21.15.22:0/1885626889 >> v1:172.21.15.22:6789/0 conn(0x7f9f24159950 legacy=0x7f9f24069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f2359e700 1 -- 172.21.15.22:0/1885626889 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240cbfb0 con 0x7f9f240cbb90 2023-10-08T00:33:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.805+0000 7f9f21d9b700 1 -- 172.21.15.22:0/1885626889 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544682257 0 0) 0x7f9f240af860 con 0x7f9f24159950 2023-10-08T00:33:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2359e700 1 --2- 172.21.15.22:0/1885626889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f240af320 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0099b0 tx=0x7f9f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328bc4afa20d6060 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f21d9b700 1 -- 172.21.15.22:0/1885626889 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00b860 con 0x7f9f240cbb90 2023-10-08T00:33:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f21d9b700 1 -- 172.21.15.22:0/1885626889 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c00b9c0 con 0x7f9f240cbb90 2023-10-08T00:33:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f21d9b700 1 -- 172.21.15.22:0/1885626889 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c00bd60 con 0x7f9f240cbb90 2023-10-08T00:33:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 -- 172.21.15.22:0/1885626889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 msgr2=0x7f9f240af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 --2- 172.21.15.22:0/1885626889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f240af320 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0099b0 tx=0x7f9f1c009250 comp rx=0 tx=0).stop 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 -- 172.21.15.22:0/1885626889 shutdown_connections 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 --2- 172.21.15.22:0/1885626889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f240af320 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 -- 172.21.15.22:0/1885626889 >> 172.21.15.22:0/1885626889 conn(0x7f9f24068e00 msgr2=0x7f9f240d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 -- 172.21.15.22:0/1885626889 shutdown_connections 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.806+0000 7f9f2914e700 1 -- 172.21.15.22:0/1885626889 wait complete. 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 Processor -- start 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 -- start start 2023-10-08T00:33:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f24069c70 0x7f9f24152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f24155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f24159950 0x7f9f24157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24152ad0 con 0x7f9f240cbb90 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24158970 con 0x7f9f24159950 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2914e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c7cc0 con 0x7f9f24069c70 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.808+0000 7f9f2259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f24155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f24155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37474/0 (socket says 172.21.15.22:37474) 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 -- 172.21.15.22:0/958658041 learned_addr learned my addr 172.21.15.22:0/958658041 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2359e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f24159950 0x7f9f24157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f22d9d700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f24069c70 0x7f9f24152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 -- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f24069c70 msgr2=0x7f9f24152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f24069c70 0x7f9f24152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 -- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f24159950 msgr2=0x7f9f24157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f24159950 0x7f9f24157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 -- 172.21.15.22:0/958658041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c0094f0 con 0x7f9f240cbb90 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2259c700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f24155d20 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c590 tx=0x7f9f0c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c011590 con 0x7f9f240cbb90 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c011710 con 0x7f9f240cbb90 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c011ad0 con 0x7f9f240cbb90 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240c7f10 con 0x7f9f240cbb90 2023-10-08T00:33:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.809+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f240c84d0 con 0x7f9f240cbb90 2023-10-08T00:33:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.810+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f240718b0 con 0x7f9f240cbb90 2023-10-08T00:33:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.811+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9f0c01b3b0 con 0x7f9f240cbb90 2023-10-08T00:33:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.811+0000 7f9f1affd700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f04067320 0x7f9f040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.811+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f9f0c083ea0 con 0x7f9f240cbb90 2023-10-08T00:33:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.811+0000 7f9f22d9d700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f04067320 0x7f9f040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.812+0000 7f9f22d9d700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f04067320 0x7f9f040697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9f14007fd0 tx=0x7f9f140015f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:15.816+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f0c050d10 con 0x7f9f240cbb90 2023-10-08T00:33:16.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.006+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f241559c0 con 0x7f9f240cbb90 2023-10-08T00:33:16.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.659+0000 7f9f1affd700 1 -- 172.21.15.22:0/958658041 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f0c017070 con 0x7f9f240cbb90 2023-10-08T00:33:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.666+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f04067320 msgr2=0x7f9f040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.666+0000 7f9f2914e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f04067320 0x7f9f040697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9f14007fd0 tx=0x7f9f140015f0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.666+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 msgr2=0x7f9f24155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:16.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.666+0000 7f9f2914e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f24155d20 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c590 tx=0x7f9f0c00c8a0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.668+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 shutdown_connections 2023-10-08T00:33:16.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.668+0000 7f9f2914e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f24159950 0x7f9f24157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.668+0000 7f9f2914e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9f04067320 0x7f9f040697d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.668+0000 7f9f2914e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9f24069c70 0x7f9f24152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.668+0000 7f9f2914e700 1 --2- 172.21.15.22:0/958658041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f240cbb90 0x7f9f24155d20 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.668+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 >> 172.21.15.22:0/958658041 conn(0x7f9f24068e00 msgr2=0x7f9f24152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:16.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.669+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 shutdown_connections 2023-10-08T00:33:16.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.669+0000 7f9f2914e700 1 -- 172.21.15.22:0/958658041 wait complete. 2023-10-08T00:33:16.675 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:33:16.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:33:16.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.813+0000 7fd57b0e6700 1 Processor -- start 2023-10-08T00:33:16.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.813+0000 7fd57b0e6700 1 -- start start 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.813+0000 7fd57b0e6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd574159890 0x7fd57415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd57b0e6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd574159c60 0x7fd57415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd57b0e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd574069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd57b0e6700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57415df50 con 0x7fd574159c60 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd57b0e6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57415a160 con 0x7fd574159890 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd57b0e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740d13a0 con 0x7fd57415db10 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd574159c60 0x7fd57415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd574159c60 0x7fd57415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45290/0 (socket says 172.21.15.22:45290) 2023-10-08T00:33:16.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 -- 172.21.15.22:0/2272923415 learned_addr learned my addr 172.21.15.22:0/2272923415 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd578e82700 1 --2- 172.21.15.22:0/2272923415 >> v2:172.21.15.192:3300/0 conn(0x7fd574159890 0x7fd57415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd579683700 1 --2- 172.21.15.22:0/2272923415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd574069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 -- 172.21.15.22:0/2272923415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 msgr2=0x7fd574069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 --2- 172.21.15.22:0/2272923415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd574069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 -- 172.21.15.22:0/2272923415 >> v2:172.21.15.192:3300/0 conn(0x7fd574159890 msgr2=0x7fd57415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 --2- 172.21.15.22:0/2272923415 >> v2:172.21.15.192:3300/0 conn(0x7fd574159890 0x7fd57415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 -- 172.21.15.22:0/2272923415 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57415e140 con 0x7fd574159c60 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd578e82700 1 --2- 172.21.15.22:0/2272923415 >> v2:172.21.15.192:3300/0 conn(0x7fd574159890 0x7fd57415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd573fff700 1 --2- 172.21.15.22:0/2272923415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159c60 0x7fd57415d5d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd5740d1090 tx=0x7fd568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacfc2b850b57fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd5737fe700 1 -- 172.21.15.22:0/2272923415 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56800b860 con 0x7fd574159c60 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd5737fe700 1 -- 172.21.15.22:0/2272923415 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56800b9c0 con 0x7fd574159c60 2023-10-08T00:33:16.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.814+0000 7fd5737fe700 1 -- 172.21.15.22:0/2272923415 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56800bd60 con 0x7fd574159c60 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2272923415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159c60 msgr2=0x7fd57415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2272923415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159c60 0x7fd57415d5d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd5740d1090 tx=0x7fd568009250 comp rx=0 tx=0).stop 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2272923415 shutdown_connections 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2272923415 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd574069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2272923415 >> v2:172.21.15.192:3300/0 conn(0x7fd574159890 0x7fd57415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2272923415 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159c60 0x7fd57415d5d0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2272923415 >> 172.21.15.22:0/2272923415 conn(0x7fd574068e20 msgr2=0x7fd5740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2272923415 shutdown_connections 2023-10-08T00:33:16.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.815+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2272923415 wait complete. 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.816+0000 7fd57b0e6700 1 Processor -- start 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.816+0000 7fd57b0e6700 1 -- start start 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd57b0e6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 0x7fd5740b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd57b0e6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd574159c60 0x7fd5741441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd57b0e6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd5741573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd57b0e6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740cd6b0 con 0x7fd574159890 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd57b0e6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b5b60 con 0x7fd574159c60 2023-10-08T00:33:16.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd57b0e6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b5e40 con 0x7fd57415db10 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 0x7fd5740b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 0x7fd5740b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45298/0 (socket says 172.21.15.22:45298) 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 -- 172.21.15.22:0/2734064547 learned_addr learned my addr 172.21.15.22:0/2734064547 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd573fff700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd574159c60 0x7fd5741441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd579683700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd5741573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 -- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 msgr2=0x7fd5741573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd5741573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 -- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd574159c60 msgr2=0x7fd5741441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd574159c60 0x7fd5741441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd578e82700 1 -- 172.21.15.22:0/2734064547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680094f0 con 0x7fd574159890 2023-10-08T00:33:16.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd573fff700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd574159c60 0x7fd5741441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.817+0000 7fd579683700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd5741573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.818+0000 7fd578e82700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 0x7fd5740b54a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd56400d860 tx=0x7fd564008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.818+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640125f0 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.818+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564012750 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.818+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564012ad0 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.818+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5740b6120 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.818+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd574144700 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.819+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5740cd820 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.819+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd564014430 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.820+0000 7fd570ff9700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd560067320 0x7fd5600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.820+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd564085990 con 0x7fd574159890 2023-10-08T00:33:16.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.820+0000 7fd573fff700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd560067320 0x7fd5600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:16.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.821+0000 7fd573fff700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd560067320 0x7fd5600697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd5740d1090 tx=0x7fd568017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:16.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:16.824+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd564056190 con 0x7fd574159890 2023-10-08T00:33:17.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.063+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5740cd7f0 con 0x7fd574159890 2023-10-08T00:33:17.667 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.666+0000 7fd570ff9700 1 -- 172.21.15.22:0/2734064547 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v111) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd564055d20 con 0x7fd574159890 2023-10-08T00:33:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.675+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd560067320 msgr2=0x7fd5600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.675+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd560067320 0x7fd5600697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd5740d1090 tx=0x7fd568017000 comp rx=0 tx=0).stop 2023-10-08T00:33:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.675+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 msgr2=0x7fd5740b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.675+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 0x7fd5740b54a0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd56400d860 tx=0x7fd564008040 comp rx=0 tx=0).stop 2023-10-08T00:33:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.676+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 shutdown_connections 2023-10-08T00:33:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.676+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd560067320 0x7fd5600697d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.676+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd57415db10 0x7fd5741573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.676+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd574159890 0x7fd5740b54a0 secure :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd56400d860 tx=0x7fd564008040 comp rx=0 tx=0).stop 2023-10-08T00:33:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.676+0000 7fd57b0e6700 1 --2- 172.21.15.22:0/2734064547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd574159c60 0x7fd5741441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.676+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 >> 172.21.15.22:0/2734064547 conn(0x7fd574068e20 msgr2=0x7fd574153280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.677+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 shutdown_connections 2023-10-08T00:33:17.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.678+0000 7fd57b0e6700 1 -- 172.21.15.22:0/2734064547 wait complete. 2023-10-08T00:33:17.682 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 28 and data pool 29 2023-10-08T00:33:17.700 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.820+0000 7ff9d61af700 1 Processor -- start 2023-10-08T00:33:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.820+0000 7ff9d61af700 1 -- start start 2023-10-08T00:33:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9d61af700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9d0159c60 0x7ff9d015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9d61af700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015a160 con 0x7ff9d015db10 2023-10-08T00:33:17.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9d61af700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d00d13a0 con 0x7ff9d0159890 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9d61af700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d015df50 con 0x7ff9d0159c60 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9ceffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9d0159c60 0x7ff9d015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9cffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9d015db10 0x7ff9d0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51590/0 (socket says 172.21.15.22:51590) 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9ceffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9d0159c60 0x7ff9d015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45304/0 (socket says 172.21.15.22:45304) 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.821+0000 7ff9cffff700 1 -- 172.21.15.22:0/582927016 learned_addr learned my addr 172.21.15.22:0/582927016 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ceffd700 1 -- 172.21.15.22:0/582927016 >> v1:172.21.15.192:6789/0 conn(0x7ff9d0159890 legacy=0x7ff9d015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ceffd700 1 -- 172.21.15.22:0/582927016 >> v1:172.21.15.22:6789/0 conn(0x7ff9d015db10 legacy=0x7ff9d0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ceffd700 1 -- 172.21.15.22:0/582927016 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d015e140 con 0x7ff9d0159c60 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/582927016 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193678613 0 0) 0x7ff9d015a160 con 0x7ff9d015db10 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/582927016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159c60 0x7ff9d015d5d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098e0 tx=0x7ff9c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987cabf7600bc400 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:17.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/582927016 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4009e80 con 0x7ff9d0159c60 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/582927016 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c400b860 con 0x7ff9d0159c60 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9ce7fc700 1 -- 172.21.15.22:0/582927016 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400bbe0 con 0x7ff9d0159c60 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9d61af700 1 -- 172.21.15.22:0/582927016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159c60 msgr2=0x7ff9d015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9d61af700 1 --2- 172.21.15.22:0/582927016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159c60 0x7ff9d015d5d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40098e0 tx=0x7ff9c40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9d61af700 1 -- 172.21.15.22:0/582927016 shutdown_connections 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9d61af700 1 --2- 172.21.15.22:0/582927016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159c60 0x7ff9d015d5d0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9d61af700 1 -- 172.21.15.22:0/582927016 >> 172.21.15.22:0/582927016 conn(0x7ff9d0068e20 msgr2=0x7ff9d00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.822+0000 7ff9d61af700 1 -- 172.21.15.22:0/582927016 shutdown_connections 2023-10-08T00:33:17.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.823+0000 7ff9d61af700 1 -- 172.21.15.22:0/582927016 wait complete. 2023-10-08T00:33:17.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 Processor -- start 2023-10-08T00:33:17.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 -- start start 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 0x7ff9d016ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d0159c60 0x7ff9d016b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d015db10 0x7ff9d0169ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d016aea0 con 0x7ff9d0159890 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d016a8e0 con 0x7ff9d015db10 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.824+0000 7ff9d61af700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d016abc0 con 0x7ff9d0159c60 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 0x7ff9d016ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 0x7ff9d016ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45312/0 (socket says 172.21.15.22:45312) 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 -- 172.21.15.22:0/3117356069 learned_addr learned my addr 172.21.15.22:0/3117356069 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 -- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d0159c60 msgr2=0x7ff9d016b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d0159c60 0x7ff9d016b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 -- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d015db10 msgr2=0x7ff9d0169ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d015db10 0x7ff9d0169ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 -- 172.21.15.22:0/3117356069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4009420 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9cf7fe700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 0x7ff9d016ce10 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000c590 tx=0x7ff9c000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0011590 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c00116f0 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d00b36c0 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0011ab0 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.825+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d00b5330 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.826+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d00b54f0 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.826+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff9c001b3b0 con 0x7ff9d0159890 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.827+0000 7ff9b77fe700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9bc067320 0x7ff9bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:17.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.827+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9c0084200 con 0x7ff9d0159890 2023-10-08T00:33:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.827+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9bc067320 0x7ff9bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.828+0000 7ff9ceffd700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9bc067320 0x7ff9bc0697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c6ee0 tx=0x7ff9c4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:17.833 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:17.831+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9c0050e90 con 0x7ff9d0159890 2023-10-08T00:33:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.026+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9d004c3c0 con 0x7ff9d0159890 2023-10-08T00:33:18.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.027+0000 7ff9b77fe700 1 -- 172.21.15.22:0/3117356069 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15377 (secure 0 0 0) 0x7ff9c0017090 con 0x7ff9d0159890 2023-10-08T00:33:18.028 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:18.028 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":167,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:17.064116+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9bc067320 msgr2=0x7ff9bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9bc067320 0x7ff9bc0697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00c6ee0 tx=0x7ff9c4017000 comp rx=0 tx=0).stop 2023-10-08T00:33:18.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 msgr2=0x7ff9d016ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 0x7ff9d016ce10 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000c590 tx=0x7ff9c000c950 comp rx=0 tx=0).stop 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 shutdown_connections 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9d015db10 0x7ff9d0169ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9d0159890 0x7ff9d016ce10 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff9bc067320 0x7ff9bc0697d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 --2- 172.21.15.22:0/3117356069 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9d0159c60 0x7ff9d016b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 >> 172.21.15.22:0/3117356069 conn(0x7ff9d0068e20 msgr2=0x7ff9d00c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 shutdown_connections 2023-10-08T00:33:18.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.029+0000 7ff9d61af700 1 -- 172.21.15.22:0/3117356069 wait complete. 2023-10-08T00:33:18.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.161+0000 7fac2a102700 1 Processor -- start 2023-10-08T00:33:18.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.161+0000 7fac2a102700 1 -- start start 2023-10-08T00:33:18.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.161+0000 7fac2a102700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.161+0000 7fac2a102700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2415a160 con 0x7fac2415db10 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.161+0000 7fac2a102700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240d13a0 con 0x7fac24159890 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.161+0000 7fac2a102700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2415e140 con 0x7fac24159c60 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac23fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fac2415db10 0x7fac24069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51594/0 (socket says 172.21.15.22:51594) 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac23fff700 1 -- 172.21.15.22:0/3818564849 learned_addr learned my addr 172.21.15.22:0/3818564849 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac22ffd700 1 --2- 172.21.15.22:0/3818564849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033976151 0 0) 0x7fac2415a160 con 0x7fac2415db10 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c003570 con 0x7fac2415db10 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768266321 0 0) 0x7fac240d13a0 con 0x7fac24159890 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac2415a160 con 0x7fac24159890 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018910668 0 0) 0x7fac0c003570 con 0x7fac2415db10 2023-10-08T00:33:18.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac22ffd700 1 -- 172.21.15.22:0/3818564849 >> v1:172.21.15.192:6789/0 conn(0x7fac24159890 legacy=0x7fac2415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac22ffd700 1 -- 172.21.15.22:0/3818564849 >> v1:172.21.15.22:6789/0 conn(0x7fac2415db10 legacy=0x7fac24069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac22ffd700 1 -- 172.21.15.22:0/3818564849 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2415a3d0 con 0x7fac24159c60 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.162+0000 7fac22ffd700 1 --2- 172.21.15.22:0/3818564849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac18009910 tx=0x7fac180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac1ab8df6c5f034 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c0017f0 con 0x7fac24159c60 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac18011420 con 0x7fac24159c60 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac227fc700 1 -- 172.21.15.22:0/3818564849 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180117c0 con 0x7fac24159c60 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 -- 172.21.15.22:0/3818564849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 msgr2=0x7fac2415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 --2- 172.21.15.22:0/3818564849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d5d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fac18009910 tx=0x7fac180091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 -- 172.21.15.22:0/3818564849 shutdown_connections 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 --2- 172.21.15.22:0/3818564849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d5d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 -- 172.21.15.22:0/3818564849 >> 172.21.15.22:0/3818564849 conn(0x7fac24068e20 msgr2=0x7fac240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:18.165 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 -- 172.21.15.22:0/3818564849 shutdown_connections 2023-10-08T00:33:18.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.163+0000 7fac2a102700 1 -- 172.21.15.22:0/3818564849 wait complete. 2023-10-08T00:33:18.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.164+0000 7fac2a102700 1 Processor -- start 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.164+0000 7fac2a102700 1 -- start start 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac2a102700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 0x7fac2415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac2a102700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac2a102700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac2415db10 0x7fac240ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac2a102700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2414ac10 con 0x7fac24159890 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac2a102700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac240b1420 con 0x7fac2415db10 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac2a102700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac240cee20 con 0x7fac24159c60 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 0x7fac2415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 0x7fac2415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45322/0 (socket says 172.21.15.22:45322) 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 -- 172.21.15.22:0/3735794467 learned_addr learned my addr 172.21.15.22:0/3735794467 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac23fff700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac2415db10 0x7fac240ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac22ffd700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 -- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 msgr2=0x7fac2415d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 -- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac2415db10 msgr2=0x7fac240ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac2415db10 0x7fac240ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.165+0000 7fac237fe700 1 -- 172.21.15.22:0/3735794467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009420 con 0x7fac24159890 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.166+0000 7fac237fe700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 0x7fac2415cba0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c790 tx=0x7fac14007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.166+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14010510 con 0x7fac24159890 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.166+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14010670 con 0x7fac24159890 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.166+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac240cf100 con 0x7fac24159890 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.166+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14010a10 con 0x7fac24159890 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.166+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac240cf3e0 con 0x7fac24159890 2023-10-08T00:33:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.167+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2404c3c0 con 0x7fac24159890 2023-10-08T00:33:18.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.167+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fac1401b3b0 con 0x7fac24159890 2023-10-08T00:33:18.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.168+0000 7fac0b7fe700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fac10067320 0x7fac100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.168+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac14084500 con 0x7fac24159890 2023-10-08T00:33:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.168+0000 7fac22ffd700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fac10067320 0x7fac100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.168+0000 7fac22ffd700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fac10067320 0x7fac100697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fac2415a090 tx=0x7fac18016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.172+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac14051190 con 0x7fac24159890 2023-10-08T00:33:18.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.369+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac24153630 con 0x7fac24159890 2023-10-08T00:33:18.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.370+0000 7fac0b7fe700 1 -- 172.21.15.22:0/3735794467 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15377 (secure 0 0 0) 0x7fac140547b0 con 0x7fac24159890 2023-10-08T00:33:18.370 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:18.371 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":167,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:17.064116+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fac10067320 msgr2=0x7fac100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fac10067320 0x7fac100697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fac2415a090 tx=0x7fac18016000 comp rx=0 tx=0).stop 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 msgr2=0x7fac2415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 0x7fac2415cba0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c790 tx=0x7fac14007e10 comp rx=0 tx=0).stop 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 shutdown_connections 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac2415db10 0x7fac240ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac24159890 0x7fac2415cba0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fac10067320 0x7fac100697d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 --2- 172.21.15.22:0/3735794467 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fac24159c60 0x7fac2415d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 >> 172.21.15.22:0/3735794467 conn(0x7fac24068e20 msgr2=0x7fac24157460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 shutdown_connections 2023-10-08T00:33:18.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.372+0000 7fac2a102700 1 -- 172.21.15.22:0/3735794467 wait complete. 2023-10-08T00:33:18.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:33:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.508+0000 7f1515504700 1 Processor -- start 2023-10-08T00:33:18.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.508+0000 7f1515504700 1 -- start start 2023-10-08T00:33:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f1515504700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1510159890 0x7f151015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f1515504700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1510159c60 0x7f151015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f1515504700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f151015db10 0x7f1510069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f1515504700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151015df50 con 0x7f1510159c60 2023-10-08T00:33:18.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f1515504700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151015a160 con 0x7f1510159890 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f1515504700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15100d13a0 con 0x7f151015db10 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f150e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1510159c60 0x7f151015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f150e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1510159c60 0x7f151015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45324/0 (socket says 172.21.15.22:45324) 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f150e7fc700 1 -- 172.21.15.22:0/4214092998 learned_addr learned my addr 172.21.15.22:0/4214092998 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.509+0000 7f150f7fe700 1 --2- 172.21.15.22:0/4214092998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f151015db10 0x7f1510069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150effd700 1 --2- 172.21.15.22:0/4214092998 >> v2:172.21.15.192:3300/0 conn(0x7f1510159890 0x7f151015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150e7fc700 1 -- 172.21.15.22:0/4214092998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f151015db10 msgr2=0x7f1510069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150e7fc700 1 --2- 172.21.15.22:0/4214092998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f151015db10 0x7f1510069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150e7fc700 1 -- 172.21.15.22:0/4214092998 >> v2:172.21.15.192:3300/0 conn(0x7f1510159890 msgr2=0x7f151015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150e7fc700 1 --2- 172.21.15.22:0/4214092998 >> v2:172.21.15.192:3300/0 conn(0x7f1510159890 0x7f151015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150e7fc700 1 -- 172.21.15.22:0/4214092998 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151015e140 con 0x7f1510159c60 2023-10-08T00:33:18.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150effd700 1 --2- 172.21.15.22:0/4214092998 >> v2:172.21.15.192:3300/0 conn(0x7f1510159890 0x7f151015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150e7fc700 1 --2- 172.21.15.22:0/4214092998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159c60 0x7f151015d5d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f15100d1090 tx=0x7f14f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e39104c6fd742dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150dffb700 1 -- 172.21.15.22:0/4214092998 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800b860 con 0x7f1510159c60 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150dffb700 1 -- 172.21.15.22:0/4214092998 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f800b9c0 con 0x7f1510159c60 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f150dffb700 1 -- 172.21.15.22:0/4214092998 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f800bd60 con 0x7f1510159c60 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f1515504700 1 -- 172.21.15.22:0/4214092998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159c60 msgr2=0x7f151015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.510+0000 7f1515504700 1 --2- 172.21.15.22:0/4214092998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159c60 0x7f151015d5d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f15100d1090 tx=0x7f14f8009250 comp rx=0 tx=0).stop 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 -- 172.21.15.22:0/4214092998 shutdown_connections 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 --2- 172.21.15.22:0/4214092998 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f151015db10 0x7f1510069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 --2- 172.21.15.22:0/4214092998 >> v2:172.21.15.192:3300/0 conn(0x7f1510159890 0x7f151015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 --2- 172.21.15.22:0/4214092998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159c60 0x7f151015d5d0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 -- 172.21.15.22:0/4214092998 >> 172.21.15.22:0/4214092998 conn(0x7f1510068e20 msgr2=0x7f15100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 -- 172.21.15.22:0/4214092998 shutdown_connections 2023-10-08T00:33:18.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.511+0000 7f1515504700 1 -- 172.21.15.22:0/4214092998 wait complete. 2023-10-08T00:33:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.512+0000 7f1515504700 1 Processor -- start 2023-10-08T00:33:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.512+0000 7f1515504700 1 -- start start 2023-10-08T00:33:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 0x7f15100c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1510159c60 0x7f15100cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f151015db10 0x7f1510149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100cd640 con 0x7f1510159890 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15100ce480 con 0x7f151015db10 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15100cd870 con 0x7f1510159c60 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 0x7f15100c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 0x7f15100c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45336/0 (socket says 172.21.15.22:45336) 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 -- 172.21.15.22:0/2533050771 learned_addr learned my addr 172.21.15.22:0/2533050771 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150f7fe700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f151015db10 0x7f1510149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 -- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1510159c60 msgr2=0x7f15100cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150e7fc700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1510159c60 0x7f15100cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1510159c60 0x7f15100cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 -- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f151015db10 msgr2=0x7f1510149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f151015db10 0x7f1510149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 -- 172.21.15.22:0/2533050771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f80094f0 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150f7fe700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f151015db10 0x7f1510149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150e7fc700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1510159c60 0x7f15100cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f150effd700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 0x7f15100c8520 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f150800c850 tx=0x7f1508008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011600 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1508011760 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15100cdb50 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508011b00 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.513+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15100ce110 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.514+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15100ce760 con 0x7f1510159890 2023-10-08T00:33:18.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.515+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f15080073b0 con 0x7f1510159890 2023-10-08T00:33:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.515+0000 7f1506ffd700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14f0067320 0x7f14f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.515+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1508084cd0 con 0x7f1510159890 2023-10-08T00:33:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.515+0000 7f150e7fc700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14f0067320 0x7f14f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.516+0000 7f150e7fc700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14f0067320 0x7f14f00697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f15100d1090 tx=0x7f14f8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:18.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.519+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1508051850 con 0x7f1510159890 2023-10-08T00:33:18.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:18.760+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f151004c3c0 con 0x7f1510159890 2023-10-08T00:33:19.685 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.685+0000 7f1506ffd700 1 -- 172.21.15.22:0/2533050771 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v114) v1 ==== 118+0+0 (secure 0 0 0) 0x7f150801e0b0 con 0x7f1510159890 2023-10-08T00:33:19.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.687+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14f0067320 msgr2=0x7f14f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.688 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.687+0000 7f1515504700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14f0067320 0x7f14f00697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f15100d1090 tx=0x7f14f8017000 comp rx=0 tx=0).stop 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.687+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 msgr2=0x7f15100c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.687+0000 7f1515504700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 0x7f15100c8520 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f150800c850 tx=0x7f1508008040 comp rx=0 tx=0).stop 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 shutdown_connections 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f151015db10 0x7f1510149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1510159890 0x7f15100c8520 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f14f0067320 0x7f14f00697d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 --2- 172.21.15.22:0/2533050771 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1510159c60 0x7f15100cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 >> 172.21.15.22:0/2533050771 conn(0x7f1510068e20 msgr2=0x7f151015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 shutdown_connections 2023-10-08T00:33:19.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.688+0000 7f1515504700 1 -- 172.21.15.22:0/2533050771 wait complete. 2023-10-08T00:33:19.703 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:33:19.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.831+0000 7f282a60d700 1 Processor -- start 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.831+0000 7f282a60d700 1 -- start start 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.832+0000 7f282a60d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 0x7f282415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.832+0000 7f282a60d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282415a160 con 0x7f2824069560 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.832+0000 7f282a60d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240d13a0 con 0x7f2824159c60 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.832+0000 7f282a60d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282415e140 con 0x7f2824159890 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.832+0000 7f2828baa700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2824069560 0x7f28240ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51608/0 (socket says 172.21.15.22:51608) 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.832+0000 7f2828baa700 1 -- 172.21.15.22:0/1009529302 learned_addr learned my addr 172.21.15.22:0/1009529302 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2823fff700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 0x7f282415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615772090 0 0) 0x7f282415a160 con 0x7f2824069560 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c003570 con 0x7f2824069560 2023-10-08T00:33:19.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471536924 0 0) 0x7f28240d13a0 con 0x7f2824159c60 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f282415a160 con 0x7f2824159c60 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554053898 0 0) 0x7f280c003570 con 0x7f2824069560 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 msgr2=0x7f282415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 0x7f282415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 >> v1:172.21.15.192:6789/0 conn(0x7f2824159c60 legacy=0x7f282415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282415a3d0 con 0x7f2824069560 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f281c0017f0 con 0x7f2824069560 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 >> v1:172.21.15.22:6789/0 conn(0x7f2824069560 legacy=0x7f28240ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c003c20 0x7f280c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 0x7f280c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c004d50 0x7f280c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282415e140 con 0x7f280c004d50 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c00bbf0 con 0x7f280c003c20 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c00bd60 con 0x7f2824159890 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2828baa700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c004d50 0x7f280c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2823fff700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c003c20 0x7f280c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f28237fe700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 0x7f280c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2828baa700 1 -- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 msgr2=0x7f280c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2828baa700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2824159890 0x7f280c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2828baa700 1 -- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c003c20 msgr2=0x7f280c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2828baa700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c003c20 0x7f280c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.833+0000 7f2828baa700 1 -- 172.21.15.22:0/1009529302 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c003570 con 0x7f280c004d50 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f2828baa700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c004d50 0x7f280c0051c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f281c00a7d0 tx=0x7f281c0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f467e313d18697 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:19.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c0070d0 con 0x7f280c004d50 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c007270 con 0x7f280c004d50 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f2822ffd700 1 -- 172.21.15.22:0/1009529302 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c007630 con 0x7f280c004d50 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f282a60d700 1 -- 172.21.15.22:0/1009529302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c004d50 msgr2=0x7f280c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f282a60d700 1 --2- 172.21.15.22:0/1009529302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c004d50 0x7f280c0051c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f281c00a7d0 tx=0x7f281c0020c0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f2828baa700 1 -- 172.21.15.22:0/1009529302 reap_dead start 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f282a60d700 1 -- 172.21.15.22:0/1009529302 shutdown_connections 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f282a60d700 1 -- 172.21.15.22:0/1009529302 >> 172.21.15.22:0/1009529302 conn(0x7f2824068e20 msgr2=0x7f28240d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f282a60d700 1 -- 172.21.15.22:0/1009529302 shutdown_connections 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.834+0000 7f282a60d700 1 -- 172.21.15.22:0/1009529302 wait complete. 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.835+0000 7f282a60d700 1 Processor -- start 2023-10-08T00:33:19.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 -- start start 2023-10-08T00:33:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2824139180 0x7f282415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 0x7f28240ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240cf2c0 0x7f28240c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240ce2e0 con 0x7f28240cf9a0 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f282415d340 con 0x7f2824139180 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.836+0000 7f282a60d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f282415d620 con 0x7f28240cf2c0 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 0x7f28240ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 0x7f28240ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45350/0 (socket says 172.21.15.22:45350) 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 -- 172.21.15.22:0/972242888 learned_addr learned my addr 172.21.15.22:0/972242888 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f2828baa700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240cf2c0 0x7f28240c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f2823fff700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2824139180 0x7f282415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 -- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240cf2c0 msgr2=0x7f28240c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240cf2c0 0x7f28240c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 -- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2824139180 msgr2=0x7f282415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2824139180 0x7f282415caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 -- 172.21.15.22:0/972242888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240ce580 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f2828baa700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240cf2c0 0x7f28240c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f28237fe700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 0x7f28240ced80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f2814007a80 tx=0x7f2814007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400f9f0 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400fb70 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28240ce860 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140133f0 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.837+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824139550 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.838+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282404c3c0 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.839+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2814013760 con 0x7f28240cf9a0 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.839+0000 7f280bfff700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2810067320 0x7f28100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:19.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.839+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2814085120 con 0x7f28240cf9a0 2023-10-08T00:33:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.839+0000 7f2823fff700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2810067320 0x7f28100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.840+0000 7f2823fff700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2810067320 0x7f28100697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2818006f00 tx=0x7f2818008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:19.844+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2814051db0 con 0x7f28240cf9a0 2023-10-08T00:33:20.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.084+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f282406a5b0 con 0x7f28240cf9a0 2023-10-08T00:33:20.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.689+0000 7f280bfff700 1 -- 172.21.15.22:0/972242888 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v115) v1 ==== 122+0+0 (secure 0 0 0) 0x7f28140553d0 con 0x7f28240cf9a0 2023-10-08T00:33:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2810067320 msgr2=0x7f28100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2810067320 0x7f28100697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2818006f00 tx=0x7f2818008040 comp rx=0 tx=0).stop 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 msgr2=0x7f28240ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 0x7f28240ced80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f2814007a80 tx=0x7f2814007d30 comp rx=0 tx=0).stop 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 shutdown_connections 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2810067320 0x7f28100697d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f28240cf2c0 0x7f28240c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2824139180 0x7f282415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 --2- 172.21.15.22:0/972242888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f28240cf9a0 0x7f28240ced80 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 >> 172.21.15.22:0/972242888 conn(0x7f2824068e20 msgr2=0x7f28240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:20.694 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 shutdown_connections 2023-10-08T00:33:20.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.692+0000 7f282a60d700 1 -- 172.21.15.22:0/972242888 wait complete. 2023-10-08T00:33:20.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:20.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.828+0000 7f628095c700 1 Processor -- start 2023-10-08T00:33:20.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.828+0000 7f628095c700 1 -- start start 2023-10-08T00:33:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f628095c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 0x7f627c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f628095c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c15af50 con 0x7f627c06bbe0 2023-10-08T00:33:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f628095c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c06e980 con 0x7f627c0c7bd0 2023-10-08T00:33:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f628095c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0ce180 con 0x7f627c1598d0 2023-10-08T00:33:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f627b59e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f627c06bbe0 0x7f627c068390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51612/0 (socket says 172.21.15.22:51612) 2023-10-08T00:33:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f627b59e700 1 -- 172.21.15.22:0/1563973366 learned_addr learned my addr 172.21.15.22:0/1563973366 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f627ad9d700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 0x7f627c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395046160 0 0) 0x7f6274001110 con 0x7f627c06bbe0 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.829+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6268003570 con 0x7f627c06bbe0 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407524172 0 0) 0x7f6268003570 con 0x7f627c06bbe0 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 msgr2=0x7f627c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 0x7f627c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 >> v1:172.21.15.192:6789/0 conn(0x7f627c0c7bd0 legacy=0x7f627c06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0c80f0 con 0x7f627c06bbe0 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f6274001600 con 0x7f627c06bbe0 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 >> v1:172.21.15.22:6789/0 conn(0x7f627c06bbe0 legacy=0x7f627c068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f6268003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6268004810 0x7f6268004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 0x7f62680051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0ce180 con 0x7f6268003a90 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626800bb60 con 0x7f6268004810 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626800bd20 con 0x7f627c1598d0 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f6268003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627a59c700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6268004810 0x7f6268004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627b59e700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 0x7f62680051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 -- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 msgr2=0x7f62680051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c1598d0 0x7f62680051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 -- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6268004810 msgr2=0x7f6268004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:20.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6268004810 0x7f6268004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 -- 172.21.15.22:0/1563973366 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268003570 con 0x7f6268003a90 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627a59c700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6268004810 0x7f6268004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f627ad9d700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f6268003ea0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e210 tx=0x7f626c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4258954301fdb905 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00eac0 con 0x7f6268003a90 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c00f040 con 0x7f6268003a90 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.830+0000 7f6279d9b700 1 -- 172.21.15.22:0/1563973366 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c00ee70 con 0x7f6268003a90 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f628095c700 1 -- 172.21.15.22:0/1563973366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 msgr2=0x7f6268003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f628095c700 1 --2- 172.21.15.22:0/1563973366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f6268003ea0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f626c00e210 tx=0x7f626c00b040 comp rx=0 tx=0).stop 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f627b59e700 1 -- 172.21.15.22:0/1563973366 reap_dead start 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f628095c700 1 -- 172.21.15.22:0/1563973366 shutdown_connections 2023-10-08T00:33:20.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f628095c700 1 -- 172.21.15.22:0/1563973366 >> 172.21.15.22:0/1563973366 conn(0x7f627c06b490 msgr2=0x7f627c0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f628095c700 1 -- 172.21.15.22:0/1563973366 shutdown_connections 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.831+0000 7f628095c700 1 -- 172.21.15.22:0/1563973366 wait complete. 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.832+0000 7f628095c700 1 Processor -- start 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.832+0000 7f628095c700 1 -- start start 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f628095c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f627c15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f628095c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f627c16a230 0x7f627c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f628095c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c150e20 0x7f627c0cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f628095c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c15c1e0 con 0x7f6268003a90 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f628095c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c16d8e0 con 0x7f627c16a230 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f628095c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c16db80 con 0x7f627c150e20 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f627c15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f627c15bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45370/0 (socket says 172.21.15.22:45370) 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 -- 172.21.15.22:0/3273832277 learned_addr learned my addr 172.21.15.22:0/3273832277 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 -- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c150e20 msgr2=0x7f627c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c150e20 0x7f627c0cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627a59c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f627c16a230 0x7f627c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 -- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f627c16a230 msgr2=0x7f627c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f627c16a230 0x7f627c1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 -- 172.21.15.22:0/3273832277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c16de60 con 0x7f6268003a90 2023-10-08T00:33:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.833+0000 7f627ad9d700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f627c15bca0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f626c00afd0 tx=0x7f626c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.834+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c029450 con 0x7f6268003a90 2023-10-08T00:33:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.834+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c0295b0 con 0x7f6268003a90 2023-10-08T00:33:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.834+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c0299b0 con 0x7f6268003a90 2023-10-08T00:33:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.834+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c16e140 con 0x7f6268003a90 2023-10-08T00:33:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.834+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c0c5b50 con 0x7f6268003a90 2023-10-08T00:33:20.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.835+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c04c3c0 con 0x7f6268003a90 2023-10-08T00:33:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.835+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f626c003040 con 0x7f6268003a90 2023-10-08T00:33:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.836+0000 7f6272ffd700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f625c067320 0x7f625c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.836+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f626c087050 con 0x7f6268003a90 2023-10-08T00:33:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.836+0000 7f627a59c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f625c067320 0x7f625c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.836+0000 7f627a59c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f625c067320 0x7f625c0697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:20.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:20.840+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f626c0b85a0 con 0x7f6268003a90 2023-10-08T00:33:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.076+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f627c0c4090 con 0x7f6268003a90 2023-10-08T00:33:21.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.077+0000 7f6272ffd700 1 -- 172.21.15.22:0/3273832277 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f626c02e090 con 0x7f6268003a90 2023-10-08T00:33:21.077 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:21.077 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:20.684582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f625c067320 msgr2=0x7f625c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f625c067320 0x7f625c0697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264009040 comp rx=0 tx=0).stop 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 msgr2=0x7f627c15bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f627c15bca0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f626c00afd0 tx=0x7f626c01a000 comp rx=0 tx=0).stop 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 shutdown_connections 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f625c067320 0x7f625c0697d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f627c150e20 0x7f627c0cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6268003a90 0x7f627c15bca0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 --2- 172.21.15.22:0/3273832277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f627c16a230 0x7f627c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 >> 172.21.15.22:0/3273832277 conn(0x7f627c06b490 msgr2=0x7f627c157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:21.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 shutdown_connections 2023-10-08T00:33:21.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.079+0000 7f628095c700 1 -- 172.21.15.22:0/3273832277 wait complete. 2023-10-08T00:33:21.081 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 115 2023-10-08T00:33:21.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:21.210 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.210+0000 7f06ac54c700 1 Processor -- start 2023-10-08T00:33:21.211 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.210+0000 7f06ac54c700 1 -- start start 2023-10-08T00:33:21.212 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06ac54c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a41578b0 0x7f06a4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06ac54c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40ad930 con 0x7f06a40af2f0 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06ac54c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40acd20 con 0x7f06a4155c10 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06ac54c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40ad000 con 0x7f06a41578b0 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06aaae9700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f06a40af2f0 0x7f06a40af710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51622/0 (socket says 172.21.15.22:51622) 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06aaae9700 1 -- 172.21.15.22:0/1002350332 learned_addr learned my addr 172.21.15.22:0/1002350332 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.211+0000 7f06a9ae7700 1 --2- 172.21.15.22:0/1002350332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a41578b0 0x7f06a4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144605054 0 0) 0x7f06a40ad930 con 0x7f06a40af2f0 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f068c003570 con 0x7f06a40af2f0 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957811957 0 0) 0x7f06a40acd20 con 0x7f06a4155c10 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a40ad930 con 0x7f06a4155c10 2023-10-08T00:33:21.213 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a9ae7700 1 -- 172.21.15.22:0/1002350332 >> v1:172.21.15.192:6789/0 conn(0x7f06a4155c10 legacy=0x7f06a40ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a9ae7700 1 -- 172.21.15.22:0/1002350332 >> v1:172.21.15.22:6789/0 conn(0x7f06a40af2f0 legacy=0x7f06a40af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a9ae7700 1 -- 172.21.15.22:0/1002350332 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40ad2e0 con 0x7f06a41578b0 2023-10-08T00:33:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a9ae7700 1 --2- 172.21.15.22:0/1002350332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a41578b0 0x7f06a4155fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0698009910 tx=0x7f06980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87430a8b67c8c51d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698011630 con 0x7f06a41578b0 2023-10-08T00:33:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698011790 con 0x7f06a41578b0 2023-10-08T00:33:21.214 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.212+0000 7f06a92e6700 1 -- 172.21.15.22:0/1002350332 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698011b30 con 0x7f06a41578b0 2023-10-08T00:33:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 -- 172.21.15.22:0/1002350332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a41578b0 msgr2=0x7f06a4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 --2- 172.21.15.22:0/1002350332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a41578b0 0x7f06a4155fe0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0698009910 tx=0x7f06980091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 -- 172.21.15.22:0/1002350332 shutdown_connections 2023-10-08T00:33:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 --2- 172.21.15.22:0/1002350332 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a41578b0 0x7f06a4155fe0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 -- 172.21.15.22:0/1002350332 >> 172.21.15.22:0/1002350332 conn(0x7f06a406a320 msgr2=0x7f06a40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 -- 172.21.15.22:0/1002350332 shutdown_connections 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.213+0000 7f06ac54c700 1 -- 172.21.15.22:0/1002350332 wait complete. 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.214+0000 7f06ac54c700 1 Processor -- start 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.214+0000 7f06ac54c700 1 -- start start 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a40af2f0 0x7f06a40a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 0x7f06a4143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41578b0 0x7f06a40a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40a5db0 con 0x7f06a4155c10 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40a54c0 con 0x7f06a41578b0 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40cd270 con 0x7f06a40af2f0 2023-10-08T00:33:21.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 0x7f06a4143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 0x7f06a4143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45380/0 (socket says 172.21.15.22:45380) 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 -- 172.21.15.22:0/2114592819 learned_addr learned my addr 172.21.15.22:0/2114592819 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06aaae9700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41578b0 0x7f06a40a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06aa2e8700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a40af2f0 0x7f06a40a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 -- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a40af2f0 msgr2=0x7f06a40a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a40af2f0 0x7f06a40a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 -- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41578b0 msgr2=0x7f06a40a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41578b0 0x7f06a40a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 -- 172.21.15.22:0/2114592819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0698009420 con 0x7f06a4155c10 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06aaae9700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41578b0 0x7f06a40a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:21.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a9ae7700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 0x7f06a4143ea0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f06a4064290 tx=0x7f0698017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069801f070 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698000c90 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a40a5760 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698025420 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.215+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a40a6780 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.216+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a404c3c0 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.217+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0698023070 con 0x7f06a4155c10 2023-10-08T00:33:21.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.217+0000 7f06a27fc700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0690067320 0x7f06900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.217+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0698085e60 con 0x7f06a4155c10 2023-10-08T00:33:21.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.217+0000 7f06aa2e8700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0690067320 0x7f06900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.218+0000 7f06aa2e8700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0690067320 0x7f06900697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f06a40b0340 tx=0x7f069c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.222+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0698052ba0 con 0x7f06a4155c10 2023-10-08T00:33:21.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.417+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06a40ad5c0 con 0x7f06a4155c10 2023-10-08T00:33:21.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.418+0000 7f06a27fc700 1 -- 172.21.15.22:0/2114592819 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f0698015090 con 0x7f06a4155c10 2023-10-08T00:33:21.418 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:21.418 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":168,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:18.659078+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:21.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0690067320 msgr2=0x7f06900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0690067320 0x7f06900697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f06a40b0340 tx=0x7f069c009040 comp rx=0 tx=0).stop 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 msgr2=0x7f06a4143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 0x7f06a4143ea0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f06a4064290 tx=0x7f0698017000 comp rx=0 tx=0).stop 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 shutdown_connections 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41578b0 0x7f06a40a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0690067320 0x7f06900697d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06a40af2f0 0x7f06a40a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 --2- 172.21.15.22:0/2114592819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06a4155c10 0x7f06a4143ea0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 >> 172.21.15.22:0/2114592819 conn(0x7f06a406a320 msgr2=0x7f06a406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:21.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.419+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 shutdown_connections 2023-10-08T00:33:21.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.420+0000 7f06ac54c700 1 -- 172.21.15.22:0/2114592819 wait complete. 2023-10-08T00:33:21.432 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:33:21.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.551+0000 7f0be577c700 1 Processor -- start 2023-10-08T00:33:21.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.551+0000 7f0be577c700 1 -- start start 2023-10-08T00:33:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0be577c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0be01594d0 0x7f0be00cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0be577c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be0159fb0 0x7f0be00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0be577c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be00d01f0 con 0x7f0be00b5fb0 2023-10-08T00:33:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0be577c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be00cf5e0 con 0x7f0be01594d0 2023-10-08T00:33:21.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0be577c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00cf8c0 con 0x7f0be0159fb0 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0be01594d0 0x7f0be00cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0be01594d0 0x7f0be00cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45390/0 (socket says 172.21.15.22:45390) 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1792167996 learned_addr learned my addr 172.21.15.22:0/1792167996 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdf7fe700 1 --2- 172.21.15.22:0/1792167996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be0159fb0 0x7f0be00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1792167996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be0159fb0 msgr2=0x7f0be00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 --2- 172.21.15.22:0/1792167996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be0159fb0 0x7f0be00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1792167996 >> v1:172.21.15.192:6789/0 conn(0x7f0be00b5fb0 legacy=0x7f0be01598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:21.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.552+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1792167996 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00cfba0 con 0x7f0be01594d0 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0bdeffd700 1 --2- 172.21.15.22:0/1792167996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be01594d0 0x7f0be00cd0f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80099b0 tx=0x7f0bd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4982b662231e3054 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0bddffb700 1 -- 172.21.15.22:0/1792167996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800b820 con 0x7f0be01594d0 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0bddffb700 1 -- 172.21.15.22:0/1792167996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd800b980 con 0x7f0be01594d0 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0bddffb700 1 -- 172.21.15.22:0/1792167996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800bd20 con 0x7f0be01594d0 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 -- 172.21.15.22:0/1792167996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be01594d0 msgr2=0x7f0be00cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 --2- 172.21.15.22:0/1792167996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be01594d0 0x7f0be00cd0f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80099b0 tx=0x7f0bd8009250 comp rx=0 tx=0).stop 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 -- 172.21.15.22:0/1792167996 shutdown_connections 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 --2- 172.21.15.22:0/1792167996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be0159fb0 0x7f0be00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 --2- 172.21.15.22:0/1792167996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be01594d0 0x7f0be00cd0f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 -- 172.21.15.22:0/1792167996 >> 172.21.15.22:0/1792167996 conn(0x7f0be00d05f0 msgr2=0x7f0be00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 -- 172.21.15.22:0/1792167996 shutdown_connections 2023-10-08T00:33:21.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.553+0000 7f0be577c700 1 -- 172.21.15.22:0/1792167996 wait complete. 2023-10-08T00:33:21.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.554+0000 7f0be577c700 1 Processor -- start 2023-10-08T00:33:21.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 -- start start 2023-10-08T00:33:21.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 0x7f0be014d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be01594d0 0x7f0be01410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0be0159fb0 0x7f0be01534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be01415f0 con 0x7f0be00b5fb0 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be01549c0 con 0x7f0be0159fb0 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0be577c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be015cd90 con 0x7f0be01594d0 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0bdeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 0x7f0be014d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0bdeffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 0x7f0be014d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45402/0 (socket says 172.21.15.22:45402) 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1623432716 learned_addr learned my addr 172.21.15.22:0/1623432716 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0bde7fc700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be01594d0 0x7f0be01410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.555+0000 7f0bdf7fe700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0be0159fb0 0x7f0be01534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be01594d0 msgr2=0x7f0be01410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bdeffd700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be01594d0 0x7f0be01410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0be0159fb0 msgr2=0x7f0be01534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bdeffd700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0be0159fb0 0x7f0be01534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bdeffd700 1 -- 172.21.15.22:0/1623432716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd80094f0 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bdeffd700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 0x7f0be014d5f0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009290 tx=0x7f0bd8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8011bf0 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8020070 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be0153a20 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd801b450 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.556+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be0153fc0 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.557+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be004c3c0 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.557+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0bd8022030 con 0x7f0be00b5fb0 2023-10-08T00:33:21.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.558+0000 7f0bd6ffd700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bc0067320 0x7f0bc00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.558+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bd8086880 con 0x7f0be00b5fb0 2023-10-08T00:33:21.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.558+0000 7f0bde7fc700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bc0067320 0x7f0bc00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.558+0000 7f0bde7fc700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bc0067320 0x7f0bc00697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0be015ca80 tx=0x7f0bc8007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.562+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bd8053620 con 0x7f0be00b5fb0 2023-10-08T00:33:21.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.751+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0be004c3c0 con 0x7f0bc0067320 2023-10-08T00:33:21.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.759+0000 7f0bd6ffd700 1 -- 172.21.15.22:0/1623432716 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274419 (secure 0 0 0) 0x7f0be004c3c0 con 0x7f0bc0067320 2023-10-08T00:33:21.762 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bc0067320 msgr2=0x7f0bc00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bc0067320 0x7f0bc00697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0be015ca80 tx=0x7f0bc8007ea0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 msgr2=0x7f0be014d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 0x7f0be014d5f0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8009290 tx=0x7f0bd8016000 comp rx=0 tx=0).stop 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 shutdown_connections 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0be0159fb0 0x7f0be01534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0be00b5fb0 0x7f0be014d5f0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0bc0067320 0x7f0bc00697d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 --2- 172.21.15.22:0/1623432716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0be01594d0 0x7f0be01410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 >> 172.21.15.22:0/1623432716 conn(0x7f0be00d05f0 msgr2=0x7f0be0158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 shutdown_connections 2023-10-08T00:33:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.762+0000 7f0be577c700 1 -- 172.21.15.22:0/1623432716 wait complete. 2023-10-08T00:33:21.766 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:21.775 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2023-10-08T00:33:20.502927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2428488,"kb_used_data":17416,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546232,"statfs":{"total":773094113280,"available":770607341568,"internally_reserved":0,"allocated":17833984,"data_stored":8613640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.850247"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T00:33:12.520105+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:12.520105+0000","last_peered":"2023-10-08T00:33:12.520105+0000","last_clean":"2023-10-08T00:33:12.520105+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:12.520105+0000","last_undegraded":"2023-10-08T00:33:12.520105+0000","last_fullsized":"2023-10-08T00:33:12.520105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067844,"statfs":{"total":96636764160,"available":96325472256,"internally_reserved":0,"allocated":2674688,"data_stored":1519481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.753}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66200000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.73599999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.51200000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.47399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.55000000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.432},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.219},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.375}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.255},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.27200000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.24199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.433},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.51800000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.42199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067844,"statfs":{"total":96636764160,"available":96325472256,"internally_reserved":0,"allocated":2674688,"data_stored":1519481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.63700000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.375,"15min":0.379},"min":{"1min":0.249,"5min":0.245,"15min":0.245},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.63100000000000001},"last":0.25}]},{"osd":3,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.308},{"interface":"front","average":{"1min":0.498,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.36199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.877,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.81100000000000005,"5min":0.88100000000000001,"15min":1.242},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83699999999999997,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.745}]},{"osd":6,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.252},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.438}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.253},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.378}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.623}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.51400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.442},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.70299999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.63},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59999999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:21.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.937+0000 7f10eecd2700 1 Processor -- start 2023-10-08T00:33:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.937+0000 7f10eecd2700 1 -- start start 2023-10-08T00:33:21.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10eecd2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e81595a0 0x7f10e80b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10eecd2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10e80c6c60 0x7f10e80c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10eecd2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10e80b1de0 0x7f10e80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10eecd2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b2b90 con 0x7f10e80b1de0 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10eecd2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b1410 con 0x7f10e80c6c60 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10eecd2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8063230 con 0x7f10e81595a0 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10ee4d1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10e80b1de0 0x7f10e80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10ee4d1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f10e80b1de0 0x7f10e80c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45404/0 (socket says 172.21.15.22:45404) 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10ee4d1700 1 -- 172.21.15.22:0/3409620407 learned_addr learned my addr 172.21.15.22:0/3409620407 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10edcd0700 1 --2- 172.21.15.22:0/3409620407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e81595a0 0x7f10e80b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.938+0000 7f10ed4cf700 1 --2- 172.21.15.22:0/3409620407 >> v2:172.21.15.192:3300/0 conn(0x7f10e80c6c60 0x7f10e80c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10ee4d1700 1 -- 172.21.15.22:0/3409620407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e81595a0 msgr2=0x7f10e80b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10ee4d1700 1 --2- 172.21.15.22:0/3409620407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e81595a0 0x7f10e80b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10ee4d1700 1 -- 172.21.15.22:0/3409620407 >> v2:172.21.15.192:3300/0 conn(0x7f10e80c6c60 msgr2=0x7f10e80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10ee4d1700 1 --2- 172.21.15.22:0/3409620407 >> v2:172.21.15.192:3300/0 conn(0x7f10e80c6c60 0x7f10e80c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10ee4d1700 1 -- 172.21.15.22:0/3409620407 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80634f0 con 0x7f10e80b1de0 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10ee4d1700 1 --2- 172.21.15.22:0/3409620407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e80c8660 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f10e806d4e0 tx=0x7f10d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe69e6ef3bffaba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eccce700 1 -- 172.21.15.22:0/3409620407 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d800e070 con 0x7f10e80b1de0 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eccce700 1 -- 172.21.15.22:0/3409620407 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d800b970 con 0x7f10e80b1de0 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eccce700 1 -- 172.21.15.22:0/3409620407 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80092e0 con 0x7f10e80b1de0 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eecd2700 1 -- 172.21.15.22:0/3409620407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 msgr2=0x7f10e80c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3409620407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e80c8660 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f10e806d4e0 tx=0x7f10d8009840 comp rx=0 tx=0).stop 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eecd2700 1 -- 172.21.15.22:0/3409620407 shutdown_connections 2023-10-08T00:33:21.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3409620407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e80c8660 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3409620407 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e81595a0 0x7f10e80b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.939+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3409620407 >> v2:172.21.15.192:3300/0 conn(0x7f10e80c6c60 0x7f10e80c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.940+0000 7f10eecd2700 1 -- 172.21.15.22:0/3409620407 >> 172.21.15.22:0/3409620407 conn(0x7f10e806ddb0 msgr2=0x7f10e806e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.940+0000 7f10eecd2700 1 -- 172.21.15.22:0/3409620407 shutdown_connections 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.940+0000 7f10eecd2700 1 -- 172.21.15.22:0/3409620407 wait complete. 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 Processor -- start 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 -- start start 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e80c6c60 0x7f10e8153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e81595a0 0x7f10e81535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e814d3e0 con 0x7f10e80b1de0 2023-10-08T00:33:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e814cdd0 con 0x7f10e81595a0 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.941+0000 7f10eecd2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e814ff00 con 0x7f10e80c6c60 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e814f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45416/0 (socket says 172.21.15.22:45416) 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 -- 172.21.15.22:0/3469304543 learned_addr learned my addr 172.21.15.22:0/3469304543 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 -- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e80c6c60 msgr2=0x7f10e8153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e80c6c60 0x7f10e8153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 -- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e81595a0 msgr2=0x7f10e81535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10ee4d1700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e81595a0 0x7f10e81535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e81595a0 0x7f10e81535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 -- 172.21.15.22:0/3469304543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8009ae0 con 0x7f10e80b1de0 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10edcd0700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e814f670 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f10e000e930 tx=0x7f10e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000eed0 con 0x7f10e80b1de0 2023-10-08T00:33:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000c850 con 0x7f10e80b1de0 2023-10-08T00:33:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e814d070 con 0x7f10e80b1de0 2023-10-08T00:33:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e000cbf0 con 0x7f10e80b1de0 2023-10-08T00:33:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.942+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e81501e0 con 0x7f10e80b1de0 2023-10-08T00:33:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.943+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e804c3c0 con 0x7f10e80b1de0 2023-10-08T00:33:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.944+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f10e0013470 con 0x7f10e80b1de0 2023-10-08T00:33:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.944+0000 7f10e5ffb700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10d4067320 0x7f10d40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.944+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10e0084e50 con 0x7f10e80b1de0 2023-10-08T00:33:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.944+0000 7f10ed4cf700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10d4067320 0x7f10d40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.945+0000 7f10ed4cf700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10d4067320 0x7f10d40697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f10e814f5c0 tx=0x7f10dc0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:21.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:21.948+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10e0051ae0 con 0x7f10e80b1de0 2023-10-08T00:33:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.137+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10e814d520 con 0x7f10d4067320 2023-10-08T00:33:22.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.144+0000 7f10e5ffb700 1 -- 172.21.15.22:0/3469304543 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274419 (secure 0 0 0) 0x7f10dc00e770 con 0x7f10d4067320 2023-10-08T00:33:22.148 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:22.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10d4067320 msgr2=0x7f10d40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10d4067320 0x7f10d40697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f10e814f5c0 tx=0x7f10dc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 msgr2=0x7f10e814f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e814f670 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f10e000e930 tx=0x7f10e00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 shutdown_connections 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10e81595a0 0x7f10e81535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10e80b1de0 0x7f10e814f670 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f10d4067320 0x7f10d40697d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 --2- 172.21.15.22:0/3469304543 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f10e80c6c60 0x7f10e8153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 >> 172.21.15.22:0/3469304543 conn(0x7f10e806ddb0 msgr2=0x7f10e8157530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 shutdown_connections 2023-10-08T00:33:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.148+0000 7f10eecd2700 1 -- 172.21.15.22:0/3469304543 wait complete. 2023-10-08T00:33:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:22.160 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2023-10-08T00:33:20.502927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2428488,"kb_used_data":17416,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752546232,"statfs":{"total":773094113280,"available":770607341568,"internally_reserved":0,"allocated":17833984,"data_stored":8613640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.850247"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:16.652300+0000","last_change":"2023-10-08T00:33:16.652300+0000","last_active":"2023-10-08T00:33:16.652300+0000","last_peered":"2023-10-08T00:33:16.652300+0000","last_clean":"2023-10-08T00:33:16.652300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:16.652300+0000","last_undegraded":"2023-10-08T00:33:16.652300+0000","last_fullsized":"2023-10-08T00:33:16.652300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T00:33:15.650074+0000","last_change":"2023-10-08T00:33:15.650074+0000","last_active":"2023-10-08T00:33:15.650074+0000","last_peered":"2023-10-08T00:33:15.650074+0000","last_clean":"2023-10-08T00:33:15.650074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T00:33:15.650074+0000","last_undegraded":"2023-10-08T00:33:15.650074+0000","last_fullsized":"2023-10-08T00:33:15.650074+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-08T00:33:12.520105+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:12.520105+0000","last_peered":"2023-10-08T00:33:12.520105+0000","last_clean":"2023-10-08T00:33:12.520105+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:12.520105+0000","last_undegraded":"2023-10-08T00:33:12.520105+0000","last_fullsized":"2023-10-08T00:33:12.520105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067844,"statfs":{"total":96636764160,"available":96325472256,"internally_reserved":0,"allocated":2674688,"data_stored":1519481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.753}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.66200000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.73599999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.55600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.51200000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.47599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.47399999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.55000000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.57399999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.432},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.219},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.375}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.255},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.27200000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.24199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.433},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.51800000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.42199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574952,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303996,"kb_used_data":2612,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067844,"statfs":{"total":96636764160,"available":96325472256,"internally_reserved":0,"allocated":2674688,"data_stored":1519481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.63700000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.375,"15min":0.379},"min":{"1min":0.249,"5min":0.245,"15min":0.245},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.63100000000000001},"last":0.25}]},{"osd":3,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.308},{"interface":"front","average":{"1min":0.498,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.36199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.877,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.81100000000000005,"5min":0.88100000000000001,"15min":1.242},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83699999999999997,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.745}]},{"osd":6,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.77800000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574952,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.252},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.30399999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.438}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.47299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.253},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.378}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.60199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63200000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.623}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.51400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.442},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.70299999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303416,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068424,"statfs":{"total":96636764160,"available":96326066176,"internally_reserved":0,"allocated":2080768,"data_stored":929113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.63},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.59999999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:22.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.319+0000 7f40b2867700 1 Processor -- start 2023-10-08T00:33:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.319+0000 7f40b2867700 1 -- start start 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b2867700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40ac0ad870 0x7f40ac06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b2867700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0b40f0 con 0x7f40ac142ea0 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b2867700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac069640 con 0x7f40ac06bf20 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b2867700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac06c3a0 con 0x7f40ac0ad870 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b1064700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f40ac0ad870 0x7f40ac06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b1865700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f40ac142ea0 0x7f40ac0b3630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51636/0 (socket says 172.21.15.22:51636) 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.320+0000 7f40b1865700 1 -- 172.21.15.22:0/1425635808 learned_addr learned my addr 172.21.15.22:0/1425635808 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:22.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b1064700 1 -- 172.21.15.22:0/1425635808 >> v1:172.21.15.192:6789/0 conn(0x7f40ac06bf20 legacy=0x7f40ac06a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b1064700 1 -- 172.21.15.22:0/1425635808 >> v1:172.21.15.22:6789/0 conn(0x7f40ac142ea0 legacy=0x7f40ac0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b1064700 1 -- 172.21.15.22:0/1425635808 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac069920 con 0x7f40ac0ad870 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b0863700 1 -- 172.21.15.22:0/1425635808 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623303281 0 0) 0x7f40ac0b40f0 con 0x7f40ac142ea0 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b1064700 1 --2- 172.21.15.22:0/1425635808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac0ad870 0x7f40ac06b9e0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f40a00098e0 tx=0x7f40a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f767507d63d10b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b0863700 1 -- 172.21.15.22:0/1425635808 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0009e80 con 0x7f40ac0ad870 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b0863700 1 -- 172.21.15.22:0/1425635808 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a000b860 con 0x7f40ac0ad870 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b0863700 1 -- 172.21.15.22:0/1425635808 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a000bbe0 con 0x7f40ac0ad870 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b2867700 1 -- 172.21.15.22:0/1425635808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac0ad870 msgr2=0x7f40ac06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b2867700 1 --2- 172.21.15.22:0/1425635808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac0ad870 0x7f40ac06b9e0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f40a00098e0 tx=0x7f40a00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b2867700 1 -- 172.21.15.22:0/1425635808 shutdown_connections 2023-10-08T00:33:22.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b2867700 1 --2- 172.21.15.22:0/1425635808 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac0ad870 0x7f40ac06b9e0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.321+0000 7f40b2867700 1 -- 172.21.15.22:0/1425635808 >> 172.21.15.22:0/1425635808 conn(0x7f40ac0ce430 msgr2=0x7f40ac0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:22.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.322+0000 7f40b2867700 1 -- 172.21.15.22:0/1425635808 shutdown_connections 2023-10-08T00:33:22.325 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.322+0000 7f40b2867700 1 -- 172.21.15.22:0/1425635808 wait complete. 2023-10-08T00:33:22.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 Processor -- start 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 -- start start 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40ac06bf20 0x7f40ac158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 0x7f40ac0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40ac0af0c0 0x7f40ac0c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac15cc30 con 0x7f40ac142ea0 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0c75e0 con 0x7f40ac0af0c0 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.323+0000 7f40b2867700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0c7ba0 con 0x7f40ac06bf20 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 0x7f40ac0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 0x7f40ac0aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45432/0 (socket says 172.21.15.22:45432) 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 -- 172.21.15.22:0/1080151199 learned_addr learned my addr 172.21.15.22:0/1080151199 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:22.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1865700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40ac06bf20 0x7f40ac158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b2066700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40ac0af0c0 0x7f40ac0c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 -- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40ac06bf20 msgr2=0x7f40ac158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40ac06bf20 0x7f40ac158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 -- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40ac0af0c0 msgr2=0x7f40ac0c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40ac0af0c0 0x7f40ac0c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 -- 172.21.15.22:0/1080151199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a0009420 con 0x7f40ac142ea0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b1064700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 0x7f40ac0aeb80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06f0d0 tx=0x7f40a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0011420 con 0x7f40ac142ea0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a0011580 con 0x7f40ac142ea0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac0af680 con 0x7f40ac142ea0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0011920 con 0x7f40ac142ea0 2023-10-08T00:33:22.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.324+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac0c7830 con 0x7f40ac142ea0 2023-10-08T00:33:22.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.325+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac04c3c0 con 0x7f40ac142ea0 2023-10-08T00:33:22.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.326+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f40a0011c90 con 0x7f40ac142ea0 2023-10-08T00:33:22.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.326+0000 7f40a9ffb700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4098067320 0x7f40980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.326+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40a0086610 con 0x7f40ac142ea0 2023-10-08T00:33:22.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.326+0000 7f40b1865700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4098067320 0x7f40980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.327+0000 7f40b1865700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4098067320 0x7f40980697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f409c000f80 tx=0x7f409c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:22.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.330+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40a0053420 con 0x7f40ac142ea0 2023-10-08T00:33:22.429 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:33:22.429+0000 7ff60c416700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:33:22.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.521+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40ac0c7ce0 con 0x7f4098067320 2023-10-08T00:33:22.529 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.529+0000 7f40a9ffb700 1 -- 172.21.15.22:0/1080151199 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289661 (secure 0 0 0) 0x7f40ac0c7ce0 con 0x7f4098067320 2023-10-08T00:33:22.533 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4098067320 msgr2=0x7f40980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4098067320 0x7f40980697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f409c000f80 tx=0x7f409c009040 comp rx=0 tx=0).stop 2023-10-08T00:33:22.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 msgr2=0x7f40ac0aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 0x7f40ac0aeb80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06f0d0 tx=0x7f40a0017000 comp rx=0 tx=0).stop 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 shutdown_connections 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40ac0af0c0 0x7f40ac0c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4098067320 0x7f40980697d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f40ac06bf20 0x7f40ac158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 --2- 172.21.15.22:0/1080151199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f40ac142ea0 0x7f40ac0aeb80 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 >> 172.21.15.22:0/1080151199 conn(0x7f40ac0ce430 msgr2=0x7f40ac141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 shutdown_connections 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.532+0000 7f40b2867700 1 -- 172.21.15.22:0/1080151199 wait complete. 2023-10-08T00:33:22.536 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:22.545 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2023-10-08T00:33:22.503405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428924,"kb_used_data":17852,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752545796,"statfs":{"total":773094113280,"available":770606895104,"internally_reserved":0,"allocated":18280448,"data_stored":8812916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001560"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691504+0000","last_change":"2023-10-08T00:33:17.689883+0000","last_active":"2023-10-08T00:33:17.691504+0000","last_peered":"2023-10-08T00:33:17.691504+0000","last_clean":"2023-10-08T00:33:17.691504+0000","last_became_active":"2023-10-08T00:33:17.689094+0000","last_became_peered":"2023-10-08T00:33:17.689094+0000","last_unstale":"2023-10-08T00:33:17.691504+0000","last_undegraded":"2023-10-08T00:33:17.691504+0000","last_fullsized":"2023-10-08T00:33:17.691504+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:14.925683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689692+0000","last_change":"2023-10-08T00:33:17.680071+0000","last_active":"2023-10-08T00:33:17.689692+0000","last_peered":"2023-10-08T00:33:17.689692+0000","last_clean":"2023-10-08T00:33:17.689692+0000","last_became_active":"2023-10-08T00:33:17.677839+0000","last_became_peered":"2023-10-08T00:33:17.677839+0000","last_unstale":"2023-10-08T00:33:17.689692+0000","last_undegraded":"2023-10-08T00:33:17.689692+0000","last_fullsized":"2023-10-08T00:33:17.689692+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:28.026003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682856+0000","last_change":"2023-10-08T00:33:17.680962+0000","last_active":"2023-10-08T00:33:17.682856+0000","last_peered":"2023-10-08T00:33:17.682856+0000","last_clean":"2023-10-08T00:33:17.682856+0000","last_became_active":"2023-10-08T00:33:17.679859+0000","last_became_peered":"2023-10-08T00:33:17.679859+0000","last_unstale":"2023-10-08T00:33:17.682856+0000","last_undegraded":"2023-10-08T00:33:17.682856+0000","last_fullsized":"2023-10-08T00:33:17.682856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:08.647685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688099+0000","last_change":"2023-10-08T00:33:17.676703+0000","last_active":"2023-10-08T00:33:17.688099+0000","last_peered":"2023-10-08T00:33:17.688099+0000","last_clean":"2023-10-08T00:33:17.688099+0000","last_became_active":"2023-10-08T00:33:17.675422+0000","last_became_peered":"2023-10-08T00:33:17.675422+0000","last_unstale":"2023-10-08T00:33:17.688099+0000","last_undegraded":"2023-10-08T00:33:17.688099+0000","last_fullsized":"2023-10-08T00:33:17.688099+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:29.979110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688305+0000","last_change":"2023-10-08T00:33:17.683438+0000","last_active":"2023-10-08T00:33:17.688305+0000","last_peered":"2023-10-08T00:33:17.688305+0000","last_clean":"2023-10-08T00:33:17.688305+0000","last_became_active":"2023-10-08T00:33:17.683150+0000","last_became_peered":"2023-10-08T00:33:17.683150+0000","last_unstale":"2023-10-08T00:33:17.688305+0000","last_undegraded":"2023-10-08T00:33:17.688305+0000","last_fullsized":"2023-10-08T00:33:17.688305+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:56:57.285573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689924+0000","last_change":"2023-10-08T00:33:17.684991+0000","last_active":"2023-10-08T00:33:17.689924+0000","last_peered":"2023-10-08T00:33:17.689924+0000","last_clean":"2023-10-08T00:33:17.689924+0000","last_became_active":"2023-10-08T00:33:17.684755+0000","last_became_peered":"2023-10-08T00:33:17.684755+0000","last_unstale":"2023-10-08T00:33:17.689924+0000","last_undegraded":"2023-10-08T00:33:17.689924+0000","last_fullsized":"2023-10-08T00:33:17.689924+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:00.811215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.679362+0000","last_change":"2023-10-08T00:33:17.669921+0000","last_active":"2023-10-08T00:33:17.679362+0000","last_peered":"2023-10-08T00:33:17.679362+0000","last_clean":"2023-10-08T00:33:17.679362+0000","last_became_active":"2023-10-08T00:33:17.669184+0000","last_became_peered":"2023-10-08T00:33:17.669184+0000","last_unstale":"2023-10-08T00:33:17.679362+0000","last_undegraded":"2023-10-08T00:33:17.679362+0000","last_fullsized":"2023-10-08T00:33:17.679362+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:12.658371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683821+0000","last_change":"2023-10-08T00:33:17.677376+0000","last_active":"2023-10-08T00:33:17.683821+0000","last_peered":"2023-10-08T00:33:17.683821+0000","last_clean":"2023-10-08T00:33:17.683821+0000","last_became_active":"2023-10-08T00:33:17.677144+0000","last_became_peered":"2023-10-08T00:33:17.677144+0000","last_unstale":"2023-10-08T00:33:17.683821+0000","last_undegraded":"2023-10-08T00:33:17.683821+0000","last_fullsized":"2023-10-08T00:33:17.683821+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:37.619632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682698+0000","last_change":"2023-10-08T00:33:17.679622+0000","last_active":"2023-10-08T00:33:17.682698+0000","last_peered":"2023-10-08T00:33:17.682698+0000","last_clean":"2023-10-08T00:33:17.682698+0000","last_became_active":"2023-10-08T00:33:17.679306+0000","last_became_peered":"2023-10-08T00:33:17.679306+0000","last_unstale":"2023-10-08T00:33:17.682698+0000","last_undegraded":"2023-10-08T00:33:17.682698+0000","last_fullsized":"2023-10-08T00:33:17.682698+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:14:55.317487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684156+0000","last_change":"2023-10-08T00:33:17.681105+0000","last_active":"2023-10-08T00:33:17.684156+0000","last_peered":"2023-10-08T00:33:17.684156+0000","last_clean":"2023-10-08T00:33:17.684156+0000","last_became_active":"2023-10-08T00:33:17.680829+0000","last_became_peered":"2023-10-08T00:33:17.680829+0000","last_unstale":"2023-10-08T00:33:17.684156+0000","last_undegraded":"2023-10-08T00:33:17.684156+0000","last_fullsized":"2023-10-08T00:33:17.684156+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:22.843289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691515+0000","last_change":"2023-10-08T00:33:17.689873+0000","last_active":"2023-10-08T00:33:17.691515+0000","last_peered":"2023-10-08T00:33:17.691515+0000","last_clean":"2023-10-08T00:33:17.691515+0000","last_became_active":"2023-10-08T00:33:17.689235+0000","last_became_peered":"2023-10-08T00:33:17.689235+0000","last_unstale":"2023-10-08T00:33:17.691515+0000","last_undegraded":"2023-10-08T00:33:17.691515+0000","last_fullsized":"2023-10-08T00:33:17.691515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:01.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680810+0000","last_change":"2023-10-08T00:33:17.672059+0000","last_active":"2023-10-08T00:33:17.680810+0000","last_peered":"2023-10-08T00:33:17.680810+0000","last_clean":"2023-10-08T00:33:17.680810+0000","last_became_active":"2023-10-08T00:33:17.671080+0000","last_became_peered":"2023-10-08T00:33:17.671080+0000","last_unstale":"2023-10-08T00:33:17.680810+0000","last_undegraded":"2023-10-08T00:33:17.680810+0000","last_fullsized":"2023-10-08T00:33:17.680810+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:29:15.679380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690624+0000","last_change":"2023-10-08T00:33:17.685379+0000","last_active":"2023-10-08T00:33:17.690624+0000","last_peered":"2023-10-08T00:33:17.690624+0000","last_clean":"2023-10-08T00:33:17.690624+0000","last_became_active":"2023-10-08T00:33:17.685101+0000","last_became_peered":"2023-10-08T00:33:17.685101+0000","last_unstale":"2023-10-08T00:33:17.690624+0000","last_undegraded":"2023-10-08T00:33:17.690624+0000","last_fullsized":"2023-10-08T00:33:17.690624+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:57.391741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691101+0000","last_change":"2023-10-08T00:33:17.688144+0000","last_active":"2023-10-08T00:33:17.691101+0000","last_peered":"2023-10-08T00:33:17.691101+0000","last_clean":"2023-10-08T00:33:17.691101+0000","last_became_active":"2023-10-08T00:33:17.687090+0000","last_became_peered":"2023-10-08T00:33:17.687090+0000","last_unstale":"2023-10-08T00:33:17.691101+0000","last_undegraded":"2023-10-08T00:33:17.691101+0000","last_fullsized":"2023-10-08T00:33:17.691101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:54.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.679612+0000","last_change":"2023-10-08T00:33:17.675041+0000","last_active":"2023-10-08T00:33:17.679612+0000","last_peered":"2023-10-08T00:33:17.679612+0000","last_clean":"2023-10-08T00:33:17.679612+0000","last_became_active":"2023-10-08T00:33:17.674773+0000","last_became_peered":"2023-10-08T00:33:17.674773+0000","last_unstale":"2023-10-08T00:33:17.679612+0000","last_undegraded":"2023-10-08T00:33:17.679612+0000","last_fullsized":"2023-10-08T00:33:17.679612+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:10.252341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684044+0000","last_change":"2023-10-08T00:33:17.672541+0000","last_active":"2023-10-08T00:33:17.684044+0000","last_peered":"2023-10-08T00:33:17.684044+0000","last_clean":"2023-10-08T00:33:17.684044+0000","last_became_active":"2023-10-08T00:33:17.672154+0000","last_became_peered":"2023-10-08T00:33:17.672154+0000","last_unstale":"2023-10-08T00:33:17.684044+0000","last_undegraded":"2023-10-08T00:33:17.684044+0000","last_fullsized":"2023-10-08T00:33:17.684044+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:20.601784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691038+0000","last_change":"2023-10-08T00:33:17.687735+0000","last_active":"2023-10-08T00:33:17.691038+0000","last_peered":"2023-10-08T00:33:17.691038+0000","last_clean":"2023-10-08T00:33:17.691038+0000","last_became_active":"2023-10-08T00:33:17.686916+0000","last_became_peered":"2023-10-08T00:33:17.686916+0000","last_unstale":"2023-10-08T00:33:17.691038+0000","last_undegraded":"2023-10-08T00:33:17.691038+0000","last_fullsized":"2023-10-08T00:33:17.691038+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:06.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684174+0000","last_change":"2023-10-08T00:33:17.682168+0000","last_active":"2023-10-08T00:33:17.684174+0000","last_peered":"2023-10-08T00:33:17.684174+0000","last_clean":"2023-10-08T00:33:17.684174+0000","last_became_active":"2023-10-08T00:33:17.681885+0000","last_became_peered":"2023-10-08T00:33:17.681885+0000","last_unstale":"2023-10-08T00:33:17.684174+0000","last_undegraded":"2023-10-08T00:33:17.684174+0000","last_fullsized":"2023-10-08T00:33:17.684174+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:01.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688694+0000","last_change":"2023-10-08T00:33:17.684367+0000","last_active":"2023-10-08T00:33:17.688694+0000","last_peered":"2023-10-08T00:33:17.688694+0000","last_clean":"2023-10-08T00:33:17.688694+0000","last_became_active":"2023-10-08T00:33:17.683988+0000","last_became_peered":"2023-10-08T00:33:17.683988+0000","last_unstale":"2023-10-08T00:33:17.688694+0000","last_undegraded":"2023-10-08T00:33:17.688694+0000","last_fullsized":"2023-10-08T00:33:17.688694+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:46.166271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675916+0000","last_change":"2023-10-08T00:33:17.674925+0000","last_active":"2023-10-08T00:33:17.675916+0000","last_peered":"2023-10-08T00:33:17.675916+0000","last_clean":"2023-10-08T00:33:17.675916+0000","last_became_active":"2023-10-08T00:33:17.674638+0000","last_became_peered":"2023-10-08T00:33:17.674638+0000","last_unstale":"2023-10-08T00:33:17.675916+0000","last_undegraded":"2023-10-08T00:33:17.675916+0000","last_fullsized":"2023-10-08T00:33:17.675916+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:22.687959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688270+0000","last_change":"2023-10-08T00:33:17.677629+0000","last_active":"2023-10-08T00:33:17.688270+0000","last_peered":"2023-10-08T00:33:17.688270+0000","last_clean":"2023-10-08T00:33:17.688270+0000","last_became_active":"2023-10-08T00:33:17.675993+0000","last_became_peered":"2023-10-08T00:33:17.675993+0000","last_unstale":"2023-10-08T00:33:17.688270+0000","last_undegraded":"2023-10-08T00:33:17.688270+0000","last_fullsized":"2023-10-08T00:33:17.688270+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:31.380659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686701+0000","last_change":"2023-10-08T00:33:17.684258+0000","last_active":"2023-10-08T00:33:17.686701+0000","last_peered":"2023-10-08T00:33:17.686701+0000","last_clean":"2023-10-08T00:33:17.686701+0000","last_became_active":"2023-10-08T00:33:17.683995+0000","last_became_peered":"2023-10-08T00:33:17.683995+0000","last_unstale":"2023-10-08T00:33:17.686701+0000","last_undegraded":"2023-10-08T00:33:17.686701+0000","last_fullsized":"2023-10-08T00:33:17.686701+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:54:12.456416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690020+0000","last_change":"2023-10-08T00:33:17.683735+0000","last_active":"2023-10-08T00:33:17.690020+0000","last_peered":"2023-10-08T00:33:17.690020+0000","last_clean":"2023-10-08T00:33:17.690020+0000","last_became_active":"2023-10-08T00:33:17.682805+0000","last_became_peered":"2023-10-08T00:33:17.682805+0000","last_unstale":"2023-10-08T00:33:17.690020+0000","last_undegraded":"2023-10-08T00:33:17.690020+0000","last_fullsized":"2023-10-08T00:33:17.690020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:59:29.841763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688104+0000","last_change":"2023-10-08T00:33:17.682514+0000","last_active":"2023-10-08T00:33:17.688104+0000","last_peered":"2023-10-08T00:33:17.688104+0000","last_clean":"2023-10-08T00:33:17.688104+0000","last_became_active":"2023-10-08T00:33:17.682212+0000","last_became_peered":"2023-10-08T00:33:17.682212+0000","last_unstale":"2023-10-08T00:33:17.688104+0000","last_undegraded":"2023-10-08T00:33:17.688104+0000","last_fullsized":"2023-10-08T00:33:17.688104+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:07:41.352833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691527+0000","last_change":"2023-10-08T00:33:17.689923+0000","last_active":"2023-10-08T00:33:17.691527+0000","last_peered":"2023-10-08T00:33:17.691527+0000","last_clean":"2023-10-08T00:33:17.691527+0000","last_became_active":"2023-10-08T00:33:17.689378+0000","last_became_peered":"2023-10-08T00:33:17.689378+0000","last_unstale":"2023-10-08T00:33:17.691527+0000","last_undegraded":"2023-10-08T00:33:17.691527+0000","last_fullsized":"2023-10-08T00:33:17.691527+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:22.687959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688445+0000","last_change":"2023-10-08T00:33:17.686788+0000","last_active":"2023-10-08T00:33:17.688445+0000","last_peered":"2023-10-08T00:33:17.688445+0000","last_clean":"2023-10-08T00:33:17.688445+0000","last_became_active":"2023-10-08T00:33:17.686496+0000","last_became_peered":"2023-10-08T00:33:17.686496+0000","last_unstale":"2023-10-08T00:33:17.688445+0000","last_undegraded":"2023-10-08T00:33:17.688445+0000","last_fullsized":"2023-10-08T00:33:17.688445+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:54.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691551+0000","last_change":"2023-10-08T00:33:17.690007+0000","last_active":"2023-10-08T00:33:17.691551+0000","last_peered":"2023-10-08T00:33:17.691551+0000","last_clean":"2023-10-08T00:33:17.691551+0000","last_became_active":"2023-10-08T00:33:17.689617+0000","last_became_peered":"2023-10-08T00:33:17.689617+0000","last_unstale":"2023-10-08T00:33:17.691551+0000","last_undegraded":"2023-10-08T00:33:17.691551+0000","last_fullsized":"2023-10-08T00:33:17.691551+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:22.843289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691913+0000","last_change":"2023-10-08T00:33:17.689146+0000","last_active":"2023-10-08T00:33:17.691913+0000","last_peered":"2023-10-08T00:33:17.691913+0000","last_clean":"2023-10-08T00:33:17.691913+0000","last_became_active":"2023-10-08T00:33:17.688831+0000","last_became_peered":"2023-10-08T00:33:17.688831+0000","last_unstale":"2023-10-08T00:33:17.691913+0000","last_undegraded":"2023-10-08T00:33:17.691913+0000","last_fullsized":"2023-10-08T00:33:17.691913+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688488+0000","last_change":"2023-10-08T00:33:17.683466+0000","last_active":"2023-10-08T00:33:17.688488+0000","last_peered":"2023-10-08T00:33:17.688488+0000","last_clean":"2023-10-08T00:33:17.688488+0000","last_became_active":"2023-10-08T00:33:17.683125+0000","last_became_peered":"2023-10-08T00:33:17.683125+0000","last_unstale":"2023-10-08T00:33:17.688488+0000","last_undegraded":"2023-10-08T00:33:17.688488+0000","last_fullsized":"2023-10-08T00:33:17.688488+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:06.492806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689679+0000","last_change":"2023-10-08T00:33:17.683523+0000","last_active":"2023-10-08T00:33:17.689679+0000","last_peered":"2023-10-08T00:33:17.689679+0000","last_clean":"2023-10-08T00:33:17.689679+0000","last_became_active":"2023-10-08T00:33:17.682734+0000","last_became_peered":"2023-10-08T00:33:17.682734+0000","last_unstale":"2023-10-08T00:33:17.689679+0000","last_undegraded":"2023-10-08T00:33:17.689679+0000","last_fullsized":"2023-10-08T00:33:17.689679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688723+0000","last_change":"2023-10-08T00:33:17.684566+0000","last_active":"2023-10-08T00:33:17.688723+0000","last_peered":"2023-10-08T00:33:17.688723+0000","last_clean":"2023-10-08T00:33:17.688723+0000","last_became_active":"2023-10-08T00:33:17.683575+0000","last_became_peered":"2023-10-08T00:33:17.683575+0000","last_unstale":"2023-10-08T00:33:17.688723+0000","last_undegraded":"2023-10-08T00:33:17.688723+0000","last_fullsized":"2023-10-08T00:33:17.688723+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:38:36.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.674349+0000","last_change":"2023-10-08T00:33:17.672690+0000","last_active":"2023-10-08T00:33:17.674349+0000","last_peered":"2023-10-08T00:33:17.674349+0000","last_clean":"2023-10-08T00:33:17.674349+0000","last_became_active":"2023-10-08T00:33:17.672421+0000","last_became_peered":"2023-10-08T00:33:17.672421+0000","last_unstale":"2023-10-08T00:33:17.674349+0000","last_undegraded":"2023-10-08T00:33:17.674349+0000","last_fullsized":"2023-10-08T00:33:17.674349+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:00.947530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682536+0000","last_change":"2023-10-08T00:33:17.677430+0000","last_active":"2023-10-08T00:33:17.682536+0000","last_peered":"2023-10-08T00:33:17.682536+0000","last_clean":"2023-10-08T00:33:17.682536+0000","last_became_active":"2023-10-08T00:33:17.677102+0000","last_became_peered":"2023-10-08T00:33:17.677102+0000","last_unstale":"2023-10-08T00:33:17.682536+0000","last_undegraded":"2023-10-08T00:33:17.682536+0000","last_fullsized":"2023-10-08T00:33:17.682536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:41.188203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690753+0000","last_change":"2023-10-08T00:33:16.671414+0000","last_active":"2023-10-08T00:33:17.690753+0000","last_peered":"2023-10-08T00:33:17.690753+0000","last_clean":"2023-10-08T00:33:17.690753+0000","last_became_active":"2023-10-08T00:33:16.671105+0000","last_became_peered":"2023-10-08T00:33:16.671105+0000","last_unstale":"2023-10-08T00:33:17.690753+0000","last_undegraded":"2023-10-08T00:33:17.690753+0000","last_fullsized":"2023-10-08T00:33:17.690753+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:18.885960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680904+0000","last_change":"2023-10-08T00:33:17.677588+0000","last_active":"2023-10-08T00:33:17.680904+0000","last_peered":"2023-10-08T00:33:17.680904+0000","last_clean":"2023-10-08T00:33:17.680904+0000","last_became_active":"2023-10-08T00:33:17.677306+0000","last_became_peered":"2023-10-08T00:33:17.677306+0000","last_unstale":"2023-10-08T00:33:17.680904+0000","last_undegraded":"2023-10-08T00:33:17.680904+0000","last_fullsized":"2023-10-08T00:33:17.680904+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:06.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686672+0000","last_change":"2023-10-08T00:33:16.667720+0000","last_active":"2023-10-08T00:33:17.686672+0000","last_peered":"2023-10-08T00:33:17.686672+0000","last_clean":"2023-10-08T00:33:17.686672+0000","last_became_active":"2023-10-08T00:33:16.667472+0000","last_became_peered":"2023-10-08T00:33:16.667472+0000","last_unstale":"2023-10-08T00:33:17.686672+0000","last_undegraded":"2023-10-08T00:33:17.686672+0000","last_fullsized":"2023-10-08T00:33:17.686672+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:05.490580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685964+0000","last_change":"2023-10-08T00:33:17.682010+0000","last_active":"2023-10-08T00:33:17.685964+0000","last_peered":"2023-10-08T00:33:17.685964+0000","last_clean":"2023-10-08T00:33:17.685964+0000","last_became_active":"2023-10-08T00:33:17.681756+0000","last_became_peered":"2023-10-08T00:33:17.681756+0000","last_unstale":"2023-10-08T00:33:17.685964+0000","last_undegraded":"2023-10-08T00:33:17.685964+0000","last_fullsized":"2023-10-08T00:33:17.685964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:17.151201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680871+0000","last_change":"2023-10-08T00:33:16.675539+0000","last_active":"2023-10-08T00:33:17.680871+0000","last_peered":"2023-10-08T00:33:17.680871+0000","last_clean":"2023-10-08T00:33:17.680871+0000","last_became_active":"2023-10-08T00:33:16.675264+0000","last_became_peered":"2023-10-08T00:33:16.675264+0000","last_unstale":"2023-10-08T00:33:17.680871+0000","last_undegraded":"2023-10-08T00:33:17.680871+0000","last_fullsized":"2023-10-08T00:33:17.680871+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:01.600042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689702+0000","last_change":"2023-10-08T00:33:17.683625+0000","last_active":"2023-10-08T00:33:17.689702+0000","last_peered":"2023-10-08T00:33:17.689702+0000","last_clean":"2023-10-08T00:33:17.689702+0000","last_became_active":"2023-10-08T00:33:17.683086+0000","last_became_peered":"2023-10-08T00:33:17.683086+0000","last_unstale":"2023-10-08T00:33:17.689702+0000","last_undegraded":"2023-10-08T00:33:17.689702+0000","last_fullsized":"2023-10-08T00:33:17.689702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:46.166271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680215+0000","last_change":"2023-10-08T00:33:16.671190+0000","last_active":"2023-10-08T00:33:17.680215+0000","last_peered":"2023-10-08T00:33:17.680215+0000","last_clean":"2023-10-08T00:33:17.680215+0000","last_became_active":"2023-10-08T00:33:16.670924+0000","last_became_peered":"2023-10-08T00:33:16.670924+0000","last_unstale":"2023-10-08T00:33:17.680215+0000","last_undegraded":"2023-10-08T00:33:17.680215+0000","last_fullsized":"2023-10-08T00:33:17.680215+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:42.536494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688289+0000","last_change":"2023-10-08T00:33:17.678044+0000","last_active":"2023-10-08T00:33:17.688289+0000","last_peered":"2023-10-08T00:33:17.688289+0000","last_clean":"2023-10-08T00:33:17.688289+0000","last_became_active":"2023-10-08T00:33:17.673937+0000","last_became_peered":"2023-10-08T00:33:17.673937+0000","last_unstale":"2023-10-08T00:33:17.688289+0000","last_undegraded":"2023-10-08T00:33:17.688289+0000","last_fullsized":"2023-10-08T00:33:17.688289+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:32.749671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683486+0000","last_change":"2023-10-08T00:33:16.678384+0000","last_active":"2023-10-08T00:33:17.683486+0000","last_peered":"2023-10-08T00:33:17.683486+0000","last_clean":"2023-10-08T00:33:17.683486+0000","last_became_active":"2023-10-08T00:33:16.677792+0000","last_became_peered":"2023-10-08T00:33:16.677792+0000","last_unstale":"2023-10-08T00:33:17.683486+0000","last_undegraded":"2023-10-08T00:33:17.683486+0000","last_fullsized":"2023-10-08T00:33:17.683486+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:36.617406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691840+0000","last_change":"2023-10-08T00:33:17.689142+0000","last_active":"2023-10-08T00:33:17.691840+0000","last_peered":"2023-10-08T00:33:17.691840+0000","last_clean":"2023-10-08T00:33:17.691840+0000","last_became_active":"2023-10-08T00:33:17.688805+0000","last_became_peered":"2023-10-08T00:33:17.688805+0000","last_unstale":"2023-10-08T00:33:17.691840+0000","last_undegraded":"2023-10-08T00:33:17.691840+0000","last_fullsized":"2023-10-08T00:33:17.691840+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:14.925683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675312+0000","last_change":"2023-10-08T00:33:16.681608+0000","last_active":"2023-10-08T00:33:17.675312+0000","last_peered":"2023-10-08T00:33:17.675312+0000","last_clean":"2023-10-08T00:33:17.675312+0000","last_became_active":"2023-10-08T00:33:16.681336+0000","last_became_peered":"2023-10-08T00:33:16.681336+0000","last_unstale":"2023-10-08T00:33:17.675312+0000","last_undegraded":"2023-10-08T00:33:17.675312+0000","last_fullsized":"2023-10-08T00:33:17.675312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:40:59.446556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.681271+0000","last_change":"2023-10-08T00:33:17.677626+0000","last_active":"2023-10-08T00:33:17.681271+0000","last_peered":"2023-10-08T00:33:17.681271+0000","last_clean":"2023-10-08T00:33:17.681271+0000","last_became_active":"2023-10-08T00:33:17.677383+0000","last_became_peered":"2023-10-08T00:33:17.677383+0000","last_unstale":"2023-10-08T00:33:17.681271+0000","last_undegraded":"2023-10-08T00:33:17.681271+0000","last_fullsized":"2023-10-08T00:33:17.681271+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:12.658371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.670493+0000","last_change":"2023-10-08T00:33:16.678082+0000","last_active":"2023-10-08T00:33:17.670493+0000","last_peered":"2023-10-08T00:33:17.670493+0000","last_clean":"2023-10-08T00:33:17.670493+0000","last_became_active":"2023-10-08T00:33:16.677816+0000","last_became_peered":"2023-10-08T00:33:16.677816+0000","last_unstale":"2023-10-08T00:33:17.670493+0000","last_undegraded":"2023-10-08T00:33:17.670493+0000","last_fullsized":"2023-10-08T00:33:17.670493+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:39.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691011+0000","last_change":"2023-10-08T00:33:17.685894+0000","last_active":"2023-10-08T00:33:17.691011+0000","last_peered":"2023-10-08T00:33:17.691011+0000","last_clean":"2023-10-08T00:33:17.691011+0000","last_became_active":"2023-10-08T00:33:17.678197+0000","last_became_peered":"2023-10-08T00:33:17.678197+0000","last_unstale":"2023-10-08T00:33:17.691011+0000","last_undegraded":"2023-10-08T00:33:17.691011+0000","last_fullsized":"2023-10-08T00:33:17.691011+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:57.013505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.674747+0000","last_change":"2023-10-08T00:33:16.682010+0000","last_active":"2023-10-08T00:33:17.674747+0000","last_peered":"2023-10-08T00:33:17.674747+0000","last_clean":"2023-10-08T00:33:17.674747+0000","last_became_active":"2023-10-08T00:33:16.681754+0000","last_became_peered":"2023-10-08T00:33:16.681754+0000","last_unstale":"2023-10-08T00:33:17.674747+0000","last_undegraded":"2023-10-08T00:33:17.674747+0000","last_fullsized":"2023-10-08T00:33:17.674747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:16.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689806+0000","last_change":"2023-10-08T00:33:17.682805+0000","last_active":"2023-10-08T00:33:17.689806+0000","last_peered":"2023-10-08T00:33:17.689806+0000","last_clean":"2023-10-08T00:33:17.689806+0000","last_became_active":"2023-10-08T00:33:17.682405+0000","last_became_peered":"2023-10-08T00:33:17.682405+0000","last_unstale":"2023-10-08T00:33:17.689806+0000","last_undegraded":"2023-10-08T00:33:17.689806+0000","last_fullsized":"2023-10-08T00:33:17.689806+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:32:25.531675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.664500+0000","last_change":"2023-10-08T00:33:16.667362+0000","last_active":"2023-10-08T00:33:17.664500+0000","last_peered":"2023-10-08T00:33:17.664500+0000","last_clean":"2023-10-08T00:33:17.664500+0000","last_became_active":"2023-10-08T00:33:16.667122+0000","last_became_peered":"2023-10-08T00:33:16.667122+0000","last_unstale":"2023-10-08T00:33:17.664500+0000","last_undegraded":"2023-10-08T00:33:17.664500+0000","last_fullsized":"2023-10-08T00:33:17.664500+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:26:25.262420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686555+0000","last_change":"2023-10-08T00:33:17.683644+0000","last_active":"2023-10-08T00:33:17.686555+0000","last_peered":"2023-10-08T00:33:17.686555+0000","last_clean":"2023-10-08T00:33:17.686555+0000","last_became_active":"2023-10-08T00:33:17.683378+0000","last_became_peered":"2023-10-08T00:33:17.683378+0000","last_unstale":"2023-10-08T00:33:17.686555+0000","last_undegraded":"2023-10-08T00:33:17.686555+0000","last_fullsized":"2023-10-08T00:33:17.686555+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:02.602268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688074+0000","last_change":"2023-10-08T00:33:16.674348+0000","last_active":"2023-10-08T00:33:17.688074+0000","last_peered":"2023-10-08T00:33:17.688074+0000","last_clean":"2023-10-08T00:33:17.688074+0000","last_became_active":"2023-10-08T00:33:16.672802+0000","last_became_peered":"2023-10-08T00:33:16.672802+0000","last_unstale":"2023-10-08T00:33:17.688074+0000","last_undegraded":"2023-10-08T00:33:17.688074+0000","last_fullsized":"2023-10-08T00:33:17.688074+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:03.777515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691585+0000","last_change":"2023-10-08T00:33:17.690850+0000","last_active":"2023-10-08T00:33:17.691585+0000","last_peered":"2023-10-08T00:33:17.691585+0000","last_clean":"2023-10-08T00:33:17.691585+0000","last_became_active":"2023-10-08T00:33:17.690558+0000","last_became_peered":"2023-10-08T00:33:17.690558+0000","last_unstale":"2023-10-08T00:33:17.691585+0000","last_undegraded":"2023-10-08T00:33:17.691585+0000","last_fullsized":"2023-10-08T00:33:17.691585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:41.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.692628+0000","last_change":"2023-10-08T00:33:16.672895+0000","last_active":"2023-10-08T00:33:17.692628+0000","last_peered":"2023-10-08T00:33:17.692628+0000","last_clean":"2023-10-08T00:33:17.692628+0000","last_became_active":"2023-10-08T00:33:16.672627+0000","last_became_peered":"2023-10-08T00:33:16.672627+0000","last_unstale":"2023-10-08T00:33:17.692628+0000","last_undegraded":"2023-10-08T00:33:17.692628+0000","last_fullsized":"2023-10-08T00:33:17.692628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:28.976885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.669358+0000","last_change":"2023-10-08T00:33:17.668284+0000","last_active":"2023-10-08T00:33:17.669358+0000","last_peered":"2023-10-08T00:33:17.669358+0000","last_clean":"2023-10-08T00:33:17.669358+0000","last_became_active":"2023-10-08T00:33:17.667949+0000","last_became_peered":"2023-10-08T00:33:17.667949+0000","last_unstale":"2023-10-08T00:33:17.669358+0000","last_undegraded":"2023-10-08T00:33:17.669358+0000","last_fullsized":"2023-10-08T00:33:17.669358+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:47.620740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683794+0000","last_change":"2023-10-08T00:33:16.678953+0000","last_active":"2023-10-08T00:33:17.683794+0000","last_peered":"2023-10-08T00:33:17.683794+0000","last_clean":"2023-10-08T00:33:17.683794+0000","last_became_active":"2023-10-08T00:33:16.678682+0000","last_became_peered":"2023-10-08T00:33:16.678682+0000","last_unstale":"2023-10-08T00:33:17.683794+0000","last_undegraded":"2023-10-08T00:33:17.683794+0000","last_fullsized":"2023-10-08T00:33:17.683794+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:40:59.446556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690483+0000","last_change":"2023-10-08T00:33:17.684851+0000","last_active":"2023-10-08T00:33:17.690483+0000","last_peered":"2023-10-08T00:33:17.690483+0000","last_clean":"2023-10-08T00:33:17.690483+0000","last_became_active":"2023-10-08T00:33:17.684469+0000","last_became_peered":"2023-10-08T00:33:17.684469+0000","last_unstale":"2023-10-08T00:33:17.690483+0000","last_undegraded":"2023-10-08T00:33:17.690483+0000","last_fullsized":"2023-10-08T00:33:17.690483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:57.391741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.665383+0000","last_change":"2023-10-08T00:33:16.681291+0000","last_active":"2023-10-08T00:33:17.665383+0000","last_peered":"2023-10-08T00:33:17.665383+0000","last_clean":"2023-10-08T00:33:17.665383+0000","last_became_active":"2023-10-08T00:33:16.681050+0000","last_became_peered":"2023-10-08T00:33:16.681050+0000","last_unstale":"2023-10-08T00:33:17.665383+0000","last_undegraded":"2023-10-08T00:33:17.665383+0000","last_fullsized":"2023-10-08T00:33:17.665383+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:07.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690533+0000","last_change":"2023-10-08T00:33:17.685946+0000","last_active":"2023-10-08T00:33:17.690533+0000","last_peered":"2023-10-08T00:33:17.690533+0000","last_clean":"2023-10-08T00:33:17.690533+0000","last_became_active":"2023-10-08T00:33:17.685042+0000","last_became_peered":"2023-10-08T00:33:17.685042+0000","last_unstale":"2023-10-08T00:33:17.690533+0000","last_undegraded":"2023-10-08T00:33:17.690533+0000","last_fullsized":"2023-10-08T00:33:17.690533+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:34.912510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.662146+0000","last_change":"2023-10-08T00:33:16.669190+0000","last_active":"2023-10-08T00:33:17.662146+0000","last_peered":"2023-10-08T00:33:17.662146+0000","last_clean":"2023-10-08T00:33:17.662146+0000","last_became_active":"2023-10-08T00:33:16.668937+0000","last_became_peered":"2023-10-08T00:33:16.668937+0000","last_unstale":"2023-10-08T00:33:17.662146+0000","last_undegraded":"2023-10-08T00:33:17.662146+0000","last_fullsized":"2023-10-08T00:33:17.662146+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:16:00.733995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686887+0000","last_change":"2023-10-08T00:33:17.682612+0000","last_active":"2023-10-08T00:33:17.686887+0000","last_peered":"2023-10-08T00:33:17.686887+0000","last_clean":"2023-10-08T00:33:17.686887+0000","last_became_active":"2023-10-08T00:33:17.681452+0000","last_became_peered":"2023-10-08T00:33:17.681452+0000","last_unstale":"2023-10-08T00:33:17.686887+0000","last_undegraded":"2023-10-08T00:33:17.686887+0000","last_fullsized":"2023-10-08T00:33:17.686887+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:18:58.137532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687932+0000","last_change":"2023-10-08T00:33:16.676094+0000","last_active":"2023-10-08T00:33:17.687932+0000","last_peered":"2023-10-08T00:33:17.687932+0000","last_clean":"2023-10-08T00:33:17.687932+0000","last_became_active":"2023-10-08T00:33:16.675736+0000","last_became_peered":"2023-10-08T00:33:16.675736+0000","last_unstale":"2023-10-08T00:33:17.687932+0000","last_undegraded":"2023-10-08T00:33:17.687932+0000","last_fullsized":"2023-10-08T00:33:17.687932+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:16.148975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682760+0000","last_change":"2023-10-08T00:33:17.677973+0000","last_active":"2023-10-08T00:33:17.682760+0000","last_peered":"2023-10-08T00:33:17.682760+0000","last_clean":"2023-10-08T00:33:17.682760+0000","last_became_active":"2023-10-08T00:33:17.677662+0000","last_became_peered":"2023-10-08T00:33:17.677662+0000","last_unstale":"2023-10-08T00:33:17.682760+0000","last_undegraded":"2023-10-08T00:33:17.682760+0000","last_fullsized":"2023-10-08T00:33:17.682760+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:13:18.060729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688745+0000","last_change":"2023-10-08T00:33:16.679329+0000","last_active":"2023-10-08T00:33:17.688745+0000","last_peered":"2023-10-08T00:33:17.688745+0000","last_clean":"2023-10-08T00:33:17.688745+0000","last_became_active":"2023-10-08T00:33:16.679030+0000","last_became_peered":"2023-10-08T00:33:16.679030+0000","last_unstale":"2023-10-08T00:33:17.688745+0000","last_undegraded":"2023-10-08T00:33:17.688745+0000","last_fullsized":"2023-10-08T00:33:17.688745+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:10.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691865+0000","last_change":"2023-10-08T00:33:17.689238+0000","last_active":"2023-10-08T00:33:17.691865+0000","last_peered":"2023-10-08T00:33:17.691865+0000","last_clean":"2023-10-08T00:33:17.691865+0000","last_became_active":"2023-10-08T00:33:17.689020+0000","last_became_peered":"2023-10-08T00:33:17.689020+0000","last_unstale":"2023-10-08T00:33:17.691865+0000","last_undegraded":"2023-10-08T00:33:17.691865+0000","last_fullsized":"2023-10-08T00:33:17.691865+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:41.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.678172+0000","last_change":"2023-10-08T00:33:16.673947+0000","last_active":"2023-10-08T00:33:17.678172+0000","last_peered":"2023-10-08T00:33:17.678172+0000","last_clean":"2023-10-08T00:33:17.678172+0000","last_became_active":"2023-10-08T00:33:16.673672+0000","last_became_peered":"2023-10-08T00:33:16.673672+0000","last_unstale":"2023-10-08T00:33:17.678172+0000","last_undegraded":"2023-10-08T00:33:17.678172+0000","last_fullsized":"2023-10-08T00:33:17.678172+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:52.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690494+0000","last_change":"2023-10-08T00:33:17.685663+0000","last_active":"2023-10-08T00:33:17.690494+0000","last_peered":"2023-10-08T00:33:17.690494+0000","last_clean":"2023-10-08T00:33:17.690494+0000","last_became_active":"2023-10-08T00:33:17.685410+0000","last_became_peered":"2023-10-08T00:33:17.685410+0000","last_unstale":"2023-10-08T00:33:17.690494+0000","last_undegraded":"2023-10-08T00:33:17.690494+0000","last_fullsized":"2023-10-08T00:33:17.690494+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:53.870890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685146+0000","last_change":"2023-10-08T00:33:16.677055+0000","last_active":"2023-10-08T00:33:17.685146+0000","last_peered":"2023-10-08T00:33:17.685146+0000","last_clean":"2023-10-08T00:33:17.685146+0000","last_became_active":"2023-10-08T00:33:16.676618+0000","last_became_peered":"2023-10-08T00:33:16.676618+0000","last_unstale":"2023-10-08T00:33:17.685146+0000","last_undegraded":"2023-10-08T00:33:17.685146+0000","last_fullsized":"2023-10-08T00:33:17.685146+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:11:40.540117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690594+0000","last_change":"2023-10-08T00:33:17.686506+0000","last_active":"2023-10-08T00:33:17.690594+0000","last_peered":"2023-10-08T00:33:17.690594+0000","last_clean":"2023-10-08T00:33:17.690594+0000","last_became_active":"2023-10-08T00:33:17.686177+0000","last_became_peered":"2023-10-08T00:33:17.686177+0000","last_unstale":"2023-10-08T00:33:17.690594+0000","last_undegraded":"2023-10-08T00:33:17.690594+0000","last_fullsized":"2023-10-08T00:33:17.690594+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:05.532998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.671015+0000","last_change":"2023-10-08T00:33:16.677685+0000","last_active":"2023-10-08T00:33:17.671015+0000","last_peered":"2023-10-08T00:33:17.671015+0000","last_clean":"2023-10-08T00:33:17.671015+0000","last_became_active":"2023-10-08T00:33:16.677356+0000","last_became_peered":"2023-10-08T00:33:16.677356+0000","last_unstale":"2023-10-08T00:33:17.671015+0000","last_undegraded":"2023-10-08T00:33:17.671015+0000","last_fullsized":"2023-10-08T00:33:17.671015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:31.747445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688065+0000","last_change":"2023-10-08T00:33:17.683944+0000","last_active":"2023-10-08T00:33:17.688065+0000","last_peered":"2023-10-08T00:33:17.688065+0000","last_clean":"2023-10-08T00:33:17.688065+0000","last_became_active":"2023-10-08T00:33:17.683617+0000","last_became_peered":"2023-10-08T00:33:17.683617+0000","last_unstale":"2023-10-08T00:33:17.688065+0000","last_undegraded":"2023-10-08T00:33:17.688065+0000","last_fullsized":"2023-10-08T00:33:17.688065+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:22.343092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689109+0000","last_change":"2023-10-08T00:33:16.680031+0000","last_active":"2023-10-08T00:33:17.689109+0000","last_peered":"2023-10-08T00:33:17.689109+0000","last_clean":"2023-10-08T00:33:17.689109+0000","last_became_active":"2023-10-08T00:33:16.679712+0000","last_became_peered":"2023-10-08T00:33:16.679712+0000","last_unstale":"2023-10-08T00:33:17.689109+0000","last_undegraded":"2023-10-08T00:33:17.689109+0000","last_fullsized":"2023-10-08T00:33:17.689109+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:54.304217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682744+0000","last_change":"2023-10-08T00:33:17.679086+0000","last_active":"2023-10-08T00:33:17.682744+0000","last_peered":"2023-10-08T00:33:17.682744+0000","last_clean":"2023-10-08T00:33:17.682744+0000","last_became_active":"2023-10-08T00:33:17.678806+0000","last_became_peered":"2023-10-08T00:33:17.678806+0000","last_unstale":"2023-10-08T00:33:17.682744+0000","last_undegraded":"2023-10-08T00:33:17.682744+0000","last_fullsized":"2023-10-08T00:33:17.682744+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:28.026003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675230+0000","last_change":"2023-10-08T00:33:16.679897+0000","last_active":"2023-10-08T00:33:17.675230+0000","last_peered":"2023-10-08T00:33:17.675230+0000","last_clean":"2023-10-08T00:33:17.675230+0000","last_became_active":"2023-10-08T00:33:16.679593+0000","last_became_peered":"2023-10-08T00:33:16.679593+0000","last_unstale":"2023-10-08T00:33:17.675230+0000","last_undegraded":"2023-10-08T00:33:17.675230+0000","last_fullsized":"2023-10-08T00:33:17.675230+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:28:00.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683798+0000","last_change":"2023-10-08T00:33:17.673172+0000","last_active":"2023-10-08T00:33:17.683798+0000","last_peered":"2023-10-08T00:33:17.683798+0000","last_clean":"2023-10-08T00:33:17.683798+0000","last_became_active":"2023-10-08T00:33:17.671505+0000","last_became_peered":"2023-10-08T00:33:17.671505+0000","last_unstale":"2023-10-08T00:33:17.683798+0000","last_undegraded":"2023-10-08T00:33:17.683798+0000","last_fullsized":"2023-10-08T00:33:17.683798+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:52:26.034754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675402+0000","last_change":"2023-10-08T00:33:16.682149+0000","last_active":"2023-10-08T00:33:17.675402+0000","last_peered":"2023-10-08T00:33:17.675402+0000","last_clean":"2023-10-08T00:33:17.675402+0000","last_became_active":"2023-10-08T00:33:16.681922+0000","last_became_peered":"2023-10-08T00:33:16.681922+0000","last_unstale":"2023-10-08T00:33:17.675402+0000","last_undegraded":"2023-10-08T00:33:17.675402+0000","last_fullsized":"2023-10-08T00:33:17.675402+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:13.954077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687856+0000","last_change":"2023-10-08T00:33:17.676696+0000","last_active":"2023-10-08T00:33:17.687856+0000","last_peered":"2023-10-08T00:33:17.687856+0000","last_clean":"2023-10-08T00:33:17.687856+0000","last_became_active":"2023-10-08T00:33:17.676377+0000","last_became_peered":"2023-10-08T00:33:17.676377+0000","last_unstale":"2023-10-08T00:33:17.687856+0000","last_undegraded":"2023-10-08T00:33:17.687856+0000","last_fullsized":"2023-10-08T00:33:17.687856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:36:59.311376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.667381+0000","last_change":"2023-10-08T00:33:16.678988+0000","last_active":"2023-10-08T00:33:17.667381+0000","last_peered":"2023-10-08T00:33:17.667381+0000","last_clean":"2023-10-08T00:33:17.667381+0000","last_became_active":"2023-10-08T00:33:16.678269+0000","last_became_peered":"2023-10-08T00:33:16.678269+0000","last_unstale":"2023-10-08T00:33:17.667381+0000","last_undegraded":"2023-10-08T00:33:17.667381+0000","last_fullsized":"2023-10-08T00:33:17.667381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:53:14.203458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675779+0000","last_change":"2023-10-08T00:33:17.673603+0000","last_active":"2023-10-08T00:33:17.675779+0000","last_peered":"2023-10-08T00:33:17.675779+0000","last_clean":"2023-10-08T00:33:17.675779+0000","last_became_active":"2023-10-08T00:33:17.673352+0000","last_became_peered":"2023-10-08T00:33:17.673352+0000","last_unstale":"2023-10-08T00:33:17.675779+0000","last_undegraded":"2023-10-08T00:33:17.675779+0000","last_fullsized":"2023-10-08T00:33:17.675779+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:40.285005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691417+0000","last_change":"2023-10-08T00:33:16.680035+0000","last_active":"2023-10-08T00:33:17.691417+0000","last_peered":"2023-10-08T00:33:17.691417+0000","last_clean":"2023-10-08T00:33:17.691417+0000","last_became_active":"2023-10-08T00:33:16.679700+0000","last_became_peered":"2023-10-08T00:33:16.679700+0000","last_unstale":"2023-10-08T00:33:17.691417+0000","last_undegraded":"2023-10-08T00:33:17.691417+0000","last_fullsized":"2023-10-08T00:33:17.691417+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:54.096948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682527+0000","last_change":"2023-10-08T00:33:17.677407+0000","last_active":"2023-10-08T00:33:17.682527+0000","last_peered":"2023-10-08T00:33:17.682527+0000","last_clean":"2023-10-08T00:33:17.682527+0000","last_became_active":"2023-10-08T00:33:17.677141+0000","last_became_peered":"2023-10-08T00:33:17.677141+0000","last_unstale":"2023-10-08T00:33:17.682527+0000","last_undegraded":"2023-10-08T00:33:17.682527+0000","last_fullsized":"2023-10-08T00:33:17.682527+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:06.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.672084+0000","last_change":"2023-10-08T00:33:16.674209+0000","last_active":"2023-10-08T00:33:17.672084+0000","last_peered":"2023-10-08T00:33:17.672084+0000","last_clean":"2023-10-08T00:33:17.672084+0000","last_became_active":"2023-10-08T00:33:16.673649+0000","last_became_peered":"2023-10-08T00:33:16.673649+0000","last_unstale":"2023-10-08T00:33:17.672084+0000","last_undegraded":"2023-10-08T00:33:17.672084+0000","last_fullsized":"2023-10-08T00:33:17.672084+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:08.378431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683485+0000","last_change":"2023-10-08T00:33:17.679548+0000","last_active":"2023-10-08T00:33:17.683485+0000","last_peered":"2023-10-08T00:33:17.683485+0000","last_clean":"2023-10-08T00:33:17.683485+0000","last_became_active":"2023-10-08T00:33:17.679124+0000","last_became_peered":"2023-10-08T00:33:17.679124+0000","last_unstale":"2023-10-08T00:33:17.683485+0000","last_undegraded":"2023-10-08T00:33:17.683485+0000","last_fullsized":"2023-10-08T00:33:17.683485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:57.013505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.676555+0000","last_change":"2023-10-08T00:33:16.677196+0000","last_active":"2023-10-08T00:33:17.676555+0000","last_peered":"2023-10-08T00:33:17.676555+0000","last_clean":"2023-10-08T00:33:17.676555+0000","last_became_active":"2023-10-08T00:33:16.676889+0000","last_became_peered":"2023-10-08T00:33:16.676889+0000","last_unstale":"2023-10-08T00:33:17.676555+0000","last_undegraded":"2023-10-08T00:33:17.676555+0000","last_fullsized":"2023-10-08T00:33:17.676555+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:37:56.529504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.678385+0000","last_change":"2023-10-08T00:33:17.672623+0000","last_active":"2023-10-08T00:33:17.678385+0000","last_peered":"2023-10-08T00:33:17.678385+0000","last_clean":"2023-10-08T00:33:17.678385+0000","last_became_active":"2023-10-08T00:33:17.672319+0000","last_became_peered":"2023-10-08T00:33:17.672319+0000","last_unstale":"2023-10-08T00:33:17.678385+0000","last_undegraded":"2023-10-08T00:33:17.678385+0000","last_fullsized":"2023-10-08T00:33:17.678385+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:20.646189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.666991+0000","last_change":"2023-10-08T00:33:16.677082+0000","last_active":"2023-10-08T00:33:17.666991+0000","last_peered":"2023-10-08T00:33:17.666991+0000","last_clean":"2023-10-08T00:33:17.666991+0000","last_became_active":"2023-10-08T00:33:16.676553+0000","last_became_peered":"2023-10-08T00:33:16.676553+0000","last_unstale":"2023-10-08T00:33:17.666991+0000","last_undegraded":"2023-10-08T00:33:17.666991+0000","last_fullsized":"2023-10-08T00:33:17.666991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:16.584682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680620+0000","last_change":"2023-10-08T00:33:17.671212+0000","last_active":"2023-10-08T00:33:17.680620+0000","last_peered":"2023-10-08T00:33:17.680620+0000","last_clean":"2023-10-08T00:33:17.680620+0000","last_became_active":"2023-10-08T00:33:17.670769+0000","last_became_peered":"2023-10-08T00:33:17.670769+0000","last_unstale":"2023-10-08T00:33:17.680620+0000","last_undegraded":"2023-10-08T00:33:17.680620+0000","last_fullsized":"2023-10-08T00:33:17.680620+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:01.139604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675308+0000","last_change":"2023-10-08T00:33:16.680790+0000","last_active":"2023-10-08T00:33:17.675308+0000","last_peered":"2023-10-08T00:33:17.675308+0000","last_clean":"2023-10-08T00:33:17.675308+0000","last_became_active":"2023-10-08T00:33:16.680489+0000","last_became_peered":"2023-10-08T00:33:16.680489+0000","last_unstale":"2023-10-08T00:33:17.675308+0000","last_undegraded":"2023-10-08T00:33:17.675308+0000","last_fullsized":"2023-10-08T00:33:17.675308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:42.536494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690515+0000","last_change":"2023-10-08T00:33:17.685264+0000","last_active":"2023-10-08T00:33:17.690515+0000","last_peered":"2023-10-08T00:33:17.690515+0000","last_clean":"2023-10-08T00:33:17.690515+0000","last_became_active":"2023-10-08T00:33:17.684996+0000","last_became_peered":"2023-10-08T00:33:17.684996+0000","last_unstale":"2023-10-08T00:33:17.690515+0000","last_undegraded":"2023-10-08T00:33:17.690515+0000","last_fullsized":"2023-10-08T00:33:17.690515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:01.139604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.665490+0000","last_change":"2023-10-08T00:33:16.667354+0000","last_active":"2023-10-08T00:33:17.665490+0000","last_peered":"2023-10-08T00:33:17.665490+0000","last_clean":"2023-10-08T00:33:17.665490+0000","last_became_active":"2023-10-08T00:33:16.667062+0000","last_became_peered":"2023-10-08T00:33:16.667062+0000","last_unstale":"2023-10-08T00:33:17.665490+0000","last_undegraded":"2023-10-08T00:33:17.665490+0000","last_fullsized":"2023-10-08T00:33:17.665490+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:32:24.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690450+0000","last_change":"2023-10-08T00:33:17.685137+0000","last_active":"2023-10-08T00:33:17.690450+0000","last_peered":"2023-10-08T00:33:17.690450+0000","last_clean":"2023-10-08T00:33:17.690450+0000","last_became_active":"2023-10-08T00:33:17.684870+0000","last_became_peered":"2023-10-08T00:33:17.684870+0000","last_unstale":"2023-10-08T00:33:17.690450+0000","last_undegraded":"2023-10-08T00:33:17.690450+0000","last_fullsized":"2023-10-08T00:33:17.690450+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:02.602268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.663779+0000","last_change":"2023-10-08T00:33:16.678604+0000","last_active":"2023-10-08T00:33:17.663779+0000","last_peered":"2023-10-08T00:33:17.663779+0000","last_clean":"2023-10-08T00:33:17.663779+0000","last_became_active":"2023-10-08T00:33:16.678234+0000","last_became_peered":"2023-10-08T00:33:16.678234+0000","last_unstale":"2023-10-08T00:33:17.663779+0000","last_undegraded":"2023-10-08T00:33:17.663779+0000","last_fullsized":"2023-10-08T00:33:17.663779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:16:15.994941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690007+0000","last_change":"2023-10-08T00:33:17.683622+0000","last_active":"2023-10-08T00:33:17.690007+0000","last_peered":"2023-10-08T00:33:17.690007+0000","last_clean":"2023-10-08T00:33:17.690007+0000","last_became_active":"2023-10-08T00:33:17.683153+0000","last_became_peered":"2023-10-08T00:33:17.683153+0000","last_unstale":"2023-10-08T00:33:17.690007+0000","last_undegraded":"2023-10-08T00:33:17.690007+0000","last_fullsized":"2023-10-08T00:33:17.690007+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:00.811215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.667486+0000","last_change":"2023-10-08T00:33:16.678700+0000","last_active":"2023-10-08T00:33:17.667486+0000","last_peered":"2023-10-08T00:33:17.667486+0000","last_clean":"2023-10-08T00:33:17.667486+0000","last_became_active":"2023-10-08T00:33:16.677754+0000","last_became_peered":"2023-10-08T00:33:16.677754+0000","last_unstale":"2023-10-08T00:33:17.667486+0000","last_undegraded":"2023-10-08T00:33:17.667486+0000","last_fullsized":"2023-10-08T00:33:17.667486+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:39.994850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685048+0000","last_change":"2023-10-08T00:33:17.678325+0000","last_active":"2023-10-08T00:33:17.685048+0000","last_peered":"2023-10-08T00:33:17.685048+0000","last_clean":"2023-10-08T00:33:17.685048+0000","last_became_active":"2023-10-08T00:33:17.678049+0000","last_became_peered":"2023-10-08T00:33:17.678049+0000","last_unstale":"2023-10-08T00:33:17.685048+0000","last_undegraded":"2023-10-08T00:33:17.685048+0000","last_fullsized":"2023-10-08T00:33:17.685048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:22.343092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687332+0000","last_change":"2023-10-08T00:33:16.682289+0000","last_active":"2023-10-08T00:33:17.687332+0000","last_peered":"2023-10-08T00:33:17.687332+0000","last_clean":"2023-10-08T00:33:17.687332+0000","last_became_active":"2023-10-08T00:33:16.681999+0000","last_became_peered":"2023-10-08T00:33:16.681999+0000","last_unstale":"2023-10-08T00:33:17.687332+0000","last_undegraded":"2023-10-08T00:33:17.687332+0000","last_fullsized":"2023-10-08T00:33:17.687332+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:54.304217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":286,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.670615+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:17.670615+0000","last_peered":"2023-10-08T00:33:17.670615+0000","last_clean":"2023-10-08T00:33:17.670615+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:17.670615+0000","last_undegraded":"2023-10-08T00:33:17.670615+0000","last_fullsized":"2023-10-08T00:33:17.670615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304048,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067792,"statfs":{"total":96636764160,"available":96325419008,"internally_reserved":0,"allocated":2727936,"data_stored":1544670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.80300000000000005}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.77700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.87}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303472,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068368,"statfs":{"total":96636764160,"available":96326008832,"internally_reserved":0,"allocated":2138112,"data_stored":954288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.495},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.39900000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.435},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":954322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.50900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.60299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304040,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067800,"statfs":{"total":96636764160,"available":96325427200,"internally_reserved":0,"allocated":2719744,"data_stored":1538956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.63700000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.375,"15min":0.379},"min":{"1min":0.249,"5min":0.245,"15min":0.245},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.63100000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.36199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.311}]},{"osd":4,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.877,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.81100000000000005,"5min":0.88100000000000001,"15min":1.242},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83699999999999997,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.54700000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303484,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068356,"statfs":{"total":96636764160,"available":96325996544,"internally_reserved":0,"allocated":2150400,"data_stored":955824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.66400000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303480,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068360,"statfs":{"total":96636764160,"available":96326000640,"internally_reserved":0,"allocated":2146304,"data_stored":955838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.39100000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.69999999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.70999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":954786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.82899999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.749},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303464,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068376,"statfs":{"total":96636764160,"available":96326017024,"internally_reserved":0,"allocated":2129920,"data_stored":954232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57299999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66700000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.747}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.68000000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:22.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T00:33:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.705+0000 7f38050f4700 1 Processor -- start 2023-10-08T00:33:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.705+0000 7f38050f4700 1 -- start start 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f38050f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38000cd910 0x7f38000ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f38050f4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000b5b00 con 0x7f38000b55a0 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f38050f4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000b5da0 con 0x7f3800159ec0 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f38050f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b6080 con 0x7f38000cd910 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f37ff59e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f38000b55a0 0x7f38000ce880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51652/0 (socket says 172.21.15.22:51652) 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f37ff59e700 1 -- 172.21.15.22:0/2041806598 learned_addr learned my addr 172.21.15.22:0/2041806598 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.706+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38000cd910 0x7f38000ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390315642 0 0) 0x7f38000b5b00 con 0x7f38000b55a0 2023-10-08T00:33:22.710 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37ec003570 con 0x7f38000b55a0 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210651418 0 0) 0x7f38000b5da0 con 0x7f3800159ec0 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38000b5b00 con 0x7f3800159ec0 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 124681356 0 0) 0x7f37ec003570 con 0x7f38000b55a0 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38000cd910 msgr2=0x7f38000ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38000cd910 0x7f38000ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 >> v1:172.21.15.192:6789/0 conn(0x7f3800159ec0 legacy=0x7f38000b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000cc100 con 0x7f38000b55a0 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f37f00017f0 con 0x7f38000b55a0 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 >> v1:172.21.15.22:6789/0 conn(0x7f38000b55a0 legacy=0x7f38000ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec003c20 0x7f37ec004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b6080 con 0x7f37ec004810 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec00c020 con 0x7f37ec0051c0 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec00c1e0 con 0x7f37ec003c20 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f38000cd910 0x7f38000ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fed9d700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec003c20 0x7f37ec004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37ff59e700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 -- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec003c20 msgr2=0x7f37ec004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec003c20 0x7f37ec004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 -- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37ec0051c0 msgr2=0x7f37ec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37ec0051c0 0x7f37ec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.707+0000 7f37fe59c700 1 -- 172.21.15.22:0/2041806598 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec003570 con 0x7f37ec004810 2023-10-08T00:33:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009c50 tx=0x7f37e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d878495e2423c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800e710 con 0x7f37ec004810 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e800e870 con 0x7f37ec004810 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f37fdd9b700 1 -- 172.21.15.22:0/2041806598 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e800ec10 con 0x7f37ec004810 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f38050f4700 1 -- 172.21.15.22:0/2041806598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37ec004810 msgr2=0x7f37ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f38050f4700 1 --2- 172.21.15.22:0/2041806598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37ec004810 0x7f37ec004c80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009c50 tx=0x7f37e80091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f37ff59e700 1 -- 172.21.15.22:0/2041806598 reap_dead start 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f38050f4700 1 -- 172.21.15.22:0/2041806598 shutdown_connections 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f38050f4700 1 -- 172.21.15.22:0/2041806598 >> 172.21.15.22:0/2041806598 conn(0x7f38000999f0 msgr2=0x7f38000b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f38050f4700 1 -- 172.21.15.22:0/2041806598 shutdown_connections 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.708+0000 7f38050f4700 1 -- 172.21.15.22:0/2041806598 wait complete. 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 Processor -- start 2023-10-08T00:33:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 -- start start 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec004810 0x7f380014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 0x7f38000ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f380009a540 0x7f380009a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000ca550 con 0x7f38000c9ba0 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3800169b40 con 0x7f380009a540 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f38050f4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380009bb50 con 0x7f37ec004810 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 0x7f38000ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f37fe59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 0x7f38000ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45452/0 (socket says 172.21.15.22:45452) 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.710+0000 7f37fe59c700 1 -- 172.21.15.22:0/2212071673 learned_addr learned my addr 172.21.15.22:0/2212071673 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:22.716 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fed9d700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec004810 0x7f380014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37ff59e700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f380009a540 0x7f380009a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fe59c700 1 -- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec004810 msgr2=0x7f380014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec004810 0x7f380014e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fe59c700 1 -- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f380009a540 msgr2=0x7f380009a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f380009a540 0x7f380009a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fe59c700 1 -- 172.21.15.22:0/2212071673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380009b2b0 con 0x7f38000c9ba0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37ff59e700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f380009a540 0x7f380009a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37fe59c700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 0x7f38000ca010 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f37e800e4b0 tx=0x7f37e8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8022070 con 0x7f38000c9ba0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e801c420 con 0x7f38000c9ba0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380009b590 con 0x7f38000c9ba0 2023-10-08T00:33:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e801c7e0 con 0x7f38000c9ba0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.711+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380014e810 con 0x7f38000c9ba0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.712+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800063c90 con 0x7f38000c9ba0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.712+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f37e801cbd0 con 0x7f38000c9ba0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.713+0000 7f37f6ffd700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37e0067320 0x7f37e00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.713+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37e8086510 con 0x7f38000c9ba0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.713+0000 7f37fed9d700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37e0067320 0x7f37e00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.714+0000 7f37fed9d700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37e0067320 0x7f37e00697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.717+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37e8053260 con 0x7f38000c9ba0 2023-10-08T00:33:22.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.989+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3800169cb0 con 0x7f38000c9ba0 2023-10-08T00:33:22.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.989+0000 7f37f6ffd700 1 -- 172.21.15.22:0/2212071673 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1439 (secure 0 0 0) 0x7f37e80175b0 con 0x7f38000c9ba0 2023-10-08T00:33:22.990 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:22.990 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":528,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1696724684,"num_in_osds":8,"osd_in_since":1696724677,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2487218176,"bytes_avail":770606895104,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":115,"id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"a","status":"up:active","gid":8271}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-08T00:33:06.499729+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T00:33:22.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.991+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37e0067320 msgr2=0x7f37e00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.991+0000 7f38050f4700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37e0067320 0x7f37e00697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f8009040 comp rx=0 tx=0).stop 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.991+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 msgr2=0x7f38000ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.991+0000 7f38050f4700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 0x7f38000ca010 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f37e800e4b0 tx=0x7f37e8019000 comp rx=0 tx=0).stop 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 shutdown_connections 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f380009a540 0x7f380009a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37e0067320 0x7f37e00697d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37ec004810 0x7f380014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 --2- 172.21.15.22:0/2212071673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38000c9ba0 0x7f38000ca010 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 >> 172.21.15.22:0/2212071673 conn(0x7f38000999f0 msgr2=0x7f38000c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:22.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 shutdown_connections 2023-10-08T00:33:22.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:22.992+0000 7f38050f4700 1 -- 172.21.15.22:0/2212071673 wait complete. 2023-10-08T00:33:23.004 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T00:33:23.005 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:23.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.123+0000 7f3d881a5700 1 Processor -- start 2023-10-08T00:33:23.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.123+0000 7f3d881a5700 1 -- start start 2023-10-08T00:33:23.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d881a5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d80159c10 0x7f3d8015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:23.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d881a5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8015c480 con 0x7f3d8015c910 2023-10-08T00:33:23.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d881a5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8015b5d0 con 0x7f3d800b5ea0 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d881a5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800b2a40 con 0x7f3d80159c10 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d86742700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3d8015c910 0x7f3d80159fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51654/0 (socket says 172.21.15.22:51654) 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d86742700 1 -- 172.21.15.22:0/1194913526 learned_addr learned my addr 172.21.15.22:0/1194913526 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.124+0000 7f3d85f41700 1 --2- 172.21.15.22:0/1194913526 >> v2:172.21.15.192:3300/0 conn(0x7f3d80159c10 0x7f3d8015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d84f3f700 1 -- 172.21.15.22:0/1194913526 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383203143 0 0) 0x7f3d8015c480 con 0x7f3d8015c910 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d84f3f700 1 -- 172.21.15.22:0/1194913526 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c003570 con 0x7f3d8015c910 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d85f41700 1 -- 172.21.15.22:0/1194913526 >> v1:172.21.15.192:6789/0 conn(0x7f3d800b5ea0 legacy=0x7f3d80068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d84f3f700 1 -- 172.21.15.22:0/1194913526 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441034186 0 0) 0x7f3d6c003570 con 0x7f3d8015c910 2023-10-08T00:33:23.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d85f41700 1 -- 172.21.15.22:0/1194913526 >> v1:172.21.15.22:6789/0 conn(0x7f3d8015c910 legacy=0x7f3d80159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d85f41700 1 -- 172.21.15.22:0/1194913526 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8015b870 con 0x7f3d80159c10 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d85f41700 1 --2- 172.21.15.22:0/1194913526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d80159c10 0x7f3d8015b090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009e60 tx=0x7f3d7c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970c104c55d64218 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d84f3f700 1 -- 172.21.15.22:0/1194913526 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00e070 con 0x7f3d80159c10 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d84f3f700 1 -- 172.21.15.22:0/1194913526 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00b850 con 0x7f3d80159c10 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.125+0000 7f3d84f3f700 1 -- 172.21.15.22:0/1194913526 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78001470 con 0x7f3d80159c10 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 -- 172.21.15.22:0/1194913526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d80159c10 msgr2=0x7f3d8015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 --2- 172.21.15.22:0/1194913526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d80159c10 0x7f3d8015b090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009e60 tx=0x7f3d7c009780 comp rx=0 tx=0).stop 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 -- 172.21.15.22:0/1194913526 shutdown_connections 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 --2- 172.21.15.22:0/1194913526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d80159c10 0x7f3d8015b090 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 -- 172.21.15.22:0/1194913526 >> 172.21.15.22:0/1194913526 conn(0x7f3d80099a20 msgr2=0x7f3d800af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 -- 172.21.15.22:0/1194913526 shutdown_connections 2023-10-08T00:33:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.126+0000 7f3d881a5700 1 -- 172.21.15.22:0/1194913526 wait complete. 2023-10-08T00:33:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.127+0000 7f3d881a5700 1 Processor -- start 2023-10-08T00:33:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.127+0000 7f3d881a5700 1 -- start start 2023-10-08T00:33:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d800b5ea0 0x7f3d800afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 0x7f3d800b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8015c910 0x7f3d8016d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8016abf0 con 0x7f3d80159c10 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8016ba50 con 0x7f3d8015c910 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800d12f0 con 0x7f3d800b5ea0 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 0x7f3d800b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 0x7f3d800b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45458/0 (socket says 172.21.15.22:45458) 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 -- 172.21.15.22:0/590131265 learned_addr learned my addr 172.21.15.22:0/590131265 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d86742700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8015c910 0x7f3d8016d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85f41700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d800b5ea0 0x7f3d800afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 -- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d800b5ea0 msgr2=0x7f3d800afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d800b5ea0 0x7f3d800afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 -- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8015c910 msgr2=0x7f3d8016d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8015c910 0x7f3d8016d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 -- 172.21.15.22:0/590131265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c009a20 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d85740700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 0x7f3d800b01c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c840 tx=0x7f3d70007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70011590 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70001e90 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8016ae40 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.128+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70011960 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.129+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8016b400 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.130+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80099f80 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.130+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3d70011d50 con 0x7f3d80159c10 2023-10-08T00:33:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.130+0000 7f3d75ffb700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d64067320 0x7f3d640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.130+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d700840d0 con 0x7f3d80159c10 2023-10-08T00:33:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.131+0000 7f3d85f41700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d64067320 0x7f3d640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.131+0000 7f3d85f41700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d64067320 0x7f3d640697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0099f0 tx=0x7f3d7c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:23.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.135+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d70050d60 con 0x7f3d80159c10 2023-10-08T00:33:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.325+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d8004c3c0 con 0x7f3d64067320 2023-10-08T00:33:23.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.334+0000 7f3d75ffb700 1 -- 172.21.15.22:0/590131265 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289661 (secure 0 0 0) 0x7f3d8004c3c0 con 0x7f3d64067320 2023-10-08T00:33:23.337 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:23.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d64067320 msgr2=0x7f3d640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d64067320 0x7f3d640697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0099f0 tx=0x7f3d7c017000 comp rx=0 tx=0).stop 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 msgr2=0x7f3d800b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 0x7f3d800b01c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c840 tx=0x7f3d70007f00 comp rx=0 tx=0).stop 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 shutdown_connections 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d8015c910 0x7f3d8016d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3d64067320 0x7f3d640697d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3d800b5ea0 0x7f3d800afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 --2- 172.21.15.22:0/590131265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d80159c10 0x7f3d800b01c0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 >> 172.21.15.22:0/590131265 conn(0x7f3d80099a20 msgr2=0x7f3d8009a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 shutdown_connections 2023-10-08T00:33:23.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:23.337+0000 7f3d881a5700 1 -- 172.21.15.22:0/590131265 wait complete. 2023-10-08T00:33:23.341 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:23.350 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":420,"stamp":"2023-10-08T00:33:22.503405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428924,"kb_used_data":17852,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752545796,"statfs":{"total":773094113280,"available":770606895104,"internally_reserved":0,"allocated":18280448,"data_stored":8812916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001560"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691504+0000","last_change":"2023-10-08T00:33:17.689883+0000","last_active":"2023-10-08T00:33:17.691504+0000","last_peered":"2023-10-08T00:33:17.691504+0000","last_clean":"2023-10-08T00:33:17.691504+0000","last_became_active":"2023-10-08T00:33:17.689094+0000","last_became_peered":"2023-10-08T00:33:17.689094+0000","last_unstale":"2023-10-08T00:33:17.691504+0000","last_undegraded":"2023-10-08T00:33:17.691504+0000","last_fullsized":"2023-10-08T00:33:17.691504+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:14.925683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689692+0000","last_change":"2023-10-08T00:33:17.680071+0000","last_active":"2023-10-08T00:33:17.689692+0000","last_peered":"2023-10-08T00:33:17.689692+0000","last_clean":"2023-10-08T00:33:17.689692+0000","last_became_active":"2023-10-08T00:33:17.677839+0000","last_became_peered":"2023-10-08T00:33:17.677839+0000","last_unstale":"2023-10-08T00:33:17.689692+0000","last_undegraded":"2023-10-08T00:33:17.689692+0000","last_fullsized":"2023-10-08T00:33:17.689692+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:28.026003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682856+0000","last_change":"2023-10-08T00:33:17.680962+0000","last_active":"2023-10-08T00:33:17.682856+0000","last_peered":"2023-10-08T00:33:17.682856+0000","last_clean":"2023-10-08T00:33:17.682856+0000","last_became_active":"2023-10-08T00:33:17.679859+0000","last_became_peered":"2023-10-08T00:33:17.679859+0000","last_unstale":"2023-10-08T00:33:17.682856+0000","last_undegraded":"2023-10-08T00:33:17.682856+0000","last_fullsized":"2023-10-08T00:33:17.682856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:08.647685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688099+0000","last_change":"2023-10-08T00:33:17.676703+0000","last_active":"2023-10-08T00:33:17.688099+0000","last_peered":"2023-10-08T00:33:17.688099+0000","last_clean":"2023-10-08T00:33:17.688099+0000","last_became_active":"2023-10-08T00:33:17.675422+0000","last_became_peered":"2023-10-08T00:33:17.675422+0000","last_unstale":"2023-10-08T00:33:17.688099+0000","last_undegraded":"2023-10-08T00:33:17.688099+0000","last_fullsized":"2023-10-08T00:33:17.688099+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:29.979110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688305+0000","last_change":"2023-10-08T00:33:17.683438+0000","last_active":"2023-10-08T00:33:17.688305+0000","last_peered":"2023-10-08T00:33:17.688305+0000","last_clean":"2023-10-08T00:33:17.688305+0000","last_became_active":"2023-10-08T00:33:17.683150+0000","last_became_peered":"2023-10-08T00:33:17.683150+0000","last_unstale":"2023-10-08T00:33:17.688305+0000","last_undegraded":"2023-10-08T00:33:17.688305+0000","last_fullsized":"2023-10-08T00:33:17.688305+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:56:57.285573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689924+0000","last_change":"2023-10-08T00:33:17.684991+0000","last_active":"2023-10-08T00:33:17.689924+0000","last_peered":"2023-10-08T00:33:17.689924+0000","last_clean":"2023-10-08T00:33:17.689924+0000","last_became_active":"2023-10-08T00:33:17.684755+0000","last_became_peered":"2023-10-08T00:33:17.684755+0000","last_unstale":"2023-10-08T00:33:17.689924+0000","last_undegraded":"2023-10-08T00:33:17.689924+0000","last_fullsized":"2023-10-08T00:33:17.689924+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:00.811215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.679362+0000","last_change":"2023-10-08T00:33:17.669921+0000","last_active":"2023-10-08T00:33:17.679362+0000","last_peered":"2023-10-08T00:33:17.679362+0000","last_clean":"2023-10-08T00:33:17.679362+0000","last_became_active":"2023-10-08T00:33:17.669184+0000","last_became_peered":"2023-10-08T00:33:17.669184+0000","last_unstale":"2023-10-08T00:33:17.679362+0000","last_undegraded":"2023-10-08T00:33:17.679362+0000","last_fullsized":"2023-10-08T00:33:17.679362+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:12.658371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683821+0000","last_change":"2023-10-08T00:33:17.677376+0000","last_active":"2023-10-08T00:33:17.683821+0000","last_peered":"2023-10-08T00:33:17.683821+0000","last_clean":"2023-10-08T00:33:17.683821+0000","last_became_active":"2023-10-08T00:33:17.677144+0000","last_became_peered":"2023-10-08T00:33:17.677144+0000","last_unstale":"2023-10-08T00:33:17.683821+0000","last_undegraded":"2023-10-08T00:33:17.683821+0000","last_fullsized":"2023-10-08T00:33:17.683821+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:37.619632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682698+0000","last_change":"2023-10-08T00:33:17.679622+0000","last_active":"2023-10-08T00:33:17.682698+0000","last_peered":"2023-10-08T00:33:17.682698+0000","last_clean":"2023-10-08T00:33:17.682698+0000","last_became_active":"2023-10-08T00:33:17.679306+0000","last_became_peered":"2023-10-08T00:33:17.679306+0000","last_unstale":"2023-10-08T00:33:17.682698+0000","last_undegraded":"2023-10-08T00:33:17.682698+0000","last_fullsized":"2023-10-08T00:33:17.682698+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:14:55.317487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684156+0000","last_change":"2023-10-08T00:33:17.681105+0000","last_active":"2023-10-08T00:33:17.684156+0000","last_peered":"2023-10-08T00:33:17.684156+0000","last_clean":"2023-10-08T00:33:17.684156+0000","last_became_active":"2023-10-08T00:33:17.680829+0000","last_became_peered":"2023-10-08T00:33:17.680829+0000","last_unstale":"2023-10-08T00:33:17.684156+0000","last_undegraded":"2023-10-08T00:33:17.684156+0000","last_fullsized":"2023-10-08T00:33:17.684156+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:22.843289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691515+0000","last_change":"2023-10-08T00:33:17.689873+0000","last_active":"2023-10-08T00:33:17.691515+0000","last_peered":"2023-10-08T00:33:17.691515+0000","last_clean":"2023-10-08T00:33:17.691515+0000","last_became_active":"2023-10-08T00:33:17.689235+0000","last_became_peered":"2023-10-08T00:33:17.689235+0000","last_unstale":"2023-10-08T00:33:17.691515+0000","last_undegraded":"2023-10-08T00:33:17.691515+0000","last_fullsized":"2023-10-08T00:33:17.691515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:01.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680810+0000","last_change":"2023-10-08T00:33:17.672059+0000","last_active":"2023-10-08T00:33:17.680810+0000","last_peered":"2023-10-08T00:33:17.680810+0000","last_clean":"2023-10-08T00:33:17.680810+0000","last_became_active":"2023-10-08T00:33:17.671080+0000","last_became_peered":"2023-10-08T00:33:17.671080+0000","last_unstale":"2023-10-08T00:33:17.680810+0000","last_undegraded":"2023-10-08T00:33:17.680810+0000","last_fullsized":"2023-10-08T00:33:17.680810+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:29:15.679380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690624+0000","last_change":"2023-10-08T00:33:17.685379+0000","last_active":"2023-10-08T00:33:17.690624+0000","last_peered":"2023-10-08T00:33:17.690624+0000","last_clean":"2023-10-08T00:33:17.690624+0000","last_became_active":"2023-10-08T00:33:17.685101+0000","last_became_peered":"2023-10-08T00:33:17.685101+0000","last_unstale":"2023-10-08T00:33:17.690624+0000","last_undegraded":"2023-10-08T00:33:17.690624+0000","last_fullsized":"2023-10-08T00:33:17.690624+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:57.391741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691101+0000","last_change":"2023-10-08T00:33:17.688144+0000","last_active":"2023-10-08T00:33:17.691101+0000","last_peered":"2023-10-08T00:33:17.691101+0000","last_clean":"2023-10-08T00:33:17.691101+0000","last_became_active":"2023-10-08T00:33:17.687090+0000","last_became_peered":"2023-10-08T00:33:17.687090+0000","last_unstale":"2023-10-08T00:33:17.691101+0000","last_undegraded":"2023-10-08T00:33:17.691101+0000","last_fullsized":"2023-10-08T00:33:17.691101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:54.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.679612+0000","last_change":"2023-10-08T00:33:17.675041+0000","last_active":"2023-10-08T00:33:17.679612+0000","last_peered":"2023-10-08T00:33:17.679612+0000","last_clean":"2023-10-08T00:33:17.679612+0000","last_became_active":"2023-10-08T00:33:17.674773+0000","last_became_peered":"2023-10-08T00:33:17.674773+0000","last_unstale":"2023-10-08T00:33:17.679612+0000","last_undegraded":"2023-10-08T00:33:17.679612+0000","last_fullsized":"2023-10-08T00:33:17.679612+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:10.252341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684044+0000","last_change":"2023-10-08T00:33:17.672541+0000","last_active":"2023-10-08T00:33:17.684044+0000","last_peered":"2023-10-08T00:33:17.684044+0000","last_clean":"2023-10-08T00:33:17.684044+0000","last_became_active":"2023-10-08T00:33:17.672154+0000","last_became_peered":"2023-10-08T00:33:17.672154+0000","last_unstale":"2023-10-08T00:33:17.684044+0000","last_undegraded":"2023-10-08T00:33:17.684044+0000","last_fullsized":"2023-10-08T00:33:17.684044+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:20.601784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691038+0000","last_change":"2023-10-08T00:33:17.687735+0000","last_active":"2023-10-08T00:33:17.691038+0000","last_peered":"2023-10-08T00:33:17.691038+0000","last_clean":"2023-10-08T00:33:17.691038+0000","last_became_active":"2023-10-08T00:33:17.686916+0000","last_became_peered":"2023-10-08T00:33:17.686916+0000","last_unstale":"2023-10-08T00:33:17.691038+0000","last_undegraded":"2023-10-08T00:33:17.691038+0000","last_fullsized":"2023-10-08T00:33:17.691038+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:06.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684174+0000","last_change":"2023-10-08T00:33:17.682168+0000","last_active":"2023-10-08T00:33:17.684174+0000","last_peered":"2023-10-08T00:33:17.684174+0000","last_clean":"2023-10-08T00:33:17.684174+0000","last_became_active":"2023-10-08T00:33:17.681885+0000","last_became_peered":"2023-10-08T00:33:17.681885+0000","last_unstale":"2023-10-08T00:33:17.684174+0000","last_undegraded":"2023-10-08T00:33:17.684174+0000","last_fullsized":"2023-10-08T00:33:17.684174+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:01.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688694+0000","last_change":"2023-10-08T00:33:17.684367+0000","last_active":"2023-10-08T00:33:17.688694+0000","last_peered":"2023-10-08T00:33:17.688694+0000","last_clean":"2023-10-08T00:33:17.688694+0000","last_became_active":"2023-10-08T00:33:17.683988+0000","last_became_peered":"2023-10-08T00:33:17.683988+0000","last_unstale":"2023-10-08T00:33:17.688694+0000","last_undegraded":"2023-10-08T00:33:17.688694+0000","last_fullsized":"2023-10-08T00:33:17.688694+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:46.166271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675916+0000","last_change":"2023-10-08T00:33:17.674925+0000","last_active":"2023-10-08T00:33:17.675916+0000","last_peered":"2023-10-08T00:33:17.675916+0000","last_clean":"2023-10-08T00:33:17.675916+0000","last_became_active":"2023-10-08T00:33:17.674638+0000","last_became_peered":"2023-10-08T00:33:17.674638+0000","last_unstale":"2023-10-08T00:33:17.675916+0000","last_undegraded":"2023-10-08T00:33:17.675916+0000","last_fullsized":"2023-10-08T00:33:17.675916+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:22.687959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688270+0000","last_change":"2023-10-08T00:33:17.677629+0000","last_active":"2023-10-08T00:33:17.688270+0000","last_peered":"2023-10-08T00:33:17.688270+0000","last_clean":"2023-10-08T00:33:17.688270+0000","last_became_active":"2023-10-08T00:33:17.675993+0000","last_became_peered":"2023-10-08T00:33:17.675993+0000","last_unstale":"2023-10-08T00:33:17.688270+0000","last_undegraded":"2023-10-08T00:33:17.688270+0000","last_fullsized":"2023-10-08T00:33:17.688270+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:31.380659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686701+0000","last_change":"2023-10-08T00:33:17.684258+0000","last_active":"2023-10-08T00:33:17.686701+0000","last_peered":"2023-10-08T00:33:17.686701+0000","last_clean":"2023-10-08T00:33:17.686701+0000","last_became_active":"2023-10-08T00:33:17.683995+0000","last_became_peered":"2023-10-08T00:33:17.683995+0000","last_unstale":"2023-10-08T00:33:17.686701+0000","last_undegraded":"2023-10-08T00:33:17.686701+0000","last_fullsized":"2023-10-08T00:33:17.686701+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:54:12.456416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690020+0000","last_change":"2023-10-08T00:33:17.683735+0000","last_active":"2023-10-08T00:33:17.690020+0000","last_peered":"2023-10-08T00:33:17.690020+0000","last_clean":"2023-10-08T00:33:17.690020+0000","last_became_active":"2023-10-08T00:33:17.682805+0000","last_became_peered":"2023-10-08T00:33:17.682805+0000","last_unstale":"2023-10-08T00:33:17.690020+0000","last_undegraded":"2023-10-08T00:33:17.690020+0000","last_fullsized":"2023-10-08T00:33:17.690020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:59:29.841763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688104+0000","last_change":"2023-10-08T00:33:17.682514+0000","last_active":"2023-10-08T00:33:17.688104+0000","last_peered":"2023-10-08T00:33:17.688104+0000","last_clean":"2023-10-08T00:33:17.688104+0000","last_became_active":"2023-10-08T00:33:17.682212+0000","last_became_peered":"2023-10-08T00:33:17.682212+0000","last_unstale":"2023-10-08T00:33:17.688104+0000","last_undegraded":"2023-10-08T00:33:17.688104+0000","last_fullsized":"2023-10-08T00:33:17.688104+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:07:41.352833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691527+0000","last_change":"2023-10-08T00:33:17.689923+0000","last_active":"2023-10-08T00:33:17.691527+0000","last_peered":"2023-10-08T00:33:17.691527+0000","last_clean":"2023-10-08T00:33:17.691527+0000","last_became_active":"2023-10-08T00:33:17.689378+0000","last_became_peered":"2023-10-08T00:33:17.689378+0000","last_unstale":"2023-10-08T00:33:17.691527+0000","last_undegraded":"2023-10-08T00:33:17.691527+0000","last_fullsized":"2023-10-08T00:33:17.691527+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:22.687959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688445+0000","last_change":"2023-10-08T00:33:17.686788+0000","last_active":"2023-10-08T00:33:17.688445+0000","last_peered":"2023-10-08T00:33:17.688445+0000","last_clean":"2023-10-08T00:33:17.688445+0000","last_became_active":"2023-10-08T00:33:17.686496+0000","last_became_peered":"2023-10-08T00:33:17.686496+0000","last_unstale":"2023-10-08T00:33:17.688445+0000","last_undegraded":"2023-10-08T00:33:17.688445+0000","last_fullsized":"2023-10-08T00:33:17.688445+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:54.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691551+0000","last_change":"2023-10-08T00:33:17.690007+0000","last_active":"2023-10-08T00:33:17.691551+0000","last_peered":"2023-10-08T00:33:17.691551+0000","last_clean":"2023-10-08T00:33:17.691551+0000","last_became_active":"2023-10-08T00:33:17.689617+0000","last_became_peered":"2023-10-08T00:33:17.689617+0000","last_unstale":"2023-10-08T00:33:17.691551+0000","last_undegraded":"2023-10-08T00:33:17.691551+0000","last_fullsized":"2023-10-08T00:33:17.691551+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:22.843289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691913+0000","last_change":"2023-10-08T00:33:17.689146+0000","last_active":"2023-10-08T00:33:17.691913+0000","last_peered":"2023-10-08T00:33:17.691913+0000","last_clean":"2023-10-08T00:33:17.691913+0000","last_became_active":"2023-10-08T00:33:17.688831+0000","last_became_peered":"2023-10-08T00:33:17.688831+0000","last_unstale":"2023-10-08T00:33:17.691913+0000","last_undegraded":"2023-10-08T00:33:17.691913+0000","last_fullsized":"2023-10-08T00:33:17.691913+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688488+0000","last_change":"2023-10-08T00:33:17.683466+0000","last_active":"2023-10-08T00:33:17.688488+0000","last_peered":"2023-10-08T00:33:17.688488+0000","last_clean":"2023-10-08T00:33:17.688488+0000","last_became_active":"2023-10-08T00:33:17.683125+0000","last_became_peered":"2023-10-08T00:33:17.683125+0000","last_unstale":"2023-10-08T00:33:17.688488+0000","last_undegraded":"2023-10-08T00:33:17.688488+0000","last_fullsized":"2023-10-08T00:33:17.688488+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:06.492806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689679+0000","last_change":"2023-10-08T00:33:17.683523+0000","last_active":"2023-10-08T00:33:17.689679+0000","last_peered":"2023-10-08T00:33:17.689679+0000","last_clean":"2023-10-08T00:33:17.689679+0000","last_became_active":"2023-10-08T00:33:17.682734+0000","last_became_peered":"2023-10-08T00:33:17.682734+0000","last_unstale":"2023-10-08T00:33:17.689679+0000","last_undegraded":"2023-10-08T00:33:17.689679+0000","last_fullsized":"2023-10-08T00:33:17.689679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688723+0000","last_change":"2023-10-08T00:33:17.684566+0000","last_active":"2023-10-08T00:33:17.688723+0000","last_peered":"2023-10-08T00:33:17.688723+0000","last_clean":"2023-10-08T00:33:17.688723+0000","last_became_active":"2023-10-08T00:33:17.683575+0000","last_became_peered":"2023-10-08T00:33:17.683575+0000","last_unstale":"2023-10-08T00:33:17.688723+0000","last_undegraded":"2023-10-08T00:33:17.688723+0000","last_fullsized":"2023-10-08T00:33:17.688723+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:38:36.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.674349+0000","last_change":"2023-10-08T00:33:17.672690+0000","last_active":"2023-10-08T00:33:17.674349+0000","last_peered":"2023-10-08T00:33:17.674349+0000","last_clean":"2023-10-08T00:33:17.674349+0000","last_became_active":"2023-10-08T00:33:17.672421+0000","last_became_peered":"2023-10-08T00:33:17.672421+0000","last_unstale":"2023-10-08T00:33:17.674349+0000","last_undegraded":"2023-10-08T00:33:17.674349+0000","last_fullsized":"2023-10-08T00:33:17.674349+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:00.947530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682536+0000","last_change":"2023-10-08T00:33:17.677430+0000","last_active":"2023-10-08T00:33:17.682536+0000","last_peered":"2023-10-08T00:33:17.682536+0000","last_clean":"2023-10-08T00:33:17.682536+0000","last_became_active":"2023-10-08T00:33:17.677102+0000","last_became_peered":"2023-10-08T00:33:17.677102+0000","last_unstale":"2023-10-08T00:33:17.682536+0000","last_undegraded":"2023-10-08T00:33:17.682536+0000","last_fullsized":"2023-10-08T00:33:17.682536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:41.188203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690753+0000","last_change":"2023-10-08T00:33:16.671414+0000","last_active":"2023-10-08T00:33:17.690753+0000","last_peered":"2023-10-08T00:33:17.690753+0000","last_clean":"2023-10-08T00:33:17.690753+0000","last_became_active":"2023-10-08T00:33:16.671105+0000","last_became_peered":"2023-10-08T00:33:16.671105+0000","last_unstale":"2023-10-08T00:33:17.690753+0000","last_undegraded":"2023-10-08T00:33:17.690753+0000","last_fullsized":"2023-10-08T00:33:17.690753+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:18.885960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680904+0000","last_change":"2023-10-08T00:33:17.677588+0000","last_active":"2023-10-08T00:33:17.680904+0000","last_peered":"2023-10-08T00:33:17.680904+0000","last_clean":"2023-10-08T00:33:17.680904+0000","last_became_active":"2023-10-08T00:33:17.677306+0000","last_became_peered":"2023-10-08T00:33:17.677306+0000","last_unstale":"2023-10-08T00:33:17.680904+0000","last_undegraded":"2023-10-08T00:33:17.680904+0000","last_fullsized":"2023-10-08T00:33:17.680904+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:06.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686672+0000","last_change":"2023-10-08T00:33:16.667720+0000","last_active":"2023-10-08T00:33:17.686672+0000","last_peered":"2023-10-08T00:33:17.686672+0000","last_clean":"2023-10-08T00:33:17.686672+0000","last_became_active":"2023-10-08T00:33:16.667472+0000","last_became_peered":"2023-10-08T00:33:16.667472+0000","last_unstale":"2023-10-08T00:33:17.686672+0000","last_undegraded":"2023-10-08T00:33:17.686672+0000","last_fullsized":"2023-10-08T00:33:17.686672+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:05.490580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685964+0000","last_change":"2023-10-08T00:33:17.682010+0000","last_active":"2023-10-08T00:33:17.685964+0000","last_peered":"2023-10-08T00:33:17.685964+0000","last_clean":"2023-10-08T00:33:17.685964+0000","last_became_active":"2023-10-08T00:33:17.681756+0000","last_became_peered":"2023-10-08T00:33:17.681756+0000","last_unstale":"2023-10-08T00:33:17.685964+0000","last_undegraded":"2023-10-08T00:33:17.685964+0000","last_fullsized":"2023-10-08T00:33:17.685964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:17.151201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680871+0000","last_change":"2023-10-08T00:33:16.675539+0000","last_active":"2023-10-08T00:33:17.680871+0000","last_peered":"2023-10-08T00:33:17.680871+0000","last_clean":"2023-10-08T00:33:17.680871+0000","last_became_active":"2023-10-08T00:33:16.675264+0000","last_became_peered":"2023-10-08T00:33:16.675264+0000","last_unstale":"2023-10-08T00:33:17.680871+0000","last_undegraded":"2023-10-08T00:33:17.680871+0000","last_fullsized":"2023-10-08T00:33:17.680871+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:01.600042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689702+0000","last_change":"2023-10-08T00:33:17.683625+0000","last_active":"2023-10-08T00:33:17.689702+0000","last_peered":"2023-10-08T00:33:17.689702+0000","last_clean":"2023-10-08T00:33:17.689702+0000","last_became_active":"2023-10-08T00:33:17.683086+0000","last_became_peered":"2023-10-08T00:33:17.683086+0000","last_unstale":"2023-10-08T00:33:17.689702+0000","last_undegraded":"2023-10-08T00:33:17.689702+0000","last_fullsized":"2023-10-08T00:33:17.689702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:46.166271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680215+0000","last_change":"2023-10-08T00:33:16.671190+0000","last_active":"2023-10-08T00:33:17.680215+0000","last_peered":"2023-10-08T00:33:17.680215+0000","last_clean":"2023-10-08T00:33:17.680215+0000","last_became_active":"2023-10-08T00:33:16.670924+0000","last_became_peered":"2023-10-08T00:33:16.670924+0000","last_unstale":"2023-10-08T00:33:17.680215+0000","last_undegraded":"2023-10-08T00:33:17.680215+0000","last_fullsized":"2023-10-08T00:33:17.680215+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:42.536494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688289+0000","last_change":"2023-10-08T00:33:17.678044+0000","last_active":"2023-10-08T00:33:17.688289+0000","last_peered":"2023-10-08T00:33:17.688289+0000","last_clean":"2023-10-08T00:33:17.688289+0000","last_became_active":"2023-10-08T00:33:17.673937+0000","last_became_peered":"2023-10-08T00:33:17.673937+0000","last_unstale":"2023-10-08T00:33:17.688289+0000","last_undegraded":"2023-10-08T00:33:17.688289+0000","last_fullsized":"2023-10-08T00:33:17.688289+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:32.749671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683486+0000","last_change":"2023-10-08T00:33:16.678384+0000","last_active":"2023-10-08T00:33:17.683486+0000","last_peered":"2023-10-08T00:33:17.683486+0000","last_clean":"2023-10-08T00:33:17.683486+0000","last_became_active":"2023-10-08T00:33:16.677792+0000","last_became_peered":"2023-10-08T00:33:16.677792+0000","last_unstale":"2023-10-08T00:33:17.683486+0000","last_undegraded":"2023-10-08T00:33:17.683486+0000","last_fullsized":"2023-10-08T00:33:17.683486+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:36.617406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691840+0000","last_change":"2023-10-08T00:33:17.689142+0000","last_active":"2023-10-08T00:33:17.691840+0000","last_peered":"2023-10-08T00:33:17.691840+0000","last_clean":"2023-10-08T00:33:17.691840+0000","last_became_active":"2023-10-08T00:33:17.688805+0000","last_became_peered":"2023-10-08T00:33:17.688805+0000","last_unstale":"2023-10-08T00:33:17.691840+0000","last_undegraded":"2023-10-08T00:33:17.691840+0000","last_fullsized":"2023-10-08T00:33:17.691840+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:14.925683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675312+0000","last_change":"2023-10-08T00:33:16.681608+0000","last_active":"2023-10-08T00:33:17.675312+0000","last_peered":"2023-10-08T00:33:17.675312+0000","last_clean":"2023-10-08T00:33:17.675312+0000","last_became_active":"2023-10-08T00:33:16.681336+0000","last_became_peered":"2023-10-08T00:33:16.681336+0000","last_unstale":"2023-10-08T00:33:17.675312+0000","last_undegraded":"2023-10-08T00:33:17.675312+0000","last_fullsized":"2023-10-08T00:33:17.675312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:40:59.446556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.681271+0000","last_change":"2023-10-08T00:33:17.677626+0000","last_active":"2023-10-08T00:33:17.681271+0000","last_peered":"2023-10-08T00:33:17.681271+0000","last_clean":"2023-10-08T00:33:17.681271+0000","last_became_active":"2023-10-08T00:33:17.677383+0000","last_became_peered":"2023-10-08T00:33:17.677383+0000","last_unstale":"2023-10-08T00:33:17.681271+0000","last_undegraded":"2023-10-08T00:33:17.681271+0000","last_fullsized":"2023-10-08T00:33:17.681271+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:12.658371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.670493+0000","last_change":"2023-10-08T00:33:16.678082+0000","last_active":"2023-10-08T00:33:17.670493+0000","last_peered":"2023-10-08T00:33:17.670493+0000","last_clean":"2023-10-08T00:33:17.670493+0000","last_became_active":"2023-10-08T00:33:16.677816+0000","last_became_peered":"2023-10-08T00:33:16.677816+0000","last_unstale":"2023-10-08T00:33:17.670493+0000","last_undegraded":"2023-10-08T00:33:17.670493+0000","last_fullsized":"2023-10-08T00:33:17.670493+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:39.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691011+0000","last_change":"2023-10-08T00:33:17.685894+0000","last_active":"2023-10-08T00:33:17.691011+0000","last_peered":"2023-10-08T00:33:17.691011+0000","last_clean":"2023-10-08T00:33:17.691011+0000","last_became_active":"2023-10-08T00:33:17.678197+0000","last_became_peered":"2023-10-08T00:33:17.678197+0000","last_unstale":"2023-10-08T00:33:17.691011+0000","last_undegraded":"2023-10-08T00:33:17.691011+0000","last_fullsized":"2023-10-08T00:33:17.691011+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:57.013505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.674747+0000","last_change":"2023-10-08T00:33:16.682010+0000","last_active":"2023-10-08T00:33:17.674747+0000","last_peered":"2023-10-08T00:33:17.674747+0000","last_clean":"2023-10-08T00:33:17.674747+0000","last_became_active":"2023-10-08T00:33:16.681754+0000","last_became_peered":"2023-10-08T00:33:16.681754+0000","last_unstale":"2023-10-08T00:33:17.674747+0000","last_undegraded":"2023-10-08T00:33:17.674747+0000","last_fullsized":"2023-10-08T00:33:17.674747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:16.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689806+0000","last_change":"2023-10-08T00:33:17.682805+0000","last_active":"2023-10-08T00:33:17.689806+0000","last_peered":"2023-10-08T00:33:17.689806+0000","last_clean":"2023-10-08T00:33:17.689806+0000","last_became_active":"2023-10-08T00:33:17.682405+0000","last_became_peered":"2023-10-08T00:33:17.682405+0000","last_unstale":"2023-10-08T00:33:17.689806+0000","last_undegraded":"2023-10-08T00:33:17.689806+0000","last_fullsized":"2023-10-08T00:33:17.689806+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:32:25.531675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.664500+0000","last_change":"2023-10-08T00:33:16.667362+0000","last_active":"2023-10-08T00:33:17.664500+0000","last_peered":"2023-10-08T00:33:17.664500+0000","last_clean":"2023-10-08T00:33:17.664500+0000","last_became_active":"2023-10-08T00:33:16.667122+0000","last_became_peered":"2023-10-08T00:33:16.667122+0000","last_unstale":"2023-10-08T00:33:17.664500+0000","last_undegraded":"2023-10-08T00:33:17.664500+0000","last_fullsized":"2023-10-08T00:33:17.664500+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:26:25.262420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686555+0000","last_change":"2023-10-08T00:33:17.683644+0000","last_active":"2023-10-08T00:33:17.686555+0000","last_peered":"2023-10-08T00:33:17.686555+0000","last_clean":"2023-10-08T00:33:17.686555+0000","last_became_active":"2023-10-08T00:33:17.683378+0000","last_became_peered":"2023-10-08T00:33:17.683378+0000","last_unstale":"2023-10-08T00:33:17.686555+0000","last_undegraded":"2023-10-08T00:33:17.686555+0000","last_fullsized":"2023-10-08T00:33:17.686555+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:02.602268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688074+0000","last_change":"2023-10-08T00:33:16.674348+0000","last_active":"2023-10-08T00:33:17.688074+0000","last_peered":"2023-10-08T00:33:17.688074+0000","last_clean":"2023-10-08T00:33:17.688074+0000","last_became_active":"2023-10-08T00:33:16.672802+0000","last_became_peered":"2023-10-08T00:33:16.672802+0000","last_unstale":"2023-10-08T00:33:17.688074+0000","last_undegraded":"2023-10-08T00:33:17.688074+0000","last_fullsized":"2023-10-08T00:33:17.688074+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:03.777515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691585+0000","last_change":"2023-10-08T00:33:17.690850+0000","last_active":"2023-10-08T00:33:17.691585+0000","last_peered":"2023-10-08T00:33:17.691585+0000","last_clean":"2023-10-08T00:33:17.691585+0000","last_became_active":"2023-10-08T00:33:17.690558+0000","last_became_peered":"2023-10-08T00:33:17.690558+0000","last_unstale":"2023-10-08T00:33:17.691585+0000","last_undegraded":"2023-10-08T00:33:17.691585+0000","last_fullsized":"2023-10-08T00:33:17.691585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:41.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.692628+0000","last_change":"2023-10-08T00:33:16.672895+0000","last_active":"2023-10-08T00:33:17.692628+0000","last_peered":"2023-10-08T00:33:17.692628+0000","last_clean":"2023-10-08T00:33:17.692628+0000","last_became_active":"2023-10-08T00:33:16.672627+0000","last_became_peered":"2023-10-08T00:33:16.672627+0000","last_unstale":"2023-10-08T00:33:17.692628+0000","last_undegraded":"2023-10-08T00:33:17.692628+0000","last_fullsized":"2023-10-08T00:33:17.692628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:28.976885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.669358+0000","last_change":"2023-10-08T00:33:17.668284+0000","last_active":"2023-10-08T00:33:17.669358+0000","last_peered":"2023-10-08T00:33:17.669358+0000","last_clean":"2023-10-08T00:33:17.669358+0000","last_became_active":"2023-10-08T00:33:17.667949+0000","last_became_peered":"2023-10-08T00:33:17.667949+0000","last_unstale":"2023-10-08T00:33:17.669358+0000","last_undegraded":"2023-10-08T00:33:17.669358+0000","last_fullsized":"2023-10-08T00:33:17.669358+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:47.620740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683794+0000","last_change":"2023-10-08T00:33:16.678953+0000","last_active":"2023-10-08T00:33:17.683794+0000","last_peered":"2023-10-08T00:33:17.683794+0000","last_clean":"2023-10-08T00:33:17.683794+0000","last_became_active":"2023-10-08T00:33:16.678682+0000","last_became_peered":"2023-10-08T00:33:16.678682+0000","last_unstale":"2023-10-08T00:33:17.683794+0000","last_undegraded":"2023-10-08T00:33:17.683794+0000","last_fullsized":"2023-10-08T00:33:17.683794+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:40:59.446556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690483+0000","last_change":"2023-10-08T00:33:17.684851+0000","last_active":"2023-10-08T00:33:17.690483+0000","last_peered":"2023-10-08T00:33:17.690483+0000","last_clean":"2023-10-08T00:33:17.690483+0000","last_became_active":"2023-10-08T00:33:17.684469+0000","last_became_peered":"2023-10-08T00:33:17.684469+0000","last_unstale":"2023-10-08T00:33:17.690483+0000","last_undegraded":"2023-10-08T00:33:17.690483+0000","last_fullsized":"2023-10-08T00:33:17.690483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:57.391741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.665383+0000","last_change":"2023-10-08T00:33:16.681291+0000","last_active":"2023-10-08T00:33:17.665383+0000","last_peered":"2023-10-08T00:33:17.665383+0000","last_clean":"2023-10-08T00:33:17.665383+0000","last_became_active":"2023-10-08T00:33:16.681050+0000","last_became_peered":"2023-10-08T00:33:16.681050+0000","last_unstale":"2023-10-08T00:33:17.665383+0000","last_undegraded":"2023-10-08T00:33:17.665383+0000","last_fullsized":"2023-10-08T00:33:17.665383+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:07.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690533+0000","last_change":"2023-10-08T00:33:17.685946+0000","last_active":"2023-10-08T00:33:17.690533+0000","last_peered":"2023-10-08T00:33:17.690533+0000","last_clean":"2023-10-08T00:33:17.690533+0000","last_became_active":"2023-10-08T00:33:17.685042+0000","last_became_peered":"2023-10-08T00:33:17.685042+0000","last_unstale":"2023-10-08T00:33:17.690533+0000","last_undegraded":"2023-10-08T00:33:17.690533+0000","last_fullsized":"2023-10-08T00:33:17.690533+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:34.912510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.662146+0000","last_change":"2023-10-08T00:33:16.669190+0000","last_active":"2023-10-08T00:33:17.662146+0000","last_peered":"2023-10-08T00:33:17.662146+0000","last_clean":"2023-10-08T00:33:17.662146+0000","last_became_active":"2023-10-08T00:33:16.668937+0000","last_became_peered":"2023-10-08T00:33:16.668937+0000","last_unstale":"2023-10-08T00:33:17.662146+0000","last_undegraded":"2023-10-08T00:33:17.662146+0000","last_fullsized":"2023-10-08T00:33:17.662146+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:16:00.733995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686887+0000","last_change":"2023-10-08T00:33:17.682612+0000","last_active":"2023-10-08T00:33:17.686887+0000","last_peered":"2023-10-08T00:33:17.686887+0000","last_clean":"2023-10-08T00:33:17.686887+0000","last_became_active":"2023-10-08T00:33:17.681452+0000","last_became_peered":"2023-10-08T00:33:17.681452+0000","last_unstale":"2023-10-08T00:33:17.686887+0000","last_undegraded":"2023-10-08T00:33:17.686887+0000","last_fullsized":"2023-10-08T00:33:17.686887+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:18:58.137532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687932+0000","last_change":"2023-10-08T00:33:16.676094+0000","last_active":"2023-10-08T00:33:17.687932+0000","last_peered":"2023-10-08T00:33:17.687932+0000","last_clean":"2023-10-08T00:33:17.687932+0000","last_became_active":"2023-10-08T00:33:16.675736+0000","last_became_peered":"2023-10-08T00:33:16.675736+0000","last_unstale":"2023-10-08T00:33:17.687932+0000","last_undegraded":"2023-10-08T00:33:17.687932+0000","last_fullsized":"2023-10-08T00:33:17.687932+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:16.148975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682760+0000","last_change":"2023-10-08T00:33:17.677973+0000","last_active":"2023-10-08T00:33:17.682760+0000","last_peered":"2023-10-08T00:33:17.682760+0000","last_clean":"2023-10-08T00:33:17.682760+0000","last_became_active":"2023-10-08T00:33:17.677662+0000","last_became_peered":"2023-10-08T00:33:17.677662+0000","last_unstale":"2023-10-08T00:33:17.682760+0000","last_undegraded":"2023-10-08T00:33:17.682760+0000","last_fullsized":"2023-10-08T00:33:17.682760+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:13:18.060729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688745+0000","last_change":"2023-10-08T00:33:16.679329+0000","last_active":"2023-10-08T00:33:17.688745+0000","last_peered":"2023-10-08T00:33:17.688745+0000","last_clean":"2023-10-08T00:33:17.688745+0000","last_became_active":"2023-10-08T00:33:16.679030+0000","last_became_peered":"2023-10-08T00:33:16.679030+0000","last_unstale":"2023-10-08T00:33:17.688745+0000","last_undegraded":"2023-10-08T00:33:17.688745+0000","last_fullsized":"2023-10-08T00:33:17.688745+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:10.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691865+0000","last_change":"2023-10-08T00:33:17.689238+0000","last_active":"2023-10-08T00:33:17.691865+0000","last_peered":"2023-10-08T00:33:17.691865+0000","last_clean":"2023-10-08T00:33:17.691865+0000","last_became_active":"2023-10-08T00:33:17.689020+0000","last_became_peered":"2023-10-08T00:33:17.689020+0000","last_unstale":"2023-10-08T00:33:17.691865+0000","last_undegraded":"2023-10-08T00:33:17.691865+0000","last_fullsized":"2023-10-08T00:33:17.691865+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:41.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.678172+0000","last_change":"2023-10-08T00:33:16.673947+0000","last_active":"2023-10-08T00:33:17.678172+0000","last_peered":"2023-10-08T00:33:17.678172+0000","last_clean":"2023-10-08T00:33:17.678172+0000","last_became_active":"2023-10-08T00:33:16.673672+0000","last_became_peered":"2023-10-08T00:33:16.673672+0000","last_unstale":"2023-10-08T00:33:17.678172+0000","last_undegraded":"2023-10-08T00:33:17.678172+0000","last_fullsized":"2023-10-08T00:33:17.678172+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:52.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690494+0000","last_change":"2023-10-08T00:33:17.685663+0000","last_active":"2023-10-08T00:33:17.690494+0000","last_peered":"2023-10-08T00:33:17.690494+0000","last_clean":"2023-10-08T00:33:17.690494+0000","last_became_active":"2023-10-08T00:33:17.685410+0000","last_became_peered":"2023-10-08T00:33:17.685410+0000","last_unstale":"2023-10-08T00:33:17.690494+0000","last_undegraded":"2023-10-08T00:33:17.690494+0000","last_fullsized":"2023-10-08T00:33:17.690494+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:53.870890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685146+0000","last_change":"2023-10-08T00:33:16.677055+0000","last_active":"2023-10-08T00:33:17.685146+0000","last_peered":"2023-10-08T00:33:17.685146+0000","last_clean":"2023-10-08T00:33:17.685146+0000","last_became_active":"2023-10-08T00:33:16.676618+0000","last_became_peered":"2023-10-08T00:33:16.676618+0000","last_unstale":"2023-10-08T00:33:17.685146+0000","last_undegraded":"2023-10-08T00:33:17.685146+0000","last_fullsized":"2023-10-08T00:33:17.685146+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:11:40.540117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690594+0000","last_change":"2023-10-08T00:33:17.686506+0000","last_active":"2023-10-08T00:33:17.690594+0000","last_peered":"2023-10-08T00:33:17.690594+0000","last_clean":"2023-10-08T00:33:17.690594+0000","last_became_active":"2023-10-08T00:33:17.686177+0000","last_became_peered":"2023-10-08T00:33:17.686177+0000","last_unstale":"2023-10-08T00:33:17.690594+0000","last_undegraded":"2023-10-08T00:33:17.690594+0000","last_fullsized":"2023-10-08T00:33:17.690594+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:05.532998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.671015+0000","last_change":"2023-10-08T00:33:16.677685+0000","last_active":"2023-10-08T00:33:17.671015+0000","last_peered":"2023-10-08T00:33:17.671015+0000","last_clean":"2023-10-08T00:33:17.671015+0000","last_became_active":"2023-10-08T00:33:16.677356+0000","last_became_peered":"2023-10-08T00:33:16.677356+0000","last_unstale":"2023-10-08T00:33:17.671015+0000","last_undegraded":"2023-10-08T00:33:17.671015+0000","last_fullsized":"2023-10-08T00:33:17.671015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:31.747445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688065+0000","last_change":"2023-10-08T00:33:17.683944+0000","last_active":"2023-10-08T00:33:17.688065+0000","last_peered":"2023-10-08T00:33:17.688065+0000","last_clean":"2023-10-08T00:33:17.688065+0000","last_became_active":"2023-10-08T00:33:17.683617+0000","last_became_peered":"2023-10-08T00:33:17.683617+0000","last_unstale":"2023-10-08T00:33:17.688065+0000","last_undegraded":"2023-10-08T00:33:17.688065+0000","last_fullsized":"2023-10-08T00:33:17.688065+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:22.343092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689109+0000","last_change":"2023-10-08T00:33:16.680031+0000","last_active":"2023-10-08T00:33:17.689109+0000","last_peered":"2023-10-08T00:33:17.689109+0000","last_clean":"2023-10-08T00:33:17.689109+0000","last_became_active":"2023-10-08T00:33:16.679712+0000","last_became_peered":"2023-10-08T00:33:16.679712+0000","last_unstale":"2023-10-08T00:33:17.689109+0000","last_undegraded":"2023-10-08T00:33:17.689109+0000","last_fullsized":"2023-10-08T00:33:17.689109+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:54.304217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682744+0000","last_change":"2023-10-08T00:33:17.679086+0000","last_active":"2023-10-08T00:33:17.682744+0000","last_peered":"2023-10-08T00:33:17.682744+0000","last_clean":"2023-10-08T00:33:17.682744+0000","last_became_active":"2023-10-08T00:33:17.678806+0000","last_became_peered":"2023-10-08T00:33:17.678806+0000","last_unstale":"2023-10-08T00:33:17.682744+0000","last_undegraded":"2023-10-08T00:33:17.682744+0000","last_fullsized":"2023-10-08T00:33:17.682744+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:28.026003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675230+0000","last_change":"2023-10-08T00:33:16.679897+0000","last_active":"2023-10-08T00:33:17.675230+0000","last_peered":"2023-10-08T00:33:17.675230+0000","last_clean":"2023-10-08T00:33:17.675230+0000","last_became_active":"2023-10-08T00:33:16.679593+0000","last_became_peered":"2023-10-08T00:33:16.679593+0000","last_unstale":"2023-10-08T00:33:17.675230+0000","last_undegraded":"2023-10-08T00:33:17.675230+0000","last_fullsized":"2023-10-08T00:33:17.675230+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:28:00.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683798+0000","last_change":"2023-10-08T00:33:17.673172+0000","last_active":"2023-10-08T00:33:17.683798+0000","last_peered":"2023-10-08T00:33:17.683798+0000","last_clean":"2023-10-08T00:33:17.683798+0000","last_became_active":"2023-10-08T00:33:17.671505+0000","last_became_peered":"2023-10-08T00:33:17.671505+0000","last_unstale":"2023-10-08T00:33:17.683798+0000","last_undegraded":"2023-10-08T00:33:17.683798+0000","last_fullsized":"2023-10-08T00:33:17.683798+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:52:26.034754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675402+0000","last_change":"2023-10-08T00:33:16.682149+0000","last_active":"2023-10-08T00:33:17.675402+0000","last_peered":"2023-10-08T00:33:17.675402+0000","last_clean":"2023-10-08T00:33:17.675402+0000","last_became_active":"2023-10-08T00:33:16.681922+0000","last_became_peered":"2023-10-08T00:33:16.681922+0000","last_unstale":"2023-10-08T00:33:17.675402+0000","last_undegraded":"2023-10-08T00:33:17.675402+0000","last_fullsized":"2023-10-08T00:33:17.675402+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:13.954077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687856+0000","last_change":"2023-10-08T00:33:17.676696+0000","last_active":"2023-10-08T00:33:17.687856+0000","last_peered":"2023-10-08T00:33:17.687856+0000","last_clean":"2023-10-08T00:33:17.687856+0000","last_became_active":"2023-10-08T00:33:17.676377+0000","last_became_peered":"2023-10-08T00:33:17.676377+0000","last_unstale":"2023-10-08T00:33:17.687856+0000","last_undegraded":"2023-10-08T00:33:17.687856+0000","last_fullsized":"2023-10-08T00:33:17.687856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:36:59.311376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.667381+0000","last_change":"2023-10-08T00:33:16.678988+0000","last_active":"2023-10-08T00:33:17.667381+0000","last_peered":"2023-10-08T00:33:17.667381+0000","last_clean":"2023-10-08T00:33:17.667381+0000","last_became_active":"2023-10-08T00:33:16.678269+0000","last_became_peered":"2023-10-08T00:33:16.678269+0000","last_unstale":"2023-10-08T00:33:17.667381+0000","last_undegraded":"2023-10-08T00:33:17.667381+0000","last_fullsized":"2023-10-08T00:33:17.667381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:53:14.203458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675779+0000","last_change":"2023-10-08T00:33:17.673603+0000","last_active":"2023-10-08T00:33:17.675779+0000","last_peered":"2023-10-08T00:33:17.675779+0000","last_clean":"2023-10-08T00:33:17.675779+0000","last_became_active":"2023-10-08T00:33:17.673352+0000","last_became_peered":"2023-10-08T00:33:17.673352+0000","last_unstale":"2023-10-08T00:33:17.675779+0000","last_undegraded":"2023-10-08T00:33:17.675779+0000","last_fullsized":"2023-10-08T00:33:17.675779+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:40.285005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691417+0000","last_change":"2023-10-08T00:33:16.680035+0000","last_active":"2023-10-08T00:33:17.691417+0000","last_peered":"2023-10-08T00:33:17.691417+0000","last_clean":"2023-10-08T00:33:17.691417+0000","last_became_active":"2023-10-08T00:33:16.679700+0000","last_became_peered":"2023-10-08T00:33:16.679700+0000","last_unstale":"2023-10-08T00:33:17.691417+0000","last_undegraded":"2023-10-08T00:33:17.691417+0000","last_fullsized":"2023-10-08T00:33:17.691417+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:54.096948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682527+0000","last_change":"2023-10-08T00:33:17.677407+0000","last_active":"2023-10-08T00:33:17.682527+0000","last_peered":"2023-10-08T00:33:17.682527+0000","last_clean":"2023-10-08T00:33:17.682527+0000","last_became_active":"2023-10-08T00:33:17.677141+0000","last_became_peered":"2023-10-08T00:33:17.677141+0000","last_unstale":"2023-10-08T00:33:17.682527+0000","last_undegraded":"2023-10-08T00:33:17.682527+0000","last_fullsized":"2023-10-08T00:33:17.682527+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:06.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.672084+0000","last_change":"2023-10-08T00:33:16.674209+0000","last_active":"2023-10-08T00:33:17.672084+0000","last_peered":"2023-10-08T00:33:17.672084+0000","last_clean":"2023-10-08T00:33:17.672084+0000","last_became_active":"2023-10-08T00:33:16.673649+0000","last_became_peered":"2023-10-08T00:33:16.673649+0000","last_unstale":"2023-10-08T00:33:17.672084+0000","last_undegraded":"2023-10-08T00:33:17.672084+0000","last_fullsized":"2023-10-08T00:33:17.672084+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:08.378431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683485+0000","last_change":"2023-10-08T00:33:17.679548+0000","last_active":"2023-10-08T00:33:17.683485+0000","last_peered":"2023-10-08T00:33:17.683485+0000","last_clean":"2023-10-08T00:33:17.683485+0000","last_became_active":"2023-10-08T00:33:17.679124+0000","last_became_peered":"2023-10-08T00:33:17.679124+0000","last_unstale":"2023-10-08T00:33:17.683485+0000","last_undegraded":"2023-10-08T00:33:17.683485+0000","last_fullsized":"2023-10-08T00:33:17.683485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:57.013505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.676555+0000","last_change":"2023-10-08T00:33:16.677196+0000","last_active":"2023-10-08T00:33:17.676555+0000","last_peered":"2023-10-08T00:33:17.676555+0000","last_clean":"2023-10-08T00:33:17.676555+0000","last_became_active":"2023-10-08T00:33:16.676889+0000","last_became_peered":"2023-10-08T00:33:16.676889+0000","last_unstale":"2023-10-08T00:33:17.676555+0000","last_undegraded":"2023-10-08T00:33:17.676555+0000","last_fullsized":"2023-10-08T00:33:17.676555+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:37:56.529504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.678385+0000","last_change":"2023-10-08T00:33:17.672623+0000","last_active":"2023-10-08T00:33:17.678385+0000","last_peered":"2023-10-08T00:33:17.678385+0000","last_clean":"2023-10-08T00:33:17.678385+0000","last_became_active":"2023-10-08T00:33:17.672319+0000","last_became_peered":"2023-10-08T00:33:17.672319+0000","last_unstale":"2023-10-08T00:33:17.678385+0000","last_undegraded":"2023-10-08T00:33:17.678385+0000","last_fullsized":"2023-10-08T00:33:17.678385+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:20.646189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.666991+0000","last_change":"2023-10-08T00:33:16.677082+0000","last_active":"2023-10-08T00:33:17.666991+0000","last_peered":"2023-10-08T00:33:17.666991+0000","last_clean":"2023-10-08T00:33:17.666991+0000","last_became_active":"2023-10-08T00:33:16.676553+0000","last_became_peered":"2023-10-08T00:33:16.676553+0000","last_unstale":"2023-10-08T00:33:17.666991+0000","last_undegraded":"2023-10-08T00:33:17.666991+0000","last_fullsized":"2023-10-08T00:33:17.666991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:16.584682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680620+0000","last_change":"2023-10-08T00:33:17.671212+0000","last_active":"2023-10-08T00:33:17.680620+0000","last_peered":"2023-10-08T00:33:17.680620+0000","last_clean":"2023-10-08T00:33:17.680620+0000","last_became_active":"2023-10-08T00:33:17.670769+0000","last_became_peered":"2023-10-08T00:33:17.670769+0000","last_unstale":"2023-10-08T00:33:17.680620+0000","last_undegraded":"2023-10-08T00:33:17.680620+0000","last_fullsized":"2023-10-08T00:33:17.680620+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:01.139604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675308+0000","last_change":"2023-10-08T00:33:16.680790+0000","last_active":"2023-10-08T00:33:17.675308+0000","last_peered":"2023-10-08T00:33:17.675308+0000","last_clean":"2023-10-08T00:33:17.675308+0000","last_became_active":"2023-10-08T00:33:16.680489+0000","last_became_peered":"2023-10-08T00:33:16.680489+0000","last_unstale":"2023-10-08T00:33:17.675308+0000","last_undegraded":"2023-10-08T00:33:17.675308+0000","last_fullsized":"2023-10-08T00:33:17.675308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:42.536494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690515+0000","last_change":"2023-10-08T00:33:17.685264+0000","last_active":"2023-10-08T00:33:17.690515+0000","last_peered":"2023-10-08T00:33:17.690515+0000","last_clean":"2023-10-08T00:33:17.690515+0000","last_became_active":"2023-10-08T00:33:17.684996+0000","last_became_peered":"2023-10-08T00:33:17.684996+0000","last_unstale":"2023-10-08T00:33:17.690515+0000","last_undegraded":"2023-10-08T00:33:17.690515+0000","last_fullsized":"2023-10-08T00:33:17.690515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:01.139604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.665490+0000","last_change":"2023-10-08T00:33:16.667354+0000","last_active":"2023-10-08T00:33:17.665490+0000","last_peered":"2023-10-08T00:33:17.665490+0000","last_clean":"2023-10-08T00:33:17.665490+0000","last_became_active":"2023-10-08T00:33:16.667062+0000","last_became_peered":"2023-10-08T00:33:16.667062+0000","last_unstale":"2023-10-08T00:33:17.665490+0000","last_undegraded":"2023-10-08T00:33:17.665490+0000","last_fullsized":"2023-10-08T00:33:17.665490+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:32:24.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690450+0000","last_change":"2023-10-08T00:33:17.685137+0000","last_active":"2023-10-08T00:33:17.690450+0000","last_peered":"2023-10-08T00:33:17.690450+0000","last_clean":"2023-10-08T00:33:17.690450+0000","last_became_active":"2023-10-08T00:33:17.684870+0000","last_became_peered":"2023-10-08T00:33:17.684870+0000","last_unstale":"2023-10-08T00:33:17.690450+0000","last_undegraded":"2023-10-08T00:33:17.690450+0000","last_fullsized":"2023-10-08T00:33:17.690450+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:02.602268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.663779+0000","last_change":"2023-10-08T00:33:16.678604+0000","last_active":"2023-10-08T00:33:17.663779+0000","last_peered":"2023-10-08T00:33:17.663779+0000","last_clean":"2023-10-08T00:33:17.663779+0000","last_became_active":"2023-10-08T00:33:16.678234+0000","last_became_peered":"2023-10-08T00:33:16.678234+0000","last_unstale":"2023-10-08T00:33:17.663779+0000","last_undegraded":"2023-10-08T00:33:17.663779+0000","last_fullsized":"2023-10-08T00:33:17.663779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:16:15.994941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690007+0000","last_change":"2023-10-08T00:33:17.683622+0000","last_active":"2023-10-08T00:33:17.690007+0000","last_peered":"2023-10-08T00:33:17.690007+0000","last_clean":"2023-10-08T00:33:17.690007+0000","last_became_active":"2023-10-08T00:33:17.683153+0000","last_became_peered":"2023-10-08T00:33:17.683153+0000","last_unstale":"2023-10-08T00:33:17.690007+0000","last_undegraded":"2023-10-08T00:33:17.690007+0000","last_fullsized":"2023-10-08T00:33:17.690007+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:00.811215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.667486+0000","last_change":"2023-10-08T00:33:16.678700+0000","last_active":"2023-10-08T00:33:17.667486+0000","last_peered":"2023-10-08T00:33:17.667486+0000","last_clean":"2023-10-08T00:33:17.667486+0000","last_became_active":"2023-10-08T00:33:16.677754+0000","last_became_peered":"2023-10-08T00:33:16.677754+0000","last_unstale":"2023-10-08T00:33:17.667486+0000","last_undegraded":"2023-10-08T00:33:17.667486+0000","last_fullsized":"2023-10-08T00:33:17.667486+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:39.994850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685048+0000","last_change":"2023-10-08T00:33:17.678325+0000","last_active":"2023-10-08T00:33:17.685048+0000","last_peered":"2023-10-08T00:33:17.685048+0000","last_clean":"2023-10-08T00:33:17.685048+0000","last_became_active":"2023-10-08T00:33:17.678049+0000","last_became_peered":"2023-10-08T00:33:17.678049+0000","last_unstale":"2023-10-08T00:33:17.685048+0000","last_undegraded":"2023-10-08T00:33:17.685048+0000","last_fullsized":"2023-10-08T00:33:17.685048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:22.343092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687332+0000","last_change":"2023-10-08T00:33:16.682289+0000","last_active":"2023-10-08T00:33:17.687332+0000","last_peered":"2023-10-08T00:33:17.687332+0000","last_clean":"2023-10-08T00:33:17.687332+0000","last_became_active":"2023-10-08T00:33:16.681999+0000","last_became_peered":"2023-10-08T00:33:16.681999+0000","last_unstale":"2023-10-08T00:33:17.687332+0000","last_undegraded":"2023-10-08T00:33:17.687332+0000","last_fullsized":"2023-10-08T00:33:17.687332+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:54.304217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":286,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.670615+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:17.670615+0000","last_peered":"2023-10-08T00:33:17.670615+0000","last_clean":"2023-10-08T00:33:17.670615+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:17.670615+0000","last_undegraded":"2023-10-08T00:33:17.670615+0000","last_fullsized":"2023-10-08T00:33:17.670615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304048,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067792,"statfs":{"total":96636764160,"available":96325419008,"internally_reserved":0,"allocated":2727936,"data_stored":1544670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.80300000000000005}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.73899999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.77700000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.87}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303472,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068368,"statfs":{"total":96636764160,"available":96326008832,"internally_reserved":0,"allocated":2138112,"data_stored":954288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.495},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.39900000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.47699999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.52300000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.435},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":954322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.50900000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.60299999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.755}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.78900000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.67200000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304040,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067800,"statfs":{"total":96636764160,"available":96325427200,"internally_reserved":0,"allocated":2719744,"data_stored":1538956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.437},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.63700000000000001},"last":0.27500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.375,"15min":0.379},"min":{"1min":0.249,"5min":0.245,"15min":0.245},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.63100000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.36199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.311}]},{"osd":4,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.877,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.81100000000000005,"5min":0.88100000000000001,"15min":1.242},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83699999999999997,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.54700000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.56699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574953,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303484,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068356,"statfs":{"total":96636764160,"available":96325996544,"internally_reserved":0,"allocated":2150400,"data_stored":955824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.443},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.33700000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.42299999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.40300000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.751},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.66400000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.71099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303480,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068360,"statfs":{"total":96636764160,"available":96326000640,"internally_reserved":0,"allocated":2146304,"data_stored":955838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.43099999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.39100000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.69999999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.70999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.68600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":954786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.60599999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.441}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.63400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.82899999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.749},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.67000000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.81100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303464,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068376,"statfs":{"total":96636764160,"available":96326017024,"internally_reserved":0,"allocated":2129920,"data_stored":954232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57299999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66700000000000004}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.747}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.68000000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.80000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:26.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:26.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.491+0000 7feecf329700 1 Processor -- start 2023-10-08T00:33:26.491 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.491+0000 7feecf329700 1 -- start start 2023-10-08T00:33:26.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecf329700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 0x7feec815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecf329700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feec815db10 0x7feec8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecf329700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec815a160 con 0x7feec8159890 2023-10-08T00:33:26.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecf329700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec80d13a0 con 0x7feec815db10 2023-10-08T00:33:26.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecf329700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec815e140 con 0x7feec8159c60 2023-10-08T00:33:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecc8c4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 0x7feec815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecd8c6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feec815db10 0x7feec8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecc8c4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 0x7feec815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:42402/0 (socket says 172.21.15.22:42402) 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecd0c5700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7feec8159890 0x7feec815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:56882/0 (socket says 172.21.15.22:56882) 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecc8c4700 1 -- 172.21.15.22:0/497871505 learned_addr learned my addr 172.21.15.22:0/497871505 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feebffff700 1 -- 172.21.15.22:0/497871505 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760273501 0 0) 0x7feec815a160 con 0x7feec8159890 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feebffff700 1 -- 172.21.15.22:0/497871505 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb4003570 con 0x7feec8159890 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecc8c4700 1 -- 172.21.15.22:0/497871505 >> v2:172.21.15.192:3300/0 conn(0x7feec815db10 msgr2=0x7feec8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecc8c4700 1 --2- 172.21.15.22:0/497871505 >> v2:172.21.15.192:3300/0 conn(0x7feec815db10 0x7feec8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.492+0000 7feecc8c4700 1 -- 172.21.15.22:0/497871505 >> v1:172.21.15.192:6789/0 conn(0x7feec8159890 legacy=0x7feec815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecc8c4700 1 -- 172.21.15.22:0/497871505 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec815a3d0 con 0x7feec8159c60 2023-10-08T00:33:26.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecc8c4700 1 --2- 172.21.15.22:0/497871505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 0x7feec815d5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feeb80099b0 tx=0x7feeb8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593fd4467614d206 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feebffff700 1 -- 172.21.15.22:0/497871505 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800b680 con 0x7feec8159c60 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feebffff700 1 -- 172.21.15.22:0/497871505 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb800b7e0 con 0x7feec8159c60 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feebffff700 1 -- 172.21.15.22:0/497871505 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb800bb80 con 0x7feec8159c60 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecf329700 1 -- 172.21.15.22:0/497871505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 msgr2=0x7feec815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecf329700 1 --2- 172.21.15.22:0/497871505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 0x7feec815d5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feeb80099b0 tx=0x7feeb8009250 comp rx=0 tx=0).stop 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecf329700 1 -- 172.21.15.22:0/497871505 shutdown_connections 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecf329700 1 --2- 172.21.15.22:0/497871505 >> v2:172.21.15.192:3300/0 conn(0x7feec815db10 0x7feec8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecf329700 1 --2- 172.21.15.22:0/497871505 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159c60 0x7feec815d5d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.493+0000 7feecf329700 1 -- 172.21.15.22:0/497871505 >> 172.21.15.22:0/497871505 conn(0x7feec8068e20 msgr2=0x7feec80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.494+0000 7feecf329700 1 -- 172.21.15.22:0/497871505 shutdown_connections 2023-10-08T00:33:26.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.494+0000 7feecf329700 1 -- 172.21.15.22:0/497871505 wait complete. 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.495+0000 7feecf329700 1 Processor -- start 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.495+0000 7feecf329700 1 -- start start 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.495+0000 7feecf329700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159890 0x7feec80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.495+0000 7feecf329700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feec8159c60 0x7feec80ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecf329700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 0x7feec80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecf329700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec816a040 con 0x7feec815db10 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecf329700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec816a320 con 0x7feec8159c60 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecf329700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec816a600 con 0x7feec8159890 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 0x7feec80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 0x7feec80cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45464/0 (socket says 172.21.15.22:45464) 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 -- 172.21.15.22:0/1316775276 learned_addr learned my addr 172.21.15.22:0/1316775276 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecc8c4700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feec8159c60 0x7feec80ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd0c5700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159890 0x7feec80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 -- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159890 msgr2=0x7feec80b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159890 0x7feec80b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 -- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feec8159c60 msgr2=0x7feec80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feec8159c60 0x7feec80ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 -- 172.21.15.22:0/1316775276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80094f0 con 0x7feec815db10 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecd8c6700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 0x7feec80cee30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7feec0009df0 tx=0x7feec000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000caa0 con 0x7feec815db10 2023-10-08T00:33:26.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec000f040 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec816a8e0 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.496+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000ce70 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.497+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80b41f0 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.497+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec804c3c0 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.498+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feec0014690 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.498+0000 7feebd7fa700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feeac067320 0x7feeac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.498+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feec0085590 con 0x7feec815db10 2023-10-08T00:33:26.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.499+0000 7feecd0c5700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feeac067320 0x7feeac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.499+0000 7feecd0c5700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feeac067320 0x7feeac0697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feec4004ee0 tx=0x7feec4007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:26.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.503+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feec0055ba0 con 0x7feec815db10 2023-10-08T00:33:26.690 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.690+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feec80b4470 con 0x7feeac067320 2023-10-08T00:33:26.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.698+0000 7feebd7fa700 1 -- 172.21.15.22:0/1316775276 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289594 (secure 0 0 0) 0x7feec80b4470 con 0x7feeac067320 2023-10-08T00:33:26.702 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:26.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feeac067320 msgr2=0x7feeac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feeac067320 0x7feeac0697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7feec4004ee0 tx=0x7feec4007d40 comp rx=0 tx=0).stop 2023-10-08T00:33:26.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 msgr2=0x7feec80cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 0x7feec80cee30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7feec0009df0 tx=0x7feec000b040 comp rx=0 tx=0).stop 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 shutdown_connections 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feec815db10 0x7feec80cee30 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feeac067320 0x7feeac0697d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feec8159890 0x7feec80b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 --2- 172.21.15.22:0/1316775276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feec8159c60 0x7feec80ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 >> 172.21.15.22:0/1316775276 conn(0x7feec8068e20 msgr2=0x7feec8152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 shutdown_connections 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.702+0000 7feecf329700 1 -- 172.21.15.22:0/1316775276 wait complete. 2023-10-08T00:33:26.705 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:26.715 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":422,"stamp":"2023-10-08T00:33:26.504481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428936,"kb_used_data":17864,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752545784,"statfs":{"total":773094113280,"available":770606882816,"internally_reserved":0,"allocated":18292736,"data_stored":8819204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.841910"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691504+0000","last_change":"2023-10-08T00:33:17.689883+0000","last_active":"2023-10-08T00:33:17.691504+0000","last_peered":"2023-10-08T00:33:17.691504+0000","last_clean":"2023-10-08T00:33:17.691504+0000","last_became_active":"2023-10-08T00:33:17.689094+0000","last_became_peered":"2023-10-08T00:33:17.689094+0000","last_unstale":"2023-10-08T00:33:17.691504+0000","last_undegraded":"2023-10-08T00:33:17.691504+0000","last_fullsized":"2023-10-08T00:33:17.691504+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:14.925683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689692+0000","last_change":"2023-10-08T00:33:17.680071+0000","last_active":"2023-10-08T00:33:17.689692+0000","last_peered":"2023-10-08T00:33:17.689692+0000","last_clean":"2023-10-08T00:33:17.689692+0000","last_became_active":"2023-10-08T00:33:17.677839+0000","last_became_peered":"2023-10-08T00:33:17.677839+0000","last_unstale":"2023-10-08T00:33:17.689692+0000","last_undegraded":"2023-10-08T00:33:17.689692+0000","last_fullsized":"2023-10-08T00:33:17.689692+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:28.026003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682856+0000","last_change":"2023-10-08T00:33:17.680962+0000","last_active":"2023-10-08T00:33:17.682856+0000","last_peered":"2023-10-08T00:33:17.682856+0000","last_clean":"2023-10-08T00:33:17.682856+0000","last_became_active":"2023-10-08T00:33:17.679859+0000","last_became_peered":"2023-10-08T00:33:17.679859+0000","last_unstale":"2023-10-08T00:33:17.682856+0000","last_undegraded":"2023-10-08T00:33:17.682856+0000","last_fullsized":"2023-10-08T00:33:17.682856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:08:08.647685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688099+0000","last_change":"2023-10-08T00:33:17.676703+0000","last_active":"2023-10-08T00:33:17.688099+0000","last_peered":"2023-10-08T00:33:17.688099+0000","last_clean":"2023-10-08T00:33:17.688099+0000","last_became_active":"2023-10-08T00:33:17.675422+0000","last_became_peered":"2023-10-08T00:33:17.675422+0000","last_unstale":"2023-10-08T00:33:17.688099+0000","last_undegraded":"2023-10-08T00:33:17.688099+0000","last_fullsized":"2023-10-08T00:33:17.688099+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:29.979110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688305+0000","last_change":"2023-10-08T00:33:17.683438+0000","last_active":"2023-10-08T00:33:17.688305+0000","last_peered":"2023-10-08T00:33:17.688305+0000","last_clean":"2023-10-08T00:33:17.688305+0000","last_became_active":"2023-10-08T00:33:17.683150+0000","last_became_peered":"2023-10-08T00:33:17.683150+0000","last_unstale":"2023-10-08T00:33:17.688305+0000","last_undegraded":"2023-10-08T00:33:17.688305+0000","last_fullsized":"2023-10-08T00:33:17.688305+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:56:57.285573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689924+0000","last_change":"2023-10-08T00:33:17.684991+0000","last_active":"2023-10-08T00:33:17.689924+0000","last_peered":"2023-10-08T00:33:17.689924+0000","last_clean":"2023-10-08T00:33:17.689924+0000","last_became_active":"2023-10-08T00:33:17.684755+0000","last_became_peered":"2023-10-08T00:33:17.684755+0000","last_unstale":"2023-10-08T00:33:17.689924+0000","last_undegraded":"2023-10-08T00:33:17.689924+0000","last_fullsized":"2023-10-08T00:33:17.689924+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:00.811215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.679362+0000","last_change":"2023-10-08T00:33:17.669921+0000","last_active":"2023-10-08T00:33:17.679362+0000","last_peered":"2023-10-08T00:33:17.679362+0000","last_clean":"2023-10-08T00:33:17.679362+0000","last_became_active":"2023-10-08T00:33:17.669184+0000","last_became_peered":"2023-10-08T00:33:17.669184+0000","last_unstale":"2023-10-08T00:33:17.679362+0000","last_undegraded":"2023-10-08T00:33:17.679362+0000","last_fullsized":"2023-10-08T00:33:17.679362+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:12.658371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683821+0000","last_change":"2023-10-08T00:33:17.677376+0000","last_active":"2023-10-08T00:33:17.683821+0000","last_peered":"2023-10-08T00:33:17.683821+0000","last_clean":"2023-10-08T00:33:17.683821+0000","last_became_active":"2023-10-08T00:33:17.677144+0000","last_became_peered":"2023-10-08T00:33:17.677144+0000","last_unstale":"2023-10-08T00:33:17.683821+0000","last_undegraded":"2023-10-08T00:33:17.683821+0000","last_fullsized":"2023-10-08T00:33:17.683821+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:37.619632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682698+0000","last_change":"2023-10-08T00:33:17.679622+0000","last_active":"2023-10-08T00:33:17.682698+0000","last_peered":"2023-10-08T00:33:17.682698+0000","last_clean":"2023-10-08T00:33:17.682698+0000","last_became_active":"2023-10-08T00:33:17.679306+0000","last_became_peered":"2023-10-08T00:33:17.679306+0000","last_unstale":"2023-10-08T00:33:17.682698+0000","last_undegraded":"2023-10-08T00:33:17.682698+0000","last_fullsized":"2023-10-08T00:33:17.682698+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:14:55.317487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684156+0000","last_change":"2023-10-08T00:33:17.681105+0000","last_active":"2023-10-08T00:33:17.684156+0000","last_peered":"2023-10-08T00:33:17.684156+0000","last_clean":"2023-10-08T00:33:17.684156+0000","last_became_active":"2023-10-08T00:33:17.680829+0000","last_became_peered":"2023-10-08T00:33:17.680829+0000","last_unstale":"2023-10-08T00:33:17.684156+0000","last_undegraded":"2023-10-08T00:33:17.684156+0000","last_fullsized":"2023-10-08T00:33:17.684156+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:22.843289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691515+0000","last_change":"2023-10-08T00:33:17.689873+0000","last_active":"2023-10-08T00:33:17.691515+0000","last_peered":"2023-10-08T00:33:17.691515+0000","last_clean":"2023-10-08T00:33:17.691515+0000","last_became_active":"2023-10-08T00:33:17.689235+0000","last_became_peered":"2023-10-08T00:33:17.689235+0000","last_unstale":"2023-10-08T00:33:17.691515+0000","last_undegraded":"2023-10-08T00:33:17.691515+0000","last_fullsized":"2023-10-08T00:33:17.691515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:01.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680810+0000","last_change":"2023-10-08T00:33:17.672059+0000","last_active":"2023-10-08T00:33:17.680810+0000","last_peered":"2023-10-08T00:33:17.680810+0000","last_clean":"2023-10-08T00:33:17.680810+0000","last_became_active":"2023-10-08T00:33:17.671080+0000","last_became_peered":"2023-10-08T00:33:17.671080+0000","last_unstale":"2023-10-08T00:33:17.680810+0000","last_undegraded":"2023-10-08T00:33:17.680810+0000","last_fullsized":"2023-10-08T00:33:17.680810+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:29:15.679380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690624+0000","last_change":"2023-10-08T00:33:17.685379+0000","last_active":"2023-10-08T00:33:17.690624+0000","last_peered":"2023-10-08T00:33:17.690624+0000","last_clean":"2023-10-08T00:33:17.690624+0000","last_became_active":"2023-10-08T00:33:17.685101+0000","last_became_peered":"2023-10-08T00:33:17.685101+0000","last_unstale":"2023-10-08T00:33:17.690624+0000","last_undegraded":"2023-10-08T00:33:17.690624+0000","last_fullsized":"2023-10-08T00:33:17.690624+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:57.391741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691101+0000","last_change":"2023-10-08T00:33:17.688144+0000","last_active":"2023-10-08T00:33:17.691101+0000","last_peered":"2023-10-08T00:33:17.691101+0000","last_clean":"2023-10-08T00:33:17.691101+0000","last_became_active":"2023-10-08T00:33:17.687090+0000","last_became_peered":"2023-10-08T00:33:17.687090+0000","last_unstale":"2023-10-08T00:33:17.691101+0000","last_undegraded":"2023-10-08T00:33:17.691101+0000","last_fullsized":"2023-10-08T00:33:17.691101+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:54.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.679612+0000","last_change":"2023-10-08T00:33:17.675041+0000","last_active":"2023-10-08T00:33:17.679612+0000","last_peered":"2023-10-08T00:33:17.679612+0000","last_clean":"2023-10-08T00:33:17.679612+0000","last_became_active":"2023-10-08T00:33:17.674773+0000","last_became_peered":"2023-10-08T00:33:17.674773+0000","last_unstale":"2023-10-08T00:33:17.679612+0000","last_undegraded":"2023-10-08T00:33:17.679612+0000","last_fullsized":"2023-10-08T00:33:17.679612+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:10.252341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684044+0000","last_change":"2023-10-08T00:33:17.672541+0000","last_active":"2023-10-08T00:33:17.684044+0000","last_peered":"2023-10-08T00:33:17.684044+0000","last_clean":"2023-10-08T00:33:17.684044+0000","last_became_active":"2023-10-08T00:33:17.672154+0000","last_became_peered":"2023-10-08T00:33:17.672154+0000","last_unstale":"2023-10-08T00:33:17.684044+0000","last_undegraded":"2023-10-08T00:33:17.684044+0000","last_fullsized":"2023-10-08T00:33:17.684044+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:07:20.601784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691038+0000","last_change":"2023-10-08T00:33:17.687735+0000","last_active":"2023-10-08T00:33:17.691038+0000","last_peered":"2023-10-08T00:33:17.691038+0000","last_clean":"2023-10-08T00:33:17.691038+0000","last_became_active":"2023-10-08T00:33:17.686916+0000","last_became_peered":"2023-10-08T00:33:17.686916+0000","last_unstale":"2023-10-08T00:33:17.691038+0000","last_undegraded":"2023-10-08T00:33:17.691038+0000","last_fullsized":"2023-10-08T00:33:17.691038+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:06.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.684174+0000","last_change":"2023-10-08T00:33:17.682168+0000","last_active":"2023-10-08T00:33:17.684174+0000","last_peered":"2023-10-08T00:33:17.684174+0000","last_clean":"2023-10-08T00:33:17.684174+0000","last_became_active":"2023-10-08T00:33:17.681885+0000","last_became_peered":"2023-10-08T00:33:17.681885+0000","last_unstale":"2023-10-08T00:33:17.684174+0000","last_undegraded":"2023-10-08T00:33:17.684174+0000","last_fullsized":"2023-10-08T00:33:17.684174+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:15:01.134833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688694+0000","last_change":"2023-10-08T00:33:17.684367+0000","last_active":"2023-10-08T00:33:17.688694+0000","last_peered":"2023-10-08T00:33:17.688694+0000","last_clean":"2023-10-08T00:33:17.688694+0000","last_became_active":"2023-10-08T00:33:17.683988+0000","last_became_peered":"2023-10-08T00:33:17.683988+0000","last_unstale":"2023-10-08T00:33:17.688694+0000","last_undegraded":"2023-10-08T00:33:17.688694+0000","last_fullsized":"2023-10-08T00:33:17.688694+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:46.166271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675916+0000","last_change":"2023-10-08T00:33:17.674925+0000","last_active":"2023-10-08T00:33:17.675916+0000","last_peered":"2023-10-08T00:33:17.675916+0000","last_clean":"2023-10-08T00:33:17.675916+0000","last_became_active":"2023-10-08T00:33:17.674638+0000","last_became_peered":"2023-10-08T00:33:17.674638+0000","last_unstale":"2023-10-08T00:33:17.675916+0000","last_undegraded":"2023-10-08T00:33:17.675916+0000","last_fullsized":"2023-10-08T00:33:17.675916+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:22.687959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688270+0000","last_change":"2023-10-08T00:33:17.677629+0000","last_active":"2023-10-08T00:33:17.688270+0000","last_peered":"2023-10-08T00:33:17.688270+0000","last_clean":"2023-10-08T00:33:17.688270+0000","last_became_active":"2023-10-08T00:33:17.675993+0000","last_became_peered":"2023-10-08T00:33:17.675993+0000","last_unstale":"2023-10-08T00:33:17.688270+0000","last_undegraded":"2023-10-08T00:33:17.688270+0000","last_fullsized":"2023-10-08T00:33:17.688270+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:22:31.380659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686701+0000","last_change":"2023-10-08T00:33:17.684258+0000","last_active":"2023-10-08T00:33:17.686701+0000","last_peered":"2023-10-08T00:33:17.686701+0000","last_clean":"2023-10-08T00:33:17.686701+0000","last_became_active":"2023-10-08T00:33:17.683995+0000","last_became_peered":"2023-10-08T00:33:17.683995+0000","last_unstale":"2023-10-08T00:33:17.686701+0000","last_undegraded":"2023-10-08T00:33:17.686701+0000","last_fullsized":"2023-10-08T00:33:17.686701+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:54:12.456416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690020+0000","last_change":"2023-10-08T00:33:17.683735+0000","last_active":"2023-10-08T00:33:17.690020+0000","last_peered":"2023-10-08T00:33:17.690020+0000","last_clean":"2023-10-08T00:33:17.690020+0000","last_became_active":"2023-10-08T00:33:17.682805+0000","last_became_peered":"2023-10-08T00:33:17.682805+0000","last_unstale":"2023-10-08T00:33:17.690020+0000","last_undegraded":"2023-10-08T00:33:17.690020+0000","last_fullsized":"2023-10-08T00:33:17.690020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:59:29.841763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688104+0000","last_change":"2023-10-08T00:33:17.682514+0000","last_active":"2023-10-08T00:33:17.688104+0000","last_peered":"2023-10-08T00:33:17.688104+0000","last_clean":"2023-10-08T00:33:17.688104+0000","last_became_active":"2023-10-08T00:33:17.682212+0000","last_became_peered":"2023-10-08T00:33:17.682212+0000","last_unstale":"2023-10-08T00:33:17.688104+0000","last_undegraded":"2023-10-08T00:33:17.688104+0000","last_fullsized":"2023-10-08T00:33:17.688104+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:07:41.352833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691527+0000","last_change":"2023-10-08T00:33:17.689923+0000","last_active":"2023-10-08T00:33:17.691527+0000","last_peered":"2023-10-08T00:33:17.691527+0000","last_clean":"2023-10-08T00:33:17.691527+0000","last_became_active":"2023-10-08T00:33:17.689378+0000","last_became_peered":"2023-10-08T00:33:17.689378+0000","last_unstale":"2023-10-08T00:33:17.691527+0000","last_undegraded":"2023-10-08T00:33:17.691527+0000","last_fullsized":"2023-10-08T00:33:17.691527+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:29:22.687959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688445+0000","last_change":"2023-10-08T00:33:17.686788+0000","last_active":"2023-10-08T00:33:17.688445+0000","last_peered":"2023-10-08T00:33:17.688445+0000","last_clean":"2023-10-08T00:33:17.688445+0000","last_became_active":"2023-10-08T00:33:17.686496+0000","last_became_peered":"2023-10-08T00:33:17.686496+0000","last_unstale":"2023-10-08T00:33:17.688445+0000","last_undegraded":"2023-10-08T00:33:17.688445+0000","last_fullsized":"2023-10-08T00:33:17.688445+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:35:54.754288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691551+0000","last_change":"2023-10-08T00:33:17.690007+0000","last_active":"2023-10-08T00:33:17.691551+0000","last_peered":"2023-10-08T00:33:17.691551+0000","last_clean":"2023-10-08T00:33:17.691551+0000","last_became_active":"2023-10-08T00:33:17.689617+0000","last_became_peered":"2023-10-08T00:33:17.689617+0000","last_unstale":"2023-10-08T00:33:17.691551+0000","last_undegraded":"2023-10-08T00:33:17.691551+0000","last_fullsized":"2023-10-08T00:33:17.691551+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:21:22.843289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691913+0000","last_change":"2023-10-08T00:33:17.689146+0000","last_active":"2023-10-08T00:33:17.691913+0000","last_peered":"2023-10-08T00:33:17.691913+0000","last_clean":"2023-10-08T00:33:17.691913+0000","last_became_active":"2023-10-08T00:33:17.688831+0000","last_became_peered":"2023-10-08T00:33:17.688831+0000","last_unstale":"2023-10-08T00:33:17.691913+0000","last_undegraded":"2023-10-08T00:33:17.691913+0000","last_fullsized":"2023-10-08T00:33:17.691913+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688488+0000","last_change":"2023-10-08T00:33:17.683466+0000","last_active":"2023-10-08T00:33:17.688488+0000","last_peered":"2023-10-08T00:33:17.688488+0000","last_clean":"2023-10-08T00:33:17.688488+0000","last_became_active":"2023-10-08T00:33:17.683125+0000","last_became_peered":"2023-10-08T00:33:17.683125+0000","last_unstale":"2023-10-08T00:33:17.688488+0000","last_undegraded":"2023-10-08T00:33:17.688488+0000","last_fullsized":"2023-10-08T00:33:17.688488+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:06.492806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689679+0000","last_change":"2023-10-08T00:33:17.683523+0000","last_active":"2023-10-08T00:33:17.689679+0000","last_peered":"2023-10-08T00:33:17.689679+0000","last_clean":"2023-10-08T00:33:17.689679+0000","last_became_active":"2023-10-08T00:33:17.682734+0000","last_became_peered":"2023-10-08T00:33:17.682734+0000","last_unstale":"2023-10-08T00:33:17.689679+0000","last_undegraded":"2023-10-08T00:33:17.689679+0000","last_fullsized":"2023-10-08T00:33:17.689679+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.715868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688723+0000","last_change":"2023-10-08T00:33:17.684566+0000","last_active":"2023-10-08T00:33:17.688723+0000","last_peered":"2023-10-08T00:33:17.688723+0000","last_clean":"2023-10-08T00:33:17.688723+0000","last_became_active":"2023-10-08T00:33:17.683575+0000","last_became_peered":"2023-10-08T00:33:17.683575+0000","last_unstale":"2023-10-08T00:33:17.688723+0000","last_undegraded":"2023-10-08T00:33:17.688723+0000","last_fullsized":"2023-10-08T00:33:17.688723+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:38:36.529946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.674349+0000","last_change":"2023-10-08T00:33:17.672690+0000","last_active":"2023-10-08T00:33:17.674349+0000","last_peered":"2023-10-08T00:33:17.674349+0000","last_clean":"2023-10-08T00:33:17.674349+0000","last_became_active":"2023-10-08T00:33:17.672421+0000","last_became_peered":"2023-10-08T00:33:17.672421+0000","last_unstale":"2023-10-08T00:33:17.674349+0000","last_undegraded":"2023-10-08T00:33:17.674349+0000","last_fullsized":"2023-10-08T00:33:17.674349+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:00.947530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682536+0000","last_change":"2023-10-08T00:33:17.677430+0000","last_active":"2023-10-08T00:33:17.682536+0000","last_peered":"2023-10-08T00:33:17.682536+0000","last_clean":"2023-10-08T00:33:17.682536+0000","last_became_active":"2023-10-08T00:33:17.677102+0000","last_became_peered":"2023-10-08T00:33:17.677102+0000","last_unstale":"2023-10-08T00:33:17.682536+0000","last_undegraded":"2023-10-08T00:33:17.682536+0000","last_fullsized":"2023-10-08T00:33:17.682536+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:17:41.188203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690753+0000","last_change":"2023-10-08T00:33:16.671414+0000","last_active":"2023-10-08T00:33:17.690753+0000","last_peered":"2023-10-08T00:33:17.690753+0000","last_clean":"2023-10-08T00:33:17.690753+0000","last_became_active":"2023-10-08T00:33:16.671105+0000","last_became_peered":"2023-10-08T00:33:16.671105+0000","last_unstale":"2023-10-08T00:33:17.690753+0000","last_undegraded":"2023-10-08T00:33:17.690753+0000","last_fullsized":"2023-10-08T00:33:17.690753+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:18.885960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680904+0000","last_change":"2023-10-08T00:33:17.677588+0000","last_active":"2023-10-08T00:33:17.680904+0000","last_peered":"2023-10-08T00:33:17.680904+0000","last_clean":"2023-10-08T00:33:17.680904+0000","last_became_active":"2023-10-08T00:33:17.677306+0000","last_became_peered":"2023-10-08T00:33:17.677306+0000","last_unstale":"2023-10-08T00:33:17.680904+0000","last_undegraded":"2023-10-08T00:33:17.680904+0000","last_fullsized":"2023-10-08T00:33:17.680904+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:32:06.593819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686672+0000","last_change":"2023-10-08T00:33:16.667720+0000","last_active":"2023-10-08T00:33:17.686672+0000","last_peered":"2023-10-08T00:33:17.686672+0000","last_clean":"2023-10-08T00:33:17.686672+0000","last_became_active":"2023-10-08T00:33:16.667472+0000","last_became_peered":"2023-10-08T00:33:16.667472+0000","last_unstale":"2023-10-08T00:33:17.686672+0000","last_undegraded":"2023-10-08T00:33:17.686672+0000","last_fullsized":"2023-10-08T00:33:17.686672+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:35:05.490580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685964+0000","last_change":"2023-10-08T00:33:17.682010+0000","last_active":"2023-10-08T00:33:17.685964+0000","last_peered":"2023-10-08T00:33:17.685964+0000","last_clean":"2023-10-08T00:33:17.685964+0000","last_became_active":"2023-10-08T00:33:17.681756+0000","last_became_peered":"2023-10-08T00:33:17.681756+0000","last_unstale":"2023-10-08T00:33:17.685964+0000","last_undegraded":"2023-10-08T00:33:17.685964+0000","last_fullsized":"2023-10-08T00:33:17.685964+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:17.151201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680871+0000","last_change":"2023-10-08T00:33:16.675539+0000","last_active":"2023-10-08T00:33:17.680871+0000","last_peered":"2023-10-08T00:33:17.680871+0000","last_clean":"2023-10-08T00:33:17.680871+0000","last_became_active":"2023-10-08T00:33:16.675264+0000","last_became_peered":"2023-10-08T00:33:16.675264+0000","last_unstale":"2023-10-08T00:33:17.680871+0000","last_undegraded":"2023-10-08T00:33:17.680871+0000","last_fullsized":"2023-10-08T00:33:17.680871+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:01.600042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689702+0000","last_change":"2023-10-08T00:33:17.683625+0000","last_active":"2023-10-08T00:33:17.689702+0000","last_peered":"2023-10-08T00:33:17.689702+0000","last_clean":"2023-10-08T00:33:17.689702+0000","last_became_active":"2023-10-08T00:33:17.683086+0000","last_became_peered":"2023-10-08T00:33:17.683086+0000","last_unstale":"2023-10-08T00:33:17.689702+0000","last_undegraded":"2023-10-08T00:33:17.689702+0000","last_fullsized":"2023-10-08T00:33:17.689702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:56:46.166271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680215+0000","last_change":"2023-10-08T00:33:16.671190+0000","last_active":"2023-10-08T00:33:17.680215+0000","last_peered":"2023-10-08T00:33:17.680215+0000","last_clean":"2023-10-08T00:33:17.680215+0000","last_became_active":"2023-10-08T00:33:16.670924+0000","last_became_peered":"2023-10-08T00:33:16.670924+0000","last_unstale":"2023-10-08T00:33:17.680215+0000","last_undegraded":"2023-10-08T00:33:17.680215+0000","last_fullsized":"2023-10-08T00:33:17.680215+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:42.536494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688289+0000","last_change":"2023-10-08T00:33:17.678044+0000","last_active":"2023-10-08T00:33:17.688289+0000","last_peered":"2023-10-08T00:33:17.688289+0000","last_clean":"2023-10-08T00:33:17.688289+0000","last_became_active":"2023-10-08T00:33:17.673937+0000","last_became_peered":"2023-10-08T00:33:17.673937+0000","last_unstale":"2023-10-08T00:33:17.688289+0000","last_undegraded":"2023-10-08T00:33:17.688289+0000","last_fullsized":"2023-10-08T00:33:17.688289+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:32.749671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683486+0000","last_change":"2023-10-08T00:33:16.678384+0000","last_active":"2023-10-08T00:33:17.683486+0000","last_peered":"2023-10-08T00:33:17.683486+0000","last_clean":"2023-10-08T00:33:17.683486+0000","last_became_active":"2023-10-08T00:33:16.677792+0000","last_became_peered":"2023-10-08T00:33:16.677792+0000","last_unstale":"2023-10-08T00:33:17.683486+0000","last_undegraded":"2023-10-08T00:33:17.683486+0000","last_fullsized":"2023-10-08T00:33:17.683486+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:53:36.617406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691840+0000","last_change":"2023-10-08T00:33:17.689142+0000","last_active":"2023-10-08T00:33:17.691840+0000","last_peered":"2023-10-08T00:33:17.691840+0000","last_clean":"2023-10-08T00:33:17.691840+0000","last_became_active":"2023-10-08T00:33:17.688805+0000","last_became_peered":"2023-10-08T00:33:17.688805+0000","last_unstale":"2023-10-08T00:33:17.691840+0000","last_undegraded":"2023-10-08T00:33:17.691840+0000","last_fullsized":"2023-10-08T00:33:17.691840+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:42:14.925683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675312+0000","last_change":"2023-10-08T00:33:16.681608+0000","last_active":"2023-10-08T00:33:17.675312+0000","last_peered":"2023-10-08T00:33:17.675312+0000","last_clean":"2023-10-08T00:33:17.675312+0000","last_became_active":"2023-10-08T00:33:16.681336+0000","last_became_peered":"2023-10-08T00:33:16.681336+0000","last_unstale":"2023-10-08T00:33:17.675312+0000","last_undegraded":"2023-10-08T00:33:17.675312+0000","last_fullsized":"2023-10-08T00:33:17.675312+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:40:59.446556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.681271+0000","last_change":"2023-10-08T00:33:17.677626+0000","last_active":"2023-10-08T00:33:17.681271+0000","last_peered":"2023-10-08T00:33:17.681271+0000","last_clean":"2023-10-08T00:33:17.681271+0000","last_became_active":"2023-10-08T00:33:17.677383+0000","last_became_peered":"2023-10-08T00:33:17.677383+0000","last_unstale":"2023-10-08T00:33:17.681271+0000","last_undegraded":"2023-10-08T00:33:17.681271+0000","last_fullsized":"2023-10-08T00:33:17.681271+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:12.658371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.670493+0000","last_change":"2023-10-08T00:33:16.678082+0000","last_active":"2023-10-08T00:33:17.670493+0000","last_peered":"2023-10-08T00:33:17.670493+0000","last_clean":"2023-10-08T00:33:17.670493+0000","last_became_active":"2023-10-08T00:33:16.677816+0000","last_became_peered":"2023-10-08T00:33:16.677816+0000","last_unstale":"2023-10-08T00:33:17.670493+0000","last_undegraded":"2023-10-08T00:33:17.670493+0000","last_fullsized":"2023-10-08T00:33:17.670493+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:39.282779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691011+0000","last_change":"2023-10-08T00:33:17.685894+0000","last_active":"2023-10-08T00:33:17.691011+0000","last_peered":"2023-10-08T00:33:17.691011+0000","last_clean":"2023-10-08T00:33:17.691011+0000","last_became_active":"2023-10-08T00:33:17.678197+0000","last_became_peered":"2023-10-08T00:33:17.678197+0000","last_unstale":"2023-10-08T00:33:17.691011+0000","last_undegraded":"2023-10-08T00:33:17.691011+0000","last_fullsized":"2023-10-08T00:33:17.691011+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:57.013505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.674747+0000","last_change":"2023-10-08T00:33:16.682010+0000","last_active":"2023-10-08T00:33:17.674747+0000","last_peered":"2023-10-08T00:33:17.674747+0000","last_clean":"2023-10-08T00:33:17.674747+0000","last_became_active":"2023-10-08T00:33:16.681754+0000","last_became_peered":"2023-10-08T00:33:16.681754+0000","last_unstale":"2023-10-08T00:33:17.674747+0000","last_undegraded":"2023-10-08T00:33:17.674747+0000","last_fullsized":"2023-10-08T00:33:17.674747+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:27:16.383066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689806+0000","last_change":"2023-10-08T00:33:17.682805+0000","last_active":"2023-10-08T00:33:17.689806+0000","last_peered":"2023-10-08T00:33:17.689806+0000","last_clean":"2023-10-08T00:33:17.689806+0000","last_became_active":"2023-10-08T00:33:17.682405+0000","last_became_peered":"2023-10-08T00:33:17.682405+0000","last_unstale":"2023-10-08T00:33:17.689806+0000","last_undegraded":"2023-10-08T00:33:17.689806+0000","last_fullsized":"2023-10-08T00:33:17.689806+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:32:25.531675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.664500+0000","last_change":"2023-10-08T00:33:16.667362+0000","last_active":"2023-10-08T00:33:17.664500+0000","last_peered":"2023-10-08T00:33:17.664500+0000","last_clean":"2023-10-08T00:33:17.664500+0000","last_became_active":"2023-10-08T00:33:16.667122+0000","last_became_peered":"2023-10-08T00:33:16.667122+0000","last_unstale":"2023-10-08T00:33:17.664500+0000","last_undegraded":"2023-10-08T00:33:17.664500+0000","last_fullsized":"2023-10-08T00:33:17.664500+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:26:25.262420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686555+0000","last_change":"2023-10-08T00:33:17.683644+0000","last_active":"2023-10-08T00:33:17.686555+0000","last_peered":"2023-10-08T00:33:17.686555+0000","last_clean":"2023-10-08T00:33:17.686555+0000","last_became_active":"2023-10-08T00:33:17.683378+0000","last_became_peered":"2023-10-08T00:33:17.683378+0000","last_unstale":"2023-10-08T00:33:17.686555+0000","last_undegraded":"2023-10-08T00:33:17.686555+0000","last_fullsized":"2023-10-08T00:33:17.686555+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:02.602268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688074+0000","last_change":"2023-10-08T00:33:16.674348+0000","last_active":"2023-10-08T00:33:17.688074+0000","last_peered":"2023-10-08T00:33:17.688074+0000","last_clean":"2023-10-08T00:33:17.688074+0000","last_became_active":"2023-10-08T00:33:16.672802+0000","last_became_peered":"2023-10-08T00:33:16.672802+0000","last_unstale":"2023-10-08T00:33:17.688074+0000","last_undegraded":"2023-10-08T00:33:17.688074+0000","last_fullsized":"2023-10-08T00:33:17.688074+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:54:03.777515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691585+0000","last_change":"2023-10-08T00:33:17.690850+0000","last_active":"2023-10-08T00:33:17.691585+0000","last_peered":"2023-10-08T00:33:17.691585+0000","last_clean":"2023-10-08T00:33:17.691585+0000","last_became_active":"2023-10-08T00:33:17.690558+0000","last_became_peered":"2023-10-08T00:33:17.690558+0000","last_unstale":"2023-10-08T00:33:17.691585+0000","last_undegraded":"2023-10-08T00:33:17.691585+0000","last_fullsized":"2023-10-08T00:33:17.691585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:41.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.692628+0000","last_change":"2023-10-08T00:33:16.672895+0000","last_active":"2023-10-08T00:33:17.692628+0000","last_peered":"2023-10-08T00:33:17.692628+0000","last_clean":"2023-10-08T00:33:17.692628+0000","last_became_active":"2023-10-08T00:33:16.672627+0000","last_became_peered":"2023-10-08T00:33:16.672627+0000","last_unstale":"2023-10-08T00:33:17.692628+0000","last_undegraded":"2023-10-08T00:33:17.692628+0000","last_fullsized":"2023-10-08T00:33:17.692628+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:42:28.976885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.669358+0000","last_change":"2023-10-08T00:33:17.668284+0000","last_active":"2023-10-08T00:33:17.669358+0000","last_peered":"2023-10-08T00:33:17.669358+0000","last_clean":"2023-10-08T00:33:17.669358+0000","last_became_active":"2023-10-08T00:33:17.667949+0000","last_became_peered":"2023-10-08T00:33:17.667949+0000","last_unstale":"2023-10-08T00:33:17.669358+0000","last_undegraded":"2023-10-08T00:33:17.669358+0000","last_fullsized":"2023-10-08T00:33:17.669358+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:32:47.620740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683794+0000","last_change":"2023-10-08T00:33:16.678953+0000","last_active":"2023-10-08T00:33:17.683794+0000","last_peered":"2023-10-08T00:33:17.683794+0000","last_clean":"2023-10-08T00:33:17.683794+0000","last_became_active":"2023-10-08T00:33:16.678682+0000","last_became_peered":"2023-10-08T00:33:16.678682+0000","last_unstale":"2023-10-08T00:33:17.683794+0000","last_undegraded":"2023-10-08T00:33:17.683794+0000","last_fullsized":"2023-10-08T00:33:17.683794+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:40:59.446556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690483+0000","last_change":"2023-10-08T00:33:17.684851+0000","last_active":"2023-10-08T00:33:17.690483+0000","last_peered":"2023-10-08T00:33:17.690483+0000","last_clean":"2023-10-08T00:33:17.690483+0000","last_became_active":"2023-10-08T00:33:17.684469+0000","last_became_peered":"2023-10-08T00:33:17.684469+0000","last_unstale":"2023-10-08T00:33:17.690483+0000","last_undegraded":"2023-10-08T00:33:17.690483+0000","last_fullsized":"2023-10-08T00:33:17.690483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:09:57.391741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.665383+0000","last_change":"2023-10-08T00:33:16.681291+0000","last_active":"2023-10-08T00:33:17.665383+0000","last_peered":"2023-10-08T00:33:17.665383+0000","last_clean":"2023-10-08T00:33:17.665383+0000","last_became_active":"2023-10-08T00:33:16.681050+0000","last_became_peered":"2023-10-08T00:33:16.681050+0000","last_unstale":"2023-10-08T00:33:17.665383+0000","last_undegraded":"2023-10-08T00:33:17.665383+0000","last_fullsized":"2023-10-08T00:33:17.665383+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:07.560703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690533+0000","last_change":"2023-10-08T00:33:17.685946+0000","last_active":"2023-10-08T00:33:17.690533+0000","last_peered":"2023-10-08T00:33:17.690533+0000","last_clean":"2023-10-08T00:33:17.690533+0000","last_became_active":"2023-10-08T00:33:17.685042+0000","last_became_peered":"2023-10-08T00:33:17.685042+0000","last_unstale":"2023-10-08T00:33:17.690533+0000","last_undegraded":"2023-10-08T00:33:17.690533+0000","last_fullsized":"2023-10-08T00:33:17.690533+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:03:34.912510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.662146+0000","last_change":"2023-10-08T00:33:16.669190+0000","last_active":"2023-10-08T00:33:17.662146+0000","last_peered":"2023-10-08T00:33:17.662146+0000","last_clean":"2023-10-08T00:33:17.662146+0000","last_became_active":"2023-10-08T00:33:16.668937+0000","last_became_peered":"2023-10-08T00:33:16.668937+0000","last_unstale":"2023-10-08T00:33:17.662146+0000","last_undegraded":"2023-10-08T00:33:17.662146+0000","last_fullsized":"2023-10-08T00:33:17.662146+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:16:00.733995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.686887+0000","last_change":"2023-10-08T00:33:17.682612+0000","last_active":"2023-10-08T00:33:17.686887+0000","last_peered":"2023-10-08T00:33:17.686887+0000","last_clean":"2023-10-08T00:33:17.686887+0000","last_became_active":"2023-10-08T00:33:17.681452+0000","last_became_peered":"2023-10-08T00:33:17.681452+0000","last_unstale":"2023-10-08T00:33:17.686887+0000","last_undegraded":"2023-10-08T00:33:17.686887+0000","last_fullsized":"2023-10-08T00:33:17.686887+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:18:58.137532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687932+0000","last_change":"2023-10-08T00:33:16.676094+0000","last_active":"2023-10-08T00:33:17.687932+0000","last_peered":"2023-10-08T00:33:17.687932+0000","last_clean":"2023-10-08T00:33:17.687932+0000","last_became_active":"2023-10-08T00:33:16.675736+0000","last_became_peered":"2023-10-08T00:33:16.675736+0000","last_unstale":"2023-10-08T00:33:17.687932+0000","last_undegraded":"2023-10-08T00:33:17.687932+0000","last_fullsized":"2023-10-08T00:33:17.687932+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:35:16.148975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682760+0000","last_change":"2023-10-08T00:33:17.677973+0000","last_active":"2023-10-08T00:33:17.682760+0000","last_peered":"2023-10-08T00:33:17.682760+0000","last_clean":"2023-10-08T00:33:17.682760+0000","last_became_active":"2023-10-08T00:33:17.677662+0000","last_became_peered":"2023-10-08T00:33:17.677662+0000","last_unstale":"2023-10-08T00:33:17.682760+0000","last_undegraded":"2023-10-08T00:33:17.682760+0000","last_fullsized":"2023-10-08T00:33:17.682760+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:13:18.060729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688745+0000","last_change":"2023-10-08T00:33:16.679329+0000","last_active":"2023-10-08T00:33:17.688745+0000","last_peered":"2023-10-08T00:33:17.688745+0000","last_clean":"2023-10-08T00:33:17.688745+0000","last_became_active":"2023-10-08T00:33:16.679030+0000","last_became_peered":"2023-10-08T00:33:16.679030+0000","last_unstale":"2023-10-08T00:33:17.688745+0000","last_undegraded":"2023-10-08T00:33:17.688745+0000","last_fullsized":"2023-10-08T00:33:17.688745+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:36:10.444888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691865+0000","last_change":"2023-10-08T00:33:17.689238+0000","last_active":"2023-10-08T00:33:17.691865+0000","last_peered":"2023-10-08T00:33:17.691865+0000","last_clean":"2023-10-08T00:33:17.691865+0000","last_became_active":"2023-10-08T00:33:17.689020+0000","last_became_peered":"2023-10-08T00:33:17.689020+0000","last_unstale":"2023-10-08T00:33:17.691865+0000","last_undegraded":"2023-10-08T00:33:17.691865+0000","last_fullsized":"2023-10-08T00:33:17.691865+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:41.494856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.678172+0000","last_change":"2023-10-08T00:33:16.673947+0000","last_active":"2023-10-08T00:33:17.678172+0000","last_peered":"2023-10-08T00:33:17.678172+0000","last_clean":"2023-10-08T00:33:17.678172+0000","last_became_active":"2023-10-08T00:33:16.673672+0000","last_became_peered":"2023-10-08T00:33:16.673672+0000","last_unstale":"2023-10-08T00:33:17.678172+0000","last_undegraded":"2023-10-08T00:33:17.678172+0000","last_fullsized":"2023-10-08T00:33:17.678172+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:41:52.888966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690494+0000","last_change":"2023-10-08T00:33:17.685663+0000","last_active":"2023-10-08T00:33:17.690494+0000","last_peered":"2023-10-08T00:33:17.690494+0000","last_clean":"2023-10-08T00:33:17.690494+0000","last_became_active":"2023-10-08T00:33:17.685410+0000","last_became_peered":"2023-10-08T00:33:17.685410+0000","last_unstale":"2023-10-08T00:33:17.690494+0000","last_undegraded":"2023-10-08T00:33:17.690494+0000","last_fullsized":"2023-10-08T00:33:17.690494+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:53.870890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685146+0000","last_change":"2023-10-08T00:33:16.677055+0000","last_active":"2023-10-08T00:33:17.685146+0000","last_peered":"2023-10-08T00:33:17.685146+0000","last_clean":"2023-10-08T00:33:17.685146+0000","last_became_active":"2023-10-08T00:33:16.676618+0000","last_became_peered":"2023-10-08T00:33:16.676618+0000","last_unstale":"2023-10-08T00:33:17.685146+0000","last_undegraded":"2023-10-08T00:33:17.685146+0000","last_fullsized":"2023-10-08T00:33:17.685146+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:11:40.540117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690594+0000","last_change":"2023-10-08T00:33:17.686506+0000","last_active":"2023-10-08T00:33:17.690594+0000","last_peered":"2023-10-08T00:33:17.690594+0000","last_clean":"2023-10-08T00:33:17.690594+0000","last_became_active":"2023-10-08T00:33:17.686177+0000","last_became_peered":"2023-10-08T00:33:17.686177+0000","last_unstale":"2023-10-08T00:33:17.690594+0000","last_undegraded":"2023-10-08T00:33:17.690594+0000","last_fullsized":"2023-10-08T00:33:17.690594+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:05.532998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.671015+0000","last_change":"2023-10-08T00:33:16.677685+0000","last_active":"2023-10-08T00:33:17.671015+0000","last_peered":"2023-10-08T00:33:17.671015+0000","last_clean":"2023-10-08T00:33:17.671015+0000","last_became_active":"2023-10-08T00:33:16.677356+0000","last_became_peered":"2023-10-08T00:33:16.677356+0000","last_unstale":"2023-10-08T00:33:17.671015+0000","last_undegraded":"2023-10-08T00:33:17.671015+0000","last_fullsized":"2023-10-08T00:33:17.671015+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:31.747445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.688065+0000","last_change":"2023-10-08T00:33:17.683944+0000","last_active":"2023-10-08T00:33:17.688065+0000","last_peered":"2023-10-08T00:33:17.688065+0000","last_clean":"2023-10-08T00:33:17.688065+0000","last_became_active":"2023-10-08T00:33:17.683617+0000","last_became_peered":"2023-10-08T00:33:17.683617+0000","last_unstale":"2023-10-08T00:33:17.688065+0000","last_undegraded":"2023-10-08T00:33:17.688065+0000","last_fullsized":"2023-10-08T00:33:17.688065+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:22.343092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.689109+0000","last_change":"2023-10-08T00:33:16.680031+0000","last_active":"2023-10-08T00:33:17.689109+0000","last_peered":"2023-10-08T00:33:17.689109+0000","last_clean":"2023-10-08T00:33:17.689109+0000","last_became_active":"2023-10-08T00:33:16.679712+0000","last_became_peered":"2023-10-08T00:33:16.679712+0000","last_unstale":"2023-10-08T00:33:17.689109+0000","last_undegraded":"2023-10-08T00:33:17.689109+0000","last_fullsized":"2023-10-08T00:33:17.689109+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:54.304217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682744+0000","last_change":"2023-10-08T00:33:17.679086+0000","last_active":"2023-10-08T00:33:17.682744+0000","last_peered":"2023-10-08T00:33:17.682744+0000","last_clean":"2023-10-08T00:33:17.682744+0000","last_became_active":"2023-10-08T00:33:17.678806+0000","last_became_peered":"2023-10-08T00:33:17.678806+0000","last_unstale":"2023-10-08T00:33:17.682744+0000","last_undegraded":"2023-10-08T00:33:17.682744+0000","last_fullsized":"2023-10-08T00:33:17.682744+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:58:28.026003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675230+0000","last_change":"2023-10-08T00:33:16.679897+0000","last_active":"2023-10-08T00:33:17.675230+0000","last_peered":"2023-10-08T00:33:17.675230+0000","last_clean":"2023-10-08T00:33:17.675230+0000","last_became_active":"2023-10-08T00:33:16.679593+0000","last_became_peered":"2023-10-08T00:33:16.679593+0000","last_unstale":"2023-10-08T00:33:17.675230+0000","last_undegraded":"2023-10-08T00:33:17.675230+0000","last_fullsized":"2023-10-08T00:33:17.675230+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:28:00.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683798+0000","last_change":"2023-10-08T00:33:17.673172+0000","last_active":"2023-10-08T00:33:17.683798+0000","last_peered":"2023-10-08T00:33:17.683798+0000","last_clean":"2023-10-08T00:33:17.683798+0000","last_became_active":"2023-10-08T00:33:17.671505+0000","last_became_peered":"2023-10-08T00:33:17.671505+0000","last_unstale":"2023-10-08T00:33:17.683798+0000","last_undegraded":"2023-10-08T00:33:17.683798+0000","last_fullsized":"2023-10-08T00:33:17.683798+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:52:26.034754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675402+0000","last_change":"2023-10-08T00:33:16.682149+0000","last_active":"2023-10-08T00:33:17.675402+0000","last_peered":"2023-10-08T00:33:17.675402+0000","last_clean":"2023-10-08T00:33:17.675402+0000","last_became_active":"2023-10-08T00:33:16.681922+0000","last_became_peered":"2023-10-08T00:33:16.681922+0000","last_unstale":"2023-10-08T00:33:17.675402+0000","last_undegraded":"2023-10-08T00:33:17.675402+0000","last_fullsized":"2023-10-08T00:33:17.675402+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:33:13.954077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687856+0000","last_change":"2023-10-08T00:33:17.676696+0000","last_active":"2023-10-08T00:33:17.687856+0000","last_peered":"2023-10-08T00:33:17.687856+0000","last_clean":"2023-10-08T00:33:17.687856+0000","last_became_active":"2023-10-08T00:33:17.676377+0000","last_became_peered":"2023-10-08T00:33:17.676377+0000","last_unstale":"2023-10-08T00:33:17.687856+0000","last_undegraded":"2023-10-08T00:33:17.687856+0000","last_fullsized":"2023-10-08T00:33:17.687856+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:36:59.311376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.667381+0000","last_change":"2023-10-08T00:33:16.678988+0000","last_active":"2023-10-08T00:33:17.667381+0000","last_peered":"2023-10-08T00:33:17.667381+0000","last_clean":"2023-10-08T00:33:17.667381+0000","last_became_active":"2023-10-08T00:33:16.678269+0000","last_became_peered":"2023-10-08T00:33:16.678269+0000","last_unstale":"2023-10-08T00:33:17.667381+0000","last_undegraded":"2023-10-08T00:33:17.667381+0000","last_fullsized":"2023-10-08T00:33:17.667381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:53:14.203458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675779+0000","last_change":"2023-10-08T00:33:17.673603+0000","last_active":"2023-10-08T00:33:17.675779+0000","last_peered":"2023-10-08T00:33:17.675779+0000","last_clean":"2023-10-08T00:33:17.675779+0000","last_became_active":"2023-10-08T00:33:17.673352+0000","last_became_peered":"2023-10-08T00:33:17.673352+0000","last_unstale":"2023-10-08T00:33:17.675779+0000","last_undegraded":"2023-10-08T00:33:17.675779+0000","last_fullsized":"2023-10-08T00:33:17.675779+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:40.285005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.691417+0000","last_change":"2023-10-08T00:33:16.680035+0000","last_active":"2023-10-08T00:33:17.691417+0000","last_peered":"2023-10-08T00:33:17.691417+0000","last_clean":"2023-10-08T00:33:17.691417+0000","last_became_active":"2023-10-08T00:33:16.679700+0000","last_became_peered":"2023-10-08T00:33:16.679700+0000","last_unstale":"2023-10-08T00:33:17.691417+0000","last_undegraded":"2023-10-08T00:33:17.691417+0000","last_fullsized":"2023-10-08T00:33:17.691417+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:54.096948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.682527+0000","last_change":"2023-10-08T00:33:17.677407+0000","last_active":"2023-10-08T00:33:17.682527+0000","last_peered":"2023-10-08T00:33:17.682527+0000","last_clean":"2023-10-08T00:33:17.682527+0000","last_became_active":"2023-10-08T00:33:17.677141+0000","last_became_peered":"2023-10-08T00:33:17.677141+0000","last_unstale":"2023-10-08T00:33:17.682527+0000","last_undegraded":"2023-10-08T00:33:17.682527+0000","last_fullsized":"2023-10-08T00:33:17.682527+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:48:06.680146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"168'1","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-08T00:33:19.520404+0000","last_change":"2023-10-08T00:33:16.674209+0000","last_active":"2023-10-08T00:33:19.520404+0000","last_peered":"2023-10-08T00:33:19.520404+0000","last_clean":"2023-10-08T00:33:19.520404+0000","last_became_active":"2023-10-08T00:33:16.673649+0000","last_became_peered":"2023-10-08T00:33:16.673649+0000","last_unstale":"2023-10-08T00:33:19.520404+0000","last_undegraded":"2023-10-08T00:33:19.520404+0000","last_fullsized":"2023-10-08T00:33:19.520404+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:02:08.378431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.683485+0000","last_change":"2023-10-08T00:33:17.679548+0000","last_active":"2023-10-08T00:33:17.683485+0000","last_peered":"2023-10-08T00:33:17.683485+0000","last_clean":"2023-10-08T00:33:17.683485+0000","last_became_active":"2023-10-08T00:33:17.679124+0000","last_became_peered":"2023-10-08T00:33:17.679124+0000","last_unstale":"2023-10-08T00:33:17.683485+0000","last_undegraded":"2023-10-08T00:33:17.683485+0000","last_fullsized":"2023-10-08T00:33:17.683485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:57.013505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.676555+0000","last_change":"2023-10-08T00:33:16.677196+0000","last_active":"2023-10-08T00:33:17.676555+0000","last_peered":"2023-10-08T00:33:17.676555+0000","last_clean":"2023-10-08T00:33:17.676555+0000","last_became_active":"2023-10-08T00:33:16.676889+0000","last_became_peered":"2023-10-08T00:33:16.676889+0000","last_unstale":"2023-10-08T00:33:17.676555+0000","last_undegraded":"2023-10-08T00:33:17.676555+0000","last_fullsized":"2023-10-08T00:33:17.676555+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:37:56.529504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.678385+0000","last_change":"2023-10-08T00:33:17.672623+0000","last_active":"2023-10-08T00:33:17.678385+0000","last_peered":"2023-10-08T00:33:17.678385+0000","last_clean":"2023-10-08T00:33:17.678385+0000","last_became_active":"2023-10-08T00:33:17.672319+0000","last_became_peered":"2023-10-08T00:33:17.672319+0000","last_unstale":"2023-10-08T00:33:17.678385+0000","last_undegraded":"2023-10-08T00:33:17.678385+0000","last_fullsized":"2023-10-08T00:33:17.678385+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:55:20.646189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.666991+0000","last_change":"2023-10-08T00:33:16.677082+0000","last_active":"2023-10-08T00:33:17.666991+0000","last_peered":"2023-10-08T00:33:17.666991+0000","last_clean":"2023-10-08T00:33:17.666991+0000","last_became_active":"2023-10-08T00:33:16.676553+0000","last_became_peered":"2023-10-08T00:33:16.676553+0000","last_unstale":"2023-10-08T00:33:17.666991+0000","last_undegraded":"2023-10-08T00:33:17.666991+0000","last_fullsized":"2023-10-08T00:33:17.666991+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:42:16.584682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.680620+0000","last_change":"2023-10-08T00:33:17.671212+0000","last_active":"2023-10-08T00:33:17.680620+0000","last_peered":"2023-10-08T00:33:17.680620+0000","last_clean":"2023-10-08T00:33:17.680620+0000","last_became_active":"2023-10-08T00:33:17.670769+0000","last_became_peered":"2023-10-08T00:33:17.670769+0000","last_unstale":"2023-10-08T00:33:17.680620+0000","last_undegraded":"2023-10-08T00:33:17.680620+0000","last_fullsized":"2023-10-08T00:33:17.680620+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:01.139604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.675308+0000","last_change":"2023-10-08T00:33:16.680790+0000","last_active":"2023-10-08T00:33:17.675308+0000","last_peered":"2023-10-08T00:33:17.675308+0000","last_clean":"2023-10-08T00:33:17.675308+0000","last_became_active":"2023-10-08T00:33:16.680489+0000","last_became_peered":"2023-10-08T00:33:16.680489+0000","last_unstale":"2023-10-08T00:33:17.675308+0000","last_undegraded":"2023-10-08T00:33:17.675308+0000","last_fullsized":"2023-10-08T00:33:17.675308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:01:42.536494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690515+0000","last_change":"2023-10-08T00:33:17.685264+0000","last_active":"2023-10-08T00:33:17.690515+0000","last_peered":"2023-10-08T00:33:17.690515+0000","last_clean":"2023-10-08T00:33:17.690515+0000","last_became_active":"2023-10-08T00:33:17.684996+0000","last_became_peered":"2023-10-08T00:33:17.684996+0000","last_unstale":"2023-10-08T00:33:17.690515+0000","last_undegraded":"2023-10-08T00:33:17.690515+0000","last_fullsized":"2023-10-08T00:33:17.690515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:30:01.139604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.665490+0000","last_change":"2023-10-08T00:33:16.667354+0000","last_active":"2023-10-08T00:33:17.665490+0000","last_peered":"2023-10-08T00:33:17.665490+0000","last_clean":"2023-10-08T00:33:17.665490+0000","last_became_active":"2023-10-08T00:33:16.667062+0000","last_became_peered":"2023-10-08T00:33:16.667062+0000","last_unstale":"2023-10-08T00:33:17.665490+0000","last_undegraded":"2023-10-08T00:33:17.665490+0000","last_fullsized":"2023-10-08T00:33:17.665490+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:32:24.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690450+0000","last_change":"2023-10-08T00:33:17.685137+0000","last_active":"2023-10-08T00:33:17.690450+0000","last_peered":"2023-10-08T00:33:17.690450+0000","last_clean":"2023-10-08T00:33:17.690450+0000","last_became_active":"2023-10-08T00:33:17.684870+0000","last_became_peered":"2023-10-08T00:33:17.684870+0000","last_unstale":"2023-10-08T00:33:17.690450+0000","last_undegraded":"2023-10-08T00:33:17.690450+0000","last_fullsized":"2023-10-08T00:33:17.690450+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:05:02.602268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.663779+0000","last_change":"2023-10-08T00:33:16.678604+0000","last_active":"2023-10-08T00:33:17.663779+0000","last_peered":"2023-10-08T00:33:17.663779+0000","last_clean":"2023-10-08T00:33:17.663779+0000","last_became_active":"2023-10-08T00:33:16.678234+0000","last_became_peered":"2023-10-08T00:33:16.678234+0000","last_unstale":"2023-10-08T00:33:17.663779+0000","last_undegraded":"2023-10-08T00:33:17.663779+0000","last_fullsized":"2023-10-08T00:33:17.663779+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:16:15.994941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.690007+0000","last_change":"2023-10-08T00:33:17.683622+0000","last_active":"2023-10-08T00:33:17.690007+0000","last_peered":"2023-10-08T00:33:17.690007+0000","last_clean":"2023-10-08T00:33:17.690007+0000","last_became_active":"2023-10-08T00:33:17.683153+0000","last_became_peered":"2023-10-08T00:33:17.683153+0000","last_unstale":"2023-10-08T00:33:17.690007+0000","last_undegraded":"2023-10-08T00:33:17.690007+0000","last_fullsized":"2023-10-08T00:33:17.690007+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:44:00.811215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.667486+0000","last_change":"2023-10-08T00:33:16.678700+0000","last_active":"2023-10-08T00:33:17.667486+0000","last_peered":"2023-10-08T00:33:17.667486+0000","last_clean":"2023-10-08T00:33:17.667486+0000","last_became_active":"2023-10-08T00:33:16.677754+0000","last_became_peered":"2023-10-08T00:33:16.677754+0000","last_unstale":"2023-10-08T00:33:17.667486+0000","last_undegraded":"2023-10-08T00:33:17.667486+0000","last_fullsized":"2023-10-08T00:33:17.667486+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:39.994850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.685048+0000","last_change":"2023-10-08T00:33:17.678325+0000","last_active":"2023-10-08T00:33:17.685048+0000","last_peered":"2023-10-08T00:33:17.685048+0000","last_clean":"2023-10-08T00:33:17.685048+0000","last_became_active":"2023-10-08T00:33:17.678049+0000","last_became_peered":"2023-10-08T00:33:17.678049+0000","last_unstale":"2023-10-08T00:33:17.685048+0000","last_undegraded":"2023-10-08T00:33:17.685048+0000","last_fullsized":"2023-10-08T00:33:17.685048+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:16.652300+0000","last_clean_scrub_stamp":"2023-10-08T00:33:16.652300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:22.343092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.687332+0000","last_change":"2023-10-08T00:33:16.682289+0000","last_active":"2023-10-08T00:33:17.687332+0000","last_peered":"2023-10-08T00:33:17.687332+0000","last_clean":"2023-10-08T00:33:17.687332+0000","last_became_active":"2023-10-08T00:33:16.681999+0000","last_became_peered":"2023-10-08T00:33:16.681999+0000","last_unstale":"2023-10-08T00:33:17.687332+0000","last_undegraded":"2023-10-08T00:33:17.687332+0000","last_fullsized":"2023-10-08T00:33:17.687332+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:15.650074+0000","last_clean_scrub_stamp":"2023-10-08T00:33:15.650074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:54.304217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":286,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T00:33:17.670615+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:17.670615+0000","last_peered":"2023-10-08T00:33:17.670615+0000","last_clean":"2023-10-08T00:33:17.670615+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:17.670615+0000","last_undegraded":"2023-10-08T00:33:17.670615+0000","last_fullsized":"2023-10-08T00:33:17.670615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304048,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067792,"statfs":{"total":96636764160,"available":96325419008,"internally_reserved":0,"allocated":2727936,"data_stored":1544670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.80100000000000005}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.68200000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.752}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.77900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303472,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068368,"statfs":{"total":96636764160,"available":96326008832,"internally_reserved":0,"allocated":2138112,"data_stored":954288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.71799999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.629}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.53000000000000003}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.49299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":954322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.32100000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.61799999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.628}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304052,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067788,"statfs":{"total":96636764160,"available":96325414912,"internally_reserved":0,"allocated":2732032,"data_stored":1545244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.33500000000000002,"15min":0.35599999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.36299999999999999,"15min":0.35999999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.623,"5min":0.623,"15min":0.63700000000000001},"last":0.26300000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.375,"15min":0.379},"min":{"1min":0.249,"5min":0.245,"15min":0.245},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.377,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.63100000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.36899999999999999,"15min":0.376},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.42399999999999999,"15min":0.42499999999999999},"min":{"1min":0.36199999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.33500000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.877,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.53400000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42099999999999999,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.81100000000000005,"5min":0.88100000000000001,"15min":1.242},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.627,"15min":0.624},"min":{"1min":0.501,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83699999999999997,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.503}]},{"osd":6,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.60399999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.435,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54900000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.48699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":1.0529999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61599999999999999,"15min":0.63100000000000001},"min":{"1min":0.45500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.84599999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303484,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068356,"statfs":{"total":96636764160,"available":96325996544,"internally_reserved":0,"allocated":2150400,"data_stored":955824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.251},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.32400000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.34599999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.59499999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.48199999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.54500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303480,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068360,"statfs":{"total":96636764160,"available":96326000640,"internally_reserved":0,"allocated":2146304,"data_stored":955838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.46300000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.38},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.48799999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.436},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.754}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.70999999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":954786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.69599999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.63600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.46700000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303464,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068376,"statfs":{"total":96636764160,"available":96326017024,"internally_reserved":0,"allocated":2129920,"data_stored":954232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65400000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.64100000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:26.723 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:33:26.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:33:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.882+0000 7f679cd29700 1 Processor -- start 2023-10-08T00:33:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.882+0000 7f679cd29700 1 -- start start 2023-10-08T00:33:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f679cd29700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67980cbb90 0x7f67980af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f679cd29700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980af860 con 0x7f6798159950 2023-10-08T00:33:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f679cd29700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980ce380 con 0x7f6798069c70 2023-10-08T00:33:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f679cd29700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67980cec20 con 0x7f67980cbb90 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f6796d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67980cbb90 0x7f67980af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f679659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6798159950 0x7f6798069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47752/0 (socket says 172.21.15.22:47752) 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.883+0000 7f679659c700 1 -- 172.21.15.22:0/3866486077 learned_addr learned my addr 172.21.15.22:0/3866486077 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f6796d9d700 1 -- 172.21.15.22:0/3866486077 >> v1:172.21.15.192:6789/0 conn(0x7f6798069c70 legacy=0x7f67980cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f6796d9d700 1 -- 172.21.15.22:0/3866486077 >> v1:172.21.15.22:6789/0 conn(0x7f6798159950 legacy=0x7f6798069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f679559a700 1 -- 172.21.15.22:0/3866486077 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694614254 0 0) 0x7f67980af860 con 0x7f6798159950 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f6796d9d700 1 -- 172.21.15.22:0/3866486077 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67980cbfb0 con 0x7f67980cbb90 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f6796d9d700 1 --2- 172.21.15.22:0/3866486077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f67980af320 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f67900098e0 tx=0x7f67900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ef38998d1e3527 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f679559a700 1 -- 172.21.15.22:0/3866486077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790009e80 con 0x7f67980cbb90 2023-10-08T00:33:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f679559a700 1 -- 172.21.15.22:0/3866486077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679000b820 con 0x7f67980cbb90 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f679559a700 1 -- 172.21.15.22:0/3866486077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679000bba0 con 0x7f67980cbb90 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f679cd29700 1 -- 172.21.15.22:0/3866486077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 msgr2=0x7f67980af320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.884+0000 7f679cd29700 1 --2- 172.21.15.22:0/3866486077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f67980af320 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f67900098e0 tx=0x7f67900091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.885+0000 7f679cd29700 1 -- 172.21.15.22:0/3866486077 shutdown_connections 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.885+0000 7f679cd29700 1 --2- 172.21.15.22:0/3866486077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f67980af320 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.885+0000 7f679cd29700 1 -- 172.21.15.22:0/3866486077 >> 172.21.15.22:0/3866486077 conn(0x7f6798068e00 msgr2=0x7f67980d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.885+0000 7f679cd29700 1 -- 172.21.15.22:0/3866486077 shutdown_connections 2023-10-08T00:33:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.885+0000 7f679cd29700 1 -- 172.21.15.22:0/3866486077 wait complete. 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.886+0000 7f679cd29700 1 Processor -- start 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.886+0000 7f679cd29700 1 -- start start 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.886+0000 7f679cd29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6798069c70 0x7f67980c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.886+0000 7f679cd29700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f679815ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.886+0000 7f679cd29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6798159950 0x7f679813fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f679cd29700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67980c7da0 con 0x7f67980cbb90 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f679cd29700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67980b5d50 con 0x7f6798069c70 2023-10-08T00:33:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f679cd29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67980ca1c0 con 0x7f6798159950 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f679815ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f679815ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56014/0 (socket says 172.21.15.22:56014) 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 -- 172.21.15.22:0/2161517755 learned_addr learned my addr 172.21.15.22:0/2161517755 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f679659c700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6798069c70 0x7f67980c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6796d9d700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6798159950 0x7f679813fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 -- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6798159950 msgr2=0x7f679813fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6798159950 0x7f679813fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 -- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6798069c70 msgr2=0x7f67980c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6798069c70 0x7f67980c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 -- 172.21.15.22:0/2161517755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790009420 con 0x7f67980cbb90 2023-10-08T00:33:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6796d9d700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6798159950 0x7f679813fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f6795d9b700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f679815ff60 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f678000c5d0 tx=0x7f6780007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780011590 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6780011710 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67980ca4a0 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6780011ad0 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.887+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67981604a0 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.888+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67981606c0 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.889+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f678001c460 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.889+0000 7f678e7fc700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6778067320 0x7f67780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.889+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f67800849a0 con 0x7f67980cbb90 2023-10-08T00:33:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.890+0000 7f679659c700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6778067320 0x7f67780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.890+0000 7f679659c700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6778067320 0x7f67780697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6788007240 tx=0x7f6788001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:26.894+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67800515f0 con 0x7f67980cbb90 2023-10-08T00:33:27.166 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.165+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f67980b5810 con 0x7f67980cbb90 2023-10-08T00:33:27.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.169+0000 7f678e7fc700 1 -- 172.21.15.22:0/2161517755 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6780054c10 con 0x7f67980cbb90 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6778067320 msgr2=0x7f67780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6778067320 0x7f67780697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6788007240 tx=0x7f6788001970 comp rx=0 tx=0).stop 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 msgr2=0x7f679815ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f679815ff60 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f678000c5d0 tx=0x7f6780007f60 comp rx=0 tx=0).stop 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 shutdown_connections 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6778067320 0x7f67780697d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6798159950 0x7f679813fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6798069c70 0x7f67980c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 --2- 172.21.15.22:0/2161517755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67980cbb90 0x7f679815ff60 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 >> 172.21.15.22:0/2161517755 conn(0x7f6798068e00 msgr2=0x7f67980b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:27.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 shutdown_connections 2023-10-08T00:33:27.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.171+0000 7f679cd29700 1 -- 172.21.15.22:0/2161517755 wait complete. 2023-10-08T00:33:27.173 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:33:27.183 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:27.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.302+0000 7fec18bdd700 1 Processor -- start 2023-10-08T00:33:27.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.302+0000 7fec18bdd700 1 -- start start 2023-10-08T00:33:27.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec18bdd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec141597f0 0x7fec140b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:27.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec18bdd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec1415d230 0x7fec1415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:27.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec18bdd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1415db70 con 0x7fec14159420 2023-10-08T00:33:27.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec18bdd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec140b11d0 con 0x7fec1415d230 2023-10-08T00:33:27.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec18bdd700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec140b14b0 con 0x7fec141597f0 2023-10-08T00:33:27.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec13fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec1415d230 0x7fec1415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec137fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fec14159420 0x7fec140b5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47768/0 (socket says 172.21.15.22:47768) 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec137fe700 1 -- 172.21.15.22:0/2893912503 learned_addr learned my addr 172.21.15.22:0/2893912503 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec12ffd700 1 --2- 172.21.15.22:0/2893912503 >> v2:172.21.15.192:3300/0 conn(0x7fec141597f0 0x7fec140b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec13fff700 1 -- 172.21.15.22:0/2893912503 >> v2:172.21.15.192:3300/0 conn(0x7fec141597f0 msgr2=0x7fec140b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec13fff700 1 --2- 172.21.15.22:0/2893912503 >> v2:172.21.15.192:3300/0 conn(0x7fec141597f0 0x7fec140b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec13fff700 1 -- 172.21.15.22:0/2893912503 >> v1:172.21.15.22:6789/0 conn(0x7fec14159420 legacy=0x7fec140b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec127fc700 1 -- 172.21.15.22:0/2893912503 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049442046 0 0) 0x7fec1415db70 con 0x7fec14159420 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec13fff700 1 -- 172.21.15.22:0/2893912503 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec140b1790 con 0x7fec1415d230 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.303+0000 7fec12ffd700 1 --2- 172.21.15.22:0/2893912503 >> v2:172.21.15.192:3300/0 conn(0x7fec141597f0 0x7fec140b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:27.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec13fff700 1 --2- 172.21.15.22:0/2893912503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec1415d630 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fec14089750 tx=0x7fec0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2d48519d19eebe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec127fc700 1 -- 172.21.15.22:0/2893912503 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c00e070 con 0x7fec1415d230 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec127fc700 1 -- 172.21.15.22:0/2893912503 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c00bc30 con 0x7fec1415d230 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec127fc700 1 -- 172.21.15.22:0/2893912503 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c012430 con 0x7fec1415d230 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 -- 172.21.15.22:0/2893912503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 msgr2=0x7fec1415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 --2- 172.21.15.22:0/2893912503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec1415d630 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fec14089750 tx=0x7fec0c009780 comp rx=0 tx=0).stop 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 -- 172.21.15.22:0/2893912503 shutdown_connections 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 --2- 172.21.15.22:0/2893912503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec1415d630 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 --2- 172.21.15.22:0/2893912503 >> v2:172.21.15.192:3300/0 conn(0x7fec141597f0 0x7fec140b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 -- 172.21.15.22:0/2893912503 >> 172.21.15.22:0/2893912503 conn(0x7fec140d0660 msgr2=0x7fec140d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 -- 172.21.15.22:0/2893912503 shutdown_connections 2023-10-08T00:33:27.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.304+0000 7fec18bdd700 1 -- 172.21.15.22:0/2893912503 wait complete. 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 Processor -- start 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 -- start start 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec14159420 0x7fec14154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec141597f0 0x7fec1414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec140b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec141554f0 con 0x7fec1415d230 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14154b20 con 0x7fec141597f0 2023-10-08T00:33:27.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.306+0000 7fec18bdd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec14153f10 con 0x7fec14159420 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec140b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec140b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56028/0 (socket says 172.21.15.22:56028) 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 -- 172.21.15.22:0/4079081264 learned_addr learned my addr 172.21.15.22:0/4079081264 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec137fe700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec14159420 0x7fec14154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec12ffd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec141597f0 0x7fec1414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 -- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec14159420 msgr2=0x7fec14154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec14159420 0x7fec14154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 -- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec141597f0 msgr2=0x7fec1414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec141597f0 0x7fec1414f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 -- 172.21.15.22:0/4079081264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c009a20 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec13fff700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec140b4e20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fec0c013000 tx=0x7fec0c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c027470 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c027610 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec141541f0 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0279d0 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.307+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec141547b0 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.308+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec140d01f0 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.309+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fec0c024070 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.309+0000 7febfb7fe700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec00067320 0x7fec000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.309+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fec0c0873e0 con 0x7fec1415d230 2023-10-08T00:33:27.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.309+0000 7fec137fe700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec00067320 0x7fec000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:27.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.310+0000 7fec137fe700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec00067320 0x7fec000697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fec04007fd0 tx=0x7fec04007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:27.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.314+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec0c054070 con 0x7fec1415d230 2023-10-08T00:33:27.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.555+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec1404c410 con 0x7fec1415d230 2023-10-08T00:33:27.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.556+0000 7febfb7fe700 1 -- 172.21.15.22:0/4079081264 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4604 (secure 0 0 0) 0x7fec0c057690 con 0x7fec1415d230 2023-10-08T00:33:27.556 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:27.557 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:20.684582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec00067320 msgr2=0x7fec000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec00067320 0x7fec000697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fec04007fd0 tx=0x7fec04007d30 comp rx=0 tx=0).stop 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 msgr2=0x7fec140b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec140b4e20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fec0c013000 tx=0x7fec0c019000 comp rx=0 tx=0).stop 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 shutdown_connections 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec1415d230 0x7fec140b4e20 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fec00067320 0x7fec000697d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec14159420 0x7fec14154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 --2- 172.21.15.22:0/4079081264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec141597f0 0x7fec1414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:27.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 >> 172.21.15.22:0/4079081264 conn(0x7fec140d0660 msgr2=0x7fec14157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:27.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 shutdown_connections 2023-10-08T00:33:27.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:27.558+0000 7fec18bdd700 1 -- 172.21.15.22:0/4079081264 wait complete. 2023-10-08T00:33:27.560 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 115 2023-10-08T00:33:27.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 115, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:33:17.064425+0000', 'modified': '2023-10-08T00:33:20.684582+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8271}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8271': {'gid': 8271, 'name': 'a', 'rank': 0, 'incarnation': 111, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6834/730688681', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6832', 'nonce': 730688681}, {'type': 'v1', 'addr': '172.21.15.22:6834', 'nonce': 730688681}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:33:27.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:33:27.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T00:33:28.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.096+0000 7f5b62d26700 1 Processor -- start 2023-10-08T00:33:28.096 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.096+0000 7f5b62d26700 1 -- start start 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b62d26700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b5c159890 0x7f5b5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b62d26700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159c60 0x7f5b5c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b62d26700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c15a160 con 0x7f5b5c15db10 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b62d26700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c0d13a0 con 0x7f5b5c159890 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b62d26700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c15e140 con 0x7f5b5c159c60 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b5c159890 0x7f5b5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b612c3700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5b5c15db10 0x7f5b5c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47776/0 (socket says 172.21.15.22:47776) 2023-10-08T00:33:28.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b612c3700 1 -- 172.21.15.22:0/3643016913 learned_addr learned my addr 172.21.15.22:0/3643016913 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b5c159890 0x7f5b5c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56042/0 (socket says 172.21.15.22:56042) 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159c60 0x7f5b5c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 -- 172.21.15.22:0/3643016913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159c60 msgr2=0x7f5b5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159c60 0x7f5b5c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 -- 172.21.15.22:0/3643016913 >> v1:172.21.15.22:6789/0 conn(0x7f5b5c15db10 legacy=0x7f5b5c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 -- 172.21.15.22:0/3643016913 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c15a3d0 con 0x7f5b5c159890 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b5b7fe700 1 -- 172.21.15.22:0/3643016913 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351913253 0 0) 0x7f5b5c15a160 con 0x7f5b5c15db10 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159c60 0x7f5b5c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159890 0x7f5b5c15abd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0098e0 tx=0x7f5b4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf4397ef80653b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b5b7fe700 1 -- 172.21.15.22:0/3643016913 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c009e80 con 0x7f5b5c159890 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b5b7fe700 1 -- 172.21.15.22:0/3643016913 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c00b860 con 0x7f5b5c159890 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.097+0000 7f5b5b7fe700 1 -- 172.21.15.22:0/3643016913 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c00bbe0 con 0x7f5b5c159890 2023-10-08T00:33:28.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 -- 172.21.15.22:0/3643016913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159890 msgr2=0x7f5b5c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159890 0x7f5b5c15abd0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0098e0 tx=0x7f5b4c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 -- 172.21.15.22:0/3643016913 shutdown_connections 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159890 0x7f5b5c15abd0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 --2- 172.21.15.22:0/3643016913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159c60 0x7f5b5c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 -- 172.21.15.22:0/3643016913 >> 172.21.15.22:0/3643016913 conn(0x7f5b5c068e20 msgr2=0x7f5b5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 -- 172.21.15.22:0/3643016913 shutdown_connections 2023-10-08T00:33:28.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.098+0000 7f5b62d26700 1 -- 172.21.15.22:0/3643016913 wait complete. 2023-10-08T00:33:28.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.099+0000 7f5b62d26700 1 Processor -- start 2023-10-08T00:33:28.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.099+0000 7f5b62d26700 1 -- start start 2023-10-08T00:33:28.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b62d26700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159890 0x7f5b5c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.103 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b62d26700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 0x7f5b5c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b62d26700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5c15db10 0x7f5b5c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b62d26700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c152390 con 0x7f5b5c159c60 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b62d26700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c152670 con 0x7f5b5c15db10 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b62d26700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c152950 con 0x7f5b5c159890 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 0x7f5b5c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 0x7f5b5c0b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56058/0 (socket says 172.21.15.22:56058) 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 -- 172.21.15.22:0/91277433 learned_addr learned my addr 172.21.15.22:0/91277433 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159890 0x7f5b5c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b612c3700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5c15db10 0x7f5b5c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 -- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159890 msgr2=0x7f5b5c15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.104 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159890 0x7f5b5c15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 -- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5c15db10 msgr2=0x7f5b5c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5c15db10 0x7f5b5c0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.100+0000 7f5b5bfff700 1 -- 172.21.15.22:0/91277433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c009420 con 0x7f5b5c159c60 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.101+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 0x7f5b5c0b5ed0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000c880 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.101+0000 7f5b58ff9700 1 -- 172.21.15.22:0/91277433 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50011600 con 0x7f5b5c159c60 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.101+0000 7f5b58ff9700 1 -- 172.21.15.22:0/91277433 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50011760 con 0x7f5b5c159c60 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.101+0000 7f5b58ff9700 1 -- 172.21.15.22:0/91277433 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50011ae0 con 0x7f5b5c159c60 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.101+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c152c30 con 0x7f5b5c159c60 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.101+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c0b6410 con 0x7f5b5c159c60 2023-10-08T00:33:28.105 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.103+0000 7f5b58ff9700 1 -- 172.21.15.22:0/91277433 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5b500073d0 con 0x7f5b5c159c60 2023-10-08T00:33:28.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.103+0000 7f5b58ff9700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b48067320 0x7f5b480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.106 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.103+0000 7f5b58ff9700 1 -- 172.21.15.22:0/91277433 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b50084dc0 con 0x7f5b5c159c60 2023-10-08T00:33:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.103+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b48067320 0x7f5b480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.104+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b48067320 0x7f5b480697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0091e0 tx=0x7f5b4c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.105+0000 7f5b6c01eb80 1 Processor -- start 2023-10-08T00:33:28.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.105+0000 7f5b6c01eb80 1 -- start start 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7e7ba50 0x55dda7e7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ea4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7e77cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7dd2a70 con 0x55dda7ec5d00 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7dd0270 con 0x55dda7ea4f60 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda7dcc060 con 0x55dda7e7ba50 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ea4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ea4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56072/0 (socket says 172.21.15.22:56072) 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 -- 172.21.15.22:0/3462882780 learned_addr learned my addr 172.21.15.22:0/3462882780 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7e7ba50 0x55dda7e7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b612c3700 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7e77cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 -- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7e7ba50 msgr2=0x55dda7e7be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7e7ba50 0x55dda7e7be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 -- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 msgr2=0x55dda7e77cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7e77cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 -- 172.21.15.22:0/3462882780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda7c66270 con 0x55dda7ec5d00 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b612c3700 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7e77cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ea4a20 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f5b50082c90 tx=0x7f5b50051a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646dd513bbca4165 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b41ffb700 1 -- 172.21.15.22:0/3462882780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50058850 con 0x55dda7ec5d00 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b41ffb700 1 -- 172.21.15.22:0/3462882780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5005c5a0 con 0x55dda7ec5d00 2023-10-08T00:33:28.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.106+0000 7f5b41ffb700 1 -- 172.21.15.22:0/3462882780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50054af0 con 0x55dda7ec5d00 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/3462882780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 msgr2=0x55dda7ea4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ea4a20 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f5b50082c90 tx=0x7f5b50051a70 comp rx=0 tx=0).stop 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/3462882780 shutdown_connections 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7e77cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7e7ba50 0x55dda7e7be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/3462882780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ea4a20 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/3462882780 >> 172.21.15.22:0/3462882780 conn(0x55dda7e7d370 msgr2=0x55dda7e7d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/3462882780 shutdown_connections 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.107+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/3462882780 wait complete. 2023-10-08T00:33:28.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.108+0000 7f5b6c01eb80 1 -- start start 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.108+0000 7f5b6c01eb80 1 Processor -- start 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.108+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 0x55dda7ebd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e76c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7d77890 con 0x55dda7ea4f60 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7d92ea0 con 0x55dda7e7ba50 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda7c4ee30 con 0x55dda7ec5d00 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 10 client.0 _ll_register_callbacks cb 0x55dda7e3f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 0x55dda7ebd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 0x55dda7ebd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56080/0 (socket says 172.21.15.22:56080) 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 -- 172.21.15.22:0/797688238 learned_addr learned my addr 172.21.15.22:0/797688238 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b612c3700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e76c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 -- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 msgr2=0x55dda7e76c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e76c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 -- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 msgr2=0x55dda7ec2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 -- 172.21.15.22:0/797688238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c0b6410 con 0x55dda7ea4f60 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b5bfff700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 0x55dda7ebd910 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000cfd0 tx=0x7f5b5006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8652b15124a609bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b3affd700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b3affd700 1 -- 172.21.15.22:0/797688238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b50071240 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b3affd700 1 -- 172.21.15.22:0/797688238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b5005deb0 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dda7e70b70 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b3affd700 1 -- 172.21.15.22:0/797688238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b50055600 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 10 client.8454 fetch_fsmap learned FSMap version 115 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.109+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x55dda7c08fe0 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b3affd700 1 -- 172.21.15.22:0/797688238 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dda7e70b70 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b3affd700 1 -- 172.21.15.22:0/797688238 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 115) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5b50063050 con 0x55dda7ea4f60 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b6c01eb80 10 client.8454 fetch_fsmap finished waiting for FSMap version 115 2023-10-08T00:33:28.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b6c01eb80 10 client.8454 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b6c01eb80 20 client.8454 populate_metadata read hostname 'smithi022' 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ed54b0 0x55dda7ed5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b6c01eb80 4 client.8454 mds_command: new command op to 8271 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 --> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dda7e4daa0 con 0x55dda7ed54b0 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ed54b0 0x55dda7ed5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b3affd700 10 client.8454 ms_handle_connect on v2:172.21.15.22:6832/730688681 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.110+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ed54b0 0x55dda7ed5880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af8dc42cca607d46 server_cookie=2c0a3ac4f7087c6b in_seq=0 out_seq=0 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b3affd700 1 -- 172.21.15.22:0/797688238 <== mds.0 v2:172.21.15.22:6832/730688681 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dda7e4daa0 con 0x55dda7ed54b0 2023-10-08T00:33:28.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b3affd700 10 client.8454 handle_command_reply: tid=0 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 client.8454 shutdown 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 msgr2=0x55dda7ebd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 0x55dda7ebd910 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000cfd0 tx=0x7f5b5006d000 comp rx=0 tx=0).stop 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 shutdown_connections 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ed54b0 0x55dda7ed5880 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e76c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b3affd700 0 client.8454 ms_handle_reset on v2:172.21.15.22:6832/730688681 2023-10-08T00:33:28.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/797688238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ea4f60 0x55dda7ebd910 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 >> 172.21.15.22:0/797688238 conn(0x55dda7e7d370 msgr2=0x55dda7ec1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 shutdown_connections 2023-10-08T00:33:28.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/797688238 wait complete. 2023-10-08T00:33:28.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.111+0000 7f5b6c01eb80 20 client.8454 trim_cache size 0 max 16384 2023-10-08T00:33:28.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.128+0000 7f5b6c01eb80 1 Processor -- start 2023-10-08T00:33:28.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.128+0000 7f5b6c01eb80 1 -- start start 2023-10-08T00:33:28.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 0x55dda7ebffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7eab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e78870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7e76c20 con 0x55dda7e7ba50 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7ec7140 con 0x55dda7ea4f60 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda7e76830 con 0x55dda7ec5d00 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 0x55dda7ebffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 0x55dda7ebffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56088/0 (socket says 172.21.15.22:56088) 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 -- 172.21.15.22:0/1232586265 learned_addr learned my addr 172.21.15.22:0/1232586265 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 -- 172.21.15.22:0/1232586265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 msgr2=0x55dda7e78870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e78870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 -- 172.21.15.22:0/1232586265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 msgr2=0x55dda7eab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7eab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 -- 172.21.15.22:0/1232586265 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dda7d9a780 con 0x55dda7e7ba50 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 0x55dda7ebffa0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0030c0 tx=0x7f5b4c02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6969e01daa506b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b427fc700 1 -- 172.21.15.22:0/1232586265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c02f040 con 0x55dda7e7ba50 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b427fc700 1 -- 172.21.15.22:0/1232586265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4c01ad30 con 0x55dda7e7ba50 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.129+0000 7f5b427fc700 1 -- 172.21.15.22:0/1232586265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4c033250 con 0x55dda7e7ba50 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1232586265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 msgr2=0x55dda7ebffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 0x55dda7ebffa0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0030c0 tx=0x7f5b4c02b040 comp rx=0 tx=0).stop 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1232586265 shutdown_connections 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ec5d00 0x55dda7e78870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7e7ba50 0x55dda7ebffa0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1232586265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7ea4f60 0x55dda7eab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1232586265 >> 172.21.15.22:0/1232586265 conn(0x55dda7e7d370 msgr2=0x55dda7e79b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1232586265 shutdown_connections 2023-10-08T00:33:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1232586265 wait complete. 2023-10-08T00:33:28.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.130+0000 7f5b6c01eb80 1 -- start start 2023-10-08T00:33:28.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.131+0000 7f5b6c01eb80 1 Processor -- start 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.131+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.131+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ea4f60 0x55dda7eb8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.131+0000 7f5b6c01eb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ebfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7f28710 con 0x55dda7ec5d00 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dda7f28150 con 0x55dda7e7ba50 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dda7f28430 con 0x55dda7ea4f60 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 10 client.0 _ll_register_callbacks cb 0x55dda7e3f110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ebfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ebfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56090/0 (socket says 172.21.15.22:56090) 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 -- 172.21.15.22:0/1033645716 learned_addr learned my addr 172.21.15.22:0/1033645716 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:28.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 -- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ea4f60 msgr2=0x55dda7eb8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ea4f60 0x55dda7eb8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 -- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 msgr2=0x55dda7ec1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 -- 172.21.15.22:0/1033645716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c15a3d0 con 0x55dda7ec5d00 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b612c3700 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ebfa40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007650 tx=0x7f5b54009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709e6d251fa73775 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b3affd700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b3affd700 1 -- 172.21.15.22:0/1033645716 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54011950 con 0x55dda7ec5d00 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b3affd700 1 -- 172.21.15.22:0/1033645716 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b54011ab0 con 0x55dda7ec5d00 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b5005c5a0 con 0x55dda7ec5d00 2023-10-08T00:33:28.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b3affd700 1 -- 172.21.15.22:0/1033645716 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b54011e80 con 0x55dda7ec5d00 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 10 client.8460 fetch_fsmap learned FSMap version 115 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.132+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x55dda7d81470 con 0x55dda7ec5d00 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b3affd700 1 -- 172.21.15.22:0/1033645716 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5005c5a0 con 0x55dda7ec5d00 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b3affd700 1 -- 172.21.15.22:0/1033645716 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 115) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5b54015470 con 0x55dda7ec5d00 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 10 client.8460 fetch_fsmap finished waiting for FSMap version 115 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 10 client.8460 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 20 client.8460 populate_metadata read hostname 'smithi022' 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ec6260 0x55dda7ec6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 4 client.8460 mds_command: new command op to 8271 tid=0[{"prefix": "status"}] 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 --> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dda7d6ee00 con 0x55dda7ec6260 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ec6260 0x55dda7ec6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b3affd700 10 client.8460 ms_handle_connect on v2:172.21.15.22:6832/730688681 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b60ac2700 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ec6260 0x55dda7ec6630 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60e31f963ad28efc server_cookie=58f9b8008158d382 in_seq=0 out_seq=0 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b3affd700 1 -- 172.21.15.22:0/1033645716 <== mds.0 v2:172.21.15.22:6832/730688681 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55dda7d6ee00 con 0x55dda7ec6260 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b3affd700 10 client.8460 handle_command_reply: tid=0 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 1 client.8460 shutdown 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 msgr2=0x55dda7ebfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.133+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ebfa40 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f5b54007650 tx=0x7f5b54009040 comp rx=0 tx=0).stop 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 shutdown_connections 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:6832/730688681,v1:172.21.15.22:6834/730688681] conn(0x55dda7ec6260 0x55dda7ec6630 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dda7ec5d00 0x55dda7ebfa40 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b3affd700 0 client.8460 ms_handle_reset on v2:172.21.15.22:6832/730688681 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dda7e7ba50 0x55dda7ec1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 --2- 172.21.15.22:0/1033645716 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55dda7ea4f60 0x55dda7eb8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 >> 172.21.15.22:0/1033645716 conn(0x55dda7e7d370 msgr2=0x55dda7eab530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 shutdown_connections 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 1 -- 172.21.15.22:0/1033645716 wait complete. 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b6c01eb80 20 client.8460 trim_cache size 0 max 16384 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 8271, 2023-10-08T00:33:28.141 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.474932772000001, 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 115, 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 168, 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 168, 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 16.091586397 2023-10-08T00:33:28.142 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:33:28.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b48067320 msgr2=0x7f5b480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b48067320 0x7f5b480697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0091e0 tx=0x7f5b4c017000 comp rx=0 tx=0).stop 2023-10-08T00:33:28.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 msgr2=0x7f5b5c0b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 0x7f5b5c0b5ed0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000c880 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2023-10-08T00:33:28.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 shutdown_connections 2023-10-08T00:33:28.143 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b5c15db10 0x7f5b5c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5b48067320 0x7f5b480697d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5b5c159890 0x7f5b5c15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 --2- 172.21.15.22:0/91277433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b5c159c60 0x7f5b5c0b5ed0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 >> 172.21.15.22:0/91277433 conn(0x7f5b5c068e20 msgr2=0x7f5b5c14d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 shutdown_connections 2023-10-08T00:33:28.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.134+0000 7f5b62d26700 1 -- 172.21.15.22:0/91277433 wait complete. 2023-10-08T00:33:28.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:33:28.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.265+0000 7fd81e988700 1 Processor -- start 2023-10-08T00:33:28.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.265+0000 7fd81e988700 1 -- start start 2023-10-08T00:33:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd81e988700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd81806bcd0 0x7fd8180caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd81e988700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81815d7e0 con 0x7fd81815df50 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd81e988700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81815dac0 con 0x7fd81806c0a0 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd81e988700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81815aa30 con 0x7fd81806bcd0 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd817fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd81806bcd0 0x7fd8180caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd81cf25700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd81815df50 0x7fd8180c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47782/0 (socket says 172.21.15.22:47782) 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.266+0000 7fd81cf25700 1 -- 172.21.15.22:0/488483362 learned_addr learned my addr 172.21.15.22:0/488483362 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd817fff700 1 -- 172.21.15.22:0/488483362 >> v1:172.21.15.192:6789/0 conn(0x7fd81806c0a0 legacy=0x7fd81815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd817fff700 1 -- 172.21.15.22:0/488483362 >> v1:172.21.15.22:6789/0 conn(0x7fd81815df50 legacy=0x7fd8180c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd817fff700 1 -- 172.21.15.22:0/488483362 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81815ad10 con 0x7fd81806bcd0 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd816ffd700 1 -- 172.21.15.22:0/488483362 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959258496 0 0) 0x7fd81815d7e0 con 0x7fd81815df50 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd817fff700 1 --2- 172.21.15.22:0/488483362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd8180caa90 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098e0 tx=0x7fd8000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29539c9bbb4f8523 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd816ffd700 1 -- 172.21.15.22:0/488483362 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800009e80 con 0x7fd81806bcd0 2023-10-08T00:33:28.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd816ffd700 1 -- 172.21.15.22:0/488483362 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000b860 con 0x7fd81806bcd0 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd816ffd700 1 -- 172.21.15.22:0/488483362 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000bbe0 con 0x7fd81806bcd0 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd81e988700 1 -- 172.21.15.22:0/488483362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 msgr2=0x7fd8180caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.267+0000 7fd81e988700 1 --2- 172.21.15.22:0/488483362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd8180caa90 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fd8000098e0 tx=0x7fd8000091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.268+0000 7fd81e988700 1 -- 172.21.15.22:0/488483362 shutdown_connections 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.268+0000 7fd81e988700 1 --2- 172.21.15.22:0/488483362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd8180caa90 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.268+0000 7fd81e988700 1 -- 172.21.15.22:0/488483362 >> 172.21.15.22:0/488483362 conn(0x7fd8180ce600 msgr2=0x7fd8180cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.268+0000 7fd81e988700 1 -- 172.21.15.22:0/488483362 shutdown_connections 2023-10-08T00:33:28.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.268+0000 7fd81e988700 1 -- 172.21.15.22:0/488483362 wait complete. 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.269+0000 7fd81e988700 1 Processor -- start 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.269+0000 7fd81e988700 1 -- start start 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.269+0000 7fd81e988700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd818155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.269+0000 7fd81e988700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd81806c0a0 0x7fd8180c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.269+0000 7fd81e988700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815df50 0x7fd8180c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81e988700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81815a6f0 con 0x7fd81806bcd0 2023-10-08T00:33:28.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81e988700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81815a260 con 0x7fd81815df50 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81e988700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd818155960 con 0x7fd81806c0a0 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd818155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd818155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56106/0 (socket says 172.21.15.22:56106) 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 -- 172.21.15.22:0/757839347 learned_addr learned my addr 172.21.15.22:0/757839347 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81cf25700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815df50 0x7fd8180c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 -- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd81806c0a0 msgr2=0x7fd8180c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd8177fe700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd81806c0a0 0x7fd8180c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd81806c0a0 0x7fd8180c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 -- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815df50 msgr2=0x7fd8180c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815df50 0x7fd8180c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 -- 172.21.15.22:0/757839347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009420 con 0x7fd81806bcd0 2023-10-08T00:33:28.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81cf25700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815df50 0x7fd8180c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd8177fe700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd81806c0a0 0x7fd8180c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd817fff700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd818155420 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd80000b3c0 tx=0x7fd800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000bbe0 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800011420 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000117e0 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8180c68e0 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.270+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd818159c10 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.271+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81804c3c0 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.272+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd800011bd0 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.272+0000 7fd80ffff700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.272+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd800086600 con 0x7fd81806bcd0 2023-10-08T00:33:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.272+0000 7fd8177fe700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:28.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.273+0000 7fd8177fe700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd8180ccef0 tx=0x7fd808009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.277+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd800053290 con 0x7fd81806bcd0 2023-10-08T00:33:28.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.515+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd81815a540 con 0x7fd81806bcd0 2023-10-08T00:33:28.516 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.516+0000 7fd80ffff700 1 -- 172.21.15.22:0/757839347 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v115) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd8000568b0 con 0x7fd81806bcd0 2023-10-08T00:33:28.516 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:33:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 msgr2=0x7fd7f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd8180ccef0 tx=0x7fd808009040 comp rx=0 tx=0).stop 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 msgr2=0x7fd818155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd818155420 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd80000b3c0 tx=0x7fd800017000 comp rx=0 tx=0).stop 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 shutdown_connections 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815df50 0x7fd8180c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81806bcd0 0x7fd818155420 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 --2- 172.21.15.22:0/757839347 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd81806c0a0 0x7fd8180c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.517+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 >> 172.21.15.22:0/757839347 conn(0x7fd8180ce600 msgr2=0x7fd81815ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.518+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 shutdown_connections 2023-10-08T00:33:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:28.518+0000 7fd81e988700 1 -- 172.21.15.22:0/757839347 wait complete. 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:33:28.530 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:33:28.531 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:33:28.531 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:33:28.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:28.531 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:33:28.546 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:33:28.546 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:33:28.546 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:33:28.546 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.546 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 41962sec preferred_lft 41962sec 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.547 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.548 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:28.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:28.549 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:33:28.610 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:33:28.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:28.612 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:33:28.669 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:33:28.669 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:33:28.669 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:33:28.669 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:33:28.670 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:33:28.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:28.670 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:33:28.670 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:33:28.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:33:28.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:33:28.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:33:28.670 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:33:28.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:28.772 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:33:28.786 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:33:28.787 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:33:28.787 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:33:28.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:28.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:33:28.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:33:28.852 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:33:28.907 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:33:28.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:33:28.908 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:33:28.962 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:33:28.962 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:33:28.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:29.043 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:29.043 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:33:29.062 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:33:29.083 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:33:29.084 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:33:29.084 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:33:29.084 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:33:29.085 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:33:29.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:33:29.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:33:29.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.310+0000 7f7bcbfa2700 1 Processor -- start 2023-10-08T00:33:29.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.310+0000 7f7bcbfa2700 1 -- start start 2023-10-08T00:33:29.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bcbfa2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7bc4159890 0x7f7bc415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:29.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bcbfa2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4069560 0x7f7bc40699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:29.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bcbfa2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc4069ee0 con 0x7f7bc4159c60 2023-10-08T00:33:29.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bcbfa2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc415a160 con 0x7f7bc4159890 2023-10-08T00:33:29.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bcbfa2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40d13a0 con 0x7f7bc4069560 2023-10-08T00:33:29.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bc9d3e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7bc4159890 0x7f7bc415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bc9d3e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7bc4159890 0x7f7bc415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56122/0 (socket says 172.21.15.22:56122) 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bc9d3e700 1 -- 172.21.15.22:0/392091319 learned_addr learned my addr 172.21.15.22:0/392091319 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bc953d700 1 --1- 172.21.15.22:0/392091319 >> v1:172.21.15.22:6789/0 conn(0x7f7bc4159c60 0x7f7bc415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47792/0 (socket says 172.21.15.22:47792) 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.311+0000 7f7bca53f700 1 --2- 172.21.15.22:0/392091319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4069560 0x7f7bc40699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc9d3e700 1 -- 172.21.15.22:0/392091319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4069560 msgr2=0x7f7bc40699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc9d3e700 1 --2- 172.21.15.22:0/392091319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4069560 0x7f7bc40699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc9d3e700 1 -- 172.21.15.22:0/392091319 >> v1:172.21.15.22:6789/0 conn(0x7f7bc4159c60 legacy=0x7f7bc415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc9d3e700 1 -- 172.21.15.22:0/392091319 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc415e140 con 0x7f7bc4159890 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc8d3c700 1 -- 172.21.15.22:0/392091319 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002264616 0 0) 0x7f7bc4069ee0 con 0x7f7bc4159c60 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc9d3e700 1 --2- 172.21.15.22:0/392091319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc415abd0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009f20 tx=0x7f7bbc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747ce6e99645fbba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:29.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc8d3c700 1 -- 172.21.15.22:0/392091319 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00e070 con 0x7f7bc4159890 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc8d3c700 1 -- 172.21.15.22:0/392091319 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00ba80 con 0x7f7bc4159890 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bc8d3c700 1 -- 172.21.15.22:0/392091319 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0092e0 con 0x7f7bc4159890 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/392091319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 msgr2=0x7f7bc415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.312+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/392091319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc415abd0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009f20 tx=0x7f7bbc009840 comp rx=0 tx=0).stop 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.313+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/392091319 shutdown_connections 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.313+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/392091319 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4069560 0x7f7bc40699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.313+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/392091319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc415abd0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.313+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/392091319 >> 172.21.15.22:0/392091319 conn(0x7f7bc4068e20 msgr2=0x7f7bc40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.313+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/392091319 shutdown_connections 2023-10-08T00:33:29.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.313+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/392091319 wait complete. 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.314+0000 7f7bcbfa2700 1 Processor -- start 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.314+0000 7f7bcbfa2700 1 -- start start 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.314+0000 7f7bcbfa2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc4069560 0x7f7bc414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.314+0000 7f7bcbfa2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc416d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.314+0000 7f7bcbfa2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4159c60 0x7f7bc40cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bcbfa2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc416dee0 con 0x7f7bc4159890 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bcbfa2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b3730 con 0x7f7bc4069560 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bcbfa2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40b3a10 con 0x7f7bc4159c60 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc416d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc416d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56136/0 (socket says 172.21.15.22:56136) 2023-10-08T00:33:29.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 -- 172.21.15.22:0/3532275483 learned_addr learned my addr 172.21.15.22:0/3532275483 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bca53f700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4159c60 0x7f7bc40cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc9d3e700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc4069560 0x7f7bc414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 -- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4159c60 msgr2=0x7f7bc40cedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4159c60 0x7f7bc40cedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 -- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc4069560 msgr2=0x7f7bc414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc4069560 0x7f7bc414ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 -- 172.21.15.22:0/3532275483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc009ae0 con 0x7f7bc4159890 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc9d3e700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc4069560 0x7f7bc414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bca53f700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4159c60 0x7f7bc40cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc953d700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc416d9a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80011e0 tx=0x7f7bb8007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8007300 con 0x7f7bc4159890 2023-10-08T00:33:29.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb8007460 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc40cd1e0 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.315+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8004830 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.316+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc40cfb90 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.316+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc40cd680 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.317+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7bb8004be0 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.317+0000 7f7bc1ffb700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bb0067320 0x7f7bb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.317+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7bb80841f0 con 0x7f7bc4159890 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.317+0000 7f7bc9d3e700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bb0067320 0x7f7bb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.318+0000 7f7bc9d3e700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bb0067320 0x7f7bb00697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009880 tx=0x7f7bbc018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.321+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bb8050ec0 con 0x7f7bc4159890 2023-10-08T00:33:29.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.562+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7bc404c3c0 con 0x7f7bc4159890 2023-10-08T00:33:29.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.562+0000 7f7bc1ffb700 1 -- 172.21.15.22:0/3532275483 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v115) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7bb80544e0 con 0x7f7bc4159890 2023-10-08T00:33:29.563 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:33:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bb0067320 msgr2=0x7f7bb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bb0067320 0x7f7bb00697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009880 tx=0x7f7bbc018000 comp rx=0 tx=0).stop 2023-10-08T00:33:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 msgr2=0x7f7bc416d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc416d9a0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80011e0 tx=0x7f7bb8007e10 comp rx=0 tx=0).stop 2023-10-08T00:33:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 shutdown_connections 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7bb0067320 0x7f7bb00697d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7bc4159c60 0x7f7bc40cedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc4069560 0x7f7bc414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 --2- 172.21.15.22:0/3532275483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bc4159890 0x7f7bc416d9a0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 >> 172.21.15.22:0/3532275483 conn(0x7f7bc4068e20 msgr2=0x7f7bc40b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 shutdown_connections 2023-10-08T00:33:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:29.564+0000 7f7bcbfa2700 1 -- 172.21.15.22:0/3532275483 wait complete. 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:33:29.577 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:33:29.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.578 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:33:29.596 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:33:29.597 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:29.598 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:33:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:33:29.598 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:29.598 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:33:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:33:29.598 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 41965sec preferred_lft 41965sec 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:33:29.599 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:33:29.600 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:33:29.601 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.601 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:33:29.601 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:33:29.601 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:33:29.601 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:33:29.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.602 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:33:29.664 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:33:29.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.666 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:33:29.724 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:33:29.725 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:33:29.725 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:33:29.725 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:33:29.725 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:33:29.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.725 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:33:29.725 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:33:29.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:33:29.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:33:29.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:33:29.726 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:33:29.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.832 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:33:29.847 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:33:29.847 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:33:29.848 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:33:29.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:29.848 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:33:29.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:33:29.912 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:29.967 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:33:29.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:33:29.967 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:30.021 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:33:30.021 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:33:30.021 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:30.102 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:30.102 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:33:30.121 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:33:30.122 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:33:30.142 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:33:30.143 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:33:30.145 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:33:30.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:30.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:30.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:33:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.338+0000 7f3ffc6e4700 1 Processor -- start 2023-10-08T00:33:30.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.338+0000 7f3ffc6e4700 1 -- start start 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.339+0000 7f3ffc6e4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3ff4153f50 0x7f3ff40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.339+0000 7f3ffc6e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff4154320 0x7f3ff406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.339+0000 7f3ffc6e4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff40b4570 con 0x7f3ff415a190 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.339+0000 7f3ffc6e4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff415a730 con 0x7f3ff4153f50 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.339+0000 7f3ffc6e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff415aa10 con 0x7f3ff4154320 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ffac81700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3ff415a190 0x7f3ff415d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47802/0 (socket says 172.21.15.22:47802) 2023-10-08T00:33:30.342 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ffac81700 1 -- 172.21.15.22:0/1993674636 learned_addr learned my addr 172.21.15.22:0/1993674636 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff9c7f700 1 --2- 172.21.15.22:0/1993674636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff4154320 0x7f3ff406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ffa480700 1 --2- 172.21.15.22:0/1993674636 >> v2:172.21.15.192:3300/0 conn(0x7f3ff4153f50 0x7f3ff40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff947e700 1 -- 172.21.15.22:0/1993674636 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746908951 0 0) 0x7f3ff40b4570 con 0x7f3ff415a190 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff947e700 1 -- 172.21.15.22:0/1993674636 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fdc003570 con 0x7f3ff415a190 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff9c7f700 1 -- 172.21.15.22:0/1993674636 >> v2:172.21.15.192:3300/0 conn(0x7f3ff4153f50 msgr2=0x7f3ff40b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff9c7f700 1 --2- 172.21.15.22:0/1993674636 >> v2:172.21.15.192:3300/0 conn(0x7f3ff4153f50 0x7f3ff40b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff9c7f700 1 -- 172.21.15.22:0/1993674636 >> v1:172.21.15.22:6789/0 conn(0x7f3ff415a190 legacy=0x7f3ff415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff9c7f700 1 -- 172.21.15.22:0/1993674636 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff415acf0 con 0x7f3ff4154320 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ffa480700 1 --2- 172.21.15.22:0/1993674636 >> v2:172.21.15.192:3300/0 conn(0x7f3ff4153f50 0x7f3ff40b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:30.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff9c7f700 1 --2- 172.21.15.22:0/1993674636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff4154320 0x7f3ff406d130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80098e0 tx=0x7f3fe80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e362c150437b8c80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff947e700 1 -- 172.21.15.22:0/1993674636 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8011630 con 0x7f3ff4154320 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff947e700 1 -- 172.21.15.22:0/1993674636 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8011790 con 0x7f3ff4154320 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.340+0000 7f3ff947e700 1 -- 172.21.15.22:0/1993674636 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8011b10 con 0x7f3ff4154320 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/1993674636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff4154320 msgr2=0x7f3ff406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/1993674636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff4154320 0x7f3ff406d130 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80098e0 tx=0x7f3fe80091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/1993674636 shutdown_connections 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/1993674636 >> v2:172.21.15.192:3300/0 conn(0x7f3ff4153f50 0x7f3ff40b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/1993674636 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff4154320 0x7f3ff406d130 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/1993674636 >> 172.21.15.22:0/1993674636 conn(0x7f3ff406baf0 msgr2=0x7f3ff406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/1993674636 shutdown_connections 2023-10-08T00:33:30.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.341+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/1993674636 wait complete. 2023-10-08T00:33:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.342+0000 7f3ffc6e4700 1 Processor -- start 2023-10-08T00:33:30.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.342+0000 7f3ffc6e4700 1 -- start start 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffc6e4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 0x7f3ff40ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffc6e4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4154320 0x7f3ff40cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffc6e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff415a190 0x7f3ff41503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffc6e4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40cb900 con 0x7f3ff4153f50 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffc6e4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40ca080 con 0x7f3ff4154320 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffc6e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff40cdfe0 con 0x7f3ff415a190 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 0x7f3ff40ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 0x7f3ff40ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56152/0 (socket says 172.21.15.22:56152) 2023-10-08T00:33:30.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 -- 172.21.15.22:0/2428358123 learned_addr learned my addr 172.21.15.22:0/2428358123 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ff9c7f700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4154320 0x7f3ff40cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffac81700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff415a190 0x7f3ff41503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 -- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff415a190 msgr2=0x7f3ff41503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff415a190 0x7f3ff41503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 -- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4154320 msgr2=0x7f3ff40cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4154320 0x7f3ff40cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 -- 172.21.15.22:0/2428358123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec009420 con 0x7f3ff4153f50 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffac81700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff415a190 0x7f3ff41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.343+0000 7f3ffa480700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 0x7f3ff40ccdf0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00ecb0 tx=0x7f3fec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:30.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.344+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00c950 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.344+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec00cab0 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.344+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe8009420 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.344+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00ce30 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.344+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff40cd6b0 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.345+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff415f5b0 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.345+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3fec013680 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.345+0000 7f3ff27fc700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fe0067320 0x7f3fe00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.345+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fec085000 con 0x7f3ff4153f50 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.346+0000 7f3ff9c7f700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fe0067320 0x7f3fe00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.350 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.346+0000 7f3ff9c7f700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fe0067320 0x7f3fe00697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4154770 tx=0x7f3fe8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:30.351 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.350+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fec051c90 con 0x7f3ff4153f50 2023-10-08T00:33:30.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.594+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3ff40718b0 con 0x7f3ff4153f50 2023-10-08T00:33:30.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.717+0000 7f3ff27fc700 1 -- 172.21.15.22:0/2428358123 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v116) v1 ==== 136+0+0 (secure 0 0 0) 0x7f3fec0552b0 con 0x7f3ff4153f50 2023-10-08T00:33:30.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fe0067320 msgr2=0x7f3fe00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fe0067320 0x7f3fe00697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4154770 tx=0x7f3fe8017000 comp rx=0 tx=0).stop 2023-10-08T00:33:30.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 msgr2=0x7f3ff40ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.720 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 0x7f3ff40ccdf0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00ecb0 tx=0x7f3fec0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 shutdown_connections 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3fe0067320 0x7f3fe00697d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ff415a190 0x7f3ff41503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ff4153f50 0x7f3ff40ccdf0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 --2- 172.21.15.22:0/2428358123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff4154320 0x7f3ff40cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.719+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 >> 172.21.15.22:0/2428358123 conn(0x7f3ff406baf0 msgr2=0x7f3ff4153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.720+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 shutdown_connections 2023-10-08T00:33:30.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.720+0000 7f3ffc6e4700 1 -- 172.21.15.22:0/2428358123 wait complete. 2023-10-08T00:33:30.732 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:33:30.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.852+0000 7fc0fd9f3700 1 Processor -- start 2023-10-08T00:33:30.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.852+0000 7fc0fd9f3700 1 -- start start 2023-10-08T00:33:30.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0fd9f3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc0f8159890 0x7fc0f815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0fd9f3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f815a160 con 0x7fc0f8069560 2023-10-08T00:33:30.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0fd9f3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80d13a0 con 0x7fc0f8159c60 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0fd9f3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f815e140 con 0x7fc0f8159890 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0f77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc0f8069560 0x7fc0f80ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47808/0 (socket says 172.21.15.22:47808) 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0f77fe700 1 -- 172.21.15.22:0/618766100 learned_addr learned my addr 172.21.15.22:0/618766100 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.853+0000 7fc0f6ffd700 1 --2- 172.21.15.22:0/618766100 >> v2:172.21.15.192:3300/0 conn(0x7fc0f8159890 0x7fc0f815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f5ffb700 1 -- 172.21.15.22:0/618766100 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513774749 0 0) 0x7fc0f815a160 con 0x7fc0f8069560 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f5ffb700 1 -- 172.21.15.22:0/618766100 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e4003570 con 0x7fc0f8069560 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f6ffd700 1 -- 172.21.15.22:0/618766100 >> v1:172.21.15.192:6789/0 conn(0x7fc0f8159c60 legacy=0x7fc0f815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f5ffb700 1 -- 172.21.15.22:0/618766100 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177315570 0 0) 0x7fc0f80d13a0 con 0x7fc0f8159c60 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f6ffd700 1 -- 172.21.15.22:0/618766100 >> v1:172.21.15.22:6789/0 conn(0x7fc0f8069560 legacy=0x7fc0f80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f6ffd700 1 -- 172.21.15.22:0/618766100 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f815a3d0 con 0x7fc0f8159890 2023-10-08T00:33:30.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f6ffd700 1 --2- 172.21.15.22:0/618766100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8159890 0x7fc0f815abd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00098e0 tx=0x7fc0f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27f9c0aa5bfe2f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f5ffb700 1 -- 172.21.15.22:0/618766100 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000b640 con 0x7fc0f8159890 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f5ffb700 1 -- 172.21.15.22:0/618766100 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000b7a0 con 0x7fc0f8159890 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.854+0000 7fc0f5ffb700 1 -- 172.21.15.22:0/618766100 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000bb40 con 0x7fc0f8159890 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/618766100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8159890 msgr2=0x7fc0f815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/618766100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8159890 0x7fc0f815abd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00098e0 tx=0x7fc0f00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/618766100 shutdown_connections 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/618766100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8159890 0x7fc0f815abd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/618766100 >> 172.21.15.22:0/618766100 conn(0x7fc0f8068e20 msgr2=0x7fc0f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/618766100 shutdown_connections 2023-10-08T00:33:30.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.855+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/618766100 wait complete. 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.856+0000 7fc0fd9f3700 1 Processor -- start 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.856+0000 7fc0fd9f3700 1 -- start start 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8069560 0x7fc0f80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 0x7fc0f8151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0f8159c60 0x7fc0f816cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8152500 con 0x7fc0f8159890 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8151f90 con 0x7fc0f8069560 2023-10-08T00:33:30.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80b6070 con 0x7fc0f8159c60 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 0x7fc0f8151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 0x7fc0f8151a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56156/0 (socket says 172.21.15.22:56156) 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8069560 0x7fc0f80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 -- 172.21.15.22:0/3231315680 learned_addr learned my addr 172.21.15.22:0/3231315680 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f77fe700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0f8159c60 0x7fc0f816cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 -- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0f8159c60 msgr2=0x7fc0f816cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0f8159c60 0x7fc0f816cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 -- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8069560 msgr2=0x7fc0f80c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8069560 0x7fc0f80c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 -- 172.21.15.22:0/3231315680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f0009420 con 0x7fc0f8159890 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0f67fc700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 0x7fc0f8151a50 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c530 tx=0x7fc0e000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:30.861 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011590 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e0011710 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f80b6350 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.857+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0011ad0 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.858+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f80ca200 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.858+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f80b2fc0 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.859+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc0e001b3b0 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.859+0000 7fc0eeffd700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc0d8067320 0x7fc0d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.859+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0e00840d0 con 0x7fc0f8159890 2023-10-08T00:33:30.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.860+0000 7fc0f6ffd700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc0d8067320 0x7fc0d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:30.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.860+0000 7fc0f6ffd700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc0d8067320 0x7fc0d80697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00093f0 tx=0x7fc0f0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:30.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:30.864+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0e0050d60 con 0x7fc0f8159890 2023-10-08T00:33:31.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.086+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0f804c3c0 con 0x7fc0d8067320 2023-10-08T00:33:31.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.088+0000 7fc0eeffd700 1 -- 172.21.15.22:0/3231315680 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc0f804c3c0 con 0x7fc0d8067320 2023-10-08T00:33:31.089 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:33:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:33:31.089 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:31.089 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc0d8067320 msgr2=0x7fc0d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc0d8067320 0x7fc0d80697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00093f0 tx=0x7fc0f0017000 comp rx=0 tx=0).stop 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 msgr2=0x7fc0f8151a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 0x7fc0f8151a50 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c530 tx=0x7fc0e000c840 comp rx=0 tx=0).stop 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 shutdown_connections 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc0d8067320 0x7fc0d80697d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc0f8159c60 0x7fc0f816cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0f8069560 0x7fc0f80c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 --2- 172.21.15.22:0/3231315680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0f8159890 0x7fc0f8151a50 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 >> 172.21.15.22:0/3231315680 conn(0x7fc0f8068e20 msgr2=0x7fc0f8152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:31.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 shutdown_connections 2023-10-08T00:33:31.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.090+0000 7fc0fd9f3700 1 -- 172.21.15.22:0/3231315680 wait complete. 2023-10-08T00:33:31.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:33:31.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.224+0000 7f465360c700 1 Processor -- start 2023-10-08T00:33:31.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.224+0000 7f465360c700 1 -- start start 2023-10-08T00:33:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f465360c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f465360c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f464c0c81f0 0x7f464c0cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f465360c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c06bdb0 con 0x7f464c0aca80 2023-10-08T00:33:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f465360c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0c8670 con 0x7f464c0c81f0 2023-10-08T00:33:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f465360c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0cb370 con 0x7f464c069d60 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4651ba9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f464c0c81f0 0x7f464c0cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:51754/0 (socket says 172.21.15.22:51754) 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 -- 172.21.15.22:0/2470273134 learned_addr learned my addr 172.21.15.22:0/2470273134 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4651ba9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f464c0c81f0 0x7f464c0cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:47134/0 (socket says 172.21.15.22:47134) 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f46513a8700 1 --1- 172.21.15.22:0/2470273134 >> v1:172.21.15.192:6789/0 conn(0x7f464c0aca80 0x7f464c06aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:37896/0 (socket says 172.21.15.22:37896) 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 -- 172.21.15.22:0/2470273134 >> v2:172.21.15.192:3300/0 conn(0x7f464c0c81f0 msgr2=0x7f464c0cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 --2- 172.21.15.22:0/2470273134 >> v2:172.21.15.192:3300/0 conn(0x7f464c0c81f0 0x7f464c0cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 -- 172.21.15.22:0/2470273134 >> v1:172.21.15.192:6789/0 conn(0x7f464c0aca80 legacy=0x7f464c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.225+0000 7f4650ba7700 1 -- 172.21.15.22:0/2470273134 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c159f60 con 0x7f464c069d60 2023-10-08T00:33:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f4650ba7700 1 --2- 172.21.15.22:0/2470273134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0c7cb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46400099b0 tx=0x7f4640009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b951b5b2619c6d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f464bfff700 1 -- 172.21.15.22:0/2470273134 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640009ea0 con 0x7f464c069d60 2023-10-08T00:33:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f464bfff700 1 -- 172.21.15.22:0/2470273134 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464000b860 con 0x7f464c069d60 2023-10-08T00:33:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f464bfff700 1 -- 172.21.15.22:0/2470273134 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464000bc00 con 0x7f464c069d60 2023-10-08T00:33:31.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 -- 172.21.15.22:0/2470273134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 msgr2=0x7f464c0c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 --2- 172.21.15.22:0/2470273134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0c7cb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46400099b0 tx=0x7f4640009250 comp rx=0 tx=0).stop 2023-10-08T00:33:31.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 -- 172.21.15.22:0/2470273134 shutdown_connections 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 --2- 172.21.15.22:0/2470273134 >> v2:172.21.15.192:3300/0 conn(0x7f464c0c81f0 0x7f464c0cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 --2- 172.21.15.22:0/2470273134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0c7cb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 -- 172.21.15.22:0/2470273134 >> 172.21.15.22:0/2470273134 conn(0x7f464c0cd670 msgr2=0x7f464c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 -- 172.21.15.22:0/2470273134 shutdown_connections 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.226+0000 7f465360c700 1 -- 172.21.15.22:0/2470273134 wait complete. 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.227+0000 7f465360c700 1 Processor -- start 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.227+0000 7f465360c700 1 -- start start 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f465360c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f465360c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 0x7f464c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f465360c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f464c0c81f0 0x7f464c0af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f465360c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0b1fd0 con 0x7f464c0aca80 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f465360c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0b13c0 con 0x7f464c0c81f0 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f465360c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0b16a0 con 0x7f464c069d60 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f4650ba7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 0x7f464c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f4650ba7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 0x7f464c157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56158/0 (socket says 172.21.15.22:56158) 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.228+0000 7f4650ba7700 1 -- 172.21.15.22:0/2274160546 learned_addr learned my addr 172.21.15.22:0/2274160546 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f46513a8700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4651ba9700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f464c0c81f0 0x7f464c0af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4650ba7700 1 -- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 msgr2=0x7f464c0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4650ba7700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4650ba7700 1 -- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f464c0c81f0 msgr2=0x7f464c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4650ba7700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f464c0c81f0 0x7f464c0af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4650ba7700 1 -- 172.21.15.22:0/2274160546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400094f0 con 0x7f464c0aca80 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f4650ba7700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 0x7f464c157710 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f464c0cb4b0 tx=0x7f4640017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640000d10 con 0x7f464c0aca80 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464000bbe0 con 0x7f464c0aca80 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0b1980 con 0x7f464c0aca80 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640011650 con 0x7f464c0aca80 2023-10-08T00:33:31.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.229+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c157c50 con 0x7f464c0aca80 2023-10-08T00:33:31.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.230+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0b2140 con 0x7f464c0aca80 2023-10-08T00:33:31.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.231+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4640011a80 con 0x7f464c0aca80 2023-10-08T00:33:31.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.231+0000 7f46497fa700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4638067320 0x7f46380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.231+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46400864c0 con 0x7f464c0aca80 2023-10-08T00:33:31.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.231+0000 7f46513a8700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4638067320 0x7f46380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.232+0000 7f46513a8700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4638067320 0x7f46380697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f464c0c3090 tx=0x7f463c007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:31.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.235+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4640053150 con 0x7f464c0aca80 2023-10-08T00:33:31.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.430+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f464c04c3c0 con 0x7f464c0aca80 2023-10-08T00:33:31.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.431+0000 7f46497fa700 1 -- 172.21.15.22:0/2274160546 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4640056770 con 0x7f464c0aca80 2023-10-08T00:33:31.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4638067320 msgr2=0x7f46380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4638067320 0x7f46380697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f464c0c3090 tx=0x7f463c007ea0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 msgr2=0x7f464c157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 0x7f464c157710 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f464c0cb4b0 tx=0x7f4640017000 comp rx=0 tx=0).stop 2023-10-08T00:33:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 shutdown_connections 2023-10-08T00:33:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f464c0c81f0 0x7f464c0af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4638067320 0x7f46380697d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f464c069d60 0x7f464c0b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 --2- 172.21.15.22:0/2274160546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f464c0aca80 0x7f464c157710 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 >> 172.21.15.22:0/2274160546 conn(0x7f464c0cd670 msgr2=0x7f464c0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:31.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 shutdown_connections 2023-10-08T00:33:31.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.433+0000 7f465360c700 1 -- 172.21.15.22:0/2274160546 wait complete. 2023-10-08T00:33:31.445 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:33:31.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:33:31.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:33:31.486 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:33:31.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:31.486 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:33:31.541 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:33:31.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:33:31.542 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:33:31.580 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:33:31.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:31.581 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:33:31.637 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:33:31.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:31.637 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T00:33:31.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:33:31.653 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T00:33:31.653 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:33:31.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:33:31.653 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T00:33:31.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:33:31.694 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T00:33:31.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create another-data-pool --pg_num_min 64 2023-10-08T00:33:31.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.817+0000 7f68423e3700 1 Processor -- start 2023-10-08T00:33:31.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.817+0000 7f68423e3700 1 -- start start 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f68423e3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f683c159ec0 0x7f683c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f68423e3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f683c0cf350 0x7f683c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f68423e3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683c0b5b00 con 0x7f683c0b53d0 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f68423e3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c0b5850 con 0x7f683c159ec0 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f68423e3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f683c0b5da0 con 0x7f683c0cf350 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f683c159ec0 0x7f683c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f683c159ec0 0x7f683c0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56170/0 (socket says 172.21.15.22:56170) 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 -- 172.21.15.22:0/2880934 learned_addr learned my addr 172.21.15.22:0/2880934 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:31.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f6840980700 1 --2- 172.21.15.22:0/2880934 >> v2:172.21.15.192:3300/0 conn(0x7f683c0cf350 0x7f683c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 -- 172.21.15.22:0/2880934 >> v2:172.21.15.192:3300/0 conn(0x7f683c0cf350 msgr2=0x7f683c0cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 --2- 172.21.15.22:0/2880934 >> v2:172.21.15.192:3300/0 conn(0x7f683c0cf350 0x7f683c0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 -- 172.21.15.22:0/2880934 >> v1:172.21.15.192:6789/0 conn(0x7f683c0b53d0 legacy=0x7f683c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 -- 172.21.15.22:0/2880934 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c0b6080 con 0x7f683c159ec0 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.818+0000 7f683bfff700 1 --2- 172.21.15.22:0/2880934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c159ec0 0x7f683c0b4e90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f683c0cb4a0 tx=0x7f6824009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4848603deeae1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f683affd700 1 -- 172.21.15.22:0/2880934 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824005c10 con 0x7f683c159ec0 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f683affd700 1 -- 172.21.15.22:0/2880934 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824005d70 con 0x7f683c159ec0 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f683affd700 1 -- 172.21.15.22:0/2880934 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682400b840 con 0x7f683c159ec0 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 -- 172.21.15.22:0/2880934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c159ec0 msgr2=0x7f683c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 --2- 172.21.15.22:0/2880934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c159ec0 0x7f683c0b4e90 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f683c0cb4a0 tx=0x7f6824009220 comp rx=0 tx=0).stop 2023-10-08T00:33:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 -- 172.21.15.22:0/2880934 shutdown_connections 2023-10-08T00:33:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 --2- 172.21.15.22:0/2880934 >> v2:172.21.15.192:3300/0 conn(0x7f683c0cf350 0x7f683c0cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 --2- 172.21.15.22:0/2880934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c159ec0 0x7f683c0b4e90 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 -- 172.21.15.22:0/2880934 >> 172.21.15.22:0/2880934 conn(0x7f683c0999f0 msgr2=0x7f683c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 -- 172.21.15.22:0/2880934 shutdown_connections 2023-10-08T00:33:31.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.819+0000 7f68423e3700 1 -- 172.21.15.22:0/2880934 wait complete. 2023-10-08T00:33:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.820+0000 7f68423e3700 1 Processor -- start 2023-10-08T00:33:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 -- start start 2023-10-08T00:33:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 0x7f683c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f683c0cf350 0x7f683c169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f683c159ec0 0x7f683c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c1577d0 con 0x7f683c0b53d0 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683c16a820 con 0x7f683c159ec0 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f68423e3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f683c16ab00 con 0x7f683c0cf350 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f683bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 0x7f683c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f683bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 0x7f683c154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56186/0 (socket says 172.21.15.22:56186) 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.821+0000 7f683bfff700 1 -- 172.21.15.22:0/612604108 learned_addr learned my addr 172.21.15.22:0/612604108 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f6840980700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f683c159ec0 0x7f683c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683b7fe700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f683c0cf350 0x7f683c169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683bfff700 1 -- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f683c0cf350 msgr2=0x7f683c169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683bfff700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f683c0cf350 0x7f683c169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683bfff700 1 -- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f683c159ec0 msgr2=0x7f683c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683bfff700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f683c159ec0 0x7f683c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683bfff700 1 -- 172.21.15.22:0/612604108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824009480 con 0x7f683c0b53d0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f683bfff700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 0x7f683c154db0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6824009260 tx=0x7f6824015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011ae0 con 0x7f683c0b53d0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6824011c60 con 0x7f683c0b53d0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682401d430 con 0x7f683c0b53d0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f683c16ade0 con 0x7f683c0b53d0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.822+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683c152d30 con 0x7f683c0b53d0 2023-10-08T00:33:31.827 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.823+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683c153200 con 0x7f683c0b53d0 2023-10-08T00:33:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.823+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f682401d7a0 con 0x7f683c0b53d0 2023-10-08T00:33:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.824+0000 7f6833fff700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f681c067320 0x7f681c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.824+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6824086f50 con 0x7f683c0b53d0 2023-10-08T00:33:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.824+0000 7f683b7fe700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f681c067320 0x7f681c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.824+0000 7f683b7fe700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f681c067320 0x7f681c0697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f682c006fd0 tx=0x7f682c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:31.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:31.828+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6824053ba0 con 0x7f683c0b53d0 2023-10-08T00:33:32.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.022+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64} v 0) v1 -- 0x7f683c063c90 con 0x7f683c0b53d0 2023-10-08T00:33:32.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:33:32.125 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:33:32.727 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.727+0000 7f6833fff700 1 -- 172.21.15.22:0/612604108 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64}]=0 pool 'another-data-pool' created v169) v1 ==== 142+0+0 (secure 0 0 0) 0x7f682402a020 con 0x7f683c0b53d0 2023-10-08T00:33:32.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.730+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f681c067320 msgr2=0x7f681c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:32.731 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.730+0000 7f68423e3700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f681c067320 0x7f681c0697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f682c006fd0 tx=0x7f682c008040 comp rx=0 tx=0).stop 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.730+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 msgr2=0x7f683c154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.730+0000 7f68423e3700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 0x7f683c154db0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6824009260 tx=0x7f6824015000 comp rx=0 tx=0).stop 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.731+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 shutdown_connections 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.731+0000 7f68423e3700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f683c159ec0 0x7f683c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.731+0000 7f68423e3700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f683c0b53d0 0x7f683c154db0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.731+0000 7f68423e3700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f681c067320 0x7f681c0697d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.731+0000 7f68423e3700 1 --2- 172.21.15.22:0/612604108 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f683c0cf350 0x7f683c169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.732 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.731+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 >> 172.21.15.22:0/612604108 conn(0x7f683c0999f0 msgr2=0x7f683c0b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:32.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.732+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 shutdown_connections 2023-10-08T00:33:32.733 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.732+0000 7f68423e3700 1 -- 172.21.15.22:0/612604108 wait complete. 2023-10-08T00:33:32.737 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'another-data-pool' created 2023-10-08T00:33:32.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs another-data-pool 2023-10-08T00:33:32.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.868+0000 7f8864df3700 1 Processor -- start 2023-10-08T00:33:32.869 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.868+0000 7f8864df3700 1 -- start start 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f8864df3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8860159890 0x7f886015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f8864df3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860069560 0x7f88600699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f8864df3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8860069ee0 con 0x7f8860159c60 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f8864df3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886015a160 con 0x7f8860159890 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f8864df3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600d13a0 con 0x7f8860069560 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f885e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8860159890 0x7f886015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:32.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f885e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8860159890 0x7f886015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56196/0 (socket says 172.21.15.22:56196) 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f885e59c700 1 -- 172.21.15.22:0/268748199 learned_addr learned my addr 172.21.15.22:0/268748199 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.869+0000 7f885ed9d700 1 --2- 172.21.15.22:0/268748199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860069560 0x7f88600699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885e59c700 1 -- 172.21.15.22:0/268748199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860069560 msgr2=0x7f88600699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885e59c700 1 --2- 172.21.15.22:0/268748199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860069560 0x7f88600699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885e59c700 1 -- 172.21.15.22:0/268748199 >> v1:172.21.15.192:6789/0 conn(0x7f8860159c60 legacy=0x7f886015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885e59c700 1 -- 172.21.15.22:0/268748199 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886015e140 con 0x7f8860159890 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885e59c700 1 --2- 172.21.15.22:0/268748199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860159890 0x7f886015abd0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f88580099b0 tx=0x7f8858009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492976985dada33a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885d59a700 1 -- 172.21.15.22:0/268748199 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800b860 con 0x7f8860159890 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885d59a700 1 -- 172.21.15.22:0/268748199 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800b9c0 con 0x7f8860159890 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f885d59a700 1 -- 172.21.15.22:0/268748199 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800bd60 con 0x7f8860159890 2023-10-08T00:33:32.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f8864df3700 1 -- 172.21.15.22:0/268748199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860159890 msgr2=0x7f886015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.870+0000 7f8864df3700 1 --2- 172.21.15.22:0/268748199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860159890 0x7f886015abd0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f88580099b0 tx=0x7f8858009250 comp rx=0 tx=0).stop 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.871+0000 7f8864df3700 1 -- 172.21.15.22:0/268748199 shutdown_connections 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.871+0000 7f8864df3700 1 --2- 172.21.15.22:0/268748199 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860069560 0x7f88600699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.871+0000 7f8864df3700 1 --2- 172.21.15.22:0/268748199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860159890 0x7f886015abd0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.871+0000 7f8864df3700 1 -- 172.21.15.22:0/268748199 >> 172.21.15.22:0/268748199 conn(0x7f8860068e20 msgr2=0x7f88600d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.871+0000 7f8864df3700 1 -- 172.21.15.22:0/268748199 shutdown_connections 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.871+0000 7f8864df3700 1 -- 172.21.15.22:0/268748199 wait complete. 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 Processor -- start 2023-10-08T00:33:32.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 -- start start 2023-10-08T00:33:32.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 0x7f88601583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8860159890 0x7f88600ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860159c60 0x7f88601523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600ce040 con 0x7f8860069560 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860158920 con 0x7f8860159890 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.872+0000 7f8864df3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600cea10 con 0x7f8860159c60 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 0x7f88601583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 0x7f88601583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56208/0 (socket says 172.21.15.22:56208) 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 -- 172.21.15.22:0/4163276493 learned_addr learned my addr 172.21.15.22:0/4163276493 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885ed9d700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860159c60 0x7f88601523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885dd9b700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8860159890 0x7f88600ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 -- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860159c60 msgr2=0x7f88601523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:32.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860159c60 0x7f88601523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 -- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8860159890 msgr2=0x7f88600ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8860159890 0x7f88600ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 -- 172.21.15.22:0/4163276493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580094f0 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f885e59c700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 0x7f88601583e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8858006fd0 tx=0x7f8858017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858024440 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580245c0 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88600cd430 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858024980 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.873+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88600cd9f0 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.874+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88600ce320 con 0x7f8860069560 2023-10-08T00:33:32.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.875+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f885801a420 con 0x7f8860069560 2023-10-08T00:33:32.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.875+0000 7f88567fc700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8840067320 0x7f88400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:32.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.875+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f8858086c60 con 0x7f8860069560 2023-10-08T00:33:32.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.875+0000 7f885dd9b700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8840067320 0x7f88400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:32.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.876+0000 7f885dd9b700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8840067320 0x7f88400697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f88601530a0 tx=0x7f8848009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:32.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:32.880+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8858053780 con 0x7f8860069560 2023-10-08T00:33:33.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.118+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"} v 0) v1 -- 0x7f886015d290 con 0x7f8860069560 2023-10-08T00:33:33.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.737+0000 7f88567fc700 1 -- 172.21.15.22:0/4163276493 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"}]=0 added data pool 30 to fsmap v117) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8858056da0 con 0x7f8860069560 2023-10-08T00:33:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8840067320 msgr2=0x7f88400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8840067320 0x7f88400697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f88601530a0 tx=0x7f8848009040 comp rx=0 tx=0).stop 2023-10-08T00:33:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 msgr2=0x7f88601583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 0x7f88601583e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8858006fd0 tx=0x7f8858017000 comp rx=0 tx=0).stop 2023-10-08T00:33:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 shutdown_connections 2023-10-08T00:33:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8840067320 0x7f88400697d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8860159c60 0x7f88601523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8860069560 0x7f88601583e0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.742+0000 7f8864df3700 1 --2- 172.21.15.22:0/4163276493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8860159890 0x7f88600ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.743+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 >> 172.21.15.22:0/4163276493 conn(0x7f8860068e20 msgr2=0x7f88601532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.743+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 shutdown_connections 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.743+0000 7f8864df3700 1 -- 172.21.15.22:0/4163276493 wait complete. 2023-10-08T00:33:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:added data pool 30 to fsmap 2023-10-08T00:33:33.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:33.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.877+0000 7fb9e5f1e700 1 Processor -- start 2023-10-08T00:33:33.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.877+0000 7fb9e5f1e700 1 -- start start 2023-10-08T00:33:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9e5f1e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb9e0159890 0x7fb9e015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9e5f1e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9e0159c60 0x7fb9e015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9e5f1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e015db10 0x7fb9e0069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9e5f1e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e015df50 con 0x7fb9e0159c60 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9e5f1e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e015a160 con 0x7fb9e0159890 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9e5f1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00d13a0 con 0x7fb9e015db10 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9e0159c60 0x7fb9e015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9e0159c60 0x7fb9e015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56212/0 (socket says 172.21.15.22:56212) 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9deffd700 1 -- 172.21.15.22:0/1554439838 learned_addr learned my addr 172.21.15.22:0/1554439838 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9df7fe700 1 --2- 172.21.15.22:0/1554439838 >> v2:172.21.15.192:3300/0 conn(0x7fb9e0159890 0x7fb9e015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.878+0000 7fb9dffff700 1 --2- 172.21.15.22:0/1554439838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e015db10 0x7fb9e0069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9deffd700 1 -- 172.21.15.22:0/1554439838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e015db10 msgr2=0x7fb9e0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9deffd700 1 --2- 172.21.15.22:0/1554439838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e015db10 0x7fb9e0069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9deffd700 1 -- 172.21.15.22:0/1554439838 >> v2:172.21.15.192:3300/0 conn(0x7fb9e0159890 msgr2=0x7fb9e015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:33.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9deffd700 1 --2- 172.21.15.22:0/1554439838 >> v2:172.21.15.192:3300/0 conn(0x7fb9e0159890 0x7fb9e015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9deffd700 1 -- 172.21.15.22:0/1554439838 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e015e140 con 0x7fb9e0159c60 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9deffd700 1 --2- 172.21.15.22:0/1554439838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0159c60 0x7fb9e015d5d0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00d1090 tx=0x7fb9d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7211969bf950d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9de7fc700 1 -- 172.21.15.22:0/1554439838 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400b640 con 0x7fb9e0159c60 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9de7fc700 1 -- 172.21.15.22:0/1554439838 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d400b7a0 con 0x7fb9e0159c60 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.879+0000 7fb9de7fc700 1 -- 172.21.15.22:0/1554439838 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400bb60 con 0x7fb9e0159c60 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/1554439838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0159c60 msgr2=0x7fb9e015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/1554439838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0159c60 0x7fb9e015d5d0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00d1090 tx=0x7fb9d4009250 comp rx=0 tx=0).stop 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/1554439838 shutdown_connections 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/1554439838 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e015db10 0x7fb9e0069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/1554439838 >> v2:172.21.15.192:3300/0 conn(0x7fb9e0159890 0x7fb9e015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/1554439838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e0159c60 0x7fb9e015d5d0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/1554439838 >> 172.21.15.22:0/1554439838 conn(0x7fb9e0068e20 msgr2=0x7fb9e00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:33.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/1554439838 shutdown_connections 2023-10-08T00:33:33.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.880+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/1554439838 wait complete. 2023-10-08T00:33:33.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.881+0000 7fb9e5f1e700 1 Processor -- start 2023-10-08T00:33:33.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.881+0000 7fb9e5f1e700 1 -- start start 2023-10-08T00:33:33.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9e5f1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9e0159890 0x7fb9e0148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9e5f1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e0159c60 0x7fb9e00c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9e5f1e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 0x7fb9e00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9e5f1e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00ca6c0 con 0x7fb9e015db10 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9e5f1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00cda10 con 0x7fb9e0159890 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9e5f1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00ca3e0 con 0x7fb9e0159c60 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 0x7fb9e00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 0x7fb9e00b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56222/0 (socket says 172.21.15.22:56222) 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 -- 172.21.15.22:0/243899623 learned_addr learned my addr 172.21.15.22:0/243899623 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9deffd700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e0159c60 0x7fb9e00c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9df7fe700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9e0159890 0x7fb9e0148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 -- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e0159c60 msgr2=0x7fb9e00c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e0159c60 0x7fb9e00c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 -- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9e0159890 msgr2=0x7fb9e0148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:33.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9e0159890 0x7fb9e0148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 -- 172.21.15.22:0/243899623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40094f0 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.882+0000 7fb9dffff700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 0x7fb9e00b3590 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009e90 tx=0x7fb9d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.883+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cb70 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.883+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800f040 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.883+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e00cd3c0 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.883+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8014480 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.883+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e0148720 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.884+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e00cdb80 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.884+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb9d8014830 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.885+0000 7fb9c77fe700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9cc067320 0x7fb9cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.885+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fb9d80857c0 con 0x7fb9e015db10 2023-10-08T00:33:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.885+0000 7fb9df7fe700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9cc067320 0x7fb9cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:33.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.885+0000 7fb9df7fe700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9cc067320 0x7fb9cc0697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009d10 tx=0x7fb9d00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:33.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:33.889+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9d80522b0 con 0x7fb9e015db10 2023-10-08T00:33:34.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.127+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9e004c3c0 con 0x7fb9e015db10 2023-10-08T00:33:34.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.128+0000 7fb9c77fe700 1 -- 172.21.15.22:0/243899623 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fb9d80558d0 con 0x7fb9e015db10 2023-10-08T00:33:34.128 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:34.129 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":117,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:33.725870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9cc067320 msgr2=0x7fb9cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9cc067320 0x7fb9cc0697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009d10 tx=0x7fb9d00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 msgr2=0x7fb9e00b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 0x7fb9e00b3590 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009e90 tx=0x7fb9d800b040 comp rx=0 tx=0).stop 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 shutdown_connections 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9e015db10 0x7fb9e00b3590 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9e0159890 0x7fb9e0148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb9cc067320 0x7fb9cc0697d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 --2- 172.21.15.22:0/243899623 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb9e0159c60 0x7fb9e00c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 >> 172.21.15.22:0/243899623 conn(0x7fb9e0068e20 msgr2=0x7fb9e0158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 shutdown_connections 2023-10-08T00:33:34.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.130+0000 7fb9e5f1e700 1 -- 172.21.15.22:0/243899623 wait complete. 2023-10-08T00:33:34.132 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 117 2023-10-08T00:33:34.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:34.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.260+0000 7f4df7976700 1 Processor -- start 2023-10-08T00:33:34.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.260+0000 7f4df7976700 1 -- start start 2023-10-08T00:33:34.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df7976700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0159890 0x7f4df015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df7976700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4df0069560 0x7f4df00699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df7976700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df015a160 con 0x7f4df0159c60 2023-10-08T00:33:34.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df7976700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df0069f20 con 0x7f4df0069560 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df7976700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00d13a0 con 0x7f4df0159890 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df5f13700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4df0069560 0x7f4df00699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df4f11700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4df0159c60 0x7f4df015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47816/0 (socket says 172.21.15.22:47816) 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df5f13700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4df0069560 0x7f4df00699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56234/0 (socket says 172.21.15.22:56234) 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.261+0000 7f4df4f11700 1 -- 172.21.15.22:0/533353289 learned_addr learned my addr 172.21.15.22:0/533353289 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5712700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0159890 0x7f4df015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5f13700 1 -- 172.21.15.22:0/533353289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0159890 msgr2=0x7f4df015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5f13700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0159890 0x7f4df015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5f13700 1 -- 172.21.15.22:0/533353289 >> v1:172.21.15.22:6789/0 conn(0x7f4df0159c60 legacy=0x7f4df015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5f13700 1 -- 172.21.15.22:0/533353289 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df015e140 con 0x7f4df0069560 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4deffff700 1 -- 172.21.15.22:0/533353289 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139074437 0 0) 0x7f4df015a160 con 0x7f4df0159c60 2023-10-08T00:33:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5712700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0159890 0x7f4df015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4df5f13700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0069560 0x7f4df00699e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4de80098e0 tx=0x7f4de80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ac96520cd32353 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4deffff700 1 -- 172.21.15.22:0/533353289 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8009e80 con 0x7f4df0069560 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4deffff700 1 -- 172.21.15.22:0/533353289 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de800b860 con 0x7f4df0069560 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.262+0000 7f4deffff700 1 -- 172.21.15.22:0/533353289 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800bbe0 con 0x7f4df0069560 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 -- 172.21.15.22:0/533353289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0069560 msgr2=0x7f4df00699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0069560 0x7f4df00699e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4de80098e0 tx=0x7f4de80091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 -- 172.21.15.22:0/533353289 shutdown_connections 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0069560 0x7f4df00699e0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 --2- 172.21.15.22:0/533353289 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0159890 0x7f4df015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 -- 172.21.15.22:0/533353289 >> 172.21.15.22:0/533353289 conn(0x7f4df0068e20 msgr2=0x7f4df00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 -- 172.21.15.22:0/533353289 shutdown_connections 2023-10-08T00:33:34.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.263+0000 7f4df7976700 1 -- 172.21.15.22:0/533353289 wait complete. 2023-10-08T00:33:34.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.264+0000 7f4df7976700 1 Processor -- start 2023-10-08T00:33:34.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.264+0000 7f4df7976700 1 -- start start 2023-10-08T00:33:34.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df7976700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0069560 0x7f4df0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df7976700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0159890 0x7f4df00c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df7976700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 0x7f4df00c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df7976700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00ca630 con 0x7f4df0159c60 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df7976700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00b3590 con 0x7f4df0159890 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df7976700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00ca120 con 0x7f4df0069560 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 0x7f4df00c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 0x7f4df00c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56238/0 (socket says 172.21.15.22:56238) 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 -- 172.21.15.22:0/526120052 learned_addr learned my addr 172.21.15.22:0/526120052 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5712700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0069560 0x7f4df0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df4f11700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0159890 0x7f4df00c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 -- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0069560 msgr2=0x7f4df0155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0069560 0x7f4df0155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 -- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0159890 msgr2=0x7f4df00c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0159890 0x7f4df00c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 -- 172.21.15.22:0/526120052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8009420 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4df5f13700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 0x7f4df00c9be0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b3c0 tx=0x7f4de8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de800bba0 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.265+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8011630 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.266+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df00b37e0 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.266+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80119f0 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.266+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df00b3da0 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.266+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df004c3c0 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.267+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4de80253f0 con 0x7f4df0159c60 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.267+0000 7f4ded7fa700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ddc067320 0x7f4ddc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.267+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f4de8086980 con 0x7f4df0159c60 2023-10-08T00:33:34.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.267+0000 7f4df5712700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ddc067320 0x7f4ddc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.268+0000 7f4df5712700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ddc067320 0x7f4ddc0697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4de00094d0 tx=0x7f4de000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.272+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4de8053480 con 0x7f4df0159c60 2023-10-08T00:33:34.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.466+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4df00b2880 con 0x7f4df0159c60 2023-10-08T00:33:34.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.467+0000 7f4ded7fa700 1 -- 172.21.15.22:0/526120052 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16947 (secure 0 0 0) 0x7f4de8015090 con 0x7f4df0159c60 2023-10-08T00:33:34.468 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:34.468 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":170,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:33.119966+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-08T00:33:32.053409+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ddc067320 msgr2=0x7f4ddc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ddc067320 0x7f4ddc0697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4de00094d0 tx=0x7f4de000b040 comp rx=0 tx=0).stop 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 msgr2=0x7f4df00c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 0x7f4df00c9be0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f4de800b3c0 tx=0x7f4de8017000 comp rx=0 tx=0).stop 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 shutdown_connections 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0159c60 0x7f4df00c9be0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4ddc067320 0x7f4ddc0697d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4df0069560 0x7f4df0155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 --2- 172.21.15.22:0/526120052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4df0159890 0x7f4df00c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 >> 172.21.15.22:0/526120052 conn(0x7f4df0068e20 msgr2=0x7f4df00d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:34.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 shutdown_connections 2023-10-08T00:33:34.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.469+0000 7f4df7976700 1 -- 172.21.15.22:0/526120052 wait complete. 2023-10-08T00:33:34.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:34.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.600+0000 7f3c643e5700 1 Processor -- start 2023-10-08T00:33:34.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.600+0000 7f3c643e5700 1 -- start start 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c643e5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3c5c159890 0x7f3c5c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c643e5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c5c069560 0x7f3c5c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c643e5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c069ee0 con 0x7f3c5c159c60 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c643e5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c15a160 con 0x7f3c5c069560 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c643e5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c0d13a0 con 0x7f3c5c159890 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c62982700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c5c069560 0x7f3c5c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c62982700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c5c069560 0x7f3c5c0699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56248/0 (socket says 172.21.15.22:56248) 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.601+0000 7f3c62982700 1 -- 172.21.15.22:0/3136233396 learned_addr learned my addr 172.21.15.22:0/3136233396 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c62181700 1 --2- 172.21.15.22:0/3136233396 >> v2:172.21.15.192:3300/0 conn(0x7f3c5c159890 0x7f3c5c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c62982700 1 -- 172.21.15.22:0/3136233396 >> v2:172.21.15.192:3300/0 conn(0x7f3c5c159890 msgr2=0x7f3c5c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c62982700 1 --2- 172.21.15.22:0/3136233396 >> v2:172.21.15.192:3300/0 conn(0x7f3c5c159890 0x7f3c5c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c62982700 1 -- 172.21.15.22:0/3136233396 >> v1:172.21.15.192:6789/0 conn(0x7f3c5c159c60 legacy=0x7f3c5c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c62982700 1 -- 172.21.15.22:0/3136233396 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c15e140 con 0x7f3c5c069560 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c62982700 1 --2- 172.21.15.22:0/3136233396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c069560 0x7f3c5c0699a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0d1090 tx=0x7f3c4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafd0cb04aa76da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c6117f700 1 -- 172.21.15.22:0/3136233396 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00e070 con 0x7f3c5c069560 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c6117f700 1 -- 172.21.15.22:0/3136233396 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c00ba10 con 0x7f3c5c069560 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c6117f700 1 -- 172.21.15.22:0/3136233396 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0092e0 con 0x7f3c5c069560 2023-10-08T00:33:34.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c643e5700 1 -- 172.21.15.22:0/3136233396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c069560 msgr2=0x7f3c5c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.602+0000 7f3c643e5700 1 --2- 172.21.15.22:0/3136233396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c069560 0x7f3c5c0699a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0d1090 tx=0x7f3c4c009840 comp rx=0 tx=0).stop 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.603+0000 7f3c643e5700 1 -- 172.21.15.22:0/3136233396 shutdown_connections 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.603+0000 7f3c643e5700 1 --2- 172.21.15.22:0/3136233396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c069560 0x7f3c5c0699a0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.603+0000 7f3c643e5700 1 --2- 172.21.15.22:0/3136233396 >> v2:172.21.15.192:3300/0 conn(0x7f3c5c159890 0x7f3c5c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.603+0000 7f3c643e5700 1 -- 172.21.15.22:0/3136233396 >> 172.21.15.22:0/3136233396 conn(0x7f3c5c068e20 msgr2=0x7f3c5c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.603+0000 7f3c643e5700 1 -- 172.21.15.22:0/3136233396 shutdown_connections 2023-10-08T00:33:34.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.603+0000 7f3c643e5700 1 -- 172.21.15.22:0/3136233396 wait complete. 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.604+0000 7f3c643e5700 1 Processor -- start 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.604+0000 7f3c643e5700 1 -- start start 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.604+0000 7f3c643e5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c5c069560 0x7f3c5c16a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.604+0000 7f3c643e5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c5c159890 0x7f3c5c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c643e5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 0x7f3c5c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c643e5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15d420 con 0x7f3c5c159c60 2023-10-08T00:33:34.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c643e5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15b9b0 con 0x7f3c5c159890 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c643e5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15bc90 con 0x7f3c5c069560 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 0x7f3c5c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 0x7f3c5c1522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56262/0 (socket says 172.21.15.22:56262) 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 -- 172.21.15.22:0/1376498248 learned_addr learned my addr 172.21.15.22:0/1376498248 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62181700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c5c069560 0x7f3c5c16a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c61980700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c5c159890 0x7f3c5c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 -- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c5c069560 msgr2=0x7f3c5c16a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c5c069560 0x7f3c5c16a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 -- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c5c159890 msgr2=0x7f3c5c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c5c159890 0x7f3c5c14d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 -- 172.21.15.22:0/1376498248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c009ae0 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c62982700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 0x7f3c5c1522a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c070e20 tx=0x7f3c4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c00bee0 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0032f0 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c15bf70 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c01d650 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.605+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c15c530 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.606+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c04c3c0 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.607+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c4c01da80 con 0x7f3c5c159c60 2023-10-08T00:33:34.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.607+0000 7f3c5a7fc700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c48067320 0x7f3c480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.607+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f3c4c086790 con 0x7f3c5c159c60 2023-10-08T00:33:34.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.607+0000 7f3c62181700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c48067320 0x7f3c480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.608+0000 7f3c62181700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c48067320 0x7f3c480697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006fd0 tx=0x7f3c54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.611+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c4c053180 con 0x7f3c5c159c60 2023-10-08T00:33:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.850+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5c06a5b0 con 0x7f3c5c159c60 2023-10-08T00:33:34.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.851+0000 7f3c5a7fc700 1 -- 172.21.15.22:0/1376498248 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f3c4c012e60 con 0x7f3c5c159c60 2023-10-08T00:33:34.853 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:34.854 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":117,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:33.725870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c48067320 msgr2=0x7f3c480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c48067320 0x7f3c480697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006fd0 tx=0x7f3c54008040 comp rx=0 tx=0).stop 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 msgr2=0x7f3c5c1522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 0x7f3c5c1522a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c070e20 tx=0x7f3c4c017000 comp rx=0 tx=0).stop 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 shutdown_connections 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c5c159c60 0x7f3c5c1522a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c48067320 0x7f3c480697d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c5c069560 0x7f3c5c16a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 --2- 172.21.15.22:0/1376498248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c5c159890 0x7f3c5c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 >> 172.21.15.22:0/1376498248 conn(0x7f3c5c068e20 msgr2=0x7f3c5c0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:34.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 shutdown_connections 2023-10-08T00:33:34.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.853+0000 7f3c643e5700 1 -- 172.21.15.22:0/1376498248 wait complete. 2023-10-08T00:33:34.856 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 117 2023-10-08T00:33:34.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:34.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.984+0000 7fb1b21fe700 1 Processor -- start 2023-10-08T00:33:34.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.984+0000 7fb1b21fe700 1 -- start start 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.984+0000 7fb1b21fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1ac159890 0x7fb1ac15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.984+0000 7fb1b21fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1ac159c60 0x7fb1ac15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1b21fe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac15a160 con 0x7fb1ac15db10 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1b21fe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac15df50 con 0x7fb1ac159890 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1b21fe700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0d13a0 con 0x7fb1ac159c60 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1ac159890 0x7fb1ac15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1ac159890 0x7fb1ac15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56270/0 (socket says 172.21.15.22:56270) 2023-10-08T00:33:34.987 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/469272536 learned_addr learned my addr 172.21.15.22:0/469272536 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1aaffd700 1 --2- 172.21.15.22:0/469272536 >> v2:172.21.15.192:3300/0 conn(0x7fb1ac159c60 0x7fb1ac15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/469272536 >> v2:172.21.15.192:3300/0 conn(0x7fb1ac159c60 msgr2=0x7fb1ac15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 --2- 172.21.15.22:0/469272536 >> v2:172.21.15.192:3300/0 conn(0x7fb1ac159c60 0x7fb1ac15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/469272536 >> v1:172.21.15.192:6789/0 conn(0x7fb1ac15db10 legacy=0x7fb1ac069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/469272536 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac15e140 con 0x7fb1ac159890 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1ab7fe700 1 --2- 172.21.15.22:0/469272536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac15abd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0b67f0 tx=0x7fb19c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fdabf70055d0d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1aa7fc700 1 -- 172.21.15.22:0/469272536 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00b820 con 0x7fb1ac159890 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1aa7fc700 1 -- 172.21.15.22:0/469272536 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00b980 con 0x7fb1ac159890 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.985+0000 7fb1aa7fc700 1 -- 172.21.15.22:0/469272536 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00bd20 con 0x7fb1ac159890 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 -- 172.21.15.22:0/469272536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 msgr2=0x7fb1ac15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/469272536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac15abd0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0b67f0 tx=0x7fb19c009250 comp rx=0 tx=0).stop 2023-10-08T00:33:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 -- 172.21.15.22:0/469272536 shutdown_connections 2023-10-08T00:33:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/469272536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac15abd0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/469272536 >> v2:172.21.15.192:3300/0 conn(0x7fb1ac159c60 0x7fb1ac15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 -- 172.21.15.22:0/469272536 >> 172.21.15.22:0/469272536 conn(0x7fb1ac068e20 msgr2=0x7fb1ac0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 -- 172.21.15.22:0/469272536 shutdown_connections 2023-10-08T00:33:34.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.986+0000 7fb1b21fe700 1 -- 172.21.15.22:0/469272536 wait complete. 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.987+0000 7fb1b21fe700 1 Processor -- start 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.987+0000 7fb1b21fe700 1 -- start start 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1b21fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1b21fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac159c60 0x7fb1ac16b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1b21fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15db10 0x7fb1ac16d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1b21fe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c8a20 con 0x7fb1ac159890 2023-10-08T00:33:34.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1b21fe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c7e10 con 0x7fb1ac159c60 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1b21fe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c80f0 con 0x7fb1ac15db10 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56280/0 (socket says 172.21.15.22:56280) 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/2588806801 learned_addr learned my addr 172.21.15.22:0/2588806801 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1aaffd700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac159c60 0x7fb1ac16b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1abfff700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15db10 0x7fb1ac16d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15db10 msgr2=0x7fb1ac16d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15db10 0x7fb1ac16d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac159c60 msgr2=0x7fb1ac16b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac159c60 0x7fb1ac16b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 -- 172.21.15.22:0/2588806801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0094f0 con 0x7fb1ac159890 2023-10-08T00:33:34.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1aaffd700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac159c60 0x7fb1ac16b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1abfff700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15db10 0x7fb1ac16d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.988+0000 7fb1ab7fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac155110 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0030c0 tx=0x7fb19c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.989+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c011e60 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.989+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c020070 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.989+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac0c83d0 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.989+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c01b6a0 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.989+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac155650 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.990+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac155840 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.990+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb19c022030 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.990+0000 7fb1937fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb198067320 0x7fb1980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.990+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fb19c086d50 con 0x7fb1ac159890 2023-10-08T00:33:34.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.991+0000 7fb1aaffd700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb198067320 0x7fb1980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:34.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.991+0000 7fb1aaffd700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb198067320 0x7fb1980697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac15a830 tx=0x7fb1a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:34.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:34.995+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1ac155840 con 0x7fb1ac159890 2023-10-08T00:33:35.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.188+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1ac155840 con 0x7fb1ac159890 2023-10-08T00:33:35.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.189+0000 7fb1937fe700 1 -- 172.21.15.22:0/2588806801 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+16934 (secure 0 0 0) 0x7fb1ac155840 con 0x7fb1ac159890 2023-10-08T00:33:35.189 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:35.189 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":171,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:34.726749+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-08T00:33:32.053409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb198067320 msgr2=0x7fb1980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:35.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb198067320 0x7fb1980697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac15a830 tx=0x7fb1a0008040 comp rx=0 tx=0).stop 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 msgr2=0x7fb1ac155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac155110 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0030c0 tx=0x7fb19c016000 comp rx=0 tx=0).stop 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 shutdown_connections 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb198067320 0x7fb1980697d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb1ac15db10 0x7fb1ac16d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1ac159890 0x7fb1ac155110 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 --2- 172.21.15.22:0/2588806801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ac159c60 0x7fb1ac16b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 >> 172.21.15.22:0/2588806801 conn(0x7fb1ac068e20 msgr2=0x7fb1ac153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 shutdown_connections 2023-10-08T00:33:35.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.191+0000 7fb1b21fe700 1 -- 172.21.15.22:0/2588806801 wait complete. 2023-10-08T00:33:35.204 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000525848 --yes-i-really-mean-it 2023-10-08T00:33:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.327+0000 7f3ecd5ef700 1 Processor -- start 2023-10-08T00:33:35.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.327+0000 7f3ecd5ef700 1 -- start start 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ecd5ef700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3ec80cd910 0x7f3ec80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ecd5ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3ec80ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ecd5ef700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80b5b00 con 0x7f3ec8159ec0 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ecd5ef700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80b5da0 con 0x7f3ec80cd910 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ecd5ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b6080 con 0x7f3ec80b55a0 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ec6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3ec8159ec0 0x7f3ec80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47826/0 (socket says 172.21.15.22:47826) 2023-10-08T00:33:35.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.328+0000 7f3ec6ffd700 1 -- 172.21.15.22:0/2851750439 learned_addr learned my addr 172.21.15.22:0/2851750439 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec77fe700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3ec80ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2851750439 >> v2:172.21.15.192:3300/0 conn(0x7f3ec80cd910 0x7f3ec80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840007405 0 0) 0x7f3ec80b5b00 con 0x7f3ec8159ec0 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb4003570 con 0x7f3ec8159ec0 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600292390 0 0) 0x7f3eb4003570 con 0x7f3ec8159ec0 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 msgr2=0x7f3ec80ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3ec80ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 >> v2:172.21.15.192:3300/0 conn(0x7f3ec80cd910 msgr2=0x7f3ec80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 --2- 172.21.15.22:0/2851750439 >> v2:172.21.15.192:3300/0 conn(0x7f3ec80cd910 0x7f3ec80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80cc100 con 0x7f3ec8159ec0 2023-10-08T00:33:35.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f3ec0001970 con 0x7f3ec8159ec0 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 >> v1:172.21.15.22:6789/0 conn(0x7f3ec8159ec0 legacy=0x7f3ec80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3eb4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3eb4003fe0 0x7f3eb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eb4004d50 0x7f3eb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b5da0 con 0x7f3eb4003fe0 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b6080 con 0x7f3eb4004d50 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb400ba90 con 0x7f3ec80b55a0 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3eb4003fe0 0x7f3eb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec6ffd700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3eb4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec77fe700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eb4004d50 0x7f3eb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 msgr2=0x7f3eb4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3eb4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eb4004d50 msgr2=0x7f3eb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3eb4004d50 0x7f3eb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2851750439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4003570 con 0x7f3eb4003fe0 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.329+0000 7f3ec6ffd700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3ec80b55a0 0x7f3eb4003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3eb4003fe0 0x7f3eb4004810 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80c75d0 tx=0x7f3eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aec00f86cb9cb60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000e6b0 con 0x7f3eb4003fe0 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000e810 con 0x7f3eb4003fe0 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ec5ffb700 1 -- 172.21.15.22:0/2851750439 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000ebd0 con 0x7f3eb4003fe0 2023-10-08T00:33:35.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2851750439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3eb4003fe0 msgr2=0x7f3eb4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2851750439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3eb4003fe0 0x7f3eb4004810 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80c75d0 tx=0x7f3eb00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ec77fe700 1 -- 172.21.15.22:0/2851750439 reap_dead start 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2851750439 shutdown_connections 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2851750439 >> 172.21.15.22:0/2851750439 conn(0x7f3ec80999f0 msgr2=0x7f3ec80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2851750439 shutdown_connections 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.330+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2851750439 wait complete. 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 Processor -- start 2023-10-08T00:33:35.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 -- start start 2023-10-08T00:33:35.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eb4003fe0 0x7f3ec8157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 0x7f3ec806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.338 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec809c680 0x7f3ec809caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8157960 con 0x7f3ec8068da0 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec809d030 con 0x7f3ec809c680 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ecd5ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec806b370 con 0x7f3eb4003fe0 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ec67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 0x7f3ec806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ec67fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 0x7f3ec806ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56294/0 (socket says 172.21.15.22:56294) 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.332+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2557088869 learned_addr learned my addr 172.21.15.22:0/2557088869 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec6ffd700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eb4003fe0 0x7f3ec8157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec77fe700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec809c680 0x7f3ec809caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eb4003fe0 msgr2=0x7f3ec8157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eb4003fe0 0x7f3ec8157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.339 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec809c680 msgr2=0x7f3ec809caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec809c680 0x7f3ec809caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec67fc700 1 -- 172.21.15.22:0/2557088869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec8069340 con 0x7f3ec8068da0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec6ffd700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eb4003fe0 0x7f3ec8157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec77fe700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec809c680 0x7f3ec809caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ec67fc700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 0x7f3ec806ae30 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4004730 tx=0x7f3eb001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0022070 con 0x7f3ec8068da0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000e980 con 0x7f3ec8068da0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec8069620 con 0x7f3ec8068da0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb001c450 con 0x7f3ec8068da0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.333+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec8069be0 con 0x7f3ec8068da0 2023-10-08T00:33:35.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.334+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec8063c90 con 0x7f3ec8068da0 2023-10-08T00:33:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.334+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3eb001c860 con 0x7f3ec8068da0 2023-10-08T00:33:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.335+0000 7f3ebeffd700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3ea8067350 0x7f3ea8069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.335+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f3eb00866c0 con 0x7f3ec8068da0 2023-10-08T00:33:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.335+0000 7f3ec6ffd700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3ea8067350 0x7f3ea8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.336+0000 7f3ec6ffd700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3ea8067350 0x7f3ea8069800 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00015e0 tx=0x7f3ec0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:35.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.339+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3eb00531c0 con 0x7f3ec8068da0 2023-10-08T00:33:35.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:35.560+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000525848", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3ec80718b0 con 0x7f3ea8067350 2023-10-08T00:33:36.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.753+0000 7f3ebeffd700 1 -- 172.21.15.22:0/2557088869 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+127 (secure 0 0 0) 0x7f3ec80718b0 con 0x7f3ea8067350 2023-10-08T00:33:36.755 INFO:teuthology.orchestra.run.smithi022.stdout:FS volume 'cephfs' renamed to 'volume_0000000000525848'. But failed to rename data pools as more than one data pool was found. 2023-10-08T00:33:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3ea8067350 msgr2=0x7f3ea8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3ea8067350 0x7f3ea8069800 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00015e0 tx=0x7f3ec0009040 comp rx=0 tx=0).stop 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 msgr2=0x7f3ec806ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 0x7f3ec806ae30 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4004730 tx=0x7f3eb001a000 comp rx=0 tx=0).stop 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 shutdown_connections 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec809c680 0x7f3ec809caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3ea8067350 0x7f3ea8069800 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3eb4003fe0 0x7f3ec8157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 --2- 172.21.15.22:0/2557088869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ec8068da0 0x7f3ec806ae30 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.756+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 >> 172.21.15.22:0/2557088869 conn(0x7f3ec80999f0 msgr2=0x7f3ec8159160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.757+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 shutdown_connections 2023-10-08T00:33:36.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.757+0000 7f3ecd5ef700 1 -- 172.21.15.22:0/2557088869 wait complete. 2023-10-08T00:33:36.772 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:33:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.900+0000 7fc713b28700 1 Processor -- start 2023-10-08T00:33:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.900+0000 7fc713b28700 1 -- start start 2023-10-08T00:33:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc713b28700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c069560 0x7fc70c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc713b28700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c069ee0 con 0x7fc70c159890 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc713b28700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c15a160 con 0x7fc70c159c60 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc713b28700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0d13a0 con 0x7fc70c069560 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc7118c4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc70c159890 0x7fc70c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49436/0 (socket says 172.21.15.22:49436) 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc7118c4700 1 -- 172.21.15.22:0/1945251297 learned_addr learned my addr 172.21.15.22:0/1945251297 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc7120c5700 1 --2- 172.21.15.22:0/1945251297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c069560 0x7fc70c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.901+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854778528 0 0) 0x7fc70c069ee0 con 0x7fc70c159890 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f4003570 con 0x7fc70c159890 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354728694 0 0) 0x7fc70c15a160 con 0x7fc70c159c60 2023-10-08T00:33:36.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc70c069ee0 con 0x7fc70c159c60 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7120c5700 1 -- 172.21.15.22:0/1945251297 >> v1:172.21.15.192:6789/0 conn(0x7fc70c159c60 legacy=0x7fc70c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7120c5700 1 -- 172.21.15.22:0/1945251297 >> v1:172.21.15.22:6789/0 conn(0x7fc70c159890 legacy=0x7fc70c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7120c5700 1 -- 172.21.15.22:0/1945251297 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c15e140 con 0x7fc70c069560 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7120c5700 1 --2- 172.21.15.22:0/1945251297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c069560 0x7fc70c0699a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc704009910 tx=0x7fc7040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55aafe0143698f68 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704011630 con 0x7fc70c069560 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc704011790 con 0x7fc70c069560 2023-10-08T00:33:36.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.902+0000 7fc7108c2700 1 -- 172.21.15.22:0/1945251297 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704011b10 con 0x7fc70c069560 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 -- 172.21.15.22:0/1945251297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c069560 msgr2=0x7fc70c0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 --2- 172.21.15.22:0/1945251297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c069560 0x7fc70c0699a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc704009910 tx=0x7fc7040091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 -- 172.21.15.22:0/1945251297 shutdown_connections 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 --2- 172.21.15.22:0/1945251297 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c069560 0x7fc70c0699a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 -- 172.21.15.22:0/1945251297 >> 172.21.15.22:0/1945251297 conn(0x7fc70c068e20 msgr2=0x7fc70c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 -- 172.21.15.22:0/1945251297 shutdown_connections 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.903+0000 7fc713b28700 1 -- 172.21.15.22:0/1945251297 wait complete. 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.904+0000 7fc713b28700 1 Processor -- start 2023-10-08T00:33:36.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.904+0000 7fc713b28700 1 -- start start 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 0x7fc70c0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc70c159890 0x7fc70c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c159c60 0x7fc70c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c142d30 con 0x7fc70c069560 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c7d70 con 0x7fc70c159890 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0c7a20 con 0x7fc70c159c60 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 0x7fc70c0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 0x7fc70c0c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54324/0 (socket says 172.21.15.22:54324) 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 -- 172.21.15.22:0/3095633687 learned_addr learned my addr 172.21.15.22:0/3095633687 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7120c5700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c159c60 0x7fc70c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7110c3700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc70c159890 0x7fc70c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 -- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c159c60 msgr2=0x7fc70c0c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c159c60 0x7fc70c0c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 -- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc70c159890 msgr2=0x7fc70c15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc70c159890 0x7fc70c15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 -- 172.21.15.22:0/3095633687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704009420 con 0x7fc70c069560 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc7118c4700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 0x7fc70c0c9240 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc002250 tx=0x7fc6fc001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00ce90 con 0x7fc70c069560 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc00ab30 con 0x7fc70c069560 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c15bf50 con 0x7fc70c069560 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.905+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0070f0 con 0x7fc70c069560 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.906+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c0c9780 con 0x7fc70c069560 2023-10-08T00:33:36.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.907+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c0c7880 con 0x7fc70c069560 2023-10-08T00:33:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.907+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc6fc0074e0 con 0x7fc70c069560 2023-10-08T00:33:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.907+0000 7fc709ffb700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc6f8067320 0x7fc6f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.907+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fc6fc0852d0 con 0x7fc70c069560 2023-10-08T00:33:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.908+0000 7fc7110c3700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc6f8067320 0x7fc6f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:36.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.908+0000 7fc7110c3700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc6f8067320 0x7fc6f80697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc70c15e070 tx=0x7fc700009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:36.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:36.911+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc70c0c7880 con 0x7fc70c069560 2023-10-08T00:33:37.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.132+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc70c0c7eb0 con 0x7fc6f8067320 2023-10-08T00:33:37.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.133+0000 7fc709ffb700 1 -- 172.21.15.22:0/3095633687 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7fc70000e630 con 0x7fc6f8067320 2023-10-08T00:33:37.134 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:33:37.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:37.134 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volume_0000000000525848" 2023-10-08T00:33:37.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:37.134 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:33:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc6f8067320 msgr2=0x7fc6f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc6f8067320 0x7fc6f80697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc70c15e070 tx=0x7fc700009040 comp rx=0 tx=0).stop 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 msgr2=0x7fc70c0c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 0x7fc70c0c9240 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc002250 tx=0x7fc6fc001bb0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 shutdown_connections 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc6f8067320 0x7fc6f80697d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc70c159c60 0x7fc70c0c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc70c069560 0x7fc70c0c9240 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 --2- 172.21.15.22:0/3095633687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc70c159890 0x7fc70c15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 >> 172.21.15.22:0/3095633687 conn(0x7fc70c068e20 msgr2=0x7fc70c155440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 shutdown_connections 2023-10-08T00:33:37.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.136+0000 7fc713b28700 1 -- 172.21.15.22:0/3095633687 wait complete. 2023-10-08T00:33:37.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:37.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.267+0000 7f773d1a5700 1 Processor -- start 2023-10-08T00:33:37.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.267+0000 7f773d1a5700 1 -- start start 2023-10-08T00:33:37.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773d1a5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7738155c10 0x7f7738155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773d1a5700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f77380ac230 0x7f77380ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773d1a5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77380ad930 con 0x7f77380ccc40 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773d1a5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380acd20 con 0x7f7738155c10 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773d1a5700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380ad000 con 0x7f77380ac230 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f7736d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7738155c10 0x7f7738155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773759e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f77380ccc40 0x7f77380af2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49440/0 (socket says 172.21.15.22:49440) 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f7736d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7738155c10 0x7f7738155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54332/0 (socket says 172.21.15.22:54332) 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.268+0000 7f773759e700 1 -- 172.21.15.22:0/2949017503 learned_addr learned my addr 172.21.15.22:0/2949017503 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773659c700 1 --2- 172.21.15.22:0/2949017503 >> v2:172.21.15.192:3300/0 conn(0x7f77380ac230 0x7f77380ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7736d9d700 1 -- 172.21.15.22:0/2949017503 >> v2:172.21.15.192:3300/0 conn(0x7f77380ac230 msgr2=0x7f77380ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7736d9d700 1 --2- 172.21.15.22:0/2949017503 >> v2:172.21.15.192:3300/0 conn(0x7f77380ac230 0x7f77380ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7736d9d700 1 -- 172.21.15.22:0/2949017503 >> v1:172.21.15.22:6789/0 conn(0x7f77380ccc40 legacy=0x7f77380af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7736d9d700 1 -- 172.21.15.22:0/2949017503 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380ad2e0 con 0x7f7738155c10 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7735d9b700 1 -- 172.21.15.22:0/2949017503 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387217948 0 0) 0x7f77380ad930 con 0x7f77380ccc40 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773659c700 1 --2- 172.21.15.22:0/2949017503 >> v2:172.21.15.192:3300/0 conn(0x7f77380ac230 0x7f77380ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7736d9d700 1 --2- 172.21.15.22:0/2949017503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f7738155fe0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f7738065bb0 tx=0x7f77280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a14016b26837c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7735d9b700 1 -- 172.21.15.22:0/2949017503 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800b6b0 con 0x7f7738155c10 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7735d9b700 1 -- 172.21.15.22:0/2949017503 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800b810 con 0x7f7738155c10 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f7735d9b700 1 -- 172.21.15.22:0/2949017503 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800bbb0 con 0x7f7738155c10 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773d1a5700 1 -- 172.21.15.22:0/2949017503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 msgr2=0x7f7738155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2949017503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f7738155fe0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f7738065bb0 tx=0x7f77280091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773d1a5700 1 -- 172.21.15.22:0/2949017503 shutdown_connections 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2949017503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f7738155fe0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2949017503 >> v2:172.21.15.192:3300/0 conn(0x7f77380ac230 0x7f77380ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.269+0000 7f773d1a5700 1 -- 172.21.15.22:0/2949017503 >> 172.21.15.22:0/2949017503 conn(0x7f773806a320 msgr2=0x7f77380cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.270+0000 7f773d1a5700 1 -- 172.21.15.22:0/2949017503 shutdown_connections 2023-10-08T00:33:37.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.270+0000 7f773d1a5700 1 -- 172.21.15.22:0/2949017503 wait complete. 2023-10-08T00:33:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 Processor -- start 2023-10-08T00:33:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 -- start start 2023-10-08T00:33:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77380ac230 0x7f773816a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77380ccc40 0x7f7738152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f77380b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380aa040 con 0x7f7738155c10 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380a9430 con 0x7f77380ccc40 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.271+0000 7f773d1a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380a9710 con 0x7f77380ac230 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f77380b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f77380b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54344/0 (socket says 172.21.15.22:54344) 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 -- 172.21.15.22:0/2676390408 learned_addr learned my addr 172.21.15.22:0/2676390408 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f7736d9d700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77380ac230 0x7f773816a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773659c700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77380ccc40 0x7f7738152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 -- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77380ac230 msgr2=0x7f773816a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77380ac230 0x7f773816a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 -- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77380ccc40 msgr2=0x7f7738152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77380ccc40 0x7f7738152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 -- 172.21.15.22:0/2676390408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7728009420 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773659c700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77380ccc40 0x7f7738152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773759e700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f77380b04e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f773000cc90 tx=0x7f7730001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000a920 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000aa80 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000ae40 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77380a99f0 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.272+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77380b0a20 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.273+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773804c3c0 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.274+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7730007300 con 0x7f7738155c10 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.274+0000 7f772effd700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7718067320 0x7f77180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.274+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f77300852e0 con 0x7f7738155c10 2023-10-08T00:33:37.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.274+0000 7f7736d9d700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7718067320 0x7f77180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.275+0000 7f7736d9d700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7718067320 0x7f77180697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f77280093f0 tx=0x7f7728017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:37.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.279+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7730051d80 con 0x7f7738155c10 2023-10-08T00:33:37.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.518+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77380aa180 con 0x7f7738155c10 2023-10-08T00:33:37.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.519+0000 7f772effd700 1 -- 172.21.15.22:0/2676390408 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f77300553a0 con 0x7f7738155c10 2023-10-08T00:33:37.520 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:37.520 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":118,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:35.746662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000525848","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:37.521 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7718067320 msgr2=0x7f77180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7718067320 0x7f77180697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f77280093f0 tx=0x7f7728017000 comp rx=0 tx=0).stop 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 msgr2=0x7f77380b04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f77380b04e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f773000cc90 tx=0x7f7730001a20 comp rx=0 tx=0).stop 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 shutdown_connections 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7738155c10 0x7f77380b04e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7718067320 0x7f77180697d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f77380ac230 0x7f773816a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 --2- 172.21.15.22:0/2676390408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77380ccc40 0x7f7738152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 >> 172.21.15.22:0/2676390408 conn(0x7f773806a320 msgr2=0x7f773806f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 shutdown_connections 2023-10-08T00:33:37.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.521+0000 7f773d1a5700 1 -- 172.21.15.22:0/2676390408 wait complete. 2023-10-08T00:33:37.523 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 118 2023-10-08T00:33:37.533 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.653+0000 7f48617b7700 1 Processor -- start 2023-10-08T00:33:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.653+0000 7f48617b7700 1 -- start start 2023-10-08T00:33:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f48617b7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f485c159420 0x7f485c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f48617b7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0b2980 con 0x7f485c15d230 2023-10-08T00:33:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f48617b7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0b11d0 con 0x7f485c1597f0 2023-10-08T00:33:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f48617b7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0b14b0 con 0x7f485c159420 2023-10-08T00:33:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f485bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f485c159420 0x7f485c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f485bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f485c159420 0x7f485c0b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54348/0 (socket says 172.21.15.22:54348) 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f4860fb6700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f485c15d230 0x7f485c15d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49458/0 (socket says 172.21.15.22:49458) 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f485bfff700 1 -- 172.21.15.22:0/3404370554 learned_addr learned my addr 172.21.15.22:0/3404370554 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f485bfff700 1 -- 172.21.15.22:0/3404370554 >> v1:172.21.15.192:6789/0 conn(0x7f485c1597f0 legacy=0x7f485c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f485bfff700 1 -- 172.21.15.22:0/3404370554 >> v1:172.21.15.22:6789/0 conn(0x7f485c15d230 legacy=0x7f485c15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.654+0000 7f485bfff700 1 -- 172.21.15.22:0/3404370554 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0b1790 con 0x7f485c159420 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f485bfff700 1 --2- 172.21.15.22:0/3404370554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0b5f40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f48440099b0 tx=0x7f4844009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5409a8a5bc190ec9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f485affd700 1 -- 172.21.15.22:0/3404370554 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400b760 con 0x7f485c159420 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f485affd700 1 -- 172.21.15.22:0/3404370554 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400b8c0 con 0x7f485c159420 2023-10-08T00:33:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f485affd700 1 -- 172.21.15.22:0/3404370554 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400bc60 con 0x7f485c159420 2023-10-08T00:33:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 -- 172.21.15.22:0/3404370554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 msgr2=0x7f485c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 --2- 172.21.15.22:0/3404370554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0b5f40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f48440099b0 tx=0x7f4844009250 comp rx=0 tx=0).stop 2023-10-08T00:33:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 -- 172.21.15.22:0/3404370554 shutdown_connections 2023-10-08T00:33:37.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 --2- 172.21.15.22:0/3404370554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0b5f40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 -- 172.21.15.22:0/3404370554 >> 172.21.15.22:0/3404370554 conn(0x7f485c0d0660 msgr2=0x7f485c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 -- 172.21.15.22:0/3404370554 shutdown_connections 2023-10-08T00:33:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.655+0000 7f48617b7700 1 -- 172.21.15.22:0/3404370554 wait complete. 2023-10-08T00:33:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.656+0000 7f48617b7700 1 Processor -- start 2023-10-08T00:33:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 -- start start 2023-10-08T00:33:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c1597f0 0x7f485c16a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15d230 0x7f485c0c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0cc1e0 con 0x7f485c159420 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0c6420 con 0x7f485c15d230 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f48617b7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c16dca0 con 0x7f485c1597f0 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f485bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f485bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54356/0 (socket says 172.21.15.22:54356) 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.657+0000 7f485bfff700 1 -- 172.21.15.22:0/2837849061 learned_addr learned my addr 172.21.15.22:0/2837849061 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485b7fe700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c1597f0 0x7f485c16a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f4860fb6700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15d230 0x7f485c0c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485bfff700 1 -- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c1597f0 msgr2=0x7f485c16a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485bfff700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c1597f0 0x7f485c16a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485bfff700 1 -- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15d230 msgr2=0x7f485c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485bfff700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15d230 0x7f485c0c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485bfff700 1 -- 172.21.15.22:0/2837849061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440094f0 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f485bfff700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0cbca0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f4844009290 tx=0x7f4844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844006bc0 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484401c690 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c16ae80 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484401ca50 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.658+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c16d650 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.659+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c04c3c0 con 0x7f485c159420 2023-10-08T00:33:37.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.660+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f484401a450 con 0x7f485c159420 2023-10-08T00:33:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.660+0000 7f4853fff700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f483c067320 0x7f483c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.660+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f4844087110 con 0x7f485c159420 2023-10-08T00:33:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.660+0000 7f485b7fe700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f483c067320 0x7f483c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:37.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.661+0000 7f485b7fe700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f483c067320 0x7f483c0697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f485c0cc530 tx=0x7f484c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:37.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.664+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4844053bc0 con 0x7f485c159420 2023-10-08T00:33:37.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.862+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f485c0b1a70 con 0x7f485c159420 2023-10-08T00:33:37.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.863+0000 7f4853fff700 1 -- 172.21.15.22:0/2837849061 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+17005 (secure 0 0 0) 0x7f48440571e0 con 0x7f485c159420 2023-10-08T00:33:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:37.863 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":173,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:36.747980+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000525848.meta","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000525848"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-08T00:33:32.053409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f483c067320 msgr2=0x7f483c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.865 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f483c067320 0x7f483c0697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f485c0cc530 tx=0x7f484c009040 comp rx=0 tx=0).stop 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 msgr2=0x7f485c0cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0cbca0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f4844009290 tx=0x7f4844016000 comp rx=0 tx=0).stop 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 shutdown_connections 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f485c15d230 0x7f485c0c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f485c159420 0x7f485c0cbca0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f483c067320 0x7f483c0697d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 --2- 172.21.15.22:0/2837849061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f485c1597f0 0x7f485c16a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 >> 172.21.15.22:0/2837849061 conn(0x7f485c0d0660 msgr2=0x7f485c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 shutdown_connections 2023-10-08T00:33:37.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:37.865+0000 7f48617b7700 1 -- 172.21.15.22:0/2837849061 wait complete. 2023-10-08T00:33:37.878 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:33:37.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:37.917 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:37.963 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:33:37.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:38.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.082+0000 7f2f8359e700 1 Processor -- start 2023-10-08T00:33:38.083 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.082+0000 7f2f8359e700 1 -- start start 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f84159420 0x7f2f840b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8359e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840b2980 con 0x7f2f841597f0 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840b11d0 con 0x7f2f8415d230 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840b14b0 con 0x7f2f84159420 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f81d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2f841597f0 0x7f2f840b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49466/0 (socket says 172.21.15.22:49466) 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f81d9b700 1 -- 172.21.15.22:0/982616426 learned_addr learned my addr 172.21.15.22:0/982616426 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:38.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8259c700 1 --2- 172.21.15.22:0/982616426 >> v2:172.21.15.192:3300/0 conn(0x7f2f84159420 0x7f2f840b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8159a700 1 -- 172.21.15.22:0/982616426 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129206042 0 0) 0x7f2f840b2980 con 0x7f2f841597f0 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.083+0000 7f2f8159a700 1 -- 172.21.15.22:0/982616426 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f6c003570 con 0x7f2f841597f0 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8159a700 1 -- 172.21.15.22:0/982616426 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 888820830 0 0) 0x7f2f6c003570 con 0x7f2f841597f0 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8259c700 1 -- 172.21.15.22:0/982616426 >> v1:172.21.15.192:6789/0 conn(0x7f2f8415d230 legacy=0x7f2f8415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8259c700 1 -- 172.21.15.22:0/982616426 >> v1:172.21.15.22:6789/0 conn(0x7f2f841597f0 legacy=0x7f2f840b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8259c700 1 -- 172.21.15.22:0/982616426 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f840b1790 con 0x7f2f84159420 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8259c700 1 --2- 172.21.15.22:0/982616426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f84159420 0x7f2f840b5f40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2f740098e0 tx=0x7f2f740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43f92cffa80f0cad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8159a700 1 -- 172.21.15.22:0/982616426 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f78001470 con 0x7f2f84159420 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8159a700 1 -- 172.21.15.22:0/982616426 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f74011420 con 0x7f2f84159420 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8159a700 1 -- 172.21.15.22:0/982616426 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740117c0 con 0x7f2f84159420 2023-10-08T00:33:38.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8359e700 1 -- 172.21.15.22:0/982616426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f84159420 msgr2=0x7f2f840b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.084+0000 7f2f8359e700 1 --2- 172.21.15.22:0/982616426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f84159420 0x7f2f840b5f40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2f740098e0 tx=0x7f2f740091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.085+0000 7f2f8359e700 1 -- 172.21.15.22:0/982616426 shutdown_connections 2023-10-08T00:33:38.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.085+0000 7f2f8359e700 1 --2- 172.21.15.22:0/982616426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f84159420 0x7f2f840b5f40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.085+0000 7f2f8359e700 1 -- 172.21.15.22:0/982616426 >> 172.21.15.22:0/982616426 conn(0x7f2f840d0660 msgr2=0x7f2f840d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:38.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.085+0000 7f2f8359e700 1 -- 172.21.15.22:0/982616426 shutdown_connections 2023-10-08T00:33:38.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.085+0000 7f2f8359e700 1 -- 172.21.15.22:0/982616426 wait complete. 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 Processor -- start 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 -- start start 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f84159420 0x7f2f840c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f841597f0 0x7f2f84068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 0x7f2f840b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840692e0 con 0x7f2f8415d230 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840c5580 con 0x7f2f841597f0 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.086+0000 7f2f8359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f840c5860 con 0x7f2f84159420 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 0x7f2f840b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 0x7f2f840b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54360/0 (socket says 172.21.15.22:54360) 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 -- 172.21.15.22:0/872429634 learned_addr learned my addr 172.21.15.22:0/872429634 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f81d9b700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f841597f0 0x7f2f84068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f8259c700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f84159420 0x7f2f840c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 -- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f84159420 msgr2=0x7f2f840c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f84159420 0x7f2f840c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 -- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f841597f0 msgr2=0x7f2f84068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f841597f0 0x7f2f84068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 -- 172.21.15.22:0/872429634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009420 con 0x7f2f8415d230 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f82d9d700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 0x7f2f840b5ac0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c8b0 tx=0x7f2f7c001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c012630 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f840c5b40 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c012790 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c012b90 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.087+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f840b6000 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.088+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8404c3c0 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.089+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f7c00a420 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.089+0000 7f2f727fc700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f64067320 0x7f2f640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.089+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f2f7c0851b0 con 0x7f2f8415d230 2023-10-08T00:33:38.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.089+0000 7f2f8259c700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f64067320 0x7f2f640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.093 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.090+0000 7f2f8259c700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f64067320 0x7f2f640697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2f740030c0 tx=0x7f2f74017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.093+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f7c051c60 con 0x7f2f8415d230 2023-10-08T00:33:38.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.331+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f840b1a70 con 0x7f2f8415d230 2023-10-08T00:33:38.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.332+0000 7f2f727fc700 1 -- 172.21.15.22:0/872429634 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f2f7c06a220 con 0x7f2f8415d230 2023-10-08T00:33:38.332 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:38.333 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":118,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:35.746662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000525848","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:38.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f64067320 msgr2=0x7f2f640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f64067320 0x7f2f640697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f2f740030c0 tx=0x7f2f74017000 comp rx=0 tx=0).stop 2023-10-08T00:33:38.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 msgr2=0x7f2f840b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 0x7f2f840b5ac0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c8b0 tx=0x7f2f7c001680 comp rx=0 tx=0).stop 2023-10-08T00:33:38.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 shutdown_connections 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f8415d230 0x7f2f840b5ac0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f64067320 0x7f2f640697d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f84159420 0x7f2f840c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 --2- 172.21.15.22:0/872429634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f841597f0 0x7f2f84068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 >> 172.21.15.22:0/872429634 conn(0x7f2f840d0660 msgr2=0x7f2f84156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 shutdown_connections 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.334+0000 7f2f8359e700 1 -- 172.21.15.22:0/872429634 wait complete. 2023-10-08T00:33:38.336 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 118 2023-10-08T00:33:38.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.465+0000 7f247b195700 1 Processor -- start 2023-10-08T00:33:38.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.465+0000 7f247b195700 1 -- start start 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.466+0000 7f247b195700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.466+0000 7f247b195700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f247415db10 0x7f2474069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.466+0000 7f247b195700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247415a160 con 0x7f2474159890 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.466+0000 7f247b195700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24740d13a0 con 0x7f247415db10 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.466+0000 7f247b195700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247415e140 con 0x7f2474159c60 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2479732700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f247415db10 0x7f2474069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247415d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:35874/0 (socket says 172.21.15.22:35874) 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 -- 172.21.15.22:0/649606590 learned_addr learned my addr 172.21.15.22:0/649606590 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 -- 172.21.15.22:0/649606590 >> v2:172.21.15.192:3300/0 conn(0x7f247415db10 msgr2=0x7f2474069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 --2- 172.21.15.22:0/649606590 >> v2:172.21.15.192:3300/0 conn(0x7f247415db10 0x7f2474069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 -- 172.21.15.22:0/649606590 >> v1:172.21.15.192:6789/0 conn(0x7f2474159890 legacy=0x7f247415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 -- 172.21.15.22:0/649606590 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247415a3d0 con 0x7f2474159c60 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f24737fe700 1 -- 172.21.15.22:0/649606590 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012608145 0 0) 0x7f247415a160 con 0x7f2474159890 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2479732700 1 --2- 172.21.15.22:0/649606590 >> v2:172.21.15.192:3300/0 conn(0x7f247415db10 0x7f2474069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:38.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f2473fff700 1 --2- 172.21.15.22:0/649606590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247415d5d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2464009f20 tx=0x7f2464009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef6e9fccd1c3dffe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f24737fe700 1 -- 172.21.15.22:0/649606590 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400e070 con 0x7f2474159c60 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f24737fe700 1 -- 172.21.15.22:0/649606590 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400b9d0 con 0x7f2474159c60 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.467+0000 7f24737fe700 1 -- 172.21.15.22:0/649606590 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24640092e0 con 0x7f2474159c60 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 -- 172.21.15.22:0/649606590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 msgr2=0x7f247415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 --2- 172.21.15.22:0/649606590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247415d5d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2464009f20 tx=0x7f2464009840 comp rx=0 tx=0).stop 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 -- 172.21.15.22:0/649606590 shutdown_connections 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 --2- 172.21.15.22:0/649606590 >> v2:172.21.15.192:3300/0 conn(0x7f247415db10 0x7f2474069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 --2- 172.21.15.22:0/649606590 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247415d5d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 -- 172.21.15.22:0/649606590 >> 172.21.15.22:0/649606590 conn(0x7f2474068e20 msgr2=0x7f24740d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 -- 172.21.15.22:0/649606590 shutdown_connections 2023-10-08T00:33:38.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.468+0000 7f247b195700 1 -- 172.21.15.22:0/649606590 wait complete. 2023-10-08T00:33:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.469+0000 7f247b195700 1 Processor -- start 2023-10-08T00:33:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.469+0000 7f247b195700 1 -- start start 2023-10-08T00:33:38.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f247b195700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2474159890 0x7f247415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f247b195700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247416ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f247b195700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 0x7f24740cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f247b195700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474151400 con 0x7f247415db10 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f247b195700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474151ca0 con 0x7f2474159890 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f247b195700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247415c310 con 0x7f2474159c60 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 0x7f24740cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 0x7f24740cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54372/0 (socket says 172.21.15.22:54372) 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2478f31700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2474159890 0x7f247415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 -- 172.21.15.22:0/2487843368 learned_addr learned my addr 172.21.15.22:0/2487843368 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2473fff700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247416ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 -- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 msgr2=0x7f247416ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247416ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 -- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2474159890 msgr2=0x7f247415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.470+0000 7f2479732700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2474159890 0x7f247415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f2479732700 1 -- 172.21.15.22:0/2487843368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009420 con 0x7f247415db10 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f2479732700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 0x7f24740cd0c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f245c00ea80 tx=0x7f245c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00eec0 con 0x7f247415db10 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c00c850 con 0x7f247415db10 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2464009ae0 con 0x7f247415db10 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00cbf0 con 0x7f247415db10 2023-10-08T00:33:38.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.471+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2474151650 con 0x7f247415db10 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.472+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2474151e30 con 0x7f247415db10 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.472+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f245c013470 con 0x7f247415db10 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.473+0000 7f2470ff9700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2454067320 0x7f24540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.473+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f245c084d80 con 0x7f247415db10 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.473+0000 7f2478f31700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2454067320 0x7f24540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.473+0000 7f2478f31700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2454067320 0x7f24540697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f246c007fd0 tx=0x7f246c007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.477+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f245c051830 con 0x7f247415db10 2023-10-08T00:33:38.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.670+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f247404c3c0 con 0x7f247415db10 2023-10-08T00:33:38.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.671+0000 7f2470ff9700 1 -- 172.21.15.22:0/2487843368 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+17005 (secure 0 0 0) 0x7f245c017090 con 0x7f247415db10 2023-10-08T00:33:38.672 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:38.672 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":173,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:36.747980+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000525848.meta","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000525848"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-08T00:33:32.053409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:38.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2454067320 msgr2=0x7f24540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2454067320 0x7f24540697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f246c007fd0 tx=0x7f246c007d30 comp rx=0 tx=0).stop 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 msgr2=0x7f24740cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 0x7f24740cd0c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f245c00ea80 tx=0x7f245c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 shutdown_connections 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247415db10 0x7f24740cd0c0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2474159890 0x7f247415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2454067320 0x7f24540697d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 --2- 172.21.15.22:0/2487843368 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2474159c60 0x7f247416ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 >> 172.21.15.22:0/2487843368 conn(0x7f2474068e20 msgr2=0x7f2474155450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 shutdown_connections 2023-10-08T00:33:38.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.674+0000 7f247b195700 1 -- 172.21.15.22:0/2487843368 wait complete. 2023-10-08T00:33:38.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 28, 'pool_name': 'cephfs.volume_0000000000525848.meta', 'create_time': '2023-10-08T00:33:14.913981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000525848'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:33:16.037633+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000525848'}}}, {'pool': 30, 'pool_name': 'another-data-pool', 'create_time': '2023-10-08T00:33:32.053409+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000525848'}}}] 2023-10-08T00:33:38.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:33:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.809+0000 7fe196e8a700 1 Processor -- start 2023-10-08T00:33:38.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.809+0000 7fe196e8a700 1 -- start start 2023-10-08T00:33:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.810+0000 7fe196e8a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.810+0000 7fe196e8a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe190159c60 0x7fe19015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.810+0000 7fe196e8a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19015a160 con 0x7fe19015db10 2023-10-08T00:33:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.810+0000 7fe196e8a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900d13a0 con 0x7fe190159c60 2023-10-08T00:33:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.810+0000 7fe196e8a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19015e140 con 0x7fe190159890 2023-10-08T00:33:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe194c26700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe190159c60 0x7fe19015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe195427700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe19015db10 0x7fe190069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:43658/0 (socket says 172.21.15.22:43658) 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe195427700 1 -- 172.21.15.22:0/1819908550 learned_addr learned my addr 172.21.15.22:0/1819908550 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe190159c60 0x7fe19015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:35810/0 (socket says 172.21.15.22:35810) 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18f7fe700 1 -- 172.21.15.22:0/1819908550 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305986717 0 0) 0x7fe19015a160 con 0x7fe19015db10 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18f7fe700 1 -- 172.21.15.22:0/1819908550 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003570 con 0x7fe19015db10 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe194c26700 1 -- 172.21.15.22:0/1819908550 >> v2:172.21.15.192:3300/0 conn(0x7fe190159c60 msgr2=0x7fe19015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe194c26700 1 --2- 172.21.15.22:0/1819908550 >> v2:172.21.15.192:3300/0 conn(0x7fe190159c60 0x7fe19015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe194c26700 1 -- 172.21.15.22:0/1819908550 >> v1:172.21.15.192:6789/0 conn(0x7fe19015db10 legacy=0x7fe190069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe194c26700 1 -- 172.21.15.22:0/1819908550 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19015a3d0 con 0x7fe190159890 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe194c26700 1 --2- 172.21.15.22:0/1819908550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19015abd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1800098e0 tx=0x7fe1800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c277f3f599eb33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18f7fe700 1 -- 172.21.15.22:0/1819908550 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180011630 con 0x7fe190159890 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18f7fe700 1 -- 172.21.15.22:0/1819908550 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180011790 con 0x7fe190159890 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.811+0000 7fe18f7fe700 1 -- 172.21.15.22:0/1819908550 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180011b30 con 0x7fe190159890 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 -- 172.21.15.22:0/1819908550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 msgr2=0x7fe19015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 --2- 172.21.15.22:0/1819908550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19015abd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1800098e0 tx=0x7fe1800091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 -- 172.21.15.22:0/1819908550 shutdown_connections 2023-10-08T00:33:38.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 --2- 172.21.15.22:0/1819908550 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19015abd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 --2- 172.21.15.22:0/1819908550 >> v2:172.21.15.192:3300/0 conn(0x7fe190159c60 0x7fe19015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 -- 172.21.15.22:0/1819908550 >> 172.21.15.22:0/1819908550 conn(0x7fe190068e20 msgr2=0x7fe1900d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 -- 172.21.15.22:0/1819908550 shutdown_connections 2023-10-08T00:33:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.812+0000 7fe196e8a700 1 -- 172.21.15.22:0/1819908550 wait complete. 2023-10-08T00:33:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.813+0000 7fe196e8a700 1 Processor -- start 2023-10-08T00:33:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.813+0000 7fe196e8a700 1 -- start start 2023-10-08T00:33:38.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe196e8a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe196e8a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 0x7fe1901518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe196e8a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe19015db10 0x7fe190151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe196e8a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cf090 con 0x7fe190159c60 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe196e8a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900ce480 con 0x7fe19015db10 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe196e8a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900ce760 con 0x7fe190159890 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 0x7fe1901518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 0x7fe1901518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54374/0 (socket says 172.21.15.22:54374) 2023-10-08T00:33:38.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 -- 172.21.15.22:0/3768004460 learned_addr learned my addr 172.21.15.22:0/3768004460 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe195427700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe19015db10 0x7fe190151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe194c26700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 -- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 msgr2=0x7fe19014b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19014b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 -- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe19015db10 msgr2=0x7fe190151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe19015db10 0x7fe190151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.814+0000 7fe18ffff700 1 -- 172.21.15.22:0/3768004460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009420 con 0x7fe190159c60 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.815+0000 7fe18ffff700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 0x7fe1901518e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe18400ec50 tx=0x7fe1840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.815+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400c850 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.815+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400c9b0 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.815+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1900cea40 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.815+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18400cd70 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.815+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19014bc40 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.816+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1900cf200 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.816+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe184013680 con 0x7fe190159c60 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.816+0000 7fe18cff9700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe17c067320 0x7fe17c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:38.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.817+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fe184085060 con 0x7fe190159c60 2023-10-08T00:33:38.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.817+0000 7fe194c26700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe17c067320 0x7fe17c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:38.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.817+0000 7fe194c26700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe17c067320 0x7fe17c0697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe1800091e0 tx=0x7fe180017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:38.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:38.821+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe184051b10 con 0x7fe190159c60 2023-10-08T00:33:39.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.014+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe19004c3c0 con 0x7fe190159c60 2023-10-08T00:33:39.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.014+0000 7fe18cff9700 1 -- 172.21.15.22:0/3768004460 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v173) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe184055130 con 0x7fe190159c60 2023-10-08T00:33:39.015 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe17c067320 msgr2=0x7fe17c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe17c067320 0x7fe17c0697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe1800091e0 tx=0x7fe180017000 comp rx=0 tx=0).stop 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 msgr2=0x7fe1901518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 0x7fe1901518e0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe18400ec50 tx=0x7fe1840091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 shutdown_connections 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe19015db10 0x7fe190151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe17c067320 0x7fe17c0697d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe190159890 0x7fe19014b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 --2- 172.21.15.22:0/3768004460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe190159c60 0x7fe1901518e0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 >> 172.21.15.22:0/3768004460 conn(0x7fe190068e20 msgr2=0x7fe19014d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 shutdown_connections 2023-10-08T00:33:39.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.016+0000 7fe196e8a700 1 -- 172.21.15.22:0/3768004460 wait complete. 2023-10-08T00:33:39.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000525848.meta pg_num 2023-10-08T00:33:39.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.151+0000 7fe8dd712700 1 Processor -- start 2023-10-08T00:33:39.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.151+0000 7fe8dd712700 1 -- start start 2023-10-08T00:33:39.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.152+0000 7fe8dd712700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.152+0000 7fe8dd712700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d815a160 con 0x7fe8d8159c60 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.152+0000 7fe8dd712700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80d13a0 con 0x7fe8d8069560 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.152+0000 7fe8dd712700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d815e140 con 0x7fe8d8159890 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.152+0000 7fe8d67fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe8d8159c60 0x7fe8d815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49482/0 (socket says 172.21.15.22:49482) 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.152+0000 7fe8d67fc700 1 -- 172.21.15.22:0/2740091708 learned_addr learned my addr 172.21.15.22:0/2740091708 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d6ffd700 1 --2- 172.21.15.22:0/2740091708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747642190 0 0) 0x7fe8d815a160 con 0x7fe8d8159c60 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c4003570 con 0x7fe8d8159c60 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444877321 0 0) 0x7fe8d80d13a0 con 0x7fe8d8069560 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d815a160 con 0x7fe8d8069560 2023-10-08T00:33:39.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106242385 0 0) 0x7fe8c4003570 con 0x7fe8d8159c60 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/2740091708 >> v1:172.21.15.192:6789/0 conn(0x7fe8d8069560 legacy=0x7fe8d80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/2740091708 >> v1:172.21.15.22:6789/0 conn(0x7fe8d8159c60 legacy=0x7fe8d815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/2740091708 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d815a3d0 con 0x7fe8d8159890 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d6ffd700 1 --2- 172.21.15.22:0/2740091708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d815abd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009e90 tx=0x7fe8d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ef7295bcdb432f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000e070 con 0x7fe8d8159890 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000b870 con 0x7fe8d8159890 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.153+0000 7fe8d5ffb700 1 -- 172.21.15.22:0/2740091708 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0001470 con 0x7fe8d8159890 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 -- 172.21.15.22:0/2740091708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 msgr2=0x7fe8d815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 --2- 172.21.15.22:0/2740091708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d815abd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009e90 tx=0x7fe8d0009780 comp rx=0 tx=0).stop 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 -- 172.21.15.22:0/2740091708 shutdown_connections 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 --2- 172.21.15.22:0/2740091708 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d815abd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 -- 172.21.15.22:0/2740091708 >> 172.21.15.22:0/2740091708 conn(0x7fe8d8068e20 msgr2=0x7fe8d80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:39.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 -- 172.21.15.22:0/2740091708 shutdown_connections 2023-10-08T00:33:39.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.154+0000 7fe8dd712700 1 -- 172.21.15.22:0/2740091708 wait complete. 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.155+0000 7fe8dd712700 1 Processor -- start 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.155+0000 7fe8dd712700 1 -- start start 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8dd712700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 0x7fe8d815cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8dd712700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d81521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8dd712700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d8159c60 0x7fe8d8144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8dd712700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8151eb0 con 0x7fe8d8069560 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8dd712700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8151020 con 0x7fe8d8159c60 2023-10-08T00:33:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8dd712700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8150420 con 0x7fe8d8159890 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 0x7fe8d815cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 0x7fe8d815cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54390/0 (socket says 172.21.15.22:54390) 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/3340669293 learned_addr learned my addr 172.21.15.22:0/3340669293 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d67fc700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d81521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d77fe700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d8159c60 0x7fe8d8144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 msgr2=0x7fe8d81521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d81521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d8159c60 msgr2=0x7fe8d8144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d8159c60 0x7fe8d8144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 -- 172.21.15.22:0/3340669293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009a20 con 0x7fe8d8069560 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d67fc700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d81521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d77fe700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d8159c60 0x7fe8d8144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.156+0000 7fe8d6ffd700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 0x7fe8d815cb20 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80899c0 tx=0x7fe8d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.157+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0012c90 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.157+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0012e10 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.157+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d8151230 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.157+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d001e6a0 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.157+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d81517f0 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.158+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d804c3c0 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.158+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe8d001ea90 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.158+0000 7fe8ceffd700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe8b8067320 0x7fe8b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.158+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fe8d00873d0 con 0x7fe8d8069560 2023-10-08T00:33:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.159+0000 7fe8d67fc700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe8b8067320 0x7fe8b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.159+0000 7fe8d67fc700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe8b8067320 0x7fe8b80697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00015a0 tx=0x7fe8c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.163+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d0053d70 con 0x7fe8d8069560 2023-10-08T00:33:39.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.355+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000525848.meta", "var": "pg_num"} v 0) v1 -- 0x7fe8d80cf0e0 con 0x7fe8d8069560 2023-10-08T00:33:39.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.356+0000 7fe8ceffd700 1 -- 172.21.15.22:0/3340669293 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000525848.meta", "var": "pg_num"}]=0 v173) v1 ==== 124+0+11 (secure 0 0 0) 0x7fe8d0057390 con 0x7fe8d8069560 2023-10-08T00:33:39.357 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe8b8067320 msgr2=0x7fe8b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe8b8067320 0x7fe8b80697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00015a0 tx=0x7fe8c0009040 comp rx=0 tx=0).stop 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 msgr2=0x7fe8d815cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 0x7fe8d815cb20 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80899c0 tx=0x7fe8d0017000 comp rx=0 tx=0).stop 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 shutdown_connections 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d8159c60 0x7fe8d8144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8d8069560 0x7fe8d815cb20 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe8b8067320 0x7fe8b80697d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 --2- 172.21.15.22:0/3340669293 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe8d8159890 0x7fe8d81521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 >> 172.21.15.22:0/3340669293 conn(0x7fe8d8068e20 msgr2=0x7fe8d8154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:39.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 shutdown_connections 2023-10-08T00:33:39.360 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.358+0000 7fe8dd712700 1 -- 172.21.15.22:0/3340669293 wait complete. 2023-10-08T00:33:39.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:33:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.493+0000 7fbc89ed2700 1 Processor -- start 2023-10-08T00:33:39.493 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.493+0000 7fbc89ed2700 1 -- start start 2023-10-08T00:33:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc89ed2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc84069560 0x7fbc840699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc89ed2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc84069ee0 con 0x7fbc84159890 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc89ed2700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8415a160 con 0x7fbc84159c60 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc89ed2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840d13a0 con 0x7fbc84069560 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc837fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbc84159890 0x7fbc8415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49486/0 (socket says 172.21.15.22:49486) 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc83fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbc84069560 0x7fbc840699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc837fe700 1 -- 172.21.15.22:0/73932146 learned_addr learned my addr 172.21.15.22:0/73932146 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc83fff700 1 -- 172.21.15.22:0/73932146 >> v1:172.21.15.192:6789/0 conn(0x7fbc84159c60 legacy=0x7fbc8415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc83fff700 1 -- 172.21.15.22:0/73932146 >> v1:172.21.15.22:6789/0 conn(0x7fbc84159890 legacy=0x7fbc8415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc83fff700 1 -- 172.21.15.22:0/73932146 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8415e140 con 0x7fbc84069560 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc827fc700 1 -- 172.21.15.22:0/73932146 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301365011 0 0) 0x7fbc84069ee0 con 0x7fbc84159890 2023-10-08T00:33:39.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc83fff700 1 --2- 172.21.15.22:0/73932146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc840699a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009e60 tx=0x7fbc7c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356cbf559758c950 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc827fc700 1 -- 172.21.15.22:0/73932146 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00e070 con 0x7fbc84069560 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc827fc700 1 -- 172.21.15.22:0/73932146 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00bbf0 con 0x7fbc84069560 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.494+0000 7fbc827fc700 1 -- 172.21.15.22:0/73932146 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c012430 con 0x7fbc84069560 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 -- 172.21.15.22:0/73932146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 msgr2=0x7fbc840699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/73932146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc840699a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009e60 tx=0x7fbc7c009780 comp rx=0 tx=0).stop 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 -- 172.21.15.22:0/73932146 shutdown_connections 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/73932146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc840699a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 -- 172.21.15.22:0/73932146 >> 172.21.15.22:0/73932146 conn(0x7fbc84068e20 msgr2=0x7fbc840d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 -- 172.21.15.22:0/73932146 shutdown_connections 2023-10-08T00:33:39.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.495+0000 7fbc89ed2700 1 -- 172.21.15.22:0/73932146 wait complete. 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.496+0000 7fbc89ed2700 1 Processor -- start 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.496+0000 7fbc89ed2700 1 -- start start 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc89ed2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc8415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc89ed2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc84159890 0x7fbc8414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc89ed2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc84159c60 0x7fbc84157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc89ed2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840cf010 con 0x7fbc84069560 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc89ed2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415d3a0 con 0x7fbc84159890 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc89ed2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840ce400 con 0x7fbc84159c60 2023-10-08T00:33:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc8415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc8415ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54408/0 (socket says 172.21.15.22:54408) 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 -- 172.21.15.22:0/2621806157 learned_addr learned my addr 172.21.15.22:0/2621806157 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc82ffd700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc84159890 0x7fbc8414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc83fff700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc84159c60 0x7fbc84157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 -- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc84159c60 msgr2=0x7fbc84157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc84159c60 0x7fbc84157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 -- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc84159890 msgr2=0x7fbc8414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc84159890 0x7fbc8414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc837fe700 1 -- 172.21.15.22:0/2621806157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c009a20 con 0x7fbc84069560 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.497+0000 7fbc83fff700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc84159c60 0x7fbc84157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.498+0000 7fbc837fe700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc8415ce60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400c7e0 tx=0x7fbc74007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.498+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74005b30 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.498+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74005c90 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.498+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc840ce6e0 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.498+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74007300 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.498+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc840ceca0 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.499+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8404c3c0 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.499+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbc740076b0 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.500+0000 7fbc7b7fe700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbc64067320 0x7fbc640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.500+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fbc740843c0 con 0x7fbc84069560 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.500+0000 7fbc82ffd700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbc64067320 0x7fbc640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.500+0000 7fbc82ffd700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbc64067320 0x7fbc640697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbc84069d80 tx=0x7fbc6c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.504+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc74050e70 con 0x7fbc84069560 2023-10-08T00:33:39.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.696+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc8406a5b0 con 0x7fbc84069560 2023-10-08T00:33:39.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.697+0000 7fbc7b7fe700 1 -- 172.21.15.22:0/2621806157 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v173) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc74054490 con 0x7fbc84069560 2023-10-08T00:33:39.698 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbc64067320 msgr2=0x7fbc640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbc64067320 0x7fbc640697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbc84069d80 tx=0x7fbc6c009060 comp rx=0 tx=0).stop 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 msgr2=0x7fbc8415ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc8415ce60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400c7e0 tx=0x7fbc74007df0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 shutdown_connections 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fbc64067320 0x7fbc640697d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbc84159c60 0x7fbc84157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc84069560 0x7fbc8415ce60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 --2- 172.21.15.22:0/2621806157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc84159890 0x7fbc8414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 >> 172.21.15.22:0/2621806157 conn(0x7fbc84068e20 msgr2=0x7fbc840c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:39.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 shutdown_connections 2023-10-08T00:33:39.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.699+0000 7fbc89ed2700 1 -- 172.21.15.22:0/2621806157 wait complete. 2023-10-08T00:33:39.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get another-data-pool pg_num 2023-10-08T00:33:39.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.833+0000 7f09a36cf700 1 Processor -- start 2023-10-08T00:33:39.834 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.834+0000 7f09a36cf700 1 -- start start 2023-10-08T00:33:39.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.834+0000 7f09a36cf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f099c06bcd0 0x7f099c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.834+0000 7f09a36cf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f099c06c0a0 0x7f099c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a36cf700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c15d7e0 con 0x7f099c15df50 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a36cf700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c15dac0 con 0x7f099c06c0a0 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a36cf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c15aa30 con 0x7f099c06bcd0 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f099c06c0a0 0x7f099c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f099c06c0a0 0x7f099c15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54424/0 (socket says 172.21.15.22:54424) 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 -- 172.21.15.22:0/690420164 learned_addr learned my addr 172.21.15.22:0/690420164 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a146b700 1 --2- 172.21.15.22:0/690420164 >> v2:172.21.15.192:3300/0 conn(0x7f099c06bcd0 0x7f099c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 -- 172.21.15.22:0/690420164 >> v2:172.21.15.192:3300/0 conn(0x7f099c06bcd0 msgr2=0x7f099c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 --2- 172.21.15.22:0/690420164 >> v2:172.21.15.192:3300/0 conn(0x7f099c06bcd0 0x7f099c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 -- 172.21.15.22:0/690420164 >> v1:172.21.15.192:6789/0 conn(0x7f099c15df50 legacy=0x7f099c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 -- 172.21.15.22:0/690420164 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c15ad10 con 0x7f099c06c0a0 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a146b700 1 --2- 172.21.15.22:0/690420164 >> v2:172.21.15.192:3300/0 conn(0x7f099c06bcd0 0x7f099c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f09a0c6a700 1 --2- 172.21.15.22:0/690420164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c06c0a0 0x7f099c15a1e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f099c0691a0 tx=0x7f0990009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be5627ad1edeca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f099bfff700 1 -- 172.21.15.22:0/690420164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000b860 con 0x7f099c06c0a0 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f099bfff700 1 -- 172.21.15.22:0/690420164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000b9c0 con 0x7f099c06c0a0 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.835+0000 7f099bfff700 1 -- 172.21.15.22:0/690420164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000bd80 con 0x7f099c06c0a0 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 -- 172.21.15.22:0/690420164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c06c0a0 msgr2=0x7f099c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 --2- 172.21.15.22:0/690420164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c06c0a0 0x7f099c15a1e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f099c0691a0 tx=0x7f0990009250 comp rx=0 tx=0).stop 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 -- 172.21.15.22:0/690420164 shutdown_connections 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 --2- 172.21.15.22:0/690420164 >> v2:172.21.15.192:3300/0 conn(0x7f099c06bcd0 0x7f099c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 --2- 172.21.15.22:0/690420164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c06c0a0 0x7f099c15a1e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 -- 172.21.15.22:0/690420164 >> 172.21.15.22:0/690420164 conn(0x7f099c0ce600 msgr2=0x7f099c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:39.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 -- 172.21.15.22:0/690420164 shutdown_connections 2023-10-08T00:33:39.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.836+0000 7f09a36cf700 1 -- 172.21.15.22:0/690420164 wait complete. 2023-10-08T00:33:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.837+0000 7f09a36cf700 1 Processor -- start 2023-10-08T00:33:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.837+0000 7f09a36cf700 1 -- start start 2023-10-08T00:33:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a36cf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f099c06bcd0 0x7f099c157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a36cf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f099c06c0a0 0x7f099c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a36cf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 0x7f099c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a36cf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0b2370 con 0x7f099c15df50 2023-10-08T00:33:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a36cf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c6cc0 con 0x7f099c06bcd0 2023-10-08T00:33:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a36cf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0c6fa0 con 0x7f099c06c0a0 2023-10-08T00:33:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 0x7f099c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 0x7f099c0c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54430/0 (socket says 172.21.15.22:54430) 2023-10-08T00:33:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 -- 172.21.15.22:0/2644268318 learned_addr learned my addr 172.21.15.22:0/2644268318 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a146b700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f099c06bcd0 0x7f099c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a0c6a700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f099c06c0a0 0x7f099c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 -- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f099c06c0a0 msgr2=0x7f099c0c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f099c06c0a0 0x7f099c0c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 -- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f099c06bcd0 msgr2=0x7f099c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f099c06bcd0 0x7f099c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a1c6c700 1 -- 172.21.15.22:0/2644268318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900094f0 con 0x7f099c15df50 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.838+0000 7f09a146b700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f099c06bcd0 0x7f099c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.839+0000 7f09a1c6c700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 0x7f099c0c87c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c8e0 tx=0x7f098c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.839+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00ce80 con 0x7f099c15df50 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.839+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00a7e0 con 0x7f099c15df50 2023-10-08T00:33:39.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.839+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c0c7280 con 0x7f099c15df50 2023-10-08T00:33:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.839+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c00ab80 con 0x7f099c15df50 2023-10-08T00:33:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.839+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c157d40 con 0x7f099c15df50 2023-10-08T00:33:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.840+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c0b2520 con 0x7f099c15df50 2023-10-08T00:33:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.840+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f098c012420 con 0x7f099c15df50 2023-10-08T00:33:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.841+0000 7f09997fa700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0988067320 0x7f09880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:39.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.841+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f098c085140 con 0x7f099c15df50 2023-10-08T00:33:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.841+0000 7f09a146b700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0988067320 0x7f09880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.841+0000 7f09a146b700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0988067320 0x7f09880697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0994006f00 tx=0x7f0994008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:39.849 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:39.845+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f099c0b2520 con 0x7f099c15df50 2023-10-08T00:33:40.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.036+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"} v 0) v1 -- 0x7f099c0b2520 con 0x7f099c15df50 2023-10-08T00:33:40.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.037+0000 7f09997fa700 1 -- 172.21.15.22:0/2644268318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"}]=0 v173) v1 ==== 106+0+11 (secure 0 0 0) 0x7f099c0b2520 con 0x7f099c15df50 2023-10-08T00:33:40.037 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:33:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.038+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0988067320 msgr2=0x7f09880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0988067320 0x7f09880697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f0994006f00 tx=0x7f0994008040 comp rx=0 tx=0).stop 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 msgr2=0x7f099c0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 0x7f099c0c87c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c8e0 tx=0x7f098c001710 comp rx=0 tx=0).stop 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 shutdown_connections 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f099c15df50 0x7f099c0c87c0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f099c06bcd0 0x7f099c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0988067320 0x7f09880697d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 --2- 172.21.15.22:0/2644268318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f099c06c0a0 0x7f099c0c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 >> 172.21.15.22:0/2644268318 conn(0x7f099c0ce600 msgr2=0x7f099c0cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:40.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 shutdown_connections 2023-10-08T00:33:40.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.039+0000 7f09a36cf700 1 -- 172.21.15.22:0/2644268318 wait complete. 2023-10-08T00:33:40.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:40.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 Processor -- start 2023-10-08T00:33:40.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 -- start start 2023-10-08T00:33:40.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 0x7f087c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f087c157820 0x7f087c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c157c80 con 0x7f087c0b1850 2023-10-08T00:33:40.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c06fc30 con 0x7f087c157820 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.171+0000 7f0881f29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0cc260 con 0x7f087c0b1c20 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f087c0b1850 0x7f087c0ae680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49502/0 (socket says 172.21.15.22:49502) 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087b7fe700 1 -- 172.21.15.22:0/1258650896 learned_addr learned my addr 172.21.15.22:0/1258650896 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087bfff700 1 --2- 172.21.15.22:0/1258650896 >> v2:172.21.15.192:3300/0 conn(0x7f087c157820 0x7f087c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087affd700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 0x7f087c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350277424 0 0) 0x7f087c157c80 con 0x7f087c0b1850 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0864003570 con 0x7f087c0b1850 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978959599 0 0) 0x7f0864003570 con 0x7f087c0b1850 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 msgr2=0x7f087c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 0x7f087c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 >> v2:172.21.15.192:3300/0 conn(0x7f087c157820 msgr2=0x7f087c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:40.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 --2- 172.21.15.22:0/1258650896 >> v2:172.21.15.192:3300/0 conn(0x7f087c157820 0x7f087c0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0cb300 con 0x7f087c0b1850 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f086c001470 con 0x7f087c0b1850 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 >> v1:172.21.15.22:6789/0 conn(0x7f087c0b1850 legacy=0x7f087c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0864003a60 0x7f0864003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0864004810 0x7f0864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 0x7f08640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c06fc30 con 0x7f0864004810 2023-10-08T00:33:40.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0cc260 con 0x7f0864003a60 2023-10-08T00:33:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086400ba60 con 0x7f087c0b1c20 2023-10-08T00:33:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087affd700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0864004810 0x7f0864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.172+0000 7f087b7fe700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0864003a60 0x7f0864003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087bfff700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 0x7f08640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087affd700 1 -- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 msgr2=0x7f08640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087affd700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f087c0b1c20 0x7f08640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087affd700 1 -- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0864003a60 msgr2=0x7f0864003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087affd700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0864003a60 0x7f0864003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087affd700 1 -- 172.21.15.22:0/1258650896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864003570 con 0x7f0864004810 2023-10-08T00:33:40.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087affd700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0864004810 0x7f0864004c80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0870009c30 tx=0x7f08700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1857ff2d91046646 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000e710 con 0x7f0864004810 2023-10-08T00:33:40.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087000e870 con 0x7f0864004810 2023-10-08T00:33:40.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f087a7fc700 1 -- 172.21.15.22:0/1258650896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087000ec30 con 0x7f0864004810 2023-10-08T00:33:40.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.173+0000 7f0881f29700 1 -- 172.21.15.22:0/1258650896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0864004810 msgr2=0x7f0864004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.180 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.174+0000 7f0881f29700 1 --2- 172.21.15.22:0/1258650896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0864004810 0x7f0864004c80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0870009c30 tx=0x7f08700091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.174+0000 7f087bfff700 1 -- 172.21.15.22:0/1258650896 reap_dead start 2023-10-08T00:33:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.174+0000 7f0881f29700 1 -- 172.21.15.22:0/1258650896 shutdown_connections 2023-10-08T00:33:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.174+0000 7f0881f29700 1 -- 172.21.15.22:0/1258650896 >> 172.21.15.22:0/1258650896 conn(0x7f087c06a320 msgr2=0x7f087c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.174+0000 7f0881f29700 1 -- 172.21.15.22:0/1258650896 shutdown_connections 2023-10-08T00:33:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.174+0000 7f0881f29700 1 -- 172.21.15.22:0/1258650896 wait complete. 2023-10-08T00:33:40.181 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.175+0000 7f0881f29700 1 Processor -- start 2023-10-08T00:33:40.182 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.175+0000 7f0881f29700 1 -- start start 2023-10-08T00:33:40.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0864004810 0x7f087c14b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c14d2d0 0x7f087c154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 0x7f087c1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c168e80 con 0x7f087c1552f0 2023-10-08T00:33:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c155740 con 0x7f087c14d2d0 2023-10-08T00:33:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c168010 con 0x7f0864004810 2023-10-08T00:33:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 0x7f087c1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 0x7f087c1492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54440/0 (socket says 172.21.15.22:54440) 2023-10-08T00:33:40.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 -- 172.21.15.22:0/626929109 learned_addr learned my addr 172.21.15.22:0/626929109 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087affd700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c14d2d0 0x7f087c154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087b7fe700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0864004810 0x7f087c14b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 -- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0864004810 msgr2=0x7f087c14b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0864004810 0x7f087c14b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 -- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c14d2d0 msgr2=0x7f087c154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c14d2d0 0x7f087c154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 -- 172.21.15.22:0/626929109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c168270 con 0x7f087c1552f0 2023-10-08T00:33:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087b7fe700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0864004810 0x7f087c14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087affd700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c14d2d0 0x7f087c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f087bfff700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 0x7f087c1492f0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f08740094d0 tx=0x7f087400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087400e040 con 0x7f087c1552f0 2023-10-08T00:33:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087400f040 con 0x7f087c1552f0 2023-10-08T00:33:40.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c168550 con 0x7f087c1552f0 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087400fe50 con 0x7f087c1552f0 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.176+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c168b10 con 0x7f087c1552f0 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.177+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c0b2360 con 0x7f087c1552f0 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.178+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0874015640 con 0x7f087c1552f0 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.178+0000 7f08637fe700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0868067320 0x7f08680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.178+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f0874085850 con 0x7f087c1552f0 2023-10-08T00:33:40.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.178+0000 7f087b7fe700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0868067320 0x7f08680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.179+0000 7f087b7fe700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0868067320 0x7f08680697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f086c000e10 tx=0x7f086c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.182+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0874055c80 con 0x7f087c1552f0 2023-10-08T00:33:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.420+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f087c168fc0 con 0x7f087c1552f0 2023-10-08T00:33:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.421+0000 7f08637fe700 1 -- 172.21.15.22:0/626929109 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f087c168fc0 con 0x7f087c1552f0 2023-10-08T00:33:40.422 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:40.422 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":118,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:35.746662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000525848","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0868067320 msgr2=0x7f08680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0868067320 0x7f08680697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f086c000e10 tx=0x7f086c009040 comp rx=0 tx=0).stop 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 msgr2=0x7f087c1492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 0x7f087c1492f0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f08740094d0 tx=0x7f087400b040 comp rx=0 tx=0).stop 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 shutdown_connections 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f087c1552f0 0x7f087c1492f0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0868067320 0x7f08680697d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0864004810 0x7f087c14b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 --2- 172.21.15.22:0/626929109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f087c14d2d0 0x7f087c154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 >> 172.21.15.22:0/626929109 conn(0x7f087c06a320 msgr2=0x7f087c0ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 shutdown_connections 2023-10-08T00:33:40.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.423+0000 7f0881f29700 1 -- 172.21.15.22:0/626929109 wait complete. 2023-10-08T00:33:40.425 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 118 2023-10-08T00:33:40.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:40.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.554+0000 7fb647b3c700 1 Processor -- start 2023-10-08T00:33:40.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.555+0000 7fb647b3c700 1 -- start start 2023-10-08T00:33:40.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb647b3c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 0x7fb64015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb647b3c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb64015db10 0x7fb640069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb647b3c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64015a160 con 0x7fb640159890 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb647b3c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400d13a0 con 0x7fb64015db10 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb647b3c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64015e140 con 0x7fb640159c60 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 0x7fb64015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6460d9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb64015db10 0x7fb640069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 0x7fb64015d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:35980/0 (socket says 172.21.15.22:35980) 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 -- 172.21.15.22:0/967874041 learned_addr learned my addr 172.21.15.22:0/967874041 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 -- 172.21.15.22:0/967874041 >> v2:172.21.15.192:3300/0 conn(0x7fb64015db10 msgr2=0x7fb640069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:40.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 --2- 172.21.15.22:0/967874041 >> v2:172.21.15.192:3300/0 conn(0x7fb64015db10 0x7fb640069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 -- 172.21.15.22:0/967874041 >> v1:172.21.15.192:6789/0 conn(0x7fb640159890 legacy=0x7fb64015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6448d6700 1 -- 172.21.15.22:0/967874041 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985030510 0 0) 0x7fb64015a160 con 0x7fb640159890 2023-10-08T00:33:40.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 -- 172.21.15.22:0/967874041 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64015a3d0 con 0x7fb640159c60 2023-10-08T00:33:40.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.556+0000 7fb6450d7700 1 --2- 172.21.15.22:0/967874041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 0x7fb64015d5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6340099b0 tx=0x7fb634009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66dfe156cd081845 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb6448d6700 1 -- 172.21.15.22:0/967874041 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb634009ea0 con 0x7fb640159c60 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb6448d6700 1 -- 172.21.15.22:0/967874041 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63400b860 con 0x7fb640159c60 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb6448d6700 1 -- 172.21.15.22:0/967874041 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400bc00 con 0x7fb640159c60 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 -- 172.21.15.22:0/967874041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 msgr2=0x7fb64015d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 --2- 172.21.15.22:0/967874041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 0x7fb64015d5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6340099b0 tx=0x7fb634009250 comp rx=0 tx=0).stop 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 -- 172.21.15.22:0/967874041 shutdown_connections 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 --2- 172.21.15.22:0/967874041 >> v2:172.21.15.192:3300/0 conn(0x7fb64015db10 0x7fb640069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.561 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 --2- 172.21.15.22:0/967874041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159c60 0x7fb64015d5d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 -- 172.21.15.22:0/967874041 >> 172.21.15.22:0/967874041 conn(0x7fb640068e20 msgr2=0x7fb6400d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 -- 172.21.15.22:0/967874041 shutdown_connections 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.557+0000 7fb647b3c700 1 -- 172.21.15.22:0/967874041 wait complete. 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.558+0000 7fb647b3c700 1 Processor -- start 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.558+0000 7fb647b3c700 1 -- start start 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb647b3c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159890 0x7fb6400b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb647b3c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 0x7fb6400cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb647b3c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64015db10 0x7fb640147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb647b3c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400cd600 con 0x7fb640159c60 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb647b3c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400ce440 con 0x7fb64015db10 2023-10-08T00:33:40.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb647b3c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb640147750 con 0x7fb640159890 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb6450d7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 0x7fb6400cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb6450d7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 0x7fb6400cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54454/0 (socket says 172.21.15.22:54454) 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb6450d7700 1 -- 172.21.15.22:0/1414870105 learned_addr learned my addr 172.21.15.22:0/1414870105 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb6458d8700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159890 0x7fb6400b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.559+0000 7fb6460d9700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64015db10 0x7fb640147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb6450d7700 1 -- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159890 msgr2=0x7fb6400b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb6450d7700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159890 0x7fb6400b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb6450d7700 1 -- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64015db10 msgr2=0x7fb640147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb6450d7700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64015db10 0x7fb640147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb6450d7700 1 -- 172.21.15.22:0/1414870105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340094f0 con 0x7fb640159c60 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb6450d7700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 0x7fb6400cd0c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb640070e20 tx=0x7fb634017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63400bbe0 con 0x7fb640159c60 2023-10-08T00:33:40.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb634011420 con 0x7fb640159c60 2023-10-08T00:33:40.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340117e0 con 0x7fb640159c60 2023-10-08T00:33:40.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400cd830 con 0x7fb640159c60 2023-10-08T00:33:40.564 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.560+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400cddf0 con 0x7fb640159c60 2023-10-08T00:33:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.561+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6400ce5d0 con 0x7fb640159c60 2023-10-08T00:33:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.562+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb634011bd0 con 0x7fb640159c60 2023-10-08T00:33:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.562+0000 7fb63dffb700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb62c067320 0x7fb62c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.562+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb6340866d0 con 0x7fb640159c60 2023-10-08T00:33:40.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.562+0000 7fb6458d8700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb62c067320 0x7fb62c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.563+0000 7fb6458d8700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb62c067320 0x7fb62c0697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb638001560 tx=0x7fb6380016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.566+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb634053240 con 0x7fb640159c60 2023-10-08T00:33:40.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.763+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb64004c3c0 con 0x7fb640159c60 2023-10-08T00:33:40.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.764+0000 7fb63dffb700 1 -- 172.21.15.22:0/1414870105 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+17005 (secure 0 0 0) 0x7fb634056860 con 0x7fb640159c60 2023-10-08T00:33:40.765 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:40.765 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":173,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:36.747980+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000525848.meta","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000525848"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-08T00:33:32.053409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:40.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb62c067320 msgr2=0x7fb62c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb62c067320 0x7fb62c0697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb638001560 tx=0x7fb6380016f0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 msgr2=0x7fb6400cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 0x7fb6400cd0c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb640070e20 tx=0x7fb634017000 comp rx=0 tx=0).stop 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 shutdown_connections 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb64015db10 0x7fb640147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb62c067320 0x7fb62c0697d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb640159890 0x7fb6400b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 --2- 172.21.15.22:0/1414870105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640159c60 0x7fb6400cd0c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.766+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 >> 172.21.15.22:0/1414870105 conn(0x7fb640068e20 msgr2=0x7fb6401571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.767+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 shutdown_connections 2023-10-08T00:33:40.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.767+0000 7fb647b3c700 1 -- 172.21.15.22:0/1414870105 wait complete. 2023-10-08T00:33:40.779 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000525848 and related pools 2023-10-08T00:33:40.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:40.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.898+0000 7f3dfd079700 1 Processor -- start 2023-10-08T00:33:40.899 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.898+0000 7f3dfd079700 1 -- start start 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3dfd079700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3dfd079700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3df8069560 0x7f3df80699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3dfd079700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df815a160 con 0x7f3df8159c60 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3dfd079700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df8069f20 con 0x7f3df8069560 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3dfd079700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80d13a0 con 0x7f3df8159890 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3df8069560 0x7f3df80699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3df8069560 0x7f3df80699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54460/0 (socket says 172.21.15.22:54460) 2023-10-08T00:33:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3df8159c60 0x7f3df815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49504/0 (socket says 172.21.15.22:49504) 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df759e700 1 -- 172.21.15.22:0/2126447221 learned_addr learned my addr 172.21.15.22:0/2126447221 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df6d9d700 1 --2- 172.21.15.22:0/2126447221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df759e700 1 -- 172.21.15.22:0/2126447221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 msgr2=0x7f3df815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df759e700 1 --2- 172.21.15.22:0/2126447221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df759e700 1 -- 172.21.15.22:0/2126447221 >> v1:172.21.15.22:6789/0 conn(0x7f3df8159c60 legacy=0x7f3df815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3df759e700 1 -- 172.21.15.22:0/2126447221 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df815e140 con 0x7f3df8069560 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.899+0000 7f3df5d9b700 1 -- 172.21.15.22:0/2126447221 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563447623 0 0) 0x7f3df815a160 con 0x7f3df8159c60 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3df759e700 1 --2- 172.21.15.22:0/2126447221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8069560 0x7f3df80699e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009f20 tx=0x7f3df0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b654de8ea26e08e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3df5d9b700 1 -- 172.21.15.22:0/2126447221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000e070 con 0x7f3df8069560 2023-10-08T00:33:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3df5d9b700 1 -- 172.21.15.22:0/2126447221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000ba80 con 0x7f3df8069560 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3df5d9b700 1 -- 172.21.15.22:0/2126447221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00092e0 con 0x7f3df8069560 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 -- 172.21.15.22:0/2126447221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8069560 msgr2=0x7f3df80699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2126447221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8069560 0x7f3df80699e0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009f20 tx=0x7f3df0009840 comp rx=0 tx=0).stop 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 -- 172.21.15.22:0/2126447221 shutdown_connections 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2126447221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8069560 0x7f3df80699e0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2126447221 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 -- 172.21.15.22:0/2126447221 >> 172.21.15.22:0/2126447221 conn(0x7f3df8068e20 msgr2=0x7f3df80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 -- 172.21.15.22:0/2126447221 shutdown_connections 2023-10-08T00:33:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.900+0000 7f3dfd079700 1 -- 172.21.15.22:0/2126447221 wait complete. 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 Processor -- start 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 -- start start 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8069560 0x7f3df815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df8153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 0x7f3df816a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80b3590 con 0x7f3df8159c60 2023-10-08T00:33:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df80b3870 con 0x7f3df8069560 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3dfd079700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df816a040 con 0x7f3df8159890 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.902+0000 7f3df759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 0x7f3df816a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 0x7f3df816a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54468/0 (socket says 172.21.15.22:54468) 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 -- 172.21.15.22:0/2095865696 learned_addr learned my addr 172.21.15.22:0/2095865696 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df6d9d700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8069560 0x7f3df815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df659c700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df8153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 -- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 msgr2=0x7f3df8153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df8153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 -- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8069560 msgr2=0x7f3df815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8069560 0x7f3df815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:40.907 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 -- 172.21.15.22:0/2095865696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0009ae0 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df659c700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df8153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3df759e700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 0x7f3df816a9c0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009430 tx=0x7f3df0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00094e0 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df00032f0 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df816a320 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0025460 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.903+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df81697f0 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.904+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df804c3c0 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.904+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3df0003040 con 0x7f3df8159c60 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.905+0000 7f3deeffd700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3dd8067320 0x7f3dd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:40.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.905+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f3df0086ba0 con 0x7f3df8159c60 2023-10-08T00:33:40.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.905+0000 7f3df6d9d700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3dd8067320 0x7f3dd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:40.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.906+0000 7f3df6d9d700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3dd8067320 0x7f3dd80697d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006fd0 tx=0x7f3de8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:40.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:40.909+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3df0053540 con 0x7f3df8159c60 2023-10-08T00:33:41.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.145+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3df80d1730 con 0x7f3df8159c60 2023-10-08T00:33:41.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.146+0000 7f3deeffd700 1 -- 172.21.15.22:0/2095865696 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f3df001be60 con 0x7f3df8159c60 2023-10-08T00:33:41.147 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:41.147 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":118,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:35.746662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000525848","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:41.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3dd8067320 msgr2=0x7f3dd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3dd8067320 0x7f3dd80697d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006fd0 tx=0x7f3de8008040 comp rx=0 tx=0).stop 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 msgr2=0x7f3df816a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 0x7f3df816a9c0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3df0009430 tx=0x7f3df0018000 comp rx=0 tx=0).stop 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 shutdown_connections 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3df8159c60 0x7f3df816a9c0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8069560 0x7f3df815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3dd8067320 0x7f3dd80697d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 --2- 172.21.15.22:0/2095865696 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3df8159890 0x7f3df8153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 >> 172.21.15.22:0/2095865696 conn(0x7f3df8068e20 msgr2=0x7f3df8155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 shutdown_connections 2023-10-08T00:33:41.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.148+0000 7f3dfd079700 1 -- 172.21.15.22:0/2095865696 wait complete. 2023-10-08T00:33:41.150 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 118 2023-10-08T00:33:41.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.280+0000 7f70e3a36700 1 Processor -- start 2023-10-08T00:33:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.280+0000 7f70e3a36700 1 -- start start 2023-10-08T00:33:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e3a36700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc141500 0x7f70dc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e3a36700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc15c2a0 con 0x7f70dc06bcd0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e3a36700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc15b690 con 0x7f70dc06c0a0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e3a36700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc15b970 con 0x7f70dc141500 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e17d2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f70dc06bcd0 0x7f70dc140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49516/0 (socket says 172.21.15.22:49516) 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e17d2700 1 -- 172.21.15.22:0/1537181034 learned_addr learned my addr 172.21.15.22:0/1537181034 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.281+0000 7f70e0fd1700 1 --2- 172.21.15.22:0/1537181034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc141500 0x7f70dc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594771425 0 0) 0x7f70dc15c2a0 con 0x7f70dc06bcd0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c4003570 con 0x7f70dc06bcd0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721788624 0 0) 0x7f70dc15b690 con 0x7f70dc06c0a0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70dc15c2a0 con 0x7f70dc06c0a0 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70e0fd1700 1 -- 172.21.15.22:0/1537181034 >> v1:172.21.15.192:6789/0 conn(0x7f70dc06c0a0 legacy=0x7f70dc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70e0fd1700 1 -- 172.21.15.22:0/1537181034 >> v1:172.21.15.22:6789/0 conn(0x7f70dc06bcd0 legacy=0x7f70dc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70e0fd1700 1 -- 172.21.15.22:0/1537181034 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc15bc50 con 0x7f70dc141500 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70e0fd1700 1 --2- 172.21.15.22:0/1537181034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc141500 0x7f70dc0c8e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009910 tx=0x7f70d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=817c0f81e9ce104b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011630 con 0x7f70dc141500 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0011790 con 0x7f70dc141500 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.282+0000 7f70dbfff700 1 -- 172.21.15.22:0/1537181034 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0011b30 con 0x7f70dc141500 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 -- 172.21.15.22:0/1537181034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc141500 msgr2=0x7f70dc0c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 --2- 172.21.15.22:0/1537181034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc141500 0x7f70dc0c8e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f70d0009910 tx=0x7f70d00091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 -- 172.21.15.22:0/1537181034 shutdown_connections 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 --2- 172.21.15.22:0/1537181034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc141500 0x7f70dc0c8e00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 -- 172.21.15.22:0/1537181034 >> 172.21.15.22:0/1537181034 conn(0x7f70dc0ce600 msgr2=0x7f70dc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 -- 172.21.15.22:0/1537181034 shutdown_connections 2023-10-08T00:33:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.283+0000 7f70e3a36700 1 -- 172.21.15.22:0/1537181034 wait complete. 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.284+0000 7f70e3a36700 1 Processor -- start 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.284+0000 7f70e3a36700 1 -- start start 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e3a36700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70dc06bcd0 0x7f70dc0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e3a36700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc06c0a0 0x7f70dc14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e3a36700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 0x7f70dc0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e3a36700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0b4260 con 0x7f70dc141500 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e3a36700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0b1d60 con 0x7f70dc06bcd0 2023-10-08T00:33:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e3a36700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0b25a0 con 0x7f70dc06c0a0 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 0x7f70dc0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 0x7f70dc0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54472/0 (socket says 172.21.15.22:54472) 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 -- 172.21.15.22:0/4153302947 learned_addr learned my addr 172.21.15.22:0/4153302947 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e0fd1700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc06c0a0 0x7f70dc14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e17d2700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70dc06bcd0 0x7f70dc0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 -- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc06c0a0 msgr2=0x7f70dc14a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc06c0a0 0x7f70dc14a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 -- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70dc06bcd0 msgr2=0x7f70dc0b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70dc06bcd0 0x7f70dc0b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e1fd3700 1 -- 172.21.15.22:0/4153302947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d0009420 con 0x7f70dc141500 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e0fd1700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc06c0a0 0x7f70dc14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:41.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.285+0000 7f70e17d2700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70dc06bcd0 0x7f70dc0b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.286+0000 7f70e1fd3700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 0x7f70dc0c76a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00c910 tx=0x7f70cc0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.286+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00a7e0 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.286+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00a960 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.286+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc14a790 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.286+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00ad20 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.286+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc0b1f50 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.287+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc04c3c0 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.287+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f70cc012630 con 0x7f70dc141500 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.288+0000 7f70d97fa700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70c8067320 0x7f70c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.290 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.288+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f70cc085370 con 0x7f70dc141500 2023-10-08T00:33:41.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.288+0000 7f70e17d2700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70c8067320 0x7f70c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.288+0000 7f70e17d2700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70c8067320 0x7f70c80697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f70d40058d0 tx=0x7f70d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:41.292 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.292+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70cc051ed0 con 0x7f70dc141500 2023-10-08T00:33:41.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.531+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70dc0b26e0 con 0x7f70dc141500 2023-10-08T00:33:41.531 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.531+0000 7f70d97fa700 1 -- 172.21.15.22:0/4153302947 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 118 v118) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f70cc0554f0 con 0x7f70dc141500 2023-10-08T00:33:41.532 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:41.532 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":118,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110}],"filesystems":[{"mdsmap":{"epoch":118,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:17.064425+0000","modified":"2023-10-08T00:33:35.746662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8271":{"gid":8271,"name":"a","rank":0,"incarnation":111,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6834/730688681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":730688681},{"type":"v1","addr":"172.21.15.22:6834","nonce":730688681}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000525848","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70c8067320 msgr2=0x7f70c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70c8067320 0x7f70c80697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f70d40058d0 tx=0x7f70d4009040 comp rx=0 tx=0).stop 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 msgr2=0x7f70dc0c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 0x7f70dc0c76a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00c910 tx=0x7f70cc0027a0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 shutdown_connections 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70dc141500 0x7f70dc0c76a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70dc06bcd0 0x7f70dc0b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f70c8067320 0x7f70c80697d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 --2- 172.21.15.22:0/4153302947 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f70dc06c0a0 0x7f70dc14a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 >> 172.21.15.22:0/4153302947 conn(0x7f70dc0ce600 msgr2=0x7f70dc0cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:41.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 shutdown_connections 2023-10-08T00:33:41.535 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.533+0000 7f70e3a36700 1 -- 172.21.15.22:0/4153302947 wait complete. 2023-10-08T00:33:41.535 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 118 2023-10-08T00:33:41.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.665+0000 7f39a0c85700 1 Processor -- start 2023-10-08T00:33:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.666+0000 7f39a0c85700 1 -- start start 2023-10-08T00:33:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.666+0000 7f39a0c85700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f399c159c60 0x7f399c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.666+0000 7f39a0c85700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f399c15db10 0x7f399c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.666+0000 7f39a0c85700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c15a160 con 0x7f399c159890 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.666+0000 7f39a0c85700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c15df50 con 0x7f399c15db10 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.666+0000 7f39a0c85700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c0d13a0 con 0x7f399c159c60 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f399c15db10 0x7f399c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f399c15db10 0x7f399c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54486/0 (socket says 172.21.15.22:54486) 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 -- 172.21.15.22:0/3324011715 learned_addr learned my addr 172.21.15.22:0/3324011715 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f3999d9b700 1 --2- 172.21.15.22:0/3324011715 >> v2:172.21.15.192:3300/0 conn(0x7f399c159c60 0x7f399c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 -- 172.21.15.22:0/3324011715 >> v2:172.21.15.192:3300/0 conn(0x7f399c159c60 msgr2=0x7f399c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 --2- 172.21.15.22:0/3324011715 >> v2:172.21.15.192:3300/0 conn(0x7f399c159c60 0x7f399c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 -- 172.21.15.22:0/3324011715 >> v1:172.21.15.192:6789/0 conn(0x7f399c159890 legacy=0x7f399c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 -- 172.21.15.22:0/3324011715 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c15e140 con 0x7f399c15db10 2023-10-08T00:33:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399ad9d700 1 --2- 172.21.15.22:0/3324011715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c069560 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f399c0b67f0 tx=0x7f398c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6e9fe827d209d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399959a700 1 -- 172.21.15.22:0/3324011715 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00e070 con 0x7f399c15db10 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399959a700 1 -- 172.21.15.22:0/3324011715 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c00ba50 con 0x7f399c15db10 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.667+0000 7f399959a700 1 -- 172.21.15.22:0/3324011715 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0092e0 con 0x7f399c15db10 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 -- 172.21.15.22:0/3324011715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 msgr2=0x7f399c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3324011715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c069560 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f399c0b67f0 tx=0x7f398c009840 comp rx=0 tx=0).stop 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 -- 172.21.15.22:0/3324011715 shutdown_connections 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3324011715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c069560 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3324011715 >> v2:172.21.15.192:3300/0 conn(0x7f399c159c60 0x7f399c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 -- 172.21.15.22:0/3324011715 >> 172.21.15.22:0/3324011715 conn(0x7f399c068e20 msgr2=0x7f399c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 -- 172.21.15.22:0/3324011715 shutdown_connections 2023-10-08T00:33:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.668+0000 7f39a0c85700 1 -- 172.21.15.22:0/3324011715 wait complete. 2023-10-08T00:33:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.669+0000 7f39a0c85700 1 Processor -- start 2023-10-08T00:33:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.669+0000 7f39a0c85700 1 -- start start 2023-10-08T00:33:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f39a0c85700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f399c159890 0x7f399c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f39a0c85700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f399c159c60 0x7f399c0ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f39a0c85700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f39a0c85700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0cf730 con 0x7f399c15db10 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f39a0c85700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0cd560 con 0x7f399c159890 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f39a0c85700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0cf170 con 0x7f399c159c60 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54502/0 (socket says 172.21.15.22:54502) 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 -- 172.21.15.22:0/3346982397 learned_addr learned my addr 172.21.15.22:0/3346982397 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399a59c700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f399c159890 0x7f399c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f3999d9b700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f399c159c60 0x7f399c0ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 -- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f399c159c60 msgr2=0x7f399c0ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f399c159c60 0x7f399c0ceae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 -- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f399c159890 msgr2=0x7f399c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f399c159890 0x7f399c152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 -- 172.21.15.22:0/3346982397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c009ae0 con 0x7f399c15db10 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399a59c700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f399c159890 0x7f399c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.670+0000 7f399ad9d700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c15c0a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f399c070e20 tx=0x7f398c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.671+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c008e80 con 0x7f399c15db10 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.671+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c00be60 con 0x7f399c15db10 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.671+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c0cf450 con 0x7f399c15db10 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.671+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c0256b0 con 0x7f399c15db10 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.671+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c0cd9f0 con 0x7f399c15db10 2023-10-08T00:33:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.672+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c0cd3b0 con 0x7f399c15db10 2023-10-08T00:33:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.672+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f398c003040 con 0x7f399c15db10 2023-10-08T00:33:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.673+0000 7f39927fc700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f397c0673f0 0x7f397c0698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.673+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f398c086b80 con 0x7f399c15db10 2023-10-08T00:33:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.673+0000 7f399a59c700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f397c0673f0 0x7f397c0698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.673+0000 7f399a59c700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f397c0673f0 0x7f397c0698a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3994007fd0 tx=0x7f3994009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.677+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f398c0535a0 con 0x7f399c15db10 2023-10-08T00:33:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.878+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f399c0cd6d0 con 0x7f399c15db10 2023-10-08T00:33:41.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.879+0000 7f39927fc700 1 -- 172.21.15.22:0/3346982397 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17245 (secure 0 0 0) 0x7f398c056bc0 con 0x7f399c15db10 2023-10-08T00:33:41.880 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:41.880 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":174,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:41.762722+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000525848.meta","create_time":"2023-10-08T00:33:14.913981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000525848"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:16.037633+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-08T00:33:32.053409+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000525848"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"29.0","mappings":[{"from":6,"to":0}]},{"pgid":"29.f","mappings":[{"from":6,"to":0}]},{"pgid":"29.1e","mappings":[{"from":6,"to":0}]},{"pgid":"29.39","mappings":[{"from":6,"to":0}]},{"pgid":"29.3d","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f397c0673f0 msgr2=0x7f397c0698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f397c0673f0 0x7f397c0698a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3994007fd0 tx=0x7f3994009040 comp rx=0 tx=0).stop 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 msgr2=0x7f399c15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c15c0a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f399c070e20 tx=0x7f398c018000 comp rx=0 tx=0).stop 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 shutdown_connections 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f399c15db10 0x7f399c15c0a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f399c159890 0x7f399c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f397c0673f0 0x7f397c0698a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 --2- 172.21.15.22:0/3346982397 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f399c159c60 0x7f399c0ceae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:41.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 >> 172.21.15.22:0/3346982397 conn(0x7f399c068e20 msgr2=0x7f399c1583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:41.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 shutdown_connections 2023-10-08T00:33:41.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:41.881+0000 7f39a0c85700 1 -- 172.21.15.22:0/3346982397 wait complete. 2023-10-08T00:33:41.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000525848 2023-10-08T00:33:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.014+0000 7f1200eaa700 1 Processor -- start 2023-10-08T00:33:42.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.014+0000 7f1200eaa700 1 -- start start 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.015+0000 7f1200eaa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11fc159890 0x7f11fc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.015+0000 7f1200eaa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f11fc159c60 0x7f11fc15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.015+0000 7f1200eaa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc15a160 con 0x7f11fc15db10 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.015+0000 7f1200eaa700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc15df50 con 0x7f11fc159890 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.015+0000 7f1200eaa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0d13a0 con 0x7f11fc159c60 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11fc159890 0x7f11fc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11fc159890 0x7f11fc15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54518/0 (socket says 172.21.15.22:54518) 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 -- 172.21.15.22:0/1211731733 learned_addr learned my addr 172.21.15.22:0/1211731733 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11f9d9b700 1 --2- 172.21.15.22:0/1211731733 >> v2:172.21.15.192:3300/0 conn(0x7f11fc159c60 0x7f11fc15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 -- 172.21.15.22:0/1211731733 >> v2:172.21.15.192:3300/0 conn(0x7f11fc159c60 msgr2=0x7f11fc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 --2- 172.21.15.22:0/1211731733 >> v2:172.21.15.192:3300/0 conn(0x7f11fc159c60 0x7f11fc15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 -- 172.21.15.22:0/1211731733 >> v1:172.21.15.192:6789/0 conn(0x7f11fc15db10 legacy=0x7f11fc069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 -- 172.21.15.22:0/1211731733 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc15e140 con 0x7f11fc159890 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11fa59c700 1 --2- 172.21.15.22:0/1211731733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc15abd0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0b67f0 tx=0x7f11ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd94eb88219610ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11f959a700 1 -- 172.21.15.22:0/1211731733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00e070 con 0x7f11fc159890 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11f959a700 1 -- 172.21.15.22:0/1211731733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec00ba10 con 0x7f11fc159890 2023-10-08T00:33:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.016+0000 7f11f959a700 1 -- 172.21.15.22:0/1211731733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0092e0 con 0x7f11fc159890 2023-10-08T00:33:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 -- 172.21.15.22:0/1211731733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 msgr2=0x7f11fc15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1211731733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc15abd0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0b67f0 tx=0x7f11ec009840 comp rx=0 tx=0).stop 2023-10-08T00:33:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 -- 172.21.15.22:0/1211731733 shutdown_connections 2023-10-08T00:33:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1211731733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc15abd0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1211731733 >> v2:172.21.15.192:3300/0 conn(0x7f11fc159c60 0x7f11fc15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 -- 172.21.15.22:0/1211731733 >> 172.21.15.22:0/1211731733 conn(0x7f11fc068e20 msgr2=0x7f11fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 -- 172.21.15.22:0/1211731733 shutdown_connections 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.017+0000 7f1200eaa700 1 -- 172.21.15.22:0/1211731733 wait complete. 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.018+0000 7f1200eaa700 1 Processor -- start 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.018+0000 7f1200eaa700 1 -- start start 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc159c60 0x7f11fc0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc15db10 0x7f11fc0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b3590 con 0x7f11fc159890 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b5790 con 0x7f11fc159c60 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0b5a70 con 0x7f11fc15db10 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc14d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54534/0 (socket says 172.21.15.22:54534) 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 -- 172.21.15.22:0/1512991970 learned_addr learned my addr 172.21.15.22:0/1512991970 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11f9d9b700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc159c60 0x7f11fc0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fad9d700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc15db10 0x7f11fc0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 -- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc15db10 msgr2=0x7f11fc0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc15db10 0x7f11fc0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 -- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc159c60 msgr2=0x7f11fc0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc159c60 0x7f11fc0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 -- 172.21.15.22:0/1512991970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec009ae0 con 0x7f11fc159890 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11f9d9b700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc159c60 0x7f11fc0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11fa59c700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc14d1b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f11fc070e20 tx=0x7f11ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec012950 con 0x7f11fc159890 2023-10-08T00:33:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec012ad0 con 0x7f11fc159890 2023-10-08T00:33:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc0b37e0 con 0x7f11fc159890 2023-10-08T00:33:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.019+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec012e90 con 0x7f11fc159890 2023-10-08T00:33:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.020+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc0b4520 con 0x7f11fc159890 2023-10-08T00:33:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.020+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc0b3d00 con 0x7f11fc159890 2023-10-08T00:33:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.021+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f11ec01d630 con 0x7f11fc159890 2023-10-08T00:33:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.021+0000 7f11f27fc700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11dc067320 0x7f11dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.021+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6325+0+0 (secure 0 0 0) 0x7f11ec086610 con 0x7f11fc159890 2023-10-08T00:33:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.021+0000 7f11f9d9b700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11dc067320 0x7f11dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.022+0000 7f11f9d9b700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11dc067320 0x7f11dc0697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0cc1a0 tx=0x7f11e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:42.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.025+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11ec052f20 con 0x7f11fc159890 2023-10-08T00:33:42.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.266+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000525848"} v 0) v1 -- 0x7f11fc04c3c0 con 0x7f11fc159890 2023-10-08T00:33:42.268 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:33:42.267+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:33:42.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.271+0000 7f11f27fc700 1 -- 172.21.15.22:0/1512991970 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000525848"}]=0 volume_0000000000525848 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v119) v1 ==== 195+0+0 (secure 0 0 0) 0x7f11ec056540 con 0x7f11fc159890 2023-10-08T00:33:42.275 INFO:tasks.ceph.mds.a.smithi022.stderr: -927> 2023-10-08T00:33:22.429+0000 7ff60c416700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:33:42.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11dc067320 msgr2=0x7f11dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11dc067320 0x7f11dc0697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0cc1a0 tx=0x7f11e4008040 comp rx=0 tx=0).stop 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 msgr2=0x7f11fc14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc14d1b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f11fc070e20 tx=0x7f11ec017000 comp rx=0 tx=0).stop 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 shutdown_connections 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11dc067320 0x7f11dc0697d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11fc15db10 0x7f11fc0b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11fc159890 0x7f11fc14d1b0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 --2- 172.21.15.22:0/1512991970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11fc159c60 0x7f11fc0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 >> 172.21.15.22:0/1512991970 conn(0x7f11fc068e20 msgr2=0x7f11fc0b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 shutdown_connections 2023-10-08T00:33:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.274+0000 7f1200eaa700 1 -- 172.21.15.22:0/1512991970 wait complete. 2023-10-08T00:33:42.277 INFO:teuthology.orchestra.run.smithi022.stderr:volume_0000000000525848 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:33:42.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000525848 --yes-i-really-mean-it 2023-10-08T00:33:42.295 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:33:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.409+0000 7f072decd700 1 Processor -- start 2023-10-08T00:33:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.409+0000 7f072decd700 1 -- start start 2023-10-08T00:33:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f072decd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159890 0x7f072815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f072decd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0728069560 0x7f07280699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f072decd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072815a160 con 0x7f0728159c60 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f072decd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0728069f20 con 0x7f0728069560 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f072decd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280d13a0 con 0x7f0728159890 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f0727fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0728069560 0x7f07280699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f0726ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0728159c60 0x7f072815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49536/0 (socket says 172.21.15.22:49536) 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f0726ffd700 1 -- 172.21.15.22:0/994793265 learned_addr learned my addr 172.21.15.22:0/994793265 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.410+0000 7f07277fe700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159890 0x7f072815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f0727fff700 1 -- 172.21.15.22:0/994793265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159890 msgr2=0x7f072815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f0727fff700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159890 0x7f072815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f0727fff700 1 -- 172.21.15.22:0/994793265 >> v1:172.21.15.22:6789/0 conn(0x7f0728159c60 legacy=0x7f072815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f0727fff700 1 -- 172.21.15.22:0/994793265 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072815e140 con 0x7f0728069560 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f07267fc700 1 -- 172.21.15.22:0/994793265 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158984801 0 0) 0x7f072815a160 con 0x7f0728159c60 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f07277fe700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159890 0x7f072815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f0727fff700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728069560 0x7f07280699e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f0720009e60 tx=0x7f0720009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c68295a037075c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f07267fc700 1 -- 172.21.15.22:0/994793265 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000e070 con 0x7f0728069560 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f07267fc700 1 -- 172.21.15.22:0/994793265 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000bb60 con 0x7f0728069560 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.411+0000 7f07267fc700 1 -- 172.21.15.22:0/994793265 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720012430 con 0x7f0728069560 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 -- 172.21.15.22:0/994793265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728069560 msgr2=0x7f07280699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728069560 0x7f07280699e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f0720009e60 tx=0x7f0720009780 comp rx=0 tx=0).stop 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 -- 172.21.15.22:0/994793265 shutdown_connections 2023-10-08T00:33:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728069560 0x7f07280699e0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 --2- 172.21.15.22:0/994793265 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159890 0x7f072815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 -- 172.21.15.22:0/994793265 >> 172.21.15.22:0/994793265 conn(0x7f0728068e20 msgr2=0x7f07280d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:42.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 -- 172.21.15.22:0/994793265 shutdown_connections 2023-10-08T00:33:42.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.412+0000 7f072decd700 1 -- 172.21.15.22:0/994793265 wait complete. 2023-10-08T00:33:42.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.413+0000 7f072decd700 1 Processor -- start 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.413+0000 7f072decd700 1 -- start start 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0728069560 0x7f0728143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 0x7f07280b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159c60 0x7f072816d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07280b3e80 con 0x7f0728159890 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07280cda30 con 0x7f0728069560 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072816e0c0 con 0x7f0728159c60 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 0x7f07280b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 0x7f07280b4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54564/0 (socket says 172.21.15.22:54564) 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 -- 172.21.15.22:0/1588595574 learned_addr learned my addr 172.21.15.22:0/1588595574 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:42.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0727fff700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159c60 0x7f072816d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f07277fe700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0728069560 0x7f0728143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 -- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159c60 msgr2=0x7f072816d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159c60 0x7f072816d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 -- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0728069560 msgr2=0x7f0728143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0728069560 0x7f0728143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 -- 172.21.15.22:0/1588595574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0718009420 con 0x7f0728159890 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f0726ffd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 0x7f07280b4150 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c840 tx=0x7f071c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c005c00 con 0x7f0728159890 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c005d60 con 0x7f0728159890 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720009a20 con 0x7f0728159890 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0072e0 con 0x7f0728159890 2023-10-08T00:33:42.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.414+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07280b3ba0 con 0x7f0728159890 2023-10-08T00:33:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.415+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072804c3c0 con 0x7f0728159890 2023-10-08T00:33:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.416+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f071c01b3b0 con 0x7f0728159890 2023-10-08T00:33:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.416+0000 7f070f7fe700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0714067320 0x7f07140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.416+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6411+0+0 (secure 0 0 0) 0x7f071c0843b0 con 0x7f0728159890 2023-10-08T00:33:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.416+0000 7f07277fe700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0714067320 0x7f07140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:42.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.417+0000 7f07277fe700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0714067320 0x7f07140697d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f07180093f0 tx=0x7f0718008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:42.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.420+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f071c04b5a0 con 0x7f0728159890 2023-10-08T00:33:42.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:42.659+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000525848", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07280d1730 con 0x7f0728159890 2023-10-08T00:33:43.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.274+0000 7f070f7fe700 1 -- 172.21.15.22:0/1588595574 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000525848", "yes_i_really_mean_it": true}]=0 v120) v1 ==== 121+0+0 (secure 0 0 0) 0x7f071c050e30 con 0x7f0728159890 2023-10-08T00:33:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.276+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0714067320 msgr2=0x7f07140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.276+0000 7f072decd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0714067320 0x7f07140697d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f07180093f0 tx=0x7f0718008040 comp rx=0 tx=0).stop 2023-10-08T00:33:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.276+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 msgr2=0x7f07280b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:43.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.276+0000 7f072decd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 0x7f07280b4150 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c840 tx=0x7f071c007db0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 shutdown_connections 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0714067320 0x7f07140697d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0728159c60 0x7f072816d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0728069560 0x7f0728143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 --2- 172.21.15.22:0/1588595574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0728159890 0x7f07280b4150 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 >> 172.21.15.22:0/1588595574 conn(0x7f0728068e20 msgr2=0x7f07280b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 shutdown_connections 2023-10-08T00:33:43.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.277+0000 7f072decd700 1 -- 172.21.15.22:0/1588595574 wait complete. 2023-10-08T00:33:43.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000525848.meta cephfs.volume_0000000000525848.meta --yes-i-really-really-mean-it 2023-10-08T00:33:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.462+0000 7fec17b37700 1 Processor -- start 2023-10-08T00:33:43.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.462+0000 7fec17b37700 1 -- start start 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec17b37700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fec10159ec0 0x7fec100b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec17b37700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec100b53d0 0x7fec100cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec17b37700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100b5b00 con 0x7fec100cce40 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec17b37700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100b5850 con 0x7fec100b53d0 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec17b37700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100b5da0 con 0x7fec10159ec0 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec100b53d0 0x7fec100cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fec100b53d0 0x7fec100cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54578/0 (socket says 172.21.15.22:54578) 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 -- 172.21.15.22:0/3473823885 learned_addr learned my addr 172.21.15.22:0/3473823885 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:43.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec158d3700 1 --2- 172.21.15.22:0/3473823885 >> v2:172.21.15.192:3300/0 conn(0x7fec10159ec0 0x7fec100b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 -- 172.21.15.22:0/3473823885 >> v2:172.21.15.192:3300/0 conn(0x7fec10159ec0 msgr2=0x7fec100b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 --2- 172.21.15.22:0/3473823885 >> v2:172.21.15.192:3300/0 conn(0x7fec10159ec0 0x7fec100b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 -- 172.21.15.22:0/3473823885 >> v1:172.21.15.192:6789/0 conn(0x7fec100cce40 legacy=0x7fec100cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 -- 172.21.15.22:0/3473823885 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100b6080 con 0x7fec100b53d0 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec158d3700 1 --2- 172.21.15.22:0/3473823885 >> v2:172.21.15.192:3300/0 conn(0x7fec10159ec0 0x7fec100b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.463+0000 7fec150d2700 1 --2- 172.21.15.22:0/3473823885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec100b53d0 0x7fec100cc900 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fec10089120 tx=0x7fec04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2198d9be6d9bd0ae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec148d1700 1 -- 172.21.15.22:0/3473823885 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400b820 con 0x7fec100b53d0 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec148d1700 1 -- 172.21.15.22:0/3473823885 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0400b980 con 0x7fec100b53d0 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec148d1700 1 -- 172.21.15.22:0/3473823885 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400bd20 con 0x7fec100b53d0 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 -- 172.21.15.22:0/3473823885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec100b53d0 msgr2=0x7fec100cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:43.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 --2- 172.21.15.22:0/3473823885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec100b53d0 0x7fec100cc900 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fec10089120 tx=0x7fec04009250 comp rx=0 tx=0).stop 2023-10-08T00:33:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 -- 172.21.15.22:0/3473823885 shutdown_connections 2023-10-08T00:33:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 --2- 172.21.15.22:0/3473823885 >> v2:172.21.15.192:3300/0 conn(0x7fec10159ec0 0x7fec100b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 --2- 172.21.15.22:0/3473823885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec100b53d0 0x7fec100cc900 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 -- 172.21.15.22:0/3473823885 >> 172.21.15.22:0/3473823885 conn(0x7fec100999f0 msgr2=0x7fec100b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 -- 172.21.15.22:0/3473823885 shutdown_connections 2023-10-08T00:33:43.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.464+0000 7fec17b37700 1 -- 172.21.15.22:0/3473823885 wait complete. 2023-10-08T00:33:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.465+0000 7fec17b37700 1 Processor -- start 2023-10-08T00:33:43.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.465+0000 7fec17b37700 1 -- start start 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec17b37700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec100b53d0 0x7fec10157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec17b37700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec100cce40 0x7fec1009c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec17b37700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 0x7fec100ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec17b37700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1009b350 con 0x7fec10159ec0 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec17b37700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1009a460 con 0x7fec100cce40 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec17b37700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1009a740 con 0x7fec100b53d0 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec160d4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 0x7fec100ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec160d4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 0x7fec100ce7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54580/0 (socket says 172.21.15.22:54580) 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec160d4700 1 -- 172.21.15.22:0/1159957337 learned_addr learned my addr 172.21.15.22:0/1159957337 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec150d2700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec100cce40 0x7fec1009c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:43.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.466+0000 7fec158d3700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec100b53d0 0x7fec10157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec160d4700 1 -- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec100b53d0 msgr2=0x7fec10157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec160d4700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec100b53d0 0x7fec10157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec160d4700 1 -- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec100cce40 msgr2=0x7fec1009c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec160d4700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec100cce40 0x7fec1009c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec160d4700 1 -- 172.21.15.22:0/1159957337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040094f0 con 0x7fec10159ec0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec160d4700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 0x7fec100ce7e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fec0000c5b0 tx=0x7fec00007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011590 con 0x7fec10159ec0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec00011710 con 0x7fec10159ec0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011ad0 con 0x7fec10159ec0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1009aa20 con 0x7fec10159ec0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.467+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1009afe0 con 0x7fec10159ec0 2023-10-08T00:33:43.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.468+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec10063c90 con 0x7fec10159ec0 2023-10-08T00:33:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.468+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fec0001c460 con 0x7fec10159ec0 2023-10-08T00:33:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.469+0000 7fec0dffb700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7febfc067320 0x7febfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.469+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fec00084af0 con 0x7fec10159ec0 2023-10-08T00:33:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.469+0000 7fec158d3700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7febfc067320 0x7febfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:43.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.470+0000 7fec158d3700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7febfc067320 0x7febfc0697d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fec08007fd0 tx=0x7fec0800e040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:43.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.473+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec000514c0 con 0x7fec10159ec0 2023-10-08T00:33:43.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:43.670+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000525848.meta", "pool2": "cephfs.volume_0000000000525848.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec100718b0 con 0x7fec10159ec0 2023-10-08T00:33:44.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.276+0000 7fec0dffb700 1 -- 172.21.15.22:0/1159957337 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000525848.meta", "pool2": "cephfs.volume_0000000000525848.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000525848.meta' removed v176) v1 ==== 241+0+0 (secure 0 0 0) 0x7fec00084030 con 0x7fec10159ec0 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7febfc067320 msgr2=0x7febfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7febfc067320 0x7febfc0697d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fec08007fd0 tx=0x7fec0800e040 comp rx=0 tx=0).stop 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 msgr2=0x7fec100ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 0x7fec100ce7e0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fec0000c5b0 tx=0x7fec00007f60 comp rx=0 tx=0).stop 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 shutdown_connections 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fec10159ec0 0x7fec100ce7e0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7febfc067320 0x7febfc0697d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fec100b53d0 0x7fec10157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 --2- 172.21.15.22:0/1159957337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec100cce40 0x7fec1009c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 >> 172.21.15.22:0/1159957337 conn(0x7fec100999f0 msgr2=0x7fec100c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:44.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 shutdown_connections 2023-10-08T00:33:44.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.280+0000 7fec17b37700 1 -- 172.21.15.22:0/1159957337 wait complete. 2023-10-08T00:33:44.283 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs.volume_0000000000525848.meta' removed 2023-10-08T00:33:44.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:33:44.424 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.424+0000 7f0559b93700 1 Processor -- start 2023-10-08T00:33:44.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.424+0000 7f0559b93700 1 -- start start 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0559b93700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05540cd910 0x7f05540ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0559b93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0559b93700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540b5b00 con 0x7f0554159ec0 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0559b93700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540b5da0 con 0x7f05540cd910 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0559b93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540b6080 con 0x7f05540b55a0 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05540cd910 0x7f05540ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f05537fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0554159ec0 0x7f05540b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:49550/0 (socket says 172.21.15.22:49550) 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f05537fe700 1 -- 172.21.15.22:0/3807329404 learned_addr learned my addr 172.21.15.22:0/3807329404 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f05540cd910 0x7f05540ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54582/0 (socket says 172.21.15.22:54582) 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0553fff700 1 --2- 172.21.15.22:0/3807329404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:44.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 -- 172.21.15.22:0/3807329404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 msgr2=0x7f05540ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 --2- 172.21.15.22:0/3807329404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 -- 172.21.15.22:0/3807329404 >> v1:172.21.15.22:6789/0 conn(0x7f0554159ec0 legacy=0x7f05540b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f05527fc700 1 -- 172.21.15.22:0/3807329404 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024153081 0 0) 0x7f05540b5b00 con 0x7f0554159ec0 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 -- 172.21.15.22:0/3807329404 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540cc100 con 0x7f05540cd910 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.425+0000 7f0552ffd700 1 --2- 172.21.15.22:0/3807329404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05540cd910 0x7f05540ce340 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f0548009910 tx=0x7f05480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0794bb694d10876 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f05527fc700 1 -- 172.21.15.22:0/3807329404 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054800b820 con 0x7f05540cd910 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f05527fc700 1 -- 172.21.15.22:0/3807329404 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054800b980 con 0x7f05540cd910 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f05527fc700 1 -- 172.21.15.22:0/3807329404 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054800bd20 con 0x7f05540cd910 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 -- 172.21.15.22:0/3807329404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05540cd910 msgr2=0x7f05540ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 --2- 172.21.15.22:0/3807329404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05540cd910 0x7f05540ce340 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f0548009910 tx=0x7f05480091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 -- 172.21.15.22:0/3807329404 shutdown_connections 2023-10-08T00:33:44.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 --2- 172.21.15.22:0/3807329404 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 --2- 172.21.15.22:0/3807329404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f05540cd910 0x7f05540ce340 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 -- 172.21.15.22:0/3807329404 >> 172.21.15.22:0/3807329404 conn(0x7f05540999f0 msgr2=0x7f05540b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 -- 172.21.15.22:0/3807329404 shutdown_connections 2023-10-08T00:33:44.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.426+0000 7f0559b93700 1 -- 172.21.15.22:0/3807329404 wait complete. 2023-10-08T00:33:44.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.427+0000 7f0559b93700 1 Processor -- start 2023-10-08T00:33:44.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.427+0000 7f0559b93700 1 -- start start 2023-10-08T00:33:44.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0559b93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:44.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0559b93700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0554159ec0 0x7f0554069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:44.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0559b93700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 0x7f055416a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0559b93700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0554069f60 con 0x7f0554069a50 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0559b93700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055406a240 con 0x7f0554159ec0 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0559b93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055406a520 con 0x7f05540b55a0 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0553fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 0x7f055416a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0553fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 0x7f055416a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54586/0 (socket says 172.21.15.22:54586) 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0553fff700 1 -- 172.21.15.22:0/1600364654 learned_addr learned my addr 172.21.15.22:0/1600364654 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f05537fe700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.428+0000 7f0552ffd700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0554159ec0 0x7f0554069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0553fff700 1 -- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 msgr2=0x7f05540c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0553fff700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0553fff700 1 -- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0554159ec0 msgr2=0x7f0554069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0553fff700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0554159ec0 0x7f0554069510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0553fff700 1 -- 172.21.15.22:0/1600364654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009420 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0553fff700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 0x7f055416a3e0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f054c007f20 tx=0x7f054c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c00eb90 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c00ed10 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055416b360 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c014670 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.429+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05540c6ee0 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.430+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05540b5b00 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.430+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f054c0149e0 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.431+0000 7f053b7fe700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0540067320 0x7f05400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.431+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5936+0+0 (secure 0 0 0) 0x7f054c0852f0 con 0x7f0554069a50 2023-10-08T00:33:44.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.431+0000 7f05537fe700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0540067320 0x7f05400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:44.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.432+0000 7f05537fe700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0540067320 0x7f05400697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0544001360 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:44.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.435+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f054c051ea0 con 0x7f0554069a50 2023-10-08T00:33:44.634 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:44.634+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f055416b880 con 0x7f0554069a50 2023-10-08T00:33:45.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.281+0000 7f053b7fe700 1 -- 172.21.15.22:0/1600364654 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v177) v1 ==== 169+0+0 (secure 0 0 0) 0x7f054c0554c0 con 0x7f0554069a50 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0540067320 msgr2=0x7f05400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0540067320 0x7f05400697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f0544001360 tx=0x7f0544009040 comp rx=0 tx=0).stop 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 msgr2=0x7f055416a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 0x7f055416a3e0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f054c007f20 tx=0x7f054c009860 comp rx=0 tx=0).stop 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 shutdown_connections 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0554069a50 0x7f055416a3e0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0540067320 0x7f05400697d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.286 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f05540b55a0 0x7f05540c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 --2- 172.21.15.22:0/1600364654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0554159ec0 0x7f0554069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 >> 172.21.15.22:0/1600364654 conn(0x7f05540999f0 msgr2=0x7f05540ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:45.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 shutdown_connections 2023-10-08T00:33:45.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.285+0000 7f0559b93700 1 -- 172.21.15.22:0/1600364654 wait complete. 2023-10-08T00:33:45.287 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:33:45.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm another-data-pool another-data-pool --yes-i-really-really-mean-it 2023-10-08T00:33:45.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.427+0000 7f6f6ecab700 1 Processor -- start 2023-10-08T00:33:45.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.427+0000 7f6f6ecab700 1 -- start start 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6ecab700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6f680b0790 0x7f6f680cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6ecab700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f681591e0 0x7f6f68159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6ecab700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680cfa00 con 0x7f6f680b03c0 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6ecab700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680cb580 con 0x7f6f681591e0 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6ecab700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680cf160 con 0x7f6f680b0790 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f681591e0 0x7f6f68159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6f681591e0 0x7f6f68159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54588/0 (socket says 172.21.15.22:54588) 2023-10-08T00:33:45.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 -- 172.21.15.22:0/2225198049 learned_addr learned my addr 172.21.15.22:0/2225198049 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6d4a8700 1 --2- 172.21.15.22:0/2225198049 >> v2:172.21.15.192:3300/0 conn(0x7f6f680b0790 0x7f6f680cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 -- 172.21.15.22:0/2225198049 >> v2:172.21.15.192:3300/0 conn(0x7f6f680b0790 msgr2=0x7f6f680cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 --2- 172.21.15.22:0/2225198049 >> v2:172.21.15.192:3300/0 conn(0x7f6f680b0790 0x7f6f680cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 -- 172.21.15.22:0/2225198049 >> v1:172.21.15.192:6789/0 conn(0x7f6f680b03c0 legacy=0x7f6f680b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.428+0000 7f6f6e4aa700 1 -- 172.21.15.22:0/2225198049 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680cf440 con 0x7f6f681591e0 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6e4aa700 1 --2- 172.21.15.22:0/2225198049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f681591e0 0x7f6f68159600 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009f20 tx=0x7f6f58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af72713647065e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6cca7700 1 -- 172.21.15.22:0/2225198049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5800e070 con 0x7f6f681591e0 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6cca7700 1 -- 172.21.15.22:0/2225198049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5800ba00 con 0x7f6f681591e0 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6cca7700 1 -- 172.21.15.22:0/2225198049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580092e0 con 0x7f6f681591e0 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 -- 172.21.15.22:0/2225198049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f681591e0 msgr2=0x7f6f68159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/2225198049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f681591e0 0x7f6f68159600 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009f20 tx=0x7f6f58009840 comp rx=0 tx=0).stop 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 -- 172.21.15.22:0/2225198049 shutdown_connections 2023-10-08T00:33:45.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/2225198049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f681591e0 0x7f6f68159600 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/2225198049 >> v2:172.21.15.192:3300/0 conn(0x7f6f680b0790 0x7f6f680cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 -- 172.21.15.22:0/2225198049 >> 172.21.15.22:0/2225198049 conn(0x7f6f68063230 msgr2=0x7f6f68063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:45.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 -- 172.21.15.22:0/2225198049 shutdown_connections 2023-10-08T00:33:45.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.429+0000 7f6f6ecab700 1 -- 172.21.15.22:0/2225198049 wait complete. 2023-10-08T00:33:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.430+0000 7f6f6ecab700 1 Processor -- start 2023-10-08T00:33:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 -- start start 2023-10-08T00:33:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f680b03c0 0x7f6f680c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:45.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 0x7f6f6814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f681591e0 0x7f6f680c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c9c70 con 0x7f6f680b0790 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680ca100 con 0x7f6f681591e0 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6ecab700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68157b40 con 0x7f6f680b03c0 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6d4a8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 0x7f6f6814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6d4a8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 0x7f6f6814a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54590/0 (socket says 172.21.15.22:54590) 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.431+0000 7f6f6d4a8700 1 -- 172.21.15.22:0/967969223 learned_addr learned my addr 172.21.15.22:0/967969223 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6dca9700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f680b03c0 0x7f6f680c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6d4a8700 1 -- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f680b03c0 msgr2=0x7f6f680c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6d4a8700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f680b03c0 0x7f6f680c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6e4aa700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f681591e0 0x7f6f680c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:45.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6d4a8700 1 -- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f681591e0 msgr2=0x7f6f680c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6d4a8700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f681591e0 0x7f6f680c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6d4a8700 1 -- 172.21.15.22:0/967969223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58009ae0 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6d4a8700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 0x7f6f6814a7a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00d890 tx=0x7f6f5c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00b600 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00b760 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680c4700 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00bae0 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.432+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f680c9900 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.433+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6804c3c0 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.433+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6f5c01e460 con 0x7f6f680b0790 2023-10-08T00:33:45.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.434+0000 7f6f65ffb700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f54067320 0x7f6f540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:45.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.434+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5360+0+0 (secure 0 0 0) 0x7f6f5c085220 con 0x7f6f680b0790 2023-10-08T00:33:45.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.434+0000 7f6f6dca9700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f54067320 0x7f6f540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:45.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.435+0000 7f6f6dca9700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f54067320 0x7f6f540697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000a8a0 tx=0x7f6f60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:45.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.438+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f5c052010 con 0x7f6f680b0790 2023-10-08T00:33:45.632 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:45.631+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f680c9db0 con 0x7f6f680b0790 2023-10-08T00:33:46.289 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.285+0000 7f6f65ffb700 1 -- 172.21.15.22:0/967969223 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true}]=0 pool 'another-data-pool' removed v178) v1 ==== 187+0+0 (secure 0 0 0) 0x7f6f5c055630 con 0x7f6f680b0790 2023-10-08T00:33:46.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f54067320 msgr2=0x7f6f540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f54067320 0x7f6f540697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000a8a0 tx=0x7f6f60008040 comp rx=0 tx=0).stop 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 msgr2=0x7f6f6814a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 0x7f6f6814a7a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00d890 tx=0x7f6f5c008040 comp rx=0 tx=0).stop 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 shutdown_connections 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f681591e0 0x7f6f680c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6f54067320 0x7f6f540697d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6f680b03c0 0x7f6f680c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 --2- 172.21.15.22:0/967969223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6f680b0790 0x7f6f6814a7a0 secure :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00d890 tx=0x7f6f5c008040 comp rx=0 tx=0).stop 2023-10-08T00:33:46.295 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.294+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 >> 172.21.15.22:0/967969223 conn(0x7f6f68063230 msgr2=0x7f6f680698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:46.296 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.296+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 shutdown_connections 2023-10-08T00:33:46.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.297+0000 7f6f6ecab700 1 -- 172.21.15.22:0/967969223 wait complete. 2023-10-08T00:33:46.299 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'another-data-pool' removed 2023-10-08T00:33:46.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:33:46.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.440+0000 7f06659df700 1 Processor -- start 2023-10-08T00:33:46.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.440+0000 7f06659df700 1 -- start start 2023-10-08T00:33:46.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f06659df700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06600cc360 0x7f06600ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f06659df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600b0170 0x7f06600ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f06659df700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06600b1320 con 0x7f06600cbf90 2023-10-08T00:33:46.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f06659df700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06601569d0 con 0x7f06600cc360 2023-10-08T00:33:46.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f06659df700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600b0710 con 0x7f06600b0170 2023-10-08T00:33:46.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f065e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06600cc360 0x7f06600ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f065e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06600cc360 0x7f06600ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54596/0 (socket says 172.21.15.22:54596) 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f065e7fc700 1 -- 172.21.15.22:0/1520763999 learned_addr learned my addr 172.21.15.22:0/1520763999 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.441+0000 7f065f7fe700 1 --2- 172.21.15.22:0/1520763999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600b0170 0x7f06600ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065e7fc700 1 -- 172.21.15.22:0/1520763999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600b0170 msgr2=0x7f06600ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065e7fc700 1 --2- 172.21.15.22:0/1520763999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600b0170 0x7f06600ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065e7fc700 1 -- 172.21.15.22:0/1520763999 >> v1:172.21.15.192:6789/0 conn(0x7f06600cbf90 legacy=0x7f066015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065e7fc700 1 -- 172.21.15.22:0/1520763999 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600b09f0 con 0x7f06600cc360 2023-10-08T00:33:46.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065e7fc700 1 --2- 172.21.15.22:0/1520763999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cc360 0x7f06600ca230 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f06480099b0 tx=0x7f0648009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948c1cb02330beca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065dffb700 1 -- 172.21.15.22:0/1520763999 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800b860 con 0x7f06600cc360 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065dffb700 1 -- 172.21.15.22:0/1520763999 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800b9c0 con 0x7f06600cc360 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f065dffb700 1 -- 172.21.15.22:0/1520763999 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800bd60 con 0x7f06600cc360 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f06659df700 1 -- 172.21.15.22:0/1520763999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cc360 msgr2=0x7f06600ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.442+0000 7f06659df700 1 --2- 172.21.15.22:0/1520763999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cc360 0x7f06600ca230 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f06480099b0 tx=0x7f0648009250 comp rx=0 tx=0).stop 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.443+0000 7f06659df700 1 -- 172.21.15.22:0/1520763999 shutdown_connections 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.443+0000 7f06659df700 1 --2- 172.21.15.22:0/1520763999 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600b0170 0x7f06600ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.443+0000 7f06659df700 1 --2- 172.21.15.22:0/1520763999 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cc360 0x7f06600ca230 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.443+0000 7f06659df700 1 -- 172.21.15.22:0/1520763999 >> 172.21.15.22:0/1520763999 conn(0x7f066006a940 msgr2=0x7f066006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.443+0000 7f06659df700 1 -- 172.21.15.22:0/1520763999 shutdown_connections 2023-10-08T00:33:46.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.443+0000 7f06659df700 1 -- 172.21.15.22:0/1520763999 wait complete. 2023-10-08T00:33:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.444+0000 7f06659df700 1 Processor -- start 2023-10-08T00:33:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.444+0000 7f06659df700 1 -- start start 2023-10-08T00:33:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06600b0170 0x7f0660168240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 0x7f066016c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600cc360 0x7f0660138400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066014b250 con 0x7f06600cbf90 2023-10-08T00:33:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0660150a80 con 0x7f06600b0170 2023-10-08T00:33:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0660168880 con 0x7f06600cc360 2023-10-08T00:33:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 0x7f066016c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 0x7f066016c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54600/0 (socket says 172.21.15.22:54600) 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 -- 172.21.15.22:0/4060781994 learned_addr learned my addr 172.21.15.22:0/4060781994 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065effd700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06600b0170 0x7f0660168240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065f7fe700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600cc360 0x7f0660138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 -- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600cc360 msgr2=0x7f0660138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600cc360 0x7f0660138400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 -- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06600b0170 msgr2=0x7f0660168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06600b0170 0x7f0660168240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 -- 172.21.15.22:0/4060781994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480094f0 con 0x7f06600cbf90 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065effd700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06600b0170 0x7f0660168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f065e7fc700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 0x7f066016c280 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f066006f910 tx=0x7f0648017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:46.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064801a450 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064801a5b0 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0660168b60 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064801a950 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.445+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660138940 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.446+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0660150bf0 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.447+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f064801acc0 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.447+0000 7f0656ffd700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0640067320 0x7f06400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.447+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0648086530 con 0x7f06600cbf90 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.447+0000 7f065effd700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0640067320 0x7f06400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.448+0000 7f065effd700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0640067320 0x7f06400697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0650007fd0 tx=0x7f0650009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:46.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.451+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0660150bf0 con 0x7f06600cbf90 2023-10-08T00:33:46.653 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.652+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0660150bf0 con 0x7f06600cbf90 2023-10-08T00:33:46.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.656+0000 7f0656ffd700 1 -- 172.21.15.22:0/4060781994 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0660150bf0 con 0x7f06600cbf90 2023-10-08T00:33:46.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0640067320 msgr2=0x7f06400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0640067320 0x7f06400697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0650007fd0 tx=0x7f0650009040 comp rx=0 tx=0).stop 2023-10-08T00:33:46.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 msgr2=0x7f066016c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 0x7f066016c280 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f066006f910 tx=0x7f0648017000 comp rx=0 tx=0).stop 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 shutdown_connections 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0640067320 0x7f06400697d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f06600cc360 0x7f0660138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06600b0170 0x7f0660168240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 --2- 172.21.15.22:0/4060781994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06600cbf90 0x7f066016c280 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 >> 172.21.15.22:0/4060781994 conn(0x7f066006a940 msgr2=0x7f0660154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 shutdown_connections 2023-10-08T00:33:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.658+0000 7f06659df700 1 -- 172.21.15.22:0/4060781994 wait complete. 2023-10-08T00:33:46.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-08T00:33:46.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.791+0000 7f22128f7700 1 Processor -- start 2023-10-08T00:33:46.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.791+0000 7f22128f7700 1 -- start start 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f22128f7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f220c159890 0x7f220c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f22128f7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c15a160 con 0x7f220c069560 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f22128f7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220c0d13a0 con 0x7f220c159c60 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f22128f7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220c15e140 con 0x7f220c159890 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f220bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f220c159890 0x7f220c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f2210e94700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f220c069560 0x7f220c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38950/0 (socket says 172.21.15.22:38950) 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f2210e94700 1 -- 172.21.15.22:0/1600579006 learned_addr learned my addr 172.21.15.22:0/1600579006 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f220bfff700 1 -- 172.21.15.22:0/1600579006 >> v1:172.21.15.192:6789/0 conn(0x7f220c159c60 legacy=0x7f220c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f220bfff700 1 -- 172.21.15.22:0/1600579006 >> v1:172.21.15.22:6789/0 conn(0x7f220c069560 legacy=0x7f220c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f220bfff700 1 -- 172.21.15.22:0/1600579006 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c15a3d0 con 0x7f220c159890 2023-10-08T00:33:46.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f220affd700 1 -- 172.21.15.22:0/1600579006 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419791558 0 0) 0x7f220c15a160 con 0x7f220c069560 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.792+0000 7f220bfff700 1 --2- 172.21.15.22:0/1600579006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159890 0x7f220c15abd0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f21f40098e0 tx=0x7f21f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45a389f8d13328 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f220affd700 1 -- 172.21.15.22:0/1600579006 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4009e80 con 0x7f220c159890 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f220affd700 1 -- 172.21.15.22:0/1600579006 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f400b820 con 0x7f220c159890 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f220affd700 1 -- 172.21.15.22:0/1600579006 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f400bba0 con 0x7f220c159890 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 -- 172.21.15.22:0/1600579006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159890 msgr2=0x7f220c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 --2- 172.21.15.22:0/1600579006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159890 0x7f220c15abd0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f21f40098e0 tx=0x7f21f40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 -- 172.21.15.22:0/1600579006 shutdown_connections 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 --2- 172.21.15.22:0/1600579006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159890 0x7f220c15abd0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 -- 172.21.15.22:0/1600579006 >> 172.21.15.22:0/1600579006 conn(0x7f220c068e20 msgr2=0x7f220c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 -- 172.21.15.22:0/1600579006 shutdown_connections 2023-10-08T00:33:46.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.793+0000 7f22128f7700 1 -- 172.21.15.22:0/1600579006 wait complete. 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.794+0000 7f22128f7700 1 Processor -- start 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.794+0000 7f22128f7700 1 -- start start 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f22128f7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220c069560 0x7f220c15ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f22128f7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220c159890 0x7f220c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f22128f7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 0x7f220c16dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f22128f7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c0ca750 con 0x7f220c159c60 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f22128f7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220c16e2b0 con 0x7f220c069560 2023-10-08T00:33:46.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f22128f7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220c15c030 con 0x7f220c159890 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f2210e94700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 0x7f220c16dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f2210e94700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 0x7f220c16dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58808/0 (socket says 172.21.15.22:58808) 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f2210e94700 1 -- 172.21.15.22:0/1657064318 learned_addr learned my addr 172.21.15.22:0/1657064318 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f220bfff700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220c069560 0x7f220c15ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.795+0000 7f220b7fe700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220c159890 0x7f220c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2210e94700 1 -- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220c159890 msgr2=0x7f220c0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2210e94700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220c159890 0x7f220c0ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2210e94700 1 -- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220c069560 msgr2=0x7f220c15ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2210e94700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220c069560 0x7f220c15ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2210e94700 1 -- 172.21.15.22:0/1657064318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f4009420 con 0x7f220c159c60 2023-10-08T00:33:46.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f220bfff700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220c069560 0x7f220c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2210e94700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 0x7f220c16dd70 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f220400cbf0 tx=0x7f22040019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400a9c0 con 0x7f220c159c60 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400ab20 con 0x7f220c159c60 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c15c310 con 0x7f220c159c60 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040070f0 con 0x7f220c159c60 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.796+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220c15c8d0 con 0x7f220c159c60 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.797+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f220c04c3c0 con 0x7f220c159c60 2023-10-08T00:33:46.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.797+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2204007520 con 0x7f220c159c60 2023-10-08T00:33:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.798+0000 7f2203fff700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21ec067320 0x7f21ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.798+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2204084d50 con 0x7f220c159c60 2023-10-08T00:33:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.798+0000 7f220bfff700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21ec067320 0x7f21ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:46.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.799+0000 7f220bfff700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21ec067320 0x7f21ec0697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f21f40030c0 tx=0x7f21f4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:46.802 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:46.802+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2204051d60 con 0x7f220c159c60 2023-10-08T00:33:47.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.080+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7f220c069ad0 con 0x7f220c159c60 2023-10-08T00:33:47.297 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.297+0000 7f2203fff700 1 -- 172.21.15.22:0/1657064318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v449) v1 ==== 163+0+0 (secure 0 0 0) 0x7f2204055380 con 0x7f220c159c60 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21ec067320 msgr2=0x7f21ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21ec067320 0x7f21ec0697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f21f40030c0 tx=0x7f21f4016000 comp rx=0 tx=0).stop 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 msgr2=0x7f220c16dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 0x7f220c16dd70 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f220400cbf0 tx=0x7f22040019b0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 shutdown_connections 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f220c159c60 0x7f220c16dd70 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220c069560 0x7f220c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21ec067320 0x7f21ec0697d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 --2- 172.21.15.22:0/1657064318 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f220c159890 0x7f220c0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 >> 172.21.15.22:0/1657064318 conn(0x7f220c068e20 msgr2=0x7f220c0b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:47.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 shutdown_connections 2023-10-08T00:33:47.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.299+0000 7f22128f7700 1 -- 172.21.15.22:0/1657064318 wait complete. 2023-10-08T00:33:47.312 INFO:tasks.cephfs_test_runner:That renaming a volume with more than one data pool does not change ... ok 2023-10-08T00:33:47.312 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) That volume rename is idempotent. 2023-10-08T00:33:47.313 INFO:tasks.cephfs_test_runner:test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:33:47.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-08T00:33:47.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.433+0000 7fe4817a3700 1 Processor -- start 2023-10-08T00:33:47.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.433+0000 7fe4817a3700 1 -- start start 2023-10-08T00:33:47.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe4817a3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe47c1597c0 0x7fe47c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:47.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe4817a3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0ae390 con 0x7fe47c0aedc0 2023-10-08T00:33:47.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe4817a3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0ae930 con 0x7fe47c0af210 2023-10-08T00:33:47.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe4817a3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c15e390 con 0x7fe47c1597c0 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe47affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe47c1597c0 0x7fe47c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe47a7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe47c0aedc0 0x7fe47c15d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38958/0 (socket says 172.21.15.22:38958) 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe47a7fc700 1 -- 172.21.15.22:0/3070340583 learned_addr learned my addr 172.21.15.22:0/3070340583 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.434+0000 7fe47affd700 1 --2- 172.21.15.22:0/3070340583 >> v2:172.21.15.22:3300/0 conn(0x7fe47c1597c0 0x7fe47c159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58810/0 (socket says 172.21.15.22:58810) 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe47affd700 1 -- 172.21.15.22:0/3070340583 >> v1:172.21.15.192:6789/0 conn(0x7fe47c0af210 legacy=0x7fe47c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe47affd700 1 -- 172.21.15.22:0/3070340583 >> v1:172.21.15.22:6789/0 conn(0x7fe47c0aedc0 legacy=0x7fe47c15d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe47affd700 1 -- 172.21.15.22:0/3070340583 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c15db00 con 0x7fe47c1597c0 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe479ffb700 1 -- 172.21.15.22:0/3070340583 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059859410 0 0) 0x7fe47c0ae390 con 0x7fe47c0aedc0 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe47affd700 1 --2- 172.21.15.22:0/3070340583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c1597c0 0x7fe47c159b90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe474009e60 tx=0x7fe474009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3bba808db7c335 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe479ffb700 1 -- 172.21.15.22:0/3070340583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400e070 con 0x7fe47c1597c0 2023-10-08T00:33:47.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe479ffb700 1 -- 172.21.15.22:0/3070340583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47400bc30 con 0x7fe47c1597c0 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.435+0000 7fe479ffb700 1 -- 172.21.15.22:0/3070340583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474012430 con 0x7fe47c1597c0 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 -- 172.21.15.22:0/3070340583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c1597c0 msgr2=0x7fe47c159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 --2- 172.21.15.22:0/3070340583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c1597c0 0x7fe47c159b90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe474009e60 tx=0x7fe474009780 comp rx=0 tx=0).stop 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 -- 172.21.15.22:0/3070340583 shutdown_connections 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 --2- 172.21.15.22:0/3070340583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c1597c0 0x7fe47c159b90 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 -- 172.21.15.22:0/3070340583 >> 172.21.15.22:0/3070340583 conn(0x7fe47c0c9f30 msgr2=0x7fe47c06dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 -- 172.21.15.22:0/3070340583 shutdown_connections 2023-10-08T00:33:47.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.436+0000 7fe4817a3700 1 -- 172.21.15.22:0/3070340583 wait complete. 2023-10-08T00:33:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.437+0000 7fe4817a3700 1 Processor -- start 2023-10-08T00:33:47.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.437+0000 7fe4817a3700 1 -- start start 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe4817a3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe47c0aedc0 0x7fe47c0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe4817a3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 0x7fe47c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe4817a3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe47c1597c0 0x7fe47c0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe4817a3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0b01c0 con 0x7fe47c0af210 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe4817a3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0b04a0 con 0x7fe47c1597c0 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe4817a3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0b0780 con 0x7fe47c0aedc0 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 0x7fe47c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 0x7fe47c1558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58826/0 (socket says 172.21.15.22:58826) 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 -- 172.21.15.22:0/4198310170 learned_addr learned my addr 172.21.15.22:0/4198310170 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:47.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47affd700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe47c0aedc0 0x7fe47c0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47b7fe700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe47c1597c0 0x7fe47c0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 -- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe47c0aedc0 msgr2=0x7fe47c0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe47c0aedc0 0x7fe47c0af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 -- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe47c1597c0 msgr2=0x7fe47c0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe47c1597c0 0x7fe47c0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 -- 172.21.15.22:0/4198310170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474009a20 con 0x7fe47c0af210 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47b7fe700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe47c1597c0 0x7fe47c0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe47a7fc700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 0x7fe47c1558a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe46400c7e0 tx=0x7fe464007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.438+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464005b30 con 0x7fe47c0af210 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.439+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe464005c90 con 0x7fe47c0af210 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.439+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c0b0a60 con 0x7fe47c0af210 2023-10-08T00:33:47.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.439+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464007300 con 0x7fe47c0af210 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.439+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c0afdb0 con 0x7fe47c0af210 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.439+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c0b0f80 con 0x7fe47c0af210 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.440+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe46401b400 con 0x7fe47c0af210 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.440+0000 7fe472ffd700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe45c067320 0x7fe45c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.440+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe464084360 con 0x7fe47c0af210 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.441+0000 7fe47affd700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe45c067320 0x7fe45c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:47.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.441+0000 7fe47affd700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe45c067320 0x7fe45c0697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe474009e60 tx=0x7fe474019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:47.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.445+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe464051470 con 0x7fe47c0af210 2023-10-08T00:33:47.721 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:47.720+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7fe47c04c3c0 con 0x7fe47c0af210 2023-10-08T00:33:48.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.299+0000 7fe472ffd700 1 -- 172.21.15.22:0/4198310170 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v450) v1 ==== 150+0+0 (secure 0 0 0) 0x7fe464054a90 con 0x7fe47c0af210 2023-10-08T00:33:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe45c067320 msgr2=0x7fe45c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe45c067320 0x7fe45c0697d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe474009e60 tx=0x7fe474019000 comp rx=0 tx=0).stop 2023-10-08T00:33:48.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 msgr2=0x7fe47c1558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 0x7fe47c1558a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe46400c7e0 tx=0x7fe464007df0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 shutdown_connections 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe47c1597c0 0x7fe47c0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe45c067320 0x7fe45c0697d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe47c0aedc0 0x7fe47c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.301+0000 7fe4817a3700 1 --2- 172.21.15.22:0/4198310170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe47c0af210 0x7fe47c1558a0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.302+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 >> 172.21.15.22:0/4198310170 conn(0x7fe47c0c9f30 msgr2=0x7fe47c156290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.302+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 shutdown_connections 2023-10-08T00:33:48.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.302+0000 7fe4817a3700 1 -- 172.21.15.22:0/4198310170 wait complete. 2023-10-08T00:33:48.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:33:48.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.442+0000 7f59eb59e700 1 Processor -- start 2023-10-08T00:33:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.442+0000 7f59eb59e700 1 -- start start 2023-10-08T00:33:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59eb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 0x7f59ec0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59eb59e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59ec0b16d0 0x7f59ec0b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59eb59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec0b2080 con 0x7f59ec15d240 2023-10-08T00:33:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59eb59e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec0cfb00 con 0x7f59ec0b16d0 2023-10-08T00:33:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59eb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0b5c40 con 0x7f59ec0b4e70 2023-10-08T00:33:48.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 0x7f59ec0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59e9d9b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59ec0b16d0 0x7f59ec0b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59ea59c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 0x7f59ec0ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:49398/0 (socket says 172.21.15.22:49398) 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59ea59c700 1 -- 172.21.15.22:0/1420765552 learned_addr learned my addr 172.21.15.22:0/1420765552 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.443+0000 7f59ead9d700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f59ec15d240 0x7f59ec15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:41038/0 (socket says 172.21.15.22:41038) 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e959a700 1 -- 172.21.15.22:0/1420765552 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646479336 0 0) 0x7f59ec0b2080 con 0x7f59ec15d240 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e959a700 1 -- 172.21.15.22:0/1420765552 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003570 con 0x7f59ec15d240 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e9d9b700 1 -- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 msgr2=0x7f59ec0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e9d9b700 1 --2- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 0x7f59ec0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e9d9b700 1 -- 172.21.15.22:0/1420765552 >> v1:172.21.15.192:6789/0 conn(0x7f59ec15d240 legacy=0x7f59ec15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e9d9b700 1 -- 172.21.15.22:0/1420765552 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0b5f20 con 0x7f59ec0b16d0 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59ea59c700 1 --2- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 0x7f59ec0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e9d9b700 1 --2- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec0b1b40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f59d40098e0 tx=0x7f59d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557d19abba4dce02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e959a700 1 -- 172.21.15.22:0/1420765552 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011630 con 0x7f59ec0b16d0 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e959a700 1 -- 172.21.15.22:0/1420765552 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4011790 con 0x7f59ec0b16d0 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.444+0000 7f59e959a700 1 -- 172.21.15.22:0/1420765552 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011b30 con 0x7f59ec0b16d0 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 -- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 msgr2=0x7f59ec0b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 --2- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec0b1b40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f59d40098e0 tx=0x7f59d40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 -- 172.21.15.22:0/1420765552 shutdown_connections 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 --2- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec0b4e70 0x7f59ec0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 --2- 172.21.15.22:0/1420765552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec0b1b40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 -- 172.21.15.22:0/1420765552 >> 172.21.15.22:0/1420765552 conn(0x7f59ec0d10c0 msgr2=0x7f59ec0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:48.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 -- 172.21.15.22:0/1420765552 shutdown_connections 2023-10-08T00:33:48.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.445+0000 7f59eb59e700 1 -- 172.21.15.22:0/1420765552 wait complete. 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.446+0000 7f59eb59e700 1 Processor -- start 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.446+0000 7f59eb59e700 1 -- start start 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59eb59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59eb59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 0x7f59ec0c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59eb59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec15d240 0x7f59ec15e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59eb59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec146150 con 0x7f59ec0b4e70 2023-10-08T00:33:48.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59eb59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c67d0 con 0x7f59ec0b16d0 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59eb59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c6ab0 con 0x7f59ec15d240 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 0x7f59ec0c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 0x7f59ec0c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58842/0 (socket says 172.21.15.22:58842) 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 -- 172.21.15.22:0/65526815 learned_addr learned my addr 172.21.15.22:0/65526815 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59ea59c700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 -- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec15d240 msgr2=0x7f59ec15e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec15d240 0x7f59ec15e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 -- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 msgr2=0x7f59ec145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 -- 172.21.15.22:0/65526815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40094f0 con 0x7f59ec0b4e70 2023-10-08T00:33:48.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e9d9b700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 0x7f59ec0c7500 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f59ec070dd0 tx=0x7f59d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.447+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d401f070 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.448+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4000bc0 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.448+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4009420 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.448+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011b30 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.448+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec0c7070 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.449+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec088990 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.449+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f59d4023070 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.449+0000 7f59e27fc700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f59cc067320 0x7f59cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.449+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f59d4085c10 con 0x7f59ec0b4e70 2023-10-08T00:33:48.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.450+0000 7f59ea59c700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f59cc067320 0x7f59cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.450+0000 7f59ea59c700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f59cc067320 0x7f59cc0697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f59e40094c0 tx=0x7f59e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.454+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59d4052c50 con 0x7f59ec0b4e70 2023-10-08T00:33:48.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.648+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f59ec0cd4c0 con 0x7f59ec0b4e70 2023-10-08T00:33:48.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.651+0000 7f59e27fc700 1 -- 172.21.15.22:0/65526815 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59d402a070 con 0x7f59ec0b4e70 2023-10-08T00:33:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f59cc067320 msgr2=0x7f59cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f59cc067320 0x7f59cc0697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f59e40094c0 tx=0x7f59e4008040 comp rx=0 tx=0).stop 2023-10-08T00:33:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 msgr2=0x7f59ec0c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 0x7f59ec0c7500 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f59ec070dd0 tx=0x7f59d4017000 comp rx=0 tx=0).stop 2023-10-08T00:33:48.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 shutdown_connections 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f59cc067320 0x7f59cc0697d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f59ec15d240 0x7f59ec15e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59ec0b16d0 0x7f59ec145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 --2- 172.21.15.22:0/65526815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59ec0b4e70 0x7f59ec0c7500 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 >> 172.21.15.22:0/65526815 conn(0x7f59ec0d10c0 msgr2=0x7f59ec0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 shutdown_connections 2023-10-08T00:33:48.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.653+0000 7f59eb59e700 1 -- 172.21.15.22:0/65526815 wait complete. 2023-10-08T00:33:48.666 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:33:48.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:48.705 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:33:48.750 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:33:48.753 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:33:48.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:48.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 Processor -- start 2023-10-08T00:33:48.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 -- start start 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30e006e6c0 0x7f30e015a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30e01566f0 0x7f30e00b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e00affc0 con 0x7f30e00c9030 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e015aa30 con 0x7f30e006e6c0 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.873+0000 7f30e5755700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e015ad10 con 0x7f30e01566f0 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30deffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f30e006e6c0 0x7f30e015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30de7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f30e00c9030 0x7f30e0155fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38960/0 (socket says 172.21.15.22:38960) 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30de7fc700 1 -- 172.21.15.22:0/2908078392 learned_addr learned my addr 172.21.15.22:0/2908078392 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30df7fe700 1 --2- 172.21.15.22:0/2908078392 >> v2:172.21.15.192:3300/0 conn(0x7f30e01566f0 0x7f30e00b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30deffd700 1 -- 172.21.15.22:0/2908078392 >> v2:172.21.15.192:3300/0 conn(0x7f30e01566f0 msgr2=0x7f30e00b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:48.876 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30deffd700 1 --2- 172.21.15.22:0/2908078392 >> v2:172.21.15.192:3300/0 conn(0x7f30e01566f0 0x7f30e00b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30deffd700 1 -- 172.21.15.22:0/2908078392 >> v1:172.21.15.22:6789/0 conn(0x7f30e00c9030 legacy=0x7f30e0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30deffd700 1 -- 172.21.15.22:0/2908078392 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e015aff0 con 0x7f30e006e6c0 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30ddffb700 1 -- 172.21.15.22:0/2908078392 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436346055 0 0) 0x7f30e00affc0 con 0x7f30e00c9030 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30deffd700 1 --2- 172.21.15.22:0/2908078392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e015a100 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f30e00ae960 tx=0x7f30d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da2278beb1e6f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30ddffb700 1 -- 172.21.15.22:0/2908078392 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800b6b0 con 0x7f30e006e6c0 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30ddffb700 1 -- 172.21.15.22:0/2908078392 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800b810 con 0x7f30e006e6c0 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.874+0000 7f30ddffb700 1 -- 172.21.15.22:0/2908078392 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800bbb0 con 0x7f30e006e6c0 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 -- 172.21.15.22:0/2908078392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 msgr2=0x7f30e015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 --2- 172.21.15.22:0/2908078392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e015a100 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f30e00ae960 tx=0x7f30d80091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 -- 172.21.15.22:0/2908078392 shutdown_connections 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 --2- 172.21.15.22:0/2908078392 >> v2:172.21.15.192:3300/0 conn(0x7f30e01566f0 0x7f30e00b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 --2- 172.21.15.22:0/2908078392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e015a100 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.877 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 -- 172.21.15.22:0/2908078392 >> 172.21.15.22:0/2908078392 conn(0x7f30e00c9f30 msgr2=0x7f30e006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 -- 172.21.15.22:0/2908078392 shutdown_connections 2023-10-08T00:33:48.878 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.875+0000 7f30e5755700 1 -- 172.21.15.22:0/2908078392 wait complete. 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.876+0000 7f30e5755700 1 Processor -- start 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.876+0000 7f30e5755700 1 -- start start 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30e5755700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30e5755700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e00c9030 0x7f30e00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30e5755700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e01566f0 0x7f30e00cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30e5755700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e014dbb0 con 0x7f30e006e6c0 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30e5755700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e01572c0 con 0x7f30e01566f0 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30e5755700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e00c70f0 con 0x7f30e00c9030 2023-10-08T00:33:48.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e014d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58860/0 (socket says 172.21.15.22:58860) 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 -- 172.21.15.22:0/3912591101 learned_addr learned my addr 172.21.15.22:0/3912591101 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30de7fc700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e00c9030 0x7f30e00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30df7fe700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e01566f0 0x7f30e00cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 -- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e00c9030 msgr2=0x7f30e00cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e00c9030 0x7f30e00cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 -- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e01566f0 msgr2=0x7f30e00cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e01566f0 0x7f30e00cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 -- 172.21.15.22:0/3912591101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8009420 con 0x7f30e006e6c0 2023-10-08T00:33:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.877+0000 7f30deffd700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e014d670 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f30e0064320 tx=0x7f30d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.878+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d800b980 con 0x7f30e006e6c0 2023-10-08T00:33:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.878+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d800bb00 con 0x7f30e006e6c0 2023-10-08T00:33:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.878+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e00c73d0 con 0x7f30e006e6c0 2023-10-08T00:33:48.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.878+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d8025670 con 0x7f30e006e6c0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.878+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e00c7990 con 0x7f30e006e6c0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.879+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e004c3c0 con 0x7f30e006e6c0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.879+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f30d8023070 con 0x7f30e006e6c0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.879+0000 7f30d6ffd700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30c0067320 0x7f30c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.880+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f30d8086020 con 0x7f30e006e6c0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.880+0000 7f30de7fc700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30c0067320 0x7f30c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.880+0000 7f30de7fc700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30c0067320 0x7f30c00697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f30e01554b0 tx=0x7f30c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:48.884+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30d8052fb0 con 0x7f30e006e6c0 2023-10-08T00:33:49.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.124+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30e00afc50 con 0x7f30e006e6c0 2023-10-08T00:33:49.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.124+0000 7f30d6ffd700 1 -- 172.21.15.22:0/3912591101 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) v1 ==== 95+0+3534 (secure 0 0 0) 0x7f30d8015de0 con 0x7f30e006e6c0 2023-10-08T00:33:49.125 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:49.125 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":120,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7459,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2081165223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":2081165223},{"type":"v1","addr":"172.21.15.22:6835","nonce":2081165223}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/678030774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":678030774},{"type":"v1","addr":"172.21.15.192:6836","nonce":678030774}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":7474,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/748954434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":748954434},{"type":"v1","addr":"172.21.15.192:6837","nonce":748954434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":110},{"gid":8640,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/3705948824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3705948824},{"type":"v1","addr":"172.21.15.22:6834","nonce":3705948824}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":120}],"filesystems":[]} 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30c0067320 msgr2=0x7f30c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30c0067320 0x7f30c00697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f30e01554b0 tx=0x7f30c8009040 comp rx=0 tx=0).stop 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 msgr2=0x7f30e014d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e014d670 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f30e0064320 tx=0x7f30d8017000 comp rx=0 tx=0).stop 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 shutdown_connections 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30e01566f0 0x7f30e00cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e006e6c0 0x7f30e014d670 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f30c0067320 0x7f30c00697d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 --2- 172.21.15.22:0/3912591101 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30e00c9030 0x7f30e00cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 >> 172.21.15.22:0/3912591101 conn(0x7f30e00c9f30 msgr2=0x7f30e00c2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 shutdown_connections 2023-10-08T00:33:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.126+0000 7f30e5755700 1 -- 172.21.15.22:0/3912591101 wait complete. 2023-10-08T00:33:49.128 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 120 2023-10-08T00:33:49.139 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:33:49.139 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:33:49.140 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:33:49.140 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:49.140 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:33:49.140 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:33:49.140 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:33:49.140 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:49.140 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:33:49.141 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:33:49.141 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:33:49.142 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:49.142 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:33:49.142 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:33:49.142 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:33:49.142 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:33:49.148 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:33:49.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:33:49.149 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:33:49.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:33:49.154 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:33:49.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:33:49.156 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:33:49.156 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:33:49.191 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:33:49.191 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:49.192 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:33:49.192 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:49.197 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:33:49.197 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:49.198 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:33:49.198 DEBUG:teuthology.parallel:result is None 2023-10-08T00:33:49.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:33:49.266 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:33:49.267 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:33:49.278 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:33:49.278 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:33:49.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.325+0000 7f66a1ce5700 1 Processor -- start 2023-10-08T00:33:49.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.325+0000 7f66a1ce5700 1 -- start start 2023-10-08T00:33:49.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a1ce5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c06c0f0 0x7f669c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:49.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a1ce5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f669c0b3810 0x7f669c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:49.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a1ce5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c143420 con 0x7f669c143050 2023-10-08T00:33:49.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a1ce5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c06a1e0 con 0x7f669c0b3810 2023-10-08T00:33:49.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a1ce5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0695d0 con 0x7f669c06c0f0 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f669c0b3810 0x7f669c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f669c0b3810 0x7f669c0b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58906/0 (socket says 172.21.15.22:58906) 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 -- 172.21.15.22:0/2991802502 learned_addr learned my addr 172.21.15.22:0/2991802502 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f669bfff700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c06c0f0 0x7f669c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 -- 172.21.15.22:0/2991802502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c06c0f0 msgr2=0x7f669c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c06c0f0 0x7f669c159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 -- 172.21.15.22:0/2991802502 >> v1:172.21.15.192:6789/0 conn(0x7f669c143050 legacy=0x7f669c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f66a14e4700 1 -- 172.21.15.22:0/2991802502 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0698b0 con 0x7f669c0b3810 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.326+0000 7f669bfff700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c06c0f0 0x7f669c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a14e4700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c0b3810 0x7f669c0b3c90 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6694009f20 tx=0x7f6694009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfaa2d743c773717 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:49.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f669b7fe700 1 -- 172.21.15.22:0/2991802502 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400e070 con 0x7f669c0b3810 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f669b7fe700 1 -- 172.21.15.22:0/2991802502 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400ba80 con 0x7f669c0b3810 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f669b7fe700 1 -- 172.21.15.22:0/2991802502 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940092e0 con 0x7f669c0b3810 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2991802502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c0b3810 msgr2=0x7f669c0b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c0b3810 0x7f669c0b3c90 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f6694009f20 tx=0x7f6694009840 comp rx=0 tx=0).stop 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2991802502 shutdown_connections 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c0b3810 0x7f669c0b3c90 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2991802502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c06c0f0 0x7f669c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2991802502 >> 172.21.15.22:0/2991802502 conn(0x7f669c0ce430 msgr2=0x7f669c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2991802502 shutdown_connections 2023-10-08T00:33:49.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.327+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2991802502 wait complete. 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.328+0000 7f66a1ce5700 1 Processor -- start 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 -- start start 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f669c06c0f0 0x7f669c138020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c0b3810 0x7f669c13d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 0x7f669c16cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c13ca40 con 0x7f669c143050 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c13d000 con 0x7f669c06c0f0 2023-10-08T00:33:49.333 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a1ce5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c16d5e0 con 0x7f669c0b3810 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a14e4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 0x7f669c16cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a14e4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 0x7f669c16cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58914/0 (socket says 172.21.15.22:58914) 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.329+0000 7f66a14e4700 1 -- 172.21.15.22:0/2578699612 learned_addr learned my addr 172.21.15.22:0/2578699612 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f669bfff700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c0b3810 0x7f669c13d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a0ce3700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f669c06c0f0 0x7f669c138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a14e4700 1 -- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c0b3810 msgr2=0x7f669c13d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a14e4700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c0b3810 0x7f669c13d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a14e4700 1 -- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f669c06c0f0 msgr2=0x7f669c138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a14e4700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f669c06c0f0 0x7f669c138020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:49.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a14e4700 1 -- 172.21.15.22:0/2578699612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009ae0 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a14e4700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 0x7f669c16cbd0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f669400b6c0 tx=0x7f6694018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940092e0 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66940070a0 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c16d8c0 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669401d650 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.330+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c138560 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.331+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c13d1b0 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.331+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6694003050 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.332+0000 7f6698ff9700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6680067320 0x7f66800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.332+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6694086820 con 0x7f669c143050 2023-10-08T00:33:49.335 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.332+0000 7f66a0ce3700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6680067320 0x7f66800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:49.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.333+0000 7f66a0ce3700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6680067320 0x7f66800697d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f66900037f0 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:49.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.336+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f669c13d1b0 con 0x7f669c143050 2023-10-08T00:33:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:49.546+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f669c13d170 con 0x7f669c143050 2023-10-08T00:33:50.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.315+0000 7f6698ff9700 1 -- 172.21.15.22:0/2578699612 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v183) v1 ==== 97+0+0 (secure 0 0 0) 0x7f66940536a0 con 0x7f669c143050 2023-10-08T00:33:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6680067320 msgr2=0x7f66800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6680067320 0x7f66800697d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f66900037f0 tx=0x7f6690009040 comp rx=0 tx=0).stop 2023-10-08T00:33:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 msgr2=0x7f669c16cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 0x7f669c16cbd0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f669400b6c0 tx=0x7f6694018000 comp rx=0 tx=0).stop 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 shutdown_connections 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f669c143050 0x7f669c16cbd0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f669c06c0f0 0x7f669c138020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6680067320 0x7f66800697d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 --2- 172.21.15.22:0/2578699612 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f669c0b3810 0x7f669c13d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 >> 172.21.15.22:0/2578699612 conn(0x7f669c0ce430 msgr2=0x7f669c0cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 shutdown_connections 2023-10-08T00:33:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.318+0000 7f66a1ce5700 1 -- 172.21.15.22:0/2578699612 wait complete. 2023-10-08T00:33:50.320 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:33:50.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:33:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 Processor -- start 2023-10-08T00:33:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 -- start start 2023-10-08T00:33:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed80cbf30 0x7efed80ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efed80ccf90 0x7efed80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80cc300 con 0x7efed815a270 2023-10-08T00:33:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed8156bf0 con 0x7efed80ccf90 2023-10-08T00:33:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.459+0000 7efedec3e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80ae950 con 0x7efed80cbf30 2023-10-08T00:33:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedc9da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed80cbf30 0x7efed80ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efed7fff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efed80ccf90 0x7efed80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedd1db700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efed815a270 0x7efed80c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:41072/0 (socket says 172.21.15.22:41072) 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedd1db700 1 -- 172.21.15.22:0/4047513727 learned_addr learned my addr 172.21.15.22:0/4047513727 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedc9da700 1 -- 172.21.15.22:0/4047513727 >> v2:172.21.15.192:3300/0 conn(0x7efed80ccf90 msgr2=0x7efed80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedc9da700 1 --2- 172.21.15.22:0/4047513727 >> v2:172.21.15.192:3300/0 conn(0x7efed80ccf90 0x7efed80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedc9da700 1 -- 172.21.15.22:0/4047513727 >> v1:172.21.15.192:6789/0 conn(0x7efed815a270 legacy=0x7efed80c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efed77fe700 1 -- 172.21.15.22:0/4047513727 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248533830 0 0) 0x7efed80cc300 con 0x7efed815a270 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedc9da700 1 -- 172.21.15.22:0/4047513727 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80ad370 con 0x7efed80cbf30 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efed7fff700 1 --2- 172.21.15.22:0/4047513727 >> v2:172.21.15.192:3300/0 conn(0x7efed80ccf90 0x7efed80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.460+0000 7efedc9da700 1 --2- 172.21.15.22:0/4047513727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed80cbf30 0x7efed80ae410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e60 tx=0x7efed0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=305b3ee7ab915a51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efed77fe700 1 -- 172.21.15.22:0/4047513727 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed000e070 con 0x7efed80cbf30 2023-10-08T00:33:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efed77fe700 1 -- 172.21.15.22:0/4047513727 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000bb60 con 0x7efed80cbf30 2023-10-08T00:33:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efed77fe700 1 -- 172.21.15.22:0/4047513727 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0012430 con 0x7efed80cbf30 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 -- 172.21.15.22:0/4047513727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed80cbf30 msgr2=0x7efed80ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 --2- 172.21.15.22:0/4047513727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed80cbf30 0x7efed80ae410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efed0009e60 tx=0x7efed0009780 comp rx=0 tx=0).stop 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 -- 172.21.15.22:0/4047513727 shutdown_connections 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 --2- 172.21.15.22:0/4047513727 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed80cbf30 0x7efed80ae410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 --2- 172.21.15.22:0/4047513727 >> v2:172.21.15.192:3300/0 conn(0x7efed80ccf90 0x7efed80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 -- 172.21.15.22:0/4047513727 >> 172.21.15.22:0/4047513727 conn(0x7efed806a320 msgr2=0x7efed80cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 -- 172.21.15.22:0/4047513727 shutdown_connections 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.461+0000 7efedec3e700 1 -- 172.21.15.22:0/4047513727 wait complete. 2023-10-08T00:33:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.462+0000 7efedec3e700 1 Processor -- start 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.462+0000 7efedec3e700 1 -- start start 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedec3e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed80cbf30 0x7efed80c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedec3e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 0x7efed8155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedec3e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed815a270 0x7efed80a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedec3e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80c15b0 con 0x7efed80ccf90 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedec3e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a6530 con 0x7efed80cbf30 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedec3e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a6810 con 0x7efed815a270 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efed7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 0x7efed8155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efed7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 0x7efed8155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58922/0 (socket says 172.21.15.22:58922) 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efed7fff700 1 -- 172.21.15.22:0/3627034611 learned_addr learned my addr 172.21.15.22:0/3627034611 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedc9da700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed80cbf30 0x7efed80c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.463+0000 7efedd1db700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed815a270 0x7efed80a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed7fff700 1 -- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed815a270 msgr2=0x7efed80a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed7fff700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed815a270 0x7efed80a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed7fff700 1 -- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed80cbf30 msgr2=0x7efed80c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed7fff700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed80cbf30 0x7efed80c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed7fff700 1 -- 172.21.15.22:0/3627034611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8009420 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed7fff700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 0x7efed8155870 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7efec800ec80 tx=0x7efec80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800c920 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec800ca80 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed0009a20 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800ce00 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.464+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80a6dd0 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.465+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed804c3c0 con 0x7efed80ccf90 2023-10-08T00:33:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.465+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efec8013680 con 0x7efed80ccf90 2023-10-08T00:33:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.466+0000 7efed4ff9700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efeb8067320 0x7efeb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.466+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efec8084d20 con 0x7efed80ccf90 2023-10-08T00:33:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.466+0000 7efedc9da700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efeb8067320 0x7efeb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.467+0000 7efedc9da700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efeb8067320 0x7efeb80697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efed00097c0 tx=0x7efed0019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.470+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec8051d00 con 0x7efed80ccf90 2023-10-08T00:33:50.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.742+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efed806f8a0 con 0x7efed80ccf90 2023-10-08T00:33:50.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.743+0000 7efed4ff9700 1 -- 172.21.15.22:0/3627034611 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efec8017090 con 0x7efed80ccf90 2023-10-08T00:33:50.743 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:50.743 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:33:50.745 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:33:50.746 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.748 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:33:50.749 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.750 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:33:50.752 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:33:50.753 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.755 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:33:50.756 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:33:50.757 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.758 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:50.759 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:33:50.759 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:33:50.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efeb8067320 msgr2=0x7efeb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efeb8067320 0x7efeb80697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7efed00097c0 tx=0x7efed0019000 comp rx=0 tx=0).stop 2023-10-08T00:33:50.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 msgr2=0x7efed8155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 0x7efed8155870 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7efec800ec80 tx=0x7efec80091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 shutdown_connections 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efeb8067320 0x7efeb80697d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efed815a270 0x7efed80a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed80cbf30 0x7efed80c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 --2- 172.21.15.22:0/3627034611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efed80ccf90 0x7efed8155870 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 >> 172.21.15.22:0/3627034611 conn(0x7efed806a320 msgr2=0x7efed806f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 shutdown_connections 2023-10-08T00:33:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.745+0000 7efedec3e700 1 -- 172.21.15.22:0/3627034611 wait complete. 2023-10-08T00:33:50.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:50.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.881+0000 7f2f61616700 1 Processor -- start 2023-10-08T00:33:50.882 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.881+0000 7f2f61616700 1 -- start start 2023-10-08T00:33:50.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f61616700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f61616700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f5c0ceaa0 0x7f2f5c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f61616700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2f5c0b1740 0x7f2f5c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f61616700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c0b2100 con 0x7f2f5c0b1740 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f61616700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c0b6570 con 0x7f2f5c0ceaa0 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f61616700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0cfe20 con 0x7f2f5c1593b0 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2f5c0b1740 0x7f2f5c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2f5c0b1740 0x7f2f5c0b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58938/0 (socket says 172.21.15.22:58938) 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 -- 172.21.15.22:0/4178161127 learned_addr learned my addr 172.21.15.22:0/4178161127 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f5b7fe700 1 --2- 172.21.15.22:0/4178161127 >> v2:172.21.15.192:3300/0 conn(0x7f2f5c0ceaa0 0x7f2f5c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f5bfff700 1 --2- 172.21.15.22:0/4178161127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 -- 172.21.15.22:0/4178161127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 msgr2=0x7f2f5c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 --2- 172.21.15.22:0/4178161127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 -- 172.21.15.22:0/4178161127 >> v2:172.21.15.192:3300/0 conn(0x7f2f5c0ceaa0 msgr2=0x7f2f5c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 --2- 172.21.15.22:0/4178161127 >> v2:172.21.15.192:3300/0 conn(0x7f2f5c0ceaa0 0x7f2f5c0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.882+0000 7f2f60e15700 1 -- 172.21.15.22:0/4178161127 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0cf210 con 0x7f2f5c0b1740 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f60e15700 1 --2- 172.21.15.22:0/4178161127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c0b1bc0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c070d90 tx=0x7f2f54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7884af0ebbf460b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f5affd700 1 -- 172.21.15.22:0/4178161127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400e070 con 0x7f2f5c0b1740 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f5affd700 1 -- 172.21.15.22:0/4178161127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400b970 con 0x7f2f5c0b1740 2023-10-08T00:33:50.886 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f5affd700 1 -- 172.21.15.22:0/4178161127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540092e0 con 0x7f2f5c0b1740 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 -- 172.21.15.22:0/4178161127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 msgr2=0x7f2f5c0b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 --2- 172.21.15.22:0/4178161127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c0b1bc0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c070d90 tx=0x7f2f54009840 comp rx=0 tx=0).stop 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 -- 172.21.15.22:0/4178161127 shutdown_connections 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 --2- 172.21.15.22:0/4178161127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c0b1bc0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 --2- 172.21.15.22:0/4178161127 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 --2- 172.21.15.22:0/4178161127 >> v2:172.21.15.192:3300/0 conn(0x7f2f5c0ceaa0 0x7f2f5c0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 -- 172.21.15.22:0/4178161127 >> 172.21.15.22:0/4178161127 conn(0x7f2f5c0d1130 msgr2=0x7f2f5c0b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 -- 172.21.15.22:0/4178161127 shutdown_connections 2023-10-08T00:33:50.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.883+0000 7f2f61616700 1 -- 172.21.15.22:0/4178161127 wait complete. 2023-10-08T00:33:50.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.884+0000 7f2f61616700 1 Processor -- start 2023-10-08T00:33:50.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 -- start start 2023-10-08T00:33:50.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f5c0ceaa0 0x7f2f5c0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c1585b0 con 0x7f2f5c0b1740 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c147e20 con 0x7f2f5c0ceaa0 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f61616700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0cc130 con 0x7f2f5c1593b0 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.885+0000 7f2f5bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58944/0 (socket says 172.21.15.22:58944) 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 -- 172.21.15.22:0/1083954335 learned_addr learned my addr 172.21.15.22:0/1083954335 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5b7fe700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f5c0ceaa0 0x7f2f5c0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f60e15700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 -- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 msgr2=0x7f2f5c0cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c0cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 -- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f5c0ceaa0 msgr2=0x7f2f5c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f5c0ceaa0 0x7f2f5c0ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 -- 172.21.15.22:0/1083954335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009ae0 con 0x7f2f5c0b1740 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f5bfff700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c158070 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00e930 tx=0x7f2f4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c013680 con 0x7f2f5c0b1740 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c0137e0 con 0x7f2f5c0b1740 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c0cb520 con 0x7f2f5c0b1740 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c013b80 con 0x7f2f5c0b1740 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.886+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c0cbae0 con 0x7f2f5c0b1740 2023-10-08T00:33:50.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.887+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c04c3c0 con 0x7f2f5c0b1740 2023-10-08T00:33:50.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.887+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f4c00c460 con 0x7f2f5c0b1740 2023-10-08T00:33:50.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.888+0000 7f2f53fff700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f3c067320 0x7f2f3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:50.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.888+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2f4c084a90 con 0x7f2f5c0b1740 2023-10-08T00:33:50.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.888+0000 7f2f5b7fe700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f3c067320 0x7f2f3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:50.893 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.889+0000 7f2f5b7fe700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f3c067320 0x7f2f3c0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0af8e0 tx=0x7f2f440091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:50.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:50.892+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f4c051a70 con 0x7f2f5c0b1740 2023-10-08T00:33:51.087 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.087+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f5c0cc410 con 0x7f2f5c0b1740 2023-10-08T00:33:51.088 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.087+0000 7f2f53fff700 1 -- 172.21.15.22:0/1083954335 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f2f4c055090 con 0x7f2f5c0b1740 2023-10-08T00:33:51.088 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:51.088 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":183,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:50.312709+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:51.090 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f3c067320 msgr2=0x7f2f3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f3c067320 0x7f2f3c0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0af8e0 tx=0x7f2f440091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 msgr2=0x7f2f5c158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c158070 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00e930 tx=0x7f2f4c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 shutdown_connections 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2f3c067320 0x7f2f3c0697d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2f5c1593b0 0x7f2f5c0cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2f5c0b1740 0x7f2f5c158070 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 --2- 172.21.15.22:0/1083954335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f5c0ceaa0 0x7f2f5c0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 >> 172.21.15.22:0/1083954335 conn(0x7f2f5c0d1130 msgr2=0x7f2f5c15b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 shutdown_connections 2023-10-08T00:33:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.090+0000 7f2f61616700 1 -- 172.21.15.22:0/1083954335 wait complete. 2023-10-08T00:33:51.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:33:51.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:33:51.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.224+0000 7f37c3f93700 1 Processor -- start 2023-10-08T00:33:51.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.224+0000 7f37c3f93700 1 -- start start 2023-10-08T00:33:51.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c3f93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc141500 0x7f37bc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c3f93700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f37bc06c0a0 0x7f37bc0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c3f93700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc15c2a0 con 0x7f37bc06bcd0 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c3f93700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc0c9880 con 0x7f37bc06c0a0 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c3f93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc15b690 con 0x7f37bc141500 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c2530700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f37bc06c0a0 0x7f37bc0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c1d2f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f37bc06bcd0 0x7f37bc140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38980/0 (socket says 172.21.15.22:38980) 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.225+0000 7f37c1d2f700 1 -- 172.21.15.22:0/1475243385 learned_addr learned my addr 172.21.15.22:0/1475243385 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c152e700 1 --2- 172.21.15.22:0/1475243385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc141500 0x7f37bc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c2530700 1 -- 172.21.15.22:0/1475243385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc141500 msgr2=0x7f37bc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c2530700 1 --2- 172.21.15.22:0/1475243385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc141500 0x7f37bc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c2530700 1 -- 172.21.15.22:0/1475243385 >> v1:172.21.15.22:6789/0 conn(0x7f37bc06bcd0 legacy=0x7f37bc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c0d2d700 1 -- 172.21.15.22:0/1475243385 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360510551 0 0) 0x7f37bc15c2a0 con 0x7f37bc06bcd0 2023-10-08T00:33:51.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c2530700 1 -- 172.21.15.22:0/1475243385 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc15b970 con 0x7f37bc06c0a0 2023-10-08T00:33:51.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c2530700 1 --2- 172.21.15.22:0/1475243385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06c0a0 0x7f37bc0c9340 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009e60 tx=0x7f37b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155737e1cccf24df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c0d2d700 1 -- 172.21.15.22:0/1475243385 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400e070 con 0x7f37bc06c0a0 2023-10-08T00:33:51.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c0d2d700 1 -- 172.21.15.22:0/1475243385 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400bb60 con 0x7f37bc06c0a0 2023-10-08T00:33:51.228 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.226+0000 7f37c0d2d700 1 -- 172.21.15.22:0/1475243385 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4012430 con 0x7f37bc06c0a0 2023-10-08T00:33:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 -- 172.21.15.22:0/1475243385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06c0a0 msgr2=0x7f37bc0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1475243385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06c0a0 0x7f37bc0c9340 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009e60 tx=0x7f37b4009780 comp rx=0 tx=0).stop 2023-10-08T00:33:51.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 -- 172.21.15.22:0/1475243385 shutdown_connections 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1475243385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06c0a0 0x7f37bc0c9340 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1475243385 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc141500 0x7f37bc0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 -- 172.21.15.22:0/1475243385 >> 172.21.15.22:0/1475243385 conn(0x7f37bc0ce600 msgr2=0x7f37bc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 -- 172.21.15.22:0/1475243385 shutdown_connections 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.227+0000 7f37c3f93700 1 -- 172.21.15.22:0/1475243385 wait complete. 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.228+0000 7f37c3f93700 1 Processor -- start 2023-10-08T00:33:51.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.228+0000 7f37c3f93700 1 -- start start 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 0x7f37bc06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc06c0a0 0x7f37bc13f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37bc141500 0x7f37bc0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc06aa40 con 0x7f37bc06bcd0 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc13fa30 con 0x7f37bc141500 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0699a0 con 0x7f37bc06c0a0 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 0x7f37bc06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 0x7f37bc06aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58970/0 (socket says 172.21.15.22:58970) 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 -- 172.21.15.22:0/1418503023 learned_addr learned my addr 172.21.15.22:0/1418503023 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 -- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc06c0a0 msgr2=0x7f37bc13f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc06c0a0 0x7f37bc13f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 -- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37bc141500 msgr2=0x7f37bc0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37bc141500 0x7f37bc0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 -- 172.21.15.22:0/1418503023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009a20 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c1d2f700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 0x7f37bc06aee0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c7e0 tx=0x7f37b8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8005b30 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8005c90 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8007300 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc069c80 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.229+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc06a240 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.231+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc04c3c0 con 0x7f37bc06bcd0 2023-10-08T00:33:51.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.231+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f37b801b400 con 0x7f37bc06bcd0 2023-10-08T00:33:51.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.231+0000 7f37b1ffb700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37a0067320 0x7f37a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.231+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f37b80843b0 con 0x7f37bc06bcd0 2023-10-08T00:33:51.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.232+0000 7f37c152e700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37a0067320 0x7f37a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.232+0000 7f37c152e700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37a0067320 0x7f37a00697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0c4920 tx=0x7f37ac0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.236+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37b8051490 con 0x7f37bc06bcd0 2023-10-08T00:33:51.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.429+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37bc15bc50 con 0x7f37bc06bcd0 2023-10-08T00:33:51.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.429+0000 7f37b1ffb700 1 -- 172.21.15.22:0/1418503023 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37b8054ab0 con 0x7f37bc06bcd0 2023-10-08T00:33:51.430 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:33:51.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.431+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37a0067320 msgr2=0x7f37a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.431+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37a0067320 0x7f37a00697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0c4920 tx=0x7f37ac0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.431+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 msgr2=0x7f37bc06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.431+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 0x7f37bc06aee0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c7e0 tx=0x7f37b8007df0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 shutdown_connections 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37bc141500 0x7f37bc0b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37bc06bcd0 0x7f37bc06aee0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f37a0067320 0x7f37a00697d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 --2- 172.21.15.22:0/1418503023 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f37bc06c0a0 0x7f37bc13f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 >> 172.21.15.22:0/1418503023 conn(0x7f37bc0ce600 msgr2=0x7f37bc0c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 shutdown_connections 2023-10-08T00:33:51.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.432+0000 7f37c3f93700 1 -- 172.21.15.22:0/1418503023 wait complete. 2023-10-08T00:33:51.444 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:33:51.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.563+0000 7f45af7c7700 1 Processor -- start 2023-10-08T00:33:51.563 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.563+0000 7f45af7c7700 1 -- start start 2023-10-08T00:33:51.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45af7c7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f45a8159890 0x7f45a815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45af7c7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f45a8159c60 0x7f45a815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45af7c7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a815a160 con 0x7f45a815db10 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45af7c7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a815df50 con 0x7f45a8159890 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45af7c7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80d13a0 con 0x7f45a8159c60 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f45a8159890 0x7f45a815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f45a8159890 0x7f45a815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58978/0 (socket says 172.21.15.22:58978) 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 -- 172.21.15.22:0/1081385471 learned_addr learned my addr 172.21.15.22:0/1081385471 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45acd62700 1 --2- 172.21.15.22:0/1081385471 >> v2:172.21.15.192:3300/0 conn(0x7f45a8159c60 0x7f45a815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 -- 172.21.15.22:0/1081385471 >> v2:172.21.15.192:3300/0 conn(0x7f45a8159c60 msgr2=0x7f45a815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 --2- 172.21.15.22:0/1081385471 >> v2:172.21.15.192:3300/0 conn(0x7f45a8159c60 0x7f45a815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 -- 172.21.15.22:0/1081385471 >> v1:172.21.15.192:6789/0 conn(0x7f45a815db10 legacy=0x7f45a8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 -- 172.21.15.22:0/1081385471 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a815e140 con 0x7f45a8159890 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45ad563700 1 --2- 172.21.15.22:0/1081385471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a815abd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f45a80b67f0 tx=0x7f4598009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fadb43e8b74c68c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45a7fff700 1 -- 172.21.15.22:0/1081385471 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800e070 con 0x7f45a8159890 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45a7fff700 1 -- 172.21.15.22:0/1081385471 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459800ba50 con 0x7f45a8159890 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.564+0000 7f45a7fff700 1 -- 172.21.15.22:0/1081385471 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45980092e0 con 0x7f45a8159890 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 -- 172.21.15.22:0/1081385471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 msgr2=0x7f45a815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 --2- 172.21.15.22:0/1081385471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a815abd0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f45a80b67f0 tx=0x7f4598009840 comp rx=0 tx=0).stop 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 -- 172.21.15.22:0/1081385471 shutdown_connections 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 --2- 172.21.15.22:0/1081385471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a815abd0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 --2- 172.21.15.22:0/1081385471 >> v2:172.21.15.192:3300/0 conn(0x7f45a8159c60 0x7f45a815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 -- 172.21.15.22:0/1081385471 >> 172.21.15.22:0/1081385471 conn(0x7f45a8068e20 msgr2=0x7f45a80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 -- 172.21.15.22:0/1081385471 shutdown_connections 2023-10-08T00:33:51.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.565+0000 7f45af7c7700 1 -- 172.21.15.22:0/1081385471 wait complete. 2023-10-08T00:33:51.569 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.566+0000 7f45af7c7700 1 Processor -- start 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.566+0000 7f45af7c7700 1 -- start start 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45af7c7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a81522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45af7c7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45a8159c60 0x7f45a80c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45af7c7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a815db10 0x7f45a80c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45af7c7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a816a080 con 0x7f45a8159890 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45af7c7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a816b030 con 0x7f45a815db10 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45af7c7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8158ab0 con 0x7f45a8159c60 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a81522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a81522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58982/0 (socket says 172.21.15.22:58982) 2023-10-08T00:33:51.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 -- 172.21.15.22:0/3599031281 learned_addr learned my addr 172.21.15.22:0/3599031281 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 -- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45a8159c60 msgr2=0x7f45a80c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45a8159c60 0x7f45a80c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45add64700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a815db10 0x7f45a80c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 -- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a815db10 msgr2=0x7f45a80c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a815db10 0x7f45a80c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45ad563700 1 -- 172.21.15.22:0/3599031281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598009ae0 con 0x7f45a8159890 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.567+0000 7f45add64700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a815db10 0x7f45a80c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.568+0000 7f45ad563700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a81522a0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4598009fd0 tx=0x7f4598018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.568+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598008a80 con 0x7f45a8159890 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.568+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598008c00 con 0x7f45a8159890 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.568+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a816a270 con 0x7f45a8159890 2023-10-08T00:33:51.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.568+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598026460 con 0x7f45a8159890 2023-10-08T00:33:51.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.568+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a816a830 con 0x7f45a8159890 2023-10-08T00:33:51.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.569+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a804c3c0 con 0x7f45a8159890 2023-10-08T00:33:51.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.569+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4598003040 con 0x7f45a8159890 2023-10-08T00:33:51.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.570+0000 7f45a57fa700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4594067320 0x7f45940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.570+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4598086930 con 0x7f45a8159890 2023-10-08T00:33:51.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.570+0000 7f45acd62700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4594067320 0x7f45940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.571+0000 7f45acd62700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4594067320 0x7f45940697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f45a816d5e0 tx=0x7f459c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.574 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.574+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4598053800 con 0x7f45a8159890 2023-10-08T00:33:51.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.769+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f45a806a5b0 con 0x7f45a8159890 2023-10-08T00:33:51.770 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.770+0000 7f45a57fa700 1 -- 172.21.15.22:0/3599031281 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v183) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4598056e20 con 0x7f45a8159890 2023-10-08T00:33:51.770 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:51.770 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:33:51.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:33:51.771 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:33:51.771 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:33:51.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:33:51.771 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:33:51.772 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4594067320 msgr2=0x7f45940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4594067320 0x7f45940697d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f45a816d5e0 tx=0x7f459c008040 comp rx=0 tx=0).stop 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 msgr2=0x7f45a81522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a81522a0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4598009fd0 tx=0x7f4598018000 comp rx=0 tx=0).stop 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 shutdown_connections 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a815db10 0x7f45a80c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45a8159890 0x7f45a81522a0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4594067320 0x7f45940697d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 --2- 172.21.15.22:0/3599031281 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45a8159c60 0x7f45a80c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 >> 172.21.15.22:0/3599031281 conn(0x7f45a8068e20 msgr2=0x7f45a80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 shutdown_connections 2023-10-08T00:33:51.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.772+0000 7f45af7c7700 1 -- 172.21.15.22:0/3599031281 wait complete. 2023-10-08T00:33:51.784 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:33:51.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:33:51.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.907+0000 7f0a7a578700 1 Processor -- start 2023-10-08T00:33:51.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.907+0000 7f0a7a578700 1 -- start start 2023-10-08T00:33:51.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a7a578700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a740cca20 0x7f0a740cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a7a578700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740cfa00 con 0x7f0a740b03c0 2023-10-08T00:33:51.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a7a578700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740cb580 con 0x7f0a740b0790 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a7a578700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740cf160 con 0x7f0a740cca20 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a79576700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0a740b03c0 0x7f0a740b28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38982/0 (socket says 172.21.15.22:38982) 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a79576700 1 -- 172.21.15.22:0/857312115 learned_addr learned my addr 172.21.15.22:0/857312115 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.908+0000 7f0a79d77700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a740cca20 0x7f0a740cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073331591 0 0) 0x7f0a740cfa00 con 0x7f0a740b03c0 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c003570 con 0x7f0a740b03c0 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702638005 0 0) 0x7f0a740cb580 con 0x7f0a740b0790 2023-10-08T00:33:51.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a740cfa00 con 0x7f0a740b0790 2023-10-08T00:33:51.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610054944 0 0) 0x7f0a5c003570 con 0x7f0a740b03c0 2023-10-08T00:33:51.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a740cca20 msgr2=0x7f0a740cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:51.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a740cca20 0x7f0a740cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 >> v1:172.21.15.192:6789/0 conn(0x7f0a740b0790 legacy=0x7f0a741591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740cf440 con 0x7f0a740b03c0 2023-10-08T00:33:51.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f0a640017f0 con 0x7f0a740b03c0 2023-10-08T00:33:51.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 >> v1:172.21.15.22:6789/0 conn(0x7f0a740b03c0 legacy=0x7f0a740b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a5c003c20 0x7f0a5c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a5c004810 0x7f0a5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a5c0051c0 0x7f0a5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740cf160 con 0x7f0a5c0051c0 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00c0b0 con 0x7f0a5c003c20 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00c270 con 0x7f0a5c004810 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a740cca20 0x7f0a740cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79576700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a5c003c20 0x7f0a5c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a5c0051c0 0x7f0a5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a78d75700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a5c004810 0x7f0a5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 -- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a5c004810 msgr2=0x7f0a5c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a5c004810 0x7f0a5c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.915 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 -- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a5c003c20 msgr2=0x7f0a5c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a5c003c20 0x7f0a5c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.909+0000 7f0a79d77700 1 -- 172.21.15.22:0/857312115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c003570 con 0x7f0a5c0051c0 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a79d77700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a5c0051c0 0x7f0a5c00ba60 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ccdf0 tx=0x7f0a6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c612b6f2d65a04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00e710 con 0x7f0a5c0051c0 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00e870 con 0x7f0a5c0051c0 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a73fff700 1 -- 172.21.15.22:0/857312115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00ec10 con 0x7f0a5c0051c0 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a7a578700 1 -- 172.21.15.22:0/857312115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a5c0051c0 msgr2=0x7f0a5c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a7a578700 1 --2- 172.21.15.22:0/857312115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a5c0051c0 0x7f0a5c00ba60 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ccdf0 tx=0x7f0a6c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a79d77700 1 -- 172.21.15.22:0/857312115 reap_dead start 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a7a578700 1 -- 172.21.15.22:0/857312115 shutdown_connections 2023-10-08T00:33:51.916 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a7a578700 1 -- 172.21.15.22:0/857312115 >> 172.21.15.22:0/857312115 conn(0x7f0a74063230 msgr2=0x7f0a74063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:51.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a7a578700 1 -- 172.21.15.22:0/857312115 shutdown_connections 2023-10-08T00:33:51.917 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.910+0000 7f0a7a578700 1 -- 172.21.15.22:0/857312115 wait complete. 2023-10-08T00:33:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.911+0000 7f0a7a578700 1 Processor -- start 2023-10-08T00:33:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.911+0000 7f0a7a578700 1 -- start start 2023-10-08T00:33:51.919 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a7a578700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7414f900 0x7f0a7415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a7a578700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7414fcd0 0x7f0a7415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a7a578700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 0x7f0a7416a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a7a578700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74169a70 con 0x7f0a74169ec0 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a7a578700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740c5c50 con 0x7f0a7414f900 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a7a578700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740c5f30 con 0x7f0a7414fcd0 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a79d77700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 0x7f0a7416a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a79d77700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 0x7f0a7416a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58994/0 (socket says 172.21.15.22:58994) 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.912+0000 7f0a79d77700 1 -- 172.21.15.22:0/162849014 learned_addr learned my addr 172.21.15.22:0/162849014 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79576700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7414f900 0x7f0a7415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.920 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a78d75700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7414fcd0 0x7f0a7415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79d77700 1 -- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7414fcd0 msgr2=0x7f0a7415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79d77700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7414fcd0 0x7f0a7415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79d77700 1 -- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7414f900 msgr2=0x7f0a7415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79d77700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7414f900 0x7f0a7415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79d77700 1 -- 172.21.15.22:0/162849014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740c6210 con 0x7f0a74169ec0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a79d77700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 0x7f0a7416a360 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0091e0 tx=0x7f0a6c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c022070 con 0x7f0a74169ec0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c00e9e0 con 0x7f0a74169ec0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a740c64f0 con 0x7f0a74169ec0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00e710 con 0x7f0a74169ec0 2023-10-08T00:33:51.921 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.913+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7416aae0 con 0x7f0a74169ec0 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.914+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74169be0 con 0x7f0a74169ec0 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.915+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a6c027670 con 0x7f0a74169ec0 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.915+0000 7f0a717fa700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a60067320 0x7f0a600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.915+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0a6c0859c0 con 0x7f0a74169ec0 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.915+0000 7f0a79576700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a60067320 0x7f0a600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.916+0000 7f0a79576700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a60067320 0x7f0a600697d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0a64002020 tx=0x7f0a64006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:51.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:51.919+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a74169be0 con 0x7f0a74169ec0 2023-10-08T00:33:52.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.114+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0a74169be0 con 0x7f0a74169ec0 2023-10-08T00:33:52.326 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.326+0000 7f0a717fa700 1 -- 172.21.15.22:0/162849014 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v184) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0a74169be0 con 0x7f0a74169ec0 2023-10-08T00:33:52.329 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a60067320 msgr2=0x7f0a600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a60067320 0x7f0a600697d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0a64002020 tx=0x7f0a64006040 comp rx=0 tx=0).stop 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 msgr2=0x7f0a7416a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 0x7f0a7416a360 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0091e0 tx=0x7f0a6c019000 comp rx=0 tx=0).stop 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 shutdown_connections 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a74169ec0 0x7f0a7416a360 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a7414f900 0x7f0a7415c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0a60067320 0x7f0a600697d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 --2- 172.21.15.22:0/162849014 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0a7414fcd0 0x7f0a7415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 >> 172.21.15.22:0/162849014 conn(0x7f0a74063230 msgr2=0x7f0a7415da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 shutdown_connections 2023-10-08T00:33:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.329+0000 7f0a7a578700 1 -- 172.21.15.22:0/162849014 wait complete. 2023-10-08T00:33:52.331 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:33:52.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:33:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.471+0000 7fdf4bcea700 1 Processor -- start 2023-10-08T00:33:52.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf4bcea700 1 -- start start 2023-10-08T00:33:52.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf4bcea700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf44158d40 0x7fdf44140db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf4bcea700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4406c0a0 0x7fdf441412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf4bcea700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4415b790 con 0x7fdf4406bcd0 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf4bcea700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4415ba70 con 0x7fdf44158d40 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf4bcea700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4415bd50 con 0x7fdf4406c0a0 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf49a86700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdf4406bcd0 0x7fdf440c9230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38998/0 (socket says 172.21.15.22:38998) 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf49285700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdf44158d40 0x7fdf44140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.472+0000 7fdf49a86700 1 -- 172.21.15.22:0/44187966 learned_addr learned my addr 172.21.15.22:0/44187966 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf49285700 1 -- 172.21.15.22:0/44187966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4406c0a0 msgr2=0x7fdf441412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf49285700 1 --2- 172.21.15.22:0/44187966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4406c0a0 0x7fdf441412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf49285700 1 -- 172.21.15.22:0/44187966 >> v1:172.21.15.22:6789/0 conn(0x7fdf4406bcd0 legacy=0x7fdf440c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:52.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf49285700 1 -- 172.21.15.22:0/44187966 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4415c030 con 0x7fdf44158d40 2023-10-08T00:33:52.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf49285700 1 --2- 172.21.15.22:0/44187966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf44158d40 0x7fdf44140db0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fdf340098e0 tx=0x7fdf340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36ba34ef1b16711 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:52.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf48a84700 1 -- 172.21.15.22:0/44187966 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34009e80 con 0x7fdf44158d40 2023-10-08T00:33:52.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf48a84700 1 -- 172.21.15.22:0/44187966 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400b860 con 0x7fdf44158d40 2023-10-08T00:33:52.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.473+0000 7fdf48a84700 1 -- 172.21.15.22:0/44187966 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400bbe0 con 0x7fdf44158d40 2023-10-08T00:33:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 -- 172.21.15.22:0/44187966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf44158d40 msgr2=0x7fdf44140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/44187966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf44158d40 0x7fdf44140db0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fdf340098e0 tx=0x7fdf340091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 -- 172.21.15.22:0/44187966 shutdown_connections 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/44187966 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf4406c0a0 0x7fdf441412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/44187966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf44158d40 0x7fdf44140db0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 -- 172.21.15.22:0/44187966 >> 172.21.15.22:0/44187966 conn(0x7fdf440ce5c0 msgr2=0x7fdf440ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 -- 172.21.15.22:0/44187966 shutdown_connections 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.474+0000 7fdf4bcea700 1 -- 172.21.15.22:0/44187966 wait complete. 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.475+0000 7fdf4bcea700 1 Processor -- start 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.475+0000 7fdf4bcea700 1 -- start start 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 0x7fdf440b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4406c0a0 0x7fdf4406a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44158d40 0x7fdf44155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440c5b80 con 0x7fdf4406bcd0 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440c5d10 con 0x7fdf4406c0a0 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440b1a60 con 0x7fdf44158d40 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 0x7fdf440b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 0x7fdf440b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59026/0 (socket says 172.21.15.22:59026) 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 -- 172.21.15.22:0/807624444 learned_addr learned my addr 172.21.15.22:0/807624444 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49285700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4406c0a0 0x7fdf4406a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4a287700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44158d40 0x7fdf44155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 -- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44158d40 msgr2=0x7fdf44155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44158d40 0x7fdf44155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 -- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4406c0a0 msgr2=0x7fdf4406a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4406c0a0 0x7fdf4406a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 -- 172.21.15.22:0/807624444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009420 con 0x7fdf4406bcd0 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf49a86700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 0x7fdf440b1360 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000c7c0 tx=0x7fdf40007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40005b30 con 0x7fdf4406bcd0 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40005cb0 con 0x7fdf4406bcd0 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf440b1d40 con 0x7fdf4406bcd0 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.476+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004a80 con 0x7fdf4406bcd0 2023-10-08T00:33:52.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.477+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf440b2300 con 0x7fdf4406bcd0 2023-10-08T00:33:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.477+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440718b0 con 0x7fdf4406bcd0 2023-10-08T00:33:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.478+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdf400070f0 con 0x7fdf4406bcd0 2023-10-08T00:33:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.479+0000 7fdf39ffb700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf28067320 0x7fdf280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.479+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fdf400842d0 con 0x7fdf4406bcd0 2023-10-08T00:33:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.479+0000 7fdf49285700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf28067320 0x7fdf280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.480+0000 7fdf49285700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf28067320 0x7fdf280697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdf4406ab20 tx=0x7fdf34017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:52.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.483+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf400512c0 con 0x7fdf4406bcd0 2023-10-08T00:33:52.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:52.674+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf440b0570 con 0x7fdf4406bcd0 2023-10-08T00:33:53.334 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.332+0000 7fdf39ffb700 1 -- 172.21.15.22:0/807624444 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v185) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf400548e0 con 0x7fdf4406bcd0 2023-10-08T00:33:53.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.339+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf28067320 msgr2=0x7fdf280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:53.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.339+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf28067320 0x7fdf280697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fdf4406ab20 tx=0x7fdf34017000 comp rx=0 tx=0).stop 2023-10-08T00:33:53.340 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.339+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 msgr2=0x7fdf440b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:53.341 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.339+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 0x7fdf440b1360 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000c7c0 tx=0x7fdf40007f70 comp rx=0 tx=0).stop 2023-10-08T00:33:53.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.343+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 shutdown_connections 2023-10-08T00:33:53.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.343+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdf28067320 0x7fdf280697d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.343 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.343+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdf44158d40 0x7fdf44155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.343+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf4406bcd0 0x7fdf440b1360 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.343+0000 7fdf4bcea700 1 --2- 172.21.15.22:0/807624444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4406c0a0 0x7fdf4406a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.343+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 >> 172.21.15.22:0/807624444 conn(0x7fdf440ce5c0 msgr2=0x7fdf440c3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:53.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.346+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 shutdown_connections 2023-10-08T00:33:53.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.347+0000 7fdf4bcea700 1 -- 172.21.15.22:0/807624444 wait complete. 2023-10-08T00:33:53.352 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:33:53.364 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:33:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 Processor -- start 2023-10-08T00:33:53.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 -- start start 2023-10-08T00:33:53.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4fac06c0a0 0x7f4fac0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 0x7f4fac15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac15d7e0 con 0x7f4fac06bcd0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac15dac0 con 0x7f4fac06c0a0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.492+0000 7f4fb243a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac15aa30 con 0x7f4fac15df50 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4fabfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4fac06bcd0 0x7f4fac15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39008/0 (socket says 172.21.15.22:39008) 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4fabfff700 1 -- 172.21.15.22:0/2364503884 learned_addr learned my addr 172.21.15.22:0/2364503884 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4fb09d7700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 0x7f4fac15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4fab7fe700 1 --2- 172.21.15.22:0/2364503884 >> v2:172.21.15.192:3300/0 conn(0x7f4fac06c0a0 0x7f4fac0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272976494 0 0) 0x7f4fac15d7e0 con 0x7f4fac06bcd0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f94003570 con 0x7f4fac06bcd0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652472967 0 0) 0x7f4f94003570 con 0x7f4fac06bcd0 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 msgr2=0x7f4fac15e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:53.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 0x7f4fac15e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 >> v2:172.21.15.192:3300/0 conn(0x7f4fac06c0a0 msgr2=0x7f4fac0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 --2- 172.21.15.22:0/2364503884 >> v2:172.21.15.192:3300/0 conn(0x7f4fac06c0a0 0x7f4fac0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac15ad10 con 0x7f4fac06bcd0 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f4f9c001470 con 0x7f4fac06bcd0 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 >> v1:172.21.15.22:6789/0 conn(0x7f4fac06bcd0 legacy=0x7f4fac15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f94003a60 0x7f4f94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 0x7f4f94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94004d50 0x7f4f940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac15dac0 con 0x7f4f94003a60 2023-10-08T00:33:53.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac15aa30 con 0x7f4f94004d50 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9400bae0 con 0x7f4fac15df50 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4fabfff700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f94003a60 0x7f4f94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.493+0000 7f4fab7fe700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 0x7f4f94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fb09d7700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94004d50 0x7f4f940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fabfff700 1 -- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 msgr2=0x7f4f94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fabfff700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac15df50 0x7f4f94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fabfff700 1 -- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94004d50 msgr2=0x7f4f940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:53.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fabfff700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94004d50 0x7f4f940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fabfff700 1 -- 172.21.15.22:0/2364503884 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94003570 con 0x7f4f94003a60 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4fabfff700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f94003a60 0x7f4f94003e70 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c3c0 tx=0x7f4f9c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da27cb3cec8466e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00cc90 con 0x7f4f94003a60 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00ce10 con 0x7f4f94003a60 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.494+0000 7f4faaffd700 1 -- 172.21.15.22:0/2364503884 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c005b70 con 0x7f4f94003a60 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb243a700 1 -- 172.21.15.22:0/2364503884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f94003a60 msgr2=0x7f4f94003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb243a700 1 --2- 172.21.15.22:0/2364503884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f94003a60 0x7f4f94003e70 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00c3c0 tx=0x7f4f9c001e90 comp rx=0 tx=0).stop 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb09d7700 1 -- 172.21.15.22:0/2364503884 reap_dead start 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb243a700 1 -- 172.21.15.22:0/2364503884 shutdown_connections 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb243a700 1 -- 172.21.15.22:0/2364503884 >> 172.21.15.22:0/2364503884 conn(0x7f4fac0ce600 msgr2=0x7f4fac0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb243a700 1 -- 172.21.15.22:0/2364503884 shutdown_connections 2023-10-08T00:33:53.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.495+0000 7f4fb243a700 1 -- 172.21.15.22:0/2364503884 wait complete. 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.496+0000 7f4fb243a700 1 Processor -- start 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.496+0000 7f4fb243a700 1 -- start start 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb243a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94003a60 0x7f4fac154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb243a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac0c7290 0x7f4fac0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb243a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 0x7f4fac0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb243a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0c6ac0 con 0x7f4fac0c7700 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb243a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac158a90 con 0x7f4f94003a60 2023-10-08T00:33:53.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb243a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac157e80 con 0x7f4fac0c7290 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 0x7f4fac0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 0x7f4fac0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59040/0 (socket says 172.21.15.22:59040) 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 -- 172.21.15.22:0/576781085 learned_addr learned my addr 172.21.15.22:0/576781085 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fab7fe700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac0c7290 0x7f4fac0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fabfff700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94003a60 0x7f4fac154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 -- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac0c7290 msgr2=0x7f4fac0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac0c7290 0x7f4fac0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 -- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94003a60 msgr2=0x7f4fac154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94003a60 0x7f4fac154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 -- 172.21.15.22:0/576781085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac158160 con 0x7f4fac0c7700 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.497+0000 7f4fb09d7700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 0x7f4fac0b3f20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0b1140 tx=0x7f4fa400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:53.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.498+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400e040 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.498+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac158440 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.498+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa400f040 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.498+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400fdc0 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.498+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac154c70 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.499+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac158c40 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.499+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4fa4015640 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.500+0000 7f4f93fff700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f98067320 0x7f4f980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.500+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f4fa4085590 con 0x7f4fac0c7700 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.500+0000 7f4fabfff700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f98067320 0x7f4f980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:53.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.501+0000 7f4fabfff700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f98067320 0x7f4f980697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c001ed0 tx=0x7f4f9c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:53.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.504+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fac158c40 con 0x7f4fac0c7700 2023-10-08T00:33:53.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:53.753+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4fac158c00 con 0x7f4fac0c7700 2023-10-08T00:33:54.336 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.336+0000 7f4f93fff700 1 -- 172.21.15.22:0/576781085 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v122) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4fa4052170 con 0x7f4fac0c7700 2023-10-08T00:33:54.344 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.343+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f98067320 msgr2=0x7f4f980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.343+0000 7f4fb243a700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f98067320 0x7f4f980697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c001ed0 tx=0x7f4f9c015000 comp rx=0 tx=0).stop 2023-10-08T00:33:54.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.343+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 msgr2=0x7f4fac0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.343+0000 7f4fb243a700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 0x7f4fac0b3f20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0b1140 tx=0x7f4fa400b040 comp rx=0 tx=0).stop 2023-10-08T00:33:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.346+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 shutdown_connections 2023-10-08T00:33:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.346+0000 7f4fb243a700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fac0c7700 0x7f4fac0b3f20 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.346+0000 7f4fb243a700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f94003a60 0x7f4fac154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.346+0000 7f4fb243a700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f98067320 0x7f4f980697d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.346+0000 7f4fb243a700 1 --2- 172.21.15.22:0/576781085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4fac0c7290 0x7f4fac0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.346+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 >> 172.21.15.22:0/576781085 conn(0x7f4fac0ce600 msgr2=0x7f4fac157280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:54.348 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.348+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 shutdown_connections 2023-10-08T00:33:54.349 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.348+0000 7f4fb243a700 1 -- 172.21.15.22:0/576781085 wait complete. 2023-10-08T00:33:54.362 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 31 and data pool 32 2023-10-08T00:33:54.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:54.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.496+0000 7f78d6e61700 1 Processor -- start 2023-10-08T00:33:54.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.496+0000 7f78d6e61700 1 -- start start 2023-10-08T00:33:54.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6e61700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78d0159420 0x7f78d00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6e61700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6e61700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00b11d0 con 0x7f78d015d230 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6e61700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d00b14b0 con 0x7f78d0159420 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6e61700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d00b1790 con 0x7f78d01597f0 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d5e5f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78d0159420 0x7f78d00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6660700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f78d015d230 0x7f78d00b3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39024/0 (socket says 172.21.15.22:39024) 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d5e5f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f78d0159420 0x7f78d00b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59048/0 (socket says 172.21.15.22:59048) 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.497+0000 7f78d6660700 1 -- 172.21.15.22:0/1824861079 learned_addr learned my addr 172.21.15.22:0/1824861079 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d565e700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d5e5f700 1 -- 172.21.15.22:0/1824861079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 msgr2=0x7f78d00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d5e5f700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d5e5f700 1 -- 172.21.15.22:0/1824861079 >> v1:172.21.15.22:6789/0 conn(0x7f78d015d230 legacy=0x7f78d00b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d5e5f700 1 -- 172.21.15.22:0/1824861079 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00b1a70 con 0x7f78d0159420 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d4e5d700 1 -- 172.21.15.22:0/1824861079 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965795034 0 0) 0x7f78d00b11d0 con 0x7f78d015d230 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d565e700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d5e5f700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d00b5f40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009e60 tx=0x7f78c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68962efa157535ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d4e5d700 1 -- 172.21.15.22:0/1824861079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c000e070 con 0x7f78d0159420 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d4e5d700 1 -- 172.21.15.22:0/1824861079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c000bc30 con 0x7f78d0159420 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d4e5d700 1 -- 172.21.15.22:0/1824861079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0012430 con 0x7f78d0159420 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d6e61700 1 -- 172.21.15.22:0/1824861079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 msgr2=0x7f78d00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.498+0000 7f78d6e61700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d00b5f40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009e60 tx=0x7f78c0009780 comp rx=0 tx=0).stop 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.499+0000 7f78d6e61700 1 -- 172.21.15.22:0/1824861079 shutdown_connections 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.499+0000 7f78d6e61700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d00b5f40 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.499+0000 7f78d6e61700 1 --2- 172.21.15.22:0/1824861079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.499+0000 7f78d6e61700 1 -- 172.21.15.22:0/1824861079 >> 172.21.15.22:0/1824861079 conn(0x7f78d00d0660 msgr2=0x7f78d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:54.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.499+0000 7f78d6e61700 1 -- 172.21.15.22:0/1824861079 shutdown_connections 2023-10-08T00:33:54.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.499+0000 7f78d6e61700 1 -- 172.21.15.22:0/1824861079 wait complete. 2023-10-08T00:33:54.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 Processor -- start 2023-10-08T00:33:54.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 -- start start 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d0157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d015d230 0x7f78d00c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d015a910 con 0x7f78d0159420 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0159d00 con 0x7f78d015d230 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.500+0000 7f78d6e61700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0159fe0 con 0x7f78d01597f0 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d0157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d0157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59064/0 (socket says 172.21.15.22:59064) 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 -- 172.21.15.22:0/3108876483 learned_addr learned my addr 172.21.15.22:0/3108876483 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:54.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d565e700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d6660700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d015d230 0x7f78d00c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 -- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 msgr2=0x7f78d015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d015ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 -- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d015d230 msgr2=0x7f78d00c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d015d230 0x7f78d00c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 -- 172.21.15.22:0/3108876483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0009a20 con 0x7f78d0159420 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d5e5f700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d0157290 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f78d0089340 tx=0x7f78c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0012e40 con 0x7f78d0159420 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c0027470 con 0x7f78d0159420 2023-10-08T00:33:54.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d015a2c0 con 0x7f78d0159420 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0027830 con 0x7f78d0159420 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.501+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d01577d0 con 0x7f78d0159420 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.502+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d015abf0 con 0x7f78d0159420 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.503+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f78c0024070 con 0x7f78d0159420 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.503+0000 7f78cdffb700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78bc067320 0x7f78bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.503+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78c0087230 con 0x7f78d0159420 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.503+0000 7f78d565e700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78bc067320 0x7f78bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.504+0000 7f78d565e700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78bc067320 0x7f78bc0697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006f00 tx=0x7f78c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:54.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.508+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78c0053ec0 con 0x7f78d0159420 2023-10-08T00:33:54.657 INFO:tasks.ceph.mds.a.smithi022.stderr:2023-10-08T00:33:54.657+0000 7fb6146ce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:33:54.702 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.702+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78d004c3c0 con 0x7f78d0159420 2023-10-08T00:33:54.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.703+0000 7f78cdffb700 1 -- 172.21.15.22:0/3108876483 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f78c00574e0 con 0x7f78d0159420 2023-10-08T00:33:54.703 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:54.704 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":186,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:53.754921+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:52.705475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.704+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78bc067320 msgr2=0x7f78bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.704+0000 7f78d6e61700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78bc067320 0x7f78bc0697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f78c4006f00 tx=0x7f78c4008040 comp rx=0 tx=0).stop 2023-10-08T00:33:54.705 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.704+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 msgr2=0x7f78d0157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.704+0000 7f78d6e61700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d0157290 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f78d0089340 tx=0x7f78c0019000 comp rx=0 tx=0).stop 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 shutdown_connections 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78d015d230 0x7f78d00c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78d0159420 0x7f78d0157290 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f78bc067320 0x7f78bc0697d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 --2- 172.21.15.22:0/3108876483 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f78d01597f0 0x7f78d015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 >> 172.21.15.22:0/3108876483 conn(0x7f78d00d0660 msgr2=0x7f78d00cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 shutdown_connections 2023-10-08T00:33:54.706 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.705+0000 7f78d6e61700 1 -- 172.21.15.22:0/3108876483 wait complete. 2023-10-08T00:33:54.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:54.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.836+0000 7f8a6e22a700 1 Processor -- start 2023-10-08T00:33:54.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.836+0000 7f8a6e22a700 1 -- start start 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a6e22a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a6815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a6e22a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a68159c60 0x7f8a6815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a6e22a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6815a160 con 0x7f8a6815db10 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a6e22a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a680d13a0 con 0x7f8a68159c60 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a6e22a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6815e140 con 0x7f8a68159890 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a66ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a68159c60 0x7f8a6815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a66ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a68159c60 0x7f8a6815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59078/0 (socket says 172.21.15.22:59078) 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.837+0000 7f8a66ffd700 1 -- 172.21.15.22:0/3841520068 learned_addr learned my addr 172.21.15.22:0/3841520068 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a677fe700 1 --2- 172.21.15.22:0/3841520068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a6815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a66ffd700 1 -- 172.21.15.22:0/3841520068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 msgr2=0x7f8a6815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:54.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a66ffd700 1 --2- 172.21.15.22:0/3841520068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a6815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a66ffd700 1 -- 172.21.15.22:0/3841520068 >> v1:172.21.15.192:6789/0 conn(0x7f8a6815db10 legacy=0x7f8a68069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a66ffd700 1 -- 172.21.15.22:0/3841520068 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6815a3d0 con 0x7f8a68159c60 2023-10-08T00:33:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a66ffd700 1 --2- 172.21.15.22:0/3841520068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6815d5d0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0099b0 tx=0x7f8a5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06c476947db17b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a667fc700 1 -- 172.21.15.22:0/3841520068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c009ea0 con 0x7f8a68159c60 2023-10-08T00:33:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a667fc700 1 -- 172.21.15.22:0/3841520068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c00b860 con 0x7f8a68159c60 2023-10-08T00:33:54.840 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.838+0000 7f8a667fc700 1 -- 172.21.15.22:0/3841520068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00bc00 con 0x7f8a68159c60 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 -- 172.21.15.22:0/3841520068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 msgr2=0x7f8a6815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/3841520068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6815d5d0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0099b0 tx=0x7f8a5c009250 comp rx=0 tx=0).stop 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 -- 172.21.15.22:0/3841520068 shutdown_connections 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/3841520068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a6815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/3841520068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6815d5d0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 -- 172.21.15.22:0/3841520068 >> 172.21.15.22:0/3841520068 conn(0x7f8a68068e20 msgr2=0x7f8a680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:54.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 -- 172.21.15.22:0/3841520068 shutdown_connections 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.839+0000 7f8a6e22a700 1 -- 172.21.15.22:0/3841520068 wait complete. 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.840+0000 7f8a6e22a700 1 Processor -- start 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.840+0000 7f8a6e22a700 1 -- start start 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a6e22a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a68145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a6e22a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6816a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a6e22a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6815db10 0x7f8a680c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a6e22a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a681457a0 con 0x7f8a68159c60 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a6e22a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6816ac20 con 0x7f8a6815db10 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a6e22a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a680c7c60 con 0x7f8a68159890 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6816a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6816a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59092/0 (socket says 172.21.15.22:59092) 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 -- 172.21.15.22:0/929881873 learned_addr learned my addr 172.21.15.22:0/929881873 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 -- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 msgr2=0x7f8a68145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a67fff700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6815db10 0x7f8a680c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a677fe700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a68145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a68145260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 -- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6815db10 msgr2=0x7f8a680c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6815db10 0x7f8a680c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 -- 172.21.15.22:0/929881873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0094f0 con 0x7f8a68159c60 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.841+0000 7f8a66ffd700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6816a6e0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8a680899c0 tx=0x7f8a5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.842+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c00bbe0 con 0x7f8a68159c60 2023-10-08T00:33:54.845 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.842+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c011420 con 0x7f8a68159c60 2023-10-08T00:33:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.842+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a680c7f40 con 0x7f8a68159c60 2023-10-08T00:33:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.842+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5c0117c0 con 0x7f8a68159c60 2023-10-08T00:33:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.842+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a680c8500 con 0x7f8a68159c60 2023-10-08T00:33:54.846 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.843+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a6804c3c0 con 0x7f8a68159c60 2023-10-08T00:33:54.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.843+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8a5c011bf0 con 0x7f8a68159c60 2023-10-08T00:33:54.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.843+0000 7f8a4f7fe700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a54067320 0x7f8a540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:54.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.844+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a5c086620 con 0x7f8a68159c60 2023-10-08T00:33:54.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.844+0000 7f8a677fe700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a54067320 0x7f8a540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:54.847 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.844+0000 7f8a677fe700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a54067320 0x7f8a540697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8a580093f0 tx=0x7f8a58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:54.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:54.848+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a5c0532b0 con 0x7f8a68159c60 2023-10-08T00:33:55.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.040+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a680657f0 con 0x7f8a68159c60 2023-10-08T00:33:55.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.041+0000 7f8a4f7fe700 1 -- 172.21.15.22:0/929881873 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f8a5c0568d0 con 0x7f8a68159c60 2023-10-08T00:33:55.042 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:55.042 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":186,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:53.754921+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:52.705475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.043+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a54067320 msgr2=0x7f8a540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.043+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a54067320 0x7f8a540697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f8a580093f0 tx=0x7f8a58008040 comp rx=0 tx=0).stop 2023-10-08T00:33:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.043+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 msgr2=0x7f8a6816a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.043+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6816a6e0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f8a680899c0 tx=0x7f8a5c017000 comp rx=0 tx=0).stop 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 shutdown_connections 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6815db10 0x7f8a680c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8a54067320 0x7f8a540697d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8a68159890 0x7f8a68145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 --2- 172.21.15.22:0/929881873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a68159c60 0x7f8a6816a6e0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 >> 172.21.15.22:0/929881873 conn(0x7f8a68068e20 msgr2=0x7f8a68069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 shutdown_connections 2023-10-08T00:33:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.044+0000 7f8a6e22a700 1 -- 172.21.15.22:0/929881873 wait complete. 2023-10-08T00:33:55.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:33:55.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.178+0000 7f492d970700 1 Processor -- start 2023-10-08T00:33:55.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.178+0000 7f492d970700 1 -- start start 2023-10-08T00:33:55.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f492d970700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49280b16d0 0x7f49280b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f492d970700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49280b2080 con 0x7f49280b4e70 2023-10-08T00:33:55.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f492d970700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49280cfb00 con 0x7f49280b33b0 2023-10-08T00:33:55.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f492d970700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49280b5c40 con 0x7f49280b16d0 2023-10-08T00:33:55.183 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f492c96e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f49280b4e70 0x7f49280ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39040/0 (socket says 172.21.15.22:39040) 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f492c96e700 1 -- 172.21.15.22:0/1156109307 learned_addr learned my addr 172.21.15.22:0/1156109307 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917661149 0 0) 0x7f49280b2080 con 0x7f49280b4e70 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4914003570 con 0x7f49280b4e70 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.179+0000 7f4927fff700 1 --2- 172.21.15.22:0/1156109307 >> v2:172.21.15.192:3300/0 conn(0x7f49280b16d0 0x7f49280b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098732556 0 0) 0x7f4914003570 con 0x7f49280b4e70 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 >> v2:172.21.15.192:3300/0 conn(0x7f49280b16d0 msgr2=0x7f49280b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 --2- 172.21.15.22:0/1156109307 >> v2:172.21.15.192:3300/0 conn(0x7f49280b16d0 0x7f49280b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.184 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 >> v1:172.21.15.192:6789/0 conn(0x7f49280b33b0 legacy=0x7f49280b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49280b5f20 con 0x7f49280b4e70 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f4920001470 con 0x7f49280b4e70 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 >> v1:172.21.15.22:6789/0 conn(0x7f49280b4e70 legacy=0x7f49280ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f4914003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4914004810 0x7f4914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49140052e0 0x7f491400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280b5c40 con 0x7f4914003a60 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491400c2a0 con 0x7f4914004810 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491400c460 con 0x7f49140052e0 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f4914003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.185 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f4927fff700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4914004810 0x7f4914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492d16f700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49140052e0 0x7f491400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 -- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49140052e0 msgr2=0x7f491400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49140052e0 0x7f491400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 -- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4914004810 msgr2=0x7f4914004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4914004810 0x7f4914004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 -- 172.21.15.22:0/1156109307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4914003570 con 0x7f4914003a60 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492d16f700 1 -- 172.21.15.22:0/1156109307 reap_dead start 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f492c96e700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f4914003e70 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f492000c3c0 tx=0x7f4920001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4825f7824b5efa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000cc50 con 0x7f4914003a60 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.180+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000cdb0 con 0x7f4914003a60 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f49277fe700 1 -- 172.21.15.22:0/1156109307 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920005b50 con 0x7f4914003a60 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 -- 172.21.15.22:0/1156109307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 msgr2=0x7f4914003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f4914003e70 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f492000c3c0 tx=0x7f4920001e50 comp rx=0 tx=0).stop 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 -- 172.21.15.22:0/1156109307 shutdown_connections 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 --2- 172.21.15.22:0/1156109307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f4914003e70 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 -- 172.21.15.22:0/1156109307 >> 172.21.15.22:0/1156109307 conn(0x7f49280d10c0 msgr2=0x7f49280affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 -- 172.21.15.22:0/1156109307 shutdown_connections 2023-10-08T00:33:55.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.181+0000 7f492d970700 1 -- 172.21.15.22:0/1156109307 wait complete. 2023-10-08T00:33:55.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.182+0000 7f492d970700 1 Processor -- start 2023-10-08T00:33:55.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.182+0000 7f492d970700 1 -- start start 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d970700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f492814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d970700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4928169770 0x7f4928169be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d970700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49280affb0 0x7f49280b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d970700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492816a120 con 0x7f4914003a60 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d970700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280b0990 con 0x7f49280affb0 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d970700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492816d380 con 0x7f4928169770 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f492814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.191 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f492814d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59106/0 (socket says 172.21.15.22:59106) 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 -- 172.21.15.22:0/1353741434 learned_addr learned my addr 172.21.15.22:0/1353741434 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492d16f700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49280affb0 0x7f49280b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f4927fff700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4928169770 0x7f4928169be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 -- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4928169770 msgr2=0x7f4928169be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4928169770 0x7f4928169be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 -- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49280affb0 msgr2=0x7f49280b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49280affb0 0x7f49280b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.183+0000 7f492c96e700 1 -- 172.21.15.22:0/1353741434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492814d690 con 0x7f4914003a60 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.184+0000 7f492c96e700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f492814d150 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f491400c270 tx=0x7f4920015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.184+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000cc50 con 0x7f4914003a60 2023-10-08T00:33:55.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.184+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49200070d0 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.184+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492816cd50 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.184+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920007490 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.184+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492816a5e0 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.185+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4928088990 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.185+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4920028460 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.186+0000 7f4924ff9700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4908067320 0x7f49080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.186+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4920086200 con 0x7f4914003a60 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.186+0000 7f4927fff700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4908067320 0x7f49080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.186+0000 7f4927fff700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4908067320 0x7f49080697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f49280c9450 tx=0x7f491800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.190+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4920052e90 con 0x7f4914003a60 2023-10-08T00:33:55.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:55.430+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f492804bb80 con 0x7f4914003a60 2023-10-08T00:33:56.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.359+0000 7f4924ff9700 1 -- 172.21.15.22:0/1353741434 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v124) v1 ==== 118+0+0 (secure 0 0 0) 0x7f49200564b0 con 0x7f4914003a60 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4908067320 msgr2=0x7f49080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4908067320 0x7f49080697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f49280c9450 tx=0x7f491800b040 comp rx=0 tx=0).stop 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 msgr2=0x7f492814d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f492814d150 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f491400c270 tx=0x7f4920015000 comp rx=0 tx=0).stop 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 shutdown_connections 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49280affb0 0x7f49280b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4914003a60 0x7f492814d150 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4908067320 0x7f49080697d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 --2- 172.21.15.22:0/1353741434 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4928169770 0x7f4928169be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 >> 172.21.15.22:0/1353741434 conn(0x7f49280d10c0 msgr2=0x7f49281590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:56.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 shutdown_connections 2023-10-08T00:33:56.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.362+0000 7f492d970700 1 -- 172.21.15.22:0/1353741434 wait complete. 2023-10-08T00:33:56.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:33:56.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.506+0000 7fcc766c9700 1 Processor -- start 2023-10-08T00:33:56.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.506+0000 7fcc766c9700 1 -- start start 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.507+0000 7fcc766c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc7015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.507+0000 7fcc766c9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7015a160 con 0x7fcc70069560 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.507+0000 7fcc766c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc700d13a0 con 0x7fcc70159c60 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.507+0000 7fcc766c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7015e140 con 0x7fcc70159890 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.507+0000 7fcc74c66700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcc70069560 0x7fcc700ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39056/0 (socket says 172.21.15.22:39056) 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.507+0000 7fcc74c66700 1 -- 172.21.15.22:0/3564879333 learned_addr learned my addr 172.21.15.22:0/3564879333 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257881903 0 0) 0x7fcc7015a160 con 0x7fcc70069560 2023-10-08T00:33:56.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc5c003570 con 0x7fcc70069560 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc7015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927096526 0 0) 0x7fcc5c003570 con 0x7fcc70069560 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 msgr2=0x7fcc7015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc7015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 >> v1:172.21.15.192:6789/0 conn(0x7fcc70159c60 legacy=0x7fcc7015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7015a3d0 con 0x7fcc70069560 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fcc680017f0 con 0x7fcc70069560 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 >> v1:172.21.15.22:6789/0 conn(0x7fcc70069560 legacy=0x7fcc700ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc5c003a90 0x7fcc5c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc5c004da0 0x7fcc5c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7015e140 con 0x7fcc5c003a90 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c00bc20 con 0x7fcc5c004da0 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c00bde0 con 0x7fcc70159890 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc5c003a90 0x7fcc5c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6f7fe700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc74c66700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc5c004da0 0x7fcc5c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 -- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 msgr2=0x7fcc5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 -- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc5c004da0 msgr2=0x7fcc5c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc5c004da0 0x7fcc5c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6ffff700 1 -- 172.21.15.22:0/3564879333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c003570 con 0x7fcc5c003a90 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc6f7fe700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc70159890 0x7fcc5c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.508+0000 7fcc74c66700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc5c004da0 0x7fcc5c0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc5c003a90 0x7fcc5c003ea0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bb60 tx=0x7fcc60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408059c7d30c52ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000d5d0 con 0x7fcc5c003a90 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6000d730 con 0x7fcc5c003a90 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc6effd700 1 -- 172.21.15.22:0/3564879333 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6000daf0 con 0x7fcc5c003a90 2023-10-08T00:33:56.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc766c9700 1 -- 172.21.15.22:0/3564879333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc5c003a90 msgr2=0x7fcc5c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc766c9700 1 --2- 172.21.15.22:0/3564879333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc5c003a90 0x7fcc5c003ea0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bb60 tx=0x7fcc60008040 comp rx=0 tx=0).stop 2023-10-08T00:33:56.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc74c66700 1 -- 172.21.15.22:0/3564879333 reap_dead start 2023-10-08T00:33:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc766c9700 1 -- 172.21.15.22:0/3564879333 shutdown_connections 2023-10-08T00:33:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc766c9700 1 -- 172.21.15.22:0/3564879333 >> 172.21.15.22:0/3564879333 conn(0x7fcc70068e20 msgr2=0x7fcc700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc766c9700 1 -- 172.21.15.22:0/3564879333 shutdown_connections 2023-10-08T00:33:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.509+0000 7fcc766c9700 1 -- 172.21.15.22:0/3564879333 wait complete. 2023-10-08T00:33:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.510+0000 7fcc766c9700 1 Processor -- start 2023-10-08T00:33:56.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 -- start start 2023-10-08T00:33:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc5c003a90 0x7fcc701582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.522 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc700b3590 0x7fcc700b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 0x7fcc70154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700b3f40 con 0x7fcc70154280 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc700ce260 con 0x7fcc700b3590 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc766c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc70158820 con 0x7fcc5c003a90 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc74c66700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 0x7fcc70154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.511+0000 7fcc74c66700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 0x7fcc70154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59126/0 (socket says 172.21.15.22:59126) 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 -- 172.21.15.22:0/1950333896 learned_addr learned my addr 172.21.15.22:0/1950333896 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc5c003a90 0x7fcc701582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc6f7fe700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc700b3590 0x7fcc700b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 -- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc5c003a90 msgr2=0x7fcc701582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc5c003a90 0x7fcc701582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 -- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc700b3590 msgr2=0x7fcc700b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc700b3590 0x7fcc700b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 -- 172.21.15.22:0/1950333896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc700cd970 con 0x7fcc70154280 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc74c66700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 0x7fcc70154700 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fcc700b67f0 tx=0x7fcc68002160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68004bb0 con 0x7fcc70154280 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc68004d10 con 0x7fcc70154280 2023-10-08T00:33:56.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc700cdc10 con 0x7fcc70154280 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800ed60 con 0x7fcc70154280 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.512+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc70154ff0 con 0x7fcc70154280 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.513+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc700ce410 con 0x7fcc70154280 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.514+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcc6801d440 con 0x7fcc70154280 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.514+0000 7fcc67fff700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc50067320 0x7fcc500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.514+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc68084af0 con 0x7fcc70154280 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.514+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc50067320 0x7fcc500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.515+0000 7fcc6ffff700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc50067320 0x7fcc500697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bb60 tx=0x7fcc6001b000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:56.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.518+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc700ce410 con 0x7fcc70154280 2023-10-08T00:33:56.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:56.756+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc700ce410 con 0x7fcc70154280 2023-10-08T00:33:57.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.364+0000 7fcc67fff700 1 -- 172.21.15.22:0/1950333896 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v125) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc700ce410 con 0x7fcc70154280 2023-10-08T00:33:57.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc50067320 msgr2=0x7fcc500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc50067320 0x7fcc500697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000bb60 tx=0x7fcc6001b000 comp rx=0 tx=0).stop 2023-10-08T00:33:57.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 msgr2=0x7fcc70154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 0x7fcc70154700 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fcc700b67f0 tx=0x7fcc68002160 comp rx=0 tx=0).stop 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 shutdown_connections 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc70154280 0x7fcc70154700 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcc50067320 0x7fcc500697d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcc5c003a90 0x7fcc701582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 --2- 172.21.15.22:0/1950333896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc700b3590 0x7fcc700b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.366+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 >> 172.21.15.22:0/1950333896 conn(0x7fcc70068e20 msgr2=0x7fcc7015c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.367+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 shutdown_connections 2023-10-08T00:33:57.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.367+0000 7fcc766c9700 1 -- 172.21.15.22:0/1950333896 wait complete. 2023-10-08T00:33:57.382 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:57.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.504+0000 7f4a4b742700 1 Processor -- start 2023-10-08T00:33:57.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.505+0000 7f4a4b742700 1 -- start start 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.505+0000 7f4a4b742700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44159890 0x7f4a4415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.505+0000 7f4a4b742700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a44069560 0x7f4a440699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.505+0000 7f4a4b742700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4415a160 con 0x7f4a44159c60 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.505+0000 7f4a4b742700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a44069f20 con 0x7f4a44069560 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.505+0000 7f4a4b742700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440d13a0 con 0x7f4a44159890 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a48cdd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4a44159c60 0x7f4a4415d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41920/0 (socket says 172.21.15.22:41920) 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a48cdd700 1 -- 172.21.15.22:0/2049663843 learned_addr learned my addr 172.21.15.22:0/2049663843 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a494de700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44159890 0x7f4a4415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/2049663843 >> v2:172.21.15.192:3300/0 conn(0x7f4a44069560 0x7f4a440699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697026811 0 0) 0x7f4a4415a160 con 0x7f4a44159c60 2023-10-08T00:33:57.510 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a2c003570 con 0x7f4a44159c60 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282166198 0 0) 0x7f4a2c003570 con 0x7f4a44159c60 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44159890 msgr2=0x7f4a4415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44159890 0x7f4a4415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 >> v2:172.21.15.192:3300/0 conn(0x7f4a44069560 msgr2=0x7f4a440699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 --2- 172.21.15.22:0/2049663843 >> v2:172.21.15.192:3300/0 conn(0x7f4a44069560 0x7f4a440699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4415e140 con 0x7f4a44159c60 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f4a38001470 con 0x7f4a44159c60 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 >> v1:172.21.15.22:6789/0 conn(0x7f4a44159c60 legacy=0x7f4a4415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a2c003a60 0x7f4a2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a2c004810 0x7f4a2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c0051c0 0x7f4a2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.511 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44069f20 con 0x7f4a2c0051c0 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440d13a0 con 0x7f4a2c003a60 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c00bfa0 con 0x7f4a2c004810 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/2049663843 >> v2:172.21.15.192:3300/0 conn(0x7f4a44069560 0x7f4a440699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a494de700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44159890 0x7f4a4415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c0051c0 0x7f4a2c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.506+0000 7f4a48cdd700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a2c004810 0x7f4a2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.512 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a494de700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a2c003a60 0x7f4a2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a49cdf700 1 -- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a2c004810 msgr2=0x7f4a2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a2c004810 0x7f4a2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a49cdf700 1 -- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a2c003a60 msgr2=0x7f4a2c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a2c003a60 0x7f4a2c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a49cdf700 1 -- 172.21.15.22:0/2049663843 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c003570 con 0x7f4a2c0051c0 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a494de700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a2c003a60 0x7f4a2c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c0051c0 0x7f4a2c00ba60 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400e3c0 tx=0x7f4a3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2e1ca4f1ff768d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400ec70 con 0x7f4a2c0051c0 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400f040 con 0x7f4a2c0051c0 2023-10-08T00:33:57.513 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.507+0000 7f4a43fff700 1 -- 172.21.15.22:0/2049663843 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34014480 con 0x7f4a2c0051c0 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a4b742700 1 -- 172.21.15.22:0/2049663843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c0051c0 msgr2=0x7f4a2c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a4b742700 1 --2- 172.21.15.22:0/2049663843 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a2c0051c0 0x7f4a2c00ba60 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4a3400e3c0 tx=0x7f4a3400b040 comp rx=0 tx=0).stop 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a49cdf700 1 -- 172.21.15.22:0/2049663843 reap_dead start 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a4b742700 1 -- 172.21.15.22:0/2049663843 shutdown_connections 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a4b742700 1 -- 172.21.15.22:0/2049663843 >> 172.21.15.22:0/2049663843 conn(0x7f4a44068e20 msgr2=0x7f4a440d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a4b742700 1 -- 172.21.15.22:0/2049663843 shutdown_connections 2023-10-08T00:33:57.514 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.508+0000 7f4a4b742700 1 -- 172.21.15.22:0/2049663843 wait complete. 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.509+0000 7f4a4b742700 1 Processor -- start 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.509+0000 7f4a4b742700 1 -- start start 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44152490 0x7f4a4416aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 0x7f4a440c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a44157e30 0x7f4a440ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441583d0 con 0x7f4a44152860 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440ca890 con 0x7f4a44157e30 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4416afb0 con 0x7f4a44152490 2023-10-08T00:33:57.517 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 0x7f4a440c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 0x7f4a440c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47334/0 (socket says 172.21.15.22:47334) 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 -- 172.21.15.22:0/4231217861 learned_addr learned my addr 172.21.15.22:0/4231217861 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a49cdf700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a44157e30 0x7f4a440ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a494de700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44152490 0x7f4a4416aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 -- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44152490 msgr2=0x7f4a4416aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44152490 0x7f4a4416aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 -- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a44157e30 msgr2=0x7f4a440ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a44157e30 0x7f4a440ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 -- 172.21.15.22:0/4231217861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440ce230 con 0x7f4a44152860 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a494de700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44152490 0x7f4a4416aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:57.518 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a48cdd700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 0x7f4a440c9e10 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f4a38007390 tx=0x7f4a38001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38018030 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3800f8d0 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a440c8970 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800fc70 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.510+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a440c8690 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.511+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a440ce090 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.512+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a3801b070 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.512+0000 7f4a417fa700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a30067320 0x7f4a300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.512+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a38019070 con 0x7f4a44152860 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.513+0000 7f4a494de700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a30067320 0x7f4a300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.519 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.513+0000 7f4a494de700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a30067320 0x7f4a300697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0093f0 tx=0x7f4a3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:57.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.517+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a440ce090 con 0x7f4a44152860 2023-10-08T00:33:57.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.755+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a440ce090 con 0x7f4a44152860 2023-10-08T00:33:57.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.755+0000 7f4a417fa700 1 -- 172.21.15.22:0/4231217861 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f4a440ce090 con 0x7f4a44152860 2023-10-08T00:33:57.758 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:57.758 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:33:57.358923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:33:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a30067320 msgr2=0x7f4a300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a30067320 0x7f4a300697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0093f0 tx=0x7f4a3c008040 comp rx=0 tx=0).stop 2023-10-08T00:33:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 msgr2=0x7f4a440c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 0x7f4a440c9e10 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f4a38007390 tx=0x7f4a38001e90 comp rx=0 tx=0).stop 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 shutdown_connections 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a44157e30 0x7f4a440ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a30067320 0x7f4a300697d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a44152490 0x7f4a4416aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 --2- 172.21.15.22:0/4231217861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a44152860 0x7f4a440c9e10 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 >> 172.21.15.22:0/4231217861 conn(0x7f4a44068e20 msgr2=0x7f4a4415d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 shutdown_connections 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.758+0000 7f4a4b742700 1 -- 172.21.15.22:0/4231217861 wait complete. 2023-10-08T00:33:57.760 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 125 2023-10-08T00:33:57.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:33:57.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.890+0000 7f444f5a8700 1 Processor -- start 2023-10-08T00:33:57.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.890+0000 7f444f5a8700 1 -- start start 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444f5a8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4448159890 0x7f444815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444f5a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4448159c60 0x7f444815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444f5a8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444815a160 con 0x7f444815db10 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444f5a8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44480d13a0 con 0x7f4448159890 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444f5a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444815e140 con 0x7f4448159c60 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4448159890 0x7f444815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4448159890 0x7f444815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47348/0 (socket says 172.21.15.22:47348) 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 -- 172.21.15.22:0/2639694684 learned_addr learned my addr 172.21.15.22:0/2639694684 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444cb43700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4448159c60 0x7f444815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 -- 172.21.15.22:0/2639694684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4448159c60 msgr2=0x7f444815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4448159c60 0x7f444815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 -- 172.21.15.22:0/2639694684 >> v1:172.21.15.192:6789/0 conn(0x7f444815db10 legacy=0x7f4448069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 -- 172.21.15.22:0/2639694684 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444815a3d0 con 0x7f4448159890 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444cb43700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4448159c60 0x7f444815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.891+0000 7f444d344700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444815abd0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4438009f20 tx=0x7f4438009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c15fa29dd5e2c9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:57.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f4447fff700 1 -- 172.21.15.22:0/2639694684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800e070 con 0x7f4448159890 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f4447fff700 1 -- 172.21.15.22:0/2639694684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800ba80 con 0x7f4448159890 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f4447fff700 1 -- 172.21.15.22:0/2639694684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380092e0 con 0x7f4448159890 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 -- 172.21.15.22:0/2639694684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 msgr2=0x7f444815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444815abd0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4438009f20 tx=0x7f4438009840 comp rx=0 tx=0).stop 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 -- 172.21.15.22:0/2639694684 shutdown_connections 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444815abd0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 --2- 172.21.15.22:0/2639694684 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4448159c60 0x7f444815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 -- 172.21.15.22:0/2639694684 >> 172.21.15.22:0/2639694684 conn(0x7f4448068e20 msgr2=0x7f44480d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 -- 172.21.15.22:0/2639694684 shutdown_connections 2023-10-08T00:33:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.892+0000 7f444f5a8700 1 -- 172.21.15.22:0/2639694684 wait complete. 2023-10-08T00:33:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.893+0000 7f444f5a8700 1 Processor -- start 2023-10-08T00:33:57.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.893+0000 7f444f5a8700 1 -- start start 2023-10-08T00:33:57.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444f5a8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444f5a8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448159c60 0x7f4448152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444f5a8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f444815db10 0x7f44480cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444f5a8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444816af40 con 0x7f4448159890 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444f5a8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4448155450 con 0x7f4448159c60 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444f5a8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480cb810 con 0x7f444815db10 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444d344700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444d344700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444816a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47362/0 (socket says 172.21.15.22:47362) 2023-10-08T00:33:57.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444d344700 1 -- 172.21.15.22:0/1908421214 learned_addr learned my addr 172.21.15.22:0/1908421214 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444cb43700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448159c60 0x7f4448152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.894+0000 7f444db45700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f444815db10 0x7f44480cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444d344700 1 -- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f444815db10 msgr2=0x7f44480cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444d344700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f444815db10 0x7f44480cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444d344700 1 -- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448159c60 msgr2=0x7f4448152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444d344700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448159c60 0x7f4448152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444d344700 1 -- 172.21.15.22:0/1908421214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438009ae0 con 0x7f4448159890 2023-10-08T00:33:57.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444cb43700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448159c60 0x7f4448152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444d344700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444816a910 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4438003440 tx=0x7f4438018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438008c50 con 0x7f4448159890 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438008db0 con 0x7f4448159890 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44480b5950 con 0x7f4448159890 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380266b0 con 0x7f4448159890 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.895+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44480b3590 con 0x7f4448159890 2023-10-08T00:33:57.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.896+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44480b5e70 con 0x7f4448159890 2023-10-08T00:33:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.896+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4438003040 con 0x7f4448159890 2023-10-08T00:33:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.897+0000 7f44457fa700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4434067320 0x7f44340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.897+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4438086e10 con 0x7f4448159890 2023-10-08T00:33:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.897+0000 7f444cb43700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4434067320 0x7f44340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:57.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.898+0000 7f444cb43700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4434067320 0x7f44340697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f444815a6c0 tx=0x7f443c006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:57.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:57.901+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44480b5e70 con 0x7f4448159890 2023-10-08T00:33:58.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.096+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4448155220 con 0x7f4448159890 2023-10-08T00:33:58.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.097+0000 7f44457fa700 1 -- 172.21.15.22:0/1908421214 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f4448155220 con 0x7f4448159890 2023-10-08T00:33:58.098 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:58.098 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":187,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:33:55.332147+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-08T00:33:52.705475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:33:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4434067320 msgr2=0x7f44340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4434067320 0x7f44340697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f444815a6c0 tx=0x7f443c006f90 comp rx=0 tx=0).stop 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 msgr2=0x7f444816a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444816a910 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4438003440 tx=0x7f4438018000 comp rx=0 tx=0).stop 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 shutdown_connections 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4434067320 0x7f44340697d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f444815db10 0x7f44480cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4448159890 0x7f444816a910 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 --2- 172.21.15.22:0/1908421214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4448159c60 0x7f4448152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 >> 172.21.15.22:0/1908421214 conn(0x7f4448068e20 msgr2=0x7f44480b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 shutdown_connections 2023-10-08T00:33:58.101 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.099+0000 7f444f5a8700 1 -- 172.21.15.22:0/1908421214 wait complete. 2023-10-08T00:33:58.113 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:33:58.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:58.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.230+0000 7f3c54389700 1 Processor -- start 2023-10-08T00:33:58.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.230+0000 7f3c54389700 1 -- start start 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.231+0000 7f3c54389700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3c4c159890 0x7f3c4c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.231+0000 7f3c54389700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c4c159c60 0x7f3c4c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.231+0000 7f3c54389700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c15db10 0x7f3c4c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.231+0000 7f3c54389700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c15df50 con 0x7f3c4c159c60 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.231+0000 7f3c54389700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c15a160 con 0x7f3c4c159890 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.231+0000 7f3c54389700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0d13a0 con 0x7f3c4c15db10 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c4c159c60 0x7f3c4c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3c4c159c60 0x7f3c4c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47374/0 (socket says 172.21.15.22:47374) 2023-10-08T00:33:58.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 -- 172.21.15.22:0/3923540288 learned_addr learned my addr 172.21.15.22:0/3923540288 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c52125700 1 --2- 172.21.15.22:0/3923540288 >> v2:172.21.15.192:3300/0 conn(0x7f3c4c159890 0x7f3c4c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c52926700 1 --2- 172.21.15.22:0/3923540288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c15db10 0x7f3c4c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 -- 172.21.15.22:0/3923540288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c15db10 msgr2=0x7f3c4c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 --2- 172.21.15.22:0/3923540288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c15db10 0x7f3c4c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 -- 172.21.15.22:0/3923540288 >> v2:172.21.15.192:3300/0 conn(0x7f3c4c159890 msgr2=0x7f3c4c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 --2- 172.21.15.22:0/3923540288 >> v2:172.21.15.192:3300/0 conn(0x7f3c4c159890 0x7f3c4c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 -- 172.21.15.22:0/3923540288 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c15e140 con 0x7f3c4c159c60 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c52125700 1 --2- 172.21.15.22:0/3923540288 >> v2:172.21.15.192:3300/0 conn(0x7f3c4c159890 0x7f3c4c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51924700 1 --2- 172.21.15.22:0/3923540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c159c60 0x7f3c4c15d5d0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0d1090 tx=0x7f3c40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247a959b45fe3885 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51123700 1 -- 172.21.15.22:0/3923540288 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000b860 con 0x7f3c4c159c60 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51123700 1 -- 172.21.15.22:0/3923540288 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000b9c0 con 0x7f3c4c159c60 2023-10-08T00:33:58.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.232+0000 7f3c51123700 1 -- 172.21.15.22:0/3923540288 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000bd60 con 0x7f3c4c159c60 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 -- 172.21.15.22:0/3923540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c159c60 msgr2=0x7f3c4c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 --2- 172.21.15.22:0/3923540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c159c60 0x7f3c4c15d5d0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0d1090 tx=0x7f3c40009250 comp rx=0 tx=0).stop 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 -- 172.21.15.22:0/3923540288 shutdown_connections 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 --2- 172.21.15.22:0/3923540288 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c15db10 0x7f3c4c069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 --2- 172.21.15.22:0/3923540288 >> v2:172.21.15.192:3300/0 conn(0x7f3c4c159890 0x7f3c4c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 --2- 172.21.15.22:0/3923540288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c159c60 0x7f3c4c15d5d0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 -- 172.21.15.22:0/3923540288 >> 172.21.15.22:0/3923540288 conn(0x7f3c4c068e20 msgr2=0x7f3c4c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 -- 172.21.15.22:0/3923540288 shutdown_connections 2023-10-08T00:33:58.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.233+0000 7f3c54389700 1 -- 172.21.15.22:0/3923540288 wait complete. 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.234+0000 7f3c54389700 1 Processor -- start 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.234+0000 7f3c54389700 1 -- start start 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c54389700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4c159890 0x7f3c4c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c54389700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c159c60 0x7f3c4c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c54389700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 0x7f3c4c144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c54389700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0cd1c0 con 0x7f3c4c15db10 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c54389700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b26d0 con 0x7f3c4c159890 2023-10-08T00:33:58.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c54389700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b5a50 con 0x7f3c4c159c60 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 0x7f3c4c144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 0x7f3c4c144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47390/0 (socket says 172.21.15.22:47390) 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 -- 172.21.15.22:0/1988143642 learned_addr learned my addr 172.21.15.22:0/1988143642 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c51924700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c159c60 0x7f3c4c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52125700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4c159890 0x7f3c4c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 -- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c159c60 msgr2=0x7f3c4c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c159c60 0x7f3c4c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 -- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4c159890 msgr2=0x7f3c4c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4c159890 0x7f3c4c0b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 -- 172.21.15.22:0/1988143642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400094f0 con 0x7f3c4c15db10 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c51924700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c159c60 0x7f3c4c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:58.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.235+0000 7f3c52926700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 0x7f3c4c144120 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009fa0 tx=0x7f3c44009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.236+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400ed20 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.236+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4400ee80 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.236+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0b5d30 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.236+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44014670 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.236+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c0b62f0 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.237+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c0cd370 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.237+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c440149e0 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.237+0000 7f3c4a7fc700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c38067320 0x7f3c380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.238+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c44085410 con 0x7f3c4c15db10 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.238+0000 7f3c52125700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c38067320 0x7f3c380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.238+0000 7f3c52125700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c38067320 0x7f3c380697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c006f00 tx=0x7f3c3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:58.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.242+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c4c0cd370 con 0x7f3c4c15db10 2023-10-08T00:33:58.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.432+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c4c04c3c0 con 0x7f3c38067320 2023-10-08T00:33:58.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.440+0000 7f3c4a7fc700 1 -- 172.21.15.22:0/1988143642 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289596 (secure 0 0 0) 0x7f3c4c04c3c0 con 0x7f3c38067320 2023-10-08T00:33:58.446 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c38067320 msgr2=0x7f3c380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c38067320 0x7f3c380697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c006f00 tx=0x7f3c3c008040 comp rx=0 tx=0).stop 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 msgr2=0x7f3c4c144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 0x7f3c4c144120 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009fa0 tx=0x7f3c44009900 comp rx=0 tx=0).stop 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 shutdown_connections 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c4c15db10 0x7f3c4c144120 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4c159890 0x7f3c4c0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3c38067320 0x7f3c380697d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 --2- 172.21.15.22:0/1988143642 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3c4c159c60 0x7f3c4c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.443+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 >> 172.21.15.22:0/1988143642 conn(0x7f3c4c068e20 msgr2=0x7f3c4c153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.444+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 shutdown_connections 2023-10-08T00:33:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.444+0000 7f3c54389700 1 -- 172.21.15.22:0/1988143642 wait complete. 2023-10-08T00:33:58.450 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:58.457 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2023-10-08T00:33:56.511885+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434880,"kb_used_data":19712,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752539840,"statfs":{"total":773094113280,"available":770600796160,"internally_reserved":0,"allocated":20185088,"data_stored":9713060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.180608"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.346908+0000","last_change":"2023-10-08T00:33:54.344804+0000","last_active":"2023-10-08T00:33:54.346908+0000","last_peered":"2023-10-08T00:33:54.346908+0000","last_clean":"2023-10-08T00:33:54.346908+0000","last_became_active":"2023-10-08T00:33:54.344431+0000","last_became_peered":"2023-10-08T00:33:54.344431+0000","last_unstale":"2023-10-08T00:33:54.346908+0000","last_undegraded":"2023-10-08T00:33:54.346908+0000","last_fullsized":"2023-10-08T00:33:54.346908+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:21.800176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351167+0000","last_change":"2023-10-08T00:33:54.351167+0000","last_active":"2023-10-08T00:33:54.351167+0000","last_peered":"2023-10-08T00:33:54.351167+0000","last_clean":"2023-10-08T00:33:54.351167+0000","last_became_active":"2023-10-08T00:33:54.350786+0000","last_became_peered":"2023-10-08T00:33:54.350786+0000","last_unstale":"2023-10-08T00:33:54.351167+0000","last_undegraded":"2023-10-08T00:33:54.351167+0000","last_fullsized":"2023-10-08T00:33:54.351167+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:55.666706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.354778+0000","last_change":"2023-10-08T00:33:54.354778+0000","last_active":"2023-10-08T00:33:54.354778+0000","last_peered":"2023-10-08T00:33:54.354778+0000","last_clean":"2023-10-08T00:33:54.354778+0000","last_became_active":"2023-10-08T00:33:54.354513+0000","last_became_peered":"2023-10-08T00:33:54.354513+0000","last_unstale":"2023-10-08T00:33:54.354778+0000","last_undegraded":"2023-10-08T00:33:54.354778+0000","last_fullsized":"2023-10-08T00:33:54.354778+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:11:34.434905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361558+0000","last_change":"2023-10-08T00:33:54.361558+0000","last_active":"2023-10-08T00:33:54.361558+0000","last_peered":"2023-10-08T00:33:54.361558+0000","last_clean":"2023-10-08T00:33:54.361558+0000","last_became_active":"2023-10-08T00:33:54.361273+0000","last_became_peered":"2023-10-08T00:33:54.361273+0000","last_unstale":"2023-10-08T00:33:54.361558+0000","last_undegraded":"2023-10-08T00:33:54.361558+0000","last_fullsized":"2023-10-08T00:33:54.361558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.476052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.353026+0000","last_change":"2023-10-08T00:33:54.353026+0000","last_active":"2023-10-08T00:33:54.353026+0000","last_peered":"2023-10-08T00:33:54.353026+0000","last_clean":"2023-10-08T00:33:54.353026+0000","last_became_active":"2023-10-08T00:33:54.352404+0000","last_became_peered":"2023-10-08T00:33:54.352404+0000","last_unstale":"2023-10-08T00:33:54.353026+0000","last_undegraded":"2023-10-08T00:33:54.353026+0000","last_fullsized":"2023-10-08T00:33:54.353026+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:49.221246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361665+0000","last_change":"2023-10-08T00:33:54.358938+0000","last_active":"2023-10-08T00:33:54.361665+0000","last_peered":"2023-10-08T00:33:54.361665+0000","last_clean":"2023-10-08T00:33:54.361665+0000","last_became_active":"2023-10-08T00:33:54.358629+0000","last_became_peered":"2023-10-08T00:33:54.358629+0000","last_unstale":"2023-10-08T00:33:54.361665+0000","last_undegraded":"2023-10-08T00:33:54.361665+0000","last_fullsized":"2023-10-08T00:33:54.361665+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:22:26.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.355720+0000","last_change":"2023-10-08T00:33:54.355720+0000","last_active":"2023-10-08T00:33:54.355720+0000","last_peered":"2023-10-08T00:33:54.355720+0000","last_clean":"2023-10-08T00:33:54.355720+0000","last_became_active":"2023-10-08T00:33:54.355448+0000","last_became_peered":"2023-10-08T00:33:54.355448+0000","last_unstale":"2023-10-08T00:33:54.355720+0000","last_undegraded":"2023-10-08T00:33:54.355720+0000","last_fullsized":"2023-10-08T00:33:54.355720+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:55.454937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349945+0000","last_change":"2023-10-08T00:33:54.349945+0000","last_active":"2023-10-08T00:33:54.349945+0000","last_peered":"2023-10-08T00:33:54.349945+0000","last_clean":"2023-10-08T00:33:54.349945+0000","last_became_active":"2023-10-08T00:33:54.349645+0000","last_became_peered":"2023-10-08T00:33:54.349645+0000","last_unstale":"2023-10-08T00:33:54.349945+0000","last_undegraded":"2023-10-08T00:33:54.349945+0000","last_fullsized":"2023-10-08T00:33:54.349945+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:57.658848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.356963+0000","last_change":"2023-10-08T00:33:54.352782+0000","last_active":"2023-10-08T00:33:54.356963+0000","last_peered":"2023-10-08T00:33:54.356963+0000","last_clean":"2023-10-08T00:33:54.356963+0000","last_became_active":"2023-10-08T00:33:54.352431+0000","last_became_peered":"2023-10-08T00:33:54.352431+0000","last_unstale":"2023-10-08T00:33:54.356963+0000","last_undegraded":"2023-10-08T00:33:54.356963+0000","last_fullsized":"2023-10-08T00:33:54.356963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:51:46.688741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357073+0000","last_change":"2023-10-08T00:33:54.357073+0000","last_active":"2023-10-08T00:33:54.357073+0000","last_peered":"2023-10-08T00:33:54.357073+0000","last_clean":"2023-10-08T00:33:54.357073+0000","last_became_active":"2023-10-08T00:33:54.356764+0000","last_became_peered":"2023-10-08T00:33:54.356764+0000","last_unstale":"2023-10-08T00:33:54.357073+0000","last_undegraded":"2023-10-08T00:33:54.357073+0000","last_fullsized":"2023-10-08T00:33:54.357073+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:26.968806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357980+0000","last_change":"2023-10-08T00:33:54.357980+0000","last_active":"2023-10-08T00:33:54.357980+0000","last_peered":"2023-10-08T00:33:54.357980+0000","last_clean":"2023-10-08T00:33:54.357980+0000","last_became_active":"2023-10-08T00:33:54.357715+0000","last_became_peered":"2023-10-08T00:33:54.357715+0000","last_unstale":"2023-10-08T00:33:54.357980+0000","last_undegraded":"2023-10-08T00:33:54.357980+0000","last_fullsized":"2023-10-08T00:33:54.357980+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:40.735630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357282+0000","last_change":"2023-10-08T00:33:54.351877+0000","last_active":"2023-10-08T00:33:54.357282+0000","last_peered":"2023-10-08T00:33:54.357282+0000","last_clean":"2023-10-08T00:33:54.357282+0000","last_became_active":"2023-10-08T00:33:54.351595+0000","last_became_peered":"2023-10-08T00:33:54.351595+0000","last_unstale":"2023-10-08T00:33:54.357282+0000","last_undegraded":"2023-10-08T00:33:54.357282+0000","last_fullsized":"2023-10-08T00:33:54.357282+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:48.665205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349339+0000","last_change":"2023-10-08T00:33:54.344896+0000","last_active":"2023-10-08T00:33:54.349339+0000","last_peered":"2023-10-08T00:33:54.349339+0000","last_clean":"2023-10-08T00:33:54.349339+0000","last_became_active":"2023-10-08T00:33:54.344232+0000","last_became_peered":"2023-10-08T00:33:54.344232+0000","last_unstale":"2023-10-08T00:33:54.349339+0000","last_undegraded":"2023-10-08T00:33:54.349339+0000","last_fullsized":"2023-10-08T00:33:54.349339+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:17.711170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349680+0000","last_change":"2023-10-08T00:33:54.342366+0000","last_active":"2023-10-08T00:33:54.349680+0000","last_peered":"2023-10-08T00:33:54.349680+0000","last_clean":"2023-10-08T00:33:54.349680+0000","last_became_active":"2023-10-08T00:33:54.342125+0000","last_became_peered":"2023-10-08T00:33:54.342125+0000","last_unstale":"2023-10-08T00:33:54.349680+0000","last_undegraded":"2023-10-08T00:33:54.349680+0000","last_fullsized":"2023-10-08T00:33:54.349680+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:48:30.320572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.348160+0000","last_change":"2023-10-08T00:33:54.348160+0000","last_active":"2023-10-08T00:33:54.348160+0000","last_peered":"2023-10-08T00:33:54.348160+0000","last_clean":"2023-10-08T00:33:54.348160+0000","last_became_active":"2023-10-08T00:33:54.347723+0000","last_became_peered":"2023-10-08T00:33:54.347723+0000","last_unstale":"2023-10-08T00:33:54.348160+0000","last_undegraded":"2023-10-08T00:33:54.348160+0000","last_fullsized":"2023-10-08T00:33:54.348160+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:50.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.363105+0000","last_change":"2023-10-08T00:33:54.363105+0000","last_active":"2023-10-08T00:33:54.363105+0000","last_peered":"2023-10-08T00:33:54.363105+0000","last_clean":"2023-10-08T00:33:54.363105+0000","last_became_active":"2023-10-08T00:33:54.362808+0000","last_became_peered":"2023-10-08T00:33:54.362808+0000","last_unstale":"2023-10-08T00:33:54.363105+0000","last_undegraded":"2023-10-08T00:33:54.363105+0000","last_fullsized":"2023-10-08T00:33:54.363105+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:07:23.743228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357617+0000","last_change":"2023-10-08T00:33:54.351364+0000","last_active":"2023-10-08T00:33:54.357617+0000","last_peered":"2023-10-08T00:33:54.357617+0000","last_clean":"2023-10-08T00:33:54.357617+0000","last_became_active":"2023-10-08T00:33:54.351048+0000","last_became_peered":"2023-10-08T00:33:54.351048+0000","last_unstale":"2023-10-08T00:33:54.357617+0000","last_undegraded":"2023-10-08T00:33:54.357617+0000","last_fullsized":"2023-10-08T00:33:54.357617+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:05.105950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.344683+0000","last_change":"2023-10-08T00:33:54.344683+0000","last_active":"2023-10-08T00:33:54.344683+0000","last_peered":"2023-10-08T00:33:54.344683+0000","last_clean":"2023-10-08T00:33:54.344683+0000","last_became_active":"2023-10-08T00:33:54.344388+0000","last_became_peered":"2023-10-08T00:33:54.344388+0000","last_unstale":"2023-10-08T00:33:54.344683+0000","last_undegraded":"2023-10-08T00:33:54.344683+0000","last_fullsized":"2023-10-08T00:33:54.344683+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:50.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.346832+0000","last_change":"2023-10-08T00:33:54.346832+0000","last_active":"2023-10-08T00:33:54.346832+0000","last_peered":"2023-10-08T00:33:54.346832+0000","last_clean":"2023-10-08T00:33:54.346832+0000","last_became_active":"2023-10-08T00:33:54.346522+0000","last_became_peered":"2023-10-08T00:33:54.346522+0000","last_unstale":"2023-10-08T00:33:54.346832+0000","last_undegraded":"2023-10-08T00:33:54.346832+0000","last_fullsized":"2023-10-08T00:33:54.346832+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:07:23.743228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361662+0000","last_change":"2023-10-08T00:33:54.361662+0000","last_active":"2023-10-08T00:33:54.361662+0000","last_peered":"2023-10-08T00:33:54.361662+0000","last_clean":"2023-10-08T00:33:54.361662+0000","last_became_active":"2023-10-08T00:33:54.361393+0000","last_became_peered":"2023-10-08T00:33:54.361393+0000","last_unstale":"2023-10-08T00:33:54.361662+0000","last_undegraded":"2023-10-08T00:33:54.361662+0000","last_fullsized":"2023-10-08T00:33:54.361662+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:27:02.938350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351211+0000","last_change":"2023-10-08T00:33:54.351211+0000","last_active":"2023-10-08T00:33:54.351211+0000","last_peered":"2023-10-08T00:33:54.351211+0000","last_clean":"2023-10-08T00:33:54.351211+0000","last_became_active":"2023-10-08T00:33:54.350939+0000","last_became_peered":"2023-10-08T00:33:54.350939+0000","last_unstale":"2023-10-08T00:33:54.351211+0000","last_undegraded":"2023-10-08T00:33:54.351211+0000","last_fullsized":"2023-10-08T00:33:54.351211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:27:02.938350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357500+0000","last_change":"2023-10-08T00:33:54.348342+0000","last_active":"2023-10-08T00:33:54.357500+0000","last_peered":"2023-10-08T00:33:54.357500+0000","last_clean":"2023-10-08T00:33:54.357500+0000","last_became_active":"2023-10-08T00:33:54.347973+0000","last_became_peered":"2023-10-08T00:33:54.347973+0000","last_unstale":"2023-10-08T00:33:54.357500+0000","last_undegraded":"2023-10-08T00:33:54.357500+0000","last_fullsized":"2023-10-08T00:33:54.357500+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:41:43.590703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.347989+0000","last_change":"2023-10-08T00:33:54.347989+0000","last_active":"2023-10-08T00:33:54.347989+0000","last_peered":"2023-10-08T00:33:54.347989+0000","last_clean":"2023-10-08T00:33:54.347989+0000","last_became_active":"2023-10-08T00:33:54.347377+0000","last_became_peered":"2023-10-08T00:33:54.347377+0000","last_unstale":"2023-10-08T00:33:54.347989+0000","last_undegraded":"2023-10-08T00:33:54.347989+0000","last_fullsized":"2023-10-08T00:33:54.347989+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:40:26.460975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.350214+0000","last_change":"2023-10-08T00:33:54.343980+0000","last_active":"2023-10-08T00:33:54.350214+0000","last_peered":"2023-10-08T00:33:54.350214+0000","last_clean":"2023-10-08T00:33:54.350214+0000","last_became_active":"2023-10-08T00:33:54.343693+0000","last_became_peered":"2023-10-08T00:33:54.343693+0000","last_unstale":"2023-10-08T00:33:54.350214+0000","last_undegraded":"2023-10-08T00:33:54.350214+0000","last_fullsized":"2023-10-08T00:33:54.350214+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:51.680095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351199+0000","last_change":"2023-10-08T00:33:54.351199+0000","last_active":"2023-10-08T00:33:54.351199+0000","last_peered":"2023-10-08T00:33:54.351199+0000","last_clean":"2023-10-08T00:33:54.351199+0000","last_became_active":"2023-10-08T00:33:54.350933+0000","last_became_peered":"2023-10-08T00:33:54.350933+0000","last_unstale":"2023-10-08T00:33:54.351199+0000","last_undegraded":"2023-10-08T00:33:54.351199+0000","last_fullsized":"2023-10-08T00:33:54.351199+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:11:18.168559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.365734+0000","last_change":"2023-10-08T00:33:54.365734+0000","last_active":"2023-10-08T00:33:54.365734+0000","last_peered":"2023-10-08T00:33:54.365734+0000","last_clean":"2023-10-08T00:33:54.365734+0000","last_became_active":"2023-10-08T00:33:54.365294+0000","last_became_peered":"2023-10-08T00:33:54.365294+0000","last_unstale":"2023-10-08T00:33:54.365734+0000","last_undegraded":"2023-10-08T00:33:54.365734+0000","last_fullsized":"2023-10-08T00:33:54.365734+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:55.666706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.350356+0000","last_change":"2023-10-08T00:33:54.350356+0000","last_active":"2023-10-08T00:33:54.350356+0000","last_peered":"2023-10-08T00:33:54.350356+0000","last_clean":"2023-10-08T00:33:54.350356+0000","last_became_active":"2023-10-08T00:33:54.350078+0000","last_became_peered":"2023-10-08T00:33:54.350078+0000","last_unstale":"2023-10-08T00:33:54.350356+0000","last_undegraded":"2023-10-08T00:33:54.350356+0000","last_fullsized":"2023-10-08T00:33:54.350356+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:17.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357303+0000","last_change":"2023-10-08T00:33:54.353010+0000","last_active":"2023-10-08T00:33:54.357303+0000","last_peered":"2023-10-08T00:33:54.357303+0000","last_clean":"2023-10-08T00:33:54.357303+0000","last_became_active":"2023-10-08T00:33:54.352727+0000","last_became_peered":"2023-10-08T00:33:54.352727+0000","last_unstale":"2023-10-08T00:33:54.357303+0000","last_undegraded":"2023-10-08T00:33:54.357303+0000","last_fullsized":"2023-10-08T00:33:54.357303+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:02:45.162718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349649+0000","last_change":"2023-10-08T00:33:54.343114+0000","last_active":"2023-10-08T00:33:54.349649+0000","last_peered":"2023-10-08T00:33:54.349649+0000","last_clean":"2023-10-08T00:33:54.349649+0000","last_became_active":"2023-10-08T00:33:54.342829+0000","last_became_peered":"2023-10-08T00:33:54.342829+0000","last_unstale":"2023-10-08T00:33:54.349649+0000","last_undegraded":"2023-10-08T00:33:54.349649+0000","last_fullsized":"2023-10-08T00:33:54.349649+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:00.731268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.355361+0000","last_change":"2023-10-08T00:33:54.351530+0000","last_active":"2023-10-08T00:33:54.355361+0000","last_peered":"2023-10-08T00:33:54.355361+0000","last_clean":"2023-10-08T00:33:54.355361+0000","last_became_active":"2023-10-08T00:33:54.351253+0000","last_became_peered":"2023-10-08T00:33:54.351253+0000","last_unstale":"2023-10-08T00:33:54.355361+0000","last_undegraded":"2023-10-08T00:33:54.355361+0000","last_fullsized":"2023-10-08T00:33:54.355361+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:10:11.065007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362376+0000","last_change":"2023-10-08T00:33:54.362376+0000","last_active":"2023-10-08T00:33:54.362376+0000","last_peered":"2023-10-08T00:33:54.362376+0000","last_clean":"2023-10-08T00:33:54.362376+0000","last_became_active":"2023-10-08T00:33:54.361890+0000","last_became_peered":"2023-10-08T00:33:54.361890+0000","last_unstale":"2023-10-08T00:33:54.362376+0000","last_undegraded":"2023-10-08T00:33:54.362376+0000","last_fullsized":"2023-10-08T00:33:54.362376+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:30.564895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357281+0000","last_change":"2023-10-08T00:33:54.352901+0000","last_active":"2023-10-08T00:33:54.357281+0000","last_peered":"2023-10-08T00:33:54.357281+0000","last_clean":"2023-10-08T00:33:54.357281+0000","last_became_active":"2023-10-08T00:33:54.352623+0000","last_became_peered":"2023-10-08T00:33:54.352623+0000","last_unstale":"2023-10-08T00:33:54.357281+0000","last_undegraded":"2023-10-08T00:33:54.357281+0000","last_fullsized":"2023-10-08T00:33:54.357281+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:49.267182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.355942+0000","last_change":"2023-10-08T00:33:54.355942+0000","last_active":"2023-10-08T00:33:54.355942+0000","last_peered":"2023-10-08T00:33:54.355942+0000","last_clean":"2023-10-08T00:33:54.355942+0000","last_became_active":"2023-10-08T00:33:54.355527+0000","last_became_peered":"2023-10-08T00:33:54.355527+0000","last_unstale":"2023-10-08T00:33:54.355942+0000","last_undegraded":"2023-10-08T00:33:54.355942+0000","last_fullsized":"2023-10-08T00:33:54.355942+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:55.454937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"186'4","reported_seq":14,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.367152+0000","last_change":"2023-10-08T00:33:53.351541+0000","last_active":"2023-10-08T00:33:54.367152+0000","last_peered":"2023-10-08T00:33:54.367152+0000","last_clean":"2023-10-08T00:33:54.367152+0000","last_became_active":"2023-10-08T00:33:53.351223+0000","last_became_peered":"2023-10-08T00:33:53.351223+0000","last_unstale":"2023-10-08T00:33:54.367152+0000","last_undegraded":"2023-10-08T00:33:54.367152+0000","last_fullsized":"2023-10-08T00:33:54.367152+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:17:22.458706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351037+0000","last_change":"2023-10-08T00:33:54.351037+0000","last_active":"2023-10-08T00:33:54.351037+0000","last_peered":"2023-10-08T00:33:54.351037+0000","last_clean":"2023-10-08T00:33:54.351037+0000","last_became_active":"2023-10-08T00:33:54.350748+0000","last_became_peered":"2023-10-08T00:33:54.350748+0000","last_unstale":"2023-10-08T00:33:54.351037+0000","last_undegraded":"2023-10-08T00:33:54.351037+0000","last_fullsized":"2023-10-08T00:33:54.351037+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:27.061900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"186'2","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.366043+0000","last_change":"2023-10-08T00:33:53.347021+0000","last_active":"2023-10-08T00:33:54.366043+0000","last_peered":"2023-10-08T00:33:54.366043+0000","last_clean":"2023-10-08T00:33:54.366043+0000","last_became_active":"2023-10-08T00:33:53.346756+0000","last_became_peered":"2023-10-08T00:33:53.346756+0000","last_unstale":"2023-10-08T00:33:54.366043+0000","last_undegraded":"2023-10-08T00:33:54.366043+0000","last_fullsized":"2023-10-08T00:33:54.366043+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:01.314499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351329+0000","last_change":"2023-10-08T00:33:54.350508+0000","last_active":"2023-10-08T00:33:54.351329+0000","last_peered":"2023-10-08T00:33:54.351329+0000","last_clean":"2023-10-08T00:33:54.351329+0000","last_became_active":"2023-10-08T00:33:54.350217+0000","last_became_peered":"2023-10-08T00:33:54.350217+0000","last_unstale":"2023-10-08T00:33:54.351329+0000","last_undegraded":"2023-10-08T00:33:54.351329+0000","last_fullsized":"2023-10-08T00:33:54.351329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:16.271517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"186'2","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.360566+0000","last_change":"2023-10-08T00:33:53.349499+0000","last_active":"2023-10-08T00:33:54.360566+0000","last_peered":"2023-10-08T00:33:54.360566+0000","last_clean":"2023-10-08T00:33:54.360566+0000","last_became_active":"2023-10-08T00:33:53.348742+0000","last_became_peered":"2023-10-08T00:33:53.348742+0000","last_unstale":"2023-10-08T00:33:54.360566+0000","last_undegraded":"2023-10-08T00:33:54.360566+0000","last_fullsized":"2023-10-08T00:33:54.360566+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:47.657957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362847+0000","last_change":"2023-10-08T00:33:54.356149+0000","last_active":"2023-10-08T00:33:54.362847+0000","last_peered":"2023-10-08T00:33:54.362847+0000","last_clean":"2023-10-08T00:33:54.362847+0000","last_became_active":"2023-10-08T00:33:54.355904+0000","last_became_peered":"2023-10-08T00:33:54.355904+0000","last_unstale":"2023-10-08T00:33:54.362847+0000","last_undegraded":"2023-10-08T00:33:54.362847+0000","last_fullsized":"2023-10-08T00:33:54.362847+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:26.692054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"186'1","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.335403+0000","last_change":"2023-10-08T00:33:53.344259+0000","last_active":"2023-10-08T00:33:54.335403+0000","last_peered":"2023-10-08T00:33:54.335403+0000","last_clean":"2023-10-08T00:33:54.335403+0000","last_became_active":"2023-10-08T00:33:53.343999+0000","last_became_peered":"2023-10-08T00:33:53.343999+0000","last_unstale":"2023-10-08T00:33:54.335403+0000","last_undegraded":"2023-10-08T00:33:54.335403+0000","last_fullsized":"2023-10-08T00:33:54.335403+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:17.208427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.341966+0000","last_change":"2023-10-08T00:33:54.341966+0000","last_active":"2023-10-08T00:33:54.341966+0000","last_peered":"2023-10-08T00:33:54.341966+0000","last_clean":"2023-10-08T00:33:54.341966+0000","last_became_active":"2023-10-08T00:33:54.341563+0000","last_became_peered":"2023-10-08T00:33:54.341563+0000","last_unstale":"2023-10-08T00:33:54.341966+0000","last_undegraded":"2023-10-08T00:33:54.341966+0000","last_fullsized":"2023-10-08T00:33:54.341966+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:45.236632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.359255+0000","last_change":"2023-10-08T00:33:53.345189+0000","last_active":"2023-10-08T00:33:54.359255+0000","last_peered":"2023-10-08T00:33:54.359255+0000","last_clean":"2023-10-08T00:33:54.359255+0000","last_became_active":"2023-10-08T00:33:53.344843+0000","last_became_peered":"2023-10-08T00:33:53.344843+0000","last_unstale":"2023-10-08T00:33:54.359255+0000","last_undegraded":"2023-10-08T00:33:54.359255+0000","last_fullsized":"2023-10-08T00:33:54.359255+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:29.368855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361920+0000","last_change":"2023-10-08T00:33:54.361920+0000","last_active":"2023-10-08T00:33:54.361920+0000","last_peered":"2023-10-08T00:33:54.361920+0000","last_clean":"2023-10-08T00:33:54.361920+0000","last_became_active":"2023-10-08T00:33:54.361638+0000","last_became_peered":"2023-10-08T00:33:54.361638+0000","last_unstale":"2023-10-08T00:33:54.361920+0000","last_undegraded":"2023-10-08T00:33:54.361920+0000","last_fullsized":"2023-10-08T00:33:54.361920+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:02.921816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350592+0000","last_change":"2023-10-08T00:33:53.348279+0000","last_active":"2023-10-08T00:33:53.350592+0000","last_peered":"2023-10-08T00:33:53.350592+0000","last_clean":"2023-10-08T00:33:53.350592+0000","last_became_active":"2023-10-08T00:33:53.347888+0000","last_became_peered":"2023-10-08T00:33:53.347888+0000","last_unstale":"2023-10-08T00:33:53.350592+0000","last_undegraded":"2023-10-08T00:33:53.350592+0000","last_fullsized":"2023-10-08T00:33:53.350592+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:29:34.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349828+0000","last_change":"2023-10-08T00:33:54.349828+0000","last_active":"2023-10-08T00:33:54.349828+0000","last_peered":"2023-10-08T00:33:54.349828+0000","last_clean":"2023-10-08T00:33:54.349828+0000","last_became_active":"2023-10-08T00:33:54.349513+0000","last_became_peered":"2023-10-08T00:33:54.349513+0000","last_unstale":"2023-10-08T00:33:54.349828+0000","last_undegraded":"2023-10-08T00:33:54.349828+0000","last_fullsized":"2023-10-08T00:33:54.349828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.222159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.339022+0000","last_change":"2023-10-08T00:33:53.348397+0000","last_active":"2023-10-08T00:33:54.339022+0000","last_peered":"2023-10-08T00:33:54.339022+0000","last_clean":"2023-10-08T00:33:54.339022+0000","last_became_active":"2023-10-08T00:33:53.348187+0000","last_became_peered":"2023-10-08T00:33:53.348187+0000","last_unstale":"2023-10-08T00:33:54.339022+0000","last_undegraded":"2023-10-08T00:33:54.339022+0000","last_fullsized":"2023-10-08T00:33:54.339022+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:04.842705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.342570+0000","last_change":"2023-10-08T00:33:54.342570+0000","last_active":"2023-10-08T00:33:54.342570+0000","last_peered":"2023-10-08T00:33:54.342570+0000","last_clean":"2023-10-08T00:33:54.342570+0000","last_became_active":"2023-10-08T00:33:54.342244+0000","last_became_peered":"2023-10-08T00:33:54.342244+0000","last_unstale":"2023-10-08T00:33:54.342570+0000","last_undegraded":"2023-10-08T00:33:54.342570+0000","last_fullsized":"2023-10-08T00:33:54.342570+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:56.561890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.334910+0000","last_change":"2023-10-08T00:33:53.347646+0000","last_active":"2023-10-08T00:33:54.334910+0000","last_peered":"2023-10-08T00:33:54.334910+0000","last_clean":"2023-10-08T00:33:54.334910+0000","last_became_active":"2023-10-08T00:33:53.347122+0000","last_became_peered":"2023-10-08T00:33:53.347122+0000","last_unstale":"2023-10-08T00:33:54.334910+0000","last_undegraded":"2023-10-08T00:33:54.334910+0000","last_fullsized":"2023-10-08T00:33:54.334910+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:48.259934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357735+0000","last_change":"2023-10-08T00:33:54.348164+0000","last_active":"2023-10-08T00:33:54.357735+0000","last_peered":"2023-10-08T00:33:54.357735+0000","last_clean":"2023-10-08T00:33:54.357735+0000","last_became_active":"2023-10-08T00:33:54.347872+0000","last_became_peered":"2023-10-08T00:33:54.347872+0000","last_unstale":"2023-10-08T00:33:54.357735+0000","last_undegraded":"2023-10-08T00:33:54.357735+0000","last_fullsized":"2023-10-08T00:33:54.357735+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:27:01.870064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350525+0000","last_change":"2023-10-08T00:33:53.347779+0000","last_active":"2023-10-08T00:33:53.350525+0000","last_peered":"2023-10-08T00:33:53.350525+0000","last_clean":"2023-10-08T00:33:53.350525+0000","last_became_active":"2023-10-08T00:33:53.347490+0000","last_became_peered":"2023-10-08T00:33:53.347490+0000","last_unstale":"2023-10-08T00:33:53.350525+0000","last_undegraded":"2023-10-08T00:33:53.350525+0000","last_fullsized":"2023-10-08T00:33:53.350525+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:50:06.187345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.356941+0000","last_change":"2023-10-08T00:33:54.356941+0000","last_active":"2023-10-08T00:33:54.356941+0000","last_peered":"2023-10-08T00:33:54.356941+0000","last_clean":"2023-10-08T00:33:54.356941+0000","last_became_active":"2023-10-08T00:33:54.356644+0000","last_became_peered":"2023-10-08T00:33:54.356644+0000","last_unstale":"2023-10-08T00:33:54.356941+0000","last_undegraded":"2023-10-08T00:33:54.356941+0000","last_fullsized":"2023-10-08T00:33:54.356941+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:11.958035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"186'3","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.358994+0000","last_change":"2023-10-08T00:33:53.350234+0000","last_active":"2023-10-08T00:33:54.358994+0000","last_peered":"2023-10-08T00:33:54.358994+0000","last_clean":"2023-10-08T00:33:54.358994+0000","last_became_active":"2023-10-08T00:33:53.349900+0000","last_became_peered":"2023-10-08T00:33:53.349900+0000","last_unstale":"2023-10-08T00:33:54.358994+0000","last_undegraded":"2023-10-08T00:33:54.358994+0000","last_fullsized":"2023-10-08T00:33:54.358994+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:50.672846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.345710+0000","last_change":"2023-10-08T00:33:54.345710+0000","last_active":"2023-10-08T00:33:54.345710+0000","last_peered":"2023-10-08T00:33:54.345710+0000","last_clean":"2023-10-08T00:33:54.345710+0000","last_became_active":"2023-10-08T00:33:54.345430+0000","last_became_peered":"2023-10-08T00:33:54.345430+0000","last_unstale":"2023-10-08T00:33:54.345710+0000","last_undegraded":"2023-10-08T00:33:54.345710+0000","last_fullsized":"2023-10-08T00:33:54.345710+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:37.441319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"186'6","reported_seq":16,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.366185+0000","last_change":"2023-10-08T00:33:53.353514+0000","last_active":"2023-10-08T00:33:54.366185+0000","last_peered":"2023-10-08T00:33:54.366185+0000","last_clean":"2023-10-08T00:33:54.366185+0000","last_became_active":"2023-10-08T00:33:53.353246+0000","last_became_peered":"2023-10-08T00:33:53.353246+0000","last_unstale":"2023-10-08T00:33:54.366185+0000","last_undegraded":"2023-10-08T00:33:54.366185+0000","last_fullsized":"2023-10-08T00:33:54.366185+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:25:21.908079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361109+0000","last_change":"2023-10-08T00:33:54.361109+0000","last_active":"2023-10-08T00:33:54.361109+0000","last_peered":"2023-10-08T00:33:54.361109+0000","last_clean":"2023-10-08T00:33:54.361109+0000","last_became_active":"2023-10-08T00:33:54.360827+0000","last_became_peered":"2023-10-08T00:33:54.360827+0000","last_unstale":"2023-10-08T00:33:54.361109+0000","last_undegraded":"2023-10-08T00:33:54.361109+0000","last_fullsized":"2023-10-08T00:33:54.361109+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:23.293320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362969+0000","last_change":"2023-10-08T00:33:53.350952+0000","last_active":"2023-10-08T00:33:54.362969+0000","last_peered":"2023-10-08T00:33:54.362969+0000","last_clean":"2023-10-08T00:33:54.362969+0000","last_became_active":"2023-10-08T00:33:53.350630+0000","last_became_peered":"2023-10-08T00:33:53.350630+0000","last_unstale":"2023-10-08T00:33:54.362969+0000","last_undegraded":"2023-10-08T00:33:54.362969+0000","last_fullsized":"2023-10-08T00:33:54.362969+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:28:14.800203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.345481+0000","last_change":"2023-10-08T00:33:54.345481+0000","last_active":"2023-10-08T00:33:54.345481+0000","last_peered":"2023-10-08T00:33:54.345481+0000","last_clean":"2023-10-08T00:33:54.345481+0000","last_became_active":"2023-10-08T00:33:54.345095+0000","last_became_peered":"2023-10-08T00:33:54.345095+0000","last_unstale":"2023-10-08T00:33:54.345481+0000","last_undegraded":"2023-10-08T00:33:54.345481+0000","last_fullsized":"2023-10-08T00:33:54.345481+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:30.564895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350845+0000","last_change":"2023-10-08T00:33:53.350287+0000","last_active":"2023-10-08T00:33:53.350845+0000","last_peered":"2023-10-08T00:33:53.350845+0000","last_clean":"2023-10-08T00:33:53.350845+0000","last_became_active":"2023-10-08T00:33:53.350023+0000","last_became_peered":"2023-10-08T00:33:53.350023+0000","last_unstale":"2023-10-08T00:33:53.350845+0000","last_undegraded":"2023-10-08T00:33:53.350845+0000","last_fullsized":"2023-10-08T00:33:53.350845+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:57:12.251840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.348645+0000","last_change":"2023-10-08T00:33:54.348645+0000","last_active":"2023-10-08T00:33:54.348645+0000","last_peered":"2023-10-08T00:33:54.348645+0000","last_clean":"2023-10-08T00:33:54.348645+0000","last_became_active":"2023-10-08T00:33:54.348389+0000","last_became_peered":"2023-10-08T00:33:54.348389+0000","last_unstale":"2023-10-08T00:33:54.348645+0000","last_undegraded":"2023-10-08T00:33:54.348645+0000","last_fullsized":"2023-10-08T00:33:54.348645+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:11:34.434905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.352630+0000","last_change":"2023-10-08T00:33:53.351827+0000","last_active":"2023-10-08T00:33:53.352630+0000","last_peered":"2023-10-08T00:33:53.352630+0000","last_clean":"2023-10-08T00:33:53.352630+0000","last_became_active":"2023-10-08T00:33:53.351639+0000","last_became_peered":"2023-10-08T00:33:53.351639+0000","last_unstale":"2023-10-08T00:33:53.352630+0000","last_undegraded":"2023-10-08T00:33:53.352630+0000","last_fullsized":"2023-10-08T00:33:53.352630+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:27.769308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.365776+0000","last_change":"2023-10-08T00:33:54.365776+0000","last_active":"2023-10-08T00:33:54.365776+0000","last_peered":"2023-10-08T00:33:54.365776+0000","last_clean":"2023-10-08T00:33:54.365776+0000","last_became_active":"2023-10-08T00:33:54.365511+0000","last_became_peered":"2023-10-08T00:33:54.365511+0000","last_unstale":"2023-10-08T00:33:54.365776+0000","last_undegraded":"2023-10-08T00:33:54.365776+0000","last_fullsized":"2023-10-08T00:33:54.365776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:55.252737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"186'8","reported_seq":17,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.372258+0000","last_change":"2023-10-08T00:33:53.344885+0000","last_active":"2023-10-08T00:33:54.372258+0000","last_peered":"2023-10-08T00:33:54.372258+0000","last_clean":"2023-10-08T00:33:54.372258+0000","last_became_active":"2023-10-08T00:33:53.344556+0000","last_became_peered":"2023-10-08T00:33:53.344556+0000","last_unstale":"2023-10-08T00:33:54.372258+0000","last_undegraded":"2023-10-08T00:33:54.372258+0000","last_fullsized":"2023-10-08T00:33:54.372258+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:39:12.196401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361585+0000","last_change":"2023-10-08T00:33:54.361585+0000","last_active":"2023-10-08T00:33:54.361585+0000","last_peered":"2023-10-08T00:33:54.361585+0000","last_clean":"2023-10-08T00:33:54.361585+0000","last_became_active":"2023-10-08T00:33:54.361202+0000","last_became_peered":"2023-10-08T00:33:54.361202+0000","last_unstale":"2023-10-08T00:33:54.361585+0000","last_undegraded":"2023-10-08T00:33:54.361585+0000","last_fullsized":"2023-10-08T00:33:54.361585+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:04:09.667411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.363942+0000","last_change":"2023-10-08T00:33:53.347379+0000","last_active":"2023-10-08T00:33:54.363942+0000","last_peered":"2023-10-08T00:33:54.363942+0000","last_clean":"2023-10-08T00:33:54.363942+0000","last_became_active":"2023-10-08T00:33:53.347080+0000","last_became_peered":"2023-10-08T00:33:53.347080+0000","last_unstale":"2023-10-08T00:33:54.363942+0000","last_undegraded":"2023-10-08T00:33:54.363942+0000","last_fullsized":"2023-10-08T00:33:54.363942+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:42.543266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.353043+0000","last_change":"2023-10-08T00:33:54.353043+0000","last_active":"2023-10-08T00:33:54.353043+0000","last_peered":"2023-10-08T00:33:54.353043+0000","last_clean":"2023-10-08T00:33:54.353043+0000","last_became_active":"2023-10-08T00:33:54.352783+0000","last_became_peered":"2023-10-08T00:33:54.352783+0000","last_unstale":"2023-10-08T00:33:54.353043+0000","last_undegraded":"2023-10-08T00:33:54.353043+0000","last_fullsized":"2023-10-08T00:33:54.353043+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:25:05.471507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.369266+0000","last_change":"2023-10-08T00:33:53.345692+0000","last_active":"2023-10-08T00:33:54.369266+0000","last_peered":"2023-10-08T00:33:54.369266+0000","last_clean":"2023-10-08T00:33:54.369266+0000","last_became_active":"2023-10-08T00:33:53.345401+0000","last_became_peered":"2023-10-08T00:33:53.345401+0000","last_unstale":"2023-10-08T00:33:54.369266+0000","last_undegraded":"2023-10-08T00:33:54.369266+0000","last_fullsized":"2023-10-08T00:33:54.369266+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:58.009547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361819+0000","last_change":"2023-10-08T00:33:54.361819+0000","last_active":"2023-10-08T00:33:54.361819+0000","last_peered":"2023-10-08T00:33:54.361819+0000","last_clean":"2023-10-08T00:33:54.361819+0000","last_became_active":"2023-10-08T00:33:54.361493+0000","last_became_peered":"2023-10-08T00:33:54.361493+0000","last_unstale":"2023-10-08T00:33:54.361819+0000","last_undegraded":"2023-10-08T00:33:54.361819+0000","last_fullsized":"2023-10-08T00:33:54.361819+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:37.441319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.366116+0000","last_change":"2023-10-08T00:33:53.338180+0000","last_active":"2023-10-08T00:33:54.366116+0000","last_peered":"2023-10-08T00:33:54.366116+0000","last_clean":"2023-10-08T00:33:54.366116+0000","last_became_active":"2023-10-08T00:33:53.337918+0000","last_became_peered":"2023-10-08T00:33:53.337918+0000","last_unstale":"2023-10-08T00:33:54.366116+0000","last_undegraded":"2023-10-08T00:33:54.366116+0000","last_fullsized":"2023-10-08T00:33:54.366116+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:49.912664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357358+0000","last_change":"2023-10-08T00:33:54.357358+0000","last_active":"2023-10-08T00:33:54.357358+0000","last_peered":"2023-10-08T00:33:54.357358+0000","last_clean":"2023-10-08T00:33:54.357358+0000","last_became_active":"2023-10-08T00:33:54.357049+0000","last_became_peered":"2023-10-08T00:33:54.357049+0000","last_unstale":"2023-10-08T00:33:54.357358+0000","last_undegraded":"2023-10-08T00:33:54.357358+0000","last_fullsized":"2023-10-08T00:33:54.357358+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:38.808876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.344969+0000","last_change":"2023-10-08T00:33:53.342523+0000","last_active":"2023-10-08T00:33:53.344969+0000","last_peered":"2023-10-08T00:33:53.344969+0000","last_clean":"2023-10-08T00:33:53.344969+0000","last_became_active":"2023-10-08T00:33:53.342267+0000","last_became_peered":"2023-10-08T00:33:53.342267+0000","last_unstale":"2023-10-08T00:33:53.344969+0000","last_undegraded":"2023-10-08T00:33:53.344969+0000","last_fullsized":"2023-10-08T00:33:53.344969+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:39.698880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.368014+0000","last_change":"2023-10-08T00:33:54.368014+0000","last_active":"2023-10-08T00:33:54.368014+0000","last_peered":"2023-10-08T00:33:54.368014+0000","last_clean":"2023-10-08T00:33:54.368014+0000","last_became_active":"2023-10-08T00:33:54.367720+0000","last_became_peered":"2023-10-08T00:33:54.367720+0000","last_unstale":"2023-10-08T00:33:54.368014+0000","last_undegraded":"2023-10-08T00:33:54.368014+0000","last_fullsized":"2023-10-08T00:33:54.368014+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:36:56.828490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357514+0000","last_change":"2023-10-08T00:33:53.348103+0000","last_active":"2023-10-08T00:33:54.357514+0000","last_peered":"2023-10-08T00:33:54.357514+0000","last_clean":"2023-10-08T00:33:54.357514+0000","last_became_active":"2023-10-08T00:33:53.347843+0000","last_became_peered":"2023-10-08T00:33:53.347843+0000","last_unstale":"2023-10-08T00:33:54.357514+0000","last_undegraded":"2023-10-08T00:33:54.357514+0000","last_fullsized":"2023-10-08T00:33:54.357514+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:30.949173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.354236+0000","last_change":"2023-10-08T00:33:54.354236+0000","last_active":"2023-10-08T00:33:54.354236+0000","last_peered":"2023-10-08T00:33:54.354236+0000","last_clean":"2023-10-08T00:33:54.354236+0000","last_became_active":"2023-10-08T00:33:54.353951+0000","last_became_peered":"2023-10-08T00:33:54.353951+0000","last_unstale":"2023-10-08T00:33:54.354236+0000","last_undegraded":"2023-10-08T00:33:54.354236+0000","last_fullsized":"2023-10-08T00:33:54.354236+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:24.294444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.340743+0000","last_change":"2023-10-08T00:33:53.348228+0000","last_active":"2023-10-08T00:33:54.340743+0000","last_peered":"2023-10-08T00:33:54.340743+0000","last_clean":"2023-10-08T00:33:54.340743+0000","last_became_active":"2023-10-08T00:33:53.347961+0000","last_became_peered":"2023-10-08T00:33:53.347961+0000","last_unstale":"2023-10-08T00:33:54.340743+0000","last_undegraded":"2023-10-08T00:33:54.340743+0000","last_fullsized":"2023-10-08T00:33:54.340743+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:04.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357768+0000","last_change":"2023-10-08T00:33:54.351410+0000","last_active":"2023-10-08T00:33:54.357768+0000","last_peered":"2023-10-08T00:33:54.357768+0000","last_clean":"2023-10-08T00:33:54.357768+0000","last_became_active":"2023-10-08T00:33:54.351113+0000","last_became_peered":"2023-10-08T00:33:54.351113+0000","last_unstale":"2023-10-08T00:33:54.357768+0000","last_undegraded":"2023-10-08T00:33:54.357768+0000","last_fullsized":"2023-10-08T00:33:54.357768+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:31.750789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.337066+0000","last_change":"2023-10-08T00:33:53.338241+0000","last_active":"2023-10-08T00:33:54.337066+0000","last_peered":"2023-10-08T00:33:54.337066+0000","last_clean":"2023-10-08T00:33:54.337066+0000","last_became_active":"2023-10-08T00:33:53.337978+0000","last_became_peered":"2023-10-08T00:33:53.337978+0000","last_unstale":"2023-10-08T00:33:54.337066+0000","last_undegraded":"2023-10-08T00:33:54.337066+0000","last_fullsized":"2023-10-08T00:33:54.337066+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:23.287195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.348756+0000","last_change":"2023-10-08T00:33:54.342180+0000","last_active":"2023-10-08T00:33:54.348756+0000","last_peered":"2023-10-08T00:33:54.348756+0000","last_clean":"2023-10-08T00:33:54.348756+0000","last_became_active":"2023-10-08T00:33:54.341911+0000","last_became_peered":"2023-10-08T00:33:54.341911+0000","last_unstale":"2023-10-08T00:33:54.348756+0000","last_undegraded":"2023-10-08T00:33:54.348756+0000","last_fullsized":"2023-10-08T00:33:54.348756+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:57:13.259089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.334545+0000","last_change":"2023-10-08T00:33:53.347354+0000","last_active":"2023-10-08T00:33:54.334545+0000","last_peered":"2023-10-08T00:33:54.334545+0000","last_clean":"2023-10-08T00:33:54.334545+0000","last_became_active":"2023-10-08T00:33:53.347030+0000","last_became_peered":"2023-10-08T00:33:53.347030+0000","last_unstale":"2023-10-08T00:33:54.334545+0000","last_undegraded":"2023-10-08T00:33:54.334545+0000","last_fullsized":"2023-10-08T00:33:54.334545+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:51:45.681493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.365564+0000","last_change":"2023-10-08T00:33:54.365564+0000","last_active":"2023-10-08T00:33:54.365564+0000","last_peered":"2023-10-08T00:33:54.365564+0000","last_clean":"2023-10-08T00:33:54.365564+0000","last_became_active":"2023-10-08T00:33:54.365277+0000","last_became_peered":"2023-10-08T00:33:54.365277+0000","last_unstale":"2023-10-08T00:33:54.365564+0000","last_undegraded":"2023-10-08T00:33:54.365564+0000","last_fullsized":"2023-10-08T00:33:54.365564+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:13.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.358356+0000","last_change":"2023-10-08T00:33:53.343594+0000","last_active":"2023-10-08T00:33:54.358356+0000","last_peered":"2023-10-08T00:33:54.358356+0000","last_clean":"2023-10-08T00:33:54.358356+0000","last_became_active":"2023-10-08T00:33:53.342357+0000","last_became_peered":"2023-10-08T00:33:53.342357+0000","last_unstale":"2023-10-08T00:33:54.358356+0000","last_undegraded":"2023-10-08T00:33:54.358356+0000","last_fullsized":"2023-10-08T00:33:54.358356+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:01:09.934776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361367+0000","last_change":"2023-10-08T00:33:54.361367+0000","last_active":"2023-10-08T00:33:54.361367+0000","last_peered":"2023-10-08T00:33:54.361367+0000","last_clean":"2023-10-08T00:33:54.361367+0000","last_became_active":"2023-10-08T00:33:54.361005+0000","last_became_peered":"2023-10-08T00:33:54.361005+0000","last_unstale":"2023-10-08T00:33:54.361367+0000","last_undegraded":"2023-10-08T00:33:54.361367+0000","last_fullsized":"2023-10-08T00:33:54.361367+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.476052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350196+0000","last_change":"2023-10-08T00:33:53.349366+0000","last_active":"2023-10-08T00:33:53.350196+0000","last_peered":"2023-10-08T00:33:53.350196+0000","last_clean":"2023-10-08T00:33:53.350196+0000","last_became_active":"2023-10-08T00:33:53.349091+0000","last_became_peered":"2023-10-08T00:33:53.349091+0000","last_unstale":"2023-10-08T00:33:53.350196+0000","last_undegraded":"2023-10-08T00:33:53.350196+0000","last_fullsized":"2023-10-08T00:33:53.350196+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:16.703921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351383+0000","last_change":"2023-10-08T00:33:54.351383+0000","last_active":"2023-10-08T00:33:54.351383+0000","last_peered":"2023-10-08T00:33:54.351383+0000","last_clean":"2023-10-08T00:33:54.351383+0000","last_became_active":"2023-10-08T00:33:54.351130+0000","last_became_peered":"2023-10-08T00:33:54.351130+0000","last_unstale":"2023-10-08T00:33:54.351383+0000","last_undegraded":"2023-10-08T00:33:54.351383+0000","last_fullsized":"2023-10-08T00:33:54.351383+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:27.061900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.335025+0000","last_change":"2023-10-08T00:33:53.350467+0000","last_active":"2023-10-08T00:33:54.335025+0000","last_peered":"2023-10-08T00:33:54.335025+0000","last_clean":"2023-10-08T00:33:54.335025+0000","last_became_active":"2023-10-08T00:33:53.350162+0000","last_became_peered":"2023-10-08T00:33:53.350162+0000","last_unstale":"2023-10-08T00:33:54.335025+0000","last_undegraded":"2023-10-08T00:33:54.335025+0000","last_fullsized":"2023-10-08T00:33:54.335025+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:15.264269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361530+0000","last_change":"2023-10-08T00:33:54.361530+0000","last_active":"2023-10-08T00:33:54.361530+0000","last_peered":"2023-10-08T00:33:54.361530+0000","last_clean":"2023-10-08T00:33:54.361530+0000","last_became_active":"2023-10-08T00:33:54.361155+0000","last_became_peered":"2023-10-08T00:33:54.361155+0000","last_unstale":"2023-10-08T00:33:54.361530+0000","last_undegraded":"2023-10-08T00:33:54.361530+0000","last_fullsized":"2023-10-08T00:33:54.361530+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:27:04.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.335175+0000","last_change":"2023-10-08T00:33:53.348482+0000","last_active":"2023-10-08T00:33:54.335175+0000","last_peered":"2023-10-08T00:33:54.335175+0000","last_clean":"2023-10-08T00:33:54.335175+0000","last_became_active":"2023-10-08T00:33:53.348207+0000","last_became_peered":"2023-10-08T00:33:53.348207+0000","last_unstale":"2023-10-08T00:33:54.335175+0000","last_undegraded":"2023-10-08T00:33:54.335175+0000","last_fullsized":"2023-10-08T00:33:54.335175+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:20.792928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349714+0000","last_change":"2023-10-08T00:33:54.343611+0000","last_active":"2023-10-08T00:33:54.349714+0000","last_peered":"2023-10-08T00:33:54.349714+0000","last_clean":"2023-10-08T00:33:54.349714+0000","last_became_active":"2023-10-08T00:33:54.343352+0000","last_became_peered":"2023-10-08T00:33:54.343352+0000","last_unstale":"2023-10-08T00:33:54.349714+0000","last_undegraded":"2023-10-08T00:33:54.349714+0000","last_fullsized":"2023-10-08T00:33:54.349714+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:01.289518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.341122+0000","last_change":"2023-10-08T00:33:53.348831+0000","last_active":"2023-10-08T00:33:54.341122+0000","last_peered":"2023-10-08T00:33:54.341122+0000","last_clean":"2023-10-08T00:33:54.341122+0000","last_became_active":"2023-10-08T00:33:53.348595+0000","last_became_peered":"2023-10-08T00:33:53.348595+0000","last_unstale":"2023-10-08T00:33:54.341122+0000","last_undegraded":"2023-10-08T00:33:54.341122+0000","last_fullsized":"2023-10-08T00:33:54.341122+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:45.918796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.353210+0000","last_change":"2023-10-08T00:33:54.351627+0000","last_active":"2023-10-08T00:33:54.353210+0000","last_peered":"2023-10-08T00:33:54.353210+0000","last_clean":"2023-10-08T00:33:54.353210+0000","last_became_active":"2023-10-08T00:33:54.351347+0000","last_became_peered":"2023-10-08T00:33:54.351347+0000","last_unstale":"2023-10-08T00:33:54.353210+0000","last_undegraded":"2023-10-08T00:33:54.353210+0000","last_fullsized":"2023-10-08T00:33:54.353210+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:15.392809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.348072+0000","last_change":"2023-10-08T00:33:53.345926+0000","last_active":"2023-10-08T00:33:53.348072+0000","last_peered":"2023-10-08T00:33:53.348072+0000","last_clean":"2023-10-08T00:33:53.348072+0000","last_became_active":"2023-10-08T00:33:53.345649+0000","last_became_peered":"2023-10-08T00:33:53.345649+0000","last_unstale":"2023-10-08T00:33:53.348072+0000","last_undegraded":"2023-10-08T00:33:53.348072+0000","last_fullsized":"2023-10-08T00:33:53.348072+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:25.830311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.356083+0000","last_change":"2023-10-08T00:33:54.356083+0000","last_active":"2023-10-08T00:33:54.356083+0000","last_peered":"2023-10-08T00:33:54.356083+0000","last_clean":"2023-10-08T00:33:54.356083+0000","last_became_active":"2023-10-08T00:33:54.355825+0000","last_became_peered":"2023-10-08T00:33:54.355825+0000","last_unstale":"2023-10-08T00:33:54.356083+0000","last_undegraded":"2023-10-08T00:33:54.356083+0000","last_fullsized":"2023-10-08T00:33:54.356083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:13.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350572+0000","last_change":"2023-10-08T00:33:53.348120+0000","last_active":"2023-10-08T00:33:53.350572+0000","last_peered":"2023-10-08T00:33:53.350572+0000","last_clean":"2023-10-08T00:33:53.350572+0000","last_became_active":"2023-10-08T00:33:53.347532+0000","last_became_peered":"2023-10-08T00:33:53.347532+0000","last_unstale":"2023-10-08T00:33:53.350572+0000","last_undegraded":"2023-10-08T00:33:53.350572+0000","last_fullsized":"2023-10-08T00:33:53.350572+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:39.349670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357478+0000","last_change":"2023-10-08T00:33:54.348327+0000","last_active":"2023-10-08T00:33:54.357478+0000","last_peered":"2023-10-08T00:33:54.357478+0000","last_clean":"2023-10-08T00:33:54.357478+0000","last_became_active":"2023-10-08T00:33:54.348004+0000","last_became_peered":"2023-10-08T00:33:54.348004+0000","last_unstale":"2023-10-08T00:33:54.357478+0000","last_undegraded":"2023-10-08T00:33:54.357478+0000","last_fullsized":"2023-10-08T00:33:54.357478+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:56:22.138443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.337416+0000","last_change":"2023-10-08T00:33:53.343038+0000","last_active":"2023-10-08T00:33:54.337416+0000","last_peered":"2023-10-08T00:33:54.337416+0000","last_clean":"2023-10-08T00:33:54.337416+0000","last_became_active":"2023-10-08T00:33:53.342777+0000","last_became_peered":"2023-10-08T00:33:53.342777+0000","last_unstale":"2023-10-08T00:33:54.337416+0000","last_undegraded":"2023-10-08T00:33:54.337416+0000","last_fullsized":"2023-10-08T00:33:54.337416+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:36.613986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362647+0000","last_change":"2023-10-08T00:33:54.359382+0000","last_active":"2023-10-08T00:33:54.362647+0000","last_peered":"2023-10-08T00:33:54.362647+0000","last_clean":"2023-10-08T00:33:54.362647+0000","last_became_active":"2023-10-08T00:33:54.358949+0000","last_became_peered":"2023-10-08T00:33:54.358949+0000","last_unstale":"2023-10-08T00:33:54.362647+0000","last_undegraded":"2023-10-08T00:33:54.362647+0000","last_fullsized":"2023-10-08T00:33:54.362647+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:30.376104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"186'1","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.340825+0000","last_change":"2023-10-08T00:33:53.345362+0000","last_active":"2023-10-08T00:33:54.340825+0000","last_peered":"2023-10-08T00:33:54.340825+0000","last_clean":"2023-10-08T00:33:54.340825+0000","last_became_active":"2023-10-08T00:33:53.344612+0000","last_became_peered":"2023-10-08T00:33:53.344612+0000","last_unstale":"2023-10-08T00:33:54.340825+0000","last_undegraded":"2023-10-08T00:33:54.340825+0000","last_fullsized":"2023-10-08T00:33:54.340825+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:39:12.196401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":302,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.338407+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:53.338407+0000","last_peered":"2023-10-08T00:33:53.338407+0000","last_clean":"2023-10-08T00:33:53.338407+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:53.338407+0000","last_undegraded":"2023-10-08T00:33:53.338407+0000","last_fullsized":"2023-10-08T00:33:53.338407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304280,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067560,"statfs":{"total":96636764160,"available":96325181440,"internally_reserved":0,"allocated":2965504,"data_stored":1654884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.66200000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.623}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303700,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068140,"statfs":{"total":96636764160,"available":96325775360,"internally_reserved":0,"allocated":2371584,"data_stored":1064504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.373},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.628}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1064392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.27800000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.26400000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308380,"kb_used_data":2900,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063460,"statfs":{"total":96636764160,"available":96320983040,"internally_reserved":0,"allocated":2969600,"data_stored":1656296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48599999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.378,"15min":0.378},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.39100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.32900000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.37,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.45700000000000002,"5min":0.749,"15min":0.749},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.255},"max":{"1min":0.53400000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.495},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.242},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.627,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.52900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92900000000000005},"last":0.438}]},{"osd":7,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.84499999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.44700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303700,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068140,"statfs":{"total":96636764160,"available":96325775360,"internally_reserved":0,"allocated":2371584,"data_stored":1065016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.254},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.749}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.78000000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303728,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068112,"statfs":{"total":96636764160,"available":96325746688,"internally_reserved":0,"allocated":2400256,"data_stored":1072826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.434},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.30099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.59699999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303708,"kb_used_data":2324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068132,"statfs":{"total":96636764160,"available":96325767168,"internally_reserved":0,"allocated":2379776,"data_stored":1070750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.437}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.47399999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.37},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.48399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1064392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.75700000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.622}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:58.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:33:58.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.615+0000 7f2cc99dd700 1 Processor -- start 2023-10-08T00:33:58.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.615+0000 7f2cc99dd700 1 -- start start 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc99dd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cc4155c10 0x7f2cc4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc99dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc99dd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc40acac0 con 0x7f2cc40ac230 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc99dd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc40ad930 con 0x7f2cc4155c10 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc99dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40acd20 con 0x7f2cc40ac6d0 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc2ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cc4155c10 0x7f2cc4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc27fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2cc40ac230 0x7f2cc41568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41934/0 (socket says 172.21.15.22:41934) 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc27fc700 1 -- 172.21.15.22:0/203979330 learned_addr learned my addr 172.21.15.22:0/203979330 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc37fe700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc2ffd700 1 -- 172.21.15.22:0/203979330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 msgr2=0x7f2cc40b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc2ffd700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc40b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc2ffd700 1 -- 172.21.15.22:0/203979330 >> v1:172.21.15.22:6789/0 conn(0x7f2cc40ac230 legacy=0x7f2cc41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc2ffd700 1 -- 172.21.15.22:0/203979330 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40ad000 con 0x7f2cc4155c10 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc1ffb700 1 -- 172.21.15.22:0/203979330 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928640435 0 0) 0x7f2cc40acac0 con 0x7f2cc40ac230 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc37fe700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc40b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc2ffd700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc4155fe0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40acc50 tx=0x7f2cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0d2656746f3042 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.616+0000 7f2cc1ffb700 1 -- 172.21.15.22:0/203979330 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400b6b0 con 0x7f2cc4155c10 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc1ffb700 1 -- 172.21.15.22:0/203979330 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb400b810 con 0x7f2cc4155c10 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc1ffb700 1 -- 172.21.15.22:0/203979330 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400bbd0 con 0x7f2cc4155c10 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 -- 172.21.15.22:0/203979330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 msgr2=0x7f2cc4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc4155fe0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40acc50 tx=0x7f2cb40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 -- 172.21.15.22:0/203979330 shutdown_connections 2023-10-08T00:33:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc40b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/203979330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc4155fe0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 -- 172.21.15.22:0/203979330 >> 172.21.15.22:0/203979330 conn(0x7f2cc406a320 msgr2=0x7f2cc40cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 -- 172.21.15.22:0/203979330 shutdown_connections 2023-10-08T00:33:58.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.617+0000 7f2cc99dd700 1 -- 172.21.15.22:0/203979330 wait complete. 2023-10-08T00:33:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.618+0000 7f2cc99dd700 1 Processor -- start 2023-10-08T00:33:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.618+0000 7f2cc99dd700 1 -- start start 2023-10-08T00:33:58.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc99dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cc40ac230 0x7f2cc41568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc99dd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc4167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc99dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc41507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc99dd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc41592f0 con 0x7f2cc4155c10 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc99dd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4159cc0 con 0x7f2cc40ac230 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc99dd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4156fa0 con 0x7f2cc40ac6d0 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc41507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc41507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47416/0 (socket says 172.21.15.22:47416) 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 -- 172.21.15.22:0/2592680912 learned_addr learned my addr 172.21.15.22:0/2592680912 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc27fc700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc4167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc2ffd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cc40ac230 0x7f2cc41568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 -- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 msgr2=0x7f2cc4167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc4167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 -- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cc40ac230 msgr2=0x7f2cc41568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cc40ac230 0x7f2cc41568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc37fe700 1 -- 172.21.15.22:0/2592680912 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb4009420 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.619+0000 7f2cc27fc700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc4167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.620+0000 7f2cc37fe700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc41507c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00a380 tx=0x7f2cbc007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.620+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00ae10 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.620+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00d650 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.620+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc4157280 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.620+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00da10 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.620+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc4157840 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.621+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc4159e50 con 0x7f2cc4155c10 2023-10-08T00:33:58.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.621+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2cbc01e3b0 con 0x7f2cc4155c10 2023-10-08T00:33:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.622+0000 7f2caaffd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cb0067320 0x7f2cb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.622+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2cbc0855d0 con 0x7f2cc4155c10 2023-10-08T00:33:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.622+0000 7f2cc2ffd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cb0067320 0x7f2cb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:58.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.622+0000 7f2cc2ffd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cb0067320 0x7f2cb00697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40091e0 tx=0x7f2cb4016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:58.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.626+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cbc052360 con 0x7f2cc4155c10 2023-10-08T00:33:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.813+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cc404c3c0 con 0x7f2cb0067320 2023-10-08T00:33:58.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.822+0000 7f2caaffd700 1 -- 172.21.15.22:0/2592680912 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289596 (secure 0 0 0) 0x7f2cc404c3c0 con 0x7f2cb0067320 2023-10-08T00:33:58.826 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cb0067320 msgr2=0x7f2cb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cb0067320 0x7f2cb00697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40091e0 tx=0x7f2cb4016000 comp rx=0 tx=0).stop 2023-10-08T00:33:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 msgr2=0x7f2cc41507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:58.828 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc41507c0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00a380 tx=0x7f2cbc007900 comp rx=0 tx=0).stop 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 shutdown_connections 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cc4155c10 0x7f2cc41507c0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cc40ac230 0x7f2cc41568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cb0067320 0x7f2cb00697d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.824+0000 7f2cc99dd700 1 --2- 172.21.15.22:0/2592680912 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2cc40ac6d0 0x7f2cc4167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.825+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 >> 172.21.15.22:0/2592680912 conn(0x7f2cc406a320 msgr2=0x7f2cc40ccea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.825+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 shutdown_connections 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:58.825+0000 7f2cc99dd700 1 -- 172.21.15.22:0/2592680912 wait complete. 2023-10-08T00:33:58.829 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:33:58.838 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2023-10-08T00:33:58.512472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2434880,"kb_used_data":19712,"kb_used_omap":0,"kb_used_meta":2415104,"kb_avail":752539840,"statfs":{"total":773094113280,"available":770600796160,"internally_reserved":0,"allocated":20185088,"data_stored":9713060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2473066496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001463"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.346908+0000","last_change":"2023-10-08T00:33:54.344804+0000","last_active":"2023-10-08T00:33:54.346908+0000","last_peered":"2023-10-08T00:33:54.346908+0000","last_clean":"2023-10-08T00:33:54.346908+0000","last_became_active":"2023-10-08T00:33:54.344431+0000","last_became_peered":"2023-10-08T00:33:54.344431+0000","last_unstale":"2023-10-08T00:33:54.346908+0000","last_undegraded":"2023-10-08T00:33:54.346908+0000","last_fullsized":"2023-10-08T00:33:54.346908+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:21.800176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351167+0000","last_change":"2023-10-08T00:33:54.351167+0000","last_active":"2023-10-08T00:33:54.351167+0000","last_peered":"2023-10-08T00:33:54.351167+0000","last_clean":"2023-10-08T00:33:54.351167+0000","last_became_active":"2023-10-08T00:33:54.350786+0000","last_became_peered":"2023-10-08T00:33:54.350786+0000","last_unstale":"2023-10-08T00:33:54.351167+0000","last_undegraded":"2023-10-08T00:33:54.351167+0000","last_fullsized":"2023-10-08T00:33:54.351167+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:55.666706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.354778+0000","last_change":"2023-10-08T00:33:54.354778+0000","last_active":"2023-10-08T00:33:54.354778+0000","last_peered":"2023-10-08T00:33:54.354778+0000","last_clean":"2023-10-08T00:33:54.354778+0000","last_became_active":"2023-10-08T00:33:54.354513+0000","last_became_peered":"2023-10-08T00:33:54.354513+0000","last_unstale":"2023-10-08T00:33:54.354778+0000","last_undegraded":"2023-10-08T00:33:54.354778+0000","last_fullsized":"2023-10-08T00:33:54.354778+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:11:34.434905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361558+0000","last_change":"2023-10-08T00:33:54.361558+0000","last_active":"2023-10-08T00:33:54.361558+0000","last_peered":"2023-10-08T00:33:54.361558+0000","last_clean":"2023-10-08T00:33:54.361558+0000","last_became_active":"2023-10-08T00:33:54.361273+0000","last_became_peered":"2023-10-08T00:33:54.361273+0000","last_unstale":"2023-10-08T00:33:54.361558+0000","last_undegraded":"2023-10-08T00:33:54.361558+0000","last_fullsized":"2023-10-08T00:33:54.361558+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.476052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.353026+0000","last_change":"2023-10-08T00:33:54.353026+0000","last_active":"2023-10-08T00:33:54.353026+0000","last_peered":"2023-10-08T00:33:54.353026+0000","last_clean":"2023-10-08T00:33:54.353026+0000","last_became_active":"2023-10-08T00:33:54.352404+0000","last_became_peered":"2023-10-08T00:33:54.352404+0000","last_unstale":"2023-10-08T00:33:54.353026+0000","last_undegraded":"2023-10-08T00:33:54.353026+0000","last_fullsized":"2023-10-08T00:33:54.353026+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:49.221246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361665+0000","last_change":"2023-10-08T00:33:54.358938+0000","last_active":"2023-10-08T00:33:54.361665+0000","last_peered":"2023-10-08T00:33:54.361665+0000","last_clean":"2023-10-08T00:33:54.361665+0000","last_became_active":"2023-10-08T00:33:54.358629+0000","last_became_peered":"2023-10-08T00:33:54.358629+0000","last_unstale":"2023-10-08T00:33:54.361665+0000","last_undegraded":"2023-10-08T00:33:54.361665+0000","last_fullsized":"2023-10-08T00:33:54.361665+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:22:26.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.355720+0000","last_change":"2023-10-08T00:33:54.355720+0000","last_active":"2023-10-08T00:33:54.355720+0000","last_peered":"2023-10-08T00:33:54.355720+0000","last_clean":"2023-10-08T00:33:54.355720+0000","last_became_active":"2023-10-08T00:33:54.355448+0000","last_became_peered":"2023-10-08T00:33:54.355448+0000","last_unstale":"2023-10-08T00:33:54.355720+0000","last_undegraded":"2023-10-08T00:33:54.355720+0000","last_fullsized":"2023-10-08T00:33:54.355720+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:55.454937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349945+0000","last_change":"2023-10-08T00:33:54.349945+0000","last_active":"2023-10-08T00:33:54.349945+0000","last_peered":"2023-10-08T00:33:54.349945+0000","last_clean":"2023-10-08T00:33:54.349945+0000","last_became_active":"2023-10-08T00:33:54.349645+0000","last_became_peered":"2023-10-08T00:33:54.349645+0000","last_unstale":"2023-10-08T00:33:54.349945+0000","last_undegraded":"2023-10-08T00:33:54.349945+0000","last_fullsized":"2023-10-08T00:33:54.349945+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:22:57.658848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.356963+0000","last_change":"2023-10-08T00:33:54.352782+0000","last_active":"2023-10-08T00:33:54.356963+0000","last_peered":"2023-10-08T00:33:54.356963+0000","last_clean":"2023-10-08T00:33:54.356963+0000","last_became_active":"2023-10-08T00:33:54.352431+0000","last_became_peered":"2023-10-08T00:33:54.352431+0000","last_unstale":"2023-10-08T00:33:54.356963+0000","last_undegraded":"2023-10-08T00:33:54.356963+0000","last_fullsized":"2023-10-08T00:33:54.356963+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:51:46.688741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357073+0000","last_change":"2023-10-08T00:33:54.357073+0000","last_active":"2023-10-08T00:33:54.357073+0000","last_peered":"2023-10-08T00:33:54.357073+0000","last_clean":"2023-10-08T00:33:54.357073+0000","last_became_active":"2023-10-08T00:33:54.356764+0000","last_became_peered":"2023-10-08T00:33:54.356764+0000","last_unstale":"2023-10-08T00:33:54.357073+0000","last_undegraded":"2023-10-08T00:33:54.357073+0000","last_fullsized":"2023-10-08T00:33:54.357073+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:26.968806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357980+0000","last_change":"2023-10-08T00:33:54.357980+0000","last_active":"2023-10-08T00:33:54.357980+0000","last_peered":"2023-10-08T00:33:54.357980+0000","last_clean":"2023-10-08T00:33:54.357980+0000","last_became_active":"2023-10-08T00:33:54.357715+0000","last_became_peered":"2023-10-08T00:33:54.357715+0000","last_unstale":"2023-10-08T00:33:54.357980+0000","last_undegraded":"2023-10-08T00:33:54.357980+0000","last_fullsized":"2023-10-08T00:33:54.357980+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:56:40.735630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357282+0000","last_change":"2023-10-08T00:33:54.351877+0000","last_active":"2023-10-08T00:33:54.357282+0000","last_peered":"2023-10-08T00:33:54.357282+0000","last_clean":"2023-10-08T00:33:54.357282+0000","last_became_active":"2023-10-08T00:33:54.351595+0000","last_became_peered":"2023-10-08T00:33:54.351595+0000","last_unstale":"2023-10-08T00:33:54.357282+0000","last_undegraded":"2023-10-08T00:33:54.357282+0000","last_fullsized":"2023-10-08T00:33:54.357282+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:48.665205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349339+0000","last_change":"2023-10-08T00:33:54.344896+0000","last_active":"2023-10-08T00:33:54.349339+0000","last_peered":"2023-10-08T00:33:54.349339+0000","last_clean":"2023-10-08T00:33:54.349339+0000","last_became_active":"2023-10-08T00:33:54.344232+0000","last_became_peered":"2023-10-08T00:33:54.344232+0000","last_unstale":"2023-10-08T00:33:54.349339+0000","last_undegraded":"2023-10-08T00:33:54.349339+0000","last_fullsized":"2023-10-08T00:33:54.349339+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:17.711170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349680+0000","last_change":"2023-10-08T00:33:54.342366+0000","last_active":"2023-10-08T00:33:54.349680+0000","last_peered":"2023-10-08T00:33:54.349680+0000","last_clean":"2023-10-08T00:33:54.349680+0000","last_became_active":"2023-10-08T00:33:54.342125+0000","last_became_peered":"2023-10-08T00:33:54.342125+0000","last_unstale":"2023-10-08T00:33:54.349680+0000","last_undegraded":"2023-10-08T00:33:54.349680+0000","last_fullsized":"2023-10-08T00:33:54.349680+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:48:30.320572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.348160+0000","last_change":"2023-10-08T00:33:54.348160+0000","last_active":"2023-10-08T00:33:54.348160+0000","last_peered":"2023-10-08T00:33:54.348160+0000","last_clean":"2023-10-08T00:33:54.348160+0000","last_became_active":"2023-10-08T00:33:54.347723+0000","last_became_peered":"2023-10-08T00:33:54.347723+0000","last_unstale":"2023-10-08T00:33:54.348160+0000","last_undegraded":"2023-10-08T00:33:54.348160+0000","last_fullsized":"2023-10-08T00:33:54.348160+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:50.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.363105+0000","last_change":"2023-10-08T00:33:54.363105+0000","last_active":"2023-10-08T00:33:54.363105+0000","last_peered":"2023-10-08T00:33:54.363105+0000","last_clean":"2023-10-08T00:33:54.363105+0000","last_became_active":"2023-10-08T00:33:54.362808+0000","last_became_peered":"2023-10-08T00:33:54.362808+0000","last_unstale":"2023-10-08T00:33:54.363105+0000","last_undegraded":"2023-10-08T00:33:54.363105+0000","last_fullsized":"2023-10-08T00:33:54.363105+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:07:23.743228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357617+0000","last_change":"2023-10-08T00:33:54.351364+0000","last_active":"2023-10-08T00:33:54.357617+0000","last_peered":"2023-10-08T00:33:54.357617+0000","last_clean":"2023-10-08T00:33:54.357617+0000","last_became_active":"2023-10-08T00:33:54.351048+0000","last_became_peered":"2023-10-08T00:33:54.351048+0000","last_unstale":"2023-10-08T00:33:54.357617+0000","last_undegraded":"2023-10-08T00:33:54.357617+0000","last_fullsized":"2023-10-08T00:33:54.357617+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:34:05.105950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.344683+0000","last_change":"2023-10-08T00:33:54.344683+0000","last_active":"2023-10-08T00:33:54.344683+0000","last_peered":"2023-10-08T00:33:54.344683+0000","last_clean":"2023-10-08T00:33:54.344683+0000","last_became_active":"2023-10-08T00:33:54.344388+0000","last_became_peered":"2023-10-08T00:33:54.344388+0000","last_unstale":"2023-10-08T00:33:54.344683+0000","last_undegraded":"2023-10-08T00:33:54.344683+0000","last_fullsized":"2023-10-08T00:33:54.344683+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:50.776333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.346832+0000","last_change":"2023-10-08T00:33:54.346832+0000","last_active":"2023-10-08T00:33:54.346832+0000","last_peered":"2023-10-08T00:33:54.346832+0000","last_clean":"2023-10-08T00:33:54.346832+0000","last_became_active":"2023-10-08T00:33:54.346522+0000","last_became_peered":"2023-10-08T00:33:54.346522+0000","last_unstale":"2023-10-08T00:33:54.346832+0000","last_undegraded":"2023-10-08T00:33:54.346832+0000","last_fullsized":"2023-10-08T00:33:54.346832+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:07:23.743228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361662+0000","last_change":"2023-10-08T00:33:54.361662+0000","last_active":"2023-10-08T00:33:54.361662+0000","last_peered":"2023-10-08T00:33:54.361662+0000","last_clean":"2023-10-08T00:33:54.361662+0000","last_became_active":"2023-10-08T00:33:54.361393+0000","last_became_peered":"2023-10-08T00:33:54.361393+0000","last_unstale":"2023-10-08T00:33:54.361662+0000","last_undegraded":"2023-10-08T00:33:54.361662+0000","last_fullsized":"2023-10-08T00:33:54.361662+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:27:02.938350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351211+0000","last_change":"2023-10-08T00:33:54.351211+0000","last_active":"2023-10-08T00:33:54.351211+0000","last_peered":"2023-10-08T00:33:54.351211+0000","last_clean":"2023-10-08T00:33:54.351211+0000","last_became_active":"2023-10-08T00:33:54.350939+0000","last_became_peered":"2023-10-08T00:33:54.350939+0000","last_unstale":"2023-10-08T00:33:54.351211+0000","last_undegraded":"2023-10-08T00:33:54.351211+0000","last_fullsized":"2023-10-08T00:33:54.351211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:27:02.938350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357500+0000","last_change":"2023-10-08T00:33:54.348342+0000","last_active":"2023-10-08T00:33:54.357500+0000","last_peered":"2023-10-08T00:33:54.357500+0000","last_clean":"2023-10-08T00:33:54.357500+0000","last_became_active":"2023-10-08T00:33:54.347973+0000","last_became_peered":"2023-10-08T00:33:54.347973+0000","last_unstale":"2023-10-08T00:33:54.357500+0000","last_undegraded":"2023-10-08T00:33:54.357500+0000","last_fullsized":"2023-10-08T00:33:54.357500+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:41:43.590703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.347989+0000","last_change":"2023-10-08T00:33:54.347989+0000","last_active":"2023-10-08T00:33:54.347989+0000","last_peered":"2023-10-08T00:33:54.347989+0000","last_clean":"2023-10-08T00:33:54.347989+0000","last_became_active":"2023-10-08T00:33:54.347377+0000","last_became_peered":"2023-10-08T00:33:54.347377+0000","last_unstale":"2023-10-08T00:33:54.347989+0000","last_undegraded":"2023-10-08T00:33:54.347989+0000","last_fullsized":"2023-10-08T00:33:54.347989+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:40:26.460975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.350214+0000","last_change":"2023-10-08T00:33:54.343980+0000","last_active":"2023-10-08T00:33:54.350214+0000","last_peered":"2023-10-08T00:33:54.350214+0000","last_clean":"2023-10-08T00:33:54.350214+0000","last_became_active":"2023-10-08T00:33:54.343693+0000","last_became_peered":"2023-10-08T00:33:54.343693+0000","last_unstale":"2023-10-08T00:33:54.350214+0000","last_undegraded":"2023-10-08T00:33:54.350214+0000","last_fullsized":"2023-10-08T00:33:54.350214+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:51.680095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351199+0000","last_change":"2023-10-08T00:33:54.351199+0000","last_active":"2023-10-08T00:33:54.351199+0000","last_peered":"2023-10-08T00:33:54.351199+0000","last_clean":"2023-10-08T00:33:54.351199+0000","last_became_active":"2023-10-08T00:33:54.350933+0000","last_became_peered":"2023-10-08T00:33:54.350933+0000","last_unstale":"2023-10-08T00:33:54.351199+0000","last_undegraded":"2023-10-08T00:33:54.351199+0000","last_fullsized":"2023-10-08T00:33:54.351199+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:11:18.168559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.365734+0000","last_change":"2023-10-08T00:33:54.365734+0000","last_active":"2023-10-08T00:33:54.365734+0000","last_peered":"2023-10-08T00:33:54.365734+0000","last_clean":"2023-10-08T00:33:54.365734+0000","last_became_active":"2023-10-08T00:33:54.365294+0000","last_became_peered":"2023-10-08T00:33:54.365294+0000","last_unstale":"2023-10-08T00:33:54.365734+0000","last_undegraded":"2023-10-08T00:33:54.365734+0000","last_fullsized":"2023-10-08T00:33:54.365734+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:55:55.666706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.350356+0000","last_change":"2023-10-08T00:33:54.350356+0000","last_active":"2023-10-08T00:33:54.350356+0000","last_peered":"2023-10-08T00:33:54.350356+0000","last_clean":"2023-10-08T00:33:54.350356+0000","last_became_active":"2023-10-08T00:33:54.350078+0000","last_became_peered":"2023-10-08T00:33:54.350078+0000","last_unstale":"2023-10-08T00:33:54.350356+0000","last_undegraded":"2023-10-08T00:33:54.350356+0000","last_fullsized":"2023-10-08T00:33:54.350356+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:25:17.372993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357303+0000","last_change":"2023-10-08T00:33:54.353010+0000","last_active":"2023-10-08T00:33:54.357303+0000","last_peered":"2023-10-08T00:33:54.357303+0000","last_clean":"2023-10-08T00:33:54.357303+0000","last_became_active":"2023-10-08T00:33:54.352727+0000","last_became_peered":"2023-10-08T00:33:54.352727+0000","last_unstale":"2023-10-08T00:33:54.357303+0000","last_undegraded":"2023-10-08T00:33:54.357303+0000","last_fullsized":"2023-10-08T00:33:54.357303+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:02:45.162718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349649+0000","last_change":"2023-10-08T00:33:54.343114+0000","last_active":"2023-10-08T00:33:54.349649+0000","last_peered":"2023-10-08T00:33:54.349649+0000","last_clean":"2023-10-08T00:33:54.349649+0000","last_became_active":"2023-10-08T00:33:54.342829+0000","last_became_peered":"2023-10-08T00:33:54.342829+0000","last_unstale":"2023-10-08T00:33:54.349649+0000","last_undegraded":"2023-10-08T00:33:54.349649+0000","last_fullsized":"2023-10-08T00:33:54.349649+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:57:00.731268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.355361+0000","last_change":"2023-10-08T00:33:54.351530+0000","last_active":"2023-10-08T00:33:54.355361+0000","last_peered":"2023-10-08T00:33:54.355361+0000","last_clean":"2023-10-08T00:33:54.355361+0000","last_became_active":"2023-10-08T00:33:54.351253+0000","last_became_peered":"2023-10-08T00:33:54.351253+0000","last_unstale":"2023-10-08T00:33:54.355361+0000","last_undegraded":"2023-10-08T00:33:54.355361+0000","last_fullsized":"2023-10-08T00:33:54.355361+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:10:11.065007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362376+0000","last_change":"2023-10-08T00:33:54.362376+0000","last_active":"2023-10-08T00:33:54.362376+0000","last_peered":"2023-10-08T00:33:54.362376+0000","last_clean":"2023-10-08T00:33:54.362376+0000","last_became_active":"2023-10-08T00:33:54.361890+0000","last_became_peered":"2023-10-08T00:33:54.361890+0000","last_unstale":"2023-10-08T00:33:54.362376+0000","last_undegraded":"2023-10-08T00:33:54.362376+0000","last_fullsized":"2023-10-08T00:33:54.362376+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:30.564895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357281+0000","last_change":"2023-10-08T00:33:54.352901+0000","last_active":"2023-10-08T00:33:54.357281+0000","last_peered":"2023-10-08T00:33:54.357281+0000","last_clean":"2023-10-08T00:33:54.357281+0000","last_became_active":"2023-10-08T00:33:54.352623+0000","last_became_peered":"2023-10-08T00:33:54.352623+0000","last_unstale":"2023-10-08T00:33:54.357281+0000","last_undegraded":"2023-10-08T00:33:54.357281+0000","last_fullsized":"2023-10-08T00:33:54.357281+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:49.267182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.355942+0000","last_change":"2023-10-08T00:33:54.355942+0000","last_active":"2023-10-08T00:33:54.355942+0000","last_peered":"2023-10-08T00:33:54.355942+0000","last_clean":"2023-10-08T00:33:54.355942+0000","last_became_active":"2023-10-08T00:33:54.355527+0000","last_became_peered":"2023-10-08T00:33:54.355527+0000","last_unstale":"2023-10-08T00:33:54.355942+0000","last_undegraded":"2023-10-08T00:33:54.355942+0000","last_fullsized":"2023-10-08T00:33:54.355942+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:20:55.454937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"186'4","reported_seq":14,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.367152+0000","last_change":"2023-10-08T00:33:53.351541+0000","last_active":"2023-10-08T00:33:54.367152+0000","last_peered":"2023-10-08T00:33:54.367152+0000","last_clean":"2023-10-08T00:33:54.367152+0000","last_became_active":"2023-10-08T00:33:53.351223+0000","last_became_peered":"2023-10-08T00:33:53.351223+0000","last_unstale":"2023-10-08T00:33:54.367152+0000","last_undegraded":"2023-10-08T00:33:54.367152+0000","last_fullsized":"2023-10-08T00:33:54.367152+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:17:22.458706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351037+0000","last_change":"2023-10-08T00:33:54.351037+0000","last_active":"2023-10-08T00:33:54.351037+0000","last_peered":"2023-10-08T00:33:54.351037+0000","last_clean":"2023-10-08T00:33:54.351037+0000","last_became_active":"2023-10-08T00:33:54.350748+0000","last_became_peered":"2023-10-08T00:33:54.350748+0000","last_unstale":"2023-10-08T00:33:54.351037+0000","last_undegraded":"2023-10-08T00:33:54.351037+0000","last_fullsized":"2023-10-08T00:33:54.351037+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:27.061900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"186'2","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.366043+0000","last_change":"2023-10-08T00:33:53.347021+0000","last_active":"2023-10-08T00:33:54.366043+0000","last_peered":"2023-10-08T00:33:54.366043+0000","last_clean":"2023-10-08T00:33:54.366043+0000","last_became_active":"2023-10-08T00:33:53.346756+0000","last_became_peered":"2023-10-08T00:33:53.346756+0000","last_unstale":"2023-10-08T00:33:54.366043+0000","last_undegraded":"2023-10-08T00:33:54.366043+0000","last_fullsized":"2023-10-08T00:33:54.366043+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:17:01.314499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351329+0000","last_change":"2023-10-08T00:33:54.350508+0000","last_active":"2023-10-08T00:33:54.351329+0000","last_peered":"2023-10-08T00:33:54.351329+0000","last_clean":"2023-10-08T00:33:54.351329+0000","last_became_active":"2023-10-08T00:33:54.350217+0000","last_became_peered":"2023-10-08T00:33:54.350217+0000","last_unstale":"2023-10-08T00:33:54.351329+0000","last_undegraded":"2023-10-08T00:33:54.351329+0000","last_fullsized":"2023-10-08T00:33:54.351329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:16.271517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"186'2","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.360566+0000","last_change":"2023-10-08T00:33:53.349499+0000","last_active":"2023-10-08T00:33:54.360566+0000","last_peered":"2023-10-08T00:33:54.360566+0000","last_clean":"2023-10-08T00:33:54.360566+0000","last_became_active":"2023-10-08T00:33:53.348742+0000","last_became_peered":"2023-10-08T00:33:53.348742+0000","last_unstale":"2023-10-08T00:33:54.360566+0000","last_undegraded":"2023-10-08T00:33:54.360566+0000","last_fullsized":"2023-10-08T00:33:54.360566+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:05:47.657957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362847+0000","last_change":"2023-10-08T00:33:54.356149+0000","last_active":"2023-10-08T00:33:54.362847+0000","last_peered":"2023-10-08T00:33:54.362847+0000","last_clean":"2023-10-08T00:33:54.362847+0000","last_became_active":"2023-10-08T00:33:54.355904+0000","last_became_peered":"2023-10-08T00:33:54.355904+0000","last_unstale":"2023-10-08T00:33:54.362847+0000","last_undegraded":"2023-10-08T00:33:54.362847+0000","last_fullsized":"2023-10-08T00:33:54.362847+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:59:26.692054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"186'1","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.335403+0000","last_change":"2023-10-08T00:33:53.344259+0000","last_active":"2023-10-08T00:33:54.335403+0000","last_peered":"2023-10-08T00:33:54.335403+0000","last_clean":"2023-10-08T00:33:54.335403+0000","last_became_active":"2023-10-08T00:33:53.343999+0000","last_became_peered":"2023-10-08T00:33:53.343999+0000","last_unstale":"2023-10-08T00:33:54.335403+0000","last_undegraded":"2023-10-08T00:33:54.335403+0000","last_fullsized":"2023-10-08T00:33:54.335403+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:17.208427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.341966+0000","last_change":"2023-10-08T00:33:54.341966+0000","last_active":"2023-10-08T00:33:54.341966+0000","last_peered":"2023-10-08T00:33:54.341966+0000","last_clean":"2023-10-08T00:33:54.341966+0000","last_became_active":"2023-10-08T00:33:54.341563+0000","last_became_peered":"2023-10-08T00:33:54.341563+0000","last_unstale":"2023-10-08T00:33:54.341966+0000","last_undegraded":"2023-10-08T00:33:54.341966+0000","last_fullsized":"2023-10-08T00:33:54.341966+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:41:45.236632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.359255+0000","last_change":"2023-10-08T00:33:53.345189+0000","last_active":"2023-10-08T00:33:54.359255+0000","last_peered":"2023-10-08T00:33:54.359255+0000","last_clean":"2023-10-08T00:33:54.359255+0000","last_became_active":"2023-10-08T00:33:53.344843+0000","last_became_peered":"2023-10-08T00:33:53.344843+0000","last_unstale":"2023-10-08T00:33:54.359255+0000","last_undegraded":"2023-10-08T00:33:54.359255+0000","last_fullsized":"2023-10-08T00:33:54.359255+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:29.368855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361920+0000","last_change":"2023-10-08T00:33:54.361920+0000","last_active":"2023-10-08T00:33:54.361920+0000","last_peered":"2023-10-08T00:33:54.361920+0000","last_clean":"2023-10-08T00:33:54.361920+0000","last_became_active":"2023-10-08T00:33:54.361638+0000","last_became_peered":"2023-10-08T00:33:54.361638+0000","last_unstale":"2023-10-08T00:33:54.361920+0000","last_undegraded":"2023-10-08T00:33:54.361920+0000","last_fullsized":"2023-10-08T00:33:54.361920+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:02.921816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350592+0000","last_change":"2023-10-08T00:33:53.348279+0000","last_active":"2023-10-08T00:33:53.350592+0000","last_peered":"2023-10-08T00:33:53.350592+0000","last_clean":"2023-10-08T00:33:53.350592+0000","last_became_active":"2023-10-08T00:33:53.347888+0000","last_became_peered":"2023-10-08T00:33:53.347888+0000","last_unstale":"2023-10-08T00:33:53.350592+0000","last_undegraded":"2023-10-08T00:33:53.350592+0000","last_fullsized":"2023-10-08T00:33:53.350592+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:29:34.629083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349828+0000","last_change":"2023-10-08T00:33:54.349828+0000","last_active":"2023-10-08T00:33:54.349828+0000","last_peered":"2023-10-08T00:33:54.349828+0000","last_clean":"2023-10-08T00:33:54.349828+0000","last_became_active":"2023-10-08T00:33:54.349513+0000","last_became_peered":"2023-10-08T00:33:54.349513+0000","last_unstale":"2023-10-08T00:33:54.349828+0000","last_undegraded":"2023-10-08T00:33:54.349828+0000","last_fullsized":"2023-10-08T00:33:54.349828+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:45:38.222159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.339022+0000","last_change":"2023-10-08T00:33:53.348397+0000","last_active":"2023-10-08T00:33:54.339022+0000","last_peered":"2023-10-08T00:33:54.339022+0000","last_clean":"2023-10-08T00:33:54.339022+0000","last_became_active":"2023-10-08T00:33:53.348187+0000","last_became_peered":"2023-10-08T00:33:53.348187+0000","last_unstale":"2023-10-08T00:33:54.339022+0000","last_undegraded":"2023-10-08T00:33:54.339022+0000","last_fullsized":"2023-10-08T00:33:54.339022+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:50:04.842705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.342570+0000","last_change":"2023-10-08T00:33:54.342570+0000","last_active":"2023-10-08T00:33:54.342570+0000","last_peered":"2023-10-08T00:33:54.342570+0000","last_clean":"2023-10-08T00:33:54.342570+0000","last_became_active":"2023-10-08T00:33:54.342244+0000","last_became_peered":"2023-10-08T00:33:54.342244+0000","last_unstale":"2023-10-08T00:33:54.342570+0000","last_undegraded":"2023-10-08T00:33:54.342570+0000","last_fullsized":"2023-10-08T00:33:54.342570+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:40:56.561890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.334910+0000","last_change":"2023-10-08T00:33:53.347646+0000","last_active":"2023-10-08T00:33:54.334910+0000","last_peered":"2023-10-08T00:33:54.334910+0000","last_clean":"2023-10-08T00:33:54.334910+0000","last_became_active":"2023-10-08T00:33:53.347122+0000","last_became_peered":"2023-10-08T00:33:53.347122+0000","last_unstale":"2023-10-08T00:33:54.334910+0000","last_undegraded":"2023-10-08T00:33:54.334910+0000","last_fullsized":"2023-10-08T00:33:54.334910+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:48.259934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357735+0000","last_change":"2023-10-08T00:33:54.348164+0000","last_active":"2023-10-08T00:33:54.357735+0000","last_peered":"2023-10-08T00:33:54.357735+0000","last_clean":"2023-10-08T00:33:54.357735+0000","last_became_active":"2023-10-08T00:33:54.347872+0000","last_became_peered":"2023-10-08T00:33:54.347872+0000","last_unstale":"2023-10-08T00:33:54.357735+0000","last_undegraded":"2023-10-08T00:33:54.357735+0000","last_fullsized":"2023-10-08T00:33:54.357735+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:27:01.870064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350525+0000","last_change":"2023-10-08T00:33:53.347779+0000","last_active":"2023-10-08T00:33:53.350525+0000","last_peered":"2023-10-08T00:33:53.350525+0000","last_clean":"2023-10-08T00:33:53.350525+0000","last_became_active":"2023-10-08T00:33:53.347490+0000","last_became_peered":"2023-10-08T00:33:53.347490+0000","last_unstale":"2023-10-08T00:33:53.350525+0000","last_undegraded":"2023-10-08T00:33:53.350525+0000","last_fullsized":"2023-10-08T00:33:53.350525+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:50:06.187345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.356941+0000","last_change":"2023-10-08T00:33:54.356941+0000","last_active":"2023-10-08T00:33:54.356941+0000","last_peered":"2023-10-08T00:33:54.356941+0000","last_clean":"2023-10-08T00:33:54.356941+0000","last_became_active":"2023-10-08T00:33:54.356644+0000","last_became_peered":"2023-10-08T00:33:54.356644+0000","last_unstale":"2023-10-08T00:33:54.356941+0000","last_undegraded":"2023-10-08T00:33:54.356941+0000","last_fullsized":"2023-10-08T00:33:54.356941+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:55:11.958035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"186'3","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.358994+0000","last_change":"2023-10-08T00:33:53.350234+0000","last_active":"2023-10-08T00:33:54.358994+0000","last_peered":"2023-10-08T00:33:54.358994+0000","last_clean":"2023-10-08T00:33:54.358994+0000","last_became_active":"2023-10-08T00:33:53.349900+0000","last_became_peered":"2023-10-08T00:33:53.349900+0000","last_unstale":"2023-10-08T00:33:54.358994+0000","last_undegraded":"2023-10-08T00:33:54.358994+0000","last_fullsized":"2023-10-08T00:33:54.358994+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:33:50.672846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.345710+0000","last_change":"2023-10-08T00:33:54.345710+0000","last_active":"2023-10-08T00:33:54.345710+0000","last_peered":"2023-10-08T00:33:54.345710+0000","last_clean":"2023-10-08T00:33:54.345710+0000","last_became_active":"2023-10-08T00:33:54.345430+0000","last_became_peered":"2023-10-08T00:33:54.345430+0000","last_unstale":"2023-10-08T00:33:54.345710+0000","last_undegraded":"2023-10-08T00:33:54.345710+0000","last_fullsized":"2023-10-08T00:33:54.345710+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:37.441319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"186'6","reported_seq":16,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.366185+0000","last_change":"2023-10-08T00:33:53.353514+0000","last_active":"2023-10-08T00:33:54.366185+0000","last_peered":"2023-10-08T00:33:54.366185+0000","last_clean":"2023-10-08T00:33:54.366185+0000","last_became_active":"2023-10-08T00:33:53.353246+0000","last_became_peered":"2023-10-08T00:33:53.353246+0000","last_unstale":"2023-10-08T00:33:54.366185+0000","last_undegraded":"2023-10-08T00:33:54.366185+0000","last_fullsized":"2023-10-08T00:33:54.366185+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:25:21.908079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361109+0000","last_change":"2023-10-08T00:33:54.361109+0000","last_active":"2023-10-08T00:33:54.361109+0000","last_peered":"2023-10-08T00:33:54.361109+0000","last_clean":"2023-10-08T00:33:54.361109+0000","last_became_active":"2023-10-08T00:33:54.360827+0000","last_became_peered":"2023-10-08T00:33:54.360827+0000","last_unstale":"2023-10-08T00:33:54.361109+0000","last_undegraded":"2023-10-08T00:33:54.361109+0000","last_fullsized":"2023-10-08T00:33:54.361109+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:49:23.293320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362969+0000","last_change":"2023-10-08T00:33:53.350952+0000","last_active":"2023-10-08T00:33:54.362969+0000","last_peered":"2023-10-08T00:33:54.362969+0000","last_clean":"2023-10-08T00:33:54.362969+0000","last_became_active":"2023-10-08T00:33:53.350630+0000","last_became_peered":"2023-10-08T00:33:53.350630+0000","last_unstale":"2023-10-08T00:33:54.362969+0000","last_undegraded":"2023-10-08T00:33:54.362969+0000","last_fullsized":"2023-10-08T00:33:54.362969+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:28:14.800203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.345481+0000","last_change":"2023-10-08T00:33:54.345481+0000","last_active":"2023-10-08T00:33:54.345481+0000","last_peered":"2023-10-08T00:33:54.345481+0000","last_clean":"2023-10-08T00:33:54.345481+0000","last_became_active":"2023-10-08T00:33:54.345095+0000","last_became_peered":"2023-10-08T00:33:54.345095+0000","last_unstale":"2023-10-08T00:33:54.345481+0000","last_undegraded":"2023-10-08T00:33:54.345481+0000","last_fullsized":"2023-10-08T00:33:54.345481+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:42:30.564895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350845+0000","last_change":"2023-10-08T00:33:53.350287+0000","last_active":"2023-10-08T00:33:53.350845+0000","last_peered":"2023-10-08T00:33:53.350845+0000","last_clean":"2023-10-08T00:33:53.350845+0000","last_became_active":"2023-10-08T00:33:53.350023+0000","last_became_peered":"2023-10-08T00:33:53.350023+0000","last_unstale":"2023-10-08T00:33:53.350845+0000","last_undegraded":"2023-10-08T00:33:53.350845+0000","last_fullsized":"2023-10-08T00:33:53.350845+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:57:12.251840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.348645+0000","last_change":"2023-10-08T00:33:54.348645+0000","last_active":"2023-10-08T00:33:54.348645+0000","last_peered":"2023-10-08T00:33:54.348645+0000","last_clean":"2023-10-08T00:33:54.348645+0000","last_became_active":"2023-10-08T00:33:54.348389+0000","last_became_peered":"2023-10-08T00:33:54.348389+0000","last_unstale":"2023-10-08T00:33:54.348645+0000","last_undegraded":"2023-10-08T00:33:54.348645+0000","last_fullsized":"2023-10-08T00:33:54.348645+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:11:34.434905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.352630+0000","last_change":"2023-10-08T00:33:53.351827+0000","last_active":"2023-10-08T00:33:53.352630+0000","last_peered":"2023-10-08T00:33:53.352630+0000","last_clean":"2023-10-08T00:33:53.352630+0000","last_became_active":"2023-10-08T00:33:53.351639+0000","last_became_peered":"2023-10-08T00:33:53.351639+0000","last_unstale":"2023-10-08T00:33:53.352630+0000","last_undegraded":"2023-10-08T00:33:53.352630+0000","last_fullsized":"2023-10-08T00:33:53.352630+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:15:27.769308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.365776+0000","last_change":"2023-10-08T00:33:54.365776+0000","last_active":"2023-10-08T00:33:54.365776+0000","last_peered":"2023-10-08T00:33:54.365776+0000","last_clean":"2023-10-08T00:33:54.365776+0000","last_became_active":"2023-10-08T00:33:54.365511+0000","last_became_peered":"2023-10-08T00:33:54.365511+0000","last_unstale":"2023-10-08T00:33:54.365776+0000","last_undegraded":"2023-10-08T00:33:54.365776+0000","last_fullsized":"2023-10-08T00:33:54.365776+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:40:55.252737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"186'8","reported_seq":17,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.372258+0000","last_change":"2023-10-08T00:33:53.344885+0000","last_active":"2023-10-08T00:33:54.372258+0000","last_peered":"2023-10-08T00:33:54.372258+0000","last_clean":"2023-10-08T00:33:54.372258+0000","last_became_active":"2023-10-08T00:33:53.344556+0000","last_became_peered":"2023-10-08T00:33:53.344556+0000","last_unstale":"2023-10-08T00:33:54.372258+0000","last_undegraded":"2023-10-08T00:33:54.372258+0000","last_fullsized":"2023-10-08T00:33:54.372258+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:39:12.196401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361585+0000","last_change":"2023-10-08T00:33:54.361585+0000","last_active":"2023-10-08T00:33:54.361585+0000","last_peered":"2023-10-08T00:33:54.361585+0000","last_clean":"2023-10-08T00:33:54.361585+0000","last_became_active":"2023-10-08T00:33:54.361202+0000","last_became_peered":"2023-10-08T00:33:54.361202+0000","last_unstale":"2023-10-08T00:33:54.361585+0000","last_undegraded":"2023-10-08T00:33:54.361585+0000","last_fullsized":"2023-10-08T00:33:54.361585+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:04:09.667411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.363942+0000","last_change":"2023-10-08T00:33:53.347379+0000","last_active":"2023-10-08T00:33:54.363942+0000","last_peered":"2023-10-08T00:33:54.363942+0000","last_clean":"2023-10-08T00:33:54.363942+0000","last_became_active":"2023-10-08T00:33:53.347080+0000","last_became_peered":"2023-10-08T00:33:53.347080+0000","last_unstale":"2023-10-08T00:33:54.363942+0000","last_undegraded":"2023-10-08T00:33:54.363942+0000","last_fullsized":"2023-10-08T00:33:54.363942+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:39:42.543266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.353043+0000","last_change":"2023-10-08T00:33:54.353043+0000","last_active":"2023-10-08T00:33:54.353043+0000","last_peered":"2023-10-08T00:33:54.353043+0000","last_clean":"2023-10-08T00:33:54.353043+0000","last_became_active":"2023-10-08T00:33:54.352783+0000","last_became_peered":"2023-10-08T00:33:54.352783+0000","last_unstale":"2023-10-08T00:33:54.353043+0000","last_undegraded":"2023-10-08T00:33:54.353043+0000","last_fullsized":"2023-10-08T00:33:54.353043+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:25:05.471507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.369266+0000","last_change":"2023-10-08T00:33:53.345692+0000","last_active":"2023-10-08T00:33:54.369266+0000","last_peered":"2023-10-08T00:33:54.369266+0000","last_clean":"2023-10-08T00:33:54.369266+0000","last_became_active":"2023-10-08T00:33:53.345401+0000","last_became_peered":"2023-10-08T00:33:53.345401+0000","last_unstale":"2023-10-08T00:33:54.369266+0000","last_undegraded":"2023-10-08T00:33:54.369266+0000","last_fullsized":"2023-10-08T00:33:54.369266+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:46:58.009547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361819+0000","last_change":"2023-10-08T00:33:54.361819+0000","last_active":"2023-10-08T00:33:54.361819+0000","last_peered":"2023-10-08T00:33:54.361819+0000","last_clean":"2023-10-08T00:33:54.361819+0000","last_became_active":"2023-10-08T00:33:54.361493+0000","last_became_peered":"2023-10-08T00:33:54.361493+0000","last_unstale":"2023-10-08T00:33:54.361819+0000","last_undegraded":"2023-10-08T00:33:54.361819+0000","last_fullsized":"2023-10-08T00:33:54.361819+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:45:37.441319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"186'1","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.366116+0000","last_change":"2023-10-08T00:33:53.338180+0000","last_active":"2023-10-08T00:33:54.366116+0000","last_peered":"2023-10-08T00:33:54.366116+0000","last_clean":"2023-10-08T00:33:54.366116+0000","last_became_active":"2023-10-08T00:33:53.337918+0000","last_became_peered":"2023-10-08T00:33:53.337918+0000","last_unstale":"2023-10-08T00:33:54.366116+0000","last_undegraded":"2023-10-08T00:33:54.366116+0000","last_fullsized":"2023-10-08T00:33:54.366116+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:51:49.912664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357358+0000","last_change":"2023-10-08T00:33:54.357358+0000","last_active":"2023-10-08T00:33:54.357358+0000","last_peered":"2023-10-08T00:33:54.357358+0000","last_clean":"2023-10-08T00:33:54.357358+0000","last_became_active":"2023-10-08T00:33:54.357049+0000","last_became_peered":"2023-10-08T00:33:54.357049+0000","last_unstale":"2023-10-08T00:33:54.357358+0000","last_undegraded":"2023-10-08T00:33:54.357358+0000","last_fullsized":"2023-10-08T00:33:54.357358+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:49:38.808876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.344969+0000","last_change":"2023-10-08T00:33:53.342523+0000","last_active":"2023-10-08T00:33:53.344969+0000","last_peered":"2023-10-08T00:33:53.344969+0000","last_clean":"2023-10-08T00:33:53.344969+0000","last_became_active":"2023-10-08T00:33:53.342267+0000","last_became_peered":"2023-10-08T00:33:53.342267+0000","last_unstale":"2023-10-08T00:33:53.344969+0000","last_undegraded":"2023-10-08T00:33:53.344969+0000","last_fullsized":"2023-10-08T00:33:53.344969+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:39.698880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.368014+0000","last_change":"2023-10-08T00:33:54.368014+0000","last_active":"2023-10-08T00:33:54.368014+0000","last_peered":"2023-10-08T00:33:54.368014+0000","last_clean":"2023-10-08T00:33:54.368014+0000","last_became_active":"2023-10-08T00:33:54.367720+0000","last_became_peered":"2023-10-08T00:33:54.367720+0000","last_unstale":"2023-10-08T00:33:54.368014+0000","last_undegraded":"2023-10-08T00:33:54.368014+0000","last_fullsized":"2023-10-08T00:33:54.368014+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:36:56.828490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357514+0000","last_change":"2023-10-08T00:33:53.348103+0000","last_active":"2023-10-08T00:33:54.357514+0000","last_peered":"2023-10-08T00:33:54.357514+0000","last_clean":"2023-10-08T00:33:54.357514+0000","last_became_active":"2023-10-08T00:33:53.347843+0000","last_became_peered":"2023-10-08T00:33:53.347843+0000","last_unstale":"2023-10-08T00:33:54.357514+0000","last_undegraded":"2023-10-08T00:33:54.357514+0000","last_fullsized":"2023-10-08T00:33:54.357514+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:36:30.949173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.354236+0000","last_change":"2023-10-08T00:33:54.354236+0000","last_active":"2023-10-08T00:33:54.354236+0000","last_peered":"2023-10-08T00:33:54.354236+0000","last_clean":"2023-10-08T00:33:54.354236+0000","last_became_active":"2023-10-08T00:33:54.353951+0000","last_became_peered":"2023-10-08T00:33:54.353951+0000","last_unstale":"2023-10-08T00:33:54.354236+0000","last_undegraded":"2023-10-08T00:33:54.354236+0000","last_fullsized":"2023-10-08T00:33:54.354236+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:24.294444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.340743+0000","last_change":"2023-10-08T00:33:53.348228+0000","last_active":"2023-10-08T00:33:54.340743+0000","last_peered":"2023-10-08T00:33:54.340743+0000","last_clean":"2023-10-08T00:33:54.340743+0000","last_became_active":"2023-10-08T00:33:53.347961+0000","last_became_peered":"2023-10-08T00:33:53.347961+0000","last_unstale":"2023-10-08T00:33:54.340743+0000","last_undegraded":"2023-10-08T00:33:54.340743+0000","last_fullsized":"2023-10-08T00:33:54.340743+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:34:04.220221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357768+0000","last_change":"2023-10-08T00:33:54.351410+0000","last_active":"2023-10-08T00:33:54.357768+0000","last_peered":"2023-10-08T00:33:54.357768+0000","last_clean":"2023-10-08T00:33:54.357768+0000","last_became_active":"2023-10-08T00:33:54.351113+0000","last_became_peered":"2023-10-08T00:33:54.351113+0000","last_unstale":"2023-10-08T00:33:54.357768+0000","last_undegraded":"2023-10-08T00:33:54.357768+0000","last_fullsized":"2023-10-08T00:33:54.357768+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:49:31.750789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.337066+0000","last_change":"2023-10-08T00:33:53.338241+0000","last_active":"2023-10-08T00:33:54.337066+0000","last_peered":"2023-10-08T00:33:54.337066+0000","last_clean":"2023-10-08T00:33:54.337066+0000","last_became_active":"2023-10-08T00:33:53.337978+0000","last_became_peered":"2023-10-08T00:33:53.337978+0000","last_unstale":"2023-10-08T00:33:54.337066+0000","last_undegraded":"2023-10-08T00:33:54.337066+0000","last_fullsized":"2023-10-08T00:33:54.337066+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:23.287195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.348756+0000","last_change":"2023-10-08T00:33:54.342180+0000","last_active":"2023-10-08T00:33:54.348756+0000","last_peered":"2023-10-08T00:33:54.348756+0000","last_clean":"2023-10-08T00:33:54.348756+0000","last_became_active":"2023-10-08T00:33:54.341911+0000","last_became_peered":"2023-10-08T00:33:54.341911+0000","last_unstale":"2023-10-08T00:33:54.348756+0000","last_undegraded":"2023-10-08T00:33:54.348756+0000","last_fullsized":"2023-10-08T00:33:54.348756+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:57:13.259089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.334545+0000","last_change":"2023-10-08T00:33:53.347354+0000","last_active":"2023-10-08T00:33:54.334545+0000","last_peered":"2023-10-08T00:33:54.334545+0000","last_clean":"2023-10-08T00:33:54.334545+0000","last_became_active":"2023-10-08T00:33:53.347030+0000","last_became_peered":"2023-10-08T00:33:53.347030+0000","last_unstale":"2023-10-08T00:33:54.334545+0000","last_undegraded":"2023-10-08T00:33:54.334545+0000","last_fullsized":"2023-10-08T00:33:54.334545+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:51:45.681493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.365564+0000","last_change":"2023-10-08T00:33:54.365564+0000","last_active":"2023-10-08T00:33:54.365564+0000","last_peered":"2023-10-08T00:33:54.365564+0000","last_clean":"2023-10-08T00:33:54.365564+0000","last_became_active":"2023-10-08T00:33:54.365277+0000","last_became_peered":"2023-10-08T00:33:54.365277+0000","last_unstale":"2023-10-08T00:33:54.365564+0000","last_undegraded":"2023-10-08T00:33:54.365564+0000","last_fullsized":"2023-10-08T00:33:54.365564+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:13.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"186'2","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.358356+0000","last_change":"2023-10-08T00:33:53.343594+0000","last_active":"2023-10-08T00:33:54.358356+0000","last_peered":"2023-10-08T00:33:54.358356+0000","last_clean":"2023-10-08T00:33:54.358356+0000","last_became_active":"2023-10-08T00:33:53.342357+0000","last_became_peered":"2023-10-08T00:33:53.342357+0000","last_unstale":"2023-10-08T00:33:54.358356+0000","last_undegraded":"2023-10-08T00:33:54.358356+0000","last_fullsized":"2023-10-08T00:33:54.358356+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:01:09.934776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361367+0000","last_change":"2023-10-08T00:33:54.361367+0000","last_active":"2023-10-08T00:33:54.361367+0000","last_peered":"2023-10-08T00:33:54.361367+0000","last_clean":"2023-10-08T00:33:54.361367+0000","last_became_active":"2023-10-08T00:33:54.361005+0000","last_became_peered":"2023-10-08T00:33:54.361005+0000","last_unstale":"2023-10-08T00:33:54.361367+0000","last_undegraded":"2023-10-08T00:33:54.361367+0000","last_fullsized":"2023-10-08T00:33:54.361367+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:34.476052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350196+0000","last_change":"2023-10-08T00:33:53.349366+0000","last_active":"2023-10-08T00:33:53.350196+0000","last_peered":"2023-10-08T00:33:53.350196+0000","last_clean":"2023-10-08T00:33:53.350196+0000","last_became_active":"2023-10-08T00:33:53.349091+0000","last_became_peered":"2023-10-08T00:33:53.349091+0000","last_unstale":"2023-10-08T00:33:53.350196+0000","last_undegraded":"2023-10-08T00:33:53.350196+0000","last_fullsized":"2023-10-08T00:33:53.350196+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:16:16.703921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.351383+0000","last_change":"2023-10-08T00:33:54.351383+0000","last_active":"2023-10-08T00:33:54.351383+0000","last_peered":"2023-10-08T00:33:54.351383+0000","last_clean":"2023-10-08T00:33:54.351383+0000","last_became_active":"2023-10-08T00:33:54.351130+0000","last_became_peered":"2023-10-08T00:33:54.351130+0000","last_unstale":"2023-10-08T00:33:54.351383+0000","last_undegraded":"2023-10-08T00:33:54.351383+0000","last_fullsized":"2023-10-08T00:33:54.351383+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:27.061900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.335025+0000","last_change":"2023-10-08T00:33:53.350467+0000","last_active":"2023-10-08T00:33:54.335025+0000","last_peered":"2023-10-08T00:33:54.335025+0000","last_clean":"2023-10-08T00:33:54.335025+0000","last_became_active":"2023-10-08T00:33:53.350162+0000","last_became_peered":"2023-10-08T00:33:53.350162+0000","last_unstale":"2023-10-08T00:33:54.335025+0000","last_undegraded":"2023-10-08T00:33:54.335025+0000","last_fullsized":"2023-10-08T00:33:54.335025+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:15.264269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.361530+0000","last_change":"2023-10-08T00:33:54.361530+0000","last_active":"2023-10-08T00:33:54.361530+0000","last_peered":"2023-10-08T00:33:54.361530+0000","last_clean":"2023-10-08T00:33:54.361530+0000","last_became_active":"2023-10-08T00:33:54.361155+0000","last_became_peered":"2023-10-08T00:33:54.361155+0000","last_unstale":"2023-10-08T00:33:54.361530+0000","last_undegraded":"2023-10-08T00:33:54.361530+0000","last_fullsized":"2023-10-08T00:33:54.361530+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:27:04.058827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.335175+0000","last_change":"2023-10-08T00:33:53.348482+0000","last_active":"2023-10-08T00:33:54.335175+0000","last_peered":"2023-10-08T00:33:54.335175+0000","last_clean":"2023-10-08T00:33:54.335175+0000","last_became_active":"2023-10-08T00:33:53.348207+0000","last_became_peered":"2023-10-08T00:33:53.348207+0000","last_unstale":"2023-10-08T00:33:54.335175+0000","last_undegraded":"2023-10-08T00:33:54.335175+0000","last_fullsized":"2023-10-08T00:33:54.335175+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:20.792928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.349714+0000","last_change":"2023-10-08T00:33:54.343611+0000","last_active":"2023-10-08T00:33:54.349714+0000","last_peered":"2023-10-08T00:33:54.349714+0000","last_clean":"2023-10-08T00:33:54.349714+0000","last_became_active":"2023-10-08T00:33:54.343352+0000","last_became_peered":"2023-10-08T00:33:54.343352+0000","last_unstale":"2023-10-08T00:33:54.349714+0000","last_undegraded":"2023-10-08T00:33:54.349714+0000","last_fullsized":"2023-10-08T00:33:54.349714+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:16:01.289518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.341122+0000","last_change":"2023-10-08T00:33:53.348831+0000","last_active":"2023-10-08T00:33:54.341122+0000","last_peered":"2023-10-08T00:33:54.341122+0000","last_clean":"2023-10-08T00:33:54.341122+0000","last_became_active":"2023-10-08T00:33:53.348595+0000","last_became_peered":"2023-10-08T00:33:53.348595+0000","last_unstale":"2023-10-08T00:33:54.341122+0000","last_undegraded":"2023-10-08T00:33:54.341122+0000","last_fullsized":"2023-10-08T00:33:54.341122+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:45.918796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.353210+0000","last_change":"2023-10-08T00:33:54.351627+0000","last_active":"2023-10-08T00:33:54.353210+0000","last_peered":"2023-10-08T00:33:54.353210+0000","last_clean":"2023-10-08T00:33:54.353210+0000","last_became_active":"2023-10-08T00:33:54.351347+0000","last_became_peered":"2023-10-08T00:33:54.351347+0000","last_unstale":"2023-10-08T00:33:54.353210+0000","last_undegraded":"2023-10-08T00:33:54.353210+0000","last_fullsized":"2023-10-08T00:33:54.353210+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:15.392809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.348072+0000","last_change":"2023-10-08T00:33:53.345926+0000","last_active":"2023-10-08T00:33:53.348072+0000","last_peered":"2023-10-08T00:33:53.348072+0000","last_clean":"2023-10-08T00:33:53.348072+0000","last_became_active":"2023-10-08T00:33:53.345649+0000","last_became_peered":"2023-10-08T00:33:53.345649+0000","last_unstale":"2023-10-08T00:33:53.348072+0000","last_undegraded":"2023-10-08T00:33:53.348072+0000","last_fullsized":"2023-10-08T00:33:53.348072+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:56:25.830311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.356083+0000","last_change":"2023-10-08T00:33:54.356083+0000","last_active":"2023-10-08T00:33:54.356083+0000","last_peered":"2023-10-08T00:33:54.356083+0000","last_clean":"2023-10-08T00:33:54.356083+0000","last_became_active":"2023-10-08T00:33:54.355825+0000","last_became_peered":"2023-10-08T00:33:54.355825+0000","last_unstale":"2023-10-08T00:33:54.356083+0000","last_undegraded":"2023-10-08T00:33:54.356083+0000","last_fullsized":"2023-10-08T00:33:54.356083+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:52:13.772189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.350572+0000","last_change":"2023-10-08T00:33:53.348120+0000","last_active":"2023-10-08T00:33:53.350572+0000","last_peered":"2023-10-08T00:33:53.350572+0000","last_clean":"2023-10-08T00:33:53.350572+0000","last_became_active":"2023-10-08T00:33:53.347532+0000","last_became_peered":"2023-10-08T00:33:53.347532+0000","last_unstale":"2023-10-08T00:33:53.350572+0000","last_undegraded":"2023-10-08T00:33:53.350572+0000","last_fullsized":"2023-10-08T00:33:53.350572+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:46:39.349670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.357478+0000","last_change":"2023-10-08T00:33:54.348327+0000","last_active":"2023-10-08T00:33:54.357478+0000","last_peered":"2023-10-08T00:33:54.357478+0000","last_clean":"2023-10-08T00:33:54.357478+0000","last_became_active":"2023-10-08T00:33:54.348004+0000","last_became_peered":"2023-10-08T00:33:54.348004+0000","last_unstale":"2023-10-08T00:33:54.357478+0000","last_undegraded":"2023-10-08T00:33:54.357478+0000","last_fullsized":"2023-10-08T00:33:54.357478+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:56:22.138443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.337416+0000","last_change":"2023-10-08T00:33:53.343038+0000","last_active":"2023-10-08T00:33:54.337416+0000","last_peered":"2023-10-08T00:33:54.337416+0000","last_clean":"2023-10-08T00:33:54.337416+0000","last_became_active":"2023-10-08T00:33:53.342777+0000","last_became_peered":"2023-10-08T00:33:53.342777+0000","last_unstale":"2023-10-08T00:33:54.337416+0000","last_undegraded":"2023-10-08T00:33:54.337416+0000","last_fullsized":"2023-10-08T00:33:54.337416+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:36.613986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.362647+0000","last_change":"2023-10-08T00:33:54.359382+0000","last_active":"2023-10-08T00:33:54.362647+0000","last_peered":"2023-10-08T00:33:54.362647+0000","last_clean":"2023-10-08T00:33:54.362647+0000","last_became_active":"2023-10-08T00:33:54.358949+0000","last_became_peered":"2023-10-08T00:33:54.358949+0000","last_unstale":"2023-10-08T00:33:54.362647+0000","last_undegraded":"2023-10-08T00:33:54.362647+0000","last_fullsized":"2023-10-08T00:33:54.362647+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:53.326004+0000","last_clean_scrub_stamp":"2023-10-08T00:33:53.326004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:12:30.376104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"186'1","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-10-08T00:33:54.340825+0000","last_change":"2023-10-08T00:33:53.345362+0000","last_active":"2023-10-08T00:33:54.340825+0000","last_peered":"2023-10-08T00:33:54.340825+0000","last_clean":"2023-10-08T00:33:54.340825+0000","last_became_active":"2023-10-08T00:33:53.344612+0000","last_became_peered":"2023-10-08T00:33:53.344612+0000","last_unstale":"2023-10-08T00:33:54.340825+0000","last_undegraded":"2023-10-08T00:33:54.340825+0000","last_fullsized":"2023-10-08T00:33:54.340825+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:33:52.318755+0000","last_clean_scrub_stamp":"2023-10-08T00:33:52.318755+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:39:12.196401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":302,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-08T00:33:53.338407+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:33:53.338407+0000","last_peered":"2023-10-08T00:33:53.338407+0000","last_clean":"2023-10-08T00:33:53.338407+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:33:53.338407+0000","last_undegraded":"2023-10-08T00:33:53.338407+0000","last_fullsized":"2023-10-08T00:33:53.338407+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304280,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067560,"statfs":{"total":96636764160,"available":96325181440,"internally_reserved":0,"allocated":2965504,"data_stored":1654884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.34699999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72199999999999998,"5min":0.79200000000000004,"15min":0.89700000000000002},"last":0.66200000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.746,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.39400000000000002,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.66400000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.373,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80300000000000005,"5min":0.875,"15min":0.875},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.754,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.623}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.499,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.66700000000000004,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.79000000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":1.048},"last":0.58199999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.61899999999999999},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85499999999999998,"5min":0.89200000000000002,"15min":1.0920000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.48499999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303700,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068140,"statfs":{"total":96636764160,"available":96325775360,"internally_reserved":0,"allocated":2371584,"data_stored":1064504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48099999999999998,"15min":0.50600000000000001},"min":{"1min":0.374,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.80000000000000004,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51600000000000001,"15min":0.55300000000000005},"min":{"1min":0.38100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":0.97299999999999998,"15min":1.145},"last":0.373},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.53100000000000003},"min":{"1min":0.38900000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.65400000000000003,"5min":0.70299999999999996,"15min":0.873},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53800000000000003,"15min":0.56599999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.83199999999999996,"5min":0.90400000000000003,"15min":1.079},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.58999999999999997},"min":{"1min":0.45700000000000002,"5min":0.39400000000000002,"15min":0.38},"max":{"1min":0.76000000000000001,"5min":1.496,"15min":1.496},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.59799999999999998},"min":{"1min":0.48599999999999999,"5min":0.40699999999999997,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.02,"15min":1.1160000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70699999999999996,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.62,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.33800000000000002},"max":{"1min":0.79200000000000004,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.55400000000000005},"min":{"1min":0.34000000000000002,"5min":0.316,"15min":0.29399999999999998},"max":{"1min":0.79900000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.628}]},{"osd":7,"last update":"Sun Oct 8 00:33:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56399999999999995,"15min":0.58899999999999997},"min":{"1min":0.33100000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.76300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59799999999999998,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.59899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1064392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.23899999999999999,"5min":0.23599999999999999,"15min":0.218},"max":{"1min":0.59799999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59599999999999997,"5min":0.59699999999999998,"15min":0.65500000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.26100000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.59499999999999997},"last":0.27800000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.433,"15min":0.42299999999999999},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39900000000000002,"15min":0.39800000000000002},"min":{"1min":0.254,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.496,"5min":0.56499999999999995,"15min":0.84699999999999998},"last":0.26400000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.218,"15min":1.218},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.42699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.0569999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60599999999999998,"15min":0.61299999999999999},"min":{"1min":0.36399999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":1.294},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65500000000000003,"15min":0.65400000000000003},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.90900000000000003,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.59899999999999998},"min":{"1min":0.433,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":1.038},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.89500000000000002,"5min":1.278,"15min":1.278},"last":0.48599999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.60199999999999998},"min":{"1min":0.38400000000000001,"5min":0.36099999999999999,"15min":0.35799999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.879},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":1.087},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308380,"kb_used_data":2900,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063460,"statfs":{"total":96636764160,"available":96320983040,"internally_reserved":0,"allocated":2969600,"data_stored":1656296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48599999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.378,"15min":0.378},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.39100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.32900000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.37,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.45700000000000002,"5min":0.749,"15min":0.749},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.255},"max":{"1min":0.53400000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.495},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.242},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.627,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.52900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92900000000000005},"last":0.438}]},{"osd":7,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.84499999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.44700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303700,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068140,"statfs":{"total":96636764160,"available":96325775360,"internally_reserved":0,"allocated":2371584,"data_stored":1065016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23000000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35099999999999998,"15min":0.36899999999999999},"min":{"1min":0.28000000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.314},{"interface":"front","average":{"1min":0.375,"5min":0.36399999999999999,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56699999999999995,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35199999999999998,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.53400000000000003,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.254},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40100000000000002,"15min":0.42499999999999999},"min":{"1min":0.34899999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56399999999999995,"15min":0.58299999999999996},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58699999999999997,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84499999999999997,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.41899999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.623,"15min":0.66300000000000003},"min":{"1min":0.48499999999999999,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.80100000000000005,"5min":0.91900000000000004,"15min":1.278},"last":0.749}]},{"osd":6,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59699999999999998,"15min":0.64300000000000002},"min":{"1min":0.498,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84699999999999998,"5min":0.87,"15min":1.137},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59499999999999997,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82599999999999996,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.78000000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:01 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60699999999999998,"15min":0.64500000000000002},"min":{"1min":0.47299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91100000000000003,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.65200000000000002},"min":{"1min":0.49299999999999999,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.85999999999999999,"5min":0.94299999999999995,"15min":1.343},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303728,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068112,"statfs":{"total":96636764160,"available":96325746688,"internally_reserved":0,"allocated":2400256,"data_stored":1072826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.28699999999999998,"5min":0.22700000000000001,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.434},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.30099999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32600000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.36299999999999999,"15min":0.372},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.30099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.41099999999999998,"15min":0.40999999999999998},"min":{"1min":0.32400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.437,"15min":0.44400000000000001},"min":{"1min":0.37,"5min":0.32700000000000001,"15min":0.307},"max":{"1min":0.64700000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47899999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85299999999999998,"5min":1.47,"15min":1.47},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.873,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79800000000000004,"5min":1.385,"15min":1.385},"last":0.59699999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90400000000000003,"5min":0.996,"15min":0.996},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81399999999999995,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.45400000000000001,"5min":0.44,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":1.006,"15min":1.006},"last":0.57999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303708,"kb_used_data":2324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068132,"statfs":{"total":96636764160,"available":96325767168,"internally_reserved":0,"allocated":2379776,"data_stored":1070750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.39200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.36299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.437}]},{"osd":1,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.39700000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55900000000000005,"15min":0.60099999999999998},"min":{"1min":0.39700000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":1.21,"15min":1.21},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.65800000000000003,"15min":0.60099999999999998},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.88900000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.873},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.495,"15min":0.5},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28100000000000003},"max":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.83099999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.80100000000000005,"5min":0.85199999999999998,"15min":1.002},"last":0.47399999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54200000000000004,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54900000000000004,"15min":0.57199999999999995},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78700000000000003,"5min":0.82399999999999995,"15min":0.84199999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.58899999999999997},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.80200000000000005,"5min":0.873,"15min":0.88100000000000001},"last":0.37},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.61799999999999999},"min":{"1min":0.42699999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.48399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1064392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.499},"min":{"1min":0.36899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67100000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.47599999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.77900000000000003,"5min":0.78800000000000003,"15min":2.4169999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.52300000000000002,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.746,"15min":0.75700000000000001},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.35699999999999998,"5min":0.308,"15min":0.308},"max":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.40699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72399999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.75700000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.32900000000000001},"max":{"1min":0.628,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.65000000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":2.4870000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49199999999999999,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73899999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.501,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65800000000000003,"5min":0.76000000000000001,"15min":0.80100000000000005},"last":0.622}]},{"osd":6,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.75,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54700000000000004,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.58199999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.747,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.60699999999999998},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:33:58.845 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:33:58.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:33:59.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.003+0000 7fab32b02700 1 Processor -- start 2023-10-08T00:33:59.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.003+0000 7fab32b02700 1 -- start start 2023-10-08T00:33:59.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab32b02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cce20 0x7fab2c0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab32b02700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab2c15df40 0x7fab2c15e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab32b02700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c157c50 con 0x7fab2c0cca50 2023-10-08T00:33:59.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab32b02700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c15d7d0 con 0x7fab2c15df40 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab32b02700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c15aa20 con 0x7fab2c0cce20 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3109f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fab2c15df40 0x7fab2c15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3089e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fab2c0cca50 0x7fab2c15a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41942/0 (socket says 172.21.15.22:41942) 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3089e700 1 -- 172.21.15.22:0/2797913918 learned_addr learned my addr 172.21.15.22:0/2797913918 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3109f700 1 -- 172.21.15.22:0/2797913918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cce20 msgr2=0x7fab2c0caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3109f700 1 --2- 172.21.15.22:0/2797913918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cce20 0x7fab2c0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3109f700 1 -- 172.21.15.22:0/2797913918 >> v1:172.21.15.22:6789/0 conn(0x7fab2c0cca50 legacy=0x7fab2c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab2b7fe700 1 -- 172.21.15.22:0/2797913918 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209147183 0 0) 0x7fab1c001110 con 0x7fab2c0cca50 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3109f700 1 -- 172.21.15.22:0/2797913918 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c15ad00 con 0x7fab2c15df40 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab3109f700 1 --2- 172.21.15.22:0/2797913918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c15df40 0x7fab2c15e380 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fab24009e60 tx=0x7fab24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bcdd92e1fc9c45 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.004+0000 7fab2b7fe700 1 -- 172.21.15.22:0/2797913918 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2400e070 con 0x7fab2c15df40 2023-10-08T00:33:59.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab2b7fe700 1 -- 172.21.15.22:0/2797913918 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2400bc30 con 0x7fab2c15df40 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab2b7fe700 1 -- 172.21.15.22:0/2797913918 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24012430 con 0x7fab2c15df40 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 -- 172.21.15.22:0/2797913918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c15df40 msgr2=0x7fab2c15e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 --2- 172.21.15.22:0/2797913918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c15df40 0x7fab2c15e380 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fab24009e60 tx=0x7fab24009780 comp rx=0 tx=0).stop 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 -- 172.21.15.22:0/2797913918 shutdown_connections 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 --2- 172.21.15.22:0/2797913918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c15df40 0x7fab2c15e380 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 --2- 172.21.15.22:0/2797913918 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cce20 0x7fab2c0caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 -- 172.21.15.22:0/2797913918 >> 172.21.15.22:0/2797913918 conn(0x7fab2c0ce5c0 msgr2=0x7fab2c0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 -- 172.21.15.22:0/2797913918 shutdown_connections 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.005+0000 7fab32b02700 1 -- 172.21.15.22:0/2797913918 wait complete. 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.006+0000 7fab32b02700 1 Processor -- start 2023-10-08T00:33:59.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.006+0000 7fab32b02700 1 -- start start 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab32b02700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cca50 0x7fab2c16aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab32b02700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 0x7fab2c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab32b02700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab2c15df40 0x7fab2c0b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab32b02700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c16b420 con 0x7fab2c0cce20 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab32b02700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0b2350 con 0x7fab2c15df40 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab32b02700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0b1740 con 0x7fab2c0cca50 2023-10-08T00:33:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab2bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 0x7fab2c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab2bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 0x7fab2c0b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47438/0 (socket says 172.21.15.22:47438) 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab2bfff700 1 -- 172.21.15.22:0/419018138 learned_addr learned my addr 172.21.15.22:0/419018138 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab3089e700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cca50 0x7fab2c16aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.007+0000 7fab3109f700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab2c15df40 0x7fab2c0b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab2bfff700 1 -- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cca50 msgr2=0x7fab2c16aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab2bfff700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cca50 0x7fab2c16aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab2bfff700 1 -- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab2c15df40 msgr2=0x7fab2c0b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab2bfff700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab2c15df40 0x7fab2c0b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab2bfff700 1 -- 172.21.15.22:0/419018138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24009a20 con 0x7fab2c0cce20 2023-10-08T00:33:59.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab2bfff700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 0x7fab2c0b2b90 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b810 tx=0x7fab20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000f5f0 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000f770 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c0b1a20 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000fb30 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.008+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c0b1fe0 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.009+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c0b2170 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.009+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fab20010480 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.010+0000 7fab28ff9700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab18067320 0x7fab180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.010+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab20084bb0 con 0x7fab2c0cce20 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.010+0000 7fab3089e700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab18067320 0x7fab180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.011+0000 7fab3089e700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab18067320 0x7fab180697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fab2c15c4a0 tx=0x7fab1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:59.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.014+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab200518c0 con 0x7fab2c0cce20 2023-10-08T00:33:59.287 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.286+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fab2c0718b0 con 0x7fab2c0cce20 2023-10-08T00:33:59.291 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.290+0000 7fab28ff9700 1 -- 172.21.15.22:0/419018138 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fab20054ee0 con 0x7fab2c0cce20 2023-10-08T00:33:59.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab18067320 msgr2=0x7fab180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.293 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab18067320 0x7fab180697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fab2c15c4a0 tx=0x7fab1c009040 comp rx=0 tx=0).stop 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 msgr2=0x7fab2c0b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 0x7fab2c0b2b90 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fab2000b810 tx=0x7fab20009250 comp rx=0 tx=0).stop 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 shutdown_connections 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab2c15df40 0x7fab2c0b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fab18067320 0x7fab180697d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fab2c0cca50 0x7fab2c16aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 --2- 172.21.15.22:0/419018138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab2c0cce20 0x7fab2c0b2b90 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 >> 172.21.15.22:0/419018138 conn(0x7fab2c0ce5c0 msgr2=0x7fab2c0cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 shutdown_connections 2023-10-08T00:33:59.294 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.292+0000 7fab32b02700 1 -- 172.21.15.22:0/419018138 wait complete. 2023-10-08T00:33:59.295 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:33:59.305 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:33:59.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.423+0000 7f8fc8a0b700 1 Processor -- start 2023-10-08T00:33:59.425 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.423+0000 7f8fc8a0b700 1 -- start start 2023-10-08T00:33:59.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.424+0000 7f8fc8a0b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fc40caa90 0x7f8fc40c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.424+0000 7f8fc8a0b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc415d7e0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.424+0000 7f8fc8a0b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc415dac0 con 0x7f8fc406c0a0 2023-10-08T00:33:59.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.424+0000 7f8fc8a0b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40caef0 con 0x7f8fc40caa90 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc2d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fc40caa90 0x7f8fc40c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc259c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8fc406bcd0 0x7f8fc415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41956/0 (socket says 172.21.15.22:41956) 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc259c700 1 -- 172.21.15.22:0/2256667609 learned_addr learned my addr 172.21.15.22:0/2256667609 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc2d9d700 1 -- 172.21.15.22:0/2256667609 >> v1:172.21.15.192:6789/0 conn(0x7f8fc406c0a0 legacy=0x7f8fc415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc2d9d700 1 -- 172.21.15.22:0/2256667609 >> v1:172.21.15.22:6789/0 conn(0x7f8fc406bcd0 legacy=0x7f8fc415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc2d9d700 1 -- 172.21.15.22:0/2256667609 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc415aa30 con 0x7f8fc40caa90 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc159a700 1 -- 172.21.15.22:0/2256667609 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440246991 0 0) 0x7f8fc415d7e0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc2d9d700 1 --2- 172.21.15.22:0/2256667609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc40caa90 0x7f8fc40c8c40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40098e0 tx=0x7f8fb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cc8374c865a88b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc159a700 1 -- 172.21.15.22:0/2256667609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009e80 con 0x7f8fc40caa90 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc159a700 1 -- 172.21.15.22:0/2256667609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400b820 con 0x7f8fc40caa90 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.425+0000 7f8fc159a700 1 -- 172.21.15.22:0/2256667609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400bba0 con 0x7f8fc40caa90 2023-10-08T00:33:59.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/2256667609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc40caa90 msgr2=0x7f8fc40c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/2256667609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc40caa90 0x7f8fc40c8c40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40098e0 tx=0x7f8fb40091a0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/2256667609 shutdown_connections 2023-10-08T00:33:59.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/2256667609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc40caa90 0x7f8fc40c8c40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/2256667609 >> 172.21.15.22:0/2256667609 conn(0x7f8fc40ce600 msgr2=0x7f8fc40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:59.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/2256667609 shutdown_connections 2023-10-08T00:33:59.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.426+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/2256667609 wait complete. 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.427+0000 7f8fc8a0b700 1 Processor -- start 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.427+0000 7f8fc8a0b700 1 -- start start 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.427+0000 7f8fc8a0b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 0x7f8fc40c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.427+0000 7f8fc8a0b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc406c0a0 0x7f8fc415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc8a0b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fc40caa90 0x7f8fc416a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc8a0b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c6ab0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc8a0b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c65d0 con 0x7f8fc406c0a0 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc8a0b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc4169e40 con 0x7f8fc40caa90 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 0x7f8fc40c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 0x7f8fc40c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47458/0 (socket says 172.21.15.22:47458) 2023-10-08T00:33:59.432 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 -- 172.21.15.22:0/3165136907 learned_addr learned my addr 172.21.15.22:0/3165136907 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 -- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fc40caa90 msgr2=0x7f8fc416a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc2d9d700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fc40caa90 0x7f8fc416a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc1d9b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc406c0a0 0x7f8fc415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fc40caa90 0x7f8fc416a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 -- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc406c0a0 msgr2=0x7f8fc415b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc406c0a0 0x7f8fc415b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 -- 172.21.15.22:0/3165136907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009420 con 0x7f8fc406bcd0 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc1d9b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc406c0a0 0x7f8fc415b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc259c700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 0x7f8fc40c6090 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00cca0 tx=0x7f8fbc001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc00ab30 con 0x7f8fc406bcd0 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc00ac90 con 0x7f8fc406bcd0 2023-10-08T00:33:59.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc416d8e0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc007300 con 0x7f8fc406bcd0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.428+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc416e120 con 0x7f8fc406bcd0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.429+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc40cf7b0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.430+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8fbc0076f0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.430+0000 7f8fba7fc700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8fa4067320 0x7f8fa40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.430+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8fbc0851a0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.430+0000 7f8fc1d9b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8fa4067320 0x7f8fa40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:33:59.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.431+0000 7f8fc1d9b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8fa4067320 0x7f8fa40697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8fac006fd0 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:33:59.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.434+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fbc051e70 con 0x7f8fc406bcd0 2023-10-08T00:33:59.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.672+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fc404c3f0 con 0x7f8fc406bcd0 2023-10-08T00:33:59.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.673+0000 7f8fba7fc700 1 -- 172.21.15.22:0/3165136907 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f8fbc055490 con 0x7f8fc406bcd0 2023-10-08T00:33:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:33:59.675 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":125,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:33:57.358923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:33:59.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8fa4067320 msgr2=0x7f8fa40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8fa4067320 0x7f8fa40697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8fac006fd0 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 msgr2=0x7f8fc40c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 0x7f8fc40c6090 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00cca0 tx=0x7f8fbc001a30 comp rx=0 tx=0).stop 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 shutdown_connections 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8fa4067320 0x7f8fa40697d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8fc40caa90 0x7f8fc416a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fc406bcd0 0x7f8fc40c6090 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 --2- 172.21.15.22:0/3165136907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc406c0a0 0x7f8fc415b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 >> 172.21.15.22:0/3165136907 conn(0x7f8fc40ce600 msgr2=0x7f8fc4159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 shutdown_connections 2023-10-08T00:33:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:33:59.675+0000 7f8fc8a0b700 1 -- 172.21.15.22:0/3165136907 wait complete. 2023-10-08T00:33:59.678 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 125 2023-10-08T00:34:00.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 125, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:33:53.755231+0000', 'modified': '2023-10-08T00:33:57.358923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8721}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8721': {'gid': 8721, 'name': 'a', 'rank': 0, 'incarnation': 122, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.22:6835/663301846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6833', 'nonce': 663301846}, {'type': 'v1', 'addr': '172.21.15.22:6835', 'nonce': 663301846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:34:00.091 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:34:00.091 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T00:34:00.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.216+0000 7fdb6c0ec700 1 Processor -- start 2023-10-08T00:34:00.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.216+0000 7fdb6c0ec700 1 -- start start 2023-10-08T00:34:00.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb6c0ec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 0x7fdb6415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb6c0ec700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdb64159c60 0x7fdb6415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb6c0ec700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6415a160 con 0x7fdb6415db10 2023-10-08T00:34:00.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb6c0ec700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb640d13a0 con 0x7fdb64159c60 2023-10-08T00:34:00.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb6c0ec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6415e140 con 0x7fdb64159890 2023-10-08T00:34:00.220 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 0x7fdb6415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69687700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdb64159c60 0x7fdb6415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 0x7fdb6415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:39360/0 (socket says 172.21.15.22:39360) 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 -- 172.21.15.22:0/3996722482 learned_addr learned my addr 172.21.15.22:0/3996722482 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb6a689700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdb6415db10 0x7fdb64069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:57620/0 (socket says 172.21.15.22:57620) 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb68e86700 1 -- 172.21.15.22:0/3996722482 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926463895 0 0) 0x7fdb6415a160 con 0x7fdb6415db10 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb68e86700 1 -- 172.21.15.22:0/3996722482 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb50003570 con 0x7fdb6415db10 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 -- 172.21.15.22:0/3996722482 >> v2:172.21.15.192:3300/0 conn(0x7fdb64159c60 msgr2=0x7fdb6415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3996722482 >> v2:172.21.15.192:3300/0 conn(0x7fdb64159c60 0x7fdb6415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 -- 172.21.15.22:0/3996722482 >> v1:172.21.15.192:6789/0 conn(0x7fdb6415db10 legacy=0x7fdb64069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69e88700 1 -- 172.21.15.22:0/3996722482 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6415a3d0 con 0x7fdb64159890 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.217+0000 7fdb69687700 1 --2- 172.21.15.22:0/3996722482 >> v2:172.21.15.192:3300/0 conn(0x7fdb64159c60 0x7fdb6415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:00.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3996722482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 0x7fdb6415abd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb600099b0 tx=0x7fdb60009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d66c5ab36dc564c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb68e86700 1 -- 172.21.15.22:0/3996722482 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000b680 con 0x7fdb64159890 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb68e86700 1 -- 172.21.15.22:0/3996722482 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000b7e0 con 0x7fdb64159890 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb68e86700 1 -- 172.21.15.22:0/3996722482 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000bb60 con 0x7fdb64159890 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3996722482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 msgr2=0x7fdb6415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3996722482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 0x7fdb6415abd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdb600099b0 tx=0x7fdb60009250 comp rx=0 tx=0).stop 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3996722482 shutdown_connections 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3996722482 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb64159890 0x7fdb6415abd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3996722482 >> v2:172.21.15.192:3300/0 conn(0x7fdb64159c60 0x7fdb6415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3996722482 >> 172.21.15.22:0/3996722482 conn(0x7fdb64068e20 msgr2=0x7fdb640d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3996722482 shutdown_connections 2023-10-08T00:34:00.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.218+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3996722482 wait complete. 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.219+0000 7fdb6c0ec700 1 Processor -- start 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 -- start start 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 0x7fdb641415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb64159c60 0x7fdb640b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6415db10 0x7fdb640cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64141b20 con 0x7fdb64159890 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640c9800 con 0x7fdb64159c60 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6c0ec700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64152520 con 0x7fdb6415db10 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb69e88700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 0x7fdb641415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb69e88700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 0x7fdb641415e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47460/0 (socket says 172.21.15.22:47460) 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb69e88700 1 -- 172.21.15.22:0/3534882066 learned_addr learned my addr 172.21.15.22:0/3534882066 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb69687700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb64159c60 0x7fdb640b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.220+0000 7fdb6a689700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6415db10 0x7fdb640cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb69e88700 1 -- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6415db10 msgr2=0x7fdb640cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6415db10 0x7fdb640cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb69e88700 1 -- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb64159c60 msgr2=0x7fdb640b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb64159c60 0x7fdb640b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb69e88700 1 -- 172.21.15.22:0/3534882066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb54009420 con 0x7fdb64159890 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 0x7fdb641415e0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009290 tx=0x7fdb60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb59ffb700 1 -- 172.21.15.22:0/3534882066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000b950 con 0x7fdb64159890 2023-10-08T00:34:00.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb59ffb700 1 -- 172.21.15.22:0/3534882066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000bad0 con 0x7fdb64159890 2023-10-08T00:34:00.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600094f0 con 0x7fdb64159890 2023-10-08T00:34:00.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb59ffb700 1 -- 172.21.15.22:0/3534882066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6001a680 con 0x7fdb64159890 2023-10-08T00:34:00.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.221+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640cdf40 con 0x7fdb64159890 2023-10-08T00:34:00.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.223+0000 7fdb59ffb700 1 -- 172.21.15.22:0/3534882066 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdb6001aa30 con 0x7fdb64159890 2023-10-08T00:34:00.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.223+0000 7fdb59ffb700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb48067320 0x7fdb480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.223+0000 7fdb59ffb700 1 -- 172.21.15.22:0/3534882066 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb60086820 con 0x7fdb64159890 2023-10-08T00:34:00.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.224+0000 7fdb69687700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb48067320 0x7fdb480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.224+0000 7fdb69687700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb48067320 0x7fdb480697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdb640b1830 tx=0x7fdb540091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.225+0000 7fdb753e4b80 1 Processor -- start 2023-10-08T00:34:00.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.225+0000 7fdb753e4b80 1 -- start start 2023-10-08T00:34:00.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af274f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af27521a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af274f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2744fa70 con 0x55af27542d00 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2744d270 con 0x55af274f8a50 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af27449060 con 0x55af27521f60 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af27521a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af27521a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47466/0 (socket says 172.21.15.22:47466) 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 -- 172.21.15.22:0/2980766387 learned_addr learned my addr 172.21.15.22:0/2980766387 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb6a689700 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af274f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 -- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 msgr2=0x55af274f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af274f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69e88700 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af274f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 -- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 msgr2=0x55af274f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af274f8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 -- 172.21.15.22:0/2980766387 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af272e3270 con 0x55af27542d00 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb69687700 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af27521a20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fdb54011fe0 tx=0x7fdb54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0c220f90f3dd4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.226+0000 7fdb4effd700 1 -- 172.21.15.22:0/2980766387 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54021420 con 0x55af27542d00 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb4effd700 1 -- 172.21.15.22:0/2980766387 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54021580 con 0x55af27542d00 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb4effd700 1 -- 172.21.15.22:0/2980766387 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54021900 con 0x55af27542d00 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 -- 172.21.15.22:0/2980766387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 msgr2=0x55af27521a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af27521a20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fdb54011fe0 tx=0x7fdb54016000 comp rx=0 tx=0).stop 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 -- 172.21.15.22:0/2980766387 shutdown_connections 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af274f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af274f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/2980766387 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af27521a20 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 -- 172.21.15.22:0/2980766387 >> 172.21.15.22:0/2980766387 conn(0x55af274fa370 msgr2=0x55af274fa740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 -- 172.21.15.22:0/2980766387 shutdown_connections 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.227+0000 7fdb753e4b80 1 -- 172.21.15.22:0/2980766387 wait complete. 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.228+0000 7fdb753e4b80 1 -- start start 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.228+0000 7fdb753e4b80 1 Processor -- start 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af27541990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2753fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af2753ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af273f4890 con 0x55af27542d00 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2740fea0 con 0x55af274f8a50 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af272cbe30 con 0x55af27521f60 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 10 client.0 _ll_register_callbacks cb 0x55af274bc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af2753ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af2753ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47472/0 (socket says 172.21.15.22:47472) 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 -- 172.21.15.22:0/316914790 learned_addr learned my addr 172.21.15.22:0/316914790 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 -- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 msgr2=0x55af2753fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2753fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 -- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 msgr2=0x55af27541990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb69e88700 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af27541990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af27541990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 -- 172.21.15.22:0/316914790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb54011c30 con 0x55af27542d00 2023-10-08T00:34:00.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb6a689700 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af2753ff40 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c001460 tx=0x7fdb5c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b620c901ec58e896 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb43fff700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:34:00.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb43fff700 1 -- 172.21.15.22:0/316914790 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c019030 con 0x55af27542d00 2023-10-08T00:34:00.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb43fff700 1 -- 172.21.15.22:0/316914790 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb5c01a070 con 0x55af27542d00 2023-10-08T00:34:00.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.229+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af274edb70 con 0x55af27542d00 2023-10-08T00:34:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb43fff700 1 -- 172.21.15.22:0/316914790 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb5c004dc0 con 0x55af27542d00 2023-10-08T00:34:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 10 client.8871 fetch_fsmap learned FSMap version 125 2023-10-08T00:34:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) v3 -- 0x55af27285fe0 con 0x55af27542d00 2023-10-08T00:34:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb43fff700 1 -- 172.21.15.22:0/316914790 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c024020 con 0x55af27542d00 2023-10-08T00:34:00.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb43fff700 1 -- 172.21.15.22:0/316914790 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 125) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb5c0179a0 con 0x55af27542d00 2023-10-08T00:34:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 10 client.8871 fetch_fsmap finished waiting for FSMap version 125 2023-10-08T00:34:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 10 client.8871 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:34:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 20 client.8871 populate_metadata read hostname 'smithi022' 2023-10-08T00:34:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753cc70 0x55af2753d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 4 client.8871 mds_command: new command op to 8721 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:34:00.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 --> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af274caaa0 con 0x55af2753cc70 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb69e88700 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753cc70 0x55af2753d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb69e88700 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753cc70 0x55af2753d040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b897d0038b56b60c server_cookie=a7b016bd148c02d4 in_seq=0 out_seq=0 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.230+0000 7fdb43fff700 10 client.8871 ms_handle_connect on v2:172.21.15.22:6833/663301846 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb43fff700 1 -- 172.21.15.22:0/316914790 <== mds.0 v2:172.21.15.22:6833/663301846 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55af274caaa0 con 0x55af2753cc70 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb43fff700 10 client.8871 handle_command_reply: tid=0 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 client.8871 shutdown 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 msgr2=0x55af2753ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af2753ff40 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c001460 tx=0x7fdb5c009040 comp rx=0 tx=0).stop 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 shutdown_connections 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753cc70 0x55af2753d040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27542d00 0x55af2753ff40 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.243 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af274f8a50 0x55af27541990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb43fff700 0 client.8871 ms_handle_reset on v2:172.21.15.22:6833/663301846 2023-10-08T00:34:00.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/316914790 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2753fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 >> 172.21.15.22:0/316914790 conn(0x55af274fa370 msgr2=0x55af274f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 shutdown_connections 2023-10-08T00:34:00.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 1 -- 172.21.15.22:0/316914790 wait complete. 2023-10-08T00:34:00.244 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.231+0000 7fdb753e4b80 20 client.8871 trim_cache size 0 max 16384 2023-10-08T00:34:00.249 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.248+0000 7fdb753e4b80 1 Processor -- start 2023-10-08T00:34:00.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.248+0000 7fdb753e4b80 1 -- start start 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af274f8a50 0x55af2753e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 0x55af275584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27558a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af27528400 con 0x55af27521f60 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af274f9d70 con 0x55af27542d00 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af274fbca0 con 0x55af274f8a50 2023-10-08T00:34:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 0x55af275584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 0x55af275584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47488/0 (socket says 172.21.15.22:47488) 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 -- 172.21.15.22:0/3220198051 learned_addr learned my addr 172.21.15.22:0/3220198051 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af274f8a50 0x55af2753e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 -- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af274f8a50 msgr2=0x55af2753e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af274f8a50 0x55af2753e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 -- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 msgr2=0x55af27558a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27558a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 -- 172.21.15.22:0/3220198051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af27417780 con 0x55af27521f60 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.249+0000 7fdb69687700 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 0x55af275584f0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fdb540030a0 tx=0x7fdb54022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2933b19d5cfd5d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb4f7fe700 1 -- 172.21.15.22:0/3220198051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54021cb0 con 0x55af27521f60 2023-10-08T00:34:00.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb4f7fe700 1 -- 172.21.15.22:0/3220198051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54021e30 con 0x55af27521f60 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb4f7fe700 1 -- 172.21.15.22:0/3220198051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54021940 con 0x55af27521f60 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3220198051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 msgr2=0x55af275584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 0x55af275584f0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fdb540030a0 tx=0x7fdb54022000 comp rx=0 tx=0).stop 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3220198051 shutdown_connections 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27558a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af274f8a50 0x55af2753e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3220198051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af27521f60 0x55af275584f0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3220198051 >> 172.21.15.22:0/3220198051 conn(0x55af274fa370 msgr2=0x55af274f4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3220198051 shutdown_connections 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.250+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3220198051 wait complete. 2023-10-08T00:34:00.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.251+0000 7fdb753e4b80 1 -- start start 2023-10-08T00:34:00.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.251+0000 7fdb753e4b80 1 Processor -- start 2023-10-08T00:34:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 0x55af2759fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.258 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2751dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27520f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af27560880 con 0x55af274f8a50 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2753a360 con 0x55af27542d00 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af2753a890 con 0x55af27521f60 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 10 client.0 _ll_register_callbacks cb 0x55af274bc110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 0x55af2759fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 0x55af2759fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47492/0 (socket says 172.21.15.22:47492) 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 -- 172.21.15.22:0/3844874426 learned_addr learned my addr 172.21.15.22:0/3844874426 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69687700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2751dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb6a689700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27520f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 -- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 msgr2=0x55af2751dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2751dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 -- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 msgr2=0x55af27520f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27520f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 -- 172.21.15.22:0/3844874426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af272e3270 con 0x55af274f8a50 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69687700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2751dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb6a689700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27520f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb69e88700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 0x55af2759fbd0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fdb60053630 tx=0x7fdb60031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c15c595e29e70b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb43fff700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb43fff700 1 -- 172.21.15.22:0/3844874426 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6005a380 con 0x55af274f8a50 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb43fff700 1 -- 172.21.15.22:0/3844874426 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb60071030 con 0x55af274f8a50 2023-10-08T00:34:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb54021580 con 0x55af274f8a50 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb43fff700 1 -- 172.21.15.22:0/3844874426 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=125) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb6005e0d0 con 0x55af274f8a50 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.252+0000 7fdb753e4b80 10 client.8877 fetch_fsmap learned FSMap version 125 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=125,monmap=2+}) v3 -- 0x55af273fe470 con 0x55af274f8a50 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb43fff700 1 -- 172.21.15.22:0/3844874426 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54021580 con 0x55af274f8a50 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb43fff700 1 -- 172.21.15.22:0/3844874426 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 125) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb60056620 con 0x55af274f8a50 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 10 client.8877 fetch_fsmap finished waiting for FSMap version 125 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 10 client.8877 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 20 client.8877 populate_metadata read hostname 'smithi022' 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753f310 0x55af2753f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 4 client.8877 mds_command: new command op to 8721 tid=0[{"prefix": "status"}] 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 --> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55af273ebe00 con 0x55af2753f310 2023-10-08T00:34:00.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb69687700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753f310 0x55af2753f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb43fff700 10 client.8877 ms_handle_connect on v2:172.21.15.22:6833/663301846 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb69687700 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753f310 0x55af2753f6e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773246012e5ed0b server_cookie=d638a6d569c2e671 in_seq=0 out_seq=0 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb43fff700 1 -- 172.21.15.22:0/3844874426 <== mds.0 v2:172.21.15.22:6833/663301846 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55af273ebe00 con 0x55af2753f310 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb43fff700 10 client.8877 handle_command_reply: tid=0 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.253+0000 7fdb753e4b80 1 client.8877 shutdown 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 msgr2=0x55af2759fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 0x55af2759fbd0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fdb60053630 tx=0x7fdb60031040 comp rx=0 tx=0).stop 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 shutdown_connections 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:6833/663301846,v1:172.21.15.22:6835/663301846] conn(0x55af2753f310 0x55af2753f6e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af27542d00 0x55af27520f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb43fff700 0 client.8877 ms_handle_reset on v2:172.21.15.22:6833/663301846 2023-10-08T00:34:00.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55af274f8a50 0x55af2759fbd0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 --2- 172.21.15.22:0/3844874426 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55af27521f60 0x55af2751dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 >> 172.21.15.22:0/3844874426 conn(0x55af274fa370 msgr2=0x55af2753e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 shutdown_connections 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 1 -- 172.21.15.22:0/3844874426 wait complete. 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb753e4b80 20 client.8877 trim_cache size 0 max 16384 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:34:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 8721, 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 5.9227688179999998, 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 125, 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 187, 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 187, 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 10.986501414999999 2023-10-08T00:34:00.264 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:34:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb48067320 msgr2=0x7fdb480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb48067320 0x7fdb480697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fdb640b1830 tx=0x7fdb540091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 msgr2=0x7fdb641415e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 0x7fdb641415e0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009290 tx=0x7fdb60017000 comp rx=0 tx=0).stop 2023-10-08T00:34:00.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 shutdown_connections 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fdb48067320 0x7fdb480697d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fdb6415db10 0x7fdb640cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb64159890 0x7fdb641415e0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 --2- 172.21.15.22:0/3534882066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb64159c60 0x7fdb640b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 >> 172.21.15.22:0/3534882066 conn(0x7fdb64068e20 msgr2=0x7fdb640c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 shutdown_connections 2023-10-08T00:34:00.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.254+0000 7fdb6c0ec700 1 -- 172.21.15.22:0/3534882066 wait complete. 2023-10-08T00:34:00.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:34:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.385+0000 7f88b2ade700 1 Processor -- start 2023-10-08T00:34:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.385+0000 7f88b2ade700 1 -- start start 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b2ade700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88ac159420 0x7f88ac0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b2ade700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88ac15d230 0x7f88ac15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b2ade700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac0b2980 con 0x7f88ac1597f0 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b2ade700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac15db70 con 0x7f88ac15d230 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b2ade700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac0b11d0 con 0x7f88ac159420 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b22dd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f88ac15d230 0x7f88ac15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b12db700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f88ac1597f0 0x7f88ac0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41958/0 (socket says 172.21.15.22:41958) 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b12db700 1 -- 172.21.15.22:0/4030094014 learned_addr learned my addr 172.21.15.22:0/4030094014 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:00.389 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b1adc700 1 --2- 172.21.15.22:0/4030094014 >> v2:172.21.15.192:3300/0 conn(0x7f88ac159420 0x7f88ac0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b22dd700 1 -- 172.21.15.22:0/4030094014 >> v2:172.21.15.192:3300/0 conn(0x7f88ac159420 msgr2=0x7f88ac0b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b22dd700 1 --2- 172.21.15.22:0/4030094014 >> v2:172.21.15.192:3300/0 conn(0x7f88ac159420 0x7f88ac0b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b22dd700 1 -- 172.21.15.22:0/4030094014 >> v1:172.21.15.22:6789/0 conn(0x7f88ac1597f0 legacy=0x7f88ac0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b22dd700 1 -- 172.21.15.22:0/4030094014 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0b14b0 con 0x7f88ac15d230 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b0ada700 1 -- 172.21.15.22:0/4030094014 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569143471 0 0) 0x7f88ac0b2980 con 0x7f88ac1597f0 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.386+0000 7f88b22dd700 1 --2- 172.21.15.22:0/4030094014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac15d630 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0b2f20 tx=0x7f889c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b7cede6a000efc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b0ada700 1 -- 172.21.15.22:0/4030094014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00e070 con 0x7f88ac15d230 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b0ada700 1 -- 172.21.15.22:0/4030094014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00bb60 con 0x7f88ac15d230 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b0ada700 1 -- 172.21.15.22:0/4030094014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c012430 con 0x7f88ac15d230 2023-10-08T00:34:00.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 -- 172.21.15.22:0/4030094014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 msgr2=0x7f88ac15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 --2- 172.21.15.22:0/4030094014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac15d630 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0b2f20 tx=0x7f889c009780 comp rx=0 tx=0).stop 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 -- 172.21.15.22:0/4030094014 shutdown_connections 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 --2- 172.21.15.22:0/4030094014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac15d630 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 --2- 172.21.15.22:0/4030094014 >> v2:172.21.15.192:3300/0 conn(0x7f88ac159420 0x7f88ac0b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 -- 172.21.15.22:0/4030094014 >> 172.21.15.22:0/4030094014 conn(0x7f88ac0d0660 msgr2=0x7f88ac0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 -- 172.21.15.22:0/4030094014 shutdown_connections 2023-10-08T00:34:00.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.387+0000 7f88b2ade700 1 -- 172.21.15.22:0/4030094014 wait complete. 2023-10-08T00:34:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.388+0000 7f88b2ade700 1 Processor -- start 2023-10-08T00:34:00.393 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.388+0000 7f88b2ade700 1 -- start start 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b2ade700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88ac159420 0x7f88ac15b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b2ade700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88ac1597f0 0x7f88ac14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b2ade700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac16e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b2ade700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac14c780 con 0x7f88ac15d230 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b2ade700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b62c0 con 0x7f88ac1597f0 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b2ade700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac15ae90 con 0x7f88ac159420 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac16e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac16e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47518/0 (socket says 172.21.15.22:47518) 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 -- 172.21.15.22:0/1316592615 learned_addr learned my addr 172.21.15.22:0/1316592615 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b12db700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88ac1597f0 0x7f88ac14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b1adc700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88ac159420 0x7f88ac15b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 -- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88ac159420 msgr2=0x7f88ac15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88ac159420 0x7f88ac15b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 -- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88ac1597f0 msgr2=0x7f88ac14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88ac1597f0 0x7f88ac14c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b22dd700 1 -- 172.21.15.22:0/1316592615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009a20 con 0x7f88ac15d230 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b1adc700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88ac159420 0x7f88ac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.389+0000 7f88b12db700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88ac1597f0 0x7f88ac14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.390+0000 7f88b22dd700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac16e1d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f889c009fd0 tx=0x7f889c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.390+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c012e00 con 0x7f88ac15d230 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.390+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c01d630 con 0x7f88ac15d230 2023-10-08T00:34:00.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.390+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac15a280 con 0x7f88ac15d230 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.390+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c01d9f0 con 0x7f88ac15d230 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.390+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac15a840 con 0x7f88ac15d230 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.391+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac15b040 con 0x7f88ac15d230 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.391+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f889c024070 con 0x7f88ac15d230 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.392+0000 7f88a9ffb700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8898067350 0x7f8898069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.392+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f889c0873c0 con 0x7f88ac15d230 2023-10-08T00:34:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.392+0000 7f88b1adc700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8898067350 0x7f8898069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:00.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.392+0000 7f88b1adc700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8898067350 0x7f8898069800 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009d80 tx=0x7f88a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:00.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.396+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88ac15b040 con 0x7f88ac15d230 2023-10-08T00:34:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.634+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88ac15b000 con 0x7f88ac15d230 2023-10-08T00:34:00.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.635+0000 7f88a9ffb700 1 -- 172.21.15.22:0/1316592615 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v125) v1 ==== 53+0+73 (secure 0 0 0) 0x7f889c054050 con 0x7f88ac15d230 2023-10-08T00:34:00.637 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:34:00.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8898067350 msgr2=0x7f8898069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8898067350 0x7f8898069800 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009d80 tx=0x7f88a4008040 comp rx=0 tx=0).stop 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 msgr2=0x7f88ac16e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac16e1d0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f889c009fd0 tx=0x7f889c019000 comp rx=0 tx=0).stop 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 shutdown_connections 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88ac15d230 0x7f88ac16e1d0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8898067350 0x7f8898069800 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f88ac159420 0x7f88ac15b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 --2- 172.21.15.22:0/1316592615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88ac1597f0 0x7f88ac14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 >> 172.21.15.22:0/1316592615 conn(0x7f88ac0d0660 msgr2=0x7f88ac156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 shutdown_connections 2023-10-08T00:34:00.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:00.637+0000 7f88b2ade700 1 -- 172.21.15.22:0/1316592615 wait complete. 2023-10-08T00:34:00.650 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:34:00.650 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:34:00.650 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:34:00.650 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:34:00.650 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:00.651 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:34:00.651 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:34:00.651 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:34:00.651 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:34:00.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:00.651 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:34:00.667 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 41930sec preferred_lft 41930sec 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:34:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:34:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:00.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:00.670 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:34:00.731 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:34:00.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:00.733 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:34:00.789 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:34:00.790 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:34:00.790 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:34:00.790 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:34:00.790 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:34:00.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:00.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:34:00.790 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:34:00.790 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:34:00.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:34:00.791 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:34:00.791 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:34:00.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:00.893 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:34:00.908 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:34:00.908 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:34:00.909 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:34:00.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:00.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:34:00.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:00.974 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:01.029 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:34:01.029 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:01.030 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:01.084 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:34:01.084 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:34:01.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:01.166 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:01.166 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:01.185 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:01.207 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:01.208 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:01.208 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:34:01.208 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:34:01.208 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:34:01.209 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:34:01.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.209 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:01.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:34:01.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.436+0000 7f1498e3d700 1 Processor -- start 2023-10-08T00:34:01.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.436+0000 7f1498e3d700 1 -- start start 2023-10-08T00:34:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1498e3d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159890 0x7f149415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1498e3d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1494159c60 0x7f149415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1498e3d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149415a160 con 0x7f149415db10 2023-10-08T00:34:01.440 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1498e3d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14940d13a0 con 0x7f1494159c60 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1498e3d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149415e140 con 0x7f1494159890 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1491d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1494159c60 0x7f149415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1492d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f149415db10 0x7f1494069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41966/0 (socket says 172.21.15.22:41966) 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f1492d9d700 1 -- 172.21.15.22:0/383298081 learned_addr learned my addr 172.21.15.22:0/383298081 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.437+0000 7f149259c700 1 --2- 172.21.15.22:0/383298081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159890 0x7f149415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f149159a700 1 -- 172.21.15.22:0/383298081 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638666027 0 0) 0x7f149415a160 con 0x7f149415db10 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f149159a700 1 -- 172.21.15.22:0/383298081 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1480003570 con 0x7f149415db10 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f1491d9b700 1 -- 172.21.15.22:0/383298081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159890 msgr2=0x7f149415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f1491d9b700 1 --2- 172.21.15.22:0/383298081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159890 0x7f149415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f1491d9b700 1 -- 172.21.15.22:0/383298081 >> v1:172.21.15.22:6789/0 conn(0x7f149415db10 legacy=0x7f1494069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:01.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f1491d9b700 1 -- 172.21.15.22:0/383298081 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149415a3d0 con 0x7f1494159c60 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f1491d9b700 1 --2- 172.21.15.22:0/383298081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159c60 0x7f149415d5d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f147c0098e0 tx=0x7f147c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d304d9587ab437d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f149159a700 1 -- 172.21.15.22:0/383298081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c011630 con 0x7f1494159c60 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f149159a700 1 -- 172.21.15.22:0/383298081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c011790 con 0x7f1494159c60 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.438+0000 7f149159a700 1 -- 172.21.15.22:0/383298081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c011b30 con 0x7f1494159c60 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 -- 172.21.15.22:0/383298081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159c60 msgr2=0x7f149415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 --2- 172.21.15.22:0/383298081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159c60 0x7f149415d5d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f147c0098e0 tx=0x7f147c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 -- 172.21.15.22:0/383298081 shutdown_connections 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 --2- 172.21.15.22:0/383298081 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159890 0x7f149415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 --2- 172.21.15.22:0/383298081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159c60 0x7f149415d5d0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 -- 172.21.15.22:0/383298081 >> 172.21.15.22:0/383298081 conn(0x7f1494068e20 msgr2=0x7f14940d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 -- 172.21.15.22:0/383298081 shutdown_connections 2023-10-08T00:34:01.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.439+0000 7f1498e3d700 1 -- 172.21.15.22:0/383298081 wait complete. 2023-10-08T00:34:01.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.440+0000 7f1498e3d700 1 Processor -- start 2023-10-08T00:34:01.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.440+0000 7f1498e3d700 1 -- start start 2023-10-08T00:34:01.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.440+0000 7f1498e3d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 0x7f14940c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:01.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.440+0000 7f1498e3d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159c60 0x7f149416a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:01.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1498e3d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f149415db10 0x7f14940cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:01.445 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1498e3d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494149b00 con 0x7f1494159890 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1498e3d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149416aec0 con 0x7f149415db10 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1498e3d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940b3830 con 0x7f1494159c60 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 0x7f14940c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 0x7f14940c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47532/0 (socket says 172.21.15.22:47532) 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 -- 172.21.15.22:0/3129122082 learned_addr learned my addr 172.21.15.22:0/3129122082 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 -- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159c60 msgr2=0x7f149416a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1491d9b700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159c60 0x7f149416a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1492d9d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f149415db10 0x7f14940cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159c60 0x7f149416a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 -- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f149415db10 msgr2=0x7f14940cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f149415db10 0x7f14940cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 -- 172.21.15.22:0/3129122082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c009420 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1492d9d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f149415db10 0x7f14940cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1491d9b700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159c60 0x7f149416a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f149259c700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 0x7f14940c8f60 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f148c00ec80 tx=0x7f148c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00c970 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c00cad0 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14940b5370 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00ce70 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.441+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14940b5930 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.442+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149404c3c0 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.443+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f148c013680 con 0x7f1494159890 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.443+0000 7f148a7fc700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1474067320 0x7f14740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:01.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.443+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f148c085060 con 0x7f1494159890 2023-10-08T00:34:01.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.444+0000 7f1491d9b700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1474067320 0x7f14740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:01.448 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.444+0000 7f1491d9b700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1474067320 0x7f14740697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f149415a090 tx=0x7f147c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:01.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.448+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f148c051cb0 con 0x7f1494159890 2023-10-08T00:34:01.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.687+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14940b6260 con 0x7f1494159890 2023-10-08T00:34:01.689 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.687+0000 7f148a7fc700 1 -- 172.21.15.22:0/3129122082 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v125) v1 ==== 53+0+73 (secure 0 0 0) 0x7f148c0552d0 con 0x7f1494159890 2023-10-08T00:34:01.689 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:34:01.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1474067320 msgr2=0x7f14740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:01.691 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1474067320 0x7f14740697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f149415a090 tx=0x7f147c017000 comp rx=0 tx=0).stop 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 msgr2=0x7f14940c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 0x7f14940c8f60 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f148c00ec80 tx=0x7f148c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 shutdown_connections 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f149415db10 0x7f14940cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1494159890 0x7f14940c8f60 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1474067320 0x7f14740697d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 --2- 172.21.15.22:0/3129122082 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1494159c60 0x7f149416a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 >> 172.21.15.22:0/3129122082 conn(0x7f1494068e20 msgr2=0x7f1494069530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 shutdown_connections 2023-10-08T00:34:01.692 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:01.690+0000 7f1498e3d700 1 -- 172.21.15.22:0/3129122082 wait complete. 2023-10-08T00:34:01.703 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:34:01.703 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:34:01.704 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:34:01.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.704 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:34:01.723 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:01.724 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 41933sec preferred_lft 41933sec 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.725 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:01.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.727 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:34:01.790 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:34:01.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.792 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:34:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:34:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:34:01.850 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:34:01.850 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:34:01.850 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:34:01.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.850 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:34:01.850 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:34:01.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:34:01.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:34:01.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:34:01.851 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:34:01.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.955 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:34:01.970 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:34:01.970 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:34:01.971 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:34:01.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:01.971 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:34:02.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:02.047 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:02.102 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:34:02.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:02.102 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:02.156 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:34:02.156 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:34:02.157 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:02.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:34:02.184 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:34:02.237 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:02.238 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:02.256 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:02.256 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:02.256 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:02.257 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:02.257 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:02.257 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:02.257 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:02.257 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:02.278 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:02.278 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:02.279 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:02.279 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:02.279 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:02.279 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:02.279 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:02.280 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:02.280 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:34:02.280 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:34:02.280 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:34:02.282 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:34:02.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:02.282 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:02.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:34:02.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.475+0000 7f7141f56700 1 Processor -- start 2023-10-08T00:34:02.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.475+0000 7f7141f56700 1 -- start start 2023-10-08T00:34:02.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f7141f56700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f713c0cd910 0x7f713c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:02.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f7141f56700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:02.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f7141f56700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0b5b00 con 0x7f713c159ec0 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f7141f56700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0b5da0 con 0x7f713c0cd910 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f7141f56700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b6080 con 0x7f713c0b55a0 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f713c0cd910 0x7f713c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f713c0cd910 0x7f713c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47536/0 (socket says 172.21.15.22:47536) 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 -- 172.21.15.22:0/2961984428 learned_addr learned my addr 172.21.15.22:0/2961984428 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713bfff700 1 --2- 172.21.15.22:0/2961984428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 -- 172.21.15.22:0/2961984428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 msgr2=0x7f713c0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 --2- 172.21.15.22:0/2961984428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c0ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 -- 172.21.15.22:0/2961984428 >> v1:172.21.15.192:6789/0 conn(0x7f713c159ec0 legacy=0x7f713c0b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.476+0000 7f713affd700 1 -- 172.21.15.22:0/2961984428 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0cc100 con 0x7f713c0cd910 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f713affd700 1 --2- 172.21.15.22:0/2961984428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c0cd910 0x7f713c0ce340 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f71300099e0 tx=0x7f7130009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683867befd666d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:02.480 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f713a7fc700 1 -- 172.21.15.22:0/2961984428 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713000b820 con 0x7f713c0cd910 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f713a7fc700 1 -- 172.21.15.22:0/2961984428 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713000b980 con 0x7f713c0cd910 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f713a7fc700 1 -- 172.21.15.22:0/2961984428 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713000bd20 con 0x7f713c0cd910 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 -- 172.21.15.22:0/2961984428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c0cd910 msgr2=0x7f713c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 --2- 172.21.15.22:0/2961984428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c0cd910 0x7f713c0ce340 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f71300099e0 tx=0x7f7130009250 comp rx=0 tx=0).stop 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 -- 172.21.15.22:0/2961984428 shutdown_connections 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 --2- 172.21.15.22:0/2961984428 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c0ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 --2- 172.21.15.22:0/2961984428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c0cd910 0x7f713c0ce340 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:02.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 -- 172.21.15.22:0/2961984428 >> 172.21.15.22:0/2961984428 conn(0x7f713c0999f0 msgr2=0x7f713c0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:02.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 -- 172.21.15.22:0/2961984428 shutdown_connections 2023-10-08T00:34:02.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.477+0000 7f7141f56700 1 -- 172.21.15.22:0/2961984428 wait complete. 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.478+0000 7f7141f56700 1 Processor -- start 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 -- start start 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f713c159ec0 0x7f713c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 0x7f713c155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c153140 con 0x7f713c154ce0 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c16d180 con 0x7f713c159ec0 2023-10-08T00:34:02.485 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f7141f56700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c16d460 con 0x7f713c0b55a0 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f713bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 0x7f713c155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f713bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 0x7f713c155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47548/0 (socket says 172.21.15.22:47548) 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f713bfff700 1 -- 172.21.15.22:0/3316574945 learned_addr learned my addr 172.21.15.22:0/3316574945 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.479+0000 7f713b7fe700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713affd700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f713c159ec0 0x7f713c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713bfff700 1 -- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 msgr2=0x7f713c152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713bfff700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:02.486 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713bfff700 1 -- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f713c159ec0 msgr2=0x7f713c153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713bfff700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f713c159ec0 0x7f713c153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713bfff700 1 -- 172.21.15.22:0/3316574945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300094f0 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f713bfff700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 0x7f713c155160 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7134009df0 tx=0x7f713400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400cb50 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400f040 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c16d740 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134014480 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.480+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c16dd00 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.481+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c169ba0 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.481+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7134014830 con 0x7f713c154ce0 2023-10-08T00:34:02.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.482+0000 7f71237fe700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7128067320 0x7f71280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:02.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.482+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7134085600 con 0x7f713c154ce0 2023-10-08T00:34:02.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.482+0000 7f713b7fe700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7128067320 0x7f71280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:02.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.483+0000 7f713b7fe700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7128067320 0x7f71280697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f713c0b38c0 tx=0x7f712c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:02.488 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.486+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7134052280 con 0x7f713c154ce0 2023-10-08T00:34:02.728 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:02.726+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f713c0718b0 con 0x7f713c154ce0 2023-10-08T00:34:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.668+0000 7f71237fe700 1 -- 172.21.15.22:0/3316574945 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v126) v1 ==== 136+0+0 (secure 0 0 0) 0x7f71340558a0 con 0x7f713c154ce0 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7128067320 msgr2=0x7f71280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7128067320 0x7f71280697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f713c0b38c0 tx=0x7f712c009040 comp rx=0 tx=0).stop 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 msgr2=0x7f713c155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 0x7f713c155160 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7134009df0 tx=0x7f713400b040 comp rx=0 tx=0).stop 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 shutdown_connections 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f713c154ce0 0x7f713c155160 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7128067320 0x7f71280697d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f713c0b55a0 0x7f713c152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 --2- 172.21.15.22:0/3316574945 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f713c159ec0 0x7f713c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 >> 172.21.15.22:0/3316574945 conn(0x7f713c0999f0 msgr2=0x7f713c1523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 shutdown_connections 2023-10-08T00:34:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.671+0000 7f7141f56700 1 -- 172.21.15.22:0/3316574945 wait complete. 2023-10-08T00:34:03.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:34:03.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.813+0000 7f3795697700 1 Processor -- start 2023-10-08T00:34:03.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.813+0000 7f3795697700 1 -- start start 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f3795697700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f37901597e0 0x7f379006c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f3795697700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f3795697700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379006bbc0 con 0x7f3790159bb0 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f3795697700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900c8660 con 0x7f37901597e0 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f3795697700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379006ad10 con 0x7f379006c050 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f37901597e0 0x7f379006c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:03.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3790159bb0 0x7f379015d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41982/0 (socket says 172.21.15.22:41982) 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f37901597e0 0x7f379006c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47564/0 (socket says 172.21.15.22:47564) 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378f7fe700 1 -- 172.21.15.22:0/3664077185 learned_addr learned my addr 172.21.15.22:0/3664077185 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378e7fc700 1 --2- 172.21.15.22:0/3664077185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378effd700 1 -- 172.21.15.22:0/3664077185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 msgr2=0x7f3790068390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378effd700 1 --2- 172.21.15.22:0/3664077185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790068390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378effd700 1 -- 172.21.15.22:0/3664077185 >> v1:172.21.15.22:6789/0 conn(0x7f3790159bb0 legacy=0x7f379015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378effd700 1 -- 172.21.15.22:0/3664077185 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379006afb0 con 0x7f37901597e0 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.814+0000 7f378dffb700 1 -- 172.21.15.22:0/3664077185 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065639133 0 0) 0x7f379006bbc0 con 0x7f3790159bb0 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f378effd700 1 --2- 172.21.15.22:0/3664077185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37901597e0 0x7f379006c720 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3780009e60 tx=0x7f3780009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7cbe707d850807 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f378dffb700 1 -- 172.21.15.22:0/3664077185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000e070 con 0x7f37901597e0 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f378dffb700 1 -- 172.21.15.22:0/3664077185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378000bc30 con 0x7f37901597e0 2023-10-08T00:34:03.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f378dffb700 1 -- 172.21.15.22:0/3664077185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780012430 con 0x7f37901597e0 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 -- 172.21.15.22:0/3664077185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37901597e0 msgr2=0x7f379006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 --2- 172.21.15.22:0/3664077185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37901597e0 0x7f379006c720 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3780009e60 tx=0x7f3780009780 comp rx=0 tx=0).stop 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 -- 172.21.15.22:0/3664077185 shutdown_connections 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 --2- 172.21.15.22:0/3664077185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f37901597e0 0x7f379006c720 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 --2- 172.21.15.22:0/3664077185 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790068390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 -- 172.21.15.22:0/3664077185 >> 172.21.15.22:0/3664077185 conn(0x7f37900cdd80 msgr2=0x7f37900c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 -- 172.21.15.22:0/3664077185 shutdown_connections 2023-10-08T00:34:03.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.815+0000 7f3795697700 1 -- 172.21.15.22:0/3664077185 wait complete. 2023-10-08T00:34:03.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 Processor -- start 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 -- start start 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37901597e0 0x7f379015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 0x7f379015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c4e70 con 0x7f3790159bb0 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c4540 con 0x7f37901597e0 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f3795697700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c4820 con 0x7f379006c050 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.817+0000 7f378f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 0x7f379015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 0x7f379015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47576/0 (socket says 172.21.15.22:47576) 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 -- 172.21.15.22:0/1305104905 learned_addr learned my addr 172.21.15.22:0/1305104905 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378effd700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:03.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378e7fc700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37901597e0 0x7f379015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 -- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 msgr2=0x7f3790157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 -- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37901597e0 msgr2=0x7f379015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37901597e0 0x7f379015e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 -- 172.21.15.22:0/1305104905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780009a20 con 0x7f3790159bb0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f378f7fe700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 0x7f379015eb00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f378800c530 tx=0x7f3788007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788005b30 con 0x7f3790159bb0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3788005c90 con 0x7f3790159bb0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788007320 con 0x7f3790159bb0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37900c4b00 con 0x7f3790159bb0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.818+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37901494d0 con 0x7f3790159bb0 2023-10-08T00:34:03.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.819+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37900c5020 con 0x7f3790159bb0 2023-10-08T00:34:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.820+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f378801b3b0 con 0x7f3790159bb0 2023-10-08T00:34:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.820+0000 7f3786ffd700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3770067320 0x7f37700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.820+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3788084150 con 0x7f3790159bb0 2023-10-08T00:34:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.820+0000 7f378effd700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3770067320 0x7f37700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:03.824 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.821+0000 7f378effd700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3770067320 0x7f37700697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3780009e60 tx=0x7f3780019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:03.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:03.824+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37900c5020 con 0x7f3790159bb0 2023-10-08T00:34:04.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.047+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f37900c46b0 con 0x7f3770067320 2023-10-08T00:34:04.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.049+0000 7f3786ffd700 1 -- 172.21.15.22:0/1305104905 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f37900c46b0 con 0x7f3770067320 2023-10-08T00:34:04.050 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:34:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:34:04.051 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:04.051 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3770067320 msgr2=0x7f37700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3770067320 0x7f37700697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3780009e60 tx=0x7f3780019000 comp rx=0 tx=0).stop 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 msgr2=0x7f379015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 0x7f379015eb00 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f378800c530 tx=0x7f3788007f90 comp rx=0 tx=0).stop 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 shutdown_connections 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3790159bb0 0x7f379015eb00 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3770067320 0x7f37700697d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f379006c050 0x7f3790157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 --2- 172.21.15.22:0/1305104905 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37901597e0 0x7f379015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 >> 172.21.15.22:0/1305104905 conn(0x7f37900cdd80 msgr2=0x7f379014af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 shutdown_connections 2023-10-08T00:34:04.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.051+0000 7f3795697700 1 -- 172.21.15.22:0/1305104905 wait complete. 2023-10-08T00:34:04.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:34:04.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.185+0000 7ff9b982d700 1 Processor -- start 2023-10-08T00:34:04.187 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.185+0000 7ff9b982d700 1 -- start start 2023-10-08T00:34:04.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b982d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff9b4159a60 0x7ff9b40c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b982d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40c9cb0 con 0x7ff9b40ccc00 2023-10-08T00:34:04.188 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b982d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40c9f30 con 0x7ff9b40cb230 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b982d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b406dfc0 con 0x7ff9b4159a60 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9b40ccc00 0x7ff9b4069ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:41988/0 (socket says 172.21.15.22:41988) 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b3fff700 1 -- 172.21.15.22:0/2996083148 learned_addr learned my addr 172.21.15.22:0/2996083148 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b882b700 1 --2- 172.21.15.22:0/2996083148 >> v2:172.21.15.192:3300/0 conn(0x7ff9b4159a60 0x7ff9b40c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b37fe700 1 -- 172.21.15.22:0/2996083148 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652942288 0 0) 0x7ff9b40c9cb0 con 0x7ff9b40ccc00 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.186+0000 7ff9b37fe700 1 -- 172.21.15.22:0/2996083148 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9a0003570 con 0x7ff9b40ccc00 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b882b700 1 -- 172.21.15.22:0/2996083148 >> v1:172.21.15.192:6789/0 conn(0x7ff9b40cb230 legacy=0x7ff9b406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b882b700 1 -- 172.21.15.22:0/2996083148 >> v1:172.21.15.22:6789/0 conn(0x7ff9b40ccc00 legacy=0x7ff9b4069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b882b700 1 -- 172.21.15.22:0/2996083148 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40ca470 con 0x7ff9b4159a60 2023-10-08T00:34:04.189 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b882b700 1 --2- 172.21.15.22:0/2996083148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b4159a60 0x7ff9b40c9770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1236aca73e27f341 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:04.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b37fe700 1 -- 172.21.15.22:0/2996083148 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00e070 con 0x7ff9b4159a60 2023-10-08T00:34:04.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b37fe700 1 -- 172.21.15.22:0/2996083148 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac00bbf0 con 0x7ff9b4159a60 2023-10-08T00:34:04.190 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.187+0000 7ff9b37fe700 1 -- 172.21.15.22:0/2996083148 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac012430 con 0x7ff9b4159a60 2023-10-08T00:34:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 -- 172.21.15.22:0/2996083148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b4159a60 msgr2=0x7ff9b40c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2996083148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b4159a60 0x7ff9b40c9770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac009780 comp rx=0 tx=0).stop 2023-10-08T00:34:04.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 -- 172.21.15.22:0/2996083148 shutdown_connections 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2996083148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b4159a60 0x7ff9b40c9770 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 -- 172.21.15.22:0/2996083148 >> 172.21.15.22:0/2996083148 conn(0x7ff9b406baa0 msgr2=0x7ff9b406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 -- 172.21.15.22:0/2996083148 shutdown_connections 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.188+0000 7ff9b982d700 1 -- 172.21.15.22:0/2996083148 wait complete. 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.189+0000 7ff9b982d700 1 Processor -- start 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.189+0000 7ff9b982d700 1 -- start start 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b40cb230 0x7ff9b416a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b40ccc00 0x7ff9b40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 0x7ff9b40b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b416adf0 con 0x7ff9b4159a60 2023-10-08T00:34:04.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40c5b00 con 0x7ff9b40cb230 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40c5de0 con 0x7ff9b40ccc00 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 0x7ff9b40b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 0x7ff9b40b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47578/0 (socket says 172.21.15.22:47578) 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 -- 172.21.15.22:0/2364021849 learned_addr learned my addr 172.21.15.22:0/2364021849 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b3fff700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b40ccc00 0x7ff9b40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b882b700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b40cb230 0x7ff9b416a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 -- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b40ccc00 msgr2=0x7ff9b40b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b40ccc00 0x7ff9b40b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 -- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b40cb230 msgr2=0x7ff9b416a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b40cb230 0x7ff9b416a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 -- 172.21.15.22:0/2364021849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009a20 con 0x7ff9b4159a60 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b3fff700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b40ccc00 0x7ff9b40b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b882b700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b40cb230 0x7ff9b416a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b902c700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 0x7ff9b40b03f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00c560 tx=0x7ff99c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c011590 con 0x7ff9b4159a60 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0116f0 con 0x7ff9b4159a60 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b40c60c0 con 0x7ff9b4159a60 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c011ab0 con 0x7ff9b4159a60 2023-10-08T00:34:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.190+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b40aa480 con 0x7ff9b4159a60 2023-10-08T00:34:04.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.191+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b40c6900 con 0x7ff9b4159a60 2023-10-08T00:34:04.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.192+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff99c01b3b0 con 0x7ff9b4159a60 2023-10-08T00:34:04.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.192+0000 7ff9b0ff9700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff994067320 0x7ff9940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.192+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff99c084190 con 0x7ff9b4159a60 2023-10-08T00:34:04.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.192+0000 7ff9b882b700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff994067320 0x7ff9940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.193+0000 7ff9b882b700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff994067320 0x7ff9940697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.196+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff99c050e20 con 0x7ff9b4159a60 2023-10-08T00:34:04.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.393+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff9b40ca750 con 0x7ff9b4159a60 2023-10-08T00:34:04.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.393+0000 7ff9b0ff9700 1 -- 172.21.15.22:0/2364021849 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff99c0170c0 con 0x7ff9b4159a60 2023-10-08T00:34:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff994067320 msgr2=0x7ff9940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff994067320 0x7ff9940697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e60 tx=0x7ff9ac019000 comp rx=0 tx=0).stop 2023-10-08T00:34:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 msgr2=0x7ff9b40b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 0x7ff9b40b03f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00c560 tx=0x7ff99c007ef0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 shutdown_connections 2023-10-08T00:34:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9b4159a60 0x7ff9b40b03f0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9b40cb230 0x7ff9b416a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff994067320 0x7ff9940697d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 --2- 172.21.15.22:0/2364021849 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff9b40ccc00 0x7ff9b40b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 >> 172.21.15.22:0/2364021849 conn(0x7ff9b406baa0 msgr2=0x7ff9b4159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 shutdown_connections 2023-10-08T00:34:04.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.395+0000 7ff9b982d700 1 -- 172.21.15.22:0/2364021849 wait complete. 2023-10-08T00:34:04.409 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:34:04.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:34:04.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:04.453 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:34:04.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:04.454 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:34:04.469 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:34:04.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:34:04.469 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:04.515 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:34:04.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:04.515 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:34:04.532 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:34:04.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:04.532 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T00:34:04.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:34:04.548 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T00:34:04.548 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:34:04.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:04.548 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T00:34:04.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:34:04.590 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T00:34:04.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000871725 --yes-i-really-mean-it 2023-10-08T00:34:04.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.713+0000 7fd81d3ed700 1 Processor -- start 2023-10-08T00:34:04.715 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.713+0000 7fd81d3ed700 1 -- start start 2023-10-08T00:34:04.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd81d3ed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180685e0 0x7fd81815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd81d3ed700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd81815d3f0 0x7fd8181538f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd81d3ed700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8180c9480 con 0x7fd8180689b0 2023-10-08T00:34:04.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd81d3ed700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81815d880 con 0x7fd81815d3f0 2023-10-08T00:34:04.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd81d3ed700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81815db60 con 0x7fd8180685e0 2023-10-08T00:34:04.717 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd81815d3f0 0x7fd8181538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd81815d3f0 0x7fd8181538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47592/0 (socket says 172.21.15.22:47592) 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 -- 172.21.15.22:0/2966930443 learned_addr learned my addr 172.21.15.22:0/2966930443 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd817fff700 1 --2- 172.21.15.22:0/2966930443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180685e0 0x7fd81815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 -- 172.21.15.22:0/2966930443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180685e0 msgr2=0x7fd81815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 --2- 172.21.15.22:0/2966930443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180685e0 0x7fd81815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 -- 172.21.15.22:0/2966930443 >> v1:172.21.15.192:6789/0 conn(0x7fd8180689b0 legacy=0x7fd81806eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.714+0000 7fd8177fe700 1 -- 172.21.15.22:0/2966930443 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81815de40 con 0x7fd81815d3f0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd8177fe700 1 --2- 172.21.15.22:0/2966930443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81815d3f0 0x7fd8181538f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd800009990 tx=0x7fd800009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0eec6ac34b223fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd816ffd700 1 -- 172.21.15.22:0/2966930443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800009e80 con 0x7fd81815d3f0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd816ffd700 1 -- 172.21.15.22:0/2966930443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800005c10 con 0x7fd81815d3f0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd816ffd700 1 -- 172.21.15.22:0/2966930443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000b6e0 con 0x7fd81815d3f0 2023-10-08T00:34:04.718 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 -- 172.21.15.22:0/2966930443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81815d3f0 msgr2=0x7fd8181538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/2966930443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81815d3f0 0x7fd8181538f0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd800009990 tx=0x7fd800009220 comp rx=0 tx=0).stop 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 -- 172.21.15.22:0/2966930443 shutdown_connections 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/2966930443 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180685e0 0x7fd81815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/2966930443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd81815d3f0 0x7fd8181538f0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 -- 172.21.15.22:0/2966930443 >> 172.21.15.22:0/2966930443 conn(0x7fd81806b420 msgr2=0x7fd8180cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 -- 172.21.15.22:0/2966930443 shutdown_connections 2023-10-08T00:34:04.719 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.715+0000 7fd81d3ed700 1 -- 172.21.15.22:0/2966930443 wait complete. 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.716+0000 7fd81d3ed700 1 Processor -- start 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 -- start start 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 0x7fd8180b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180689b0 0x7fd818156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815d3f0 0x7fd818155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8181566e0 con 0x7fd8180685e0 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180b1d80 con 0x7fd81815d3f0 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd81d3ed700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8180b1200 con 0x7fd8180689b0 2023-10-08T00:34:04.722 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd817fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 0x7fd8180b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd817fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 0x7fd8180b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47600/0 (socket says 172.21.15.22:47600) 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.717+0000 7fd817fff700 1 -- 172.21.15.22:0/3455566 learned_addr learned my addr 172.21.15.22:0/3455566 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd8177fe700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180689b0 0x7fd818156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd81cbec700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815d3f0 0x7fd818155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd817fff700 1 -- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180689b0 msgr2=0x7fd818156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd817fff700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180689b0 0x7fd818156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd817fff700 1 -- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815d3f0 msgr2=0x7fd818155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd817fff700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815d3f0 0x7fd818155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd817fff700 1 -- 172.21.15.22:0/3455566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009480 con 0x7fd8180685e0 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd8177fe700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180689b0 0x7fd818156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd817fff700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 0x7fd8180b0c20 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fd80800ec80 tx=0x7fd8080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:04.723 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80800c9d0 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80800cb30 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8180b14e0 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808013470 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.718+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8180b1aa0 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.719+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81804c3c0 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.719+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd808013820 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.720+0000 7fd80ffff700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.720+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd808085000 con 0x7fd8180685e0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.720+0000 7fd8177fe700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:04.724 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.721+0000 7fd8177fe700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd800009260 tx=0x7fd800016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:04.725 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.724+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd808051c90 con 0x7fd8180685e0 2023-10-08T00:34:04.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:04.947+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000871725", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd8180c9c60 con 0x7fd7f8067320 2023-10-08T00:34:07.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.698+0000 7fd80ffff700 1 -- 172.21.15.22:0/3455566 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fd8180c9c60 con 0x7fd7f8067320 2023-10-08T00:34:07.700 INFO:teuthology.orchestra.run.smithi022.stdout:FS volume 'cephfs' renamed to 'volume_0000000000871725' 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 msgr2=0x7fd7f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd800009260 tx=0x7fd800016000 comp rx=0 tx=0).stop 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 msgr2=0x7fd8180b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 0x7fd8180b0c20 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fd80800ec80 tx=0x7fd8080091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 shutdown_connections 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd81815d3f0 0x7fd818155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8180685e0 0x7fd8180b0c20 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd7f8067320 0x7fd7f80697d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.703 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 --2- 172.21.15.22:0/3455566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd8180689b0 0x7fd818156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 >> 172.21.15.22:0/3455566 conn(0x7fd81806b420 msgr2=0x7fd8180c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 shutdown_connections 2023-10-08T00:34:07.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.701+0000 7fd81d3ed700 1 -- 172.21.15.22:0/3455566 wait complete. 2023-10-08T00:34:07.718 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000871725 --yes-i-really-mean-it 2023-10-08T00:34:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.846+0000 7fb7355e4700 1 Processor -- start 2023-10-08T00:34:07.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.846+0000 7fb7355e4700 1 -- start start 2023-10-08T00:34:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb7355e4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7301563b0 0x7fb730156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:07.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb7355e4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb73015a440 0x7fb7300acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb7355e4700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73015a9b0 con 0x7fb730068890 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb7355e4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73015ac90 con 0x7fb73015a440 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb7355e4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73015af70 con 0x7fb7301563b0 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb72e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb73015a440 0x7fb7300acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb72e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb73015a440 0x7fb7300acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45996/0 (socket says 172.21.15.22:45996) 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb72e7fc700 1 -- 172.21.15.22:0/3188107250 learned_addr learned my addr 172.21.15.22:0/3188107250 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.847+0000 7fb72effd700 1 --2- 172.21.15.22:0/3188107250 >> v2:172.21.15.192:3300/0 conn(0x7fb7301563b0 0x7fb730156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72e7fc700 1 -- 172.21.15.22:0/3188107250 >> v2:172.21.15.192:3300/0 conn(0x7fb7301563b0 msgr2=0x7fb730156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:07.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72e7fc700 1 --2- 172.21.15.22:0/3188107250 >> v2:172.21.15.192:3300/0 conn(0x7fb7301563b0 0x7fb730156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72e7fc700 1 -- 172.21.15.22:0/3188107250 >> v1:172.21.15.192:6789/0 conn(0x7fb730068890 legacy=0x7fb7300c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72e7fc700 1 -- 172.21.15.22:0/3188107250 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73015b250 con 0x7fb73015a440 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72effd700 1 --2- 172.21.15.22:0/3188107250 >> v2:172.21.15.192:3300/0 conn(0x7fb7301563b0 0x7fb730156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72e7fc700 1 --2- 172.21.15.22:0/3188107250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb73015a440 0x7fb7300acf30 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fb73006a9f0 tx=0x7fb71800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362abea387e9809f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72dffb700 1 -- 172.21.15.22:0/3188107250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71800dc10 con 0x7fb73015a440 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72dffb700 1 -- 172.21.15.22:0/3188107250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71800dd70 con 0x7fb73015a440 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb72dffb700 1 -- 172.21.15.22:0/3188107250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180106c0 con 0x7fb73015a440 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 -- 172.21.15.22:0/3188107250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb73015a440 msgr2=0x7fb7300acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 --2- 172.21.15.22:0/3188107250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb73015a440 0x7fb7300acf30 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fb73006a9f0 tx=0x7fb71800b4f0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 -- 172.21.15.22:0/3188107250 shutdown_connections 2023-10-08T00:34:07.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 --2- 172.21.15.22:0/3188107250 >> v2:172.21.15.192:3300/0 conn(0x7fb7301563b0 0x7fb730156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 --2- 172.21.15.22:0/3188107250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb73015a440 0x7fb7300acf30 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 -- 172.21.15.22:0/3188107250 >> 172.21.15.22:0/3188107250 conn(0x7fb7300c8f90 msgr2=0x7fb7300c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.848+0000 7fb7355e4700 1 -- 172.21.15.22:0/3188107250 shutdown_connections 2023-10-08T00:34:07.853 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.849+0000 7fb7355e4700 1 -- 172.21.15.22:0/3188107250 wait complete. 2023-10-08T00:34:07.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 Processor -- start 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 -- start start 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 0x7fb730156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7301563b0 0x7fb7300adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb73015a440 0x7fb7300ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730158580 con 0x7fb730068890 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730157970 con 0x7fb73015a440 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.850+0000 7fb7355e4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb730157c50 con 0x7fb7301563b0 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 0x7fb730156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 0x7fb730156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46006/0 (socket says 172.21.15.22:46006) 2023-10-08T00:34:07.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 -- 172.21.15.22:0/2782641287 learned_addr learned my addr 172.21.15.22:0/2782641287 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72f7fe700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb73015a440 0x7fb7300ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72e7fc700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7301563b0 0x7fb7300adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 -- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7301563b0 msgr2=0x7fb7300adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7301563b0 0x7fb7300adbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 -- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb73015a440 msgr2=0x7fb7300ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb73015a440 0x7fb7300ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 -- 172.21.15.22:0/2782641287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71800b790 con 0x7fb730068890 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72f7fe700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb73015a440 0x7fb7300ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb72effd700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 0x7fb730156ef0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fb72800a400 tx=0x7fb728007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800d650 con 0x7fb730068890 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800d7b0 con 0x7fb730068890 2023-10-08T00:34:07.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb730157f30 con 0x7fb730068890 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800db50 con 0x7fb730068890 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.851+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73014dfd0 con 0x7fb730068890 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.852+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7300718b0 con 0x7fb730068890 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.853+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb728015440 con 0x7fb730068890 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.853+0000 7fb726ffd700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb710067320 0x7fb7100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.853+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb7280855d0 con 0x7fb730068890 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.853+0000 7fb72e7fc700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb710067320 0x7fb7100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.854+0000 7fb72e7fc700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb710067320 0x7fb7100697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb73006a9f0 tx=0x7fb71801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:07.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:07.857+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb72804e5a0 con 0x7fb730068890 2023-10-08T00:34:08.081 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.080+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000871725", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb7301586c0 con 0x7fb710067320 2023-10-08T00:34:08.704 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.703+0000 7fb726ffd700 1 -- 172.21.15.22:0/2782641287 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fb718000bc0 con 0x7fb710067320 2023-10-08T00:34:08.705 INFO:teuthology.orchestra.run.smithi022.stdout:FS volume 'cephfs' renamed to 'volume_0000000000871725' 2023-10-08T00:34:08.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb710067320 msgr2=0x7fb7100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:08.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb710067320 0x7fb7100697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb73006a9f0 tx=0x7fb71801a000 comp rx=0 tx=0).stop 2023-10-08T00:34:08.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 msgr2=0x7fb730156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:08.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 0x7fb730156ef0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fb72800a400 tx=0x7fb728007910 comp rx=0 tx=0).stop 2023-10-08T00:34:08.707 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 shutdown_connections 2023-10-08T00:34:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb73015a440 0x7fb7300ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb730068890 0x7fb730156ef0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb710067320 0x7fb7100697d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.705+0000 7fb7355e4700 1 --2- 172.21.15.22:0/2782641287 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb7301563b0 0x7fb7300adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.706+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 >> 172.21.15.22:0/2782641287 conn(0x7fb7300c8f90 msgr2=0x7fb7300acef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.706+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 shutdown_connections 2023-10-08T00:34:08.709 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.706+0000 7fb7355e4700 1 -- 172.21.15.22:0/2782641287 wait complete. 2023-10-08T00:34:08.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:34:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.846+0000 7fb8df59e700 1 Processor -- start 2023-10-08T00:34:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.847+0000 7fb8df59e700 1 -- start start 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8df59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8e01597f0 0x7fb8e00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8df59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e015d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8df59e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e015dbb0 con 0x7fb8e0159420 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8df59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e00b11d0 con 0x7fb8e01597f0 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8df59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e00b14b0 con 0x7fb8e015d230 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8e01597f0 0x7fb8e00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8e01597f0 0x7fb8e00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46010/0 (socket says 172.21.15.22:46010) 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/2693118138 learned_addr learned my addr 172.21.15.22:0/2693118138 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:08.850 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ded9d700 1 --2- 172.21.15.22:0/2693118138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/2693118138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 msgr2=0x7fb8e015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 --2- 172.21.15.22:0/2693118138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/2693118138 >> v1:172.21.15.192:6789/0 conn(0x7fb8e0159420 legacy=0x7fb8e00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/2693118138 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e00b1790 con 0x7fb8e01597f0 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8ddd9b700 1 --2- 172.21.15.22:0/2693118138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e00b2270 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80099b0 tx=0x7fb8c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd910fa88722b89 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8dd59a700 1 -- 172.21.15.22:0/2693118138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800b860 con 0x7fb8e01597f0 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8dd59a700 1 -- 172.21.15.22:0/2693118138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c800b9c0 con 0x7fb8e01597f0 2023-10-08T00:34:08.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.848+0000 7fb8dd59a700 1 -- 172.21.15.22:0/2693118138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800bd60 con 0x7fb8e01597f0 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 -- 172.21.15.22:0/2693118138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 msgr2=0x7fb8e00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 --2- 172.21.15.22:0/2693118138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e00b2270 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80099b0 tx=0x7fb8c8009250 comp rx=0 tx=0).stop 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 -- 172.21.15.22:0/2693118138 shutdown_connections 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 --2- 172.21.15.22:0/2693118138 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 --2- 172.21.15.22:0/2693118138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e00b2270 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 -- 172.21.15.22:0/2693118138 >> 172.21.15.22:0/2693118138 conn(0x7fb8e00d0660 msgr2=0x7fb8e00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:08.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 -- 172.21.15.22:0/2693118138 shutdown_connections 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.849+0000 7fb8df59e700 1 -- 172.21.15.22:0/2693118138 wait complete. 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.850+0000 7fb8df59e700 1 Processor -- start 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.850+0000 7fb8df59e700 1 -- start start 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8df59e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8e0159420 0x7fb8e015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8df59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8df59e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8df59e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0155810 con 0x7fb8e01597f0 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8df59e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e0152dc0 con 0x7fb8e0159420 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8df59e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e014ead0 con 0x7fb8e015d230 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:08.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e0152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46016/0 (socket says 172.21.15.22:46016) 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/131252943 learned_addr learned my addr 172.21.15.22:0/131252943 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ded9d700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8de59c700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8e0159420 0x7fb8e015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 msgr2=0x7fb8e014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8e0159420 msgr2=0x7fb8e015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8e0159420 0x7fb8e015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 -- 172.21.15.22:0/131252943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80094f0 con 0x7fb8e01597f0 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8de59c700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8e0159420 0x7fb8e015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8ddd9b700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e0152880 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0089340 tx=0x7fb8c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.851+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8024440 con 0x7fb8e01597f0 2023-10-08T00:34:08.856 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.852+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c80245a0 con 0x7fb8e01597f0 2023-10-08T00:34:08.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.852+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e0155a60 con 0x7fb8e01597f0 2023-10-08T00:34:08.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.852+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8024940 con 0x7fb8e01597f0 2023-10-08T00:34:08.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.852+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e0156020 con 0x7fb8e01597f0 2023-10-08T00:34:08.857 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.852+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e004c3c0 con 0x7fb8e01597f0 2023-10-08T00:34:08.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.853+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb8c801a420 con 0x7fb8e01597f0 2023-10-08T00:34:08.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.853+0000 7fb8d67fc700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb8c0067320 0x7fb8c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:08.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.853+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb8c8086a70 con 0x7fb8e01597f0 2023-10-08T00:34:08.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.854+0000 7fb8de59c700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb8c0067320 0x7fb8c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:08.858 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.854+0000 7fb8de59c700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb8c0067320 0x7fb8c00697d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8007fd0 tx=0x7fb8d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:08.859 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:08.858+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8c80536f0 con 0x7fb8e01597f0 2023-10-08T00:34:09.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.078+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e00b1a70 con 0x7fb8c0067320 2023-10-08T00:34:09.082 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.081+0000 7fb8d67fc700 1 -- 172.21.15.22:0/131252943 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7fb8e00b1a70 con 0x7fb8c0067320 2023-10-08T00:34:09.082 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:34:09.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:09.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volume_0000000000871725" 2023-10-08T00:34:09.083 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:09.083 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:34:09.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb8c0067320 msgr2=0x7fb8c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.084 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb8c0067320 0x7fb8c00697d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8007fd0 tx=0x7fb8d8009040 comp rx=0 tx=0).stop 2023-10-08T00:34:09.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 msgr2=0x7fb8e0152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e0152880 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0089340 tx=0x7fb8c8017000 comp rx=0 tx=0).stop 2023-10-08T00:34:09.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 shutdown_connections 2023-10-08T00:34:09.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb8c0067320 0x7fb8c00697d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.085 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8e015d230 0x7fb8e014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8e0159420 0x7fb8e015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 --2- 172.21.15.22:0/131252943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8e01597f0 0x7fb8e0152880 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 >> 172.21.15.22:0/131252943 conn(0x7fb8e00d0660 msgr2=0x7fb8e00d0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:09.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 shutdown_connections 2023-10-08T00:34:09.086 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.082+0000 7fb8df59e700 1 -- 172.21.15.22:0/131252943 wait complete. 2023-10-08T00:34:09.096 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:09.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.213+0000 7fd57f7f9700 1 Processor -- start 2023-10-08T00:34:09.215 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.213+0000 7fd57f7f9700 1 -- start start 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57f7f9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5780b1420 0x7fd5780ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57f7f9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5780cc300 con 0x7fd5780ccf90 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57f7f9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5780ad370 con 0x7fd5780cbf30 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57f7f9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd578156bf0 con 0x7fd5780b1420 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57cd94700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5780b1420 0x7fd5780ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57dd96700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd5780ccf90 0x7fd5780c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56032/0 (socket says 172.21.15.22:56032) 2023-10-08T00:34:09.216 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.214+0000 7fd57dd96700 1 -- 172.21.15.22:0/231434303 learned_addr learned my addr 172.21.15.22:0/231434303 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:09.217 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd57cd94700 1 -- 172.21.15.22:0/231434303 >> v1:172.21.15.192:6789/0 conn(0x7fd5780cbf30 legacy=0x7fd5780b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd57cd94700 1 -- 172.21.15.22:0/231434303 >> v1:172.21.15.22:6789/0 conn(0x7fd5780ccf90 legacy=0x7fd5780c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd57cd94700 1 -- 172.21.15.22:0/231434303 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780ad650 con 0x7fd5780b1420 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd577fff700 1 -- 172.21.15.22:0/231434303 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674353450 0 0) 0x7fd5780cc300 con 0x7fd5780ccf90 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd57cd94700 1 --2- 172.21.15.22:0/231434303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780b1420 0x7fd5780ae410 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0098e0 tx=0x7fd56c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6488e31d1bf789f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd577fff700 1 -- 172.21.15.22:0/231434303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c009e80 con 0x7fd5780b1420 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd577fff700 1 -- 172.21.15.22:0/231434303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c00b860 con 0x7fd5780b1420 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd577fff700 1 -- 172.21.15.22:0/231434303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c00bbe0 con 0x7fd5780b1420 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.215+0000 7fd57f7f9700 1 -- 172.21.15.22:0/231434303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780b1420 msgr2=0x7fd5780ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.216+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/231434303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780b1420 0x7fd5780ae410 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0098e0 tx=0x7fd56c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.216+0000 7fd57f7f9700 1 -- 172.21.15.22:0/231434303 shutdown_connections 2023-10-08T00:34:09.218 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.216+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/231434303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780b1420 0x7fd5780ae410 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.216+0000 7fd57f7f9700 1 -- 172.21.15.22:0/231434303 >> 172.21.15.22:0/231434303 conn(0x7fd57806a320 msgr2=0x7fd5780cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:09.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.216+0000 7fd57f7f9700 1 -- 172.21.15.22:0/231434303 shutdown_connections 2023-10-08T00:34:09.219 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.216+0000 7fd57f7f9700 1 -- 172.21.15.22:0/231434303 wait complete. 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.217+0000 7fd57f7f9700 1 Processor -- start 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.217+0000 7fd57f7f9700 1 -- start start 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57f7f9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5780b1420 0x7fd57816a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57f7f9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 0x7fd57806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57f7f9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5780ccf90 0x7fd57806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57f7f9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57816b330 con 0x7fd5780cbf30 2023-10-08T00:34:09.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57f7f9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57816b610 con 0x7fd5780ccf90 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57f7f9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57816aa00 con 0x7fd5780b1420 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 0x7fd57806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 0x7fd57806e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46048/0 (socket says 172.21.15.22:46048) 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 -- 172.21.15.22:0/1136544394 learned_addr learned my addr 172.21.15.22:0/1136544394 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57dd96700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5780ccf90 0x7fd57806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57d595700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5780b1420 0x7fd57816a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 -- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5780b1420 msgr2=0x7fd57816a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5780b1420 0x7fd57816a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 -- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5780ccf90 msgr2=0x7fd57806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5780ccf90 0x7fd57806ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.222 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 -- 172.21.15.22:0/1136544394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c009420 con 0x7fd5780cbf30 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57d595700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5780b1420 0x7fd57816a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57dd96700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5780ccf90 0x7fd57806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd57cd94700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 0x7fd57806e8a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd56c013000 tx=0x7fd56c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.218+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c011420 con 0x7fd5780cbf30 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.219+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56c011580 con 0x7fd5780cbf30 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.219+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56c011920 con 0x7fd5780cbf30 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.219+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57816ace0 con 0x7fd5780cbf30 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.219+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57816a710 con 0x7fd5780cbf30 2023-10-08T00:34:09.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.219+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57806d090 con 0x7fd5780cbf30 2023-10-08T00:34:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.221+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd56c011c90 con 0x7fd5780cbf30 2023-10-08T00:34:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.221+0000 7fd5757fa700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd564067350 0x7fd564069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.221+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd56c086ef0 con 0x7fd5780cbf30 2023-10-08T00:34:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.221+0000 7fd57d595700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd564067350 0x7fd564069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.224 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.222+0000 7fd57d595700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd564067350 0x7fd564069800 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd570007fd0 tx=0x7fd570009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:09.225 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.224+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd56c0b25a0 con 0x7fd5780cbf30 2023-10-08T00:34:09.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.465+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd57816b780 con 0x7fd5780cbf30 2023-10-08T00:34:09.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.466+0000 7fd5757fa700 1 -- 172.21.15.22:0/1136544394 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fd56c053cf0 con 0x7fd5780cbf30 2023-10-08T00:34:09.468 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:09.468 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":128,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:34:05.678513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000871725","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:34:09.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd564067350 msgr2=0x7fd564069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd564067350 0x7fd564069800 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd570007fd0 tx=0x7fd570009040 comp rx=0 tx=0).stop 2023-10-08T00:34:09.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 msgr2=0x7fd57806e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 0x7fd57806e8a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd56c013000 tx=0x7fd56c017000 comp rx=0 tx=0).stop 2023-10-08T00:34:09.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 shutdown_connections 2023-10-08T00:34:09.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5780ccf90 0x7fd57806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd564067350 0x7fd564069800 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd5780b1420 0x7fd57816a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 --2- 172.21.15.22:0/1136544394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5780cbf30 0x7fd57806e8a0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 >> 172.21.15.22:0/1136544394 conn(0x7fd57806a320 msgr2=0x7fd5780b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 shutdown_connections 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.468+0000 7fd57f7f9700 1 -- 172.21.15.22:0/1136544394 wait complete. 2023-10-08T00:34:09.471 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 128 2023-10-08T00:34:09.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.599+0000 7fd57333e700 1 Processor -- start 2023-10-08T00:34:09.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.600+0000 7fd57333e700 1 -- start start 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.600+0000 7fd57333e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd56c06aa40 0x7fd56c0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.600+0000 7fd57333e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06bac0 0x7fd56c06ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.600+0000 7fd57333e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c0cc210 con 0x7fd56c06b350 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.600+0000 7fd57333e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0cc4f0 con 0x7fd56c06aa40 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.600+0000 7fd57333e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0cc7d0 con 0x7fd56c06bac0 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5718db700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd56c06b350 0x7fd56c0c81d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56040/0 (socket says 172.21.15.22:56040) 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5718db700 1 -- 172.21.15.22:0/172882981 learned_addr learned my addr 172.21.15.22:0/172882981 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5710da700 1 --2- 172.21.15.22:0/172882981 >> v2:172.21.15.22:3300/0 conn(0x7fd56c06aa40 0x7fd56c0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5708d9700 1 --2- 172.21.15.22:0/172882981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06bac0 0x7fd56c06ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd56bfff700 1 -- 172.21.15.22:0/172882981 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210098919 0 0) 0x7fd56c0cc210 con 0x7fd56c06b350 2023-10-08T00:34:09.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd56bfff700 1 -- 172.21.15.22:0/172882981 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd554003570 con 0x7fd56c06b350 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5710da700 1 -- 172.21.15.22:0/172882981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06bac0 msgr2=0x7fd56c06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5710da700 1 --2- 172.21.15.22:0/172882981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06bac0 0x7fd56c06ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5710da700 1 -- 172.21.15.22:0/172882981 >> v1:172.21.15.22:6789/0 conn(0x7fd56c06b350 legacy=0x7fd56c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5710da700 1 -- 172.21.15.22:0/172882981 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0ccab0 con 0x7fd56c06aa40 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd5710da700 1 --2- 172.21.15.22:0/172882981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c0cbc00 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fd564009eb0 tx=0x7fd564009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5772412cbe89bc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd56bfff700 1 -- 172.21.15.22:0/172882981 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400e070 con 0x7fd56c06aa40 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd56bfff700 1 -- 172.21.15.22:0/172882981 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400bb80 con 0x7fd56c06aa40 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.601+0000 7fd56bfff700 1 -- 172.21.15.22:0/172882981 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564012430 con 0x7fd56c06aa40 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 -- 172.21.15.22:0/172882981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 msgr2=0x7fd56c0cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 --2- 172.21.15.22:0/172882981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c0cbc00 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fd564009eb0 tx=0x7fd564009780 comp rx=0 tx=0).stop 2023-10-08T00:34:09.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 -- 172.21.15.22:0/172882981 shutdown_connections 2023-10-08T00:34:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 --2- 172.21.15.22:0/172882981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c0cbc00 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 --2- 172.21.15.22:0/172882981 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06bac0 0x7fd56c06ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 -- 172.21.15.22:0/172882981 >> 172.21.15.22:0/172882981 conn(0x7fd56c0cd670 msgr2=0x7fd56c0cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 -- 172.21.15.22:0/172882981 shutdown_connections 2023-10-08T00:34:09.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.602+0000 7fd57333e700 1 -- 172.21.15.22:0/172882981 wait complete. 2023-10-08T00:34:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.603+0000 7fd57333e700 1 Processor -- start 2023-10-08T00:34:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.603+0000 7fd57333e700 1 -- start start 2023-10-08T00:34:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd57333e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd57333e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06b350 0x7fd56c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd57333e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd56c06bac0 0x7fd56c142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd57333e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c156420 con 0x7fd56c06aa40 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd57333e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0b1930 con 0x7fd56c06bac0 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd57333e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c154980 con 0x7fd56c06b350 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46058/0 (socket says 172.21.15.22:46058) 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 -- 172.21.15.22:0/3731625691 learned_addr learned my addr 172.21.15.22:0/3731625691 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 -- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06b350 msgr2=0x7fd56c154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06b350 0x7fd56c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 -- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd56c06bac0 msgr2=0x7fd56c142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd56c06bac0 0x7fd56c142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 -- 172.21.15.22:0/3731625691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd564009a20 con 0x7fd56c06aa40 2023-10-08T00:34:09.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.604+0000 7fd5710da700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c154440 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fd564003440 tx=0x7fd564019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.605+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564012d90 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.605+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564027470 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.605+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c0b1600 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.605+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564027830 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.605+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c155c30 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.606+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c156260 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.606+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd564024070 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.606+0000 7fd5697fa700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd558067320 0x7fd5580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.606+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd564087630 con 0x7fd56c06aa40 2023-10-08T00:34:09.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.607+0000 7fd5708d9700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd558067320 0x7fd5580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:09.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.607+0000 7fd5708d9700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd558067320 0x7fd5580697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0b13f0 tx=0x7fd5600091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:09.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.611+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd564054370 con 0x7fd56c06aa40 2023-10-08T00:34:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.804+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd56c04c3c0 con 0x7fd56c06aa40 2023-10-08T00:34:09.806 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.805+0000 7fd5697fa700 1 -- 172.21.15.22:0/3731625691 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+15442 (secure 0 0 0) 0x7fd564057990 con 0x7fd56c06aa40 2023-10-08T00:34:09.807 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:09.807 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":190,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:07.690501+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000871725.meta","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000871725"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000871725.data","create_time":"2023-10-08T00:33:52.705475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000871725"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd558067320 msgr2=0x7fd5580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd558067320 0x7fd5580697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd56c0b13f0 tx=0x7fd5600091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 msgr2=0x7fd56c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c154440 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fd564003440 tx=0x7fd564019000 comp rx=0 tx=0).stop 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 shutdown_connections 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd56c06bac0 0x7fd56c142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd56c06aa40 0x7fd56c154440 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd558067320 0x7fd5580697d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 --2- 172.21.15.22:0/3731625691 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd56c06b350 0x7fd56c154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:09.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 >> 172.21.15.22:0/3731625691 conn(0x7fd56c0cd670 msgr2=0x7fd56c0c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:09.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 shutdown_connections 2023-10-08T00:34:09.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:09.807+0000 7fd57333e700 1 -- 172.21.15.22:0/3731625691 wait complete. 2023-10-08T00:34:09.822 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:34:09.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:34:09.864 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:34:09.905 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:34:09.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:10.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.023+0000 7fe326999700 1 Processor -- start 2023-10-08T00:34:10.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.023+0000 7fe326999700 1 -- start start 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe326999700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe320159890 0x7fe32015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe326999700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 0x7fe3200699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe326999700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe320069ee0 con 0x7fe320159c60 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe326999700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32015a160 con 0x7fe320159890 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe326999700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200d13a0 con 0x7fe320069560 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe31f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe320159c60 0x7fe32015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56052/0 (socket says 172.21.15.22:56052) 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe31f7fe700 1 -- 172.21.15.22:0/3973056789 learned_addr learned my addr 172.21.15.22:0/3973056789 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:10.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe31ffff700 1 --2- 172.21.15.22:0/3973056789 >> v2:172.21.15.192:3300/0 conn(0x7fe320159890 0x7fe32015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe324f36700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 0x7fe3200699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491730696 0 0) 0x7fe320069ee0 con 0x7fe320159c60 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.024+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30c003570 con 0x7fe320159c60 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707057371 0 0) 0x7fe30c003570 con 0x7fe320159c60 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 msgr2=0x7fe3200699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 0x7fe3200699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 >> v2:172.21.15.192:3300/0 conn(0x7fe320159890 msgr2=0x7fe32015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 --2- 172.21.15.22:0/3973056789 >> v2:172.21.15.192:3300/0 conn(0x7fe320159890 0x7fe32015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32015e140 con 0x7fe320159c60 2023-10-08T00:34:10.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fe308001470 con 0x7fe320159c60 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31ffff700 1 --2- 172.21.15.22:0/3973056789 >> v2:172.21.15.192:3300/0 conn(0x7fe320159890 0x7fe32015abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 >> v1:172.21.15.22:6789/0 conn(0x7fe320159c60 legacy=0x7fe32015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe30c003a60 0x7fe30c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 0x7fe30c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe30c004d50 0x7fe30c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015a160 con 0x7fe30c004d50 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200d13a0 con 0x7fe30c003a60 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c00ba60 con 0x7fe320069560 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe30c004d50 0x7fe30c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31ffff700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe30c003a60 0x7fe30c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe31f7fe700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 0x7fe30c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 -- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 msgr2=0x7fe30c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe320069560 0x7fe30c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 -- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe30c003a60 msgr2=0x7fe30c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe30c003a60 0x7fe30c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 -- 172.21.15.22:0/3973056789 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c003570 con 0x7fe30c004d50 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.025+0000 7fe324f36700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe30c004d50 0x7fe30c0051c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe31800e210 tx=0x7fe31800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea8bc5ab52c7830 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800ea60 con 0x7fe30c004d50 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31800f040 con 0x7fe30c004d50 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe31effd700 1 -- 172.21.15.22:0/3973056789 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800ee10 con 0x7fe30c004d50 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe326999700 1 -- 172.21.15.22:0/3973056789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe30c004d50 msgr2=0x7fe30c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.032 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe326999700 1 --2- 172.21.15.22:0/3973056789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe30c004d50 0x7fe30c0051c0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe31800e210 tx=0x7fe31800b040 comp rx=0 tx=0).stop 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe324f36700 1 -- 172.21.15.22:0/3973056789 reap_dead start 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe326999700 1 -- 172.21.15.22:0/3973056789 shutdown_connections 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe326999700 1 -- 172.21.15.22:0/3973056789 >> 172.21.15.22:0/3973056789 conn(0x7fe320068e20 msgr2=0x7fe3200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe326999700 1 -- 172.21.15.22:0/3973056789 shutdown_connections 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.026+0000 7fe326999700 1 -- 172.21.15.22:0/3973056789 wait complete. 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.027+0000 7fe326999700 1 Processor -- start 2023-10-08T00:34:10.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.027+0000 7fe326999700 1 -- start start 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe326999700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 0x7fe32015ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe326999700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe32015c0e0 0x7fe32015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe326999700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3200b3590 0x7fe3200b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe326999700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe320151f90 con 0x7fe320158850 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe326999700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015bc50 con 0x7fe32015c0e0 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe326999700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe320158c20 con 0x7fe3200b3590 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 0x7fe32015ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 0x7fe32015ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46080/0 (socket says 172.21.15.22:46080) 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe31ffff700 1 -- 172.21.15.22:0/1755416083 learned_addr learned my addr 172.21.15.22:0/1755416083 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe31f7fe700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe32015c0e0 0x7fe32015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.028+0000 7fe324f36700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3200b3590 0x7fe3200b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe31ffff700 1 -- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3200b3590 msgr2=0x7fe3200b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe31ffff700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3200b3590 0x7fe3200b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe31ffff700 1 -- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe32015c0e0 msgr2=0x7fe32015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe31ffff700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe32015c0e0 0x7fe32015f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe31ffff700 1 -- 172.21.15.22:0/1755416083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200b3f40 con 0x7fe320158850 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe31ffff700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 0x7fe32015ec10 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe310011d70 tx=0x7fe3100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011e70 con 0x7fe320158850 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31000fbc0 con 0x7fe320158850 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3200b44a0 con 0x7fe320158850 2023-10-08T00:34:10.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31001d480 con 0x7fe320158850 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.029+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32015b600 con 0x7fe320158850 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.030+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32004c3c0 con 0x7fe320158850 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.030+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe31001d870 con 0x7fe320158850 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.031+0000 7fe317fff700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe300067320 0x7fe3000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.031+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe310018070 con 0x7fe320158850 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.031+0000 7fe31f7fe700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe300067320 0x7fe3000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.038 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.031+0000 7fe31f7fe700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe300067320 0x7fe3000697d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe308001d20 tx=0x7fe308001e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.035+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3100525e0 con 0x7fe320158850 2023-10-08T00:34:10.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.271+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe320152150 con 0x7fe320158850 2023-10-08T00:34:10.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.271+0000 7fe317fff700 1 -- 172.21.15.22:0/1755416083 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fe310055c00 con 0x7fe320158850 2023-10-08T00:34:10.273 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:10.273 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":128,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:34:05.678513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000871725","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:34:10.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe300067320 msgr2=0x7fe3000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe300067320 0x7fe3000697d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe308001d20 tx=0x7fe308001e90 comp rx=0 tx=0).stop 2023-10-08T00:34:10.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 msgr2=0x7fe32015ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 0x7fe32015ec10 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe310011d70 tx=0x7fe3100091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 shutdown_connections 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe300067320 0x7fe3000697d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe3200b3590 0x7fe3200b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe320158850 0x7fe32015ec10 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 --2- 172.21.15.22:0/1755416083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe32015c0e0 0x7fe32015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.273+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 >> 172.21.15.22:0/1755416083 conn(0x7fe320068e20 msgr2=0x7fe3200b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.274+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 shutdown_connections 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.274+0000 7fe326999700 1 -- 172.21.15.22:0/1755416083 wait complete. 2023-10-08T00:34:10.276 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 128 2023-10-08T00:34:10.287 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:10.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.408+0000 7f5184b30700 1 Processor -- start 2023-10-08T00:34:10.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.408+0000 7f5184b30700 1 -- start start 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f5184b30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51800caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f5184b30700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f518015df50 0x7f518015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f5184b30700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518015d7e0 con 0x7f518006bcd0 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f5184b30700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518015dac0 con 0x7f518015df50 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f5184b30700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518015aa30 con 0x7f518006c0a0 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f518015df50 0x7f518015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f518015df50 0x7f518015e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46094/0 (socket says 172.21.15.22:46094) 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 -- 172.21.15.22:0/4805222 learned_addr learned my addr 172.21.15.22:0/4805222 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517dd9b700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51800caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 -- 172.21.15.22:0/4805222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 msgr2=0x7f51800caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:10.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51800caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 -- 172.21.15.22:0/4805222 >> v1:172.21.15.192:6789/0 conn(0x7f518006bcd0 legacy=0x7f518015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 -- 172.21.15.22:0/4805222 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518015ad10 con 0x7f518015df50 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517dd9b700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51800caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517ed9d700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518015df50 0x7f518015e3c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f51780099b0 tx=0x7f5178009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de7f637b80defa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517d59a700 1 -- 172.21.15.22:0/4805222 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800b860 con 0x7f518015df50 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517d59a700 1 -- 172.21.15.22:0/4805222 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517800b9c0 con 0x7f518015df50 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.409+0000 7f517d59a700 1 -- 172.21.15.22:0/4805222 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517800bd80 con 0x7f518015df50 2023-10-08T00:34:10.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 -- 172.21.15.22:0/4805222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518015df50 msgr2=0x7f518015e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518015df50 0x7f518015e3c0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f51780099b0 tx=0x7f5178009250 comp rx=0 tx=0).stop 2023-10-08T00:34:10.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 -- 172.21.15.22:0/4805222 shutdown_connections 2023-10-08T00:34:10.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518015df50 0x7f518015e3c0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 --2- 172.21.15.22:0/4805222 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51800caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 -- 172.21.15.22:0/4805222 >> 172.21.15.22:0/4805222 conn(0x7f51800ce600 msgr2=0x7f51800cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:10.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 -- 172.21.15.22:0/4805222 shutdown_connections 2023-10-08T00:34:10.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.410+0000 7f5184b30700 1 -- 172.21.15.22:0/4805222 wait complete. 2023-10-08T00:34:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.411+0000 7f5184b30700 1 Processor -- start 2023-10-08T00:34:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.411+0000 7f5184b30700 1 -- start start 2023-10-08T00:34:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f5184b30700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 0x7f5180156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f5184b30700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51801590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f5184b30700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f518015df50 0x7f518016ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f5184b30700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51800b20c0 con 0x7f518006bcd0 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f5184b30700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51800b14b0 con 0x7f518015df50 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f5184b30700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51800b1790 con 0x7f518006c0a0 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 0x7f5180156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 0x7f5180156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46110/0 (socket says 172.21.15.22:46110) 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 -- 172.21.15.22:0/3734590358 learned_addr learned my addr 172.21.15.22:0/3734590358 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517ed9d700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f518015df50 0x7f518016ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517dd9b700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51801590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 -- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 msgr2=0x7f51801590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51801590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 -- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f518015df50 msgr2=0x7f518016ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f518015df50 0x7f518016ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.412+0000 7f517e59c700 1 -- 172.21.15.22:0/3734590358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780094f0 con 0x7f518006bcd0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.413+0000 7f517e59c700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 0x7f5180156670 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f517000c8e0 tx=0x7f5170001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.413+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170012630 con 0x7f518006bcd0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.413+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51700127b0 con 0x7f518006bcd0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.413+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51800b1a70 con 0x7f518006bcd0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.413+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170012b70 con 0x7f518006bcd0 2023-10-08T00:34:10.420 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.413+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5180159620 con 0x7f518006bcd0 2023-10-08T00:34:10.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.414+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518004c3c0 con 0x7f518006bcd0 2023-10-08T00:34:10.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.414+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5170003030 con 0x7f518006bcd0 2023-10-08T00:34:10.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.415+0000 7f51767fc700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5160067320 0x7f51600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.415+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f5170084be0 con 0x7f518006bcd0 2023-10-08T00:34:10.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.415+0000 7f517dd9b700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5160067320 0x7f51600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.421 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.415+0000 7f517dd9b700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5160067320 0x7f51600697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5180156bb0 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.419+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5170051820 con 0x7f518006bcd0 2023-10-08T00:34:10.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.614+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f518015aff0 con 0x7f518006bcd0 2023-10-08T00:34:10.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.615+0000 7f51767fc700 1 -- 172.21.15.22:0/3734590358 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f5170054e40 con 0x7f518006bcd0 2023-10-08T00:34:10.617 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:10.617 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":190,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:07.690501+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000871725.meta","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000871725"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000871725.data","create_time":"2023-10-08T00:33:52.705475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000871725"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5160067320 msgr2=0x7f51600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5160067320 0x7f51600697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5180156bb0 tx=0x7f5168008040 comp rx=0 tx=0).stop 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 msgr2=0x7f5180156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 0x7f5180156670 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f517000c8e0 tx=0x7f5170001710 comp rx=0 tx=0).stop 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 shutdown_connections 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f518015df50 0x7f518016ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f518006bcd0 0x7f5180156670 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5160067320 0x7f51600697d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 --2- 172.21.15.22:0/3734590358 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f518006c0a0 0x7f51801590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 >> 172.21.15.22:0/3734590358 conn(0x7f51800ce600 msgr2=0x7f518006a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 shutdown_connections 2023-10-08T00:34:10.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.617+0000 7f5184b30700 1 -- 172.21.15.22:0/3734590358 wait complete. 2023-10-08T00:34:10.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 31, 'pool_name': 'cephfs.volume_0000000000871725.meta', 'create_time': '2023-10-08T00:33:52.144999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000871725'}}}, {'pool': 32, 'pool_name': 'cephfs.volume_0000000000871725.data', 'create_time': '2023-10-08T00:33:52.705475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000871725'}}}] 2023-10-08T00:34:10.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:34:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.753+0000 7f772629e700 1 Processor -- start 2023-10-08T00:34:10.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.753+0000 7f772629e700 1 -- start start 2023-10-08T00:34:10.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f772629e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f772006bcd0 0x7f77200caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f772629e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f772006c0a0 0x7f772015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f772629e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f772015d7e0 con 0x7f772015df50 2023-10-08T00:34:10.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f772629e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772015dac0 con 0x7f772006c0a0 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f772629e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f772015aa30 con 0x7f772006bcd0 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f771f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f772006c0a0 0x7f772015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f771f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f772006c0a0 0x7f772015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46114/0 (socket says 172.21.15.22:46114) 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.754+0000 7f771f7fe700 1 -- 172.21.15.22:0/3100552876 learned_addr learned my addr 172.21.15.22:0/3100552876 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771ffff700 1 --2- 172.21.15.22:0/3100552876 >> v2:172.21.15.192:3300/0 conn(0x7f772006bcd0 0x7f77200caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771f7fe700 1 -- 172.21.15.22:0/3100552876 >> v2:172.21.15.192:3300/0 conn(0x7f772006bcd0 msgr2=0x7f77200caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771f7fe700 1 --2- 172.21.15.22:0/3100552876 >> v2:172.21.15.192:3300/0 conn(0x7f772006bcd0 0x7f77200caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771f7fe700 1 -- 172.21.15.22:0/3100552876 >> v1:172.21.15.192:6789/0 conn(0x7f772015df50 legacy=0x7f77200c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.759 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771f7fe700 1 -- 172.21.15.22:0/3100552876 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772015ad10 con 0x7f772006c0a0 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771f7fe700 1 --2- 172.21.15.22:0/3100552876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f772015a1e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f77200691a0 tx=0x7f7708009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cfe5ae7ca1fc19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771effd700 1 -- 172.21.15.22:0/3100552876 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800b860 con 0x7f772006c0a0 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771effd700 1 -- 172.21.15.22:0/3100552876 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770800b9c0 con 0x7f772006c0a0 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.755+0000 7f771effd700 1 -- 172.21.15.22:0/3100552876 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800bd80 con 0x7f772006c0a0 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 -- 172.21.15.22:0/3100552876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 msgr2=0x7f772015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 --2- 172.21.15.22:0/3100552876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f772015a1e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f77200691a0 tx=0x7f7708009250 comp rx=0 tx=0).stop 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 -- 172.21.15.22:0/3100552876 shutdown_connections 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 --2- 172.21.15.22:0/3100552876 >> v2:172.21.15.192:3300/0 conn(0x7f772006bcd0 0x7f77200caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 --2- 172.21.15.22:0/3100552876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f772015a1e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 -- 172.21.15.22:0/3100552876 >> 172.21.15.22:0/3100552876 conn(0x7f77200ce600 msgr2=0x7f77200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:10.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 -- 172.21.15.22:0/3100552876 shutdown_connections 2023-10-08T00:34:10.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.756+0000 7f772629e700 1 -- 172.21.15.22:0/3100552876 wait complete. 2023-10-08T00:34:10.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.757+0000 7f772629e700 1 Processor -- start 2023-10-08T00:34:10.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.757+0000 7f772629e700 1 -- start start 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f772006bcd0 0x7f7720152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f7720147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f772015df50 0x7f7720069700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772016e000 con 0x7f772006c0a0 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772016d3f0 con 0x7f772015df50 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f772016d6d0 con 0x7f772006bcd0 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f7720147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f7720147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46120/0 (socket says 172.21.15.22:46120) 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 -- 172.21.15.22:0/3261248294 learned_addr learned my addr 172.21.15.22:0/3261248294 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:10.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 -- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f772006bcd0 msgr2=0x7f7720152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f772006bcd0 0x7f7720152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 -- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f772015df50 msgr2=0x7f7720069700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772483b700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f772015df50 0x7f7720069700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f772015df50 0x7f7720069700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 -- 172.21.15.22:0/3261248294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080094f0 con 0x7f772006c0a0 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f771f7fe700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f7720147230 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f7720069220 tx=0x7f7708017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770801f070 con 0x7f772006c0a0 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708002f30 con 0x7f772006c0a0 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708025420 con 0x7f772006c0a0 2023-10-08T00:34:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772016d9b0 con 0x7f772006c0a0 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.758+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7720156030 con 0x7f772006c0a0 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.759+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772004c3c0 con 0x7f772006c0a0 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.760+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7708023070 con 0x7f772006c0a0 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.760+0000 7f7717fff700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7700067320 0x7f77000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.760+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f7708086170 con 0x7f772006c0a0 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.760+0000 7f771ffff700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7700067320 0x7f77000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.761+0000 7f771ffff700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7700067320 0x7f77000697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7720155ad0 tx=0x7f7710008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:10.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.764+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7708052db0 con 0x7f772006c0a0 2023-10-08T00:34:10.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.956+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f772016e140 con 0x7f772006c0a0 2023-10-08T00:34:10.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.957+0000 7f7717fff700 1 -- 172.21.15.22:0/3261248294 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v190) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7708015020 con 0x7f772006c0a0 2023-10-08T00:34:10.958 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:34:10.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.958+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7700067320 msgr2=0x7f77000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7700067320 0x7f77000697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7720155ad0 tx=0x7f7710008040 comp rx=0 tx=0).stop 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 msgr2=0x7f7720147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f7720147230 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f7720069220 tx=0x7f7708017000 comp rx=0 tx=0).stop 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 shutdown_connections 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f772015df50 0x7f7720069700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7700067320 0x7f77000697d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f772006bcd0 0x7f7720152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 --2- 172.21.15.22:0/3261248294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f772006c0a0 0x7f7720147230 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 >> 172.21.15.22:0/3261248294 conn(0x7f77200ce600 msgr2=0x7f77200c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 shutdown_connections 2023-10-08T00:34:10.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:10.959+0000 7f772629e700 1 -- 172.21.15.22:0/3261248294 wait complete. 2023-10-08T00:34:10.972 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000871725.meta pg_num 2023-10-08T00:34:11.094 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.092+0000 7f61d065b700 1 Processor -- start 2023-10-08T00:34:11.095 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.093+0000 7f61d065b700 1 -- start start 2023-10-08T00:34:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.093+0000 7f61d065b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61c8159c60 0x7f61c815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.093+0000 7f61d065b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c815db10 0x7f61c8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.093+0000 7f61d065b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c815a160 con 0x7f61c8159890 2023-10-08T00:34:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.093+0000 7f61d065b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c815df50 con 0x7f61c8159c60 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.093+0000 7f61d065b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80d13a0 con 0x7f61c815db10 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cdbf6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61c8159c60 0x7f61c815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cebf8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c815db10 0x7f61c8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61ce3f7700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f61c8159890 0x7f61c815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:38484/0 (socket says 172.21.15.22:38484) 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61ce3f7700 1 -- 172.21.15.22:0/2864656052 learned_addr learned my addr 172.21.15.22:0/2864656052 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cd3f5700 1 -- 172.21.15.22:0/2864656052 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115826184 0 0) 0x7f61c815a160 con 0x7f61c8159890 2023-10-08T00:34:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cd3f5700 1 -- 172.21.15.22:0/2864656052 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b0003570 con 0x7f61c8159890 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cebf8700 1 -- 172.21.15.22:0/2864656052 >> v2:172.21.15.192:3300/0 conn(0x7f61c8159c60 msgr2=0x7f61c815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cebf8700 1 --2- 172.21.15.22:0/2864656052 >> v2:172.21.15.192:3300/0 conn(0x7f61c8159c60 0x7f61c815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cebf8700 1 -- 172.21.15.22:0/2864656052 >> v1:172.21.15.192:6789/0 conn(0x7f61c8159890 legacy=0x7f61c815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cebf8700 1 -- 172.21.15.22:0/2864656052 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c815e140 con 0x7f61c815db10 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.094+0000 7f61cdbf6700 1 --2- 172.21.15.22:0/2864656052 >> v2:172.21.15.192:3300/0 conn(0x7f61c8159c60 0x7f61c815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61cebf8700 1 --2- 172.21.15.22:0/2864656052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c815db10 0x7f61c8069560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098e0 tx=0x7f61b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5633bafbe3a45fdd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61cd3f5700 1 -- 172.21.15.22:0/2864656052 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011630 con 0x7f61c815db10 2023-10-08T00:34:11.099 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61cd3f5700 1 -- 172.21.15.22:0/2864656052 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8011790 con 0x7f61c815db10 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61cd3f5700 1 -- 172.21.15.22:0/2864656052 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011b30 con 0x7f61c815db10 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 -- 172.21.15.22:0/2864656052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c815db10 msgr2=0x7f61c8069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 --2- 172.21.15.22:0/2864656052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c815db10 0x7f61c8069560 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61b80098e0 tx=0x7f61b80091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 -- 172.21.15.22:0/2864656052 shutdown_connections 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 --2- 172.21.15.22:0/2864656052 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c815db10 0x7f61c8069560 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 --2- 172.21.15.22:0/2864656052 >> v2:172.21.15.192:3300/0 conn(0x7f61c8159c60 0x7f61c815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 -- 172.21.15.22:0/2864656052 >> 172.21.15.22:0/2864656052 conn(0x7f61c8068e20 msgr2=0x7f61c80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 -- 172.21.15.22:0/2864656052 shutdown_connections 2023-10-08T00:34:11.100 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.095+0000 7f61d065b700 1 -- 172.21.15.22:0/2864656052 wait complete. 2023-10-08T00:34:11.107 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 Processor -- start 2023-10-08T00:34:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 -- start start 2023-10-08T00:34:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 0x7f61c80ce330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c8159c60 0x7f61c8141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c815db10 0x7f61c8142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c81427c0 con 0x7f61c8159890 2023-10-08T00:34:11.108 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c81515d0 con 0x7f61c815db10 2023-10-08T00:34:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61d065b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c815cf90 con 0x7f61c8159c60 2023-10-08T00:34:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61ce3f7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 0x7f61c80ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.097+0000 7f61ce3f7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 0x7f61c80ce330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46130/0 (socket says 172.21.15.22:46130) 2023-10-08T00:34:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 -- 172.21.15.22:0/3898395851 learned_addr learned my addr 172.21.15.22:0/3898395851 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:11.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61cdbf6700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c8159c60 0x7f61c8141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61cebf8700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c815db10 0x7f61c8142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 -- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c8159c60 msgr2=0x7f61c8141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c8159c60 0x7f61c8141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 -- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c815db10 msgr2=0x7f61c8142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c815db10 0x7f61c8142280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 -- 172.21.15.22:0/3898395851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc009420 con 0x7f61c8159890 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61ce3f7700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 0x7f61c80ce330 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f61c000cd30 tx=0x7f61c0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000ab70 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000acf0 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b8009420 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0007340 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.098+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c815d550 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.099+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c81513a0 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.100+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f61c0007770 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.100+0000 7f61c67fc700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61b4067320 0x7f61b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.100+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f61c00851a0 con 0x7f61c8159890 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.100+0000 7f61cdbf6700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61b4067320 0x7f61b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.101+0000 7f61cdbf6700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61b4067320 0x7f61b40697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0093f0 tx=0x7f61bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.104+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61c81513a0 con 0x7f61c8159890 2023-10-08T00:34:11.298 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.295+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000871725.meta", "var": "pg_num"} v 0) v1 -- 0x7f61c81513a0 con 0x7f61c8159890 2023-10-08T00:34:11.299 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.296+0000 7f61c67fc700 1 -- 172.21.15.22:0/3898395851 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000871725.meta", "var": "pg_num"}]=0 v190) v1 ==== 124+0+11 (secure 0 0 0) 0x7f61c81513a0 con 0x7f61c8159890 2023-10-08T00:34:11.299 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:34:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61b4067320 msgr2=0x7f61b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61b4067320 0x7f61b40697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0093f0 tx=0x7f61bc008040 comp rx=0 tx=0).stop 2023-10-08T00:34:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 msgr2=0x7f61c80ce330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 0x7f61c80ce330 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f61c000cd30 tx=0x7f61c0001b10 comp rx=0 tx=0).stop 2023-10-08T00:34:11.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 shutdown_connections 2023-10-08T00:34:11.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c815db10 0x7f61c8142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.302 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61c8159890 0x7f61c80ce330 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f61b4067320 0x7f61b40697d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 --2- 172.21.15.22:0/3898395851 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f61c8159c60 0x7f61c8141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 >> 172.21.15.22:0/3898395851 conn(0x7f61c8068e20 msgr2=0x7f61c81544b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 shutdown_connections 2023-10-08T00:34:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.298+0000 7f61d065b700 1 -- 172.21.15.22:0/3898395851 wait complete. 2023-10-08T00:34:11.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000871725.data pg_num 2023-10-08T00:34:11.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.432+0000 7f2d31767700 1 Processor -- start 2023-10-08T00:34:11.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.432+0000 7f2d31767700 1 -- start start 2023-10-08T00:34:11.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d31767700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d31767700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d31767700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c15a160 con 0x7f2d2c15db10 2023-10-08T00:34:11.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d31767700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c0d13a0 con 0x7f2d2c159890 2023-10-08T00:34:11.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d31767700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c15e140 con 0x7f2d2c159c60 2023-10-08T00:34:11.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2d2c15db10 0x7f2d2c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56066/0 (socket says 172.21.15.22:56066) 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2b7fe700 1 -- 172.21.15.22:0/1180641773 learned_addr learned my addr 172.21.15.22:0/1180641773 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2affd700 1 --2- 172.21.15.22:0/1180641773 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/1180641773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d29ffb700 1 -- 172.21.15.22:0/1180641773 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242465713 0 0) 0x7f2d2c15a160 con 0x7f2d2c15db10 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d29ffb700 1 -- 172.21.15.22:0/1180641773 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d18003570 con 0x7f2d2c15db10 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2a7fc700 1 -- 172.21.15.22:0/1180641773 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 msgr2=0x7f2d2c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/1180641773 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2a7fc700 1 -- 172.21.15.22:0/1180641773 >> v1:172.21.15.22:6789/0 conn(0x7f2d2c15db10 legacy=0x7f2d2c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2a7fc700 1 -- 172.21.15.22:0/1180641773 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c15a3d0 con 0x7f2d2c159c60 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.433+0000 7f2d2affd700 1 --2- 172.21.15.22:0/1180641773 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/1180641773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2d140098e0 tx=0x7f2d140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3d30b67d9d9f7a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d29ffb700 1 -- 172.21.15.22:0/1180641773 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011630 con 0x7f2d2c159c60 2023-10-08T00:34:11.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d29ffb700 1 -- 172.21.15.22:0/1180641773 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14011790 con 0x7f2d2c159c60 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d29ffb700 1 -- 172.21.15.22:0/1180641773 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011b30 con 0x7f2d2c159c60 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 -- 172.21.15.22:0/1180641773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159c60 msgr2=0x7f2d2c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 --2- 172.21.15.22:0/1180641773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2d140098e0 tx=0x7f2d140091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 -- 172.21.15.22:0/1180641773 shutdown_connections 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 --2- 172.21.15.22:0/1180641773 >> v2:172.21.15.192:3300/0 conn(0x7f2d2c159890 0x7f2d2c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 --2- 172.21.15.22:0/1180641773 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c159c60 0x7f2d2c15d5d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 -- 172.21.15.22:0/1180641773 >> 172.21.15.22:0/1180641773 conn(0x7f2d2c068e20 msgr2=0x7f2d2c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 -- 172.21.15.22:0/1180641773 shutdown_connections 2023-10-08T00:34:11.438 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.434+0000 7f2d31767700 1 -- 172.21.15.22:0/1180641773 wait complete. 2023-10-08T00:34:11.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 Processor -- start 2023-10-08T00:34:11.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 -- start start 2023-10-08T00:34:11.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 0x7f2d2c16a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.441 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c15db10 0x7f2d2c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c154d10 con 0x7f2d2c159890 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c154ab0 con 0x7f2d2c159c60 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d31767700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c15b930 con 0x7f2d2c15db10 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d2affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 0x7f2d2c16a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d2affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 0x7f2d2c16a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46132/0 (socket says 172.21.15.22:46132) 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.436+0000 7f2d2affd700 1 -- 172.21.15.22:0/2089333522 learned_addr learned my addr 172.21.15.22:0/2089333522 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2b7fe700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c15db10 0x7f2d2c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2affd700 1 -- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c15db10 msgr2=0x7f2d2c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.442 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2affd700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c15db10 0x7f2d2c154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2affd700 1 -- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 msgr2=0x7f2d2c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2affd700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2affd700 1 -- 172.21.15.22:0/2089333522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009420 con 0x7f2d2c159890 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2b7fe700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c15db10 0x7f2d2c154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d2affd700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 0x7f2d2c16a7c0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400ec80 tx=0x7f2d240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400c9d0 con 0x7f2d2c159890 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d14009420 con 0x7f2d2c159890 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2400cb30 con 0x7f2d2c159890 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2400ceb0 con 0x7f2d2c159890 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.437+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c15bef0 con 0x7f2d2c159890 2023-10-08T00:34:11.443 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.438+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2c151440 con 0x7f2d2c159890 2023-10-08T00:34:11.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.438+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2d24013680 con 0x7f2d2c159890 2023-10-08T00:34:11.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.439+0000 7f2d22ffd700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c067320 0x7f2d0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.439+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2d24085140 con 0x7f2d2c159890 2023-10-08T00:34:11.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.439+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c067320 0x7f2d0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.440+0000 7f2d2a7fc700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c067320 0x7f2d0c0697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c15a090 tx=0x7f2d14017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.443+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d24051d80 con 0x7f2d2c159890 2023-10-08T00:34:11.636 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.635+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000871725.data", "var": "pg_num"} v 0) v1 -- 0x7f2d2c04c3c0 con 0x7f2d2c159890 2023-10-08T00:34:11.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.635+0000 7f2d22ffd700 1 -- 172.21.15.22:0/2089333522 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000871725.data", "var": "pg_num"}]=0 v190) v1 ==== 124+0+11 (secure 0 0 0) 0x7f2d240553a0 con 0x7f2d2c159890 2023-10-08T00:34:11.637 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:34:11.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c067320 msgr2=0x7f2d0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c067320 0x7f2d0c0697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c15a090 tx=0x7f2d14017000 comp rx=0 tx=0).stop 2023-10-08T00:34:11.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 msgr2=0x7f2d2c16a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 0x7f2d2c16a7c0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400ec80 tx=0x7f2d240091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 shutdown_connections 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2d0c067320 0x7f2d0c0697d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d2c15db10 0x7f2d2c154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d2c159890 0x7f2d2c16a7c0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 --2- 172.21.15.22:0/2089333522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d2c159c60 0x7f2d2c150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 >> 172.21.15.22:0/2089333522 conn(0x7f2d2c068e20 msgr2=0x7f2d2c0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.637+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 shutdown_connections 2023-10-08T00:34:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.638+0000 7f2d31767700 1 -- 172.21.15.22:0/2089333522 wait complete. 2023-10-08T00:34:11.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:11.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.769+0000 7fa7c0ff0700 1 Processor -- start 2023-10-08T00:34:11.771 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.769+0000 7fa7c0ff0700 1 -- start start 2023-10-08T00:34:11.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.770+0000 7fa7c0ff0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7bc0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.770+0000 7fa7c0ff0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc15c2a0 con 0x7fa7bc06c0a0 2023-10-08T00:34:11.774 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.770+0000 7fa7c0ff0700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc15b690 con 0x7fa7bc06bcd0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.770+0000 7fa7c0ff0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc15b970 con 0x7fa7bc141500 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.770+0000 7fa7bad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa7bc06c0a0 0x7fa7bc0c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56076/0 (socket says 172.21.15.22:56076) 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.770+0000 7fa7bad9d700 1 -- 172.21.15.22:0/1024671888 learned_addr learned my addr 172.21.15.22:0/1024671888 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b9d9b700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7bc0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615395153 0 0) 0x7fa7bc15c2a0 con 0x7fa7bc06c0a0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a8003570 con 0x7fa7bc06c0a0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542987639 0 0) 0x7fa7bc15b690 con 0x7fa7bc06bcd0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7bc15c2a0 con 0x7fa7bc06bcd0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712948609 0 0) 0x7fa7a8003570 con 0x7fa7bc06c0a0 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 msgr2=0x7fa7bc0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7bc0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 >> v1:172.21.15.192:6789/0 conn(0x7fa7bc06bcd0 legacy=0x7fa7bc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc15bc50 con 0x7fa7bc06c0a0 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fa7b4001470 con 0x7fa7bc06c0a0 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b9d9b700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7bc0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 >> v1:172.21.15.22:6789/0 conn(0x7fa7bc06c0a0 legacy=0x7fa7bc0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7a8003c20 0x7fa7a8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc15b970 con 0x7fa7a8004d50 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a800bb10 con 0x7fa7a8003c20 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a800bcd0 con 0x7fa7bc141500 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7ba59c700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7a8003c20 0x7fa7a8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.771+0000 7fa7b9d9b700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 -- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 msgr2=0x7fa7a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7bc141500 0x7fa7a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 -- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7a8003c20 msgr2=0x7fa7a8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7a8003c20 0x7fa7a8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 -- 172.21.15.22:0/1024671888 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4009420 con 0x7fa7a8004d50 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c2d0 tx=0x7fa7bc06e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b909c9c37f162801 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400cc00 con 0x7fa7a8004d50 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400cd60 con 0x7fa7a8004d50 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7b959a700 1 -- 172.21.15.22:0/1024671888 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4005b70 con 0x7fa7a8004d50 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/1024671888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7a8004d50 msgr2=0x7fa7a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/1024671888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7a8004d50 0x7fa7a80051c0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c2d0 tx=0x7fa7bc06e470 comp rx=0 tx=0).stop 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7bad9d700 1 -- 172.21.15.22:0/1024671888 reap_dead start 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/1024671888 shutdown_connections 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/1024671888 >> 172.21.15.22:0/1024671888 conn(0x7fa7bc0ce600 msgr2=0x7fa7bc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/1024671888 shutdown_connections 2023-10-08T00:34:11.778 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.772+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/1024671888 wait complete. 2023-10-08T00:34:11.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 Processor -- start 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 -- start start 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7a8004d50 0x7fa7bc16b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7bc16be00 0x7fa7bc14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 0x7fa7bc13b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc16c270 con 0x7fa7bc14eb10 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1504d0 con 0x7fa7bc16be00 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7c0ff0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc150960 con 0x7fa7a8004d50 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7bad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 0x7fa7bc13b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7bad9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 0x7fa7bc13b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46156/0 (socket says 172.21.15.22:46156) 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7bad9d700 1 -- 172.21.15.22:0/3923599186 learned_addr learned my addr 172.21.15.22:0/3923599186 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7ba59c700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7a8004d50 0x7fa7bc16b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.774+0000 7fa7b9d9b700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7bc16be00 0x7fa7bc14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7bad9d700 1 -- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7a8004d50 msgr2=0x7fa7bc16b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7a8004d50 0x7fa7bc16b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7bad9d700 1 -- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7bc16be00 msgr2=0x7fa7bc14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7bc16be00 0x7fa7bc14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7bad9d700 1 -- 172.21.15.22:0/3923599186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc14f8c0 con 0x7fa7bc14eb10 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7bad9d700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 0x7fa7bc13b930 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001ed0 tx=0x7fa7b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4023070 con 0x7fa7bc14eb10 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4004a40 con 0x7fa7bc14eb10 2023-10-08T00:34:11.783 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc14fba0 con 0x7fa7bc14eb10 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004e20 con 0x7fa7bc14eb10 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.775+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc150160 con 0x7fa7bc14eb10 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.776+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc150680 con 0x7fa7bc14eb10 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.776+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7b4019070 con 0x7fa7bc14eb10 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.777+0000 7fa7b27fc700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa79c067320 0x7fa79c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.777+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fa7b4085880 con 0x7fa7bc14eb10 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.777+0000 7fa7ba59c700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa79c067320 0x7fa79c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.778+0000 7fa7ba59c700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa79c067320 0x7fa79c0697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc15b090 tx=0x7fa7ac0017a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:11.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:11.781+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7bc150680 con 0x7fa7bc14eb10 2023-10-08T00:34:12.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.022+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7bc150640 con 0x7fa7bc14eb10 2023-10-08T00:34:12.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.022+0000 7fa7b27fc700 1 -- 172.21.15.22:0/3923599186 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fa7b4017020 con 0x7fa7bc14eb10 2023-10-08T00:34:12.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:12.024 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":128,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:34:05.678513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000871725","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:34:12.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa79c067320 msgr2=0x7fa79c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa79c067320 0x7fa79c0697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc15b090 tx=0x7fa7ac0017a0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 msgr2=0x7fa7bc13b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 0x7fa7bc13b930 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4001ed0 tx=0x7fa7b4015000 comp rx=0 tx=0).stop 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 shutdown_connections 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7bc14eb10 0x7fa7bc13b930 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa79c067320 0x7fa79c0697d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa7a8004d50 0x7fa7bc16b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 --2- 172.21.15.22:0/3923599186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7bc16be00 0x7fa7bc14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.024+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 >> 172.21.15.22:0/3923599186 conn(0x7fa7bc0ce600 msgr2=0x7fa7bc0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.025+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 shutdown_connections 2023-10-08T00:34:12.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.025+0000 7fa7c0ff0700 1 -- 172.21.15.22:0/3923599186 wait complete. 2023-10-08T00:34:12.028 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 128 2023-10-08T00:34:12.038 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:12.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 Processor -- start 2023-10-08T00:34:12.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 -- start start 2023-10-08T00:34:12.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec159c10 0x7f03ec15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03ec0b5ea0 0x7f03ec068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f03ec068bb0 0x7f03ec15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec0b2a40 con 0x7f03ec0b5ea0 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec15c480 con 0x7f03ec068bb0 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.156+0000 7f03f291f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec15b5d0 con 0x7f03ec159c10 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03ec0b5ea0 0x7f03ec068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03ec0b5ea0 0x7f03ec068670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46168/0 (socket says 172.21.15.22:46168) 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 -- 172.21.15.22:0/2197226667 learned_addr learned my addr 172.21.15.22:0/2197226667 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03f0ebc700 1 --2- 172.21.15.22:0/2197226667 >> v2:172.21.15.192:3300/0 conn(0x7f03ec068bb0 0x7f03ec15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03ebfff700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec159c10 0x7f03ec15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 -- 172.21.15.22:0/2197226667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec159c10 msgr2=0x7f03ec15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec159c10 0x7f03ec15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 -- 172.21.15.22:0/2197226667 >> v2:172.21.15.192:3300/0 conn(0x7f03ec068bb0 msgr2=0x7f03ec15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 --2- 172.21.15.22:0/2197226667 >> v2:172.21.15.192:3300/0 conn(0x7f03ec068bb0 0x7f03ec15c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 -- 172.21.15.22:0/2197226667 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec15b870 con 0x7f03ec0b5ea0 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03ebfff700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec159c10 0x7f03ec15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:12.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eb7fe700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec0b5ea0 0x7f03ec068670 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f03ec08af20 tx=0x7f03d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fb7c6ef56076f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eaffd700 1 -- 172.21.15.22:0/2197226667 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400b860 con 0x7f03ec0b5ea0 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eaffd700 1 -- 172.21.15.22:0/2197226667 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400b9c0 con 0x7f03ec0b5ea0 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.157+0000 7f03eaffd700 1 -- 172.21.15.22:0/2197226667 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400bd60 con 0x7f03ec0b5ea0 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 -- 172.21.15.22:0/2197226667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec0b5ea0 msgr2=0x7f03ec068670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec0b5ea0 0x7f03ec068670 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f03ec08af20 tx=0x7f03d4009250 comp rx=0 tx=0).stop 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 -- 172.21.15.22:0/2197226667 shutdown_connections 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 --2- 172.21.15.22:0/2197226667 >> v2:172.21.15.192:3300/0 conn(0x7f03ec068bb0 0x7f03ec15c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec159c10 0x7f03ec15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 --2- 172.21.15.22:0/2197226667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec0b5ea0 0x7f03ec068670 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 -- 172.21.15.22:0/2197226667 >> 172.21.15.22:0/2197226667 conn(0x7f03ec099a20 msgr2=0x7f03ec0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:12.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 -- 172.21.15.22:0/2197226667 shutdown_connections 2023-10-08T00:34:12.164 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.158+0000 7f03f291f700 1 -- 172.21.15.22:0/2197226667 wait complete. 2023-10-08T00:34:12.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.159+0000 7f03f291f700 1 Processor -- start 2023-10-08T00:34:12.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.159+0000 7f03f291f700 1 -- start start 2023-10-08T00:34:12.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f291f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03ec068bb0 0x7f03ec157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f291f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec0b5ea0 0x7f03ec0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f291f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 0x7f03ec0c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f291f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0af710 con 0x7f03ec159c10 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f291f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0c6780 con 0x7f03ec068bb0 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f291f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0c6a60 con 0x7f03ec0b5ea0 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 0x7f03ec0c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 0x7f03ec0c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46180/0 (socket says 172.21.15.22:46180) 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 -- 172.21.15.22:0/831587312 learned_addr learned my addr 172.21.15.22:0/831587312 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03eb7fe700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec0b5ea0 0x7f03ec0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03ebfff700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03ec068bb0 0x7f03ec157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 -- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec0b5ea0 msgr2=0x7f03ec0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec0b5ea0 0x7f03ec0c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 -- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03ec068bb0 msgr2=0x7f03ec157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03ec068bb0 0x7f03ec157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.160+0000 7f03f0ebc700 1 -- 172.21.15.22:0/831587312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40094f0 con 0x7f03ec159c10 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.161+0000 7f03f0ebc700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 0x7f03ec0c72c0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fa0 tx=0x7f03e4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.161+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e400ebc0 con 0x7f03ec159c10 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.161+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e400ed20 con 0x7f03ec159c10 2023-10-08T00:34:12.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.161+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4014670 con 0x7f03ec159c10 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.161+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec0c6d40 con 0x7f03ec159c10 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.161+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec157b40 con 0x7f03ec159c10 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.162+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec0af8c0 con 0x7f03ec159c10 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.162+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f03e40149e0 con 0x7f03ec159c10 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.163+0000 7f03e3fff700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03cc067320 0x7f03cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.163+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f03e4085320 con 0x7f03ec159c10 2023-10-08T00:34:12.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.163+0000 7f03ebfff700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03cc067320 0x7f03cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.163+0000 7f03ebfff700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03cc067320 0x7f03cc0697d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f03dc006fd0 tx=0x7f03dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.167+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03ec0af8c0 con 0x7f03ec159c10 2023-10-08T00:34:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.361+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03ec04c3c0 con 0x7f03ec159c10 2023-10-08T00:34:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.362+0000 7f03e3fff700 1 -- 172.21.15.22:0/831587312 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f03e4051f60 con 0x7f03ec159c10 2023-10-08T00:34:12.364 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:12.364 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":190,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:07.690501+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000871725.meta","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000871725"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000871725.data","create_time":"2023-10-08T00:33:52.705475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000871725"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03cc067320 msgr2=0x7f03cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03cc067320 0x7f03cc0697d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f03dc006fd0 tx=0x7f03dc008040 comp rx=0 tx=0).stop 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 msgr2=0x7f03ec0c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 0x7f03ec0c72c0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fa0 tx=0x7f03e4009900 comp rx=0 tx=0).stop 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 shutdown_connections 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03ec159c10 0x7f03ec0c72c0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f03ec068bb0 0x7f03ec157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f03cc067320 0x7f03cc0697d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 --2- 172.21.15.22:0/831587312 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f03ec0b5ea0 0x7f03ec0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 >> 172.21.15.22:0/831587312 conn(0x7f03ec099a20 msgr2=0x7f03ec09a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 shutdown_connections 2023-10-08T00:34:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.364+0000 7f03f291f700 1 -- 172.21.15.22:0/831587312 wait complete. 2023-10-08T00:34:12.378 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000871725 and related pools 2023-10-08T00:34:12.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:12.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.496+0000 7fc1958ef700 1 Processor -- start 2023-10-08T00:34:12.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.496+0000 7fc1958ef700 1 -- start start 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc1958ef700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc190159c10 0x7fc19015b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc1958ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc19015c910 0x7fc19015cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc1958ef700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc19015c480 con 0x7fc1900b5ea0 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc1958ef700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900b2a40 con 0x7fc190159c10 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc1958ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19015d290 con 0x7fc19015c910 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc18effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc190159c10 0x7fc19015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc18e7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc1900b5ea0 0x7fc190068670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56080/0 (socket says 172.21.15.22:56080) 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.497+0000 7fc18e7fc700 1 -- 172.21.15.22:0/891550868 learned_addr learned my addr 172.21.15.22:0/891550868 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18f7fe700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc19015c910 0x7fc19015cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18effd700 1 -- 172.21.15.22:0/891550868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc19015c910 msgr2=0x7fc19015cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18effd700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc19015c910 0x7fc19015cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18effd700 1 -- 172.21.15.22:0/891550868 >> v1:172.21.15.22:6789/0 conn(0x7fc1900b5ea0 legacy=0x7fc190068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18effd700 1 -- 172.21.15.22:0/891550868 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19015b5d0 con 0x7fc190159c10 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18dffb700 1 -- 172.21.15.22:0/891550868 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987475982 0 0) 0x7fc19015c480 con 0x7fc1900b5ea0 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18f7fe700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc19015c910 0x7fc19015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18effd700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19015b090 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc1880098e0 tx=0x7fc1880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c950c6c889a005 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18dffb700 1 -- 172.21.15.22:0/891550868 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188009e80 con 0x7fc190159c10 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18dffb700 1 -- 172.21.15.22:0/891550868 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18800b860 con 0x7fc190159c10 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc18dffb700 1 -- 172.21.15.22:0/891550868 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800bbe0 con 0x7fc190159c10 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc1958ef700 1 -- 172.21.15.22:0/891550868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 msgr2=0x7fc19015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.498+0000 7fc1958ef700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19015b090 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc1880098e0 tx=0x7fc1880091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.499+0000 7fc1958ef700 1 -- 172.21.15.22:0/891550868 shutdown_connections 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.499+0000 7fc1958ef700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc19015c910 0x7fc19015cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.499+0000 7fc1958ef700 1 --2- 172.21.15.22:0/891550868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19015b090 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.499+0000 7fc1958ef700 1 -- 172.21.15.22:0/891550868 >> 172.21.15.22:0/891550868 conn(0x7fc190099a20 msgr2=0x7fc1900af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.499+0000 7fc1958ef700 1 -- 172.21.15.22:0/891550868 shutdown_connections 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.499+0000 7fc1958ef700 1 -- 172.21.15.22:0/891550868 wait complete. 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.500+0000 7fc1958ef700 1 Processor -- start 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.500+0000 7fc1958ef700 1 -- start start 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900b5ea0 0x7fc1900c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19016d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc19015c910 0x7fc19015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc190159460 con 0x7fc190159c10 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900ad390 con 0x7fc19015c910 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900c5b00 con 0x7fc1900b5ea0 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19016d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19016d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46208/0 (socket says 172.21.15.22:46208) 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 -- 172.21.15.22:0/4087222314 learned_addr learned my addr 172.21.15.22:0/4087222314 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18effd700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900b5ea0 0x7fc1900c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18f7fe700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc19015c910 0x7fc19015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 -- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900b5ea0 msgr2=0x7fc1900c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900b5ea0 0x7fc1900c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 -- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc19015c910 msgr2=0x7fc19015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc19015c910 0x7fc19015fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 -- 172.21.15.22:0/4087222314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009420 con 0x7fc190159c10 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18effd700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900b5ea0 0x7fc1900c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc18e7fc700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19016d9d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c7e0 tx=0x7fc178007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178005b30 con 0x7fc190159c10 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc178005c90 con 0x7fc190159c10 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1900ad5e0 con 0x7fc190159c10 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc178007300 con 0x7fc190159c10 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.501+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1900adba0 con 0x7fc190159c10 2023-10-08T00:34:12.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.502+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1900addc0 con 0x7fc190159c10 2023-10-08T00:34:12.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.503+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc17801b400 con 0x7fc190159c10 2023-10-08T00:34:12.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.503+0000 7fc186ffd700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc170067320 0x7fc1700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.503+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fc178084820 con 0x7fc190159c10 2023-10-08T00:34:12.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.503+0000 7fc18effd700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc170067320 0x7fc1700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.504+0000 7fc18effd700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc170067320 0x7fc1700697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc188003080 tx=0x7fc188017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.509 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.508+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc178051460 con 0x7fc190159c10 2023-10-08T00:34:12.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.746+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc19004c3c0 con 0x7fc190159c10 2023-10-08T00:34:12.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.746+0000 7fc186ffd700 1 -- 172.21.15.22:0/4087222314 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fc178054a80 con 0x7fc190159c10 2023-10-08T00:34:12.748 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:12.748 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":128,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:34:05.678513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000871725","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:34:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc170067320 msgr2=0x7fc1700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc170067320 0x7fc1700697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc188003080 tx=0x7fc188017000 comp rx=0 tx=0).stop 2023-10-08T00:34:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 msgr2=0x7fc19016d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19016d9d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c7e0 tx=0x7fc178007df0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 shutdown_connections 2023-10-08T00:34:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc19015c910 0x7fc19015fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc170067320 0x7fc1700697d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc1900b5ea0 0x7fc1900c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 --2- 172.21.15.22:0/4087222314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc190159c10 0x7fc19016d9d0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 >> 172.21.15.22:0/4087222314 conn(0x7fc190099a20 msgr2=0x7fc19009a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 shutdown_connections 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.748+0000 7fc1958ef700 1 -- 172.21.15.22:0/4087222314 wait complete. 2023-10-08T00:34:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 128 2023-10-08T00:34:12.762 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:12.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.879+0000 7fb0410d3700 1 Processor -- start 2023-10-08T00:34:12.881 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.879+0000 7fb0410d3700 1 -- start start 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb0410d3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb03c159890 0x7fb03c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb0410d3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb03c159c60 0x7fb03c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb0410d3700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c15a160 con 0x7fb03c15db10 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb0410d3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c15df50 con 0x7fb03c159890 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb0410d3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c0d13a0 con 0x7fb03c159c60 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb03ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb03c159890 0x7fb03c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb03ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb03c159890 0x7fb03c15abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46220/0 (socket says 172.21.15.22:46220) 2023-10-08T00:34:12.883 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb03ad9d700 1 -- 172.21.15.22:0/669156358 learned_addr learned my addr 172.21.15.22:0/669156358 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb03a59c700 1 --2- 172.21.15.22:0/669156358 >> v2:172.21.15.192:3300/0 conn(0x7fb03c159c60 0x7fb03c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb03ad9d700 1 -- 172.21.15.22:0/669156358 >> v2:172.21.15.192:3300/0 conn(0x7fb03c159c60 msgr2=0x7fb03c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.880+0000 7fb03ad9d700 1 --2- 172.21.15.22:0/669156358 >> v2:172.21.15.192:3300/0 conn(0x7fb03c159c60 0x7fb03c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb03ad9d700 1 -- 172.21.15.22:0/669156358 >> v1:172.21.15.192:6789/0 conn(0x7fb03c15db10 legacy=0x7fb03c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb03ad9d700 1 -- 172.21.15.22:0/669156358 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c15e140 con 0x7fb03c159890 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb03ad9d700 1 --2- 172.21.15.22:0/669156358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c159890 0x7fb03c15abd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b67f0 tx=0x7fb02c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd023ce207f729d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb039d9b700 1 -- 172.21.15.22:0/669156358 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00b820 con 0x7fb03c159890 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb039d9b700 1 -- 172.21.15.22:0/669156358 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00b980 con 0x7fb03c159890 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb039d9b700 1 -- 172.21.15.22:0/669156358 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00bd20 con 0x7fb03c159890 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 -- 172.21.15.22:0/669156358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c159890 msgr2=0x7fb03c15abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 --2- 172.21.15.22:0/669156358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c159890 0x7fb03c15abd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b67f0 tx=0x7fb02c009250 comp rx=0 tx=0).stop 2023-10-08T00:34:12.884 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 -- 172.21.15.22:0/669156358 shutdown_connections 2023-10-08T00:34:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 --2- 172.21.15.22:0/669156358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c159890 0x7fb03c15abd0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 --2- 172.21.15.22:0/669156358 >> v2:172.21.15.192:3300/0 conn(0x7fb03c159c60 0x7fb03c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 -- 172.21.15.22:0/669156358 >> 172.21.15.22:0/669156358 conn(0x7fb03c068e20 msgr2=0x7fb03c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 -- 172.21.15.22:0/669156358 shutdown_connections 2023-10-08T00:34:12.885 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.881+0000 7fb0410d3700 1 -- 172.21.15.22:0/669156358 wait complete. 2023-10-08T00:34:12.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 Processor -- start 2023-10-08T00:34:12.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 -- start start 2023-10-08T00:34:12.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c159890 0x7fb03c157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.887 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c159c60 0x7fb03c16a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 0x7fb03c0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c16b0d0 con 0x7fb03c15db10 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c16a600 con 0x7fb03c159890 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.883+0000 7fb0410d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c16a830 con 0x7fb03c159c60 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 0x7fb03c0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 0x7fb03c0ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46236/0 (socket says 172.21.15.22:46236) 2023-10-08T00:34:12.888 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 -- 172.21.15.22:0/1695883258 learned_addr learned my addr 172.21.15.22:0/1695883258 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03ad9d700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c159890 0x7fb03c157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03a59c700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c159c60 0x7fb03c16a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 -- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c159c60 msgr2=0x7fb03c16a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c159c60 0x7fb03c16a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 -- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c159890 msgr2=0x7fb03c157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c159890 0x7fb03c157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 -- 172.21.15.22:0/1695883258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0094f0 con 0x7fb03c15db10 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03ad9d700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c159890 0x7fb03c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb03b59e700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 0x7fb03c0ca190 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fb03400bc60 tx=0x7fb034009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03400c9c0 con 0x7fb03c15db10 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03400cb60 con 0x7fb03c15db10 2023-10-08T00:34:12.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c16ab10 con 0x7fb03c15db10 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034014410 con 0x7fb03c15db10 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.884+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c16b430 con 0x7fb03c15db10 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.885+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c16b290 con 0x7fb03c15db10 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.886+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb034014800 con 0x7fb03c15db10 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.886+0000 7fb032ffd700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb01c067320 0x7fb01c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.886+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb034084d40 con 0x7fb03c15db10 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.886+0000 7fb03ad9d700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb01c067320 0x7fb01c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:12.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.887+0000 7fb03ad9d700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb01c067320 0x7fb01c0697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b67f0 tx=0x7fb02c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:12.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:12.890+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb03404c5a0 con 0x7fb03c15db10 2023-10-08T00:34:13.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.131+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb03c16b650 con 0x7fb03c15db10 2023-10-08T00:34:13.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.132+0000 7fb032ffd700 1 -- 172.21.15.22:0/1695883258 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4627 (secure 0 0 0) 0x7fb03c16b290 con 0x7fb03c15db10 2023-10-08T00:34:13.134 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:13.134 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":128,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:33:53.755231+0000","modified":"2023-10-08T00:34:05.678513+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8721},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8721":{"gid":8721,"name":"a","rank":0,"incarnation":122,"state":"up:active","state_seq":3,"addr":"172.21.15.22:6835/663301846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":663301846},{"type":"v1","addr":"172.21.15.22:6835","nonce":663301846}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000871725","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb01c067320 msgr2=0x7fb01c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb01c067320 0x7fb01c0697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0b67f0 tx=0x7fb02c016000 comp rx=0 tx=0).stop 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 msgr2=0x7fb03c0ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 0x7fb03c0ca190 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fb03400bc60 tx=0x7fb034009820 comp rx=0 tx=0).stop 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 shutdown_connections 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb03c15db10 0x7fb03c0ca190 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb03c159890 0x7fb03c157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb01c067320 0x7fb01c0697d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 --2- 172.21.15.22:0/1695883258 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb03c159c60 0x7fb03c16a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 >> 172.21.15.22:0/1695883258 conn(0x7fb03c068e20 msgr2=0x7fb03c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:13.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 shutdown_connections 2023-10-08T00:34:13.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.134+0000 7fb0410d3700 1 -- 172.21.15.22:0/1695883258 wait complete. 2023-10-08T00:34:13.137 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 128 2023-10-08T00:34:13.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:13.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.265+0000 7f3000373700 1 Processor -- start 2023-10-08T00:34:13.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.265+0000 7f3000373700 1 -- start start 2023-10-08T00:34:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f3000373700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2ff8159890 0x7f2ff815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f3000373700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ff8069560 0x7f2ff80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f3000373700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff8069ee0 con 0x7f2ff8159c60 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f3000373700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff815a160 con 0x7f2ff8069560 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f3000373700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80d13a0 con 0x7f2ff8159890 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ff8069560 0x7f2ff80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2ff8069560 0x7f2ff80699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46240/0 (socket says 172.21.15.22:46240) 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 -- 172.21.15.22:0/2814976610 learned_addr learned my addr 172.21.15.22:0/2814976610 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe10f700 1 --2- 172.21.15.22:0/2814976610 >> v2:172.21.15.192:3300/0 conn(0x7f2ff8159890 0x7f2ff815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 -- 172.21.15.22:0/2814976610 >> v2:172.21.15.192:3300/0 conn(0x7f2ff8159890 msgr2=0x7f2ff815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 --2- 172.21.15.22:0/2814976610 >> v2:172.21.15.192:3300/0 conn(0x7f2ff8159890 0x7f2ff815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 -- 172.21.15.22:0/2814976610 >> v1:172.21.15.192:6789/0 conn(0x7f2ff8159c60 legacy=0x7f2ff815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.266+0000 7f2ffe910700 1 -- 172.21.15.22:0/2814976610 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff815e140 con 0x7f2ff8069560 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f2ffe910700 1 --2- 172.21.15.22:0/2814976610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8069560 0x7f2ff80699a0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80d1090 tx=0x7f2ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d0652cd4071136 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:13.269 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f2ffd10d700 1 -- 172.21.15.22:0/2814976610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0009e70 con 0x7f2ff8069560 2023-10-08T00:34:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f2ffd10d700 1 -- 172.21.15.22:0/2814976610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff000b860 con 0x7f2ff8069560 2023-10-08T00:34:13.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f2ffd10d700 1 -- 172.21.15.22:0/2814976610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff000bc00 con 0x7f2ff8069560 2023-10-08T00:34:13.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 -- 172.21.15.22:0/2814976610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8069560 msgr2=0x7f2ff80699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 --2- 172.21.15.22:0/2814976610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8069560 0x7f2ff80699a0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80d1090 tx=0x7f2ff0009250 comp rx=0 tx=0).stop 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 -- 172.21.15.22:0/2814976610 shutdown_connections 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 --2- 172.21.15.22:0/2814976610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8069560 0x7f2ff80699a0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 --2- 172.21.15.22:0/2814976610 >> v2:172.21.15.192:3300/0 conn(0x7f2ff8159890 0x7f2ff815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 -- 172.21.15.22:0/2814976610 >> 172.21.15.22:0/2814976610 conn(0x7f2ff8068e20 msgr2=0x7f2ff80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 -- 172.21.15.22:0/2814976610 shutdown_connections 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.267+0000 7f3000373700 1 -- 172.21.15.22:0/2814976610 wait complete. 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 Processor -- start 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 -- start start 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ff8069560 0x7f2ff8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 0x7f2ff80cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ff8159c60 0x7f2ff80b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8149850 con 0x7f2ff8159890 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c9600 con 0x7f2ff8069560 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f3000373700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c89f0 con 0x7f2ff8159c60 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f2ffd90e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 0x7f2ff80cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f2ffd90e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 0x7f2ff80cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46248/0 (socket says 172.21.15.22:46248) 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.269+0000 7f2ffd90e700 1 -- 172.21.15.22:0/651264211 learned_addr learned my addr 172.21.15.22:0/651264211 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffe910700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ff8159c60 0x7f2ff80b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffe10f700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ff8069560 0x7f2ff8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffd90e700 1 -- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ff8159c60 msgr2=0x7f2ff80b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffd90e700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ff8159c60 0x7f2ff80b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffd90e700 1 -- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ff8069560 msgr2=0x7f2ff8149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffd90e700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ff8069560 0x7f2ff8149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffd90e700 1 -- 172.21.15.22:0/651264211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff00094f0 con 0x7f2ff8159890 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ffd90e700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 0x7f2ff80cda80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00c4e0 tx=0x7f2fec00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec011590 con 0x7f2ff8159890 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec011710 con 0x7f2ff8159890 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff80c8cd0 con 0x7f2ff8159890 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec011ad0 con 0x7f2ff8159890 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.270+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80c9290 con 0x7f2ff8159890 2023-10-08T00:34:13.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.271+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80c9770 con 0x7f2ff8159890 2023-10-08T00:34:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.272+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2fec01b3b0 con 0x7f2ff8159890 2023-10-08T00:34:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.272+0000 7f2ff67fc700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2fe4067320 0x7f2fe40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.272+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2fec084000 con 0x7f2ff8159890 2023-10-08T00:34:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.272+0000 7f2ffe10f700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2fe4067320 0x7f2fe40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.273+0000 7f2ffe10f700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2fe4067320 0x7f2fe40697d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800f570 tx=0x7f2fe800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:13.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.277+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fec050c40 con 0x7f2ff8159890 2023-10-08T00:34:13.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.471+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff804c3c0 con 0x7f2ff8159890 2023-10-08T00:34:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.472+0000 7f2ff67fc700 1 -- 172.21.15.22:0/651264211 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+15442 (secure 0 0 0) 0x7f2fec017070 con 0x7f2ff8159890 2023-10-08T00:34:13.473 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:13.474 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":190,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:07.690501+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000871725.meta","create_time":"2023-10-08T00:33:52.144999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000871725"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000871725.data","create_time":"2023-10-08T00:33:52.705475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000871725"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.473+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2fe4067320 msgr2=0x7f2fe40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.473+0000 7f3000373700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2fe4067320 0x7f2fe40697d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800f570 tx=0x7f2fe800b040 comp rx=0 tx=0).stop 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 msgr2=0x7f2ff80cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 0x7f2ff80cda80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00c4e0 tx=0x7f2fec00c7f0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 shutdown_connections 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2fe4067320 0x7f2fe40697d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ff8159c60 0x7f2ff80b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ff8069560 0x7f2ff8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 --2- 172.21.15.22:0/651264211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ff8159890 0x7f2ff80cda80 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 >> 172.21.15.22:0/651264211 conn(0x7f2ff8068e20 msgr2=0x7f2ff8157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 shutdown_connections 2023-10-08T00:34:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.474+0000 7f3000373700 1 -- 172.21.15.22:0/651264211 wait complete. 2023-10-08T00:34:13.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000871725 2023-10-08T00:34:13.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.605+0000 7fa549072700 1 Processor -- start 2023-10-08T00:34:13.607 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.605+0000 7fa549072700 1 -- start start 2023-10-08T00:34:13.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa549072700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159890 0x7fa54415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa549072700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa544069560 0x7fa5440699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa549072700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54415a160 con 0x7fa544159c60 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa549072700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa544069f20 con 0x7fa544069560 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa549072700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440d13a0 con 0x7fa544159890 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa54359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa544069560 0x7fa5440699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa54359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa544069560 0x7fa5440699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46260/0 (socket says 172.21.15.22:46260) 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa54359e700 1 -- 172.21.15.22:0/466388343 learned_addr learned my addr 172.21.15.22:0/466388343 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa54359e700 1 -- 172.21.15.22:0/466388343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159890 msgr2=0x7fa54415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.606+0000 7fa542d9d700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159890 0x7fa54415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa54359e700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159890 0x7fa54415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa54359e700 1 -- 172.21.15.22:0/466388343 >> v1:172.21.15.192:6789/0 conn(0x7fa544159c60 legacy=0x7fa54415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:13.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa54359e700 1 -- 172.21.15.22:0/466388343 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54415e140 con 0x7fa544069560 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa542d9d700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159890 0x7fa54415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa54359e700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440699e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fa5340099b0 tx=0x7fa534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93871cbfc8c6f25f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa541d9b700 1 -- 172.21.15.22:0/466388343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400b820 con 0x7fa544069560 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa541d9b700 1 -- 172.21.15.22:0/466388343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53400b980 con 0x7fa544069560 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa541d9b700 1 -- 172.21.15.22:0/466388343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53400bd20 con 0x7fa544069560 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 -- 172.21.15.22:0/466388343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 msgr2=0x7fa5440699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440699e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fa5340099b0 tx=0x7fa534009250 comp rx=0 tx=0).stop 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 -- 172.21.15.22:0/466388343 shutdown_connections 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440699e0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 --2- 172.21.15.22:0/466388343 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159890 0x7fa54415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 -- 172.21.15.22:0/466388343 >> 172.21.15.22:0/466388343 conn(0x7fa544068e20 msgr2=0x7fa5440d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:13.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 -- 172.21.15.22:0/466388343 shutdown_connections 2023-10-08T00:34:13.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.607+0000 7fa549072700 1 -- 172.21.15.22:0/466388343 wait complete. 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 Processor -- start 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 -- start start 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa544159890 0x7fa544151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159c60 0x7fa54414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa544152740 con 0x7fa544069560 2023-10-08T00:34:13.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5441518b0 con 0x7fa544159890 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa549072700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54414d890 con 0x7fa544159c60 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa542d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa542d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46272/0 (socket says 172.21.15.22:46272) 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.609+0000 7fa542d9d700 1 -- 172.21.15.22:0/3282604805 learned_addr learned my addr 172.21.15.22:0/3282604805 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa542d9d700 1 -- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159c60 msgr2=0x7fa54414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa542d9d700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159c60 0x7fa54414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa54259c700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa544159890 0x7fa544151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa542d9d700 1 -- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa544159890 msgr2=0x7fa544151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa542d9d700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa544159890 0x7fa544151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa542d9d700 1 -- 172.21.15.22:0/3282604805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340094f0 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa542d9d700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440ce270 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00a400 tx=0x7fa53c007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00d650 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c00d7b0 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa544151b30 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00db50 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.610+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5441520f0 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.611+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544064d80 con 0x7fa544069560 2023-10-08T00:34:13.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.611+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa53c015440 con 0x7fa544069560 2023-10-08T00:34:13.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.612+0000 7fa53affd700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa524067320 0x7fa5240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:13.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.612+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fa53c085570 con 0x7fa544069560 2023-10-08T00:34:13.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.612+0000 7fa54259c700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa524067320 0x7fa5240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:13.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.613+0000 7fa54259c700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa524067320 0x7fa5240697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa5440cc5f0 tx=0x7fa52c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:13.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.616+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa53c04e5a0 con 0x7fa544069560 2023-10-08T00:34:13.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.854+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000871725"} v 0) v1 -- 0x7fa54404c3c0 con 0x7fa544069560 2023-10-08T00:34:13.856 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:34:13.855+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:34:13.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.859+0000 7fa53affd700 1 -- 172.21.15.22:0/3282604805 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000871725"}]=0 volume_0000000000871725 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v129) v1 ==== 195+0+0 (secure 0 0 0) 0x7fa53c083e60 con 0x7fa544069560 2023-10-08T00:34:13.861 INFO:tasks.ceph.mds.a.smithi022.stderr: -915> 2023-10-08T00:33:54.657+0000 7fb6146ce700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa524067320 msgr2=0x7fa5240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa524067320 0x7fa5240697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa5440cc5f0 tx=0x7fa52c009040 comp rx=0 tx=0).stop 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 msgr2=0x7fa5440ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440ce270 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00a400 tx=0x7fa53c007910 comp rx=0 tx=0).stop 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 shutdown_connections 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fa524067320 0x7fa5240697d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fa544159c60 0x7fa54414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa544069560 0x7fa5440ce270 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 --2- 172.21.15.22:0/3282604805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa544159890 0x7fa544151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 >> 172.21.15.22:0/3282604805 conn(0x7fa544068e20 msgr2=0x7fa544154160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 shutdown_connections 2023-10-08T00:34:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.861+0000 7fa549072700 1 -- 172.21.15.22:0/3282604805 wait complete. 2023-10-08T00:34:13.864 INFO:teuthology.orchestra.run.smithi022.stderr:volume_0000000000871725 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:34:13.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000871725 --yes-i-really-mean-it 2023-10-08T00:34:13.883 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:34:13.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.998+0000 7f4a48952700 1 Processor -- start 2023-10-08T00:34:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.998+0000 7f4a48952700 1 -- start start 2023-10-08T00:34:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a48952700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b4e70 0x7f4a440ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a48952700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a440b16d0 0x7f4a440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a48952700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440b2080 con 0x7f4a4415d240 2023-10-08T00:34:14.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a48952700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a440cfb00 con 0x7f4a440b16d0 2023-10-08T00:34:14.001 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a48952700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440b5c40 con 0x7f4a440b4e70 2023-10-08T00:34:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a42d9d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b4e70 0x7f4a440ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a4259c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a440b16d0 0x7f4a440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:14.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a4359e700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4a4415d240 0x7f4a4415d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:38522/0 (socket says 172.21.15.22:38522) 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a4359e700 1 -- 172.21.15.22:0/1077139815 learned_addr learned my addr 172.21.15.22:0/1077139815 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:13.999+0000 7f4a41d9b700 1 -- 172.21.15.22:0/1077139815 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592118284 0 0) 0x7f4a440b2080 con 0x7f4a4415d240 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a41d9b700 1 -- 172.21.15.22:0/1077139815 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a30003570 con 0x7f4a4415d240 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a42d9d700 1 -- 172.21.15.22:0/1077139815 >> v2:172.21.15.192:3300/0 conn(0x7f4a440b16d0 msgr2=0x7f4a440b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a42d9d700 1 --2- 172.21.15.22:0/1077139815 >> v2:172.21.15.192:3300/0 conn(0x7f4a440b16d0 0x7f4a440b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a42d9d700 1 -- 172.21.15.22:0/1077139815 >> v1:172.21.15.192:6789/0 conn(0x7f4a4415d240 legacy=0x7f4a4415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a42d9d700 1 -- 172.21.15.22:0/1077139815 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440b5f20 con 0x7f4a440b4e70 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a4259c700 1 --2- 172.21.15.22:0/1077139815 >> v2:172.21.15.192:3300/0 conn(0x7f4a440b16d0 0x7f4a440b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a42d9d700 1 --2- 172.21.15.22:0/1077139815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b4e70 0x7f4a440ccff0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a340098e0 tx=0x7f4a340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38660321011787b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:14.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a41d9b700 1 -- 172.21.15.22:0/1077139815 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34011630 con 0x7f4a440b4e70 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a41d9b700 1 -- 172.21.15.22:0/1077139815 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a34011790 con 0x7f4a440b4e70 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a41d9b700 1 -- 172.21.15.22:0/1077139815 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34011b30 con 0x7f4a440b4e70 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 -- 172.21.15.22:0/1077139815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b4e70 msgr2=0x7f4a440ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 --2- 172.21.15.22:0/1077139815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b4e70 0x7f4a440ccff0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4a340098e0 tx=0x7f4a340091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 -- 172.21.15.22:0/1077139815 shutdown_connections 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 --2- 172.21.15.22:0/1077139815 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b4e70 0x7f4a440ccff0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 --2- 172.21.15.22:0/1077139815 >> v2:172.21.15.192:3300/0 conn(0x7f4a440b16d0 0x7f4a440b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 -- 172.21.15.22:0/1077139815 >> 172.21.15.22:0/1077139815 conn(0x7f4a440d10c0 msgr2=0x7f4a440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.000+0000 7f4a48952700 1 -- 172.21.15.22:0/1077139815 shutdown_connections 2023-10-08T00:34:14.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.001+0000 7f4a48952700 1 -- 172.21.15.22:0/1077139815 wait complete. 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 Processor -- start 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 -- start start 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b16d0 0x7f4a441527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 0x7f4a4415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a4415d240 0x7f4a4415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44152dd0 con 0x7f4a440b4e70 2023-10-08T00:34:14.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441530b0 con 0x7f4a4415d240 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.002+0000 7f4a48952700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44153390 con 0x7f4a440b16d0 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 0x7f4a4415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 0x7f4a4415b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46290/0 (socket says 172.21.15.22:46290) 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 -- 172.21.15.22:0/395452408 learned_addr learned my addr 172.21.15.22:0/395452408 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4359e700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a4415d240 0x7f4a4415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a42d9d700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b16d0 0x7f4a441527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 -- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b16d0 msgr2=0x7f4a441527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b16d0 0x7f4a441527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 -- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a4415d240 msgr2=0x7f4a4415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a4415d240 0x7f4a4415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 -- 172.21.15.22:0/395452408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c009420 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a4259c700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 0x7f4a4415b6c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00ec80 tx=0x7f4a2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00c920 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c00ca80 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a34009420 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c00ce00 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.003+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a44153950 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.004+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a44088990 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.005+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4a2c013680 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.005+0000 7f4a3affd700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a24067320 0x7f4a240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.005+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f4a2c0850f0 con 0x7f4a440b4e70 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.005+0000 7f4a42d9d700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a24067320 0x7f4a240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:14.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.006+0000 7f4a42d9d700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a24067320 0x7f4a240697d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4a340091e0 tx=0x7f4a34017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:14.011 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.010+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a2c051ce0 con 0x7f4a440b4e70 2023-10-08T00:34:14.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.246+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000871725", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a4404bb80 con 0x7f4a440b4e70 2023-10-08T00:34:14.862 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.861+0000 7f4a3affd700 1 -- 172.21.15.22:0/395452408 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000871725", "yes_i_really_mean_it": true}]=0 v130) v1 ==== 121+0+0 (secure 0 0 0) 0x7f4a2c055300 con 0x7f4a440b4e70 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a24067320 msgr2=0x7f4a240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a24067320 0x7f4a240697d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4a340091e0 tx=0x7f4a34017000 comp rx=0 tx=0).stop 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 msgr2=0x7f4a4415b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 0x7f4a4415b6c0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00ec80 tx=0x7f4a2c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 shutdown_connections 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a4415d240 0x7f4a4415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4a24067320 0x7f4a240697d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4a440b16d0 0x7f4a441527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 --2- 172.21.15.22:0/395452408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a440b4e70 0x7f4a4415b6c0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:14.866 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 >> 172.21.15.22:0/395452408 conn(0x7f4a440d10c0 msgr2=0x7f4a440cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 shutdown_connections 2023-10-08T00:34:14.867 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:14.864+0000 7f4a48952700 1 -- 172.21.15.22:0/395452408 wait complete. 2023-10-08T00:34:14.879 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000871725.meta cephfs.volume_0000000000871725.meta --yes-i-really-really-mean-it 2023-10-08T00:34:15.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.045+0000 7f0e151ce700 1 Processor -- start 2023-10-08T00:34:15.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.045+0000 7f0e151ce700 1 -- start start 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e151ce700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e10154320 0x7f0e1006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e151ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e1015a190 0x7f0e1006d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e151ce700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e100b4570 con 0x7f0e10153f50 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e151ce700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e100b2710 con 0x7f0e10154320 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e151ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1015a730 con 0x7f0e1015a190 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e10154320 0x7f0e1006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:15.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e10154320 0x7f0e1006d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46304/0 (socket says 172.21.15.22:46304) 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 -- 172.21.15.22:0/1323683853 learned_addr learned my addr 172.21.15.22:0/1323683853 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0f59e700 1 --2- 172.21.15.22:0/1323683853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e1015a190 0x7f0e1006d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 -- 172.21.15.22:0/1323683853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e1015a190 msgr2=0x7f0e1006d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 --2- 172.21.15.22:0/1323683853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e1015a190 0x7f0e1006d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 -- 172.21.15.22:0/1323683853 >> v1:172.21.15.192:6789/0 conn(0x7f0e10153f50 legacy=0x7f0e100b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.046+0000 7f0e0e59c700 1 -- 172.21.15.22:0/1323683853 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1015aa10 con 0x7f0e10154320 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e0e59c700 1 --2- 172.21.15.22:0/1323683853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e10154320 0x7f0e1006d130 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f0df80099b0 tx=0x7f0df8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77547e5ebb53a0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e0dd9b700 1 -- 172.21.15.22:0/1323683853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800b860 con 0x7f0e10154320 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e0dd9b700 1 -- 172.21.15.22:0/1323683853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df800b9c0 con 0x7f0e10154320 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e0dd9b700 1 -- 172.21.15.22:0/1323683853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800bd60 con 0x7f0e10154320 2023-10-08T00:34:15.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 -- 172.21.15.22:0/1323683853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e10154320 msgr2=0x7f0e1006d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1323683853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e10154320 0x7f0e1006d130 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f0df80099b0 tx=0x7f0df8009250 comp rx=0 tx=0).stop 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 -- 172.21.15.22:0/1323683853 shutdown_connections 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1323683853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e1015a190 0x7f0e1006d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1323683853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e10154320 0x7f0e1006d130 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 -- 172.21.15.22:0/1323683853 >> 172.21.15.22:0/1323683853 conn(0x7f0e1006baf0 msgr2=0x7f0e1006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 -- 172.21.15.22:0/1323683853 shutdown_connections 2023-10-08T00:34:15.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.047+0000 7f0e151ce700 1 -- 172.21.15.22:0/1323683853 wait complete. 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 Processor -- start 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 -- start start 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e10153f50 0x7f0e100af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e10154320 0x7f0e1016b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 0x7f0e100cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cd910 con 0x7f0e1015a190 2023-10-08T00:34:15.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cb470 con 0x7f0e10154320 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e151ce700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100cd670 con 0x7f0e10153f50 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e0f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 0x7f0e100cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e0f59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 0x7f0e100cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46314/0 (socket says 172.21.15.22:46314) 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.049+0000 7f0e0f59e700 1 -- 172.21.15.22:0/1544507523 learned_addr learned my addr 172.21.15.22:0/1544507523 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0e59c700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e10154320 0x7f0e1016b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0ed9d700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e10153f50 0x7f0e100af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0f59e700 1 -- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e10153f50 msgr2=0x7f0e100af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0f59e700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e10153f50 0x7f0e100af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0f59e700 1 -- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e10154320 msgr2=0x7f0e1016b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0f59e700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e10154320 0x7f0e1016b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0f59e700 1 -- 172.21.15.22:0/1544507523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80094f0 con 0x7f0e1015a190 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0ed9d700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e10153f50 0x7f0e100af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0e59c700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e10154320 0x7f0e1016b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e0f59e700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 0x7f0e100cd130 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f0e00007f20 tx=0x7f0e00009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0000eca0 con 0x7f0e1015a190 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0000ee20 con 0x7f0e1015a190 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e100cab40 con 0x7f0e1015a190 2023-10-08T00:34:15.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e00014670 con 0x7f0e1015a190 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.050+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e100cb100 con 0x7f0e1015a190 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.051+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e100cb5e0 con 0x7f0e1015a190 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.051+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0e000149e0 con 0x7f0e1015a190 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.052+0000 7f0e06ffd700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0df0067320 0x7f0df00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.052+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f0e00085440 con 0x7f0e1015a190 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.052+0000 7f0e0ed9d700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0df0067320 0x7f0df00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.053+0000 7f0e0ed9d700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0df0067320 0x7f0df00697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007fd0 tx=0x7f0e08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:15.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.056+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e00052030 con 0x7f0e1015a190 2023-10-08T00:34:15.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.252+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000871725.meta", "pool2": "cephfs.volume_0000000000871725.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0e100718b0 con 0x7f0e1015a190 2023-10-08T00:34:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.866+0000 7f0e06ffd700 1 -- 172.21.15.22:0/1544507523 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000871725.meta", "pool2": "cephfs.volume_0000000000871725.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000871725.meta' removed v192) v1 ==== 241+0+0 (secure 0 0 0) 0x7f0e00055650 con 0x7f0e1015a190 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0df0067320 msgr2=0x7f0df00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0df0067320 0x7f0df00697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0e08007fd0 tx=0x7f0e08009040 comp rx=0 tx=0).stop 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 msgr2=0x7f0e100cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 0x7f0e100cd130 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f0e00007f20 tx=0x7f0e00009860 comp rx=0 tx=0).stop 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 shutdown_connections 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e1015a190 0x7f0e100cd130 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0df0067320 0x7f0df00697d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0e10153f50 0x7f0e100af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.870+0000 7f0e151ce700 1 --2- 172.21.15.22:0/1544507523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e10154320 0x7f0e1016b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.871+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 >> 172.21.15.22:0/1544507523 conn(0x7f0e1006baf0 msgr2=0x7f0e10152010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.871+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 shutdown_connections 2023-10-08T00:34:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:15.871+0000 7f0e151ce700 1 -- 172.21.15.22:0/1544507523 wait complete. 2023-10-08T00:34:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs.volume_0000000000871725.meta' removed 2023-10-08T00:34:15.887 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000871725.data cephfs.volume_0000000000871725.data --yes-i-really-really-mean-it 2023-10-08T00:34:16.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 Processor -- start 2023-10-08T00:34:16.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 -- start start 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb854159ec0 0x7fb8540b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540cf350 0x7fb8540cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8540b5b00 con 0x7fb8540b53d0 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540b5850 con 0x7fb854159ec0 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.016+0000 7fb85a38d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540b5da0 con 0x7fb8540cf350 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb854159ec0 0x7fb8540b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb8537fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb8540b53d0 0x7fb8540cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56088/0 (socket says 172.21.15.22:56088) 2023-10-08T00:34:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb8537fe700 1 -- 172.21.15.22:0/2058319193 learned_addr learned my addr 172.21.15.22:0/2058319193 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 --2- 172.21.15.22:0/2058319193 >> v2:172.21.15.22:3300/0 conn(0x7fb854159ec0 0x7fb8540b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46324/0 (socket says 172.21.15.22:46324) 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 -- 172.21.15.22:0/2058319193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540cf350 msgr2=0x7fb8540cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb85892a700 1 --2- 172.21.15.22:0/2058319193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540cf350 0x7fb8540cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb852ffd700 1 -- 172.21.15.22:0/2058319193 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625572516 0 0) 0x7fb8540b5b00 con 0x7fb8540b53d0 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 --2- 172.21.15.22:0/2058319193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540cf350 0x7fb8540cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 -- 172.21.15.22:0/2058319193 >> v1:172.21.15.22:6789/0 conn(0x7fb8540b53d0 legacy=0x7fb8540cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 -- 172.21.15.22:0/2058319193 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540b6080 con 0x7fb854159ec0 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb853fff700 1 --2- 172.21.15.22:0/2058319193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb854159ec0 0x7fb8540b4e90 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb8440098d0 tx=0x7fb844009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e0258d7006025c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb852ffd700 1 -- 172.21.15.22:0/2058319193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844009e70 con 0x7fb854159ec0 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb852ffd700 1 -- 172.21.15.22:0/2058319193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb844005c10 con 0x7fb854159ec0 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.017+0000 7fb852ffd700 1 -- 172.21.15.22:0/2058319193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400b650 con 0x7fb854159ec0 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 -- 172.21.15.22:0/2058319193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb854159ec0 msgr2=0x7fb8540b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 --2- 172.21.15.22:0/2058319193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb854159ec0 0x7fb8540b4e90 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fb8440098d0 tx=0x7fb844009120 comp rx=0 tx=0).stop 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 -- 172.21.15.22:0/2058319193 shutdown_connections 2023-10-08T00:34:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 --2- 172.21.15.22:0/2058319193 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540cf350 0x7fb8540cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 --2- 172.21.15.22:0/2058319193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb854159ec0 0x7fb8540b4e90 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 -- 172.21.15.22:0/2058319193 >> 172.21.15.22:0/2058319193 conn(0x7fb8540999f0 msgr2=0x7fb8540b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 -- 172.21.15.22:0/2058319193 shutdown_connections 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.018+0000 7fb85a38d700 1 -- 172.21.15.22:0/2058319193 wait complete. 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.019+0000 7fb85a38d700 1 Processor -- start 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.019+0000 7fb85a38d700 1 -- start start 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85a38d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540b53d0 0x7fb85406a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85a38d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 0x7fb854156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:16.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85a38d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb854159ec0 0x7fb8540c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85a38d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854157470 con 0x7fb8540cf350 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85a38d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854069360 con 0x7fb854159ec0 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85a38d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb854069c00 con 0x7fb8540b53d0 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 0x7fb854156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 0x7fb854156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46332/0 (socket says 172.21.15.22:46332) 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 -- 172.21.15.22:0/3736986235 learned_addr learned my addr 172.21.15.22:0/3736986235 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb85892a700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb854159ec0 0x7fb8540c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb853fff700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540b53d0 0x7fb85406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 -- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540b53d0 msgr2=0x7fb85406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540b53d0 0x7fb85406a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 -- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb854159ec0 msgr2=0x7fb8540c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb854159ec0 0x7fb8540c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 -- 172.21.15.22:0/3736986235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440093c0 con 0x7fb8540cf350 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb853fff700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540b53d0 0x7fb85406a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb8537fe700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 0x7fb854156f30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c5e0 tx=0x7fb848001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.020+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848005b30 con 0x7fb8540cf350 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.021+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848005c90 con 0x7fb8540cf350 2023-10-08T00:34:16.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.021+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85416ab20 con 0x7fb8540cf350 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.021+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480072e0 con 0x7fb8540cf350 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.021+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb854069890 con 0x7fb8540cf350 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.022+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854063c90 con 0x7fb8540cf350 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.022+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb84801b3b0 con 0x7fb8540cf350 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.022+0000 7fb83bfff700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb840067320 0x7fb8400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.022+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5394+0+0 (secure 0 0 0) 0x7fb848083fc0 con 0x7fb8540cf350 2023-10-08T00:34:16.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.023+0000 7fb853fff700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb840067320 0x7fb8400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:16.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.023+0000 7fb853fff700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb840067320 0x7fb8400697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb85409c580 tx=0x7fb844016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:16.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.027+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb848050e30 con 0x7fb8540cf350 2023-10-08T00:34:16.221 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.220+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000871725.data", "pool2": "cephfs.volume_0000000000871725.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb854069a50 con 0x7fb8540cf350 2023-10-08T00:34:16.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.868+0000 7fb83bfff700 1 -- 172.21.15.22:0/3736986235 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000871725.data", "pool2": "cephfs.volume_0000000000871725.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000871725.data' removed v193) v1 ==== 241+0+0 (secure 0 0 0) 0x7fb848017100 con 0x7fb8540cf350 2023-10-08T00:34:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb840067320 msgr2=0x7fb8400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb840067320 0x7fb8400697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb85409c580 tx=0x7fb844016000 comp rx=0 tx=0).stop 2023-10-08T00:34:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 msgr2=0x7fb854156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 0x7fb854156f30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c5e0 tx=0x7fb848001070 comp rx=0 tx=0).stop 2023-10-08T00:34:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 shutdown_connections 2023-10-08T00:34:16.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb854159ec0 0x7fb8540c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb840067320 0x7fb8400697d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb8540b53d0 0x7fb85406a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 --2- 172.21.15.22:0/3736986235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8540cf350 0x7fb854156f30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 >> 172.21.15.22:0/3736986235 conn(0x7fb8540999f0 msgr2=0x7fb8540c5510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 shutdown_connections 2023-10-08T00:34:16.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:16.872+0000 7fb85a38d700 1 -- 172.21.15.22:0/3736986235 wait complete. 2023-10-08T00:34:16.875 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs.volume_0000000000871725.data' removed 2023-10-08T00:34:16.889 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:34:17.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.013+0000 7f20d89da700 1 Processor -- start 2023-10-08T00:34:17.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.013+0000 7f20d89da700 1 -- start start 2023-10-08T00:34:17.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d89da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159890 0x7f20d415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d89da700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f20d4159c60 0x7f20d415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d89da700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d415a160 con 0x7f20d415db10 2023-10-08T00:34:17.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d89da700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d40d13a0 con 0x7f20d4159c60 2023-10-08T00:34:17.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d89da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d415e140 con 0x7f20d4159890 2023-10-08T00:34:17.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d2d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f20d415db10 0x7f20d4069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51796/0 (socket says 172.21.15.22:51796) 2023-10-08T00:34:17.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.014+0000 7f20d2d9d700 1 -- 172.21.15.22:0/2004457307 learned_addr learned my addr 172.21.15.22:0/2004457307 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:17.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d1d9b700 1 --2- 172.21.15.22:0/2004457307 >> v2:172.21.15.192:3300/0 conn(0x7f20d4159c60 0x7f20d415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d259c700 1 --2- 172.21.15.22:0/2004457307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159890 0x7f20d415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d159a700 1 -- 172.21.15.22:0/2004457307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142071761 0 0) 0x7f20d415a160 con 0x7f20d415db10 2023-10-08T00:34:17.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d159a700 1 -- 172.21.15.22:0/2004457307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c0003570 con 0x7f20d415db10 2023-10-08T00:34:17.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d259c700 1 -- 172.21.15.22:0/2004457307 >> v2:172.21.15.192:3300/0 conn(0x7f20d4159c60 msgr2=0x7f20d415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:17.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d259c700 1 --2- 172.21.15.22:0/2004457307 >> v2:172.21.15.192:3300/0 conn(0x7f20d4159c60 0x7f20d415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d259c700 1 -- 172.21.15.22:0/2004457307 >> v1:172.21.15.22:6789/0 conn(0x7f20d415db10 legacy=0x7f20d4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d259c700 1 -- 172.21.15.22:0/2004457307 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d415a3d0 con 0x7f20d4159890 2023-10-08T00:34:17.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d1d9b700 1 --2- 172.21.15.22:0/2004457307 >> v2:172.21.15.192:3300/0 conn(0x7f20d4159c60 0x7f20d415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:17.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d259c700 1 --2- 172.21.15.22:0/2004457307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159890 0x7f20d415abd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098e0 tx=0x7f20cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecee24ebd9bf3563 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d159a700 1 -- 172.21.15.22:0/2004457307 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc011630 con 0x7f20d4159890 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d159a700 1 -- 172.21.15.22:0/2004457307 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc011790 con 0x7f20d4159890 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.015+0000 7f20d159a700 1 -- 172.21.15.22:0/2004457307 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc011b30 con 0x7f20d4159890 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 -- 172.21.15.22:0/2004457307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159890 msgr2=0x7f20d415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 --2- 172.21.15.22:0/2004457307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159890 0x7f20d415abd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0098e0 tx=0x7f20cc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 -- 172.21.15.22:0/2004457307 shutdown_connections 2023-10-08T00:34:17.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 --2- 172.21.15.22:0/2004457307 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159890 0x7f20d415abd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 --2- 172.21.15.22:0/2004457307 >> v2:172.21.15.192:3300/0 conn(0x7f20d4159c60 0x7f20d415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 -- 172.21.15.22:0/2004457307 >> 172.21.15.22:0/2004457307 conn(0x7f20d4068e20 msgr2=0x7f20d40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:17.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 -- 172.21.15.22:0/2004457307 shutdown_connections 2023-10-08T00:34:17.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.016+0000 7f20d89da700 1 -- 172.21.15.22:0/2004457307 wait complete. 2023-10-08T00:34:17.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.017+0000 7f20d89da700 1 Processor -- start 2023-10-08T00:34:17.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.017+0000 7f20d89da700 1 -- start start 2023-10-08T00:34:17.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d89da700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 0x7f20d40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d89da700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159c60 0x7f20d40cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d89da700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20d415db10 0x7f20d40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.026 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d89da700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c8180 con 0x7f20d4159890 2023-10-08T00:34:17.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d89da700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40b44f0 con 0x7f20d415db10 2023-10-08T00:34:17.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d89da700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c8440 con 0x7f20d4159c60 2023-10-08T00:34:17.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 0x7f20d40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 0x7f20d40b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56432/0 (socket says 172.21.15.22:56432) 2023-10-08T00:34:17.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 -- 172.21.15.22:0/4182962711 learned_addr learned my addr 172.21.15.22:0/4182962711 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:17.027 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d1d9b700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159c60 0x7f20d40cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d2d9d700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20d415db10 0x7f20d40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 -- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159c60 msgr2=0x7f20d40cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159c60 0x7f20d40cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 -- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20d415db10 msgr2=0x7f20d40ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20d415db10 0x7f20d40ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 -- 172.21.15.22:0/4182962711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc009420 con 0x7f20d4159890 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.018+0000 7f20d259c700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 0x7f20d40b3590 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009ed0 tx=0x7f20cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.019+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc011b10 con 0x7f20d4159890 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.019+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc0253f0 con 0x7f20d4159890 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.019+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc009420 con 0x7f20d4159890 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.019+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0257b0 con 0x7f20d4159890 2023-10-08T00:34:17.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.019+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d40b3c50 con 0x7f20d4159890 2023-10-08T00:34:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.020+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d404c3c0 con 0x7f20d4159890 2023-10-08T00:34:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.020+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f20cc025ba0 con 0x7f20d4159890 2023-10-08T00:34:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.020+0000 7f20ca7fc700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20b4067320 0x7f20b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.021+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f20cc086280 con 0x7f20d4159890 2023-10-08T00:34:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.021+0000 7f20d1d9b700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20b4067320 0x7f20b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.021+0000 7f20d1d9b700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20b4067320 0x7f20b40697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f20d416d350 tx=0x7f20bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:17.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.026+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20cc053210 con 0x7f20d4159890 2023-10-08T00:34:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.225+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f20d41535c0 con 0x7f20d4159890 2023-10-08T00:34:17.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.229+0000 7f20ca7fc700 1 -- 172.21.15.22:0/4182962711 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f20cc056830 con 0x7f20d4159890 2023-10-08T00:34:17.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20b4067320 msgr2=0x7f20b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20b4067320 0x7f20b40697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f20d416d350 tx=0x7f20bc008040 comp rx=0 tx=0).stop 2023-10-08T00:34:17.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 msgr2=0x7f20d40b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 0x7f20d40b3590 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009ed0 tx=0x7f20cc017000 comp rx=0 tx=0).stop 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 shutdown_connections 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20d415db10 0x7f20d40ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20d4159890 0x7f20d40b3590 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f20b4067320 0x7f20b40697d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 --2- 172.21.15.22:0/4182962711 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f20d4159c60 0x7f20d40cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 >> 172.21.15.22:0/4182962711 conn(0x7f20d4068e20 msgr2=0x7f20d414d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 shutdown_connections 2023-10-08T00:34:17.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.231+0000 7f20d89da700 1 -- 172.21.15.22:0/4182962711 wait complete. 2023-10-08T00:34:17.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-08T00:34:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 Processor -- start 2023-10-08T00:34:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 -- start start 2023-10-08T00:34:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ca41597e0 0x7f7ca406c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ca406c050 0x7f7ca4068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca406bbc0 con 0x7f7ca4159bb0 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca40c8660 con 0x7f7ca406c050 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca9371700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca406ad10 con 0x7f7ca41597e0 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca27fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ca406c050 0x7f7ca4068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca27fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7ca406c050 0x7f7ca4068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56434/0 (socket says 172.21.15.22:56434) 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.364+0000 7f7ca27fc700 1 -- 172.21.15.22:0/3513423246 learned_addr learned my addr 172.21.15.22:0/3513423246 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca2ffd700 1 --2- 172.21.15.22:0/3513423246 >> v2:172.21.15.192:3300/0 conn(0x7f7ca41597e0 0x7f7ca406c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca27fc700 1 -- 172.21.15.22:0/3513423246 >> v2:172.21.15.192:3300/0 conn(0x7f7ca41597e0 msgr2=0x7f7ca406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca27fc700 1 --2- 172.21.15.22:0/3513423246 >> v2:172.21.15.192:3300/0 conn(0x7f7ca41597e0 0x7f7ca406c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca27fc700 1 -- 172.21.15.22:0/3513423246 >> v1:172.21.15.192:6789/0 conn(0x7f7ca4159bb0 legacy=0x7f7ca415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca27fc700 1 -- 172.21.15.22:0/3513423246 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca406afb0 con 0x7f7ca406c050 2023-10-08T00:34:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca2ffd700 1 --2- 172.21.15.22:0/3513423246 >> v2:172.21.15.192:3300/0 conn(0x7f7ca41597e0 0x7f7ca406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca27fc700 1 --2- 172.21.15.22:0/3513423246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca406c050 0x7f7ca4068390 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4064fd0 tx=0x7f7c8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5093d3a0f19b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca1ffb700 1 -- 172.21.15.22:0/3513423246 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00b860 con 0x7f7ca406c050 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca1ffb700 1 -- 172.21.15.22:0/3513423246 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00b9c0 con 0x7f7ca406c050 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.365+0000 7f7ca1ffb700 1 -- 172.21.15.22:0/3513423246 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00bd60 con 0x7f7ca406c050 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 -- 172.21.15.22:0/3513423246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca406c050 msgr2=0x7f7ca4068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 --2- 172.21.15.22:0/3513423246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca406c050 0x7f7ca4068390 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4064fd0 tx=0x7f7c8c009250 comp rx=0 tx=0).stop 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 -- 172.21.15.22:0/3513423246 shutdown_connections 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 --2- 172.21.15.22:0/3513423246 >> v2:172.21.15.192:3300/0 conn(0x7f7ca41597e0 0x7f7ca406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 --2- 172.21.15.22:0/3513423246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca406c050 0x7f7ca4068390 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 -- 172.21.15.22:0/3513423246 >> 172.21.15.22:0/3513423246 conn(0x7f7ca40cdd80 msgr2=0x7f7ca40c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 -- 172.21.15.22:0/3513423246 shutdown_connections 2023-10-08T00:34:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.366+0000 7f7ca9371700 1 -- 172.21.15.22:0/3513423246 wait complete. 2023-10-08T00:34:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.367+0000 7f7ca9371700 1 Processor -- start 2023-10-08T00:34:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.367+0000 7f7ca9371700 1 -- start start 2023-10-08T00:34:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca9371700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca406c050 0x7f7ca40b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca9371700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 0x7f7ca40c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca9371700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca4159bb0 0x7f7ca415c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca9371700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40c6af0 con 0x7f7ca41597e0 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca9371700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40c5ee0 con 0x7f7ca4159bb0 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca9371700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40c61c0 con 0x7f7ca406c050 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 0x7f7ca40c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 0x7f7ca40c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56444/0 (socket says 172.21.15.22:56444) 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 -- 172.21.15.22:0/1576436865 learned_addr learned my addr 172.21.15.22:0/1576436865 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca2ffd700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca406c050 0x7f7ca40b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca37fe700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca4159bb0 0x7f7ca415c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 -- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca406c050 msgr2=0x7f7ca40b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca406c050 0x7f7ca40b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 -- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca4159bb0 msgr2=0x7f7ca415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca4159bb0 0x7f7ca415c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 -- 172.21.15.22:0/1576436865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0094f0 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7ca27fc700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 0x7f7ca40c5440 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009290 tx=0x7f7c8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.368+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011e60 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.369+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c01f070 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.369+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca40c64a0 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.369+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c01a870 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.369+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca40b2f50 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.369+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca40c6c60 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.370+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7c8c01abe0 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.370+0000 7f7c9affd700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7c84067320 0x7f7c840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.371+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7c8c021070 con 0x7f7ca41597e0 2023-10-08T00:34:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.371+0000 7f7ca2ffd700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7c84067320 0x7f7c840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.371+0000 7f7ca2ffd700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7c84067320 0x7f7c840697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c006f00 tx=0x7f7c9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.376+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c8c053840 con 0x7f7ca41597e0 2023-10-08T00:34:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.648+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7f7ca404c3c0 con 0x7f7ca41597e0 2023-10-08T00:34:17.870 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.869+0000 7f7c9affd700 1 -- 172.21.15.22:0/1576436865 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v479) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7c8c0150d0 con 0x7f7ca41597e0 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7c84067320 msgr2=0x7f7c840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7c84067320 0x7f7c840697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c006f00 tx=0x7f7c9c008040 comp rx=0 tx=0).stop 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 msgr2=0x7f7ca40c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 0x7f7ca40c5440 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009290 tx=0x7f7c8c017000 comp rx=0 tx=0).stop 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 shutdown_connections 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca4159bb0 0x7f7ca415c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7c84067320 0x7f7c840697d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.873 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7ca406c050 0x7f7ca40b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 --2- 172.21.15.22:0/1576436865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ca41597e0 0x7f7ca40c5440 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 >> 172.21.15.22:0/1576436865 conn(0x7f7ca40cdd80 msgr2=0x7f7ca41541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 shutdown_connections 2023-10-08T00:34:17.874 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:17.871+0000 7f7ca9371700 1 -- 172.21.15.22:0/1576436865 wait complete. 2023-10-08T00:34:17.885 INFO:tasks.cephfs_test_runner:That volume rename is idempotent. ... ok 2023-10-08T00:34:17.885 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-08T00:34:17.886 INFO:tasks.cephfs_test_runner:test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:34:17.886 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-08T00:34:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.005+0000 7f9213118700 1 Processor -- start 2023-10-08T00:34:18.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.005+0000 7f9213118700 1 -- start start 2023-10-08T00:34:18.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f9213118700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c159c60 0x7f920c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:18.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f9213118700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c15a160 con 0x7f920c15db10 2023-10-08T00:34:18.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f9213118700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920c0d13a0 con 0x7f920c159890 2023-10-08T00:34:18.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f9213118700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c15e140 con 0x7f920c159c60 2023-10-08T00:34:18.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f92116b5700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f920c15db10 0x7f920c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51800/0 (socket says 172.21.15.22:51800) 2023-10-08T00:34:18.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f92116b5700 1 -- 172.21.15.22:0/1815985228 learned_addr learned my addr 172.21.15.22:0/1815985228 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920bfff700 1 --2- 172.21.15.22:0/1815985228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c159c60 0x7f920c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772473643 0 0) 0x7f920c15a160 con 0x7f920c15db10 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91f8003570 con 0x7f920c15db10 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942246779 0 0) 0x7f920c0d13a0 con 0x7f920c159890 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f920c15a160 con 0x7f920c159890 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920bfff700 1 -- 172.21.15.22:0/1815985228 >> v1:172.21.15.192:6789/0 conn(0x7f920c159890 legacy=0x7f920c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920bfff700 1 -- 172.21.15.22:0/1815985228 >> v1:172.21.15.22:6789/0 conn(0x7f920c15db10 legacy=0x7f920c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920bfff700 1 -- 172.21.15.22:0/1815985228 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c15a3d0 con 0x7f920c159c60 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920bfff700 1 --2- 172.21.15.22:0/1815985228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c159c60 0x7f920c15d5d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009e90 tx=0x7f91fc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6922aab7219d6b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00e070 con 0x7f920c159c60 2023-10-08T00:34:18.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc00bb80 con 0x7f920c159c60 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f920b7fe700 1 -- 172.21.15.22:0/1815985228 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc012430 con 0x7f920c159c60 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f9213118700 1 -- 172.21.15.22:0/1815985228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c159c60 msgr2=0x7f920c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.006+0000 7f9213118700 1 --2- 172.21.15.22:0/1815985228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c159c60 0x7f920c15d5d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009e90 tx=0x7f91fc009780 comp rx=0 tx=0).stop 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.008+0000 7f9213118700 1 -- 172.21.15.22:0/1815985228 shutdown_connections 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.008+0000 7f9213118700 1 --2- 172.21.15.22:0/1815985228 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c159c60 0x7f920c15d5d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.008+0000 7f9213118700 1 -- 172.21.15.22:0/1815985228 >> 172.21.15.22:0/1815985228 conn(0x7f920c068e20 msgr2=0x7f920c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.008+0000 7f9213118700 1 -- 172.21.15.22:0/1815985228 shutdown_connections 2023-10-08T00:34:18.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.008+0000 7f9213118700 1 -- 172.21.15.22:0/1815985228 wait complete. 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.009+0000 7f9213118700 1 Processor -- start 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.009+0000 7f9213118700 1 -- start start 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f920c159890 0x7f920c14a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 0x7f920c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c15db10 0x7f920c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c14c620 con 0x7f920c159c60 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0b4510 con 0x7f920c159890 2023-10-08T00:34:18.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920c0b3900 con 0x7f920c15db10 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 0x7f920c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 0x7f920c14d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56450/0 (socket says 172.21.15.22:56450) 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 -- 172.21.15.22:0/2228110739 learned_addr learned my addr 172.21.15.22:0/2228110739 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f92116b5700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c15db10 0x7f920c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9210eb4700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f920c159890 0x7f920c14a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 -- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c15db10 msgr2=0x7f920c152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c15db10 0x7f920c152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 -- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f920c159890 msgr2=0x7f920c14a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f920c159890 0x7f920c14a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 -- 172.21.15.22:0/2228110739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc009a20 con 0x7f920c159c60 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9210eb4700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f920c159890 0x7f920c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:18.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f920bfff700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 0x7f920c14d210 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0099f0 tx=0x7f91fc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc012e30 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc01b420 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c0b3be0 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.010+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc01b7e0 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.011+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c0b41a0 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.011+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c0b46c0 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.012+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f91fc01bbd0 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.012+0000 7f9208ff9700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91ec067320 0x7f91ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.012+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f91fc086760 con 0x7f920c159c60 2023-10-08T00:34:18.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.013+0000 7f9210eb4700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91ec067320 0x7f91ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:18.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.013+0000 7f9210eb4700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91ec067320 0x7f91ec0697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9204007fd0 tx=0x7f9204009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:18.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.016+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f920c0b46c0 con 0x7f920c159c60 2023-10-08T00:34:18.288 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.288+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f920c0b4680 con 0x7f920c159c60 2023-10-08T00:34:18.875 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.874+0000 7f9208ff9700 1 -- 172.21.15.22:0/2228110739 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v480) v1 ==== 134+0+0 (secure 0 0 0) 0x7f91fc053660 con 0x7f920c159c60 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91ec067320 msgr2=0x7f91ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91ec067320 0x7f91ec0697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9204007fd0 tx=0x7f9204009040 comp rx=0 tx=0).stop 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 msgr2=0x7f920c14d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 0x7f920c14d210 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0099f0 tx=0x7f91fc019000 comp rx=0 tx=0).stop 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 shutdown_connections 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f91ec067320 0x7f91ec0697d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.879 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f920c15db10 0x7f920c152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f920c159890 0x7f920c14a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 --2- 172.21.15.22:0/2228110739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f920c159c60 0x7f920c14d210 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:18.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 >> 172.21.15.22:0/2228110739 conn(0x7f920c068e20 msgr2=0x7f920c15c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:18.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 shutdown_connections 2023-10-08T00:34:18.880 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:18.877+0000 7f9213118700 1 -- 172.21.15.22:0/2228110739 wait complete. 2023-10-08T00:34:18.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:34:19.017 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.017+0000 7f25c77c0700 1 Processor -- start 2023-10-08T00:34:19.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.017+0000 7f25c77c0700 1 -- start start 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c77c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 0x7f25c015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c77c0700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25c0159c60 0x7f25c015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c77c0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c015a160 con 0x7f25c015db10 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c77c0700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00d13a0 con 0x7f25c0159c60 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c77c0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c015e140 con 0x7f25c0159890 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c5d5d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f25c015db10 0x7f25c0069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51806/0 (socket says 172.21.15.22:51806) 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c5d5d700 1 -- 172.21.15.22:0/895776719 learned_addr learned my addr 172.21.15.22:0/895776719 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:19.021 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c4d5b700 1 --2- 172.21.15.22:0/895776719 >> v2:172.21.15.192:3300/0 conn(0x7f25c0159c60 0x7f25c015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25c555c700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 0x7f25c015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445978775 0 0) 0x7f25c015a160 con 0x7f25c015db10 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.018+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25ac003570 con 0x7f25c015db10 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013070911 0 0) 0x7f25ac003570 con 0x7f25c015db10 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 msgr2=0x7f25c015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 0x7f25c015abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 >> v2:172.21.15.192:3300/0 conn(0x7f25c0159c60 msgr2=0x7f25c015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 --2- 172.21.15.22:0/895776719 >> v2:172.21.15.192:3300/0 conn(0x7f25c0159c60 0x7f25c015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c015a3d0 con 0x7f25c015db10 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f25b80017f0 con 0x7f25c015db10 2023-10-08T00:34:19.022 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 >> v1:172.21.15.22:6789/0 conn(0x7f25c015db10 legacy=0x7f25c0069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac003a60 0x7f25ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25ac004810 0x7f25ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 0x7f25ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00d13a0 con 0x7f25ac004810 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c015e140 con 0x7f25ac003a60 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac00ba60 con 0x7f25c0159890 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25ac004810 0x7f25ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c555c700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac003a60 0x7f25ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c5d5d700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 0x7f25ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 -- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 msgr2=0x7f25ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c0159890 0x7f25ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.023 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 -- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac003a60 msgr2=0x7f25ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:19.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac003a60 0x7f25ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 -- 172.21.15.22:0/895776719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac003570 con 0x7f25ac004810 2023-10-08T00:34:19.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25c4d5b700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25ac004810 0x7f25ac004c80 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009c00 tx=0x7f25b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c1c0be9ba6febc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000e710 con 0x7f25ac004810 2023-10-08T00:34:19.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b000e870 con 0x7f25ac004810 2023-10-08T00:34:19.024 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.019+0000 7f25b7fff700 1 -- 172.21.15.22:0/895776719 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b000ec30 con 0x7f25ac004810 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c77c0700 1 -- 172.21.15.22:0/895776719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25ac004810 msgr2=0x7f25ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c77c0700 1 --2- 172.21.15.22:0/895776719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25ac004810 0x7f25ac004c80 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009c00 tx=0x7f25b00091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c5d5d700 1 -- 172.21.15.22:0/895776719 reap_dead start 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c77c0700 1 -- 172.21.15.22:0/895776719 shutdown_connections 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c77c0700 1 -- 172.21.15.22:0/895776719 >> 172.21.15.22:0/895776719 conn(0x7f25c0068e20 msgr2=0x7f25c00d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c77c0700 1 -- 172.21.15.22:0/895776719 shutdown_connections 2023-10-08T00:34:19.025 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.020+0000 7f25c77c0700 1 -- 172.21.15.22:0/895776719 wait complete. 2023-10-08T00:34:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.021+0000 7f25c77c0700 1 Processor -- start 2023-10-08T00:34:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.021+0000 7f25c77c0700 1 -- start start 2023-10-08T00:34:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c77c0700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac004810 0x7f25c00b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.028 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c77c0700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c014f730 0x7f25c00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c77c0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 0x7f25c0151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c77c0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00b1c80 con 0x7f25c0150eb0 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c77c0700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00cab70 con 0x7f25ac004810 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c77c0700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0150130 con 0x7f25c014f730 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 0x7f25c0151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 0x7f25c0151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56478/0 (socket says 172.21.15.22:56478) 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 -- 172.21.15.22:0/1710106160 learned_addr learned my addr 172.21.15.22:0/1710106160 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c555c700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac004810 0x7f25c00b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c4d5b700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c014f730 0x7f25c00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 -- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c014f730 msgr2=0x7f25c00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.029 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c014f730 0x7f25c00b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 -- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac004810 msgr2=0x7f25c00b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac004810 0x7f25c00b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.022+0000 7f25c5d5d700 1 -- 172.21.15.22:0/1710106160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c01503d0 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.023+0000 7f25c5d5d700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 0x7f25c0151350 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f25c006a860 tx=0x7f25b8001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.023+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b800eb10 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.023+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b800ec70 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.023+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8013420 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.023+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c01506b0 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.023+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c0151890 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.024+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c0150bd0 con 0x7f25c0150eb0 2023-10-08T00:34:19.030 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.024+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f25b8013870 con 0x7f25c0150eb0 2023-10-08T00:34:19.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.025+0000 7f25b57fa700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f25a4067320 0x7f25a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.025+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f25b8084f40 con 0x7f25c0150eb0 2023-10-08T00:34:19.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.025+0000 7f25c555c700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f25a4067320 0x7f25a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.025+0000 7f25c555c700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f25a4067320 0x7f25a40697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006f00 tx=0x7f25bc0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.031 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.029+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25c0150bd0 con 0x7f25c0150eb0 2023-10-08T00:34:19.223 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.222+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f25c0150bd0 con 0x7f25c0150eb0 2023-10-08T00:34:19.226 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.226+0000 7f25b57fa700 1 -- 172.21.15.22:0/1710106160 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f25c0150bd0 con 0x7f25c0150eb0 2023-10-08T00:34:19.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f25a4067320 msgr2=0x7f25a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f25a4067320 0x7f25a40697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f25bc006f00 tx=0x7f25bc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 msgr2=0x7f25c0151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.229 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 0x7f25c0151350 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f25c006a860 tx=0x7f25b8001330 comp rx=0 tx=0).stop 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 shutdown_connections 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25c0150eb0 0x7f25c0151350 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25ac004810 0x7f25c00b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f25a4067320 0x7f25a40697d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.228+0000 7f25c77c0700 1 --2- 172.21.15.22:0/1710106160 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f25c014f730 0x7f25c00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.229+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 >> 172.21.15.22:0/1710106160 conn(0x7f25c0068e20 msgr2=0x7f25c015c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.229+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 shutdown_connections 2023-10-08T00:34:19.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.229+0000 7f25c77c0700 1 -- 172.21.15.22:0/1710106160 wait complete. 2023-10-08T00:34:19.241 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:34:19.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:34:19.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:34:19.329 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:34:19.329 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T00:34:19.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:19.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.448+0000 7f517809c700 1 Processor -- start 2023-10-08T00:34:19.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.448+0000 7f517809c700 1 -- start start 2023-10-08T00:34:19.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f517809c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5170159890 0x7f517015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f517809c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5170159c60 0x7f517015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f517809c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f5170069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f517809c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517015df50 con 0x7f5170159890 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f517809c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517015a160 con 0x7f5170159c60 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f517809c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700d13a0 con 0x7f517015db10 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f5175e38700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5170159890 0x7f517015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f5175e38700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5170159890 0x7f517015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56494/0 (socket says 172.21.15.22:56494) 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.449+0000 7f5175e38700 1 -- 172.21.15.22:0/1532001714 learned_addr learned my addr 172.21.15.22:0/1532001714 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175637700 1 --2- 172.21.15.22:0/1532001714 >> v2:172.21.15.192:3300/0 conn(0x7f5170159c60 0x7f517015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5176639700 1 --2- 172.21.15.22:0/1532001714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f5170069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175e38700 1 -- 172.21.15.22:0/1532001714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 msgr2=0x7f5170069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175e38700 1 --2- 172.21.15.22:0/1532001714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f5170069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175e38700 1 -- 172.21.15.22:0/1532001714 >> v2:172.21.15.192:3300/0 conn(0x7f5170159c60 msgr2=0x7f517015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:19.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175e38700 1 --2- 172.21.15.22:0/1532001714 >> v2:172.21.15.192:3300/0 conn(0x7f5170159c60 0x7f517015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175e38700 1 -- 172.21.15.22:0/1532001714 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517015e140 con 0x7f5170159890 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5175e38700 1 --2- 172.21.15.22:0/1532001714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f517015abd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f51700b67f0 tx=0x7f5168009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665898f8ebe55434 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5174e36700 1 -- 172.21.15.22:0/1532001714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516800b860 con 0x7f5170159890 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5174e36700 1 -- 172.21.15.22:0/1532001714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516800b9c0 con 0x7f5170159890 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f5174e36700 1 -- 172.21.15.22:0/1532001714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516800bd60 con 0x7f5170159890 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f517809c700 1 -- 172.21.15.22:0/1532001714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 msgr2=0x7f517015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.450+0000 7f517809c700 1 --2- 172.21.15.22:0/1532001714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f517015abd0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f51700b67f0 tx=0x7f5168009250 comp rx=0 tx=0).stop 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 -- 172.21.15.22:0/1532001714 shutdown_connections 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 --2- 172.21.15.22:0/1532001714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f517015abd0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 --2- 172.21.15.22:0/1532001714 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f5170069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 --2- 172.21.15.22:0/1532001714 >> v2:172.21.15.192:3300/0 conn(0x7f5170159c60 0x7f517015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 -- 172.21.15.22:0/1532001714 >> 172.21.15.22:0/1532001714 conn(0x7f5170068e20 msgr2=0x7f51700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 -- 172.21.15.22:0/1532001714 shutdown_connections 2023-10-08T00:34:19.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.451+0000 7f517809c700 1 -- 172.21.15.22:0/1532001714 wait complete. 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 Processor -- start 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 -- start start 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f51700b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5170159c60 0x7f51700c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f51700c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5170153650 con 0x7f5170159890 2023-10-08T00:34:19.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51700c9dd0 con 0x7f5170159c60 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.452+0000 7f517809c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51700b3630 con 0x7f517015db10 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f51700b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f51700b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56510/0 (socket says 172.21.15.22:56510) 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 -- 172.21.15.22:0/379420029 learned_addr learned my addr 172.21.15.22:0/379420029 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175637700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5170159c60 0x7f51700c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5176639700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f51700c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 -- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 msgr2=0x7f51700c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f51700c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 -- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5170159c60 msgr2=0x7f51700c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5170159c60 0x7f51700c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 -- 172.21.15.22:0/379420029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680094f0 con 0x7f5170159890 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175637700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5170159c60 0x7f51700c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f5175e38700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f51700b2170 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5170070e20 tx=0x7f5168017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168024440 con 0x7f5170159890 2023-10-08T00:34:19.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51680245a0 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51700b3910 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5168024960 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.453+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51700b3ed0 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.454+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517004c3c0 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.455+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f516801a420 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.455+0000 7f516dffb700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f515c067320 0x7f515c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.455+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f51680866d0 con 0x7f5170159890 2023-10-08T00:34:19.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.456+0000 7f5175637700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f515c067320 0x7f515c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.456+0000 7f5175637700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f515c067320 0x7f515c0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f51701532b0 tx=0x7f5164008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.460+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5168053660 con 0x7f5170159890 2023-10-08T00:34:19.697 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.697+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f517006a5b0 con 0x7f5170159890 2023-10-08T00:34:19.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.697+0000 7f516dffb700 1 -- 172.21.15.22:0/379420029 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+3537 (secure 0 0 0) 0x7f5168015df0 con 0x7f5170159890 2023-10-08T00:34:19.698 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:19.698 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":130,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7786,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2778724837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2778724837},{"type":"v1","addr":"172.21.15.192:6836","nonce":2778724837}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":7789,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1131036034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1131036034},{"type":"v1","addr":"172.21.15.192:6837","nonce":1131036034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":8718,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/4019263721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":4019263721},{"type":"v1","addr":"172.21.15.22:6834","nonce":4019263721}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":121},{"gid":9024,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/588666525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":588666525},{"type":"v1","addr":"172.21.15.22:6835","nonce":588666525}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":130}],"filesystems":[]} 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f515c067320 msgr2=0x7f515c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f515c067320 0x7f515c0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f51701532b0 tx=0x7f5164008040 comp rx=0 tx=0).stop 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 msgr2=0x7f51700b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f51700b2170 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f5170070e20 tx=0x7f5168017000 comp rx=0 tx=0).stop 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 shutdown_connections 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f515c067320 0x7f515c0697d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.700 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f517015db10 0x7f51700c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5170159890 0x7f51700b2170 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 --2- 172.21.15.22:0/379420029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5170159c60 0x7f51700c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 >> 172.21.15.22:0/379420029 conn(0x7f5170068e20 msgr2=0x7f51700c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 shutdown_connections 2023-10-08T00:34:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.699+0000 7f517809c700 1 -- 172.21.15.22:0/379420029 wait complete. 2023-10-08T00:34:19.701 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 130 2023-10-08T00:34:19.712 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T00:34:19.713 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T00:34:19.713 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:34:19.713 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:34:19.713 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T00:34:19.713 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T00:34:19.713 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:34:19.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:34:19.714 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T00:34:19.714 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T00:34:19.714 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:34:19.714 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:34:19.715 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T00:34:19.715 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T00:34:19.715 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:34:19.715 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:34:19.722 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:34:19.722 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T00:34:19.723 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:34:19.723 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T00:34:19.725 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:34:19.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T00:34:19.726 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:34:19.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T00:34:19.764 INFO:tasks.ceph.mds.a:Started 2023-10-08T00:34:19.765 DEBUG:teuthology.parallel:result is None 2023-10-08T00:34:19.765 INFO:tasks.ceph.mds.c:Started 2023-10-08T00:34:19.766 DEBUG:teuthology.parallel:result is None 2023-10-08T00:34:19.768 INFO:tasks.ceph.mds.b:Started 2023-10-08T00:34:19.768 DEBUG:teuthology.parallel:result is None 2023-10-08T00:34:19.769 INFO:tasks.ceph.mds.d:Started 2023-10-08T00:34:19.769 DEBUG:teuthology.parallel:result is None 2023-10-08T00:34:19.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T00:34:19.840 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2023-10-08T00:34:19.841 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2023-10-08T00:34:19.850 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-10-08T00:34:19.850 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:34:19.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.900+0000 7fcdf9810700 1 Processor -- start 2023-10-08T00:34:19.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.900+0000 7fcdf9810700 1 -- start start 2023-10-08T00:34:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.900+0000 7fcdf9810700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.900+0000 7fcdf9810700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf415a160 con 0x7fcdf4159890 2023-10-08T00:34:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.900+0000 7fcdf9810700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40d13a0 con 0x7fcdf415db10 2023-10-08T00:34:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.900+0000 7fcdf9810700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf415e140 con 0x7fcdf4159c60 2023-10-08T00:34:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf2ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcdf4159890 0x7fcdf415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51830/0 (socket says 172.21.15.22:51830) 2023-10-08T00:34:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf2ffd700 1 -- 172.21.15.22:0/3710185253 learned_addr learned my addr 172.21.15.22:0/3710185253 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf27fc700 1 --2- 172.21.15.22:0/3710185253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652598924 0 0) 0x7fcdf415a160 con 0x7fcdf4159890 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde0003570 con 0x7fcdf4159890 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161486859 0 0) 0x7fcdf40d13a0 con 0x7fcdf415db10 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf415a160 con 0x7fcdf415db10 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf27fc700 1 -- 172.21.15.22:0/3710185253 >> v1:172.21.15.192:6789/0 conn(0x7fcdf415db10 legacy=0x7fcdf4069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf27fc700 1 -- 172.21.15.22:0/3710185253 >> v1:172.21.15.22:6789/0 conn(0x7fcdf4159890 legacy=0x7fcdf415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587944161 0 0) 0x7fcde0003570 con 0x7fcdf4159890 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf27fc700 1 -- 172.21.15.22:0/3710185253 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf415a3d0 con 0x7fcdf4159c60 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.901+0000 7fcdf27fc700 1 --2- 172.21.15.22:0/3710185253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf415d5d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009910 tx=0x7fcde40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d7ec0a90344193 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc001470 con 0x7fcdf4159c60 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde4011420 con 0x7fcdf4159c60 2023-10-08T00:34:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf1ffb700 1 -- 172.21.15.22:0/3710185253 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde40117c0 con 0x7fcdf4159c60 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 -- 172.21.15.22:0/3710185253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 msgr2=0x7fcdf415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 --2- 172.21.15.22:0/3710185253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf415d5d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009910 tx=0x7fcde40091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 -- 172.21.15.22:0/3710185253 shutdown_connections 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 --2- 172.21.15.22:0/3710185253 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf415d5d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 -- 172.21.15.22:0/3710185253 >> 172.21.15.22:0/3710185253 conn(0x7fcdf4068e20 msgr2=0x7fcdf40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 -- 172.21.15.22:0/3710185253 shutdown_connections 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.902+0000 7fcdf9810700 1 -- 172.21.15.22:0/3710185253 wait complete. 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.903+0000 7fcdf9810700 1 Processor -- start 2023-10-08T00:34:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.903+0000 7fcdf9810700 1 -- start start 2023-10-08T00:34:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf9810700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf4159890 0x7fcdf40b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf9810700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf4147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf9810700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 0x7fcdf40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf9810700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40cf2a0 con 0x7fcdf415db10 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf9810700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40b6460 con 0x7fcdf4159890 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf9810700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf41478c0 con 0x7fcdf4159c60 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 0x7fcdf40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 0x7fcdf40cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56536/0 (socket says 172.21.15.22:56536) 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 -- 172.21.15.22:0/348420720 learned_addr learned my addr 172.21.15.22:0/348420720 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf2ffd700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf4159890 0x7fcdf40b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf27fc700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf4147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 -- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 msgr2=0x7fcdf4147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf4147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 -- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf4159890 msgr2=0x7fcdf40b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.904+0000 7fcdf37fe700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf4159890 0x7fcdf40b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdf37fe700 1 -- 172.21.15.22:0/348420720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4009420 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdf37fe700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 0x7fcdf40cf730 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c890 tx=0x7fcdec002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec012630 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40ce5e0 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec0127b0 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec012b70 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.905+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf40cef30 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.906+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf40ceab0 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.906+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcdec01b400 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.907+0000 7fcdeaffd700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdd4067320 0x7fcdd40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.907+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcdec084c70 con 0x7fcdf415db10 2023-10-08T00:34:19.910 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.907+0000 7fcdf2ffd700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdd4067320 0x7fcdd40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.907+0000 7fcdf2ffd700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdd4067320 0x7fcdd40697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0015a0 tx=0x7fcddc000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:19.911+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdf40ceab0 con 0x7fcdf415db10 2023-10-08T00:34:20.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.123+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcdf40ceab0 con 0x7fcdf415db10 2023-10-08T00:34:20.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.890+0000 7fcdeaffd700 1 -- 172.21.15.22:0/348420720 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v198) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcdf40ceab0 con 0x7fcdf415db10 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdd4067320 msgr2=0x7fcdd40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdd4067320 0x7fcdd40697d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0015a0 tx=0x7fcddc000bc0 comp rx=0 tx=0).stop 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 msgr2=0x7fcdf40cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 0x7fcdf40cf730 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00c890 tx=0x7fcdec002700 comp rx=0 tx=0).stop 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 shutdown_connections 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcdf415db10 0x7fcdf40cf730 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf4159890 0x7fcdf40b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:20.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcdd4067320 0x7fcdd40697d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:20.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 --2- 172.21.15.22:0/348420720 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcdf4159c60 0x7fcdf4147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:20.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 >> 172.21.15.22:0/348420720 conn(0x7fcdf4068e20 msgr2=0x7fcdf41586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:20.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 shutdown_connections 2023-10-08T00:34:20.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:20.893+0000 7fcdf9810700 1 -- 172.21.15.22:0/348420720 wait complete. 2023-10-08T00:34:20.895 INFO:teuthology.orchestra.run.smithi022.stderr: removed all blocklist entries 2023-10-08T00:34:20.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T00:34:21.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.034+0000 7fd077267700 1 Processor -- start 2023-10-08T00:34:21.035 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.034+0000 7fd077267700 1 -- start start 2023-10-08T00:34:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd077267700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd070159c60 0x7fd07015d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd077267700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd07015db10 0x7fd070069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd077267700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07015a160 con 0x7fd070159890 2023-10-08T00:34:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd077267700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07015df50 con 0x7fd07015db10 2023-10-08T00:34:21.039 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd077267700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700d13a0 con 0x7fd070159c60 2023-10-08T00:34:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd075003700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd070159890 0x7fd07015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:60292/0 (socket says 172.21.15.22:60292) 2023-10-08T00:34:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd075003700 1 -- 172.21.15.22:0/1891247795 learned_addr learned my addr 172.21.15.22:0/1891247795 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd074802700 1 --2- 172.21.15.22:0/1891247795 >> v2:172.21.15.192:3300/0 conn(0x7fd070159c60 0x7fd07015d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.035+0000 7fd075804700 1 --2- 172.21.15.22:0/1891247795 >> v2:172.21.15.22:3300/0 conn(0x7fd07015db10 0x7fd070069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd067fff700 1 -- 172.21.15.22:0/1891247795 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029848680 0 0) 0x7fd07015a160 con 0x7fd070159890 2023-10-08T00:34:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd067fff700 1 -- 172.21.15.22:0/1891247795 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd05c003570 con 0x7fd070159890 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd075804700 1 -- 172.21.15.22:0/1891247795 >> v2:172.21.15.192:3300/0 conn(0x7fd070159c60 msgr2=0x7fd07015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd075804700 1 --2- 172.21.15.22:0/1891247795 >> v2:172.21.15.192:3300/0 conn(0x7fd070159c60 0x7fd07015d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd075804700 1 -- 172.21.15.22:0/1891247795 >> v1:172.21.15.192:6789/0 conn(0x7fd070159890 legacy=0x7fd07015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd075804700 1 -- 172.21.15.22:0/1891247795 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07015e140 con 0x7fd07015db10 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd075804700 1 --2- 172.21.15.22:0/1891247795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd070069560 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b67f0 tx=0x7fd068009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489d50d57dd8310 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd067fff700 1 -- 172.21.15.22:0/1891247795 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800e070 con 0x7fd07015db10 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd067fff700 1 -- 172.21.15.22:0/1891247795 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06800bab0 con 0x7fd07015db10 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.036+0000 7fd067fff700 1 -- 172.21.15.22:0/1891247795 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800be70 con 0x7fd07015db10 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 -- 172.21.15.22:0/1891247795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 msgr2=0x7fd070069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.041 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 --2- 172.21.15.22:0/1891247795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd070069560 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b67f0 tx=0x7fd068009780 comp rx=0 tx=0).stop 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 -- 172.21.15.22:0/1891247795 shutdown_connections 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 --2- 172.21.15.22:0/1891247795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd070069560 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 --2- 172.21.15.22:0/1891247795 >> v2:172.21.15.192:3300/0 conn(0x7fd070159c60 0x7fd07015d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 -- 172.21.15.22:0/1891247795 >> 172.21.15.22:0/1891247795 conn(0x7fd070068e20 msgr2=0x7fd0700d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 -- 172.21.15.22:0/1891247795 shutdown_connections 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.037+0000 7fd077267700 1 -- 172.21.15.22:0/1891247795 wait complete. 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.038+0000 7fd077267700 1 Processor -- start 2023-10-08T00:34:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.038+0000 7fd077267700 1 -- start start 2023-10-08T00:34:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd077267700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd070159890 0x7fd0700b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd077267700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd070159c60 0x7fd0700c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd077267700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd07016ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd077267700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07016dbf0 con 0x7fd07015db10 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd077267700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b3ad0 con 0x7fd070159c60 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd077267700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07015beb0 con 0x7fd070159890 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd075804700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd07016ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd075804700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd07016ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56552/0 (socket says 172.21.15.22:56552) 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd075804700 1 -- 172.21.15.22:0/3679916262 learned_addr learned my addr 172.21.15.22:0/3679916262 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd074802700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd070159c60 0x7fd0700c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd075003700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd070159890 0x7fd0700b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.046 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd075804700 1 -- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd070159890 msgr2=0x7fd0700b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.039+0000 7fd075804700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd070159890 0x7fd0700b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd075804700 1 -- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd070159c60 msgr2=0x7fd0700c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd075804700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd070159c60 0x7fd0700c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd075804700 1 -- 172.21.15.22:0/3679916262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068009a20 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd075804700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd07016ce80 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd070070e20 tx=0x7fd068019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068012dd0 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd068027470 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07015c190 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068027830 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.040+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07015c750 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.041+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07004c3c0 con 0x7fd07015db10 2023-10-08T00:34:21.047 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.041+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd068024070 con 0x7fd07015db10 2023-10-08T00:34:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.042+0000 7fd0657fa700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd054067320 0x7fd0540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.042+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd068087300 con 0x7fd07015db10 2023-10-08T00:34:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.042+0000 7fd075003700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd054067320 0x7fd0540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.042+0000 7fd075003700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd054067320 0x7fd0540697d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd06c007fd0 tx=0x7fd06c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.048 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.046+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0680542a0 con 0x7fd07015db10 2023-10-08T00:34:21.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.322+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd07006a5b0 con 0x7fd07015db10 2023-10-08T00:34:21.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.322+0000 7fd0657fa700 1 -- 172.21.15.22:0/3679916262 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd0680578c0 con 0x7fd07015db10 2023-10-08T00:34:21.325 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:21.325 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:34:21.325 INFO:teuthology.orchestra.run.smithi022.stdout: "auth_dump": [ 2023-10-08T00:34:21.325 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.325 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.a", 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlyZ//OhAAZaUT4u5wWlfF/Ufs6QKlRw==", 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.326 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.b", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlfkZDCxAACwD9mWg8x3fJgk5tjoNTnA==", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.c", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlxkZYBhAAQC6+sBgWzVFWQ6XLuIyfuw==", 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.327 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mds.d", 2023-10-08T00:34:21.328 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlhvfbFBAADvh6Fe1xZ95Mm23a2N9vCw==", 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.0", 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCk9iFlriSzOBAAgO2TmjQ+HJon+i2rdytC6Q==", 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.329 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.1", 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCn9iFl+aCXNhAAxtzdrOZrShpvFPNd3mM6JA==", 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.330 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.2", 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCq9iFl0yv9NBAAJWNruNU6xm9Q1YnFKDe7yw==", 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.3", 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCt9iFlLSwCMxAA8oBgZdWJrRb154+OY3V8Uw==", 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.332 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.4", 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCz9iFl3w1jMRAA7lKbJDB+kWod53X++PIj/w==", 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.5", 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC29iFl2TCdLxAA62sHOUFXqRcSJcuizOx7ug==", 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.6", 2023-10-08T00:34:21.334 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC59iFluLfcLBAA2Tj3mbgxwjc5uyCB8jNATA==", 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "osd.7", 2023-10-08T00:34:21.335 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQC89iFlfxopLRAA5kqb5L6G8uzskvaPbWZmoQ==", 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow profile osd", 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile osd", 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.0", 2023-10-08T00:34:21.336 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFl+i7dGBAADEmAr2VVq5CPO+jgWrxM8g==", 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow r", 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.1", 2023-10-08T00:34:21.337 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlqG/RIRAAeQrOmSTy8VmRdcG9Lgw1yg==", 2023-10-08T00:34:21.338 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.338 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.338 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:34:21.338 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:34:21.338 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:34:21.338 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.2", 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlYVXAHhAAnXUk7gfjxZP4Hl+RexFrPw==", 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.339 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:34:21.340 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:34:21.340 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:34:21.340 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.340 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.340 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.3", 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCj9iFlzBpGJxAARhQbbyWo/YVl/apfUshcsA==", 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow", 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow r", 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow rw", 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow rwx" 2023-10-08T00:34:21.341 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "client.admin", 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlK/4hHhAALWrba2JkMEhwsdvmHcxnMg==", 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": "allow *", 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow *", 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.x", 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFl4WLjNxAAgLMHfiNmPAfELmx8VtclZg==", 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "entity": "mgr.y", 2023-10-08T00:34:21.343 INFO:teuthology.orchestra.run.smithi022.stdout: "key": "AQCi9iFlymNHNBAA0j+RTZJ4x+5DXouLux44yw==", 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": { 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": "allow *", 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": "allow profile mgr", 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": "allow *" 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2023-10-08T00:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:34:21.345 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd054067320 msgr2=0x7fd0540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd054067320 0x7fd0540697d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd06c007fd0 tx=0x7fd06c009040 comp rx=0 tx=0).stop 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 msgr2=0x7fd07016ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd07016ce80 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd070070e20 tx=0x7fd068019000 comp rx=0 tx=0).stop 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 shutdown_connections 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd07015db10 0x7fd07016ce80 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fd054067320 0x7fd0540697d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd070159890 0x7fd0700b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 --2- 172.21.15.22:0/3679916262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd070159c60 0x7fd0700c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 >> 172.21.15.22:0/3679916262 conn(0x7fd070068e20 msgr2=0x7fd0700b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:21.346 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 shutdown_connections 2023-10-08T00:34:21.347 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.324+0000 7fd077267700 1 -- 172.21.15.22:0/3679916262 wait complete. 2023-10-08T00:34:21.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:21.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.465+0000 7f9d668ca700 1 Processor -- start 2023-10-08T00:34:21.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.465+0000 7f9d668ca700 1 -- start start 2023-10-08T00:34:21.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d668ca700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9d60159420 0x7f9d600b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d668ca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9d6015d230 0x7f9d6015d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d668ca700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d600b2980 con 0x7f9d601597f0 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d668ca700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d6015db70 con 0x7f9d6015d230 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d668ca700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d600b11d0 con 0x7f9d60159420 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9d6015d230 0x7f9d6015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9d6015d230 0x7f9d6015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56558/0 (socket says 172.21.15.22:56558) 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 -- 172.21.15.22:0/731319271 learned_addr learned my addr 172.21.15.22:0/731319271 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d658c8700 1 --2- 172.21.15.22:0/731319271 >> v2:172.21.15.192:3300/0 conn(0x7f9d60159420 0x7f9d600b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 -- 172.21.15.22:0/731319271 >> v2:172.21.15.192:3300/0 conn(0x7f9d60159420 msgr2=0x7f9d600b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 --2- 172.21.15.22:0/731319271 >> v2:172.21.15.192:3300/0 conn(0x7f9d60159420 0x7f9d600b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 -- 172.21.15.22:0/731319271 >> v1:172.21.15.192:6789/0 conn(0x7f9d601597f0 legacy=0x7f9d600b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:21.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.466+0000 7f9d660c9700 1 -- 172.21.15.22:0/731319271 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d600b14b0 con 0x7f9d6015d230 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d660c9700 1 --2- 172.21.15.22:0/731319271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6015d230 0x7f9d6015d630 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f9d600b2f20 tx=0x7f9d58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398ae78c36a49270 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d648c6700 1 -- 172.21.15.22:0/731319271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800b820 con 0x7f9d6015d230 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d648c6700 1 -- 172.21.15.22:0/731319271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800b980 con 0x7f9d6015d230 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d648c6700 1 -- 172.21.15.22:0/731319271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5800bd20 con 0x7f9d6015d230 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 -- 172.21.15.22:0/731319271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6015d230 msgr2=0x7f9d6015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 --2- 172.21.15.22:0/731319271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6015d230 0x7f9d6015d630 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f9d600b2f20 tx=0x7f9d58009250 comp rx=0 tx=0).stop 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 -- 172.21.15.22:0/731319271 shutdown_connections 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 --2- 172.21.15.22:0/731319271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d6015d230 0x7f9d6015d630 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 --2- 172.21.15.22:0/731319271 >> v2:172.21.15.192:3300/0 conn(0x7f9d60159420 0x7f9d600b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 -- 172.21.15.22:0/731319271 >> 172.21.15.22:0/731319271 conn(0x7f9d600d0660 msgr2=0x7f9d600d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:21.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 -- 172.21.15.22:0/731319271 shutdown_connections 2023-10-08T00:34:21.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.467+0000 7f9d668ca700 1 -- 172.21.15.22:0/731319271 wait complete. 2023-10-08T00:34:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 Processor -- start 2023-10-08T00:34:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 -- start start 2023-10-08T00:34:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 0x7f9d600cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d601597f0 0x7f9d600cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d6015d230 0x7f9d6015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60147a30 con 0x7f9d60159420 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d60147d10 con 0x7f9d601597f0 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d668ca700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d600cbdd0 con 0x7f9d6015d230 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d658c8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 0x7f9d600cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d658c8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 0x7f9d600cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56574/0 (socket says 172.21.15.22:56574) 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.469+0000 7f9d658c8700 1 -- 172.21.15.22:0/3893210285 learned_addr learned my addr 172.21.15.22:0/3893210285 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d660c9700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d6015d230 0x7f9d6015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d650c7700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d601597f0 0x7f9d600cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d658c8700 1 -- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d6015d230 msgr2=0x7f9d6015ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d658c8700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d6015d230 0x7f9d6015ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d658c8700 1 -- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d601597f0 msgr2=0x7f9d600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d658c8700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d601597f0 0x7f9d600cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d658c8700 1 -- 172.21.15.22:0/3893210285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580094f0 con 0x7f9d60159420 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d650c7700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d601597f0 0x7f9d600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d658c8700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 0x7f9d600cb1b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000e1c0 tx=0x7f9d50009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000ee60 con 0x7f9d60159420 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d50014420 con 0x7f9d60159420 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d600cc0b0 con 0x7f9d60159420 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d500147e0 con 0x7f9d60159420 2023-10-08T00:34:21.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.470+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6015c260 con 0x7f9d60159420 2023-10-08T00:34:21.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.471+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6004c3c0 con 0x7f9d60159420 2023-10-08T00:34:21.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.472+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9d50014b90 con 0x7f9d60159420 2023-10-08T00:34:21.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.472+0000 7f9d5dffb700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d4c067320 0x7f9d4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.472+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f9d50085140 con 0x7f9d60159420 2023-10-08T00:34:21.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.472+0000 7f9d650c7700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d4c067320 0x7f9d4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.473+0000 7f9d650c7700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d4c067320 0x7f9d4c0697d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006fd0 tx=0x7f9d54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.476+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d50052120 con 0x7f9d60159420 2023-10-08T00:34:21.671 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.671+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d600b1790 con 0x7f9d60159420 2023-10-08T00:34:21.672 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.672+0000 7f9d5dffb700 1 -- 172.21.15.22:0/3893210285 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+12144 (secure 0 0 0) 0x7f9d50009a60 con 0x7f9d60159420 2023-10-08T00:34:21.672 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:21.673 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":198,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:20.886367+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":185,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d4c067320 msgr2=0x7f9d4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d4c067320 0x7f9d4c0697d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006fd0 tx=0x7f9d54008040 comp rx=0 tx=0).stop 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 msgr2=0x7f9d600cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 0x7f9d600cb1b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000e1c0 tx=0x7f9d50009920 comp rx=0 tx=0).stop 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 shutdown_connections 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9d4c067320 0x7f9d4c0697d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9d6015d230 0x7f9d6015ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d60159420 0x7f9d600cb1b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 --2- 172.21.15.22:0/3893210285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d601597f0 0x7f9d600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 >> 172.21.15.22:0/3893210285 conn(0x7f9d600d0660 msgr2=0x7f9d60156230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:21.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 shutdown_connections 2023-10-08T00:34:21.676 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.674+0000 7f9d668ca700 1 -- 172.21.15.22:0/3893210285 wait complete. 2023-10-08T00:34:21.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T00:34:21.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:34:21.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.809+0000 7f9049d82700 1 Processor -- start 2023-10-08T00:34:21.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.809+0000 7f9049d82700 1 -- start start 2023-10-08T00:34:21.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9049d82700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90440b16d0 0x7f90440b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9049d82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90440b33b0 0x7f90440b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9049d82700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440b2080 con 0x7f90440b4e70 2023-10-08T00:34:21.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9049d82700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440cfb00 con 0x7f90440b16d0 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9049d82700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440b5c40 con 0x7f90440b33b0 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9048d80700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f90440b4e70 0x7f90440ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51842/0 (socket says 172.21.15.22:51842) 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9048d80700 1 -- 172.21.15.22:0/1916704095 learned_addr learned my addr 172.21.15.22:0/1916704095 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9043fff700 1 --2- 172.21.15.22:0/1916704095 >> v2:172.21.15.22:3300/0 conn(0x7f90440b16d0 0x7f90440b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9049581700 1 --2- 172.21.15.22:0/1916704095 >> v2:172.21.15.192:3300/0 conn(0x7f90440b33b0 0x7f90440b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9043fff700 1 -- 172.21.15.22:0/1916704095 >> v2:172.21.15.192:3300/0 conn(0x7f90440b33b0 msgr2=0x7f90440b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:21.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9043fff700 1 --2- 172.21.15.22:0/1916704095 >> v2:172.21.15.192:3300/0 conn(0x7f90440b33b0 0x7f90440b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9043fff700 1 -- 172.21.15.22:0/1916704095 >> v1:172.21.15.22:6789/0 conn(0x7f90440b4e70 legacy=0x7f90440ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f90437fe700 1 -- 172.21.15.22:0/1916704095 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994557042 0 0) 0x7f90440b2080 con 0x7f90440b4e70 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.810+0000 7f9043fff700 1 -- 172.21.15.22:0/1916704095 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440b5f20 con 0x7f90440b16d0 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9043fff700 1 --2- 172.21.15.22:0/1916704095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b16d0 0x7f90440b1b40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9044071380 tx=0x7f90380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718c09257b2a920e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f90437fe700 1 -- 172.21.15.22:0/1916704095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800b6b0 con 0x7f90440b16d0 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f90437fe700 1 -- 172.21.15.22:0/1916704095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903800b810 con 0x7f90440b16d0 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f90437fe700 1 -- 172.21.15.22:0/1916704095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800bbb0 con 0x7f90440b16d0 2023-10-08T00:34:21.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 -- 172.21.15.22:0/1916704095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b16d0 msgr2=0x7f90440b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 --2- 172.21.15.22:0/1916704095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b16d0 0x7f90440b1b40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9044071380 tx=0x7f90380091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 -- 172.21.15.22:0/1916704095 shutdown_connections 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 --2- 172.21.15.22:0/1916704095 >> v2:172.21.15.192:3300/0 conn(0x7f90440b33b0 0x7f90440b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 --2- 172.21.15.22:0/1916704095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b16d0 0x7f90440b1b40 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 -- 172.21.15.22:0/1916704095 >> 172.21.15.22:0/1916704095 conn(0x7f90440d10c0 msgr2=0x7f90440affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 -- 172.21.15.22:0/1916704095 shutdown_connections 2023-10-08T00:34:21.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.811+0000 7f9049d82700 1 -- 172.21.15.22:0/1916704095 wait complete. 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.812+0000 7f9049d82700 1 Processor -- start 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.812+0000 7f9049d82700 1 -- start start 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049d82700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b16d0 0x7f904416d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049d82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90440b33b0 0x7f90441699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049d82700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 0x7f90440cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049d82700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440c7020 con 0x7f90440b4e70 2023-10-08T00:34:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049d82700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440c7270 con 0x7f90440b16d0 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049d82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440c7550 con 0x7f90440b33b0 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049581700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 0x7f90440cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049581700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 0x7f90440cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56582/0 (socket says 172.21.15.22:56582) 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9049581700 1 -- 172.21.15.22:0/4221474659 learned_addr learned my addr 172.21.15.22:0/4221474659 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9048d80700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b16d0 0x7f904416d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.813+0000 7f9043fff700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90440b33b0 0x7f90441699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049581700 1 -- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90440b33b0 msgr2=0x7f90441699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049581700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90440b33b0 0x7f90441699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049581700 1 -- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b16d0 msgr2=0x7f904416d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049581700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b16d0 0x7f904416d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049581700 1 -- 172.21.15.22:0/4221474659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9038009420 con 0x7f90440b4e70 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049581700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 0x7f90440cb430 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f903c009fa0 tx=0x7f903c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ebc0 con 0x7f90440b4e70 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00ed20 con 0x7f90440b4e70 2023-10-08T00:34:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90440c7830 con 0x7f90440b4e70 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c014670 con 0x7f90440b4e70 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.814+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90440c7e70 con 0x7f90440b4e70 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.815+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9044088990 con 0x7f90440b4e70 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.815+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f903c0149e0 con 0x7f90440b4e70 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.816+0000 7f9040ff9700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9030067320 0x7f90300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.816+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f903c084fc0 con 0x7f90440b4e70 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.816+0000 7f9048d80700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9030067320 0x7f90300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:21.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.816+0000 7f9048d80700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9030067320 0x7f90300697d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:21.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:21.820+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f903c051fa0 con 0x7f90440b4e70 2023-10-08T00:34:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.014+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f904404bb80 con 0x7f90440b4e70 2023-10-08T00:34:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.015+0000 7f9040ff9700 1 -- 172.21.15.22:0/4221474659 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v198) v1 ==== 93+0+10 (secure 0 0 0) 0x7f903c0555c0 con 0x7f90440b4e70 2023-10-08T00:34:22.016 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:34:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9030067320 msgr2=0x7f90300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9030067320 0x7f90300697d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034007d30 comp rx=0 tx=0).stop 2023-10-08T00:34:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 msgr2=0x7f90440cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 0x7f90440cb430 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f903c009fa0 tx=0x7f903c009900 comp rx=0 tx=0).stop 2023-10-08T00:34:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 shutdown_connections 2023-10-08T00:34:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90440b4e70 0x7f90440cb430 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b16d0 0x7f904416d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9030067320 0x7f90300697d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 --2- 172.21.15.22:0/4221474659 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f90440b33b0 0x7f90441699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 >> 172.21.15.22:0/4221474659 conn(0x7f90440d10c0 msgr2=0x7f9044069710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 shutdown_connections 2023-10-08T00:34:22.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.017+0000 7f9049d82700 1 -- 172.21.15.22:0/4221474659 wait complete. 2023-10-08T00:34:22.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T00:34:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.148+0000 7efd38447700 1 Processor -- start 2023-10-08T00:34:22.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.148+0000 7efd38447700 1 -- start start 2023-10-08T00:34:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd38447700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd30159890 0x7efd3015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd38447700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3015a160 con 0x7efd30069560 2023-10-08T00:34:22.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd38447700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300d13a0 con 0x7efd30159c60 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd38447700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd3015e140 con 0x7efd30159890 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd361e3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efd30159890 0x7efd3015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd369e4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efd30069560 0x7efd300ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51846/0 (socket says 172.21.15.22:51846) 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.149+0000 7efd369e4700 1 -- 172.21.15.22:0/2688589058 learned_addr learned my addr 172.21.15.22:0/2688589058 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd351e1700 1 -- 172.21.15.22:0/2688589058 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587154374 0 0) 0x7efd3015a160 con 0x7efd30069560 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd351e1700 1 -- 172.21.15.22:0/2688589058 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd18003570 con 0x7efd30069560 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd361e3700 1 -- 172.21.15.22:0/2688589058 >> v1:172.21.15.192:6789/0 conn(0x7efd30159c60 legacy=0x7efd3015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd361e3700 1 -- 172.21.15.22:0/2688589058 >> v1:172.21.15.22:6789/0 conn(0x7efd30069560 legacy=0x7efd300ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd361e3700 1 -- 172.21.15.22:0/2688589058 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3015a3d0 con 0x7efd30159890 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd361e3700 1 --2- 172.21.15.22:0/2688589058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30159890 0x7efd3015abd0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7efd280098e0 tx=0x7efd280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509da7d17a741059 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd351e1700 1 -- 172.21.15.22:0/2688589058 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800b640 con 0x7efd30159890 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd351e1700 1 -- 172.21.15.22:0/2688589058 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2800b7a0 con 0x7efd30159890 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.150+0000 7efd351e1700 1 -- 172.21.15.22:0/2688589058 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800bb40 con 0x7efd30159890 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 -- 172.21.15.22:0/2688589058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30159890 msgr2=0x7efd3015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 --2- 172.21.15.22:0/2688589058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30159890 0x7efd3015abd0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7efd280098e0 tx=0x7efd280091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 -- 172.21.15.22:0/2688589058 shutdown_connections 2023-10-08T00:34:22.153 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 --2- 172.21.15.22:0/2688589058 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30159890 0x7efd3015abd0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 -- 172.21.15.22:0/2688589058 >> 172.21.15.22:0/2688589058 conn(0x7efd30068e20 msgr2=0x7efd300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 -- 172.21.15.22:0/2688589058 shutdown_connections 2023-10-08T00:34:22.154 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.151+0000 7efd38447700 1 -- 172.21.15.22:0/2688589058 wait complete. 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.152+0000 7efd38447700 1 Processor -- start 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.152+0000 7efd38447700 1 -- start start 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 0x7efd301582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd30159890 0x7efd300b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd30159c60 0x7efd300c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c8c20 con 0x7efd30069560 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c8010 con 0x7efd30159c60 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300c82f0 con 0x7efd30159890 2023-10-08T00:34:22.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 0x7efd301582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 0x7efd301582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56604/0 (socket says 172.21.15.22:56604) 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 -- 172.21.15.22:0/1951891345 learned_addr learned my addr 172.21.15.22:0/1951891345 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 -- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd30159890 msgr2=0x7efd300b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd369e4700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd30159c60 0x7efd300c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd30159890 0x7efd300b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 -- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd30159c60 msgr2=0x7efd300c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd30159c60 0x7efd300c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 -- 172.21.15.22:0/1951891345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009420 con 0x7efd30069560 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd361e3700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 0x7efd301582e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7efd30070e20 tx=0x7efd28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:22.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800bb20 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28011420 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300c85d0 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd280117a0 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.153+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300b3af0 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.154+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3004c3c0 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.155+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efd28011b90 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.155+0000 7efd2e7fc700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efd1c067320 0x7efd1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.155+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efd280860f0 con 0x7efd30069560 2023-10-08T00:34:22.159 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.155+0000 7efd359e2700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efd1c067320 0x7efd1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.156+0000 7efd359e2700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efd1c067320 0x7efd1c0697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efd300b4e00 tx=0x7efd24007b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:22.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.159+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd280530d0 con 0x7efd30069560 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.355+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd3006a5b0 con 0x7efd30069560 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.355+0000 7efd2e7fc700 1 -- 172.21.15.22:0/1951891345 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v198) v1 ==== 84+0+65 (secure 0 0 0) 0x7efd280566f0 con 0x7efd30069560 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2023-10-08T00:34:22.356 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2023-10-08T00:34:22.357 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:22.357 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:34:22.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efd1c067320 msgr2=0x7efd1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efd1c067320 0x7efd1c0697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7efd300b4e00 tx=0x7efd24007b40 comp rx=0 tx=0).stop 2023-10-08T00:34:22.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 msgr2=0x7efd301582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 0x7efd301582e0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7efd30070e20 tx=0x7efd28017000 comp rx=0 tx=0).stop 2023-10-08T00:34:22.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 shutdown_connections 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd30159c60 0x7efd300c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd30069560 0x7efd301582e0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efd1c067320 0x7efd1c0697d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 --2- 172.21.15.22:0/1951891345 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efd30159890 0x7efd300b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 >> 172.21.15.22:0/1951891345 conn(0x7efd30068e20 msgr2=0x7efd30152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 shutdown_connections 2023-10-08T00:34:22.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.357+0000 7efd38447700 1 -- 172.21.15.22:0/1951891345 wait complete. 2023-10-08T00:34:22.370 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T00:34:22.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T00:34:22.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.493+0000 7ffbb4140700 1 Processor -- start 2023-10-08T00:34:22.494 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.493+0000 7ffbb4140700 1 -- start start 2023-10-08T00:34:22.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb4140700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffbac159ec0 0x7ffbac0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb4140700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0b53d0 0x7ffbac0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb4140700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffbac0cce40 0x7ffbac0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb4140700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0b5b00 con 0x7ffbac159ec0 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb4140700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbac0b5850 con 0x7ffbac0cce40 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb4140700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0b5da0 con 0x7ffbac0b53d0 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb1edc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffbac159ec0 0x7ffbac0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb1edc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffbac159ec0 0x7ffbac0b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56606/0 (socket says 172.21.15.22:56606) 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb1edc700 1 -- 172.21.15.22:0/2983794563 learned_addr learned my addr 172.21.15.22:0/2983794563 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb26dd700 1 --2- 172.21.15.22:0/2983794563 >> v2:172.21.15.192:3300/0 conn(0x7ffbac0cce40 0x7ffbac0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.494+0000 7ffbb16db700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0b53d0 0x7ffbac0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb1edc700 1 -- 172.21.15.22:0/2983794563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0b53d0 msgr2=0x7ffbac0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb1edc700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0b53d0 0x7ffbac0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb1edc700 1 -- 172.21.15.22:0/2983794563 >> v2:172.21.15.192:3300/0 conn(0x7ffbac0cce40 msgr2=0x7ffbac0cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb1edc700 1 --2- 172.21.15.22:0/2983794563 >> v2:172.21.15.192:3300/0 conn(0x7ffbac0cce40 0x7ffbac0cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb1edc700 1 -- 172.21.15.22:0/2983794563 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac0b6080 con 0x7ffbac159ec0 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb16db700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0b53d0 0x7ffbac0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb1edc700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac159ec0 0x7ffbac0b4e90 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0c75b0 tx=0x7ffba4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0e0bd0361e9f6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb0eda700 1 -- 172.21.15.22:0/2983794563 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4005c10 con 0x7ffbac159ec0 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb0eda700 1 -- 172.21.15.22:0/2983794563 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4005d70 con 0x7ffbac159ec0 2023-10-08T00:34:22.498 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb0eda700 1 -- 172.21.15.22:0/2983794563 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4006260 con 0x7ffbac159ec0 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb4140700 1 -- 172.21.15.22:0/2983794563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac159ec0 msgr2=0x7ffbac0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.495+0000 7ffbb4140700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac159ec0 0x7ffbac0b4e90 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7ffbac0c75b0 tx=0x7ffba4009220 comp rx=0 tx=0).stop 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 -- 172.21.15.22:0/2983794563 shutdown_connections 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac159ec0 0x7ffbac0b4e90 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 --2- 172.21.15.22:0/2983794563 >> v2:172.21.15.192:3300/0 conn(0x7ffbac0cce40 0x7ffbac0cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 --2- 172.21.15.22:0/2983794563 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0b53d0 0x7ffbac0cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 -- 172.21.15.22:0/2983794563 >> 172.21.15.22:0/2983794563 conn(0x7ffbac0999f0 msgr2=0x7ffbac0b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:22.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 -- 172.21.15.22:0/2983794563 shutdown_connections 2023-10-08T00:34:22.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.496+0000 7ffbb4140700 1 -- 172.21.15.22:0/2983794563 wait complete. 2023-10-08T00:34:22.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 Processor -- start 2023-10-08T00:34:22.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 -- start start 2023-10-08T00:34:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 0x7ffbac06ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0cce40 0x7ffbac069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbac159ec0 0x7ffbac150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac0698a0 con 0x7ffbac0b53d0 2023-10-08T00:34:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac069ad0 con 0x7ffbac159ec0 2023-10-08T00:34:22.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.497+0000 7ffbb4140700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac069db0 con 0x7ffbac0cce40 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 0x7ffbac06ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 0x7ffbac06ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56612/0 (socket says 172.21.15.22:56612) 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 -- 172.21.15.22:0/3400218555 learned_addr learned my addr 172.21.15.22:0/3400218555 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 -- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0cce40 msgr2=0x7ffbac069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb26dd700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbac159ec0 0x7ffbac150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0cce40 0x7ffbac069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 -- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbac159ec0 msgr2=0x7ffbac150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbac159ec0 0x7ffbac150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 -- 172.21.15.22:0/3400218555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4009480 con 0x7ffbac0b53d0 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb1edc700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 0x7ffbac06ae50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7ffba400b0e0 tx=0x7ffba4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba400b880 con 0x7ffbac0b53d0 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4020070 con 0x7ffbac0b53d0 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbac06a090 con 0x7ffbac0b53d0 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba400bc10 con 0x7ffbac0b53d0 2023-10-08T00:34:22.505 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.498+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbac1508c0 con 0x7ffbac0b53d0 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.499+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbac156f70 con 0x7ffbac0b53d0 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.500+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffba4022030 con 0x7ffbac0b53d0 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.500+0000 7ffba9ffb700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb98067320 0x7ffb980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.500+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffba4086270 con 0x7ffbac0b53d0 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.500+0000 7ffbb16db700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb98067320 0x7ffb980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.501+0000 7ffbb16db700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb98067320 0x7ffb980697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006fd0 tx=0x7ffba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:22.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.504+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbac156f70 con 0x7ffbac0b53d0 2023-10-08T00:34:22.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.697+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ffbac156f70 con 0x7ffbac0b53d0 2023-10-08T00:34:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.896+0000 7ffba9ffb700 1 -- 172.21.15.22:0/3400218555 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v199) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffbac156f70 con 0x7ffbac0b53d0 2023-10-08T00:34:22.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb98067320 msgr2=0x7ffb980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.901 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb98067320 0x7ffb980697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006fd0 tx=0x7ffba0008040 comp rx=0 tx=0).stop 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 msgr2=0x7ffbac06ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 0x7ffbac06ae50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7ffba400b0e0 tx=0x7ffba4016000 comp rx=0 tx=0).stop 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 shutdown_connections 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbac159ec0 0x7ffbac150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffbac0b53d0 0x7ffbac06ae50 secure :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7ffba400b0e0 tx=0x7ffba4016000 comp rx=0 tx=0).stop 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb98067320 0x7ffb980697d0 secure :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ffba0006fd0 tx=0x7ffba0008040 comp rx=0 tx=0).stop 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 --2- 172.21.15.22:0/3400218555 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffbac0cce40 0x7ffbac069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:22.902 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.901+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 >> 172.21.15.22:0/3400218555 conn(0x7ffbac0999f0 msgr2=0x7ffbac0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:22.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.902+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 shutdown_connections 2023-10-08T00:34:22.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:22.903+0000 7ffbb4140700 1 -- 172.21.15.22:0/3400218555 wait complete. 2023-10-08T00:34:22.904 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2023-10-08T00:34:22.916 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T00:34:23.042 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.041+0000 7eff628b9700 1 Processor -- start 2023-10-08T00:34:23.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.041+0000 7eff628b9700 1 -- start start 2023-10-08T00:34:23.049 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.042+0000 7eff628b9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7eff5c159950 0x7eff5c0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.042+0000 7eff628b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c069c70 0x7eff5c0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.042+0000 7eff628b9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5c0ce380 con 0x7eff5c0af320 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.042+0000 7eff628b9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5c0cec20 con 0x7eff5c159950 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.042+0000 7eff628b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0afa90 con 0x7eff5c069c70 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.042+0000 7eff5bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7eff5c159950 0x7eff5c0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7eff5c0af320 0x7eff5c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51858/0 (socket says 172.21.15.22:51858) 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7eff5c159950 0x7eff5c0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56626/0 (socket says 172.21.15.22:56626) 2023-10-08T00:34:23.050 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5b7fe700 1 -- 172.21.15.22:0/1608917545 learned_addr learned my addr 172.21.15.22:0/1608917545 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff60e56700 1 --2- 172.21.15.22:0/1608917545 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c069c70 0x7eff5c0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5bfff700 1 -- 172.21.15.22:0/1608917545 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c069c70 msgr2=0x7eff5c0cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5bfff700 1 --2- 172.21.15.22:0/1608917545 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c069c70 0x7eff5c0cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5bfff700 1 -- 172.21.15.22:0/1608917545 >> v1:172.21.15.22:6789/0 conn(0x7eff5c0af320 legacy=0x7eff5c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5bfff700 1 -- 172.21.15.22:0/1608917545 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0ce5d0 con 0x7eff5c159950 2023-10-08T00:34:23.051 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5bfff700 1 --2- 172.21.15.22:0/1608917545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c159950 0x7eff5c0cbb90 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0098e0 tx=0x7eff4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb8c54a5860e879 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5affd700 1 -- 172.21.15.22:0/1608917545 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c009e80 con 0x7eff5c159950 2023-10-08T00:34:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5affd700 1 -- 172.21.15.22:0/1608917545 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00b860 con 0x7eff5c159950 2023-10-08T00:34:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.043+0000 7eff5affd700 1 -- 172.21.15.22:0/1608917545 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00bbe0 con 0x7eff5c159950 2023-10-08T00:34:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 -- 172.21.15.22:0/1608917545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c159950 msgr2=0x7eff5c0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:23.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 --2- 172.21.15.22:0/1608917545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c159950 0x7eff5c0cbb90 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0098e0 tx=0x7eff4c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 -- 172.21.15.22:0/1608917545 shutdown_connections 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 --2- 172.21.15.22:0/1608917545 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c069c70 0x7eff5c0cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 --2- 172.21.15.22:0/1608917545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c159950 0x7eff5c0cbb90 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 -- 172.21.15.22:0/1608917545 >> 172.21.15.22:0/1608917545 conn(0x7eff5c068e00 msgr2=0x7eff5c0d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 -- 172.21.15.22:0/1608917545 shutdown_connections 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.044+0000 7eff628b9700 1 -- 172.21.15.22:0/1608917545 wait complete. 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.045+0000 7eff628b9700 1 Processor -- start 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.045+0000 7eff628b9700 1 -- start start 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff628b9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff5c069c70 0x7eff5c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:23.053 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff628b9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 0x7eff5c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff628b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c159950 0x7eff5c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff628b9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0c95d0 con 0x7eff5c0af320 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff628b9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0b6330 con 0x7eff5c069c70 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff628b9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c0c89c0 con 0x7eff5c159950 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 0x7eff5c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 0x7eff5c0b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56630/0 (socket says 172.21.15.22:56630) 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 -- 172.21.15.22:0/947759569 learned_addr learned my addr 172.21.15.22:0/947759569 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff60e56700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c159950 0x7eff5c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:23.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5bfff700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff5c069c70 0x7eff5c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 -- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c159950 msgr2=0x7eff5c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c159950 0x7eff5c0b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 -- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff5c069c70 msgr2=0x7eff5c0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff5c069c70 0x7eff5c0b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 -- 172.21.15.22:0/947759569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009420 con 0x7eff5c0af320 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff60e56700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c159950 0x7eff5c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5bfff700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff5c069c70 0x7eff5c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff5b7fe700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 0x7eff5c0b4f60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c7c0 tx=0x7eff50007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.046+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50005b30 con 0x7eff5c0af320 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.047+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff50005cb0 con 0x7eff5c0af320 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.047+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0c8ca0 con 0x7eff5c0af320 2023-10-08T00:34:23.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.047+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50004a80 con 0x7eff5c0af320 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.047+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5c0c9260 con 0x7eff5c0af320 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.048+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5c159d20 con 0x7eff5c0af320 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.048+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff500070f0 con 0x7eff5c0af320 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.049+0000 7eff43fff700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff48067320 0x7eff480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.049+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5223+0+0 (secure 0 0 0) 0x7eff50083f10 con 0x7eff5c0af320 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.049+0000 7eff5bfff700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff48067320 0x7eff480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:23.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.050+0000 7eff5bfff700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff48067320 0x7eff480697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0091e0 tx=0x7eff4c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:23.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.053+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff5c159d20 con 0x7eff5c0af320 2023-10-08T00:34:23.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.247+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7eff5c159d20 con 0x7eff5c0af320 2023-10-08T00:34:23.903 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.902+0000 7eff43fff700 1 -- 172.21.15.22:0/947759569 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v200) v1 ==== 170+0+0 (secure 0 0 0) 0x7eff5c159d20 con 0x7eff5c0af320 2023-10-08T00:34:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.908+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff48067320 msgr2=0x7eff480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.908+0000 7eff628b9700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff48067320 0x7eff480697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7eff4c0091e0 tx=0x7eff4c017000 comp rx=0 tx=0).stop 2023-10-08T00:34:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.908+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 msgr2=0x7eff5c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.908+0000 7eff628b9700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 0x7eff5c0b4f60 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c7c0 tx=0x7eff50007f70 comp rx=0 tx=0).stop 2023-10-08T00:34:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.911+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 shutdown_connections 2023-10-08T00:34:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.911+0000 7eff628b9700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7eff48067320 0x7eff480697d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.911+0000 7eff628b9700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7eff5c159950 0x7eff5c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.911+0000 7eff628b9700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff5c069c70 0x7eff5c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.911+0000 7eff628b9700 1 --2- 172.21.15.22:0/947759569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff5c0af320 0x7eff5c0b4f60 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.911+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 >> 172.21.15.22:0/947759569 conn(0x7eff5c068e00 msgr2=0x7eff5c1532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.913+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 shutdown_connections 2023-10-08T00:34:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:23.913+0000 7eff628b9700 1 -- 172.21.15.22:0/947759569 wait complete. 2023-10-08T00:34:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2023-10-08T00:34:23.935 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T00:34:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.061+0000 7f7d6d2ad700 1 Processor -- start 2023-10-08T00:34:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.061+0000 7f7d6d2ad700 1 -- start start 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.061+0000 7f7d6d2ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d68159890 0x7f7d6815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.061+0000 7f7d6d2ad700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d68159c60 0x7f7d6815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.061+0000 7f7d6d2ad700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7d6815db10 0x7f7d68069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.061+0000 7f7d6d2ad700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6815a160 con 0x7f7d6815db10 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d6d2ad700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d680d13a0 con 0x7f7d68159c60 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d6d2ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6815e140 con 0x7f7d68159890 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7d6815db10 0x7f7d68069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7d6815db10 0x7f7d68069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56636/0 (socket says 172.21.15.22:56636) 2023-10-08T00:34:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 -- 172.21.15.22:0/4050384784 learned_addr learned my addr 172.21.15.22:0/4050384784 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d66ffd700 1 --2- 172.21.15.22:0/4050384784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d68159890 0x7f7d6815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d667fc700 1 --2- 172.21.15.22:0/4050384784 >> v2:172.21.15.192:3300/0 conn(0x7f7d68159c60 0x7f7d6815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 -- 172.21.15.22:0/4050384784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d68159890 msgr2=0x7f7d6815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 --2- 172.21.15.22:0/4050384784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d68159890 0x7f7d6815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 -- 172.21.15.22:0/4050384784 >> v2:172.21.15.192:3300/0 conn(0x7f7d68159c60 msgr2=0x7f7d6815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 --2- 172.21.15.22:0/4050384784 >> v2:172.21.15.192:3300/0 conn(0x7f7d68159c60 0x7f7d6815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 -- 172.21.15.22:0/4050384784 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6815a3d0 con 0x7f7d6815db10 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d667fc700 1 --2- 172.21.15.22:0/4050384784 >> v2:172.21.15.192:3300/0 conn(0x7f7d68159c60 0x7f7d6815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d677fe700 1 --2- 172.21.15.22:0/4050384784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d6815db10 0x7f7d68069560 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f7d680650f0 tx=0x7f7d58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeabc95ee5eaa18 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d65ffb700 1 -- 172.21.15.22:0/4050384784 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800e070 con 0x7f7d6815db10 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d65ffb700 1 -- 172.21.15.22:0/4050384784 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5800ba50 con 0x7f7d6815db10 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.062+0000 7f7d65ffb700 1 -- 172.21.15.22:0/4050384784 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580092e0 con 0x7f7d6815db10 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/4050384784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d6815db10 msgr2=0x7f7d68069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/4050384784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d6815db10 0x7f7d68069560 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f7d680650f0 tx=0x7f7d58009840 comp rx=0 tx=0).stop 2023-10-08T00:34:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/4050384784 shutdown_connections 2023-10-08T00:34:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/4050384784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d6815db10 0x7f7d68069560 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/4050384784 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d68159890 0x7f7d6815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/4050384784 >> v2:172.21.15.192:3300/0 conn(0x7f7d68159c60 0x7f7d6815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/4050384784 >> 172.21.15.22:0/4050384784 conn(0x7f7d68068e20 msgr2=0x7f7d680d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/4050384784 shutdown_connections 2023-10-08T00:34:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.063+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/4050384784 wait complete. 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.064+0000 7f7d6d2ad700 1 Processor -- start 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.064+0000 7f7d6d2ad700 1 -- start start 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d6d2ad700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 0x7f7d680cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d6d2ad700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d68159c60 0x7f7d68149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d6d2ad700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6815db10 0x7f7d680b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d6d2ad700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d68158dd0 con 0x7f7d68159890 2023-10-08T00:34:24.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d6d2ad700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680cedf0 con 0x7f7d68159c60 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d6d2ad700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d680cf650 con 0x7f7d6815db10 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 0x7f7d680cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 0x7f7d680cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56640/0 (socket says 172.21.15.22:56640) 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 -- 172.21.15.22:0/990771863 learned_addr learned my addr 172.21.15.22:0/990771863 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d677fe700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6815db10 0x7f7d680b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d667fc700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d68159c60 0x7f7d68149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 -- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6815db10 msgr2=0x7f7d680b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6815db10 0x7f7d680b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 -- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d68159c60 msgr2=0x7f7d68149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d68159c60 0x7f7d68149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.065+0000 7f7d66ffd700 1 -- 172.21.15.22:0/990771863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009ae0 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.066+0000 7f7d66ffd700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 0x7f7d680cfae0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000d890 tx=0x7f7d60008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.066+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d600125f0 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.066+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60012750 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.066+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d680cdd40 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.066+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60012af0 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.066+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d680cf2e0 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.067+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6804c3c0 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.067+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7d6001e460 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.068+0000 7f7d5effd700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7d48067320 0x7f7d480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.068+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f7d60085180 con 0x7f7d68159890 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.068+0000 7f7d667fc700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7d48067320 0x7f7d480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.068+0000 7f7d667fc700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7d48067320 0x7f7d480697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7d6816cfc0 tx=0x7f7d50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.072+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d60051e70 con 0x7f7d68159890 2023-10-08T00:34:24.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.311+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7d680cf930 con 0x7f7d68159890 2023-10-08T00:34:24.909 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.908+0000 7f7d5effd700 1 -- 172.21.15.22:0/990771863 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v132) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7d60055490 con 0x7f7d68159890 2023-10-08T00:34:24.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7d48067320 msgr2=0x7f7d480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:24.912 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7d48067320 0x7f7d480697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7d6816cfc0 tx=0x7f7d50008040 comp rx=0 tx=0).stop 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 msgr2=0x7f7d680cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 0x7f7d680cfae0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000d890 tx=0x7f7d60008040 comp rx=0 tx=0).stop 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 shutdown_connections 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7d48067320 0x7f7d480697d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d6815db10 0x7f7d680b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d68159890 0x7f7d680cfae0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 --2- 172.21.15.22:0/990771863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d68159c60 0x7f7d68149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 >> 172.21.15.22:0/990771863 conn(0x7f7d68068e20 msgr2=0x7f7d6815be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 shutdown_connections 2023-10-08T00:34:24.913 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:24.911+0000 7f7d6d2ad700 1 -- 172.21.15.22:0/990771863 wait complete. 2023-10-08T00:34:24.919 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 33 and data pool 34 2023-10-08T00:34:24.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:25.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.051+0000 7f55ad0d6700 1 Processor -- start 2023-10-08T00:34:25.052 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.051+0000 7f55ad0d6700 1 -- start start 2023-10-08T00:34:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55ad0d6700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55a8159c10 0x7f55a815b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.054 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55ad0d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a8068670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55ad0d6700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a815c480 con 0x7f55a8068bb0 2023-10-08T00:34:25.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55ad0d6700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a80b2a40 con 0x7f55a8159c10 2023-10-08T00:34:25.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55ad0d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a815b5d0 con 0x7f55a80b5ea0 2023-10-08T00:34:25.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55a6d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55a8159c10 0x7f55a815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.055 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55a659c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a8068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55a6d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55a8159c10 0x7f55a815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:53944/0 (socket says 172.21.15.22:53944) 2023-10-08T00:34:25.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.052+0000 7f55a6d9d700 1 -- 172.21.15.22:0/1749350354 learned_addr learned my addr 172.21.15.22:0/1749350354 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:25.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a6d9d700 1 -- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 msgr2=0x7f55a8068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:25.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a6d9d700 1 --2- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a8068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.056 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a6d9d700 1 -- 172.21.15.22:0/1749350354 >> v1:172.21.15.192:6789/0 conn(0x7f55a8068bb0 legacy=0x7f55a815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a6d9d700 1 -- 172.21.15.22:0/1749350354 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a815b870 con 0x7f55a8159c10 2023-10-08T00:34:25.057 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a659c700 1 --2- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a8068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:25.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a6d9d700 1 --2- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8159c10 0x7f55a815b090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5598009f20 tx=0x7f5598009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d900b12a94df64dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a5d9b700 1 -- 172.21.15.22:0/1749350354 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559800e070 con 0x7f55a8159c10 2023-10-08T00:34:25.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a5d9b700 1 -- 172.21.15.22:0/1749350354 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559800b9d0 con 0x7f55a8159c10 2023-10-08T00:34:25.058 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.053+0000 7f55a5d9b700 1 -- 172.21.15.22:0/1749350354 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55980092e0 con 0x7f55a8159c10 2023-10-08T00:34:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 -- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8159c10 msgr2=0x7f55a815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8159c10 0x7f55a815b090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5598009f20 tx=0x7f5598009840 comp rx=0 tx=0).stop 2023-10-08T00:34:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 -- 172.21.15.22:0/1749350354 shutdown_connections 2023-10-08T00:34:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8159c10 0x7f55a815b090 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.059 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/1749350354 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a8068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 -- 172.21.15.22:0/1749350354 >> 172.21.15.22:0/1749350354 conn(0x7f55a8099a20 msgr2=0x7f55a80af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:25.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 -- 172.21.15.22:0/1749350354 shutdown_connections 2023-10-08T00:34:25.060 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.054+0000 7f55ad0d6700 1 -- 172.21.15.22:0/1749350354 wait complete. 2023-10-08T00:34:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.055+0000 7f55ad0d6700 1 Processor -- start 2023-10-08T00:34:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.055+0000 7f55ad0d6700 1 -- start start 2023-10-08T00:34:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55ad0d6700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8068bb0 0x7f55a816ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55ad0d6700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55ad0d6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 0x7f55a8167790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55ad0d6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a816c160 con 0x7f55a8159c10 2023-10-08T00:34:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55ad0d6700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a816b550 con 0x7f55a8068bb0 2023-10-08T00:34:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55ad0d6700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a816b830 con 0x7f55a80b5ea0 2023-10-08T00:34:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 0x7f55a8167790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 0x7f55a8167790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56646/0 (socket says 172.21.15.22:56646) 2023-10-08T00:34:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 -- 172.21.15.22:0/83554079 learned_addr learned my addr 172.21.15.22:0/83554079 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a659c700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a6d9d700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8068bb0 0x7f55a816ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 -- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 msgr2=0x7f55a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 -- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8068bb0 msgr2=0x7f55a816ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8068bb0 0x7f55a816ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 -- 172.21.15.22:0/83554079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590009420 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a6d9d700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8068bb0 0x7f55a816ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f55a759e700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 0x7f55a8167790 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f55a000c560 tx=0x7f55a0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.056+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0011590 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.057+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a00116f0 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.057+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5598009ae0 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.057+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0011ab0 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.057+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a816bdf0 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.058+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a804c3c0 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.058+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55a001b3b0 con 0x7f55a8159c10 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.058+0000 7f559effd700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5588067320 0x7f55880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.059+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55a0084210 con 0x7f55a8159c10 2023-10-08T00:34:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.059+0000 7f55a6d9d700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5588067320 0x7f55880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.059+0000 7f55a6d9d700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5588067320 0x7f55880697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5598009880 tx=0x7f5598018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.068 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.063+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55a0050ea0 con 0x7f55a8159c10 2023-10-08T00:34:25.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.258+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55a816c2a0 con 0x7f55a8159c10 2023-10-08T00:34:25.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.259+0000 7f559effd700 1 -- 172.21.15.22:0/83554079 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f55a0017090 con 0x7f55a8159c10 2023-10-08T00:34:25.260 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:25.260 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":201,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:24.312948+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:34:22.729022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-08T00:34:23.277833+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5588067320 msgr2=0x7f55880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5588067320 0x7f55880697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5598009880 tx=0x7f5598018000 comp rx=0 tx=0).stop 2023-10-08T00:34:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 msgr2=0x7f55a8167790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 0x7f55a8167790 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f55a000c560 tx=0x7f55a0007ef0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 shutdown_connections 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55a8159c10 0x7f55a8167790 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55a8068bb0 0x7f55a816ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5588067320 0x7f55880697d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 --2- 172.21.15.22:0/83554079 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f55a80b5ea0 0x7f55a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.261+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 >> 172.21.15.22:0/83554079 conn(0x7f55a8099a20 msgr2=0x7f55a809a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.262+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 shutdown_connections 2023-10-08T00:34:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.262+0000 7f55ad0d6700 1 -- 172.21.15.22:0/83554079 wait complete. 2023-10-08T00:34:25.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.393+0000 7f592431c700 1 Processor -- start 2023-10-08T00:34:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.393+0000 7f592431c700 1 -- start start 2023-10-08T00:34:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f592431c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f591c159c60 0x7f591c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f592431c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f592431c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c15a160 con 0x7f591c159890 2023-10-08T00:34:25.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f592431c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c15df50 con 0x7f591c159c60 2023-10-08T00:34:25.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f592431c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0d13a0 con 0x7f591c15db10 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f59228b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f59218b7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f591c159c60 0x7f591c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f59228b9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:41596/0 (socket says 172.21.15.22:41596) 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f59218b7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f591c159c60 0x7f591c15d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:53956/0 (socket says 172.21.15.22:53956) 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f59220b8700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f591c159890 0x7f591c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:60340/0 (socket says 172.21.15.22:60340) 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.394+0000 7f59228b9700 1 -- 172.21.15.22:0/849655723 learned_addr learned my addr 172.21.15.22:0/849655723 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59228b9700 1 -- 172.21.15.22:0/849655723 >> v2:172.21.15.192:3300/0 conn(0x7f591c159c60 msgr2=0x7f591c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59228b9700 1 --2- 172.21.15.22:0/849655723 >> v2:172.21.15.192:3300/0 conn(0x7f591c159c60 0x7f591c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59228b9700 1 -- 172.21.15.22:0/849655723 >> v1:172.21.15.192:6789/0 conn(0x7f591c159890 legacy=0x7f591c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59228b9700 1 -- 172.21.15.22:0/849655723 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c15e140 con 0x7f591c15db10 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59228b9700 1 --2- 172.21.15.22:0/849655723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c069560 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f590c009f20 tx=0x7f590c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf08ea8968c34ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59210b6700 1 -- 172.21.15.22:0/849655723 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c00e070 con 0x7f591c15db10 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59210b6700 1 -- 172.21.15.22:0/849655723 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c00b9d0 con 0x7f591c15db10 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f59210b6700 1 -- 172.21.15.22:0/849655723 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0092e0 con 0x7f591c15db10 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f592431c700 1 -- 172.21.15.22:0/849655723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 msgr2=0x7f591c069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.395+0000 7f592431c700 1 --2- 172.21.15.22:0/849655723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c069560 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f590c009f20 tx=0x7f590c009840 comp rx=0 tx=0).stop 2023-10-08T00:34:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.396+0000 7f592431c700 1 -- 172.21.15.22:0/849655723 shutdown_connections 2023-10-08T00:34:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.396+0000 7f592431c700 1 --2- 172.21.15.22:0/849655723 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c069560 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.396+0000 7f592431c700 1 --2- 172.21.15.22:0/849655723 >> v2:172.21.15.192:3300/0 conn(0x7f591c159c60 0x7f591c15d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.396+0000 7f592431c700 1 -- 172.21.15.22:0/849655723 >> 172.21.15.22:0/849655723 conn(0x7f591c068e20 msgr2=0x7f591c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.396+0000 7f592431c700 1 -- 172.21.15.22:0/849655723 shutdown_connections 2023-10-08T00:34:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.396+0000 7f592431c700 1 -- 172.21.15.22:0/849655723 wait complete. 2023-10-08T00:34:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 Processor -- start 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 -- start start 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f591c159890 0x7f591c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 0x7f591c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c151b80 con 0x7f591c159c60 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c151e60 con 0x7f591c159890 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.397+0000 7f592431c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c152140 con 0x7f591c15db10 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 0x7f591c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 0x7f591c151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56662/0 (socket says 172.21.15.22:56662) 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 -- 172.21.15.22:0/209478148 learned_addr learned my addr 172.21.15.22:0/209478148 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59228b9700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59220b8700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f591c159890 0x7f591c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 -- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 msgr2=0x7f591c154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 -- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f591c159890 msgr2=0x7f591c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f591c159890 0x7f591c14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 -- 172.21.15.22:0/209478148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009ae0 con 0x7f591c159c60 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f59218b7700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 0x7f591c151280 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f591000ec80 tx=0x7f59100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000c850 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591000c9b0 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000cd50 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c152420 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.398+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c1517c0 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.399+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c0cd150 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.400+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5910013680 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.400+0000 7f591a7fc700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5908067320 0x7f59080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.400+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5910084f10 con 0x7f591c159c60 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.400+0000 7f59220b8700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5908067320 0x7f59080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.401+0000 7f59220b8700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5908067320 0x7f59080697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5914004fd0 tx=0x7f5914007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.404+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f591c0cd150 con 0x7f591c159c60 2023-10-08T00:34:25.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.599+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f591c0cd150 con 0x7f591c159c60 2023-10-08T00:34:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.600+0000 7f591a7fc700 1 -- 172.21.15.22:0/209478148 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15377 (secure 0 0 0) 0x7f591c0cd150 con 0x7f591c159c60 2023-10-08T00:34:25.600 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:25.601 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":201,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:24.312948+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:34:22.729022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-08T00:34:23.277833+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5908067320 msgr2=0x7f59080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5908067320 0x7f59080697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5914004fd0 tx=0x7f5914007eb0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 msgr2=0x7f591c151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 0x7f591c151280 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f591000ec80 tx=0x7f59100091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 shutdown_connections 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5908067320 0x7f59080697d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f591c15db10 0x7f591c154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f591c159890 0x7f591c14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 --2- 172.21.15.22:0/209478148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c159c60 0x7f591c151280 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 >> 172.21.15.22:0/209478148 conn(0x7f591c068e20 msgr2=0x7f591c157300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 shutdown_connections 2023-10-08T00:34:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.602+0000 7f592431c700 1 -- 172.21.15.22:0/209478148 wait complete. 2023-10-08T00:34:25.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T00:34:25.738 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.738+0000 7f9c48ce9700 1 Processor -- start 2023-10-08T00:34:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.738+0000 7f9c48ce9700 1 -- start start 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c48ce9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c44159890 0x7f9c4415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c48ce9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c44159c60 0x7f9c4415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c48ce9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c4415db10 0x7f9c44069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c48ce9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4415a160 con 0x7f9c4415db10 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c48ce9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c440d13a0 con 0x7f9c44159c60 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c48ce9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4415e140 con 0x7f9c44159890 2023-10-08T00:34:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c4415db10 0x7f9c44069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c4415db10 0x7f9c44069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56664/0 (socket says 172.21.15.22:56664) 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 -- 172.21.15.22:0/30479785 learned_addr learned my addr 172.21.15.22:0/30479785 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c41d9b700 1 --2- 172.21.15.22:0/30479785 >> v2:172.21.15.192:3300/0 conn(0x7f9c44159c60 0x7f9c4415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c4259c700 1 --2- 172.21.15.22:0/30479785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c44159890 0x7f9c4415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 -- 172.21.15.22:0/30479785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c44159890 msgr2=0x7f9c4415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 --2- 172.21.15.22:0/30479785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c44159890 0x7f9c4415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 -- 172.21.15.22:0/30479785 >> v2:172.21.15.192:3300/0 conn(0x7f9c44159c60 msgr2=0x7f9c4415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 --2- 172.21.15.22:0/30479785 >> v2:172.21.15.192:3300/0 conn(0x7f9c44159c60 0x7f9c4415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 -- 172.21.15.22:0/30479785 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4415a3d0 con 0x7f9c4415db10 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c41d9b700 1 --2- 172.21.15.22:0/30479785 >> v2:172.21.15.192:3300/0 conn(0x7f9c44159c60 0x7f9c4415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c42d9d700 1 --2- 172.21.15.22:0/30479785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4415db10 0x7f9c44069560 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f9c440650f0 tx=0x7f9c3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1936502b14b988f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.739+0000 7f9c4159a700 1 -- 172.21.15.22:0/30479785 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00e070 con 0x7f9c4415db10 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c4159a700 1 -- 172.21.15.22:0/30479785 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00ba50 con 0x7f9c4415db10 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c4159a700 1 -- 172.21.15.22:0/30479785 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0092e0 con 0x7f9c4415db10 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 -- 172.21.15.22:0/30479785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4415db10 msgr2=0x7f9c44069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/30479785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4415db10 0x7f9c44069560 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f9c440650f0 tx=0x7f9c3c009840 comp rx=0 tx=0).stop 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 -- 172.21.15.22:0/30479785 shutdown_connections 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/30479785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4415db10 0x7f9c44069560 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/30479785 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c44159890 0x7f9c4415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/30479785 >> v2:172.21.15.192:3300/0 conn(0x7f9c44159c60 0x7f9c4415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 -- 172.21.15.22:0/30479785 >> 172.21.15.22:0/30479785 conn(0x7f9c44068e20 msgr2=0x7f9c440d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 -- 172.21.15.22:0/30479785 shutdown_connections 2023-10-08T00:34:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.740+0000 7f9c48ce9700 1 -- 172.21.15.22:0/30479785 wait complete. 2023-10-08T00:34:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.741+0000 7f9c48ce9700 1 Processor -- start 2023-10-08T00:34:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.741+0000 7f9c48ce9700 1 -- start start 2023-10-08T00:34:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c48ce9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 0x7f9c440cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c48ce9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c44159c60 0x7f9c440cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c48ce9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c4415db10 0x7f9c440cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c48ce9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440b1410 con 0x7f9c44159890 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c48ce9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c44144790 con 0x7f9c44159c60 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c48ce9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c440b1600 con 0x7f9c4415db10 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 0x7f9c440cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 0x7f9c440cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56678/0 (socket says 172.21.15.22:56678) 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 -- 172.21.15.22:0/2120283053 learned_addr learned my addr 172.21.15.22:0/2120283053 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c41d9b700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c44159c60 0x7f9c440cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c42d9d700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c4415db10 0x7f9c440cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 -- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c4415db10 msgr2=0x7f9c440cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c4415db10 0x7f9c440cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 -- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c44159c60 msgr2=0x7f9c440cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c44159c60 0x7f9c440cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.742+0000 7f9c4259c700 1 -- 172.21.15.22:0/2120283053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c009ae0 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.743+0000 7f9c4259c700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 0x7f9c440cd1c0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c800 tx=0x7f9c34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.743+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011600 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.743+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c34011760 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.743+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c440b18e0 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.743+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34011b00 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.743+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c440b1ea0 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.744+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4404c3c0 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.744+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9c340193f0 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.744+0000 7f9c3a7fc700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c24067320 0x7f9c240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.745+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c34084fe0 con 0x7f9c44159890 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.745+0000 7f9c41d9b700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c24067320 0x7f9c240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.745+0000 7f9c41d9b700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c24067320 0x7f9c240697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9c4415a090 tx=0x7f9c2c006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:25.749 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.749+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c34051b60 con 0x7f9c44159890 2023-10-08T00:34:25.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:25.989+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9c4406a5b0 con 0x7f9c44159890 2023-10-08T00:34:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.921+0000 7f9c3a7fc700 1 -- 172.21.15.22:0/2120283053 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v135) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9c34055180 con 0x7f9c44159890 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c24067320 msgr2=0x7f9c240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c24067320 0x7f9c240697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f9c4415a090 tx=0x7f9c2c006f90 comp rx=0 tx=0).stop 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 msgr2=0x7f9c440cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 0x7f9c440cd1c0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c800 tx=0x7f9c34008040 comp rx=0 tx=0).stop 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 shutdown_connections 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9c24067320 0x7f9c240697d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9c4415db10 0x7f9c440cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:26.925 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44159890 0x7f9c440cd1c0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 --2- 172.21.15.22:0/2120283053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c44159c60 0x7f9c440cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 >> 172.21.15.22:0/2120283053 conn(0x7f9c44068e20 msgr2=0x7f9c441552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 shutdown_connections 2023-10-08T00:34:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:26.924+0000 7f9c48ce9700 1 -- 172.21.15.22:0/2120283053 wait complete. 2023-10-08T00:34:26.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T00:34:27.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.068+0000 7f26c2dfd700 1 Processor -- start 2023-10-08T00:34:27.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.068+0000 7f26c2dfd700 1 -- start start 2023-10-08T00:34:27.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c2dfd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26bc0caa90 0x7f26bc0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:27.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c2dfd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc15d7e0 con 0x7f26bc06bcd0 2023-10-08T00:34:27.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c2dfd700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc15dac0 con 0x7f26bc06c0a0 2023-10-08T00:34:27.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c2dfd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc0caef0 con 0x7f26bc0caa90 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c139a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26bc0caa90 0x7f26bc0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c0b99700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f26bc06bcd0 0x7f26bc15a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54716/0 (socket says 172.21.15.22:54716) 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c0b99700 1 -- 172.21.15.22:0/2212362777 learned_addr learned my addr 172.21.15.22:0/2212362777 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.069+0000 7f26c139a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26bc0caa90 0x7f26bc0c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53362/0 (socket says 172.21.15.22:53362) 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26c139a700 1 -- 172.21.15.22:0/2212362777 >> v1:172.21.15.192:6789/0 conn(0x7f26bc06c0a0 legacy=0x7f26bc15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26c139a700 1 -- 172.21.15.22:0/2212362777 >> v1:172.21.15.22:6789/0 conn(0x7f26bc06bcd0 legacy=0x7f26bc15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26c139a700 1 -- 172.21.15.22:0/2212362777 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc15aa30 con 0x7f26bc0caa90 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26bb7fe700 1 -- 172.21.15.22:0/2212362777 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479418068 0 0) 0x7f26bc15d7e0 con 0x7f26bc06bcd0 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26c139a700 1 --2- 172.21.15.22:0/2212362777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc0c8c40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f26a40098e0 tx=0x7f26a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39422c5869d2d91d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26bb7fe700 1 -- 172.21.15.22:0/2212362777 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4009e80 con 0x7f26bc0caa90 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26bb7fe700 1 -- 172.21.15.22:0/2212362777 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a400b860 con 0x7f26bc0caa90 2023-10-08T00:34:27.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.070+0000 7f26bb7fe700 1 -- 172.21.15.22:0/2212362777 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a400bbe0 con 0x7f26bc0caa90 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 -- 172.21.15.22:0/2212362777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 msgr2=0x7f26bc0c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/2212362777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc0c8c40 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f26a40098e0 tx=0x7f26a40091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 -- 172.21.15.22:0/2212362777 shutdown_connections 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/2212362777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc0c8c40 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 -- 172.21.15.22:0/2212362777 >> 172.21.15.22:0/2212362777 conn(0x7f26bc0ce600 msgr2=0x7f26bc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 -- 172.21.15.22:0/2212362777 shutdown_connections 2023-10-08T00:34:27.073 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.071+0000 7f26c2dfd700 1 -- 172.21.15.22:0/2212362777 wait complete. 2023-10-08T00:34:27.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.072+0000 7f26c2dfd700 1 Processor -- start 2023-10-08T00:34:27.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.072+0000 7f26c2dfd700 1 -- start start 2023-10-08T00:34:27.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26bc06bcd0 0x7f26bc1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:27.075 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26bc06c0a0 0x7f26bc0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc15efd0 con 0x7f26bc0caa90 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0b1840 con 0x7f26bc06bcd0 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc15ea10 con 0x7f26bc06c0a0 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc15df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53374/0 (socket says 172.21.15.22:53374) 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 -- 172.21.15.22:0/4003546099 learned_addr learned my addr 172.21.15.22:0/4003546099 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c0b99700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26bc06bcd0 0x7f26bc1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26bbfff700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26bc06c0a0 0x7f26bc0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 -- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26bc06c0a0 msgr2=0x7f26bc0b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26bc06c0a0 0x7f26bc0b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 -- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26bc06bcd0 msgr2=0x7f26bc1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26bc06bcd0 0x7f26bc1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 -- 172.21.15.22:0/4003546099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4009420 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26bbfff700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26bc06c0a0 0x7f26bc0b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c139a700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc15df50 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f26bc069220 tx=0x7f26a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a401f070 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a400b9d0 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc15ecf0 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.073+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4025650 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.074+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc15ff10 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.074+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc04c3c0 con 0x7f26bc0caa90 2023-10-08T00:34:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.075+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f26a4023070 con 0x7f26bc0caa90 2023-10-08T00:34:27.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.075+0000 7f26b8ff9700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f269c067320 0x7f269c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:27.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.076+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f26a4086270 con 0x7f26bc0caa90 2023-10-08T00:34:27.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.076+0000 7f26c0b99700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f269c067320 0x7f269c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:27.078 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.076+0000 7f26c0b99700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f269c067320 0x7f269c0697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f26b4000c00 tx=0x7f26b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.080+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26a4052f00 con 0x7f26bc0caa90 2023-10-08T00:34:27.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.318+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f26bc15ad10 con 0x7f26bc0caa90 2023-10-08T00:34:27.923 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.922+0000 7f26b8ff9700 1 -- 172.21.15.22:0/4003546099 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v136) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26a4056520 con 0x7f26bc0caa90 2023-10-08T00:34:27.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f269c067320 msgr2=0x7f269c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f269c067320 0x7f269c0697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f26b4000c00 tx=0x7f26b4009040 comp rx=0 tx=0).stop 2023-10-08T00:34:27.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 msgr2=0x7f26bc15df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:27.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc15df50 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f26bc069220 tx=0x7f26a4017000 comp rx=0 tx=0).stop 2023-10-08T00:34:27.927 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 shutdown_connections 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26bc0caa90 0x7f26bc15df50 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26bc06bcd0 0x7f26bc1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f269c067320 0x7f269c0697d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 --2- 172.21.15.22:0/4003546099 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f26bc06c0a0 0x7f26bc0b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 >> 172.21.15.22:0/4003546099 conn(0x7f26bc0ce600 msgr2=0x7f26bc15c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 shutdown_connections 2023-10-08T00:34:27.928 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:27.925+0000 7f26c2dfd700 1 -- 172.21.15.22:0/4003546099 wait complete. 2023-10-08T00:34:27.939 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:28.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.061+0000 7f062dbfe700 1 Processor -- start 2023-10-08T00:34:28.062 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.061+0000 7f062dbfe700 1 -- start start 2023-10-08T00:34:28.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f062dbfe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f062815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f062dbfe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0628069560 0x7f06280699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.064 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f062dbfe700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062815a160 con 0x7f0628159c60 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f062dbfe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0628069f20 con 0x7f0628069560 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f062dbfe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06280d13a0 con 0x7f0628159890 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f0627fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0628069560 0x7f06280699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f0627fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0628069560 0x7f06280699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53386/0 (socket says 172.21.15.22:53386) 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f0627fff700 1 -- 172.21.15.22:0/1016569109 learned_addr learned my addr 172.21.15.22:0/1016569109 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f06277fe700 1 --2- 172.21.15.22:0/1016569109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f062815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.062+0000 7f0627fff700 1 -- 172.21.15.22:0/1016569109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 msgr2=0x7f062815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f0627fff700 1 --2- 172.21.15.22:0/1016569109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f062815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f0627fff700 1 -- 172.21.15.22:0/1016569109 >> v1:172.21.15.192:6789/0 conn(0x7f0628159c60 legacy=0x7f062815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f0627fff700 1 -- 172.21.15.22:0/1016569109 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062815e140 con 0x7f0628069560 2023-10-08T00:34:28.065 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f0627fff700 1 --2- 172.21.15.22:0/1016569109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f06280699e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f0620009f20 tx=0x7f0620009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e013e6e374ea9e99 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f06267fc700 1 -- 172.21.15.22:0/1016569109 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000e070 con 0x7f0628069560 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f06267fc700 1 -- 172.21.15.22:0/1016569109 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000b9d0 con 0x7f0628069560 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f06267fc700 1 -- 172.21.15.22:0/1016569109 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200092e0 con 0x7f0628069560 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 -- 172.21.15.22:0/1016569109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 msgr2=0x7f06280699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 --2- 172.21.15.22:0/1016569109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f06280699e0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f0620009f20 tx=0x7f0620009840 comp rx=0 tx=0).stop 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 -- 172.21.15.22:0/1016569109 shutdown_connections 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 --2- 172.21.15.22:0/1016569109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f06280699e0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 --2- 172.21.15.22:0/1016569109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f062815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 -- 172.21.15.22:0/1016569109 >> 172.21.15.22:0/1016569109 conn(0x7f0628068e20 msgr2=0x7f06280d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 -- 172.21.15.22:0/1016569109 shutdown_connections 2023-10-08T00:34:28.067 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.063+0000 7f062dbfe700 1 -- 172.21.15.22:0/1016569109 wait complete. 2023-10-08T00:34:28.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 Processor -- start 2023-10-08T00:34:28.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 -- start start 2023-10-08T00:34:28.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f062814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f0628154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.069 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0628159c60 0x7f0628155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628151ae0 con 0x7f0628069560 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06280b0940 con 0x7f0628159c60 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.065+0000 7f062dbfe700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06280ce9b0 con 0x7f0628159890 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f062814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f062814d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53402/0 (socket says 172.21.15.22:53402) 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 -- 172.21.15.22:0/3352196942 learned_addr learned my addr 172.21.15.22:0/3352196942 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f0627fff700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0628159c60 0x7f0628155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f0626ffd700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f0628154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 -- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 msgr2=0x7f0628154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f0628154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 -- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0628159c60 msgr2=0x7f0628155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0628159c60 0x7f0628155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 -- 172.21.15.22:0/3352196942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009ae0 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f0626ffd700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f0628154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f06277fe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f062814d1b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f061800ec80 tx=0x7f06180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800c9d0 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800cb30 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06280cec90 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618013470 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.066+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06280b05d0 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.067+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062804c3c0 con 0x7f0628069560 2023-10-08T00:34:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.068+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0618013820 con 0x7f0628069560 2023-10-08T00:34:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.068+0000 7f060f7fe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0614067320 0x7f06140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.068+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0618085060 con 0x7f0628069560 2023-10-08T00:34:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.068+0000 7f0626ffd700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0614067320 0x7f06140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.069+0000 7f0626ffd700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0614067320 0x7f06140697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f062816df30 tx=0x7f061c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.072+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0618051cf0 con 0x7f0628069560 2023-10-08T00:34:28.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.310+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f062806a5b0 con 0x7f0628069560 2023-10-08T00:34:28.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.310+0000 7f060f7fe700 1 -- 172.21.15.22:0/3352196942 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f0618055310 con 0x7f0628069560 2023-10-08T00:34:28.311 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:28.311 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":136,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:34:24.313262+0000","modified":"2023-10-08T00:34:27.920845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9099":{"gid":9099,"name":"d","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3800835270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3800835270},{"type":"v1","addr":"172.21.15.192:6837","nonce":3800835270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-08T00:34:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0614067320 msgr2=0x7f06140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0614067320 0x7f06140697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f062816df30 tx=0x7f061c009040 comp rx=0 tx=0).stop 2023-10-08T00:34:28.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 msgr2=0x7f062814d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f062814d1b0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f061800ec80 tx=0x7f06180091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 shutdown_connections 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0628159c60 0x7f0628155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0628069560 0x7f062814d1b0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0614067320 0x7f06140697d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 --2- 172.21.15.22:0/3352196942 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f0628159890 0x7f0628154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 >> 172.21.15.22:0/3352196942 conn(0x7f0628068e20 msgr2=0x7f0628158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.312+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 shutdown_connections 2023-10-08T00:34:28.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.313+0000 7f062dbfe700 1 -- 172.21.15.22:0/3352196942 wait complete. 2023-10-08T00:34:28.315 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 136 2023-10-08T00:34:28.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:34:28.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.444+0000 7f327e69b700 1 Processor -- start 2023-10-08T00:34:28.444 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.444+0000 7f327e69b700 1 -- start start 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.444+0000 7f327e69b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3278159890 0x7f327815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.444+0000 7f327e69b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f327815a160 con 0x7f3278159c60 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.444+0000 7f327e69b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780d13a0 con 0x7f3278069560 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.444+0000 7f327e69b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327815e140 con 0x7f3278159890 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3277fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3278159890 0x7f327815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f32777fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3278159c60 0x7f327815d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54724/0 (socket says 172.21.15.22:54724) 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3277fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3278159890 0x7f327815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53408/0 (socket says 172.21.15.22:53408) 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f32777fe700 1 -- 172.21.15.22:0/3720974419 learned_addr learned my addr 172.21.15.22:0/3720974419 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3277fff700 1 -- 172.21.15.22:0/3720974419 >> v1:172.21.15.192:6789/0 conn(0x7f3278069560 legacy=0x7f32780ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.446 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3277fff700 1 -- 172.21.15.22:0/3720974419 >> v1:172.21.15.22:6789/0 conn(0x7f3278159c60 legacy=0x7f327815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3276ffd700 1 -- 172.21.15.22:0/3720974419 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193124325 0 0) 0x7f327815a160 con 0x7f3278159c60 2023-10-08T00:34:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3277fff700 1 -- 172.21.15.22:0/3720974419 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327815a3d0 con 0x7f3278159890 2023-10-08T00:34:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3277fff700 1 --2- 172.21.15.22:0/3720974419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278159890 0x7f327815abd0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f32680098e0 tx=0x7f32680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db71e4cab7037544 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3276ffd700 1 -- 172.21.15.22:0/3720974419 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268009e80 con 0x7f3278159890 2023-10-08T00:34:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3276ffd700 1 -- 172.21.15.22:0/3720974419 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326800b860 con 0x7f3278159890 2023-10-08T00:34:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.445+0000 7f3276ffd700 1 -- 172.21.15.22:0/3720974419 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326800bbe0 con 0x7f3278159890 2023-10-08T00:34:28.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 -- 172.21.15.22:0/3720974419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278159890 msgr2=0x7f327815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.449 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 --2- 172.21.15.22:0/3720974419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278159890 0x7f327815abd0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f32680098e0 tx=0x7f32680091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 -- 172.21.15.22:0/3720974419 shutdown_connections 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 --2- 172.21.15.22:0/3720974419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278159890 0x7f327815abd0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 -- 172.21.15.22:0/3720974419 >> 172.21.15.22:0/3720974419 conn(0x7f3278068e20 msgr2=0x7f32780d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 -- 172.21.15.22:0/3720974419 shutdown_connections 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.446+0000 7f327e69b700 1 -- 172.21.15.22:0/3720974419 wait complete. 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.447+0000 7f327e69b700 1 Processor -- start 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.447+0000 7f327e69b700 1 -- start start 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327e69b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 0x7f3278140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327e69b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3278159890 0x7f32780ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327e69b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3278159c60 0x7f32780b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.450 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327e69b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278157640 con 0x7f3278069560 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327e69b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278156a30 con 0x7f3278159c60 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327e69b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278156d10 con 0x7f3278159890 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 0x7f3278140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 0x7f3278140e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53412/0 (socket says 172.21.15.22:53412) 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 -- 172.21.15.22:0/985124446 learned_addr learned my addr 172.21.15.22:0/985124446 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f32777fe700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3278159890 0x7f32780ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f327cc38700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3278159c60 0x7f32780b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 -- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3278159890 msgr2=0x7f32780ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3278159890 0x7f32780ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 -- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3278159c60 msgr2=0x7f32780b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3278159c60 0x7f32780b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 -- 172.21.15.22:0/985124446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268009420 con 0x7f3278069560 2023-10-08T00:34:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.448+0000 7f3277fff700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 0x7f3278140e60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f3278070e20 tx=0x7f3268017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.449+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326801f070 con 0x7f3278069560 2023-10-08T00:34:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.449+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3268000c90 con 0x7f3278069560 2023-10-08T00:34:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.449+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3278156ff0 con 0x7f3278069560 2023-10-08T00:34:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.449+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268025420 con 0x7f3278069560 2023-10-08T00:34:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.449+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32781415b0 con 0x7f3278069560 2023-10-08T00:34:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.450+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327804c3c0 con 0x7f3278069560 2023-10-08T00:34:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.450+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3268023070 con 0x7f3278069560 2023-10-08T00:34:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.450+0000 7f325ffff700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3264067320 0x7f32640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.451+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3268086140 con 0x7f3278069560 2023-10-08T00:34:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.451+0000 7f32777fe700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3264067320 0x7f32640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.451+0000 7f32777fe700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3264067320 0x7f32640697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f32781446b0 tx=0x7f326c007f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.455 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.455+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3268052dd0 con 0x7f3278069560 2023-10-08T00:34:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.650+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3278158ee0 con 0x7f3278069560 2023-10-08T00:34:28.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.650+0000 7f325ffff700 1 -- 172.21.15.22:0/985124446 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15364 (secure 0 0 0) 0x7f32680563f0 con 0x7f3278069560 2023-10-08T00:34:28.652 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:28.652 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":202,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:25.658433+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:34:22.729022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-08T00:34:23.277833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:34:28.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.652+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3264067320 msgr2=0x7f32640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.652+0000 7f327e69b700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3264067320 0x7f32640697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f32781446b0 tx=0x7f326c007f30 comp rx=0 tx=0).stop 2023-10-08T00:34:28.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.652+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 msgr2=0x7f3278140e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.652+0000 7f327e69b700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 0x7f3278140e60 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f3278070e20 tx=0x7f3268017000 comp rx=0 tx=0).stop 2023-10-08T00:34:28.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.652+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 shutdown_connections 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3278159c60 0x7f32780b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3278069560 0x7f3278140e60 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3264067320 0x7f32640697d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 --2- 172.21.15.22:0/985124446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3278159890 0x7f32780ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 >> 172.21.15.22:0/985124446 conn(0x7f3278068e20 msgr2=0x7f32780b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 shutdown_connections 2023-10-08T00:34:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.653+0000 7f327e69b700 1 -- 172.21.15.22:0/985124446 wait complete. 2023-10-08T00:34:28.666 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T00:34:28.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:34:28.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.784+0000 7fb63bcfa700 1 Processor -- start 2023-10-08T00:34:28.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.785+0000 7fb63bcfa700 1 -- start start 2023-10-08T00:34:28.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.785+0000 7fb63bcfa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 0x7fb6340ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.785+0000 7fb63bcfa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 0x7fb6340b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb63bcfa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6340cc300 con 0x7fb63415a270 2023-10-08T00:34:28.789 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb63bcfa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb634156bf0 con 0x7fb6340cbf30 2023-10-08T00:34:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb63bcfa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340ae950 con 0x7fb6340ccf90 2023-10-08T00:34:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639a96700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 0x7fb6340ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 0x7fb6340b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 0x7fb6340b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:42322/0 (socket says 172.21.15.22:42322) 2023-10-08T00:34:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639a96700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 0x7fb6340ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:44602/0 (socket says 172.21.15.22:44602) 2023-10-08T00:34:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 -- 172.21.15.22:0/272013406 learned_addr learned my addr 172.21.15.22:0/272013406 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb63a297700 1 --1- 172.21.15.22:0/272013406 >> v1:172.21.15.192:6789/0 conn(0x7fb63415a270 0x7fb6340c9740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:40176/0 (socket says 172.21.15.22:40176) 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 -- 172.21.15.22:0/272013406 >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 msgr2=0x7fb6340ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 --2- 172.21.15.22:0/272013406 >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 0x7fb6340ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 -- 172.21.15.22:0/272013406 >> v1:172.21.15.192:6789/0 conn(0x7fb63415a270 legacy=0x7fb6340c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 -- 172.21.15.22:0/272013406 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340ad370 con 0x7fb6340ccf90 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639a96700 1 --2- 172.21.15.22:0/272013406 >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 0x7fb6340ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.786+0000 7fb639295700 1 --2- 172.21.15.22:0/272013406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 0x7fb6340b0d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6280099b0 tx=0x7fb628009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727ca86762376219 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb638a94700 1 -- 172.21.15.22:0/272013406 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb628009ea0 con 0x7fb6340ccf90 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb638a94700 1 -- 172.21.15.22:0/272013406 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800b860 con 0x7fb6340ccf90 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb638a94700 1 -- 172.21.15.22:0/272013406 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800bc00 con 0x7fb6340ccf90 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 -- 172.21.15.22:0/272013406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 msgr2=0x7fb6340b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/272013406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 0x7fb6340b0d10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6280099b0 tx=0x7fb628009250 comp rx=0 tx=0).stop 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 -- 172.21.15.22:0/272013406 shutdown_connections 2023-10-08T00:34:28.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/272013406 >> v2:172.21.15.192:3300/0 conn(0x7fb6340cbf30 0x7fb6340ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/272013406 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340ccf90 0x7fb6340b0d10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 -- 172.21.15.22:0/272013406 >> 172.21.15.22:0/272013406 conn(0x7fb63406a320 msgr2=0x7fb6340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:28.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 -- 172.21.15.22:0/272013406 shutdown_connections 2023-10-08T00:34:28.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.787+0000 7fb63bcfa700 1 -- 172.21.15.22:0/272013406 wait complete. 2023-10-08T00:34:28.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.788+0000 7fb63bcfa700 1 Processor -- start 2023-10-08T00:34:28.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 -- start start 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340cbf30 0x7fb634156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6340ccf90 0x7fb634150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63415a270 0x7fb63414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb634150cc0 con 0x7fb63415a270 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb634154690 con 0x7fb6340ccf90 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63bcfa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb634154b20 con 0x7fb6340cbf30 2023-10-08T00:34:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb639a96700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340cbf30 0x7fb634156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb63a297700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63415a270 0x7fb63414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb639295700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6340ccf90 0x7fb634150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb639a96700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340cbf30 0x7fb634156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:42330/0 (socket says 172.21.15.22:42330) 2023-10-08T00:34:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb639a96700 1 -- 172.21.15.22:0/1655254077 learned_addr learned my addr 172.21.15.22:0/1655254077 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.789+0000 7fb639295700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6340ccf90 0x7fb634150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:44618/0 (socket says 172.21.15.22:44618) 2023-10-08T00:34:28.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63a297700 1 -- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340cbf30 msgr2=0x7fb634156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63a297700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340cbf30 0x7fb634156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63a297700 1 -- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6340ccf90 msgr2=0x7fb634150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63a297700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6340ccf90 0x7fb634150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63a297700 1 -- 172.21.15.22:0/1655254077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c009420 con 0x7fb63415a270 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63a297700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63415a270 0x7fb63414ec20 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fb62400cc40 tx=0x7fb624001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624005df0 con 0x7fb63415a270 2023-10-08T00:34:28.799 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400a6a0 con 0x7fb63415a270 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6280094f0 con 0x7fb63415a270 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400aa60 con 0x7fb63415a270 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.790+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb634154040 con 0x7fb63415a270 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.791+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63404c3c0 con 0x7fb63415a270 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.791+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb6240070f0 con 0x7fb63415a270 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.792+0000 7fb631ffb700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb620067320 0x7fb6200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.792+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb624084c60 con 0x7fb63415a270 2023-10-08T00:34:28.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.792+0000 7fb639a96700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb620067320 0x7fb6200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:28.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.793+0000 7fb639a96700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb620067320 0x7fb6200697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009fa0 tx=0x7fb62c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:28.801 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.796+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6240519a0 con 0x7fb63415a270 2023-10-08T00:34:28.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.984+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb63406f910 con 0x7fb620067320 2023-10-08T00:34:28.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.993+0000 7fb631ffb700 1 -- 172.21.15.22:0/1655254077 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289427 (secure 0 0 0) 0x7fb63406f910 con 0x7fb620067320 2023-10-08T00:34:28.997 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:28.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb620067320 msgr2=0x7fb6200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:28.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb620067320 0x7fb6200697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb62c009fa0 tx=0x7fb62c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63415a270 msgr2=0x7fb63414ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63415a270 0x7fb63414ec20 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fb62400cc40 tx=0x7fb624001a50 comp rx=0 tx=0).stop 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 shutdown_connections 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63415a270 0x7fb63414ec20 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb620067320 0x7fb6200697d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb6340cbf30 0x7fb634156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 --2- 172.21.15.22:0/1655254077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6340ccf90 0x7fb634150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 >> 172.21.15.22:0/1655254077 conn(0x7fb63406a320 msgr2=0x7fb6340cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 shutdown_connections 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:28.996+0000 7fb63bcfa700 1 -- 172.21.15.22:0/1655254077 wait complete. 2023-10-08T00:34:29.000 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:34:29.009 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2023-10-08T00:34:28.519386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440392,"kb_used_data":21128,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534328,"statfs":{"total":773094113280,"available":770595151872,"internally_reserved":0,"allocated":21635072,"data_stored":10388179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.620325"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675922+0000","last_change":"2023-10-08T00:34:24.675922+0000","last_active":"2023-10-08T00:34:24.675922+0000","last_peered":"2023-10-08T00:34:24.675922+0000","last_clean":"2023-10-08T00:34:24.675922+0000","last_became_active":"2023-10-08T00:34:24.675497+0000","last_became_peered":"2023-10-08T00:34:24.675497+0000","last_unstale":"2023-10-08T00:34:24.675922+0000","last_undegraded":"2023-10-08T00:34:24.675922+0000","last_fullsized":"2023-10-08T00:34:24.675922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:06:19.234945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671314+0000","last_change":"2023-10-08T00:34:24.671314+0000","last_active":"2023-10-08T00:34:24.671314+0000","last_peered":"2023-10-08T00:34:24.671314+0000","last_clean":"2023-10-08T00:34:24.671314+0000","last_became_active":"2023-10-08T00:34:24.670309+0000","last_became_peered":"2023-10-08T00:34:24.670309+0000","last_unstale":"2023-10-08T00:34:24.671314+0000","last_undegraded":"2023-10-08T00:34:24.671314+0000","last_fullsized":"2023-10-08T00:34:24.671314+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:46:00.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676010+0000","last_change":"2023-10-08T00:34:24.676010+0000","last_active":"2023-10-08T00:34:24.676010+0000","last_peered":"2023-10-08T00:34:24.676010+0000","last_clean":"2023-10-08T00:34:24.676010+0000","last_became_active":"2023-10-08T00:34:24.675749+0000","last_became_peered":"2023-10-08T00:34:24.675749+0000","last_unstale":"2023-10-08T00:34:24.676010+0000","last_undegraded":"2023-10-08T00:34:24.676010+0000","last_fullsized":"2023-10-08T00:34:24.676010+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:27.398231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672358+0000","last_change":"2023-10-08T00:34:24.672358+0000","last_active":"2023-10-08T00:34:24.672358+0000","last_peered":"2023-10-08T00:34:24.672358+0000","last_clean":"2023-10-08T00:34:24.672358+0000","last_became_active":"2023-10-08T00:34:24.672065+0000","last_became_peered":"2023-10-08T00:34:24.672065+0000","last_unstale":"2023-10-08T00:34:24.672358+0000","last_undegraded":"2023-10-08T00:34:24.672358+0000","last_fullsized":"2023-10-08T00:34:24.672358+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:15:58.188353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674984+0000","last_change":"2023-10-08T00:34:24.674984+0000","last_active":"2023-10-08T00:34:24.674984+0000","last_peered":"2023-10-08T00:34:24.674984+0000","last_clean":"2023-10-08T00:34:24.674984+0000","last_became_active":"2023-10-08T00:34:24.674693+0000","last_became_peered":"2023-10-08T00:34:24.674693+0000","last_unstale":"2023-10-08T00:34:24.674984+0000","last_undegraded":"2023-10-08T00:34:24.674984+0000","last_fullsized":"2023-10-08T00:34:24.674984+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:08.081303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.670582+0000","last_change":"2023-10-08T00:34:24.670582+0000","last_active":"2023-10-08T00:34:24.670582+0000","last_peered":"2023-10-08T00:34:24.670582+0000","last_clean":"2023-10-08T00:34:24.670582+0000","last_became_active":"2023-10-08T00:34:24.670302+0000","last_became_peered":"2023-10-08T00:34:24.670302+0000","last_unstale":"2023-10-08T00:34:24.670582+0000","last_undegraded":"2023-10-08T00:34:24.670582+0000","last_fullsized":"2023-10-08T00:34:24.670582+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:09.156627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676663+0000","last_change":"2023-10-08T00:34:24.676663+0000","last_active":"2023-10-08T00:34:24.676663+0000","last_peered":"2023-10-08T00:34:24.676663+0000","last_clean":"2023-10-08T00:34:24.676663+0000","last_became_active":"2023-10-08T00:34:24.676388+0000","last_became_peered":"2023-10-08T00:34:24.676388+0000","last_unstale":"2023-10-08T00:34:24.676663+0000","last_undegraded":"2023-10-08T00:34:24.676663+0000","last_fullsized":"2023-10-08T00:34:24.676663+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.109423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674032+0000","last_change":"2023-10-08T00:34:24.674032+0000","last_active":"2023-10-08T00:34:24.674032+0000","last_peered":"2023-10-08T00:34:24.674032+0000","last_clean":"2023-10-08T00:34:24.674032+0000","last_became_active":"2023-10-08T00:34:24.673802+0000","last_became_peered":"2023-10-08T00:34:24.673802+0000","last_unstale":"2023-10-08T00:34:24.674032+0000","last_undegraded":"2023-10-08T00:34:24.674032+0000","last_fullsized":"2023-10-08T00:34:24.674032+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:23.453754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675985+0000","last_change":"2023-10-08T00:34:24.675985+0000","last_active":"2023-10-08T00:34:24.675985+0000","last_peered":"2023-10-08T00:34:24.675985+0000","last_clean":"2023-10-08T00:34:24.675985+0000","last_became_active":"2023-10-08T00:34:24.675742+0000","last_became_peered":"2023-10-08T00:34:24.675742+0000","last_unstale":"2023-10-08T00:34:24.675985+0000","last_undegraded":"2023-10-08T00:34:24.675985+0000","last_fullsized":"2023-10-08T00:34:24.675985+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:45.029174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.679936+0000","last_change":"2023-10-08T00:34:24.679936+0000","last_active":"2023-10-08T00:34:24.679936+0000","last_peered":"2023-10-08T00:34:24.679936+0000","last_clean":"2023-10-08T00:34:24.679936+0000","last_became_active":"2023-10-08T00:34:24.679646+0000","last_became_peered":"2023-10-08T00:34:24.679646+0000","last_unstale":"2023-10-08T00:34:24.679936+0000","last_undegraded":"2023-10-08T00:34:24.679936+0000","last_fullsized":"2023-10-08T00:34:24.679936+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:43.891403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675136+0000","last_change":"2023-10-08T00:34:24.675136+0000","last_active":"2023-10-08T00:34:24.675136+0000","last_peered":"2023-10-08T00:34:24.675136+0000","last_clean":"2023-10-08T00:34:24.675136+0000","last_became_active":"2023-10-08T00:34:24.672944+0000","last_became_peered":"2023-10-08T00:34:24.672944+0000","last_unstale":"2023-10-08T00:34:24.675136+0000","last_undegraded":"2023-10-08T00:34:24.675136+0000","last_fullsized":"2023-10-08T00:34:24.675136+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:52.369917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.673716+0000","last_change":"2023-10-08T00:34:24.673716+0000","last_active":"2023-10-08T00:34:24.673716+0000","last_peered":"2023-10-08T00:34:24.673716+0000","last_clean":"2023-10-08T00:34:24.673716+0000","last_became_active":"2023-10-08T00:34:24.673263+0000","last_became_peered":"2023-10-08T00:34:24.673263+0000","last_unstale":"2023-10-08T00:34:24.673716+0000","last_undegraded":"2023-10-08T00:34:24.673716+0000","last_fullsized":"2023-10-08T00:34:24.673716+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:46.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678215+0000","last_change":"2023-10-08T00:34:24.678215+0000","last_active":"2023-10-08T00:34:24.678215+0000","last_peered":"2023-10-08T00:34:24.678215+0000","last_clean":"2023-10-08T00:34:24.678215+0000","last_became_active":"2023-10-08T00:34:24.677895+0000","last_became_peered":"2023-10-08T00:34:24.677895+0000","last_unstale":"2023-10-08T00:34:24.678215+0000","last_undegraded":"2023-10-08T00:34:24.678215+0000","last_fullsized":"2023-10-08T00:34:24.678215+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:16.843704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678822+0000","last_change":"2023-10-08T00:34:24.678822+0000","last_active":"2023-10-08T00:34:24.678822+0000","last_peered":"2023-10-08T00:34:24.678822+0000","last_clean":"2023-10-08T00:34:24.678822+0000","last_became_active":"2023-10-08T00:34:24.678557+0000","last_became_peered":"2023-10-08T00:34:24.678557+0000","last_unstale":"2023-10-08T00:34:24.678822+0000","last_undegraded":"2023-10-08T00:34:24.678822+0000","last_fullsized":"2023-10-08T00:34:24.678822+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.503356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677650+0000","last_change":"2023-10-08T00:34:24.677650+0000","last_active":"2023-10-08T00:34:24.677650+0000","last_peered":"2023-10-08T00:34:24.677650+0000","last_clean":"2023-10-08T00:34:24.677650+0000","last_became_active":"2023-10-08T00:34:24.677406+0000","last_became_peered":"2023-10-08T00:34:24.677406+0000","last_unstale":"2023-10-08T00:34:24.677650+0000","last_undegraded":"2023-10-08T00:34:24.677650+0000","last_fullsized":"2023-10-08T00:34:24.677650+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:18:32.313511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675969+0000","last_change":"2023-10-08T00:34:24.675969+0000","last_active":"2023-10-08T00:34:24.675969+0000","last_peered":"2023-10-08T00:34:24.675969+0000","last_clean":"2023-10-08T00:34:24.675969+0000","last_became_active":"2023-10-08T00:34:24.675593+0000","last_became_peered":"2023-10-08T00:34:24.675593+0000","last_unstale":"2023-10-08T00:34:24.675969+0000","last_undegraded":"2023-10-08T00:34:24.675969+0000","last_fullsized":"2023-10-08T00:34:24.675969+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:44.737824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675479+0000","last_change":"2023-10-08T00:34:24.675479+0000","last_active":"2023-10-08T00:34:24.675479+0000","last_peered":"2023-10-08T00:34:24.675479+0000","last_clean":"2023-10-08T00:34:24.675479+0000","last_became_active":"2023-10-08T00:34:24.675172+0000","last_became_peered":"2023-10-08T00:34:24.675172+0000","last_unstale":"2023-10-08T00:34:24.675479+0000","last_undegraded":"2023-10-08T00:34:24.675479+0000","last_fullsized":"2023-10-08T00:34:24.675479+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:07.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671000+0000","last_change":"2023-10-08T00:34:24.671000+0000","last_active":"2023-10-08T00:34:24.671000+0000","last_peered":"2023-10-08T00:34:24.671000+0000","last_clean":"2023-10-08T00:34:24.671000+0000","last_became_active":"2023-10-08T00:34:24.670702+0000","last_became_peered":"2023-10-08T00:34:24.670702+0000","last_unstale":"2023-10-08T00:34:24.671000+0000","last_undegraded":"2023-10-08T00:34:24.671000+0000","last_fullsized":"2023-10-08T00:34:24.671000+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:33.491556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678277+0000","last_change":"2023-10-08T00:34:24.678277+0000","last_active":"2023-10-08T00:34:24.678277+0000","last_peered":"2023-10-08T00:34:24.678277+0000","last_clean":"2023-10-08T00:34:24.678277+0000","last_became_active":"2023-10-08T00:34:24.678003+0000","last_became_peered":"2023-10-08T00:34:24.678003+0000","last_unstale":"2023-10-08T00:34:24.678277+0000","last_undegraded":"2023-10-08T00:34:24.678277+0000","last_fullsized":"2023-10-08T00:34:24.678277+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:26.105813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671530+0000","last_change":"2023-10-08T00:34:24.671530+0000","last_active":"2023-10-08T00:34:24.671530+0000","last_peered":"2023-10-08T00:34:24.671530+0000","last_clean":"2023-10-08T00:34:24.671530+0000","last_became_active":"2023-10-08T00:34:24.670341+0000","last_became_peered":"2023-10-08T00:34:24.670341+0000","last_unstale":"2023-10-08T00:34:24.671530+0000","last_undegraded":"2023-10-08T00:34:24.671530+0000","last_fullsized":"2023-10-08T00:34:24.671530+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:35.893717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675373+0000","last_change":"2023-10-08T00:34:24.675373+0000","last_active":"2023-10-08T00:34:24.675373+0000","last_peered":"2023-10-08T00:34:24.675373+0000","last_clean":"2023-10-08T00:34:24.675373+0000","last_became_active":"2023-10-08T00:34:24.674968+0000","last_became_peered":"2023-10-08T00:34:24.674968+0000","last_unstale":"2023-10-08T00:34:24.675373+0000","last_undegraded":"2023-10-08T00:34:24.675373+0000","last_fullsized":"2023-10-08T00:34:24.675373+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:30.402121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.680189+0000","last_change":"2023-10-08T00:34:24.680189+0000","last_active":"2023-10-08T00:34:24.680189+0000","last_peered":"2023-10-08T00:34:24.680189+0000","last_clean":"2023-10-08T00:34:24.680189+0000","last_became_active":"2023-10-08T00:34:24.679908+0000","last_became_peered":"2023-10-08T00:34:24.679908+0000","last_unstale":"2023-10-08T00:34:24.680189+0000","last_undegraded":"2023-10-08T00:34:24.680189+0000","last_fullsized":"2023-10-08T00:34:24.680189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:22:57.189521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676084+0000","last_change":"2023-10-08T00:34:24.676084+0000","last_active":"2023-10-08T00:34:24.676084+0000","last_peered":"2023-10-08T00:34:24.676084+0000","last_clean":"2023-10-08T00:34:24.676084+0000","last_became_active":"2023-10-08T00:34:24.675237+0000","last_became_peered":"2023-10-08T00:34:24.675237+0000","last_unstale":"2023-10-08T00:34:24.676084+0000","last_undegraded":"2023-10-08T00:34:24.676084+0000","last_fullsized":"2023-10-08T00:34:24.676084+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:42.113958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.668780+0000","last_change":"2023-10-08T00:34:24.668780+0000","last_active":"2023-10-08T00:34:24.668780+0000","last_peered":"2023-10-08T00:34:24.668780+0000","last_clean":"2023-10-08T00:34:24.668780+0000","last_became_active":"2023-10-08T00:34:24.668496+0000","last_became_peered":"2023-10-08T00:34:24.668496+0000","last_unstale":"2023-10-08T00:34:24.668780+0000","last_undegraded":"2023-10-08T00:34:24.668780+0000","last_fullsized":"2023-10-08T00:34:24.668780+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:34.623264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.670741+0000","last_change":"2023-10-08T00:34:24.670741+0000","last_active":"2023-10-08T00:34:24.670741+0000","last_peered":"2023-10-08T00:34:24.670741+0000","last_clean":"2023-10-08T00:34:24.670741+0000","last_became_active":"2023-10-08T00:34:24.670446+0000","last_became_peered":"2023-10-08T00:34:24.670446+0000","last_unstale":"2023-10-08T00:34:24.670741+0000","last_undegraded":"2023-10-08T00:34:24.670741+0000","last_fullsized":"2023-10-08T00:34:24.670741+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:05.004645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677253+0000","last_change":"2023-10-08T00:34:24.677253+0000","last_active":"2023-10-08T00:34:24.677253+0000","last_peered":"2023-10-08T00:34:24.677253+0000","last_clean":"2023-10-08T00:34:24.677253+0000","last_became_active":"2023-10-08T00:34:24.676908+0000","last_became_peered":"2023-10-08T00:34:24.676908+0000","last_unstale":"2023-10-08T00:34:24.677253+0000","last_undegraded":"2023-10-08T00:34:24.677253+0000","last_fullsized":"2023-10-08T00:34:24.677253+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:28:19.245923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677994+0000","last_change":"2023-10-08T00:34:24.677994+0000","last_active":"2023-10-08T00:34:24.677994+0000","last_peered":"2023-10-08T00:34:24.677994+0000","last_clean":"2023-10-08T00:34:24.677994+0000","last_became_active":"2023-10-08T00:34:24.677709+0000","last_became_peered":"2023-10-08T00:34:24.677709+0000","last_unstale":"2023-10-08T00:34:24.677994+0000","last_undegraded":"2023-10-08T00:34:24.677994+0000","last_fullsized":"2023-10-08T00:34:24.677994+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:35:19.836923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674625+0000","last_change":"2023-10-08T00:34:24.674625+0000","last_active":"2023-10-08T00:34:24.674625+0000","last_peered":"2023-10-08T00:34:24.674625+0000","last_clean":"2023-10-08T00:34:24.674625+0000","last_became_active":"2023-10-08T00:34:24.674273+0000","last_became_peered":"2023-10-08T00:34:24.674273+0000","last_unstale":"2023-10-08T00:34:24.674625+0000","last_undegraded":"2023-10-08T00:34:24.674625+0000","last_fullsized":"2023-10-08T00:34:24.674625+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:03:15.732459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677683+0000","last_change":"2023-10-08T00:34:24.677683+0000","last_active":"2023-10-08T00:34:24.677683+0000","last_peered":"2023-10-08T00:34:24.677683+0000","last_clean":"2023-10-08T00:34:24.677683+0000","last_became_active":"2023-10-08T00:34:24.677347+0000","last_became_peered":"2023-10-08T00:34:24.677347+0000","last_unstale":"2023-10-08T00:34:24.677683+0000","last_undegraded":"2023-10-08T00:34:24.677683+0000","last_fullsized":"2023-10-08T00:34:24.677683+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:02.487928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675552+0000","last_change":"2023-10-08T00:34:24.675552+0000","last_active":"2023-10-08T00:34:24.675552+0000","last_peered":"2023-10-08T00:34:24.675552+0000","last_clean":"2023-10-08T00:34:24.675552+0000","last_became_active":"2023-10-08T00:34:24.674888+0000","last_became_peered":"2023-10-08T00:34:24.674888+0000","last_unstale":"2023-10-08T00:34:24.675552+0000","last_undegraded":"2023-10-08T00:34:24.675552+0000","last_fullsized":"2023-10-08T00:34:24.675552+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:43.043875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.669187+0000","last_change":"2023-10-08T00:34:24.669187+0000","last_active":"2023-10-08T00:34:24.669187+0000","last_peered":"2023-10-08T00:34:24.669187+0000","last_clean":"2023-10-08T00:34:24.669187+0000","last_became_active":"2023-10-08T00:34:24.668985+0000","last_became_peered":"2023-10-08T00:34:24.668985+0000","last_unstale":"2023-10-08T00:34:24.669187+0000","last_undegraded":"2023-10-08T00:34:24.669187+0000","last_fullsized":"2023-10-08T00:34:24.669187+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:17:13.412317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.673303+0000","last_change":"2023-10-08T00:34:24.673303+0000","last_active":"2023-10-08T00:34:24.673303+0000","last_peered":"2023-10-08T00:34:24.673303+0000","last_clean":"2023-10-08T00:34:24.673303+0000","last_became_active":"2023-10-08T00:34:24.673012+0000","last_became_peered":"2023-10-08T00:34:24.673012+0000","last_unstale":"2023-10-08T00:34:24.673303+0000","last_undegraded":"2023-10-08T00:34:24.673303+0000","last_fullsized":"2023-10-08T00:34:24.673303+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:10:41.634748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"201'4","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.920095+0000","last_change":"2023-10-08T00:34:23.917685+0000","last_active":"2023-10-08T00:34:24.920095+0000","last_peered":"2023-10-08T00:34:24.920095+0000","last_clean":"2023-10-08T00:34:24.920095+0000","last_became_active":"2023-10-08T00:34:23.917388+0000","last_became_peered":"2023-10-08T00:34:23.917388+0000","last_unstale":"2023-10-08T00:34:24.920095+0000","last_undegraded":"2023-10-08T00:34:24.920095+0000","last_fullsized":"2023-10-08T00:34:24.920095+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:13:08.625401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.666347+0000","last_change":"2023-10-08T00:34:24.666347+0000","last_active":"2023-10-08T00:34:24.666347+0000","last_peered":"2023-10-08T00:34:24.666347+0000","last_clean":"2023-10-08T00:34:24.666347+0000","last_became_active":"2023-10-08T00:34:24.666053+0000","last_became_peered":"2023-10-08T00:34:24.666053+0000","last_unstale":"2023-10-08T00:34:24.666347+0000","last_undegraded":"2023-10-08T00:34:24.666347+0000","last_fullsized":"2023-10-08T00:34:24.666347+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:05.045792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672876+0000","last_change":"2023-10-08T00:34:23.914036+0000","last_active":"2023-10-08T00:34:24.672876+0000","last_peered":"2023-10-08T00:34:24.672876+0000","last_clean":"2023-10-08T00:34:24.672876+0000","last_became_active":"2023-10-08T00:34:23.913728+0000","last_became_peered":"2023-10-08T00:34:23.913728+0000","last_unstale":"2023-10-08T00:34:24.672876+0000","last_undegraded":"2023-10-08T00:34:24.672876+0000","last_fullsized":"2023-10-08T00:34:24.672876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:03:14.727899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672930+0000","last_change":"2023-10-08T00:34:24.672930+0000","last_active":"2023-10-08T00:34:24.672930+0000","last_peered":"2023-10-08T00:34:24.672930+0000","last_clean":"2023-10-08T00:34:24.672930+0000","last_became_active":"2023-10-08T00:34:24.672587+0000","last_became_peered":"2023-10-08T00:34:24.672587+0000","last_unstale":"2023-10-08T00:34:24.672930+0000","last_undegraded":"2023-10-08T00:34:24.672930+0000","last_fullsized":"2023-10-08T00:34:24.672930+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:50:09.378616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.918124+0000","last_change":"2023-10-08T00:34:23.917828+0000","last_active":"2023-10-08T00:34:24.918124+0000","last_peered":"2023-10-08T00:34:24.918124+0000","last_clean":"2023-10-08T00:34:24.918124+0000","last_became_active":"2023-10-08T00:34:23.915221+0000","last_became_peered":"2023-10-08T00:34:23.915221+0000","last_unstale":"2023-10-08T00:34:24.918124+0000","last_undegraded":"2023-10-08T00:34:24.918124+0000","last_fullsized":"2023-10-08T00:34:24.918124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:56.533987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.673008+0000","last_change":"2023-10-08T00:34:24.673008+0000","last_active":"2023-10-08T00:34:24.673008+0000","last_peered":"2023-10-08T00:34:24.673008+0000","last_clean":"2023-10-08T00:34:24.673008+0000","last_became_active":"2023-10-08T00:34:24.672664+0000","last_became_peered":"2023-10-08T00:34:24.672664+0000","last_unstale":"2023-10-08T00:34:24.673008+0000","last_undegraded":"2023-10-08T00:34:24.673008+0000","last_fullsized":"2023-10-08T00:34:24.673008+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:23.453754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.917446+0000","last_change":"2023-10-08T00:34:23.918854+0000","last_active":"2023-10-08T00:34:24.917446+0000","last_peered":"2023-10-08T00:34:24.917446+0000","last_clean":"2023-10-08T00:34:24.917446+0000","last_became_active":"2023-10-08T00:34:23.918563+0000","last_became_peered":"2023-10-08T00:34:23.918563+0000","last_unstale":"2023-10-08T00:34:24.917446+0000","last_undegraded":"2023-10-08T00:34:24.917446+0000","last_fullsized":"2023-10-08T00:34:24.917446+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:33.618705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671195+0000","last_change":"2023-10-08T00:34:24.671195+0000","last_active":"2023-10-08T00:34:24.671195+0000","last_peered":"2023-10-08T00:34:24.671195+0000","last_clean":"2023-10-08T00:34:24.671195+0000","last_became_active":"2023-10-08T00:34:24.670203+0000","last_became_peered":"2023-10-08T00:34:24.670203+0000","last_unstale":"2023-10-08T00:34:24.671195+0000","last_undegraded":"2023-10-08T00:34:24.671195+0000","last_fullsized":"2023-10-08T00:34:24.671195+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:09:00.567932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.660689+0000","last_change":"2023-10-08T00:34:23.919378+0000","last_active":"2023-10-08T00:34:24.660689+0000","last_peered":"2023-10-08T00:34:24.660689+0000","last_clean":"2023-10-08T00:34:24.660689+0000","last_became_active":"2023-10-08T00:34:23.918536+0000","last_became_peered":"2023-10-08T00:34:23.918536+0000","last_unstale":"2023-10-08T00:34:24.660689+0000","last_undegraded":"2023-10-08T00:34:24.660689+0000","last_fullsized":"2023-10-08T00:34:24.660689+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:18.580886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.679916+0000","last_change":"2023-10-08T00:34:24.679916+0000","last_active":"2023-10-08T00:34:24.679916+0000","last_peered":"2023-10-08T00:34:24.679916+0000","last_clean":"2023-10-08T00:34:24.679916+0000","last_became_active":"2023-10-08T00:34:24.679387+0000","last_became_peered":"2023-10-08T00:34:24.679387+0000","last_unstale":"2023-10-08T00:34:24.679916+0000","last_undegraded":"2023-10-08T00:34:24.679916+0000","last_fullsized":"2023-10-08T00:34:24.679916+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:09.852679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672938+0000","last_change":"2023-10-08T00:34:23.923903+0000","last_active":"2023-10-08T00:34:24.672938+0000","last_peered":"2023-10-08T00:34:24.672938+0000","last_clean":"2023-10-08T00:34:24.672938+0000","last_became_active":"2023-10-08T00:34:23.923629+0000","last_became_peered":"2023-10-08T00:34:23.923629+0000","last_unstale":"2023-10-08T00:34:24.672938+0000","last_undegraded":"2023-10-08T00:34:24.672938+0000","last_fullsized":"2023-10-08T00:34:24.672938+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:45:23.040367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.680661+0000","last_change":"2023-10-08T00:34:24.680661+0000","last_active":"2023-10-08T00:34:24.680661+0000","last_peered":"2023-10-08T00:34:24.680661+0000","last_clean":"2023-10-08T00:34:24.680661+0000","last_became_active":"2023-10-08T00:34:24.680418+0000","last_became_peered":"2023-10-08T00:34:24.680418+0000","last_unstale":"2023-10-08T00:34:24.680661+0000","last_undegraded":"2023-10-08T00:34:24.680661+0000","last_fullsized":"2023-10-08T00:34:24.680661+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:30:13.547501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917789+0000","last_change":"2023-10-08T00:34:23.915222+0000","last_active":"2023-10-08T00:34:23.917789+0000","last_peered":"2023-10-08T00:34:23.917789+0000","last_clean":"2023-10-08T00:34:23.917789+0000","last_became_active":"2023-10-08T00:34:23.914924+0000","last_became_peered":"2023-10-08T00:34:23.914924+0000","last_unstale":"2023-10-08T00:34:23.917789+0000","last_undegraded":"2023-10-08T00:34:23.917789+0000","last_fullsized":"2023-10-08T00:34:23.917789+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:16:38.729004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678051+0000","last_change":"2023-10-08T00:34:24.678051+0000","last_active":"2023-10-08T00:34:24.678051+0000","last_peered":"2023-10-08T00:34:24.678051+0000","last_clean":"2023-10-08T00:34:24.678051+0000","last_became_active":"2023-10-08T00:34:24.676432+0000","last_became_peered":"2023-10-08T00:34:24.676432+0000","last_unstale":"2023-10-08T00:34:24.678051+0000","last_undegraded":"2023-10-08T00:34:24.678051+0000","last_fullsized":"2023-10-08T00:34:24.678051+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:37:47.695210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.921329+0000","last_change":"2023-10-08T00:34:23.918979+0000","last_active":"2023-10-08T00:34:23.921329+0000","last_peered":"2023-10-08T00:34:23.921329+0000","last_clean":"2023-10-08T00:34:23.921329+0000","last_became_active":"2023-10-08T00:34:23.918512+0000","last_became_peered":"2023-10-08T00:34:23.918512+0000","last_unstale":"2023-10-08T00:34:23.921329+0000","last_undegraded":"2023-10-08T00:34:23.921329+0000","last_fullsized":"2023-10-08T00:34:23.921329+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:20.211261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672209+0000","last_change":"2023-10-08T00:34:24.672209+0000","last_active":"2023-10-08T00:34:24.672209+0000","last_peered":"2023-10-08T00:34:24.672209+0000","last_clean":"2023-10-08T00:34:24.672209+0000","last_became_active":"2023-10-08T00:34:24.671928+0000","last_became_peered":"2023-10-08T00:34:24.671928+0000","last_unstale":"2023-10-08T00:34:24.672209+0000","last_undegraded":"2023-10-08T00:34:24.672209+0000","last_fullsized":"2023-10-08T00:34:24.672209+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:56.451225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923104+0000","last_change":"2023-10-08T00:34:23.917037+0000","last_active":"2023-10-08T00:34:23.923104+0000","last_peered":"2023-10-08T00:34:23.923104+0000","last_clean":"2023-10-08T00:34:23.923104+0000","last_became_active":"2023-10-08T00:34:23.916761+0000","last_became_peered":"2023-10-08T00:34:23.916761+0000","last_unstale":"2023-10-08T00:34:23.923104+0000","last_undegraded":"2023-10-08T00:34:23.923104+0000","last_fullsized":"2023-10-08T00:34:23.923104+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:15.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672179+0000","last_change":"2023-10-08T00:34:24.672179+0000","last_active":"2023-10-08T00:34:24.672179+0000","last_peered":"2023-10-08T00:34:24.672179+0000","last_clean":"2023-10-08T00:34:24.672179+0000","last_became_active":"2023-10-08T00:34:24.670713+0000","last_became_peered":"2023-10-08T00:34:24.670713+0000","last_unstale":"2023-10-08T00:34:24.672179+0000","last_undegraded":"2023-10-08T00:34:24.672179+0000","last_fullsized":"2023-10-08T00:34:24.672179+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:57.631640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.920435+0000","last_change":"2023-10-08T00:34:23.919650+0000","last_active":"2023-10-08T00:34:23.920435+0000","last_peered":"2023-10-08T00:34:23.920435+0000","last_clean":"2023-10-08T00:34:23.920435+0000","last_became_active":"2023-10-08T00:34:23.919358+0000","last_became_peered":"2023-10-08T00:34:23.919358+0000","last_unstale":"2023-10-08T00:34:23.920435+0000","last_undegraded":"2023-10-08T00:34:23.920435+0000","last_fullsized":"2023-10-08T00:34:23.920435+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:22:56.184961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672149+0000","last_change":"2023-10-08T00:34:24.672149+0000","last_active":"2023-10-08T00:34:24.672149+0000","last_peered":"2023-10-08T00:34:24.672149+0000","last_clean":"2023-10-08T00:34:24.672149+0000","last_became_active":"2023-10-08T00:34:24.671963+0000","last_became_peered":"2023-10-08T00:34:24.671963+0000","last_unstale":"2023-10-08T00:34:24.672149+0000","last_undegraded":"2023-10-08T00:34:24.672149+0000","last_fullsized":"2023-10-08T00:34:24.672149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:19.585446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"201'3","reported_seq":12,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.921947+0000","last_change":"2023-10-08T00:34:23.917070+0000","last_active":"2023-10-08T00:34:24.921947+0000","last_peered":"2023-10-08T00:34:24.921947+0000","last_clean":"2023-10-08T00:34:24.921947+0000","last_became_active":"2023-10-08T00:34:23.916797+0000","last_became_peered":"2023-10-08T00:34:23.916797+0000","last_unstale":"2023-10-08T00:34:24.921947+0000","last_undegraded":"2023-10-08T00:34:24.921947+0000","last_fullsized":"2023-10-08T00:34:24.921947+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:04.954720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.668895+0000","last_change":"2023-10-08T00:34:24.668895+0000","last_active":"2023-10-08T00:34:24.668895+0000","last_peered":"2023-10-08T00:34:24.668895+0000","last_clean":"2023-10-08T00:34:24.668895+0000","last_became_active":"2023-10-08T00:34:24.668612+0000","last_became_peered":"2023-10-08T00:34:24.668612+0000","last_unstale":"2023-10-08T00:34:24.668895+0000","last_undegraded":"2023-10-08T00:34:24.668895+0000","last_fullsized":"2023-10-08T00:34:24.668895+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:45.962549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"201'6","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.920369+0000","last_change":"2023-10-08T00:34:23.912626+0000","last_active":"2023-10-08T00:34:24.920369+0000","last_peered":"2023-10-08T00:34:24.920369+0000","last_clean":"2023-10-08T00:34:24.920369+0000","last_became_active":"2023-10-08T00:34:23.912352+0000","last_became_peered":"2023-10-08T00:34:23.912352+0000","last_unstale":"2023-10-08T00:34:24.920369+0000","last_undegraded":"2023-10-08T00:34:24.920369+0000","last_fullsized":"2023-10-08T00:34:24.920369+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:30:12.542941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674820+0000","last_change":"2023-10-08T00:34:24.674820+0000","last_active":"2023-10-08T00:34:24.674820+0000","last_peered":"2023-10-08T00:34:24.674820+0000","last_clean":"2023-10-08T00:34:24.674820+0000","last_became_active":"2023-10-08T00:34:24.674445+0000","last_became_peered":"2023-10-08T00:34:24.674445+0000","last_unstale":"2023-10-08T00:34:24.674820+0000","last_undegraded":"2023-10-08T00:34:24.674820+0000","last_fullsized":"2023-10-08T00:34:24.674820+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:14:10.406483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.918286+0000","last_change":"2023-10-08T00:34:23.919305+0000","last_active":"2023-10-08T00:34:24.918286+0000","last_peered":"2023-10-08T00:34:24.918286+0000","last_clean":"2023-10-08T00:34:24.918286+0000","last_became_active":"2023-10-08T00:34:23.918116+0000","last_became_peered":"2023-10-08T00:34:23.918116+0000","last_unstale":"2023-10-08T00:34:24.918286+0000","last_undegraded":"2023-10-08T00:34:24.918286+0000","last_fullsized":"2023-10-08T00:34:24.918286+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:08.152067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678064+0000","last_change":"2023-10-08T00:34:24.678064+0000","last_active":"2023-10-08T00:34:24.678064+0000","last_peered":"2023-10-08T00:34:24.678064+0000","last_clean":"2023-10-08T00:34:24.678064+0000","last_became_active":"2023-10-08T00:34:24.677790+0000","last_became_peered":"2023-10-08T00:34:24.677790+0000","last_unstale":"2023-10-08T00:34:24.678064+0000","last_undegraded":"2023-10-08T00:34:24.678064+0000","last_fullsized":"2023-10-08T00:34:24.678064+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:00.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923421+0000","last_change":"2023-10-08T00:34:23.922308+0000","last_active":"2023-10-08T00:34:23.923421+0000","last_peered":"2023-10-08T00:34:23.923421+0000","last_clean":"2023-10-08T00:34:23.923421+0000","last_became_active":"2023-10-08T00:34:23.918631+0000","last_became_peered":"2023-10-08T00:34:23.918631+0000","last_unstale":"2023-10-08T00:34:23.923421+0000","last_undegraded":"2023-10-08T00:34:23.923421+0000","last_fullsized":"2023-10-08T00:34:23.923421+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:21:42.582154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.665961+0000","last_change":"2023-10-08T00:34:24.665961+0000","last_active":"2023-10-08T00:34:24.665961+0000","last_peered":"2023-10-08T00:34:24.665961+0000","last_clean":"2023-10-08T00:34:24.665961+0000","last_became_active":"2023-10-08T00:34:24.665693+0000","last_became_peered":"2023-10-08T00:34:24.665693+0000","last_unstale":"2023-10-08T00:34:24.665961+0000","last_undegraded":"2023-10-08T00:34:24.665961+0000","last_fullsized":"2023-10-08T00:34:24.665961+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:02:47.239223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923173+0000","last_change":"2023-10-08T00:34:23.917666+0000","last_active":"2023-10-08T00:34:23.923173+0000","last_peered":"2023-10-08T00:34:23.923173+0000","last_clean":"2023-10-08T00:34:23.923173+0000","last_became_active":"2023-10-08T00:34:23.917364+0000","last_became_peered":"2023-10-08T00:34:23.917364+0000","last_unstale":"2023-10-08T00:34:23.923173+0000","last_undegraded":"2023-10-08T00:34:23.923173+0000","last_fullsized":"2023-10-08T00:34:23.923173+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:27.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676341+0000","last_change":"2023-10-08T00:34:24.676341+0000","last_active":"2023-10-08T00:34:24.676341+0000","last_peered":"2023-10-08T00:34:24.676341+0000","last_clean":"2023-10-08T00:34:24.676341+0000","last_became_active":"2023-10-08T00:34:24.676009+0000","last_became_peered":"2023-10-08T00:34:24.676009+0000","last_unstale":"2023-10-08T00:34:24.676341+0000","last_undegraded":"2023-10-08T00:34:24.676341+0000","last_fullsized":"2023-10-08T00:34:24.676341+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:04.803297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"201'8","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.922014+0000","last_change":"2023-10-08T00:34:23.915016+0000","last_active":"2023-10-08T00:34:24.922014+0000","last_peered":"2023-10-08T00:34:24.922014+0000","last_clean":"2023-10-08T00:34:24.922014+0000","last_became_active":"2023-10-08T00:34:23.914383+0000","last_became_peered":"2023-10-08T00:34:23.914383+0000","last_unstale":"2023-10-08T00:34:24.922014+0000","last_undegraded":"2023-10-08T00:34:24.922014+0000","last_fullsized":"2023-10-08T00:34:24.922014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:34:25.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674543+0000","last_change":"2023-10-08T00:34:24.674543+0000","last_active":"2023-10-08T00:34:24.674543+0000","last_peered":"2023-10-08T00:34:24.674543+0000","last_clean":"2023-10-08T00:34:24.674543+0000","last_became_active":"2023-10-08T00:34:24.673882+0000","last_became_peered":"2023-10-08T00:34:24.673882+0000","last_unstale":"2023-10-08T00:34:24.674543+0000","last_undegraded":"2023-10-08T00:34:24.674543+0000","last_fullsized":"2023-10-08T00:34:24.674543+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:20:58.396153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.667471+0000","last_change":"2023-10-08T00:34:23.922856+0000","last_active":"2023-10-08T00:34:24.667471+0000","last_peered":"2023-10-08T00:34:24.667471+0000","last_clean":"2023-10-08T00:34:24.667471+0000","last_became_active":"2023-10-08T00:34:23.922578+0000","last_became_peered":"2023-10-08T00:34:23.922578+0000","last_unstale":"2023-10-08T00:34:24.667471+0000","last_undegraded":"2023-10-08T00:34:24.667471+0000","last_fullsized":"2023-10-08T00:34:24.667471+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:26.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.668804+0000","last_change":"2023-10-08T00:34:24.668804+0000","last_active":"2023-10-08T00:34:24.668804+0000","last_peered":"2023-10-08T00:34:24.668804+0000","last_clean":"2023-10-08T00:34:24.668804+0000","last_became_active":"2023-10-08T00:34:24.668510+0000","last_became_peered":"2023-10-08T00:34:24.668510+0000","last_unstale":"2023-10-08T00:34:24.668804+0000","last_undegraded":"2023-10-08T00:34:24.668804+0000","last_fullsized":"2023-10-08T00:34:24.668804+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:16:39.733563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.916369+0000","last_change":"2023-10-08T00:34:23.919108+0000","last_active":"2023-10-08T00:34:24.916369+0000","last_peered":"2023-10-08T00:34:24.916369+0000","last_clean":"2023-10-08T00:34:24.916369+0000","last_became_active":"2023-10-08T00:34:23.917323+0000","last_became_peered":"2023-10-08T00:34:23.917323+0000","last_unstale":"2023-10-08T00:34:24.916369+0000","last_undegraded":"2023-10-08T00:34:24.916369+0000","last_fullsized":"2023-10-08T00:34:24.916369+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:20:58.890100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671773+0000","last_change":"2023-10-08T00:34:24.671773+0000","last_active":"2023-10-08T00:34:24.671773+0000","last_peered":"2023-10-08T00:34:24.671773+0000","last_clean":"2023-10-08T00:34:24.671773+0000","last_became_active":"2023-10-08T00:34:24.671439+0000","last_became_peered":"2023-10-08T00:34:24.671439+0000","last_unstale":"2023-10-08T00:34:24.671773+0000","last_undegraded":"2023-10-08T00:34:24.671773+0000","last_fullsized":"2023-10-08T00:34:24.671773+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:01.606852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.666306+0000","last_change":"2023-10-08T00:34:23.916231+0000","last_active":"2023-10-08T00:34:24.666306+0000","last_peered":"2023-10-08T00:34:24.666306+0000","last_clean":"2023-10-08T00:34:24.666306+0000","last_became_active":"2023-10-08T00:34:23.915993+0000","last_became_peered":"2023-10-08T00:34:23.915993+0000","last_unstale":"2023-10-08T00:34:24.666306+0000","last_undegraded":"2023-10-08T00:34:24.666306+0000","last_fullsized":"2023-10-08T00:34:24.666306+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:23.395690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678710+0000","last_change":"2023-10-08T00:34:24.678710+0000","last_active":"2023-10-08T00:34:24.678710+0000","last_peered":"2023-10-08T00:34:24.678710+0000","last_clean":"2023-10-08T00:34:24.678710+0000","last_became_active":"2023-10-08T00:34:24.678445+0000","last_became_peered":"2023-10-08T00:34:24.678445+0000","last_unstale":"2023-10-08T00:34:24.678710+0000","last_undegraded":"2023-10-08T00:34:24.678710+0000","last_fullsized":"2023-10-08T00:34:24.678710+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:46.841257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917380+0000","last_change":"2023-10-08T00:34:23.916240+0000","last_active":"2023-10-08T00:34:23.917380+0000","last_peered":"2023-10-08T00:34:23.917380+0000","last_clean":"2023-10-08T00:34:23.917380+0000","last_became_active":"2023-10-08T00:34:23.915896+0000","last_became_peered":"2023-10-08T00:34:23.915896+0000","last_unstale":"2023-10-08T00:34:23.917380+0000","last_undegraded":"2023-10-08T00:34:23.917380+0000","last_fullsized":"2023-10-08T00:34:23.917380+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:34.118136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676361+0000","last_change":"2023-10-08T00:34:24.676361+0000","last_active":"2023-10-08T00:34:24.676361+0000","last_peered":"2023-10-08T00:34:24.676361+0000","last_clean":"2023-10-08T00:34:24.676361+0000","last_became_active":"2023-10-08T00:34:24.675915+0000","last_became_peered":"2023-10-08T00:34:24.675915+0000","last_unstale":"2023-10-08T00:34:24.676361+0000","last_undegraded":"2023-10-08T00:34:24.676361+0000","last_fullsized":"2023-10-08T00:34:24.676361+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:58:52.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.922286+0000","last_change":"2023-10-08T00:34:23.919490+0000","last_active":"2023-10-08T00:34:24.922286+0000","last_peered":"2023-10-08T00:34:24.922286+0000","last_clean":"2023-10-08T00:34:24.922286+0000","last_became_active":"2023-10-08T00:34:23.918666+0000","last_became_peered":"2023-10-08T00:34:23.918666+0000","last_unstale":"2023-10-08T00:34:24.922286+0000","last_undegraded":"2023-10-08T00:34:24.922286+0000","last_fullsized":"2023-10-08T00:34:24.922286+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:58:12.210868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674356+0000","last_change":"2023-10-08T00:34:24.674356+0000","last_active":"2023-10-08T00:34:24.674356+0000","last_peered":"2023-10-08T00:34:24.674356+0000","last_clean":"2023-10-08T00:34:24.674356+0000","last_became_active":"2023-10-08T00:34:24.674083+0000","last_became_peered":"2023-10-08T00:34:24.674083+0000","last_unstale":"2023-10-08T00:34:24.674356+0000","last_undegraded":"2023-10-08T00:34:24.674356+0000","last_fullsized":"2023-10-08T00:34:24.674356+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:17.258482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.920684+0000","last_change":"2023-10-08T00:34:23.914905+0000","last_active":"2023-10-08T00:34:23.920684+0000","last_peered":"2023-10-08T00:34:23.920684+0000","last_clean":"2023-10-08T00:34:23.920684+0000","last_became_active":"2023-10-08T00:34:23.914606+0000","last_became_peered":"2023-10-08T00:34:23.914606+0000","last_unstale":"2023-10-08T00:34:23.920684+0000","last_undegraded":"2023-10-08T00:34:23.920684+0000","last_fullsized":"2023-10-08T00:34:23.920684+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:35:28.374547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671861+0000","last_change":"2023-10-08T00:34:24.671861+0000","last_active":"2023-10-08T00:34:24.671861+0000","last_peered":"2023-10-08T00:34:24.671861+0000","last_clean":"2023-10-08T00:34:24.671861+0000","last_became_active":"2023-10-08T00:34:24.671491+0000","last_became_peered":"2023-10-08T00:34:24.671491+0000","last_unstale":"2023-10-08T00:34:24.671861+0000","last_undegraded":"2023-10-08T00:34:24.671861+0000","last_fullsized":"2023-10-08T00:34:24.671861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:39:18.197127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923438+0000","last_change":"2023-10-08T00:34:23.920384+0000","last_active":"2023-10-08T00:34:23.923438+0000","last_peered":"2023-10-08T00:34:23.923438+0000","last_clean":"2023-10-08T00:34:23.923438+0000","last_became_active":"2023-10-08T00:34:23.919960+0000","last_became_peered":"2023-10-08T00:34:23.919960+0000","last_unstale":"2023-10-08T00:34:23.923438+0000","last_undegraded":"2023-10-08T00:34:23.923438+0000","last_fullsized":"2023-10-08T00:34:23.923438+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:24:18.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672528+0000","last_change":"2023-10-08T00:34:24.672528+0000","last_active":"2023-10-08T00:34:24.672528+0000","last_peered":"2023-10-08T00:34:24.672528+0000","last_clean":"2023-10-08T00:34:24.672528+0000","last_became_active":"2023-10-08T00:34:24.670292+0000","last_became_peered":"2023-10-08T00:34:24.670292+0000","last_unstale":"2023-10-08T00:34:24.672528+0000","last_undegraded":"2023-10-08T00:34:24.672528+0000","last_fullsized":"2023-10-08T00:34:24.672528+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:06.882267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923052+0000","last_change":"2023-10-08T00:34:23.915189+0000","last_active":"2023-10-08T00:34:23.923052+0000","last_peered":"2023-10-08T00:34:23.923052+0000","last_clean":"2023-10-08T00:34:23.923052+0000","last_became_active":"2023-10-08T00:34:23.914760+0000","last_became_peered":"2023-10-08T00:34:23.914760+0000","last_unstale":"2023-10-08T00:34:23.923052+0000","last_undegraded":"2023-10-08T00:34:23.923052+0000","last_fullsized":"2023-10-08T00:34:23.923052+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:03.989990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671671+0000","last_change":"2023-10-08T00:34:24.671671+0000","last_active":"2023-10-08T00:34:24.671671+0000","last_peered":"2023-10-08T00:34:24.671671+0000","last_clean":"2023-10-08T00:34:24.671671+0000","last_became_active":"2023-10-08T00:34:24.670709+0000","last_became_peered":"2023-10-08T00:34:24.670709+0000","last_unstale":"2023-10-08T00:34:24.671671+0000","last_undegraded":"2023-10-08T00:34:24.671671+0000","last_fullsized":"2023-10-08T00:34:24.671671+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:11:42.530959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.917829+0000","last_change":"2023-10-08T00:34:23.922509+0000","last_active":"2023-10-08T00:34:24.917829+0000","last_peered":"2023-10-08T00:34:24.917829+0000","last_clean":"2023-10-08T00:34:24.917829+0000","last_became_active":"2023-10-08T00:34:23.922303+0000","last_became_peered":"2023-10-08T00:34:23.922303+0000","last_unstale":"2023-10-08T00:34:24.917829+0000","last_undegraded":"2023-10-08T00:34:24.917829+0000","last_fullsized":"2023-10-08T00:34:24.917829+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:04.625601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674470+0000","last_change":"2023-10-08T00:34:24.674470+0000","last_active":"2023-10-08T00:34:24.674470+0000","last_peered":"2023-10-08T00:34:24.674470+0000","last_clean":"2023-10-08T00:34:24.674470+0000","last_became_active":"2023-10-08T00:34:24.674206+0000","last_became_peered":"2023-10-08T00:34:24.674206+0000","last_unstale":"2023-10-08T00:34:24.674470+0000","last_undegraded":"2023-10-08T00:34:24.674470+0000","last_fullsized":"2023-10-08T00:34:24.674470+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:36:16.555002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.918645+0000","last_change":"2023-10-08T00:34:23.917355+0000","last_active":"2023-10-08T00:34:23.918645+0000","last_peered":"2023-10-08T00:34:23.918645+0000","last_clean":"2023-10-08T00:34:23.918645+0000","last_became_active":"2023-10-08T00:34:23.916943+0000","last_became_peered":"2023-10-08T00:34:23.916943+0000","last_unstale":"2023-10-08T00:34:23.918645+0000","last_undegraded":"2023-10-08T00:34:23.918645+0000","last_fullsized":"2023-10-08T00:34:23.918645+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:59:56.324897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.679774+0000","last_change":"2023-10-08T00:34:24.679774+0000","last_active":"2023-10-08T00:34:24.679774+0000","last_peered":"2023-10-08T00:34:24.679774+0000","last_clean":"2023-10-08T00:34:24.679774+0000","last_became_active":"2023-10-08T00:34:24.677029+0000","last_became_peered":"2023-10-08T00:34:24.677029+0000","last_unstale":"2023-10-08T00:34:24.679774+0000","last_undegraded":"2023-10-08T00:34:24.679774+0000","last_fullsized":"2023-10-08T00:34:24.679774+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:20:59.894660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917150+0000","last_change":"2023-10-08T00:34:23.914170+0000","last_active":"2023-10-08T00:34:23.917150+0000","last_peered":"2023-10-08T00:34:23.917150+0000","last_clean":"2023-10-08T00:34:23.917150+0000","last_became_active":"2023-10-08T00:34:23.913922+0000","last_became_peered":"2023-10-08T00:34:23.913922+0000","last_unstale":"2023-10-08T00:34:23.917150+0000","last_undegraded":"2023-10-08T00:34:23.917150+0000","last_fullsized":"2023-10-08T00:34:23.917150+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:50:36.759775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675155+0000","last_change":"2023-10-08T00:34:24.675155+0000","last_active":"2023-10-08T00:34:24.675155+0000","last_peered":"2023-10-08T00:34:24.675155+0000","last_clean":"2023-10-08T00:34:24.675155+0000","last_became_active":"2023-10-08T00:34:24.674822+0000","last_became_peered":"2023-10-08T00:34:24.674822+0000","last_unstale":"2023-10-08T00:34:24.675155+0000","last_undegraded":"2023-10-08T00:34:24.675155+0000","last_fullsized":"2023-10-08T00:34:24.675155+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:21.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.915806+0000","last_change":"2023-10-08T00:34:23.913664+0000","last_active":"2023-10-08T00:34:23.915806+0000","last_peered":"2023-10-08T00:34:23.915806+0000","last_clean":"2023-10-08T00:34:23.915806+0000","last_became_active":"2023-10-08T00:34:23.913319+0000","last_became_peered":"2023-10-08T00:34:23.913319+0000","last_unstale":"2023-10-08T00:34:23.915806+0000","last_undegraded":"2023-10-08T00:34:23.915806+0000","last_fullsized":"2023-10-08T00:34:23.915806+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:37:01.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672915+0000","last_change":"2023-10-08T00:34:24.672915+0000","last_active":"2023-10-08T00:34:24.672915+0000","last_peered":"2023-10-08T00:34:24.672915+0000","last_clean":"2023-10-08T00:34:24.672915+0000","last_became_active":"2023-10-08T00:34:24.672640+0000","last_became_peered":"2023-10-08T00:34:24.672640+0000","last_unstale":"2023-10-08T00:34:24.672915+0000","last_undegraded":"2023-10-08T00:34:24.672915+0000","last_fullsized":"2023-10-08T00:34:24.672915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:41.188833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.915662+0000","last_change":"2023-10-08T00:34:23.913061+0000","last_active":"2023-10-08T00:34:23.915662+0000","last_peered":"2023-10-08T00:34:23.915662+0000","last_clean":"2023-10-08T00:34:23.915662+0000","last_became_active":"2023-10-08T00:34:23.912809+0000","last_became_peered":"2023-10-08T00:34:23.912809+0000","last_unstale":"2023-10-08T00:34:23.915662+0000","last_undegraded":"2023-10-08T00:34:23.915662+0000","last_fullsized":"2023-10-08T00:34:23.915662+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:08.104864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676259+0000","last_change":"2023-10-08T00:34:24.676259+0000","last_active":"2023-10-08T00:34:24.676259+0000","last_peered":"2023-10-08T00:34:24.676259+0000","last_clean":"2023-10-08T00:34:24.676259+0000","last_became_active":"2023-10-08T00:34:24.675810+0000","last_became_peered":"2023-10-08T00:34:24.675810+0000","last_unstale":"2023-10-08T00:34:24.676259+0000","last_undegraded":"2023-10-08T00:34:24.676259+0000","last_fullsized":"2023-10-08T00:34:24.676259+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:02.468634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.921707+0000","last_change":"2023-10-08T00:34:23.920509+0000","last_active":"2023-10-08T00:34:23.921707+0000","last_peered":"2023-10-08T00:34:23.921707+0000","last_clean":"2023-10-08T00:34:23.921707+0000","last_became_active":"2023-10-08T00:34:23.920225+0000","last_became_peered":"2023-10-08T00:34:23.920225+0000","last_unstale":"2023-10-08T00:34:23.921707+0000","last_undegraded":"2023-10-08T00:34:23.921707+0000","last_fullsized":"2023-10-08T00:34:23.921707+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:47.780856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674334+0000","last_change":"2023-10-08T00:34:24.674334+0000","last_active":"2023-10-08T00:34:24.674334+0000","last_peered":"2023-10-08T00:34:24.674334+0000","last_clean":"2023-10-08T00:34:24.674334+0000","last_became_active":"2023-10-08T00:34:24.674076+0000","last_became_peered":"2023-10-08T00:34:24.674076+0000","last_unstale":"2023-10-08T00:34:24.674334+0000","last_undegraded":"2023-10-08T00:34:24.674334+0000","last_fullsized":"2023-10-08T00:34:24.674334+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:04:33.103286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.915866+0000","last_change":"2023-10-08T00:34:23.912410+0000","last_active":"2023-10-08T00:34:23.915866+0000","last_peered":"2023-10-08T00:34:23.915866+0000","last_clean":"2023-10-08T00:34:23.915866+0000","last_became_active":"2023-10-08T00:34:23.912037+0000","last_became_peered":"2023-10-08T00:34:23.912037+0000","last_unstale":"2023-10-08T00:34:23.915866+0000","last_undegraded":"2023-10-08T00:34:23.915866+0000","last_fullsized":"2023-10-08T00:34:23.915866+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:09.922100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678985+0000","last_change":"2023-10-08T00:34:24.678985+0000","last_active":"2023-10-08T00:34:24.678985+0000","last_peered":"2023-10-08T00:34:24.678985+0000","last_clean":"2023-10-08T00:34:24.678985+0000","last_became_active":"2023-10-08T00:34:24.678704+0000","last_became_peered":"2023-10-08T00:34:24.678704+0000","last_unstale":"2023-10-08T00:34:24.678985+0000","last_undegraded":"2023-10-08T00:34:24.678985+0000","last_fullsized":"2023-10-08T00:34:24.678985+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:18:58.408530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917408+0000","last_change":"2023-10-08T00:34:23.915426+0000","last_active":"2023-10-08T00:34:23.917408+0000","last_peered":"2023-10-08T00:34:23.917408+0000","last_clean":"2023-10-08T00:34:23.917408+0000","last_became_active":"2023-10-08T00:34:23.914919+0000","last_became_peered":"2023-10-08T00:34:23.914919+0000","last_unstale":"2023-10-08T00:34:23.917408+0000","last_undegraded":"2023-10-08T00:34:23.917408+0000","last_fullsized":"2023-10-08T00:34:23.917408+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:05.305697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678161+0000","last_change":"2023-10-08T00:34:24.678161+0000","last_active":"2023-10-08T00:34:24.678161+0000","last_peered":"2023-10-08T00:34:24.678161+0000","last_clean":"2023-10-08T00:34:24.678161+0000","last_became_active":"2023-10-08T00:34:24.677084+0000","last_became_peered":"2023-10-08T00:34:24.677084+0000","last_unstale":"2023-10-08T00:34:24.678161+0000","last_undegraded":"2023-10-08T00:34:24.678161+0000","last_fullsized":"2023-10-08T00:34:24.678161+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:40.636784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":314,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.916438+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:34:23.916438+0000","last_peered":"2023-10-08T00:34:23.916438+0000","last_clean":"2023-10-08T00:34:23.916438+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:34:23.916438+0000","last_undegraded":"2023-10-08T00:34:23.916438+0000","last_fullsized":"2023-10-08T00:34:23.916438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304448,"kb_used_data":3064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067392,"statfs":{"total":96636764160,"available":96325009408,"internally_reserved":0,"allocated":3137536,"data_stored":1735352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"min":{"1min":0.372,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.42399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.66400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82599999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.502},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.70699999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.875,"15min":0.875},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.46100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.434,"5min":0.254,"15min":0.254},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80700000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39800000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79000000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":1.048},"last":0.38800000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59099999999999997,"15min":0.61799999999999999},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.44500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.502},"min":{"1min":0.32900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.62,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.497},{"interface":"front","average":{"1min":0.498,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68700000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65600000000000003,"5min":0.97299999999999998,"15min":1.145},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.70299999999999996,"15min":0.873},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.90400000000000003,"15min":1.079},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71799999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73399999999999999,"5min":1.496,"15min":1.496},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":1.02,"15min":1.1160000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69699999999999995,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.309},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.755,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.39800000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.82399999999999995,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.629},"min":{"1min":0.46300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.20899999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.53200000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.35199999999999998},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.52200000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.65500000000000003},"last":0.308},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.372,"15min":0.377},"min":{"1min":0.27200000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.628},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.91900000000000004,"5min":1.218,"15min":1.218},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.52500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":1.121,"5min":1.121,"15min":1.294},"last":0.442},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65500000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":1.1319999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.47699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.1120000000000001,"5min":1.278,"15min":1.278},"last":0.42999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":1.087},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308560,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063280,"statfs":{"total":96636764160,"available":96320798720,"internally_reserved":0,"allocated":3153920,"data_stored":1742185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48599999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.629},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.28599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.378,"15min":0.378},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.39100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.37,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.45700000000000002,"5min":0.749,"15min":0.749},"last":0.439},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.255},"max":{"1min":0.53400000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.242},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.627,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.56499999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92900000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.84499999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.34100000000000003},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46800000000000003,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34599999999999997,"15min":0.373},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.36699999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48199999999999998,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.36699999999999999,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.371},"min":{"1min":0.248,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.44,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.42099999999999999},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57199999999999995,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.59299999999999997,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.66000000000000003},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.83099999999999996,"5min":0.91900000000000004,"15min":1.278},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.79600000000000004,"5min":0.87,"15min":1.137},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78000000000000003,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.42699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.75800000000000001,"5min":0.94299999999999995,"15min":1.343},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303884,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067956,"statfs":{"total":96636764160,"available":96325586944,"internally_reserved":0,"allocated":2560000,"data_stored":1151837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53200000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36299999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.34599999999999997},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.501,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.5,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.248},"max":{"1min":0.55200000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.443},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.64400000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.434,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":1.47,"15min":1.47},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.35899999999999999},"max":{"1min":0.76700000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.626,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.385,"15min":1.385},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83099999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.996,"15min":0.996},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85399999999999998,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.66700000000000004,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72299999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.21,"15min":1.21},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65200000000000002,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.72599999999999998,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.621},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.82499999999999996,"15min":0.873},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.28100000000000003},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.002},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.56899999999999995},"min":{"1min":0.371,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.41599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.47599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303884,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067956,"statfs":{"total":96636764160,"available":96325586944,"internally_reserved":0,"allocated":2560000,"data_stored":1151817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.434},{"interface":"front","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.59599999999999997},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.55000000000000004},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75700000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.70999999999999996,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.623,"15min":0.58099999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.64200000000000002},"min":{"1min":0.42599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":2.4870000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73999999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.626},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.503,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.753,"15min":0.80100000000000005},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.58399999999999996},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:34:29.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:34:29.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.167+0000 7f274c7a1700 1 Processor -- start 2023-10-08T00:34:29.168 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.168+0000 7f274c7a1700 1 -- start start 2023-10-08T00:34:29.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.168+0000 7f274c7a1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2744159890 0x7f274415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.168+0000 7f274c7a1700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2744159c60 0x7f274415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.168+0000 7f274c7a1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274415a160 con 0x7f274415db10 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.168+0000 7f274c7a1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274415df50 con 0x7f2744159890 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274c7a1700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440d13a0 con 0x7f2744159c60 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274a53d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2744159890 0x7f274415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274ad3e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f274415db10 0x7f2744069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54738/0 (socket says 172.21.15.22:54738) 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274ad3e700 1 -- 172.21.15.22:0/2648341086 learned_addr learned my addr 172.21.15.22:0/2648341086 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f2749d3c700 1 --2- 172.21.15.22:0/2648341086 >> v2:172.21.15.192:3300/0 conn(0x7f2744159c60 0x7f274415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274953b700 1 -- 172.21.15.22:0/2648341086 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111039809 0 0) 0x7f274415a160 con 0x7f274415db10 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274a53d700 1 -- 172.21.15.22:0/2648341086 >> v2:172.21.15.192:3300/0 conn(0x7f2744159c60 msgr2=0x7f274415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:29.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274a53d700 1 --2- 172.21.15.22:0/2648341086 >> v2:172.21.15.192:3300/0 conn(0x7f2744159c60 0x7f274415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274a53d700 1 -- 172.21.15.22:0/2648341086 >> v1:172.21.15.22:6789/0 conn(0x7f274415db10 legacy=0x7f2744069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274a53d700 1 -- 172.21.15.22:0/2648341086 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274415e140 con 0x7f2744159890 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274a53d700 1 --2- 172.21.15.22:0/2648341086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274415abd0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f27440b67f0 tx=0x7f273c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65239313f08d6fc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274953b700 1 -- 172.21.15.22:0/2648341086 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c011630 con 0x7f2744159890 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274953b700 1 -- 172.21.15.22:0/2648341086 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c011790 con 0x7f2744159890 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.169+0000 7f274953b700 1 -- 172.21.15.22:0/2648341086 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c011b30 con 0x7f2744159890 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 -- 172.21.15.22:0/2648341086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 msgr2=0x7f274415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 --2- 172.21.15.22:0/2648341086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274415abd0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f27440b67f0 tx=0x7f273c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 -- 172.21.15.22:0/2648341086 shutdown_connections 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 --2- 172.21.15.22:0/2648341086 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274415abd0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 --2- 172.21.15.22:0/2648341086 >> v2:172.21.15.192:3300/0 conn(0x7f2744159c60 0x7f274415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.172 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 -- 172.21.15.22:0/2648341086 >> 172.21.15.22:0/2648341086 conn(0x7f2744068e20 msgr2=0x7f27440d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:29.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 -- 172.21.15.22:0/2648341086 shutdown_connections 2023-10-08T00:34:29.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.170+0000 7f274c7a1700 1 -- 172.21.15.22:0/2648341086 wait complete. 2023-10-08T00:34:29.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.171+0000 7f274c7a1700 1 Processor -- start 2023-10-08T00:34:29.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.171+0000 7f274c7a1700 1 -- start start 2023-10-08T00:34:29.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274c7a1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274c7a1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2744159c60 0x7f27440cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274c7a1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f274415db10 0x7f27440cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274c7a1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440b5090 con 0x7f2744159890 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274c7a1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440b4480 con 0x7f2744159c60 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274c7a1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27440b4760 con 0x7f274415db10 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274414d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53438/0 (socket says 172.21.15.22:53438) 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 -- 172.21.15.22:0/543151134 learned_addr learned my addr 172.21.15.22:0/543151134 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f2749d3c700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2744159c60 0x7f27440cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274ad3e700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f274415db10 0x7f27440cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 -- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f274415db10 msgr2=0x7f27440cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f274415db10 0x7f27440cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 -- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2744159c60 msgr2=0x7f27440cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2744159c60 0x7f27440cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 -- 172.21.15.22:0/543151134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c009420 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.172+0000 7f274a53d700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274414d270 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f2744070e20 tx=0x7f273c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.173+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c011900 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.173+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c011a60 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.173+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440b4a40 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.173+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c025670 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.173+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274414d7b0 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.173+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274404c3c0 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.174+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f273c023070 con 0x7f2744159890 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.174+0000 7f27427fc700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2730067320 0x7f27300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.174+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f273c0861b0 con 0x7f2744159890 2023-10-08T00:34:29.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.175+0000 7f2749d3c700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2730067320 0x7f27300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.175+0000 7f2749d3c700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2730067320 0x7f27300697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2744157e20 tx=0x7f27380091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.179 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.179+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f273c052e40 con 0x7f2744159890 2023-10-08T00:34:29.371 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.370+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27440b51d0 con 0x7f2730067320 2023-10-08T00:34:29.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.379+0000 7f27427fc700 1 -- 172.21.15.22:0/543151134 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289427 (secure 0 0 0) 0x7f2738011a50 con 0x7f2730067320 2023-10-08T00:34:29.382 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2730067320 msgr2=0x7f27300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2730067320 0x7f27300697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2744157e20 tx=0x7f27380091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 msgr2=0x7f274414d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274414d270 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f2744070e20 tx=0x7f273c017000 comp rx=0 tx=0).stop 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 shutdown_connections 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2730067320 0x7f27300697d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f274415db10 0x7f27440cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2744159890 0x7f274414d270 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 --2- 172.21.15.22:0/543151134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2744159c60 0x7f27440cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 >> 172.21.15.22:0/543151134 conn(0x7f2744068e20 msgr2=0x7f27440b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:29.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 shutdown_connections 2023-10-08T00:34:29.386 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.382+0000 7f274c7a1700 1 -- 172.21.15.22:0/543151134 wait complete. 2023-10-08T00:34:29.386 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:34:29.394 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2023-10-08T00:34:28.519386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440392,"kb_used_data":21128,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752534328,"statfs":{"total":773094113280,"available":770595151872,"internally_reserved":0,"allocated":21635072,"data_stored":10388179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.620325"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675922+0000","last_change":"2023-10-08T00:34:24.675922+0000","last_active":"2023-10-08T00:34:24.675922+0000","last_peered":"2023-10-08T00:34:24.675922+0000","last_clean":"2023-10-08T00:34:24.675922+0000","last_became_active":"2023-10-08T00:34:24.675497+0000","last_became_peered":"2023-10-08T00:34:24.675497+0000","last_unstale":"2023-10-08T00:34:24.675922+0000","last_undegraded":"2023-10-08T00:34:24.675922+0000","last_fullsized":"2023-10-08T00:34:24.675922+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:06:19.234945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671314+0000","last_change":"2023-10-08T00:34:24.671314+0000","last_active":"2023-10-08T00:34:24.671314+0000","last_peered":"2023-10-08T00:34:24.671314+0000","last_clean":"2023-10-08T00:34:24.671314+0000","last_became_active":"2023-10-08T00:34:24.670309+0000","last_became_peered":"2023-10-08T00:34:24.670309+0000","last_unstale":"2023-10-08T00:34:24.671314+0000","last_undegraded":"2023-10-08T00:34:24.671314+0000","last_fullsized":"2023-10-08T00:34:24.671314+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:46:00.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676010+0000","last_change":"2023-10-08T00:34:24.676010+0000","last_active":"2023-10-08T00:34:24.676010+0000","last_peered":"2023-10-08T00:34:24.676010+0000","last_clean":"2023-10-08T00:34:24.676010+0000","last_became_active":"2023-10-08T00:34:24.675749+0000","last_became_peered":"2023-10-08T00:34:24.675749+0000","last_unstale":"2023-10-08T00:34:24.676010+0000","last_undegraded":"2023-10-08T00:34:24.676010+0000","last_fullsized":"2023-10-08T00:34:24.676010+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:37:27.398231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672358+0000","last_change":"2023-10-08T00:34:24.672358+0000","last_active":"2023-10-08T00:34:24.672358+0000","last_peered":"2023-10-08T00:34:24.672358+0000","last_clean":"2023-10-08T00:34:24.672358+0000","last_became_active":"2023-10-08T00:34:24.672065+0000","last_became_peered":"2023-10-08T00:34:24.672065+0000","last_unstale":"2023-10-08T00:34:24.672358+0000","last_undegraded":"2023-10-08T00:34:24.672358+0000","last_fullsized":"2023-10-08T00:34:24.672358+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:15:58.188353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674984+0000","last_change":"2023-10-08T00:34:24.674984+0000","last_active":"2023-10-08T00:34:24.674984+0000","last_peered":"2023-10-08T00:34:24.674984+0000","last_clean":"2023-10-08T00:34:24.674984+0000","last_became_active":"2023-10-08T00:34:24.674693+0000","last_became_peered":"2023-10-08T00:34:24.674693+0000","last_unstale":"2023-10-08T00:34:24.674984+0000","last_undegraded":"2023-10-08T00:34:24.674984+0000","last_fullsized":"2023-10-08T00:34:24.674984+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:12:08.081303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.670582+0000","last_change":"2023-10-08T00:34:24.670582+0000","last_active":"2023-10-08T00:34:24.670582+0000","last_peered":"2023-10-08T00:34:24.670582+0000","last_clean":"2023-10-08T00:34:24.670582+0000","last_became_active":"2023-10-08T00:34:24.670302+0000","last_became_peered":"2023-10-08T00:34:24.670302+0000","last_unstale":"2023-10-08T00:34:24.670582+0000","last_undegraded":"2023-10-08T00:34:24.670582+0000","last_fullsized":"2023-10-08T00:34:24.670582+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:09.156627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676663+0000","last_change":"2023-10-08T00:34:24.676663+0000","last_active":"2023-10-08T00:34:24.676663+0000","last_peered":"2023-10-08T00:34:24.676663+0000","last_clean":"2023-10-08T00:34:24.676663+0000","last_became_active":"2023-10-08T00:34:24.676388+0000","last_became_peered":"2023-10-08T00:34:24.676388+0000","last_unstale":"2023-10-08T00:34:24.676663+0000","last_undegraded":"2023-10-08T00:34:24.676663+0000","last_fullsized":"2023-10-08T00:34:24.676663+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:09.109423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674032+0000","last_change":"2023-10-08T00:34:24.674032+0000","last_active":"2023-10-08T00:34:24.674032+0000","last_peered":"2023-10-08T00:34:24.674032+0000","last_clean":"2023-10-08T00:34:24.674032+0000","last_became_active":"2023-10-08T00:34:24.673802+0000","last_became_peered":"2023-10-08T00:34:24.673802+0000","last_unstale":"2023-10-08T00:34:24.674032+0000","last_undegraded":"2023-10-08T00:34:24.674032+0000","last_fullsized":"2023-10-08T00:34:24.674032+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:23.453754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675985+0000","last_change":"2023-10-08T00:34:24.675985+0000","last_active":"2023-10-08T00:34:24.675985+0000","last_peered":"2023-10-08T00:34:24.675985+0000","last_clean":"2023-10-08T00:34:24.675985+0000","last_became_active":"2023-10-08T00:34:24.675742+0000","last_became_peered":"2023-10-08T00:34:24.675742+0000","last_unstale":"2023-10-08T00:34:24.675985+0000","last_undegraded":"2023-10-08T00:34:24.675985+0000","last_fullsized":"2023-10-08T00:34:24.675985+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:14:45.029174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.679936+0000","last_change":"2023-10-08T00:34:24.679936+0000","last_active":"2023-10-08T00:34:24.679936+0000","last_peered":"2023-10-08T00:34:24.679936+0000","last_clean":"2023-10-08T00:34:24.679936+0000","last_became_active":"2023-10-08T00:34:24.679646+0000","last_became_peered":"2023-10-08T00:34:24.679646+0000","last_unstale":"2023-10-08T00:34:24.679936+0000","last_undegraded":"2023-10-08T00:34:24.679936+0000","last_fullsized":"2023-10-08T00:34:24.679936+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:34:43.891403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675136+0000","last_change":"2023-10-08T00:34:24.675136+0000","last_active":"2023-10-08T00:34:24.675136+0000","last_peered":"2023-10-08T00:34:24.675136+0000","last_clean":"2023-10-08T00:34:24.675136+0000","last_became_active":"2023-10-08T00:34:24.672944+0000","last_became_peered":"2023-10-08T00:34:24.672944+0000","last_unstale":"2023-10-08T00:34:24.675136+0000","last_undegraded":"2023-10-08T00:34:24.675136+0000","last_fullsized":"2023-10-08T00:34:24.675136+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:12:52.369917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.673716+0000","last_change":"2023-10-08T00:34:24.673716+0000","last_active":"2023-10-08T00:34:24.673716+0000","last_peered":"2023-10-08T00:34:24.673716+0000","last_clean":"2023-10-08T00:34:24.673716+0000","last_became_active":"2023-10-08T00:34:24.673263+0000","last_became_peered":"2023-10-08T00:34:24.673263+0000","last_unstale":"2023-10-08T00:34:24.673716+0000","last_undegraded":"2023-10-08T00:34:24.673716+0000","last_fullsized":"2023-10-08T00:34:24.673716+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:37:46.206707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678215+0000","last_change":"2023-10-08T00:34:24.678215+0000","last_active":"2023-10-08T00:34:24.678215+0000","last_peered":"2023-10-08T00:34:24.678215+0000","last_clean":"2023-10-08T00:34:24.678215+0000","last_became_active":"2023-10-08T00:34:24.677895+0000","last_became_peered":"2023-10-08T00:34:24.677895+0000","last_unstale":"2023-10-08T00:34:24.678215+0000","last_undegraded":"2023-10-08T00:34:24.678215+0000","last_fullsized":"2023-10-08T00:34:24.678215+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:51:16.843704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678822+0000","last_change":"2023-10-08T00:34:24.678822+0000","last_active":"2023-10-08T00:34:24.678822+0000","last_peered":"2023-10-08T00:34:24.678822+0000","last_clean":"2023-10-08T00:34:24.678822+0000","last_became_active":"2023-10-08T00:34:24.678557+0000","last_became_peered":"2023-10-08T00:34:24.678557+0000","last_unstale":"2023-10-08T00:34:24.678822+0000","last_undegraded":"2023-10-08T00:34:24.678822+0000","last_fullsized":"2023-10-08T00:34:24.678822+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:17:47.503356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677650+0000","last_change":"2023-10-08T00:34:24.677650+0000","last_active":"2023-10-08T00:34:24.677650+0000","last_peered":"2023-10-08T00:34:24.677650+0000","last_clean":"2023-10-08T00:34:24.677650+0000","last_became_active":"2023-10-08T00:34:24.677406+0000","last_became_peered":"2023-10-08T00:34:24.677406+0000","last_unstale":"2023-10-08T00:34:24.677650+0000","last_undegraded":"2023-10-08T00:34:24.677650+0000","last_fullsized":"2023-10-08T00:34:24.677650+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:18:32.313511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675969+0000","last_change":"2023-10-08T00:34:24.675969+0000","last_active":"2023-10-08T00:34:24.675969+0000","last_peered":"2023-10-08T00:34:24.675969+0000","last_clean":"2023-10-08T00:34:24.675969+0000","last_became_active":"2023-10-08T00:34:24.675593+0000","last_became_peered":"2023-10-08T00:34:24.675593+0000","last_unstale":"2023-10-08T00:34:24.675969+0000","last_undegraded":"2023-10-08T00:34:24.675969+0000","last_fullsized":"2023-10-08T00:34:24.675969+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:43:44.737824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675479+0000","last_change":"2023-10-08T00:34:24.675479+0000","last_active":"2023-10-08T00:34:24.675479+0000","last_peered":"2023-10-08T00:34:24.675479+0000","last_clean":"2023-10-08T00:34:24.675479+0000","last_became_active":"2023-10-08T00:34:24.675172+0000","last_became_peered":"2023-10-08T00:34:24.675172+0000","last_unstale":"2023-10-08T00:34:24.675479+0000","last_undegraded":"2023-10-08T00:34:24.675479+0000","last_fullsized":"2023-10-08T00:34:24.675479+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:20:07.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671000+0000","last_change":"2023-10-08T00:34:24.671000+0000","last_active":"2023-10-08T00:34:24.671000+0000","last_peered":"2023-10-08T00:34:24.671000+0000","last_clean":"2023-10-08T00:34:24.671000+0000","last_became_active":"2023-10-08T00:34:24.670702+0000","last_became_peered":"2023-10-08T00:34:24.670702+0000","last_unstale":"2023-10-08T00:34:24.671000+0000","last_undegraded":"2023-10-08T00:34:24.671000+0000","last_fullsized":"2023-10-08T00:34:24.671000+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:33:33.491556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678277+0000","last_change":"2023-10-08T00:34:24.678277+0000","last_active":"2023-10-08T00:34:24.678277+0000","last_peered":"2023-10-08T00:34:24.678277+0000","last_clean":"2023-10-08T00:34:24.678277+0000","last_became_active":"2023-10-08T00:34:24.678003+0000","last_became_peered":"2023-10-08T00:34:24.678003+0000","last_unstale":"2023-10-08T00:34:24.678277+0000","last_undegraded":"2023-10-08T00:34:24.678277+0000","last_fullsized":"2023-10-08T00:34:24.678277+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:22:26.105813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671530+0000","last_change":"2023-10-08T00:34:24.671530+0000","last_active":"2023-10-08T00:34:24.671530+0000","last_peered":"2023-10-08T00:34:24.671530+0000","last_clean":"2023-10-08T00:34:24.671530+0000","last_became_active":"2023-10-08T00:34:24.670341+0000","last_became_peered":"2023-10-08T00:34:24.670341+0000","last_unstale":"2023-10-08T00:34:24.671530+0000","last_undegraded":"2023-10-08T00:34:24.671530+0000","last_fullsized":"2023-10-08T00:34:24.671530+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:29:35.893717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675373+0000","last_change":"2023-10-08T00:34:24.675373+0000","last_active":"2023-10-08T00:34:24.675373+0000","last_peered":"2023-10-08T00:34:24.675373+0000","last_clean":"2023-10-08T00:34:24.675373+0000","last_became_active":"2023-10-08T00:34:24.674968+0000","last_became_peered":"2023-10-08T00:34:24.674968+0000","last_unstale":"2023-10-08T00:34:24.675373+0000","last_undegraded":"2023-10-08T00:34:24.675373+0000","last_fullsized":"2023-10-08T00:34:24.675373+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:30.402121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.680189+0000","last_change":"2023-10-08T00:34:24.680189+0000","last_active":"2023-10-08T00:34:24.680189+0000","last_peered":"2023-10-08T00:34:24.680189+0000","last_clean":"2023-10-08T00:34:24.680189+0000","last_became_active":"2023-10-08T00:34:24.679908+0000","last_became_peered":"2023-10-08T00:34:24.679908+0000","last_unstale":"2023-10-08T00:34:24.680189+0000","last_undegraded":"2023-10-08T00:34:24.680189+0000","last_fullsized":"2023-10-08T00:34:24.680189+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:22:57.189521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676084+0000","last_change":"2023-10-08T00:34:24.676084+0000","last_active":"2023-10-08T00:34:24.676084+0000","last_peered":"2023-10-08T00:34:24.676084+0000","last_clean":"2023-10-08T00:34:24.676084+0000","last_became_active":"2023-10-08T00:34:24.675237+0000","last_became_peered":"2023-10-08T00:34:24.675237+0000","last_unstale":"2023-10-08T00:34:24.676084+0000","last_undegraded":"2023-10-08T00:34:24.676084+0000","last_fullsized":"2023-10-08T00:34:24.676084+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:15:42.113958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.668780+0000","last_change":"2023-10-08T00:34:24.668780+0000","last_active":"2023-10-08T00:34:24.668780+0000","last_peered":"2023-10-08T00:34:24.668780+0000","last_clean":"2023-10-08T00:34:24.668780+0000","last_became_active":"2023-10-08T00:34:24.668496+0000","last_became_peered":"2023-10-08T00:34:24.668496+0000","last_unstale":"2023-10-08T00:34:24.668780+0000","last_undegraded":"2023-10-08T00:34:24.668780+0000","last_fullsized":"2023-10-08T00:34:24.668780+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:34.623264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.670741+0000","last_change":"2023-10-08T00:34:24.670741+0000","last_active":"2023-10-08T00:34:24.670741+0000","last_peered":"2023-10-08T00:34:24.670741+0000","last_clean":"2023-10-08T00:34:24.670741+0000","last_became_active":"2023-10-08T00:34:24.670446+0000","last_became_peered":"2023-10-08T00:34:24.670446+0000","last_unstale":"2023-10-08T00:34:24.670741+0000","last_undegraded":"2023-10-08T00:34:24.670741+0000","last_fullsized":"2023-10-08T00:34:24.670741+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:12:05.004645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677253+0000","last_change":"2023-10-08T00:34:24.677253+0000","last_active":"2023-10-08T00:34:24.677253+0000","last_peered":"2023-10-08T00:34:24.677253+0000","last_clean":"2023-10-08T00:34:24.677253+0000","last_became_active":"2023-10-08T00:34:24.676908+0000","last_became_peered":"2023-10-08T00:34:24.676908+0000","last_unstale":"2023-10-08T00:34:24.677253+0000","last_undegraded":"2023-10-08T00:34:24.677253+0000","last_fullsized":"2023-10-08T00:34:24.677253+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:28:19.245923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677994+0000","last_change":"2023-10-08T00:34:24.677994+0000","last_active":"2023-10-08T00:34:24.677994+0000","last_peered":"2023-10-08T00:34:24.677994+0000","last_clean":"2023-10-08T00:34:24.677994+0000","last_became_active":"2023-10-08T00:34:24.677709+0000","last_became_peered":"2023-10-08T00:34:24.677709+0000","last_unstale":"2023-10-08T00:34:24.677994+0000","last_undegraded":"2023-10-08T00:34:24.677994+0000","last_fullsized":"2023-10-08T00:34:24.677994+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:35:19.836923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674625+0000","last_change":"2023-10-08T00:34:24.674625+0000","last_active":"2023-10-08T00:34:24.674625+0000","last_peered":"2023-10-08T00:34:24.674625+0000","last_clean":"2023-10-08T00:34:24.674625+0000","last_became_active":"2023-10-08T00:34:24.674273+0000","last_became_peered":"2023-10-08T00:34:24.674273+0000","last_unstale":"2023-10-08T00:34:24.674625+0000","last_undegraded":"2023-10-08T00:34:24.674625+0000","last_fullsized":"2023-10-08T00:34:24.674625+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:03:15.732459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.677683+0000","last_change":"2023-10-08T00:34:24.677683+0000","last_active":"2023-10-08T00:34:24.677683+0000","last_peered":"2023-10-08T00:34:24.677683+0000","last_clean":"2023-10-08T00:34:24.677683+0000","last_became_active":"2023-10-08T00:34:24.677347+0000","last_became_peered":"2023-10-08T00:34:24.677347+0000","last_unstale":"2023-10-08T00:34:24.677683+0000","last_undegraded":"2023-10-08T00:34:24.677683+0000","last_fullsized":"2023-10-08T00:34:24.677683+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:23:02.487928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675552+0000","last_change":"2023-10-08T00:34:24.675552+0000","last_active":"2023-10-08T00:34:24.675552+0000","last_peered":"2023-10-08T00:34:24.675552+0000","last_clean":"2023-10-08T00:34:24.675552+0000","last_became_active":"2023-10-08T00:34:24.674888+0000","last_became_peered":"2023-10-08T00:34:24.674888+0000","last_unstale":"2023-10-08T00:34:24.675552+0000","last_undegraded":"2023-10-08T00:34:24.675552+0000","last_fullsized":"2023-10-08T00:34:24.675552+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:59:43.043875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.669187+0000","last_change":"2023-10-08T00:34:24.669187+0000","last_active":"2023-10-08T00:34:24.669187+0000","last_peered":"2023-10-08T00:34:24.669187+0000","last_clean":"2023-10-08T00:34:24.669187+0000","last_became_active":"2023-10-08T00:34:24.668985+0000","last_became_peered":"2023-10-08T00:34:24.668985+0000","last_unstale":"2023-10-08T00:34:24.669187+0000","last_undegraded":"2023-10-08T00:34:24.669187+0000","last_fullsized":"2023-10-08T00:34:24.669187+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:17:13.412317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.673303+0000","last_change":"2023-10-08T00:34:24.673303+0000","last_active":"2023-10-08T00:34:24.673303+0000","last_peered":"2023-10-08T00:34:24.673303+0000","last_clean":"2023-10-08T00:34:24.673303+0000","last_became_active":"2023-10-08T00:34:24.673012+0000","last_became_peered":"2023-10-08T00:34:24.673012+0000","last_unstale":"2023-10-08T00:34:24.673303+0000","last_undegraded":"2023-10-08T00:34:24.673303+0000","last_fullsized":"2023-10-08T00:34:24.673303+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:10:41.634748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"201'4","reported_seq":13,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.920095+0000","last_change":"2023-10-08T00:34:23.917685+0000","last_active":"2023-10-08T00:34:24.920095+0000","last_peered":"2023-10-08T00:34:24.920095+0000","last_clean":"2023-10-08T00:34:24.920095+0000","last_became_active":"2023-10-08T00:34:23.917388+0000","last_became_peered":"2023-10-08T00:34:23.917388+0000","last_unstale":"2023-10-08T00:34:24.920095+0000","last_undegraded":"2023-10-08T00:34:24.920095+0000","last_fullsized":"2023-10-08T00:34:24.920095+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:13:08.625401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.666347+0000","last_change":"2023-10-08T00:34:24.666347+0000","last_active":"2023-10-08T00:34:24.666347+0000","last_peered":"2023-10-08T00:34:24.666347+0000","last_clean":"2023-10-08T00:34:24.666347+0000","last_became_active":"2023-10-08T00:34:24.666053+0000","last_became_peered":"2023-10-08T00:34:24.666053+0000","last_unstale":"2023-10-08T00:34:24.666347+0000","last_undegraded":"2023-10-08T00:34:24.666347+0000","last_fullsized":"2023-10-08T00:34:24.666347+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:01:05.045792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672876+0000","last_change":"2023-10-08T00:34:23.914036+0000","last_active":"2023-10-08T00:34:24.672876+0000","last_peered":"2023-10-08T00:34:24.672876+0000","last_clean":"2023-10-08T00:34:24.672876+0000","last_became_active":"2023-10-08T00:34:23.913728+0000","last_became_peered":"2023-10-08T00:34:23.913728+0000","last_unstale":"2023-10-08T00:34:24.672876+0000","last_undegraded":"2023-10-08T00:34:24.672876+0000","last_fullsized":"2023-10-08T00:34:24.672876+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:03:14.727899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672930+0000","last_change":"2023-10-08T00:34:24.672930+0000","last_active":"2023-10-08T00:34:24.672930+0000","last_peered":"2023-10-08T00:34:24.672930+0000","last_clean":"2023-10-08T00:34:24.672930+0000","last_became_active":"2023-10-08T00:34:24.672587+0000","last_became_peered":"2023-10-08T00:34:24.672587+0000","last_unstale":"2023-10-08T00:34:24.672930+0000","last_undegraded":"2023-10-08T00:34:24.672930+0000","last_fullsized":"2023-10-08T00:34:24.672930+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:50:09.378616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.918124+0000","last_change":"2023-10-08T00:34:23.917828+0000","last_active":"2023-10-08T00:34:24.918124+0000","last_peered":"2023-10-08T00:34:24.918124+0000","last_clean":"2023-10-08T00:34:24.918124+0000","last_became_active":"2023-10-08T00:34:23.915221+0000","last_became_peered":"2023-10-08T00:34:23.915221+0000","last_unstale":"2023-10-08T00:34:24.918124+0000","last_undegraded":"2023-10-08T00:34:24.918124+0000","last_fullsized":"2023-10-08T00:34:24.918124+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:24:56.533987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.673008+0000","last_change":"2023-10-08T00:34:24.673008+0000","last_active":"2023-10-08T00:34:24.673008+0000","last_peered":"2023-10-08T00:34:24.673008+0000","last_clean":"2023-10-08T00:34:24.673008+0000","last_became_active":"2023-10-08T00:34:24.672664+0000","last_became_peered":"2023-10-08T00:34:24.672664+0000","last_unstale":"2023-10-08T00:34:24.673008+0000","last_undegraded":"2023-10-08T00:34:24.673008+0000","last_fullsized":"2023-10-08T00:34:24.673008+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:45:23.453754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.917446+0000","last_change":"2023-10-08T00:34:23.918854+0000","last_active":"2023-10-08T00:34:24.917446+0000","last_peered":"2023-10-08T00:34:24.917446+0000","last_clean":"2023-10-08T00:34:24.917446+0000","last_became_active":"2023-10-08T00:34:23.918563+0000","last_became_peered":"2023-10-08T00:34:23.918563+0000","last_unstale":"2023-10-08T00:34:24.917446+0000","last_undegraded":"2023-10-08T00:34:24.917446+0000","last_fullsized":"2023-10-08T00:34:24.917446+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:09:33.618705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671195+0000","last_change":"2023-10-08T00:34:24.671195+0000","last_active":"2023-10-08T00:34:24.671195+0000","last_peered":"2023-10-08T00:34:24.671195+0000","last_clean":"2023-10-08T00:34:24.671195+0000","last_became_active":"2023-10-08T00:34:24.670203+0000","last_became_peered":"2023-10-08T00:34:24.670203+0000","last_unstale":"2023-10-08T00:34:24.671195+0000","last_undegraded":"2023-10-08T00:34:24.671195+0000","last_fullsized":"2023-10-08T00:34:24.671195+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:09:00.567932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.660689+0000","last_change":"2023-10-08T00:34:23.919378+0000","last_active":"2023-10-08T00:34:24.660689+0000","last_peered":"2023-10-08T00:34:24.660689+0000","last_clean":"2023-10-08T00:34:24.660689+0000","last_became_active":"2023-10-08T00:34:23.918536+0000","last_became_peered":"2023-10-08T00:34:23.918536+0000","last_unstale":"2023-10-08T00:34:24.660689+0000","last_undegraded":"2023-10-08T00:34:24.660689+0000","last_fullsized":"2023-10-08T00:34:24.660689+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:18.580886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.679916+0000","last_change":"2023-10-08T00:34:24.679916+0000","last_active":"2023-10-08T00:34:24.679916+0000","last_peered":"2023-10-08T00:34:24.679916+0000","last_clean":"2023-10-08T00:34:24.679916+0000","last_became_active":"2023-10-08T00:34:24.679387+0000","last_became_peered":"2023-10-08T00:34:24.679387+0000","last_unstale":"2023-10-08T00:34:24.679916+0000","last_undegraded":"2023-10-08T00:34:24.679916+0000","last_fullsized":"2023-10-08T00:34:24.679916+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:09.852679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672938+0000","last_change":"2023-10-08T00:34:23.923903+0000","last_active":"2023-10-08T00:34:24.672938+0000","last_peered":"2023-10-08T00:34:24.672938+0000","last_clean":"2023-10-08T00:34:24.672938+0000","last_became_active":"2023-10-08T00:34:23.923629+0000","last_became_peered":"2023-10-08T00:34:23.923629+0000","last_unstale":"2023-10-08T00:34:24.672938+0000","last_undegraded":"2023-10-08T00:34:24.672938+0000","last_fullsized":"2023-10-08T00:34:24.672938+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:45:23.040367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.680661+0000","last_change":"2023-10-08T00:34:24.680661+0000","last_active":"2023-10-08T00:34:24.680661+0000","last_peered":"2023-10-08T00:34:24.680661+0000","last_clean":"2023-10-08T00:34:24.680661+0000","last_became_active":"2023-10-08T00:34:24.680418+0000","last_became_peered":"2023-10-08T00:34:24.680418+0000","last_unstale":"2023-10-08T00:34:24.680661+0000","last_undegraded":"2023-10-08T00:34:24.680661+0000","last_fullsized":"2023-10-08T00:34:24.680661+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:30:13.547501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917789+0000","last_change":"2023-10-08T00:34:23.915222+0000","last_active":"2023-10-08T00:34:23.917789+0000","last_peered":"2023-10-08T00:34:23.917789+0000","last_clean":"2023-10-08T00:34:23.917789+0000","last_became_active":"2023-10-08T00:34:23.914924+0000","last_became_peered":"2023-10-08T00:34:23.914924+0000","last_unstale":"2023-10-08T00:34:23.917789+0000","last_undegraded":"2023-10-08T00:34:23.917789+0000","last_fullsized":"2023-10-08T00:34:23.917789+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:16:38.729004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678051+0000","last_change":"2023-10-08T00:34:24.678051+0000","last_active":"2023-10-08T00:34:24.678051+0000","last_peered":"2023-10-08T00:34:24.678051+0000","last_clean":"2023-10-08T00:34:24.678051+0000","last_became_active":"2023-10-08T00:34:24.676432+0000","last_became_peered":"2023-10-08T00:34:24.676432+0000","last_unstale":"2023-10-08T00:34:24.678051+0000","last_undegraded":"2023-10-08T00:34:24.678051+0000","last_fullsized":"2023-10-08T00:34:24.678051+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:37:47.695210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.921329+0000","last_change":"2023-10-08T00:34:23.918979+0000","last_active":"2023-10-08T00:34:23.921329+0000","last_peered":"2023-10-08T00:34:23.921329+0000","last_clean":"2023-10-08T00:34:23.921329+0000","last_became_active":"2023-10-08T00:34:23.918512+0000","last_became_peered":"2023-10-08T00:34:23.918512+0000","last_unstale":"2023-10-08T00:34:23.921329+0000","last_undegraded":"2023-10-08T00:34:23.921329+0000","last_fullsized":"2023-10-08T00:34:23.921329+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:20.211261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672209+0000","last_change":"2023-10-08T00:34:24.672209+0000","last_active":"2023-10-08T00:34:24.672209+0000","last_peered":"2023-10-08T00:34:24.672209+0000","last_clean":"2023-10-08T00:34:24.672209+0000","last_became_active":"2023-10-08T00:34:24.671928+0000","last_became_peered":"2023-10-08T00:34:24.671928+0000","last_unstale":"2023-10-08T00:34:24.672209+0000","last_undegraded":"2023-10-08T00:34:24.672209+0000","last_fullsized":"2023-10-08T00:34:24.672209+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:34:56.451225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923104+0000","last_change":"2023-10-08T00:34:23.917037+0000","last_active":"2023-10-08T00:34:23.923104+0000","last_peered":"2023-10-08T00:34:23.923104+0000","last_clean":"2023-10-08T00:34:23.923104+0000","last_became_active":"2023-10-08T00:34:23.916761+0000","last_became_peered":"2023-10-08T00:34:23.916761+0000","last_unstale":"2023-10-08T00:34:23.923104+0000","last_undegraded":"2023-10-08T00:34:23.923104+0000","last_fullsized":"2023-10-08T00:34:23.923104+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:53:15.507140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672179+0000","last_change":"2023-10-08T00:34:24.672179+0000","last_active":"2023-10-08T00:34:24.672179+0000","last_peered":"2023-10-08T00:34:24.672179+0000","last_clean":"2023-10-08T00:34:24.672179+0000","last_became_active":"2023-10-08T00:34:24.670713+0000","last_became_peered":"2023-10-08T00:34:24.670713+0000","last_unstale":"2023-10-08T00:34:24.672179+0000","last_undegraded":"2023-10-08T00:34:24.672179+0000","last_fullsized":"2023-10-08T00:34:24.672179+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:43:57.631640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.920435+0000","last_change":"2023-10-08T00:34:23.919650+0000","last_active":"2023-10-08T00:34:23.920435+0000","last_peered":"2023-10-08T00:34:23.920435+0000","last_clean":"2023-10-08T00:34:23.920435+0000","last_became_active":"2023-10-08T00:34:23.919358+0000","last_became_peered":"2023-10-08T00:34:23.919358+0000","last_unstale":"2023-10-08T00:34:23.920435+0000","last_undegraded":"2023-10-08T00:34:23.920435+0000","last_fullsized":"2023-10-08T00:34:23.920435+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:22:56.184961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672149+0000","last_change":"2023-10-08T00:34:24.672149+0000","last_active":"2023-10-08T00:34:24.672149+0000","last_peered":"2023-10-08T00:34:24.672149+0000","last_clean":"2023-10-08T00:34:24.672149+0000","last_became_active":"2023-10-08T00:34:24.671963+0000","last_became_peered":"2023-10-08T00:34:24.671963+0000","last_unstale":"2023-10-08T00:34:24.672149+0000","last_undegraded":"2023-10-08T00:34:24.672149+0000","last_fullsized":"2023-10-08T00:34:24.672149+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:27:19.585446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"201'3","reported_seq":12,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.921947+0000","last_change":"2023-10-08T00:34:23.917070+0000","last_active":"2023-10-08T00:34:24.921947+0000","last_peered":"2023-10-08T00:34:24.921947+0000","last_clean":"2023-10-08T00:34:24.921947+0000","last_became_active":"2023-10-08T00:34:23.916797+0000","last_became_peered":"2023-10-08T00:34:23.916797+0000","last_unstale":"2023-10-08T00:34:24.921947+0000","last_undegraded":"2023-10-08T00:34:24.921947+0000","last_fullsized":"2023-10-08T00:34:24.921947+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:48:04.954720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.668895+0000","last_change":"2023-10-08T00:34:24.668895+0000","last_active":"2023-10-08T00:34:24.668895+0000","last_peered":"2023-10-08T00:34:24.668895+0000","last_clean":"2023-10-08T00:34:24.668895+0000","last_became_active":"2023-10-08T00:34:24.668612+0000","last_became_peered":"2023-10-08T00:34:24.668612+0000","last_unstale":"2023-10-08T00:34:24.668895+0000","last_undegraded":"2023-10-08T00:34:24.668895+0000","last_fullsized":"2023-10-08T00:34:24.668895+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:42:45.962549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"201'6","reported_seq":15,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.920369+0000","last_change":"2023-10-08T00:34:23.912626+0000","last_active":"2023-10-08T00:34:24.920369+0000","last_peered":"2023-10-08T00:34:24.920369+0000","last_clean":"2023-10-08T00:34:24.920369+0000","last_became_active":"2023-10-08T00:34:23.912352+0000","last_became_peered":"2023-10-08T00:34:23.912352+0000","last_unstale":"2023-10-08T00:34:24.920369+0000","last_undegraded":"2023-10-08T00:34:24.920369+0000","last_fullsized":"2023-10-08T00:34:24.920369+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:30:12.542941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674820+0000","last_change":"2023-10-08T00:34:24.674820+0000","last_active":"2023-10-08T00:34:24.674820+0000","last_peered":"2023-10-08T00:34:24.674820+0000","last_clean":"2023-10-08T00:34:24.674820+0000","last_became_active":"2023-10-08T00:34:24.674445+0000","last_became_peered":"2023-10-08T00:34:24.674445+0000","last_unstale":"2023-10-08T00:34:24.674820+0000","last_undegraded":"2023-10-08T00:34:24.674820+0000","last_fullsized":"2023-10-08T00:34:24.674820+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T04:14:10.406483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.918286+0000","last_change":"2023-10-08T00:34:23.919305+0000","last_active":"2023-10-08T00:34:24.918286+0000","last_peered":"2023-10-08T00:34:24.918286+0000","last_clean":"2023-10-08T00:34:24.918286+0000","last_became_active":"2023-10-08T00:34:23.918116+0000","last_became_peered":"2023-10-08T00:34:23.918116+0000","last_unstale":"2023-10-08T00:34:24.918286+0000","last_undegraded":"2023-10-08T00:34:24.918286+0000","last_fullsized":"2023-10-08T00:34:24.918286+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T07:59:08.152067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678064+0000","last_change":"2023-10-08T00:34:24.678064+0000","last_active":"2023-10-08T00:34:24.678064+0000","last_peered":"2023-10-08T00:34:24.678064+0000","last_clean":"2023-10-08T00:34:24.678064+0000","last_became_active":"2023-10-08T00:34:24.677790+0000","last_became_peered":"2023-10-08T00:34:24.677790+0000","last_unstale":"2023-10-08T00:34:24.678064+0000","last_undegraded":"2023-10-08T00:34:24.678064+0000","last_fullsized":"2023-10-08T00:34:24.678064+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:13:00.945844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923421+0000","last_change":"2023-10-08T00:34:23.922308+0000","last_active":"2023-10-08T00:34:23.923421+0000","last_peered":"2023-10-08T00:34:23.923421+0000","last_clean":"2023-10-08T00:34:23.923421+0000","last_became_active":"2023-10-08T00:34:23.918631+0000","last_became_peered":"2023-10-08T00:34:23.918631+0000","last_unstale":"2023-10-08T00:34:23.923421+0000","last_undegraded":"2023-10-08T00:34:23.923421+0000","last_fullsized":"2023-10-08T00:34:23.923421+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:21:42.582154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.665961+0000","last_change":"2023-10-08T00:34:24.665961+0000","last_active":"2023-10-08T00:34:24.665961+0000","last_peered":"2023-10-08T00:34:24.665961+0000","last_clean":"2023-10-08T00:34:24.665961+0000","last_became_active":"2023-10-08T00:34:24.665693+0000","last_became_peered":"2023-10-08T00:34:24.665693+0000","last_unstale":"2023-10-08T00:34:24.665961+0000","last_undegraded":"2023-10-08T00:34:24.665961+0000","last_fullsized":"2023-10-08T00:34:24.665961+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:02:47.239223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923173+0000","last_change":"2023-10-08T00:34:23.917666+0000","last_active":"2023-10-08T00:34:23.923173+0000","last_peered":"2023-10-08T00:34:23.923173+0000","last_clean":"2023-10-08T00:34:23.923173+0000","last_became_active":"2023-10-08T00:34:23.917364+0000","last_became_peered":"2023-10-08T00:34:23.917364+0000","last_unstale":"2023-10-08T00:34:23.923173+0000","last_undegraded":"2023-10-08T00:34:23.923173+0000","last_fullsized":"2023-10-08T00:34:23.923173+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:52:27.350665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676341+0000","last_change":"2023-10-08T00:34:24.676341+0000","last_active":"2023-10-08T00:34:24.676341+0000","last_peered":"2023-10-08T00:34:24.676341+0000","last_clean":"2023-10-08T00:34:24.676341+0000","last_became_active":"2023-10-08T00:34:24.676009+0000","last_became_peered":"2023-10-08T00:34:24.676009+0000","last_unstale":"2023-10-08T00:34:24.676341+0000","last_undegraded":"2023-10-08T00:34:24.676341+0000","last_fullsized":"2023-10-08T00:34:24.676341+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:10:04.803297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"201'8","reported_seq":17,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.922014+0000","last_change":"2023-10-08T00:34:23.915016+0000","last_active":"2023-10-08T00:34:24.922014+0000","last_peered":"2023-10-08T00:34:24.922014+0000","last_clean":"2023-10-08T00:34:24.922014+0000","last_became_active":"2023-10-08T00:34:23.914383+0000","last_became_peered":"2023-10-08T00:34:23.914383+0000","last_unstale":"2023-10-08T00:34:24.922014+0000","last_undegraded":"2023-10-08T00:34:24.922014+0000","last_fullsized":"2023-10-08T00:34:24.922014+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T00:34:25.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674543+0000","last_change":"2023-10-08T00:34:24.674543+0000","last_active":"2023-10-08T00:34:24.674543+0000","last_peered":"2023-10-08T00:34:24.674543+0000","last_clean":"2023-10-08T00:34:24.674543+0000","last_became_active":"2023-10-08T00:34:24.673882+0000","last_became_peered":"2023-10-08T00:34:24.673882+0000","last_unstale":"2023-10-08T00:34:24.674543+0000","last_undegraded":"2023-10-08T00:34:24.674543+0000","last_fullsized":"2023-10-08T00:34:24.674543+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:20:58.396153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.667471+0000","last_change":"2023-10-08T00:34:23.922856+0000","last_active":"2023-10-08T00:34:24.667471+0000","last_peered":"2023-10-08T00:34:24.667471+0000","last_clean":"2023-10-08T00:34:24.667471+0000","last_became_active":"2023-10-08T00:34:23.922578+0000","last_became_peered":"2023-10-08T00:34:23.922578+0000","last_unstale":"2023-10-08T00:34:24.667471+0000","last_undegraded":"2023-10-08T00:34:24.667471+0000","last_fullsized":"2023-10-08T00:34:24.667471+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:43:26.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.668804+0000","last_change":"2023-10-08T00:34:24.668804+0000","last_active":"2023-10-08T00:34:24.668804+0000","last_peered":"2023-10-08T00:34:24.668804+0000","last_clean":"2023-10-08T00:34:24.668804+0000","last_became_active":"2023-10-08T00:34:24.668510+0000","last_became_peered":"2023-10-08T00:34:24.668510+0000","last_unstale":"2023-10-08T00:34:24.668804+0000","last_undegraded":"2023-10-08T00:34:24.668804+0000","last_fullsized":"2023-10-08T00:34:24.668804+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:16:39.733563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.916369+0000","last_change":"2023-10-08T00:34:23.919108+0000","last_active":"2023-10-08T00:34:24.916369+0000","last_peered":"2023-10-08T00:34:24.916369+0000","last_clean":"2023-10-08T00:34:24.916369+0000","last_became_active":"2023-10-08T00:34:23.917323+0000","last_became_peered":"2023-10-08T00:34:23.917323+0000","last_unstale":"2023-10-08T00:34:24.916369+0000","last_undegraded":"2023-10-08T00:34:24.916369+0000","last_fullsized":"2023-10-08T00:34:24.916369+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:20:58.890100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671773+0000","last_change":"2023-10-08T00:34:24.671773+0000","last_active":"2023-10-08T00:34:24.671773+0000","last_peered":"2023-10-08T00:34:24.671773+0000","last_clean":"2023-10-08T00:34:24.671773+0000","last_became_active":"2023-10-08T00:34:24.671439+0000","last_became_peered":"2023-10-08T00:34:24.671439+0000","last_unstale":"2023-10-08T00:34:24.671773+0000","last_undegraded":"2023-10-08T00:34:24.671773+0000","last_fullsized":"2023-10-08T00:34:24.671773+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T01:41:01.606852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"201'1","reported_seq":10,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.666306+0000","last_change":"2023-10-08T00:34:23.916231+0000","last_active":"2023-10-08T00:34:24.666306+0000","last_peered":"2023-10-08T00:34:24.666306+0000","last_clean":"2023-10-08T00:34:24.666306+0000","last_became_active":"2023-10-08T00:34:23.915993+0000","last_became_peered":"2023-10-08T00:34:23.915993+0000","last_unstale":"2023-10-08T00:34:24.666306+0000","last_undegraded":"2023-10-08T00:34:24.666306+0000","last_fullsized":"2023-10-08T00:34:24.666306+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:24:23.395690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678710+0000","last_change":"2023-10-08T00:34:24.678710+0000","last_active":"2023-10-08T00:34:24.678710+0000","last_peered":"2023-10-08T00:34:24.678710+0000","last_clean":"2023-10-08T00:34:24.678710+0000","last_became_active":"2023-10-08T00:34:24.678445+0000","last_became_peered":"2023-10-08T00:34:24.678445+0000","last_unstale":"2023-10-08T00:34:24.678710+0000","last_undegraded":"2023-10-08T00:34:24.678710+0000","last_fullsized":"2023-10-08T00:34:24.678710+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:18:46.841257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917380+0000","last_change":"2023-10-08T00:34:23.916240+0000","last_active":"2023-10-08T00:34:23.917380+0000","last_peered":"2023-10-08T00:34:23.917380+0000","last_clean":"2023-10-08T00:34:23.917380+0000","last_became_active":"2023-10-08T00:34:23.915896+0000","last_became_peered":"2023-10-08T00:34:23.915896+0000","last_unstale":"2023-10-08T00:34:23.917380+0000","last_undegraded":"2023-10-08T00:34:23.917380+0000","last_fullsized":"2023-10-08T00:34:23.917380+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:14:34.118136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676361+0000","last_change":"2023-10-08T00:34:24.676361+0000","last_active":"2023-10-08T00:34:24.676361+0000","last_peered":"2023-10-08T00:34:24.676361+0000","last_clean":"2023-10-08T00:34:24.676361+0000","last_became_active":"2023-10-08T00:34:24.675915+0000","last_became_peered":"2023-10-08T00:34:24.675915+0000","last_unstale":"2023-10-08T00:34:24.676361+0000","last_undegraded":"2023-10-08T00:34:24.676361+0000","last_fullsized":"2023-10-08T00:34:24.676361+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:58:52.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.922286+0000","last_change":"2023-10-08T00:34:23.919490+0000","last_active":"2023-10-08T00:34:24.922286+0000","last_peered":"2023-10-08T00:34:24.922286+0000","last_clean":"2023-10-08T00:34:24.922286+0000","last_became_active":"2023-10-08T00:34:23.918666+0000","last_became_peered":"2023-10-08T00:34:23.918666+0000","last_unstale":"2023-10-08T00:34:24.922286+0000","last_undegraded":"2023-10-08T00:34:24.922286+0000","last_fullsized":"2023-10-08T00:34:24.922286+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:58:12.210868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674356+0000","last_change":"2023-10-08T00:34:24.674356+0000","last_active":"2023-10-08T00:34:24.674356+0000","last_peered":"2023-10-08T00:34:24.674356+0000","last_clean":"2023-10-08T00:34:24.674356+0000","last_became_active":"2023-10-08T00:34:24.674083+0000","last_became_peered":"2023-10-08T00:34:24.674083+0000","last_unstale":"2023-10-08T00:34:24.674356+0000","last_undegraded":"2023-10-08T00:34:24.674356+0000","last_fullsized":"2023-10-08T00:34:24.674356+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:17.258482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.920684+0000","last_change":"2023-10-08T00:34:23.914905+0000","last_active":"2023-10-08T00:34:23.920684+0000","last_peered":"2023-10-08T00:34:23.920684+0000","last_clean":"2023-10-08T00:34:23.920684+0000","last_became_active":"2023-10-08T00:34:23.914606+0000","last_became_peered":"2023-10-08T00:34:23.914606+0000","last_unstale":"2023-10-08T00:34:23.920684+0000","last_undegraded":"2023-10-08T00:34:23.920684+0000","last_fullsized":"2023-10-08T00:34:23.920684+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:35:28.374547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671861+0000","last_change":"2023-10-08T00:34:24.671861+0000","last_active":"2023-10-08T00:34:24.671861+0000","last_peered":"2023-10-08T00:34:24.671861+0000","last_clean":"2023-10-08T00:34:24.671861+0000","last_became_active":"2023-10-08T00:34:24.671491+0000","last_became_peered":"2023-10-08T00:34:24.671491+0000","last_unstale":"2023-10-08T00:34:24.671861+0000","last_undegraded":"2023-10-08T00:34:24.671861+0000","last_fullsized":"2023-10-08T00:34:24.671861+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:39:18.197127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923438+0000","last_change":"2023-10-08T00:34:23.920384+0000","last_active":"2023-10-08T00:34:23.923438+0000","last_peered":"2023-10-08T00:34:23.923438+0000","last_clean":"2023-10-08T00:34:23.923438+0000","last_became_active":"2023-10-08T00:34:23.919960+0000","last_became_peered":"2023-10-08T00:34:23.919960+0000","last_unstale":"2023-10-08T00:34:23.923438+0000","last_undegraded":"2023-10-08T00:34:23.923438+0000","last_fullsized":"2023-10-08T00:34:23.923438+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:24:18.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672528+0000","last_change":"2023-10-08T00:34:24.672528+0000","last_active":"2023-10-08T00:34:24.672528+0000","last_peered":"2023-10-08T00:34:24.672528+0000","last_clean":"2023-10-08T00:34:24.672528+0000","last_became_active":"2023-10-08T00:34:24.670292+0000","last_became_peered":"2023-10-08T00:34:24.670292+0000","last_unstale":"2023-10-08T00:34:24.672528+0000","last_undegraded":"2023-10-08T00:34:24.672528+0000","last_fullsized":"2023-10-08T00:34:24.672528+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:30:06.882267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.923052+0000","last_change":"2023-10-08T00:34:23.915189+0000","last_active":"2023-10-08T00:34:23.923052+0000","last_peered":"2023-10-08T00:34:23.923052+0000","last_clean":"2023-10-08T00:34:23.923052+0000","last_became_active":"2023-10-08T00:34:23.914760+0000","last_became_peered":"2023-10-08T00:34:23.914760+0000","last_unstale":"2023-10-08T00:34:23.923052+0000","last_undegraded":"2023-10-08T00:34:23.923052+0000","last_fullsized":"2023-10-08T00:34:23.923052+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:33:03.989990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.671671+0000","last_change":"2023-10-08T00:34:24.671671+0000","last_active":"2023-10-08T00:34:24.671671+0000","last_peered":"2023-10-08T00:34:24.671671+0000","last_clean":"2023-10-08T00:34:24.671671+0000","last_became_active":"2023-10-08T00:34:24.670709+0000","last_became_peered":"2023-10-08T00:34:24.670709+0000","last_unstale":"2023-10-08T00:34:24.671671+0000","last_undegraded":"2023-10-08T00:34:24.671671+0000","last_fullsized":"2023-10-08T00:34:24.671671+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T06:11:42.530959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"201'2","reported_seq":11,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.917829+0000","last_change":"2023-10-08T00:34:23.922509+0000","last_active":"2023-10-08T00:34:24.917829+0000","last_peered":"2023-10-08T00:34:24.917829+0000","last_clean":"2023-10-08T00:34:24.917829+0000","last_became_active":"2023-10-08T00:34:23.922303+0000","last_became_peered":"2023-10-08T00:34:23.922303+0000","last_unstale":"2023-10-08T00:34:24.917829+0000","last_undegraded":"2023-10-08T00:34:24.917829+0000","last_fullsized":"2023-10-08T00:34:24.917829+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:52:04.625601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674470+0000","last_change":"2023-10-08T00:34:24.674470+0000","last_active":"2023-10-08T00:34:24.674470+0000","last_peered":"2023-10-08T00:34:24.674470+0000","last_clean":"2023-10-08T00:34:24.674470+0000","last_became_active":"2023-10-08T00:34:24.674206+0000","last_became_peered":"2023-10-08T00:34:24.674206+0000","last_unstale":"2023-10-08T00:34:24.674470+0000","last_undegraded":"2023-10-08T00:34:24.674470+0000","last_fullsized":"2023-10-08T00:34:24.674470+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:36:16.555002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.918645+0000","last_change":"2023-10-08T00:34:23.917355+0000","last_active":"2023-10-08T00:34:23.918645+0000","last_peered":"2023-10-08T00:34:23.918645+0000","last_clean":"2023-10-08T00:34:23.918645+0000","last_became_active":"2023-10-08T00:34:23.916943+0000","last_became_peered":"2023-10-08T00:34:23.916943+0000","last_unstale":"2023-10-08T00:34:23.918645+0000","last_undegraded":"2023-10-08T00:34:23.918645+0000","last_fullsized":"2023-10-08T00:34:23.918645+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:59:56.324897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.679774+0000","last_change":"2023-10-08T00:34:24.679774+0000","last_active":"2023-10-08T00:34:24.679774+0000","last_peered":"2023-10-08T00:34:24.679774+0000","last_clean":"2023-10-08T00:34:24.679774+0000","last_became_active":"2023-10-08T00:34:24.677029+0000","last_became_peered":"2023-10-08T00:34:24.677029+0000","last_unstale":"2023-10-08T00:34:24.679774+0000","last_undegraded":"2023-10-08T00:34:24.679774+0000","last_fullsized":"2023-10-08T00:34:24.679774+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:20:59.894660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917150+0000","last_change":"2023-10-08T00:34:23.914170+0000","last_active":"2023-10-08T00:34:23.917150+0000","last_peered":"2023-10-08T00:34:23.917150+0000","last_clean":"2023-10-08T00:34:23.917150+0000","last_became_active":"2023-10-08T00:34:23.913922+0000","last_became_peered":"2023-10-08T00:34:23.913922+0000","last_unstale":"2023-10-08T00:34:23.917150+0000","last_undegraded":"2023-10-08T00:34:23.917150+0000","last_fullsized":"2023-10-08T00:34:23.917150+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:50:36.759775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.675155+0000","last_change":"2023-10-08T00:34:24.675155+0000","last_active":"2023-10-08T00:34:24.675155+0000","last_peered":"2023-10-08T00:34:24.675155+0000","last_clean":"2023-10-08T00:34:24.675155+0000","last_became_active":"2023-10-08T00:34:24.674822+0000","last_became_peered":"2023-10-08T00:34:24.674822+0000","last_unstale":"2023-10-08T00:34:24.675155+0000","last_undegraded":"2023-10-08T00:34:24.675155+0000","last_fullsized":"2023-10-08T00:34:24.675155+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:04:21.215821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.915806+0000","last_change":"2023-10-08T00:34:23.913664+0000","last_active":"2023-10-08T00:34:23.915806+0000","last_peered":"2023-10-08T00:34:23.915806+0000","last_clean":"2023-10-08T00:34:23.915806+0000","last_became_active":"2023-10-08T00:34:23.913319+0000","last_became_peered":"2023-10-08T00:34:23.913319+0000","last_unstale":"2023-10-08T00:34:23.915806+0000","last_undegraded":"2023-10-08T00:34:23.915806+0000","last_fullsized":"2023-10-08T00:34:23.915806+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:37:01.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.672915+0000","last_change":"2023-10-08T00:34:24.672915+0000","last_active":"2023-10-08T00:34:24.672915+0000","last_peered":"2023-10-08T00:34:24.672915+0000","last_clean":"2023-10-08T00:34:24.672915+0000","last_became_active":"2023-10-08T00:34:24.672640+0000","last_became_peered":"2023-10-08T00:34:24.672640+0000","last_unstale":"2023-10-08T00:34:24.672915+0000","last_undegraded":"2023-10-08T00:34:24.672915+0000","last_fullsized":"2023-10-08T00:34:24.672915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:57:41.188833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.915662+0000","last_change":"2023-10-08T00:34:23.913061+0000","last_active":"2023-10-08T00:34:23.915662+0000","last_peered":"2023-10-08T00:34:23.915662+0000","last_clean":"2023-10-08T00:34:23.915662+0000","last_became_active":"2023-10-08T00:34:23.912809+0000","last_became_peered":"2023-10-08T00:34:23.912809+0000","last_unstale":"2023-10-08T00:34:23.915662+0000","last_undegraded":"2023-10-08T00:34:23.915662+0000","last_fullsized":"2023-10-08T00:34:23.915662+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T12:00:08.104864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.676259+0000","last_change":"2023-10-08T00:34:24.676259+0000","last_active":"2023-10-08T00:34:24.676259+0000","last_peered":"2023-10-08T00:34:24.676259+0000","last_clean":"2023-10-08T00:34:24.676259+0000","last_became_active":"2023-10-08T00:34:24.675810+0000","last_became_peered":"2023-10-08T00:34:24.675810+0000","last_unstale":"2023-10-08T00:34:24.676259+0000","last_undegraded":"2023-10-08T00:34:24.676259+0000","last_fullsized":"2023-10-08T00:34:24.676259+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T03:49:02.468634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.921707+0000","last_change":"2023-10-08T00:34:23.920509+0000","last_active":"2023-10-08T00:34:23.921707+0000","last_peered":"2023-10-08T00:34:23.921707+0000","last_clean":"2023-10-08T00:34:23.921707+0000","last_became_active":"2023-10-08T00:34:23.920225+0000","last_became_peered":"2023-10-08T00:34:23.920225+0000","last_unstale":"2023-10-08T00:34:23.921707+0000","last_undegraded":"2023-10-08T00:34:23.921707+0000","last_fullsized":"2023-10-08T00:34:23.921707+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T08:06:47.780856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.674334+0000","last_change":"2023-10-08T00:34:24.674334+0000","last_active":"2023-10-08T00:34:24.674334+0000","last_peered":"2023-10-08T00:34:24.674334+0000","last_clean":"2023-10-08T00:34:24.674334+0000","last_became_active":"2023-10-08T00:34:24.674076+0000","last_became_peered":"2023-10-08T00:34:24.674076+0000","last_unstale":"2023-10-08T00:34:24.674334+0000","last_undegraded":"2023-10-08T00:34:24.674334+0000","last_fullsized":"2023-10-08T00:34:24.674334+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:04:33.103286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.915866+0000","last_change":"2023-10-08T00:34:23.912410+0000","last_active":"2023-10-08T00:34:23.915866+0000","last_peered":"2023-10-08T00:34:23.915866+0000","last_clean":"2023-10-08T00:34:23.915866+0000","last_became_active":"2023-10-08T00:34:23.912037+0000","last_became_peered":"2023-10-08T00:34:23.912037+0000","last_unstale":"2023-10-08T00:34:23.915866+0000","last_undegraded":"2023-10-08T00:34:23.915866+0000","last_fullsized":"2023-10-08T00:34:23.915866+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:47:09.922100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678985+0000","last_change":"2023-10-08T00:34:24.678985+0000","last_active":"2023-10-08T00:34:24.678985+0000","last_peered":"2023-10-08T00:34:24.678985+0000","last_clean":"2023-10-08T00:34:24.678985+0000","last_became_active":"2023-10-08T00:34:24.678704+0000","last_became_peered":"2023-10-08T00:34:24.678704+0000","last_unstale":"2023-10-08T00:34:24.678985+0000","last_undegraded":"2023-10-08T00:34:24.678985+0000","last_fullsized":"2023-10-08T00:34:24.678985+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T05:18:58.408530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":9,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.917408+0000","last_change":"2023-10-08T00:34:23.915426+0000","last_active":"2023-10-08T00:34:23.917408+0000","last_peered":"2023-10-08T00:34:23.917408+0000","last_clean":"2023-10-08T00:34:23.917408+0000","last_became_active":"2023-10-08T00:34:23.914919+0000","last_became_peered":"2023-10-08T00:34:23.914919+0000","last_unstale":"2023-10-08T00:34:23.917408+0000","last_undegraded":"2023-10-08T00:34:23.917408+0000","last_fullsized":"2023-10-08T00:34:23.917408+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:22.891185+0000","last_clean_scrub_stamp":"2023-10-08T00:34:22.891185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T02:52:05.305697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":8,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-10-08T00:34:24.678161+0000","last_change":"2023-10-08T00:34:24.678161+0000","last_active":"2023-10-08T00:34:24.678161+0000","last_peered":"2023-10-08T00:34:24.678161+0000","last_clean":"2023-10-08T00:34:24.678161+0000","last_became_active":"2023-10-08T00:34:24.677084+0000","last_became_peered":"2023-10-08T00:34:24.677084+0000","last_unstale":"2023-10-08T00:34:24.678161+0000","last_undegraded":"2023-10-08T00:34:24.678161+0000","last_fullsized":"2023-10-08T00:34:24.678161+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:34:23.895744+0000","last_clean_scrub_stamp":"2023-10-08T00:34:23.895744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T09:12:40.636784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":314,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-10-08T00:34:23.916438+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:34:23.916438+0000","last_peered":"2023-10-08T00:34:23.916438+0000","last_clean":"2023-10-08T00:34:23.916438+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:34:23.916438+0000","last_undegraded":"2023-10-08T00:34:23.916438+0000","last_fullsized":"2023-10-08T00:34:23.916438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304448,"kb_used_data":3064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067392,"statfs":{"total":96636764160,"available":96325009408,"internally_reserved":0,"allocated":3137536,"data_stored":1735352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52300000000000002,"15min":0.51000000000000001},"min":{"1min":0.372,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73399999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53400000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.316,"15min":0.28599999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.69299999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.30499999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.42399999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.66400000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.33600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82599999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.502},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.55600000000000005},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.28499999999999998},"max":{"1min":0.70699999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.76500000000000001,"5min":0.875,"15min":0.875},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.46100000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.76600000000000001,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.67500000000000004}]},{"osd":4,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.434,"5min":0.254,"15min":0.254},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.97899999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80700000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39800000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52000000000000002,"15min":0.53600000000000003},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79000000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56699999999999995,"15min":0.58199999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.87,"5min":0.87,"15min":1.048},"last":0.38800000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59099999999999997,"15min":0.61799999999999999},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.44500000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.502},"min":{"1min":0.32900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.62,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.497},{"interface":"front","average":{"1min":0.498,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.68700000000000006,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.34300000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51100000000000001,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65600000000000003,"5min":0.97299999999999998,"15min":1.145},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51300000000000001,"15min":0.52900000000000003},"min":{"1min":0.39100000000000001,"5min":0.317,"15min":0.29299999999999998},"max":{"1min":0.67700000000000005,"5min":0.70299999999999996,"15min":0.873},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.69699999999999995,"5min":0.90400000000000003,"15min":1.079},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54200000000000004,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71799999999999997,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.41399999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73399999999999999,"5min":1.496,"15min":1.496},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59499999999999997},"min":{"1min":0.42699999999999999,"5min":0.40899999999999997,"15min":0.38200000000000001},"max":{"1min":0.73099999999999998,"5min":1.02,"15min":1.1160000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69699999999999995,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.309},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.78300000000000003,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.44700000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56200000000000006,"15min":0.55200000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.85299999999999998,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.60099999999999998},"min":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.755,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.39800000000000002}]},{"osd":7,"last update":"Sun Oct 8 00:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.82399999999999995,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60399999999999998,"15min":0.629},"min":{"1min":0.46300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88900000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.47399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307976,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063864,"statfs":{"total":96636764160,"available":96321396736,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32600000000000001,"15min":0.33200000000000002},"min":{"1min":0.20899999999999999,"5min":0.185,"15min":0.185},"max":{"1min":0.53200000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.36499999999999999,"15min":0.35199999999999998},"min":{"1min":0.28199999999999997,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.52200000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.37,"15min":0.36899999999999999},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.65500000000000003},"last":0.308},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.372,"15min":0.377},"min":{"1min":0.27200000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.59499999999999997},"last":0.32600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42899999999999999,"15min":0.42299999999999999},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.60999999999999999,"5min":0.66500000000000004,"15min":0.67200000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.39700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.623,"15min":0.628},"min":{"1min":0.433,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.91900000000000004,"5min":1.218,"15min":1.218},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.627},"min":{"1min":0.52500000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.61599999999999999,"15min":0.61399999999999999},"min":{"1min":0.48199999999999998,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":1.121,"5min":1.121,"15min":1.294},"last":0.442},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.66200000000000003,"15min":0.65500000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":1.1319999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.45100000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.63200000000000001},"min":{"1min":0.47699999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.1120000000000001,"5min":1.278,"15min":1.278},"last":0.42999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:34:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80400000000000005,"5min":0.89600000000000002,"15min":1.087},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308560,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063280,"statfs":{"total":96636764160,"available":96320798720,"internally_reserved":0,"allocated":3153920,"data_stored":1742185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48599999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.629},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36499999999999999,"15min":0.36099999999999999},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.28599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.378,"15min":0.378},"min":{"1min":0.27200000000000002,"5min":0.249,"15min":0.245},"max":{"1min":0.52300000000000002,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.38400000000000001,"15min":0.39100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.37,"15min":0.374},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.45700000000000002,"5min":0.749,"15min":0.749},"last":0.439},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.255},"max":{"1min":0.53400000000000003,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.77600000000000002,"5min":0.88600000000000001,"15min":0.97499999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.78500000000000003,"5min":0.91400000000000003,"15min":1.0369999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":1.242},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.627,"15min":0.622},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.80700000000000005,"5min":0.85699999999999998,"15min":0.90600000000000003},"last":0.56499999999999995}]},{"osd":6,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77800000000000002,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60699999999999998,"15min":0.60999999999999999},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92900000000000005},"last":0.66700000000000004}]},{"osd":7,"last update":"Sun Oct 8 00:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.434,"5min":0.37,"15min":0.37},"max":{"1min":0.84499999999999997,"5min":0.86199999999999999,"15min":1.1020000000000001},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574966,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.32800000000000001,"15min":0.34100000000000003},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46800000000000003,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34599999999999997,"15min":0.373},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.48499999999999999,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35199999999999998,"15min":0.36699999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48199999999999998,"5min":0.55500000000000005,"15min":0.65000000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.36699999999999999,"15min":0.39700000000000002},"min":{"1min":0.26800000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.53500000000000003,"5min":0.60499999999999998,"15min":0.68600000000000005},"last":0.316}]},{"osd":3,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.34999999999999998,"15min":0.371},"min":{"1min":0.248,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":0.44,"5min":0.56299999999999994,"15min":0.60799999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.42099999999999999},"min":{"1min":0.32200000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57199999999999995,"5min":0.63200000000000001,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.36299999999999999,"15min":0.33000000000000002},"max":{"1min":0.751,"5min":0.79000000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.59299999999999997,"15min":0.628},"min":{"1min":0.46999999999999997,"5min":0.41099999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":0.90400000000000003,"15min":1.0760000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.84899999999999998,"5min":0.91000000000000003,"15min":0.93400000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.625,"15min":0.66000000000000003},"min":{"1min":0.51100000000000001,"5min":0.40600000000000003,"15min":0.34899999999999998},"max":{"1min":0.83099999999999996,"5min":0.91900000000000004,"15min":1.278},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.49399999999999999,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.79600000000000004,"5min":0.87,"15min":1.137},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59699999999999998,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78000000000000003,"5min":0.85699999999999998,"15min":0.95999999999999996},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 00:34:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.64000000000000001},"min":{"1min":0.42699999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":1.1259999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60599999999999998,"15min":0.64700000000000002},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":0.75800000000000001,"5min":0.94299999999999995,"15min":1.343},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303884,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067956,"statfs":{"total":96636764160,"available":96325586944,"internally_reserved":0,"allocated":2560000,"data_stored":1151837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.34999999999999998,"15min":0.34799999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.37,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.53200000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36299999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.34100000000000003,"15min":0.34599999999999997},"min":{"1min":0.253,"5min":0.23100000000000001,"15min":0.22800000000000001},"max":{"1min":0.501,"5min":0.54400000000000004,"15min":0.66000000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.372},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.5,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.248},"max":{"1min":0.55200000000000005,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.442,"15min":0.443},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.64400000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58799999999999997,"15min":0.57699999999999996},"min":{"1min":0.434,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81399999999999995,"5min":1.47,"15min":1.47},"last":0.622},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.35899999999999999},"max":{"1min":0.76700000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.626,"15min":0.63},"min":{"1min":0.47199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.49199999999999999,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":0.85699999999999998,"5min":1.385,"15min":1.385},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.627,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.83099999999999996,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.47899999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":0.996,"15min":0.996},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:33:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.45300000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85399999999999998,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.44,"15min":0.435},"max":{"1min":0.83699999999999997,"5min":1.006,"15min":1.006},"last":0.61399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1151747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.5,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.66700000000000004,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.72299999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.57599999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.68899999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.499},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.60599999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56399999999999995,"15min":0.59799999999999998},"min":{"1min":0.38,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":1.712},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.34399999999999997},"max":{"1min":0.65200000000000002,"5min":1.21,"15min":1.21},"last":0.59199999999999997}]},{"osd":3,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65200000000000002,"15min":0.60099999999999998},"min":{"1min":0.39800000000000002,"5min":0.373,"15min":0.35599999999999998},"max":{"1min":0.72599999999999998,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":0.621},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.82499999999999996,"15min":0.873},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48899999999999999,"15min":0.5},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.28100000000000003},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.44700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.002},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.78500000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54600000000000004,"15min":0.56899999999999995},"min":{"1min":0.371,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.41599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56100000000000005,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59999999999999998,"15min":0.61699999999999999},"min":{"1min":0.43099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81699999999999995,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.47599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303884,"kb_used_data":2500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067956,"statfs":{"total":96636764160,"available":96325586944,"internally_reserved":0,"allocated":2560000,"data_stored":1151817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51700000000000002,"15min":0.501},"min":{"1min":0.29199999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.86699999999999999},"last":0.434},{"interface":"front","average":{"1min":0.503,"5min":0.50800000000000001,"15min":0.51800000000000002},"min":{"1min":0.374,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.59599999999999997},"min":{"1min":0.35499999999999998,"5min":0.34000000000000002,"15min":0.318},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52700000000000002,"15min":0.55000000000000004},"min":{"1min":0.39800000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.74399999999999999,"5min":0.746,"15min":0.75700000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.70999999999999996,"5min":0.77700000000000002,"15min":0.88300000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.623,"15min":0.58099999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.32900000000000001},"max":{"1min":0.80100000000000005,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57299999999999995,"15min":0.64200000000000002},"min":{"1min":0.42599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":2.4870000000000001},"last":0.49299999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.32400000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73999999999999999,"5min":0.749,"15min":0.78700000000000003},"last":0.626},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.503,"15min":0.53700000000000003},"min":{"1min":0.36899999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.753,"15min":0.80100000000000005},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.58399999999999996},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:34:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.85199999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.60399999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:34:29.401 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T00:34:29.402 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T00:34:29.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.562+0000 7fb95ec40700 1 Processor -- start 2023-10-08T00:34:29.562 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.562+0000 7fb95ec40700 1 -- start start 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.562+0000 7fb95ec40700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb9580cdcf0 0x7fb9580c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.562+0000 7fb95ec40700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb958157ca0 con 0x7fb958156720 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.562+0000 7fb95ec40700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb958157090 con 0x7fb95806fa50 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.562+0000 7fb95ec40700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb958157370 con 0x7fb9580cdcf0 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95c9dc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb958156720 0x7fb95806f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54744/0 (socket says 172.21.15.22:54744) 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95c9dc700 1 -- 172.21.15.22:0/3259112216 learned_addr learned my addr 172.21.15.22:0/3259112216 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95d1dd700 1 --2- 172.21.15.22:0/3259112216 >> v2:172.21.15.192:3300/0 conn(0x7fb9580cdcf0 0x7fb9580c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb9577fe700 1 -- 172.21.15.22:0/3259112216 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399144857 0 0) 0x7fb958157ca0 con 0x7fb958156720 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb9577fe700 1 -- 172.21.15.22:0/3259112216 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb940003570 con 0x7fb958156720 2023-10-08T00:34:29.565 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95d1dd700 1 -- 172.21.15.22:0/3259112216 >> v1:172.21.15.192:6789/0 conn(0x7fb95806fa50 legacy=0x7fb9580cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95d1dd700 1 -- 172.21.15.22:0/3259112216 >> v1:172.21.15.22:6789/0 conn(0x7fb958156720 legacy=0x7fb95806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb9577fe700 1 -- 172.21.15.22:0/3259112216 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1082173755 0 0) 0x7fb940003570 con 0x7fb958156720 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95d1dd700 1 -- 172.21.15.22:0/3259112216 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958157650 con 0x7fb9580cdcf0 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb95d1dd700 1 --2- 172.21.15.22:0/3259112216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580c9d30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e60 tx=0x7fb950009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2753f13952b4911d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.563+0000 7fb9577fe700 1 -- 172.21.15.22:0/3259112216 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95000e070 con 0x7fb9580cdcf0 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb9577fe700 1 -- 172.21.15.22:0/3259112216 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95000b850 con 0x7fb9580cdcf0 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb9577fe700 1 -- 172.21.15.22:0/3259112216 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948001470 con 0x7fb9580cdcf0 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 -- 172.21.15.22:0/3259112216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 msgr2=0x7fb9580c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 --2- 172.21.15.22:0/3259112216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580c9d30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb950009e60 tx=0x7fb950009780 comp rx=0 tx=0).stop 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 -- 172.21.15.22:0/3259112216 shutdown_connections 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 --2- 172.21.15.22:0/3259112216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580c9d30 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.566 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 -- 172.21.15.22:0/3259112216 >> 172.21.15.22:0/3259112216 conn(0x7fb9580694a0 msgr2=0x7fb9580698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 -- 172.21.15.22:0/3259112216 shutdown_connections 2023-10-08T00:34:29.567 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.564+0000 7fb95ec40700 1 -- 172.21.15.22:0/3259112216 wait complete. 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.565+0000 7fb95ec40700 1 Processor -- start 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.565+0000 7fb95ec40700 1 -- start start 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95ec40700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 0x7fb9580b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95ec40700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95ec40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb958156720 0x7fb958154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95ec40700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580b17f0 con 0x7fb95806fa50 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95ec40700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580b0940 con 0x7fb9580cdcf0 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95ec40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580b0be0 con 0x7fb958156720 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95c9dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 0x7fb9580b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95c9dc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 0x7fb9580b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53442/0 (socket says 172.21.15.22:53442) 2023-10-08T00:34:29.570 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95c9dc700 1 -- 172.21.15.22:0/4285531571 learned_addr learned my addr 172.21.15.22:0/4285531571 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb957fff700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.566+0000 7fb95d1dd700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb958156720 0x7fb958154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95c9dc700 1 -- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb958156720 msgr2=0x7fb958154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95c9dc700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb958156720 0x7fb958154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95c9dc700 1 -- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 msgr2=0x7fb9580b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95c9dc700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95c9dc700 1 -- 172.21.15.22:0/4285531571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950009a20 con 0x7fb95806fa50 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95c9dc700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 0x7fb9580b0400 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c7f0 tx=0x7fb9480019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948007360 con 0x7fb95806fa50 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9480074c0 con 0x7fb95806fa50 2023-10-08T00:34:29.571 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9580b0ec0 con 0x7fb95806fa50 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948004830 con 0x7fb95806fa50 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.567+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9580b1480 con 0x7fb95806fa50 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.568+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9580b1ad0 con 0x7fb95806fa50 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.568+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb948004c20 con 0x7fb95806fa50 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.569+0000 7fb954ff9700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb944067320 0x7fb9440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.569+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb948083ea0 con 0x7fb95806fa50 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.569+0000 7fb957fff700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb944067320 0x7fb9440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.572 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.570+0000 7fb957fff700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb944067320 0x7fb9440697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb9580adae0 tx=0x7fb94c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.573 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.573+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb948050bb0 con 0x7fb95806fa50 2023-10-08T00:34:29.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.848+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb9580718b0 con 0x7fb95806fa50 2023-10-08T00:34:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.852+0000 7fb954ff9700 1 -- 172.21.15.22:0/4285531571 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb948018020 con 0x7fb95806fa50 2023-10-08T00:34:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb944067320 msgr2=0x7fb9440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb944067320 0x7fb9440697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb9580adae0 tx=0x7fb94c009040 comp rx=0 tx=0).stop 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 msgr2=0x7fb9580b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 0x7fb9580b0400 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb94800c7f0 tx=0x7fb9480019e0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 shutdown_connections 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb944067320 0x7fb9440697d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb958156720 0x7fb958154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb95806fa50 0x7fb9580b0400 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 --2- 172.21.15.22:0/4285531571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9580cdcf0 0x7fb9580b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 >> 172.21.15.22:0/4285531571 conn(0x7fb9580694a0 msgr2=0x7fb95814ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 shutdown_connections 2023-10-08T00:34:29.855 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.854+0000 7fb95ec40700 1 -- 172.21.15.22:0/4285531571 wait complete. 2023-10-08T00:34:29.856 INFO:teuthology.orchestra.run.smithi022.stderr:updated caps for client.0 2023-10-08T00:34:29.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:34:29.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.985+0000 7f08d8bef700 1 Processor -- start 2023-10-08T00:34:29.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.985+0000 7f08d8bef700 1 -- start start 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d8bef700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08d406bcd0 0x7f08d4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d8bef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d40c9510 0x7f08d4141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d8bef700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d415c2a0 con 0x7f08d406c0a0 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d8bef700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d415b690 con 0x7f08d406bcd0 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d8bef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d415b970 con 0x7f08d40c9510 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08d406bcd0 0x7f08d4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08d406bcd0 0x7f08d4140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53448/0 (socket says 172.21.15.22:53448) 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 -- 172.21.15.22:0/361177524 learned_addr learned my addr 172.21.15.22:0/361177524 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d2d9d700 1 --2- 172.21.15.22:0/361177524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d40c9510 0x7f08d4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 -- 172.21.15.22:0/361177524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d40c9510 msgr2=0x7f08d4141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 --2- 172.21.15.22:0/361177524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d40c9510 0x7f08d4141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 -- 172.21.15.22:0/361177524 >> v1:172.21.15.192:6789/0 conn(0x7f08d406c0a0 legacy=0x7f08d40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 -- 172.21.15.22:0/361177524 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d415bc50 con 0x7f08d406bcd0 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.986+0000 7f08d259c700 1 --2- 172.21.15.22:0/361177524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d406bcd0 0x7f08d4140df0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f08c40099b0 tx=0x7f08c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8830cf5fd83c2758 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d159a700 1 -- 172.21.15.22:0/361177524 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4009ea0 con 0x7f08d406bcd0 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d159a700 1 -- 172.21.15.22:0/361177524 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400b860 con 0x7f08d406bcd0 2023-10-08T00:34:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d159a700 1 -- 172.21.15.22:0/361177524 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400bc00 con 0x7f08d406bcd0 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 -- 172.21.15.22:0/361177524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d406bcd0 msgr2=0x7f08d4140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 --2- 172.21.15.22:0/361177524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d406bcd0 0x7f08d4140df0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f08c40099b0 tx=0x7f08c4009250 comp rx=0 tx=0).stop 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 -- 172.21.15.22:0/361177524 shutdown_connections 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 --2- 172.21.15.22:0/361177524 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d40c9510 0x7f08d4141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 --2- 172.21.15.22:0/361177524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d406bcd0 0x7f08d4140df0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 -- 172.21.15.22:0/361177524 >> 172.21.15.22:0/361177524 conn(0x7f08d40ce600 msgr2=0x7f08d40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 -- 172.21.15.22:0/361177524 shutdown_connections 2023-10-08T00:34:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.987+0000 7f08d8bef700 1 -- 172.21.15.22:0/361177524 wait complete. 2023-10-08T00:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.988+0000 7f08d8bef700 1 Processor -- start 2023-10-08T00:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.988+0000 7f08d8bef700 1 -- start start 2023-10-08T00:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d8bef700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d406bcd0 0x7f08d4157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d8bef700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08d406c0a0 0x7f08d40c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d8bef700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 0x7f08d4156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d8bef700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40c6420 con 0x7f08d40c9510 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d8bef700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d416be30 con 0x7f08d406c0a0 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d8bef700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d416c110 con 0x7f08d406bcd0 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 0x7f08d4156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 0x7f08d4156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53456/0 (socket says 172.21.15.22:53456) 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 -- 172.21.15.22:0/1317691109 learned_addr learned my addr 172.21.15.22:0/1317691109 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d259c700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d406bcd0 0x7f08d4157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d1d9b700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08d406c0a0 0x7f08d40c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 -- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d406bcd0 msgr2=0x7f08d4157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d406bcd0 0x7f08d4157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 -- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08d406c0a0 msgr2=0x7f08d40c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08d406c0a0 0x7f08d40c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d2d9d700 1 -- 172.21.15.22:0/1317691109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c40094f0 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.989+0000 7f08d1d9b700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08d406c0a0 0x7f08d40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.990+0000 7f08d2d9d700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 0x7f08d4156420 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009df0 tx=0x7f08cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.990+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00cb50 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.990+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00f040 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.990+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc014480 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.990+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d416c3f0 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.990+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d4156960 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.991+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d40b2650 con 0x7f08d40c9510 2023-10-08T00:34:29.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.991+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f08cc014830 con 0x7f08d40c9510 2023-10-08T00:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.991+0000 7f08ca7fc700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f08b4067320 0x7f08b40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.992+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f08cc085690 con 0x7f08d40c9510 2023-10-08T00:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.992+0000 7f08d259c700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f08b4067320 0x7f08b40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.992+0000 7f08d259c700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f08b4067320 0x7f08b40697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f08c40099b0 tx=0x7f08c4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:29.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:29.996+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08d40b2650 con 0x7f08d40c9510 2023-10-08T00:34:30.232 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.232+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08d40b2650 con 0x7f08d40c9510 2023-10-08T00:34:30.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.233+0000 7f08ca7fc700 1 -- 172.21.15.22:0/1317691109 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f08d40b2650 con 0x7f08d40c9510 2023-10-08T00:34:30.233 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:34:30.233 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":136,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:34:24.313262+0000","modified":"2023-10-08T00:34:27.920845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9099":{"gid":9099,"name":"d","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3800835270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3800835270},{"type":"v1","addr":"172.21.15.192:6837","nonce":3800835270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f08b4067320 msgr2=0x7f08b40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f08b4067320 0x7f08b40697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f08c40099b0 tx=0x7f08c4017000 comp rx=0 tx=0).stop 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 msgr2=0x7f08d4156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 0x7f08d4156420 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009df0 tx=0x7f08cc00b040 comp rx=0 tx=0).stop 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 shutdown_connections 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08d40c9510 0x7f08d4156420 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f08b4067320 0x7f08b40697d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f08d406bcd0 0x7f08d4157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 --2- 172.21.15.22:0/1317691109 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08d406c0a0 0x7f08d40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 >> 172.21.15.22:0/1317691109 conn(0x7f08d40ce600 msgr2=0x7f08d40c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 shutdown_connections 2023-10-08T00:34:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.235+0000 7f08d8bef700 1 -- 172.21.15.22:0/1317691109 wait complete. 2023-10-08T00:34:30.237 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 136 2023-10-08T00:34:30.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T00:34:24.313262+0000', 'modified': '2023-10-08T00:34:27.920845+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9099}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9099': {'gid': 9099, 'name': 'd', 'rank': 0, 'incarnation': 132, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/3800835270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 3800835270}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3800835270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T00:34:30.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T00:34:30.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T00:34:30.666 INFO:tasks.ceph.mds.d.smithi192.stderr:2023-10-08T00:34:30.665+0000 7fc8a0193700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:34:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.772+0000 7f0235655700 1 Processor -- start 2023-10-08T00:34:30.773 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.772+0000 7f0235655700 1 -- start start 2023-10-08T00:34:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f0235655700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02301594d0 0x7f02300cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f0235655700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02300b5fb0 0x7f02301598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f0235655700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300d01f0 con 0x7f0230159de0 2023-10-08T00:34:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f0235655700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300cf5e0 con 0x7f02301594d0 2023-10-08T00:34:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f0235655700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300cf8c0 con 0x7f02300b5fb0 2023-10-08T00:34:30.775 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02301594d0 0x7f02300cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02301594d0 0x7f02300cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53458/0 (socket says 172.21.15.22:53458) 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 -- 172.21.15.22:0/656731931 learned_addr learned my addr 172.21.15.22:0/656731931 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022e7fc700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02300b5fb0 0x7f02301598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 -- 172.21.15.22:0/656731931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02300b5fb0 msgr2=0x7f02301598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02300b5fb0 0x7f02301598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 -- 172.21.15.22:0/656731931 >> v1:172.21.15.192:6789/0 conn(0x7f0230159de0 legacy=0x7f023015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022effd700 1 -- 172.21.15.22:0/656731931 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300cfba0 con 0x7f02301594d0 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.773+0000 7f022e7fc700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02300b5fb0 0x7f02301598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f022effd700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02301594d0 0x7f02300cd0f0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f0228009f20 tx=0x7f0228009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b31f7f50e54bb6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f022dffb700 1 -- 172.21.15.22:0/656731931 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e070 con 0x7f02301594d0 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f022dffb700 1 -- 172.21.15.22:0/656731931 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800ba40 con 0x7f02301594d0 2023-10-08T00:34:30.776 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f022dffb700 1 -- 172.21.15.22:0/656731931 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280092e0 con 0x7f02301594d0 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 -- 172.21.15.22:0/656731931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02301594d0 msgr2=0x7f02300cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02301594d0 0x7f02300cd0f0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f0228009f20 tx=0x7f0228009840 comp rx=0 tx=0).stop 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 -- 172.21.15.22:0/656731931 shutdown_connections 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02301594d0 0x7f02300cd0f0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 --2- 172.21.15.22:0/656731931 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02300b5fb0 0x7f02301598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 -- 172.21.15.22:0/656731931 >> 172.21.15.22:0/656731931 conn(0x7f02300d05f0 msgr2=0x7f02300d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 -- 172.21.15.22:0/656731931 shutdown_connections 2023-10-08T00:34:30.777 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.774+0000 7f0235655700 1 -- 172.21.15.22:0/656731931 wait complete. 2023-10-08T00:34:30.779 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 Processor -- start 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 -- start start 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 0x7f0230154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02301594d0 0x7f02300d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0230159de0 0x7f02300d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230158710 con 0x7f02300b5fb0 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230157b00 con 0x7f0230159de0 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.776+0000 7f0235655700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0230157de0 con 0x7f02301594d0 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 0x7f0230154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 0x7f0230154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53464/0 (socket says 172.21.15.22:53464) 2023-10-08T00:34:30.780 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 -- 172.21.15.22:0/15811468 learned_addr learned my addr 172.21.15.22:0/15811468 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 -- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02301594d0 msgr2=0x7f02300d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02301594d0 0x7f02300d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 -- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0230159de0 msgr2=0x7f02300d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0230159de0 0x7f02300d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 -- 172.21.15.22:0/15811468 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009ae0 con 0x7f02300b5fb0 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f022effd700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 0x7f0230154280 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f02300895a0 tx=0x7f0228017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f0226ffd700 1 -- 172.21.15.22:0/15811468 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280094e0 con 0x7f02300b5fb0 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f0226ffd700 1 -- 172.21.15.22:0/15811468 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228012ac0 con 0x7f02300b5fb0 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02301580c0 con 0x7f02300b5fb0 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f0226ffd700 1 -- 172.21.15.22:0/15811468 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228012e80 con 0x7f02300b5fb0 2023-10-08T00:34:30.781 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.777+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230158ba0 con 0x7f02300b5fb0 2023-10-08T00:34:30.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.779+0000 7f0226ffd700 1 -- 172.21.15.22:0/15811468 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f022801d630 con 0x7f02300b5fb0 2023-10-08T00:34:30.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.779+0000 7f0226ffd700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0210067320 0x7f02100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.779+0000 7f0226ffd700 1 -- 172.21.15.22:0/15811468 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f02280864d0 con 0x7f02300b5fb0 2023-10-08T00:34:30.782 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.779+0000 7f022e7fc700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0210067320 0x7f02100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.784 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.780+0000 7f022e7fc700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0210067320 0x7f02100697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f02300ccb80 tx=0x7f0218008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.781+0000 7f023e94db80 1 Processor -- start 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.781+0000 7f023e94db80 1 -- start start 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f023e94db80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa598ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f023e94db80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa4efa70 con 0x55b8fa5e3480 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa4ed270 con 0x55b8fa5965f0 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa4e9060 con 0x55b8fa598b80 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53478/0 (socket says 172.21.15.22:53478) 2023-10-08T00:34:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 -- 172.21.15.22:0/654856196 learned_addr learned my addr 172.21.15.22:0/654856196 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 -- 172.21.15.22:0/654856196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 msgr2=0x55b8fa598ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa598ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 -- 172.21.15.22:0/654856196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 msgr2=0x55b8fa5e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 -- 172.21.15.22:0/654856196 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8fa383270 con 0x55b8fa5e3480 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f022effd700 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c27d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f0228056ca0 tx=0x7f0228056b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da73b2c459efaade server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.782+0000 7f020ffff700 1 -- 172.21.15.22:0/654856196 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e070 con 0x55b8fa5e3480 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f020ffff700 1 -- 172.21.15.22:0/654856196 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228056d10 con 0x55b8fa5e3480 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f020ffff700 1 -- 172.21.15.22:0/654856196 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228059f60 con 0x55b8fa5e3480 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 -- 172.21.15.22:0/654856196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 msgr2=0x55b8fa5c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.786 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c27d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f0228056ca0 tx=0x7f0228056b70 comp rx=0 tx=0).stop 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 -- 172.21.15.22:0/654856196 shutdown_connections 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa598ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c27d0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 --2- 172.21.15.22:0/654856196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 -- 172.21.15.22:0/654856196 >> 172.21.15.22:0/654856196 conn(0x55b8fa59a0c0 msgr2=0x55b8fa59a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 -- 172.21.15.22:0/654856196 shutdown_connections 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.783+0000 7f023e94db80 1 -- 172.21.15.22:0/654856196 wait complete. 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.784+0000 7f023e94db80 1 -- start start 2023-10-08T00:34:30.787 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.784+0000 7f023e94db80 1 Processor -- start 2023-10-08T00:34:30.791 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5965f0 0x55b8fa5c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa5c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa494890 con 0x55b8fa598b80 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa4afea0 con 0x55b8fa5e3480 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa36be30 con 0x55b8fa5965f0 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f023e94db80 10 client.0 _ll_register_callbacks cb 0x55b8fa55c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa5c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa5c1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53492/0 (socket says 172.21.15.22:53492) 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 -- 172.21.15.22:0/3513098566 learned_addr learned my addr 172.21.15.22:0/3513098566 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022effd700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5965f0 0x55b8fa5c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022f7fe700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 -- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5965f0 msgr2=0x55b8fa5c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5965f0 0x55b8fa5c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 -- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 msgr2=0x55b8fa5c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 -- 172.21.15.22:0/3513098566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230158ba0 con 0x55b8fa598b80 2023-10-08T00:34:30.793 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022f7fe700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f022e7fc700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa5c1200 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f021800cfb0 tx=0x7f0218013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be73eaff5ec57ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.785+0000 7f020d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f020d7fa700 1 -- 172.21.15.22:0/3513098566 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218013e50 con 0x55b8fa598b80 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f020d7fa700 1 -- 172.21.15.22:0/3513098566 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f021801e400 con 0x55b8fa598b80 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8fa58dcd0 con 0x55b8fa598b80 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f020d7fa700 1 -- 172.21.15.22:0/3513098566 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f021801e7d0 con 0x55b8fa598b80 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 10 client.9228 fetch_fsmap learned FSMap version 136 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x55b8fa325fe0 con 0x55b8fa598b80 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f020d7fa700 1 -- 172.21.15.22:0/3513098566 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b8fa58dcd0 con 0x55b8fa598b80 2023-10-08T00:34:30.794 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f020d7fa700 1 -- 172.21.15.22:0/3513098566 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f02180113d0 con 0x55b8fa598b80 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 10 client.9228 fetch_fsmap finished waiting for FSMap version 136 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 10 client.9228 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 20 client.9228 populate_metadata read hostname 'smithi022' 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa5e2710 0x55b8fa5e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 4 client.9228 mds_command: new command op to 9099 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 --> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8fa56aaa0 con 0x55b8fa5e2710 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.786+0000 7f022effd700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa5e2710 0x55b8fa5e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.787+0000 7f020d7fa700 10 client.9228 ms_handle_connect on v2:172.21.15.192:6835/3800835270 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.787+0000 7f022effd700 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa5e2710 0x55b8fa5e2ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b314654133cf611 server_cookie=b732cf8bf4e76b93 in_seq=0 out_seq=0 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.787+0000 7f020d7fa700 1 -- 172.21.15.22:0/3513098566 <== mds.0 v2:172.21.15.192:6835/3800835270 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b8fa56aaa0 con 0x55b8fa5e2710 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.787+0000 7f020d7fa700 10 client.9228 handle_command_reply: tid=0 2023-10-08T00:34:30.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.787+0000 7f023e94db80 1 client.9228 shutdown 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.787+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 msgr2=0x55b8fa5c1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa5c1200 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f021800cfb0 tx=0x7f0218013000 comp rx=0 tx=0).stop 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 shutdown_connections 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa5e2710 0x55b8fa5e2ae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5965f0 0x55b8fa5c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 --2- 172.21.15.22:0/3513098566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa5c1200 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f020d7fa700 0 client.9228 ms_handle_reset on v2:172.21.15.192:6835/3800835270 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 >> 172.21.15.22:0/3513098566 conn(0x55b8fa59a0c0 msgr2=0x55b8fa595a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 shutdown_connections 2023-10-08T00:34:30.796 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 1 -- 172.21.15.22:0/3513098566 wait complete. 2023-10-08T00:34:30.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.788+0000 7f023e94db80 20 client.9228 trim_cache size 0 max 16384 2023-10-08T00:34:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 Processor -- start 2023-10-08T00:34:30.805 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 -- start start 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa599140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5e3480 0x55b8fa5de940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa5e1cc0 con 0x55b8fa598b80 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa571410 con 0x55b8fa5965f0 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa58fee0 con 0x55b8fa5e3480 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f022e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa599140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.805+0000 7f022e7fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa599140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53496/0 (socket says 172.21.15.22:53496) 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 -- 172.21.15.22:0/3336503818 learned_addr learned my addr 172.21.15.22:0/3336503818 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.808 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022effd700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022f7fe700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5e3480 0x55b8fa5de940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 -- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5e3480 msgr2=0x55b8fa5de940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5e3480 0x55b8fa5de940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 -- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 msgr2=0x55b8fa5e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 -- 172.21.15.22:0/3336503818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8fa4b7780 con 0x55b8fa598b80 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022f7fe700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5e3480 0x55b8fa5de940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022effd700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f022e7fc700 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa599140 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f021800e010 tx=0x7f0218015030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e792416ac7e4fb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f0224ff9700 1 -- 172.21.15.22:0/3336503818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021801e400 con 0x55b8fa598b80 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f0224ff9700 1 -- 172.21.15.22:0/3336503818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180118e0 con 0x55b8fa598b80 2023-10-08T00:34:30.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.806+0000 7f0224ff9700 1 -- 172.21.15.22:0/3336503818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180113d0 con 0x55b8fa598b80 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 -- 172.21.15.22:0/3336503818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 msgr2=0x55b8fa599140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa599140 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f021800e010 tx=0x7f0218015030 comp rx=0 tx=0).stop 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 -- 172.21.15.22:0/3336503818 shutdown_connections 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa5e3480 0x55b8fa5de940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5965f0 0x55b8fa5e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 --2- 172.21.15.22:0/3336503818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa598b80 0x55b8fa599140 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 -- 172.21.15.22:0/3336503818 >> 172.21.15.22:0/3336503818 conn(0x55b8fa59a0c0 msgr2=0x55b8fa5eea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 -- 172.21.15.22:0/3336503818 shutdown_connections 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 -- 172.21.15.22:0/3336503818 wait complete. 2023-10-08T00:34:30.810 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 -- start start 2023-10-08T00:34:30.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.807+0000 7f023e94db80 1 Processor -- start 2023-10-08T00:34:30.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 0x55b8fa6382b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa6455b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5bad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa5bb870 con 0x55b8fa5965f0 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa63c020 con 0x55b8fa5e3480 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b8fa5c4ff0 con 0x55b8fa598b80 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f023e94db80 10 client.0 _ll_register_callbacks cb 0x55b8fa55c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 0x55b8fa6382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 0x55b8fa6382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53512/0 (socket says 172.21.15.22:53512) 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 -- 172.21.15.22:0/200123919 learned_addr learned my addr 172.21.15.22:0/200123919 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022e7fc700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa6455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022f7fe700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 -- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 msgr2=0x55b8fa6455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa6455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 -- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 msgr2=0x55b8fa5bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022effd700 1 -- 172.21.15.22:0/200123919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8fa325fe0 con 0x55b8fa5965f0 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.808+0000 7f022e7fc700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa6455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f022effd700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 0x55b8fa6382b0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f0228009880 tx=0x7f0228071040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e463461dd197196e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f020d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f020d7fa700 1 -- 172.21.15.22:0/200123919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228083040 con 0x55b8fa5965f0 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f020d7fa700 1 -- 172.21.15.22:0/200123919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f022805dcb0 con 0x55b8fa5965f0 2023-10-08T00:34:30.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0228056d10 con 0x55b8fa5965f0 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f020d7fa700 1 -- 172.21.15.22:0/200123919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0228059f60 con 0x55b8fa5965f0 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 10 client.9234 fetch_fsmap learned FSMap version 136 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x55b8fa49e470 con 0x55b8fa5965f0 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f020d7fa700 1 -- 172.21.15.22:0/200123919 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228056d10 con 0x55b8fa5965f0 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f020d7fa700 1 -- 172.21.15.22:0/200123919 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0228063020 con 0x55b8fa5965f0 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 10 client.9234 fetch_fsmap finished waiting for FSMap version 136 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 10 client.9234 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 20 client.9234 populate_metadata read hostname 'smithi022' 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa59a490 0x55b8fa59a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 4 client.9234 mds_command: new command op to 9099 tid=0[{"prefix": "status"}] 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 --> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b8fa48be00 con 0x55b8fa59a490 2023-10-08T00:34:30.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.809+0000 7f022e7fc700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa59a490 0x55b8fa59a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f022e7fc700 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa59a490 0x55b8fa59a860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e32e5ead65dda02c server_cookie=57e3aec1ea3f2ad4 in_seq=0 out_seq=0 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f020d7fa700 10 client.9234 ms_handle_connect on v2:172.21.15.192:6835/3800835270 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f020d7fa700 1 -- 172.21.15.22:0/200123919 <== mds.0 v2:172.21.15.192:6835/3800835270 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55b8fa48be00 con 0x55b8fa59a490 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f020d7fa700 10 client.9234 handle_command_reply: tid=0 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 client.9234 shutdown 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 msgr2=0x55b8fa6382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 0x55b8fa6382b0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f0228009880 tx=0x7f0228071040 comp rx=0 tx=0).stop 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 shutdown_connections 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:6835/3800835270,v1:172.21.15.192:6837/3800835270] conn(0x55b8fa59a490 0x55b8fa59a860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b8fa5e3480 0x55b8fa5bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b8fa5965f0 0x55b8fa6382b0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 --2- 172.21.15.22:0/200123919 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x55b8fa598b80 0x55b8fa6455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f020d7fa700 0 client.9234 ms_handle_reset on v2:172.21.15.192:6835/3800835270 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 >> 172.21.15.22:0/200123919 conn(0x55b8fa59a0c0 msgr2=0x55b8fa5ee850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 shutdown_connections 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 1 -- 172.21.15.22:0/200123919 wait complete. 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.810+0000 7f023e94db80 20 client.9234 trim_cache size 0 max 16384 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "583a09b5-95bd-4449-bff4-3bbba2592bdd", 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2023-10-08T00:34:30.819 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 9099, 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 5.90264904, 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 136, 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 202, 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 202, 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 10.958624630999999 2023-10-08T00:34:30.820 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:34:30.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0210067320 msgr2=0x7f02100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0210067320 0x7f02100697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f02300ccb80 tx=0x7f0218008040 comp rx=0 tx=0).stop 2023-10-08T00:34:30.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 msgr2=0x7f0230154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 0x7f0230154280 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f02300895a0 tx=0x7f0228017000 comp rx=0 tx=0).stop 2023-10-08T00:34:30.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 shutdown_connections 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0230159de0 0x7f02300d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02300b5fb0 0x7f0230154280 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f0210067320 0x7f02100697d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 --2- 172.21.15.22:0/15811468 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02301594d0 0x7f02300d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 >> 172.21.15.22:0/15811468 conn(0x7f02300d05f0 msgr2=0x7f02300af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 shutdown_connections 2023-10-08T00:34:30.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.811+0000 7f0235655700 1 -- 172.21.15.22:0/15811468 wait complete. 2023-10-08T00:34:30.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:34:30.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.942+0000 7ff5fdf9f700 1 Processor -- start 2023-10-08T00:34:30.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.942+0000 7ff5fdf9f700 1 -- start start 2023-10-08T00:34:30.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5fdf9f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5f8159c60 0x7ff5f815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5fdf9f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff5f815db10 0x7ff5f8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5fdf9f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f815a160 con 0x7ff5f8159890 2023-10-08T00:34:30.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5fdf9f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f815df50 con 0x7ff5f8159c60 2023-10-08T00:34:30.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5fdf9f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80d13a0 con 0x7ff5f815db10 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5f6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5f8159c60 0x7ff5f815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5f77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff5f8159890 0x7ff5f815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54746/0 (socket says 172.21.15.22:54746) 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5f6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff5f8159c60 0x7ff5f815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53516/0 (socket says 172.21.15.22:53516) 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5f77fe700 1 -- 172.21.15.22:0/3950952906 learned_addr learned my addr 172.21.15.22:0/3950952906 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.943+0000 7ff5f7fff700 1 --2- 172.21.15.22:0/3950952906 >> v2:172.21.15.192:3300/0 conn(0x7ff5f815db10 0x7ff5f8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/3950952906 >> v2:172.21.15.192:3300/0 conn(0x7ff5f815db10 msgr2=0x7ff5f8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f6ffd700 1 --2- 172.21.15.22:0/3950952906 >> v2:172.21.15.192:3300/0 conn(0x7ff5f815db10 0x7ff5f8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/3950952906 >> v1:172.21.15.22:6789/0 conn(0x7ff5f8159890 legacy=0x7ff5f815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f67fc700 1 -- 172.21.15.22:0/3950952906 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931513867 0 0) 0x7ff5f815a160 con 0x7ff5f8159890 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/3950952906 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f815e140 con 0x7ff5f8159c60 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f7fff700 1 --2- 172.21.15.22:0/3950952906 >> v2:172.21.15.192:3300/0 conn(0x7ff5f815db10 0x7ff5f8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f6ffd700 1 --2- 172.21.15.22:0/3950952906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f815d5d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7ff5f806a890 tx=0x7ff5ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e28792cedb67530 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f67fc700 1 -- 172.21.15.22:0/3950952906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00b6b0 con 0x7ff5f8159c60 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f67fc700 1 -- 172.21.15.22:0/3950952906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec00b810 con 0x7ff5f8159c60 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5f67fc700 1 -- 172.21.15.22:0/3950952906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00bbb0 con 0x7ff5f8159c60 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/3950952906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 msgr2=0x7ff5f815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/3950952906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f815d5d0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7ff5f806a890 tx=0x7ff5ec0091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/3950952906 shutdown_connections 2023-10-08T00:34:30.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/3950952906 >> v2:172.21.15.192:3300/0 conn(0x7ff5f815db10 0x7ff5f8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/3950952906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f815d5d0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/3950952906 >> 172.21.15.22:0/3950952906 conn(0x7ff5f8068e20 msgr2=0x7ff5f80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:30.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/3950952906 shutdown_connections 2023-10-08T00:34:30.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.944+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/3950952906 wait complete. 2023-10-08T00:34:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 Processor -- start 2023-10-08T00:34:30.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 -- start start 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5f8159890 0x7ff5f814a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f8151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5f815db10 0x7ff5f814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80b12b0 con 0x7ff5f8159c60 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80b06c0 con 0x7ff5f8159890 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.946+0000 7ff5fdf9f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80b0980 con 0x7ff5f815db10 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f8151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f8151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53524/0 (socket says 172.21.15.22:53524) 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/2681599053 learned_addr learned my addr 172.21.15.22:0/2681599053 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f7fff700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5f815db10 0x7ff5f814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f77fe700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5f8159890 0x7ff5f814a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5f815db10 msgr2=0x7ff5f814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5f815db10 0x7ff5f814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5f8159890 msgr2=0x7ff5f814a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5f8159890 0x7ff5f814a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 -- 172.21.15.22:0/2681599053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009420 con 0x7ff5f8159c60 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f77fe700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5f8159890 0x7ff5f814a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5f6ffd700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f8151d30 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8070e20 tx=0x7ff5ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00bb90 con 0x7ff5f8159c60 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec011420 con 0x7ff5f8159c60 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f80b0c60 con 0x7ff5f8159c60 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0117a0 con 0x7ff5f8159c60 2023-10-08T00:34:30.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.947+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f814a9a0 con 0x7ff5f8159c60 2023-10-08T00:34:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.948+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f804c3c0 con 0x7ff5f8159c60 2023-10-08T00:34:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.949+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff5ec011b90 con 0x7ff5f8159c60 2023-10-08T00:34:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.949+0000 7ff5df7fe700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff5e4067320 0x7ff5e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.949+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5ec0865c0 con 0x7ff5f8159c60 2023-10-08T00:34:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.949+0000 7ff5f77fe700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff5e4067320 0x7ff5e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:30.954 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.950+0000 7ff5f77fe700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff5e4067320 0x7ff5e40697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff5f816cf40 tx=0x7ff5e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:30.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:30.953+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5ec0533d0 con 0x7ff5f8159c60 2023-10-08T00:34:31.192 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.191+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff5f80b13f0 con 0x7ff5f8159c60 2023-10-08T00:34:31.193 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.192+0000 7ff5df7fe700 1 -- 172.21.15.22:0/2681599053 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v136) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff5ec0569f0 con 0x7ff5f8159c60 2023-10-08T00:34:31.193 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:34:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff5e4067320 msgr2=0x7ff5e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff5e4067320 0x7ff5e40697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff5f816cf40 tx=0x7ff5e8009040 comp rx=0 tx=0).stop 2023-10-08T00:34:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 msgr2=0x7ff5f8151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f8151d30 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8070e20 tx=0x7ff5ec017000 comp rx=0 tx=0).stop 2023-10-08T00:34:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 shutdown_connections 2023-10-08T00:34:31.195 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff5e4067320 0x7ff5e40697d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff5f815db10 0x7ff5f814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff5f8159890 0x7ff5f814a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 --2- 172.21.15.22:0/2681599053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5f8159c60 0x7ff5f8151d30 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.193+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 >> 172.21.15.22:0/2681599053 conn(0x7ff5f8068e20 msgr2=0x7ff5f81579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.194+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 shutdown_connections 2023-10-08T00:34:31.196 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:31.194+0000 7ff5fdf9f700 1 -- 172.21.15.22:0/2681599053 wait complete. 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:34:31.207 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:34:31.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.208 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2023-10-08T00:34:31.226 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:34:31.366 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:34:31.366 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:34:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2023-10-08T00:34:31.369 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.369 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T00:34:31.370 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 41900sec preferred_lft 41900sec 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2023-10-08T00:34:31.371 INFO:teuthology.orchestra.run.smithi022.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::581c:64ff:fe1e:906a/64 scope link 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether ee:44:fb:0f:0c:15 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec44:fbff:fe0f:c15/64 scope link 2023-10-08T00:34:31.372 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.373 INFO:teuthology.orchestra.run.smithi022.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:31.373 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether fe:26:80:cc:a1:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:34:31.373 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::fc26:80ff:fecc:a1b2/64 scope link 2023-10-08T00:34:31.373 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:31.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.374 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:34:31.401 INFO:teuthology.orchestra.run.smithi022.stdout:1 2023-10-08T00:34:31.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.403 DEBUG:teuthology.orchestra.run.smithi022:> route 2023-10-08T00:34:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2023-10-08T00:34:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:34:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T00:34:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T00:34:31.463 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:34:31.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.464 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec bash -c ' 2023-10-08T00:34:31.464 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2023-10-08T00:34:31.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T00:34:31.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T00:34:31.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T00:34:31.465 DEBUG:teuthology.orchestra.run.smithi022:> ') 2023-10-08T00:34:31.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.568 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:34:31.583 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:34:31.583 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:34:31.583 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:34:31.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.584 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2023-10-08T00:34:31.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:31.648 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:31.703 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T00:34:31.703 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:31.704 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:31.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T00:34:31.758 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:34:31.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:31.839 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:31.840 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:31.858 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:31.859 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:31.881 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:31.882 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:31.882 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:31.882 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:31.883 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:31.883 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:31.883 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:31.883 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:31.884 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:34:31.884 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:34:31.884 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:34:31.885 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:34:31.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:31.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:31.952 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T00:34:32.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.110+0000 7fe67c434700 1 Processor -- start 2023-10-08T00:34:32.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.111+0000 7fe67c434700 1 -- start start 2023-10-08T00:34:32.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.111+0000 7fe67c434700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe674159840 0x7fe6740cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:32.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.111+0000 7fe67c434700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6740cba70 0x7fe6740694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:32.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.111+0000 7fe67c434700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740cfb30 con 0x7fe674159c10 2023-10-08T00:34:32.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.111+0000 7fe67c434700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740cbf10 con 0x7fe674159840 2023-10-08T00:34:32.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.111+0000 7fe67c434700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740cf4e0 con 0x7fe6740cba70 2023-10-08T00:34:32.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe674159840 0x7fe6740cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe674159840 0x7fe6740cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53536/0 (socket says 172.21.15.22:53536) 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 -- 172.21.15.22:0/4112432549 learned_addr learned my addr 172.21.15.22:0/4112432549 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe6799cf700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6740cba70 0x7fe6740694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 -- 172.21.15.22:0/4112432549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6740cba70 msgr2=0x7fe6740694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6740cba70 0x7fe6740694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 -- 172.21.15.22:0/4112432549 >> v1:172.21.15.192:6789/0 conn(0x7fe674159c10 legacy=0x7fe6740ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 -- 172.21.15.22:0/4112432549 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740cf7c0 con 0x7fe674159840 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe6799cf700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6740cba70 0x7fe6740694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe67a1d0700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159840 0x7fe6740cb530 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0099b0 tx=0x7fe66c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df48e4c8582830fb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe6791ce700 1 -- 172.21.15.22:0/4112432549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00b820 con 0x7fe674159840 2023-10-08T00:34:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe6791ce700 1 -- 172.21.15.22:0/4112432549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00b980 con 0x7fe674159840 2023-10-08T00:34:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.112+0000 7fe6791ce700 1 -- 172.21.15.22:0/4112432549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00bd40 con 0x7fe674159840 2023-10-08T00:34:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 -- 172.21.15.22:0/4112432549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159840 msgr2=0x7fe6740cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159840 0x7fe6740cb530 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0099b0 tx=0x7fe66c009250 comp rx=0 tx=0).stop 2023-10-08T00:34:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 -- 172.21.15.22:0/4112432549 shutdown_connections 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159840 0x7fe6740cb530 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 --2- 172.21.15.22:0/4112432549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6740cba70 0x7fe6740694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 -- 172.21.15.22:0/4112432549 >> 172.21.15.22:0/4112432549 conn(0x7fe674068e10 msgr2=0x7fe6740d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 -- 172.21.15.22:0/4112432549 shutdown_connections 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.113+0000 7fe67c434700 1 -- 172.21.15.22:0/4112432549 wait complete. 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.114+0000 7fe67c434700 1 Processor -- start 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.114+0000 7fe67c434700 1 -- start start 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6740cba70 0x7fe6740b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe674159840 0x7fe6740c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 0x7fe6740b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c8ec0 con 0x7fe674159c10 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c9780 con 0x7fe6740cba70 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c7940 con 0x7fe674159840 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 0x7fe6740b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 0x7fe6740b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53546/0 (socket says 172.21.15.22:53546) 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 -- 172.21.15.22:0/2416397795 learned_addr learned my addr 172.21.15.22:0/2416397795 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe6799cf700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe674159840 0x7fe6740c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a1d0700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6740cba70 0x7fe6740b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 -- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe674159840 msgr2=0x7fe6740c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe674159840 0x7fe6740c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 -- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6740cba70 msgr2=0x7fe6740b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6740cba70 0x7fe6740b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 -- 172.21.15.22:0/2416397795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c0094f0 con 0x7fe674159c10 2023-10-08T00:34:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67a9d1700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 0x7fe6740b5720 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fe66400bc30 tx=0x7fe664009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400c840 con 0x7fe674159c10 2023-10-08T00:34:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400c9e0 con 0x7fe674159c10 2023-10-08T00:34:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740b5c60 con 0x7fe674159c10 2023-10-08T00:34:32.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.115+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400cda0 con 0x7fe674159c10 2023-10-08T00:34:32.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.116+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6740b3e40 con 0x7fe674159c10 2023-10-08T00:34:32.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.116+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe674064550 con 0x7fe674159c10 2023-10-08T00:34:32.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.117+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe664014620 con 0x7fe674159c10 2023-10-08T00:34:32.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.117+0000 7fe6727fc700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe660067320 0x7fe6600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:32.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.117+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe664084ba0 con 0x7fe674159c10 2023-10-08T00:34:32.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.117+0000 7fe67a1d0700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe660067320 0x7fe6600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:32.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.118+0000 7fe67a1d0700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe660067320 0x7fe6600697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0099b0 tx=0x7fe66c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:32.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.122+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe664051830 con 0x7fe674159c10 2023-10-08T00:34:32.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:34:32.258 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:34:32.363 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.363+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6740c7ab0 con 0x7fe674159c10 2023-10-08T00:34:32.364 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.363+0000 7fe6727fc700 1 -- 172.21.15.22:0/2416397795 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v136) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe664054e50 con 0x7fe674159c10 2023-10-08T00:34:32.364 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T00:34:32.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe660067320 msgr2=0x7fe6600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:32.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe660067320 0x7fe6600697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0099b0 tx=0x7fe66c016000 comp rx=0 tx=0).stop 2023-10-08T00:34:32.366 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 msgr2=0x7fe6740b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 0x7fe6740b5720 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fe66400bc30 tx=0x7fe664009820 comp rx=0 tx=0).stop 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 shutdown_connections 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe674159c10 0x7fe6740b5720 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6740cba70 0x7fe6740b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe660067320 0x7fe6600697d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.365+0000 7fe67c434700 1 --2- 172.21.15.22:0/2416397795 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe674159840 0x7fe6740c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.366+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 >> 172.21.15.22:0/2416397795 conn(0x7fe674068e10 msgr2=0x7fe6740c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.366+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 shutdown_connections 2023-10-08T00:34:32.367 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:32.366+0000 7fe67c434700 1 -- 172.21.15.22:0/2416397795 wait complete. 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T00:34:32.378 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T00:34:32.379 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:34:32.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.379 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2023-10-08T00:34:32.395 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2023-10-08T00:34:32.396 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 41903sec preferred_lft 41903sec 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.397 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::947d:40ff:fe81:425/64 scope link 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether aa:fb:2b:67:b7:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::a8fb:2bff:fe67:b7f9/64 scope link 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 26:a6:d3:01:af:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::24a6:d3ff:fe01:af4b/64 scope link 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2023-10-08T00:34:32.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.399 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T00:34:32.461 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-10-08T00:34:32.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.463 DEBUG:teuthology.orchestra.run.smithi192:> route 2023-10-08T00:34:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2023-10-08T00:34:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T00:34:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-08T00:34:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-08T00:34:32.520 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T00:34:32.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.521 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2023-10-08T00:34:32.521 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2023-10-08T00:34:32.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-08T00:34:32.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-08T00:34:32.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-08T00:34:32.521 DEBUG:teuthology.orchestra.run.smithi192:> ') 2023-10-08T00:34:32.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.624 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:34:32.638 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:34:32.638 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:34:32.639 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:34:32.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.639 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2023-10-08T00:34:32.703 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:32.703 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:32.758 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T00:34:32.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T00:34:32.759 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:32.814 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T00:34:32.814 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T00:34:32.814 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:32.894 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:32.895 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:32.913 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:32.913 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:32.913 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:32.913 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:32.913 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:32.914 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:32.914 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:32.914 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:32.935 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T00:34:32.935 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T00:34:32.935 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.192:3300,172.21.15.192:3301" 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 1@583a09b5-95bd-4449-bff4-3bbba2592bdd.cephfs=/ 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.22:3300/172.21.15.192:3300/172.21.15.192:3301" will pass to kernel 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: v2 mount support check returned 2 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790" 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.22:6789,172.21.15.192:6789,172.21.15.192:6790:/ 2023-10-08T00:34:32.936 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=583a09b5-95bd-4449-bff4-3bbba2592bdd" will pass to kernel 2023-10-08T00:34:32.937 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T00:34:32.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:32.938 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:33.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-08T00:34:33.136 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.136+0000 7f9a5653e700 1 Processor -- start 2023-10-08T00:34:33.137 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.136+0000 7f9a5653e700 1 -- start start 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a5653e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 0x7f9a500b2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a5653e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a50154320 0x7f9a5006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a5653e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a500b4570 con 0x7f9a5015a190 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a5653e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5015a730 con 0x7f9a50154320 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a5653e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5015aa10 con 0x7f9a50153f50 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 0x7f9a500b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a50154320 0x7f9a5006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:33.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 0x7f9a500b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:42454/0 (socket says 172.21.15.22:42454) 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4ffff700 1 -- 172.21.15.22:0/1561732628 learned_addr learned my addr 172.21.15.22:0/1561732628 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4f7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9a50154320 0x7f9a5006d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:44712/0 (socket says 172.21.15.22:44712) 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a54adb700 1 --1- 172.21.15.22:0/1561732628 >> v1:172.21.15.192:6789/0 conn(0x7f9a5015a190 0x7f9a5015d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:40218/0 (socket says 172.21.15.22:40218) 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4f7fe700 1 -- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 msgr2=0x7f9a500b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4f7fe700 1 --2- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 0x7f9a500b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4f7fe700 1 -- 172.21.15.22:0/1561732628 >> v1:172.21.15.192:6789/0 conn(0x7f9a5015a190 legacy=0x7f9a5015d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4f7fe700 1 -- 172.21.15.22:0/1561732628 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5015acf0 con 0x7f9a50154320 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4ffff700 1 --2- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 0x7f9a500b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.137+0000 7f9a4effd700 1 -- 172.21.15.22:0/1561732628 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637808145 0 0) 0x7f9a500b4570 con 0x7f9a5015a190 2023-10-08T00:34:33.140 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a4f7fe700 1 --2- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5006d130 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9a440098e0 tx=0x7f9a440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b685dad9c1b1996e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a4effd700 1 -- 172.21.15.22:0/1561732628 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400b640 con 0x7f9a50154320 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a4effd700 1 -- 172.21.15.22:0/1561732628 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4400b7a0 con 0x7f9a50154320 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a4effd700 1 -- 172.21.15.22:0/1561732628 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4400bb40 con 0x7f9a50154320 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 -- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 msgr2=0x7f9a5006d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 --2- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5006d130 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9a440098e0 tx=0x7f9a440091a0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 -- 172.21.15.22:0/1561732628 shutdown_connections 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 --2- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a50153f50 0x7f9a500b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 --2- 172.21.15.22:0/1561732628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5006d130 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 -- 172.21.15.22:0/1561732628 >> 172.21.15.22:0/1561732628 conn(0x7f9a5006baf0 msgr2=0x7f9a5006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 -- 172.21.15.22:0/1561732628 shutdown_connections 2023-10-08T00:34:33.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.138+0000 7f9a5653e700 1 -- 172.21.15.22:0/1561732628 wait complete. 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.139+0000 7f9a5653e700 1 Processor -- start 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 -- start start 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 0x7f9a501452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5015a190 0x7f9a5015edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500ced10 con 0x7f9a50153f50 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5015c570 con 0x7f9a50154320 2023-10-08T00:34:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.140+0000 7f9a5653e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50145800 con 0x7f9a5015a190 2023-10-08T00:34:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 0x7f9a501452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 0x7f9a501452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53554/0 (socket says 172.21.15.22:53554) 2023-10-08T00:34:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 -- 172.21.15.22:0/2637874732 learned_addr learned my addr 172.21.15.22:0/2637874732 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4f7fe700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a54adb700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5015a190 0x7f9a5015edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 -- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5015a190 msgr2=0x7f9a5015edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5015a190 0x7f9a5015edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 -- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 msgr2=0x7f9a5015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5015e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 -- 172.21.15.22:0/2637874732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400094f0 con 0x7f9a50153f50 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a4ffff700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 0x7f9a501452c0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000ec50 tx=0x7f9a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000c850 con 0x7f9a50153f50 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000c9b0 con 0x7f9a50153f50 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a44009420 con 0x7f9a50153f50 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000cd50 con 0x7f9a50153f50 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.141+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a500cb620 con 0x7f9a50153f50 2023-10-08T00:34:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.142+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5015c850 con 0x7f9a50153f50 2023-10-08T00:34:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.143+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9a40013680 con 0x7f9a50153f50 2023-10-08T00:34:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.143+0000 7f9a37fff700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9a3c067320 0x7f9a3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.143+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a40084f70 con 0x7f9a50153f50 2023-10-08T00:34:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.143+0000 7f9a4f7fe700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9a3c067320 0x7f9a3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.144+0000 7f9a4f7fe700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9a3c067320 0x7f9a3c0697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9a50154770 tx=0x7f9a44017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:33.148 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.148+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a40051c00 con 0x7f9a50153f50 2023-10-08T00:34:33.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.388+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9a500718b0 con 0x7f9a50153f50 2023-10-08T00:34:33.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.859+0000 7f9a37fff700 1 -- 172.21.15.22:0/2637874732 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v137) v1 ==== 136+0+0 (secure 0 0 0) 0x7f9a40055220 con 0x7f9a50153f50 2023-10-08T00:34:33.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9a3c067320 msgr2=0x7f9a3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9a3c067320 0x7f9a3c0697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9a50154770 tx=0x7f9a44017000 comp rx=0 tx=0).stop 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 msgr2=0x7f9a501452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 0x7f9a501452c0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000ec50 tx=0x7f9a40009250 comp rx=0 tx=0).stop 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 shutdown_connections 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9a3c067320 0x7f9a3c0697d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9a5015a190 0x7f9a5015edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a50153f50 0x7f9a501452c0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 --2- 172.21.15.22:0/2637874732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a50154320 0x7f9a5015e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 >> 172.21.15.22:0/2637874732 conn(0x7f9a5006baf0 msgr2=0x7f9a501533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 shutdown_connections 2023-10-08T00:34:33.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:33.863+0000 7f9a5653e700 1 -- 172.21.15.22:0/2637874732 wait complete. 2023-10-08T00:34:33.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T00:34:34.002 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.002+0000 7fc7221e8700 1 Processor -- start 2023-10-08T00:34:34.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.002+0000 7fc7221e8700 1 -- start start 2023-10-08T00:34:34.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc7221e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 0x7fc71c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc7221e8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71c069ee0 con 0x7fc71c159c60 2023-10-08T00:34:34.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc7221e8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71c15a160 con 0x7fc71c159890 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc7221e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0d13a0 con 0x7fc71c069560 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc71c159c60 0x7fc71c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:54750/0 (socket says 172.21.15.22:54750) 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71affd700 1 -- 172.21.15.22:0/3861130739 learned_addr learned my addr 172.21.15.22:0/3861130739 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71bfff700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 0x7fc71c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723613130 0 0) 0x7fc71c069ee0 con 0x7fc71c159c60 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc704003570 con 0x7fc71c159c60 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2999302373 0 0) 0x7fc704003570 con 0x7fc71c159c60 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 msgr2=0x7fc71c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 0x7fc71c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 >> v1:172.21.15.192:6789/0 conn(0x7fc71c159890 legacy=0x7fc71c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c15e140 con 0x7fc71c159c60 2023-10-08T00:34:34.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7fc710001470 con 0x7fc71c159c60 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 >> v1:172.21.15.22:6789/0 conn(0x7fc71c159c60 legacy=0x7fc71c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc704003a90 0x7fc704003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 0x7fc704004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704004d50 0x7fc7040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0d13a0 con 0x7fc704003a90 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70400bb40 con 0x7fc704004d50 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.003+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70400bd00 con 0x7fc71c069560 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc704003a90 0x7fc704003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71affd700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 0x7fc704004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71bfff700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704004d50 0x7fc7040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 -- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 msgr2=0x7fc704004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.008 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c069560 0x7fc704004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 -- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704004d50 msgr2=0x7fc7040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704004d50 0x7fc7040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 -- 172.21.15.22:0/3861130739 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704003570 con 0x7fc704003a90 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71bfff700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704004d50 0x7fc7040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc704003a90 0x7fc704003e60 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fc70c001970 tx=0x7fc70c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df648f76087e9164 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00c5d0 con 0x7fc704003a90 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c00c730 con 0x7fc704003a90 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.004+0000 7fc71a7fc700 1 -- 172.21.15.22:0/3861130739 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00caf0 con 0x7fc704003a90 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc7221e8700 1 -- 172.21.15.22:0/3861130739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc704003a90 msgr2=0x7fc704003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc7221e8700 1 --2- 172.21.15.22:0/3861130739 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc704003a90 0x7fc704003e60 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fc70c001970 tx=0x7fc70c007d30 comp rx=0 tx=0).stop 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc71bfff700 1 -- 172.21.15.22:0/3861130739 reap_dead start 2023-10-08T00:34:34.009 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc7221e8700 1 -- 172.21.15.22:0/3861130739 shutdown_connections 2023-10-08T00:34:34.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc7221e8700 1 -- 172.21.15.22:0/3861130739 >> 172.21.15.22:0/3861130739 conn(0x7fc71c068e20 msgr2=0x7fc71c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:34.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc7221e8700 1 -- 172.21.15.22:0/3861130739 shutdown_connections 2023-10-08T00:34:34.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.005+0000 7fc7221e8700 1 -- 172.21.15.22:0/3861130739 wait complete. 2023-10-08T00:34:34.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.006+0000 7fc7221e8700 1 Processor -- start 2023-10-08T00:34:34.010 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.006+0000 7fc7221e8700 1 -- start start 2023-10-08T00:34:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc7221e8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704003a90 0x7fc71c14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc7221e8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 0x7fc71c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc7221e8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c151cb0 0x7fc71c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc7221e8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c15f960 con 0x7fc71c0ce810 2023-10-08T00:34:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc7221e8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c152640 con 0x7fc704003a90 2023-10-08T00:34:34.012 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc7221e8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c15fdf0 con 0x7fc71c151cb0 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 0x7fc71c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 0x7fc71c15e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53566/0 (socket says 172.21.15.22:53566) 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 -- 172.21.15.22:0/1648372388 learned_addr learned my addr 172.21.15.22:0/1648372388 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71bfff700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c151cb0 0x7fc71c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704003a90 0x7fc71c14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 -- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c151cb0 msgr2=0x7fc71c152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c151cb0 0x7fc71c152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 -- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704003a90 msgr2=0x7fc71c14f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704003a90 0x7fc71c14f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 -- 172.21.15.22:0/1648372388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c15ed50 con 0x7fc71c0ce810 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.007+0000 7fc71affd700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 0x7fc71c15e420 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fc7100073c0 tx=0x7fc710001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.013 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.008+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710018030 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.008+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7100077a0 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.008+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c15f030 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.008+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71000fa20 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.008+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c15f5f0 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.009+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c04c3c0 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.009+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc71001b070 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.010+0000 7fc7037fe700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc708067320 0x7fc7080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.010+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc710019070 con 0x7fc71c0ce810 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.010+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc708067320 0x7fc7080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.014 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.010+0000 7fc71b7fe700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc708067320 0x7fc7080697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc70c001410 tx=0x7fc70c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.014+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc710051620 con 0x7fc71c0ce810 2023-10-08T00:34:34.236 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.235+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc71c06a5b0 con 0x7fc708067320 2023-10-08T00:34:34.238 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.237+0000 7fc7037fe700 1 -- 172.21.15.22:0/1648372388 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc71c06a5b0 con 0x7fc708067320 2023-10-08T00:34:34.238 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2023-10-08T00:34:34.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2023-10-08T00:34:34.238 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephfs" 2023-10-08T00:34:34.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2023-10-08T00:34:34.239 INFO:teuthology.orchestra.run.smithi022.stdout:] 2023-10-08T00:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc708067320 msgr2=0x7fc7080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc708067320 0x7fc7080697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc70c001410 tx=0x7fc70c015000 comp rx=0 tx=0).stop 2023-10-08T00:34:34.240 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 msgr2=0x7fc71c15e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 0x7fc71c15e420 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fc7100073c0 tx=0x7fc710001e70 comp rx=0 tx=0).stop 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 shutdown_connections 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fc708067320 0x7fc7080697d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fc71c151cb0 0x7fc71c152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc704003a90 0x7fc71c14f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 --2- 172.21.15.22:0/1648372388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc71c0ce810 0x7fc71c15e420 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.241 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 >> 172.21.15.22:0/1648372388 conn(0x7fc71c068e20 msgr2=0x7fc71c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 shutdown_connections 2023-10-08T00:34:34.242 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.239+0000 7fc7221e8700 1 -- 172.21.15.22:0/1648372388 wait complete. 2023-10-08T00:34:34.252 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T00:34:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.374+0000 7ff67f5d1700 1 Processor -- start 2023-10-08T00:34:34.374 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.374+0000 7ff67f5d1700 1 -- start start 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67f5d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67806c0a0 0x7ff6780caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67f5d1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff67815df50 0x7ff67815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67f5d1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67815d7e0 con 0x7ff67806bcd0 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67f5d1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67815dac0 con 0x7ff67815df50 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67f5d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67815aa30 con 0x7ff67806c0a0 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff67815df50 0x7ff67815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff67815df50 0x7ff67815e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53570/0 (socket says 172.21.15.22:53570) 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 -- 172.21.15.22:0/2663357924 learned_addr learned my addr 172.21.15.22:0/2663357924 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67cb6c700 1 --2- 172.21.15.22:0/2663357924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67806c0a0 0x7ff6780caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.377 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 -- 172.21.15.22:0/2663357924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67806c0a0 msgr2=0x7ff6780caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 --2- 172.21.15.22:0/2663357924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67806c0a0 0x7ff6780caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 -- 172.21.15.22:0/2663357924 >> v1:172.21.15.192:6789/0 conn(0x7ff67806bcd0 legacy=0x7ff67815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 -- 172.21.15.22:0/2663357924 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67815ad10 con 0x7ff67815df50 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff67db6e700 1 --2- 172.21.15.22:0/2663357924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67815df50 0x7ff67815e3c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff6700099b0 tx=0x7ff670009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ccdabc5527210f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff677fff700 1 -- 172.21.15.22:0/2663357924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000b820 con 0x7ff67815df50 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff677fff700 1 -- 172.21.15.22:0/2663357924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000b980 con 0x7ff67815df50 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.375+0000 7ff677fff700 1 -- 172.21.15.22:0/2663357924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000bd40 con 0x7ff67815df50 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2663357924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67815df50 msgr2=0x7ff67815e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2663357924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67815df50 0x7ff67815e3c0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7ff6700099b0 tx=0x7ff670009250 comp rx=0 tx=0).stop 2023-10-08T00:34:34.378 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2663357924 shutdown_connections 2023-10-08T00:34:34.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2663357924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67815df50 0x7ff67815e3c0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2663357924 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67806c0a0 0x7ff6780caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2663357924 >> 172.21.15.22:0/2663357924 conn(0x7ff6780ce600 msgr2=0x7ff6780cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:34.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2663357924 shutdown_connections 2023-10-08T00:34:34.379 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.376+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2663357924 wait complete. 2023-10-08T00:34:34.381 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.377+0000 7ff67f5d1700 1 Processor -- start 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.377+0000 7ff67f5d1700 1 -- start start 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67f5d1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 0x7ff6781492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67f5d1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67806c0a0 0x7ff678159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67f5d1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67815df50 0x7ff678159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67f5d1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff678149820 con 0x7ff67806bcd0 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67f5d1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67816d490 con 0x7ff67806c0a0 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67f5d1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff678154480 con 0x7ff67815df50 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 0x7ff6781492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 0x7ff6781492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53584/0 (socket says 172.21.15.22:53584) 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 -- 172.21.15.22:0/2185921151 learned_addr learned my addr 172.21.15.22:0/2185921151 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67db6e700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67815df50 0x7ff678159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.382 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67cb6c700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67806c0a0 0x7ff678159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 -- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67815df50 msgr2=0x7ff678159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67815df50 0x7ff678159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 -- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67806c0a0 msgr2=0x7ff678159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67806c0a0 0x7ff678159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.378+0000 7ff67d36d700 1 -- 172.21.15.22:0/2185921151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6700094f0 con 0x7ff67806bcd0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.379+0000 7ff67d36d700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 0x7ff6781492e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff66800bc60 tx=0x7ff668009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.379+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800c840 con 0x7ff67806bcd0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.379+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66800c9a0 con 0x7ff67806bcd0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.379+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800cda0 con 0x7ff67806bcd0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.379+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67816e1e0 con 0x7ff67806bcd0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.379+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67816d9e0 con 0x7ff67806bcd0 2023-10-08T00:34:34.383 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.380+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67804c3c0 con 0x7ff67806bcd0 2023-10-08T00:34:34.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.380+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff668014620 con 0x7ff67806bcd0 2023-10-08T00:34:34.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.381+0000 7ff6757fa700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff664067320 0x7ff6640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.381+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff668084c00 con 0x7ff67806bcd0 2023-10-08T00:34:34.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.381+0000 7ff67cb6c700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff664067320 0x7ff6640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.384 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.381+0000 7ff67cb6c700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff664067320 0x7ff6640697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff6780b0f20 tx=0x7ff66c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.385 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.385+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff66804c5a0 con 0x7ff67806bcd0 2023-10-08T00:34:34.579 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.579+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff67815b020 con 0x7ff67806bcd0 2023-10-08T00:34:34.580 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.579+0000 7ff6757fa700 1 -- 172.21.15.22:0/2185921151 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff668051890 con 0x7ff67806bcd0 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff664067320 msgr2=0x7ff6640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff664067320 0x7ff6640697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff6780b0f20 tx=0x7ff66c008040 comp rx=0 tx=0).stop 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 msgr2=0x7ff6781492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 0x7ff6781492e0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7ff66800bc60 tx=0x7ff668009820 comp rx=0 tx=0).stop 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 shutdown_connections 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff664067320 0x7ff6640697d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.582 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff67815df50 0x7ff678159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff67806bcd0 0x7ff6781492e0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 --2- 172.21.15.22:0/2185921151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff67806c0a0 0x7ff678159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 >> 172.21.15.22:0/2185921151 conn(0x7ff6780ce600 msgr2=0x7ff678154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 shutdown_connections 2023-10-08T00:34:34.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.581+0000 7ff67f5d1700 1 -- 172.21.15.22:0/2185921151 wait complete. 2023-10-08T00:34:34.594 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T00:34:34.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:34:34.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T00:34:34.634 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:34:34.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:34.635 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T00:34:34.690 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T00:34:34.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T00:34:34.691 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-08T00:34:34.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:34:34.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:34.743 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T00:34:34.760 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:34:34.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:34.760 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T00:34:34.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:34:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-08T00:34:34.775 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:34:34.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:34:34.776 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T00:34:34.816 INFO:teuthology.orchestra.run.smithi192.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-08T00:34:34.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:34:34.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs 2023-10-08T00:34:34.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.940+0000 7ff819d4a700 1 Processor -- start 2023-10-08T00:34:34.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.940+0000 7ff819d4a700 1 -- start start 2023-10-08T00:34:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff819d4a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff81406c0a0 0x7ff8140caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff819d4a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff81415df50 0x7ff81415e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff819d4a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81415d7e0 con 0x7ff81406bcd0 2023-10-08T00:34:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff819d4a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81415dac0 con 0x7ff81406c0a0 2023-10-08T00:34:34.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff819d4a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81415aa30 con 0x7ff81415df50 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff812ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff81406c0a0 0x7ff8140caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff812ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff81406c0a0 0x7ff8140caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53590/0 (socket says 172.21.15.22:53590) 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff812ffd700 1 -- 172.21.15.22:0/1524951051 learned_addr learned my addr 172.21.15.22:0/1524951051 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff813fff700 1 --2- 172.21.15.22:0/1524951051 >> v2:172.21.15.192:3300/0 conn(0x7ff81415df50 0x7ff81415e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff812ffd700 1 -- 172.21.15.22:0/1524951051 >> v2:172.21.15.192:3300/0 conn(0x7ff81415df50 msgr2=0x7ff81415e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.941+0000 7ff812ffd700 1 --2- 172.21.15.22:0/1524951051 >> v2:172.21.15.192:3300/0 conn(0x7ff81415df50 0x7ff81415e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff812ffd700 1 -- 172.21.15.22:0/1524951051 >> v1:172.21.15.192:6789/0 conn(0x7ff81406bcd0 legacy=0x7ff81415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff812ffd700 1 -- 172.21.15.22:0/1524951051 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81415ad10 con 0x7ff81406c0a0 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff813fff700 1 --2- 172.21.15.22:0/1524951051 >> v2:172.21.15.192:3300/0 conn(0x7ff81415df50 0x7ff81415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff812ffd700 1 --2- 172.21.15.22:0/1524951051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140caa90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff81415d720 tx=0x7ff808009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129ef589b998eca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff8127fc700 1 -- 172.21.15.22:0/1524951051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800b820 con 0x7ff81406c0a0 2023-10-08T00:34:34.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff8127fc700 1 -- 172.21.15.22:0/1524951051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800b980 con 0x7ff81406c0a0 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff8127fc700 1 -- 172.21.15.22:0/1524951051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800bd40 con 0x7ff81406c0a0 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 -- 172.21.15.22:0/1524951051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 msgr2=0x7ff8140caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 --2- 172.21.15.22:0/1524951051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140caa90 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7ff81415d720 tx=0x7ff808009250 comp rx=0 tx=0).stop 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 -- 172.21.15.22:0/1524951051 shutdown_connections 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 --2- 172.21.15.22:0/1524951051 >> v2:172.21.15.192:3300/0 conn(0x7ff81415df50 0x7ff81415e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 --2- 172.21.15.22:0/1524951051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140caa90 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 -- 172.21.15.22:0/1524951051 >> 172.21.15.22:0/1524951051 conn(0x7ff8140ce600 msgr2=0x7ff8140cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.942+0000 7ff819d4a700 1 -- 172.21.15.22:0/1524951051 shutdown_connections 2023-10-08T00:34:34.945 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.943+0000 7ff819d4a700 1 -- 172.21.15.22:0/1524951051 wait complete. 2023-10-08T00:34:34.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.944+0000 7ff819d4a700 1 Processor -- start 2023-10-08T00:34:34.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.944+0000 7ff819d4a700 1 -- start start 2023-10-08T00:34:34.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.944+0000 7ff819d4a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff81406bcd0 0x7ff8140c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.944+0000 7ff819d4a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.948 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.944+0000 7ff819d4a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff81415df50 0x7ff8140c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff819d4a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff814153fd0 con 0x7ff81406c0a0 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff819d4a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8141542b0 con 0x7ff81415df50 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff819d4a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff814154590 con 0x7ff81406bcd0 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53604/0 (socket says 172.21.15.22:53604) 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 -- 172.21.15.22:0/1479353412 learned_addr learned my addr 172.21.15.22:0/1479353412 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff813fff700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff81415df50 0x7ff8140c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff8137fe700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff81406bcd0 0x7ff8140c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 -- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff81406bcd0 msgr2=0x7ff8140c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff81406bcd0 0x7ff8140c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 -- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff81415df50 msgr2=0x7ff8140c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff81415df50 0x7ff8140c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 -- 172.21.15.22:0/1479353412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8080094f0 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff812ffd700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff81406c0a0 0x7ff8140b2490 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff814069220 tx=0x7ff808016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808011bf0 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff808020070 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff819d4a700 1 -- 172.21.15.22:0/1479353412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff814154870 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80801b450 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.945+0000 7ff819d4a700 1 -- 172.21.15.22:0/1479353412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff814153c60 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.946+0000 7ff819d4a700 1 -- 172.21.15.22:0/1479353412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff814154d10 con 0x7ff81406c0a0 2023-10-08T00:34:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.947+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff808022030 con 0x7ff81406c0a0 2023-10-08T00:34:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.947+0000 7ff7fb7fe700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff800067320 0x7ff8000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.947+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff808086850 con 0x7ff81406c0a0 2023-10-08T00:34:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.947+0000 7ff8137fe700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff800067320 0x7ff8000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.948+0000 7ff8137fe700 1 --2- 172.21.15.22:0/1479353412 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ff800067320 0x7ff8000697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff804009ab0 tx=0x7ff804009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:34.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:34.952+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8080535f0 con 0x7ff81406c0a0 2023-10-08T00:34:35.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.171+0000 7ff819d4a700 1 -- 172.21.15.22:0/1479353412 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7ff814154d10 con 0x7ff800067320 2023-10-08T00:34:35.172 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-10-08T00:34:35.172+0000 7f7d5e472700 -1 mgr.server reply reply (1) Operation not permitted WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-08T00:34:35.173 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.173+0000 7ff7fb7fe700 1 -- 172.21.15.22:0/1479353412 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: -1 WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it.) v1 ==== 204+0+0 (secure 0 0 0) 0x7ff814154d10 con 0x7ff800067320 2023-10-08T00:34:35.174 INFO:teuthology.orchestra.run.smithi022.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-08T00:34:35.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:34:35.179 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2023-10-08T00:34:35.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.300+0000 7f4953101700 1 Processor -- start 2023-10-08T00:34:35.301 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.300+0000 7f4953101700 1 -- start start 2023-10-08T00:34:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f4953101700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c157960 0x7f494c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f4953101700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f494c06b4d0 0x7f494c068390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f4953101700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c06b030 con 0x7f494c06b940 2023-10-08T00:34:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f4953101700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c0ac760 con 0x7f494c06b4d0 2023-10-08T00:34:35.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f4953101700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0af830 con 0x7f494c157960 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f494c06b4d0 0x7f494c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f494c06b4d0 0x7f494c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53614/0 (socket says 172.21.15.22:53614) 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 -- 172.21.15.22:0/1738729398 learned_addr learned my addr 172.21.15.22:0/1738729398 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f4950e9d700 1 --2- 172.21.15.22:0/1738729398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c157960 0x7f494c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 -- 172.21.15.22:0/1738729398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c157960 msgr2=0x7f494c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 --2- 172.21.15.22:0/1738729398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c157960 0x7f494c0af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 -- 172.21.15.22:0/1738729398 >> v1:172.21.15.192:6789/0 conn(0x7f494c06b940 legacy=0x7f494c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 -- 172.21.15.22:0/1738729398 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0c7f60 con 0x7f494c06b4d0 2023-10-08T00:34:35.307 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.301+0000 7f494bfff700 1 --2- 172.21.15.22:0/1738729398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b4d0 0x7f494c068390 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f493c0099b0 tx=0x7f493c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2545e17e88979399 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f494b7fe700 1 -- 172.21.15.22:0/1738729398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00b860 con 0x7f494c06b4d0 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f494b7fe700 1 -- 172.21.15.22:0/1738729398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c00b9c0 con 0x7f494c06b4d0 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f494b7fe700 1 -- 172.21.15.22:0/1738729398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00bd60 con 0x7f494c06b4d0 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 -- 172.21.15.22:0/1738729398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b4d0 msgr2=0x7f494c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 --2- 172.21.15.22:0/1738729398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b4d0 0x7f494c068390 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f493c0099b0 tx=0x7f493c009250 comp rx=0 tx=0).stop 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 -- 172.21.15.22:0/1738729398 shutdown_connections 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 --2- 172.21.15.22:0/1738729398 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c157960 0x7f494c0af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 --2- 172.21.15.22:0/1738729398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b4d0 0x7f494c068390 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 -- 172.21.15.22:0/1738729398 >> 172.21.15.22:0/1738729398 conn(0x7f494c0c9870 msgr2=0x7f494c0c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 -- 172.21.15.22:0/1738729398 shutdown_connections 2023-10-08T00:34:35.308 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.302+0000 7f4953101700 1 -- 172.21.15.22:0/1738729398 wait complete. 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.303+0000 7f4953101700 1 Processor -- start 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.303+0000 7f4953101700 1 -- start start 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4953101700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c06b4d0 0x7f494c0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4953101700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b940 0x7f494c0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4953101700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494c157960 0x7f494c0c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4953101700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c16d730 con 0x7f494c06b940 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4953101700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c16e2b0 con 0x7f494c157960 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4953101700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0cc9e0 con 0x7f494c06b4d0 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f494bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b940 0x7f494c0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f494bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b940 0x7f494c0c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53618/0 (socket says 172.21.15.22:53618) 2023-10-08T00:34:35.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f494bfff700 1 -- 172.21.15.22:0/3595118746 learned_addr learned my addr 172.21.15.22:0/3595118746 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f4950e9d700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c06b4d0 0x7f494c0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.304+0000 7f495169e700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494c157960 0x7f494c0c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f494bfff700 1 -- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c06b4d0 msgr2=0x7f494c0c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f494bfff700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f494c06b4d0 0x7f494c0c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f494bfff700 1 -- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494c157960 msgr2=0x7f494c0c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f494bfff700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494c157960 0x7f494c0c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f494bfff700 1 -- 172.21.15.22:0/3595118746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0094f0 con 0x7f494c06b940 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f495169e700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f494c157960 0x7f494c0c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f494bfff700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f494c06b940 0x7f494c0c2340 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f494c06cac0 tx=0x7f493c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f4948ff9700 1 -- 172.21.15.22:0/3595118746 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c024440 con 0x7f494c06b940 2023-10-08T00:34:35.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f4948ff9700 1 -- 172.21.15.22:0/3595118746 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c0245c0 con 0x7f494c06b940 2023-10-08T00:34:35.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f4953101700 1 -- 172.21.15.22:0/3595118746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c16d980 con 0x7f494c06b940 2023-10-08T00:34:35.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f4948ff9700 1 -- 172.21.15.22:0/3595118746 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c024980 con 0x7f494c06b940 2023-10-08T00:34:35.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.305+0000 7f4953101700 1 -- 172.21.15.22:0/3595118746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c16df40 con 0x7f494c06b940 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.306+0000 7f4953101700 1 -- 172.21.15.22:0/3595118746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c0676a0 con 0x7f494c06b940 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.306+0000 7f4948ff9700 1 -- 172.21.15.22:0/3595118746 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f493c01a420 con 0x7f494c06b940 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.307+0000 7f4948ff9700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f492c067320 0x7f492c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.307+0000 7f4948ff9700 1 -- 172.21.15.22:0/3595118746 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f493c086a10 con 0x7f494c06b940 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.307+0000 7f4950e9d700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f492c067320 0x7f492c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.307+0000 7f4950e9d700 1 --2- 172.21.15.22:0/3595118746 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f492c067320 0x7f492c0697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4934006fd0 tx=0x7f4934008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:34:35.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.311+0000 7f4948ff9700 1 -- 172.21.15.22:0/3595118746 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f493c053660 con 0x7f494c06b940 2023-10-08T00:34:35.534 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:34:35.534+0000 7f4953101700 1 -- 172.21.15.22:0/3595118746 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f494c16e420 con 0x7f492c067320 2023-10-08T00:35:02.320 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:35:02.323 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:35:32.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:35:32.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:36:02.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:36:02.471 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:36:32.537 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:36:32.541 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:36:35.209 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-08T00:36:35.210 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T00:36:35.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:36:35.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T00:36:35.294 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T00:36:35.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:36:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.422+0000 7f21dcd41700 1 Processor -- start 2023-10-08T00:36:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.422+0000 7f21dcd41700 1 -- start start 2023-10-08T00:36:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21dcd41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 0x7f21d80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21dcd41700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f21d806c0a0 0x7f21d815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21dcd41700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d815d7e0 con 0x7f21d815df50 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21dcd41700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d815dac0 con 0x7f21d806c0a0 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21dcd41700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d815aa30 con 0x7f21d806bcd0 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d6d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f21d815df50 0x7f21d80c8c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44524/0 (socket says 172.21.15.22:44524) 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d6d9d700 1 -- 172.21.15.22:0/3680544338 learned_addr learned my addr 172.21.15.22:0/3680544338 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d5d9b700 1 --2- 172.21.15.22:0/3680544338 >> v2:172.21.15.192:3300/0 conn(0x7f21d806c0a0 0x7f21d815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d659c700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 0x7f21d80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814733104 0 0) 0x7f21d815d7e0 con 0x7f21d815df50 2023-10-08T00:36:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c4003570 con 0x7f21d815df50 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3447934875 0 0) 0x7f21c4003570 con 0x7f21d815df50 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 msgr2=0x7f21d80caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 0x7f21d80caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 >> v2:172.21.15.192:3300/0 conn(0x7f21d806c0a0 msgr2=0x7f21d815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 --2- 172.21.15.22:0/3680544338 >> v2:172.21.15.192:3300/0 conn(0x7f21d806c0a0 0x7f21d815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d815ad10 con 0x7f21d815df50 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f21d00017f0 con 0x7f21d815df50 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 >> v1:172.21.15.22:6789/0 conn(0x7f21d815df50 legacy=0x7f21d80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 0x7f21c4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4003fe0 0x7f21c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.428 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.423+0000 7f21d559a700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d815dac0 con 0x7f21c4004d50 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d815aa30 con 0x7f21c4003fe0 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c400bb40 con 0x7f21d806bcd0 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d5d9b700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4003fe0 0x7f21c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d659c700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 0x7f21c4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 -- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 msgr2=0x7f21c4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d806bcd0 0x7f21c4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 -- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4003fe0 msgr2=0x7f21c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4003fe0 0x7f21c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.429 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 -- 172.21.15.22:0/3680544338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4003570 con 0x7f21c4004d50 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d5d9b700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4003fe0 0x7f21c4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d6d9d700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a940 tx=0x7f21d0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9645841e82b63200 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0007110 con 0x7f21c4004d50 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0007290 con 0x7f21c4004d50 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.424+0000 7f21d559a700 1 -- 172.21.15.22:0/3680544338 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0007650 con 0x7f21c4004d50 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21dcd41700 1 -- 172.21.15.22:0/3680544338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21c4004d50 msgr2=0x7f21c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21dcd41700 1 --2- 172.21.15.22:0/3680544338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21c4004d50 0x7f21c40051c0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a940 tx=0x7f21d0002210 comp rx=0 tx=0).stop 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21d6d9d700 1 -- 172.21.15.22:0/3680544338 reap_dead start 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21dcd41700 1 -- 172.21.15.22:0/3680544338 shutdown_connections 2023-10-08T00:36:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21dcd41700 1 -- 172.21.15.22:0/3680544338 >> 172.21.15.22:0/3680544338 conn(0x7f21d80ce600 msgr2=0x7f21d80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21dcd41700 1 -- 172.21.15.22:0/3680544338 shutdown_connections 2023-10-08T00:36:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.425+0000 7f21dcd41700 1 -- 172.21.15.22:0/3680544338 wait complete. 2023-10-08T00:36:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.426+0000 7f21dcd41700 1 Processor -- start 2023-10-08T00:36:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.426+0000 7f21dcd41700 1 -- start start 2023-10-08T00:36:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21dcd41700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4004d50 0x7f21d80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21dcd41700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 0x7f21d80c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21dcd41700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80c74a0 0x7f21d80c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21dcd41700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80b40e0 con 0x7f21d8169dd0 2023-10-08T00:36:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21dcd41700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80c7940 con 0x7f21c4004d50 2023-10-08T00:36:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21dcd41700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d80b1540 con 0x7f21d80c74a0 2023-10-08T00:36:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 0x7f21d80c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 0x7f21d80c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38038/0 (socket says 172.21.15.22:38038) 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 -- 172.21.15.22:0/644956797 learned_addr learned my addr 172.21.15.22:0/644956797 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d659c700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4004d50 0x7f21d80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d6d9d700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80c74a0 0x7f21d80c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 -- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80c74a0 msgr2=0x7f21d80c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80c74a0 0x7f21d80c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 -- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4004d50 msgr2=0x7f21d80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4004d50 0x7f21d80b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 -- 172.21.15.22:0/644956797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80b1820 con 0x7f21d8169dd0 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d6d9d700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80c74a0 0x7f21d80c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21d5d9b700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 0x7f21d80c6f60 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f21c0011d70 tx=0x7f21c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.427+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c000fcd0 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.428+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000fe30 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.428+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d80b1b00 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.428+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0014670 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.428+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d80b3df0 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.428+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d80648d0 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.429+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f21c0014a60 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.429+0000 7f21ce7fc700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21b8067320 0x7f21b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.429+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f21c0018070 con 0x7f21d8169dd0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.430+0000 7f21d659c700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21b8067320 0x7f21b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.430+0000 7f21d659c700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21b8067320 0x7f21b80697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006f00 tx=0x7f21c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.434+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21c0052560 con 0x7f21d8169dd0 2023-10-08T00:36:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.674+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21d804c3c0 con 0x7f21d8169dd0 2023-10-08T00:36:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.674+0000 7f21ce7fc700 1 -- 172.21.15.22:0/644956797 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f21c0055b80 con 0x7f21d8169dd0 2023-10-08T00:36:35.675 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:35.675 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":137,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:34:24.313262+0000","modified":"2023-10-08T00:34:27.920845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9099":{"gid":9099,"name":"d","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3800835270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3800835270},{"type":"v1","addr":"172.21.15.192:6837","nonce":3800835270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21b8067320 msgr2=0x7f21b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21b8067320 0x7f21b80697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006f00 tx=0x7f21c8008040 comp rx=0 tx=0).stop 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 msgr2=0x7f21d80c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 0x7f21d80c6f60 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f21c0011d70 tx=0x7f21c00091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 shutdown_connections 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f21b8067320 0x7f21b80697d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f21d80c74a0 0x7f21d80c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c4004d50 0x7f21d80b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 --2- 172.21.15.22:0/644956797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21d8169dd0 0x7f21d80c6f60 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.677 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 >> 172.21.15.22:0/644956797 conn(0x7f21d80ce600 msgr2=0x7f21d8159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:35.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 shutdown_connections 2023-10-08T00:36:35.678 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.676+0000 7f21dcd41700 1 -- 172.21.15.22:0/644956797 wait complete. 2023-10-08T00:36:35.678 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 137 2023-10-08T00:36:35.689 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:36:35.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.808+0000 7fb6980ca700 1 Processor -- start 2023-10-08T00:36:35.809 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.808+0000 7fb6980ca700 1 -- start start 2023-10-08T00:36:35.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb6980ca700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb69006aa40 0x7fb6900cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb6980ca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb69006bac0 0x7fb69006ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb6980ca700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900cc210 con 0x7fb69006b350 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb6980ca700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900cc4f0 con 0x7fb69006bac0 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb6980ca700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900cc7d0 con 0x7fb69006aa40 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb695665700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb69006bac0 0x7fb69006ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb695665700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb69006bac0 0x7fb69006ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38048/0 (socket says 172.21.15.22:38048) 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.809+0000 7fb695665700 1 -- 172.21.15.22:0/152192748 learned_addr learned my addr 172.21.15.22:0/152192748 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb695e66700 1 --2- 172.21.15.22:0/152192748 >> v2:172.21.15.192:3300/0 conn(0x7fb69006aa40 0x7fb6900cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb695665700 1 -- 172.21.15.22:0/152192748 >> v2:172.21.15.192:3300/0 conn(0x7fb69006aa40 msgr2=0x7fb6900cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb695665700 1 --2- 172.21.15.22:0/152192748 >> v2:172.21.15.192:3300/0 conn(0x7fb69006aa40 0x7fb6900cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb695665700 1 -- 172.21.15.22:0/152192748 >> v1:172.21.15.192:6789/0 conn(0x7fb69006b350 legacy=0x7fb6900c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb695665700 1 -- 172.21.15.22:0/152192748 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900ccab0 con 0x7fb69006bac0 2023-10-08T00:36:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb695665700 1 --2- 172.21.15.22:0/152192748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb69006ae10 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fb69006e570 tx=0x7fb684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b887fa6c6c76b356 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb694e64700 1 -- 172.21.15.22:0/152192748 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400b820 con 0x7fb69006bac0 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb694e64700 1 -- 172.21.15.22:0/152192748 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400b980 con 0x7fb69006bac0 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.810+0000 7fb694e64700 1 -- 172.21.15.22:0/152192748 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400bd20 con 0x7fb69006bac0 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 -- 172.21.15.22:0/152192748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 msgr2=0x7fb69006ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 --2- 172.21.15.22:0/152192748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb69006ae10 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fb69006e570 tx=0x7fb684009250 comp rx=0 tx=0).stop 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 -- 172.21.15.22:0/152192748 shutdown_connections 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 --2- 172.21.15.22:0/152192748 >> v2:172.21.15.192:3300/0 conn(0x7fb69006aa40 0x7fb6900cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 --2- 172.21.15.22:0/152192748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb69006ae10 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 -- 172.21.15.22:0/152192748 >> 172.21.15.22:0/152192748 conn(0x7fb6900cd670 msgr2=0x7fb6900cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 -- 172.21.15.22:0/152192748 shutdown_connections 2023-10-08T00:36:35.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.811+0000 7fb6980ca700 1 -- 172.21.15.22:0/152192748 wait complete. 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.812+0000 7fb6980ca700 1 Processor -- start 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.812+0000 7fb6980ca700 1 -- start start 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.812+0000 7fb6980ca700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb69006aa40 0x7fb69014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.812+0000 7fb6980ca700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb69006b350 0x7fb6900c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb6980ca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb6900c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb6980ca700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69015b5a0 con 0x7fb69006bac0 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb6980ca700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900c6da0 con 0x7fb69006b350 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb6980ca700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900c7080 con 0x7fb69006aa40 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb6900c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb6900c4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38050/0 (socket says 172.21.15.22:38050) 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 -- 172.21.15.22:0/3361710226 learned_addr learned my addr 172.21.15.22:0/3361710226 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb695665700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb69006b350 0x7fb6900c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb695e66700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb69006aa40 0x7fb69014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 -- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb69006aa40 msgr2=0x7fb69014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb69006aa40 0x7fb69014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 -- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb69006b350 msgr2=0x7fb6900c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb69006b350 0x7fb6900c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 -- 172.21.15.22:0/3361710226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840094f0 con 0x7fb69006bac0 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb696667700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb6900c4720 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c930 tx=0x7fb6800026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680012630 con 0x7fb69006bac0 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6800127d0 con 0x7fb69006bac0 2023-10-08T00:36:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69015b230 con 0x7fb69006bac0 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.813+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680012b90 con 0x7fb69006bac0 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.814+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69015ae50 con 0x7fb69006bac0 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.815+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69004c3c0 con 0x7fb69006bac0 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.815+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb68001a3b0 con 0x7fb69006bac0 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.815+0000 7fb68dffb700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb67c067320 0x7fb67c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.815+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fb680084900 con 0x7fb69006bac0 2023-10-08T00:36:35.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.816+0000 7fb695e66700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb67c067320 0x7fb67c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:35.819 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.816+0000 7fb695e66700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb67c067320 0x7fb67c0697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb688006aa0 tx=0x7fb688008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:35.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:35.820+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb680051540 con 0x7fb69006bac0 2023-10-08T00:36:36.015 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.015+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6900c7cb0 con 0x7fb69006bac0 2023-10-08T00:36:36.016 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.015+0000 7fb68dffb700 1 -- 172.21.15.22:0/3361710226 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+15509 (secure 0 0 0) 0x7fb680054b60 con 0x7fb69006bac0 2023-10-08T00:36:36.016 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:36.016 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":204,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:42.885360+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:34:22.729022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-08T00:34:23.277833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.b","mappings":[{"from":0,"to":1}]},{"pgid":"34.13","mappings":[{"from":0,"to":2}]},{"pgid":"34.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb67c067320 msgr2=0x7fb67c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb67c067320 0x7fb67c0697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb688006aa0 tx=0x7fb688008040 comp rx=0 tx=0).stop 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 msgr2=0x7fb6900c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb6900c4720 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c930 tx=0x7fb6800026e0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 shutdown_connections 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb69006bac0 0x7fb6900c4720 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fb67c067320 0x7fb67c0697d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb69006aa40 0x7fb69014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 --2- 172.21.15.22:0/3361710226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb69006b350 0x7fb6900c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.019 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 >> 172.21.15.22:0/3361710226 conn(0x7fb6900cd670 msgr2=0x7fb6900c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:36.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 shutdown_connections 2023-10-08T00:36:36.020 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.018+0000 7fb6980ca700 1 -- 172.21.15.22:0/3361710226 wait complete. 2023-10-08T00:36:36.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T00:24:46.437265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 33, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T00:34:22.729022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 34, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T00:34:23.277833+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '202', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T00:36:36.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T00:36:36.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.152+0000 7f56643ae700 1 Processor -- start 2023-10-08T00:36:36.152 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.152+0000 7f56643ae700 1 -- start start 2023-10-08T00:36:36.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f56643ae700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f565c157800 0x7f565c069770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f56643ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157bd0 0x7f565c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f56643ae700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f565c0afc90 0x7f565c0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.155 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f56643ae700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0c8e00 con 0x7f565c157800 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f56643ae700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0af800 con 0x7f565c0afc90 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f56643ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0c8840 con 0x7f565c157bd0 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f565c157800 0x7f565c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f565c157800 0x7f565c069770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38060/0 (socket says 172.21.15.22:38060) 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 -- 172.21.15.22:0/310436183 learned_addr learned my addr 172.21.15.22:0/310436183 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566294b700 1 --2- 172.21.15.22:0/310436183 >> v2:172.21.15.192:3300/0 conn(0x7f565c0afc90 0x7f565c0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f5661949700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157bd0 0x7f565c069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 -- 172.21.15.22:0/310436183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157bd0 msgr2=0x7f565c069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157bd0 0x7f565c069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 -- 172.21.15.22:0/310436183 >> v2:172.21.15.192:3300/0 conn(0x7f565c0afc90 msgr2=0x7f565c0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.156 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 --2- 172.21.15.22:0/310436183 >> v2:172.21.15.192:3300/0 conn(0x7f565c0afc90 0x7f565c0b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 -- 172.21.15.22:0/310436183 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0c8b20 con 0x7f565c157800 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566294b700 1 --2- 172.21.15.22:0/310436183 >> v2:172.21.15.192:3300/0 conn(0x7f565c0afc90 0x7f565c0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f5661949700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157bd0 0x7f565c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.153+0000 7f566214a700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157800 0x7f565c069770 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f565c0abb30 tx=0x7f5658009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f618c1e04e61baf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f5661148700 1 -- 172.21.15.22:0/310436183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565800b860 con 0x7f565c157800 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f5661148700 1 -- 172.21.15.22:0/310436183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565800b9c0 con 0x7f565c157800 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f5661148700 1 -- 172.21.15.22:0/310436183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565800bd60 con 0x7f565c157800 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 -- 172.21.15.22:0/310436183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157800 msgr2=0x7f565c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157800 0x7f565c069770 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f565c0abb30 tx=0x7f5658009250 comp rx=0 tx=0).stop 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 -- 172.21.15.22:0/310436183 shutdown_connections 2023-10-08T00:36:36.157 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157800 0x7f565c069770 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 --2- 172.21.15.22:0/310436183 >> v2:172.21.15.192:3300/0 conn(0x7f565c0afc90 0x7f565c0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 --2- 172.21.15.22:0/310436183 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157bd0 0x7f565c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 -- 172.21.15.22:0/310436183 >> 172.21.15.22:0/310436183 conn(0x7f565c068e10 msgr2=0x7f565c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:36.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 -- 172.21.15.22:0/310436183 shutdown_connections 2023-10-08T00:36:36.158 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.154+0000 7f56643ae700 1 -- 172.21.15.22:0/310436183 wait complete. 2023-10-08T00:36:36.160 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.155+0000 7f56643ae700 1 Processor -- start 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.155+0000 7f56643ae700 1 -- start start 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f56643ae700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f565c0afc90 0x7f565c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f56643ae700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157800 0x7f565c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f56643ae700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 0x7f565c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f56643ae700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c15a9d0 con 0x7f565c157bd0 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f56643ae700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c159dc0 con 0x7f565c0afc90 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f56643ae700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c15a0a0 con 0x7f565c157800 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f566294b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 0x7f565c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f566294b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 0x7f565c1594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38076/0 (socket says 172.21.15.22:38076) 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f566294b700 1 -- 172.21.15.22:0/3070258140 learned_addr learned my addr 172.21.15.22:0/3070258140 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:36.161 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f566214a700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f565c0afc90 0x7f565c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.156+0000 7f5661949700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157800 0x7f565c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f566294b700 1 -- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157800 msgr2=0x7f565c153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f566294b700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157800 0x7f565c153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f566294b700 1 -- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f565c0afc90 msgr2=0x7f565c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f566294b700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f565c0afc90 0x7f565c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f566294b700 1 -- 172.21.15.22:0/3070258140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580094f0 con 0x7f565c157bd0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f566294b700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 0x7f565c1594d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f565400cf60 tx=0x7f5654007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654015440 con 0x7f565c157bd0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56540155a0 con 0x7f565c157bd0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c15a380 con 0x7f565c157bd0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654015960 con 0x7f565c157bd0 2023-10-08T00:36:36.162 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.157+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c1544e0 con 0x7f565c157bd0 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.158+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c15ab80 con 0x7f565c157bd0 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.158+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5654015d50 con 0x7f565c157bd0 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.159+0000 7f56527fc700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5640067320 0x7f56400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.159+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f56540854e0 con 0x7f565c157bd0 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.159+0000 7f566214a700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5640067320 0x7f56400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.159+0000 7f566214a700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5640067320 0x7f56400697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f565c0abb30 tx=0x7f5658017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.163 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.163+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f565c15ab80 con 0x7f565c157bd0 2023-10-08T00:36:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.354+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f565c04c3c0 con 0x7f565c157bd0 2023-10-08T00:36:36.355 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.355+0000 7f56527fc700 1 -- 172.21.15.22:0/3070258140 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v204) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5654052120 con 0x7f565c157bd0 2023-10-08T00:36:36.355 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5640067320 msgr2=0x7f56400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5640067320 0x7f56400697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f565c0abb30 tx=0x7f5658017000 comp rx=0 tx=0).stop 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 msgr2=0x7f565c1594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 0x7f565c1594d0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f565400cf60 tx=0x7f5654007870 comp rx=0 tx=0).stop 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 shutdown_connections 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f565c157bd0 0x7f565c1594d0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f565c0afc90 0x7f565c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5640067320 0x7f56400697d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 --2- 172.21.15.22:0/3070258140 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f565c157800 0x7f565c153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.358 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 >> 172.21.15.22:0/3070258140 conn(0x7f565c068e10 msgr2=0x7f565c06db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 shutdown_connections 2023-10-08T00:36:36.359 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.357+0000 7f56643ae700 1 -- 172.21.15.22:0/3070258140 wait complete. 2023-10-08T00:36:36.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T00:36:36.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.491+0000 7f1bb1e3c700 1 Processor -- start 2023-10-08T00:36:36.492 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.491+0000 7f1bb1e3c700 1 -- start start 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bb1e3c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bb1e3c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1bac0aef40 0x7f1bac0695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bb1e3c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1bac1571e0 0x7f1bac1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bb1e3c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac06a2b0 con 0x7f1bac1571e0 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bb1e3c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bac06b110 con 0x7f1bac0aef40 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bb1e3c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac0cb380 con 0x7f1bac0aeb70 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1babfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1bac1571e0 0x7f1bac1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1babfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1bac1571e0 0x7f1bac1575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38080/0 (socket says 172.21.15.22:38080) 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1babfff700 1 -- 172.21.15.22:0/516238616 learned_addr learned my addr 172.21.15.22:0/516238616 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1bab7fe700 1 --2- 172.21.15.22:0/516238616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.495 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.492+0000 7f1baaffd700 1 --2- 172.21.15.22:0/516238616 >> v2:172.21.15.192:3300/0 conn(0x7f1bac0aef40 0x7f1bac0695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1babfff700 1 -- 172.21.15.22:0/516238616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 msgr2=0x7f1bac0cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1babfff700 1 --2- 172.21.15.22:0/516238616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac0cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1babfff700 1 -- 172.21.15.22:0/516238616 >> v2:172.21.15.192:3300/0 conn(0x7f1bac0aef40 msgr2=0x7f1bac0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1babfff700 1 --2- 172.21.15.22:0/516238616 >> v2:172.21.15.192:3300/0 conn(0x7f1bac0aef40 0x7f1bac0695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1babfff700 1 -- 172.21.15.22:0/516238616 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bac0634e0 con 0x7f1bac1571e0 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1babfff700 1 --2- 172.21.15.22:0/516238616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575f0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f1bac06ca10 tx=0x7f1ba4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd53f41bf057c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1baa7fc700 1 -- 172.21.15.22:0/516238616 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba400e070 con 0x7f1bac1571e0 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1baa7fc700 1 -- 172.21.15.22:0/516238616 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba400b970 con 0x7f1bac1571e0 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1baa7fc700 1 -- 172.21.15.22:0/516238616 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba40092e0 con 0x7f1bac1571e0 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/516238616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 msgr2=0x7f1bac1575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.493+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/516238616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575f0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f1bac06ca10 tx=0x7f1ba4009840 comp rx=0 tx=0).stop 2023-10-08T00:36:36.496 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/516238616 shutdown_connections 2023-10-08T00:36:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/516238616 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575f0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/516238616 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac0cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/516238616 >> v2:172.21.15.192:3300/0 conn(0x7f1bac0aef40 0x7f1bac0695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/516238616 >> 172.21.15.22:0/516238616 conn(0x7f1bac06ded0 msgr2=0x7f1bac06e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/516238616 shutdown_connections 2023-10-08T00:36:36.497 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.494+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/516238616 wait complete. 2023-10-08T00:36:36.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.495+0000 7f1bb1e3c700 1 Processor -- start 2023-10-08T00:36:36.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.495+0000 7f1bb1e3c700 1 -- start start 2023-10-08T00:36:36.499 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bac0aef40 0x7f1bac143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac143740 con 0x7f1bac1571e0 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac142b30 con 0x7f1bac0aef40 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac142e10 con 0x7f1bac0aeb70 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38096/0 (socket says 172.21.15.22:38096) 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 -- 172.21.15.22:0/4186151824 learned_addr learned my addr 172.21.15.22:0/4186151824 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1baaffd700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bac0aef40 0x7f1bac143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bab7fe700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.500 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 -- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 msgr2=0x7f1bac152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 -- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bac0aef40 msgr2=0x7f1bac143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bac0aef40 0x7f1bac143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 -- 172.21.15.22:0/4186151824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4009ae0 con 0x7f1bac1571e0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1babfff700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575b0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009880 tx=0x7f1ba4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4008b10 con 0x7f1bac1571e0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4008c70 con 0x7f1bac1571e0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba401c410 con 0x7f1bac1571e0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac1430f0 con 0x7f1bac1571e0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.496+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac1527b0 con 0x7f1bac1571e0 2023-10-08T00:36:36.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.497+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bac152a60 con 0x7f1bac1571e0 2023-10-08T00:36:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.498+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1ba4003040 con 0x7f1bac1571e0 2023-10-08T00:36:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.498+0000 7f1b937fe700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b98067320 0x7f1b980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.498+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1ba4086480 con 0x7f1bac1571e0 2023-10-08T00:36:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.498+0000 7f1bab7fe700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b98067320 0x7f1b980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.502 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.499+0000 7f1bab7fe700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b98067320 0x7f1b980697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009db0 tx=0x7f1b9c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.503 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.503+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ba4052fb0 con 0x7f1bac1571e0 2023-10-08T00:36:36.695 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.695+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bac04c3c0 con 0x7f1bac1571e0 2023-10-08T00:36:36.696 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.695+0000 7f1b937fe700 1 -- 172.21.15.22:0/4186151824 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v204) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ba40565d0 con 0x7f1bac1571e0 2023-10-08T00:36:36.696 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2023-10-08T00:36:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b98067320 msgr2=0x7f1b980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b98067320 0x7f1b980697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009db0 tx=0x7f1b9c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 msgr2=0x7f1bac1575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575b0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4009880 tx=0x7f1ba4018000 comp rx=0 tx=0).stop 2023-10-08T00:36:36.698 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 shutdown_connections 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bac1571e0 0x7f1bac1575b0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1b98067320 0x7f1b980697d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1bac0aeb70 0x7f1bac152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 --2- 172.21.15.22:0/4186151824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bac0aef40 0x7f1bac143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 >> 172.21.15.22:0/4186151824 conn(0x7f1bac06ded0 msgr2=0x7f1bac0696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 shutdown_connections 2023-10-08T00:36:36.699 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.697+0000 7f1bb1e3c700 1 -- 172.21.15.22:0/4186151824 wait complete. 2023-10-08T00:36:36.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T00:36:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.832+0000 7f463567e700 1 Processor -- start 2023-10-08T00:36:36.832 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.832+0000 7f463567e700 1 -- start start 2023-10-08T00:36:36.835 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.832+0000 7f463567e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f46300699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.832+0000 7f463567e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4630069ee0 con 0x7f4630159c60 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.832+0000 7f463567e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463015a160 con 0x7f4630159890 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.832+0000 7f463567e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300d13a0 con 0x7f4630069560 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462e7fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4630159c60 0x7f463015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36522/0 (socket says 172.21.15.22:36522) 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462e7fc700 1 -- 172.21.15.22:0/1250002380 learned_addr learned my addr 172.21.15.22:0/1250002380 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462f7fe700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f46300699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275822311 0 0) 0x7f4630069ee0 con 0x7f4630159c60 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f461c003570 con 0x7f4630159c60 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3397733569 0 0) 0x7f461c003570 con 0x7f4630159c60 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 msgr2=0x7f46300699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.836 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f46300699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 >> v1:172.21.15.192:6789/0 conn(0x7f4630159890 legacy=0x7f463015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463015e140 con 0x7f4630159c60 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f4618001470 con 0x7f4630159c60 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 >> v1:172.21.15.22:6789/0 conn(0x7f4630159c60 legacy=0x7f463015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f461c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f461c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300d13a0 con 0x7f461c003a90 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c00bb40 con 0x7f461c004d50 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c00bd00 con 0x7f4630069560 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462effd700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f461c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.837 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462e7fc700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f461c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.833+0000 7f462f7fe700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462effd700 1 -- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 msgr2=0x7f461c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462effd700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f461c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462effd700 1 -- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c004d50 msgr2=0x7f461c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462effd700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c004d50 0x7f461c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462effd700 1 -- 172.21.15.22:0/1250002380 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c003570 con 0x7f461c003a90 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462e7fc700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4630069560 0x7f461c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462effd700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f461c003e60 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4628001970 tx=0x7f4628007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b3393ffc1cb199 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800c5d0 con 0x7f461c003a90 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800c730 con 0x7f461c003a90 2023-10-08T00:36:36.838 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462dffb700 1 -- 172.21.15.22:0/1250002380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800caf0 con 0x7f461c003a90 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f463567e700 1 -- 172.21.15.22:0/1250002380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 msgr2=0x7f461c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f463567e700 1 --2- 172.21.15.22:0/1250002380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f461c003e60 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f4628001970 tx=0x7f4628007d30 comp rx=0 tx=0).stop 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.834+0000 7f462f7fe700 1 -- 172.21.15.22:0/1250002380 reap_dead start 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.835+0000 7f463567e700 1 -- 172.21.15.22:0/1250002380 shutdown_connections 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.835+0000 7f463567e700 1 -- 172.21.15.22:0/1250002380 >> 172.21.15.22:0/1250002380 conn(0x7f4630068e20 msgr2=0x7f46300d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.835+0000 7f463567e700 1 -- 172.21.15.22:0/1250002380 shutdown_connections 2023-10-08T00:36:36.839 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.835+0000 7f463567e700 1 -- 172.21.15.22:0/1250002380 wait complete. 2023-10-08T00:36:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.836+0000 7f463567e700 1 Processor -- start 2023-10-08T00:36:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.836+0000 7f463567e700 1 -- start start 2023-10-08T00:36:36.841 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f46300cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46300cd7d0 0x7f46300b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46300b60f0 0x7f463015f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463015f0d0 con 0x7f461c003a90 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463015e4c0 con 0x7f46300cd7d0 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463015e7a0 con 0x7f46300b60f0 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f46300cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f46300cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53174/0 (socket says 172.21.15.22:53174) 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 -- 172.21.15.22:0/3330374390 learned_addr learned my addr 172.21.15.22:0/3330374390 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 -- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46300b60f0 msgr2=0x7f463015f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46300b60f0 0x7f463015f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 -- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46300cd7d0 msgr2=0x7f46300b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46300cd7d0 0x7f46300b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 -- 172.21.15.22:0/3330374390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463015ea80 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f462effd700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f46300cd290 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f462800c3c0 tx=0x7f4628015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462800c5d0 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462800cab0 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628006a30 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463015ed60 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.837+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46300cfc50 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.838+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463015f3b0 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.839+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4628019070 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.840+0000 7f4626ffd700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4610067320 0x7f46100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.840+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f4628085b60 con 0x7f461c003a90 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.840+0000 7f462e7fc700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4610067320 0x7f46100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.840+0000 7f462e7fc700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4610067320 0x7f46100697d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4618000e10 tx=0x7f4618001b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:36.843+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46280528a0 con 0x7f461c003a90 2023-10-08T00:36:37.033 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.033+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f463004c3c0 con 0x7f461c003a90 2023-10-08T00:36:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.033+0000 7f4626ffd700 1 -- 172.21.15.22:0/3330374390 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v204) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46280170a0 con 0x7f461c003a90 2023-10-08T00:36:37.034 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2023-10-08T00:36:37.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4610067320 msgr2=0x7f46100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.036 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4610067320 0x7f46100697d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4618000e10 tx=0x7f4618001b90 comp rx=0 tx=0).stop 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 msgr2=0x7f46300cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f46300cd290 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f462800c3c0 tx=0x7f4628015000 comp rx=0 tx=0).stop 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 shutdown_connections 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4610067320 0x7f46100697d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46300b60f0 0x7f463015f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f461c003a90 0x7f46300cd290 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 --2- 172.21.15.22:0/3330374390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46300cd7d0 0x7f46300b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 >> 172.21.15.22:0/3330374390 conn(0x7f4630068e20 msgr2=0x7f4630069930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 shutdown_connections 2023-10-08T00:36:37.037 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.035+0000 7f463567e700 1 -- 172.21.15.22:0/3330374390 wait complete. 2023-10-08T00:36:37.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:36:37.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.166+0000 7fcd8ebc1700 1 Processor -- start 2023-10-08T00:36:37.167 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.166+0000 7fcd8ebc1700 1 -- start start 2023-10-08T00:36:37.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8ebc1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159890 0x7fcd8815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8ebc1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcd88069560 0x7fcd880699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8ebc1700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8815a160 con 0x7fcd88159c60 2023-10-08T00:36:37.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8ebc1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd88069f20 con 0x7fcd88069560 2023-10-08T00:36:37.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8ebc1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880d13a0 con 0x7fcd88159890 2023-10-08T00:36:37.169 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8d15e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcd88069560 0x7fcd880699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8d15e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcd88069560 0x7fcd880699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53190/0 (socket says 172.21.15.22:53190) 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8d15e700 1 -- 172.21.15.22:0/2178574056 learned_addr learned my addr 172.21.15.22:0/2178574056 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8c95d700 1 --2- 172.21.15.22:0/2178574056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159890 0x7fcd8815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.167+0000 7fcd8d15e700 1 -- 172.21.15.22:0/2178574056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159890 msgr2=0x7fcd8815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8d15e700 1 --2- 172.21.15.22:0/2178574056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159890 0x7fcd8815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8d15e700 1 -- 172.21.15.22:0/2178574056 >> v1:172.21.15.192:6789/0 conn(0x7fcd88159c60 legacy=0x7fcd8815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8d15e700 1 -- 172.21.15.22:0/2178574056 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8815e140 con 0x7fcd88069560 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8d15e700 1 --2- 172.21.15.22:0/2178574056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88069560 0x7fcd880699e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcd700099b0 tx=0x7fcd70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68eb25e3285dd07b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd877fe700 1 -- 172.21.15.22:0/2178574056 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000b860 con 0x7fcd88069560 2023-10-08T00:36:37.170 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd877fe700 1 -- 172.21.15.22:0/2178574056 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7000b9c0 con 0x7fcd88069560 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd877fe700 1 -- 172.21.15.22:0/2178574056 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000bd60 con 0x7fcd88069560 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2178574056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88069560 msgr2=0x7fcd880699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2178574056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88069560 0x7fcd880699e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fcd700099b0 tx=0x7fcd70009250 comp rx=0 tx=0).stop 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2178574056 shutdown_connections 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2178574056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88069560 0x7fcd880699e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2178574056 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159890 0x7fcd8815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2178574056 >> 172.21.15.22:0/2178574056 conn(0x7fcd88068e20 msgr2=0x7fcd880d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2178574056 shutdown_connections 2023-10-08T00:36:37.171 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.168+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2178574056 wait complete. 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 Processor -- start 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 -- start start 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd88069560 0x7fcd8814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 0x7fcd88154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159c60 0x7fcd88155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd88151ae0 con 0x7fcd88159890 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880b0940 con 0x7fcd88069560 2023-10-08T00:36:37.174 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.170+0000 7fcd8ebc1700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880ce9b0 con 0x7fcd88159c60 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 0x7fcd88154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 0x7fcd88154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53202/0 (socket says 172.21.15.22:53202) 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 -- 172.21.15.22:0/2524454066 learned_addr learned my addr 172.21.15.22:0/2524454066 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd8c95d700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd88069560 0x7fcd8814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd8d15e700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159c60 0x7fcd88155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 -- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159c60 msgr2=0x7fcd88155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159c60 0x7fcd88155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 -- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd88069560 msgr2=0x7fcd8814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd88069560 0x7fcd8814d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 -- 172.21.15.22:0/2524454066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700094f0 con 0x7fcd88159890 2023-10-08T00:36:37.175 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd8d15e700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159c60 0x7fcd88155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd87fff700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 0x7fcd88154cd0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800cb40 tx=0x7fcd78001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800a7e0 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7800a960 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800ad20 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd880cec90 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.171+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd880b05d0 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.172+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd880b0ad0 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.173+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcd78003030 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.173+0000 7fcd84ff9700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd68067320 0x7fcd680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.173+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fcd78084d50 con 0x7fcd88159890 2023-10-08T00:36:37.176 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.173+0000 7fcd8c95d700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd68067320 0x7fcd680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.177 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.174+0000 7fcd8c95d700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd68067320 0x7fcd680697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcd80006fd0 tx=0x7fcd80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.178 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.177+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd78051990 con 0x7fcd88159890 2023-10-08T00:36:37.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.414+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd8804c3c0 con 0x7fcd88159890 2023-10-08T00:36:37.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.415+0000 7fcd84ff9700 1 -- 172.21.15.22:0/2524454066 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fcd78054fb0 con 0x7fcd88159890 2023-10-08T00:36:37.415 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":137,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:34:24.313262+0000","modified":"2023-10-08T00:34:27.920845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9099":{"gid":9099,"name":"d","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3800835270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3800835270},{"type":"v1","addr":"172.21.15.192:6837","nonce":3800835270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-08T00:36:37.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd68067320 msgr2=0x7fcd680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd68067320 0x7fcd680697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fcd80006fd0 tx=0x7fcd80008040 comp rx=0 tx=0).stop 2023-10-08T00:36:37.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 msgr2=0x7fcd88154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 0x7fcd88154cd0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800cb40 tx=0x7fcd78001770 comp rx=0 tx=0).stop 2023-10-08T00:36:37.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 shutdown_connections 2023-10-08T00:36:37.418 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fcd68067320 0x7fcd680697d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd88159c60 0x7fcd88155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd88069560 0x7fcd8814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 --2- 172.21.15.22:0/2524454066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd88159890 0x7fcd88154cd0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 >> 172.21.15.22:0/2524454066 conn(0x7fcd88068e20 msgr2=0x7fcd88158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 shutdown_connections 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.417+0000 7fcd8ebc1700 1 -- 172.21.15.22:0/2524454066 wait complete. 2023-10-08T00:36:37.419 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 137 2023-10-08T00:36:37.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:36:37.549 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.549+0000 7feb9639f700 1 Processor -- start 2023-10-08T00:36:37.550 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.549+0000 7feb9639f700 1 -- start start 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9639f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9006bcd0 0x7feb900caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9639f700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb9015df50 0x7feb9015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9639f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9015d7e0 con 0x7feb9006c0a0 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9639f700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9015dac0 con 0x7feb9015df50 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9639f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9015aa30 con 0x7feb9006bcd0 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb8f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feb9006c0a0 0x7feb9015a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36534/0 (socket says 172.21.15.22:36534) 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb8f7fe700 1 -- 172.21.15.22:0/1356977552 learned_addr learned my addr 172.21.15.22:0/1356977552 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb8ffff700 1 --2- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9006bcd0 0x7feb900caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.552 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9493c700 1 --2- 172.21.15.22:0/1356977552 >> v2:172.21.15.192:3300/0 conn(0x7feb9015df50 0x7feb9015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb8effd700 1 -- 172.21.15.22:0/1356977552 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312916827 0 0) 0x7feb9015d7e0 con 0x7feb9006c0a0 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb8effd700 1 -- 172.21.15.22:0/1356977552 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb78003570 con 0x7feb9006c0a0 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9493c700 1 -- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9006bcd0 msgr2=0x7feb900caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9493c700 1 --2- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9006bcd0 0x7feb900caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9493c700 1 -- 172.21.15.22:0/1356977552 >> v1:172.21.15.22:6789/0 conn(0x7feb9006c0a0 legacy=0x7feb9015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.550+0000 7feb9493c700 1 -- 172.21.15.22:0/1356977552 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9015ad10 con 0x7feb9015df50 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9493c700 1 --2- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9015df50 0x7feb9015e3b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7feb88009e60 tx=0x7feb88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8180d6fe5d446fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb8effd700 1 -- 172.21.15.22:0/1356977552 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800e070 con 0x7feb9015df50 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb8effd700 1 -- 172.21.15.22:0/1356977552 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8800bab0 con 0x7feb9015df50 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb8effd700 1 -- 172.21.15.22:0/1356977552 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800be30 con 0x7feb9015df50 2023-10-08T00:36:37.553 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 -- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9015df50 msgr2=0x7feb9015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 --2- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9015df50 0x7feb9015e3b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7feb88009e60 tx=0x7feb88009780 comp rx=0 tx=0).stop 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 -- 172.21.15.22:0/1356977552 shutdown_connections 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 --2- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9015df50 0x7feb9015e3b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 --2- 172.21.15.22:0/1356977552 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9006bcd0 0x7feb900caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 -- 172.21.15.22:0/1356977552 >> 172.21.15.22:0/1356977552 conn(0x7feb900ce600 msgr2=0x7feb900cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 -- 172.21.15.22:0/1356977552 shutdown_connections 2023-10-08T00:36:37.554 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.551+0000 7feb9639f700 1 -- 172.21.15.22:0/1356977552 wait complete. 2023-10-08T00:36:37.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.552+0000 7feb9639f700 1 Processor -- start 2023-10-08T00:36:37.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 -- start start 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 0x7feb901587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9006c0a0 0x7feb90146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9015df50 0x7feb90155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb90151c80 con 0x7feb9006bcd0 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900c33a0 con 0x7feb9006c0a0 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb9639f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb90158ef0 con 0x7feb9015df50 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 0x7feb901587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 0x7feb901587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53218/0 (socket says 172.21.15.22:53218) 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.553+0000 7feb8ffff700 1 -- 172.21.15.22:0/3462518561 learned_addr learned my addr 172.21.15.22:0/3462518561 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8f7fe700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9006c0a0 0x7feb90146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb9493c700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9015df50 0x7feb90155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.557 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8ffff700 1 -- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9015df50 msgr2=0x7feb90155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8ffff700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9015df50 0x7feb90155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8ffff700 1 -- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9006c0a0 msgr2=0x7feb90146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8ffff700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9006c0a0 0x7feb90146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8ffff700 1 -- 172.21.15.22:0/3462518561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009a20 con 0x7feb9006bcd0 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8f7fe700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9006c0a0 0x7feb90146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb8ffff700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 0x7feb901587f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e930 tx=0x7feb800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000eed0 con 0x7feb9006bcd0 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8000c850 con 0x7feb9006bcd0 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb901591d0 con 0x7feb9006bcd0 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000cbf0 con 0x7feb9006bcd0 2023-10-08T00:36:37.558 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.554+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb900c38d0 con 0x7feb9006bcd0 2023-10-08T00:36:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.555+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9004c3c0 con 0x7feb9006bcd0 2023-10-08T00:36:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.556+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7feb80013470 con 0x7feb9006bcd0 2023-10-08T00:36:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.556+0000 7feb77fff700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feb7c067320 0x7feb7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.556+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7feb80084f60 con 0x7feb9006bcd0 2023-10-08T00:36:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.556+0000 7feb8f7fe700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feb7c067320 0x7feb7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.559 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.557+0000 7feb8f7fe700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feb7c067320 0x7feb7c0697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7feb840058d0 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.560 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.560+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb80051b60 con 0x7feb9006bcd0 2023-10-08T00:36:37.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.752+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb9015aff0 con 0x7feb9006bcd0 2023-10-08T00:36:37.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.753+0000 7feb77fff700 1 -- 172.21.15.22:0/3462518561 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+15509 (secure 0 0 0) 0x7feb80017090 con 0x7feb9006bcd0 2023-10-08T00:36:37.755 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:37.755 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":204,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:42.885360+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:34:22.729022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-08T00:34:23.277833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.b","mappings":[{"from":0,"to":1}]},{"pgid":"34.13","mappings":[{"from":0,"to":2}]},{"pgid":"34.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:36:37.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feb7c067320 msgr2=0x7feb7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feb7c067320 0x7feb7c0697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7feb840058d0 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-10-08T00:36:37.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 msgr2=0x7feb901587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.757 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 0x7feb901587f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7feb8000e930 tx=0x7feb800091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 shutdown_connections 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7feb7c067320 0x7feb7c0697d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feb9015df50 0x7feb90155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb9006bcd0 0x7feb901587f0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 --2- 172.21.15.22:0/3462518561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9006c0a0 0x7feb90146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 >> 172.21.15.22:0/3462518561 conn(0x7feb900ce600 msgr2=0x7feb9006a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 shutdown_connections 2023-10-08T00:36:37.758 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.755+0000 7feb9639f700 1 -- 172.21.15.22:0/3462518561 wait complete. 2023-10-08T00:36:37.769 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:36:37.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:36:37.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.887+0000 7f5358c29700 1 Processor -- start 2023-10-08T00:36:37.889 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.887+0000 7f5358c29700 1 -- start start 2023-10-08T00:36:37.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f5358c29700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53540b1850 0x7f53540b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.890 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f5358c29700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53540cb300 con 0x7f53540ae680 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f5358c29700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53540cb5e0 con 0x7f53541579f0 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f5358c29700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535406fc30 con 0x7f53540b1850 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f535259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53540b1850 0x7f53540b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f5351d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f53540ae680 0x7f53541572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36538/0 (socket says 172.21.15.22:36538) 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f5351d9b700 1 -- 172.21.15.22:0/12788347 learned_addr learned my addr 172.21.15.22:0/12788347 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.888+0000 7f535259c700 1 --2- 172.21.15.22:0/12788347 >> v2:172.21.15.22:3300/0 conn(0x7f53540b1850 0x7f53540b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53226/0 (socket says 172.21.15.22:53226) 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535259c700 1 -- 172.21.15.22:0/12788347 >> v1:172.21.15.192:6789/0 conn(0x7f53541579f0 legacy=0x7f53540abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535259c700 1 -- 172.21.15.22:0/12788347 >> v1:172.21.15.22:6789/0 conn(0x7f53540ae680 legacy=0x7f53541572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535259c700 1 -- 172.21.15.22:0/12788347 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540cb8c0 con 0x7f53540b1850 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535159a700 1 -- 172.21.15.22:0/12788347 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441758863 0 0) 0x7f53540cb300 con 0x7f53540ae680 2023-10-08T00:36:37.891 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535259c700 1 --2- 172.21.15.22:0/12788347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540b1850 0x7f53540b1c20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f534c0098e0 tx=0x7f534c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0b0480be7eb54d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535159a700 1 -- 172.21.15.22:0/12788347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c009e80 con 0x7f53540b1850 2023-10-08T00:36:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535159a700 1 -- 172.21.15.22:0/12788347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c00b860 con 0x7f53540b1850 2023-10-08T00:36:37.892 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f535159a700 1 -- 172.21.15.22:0/12788347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00bbe0 con 0x7f53540b1850 2023-10-08T00:36:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f5358c29700 1 -- 172.21.15.22:0/12788347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540b1850 msgr2=0x7f53540b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.889+0000 7f5358c29700 1 --2- 172.21.15.22:0/12788347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540b1850 0x7f53540b1c20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f534c0098e0 tx=0x7f534c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.890+0000 7f5358c29700 1 -- 172.21.15.22:0/12788347 shutdown_connections 2023-10-08T00:36:37.894 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.890+0000 7f5358c29700 1 --2- 172.21.15.22:0/12788347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540b1850 0x7f53540b1c20 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.890+0000 7f5358c29700 1 -- 172.21.15.22:0/12788347 >> 172.21.15.22:0/12788347 conn(0x7f535406a320 msgr2=0x7f53540cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.890+0000 7f5358c29700 1 -- 172.21.15.22:0/12788347 shutdown_connections 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.890+0000 7f5358c29700 1 -- 172.21.15.22:0/12788347 wait complete. 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 Processor -- start 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 -- start start 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 0x7f53541596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53540b1850 0x7f53540b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53541579f0 0x7f53540ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540cc260 con 0x7f53540ae680 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53540b07e0 con 0x7f53541579f0 2023-10-08T00:36:37.895 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f5358c29700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5354159210 con 0x7f53540b1850 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f535259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 0x7f53541596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f535259c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 0x7f53541596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53238/0 (socket says 172.21.15.22:53238) 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.891+0000 7f535259c700 1 -- 172.21.15.22:0/3237016068 learned_addr learned my addr 172.21.15.22:0/3237016068 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f5351d9b700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53540b1850 0x7f53540b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f5352d9d700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53541579f0 0x7f53540ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f535259c700 1 -- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53540b1850 msgr2=0x7f53540b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f535259c700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53540b1850 0x7f53540b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f535259c700 1 -- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53541579f0 msgr2=0x7f53540ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f535259c700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53541579f0 0x7f53540ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f535259c700 1 -- 172.21.15.22:0/3237016068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c009420 con 0x7f53540ae680 2023-10-08T00:36:37.896 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f535259c700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 0x7f53541596a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f5354064290 tx=0x7f534c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c01f070 con 0x7f53540ae680 2023-10-08T00:36:37.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c000c90 con 0x7f53540ae680 2023-10-08T00:36:37.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5354159be0 con 0x7f53540ae680 2023-10-08T00:36:37.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c025420 con 0x7f53540ae680 2023-10-08T00:36:37.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.892+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5354158bc0 con 0x7f53540ae680 2023-10-08T00:36:37.897 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.893+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535404c3c0 con 0x7f53540ae680 2023-10-08T00:36:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.893+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f534c023070 con 0x7f53540ae680 2023-10-08T00:36:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.894+0000 7f534a7fc700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5334067320 0x7f53340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.894+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f534c0861c0 con 0x7f53540ae680 2023-10-08T00:36:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.894+0000 7f5351d9b700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5334067320 0x7f53340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:37.898 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.895+0000 7f5351d9b700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5334067320 0x7f53340697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f535406f660 tx=0x7f533c007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:37.900 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:37.898+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f534c052e00 con 0x7f53540ae680 2023-10-08T00:36:38.138 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.137+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53540cbba0 con 0x7f53540ae680 2023-10-08T00:36:38.139 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.137+0000 7f534a7fc700 1 -- 172.21.15.22:0/3237016068 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f534c015090 con 0x7f53540ae680 2023-10-08T00:36:38.139 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:38.139 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":137,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:34:24.313262+0000","modified":"2023-10-08T00:34:27.920845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9099":{"gid":9099,"name":"d","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3800835270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3800835270},{"type":"v1","addr":"172.21.15.192:6837","nonce":3800835270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5334067320 msgr2=0x7f53340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5334067320 0x7f53340697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f535406f660 tx=0x7f533c007d10 comp rx=0 tx=0).stop 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 msgr2=0x7f53541596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 0x7f53541596a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f5354064290 tx=0x7f534c017000 comp rx=0 tx=0).stop 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 shutdown_connections 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53541579f0 0x7f53540ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.141 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53540ae680 0x7f53541596a0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5334067320 0x7f53340697d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 --2- 172.21.15.22:0/3237016068 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f53540b1850 0x7f53540b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 >> 172.21.15.22:0/3237016068 conn(0x7f535406a320 msgr2=0x7f535414c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 shutdown_connections 2023-10-08T00:36:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.139+0000 7f5358c29700 1 -- 172.21.15.22:0/3237016068 wait complete. 2023-10-08T00:36:38.142 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 137 2023-10-08T00:36:38.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.270+0000 7f3d1819c700 1 Processor -- start 2023-10-08T00:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.270+0000 7f3d1819c700 1 -- start start 2023-10-08T00:36:38.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d1819c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d10069560 0x7f3d100699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d1819c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d10069ee0 con 0x7f3d10159890 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d1819c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1015a160 con 0x7f3d10159c60 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d1819c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100d13a0 con 0x7f3d10069560 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d15f38700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3d10159890 0x7f3d1015abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36550/0 (socket says 172.21.15.22:36550) 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d15f38700 1 -- 172.21.15.22:0/2374212752 learned_addr learned my addr 172.21.15.22:0/2374212752 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d16739700 1 --2- 172.21.15.22:0/2374212752 >> v2:172.21.15.192:3300/0 conn(0x7f3d10069560 0x7f3d100699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116852664 0 0) 0x7f3d10069ee0 con 0x7f3d10159890 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf8003570 con 0x7f3d10159890 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4125497105 0 0) 0x7f3cf8003570 con 0x7f3d10159890 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 >> v2:172.21.15.192:3300/0 conn(0x7f3d10069560 msgr2=0x7f3d100699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 --2- 172.21.15.22:0/2374212752 >> v2:172.21.15.192:3300/0 conn(0x7f3d10069560 0x7f3d100699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 >> v1:172.21.15.192:6789/0 conn(0x7f3d10159c60 legacy=0x7f3d1015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1015e140 con 0x7f3d10159890 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f3d08001470 con 0x7f3d10159890 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 >> v1:172.21.15.22:6789/0 conn(0x7f3d10159890 legacy=0x7f3d1015abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf8003a60 0x7f3cf8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf8004810 0x7f3cf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf80051c0 0x7f3cf800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100d13a0 con 0x7f3cf8003a60 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf800c0d0 con 0x7f3cf8004810 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf800c290 con 0x7f3cf80051c0 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.271+0000 7f3d15f38700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf8003a60 0x7f3cf8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15737700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf8004810 0x7f3cf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d16739700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf80051c0 0x7f3cf800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15f38700 1 -- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf80051c0 msgr2=0x7f3cf800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15f38700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf80051c0 0x7f3cf800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15f38700 1 -- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf8004810 msgr2=0x7f3cf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15f38700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cf8004810 0x7f3cf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d16739700 1 -- 172.21.15.22:0/2374212752 reap_dead start 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15f38700 1 -- 172.21.15.22:0/2374212752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8003570 con 0x7f3cf8003a60 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d15f38700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf8003a60 0x7f3cf8003e70 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c3c0 tx=0x7f3d08001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973417f5dd5435c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800cc10 con 0x7f3cf8003a60 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0800cd70 con 0x7f3cf8003a60 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.272+0000 7f3d14f36700 1 -- 172.21.15.22:0/2374212752 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d08005b50 con 0x7f3cf8003a60 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 -- 172.21.15.22:0/2374212752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf8003a60 msgr2=0x7f3cf8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf8003a60 0x7f3cf8003e70 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800c3c0 tx=0x7f3d08001e50 comp rx=0 tx=0).stop 2023-10-08T00:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 -- 172.21.15.22:0/2374212752 shutdown_connections 2023-10-08T00:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 --2- 172.21.15.22:0/2374212752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cf8003a60 0x7f3cf8003e70 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 -- 172.21.15.22:0/2374212752 >> 172.21.15.22:0/2374212752 conn(0x7f3d10068e20 msgr2=0x7f3d100d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 -- 172.21.15.22:0/2374212752 shutdown_connections 2023-10-08T00:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.273+0000 7f3d1819c700 1 -- 172.21.15.22:0/2374212752 wait complete. 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.274+0000 7f3d1819c700 1 Processor -- start 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.274+0000 7f3d1819c700 1 -- start start 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf8003a60 0x7f3d10155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d100cd130 0x7f3d100b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 0x7f3d101576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1016a930 con 0x7f3d10157260 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10157c20 con 0x7f3d100cd130 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10169cb0 con 0x7f3cf8003a60 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 0x7f3d101576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 0x7f3d101576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53270/0 (socket says 172.21.15.22:53270) 2023-10-08T00:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 -- 172.21.15.22:0/4082118579 learned_addr learned my addr 172.21.15.22:0/4082118579 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d15737700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d100cd130 0x7f3d100b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d15f38700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf8003a60 0x7f3d10155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 -- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf8003a60 msgr2=0x7f3d10155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf8003a60 0x7f3d10155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 -- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d100cd130 msgr2=0x7f3d100b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d100cd130 0x7f3d100b5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 -- 172.21.15.22:0/4082118579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10169f90 con 0x7f3d10157260 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d15737700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d100cd130 0x7f3d100b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d16739700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 0x7f3d101576e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f3d000094d0 tx=0x7f3d0000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000e040 con 0x7f3d10157260 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000f040 con 0x7f3d10157260 2023-10-08T00:36:38.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.275+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1016a270 con 0x7f3d10157260 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.276+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000fe70 con 0x7f3d10157260 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.276+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d10155fa0 con 0x7f3d10157260 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.277+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1016aa70 con 0x7f3d10157260 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.277+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3d00015640 con 0x7f3d10157260 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.277+0000 7f3d0dffb700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cfc067320 0x7f3cfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.278+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f3d000856c0 con 0x7f3d10157260 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.278+0000 7f3d15f38700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cfc067320 0x7f3cfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.278+0000 7f3d15f38700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cfc067320 0x7f3cfc0697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3d08000ff0 tx=0x7f3d08015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.282+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d1016aa70 con 0x7f3d10157260 2023-10-08T00:36:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.519+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d1016aa70 con 0x7f3d10157260 2023-10-08T00:36:38.520 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.519+0000 7f3d0dffb700 1 -- 172.21.15.22:0/4082118579 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f3d1016aa70 con 0x7f3d10157260 2023-10-08T00:36:38.521 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:38.521 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":137,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T00:34:24.313262+0000","modified":"2023-10-08T00:34:27.920845+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9099},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9099":{"gid":9099,"name":"d","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3800835270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3800835270},{"type":"v1","addr":"172.21.15.192:6837","nonce":3800835270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-08T00:36:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cfc067320 msgr2=0x7f3cfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cfc067320 0x7f3cfc0697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3d08000ff0 tx=0x7f3d08015000 comp rx=0 tx=0).stop 2023-10-08T00:36:38.523 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 msgr2=0x7f3d101576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 0x7f3d101576e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f3d000094d0 tx=0x7f3d0000b040 comp rx=0 tx=0).stop 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 shutdown_connections 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d10157260 0x7f3d101576e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3cfc067320 0x7f3cfc0697d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3cf8003a60 0x7f3d10155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.521+0000 7f3d1819c700 1 --2- 172.21.15.22:0/4082118579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d100cd130 0x7f3d100b5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.522+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 >> 172.21.15.22:0/4082118579 conn(0x7f3d10068e20 msgr2=0x7f3d10158940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.522+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 shutdown_connections 2023-10-08T00:36:38.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.522+0000 7f3d1819c700 1 -- 172.21.15.22:0/4082118579 wait complete. 2023-10-08T00:36:38.525 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 137 2023-10-08T00:36:38.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:36:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.652+0000 7f24ca560700 1 Processor -- start 2023-10-08T00:36:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.652+0000 7f24ca560700 1 -- start start 2023-10-08T00:36:38.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24ca560700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f24c406c0a0 0x7f24c40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.656 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24ca560700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c415df50 0x7f24c415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24ca560700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c415d7e0 con 0x7f24c406bcd0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24ca560700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c415dac0 con 0x7f24c406c0a0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24ca560700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c415aa30 con 0x7f24c415df50 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24c3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f24c406bcd0 0x7f24c415a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36558/0 (socket says 172.21.15.22:36558) 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24c3fff700 1 -- 172.21.15.22:0/3240856824 learned_addr learned my addr 172.21.15.22:0/3240856824 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.653+0000 7f24c8afd700 1 --2- 172.21.15.22:0/3240856824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c415df50 0x7f24c415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c37fe700 1 --2- 172.21.15.22:0/3240856824 >> v2:172.21.15.192:3300/0 conn(0x7f24c406c0a0 0x7f24c40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c2ffd700 1 -- 172.21.15.22:0/3240856824 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922038252 0 0) 0x7f24c415d7e0 con 0x7f24c406bcd0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c2ffd700 1 -- 172.21.15.22:0/3240856824 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003570 con 0x7f24c406bcd0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c8afd700 1 -- 172.21.15.22:0/3240856824 >> v2:172.21.15.192:3300/0 conn(0x7f24c406c0a0 msgr2=0x7f24c40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c2ffd700 1 -- 172.21.15.22:0/3240856824 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3922573481 0 0) 0x7f24b0003570 con 0x7f24c406bcd0 2023-10-08T00:36:38.657 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c8afd700 1 --2- 172.21.15.22:0/3240856824 >> v2:172.21.15.192:3300/0 conn(0x7f24c406c0a0 0x7f24c40caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c8afd700 1 -- 172.21.15.22:0/3240856824 >> v1:172.21.15.22:6789/0 conn(0x7f24c406bcd0 legacy=0x7f24c415a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c8afd700 1 -- 172.21.15.22:0/3240856824 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c415ad10 con 0x7f24c415df50 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c37fe700 1 --2- 172.21.15.22:0/3240856824 >> v2:172.21.15.192:3300/0 conn(0x7f24c406c0a0 0x7f24c40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c8afd700 1 --2- 172.21.15.22:0/3240856824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c415df50 0x7f24c415e3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009e60 tx=0x7f24bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=952e8ae9f08d928 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c2ffd700 1 -- 172.21.15.22:0/3240856824 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc00e070 con 0x7f24c415df50 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c2ffd700 1 -- 172.21.15.22:0/3240856824 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc00b7a0 con 0x7f24c415df50 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.654+0000 7f24c2ffd700 1 -- 172.21.15.22:0/3240856824 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac001470 con 0x7f24c415df50 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 -- 172.21.15.22:0/3240856824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c415df50 msgr2=0x7f24c415e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 --2- 172.21.15.22:0/3240856824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c415df50 0x7f24c415e3f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009e60 tx=0x7f24bc009780 comp rx=0 tx=0).stop 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 -- 172.21.15.22:0/3240856824 shutdown_connections 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 --2- 172.21.15.22:0/3240856824 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c415df50 0x7f24c415e3f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.658 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 --2- 172.21.15.22:0/3240856824 >> v2:172.21.15.192:3300/0 conn(0x7f24c406c0a0 0x7f24c40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 -- 172.21.15.22:0/3240856824 >> 172.21.15.22:0/3240856824 conn(0x7f24c40ce600 msgr2=0x7f24c40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:38.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 -- 172.21.15.22:0/3240856824 shutdown_connections 2023-10-08T00:36:38.659 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.655+0000 7f24ca560700 1 -- 172.21.15.22:0/3240856824 wait complete. 2023-10-08T00:36:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.656+0000 7f24ca560700 1 Processor -- start 2023-10-08T00:36:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.656+0000 7f24ca560700 1 -- start start 2023-10-08T00:36:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24ca560700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c406bcd0 0x7f24c40b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24ca560700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406c0a0 0x7f24c4154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24ca560700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 0x7f24c40b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24ca560700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c416d630 con 0x7f24c415df50 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24ca560700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4154a70 con 0x7f24c406bcd0 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24ca560700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c416a4f0 con 0x7f24c406c0a0 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 0x7f24c40b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 0x7f24c40b2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53286/0 (socket says 172.21.15.22:53286) 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 -- 172.21.15.22:0/1329782502 learned_addr learned my addr 172.21.15.22:0/1329782502 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c3fff700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c406bcd0 0x7f24c40b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c37fe700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406c0a0 0x7f24c4154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 -- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406c0a0 msgr2=0x7f24c4154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406c0a0 0x7f24c4154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 -- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c406bcd0 msgr2=0x7f24c40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c406bcd0 0x7f24c40b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 -- 172.21.15.22:0/1329782502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4009420 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c3fff700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c406bcd0 0x7f24c40b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.657+0000 7f24c8afd700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 0x7f24c40b2c30 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b610 tx=0x7f24bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.658+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc012cc0 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.658+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc012e20 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.658+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc009a20 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.658+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0266b0 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.658+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c416aab0 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.659+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c416d7a0 con 0x7f24c415df50 2023-10-08T00:36:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.659+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24bc026ae0 con 0x7f24c415df50 2023-10-08T00:36:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.659+0000 7f24bbfff700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f24a4067320 0x7f24a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.659+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f24bc087050 con 0x7f24c415df50 2023-10-08T00:36:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.660+0000 7f24c3fff700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f24a4067320 0x7f24a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.660+0000 7f24c3fff700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f24a4067320 0x7f24a40697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f24ac001620 tx=0x7f24ac001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.664+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24bc0b85a0 con 0x7f24c415df50 2023-10-08T00:36:38.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.858+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24c40ce0b0 con 0x7f24c415df50 2023-10-08T00:36:38.860 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.859+0000 7f24bbfff700 1 -- 172.21.15.22:0/1329782502 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+15509 (secure 0 0 0) 0x7f24bc06de60 con 0x7f24c415df50 2023-10-08T00:36:38.861 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:38.861 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":204,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:34:42.885360+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-08T00:34:22.729022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-08T00:34:23.277833+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.b","mappings":[{"from":0,"to":1}]},{"pgid":"34.13","mappings":[{"from":0,"to":2}]},{"pgid":"34.24","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f24a4067320 msgr2=0x7f24a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f24a4067320 0x7f24a40697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f24ac001620 tx=0x7f24ac001970 comp rx=0 tx=0).stop 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 msgr2=0x7f24c40b2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 0x7f24c40b2c30 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b610 tx=0x7f24bc018000 comp rx=0 tx=0).stop 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 shutdown_connections 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24c415df50 0x7f24c40b2c30 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24c406bcd0 0x7f24c40b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f24a4067320 0x7f24a40697d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.863 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 --2- 172.21.15.22:0/1329782502 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24c406c0a0 0x7f24c4154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 >> 172.21.15.22:0/1329782502 conn(0x7f24c40ce600 msgr2=0x7f24c40704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:38.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 shutdown_connections 2023-10-08T00:36:38.864 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.861+0000 7f24ca560700 1 -- 172.21.15.22:0/1329782502 wait complete. 2023-10-08T00:36:38.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T00:36:38.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.994+0000 7f73001c9700 1 Processor -- start 2023-10-08T00:36:38.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.994+0000 7f73001c9700 1 -- start start 2023-10-08T00:36:38.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.995+0000 7f73001c9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72f806bcd0 0x7f72f80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.995+0000 7f73001c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806c0a0 0x7f72f815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.995+0000 7f73001c9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f815d7e0 con 0x7f72f815df50 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.995+0000 7f73001c9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f815dac0 con 0x7f72f806bcd0 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.995+0000 7f73001c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f815aa30 con 0x7f72f806c0a0 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.995+0000 7f72fdf65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72f806bcd0 0x7f72f80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72f806bcd0 0x7f72f80caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53296/0 (socket says 172.21.15.22:53296) 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 -- 172.21.15.22:0/3903656473 learned_addr learned my addr 172.21.15.22:0/3903656473 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fd764700 1 --2- 172.21.15.22:0/3903656473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806c0a0 0x7f72f815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 -- 172.21.15.22:0/3903656473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806c0a0 msgr2=0x7f72f815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 --2- 172.21.15.22:0/3903656473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806c0a0 0x7f72f815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 -- 172.21.15.22:0/3903656473 >> v1:172.21.15.192:6789/0 conn(0x7f72f815df50 legacy=0x7f72f80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 -- 172.21.15.22:0/3903656473 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f815ad10 con 0x7f72f806bcd0 2023-10-08T00:36:38.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fdf65700 1 --2- 172.21.15.22:0/3903656473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806bcd0 0x7f72f80caa90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f72f00099b0 tx=0x7f72f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20993e0ed70e006d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fcf63700 1 -- 172.21.15.22:0/3903656473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000b860 con 0x7f72f806bcd0 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fcf63700 1 -- 172.21.15.22:0/3903656473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000b9c0 con 0x7f72f806bcd0 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.996+0000 7f72fcf63700 1 -- 172.21.15.22:0/3903656473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000bd80 con 0x7f72f806bcd0 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 -- 172.21.15.22:0/3903656473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806bcd0 msgr2=0x7f72f80caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 --2- 172.21.15.22:0/3903656473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806bcd0 0x7f72f80caa90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f72f00099b0 tx=0x7f72f0009250 comp rx=0 tx=0).stop 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 -- 172.21.15.22:0/3903656473 shutdown_connections 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 --2- 172.21.15.22:0/3903656473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806bcd0 0x7f72f80caa90 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 --2- 172.21.15.22:0/3903656473 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806c0a0 0x7f72f815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 -- 172.21.15.22:0/3903656473 >> 172.21.15.22:0/3903656473 conn(0x7f72f80ce600 msgr2=0x7f72f80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 -- 172.21.15.22:0/3903656473 shutdown_connections 2023-10-08T00:36:39.000 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.997+0000 7f73001c9700 1 -- 172.21.15.22:0/3903656473 wait complete. 2023-10-08T00:36:39.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.998+0000 7f73001c9700 1 Processor -- start 2023-10-08T00:36:39.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.998+0000 7f73001c9700 1 -- start start 2023-10-08T00:36:39.003 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806bcd0 0x7f72f80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 0x7f72f815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f815df50 0x7f72f815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f816b520 con 0x7f72f806c0a0 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80c6e30 con 0x7f72f815df50 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f816b240 con 0x7f72f806bcd0 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 0x7f72f815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 0x7f72f815c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53298/0 (socket says 172.21.15.22:53298) 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 -- 172.21.15.22:0/1617218535 learned_addr learned my addr 172.21.15.22:0/1617218535 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fdf65700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806bcd0 0x7f72f80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fe766700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f815df50 0x7f72f815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 -- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806bcd0 msgr2=0x7f72f80c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806bcd0 0x7f72f80c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 -- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f815df50 msgr2=0x7f72f815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f815df50 0x7f72f815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 -- 172.21.15.22:0/1617218535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00094f0 con 0x7f72f806c0a0 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fe766700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f815df50 0x7f72f815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72fd764700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 0x7f72f815c330 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00d860 tx=0x7f72ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0125f0 con 0x7f72f806c0a0 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec012750 con 0x7f72f806c0a0 2023-10-08T00:36:39.005 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec012b10 con 0x7f72f806c0a0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:38.999+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f80b1540 con 0x7f72f806c0a0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.000+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f80b1b00 con 0x7f72f806c0a0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.000+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80b13a0 con 0x7f72f806c0a0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.001+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f72ec01e460 con 0x7f72f806c0a0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.001+0000 7f72f5ffb700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72e4067320 0x7f72e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.001+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f72ec085390 con 0x7f72f806c0a0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.002+0000 7f72fdf65700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72e4067320 0x7f72e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.006 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.002+0000 7f72fdf65700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72e4067320 0x7f72e40697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f72f00099b0 tx=0x7f72f0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.005+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f80b13a0 con 0x7f72f806c0a0 2023-10-08T00:36:39.247 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.246+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f72f80b13a0 con 0x7f72f806c0a0 2023-10-08T00:36:39.248 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-08T00:36:39.246+0000 7ff03dd0d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T00:36:39.252 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.251+0000 7f72f5ffb700 1 -- 172.21.15.22:0/1617218535 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v138) v1 ==== 161+0+0 (secure 0 0 0) 0x7f72f80b13a0 con 0x7f72f806c0a0 2023-10-08T00:36:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72e4067320 msgr2=0x7f72e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72e4067320 0x7f72e40697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f72f00099b0 tx=0x7f72f0017000 comp rx=0 tx=0).stop 2023-10-08T00:36:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 msgr2=0x7f72f815c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 0x7f72f815c330 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00d860 tx=0x7f72ec008040 comp rx=0 tx=0).stop 2023-10-08T00:36:39.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 shutdown_connections 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f815df50 0x7f72f815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f72e4067320 0x7f72e40697d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f72f806bcd0 0x7f72f80c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 --2- 172.21.15.22:0/1617218535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f806c0a0 0x7f72f815c330 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 >> 172.21.15.22:0/1617218535 conn(0x7f72f80ce600 msgr2=0x7f72f8155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 shutdown_connections 2023-10-08T00:36:39.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.253+0000 7f73001c9700 1 -- 172.21.15.22:0/1617218535 wait complete. 2023-10-08T00:36:39.257 INFO:tasks.ceph.mds.d.smithi192.stderr: -3252> 2023-10-08T00:34:30.665+0000 7fc8a0193700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T00:36:39.257 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T00:36:39.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T00:36:39.280 INFO:tasks.ceph.mds.d.smithi192.stdout:starting mds.d at 2023-10-08T00:36:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.386+0000 7f93df832700 1 Processor -- start 2023-10-08T00:36:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93df832700 1 -- start start 2023-10-08T00:36:39.390 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93df832700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f93d8159c60 0x7f93d815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93df832700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d815a160 con 0x7f93d8159890 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93df832700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d80d13a0 con 0x7f93d815db10 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93df832700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d815df50 con 0x7f93d8159c60 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93dd5ce700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f93d8159890 0x7f93d815abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36566/0 (socket says 172.21.15.22:36566) 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.387+0000 7f93dd5ce700 1 -- 172.21.15.22:0/1491294489 learned_addr learned my addr 172.21.15.22:0/1491294489 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93dcdcd700 1 --2- 172.21.15.22:0/1491294489 >> v2:172.21.15.192:3300/0 conn(0x7f93d8159c60 0x7f93d815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93d7fff700 1 -- 172.21.15.22:0/1491294489 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807028335 0 0) 0x7f93d815a160 con 0x7f93d8159890 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93d7fff700 1 -- 172.21.15.22:0/1491294489 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c0003570 con 0x7f93d8159890 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93dcdcd700 1 -- 172.21.15.22:0/1491294489 >> v1:172.21.15.192:6789/0 conn(0x7f93d815db10 legacy=0x7f93d8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93d7fff700 1 -- 172.21.15.22:0/1491294489 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466447822 0 0) 0x7f93d80d13a0 con 0x7f93d815db10 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93dcdcd700 1 -- 172.21.15.22:0/1491294489 >> v1:172.21.15.22:6789/0 conn(0x7f93d8159890 legacy=0x7f93d815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93dcdcd700 1 -- 172.21.15.22:0/1491294489 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d815e140 con 0x7f93d8159c60 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93dcdcd700 1 --2- 172.21.15.22:0/1491294489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159c60 0x7f93d815d5d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0098e0 tx=0x7f93cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3caf44a33af3097 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93d7fff700 1 -- 172.21.15.22:0/1491294489 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00b640 con 0x7f93d8159c60 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93d7fff700 1 -- 172.21.15.22:0/1491294489 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc00b7a0 con 0x7f93d8159c60 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.388+0000 7f93d7fff700 1 -- 172.21.15.22:0/1491294489 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00bb40 con 0x7f93d8159c60 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 -- 172.21.15.22:0/1491294489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159c60 msgr2=0x7f93d815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 --2- 172.21.15.22:0/1491294489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159c60 0x7f93d815d5d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0098e0 tx=0x7f93cc0091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 -- 172.21.15.22:0/1491294489 shutdown_connections 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 --2- 172.21.15.22:0/1491294489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159c60 0x7f93d815d5d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 -- 172.21.15.22:0/1491294489 >> 172.21.15.22:0/1491294489 conn(0x7f93d8068e20 msgr2=0x7f93d80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 -- 172.21.15.22:0/1491294489 shutdown_connections 2023-10-08T00:36:39.392 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.389+0000 7f93df832700 1 -- 172.21.15.22:0/1491294489 wait complete. 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.390+0000 7f93df832700 1 Processor -- start 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.390+0000 7f93df832700 1 -- start start 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93df832700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159890 0x7f93d8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93df832700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 0x7f93d80ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93df832700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93d815db10 0x7f93d80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93df832700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80b1560 con 0x7f93d8159c60 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93df832700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80b3ff0 con 0x7f93d8159890 2023-10-08T00:36:39.395 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93df832700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d80b36c0 con 0x7f93d815db10 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 0x7f93d80ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 0x7f93d80ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53302/0 (socket says 172.21.15.22:53302) 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 -- 172.21.15.22:0/676222204 learned_addr learned my addr 172.21.15.22:0/676222204 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dddcf700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93d815db10 0x7f93d80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dd5ce700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159890 0x7f93d8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 -- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93d815db10 msgr2=0x7f93d80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93d815db10 0x7f93d80ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 -- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159890 msgr2=0x7f93d8145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159890 0x7f93d8145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dcdcd700 1 -- 172.21.15.22:0/676222204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009420 con 0x7f93d8159c60 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.391+0000 7f93dd5ce700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159890 0x7f93d8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:39.396 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.392+0000 7f93dcdcd700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 0x7f93d80ce0d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f93d8070e20 tx=0x7f93cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.392+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc01f070 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.392+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc00b910 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.392+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011420 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.392+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d80b39a0 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.392+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d8145940 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.393+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8145b30 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.393+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f93cc011790 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.393+0000 7f93d57fa700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f93c4067320 0x7f93c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.394+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f93cc085f60 con 0x7f93d8159c60 2023-10-08T00:36:39.397 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.394+0000 7f93dd5ce700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f93c4067320 0x7f93c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:39.398 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.394+0000 7f93dd5ce700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f93c4067320 0x7f93c40697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f93d00058d0 tx=0x7f93d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:39.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.398+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93cc052bf0 con 0x7f93d8159c60 2023-10-08T00:36:39.637 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:39.636+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f93d80b4160 con 0x7f93d8159c60 2023-10-08T00:36:40.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.252+0000 7f93d57fa700 1 -- 172.21.15.22:0/676222204 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v139) v1 ==== 104+0+0 (secure 0 0 0) 0x7f93cc056210 con 0x7f93d8159c60 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f93c4067320 msgr2=0x7f93c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f93c4067320 0x7f93c40697d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f93d00058d0 tx=0x7f93d0009040 comp rx=0 tx=0).stop 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 msgr2=0x7f93d80ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 0x7f93d80ce0d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f93d8070e20 tx=0x7f93cc017000 comp rx=0 tx=0).stop 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 shutdown_connections 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f93c4067320 0x7f93c40697d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f93d815db10 0x7f93d80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d8159890 0x7f93d8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 --2- 172.21.15.22:0/676222204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93d8159c60 0x7f93d80ce0d0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 >> 172.21.15.22:0/676222204 conn(0x7f93d8068e20 msgr2=0x7f93d8156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:40.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 shutdown_connections 2023-10-08T00:36:40.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.254+0000 7f93df832700 1 -- 172.21.15.22:0/676222204 wait complete. 2023-10-08T00:36:40.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T00:36:40.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.397+0000 7f676590b700 1 Processor -- start 2023-10-08T00:36:40.399 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.397+0000 7f676590b700 1 -- start start 2023-10-08T00:36:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f676590b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67600b21b0 0x7f676015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f676590b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67600b2580 0x7f676006be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f676590b700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f676006c3d0 0x7f6760156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f676590b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676006c850 con 0x7f67600b2580 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f676590b700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676015aa10 con 0x7f676006c3d0 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f676590b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67600cd160 con 0x7f67600b21b0 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67600b2580 0x7f676006be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675e7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67600b2580 0x7f676006be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53310/0 (socket says 172.21.15.22:53310) 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675e7fc700 1 -- 172.21.15.22:0/2678064954 learned_addr learned my addr 172.21.15.22:0/2678064954 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675effd700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67600b21b0 0x7f676015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675f7fe700 1 --2- 172.21.15.22:0/2678064954 >> v2:172.21.15.192:3300/0 conn(0x7f676006c3d0 0x7f6760156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675e7fc700 1 -- 172.21.15.22:0/2678064954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67600b21b0 msgr2=0x7f676015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.398+0000 7f675e7fc700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67600b21b0 0x7f676015aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675e7fc700 1 -- 172.21.15.22:0/2678064954 >> v2:172.21.15.192:3300/0 conn(0x7f676006c3d0 msgr2=0x7f6760156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675e7fc700 1 --2- 172.21.15.22:0/2678064954 >> v2:172.21.15.192:3300/0 conn(0x7f676006c3d0 0x7f6760156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675e7fc700 1 -- 172.21.15.22:0/2678064954 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6760157be0 con 0x7f67600b2580 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675effd700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67600b21b0 0x7f676015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675e7fc700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676006be90 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6748009990 tx=0x7f6748009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918f5078e99d8ed4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:40.404 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675dffb700 1 -- 172.21.15.22:0/2678064954 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6748005c10 con 0x7f67600b2580 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675dffb700 1 -- 172.21.15.22:0/2678064954 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6748005d70 con 0x7f67600b2580 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f675dffb700 1 -- 172.21.15.22:0/2678064954 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800b840 con 0x7f67600b2580 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 -- 172.21.15.22:0/2678064954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 msgr2=0x7f676006be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676006be90 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6748009990 tx=0x7f6748009220 comp rx=0 tx=0).stop 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 -- 172.21.15.22:0/2678064954 shutdown_connections 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 --2- 172.21.15.22:0/2678064954 >> v2:172.21.15.192:3300/0 conn(0x7f676006c3d0 0x7f6760156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f67600b21b0 0x7f676015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 --2- 172.21.15.22:0/2678064954 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676006be90 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 -- 172.21.15.22:0/2678064954 >> 172.21.15.22:0/2678064954 conn(0x7f676006b3e0 msgr2=0x7f67600aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 -- 172.21.15.22:0/2678064954 shutdown_connections 2023-10-08T00:36:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.399+0000 7f676590b700 1 -- 172.21.15.22:0/2678064954 wait complete. 2023-10-08T00:36:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 Processor -- start 2023-10-08T00:36:40.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 -- start start 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f676006c3d0 0x7f67600c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67600b21b0 0x7f6760153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676016ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600c4210 con 0x7f67600b2580 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67600a5780 con 0x7f67600b21b0 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.401+0000 7f676590b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6760153b50 con 0x7f676006c3d0 2023-10-08T00:36:40.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676016ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676016ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53314/0 (socket says 172.21.15.22:53314) 2023-10-08T00:36:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 -- 172.21.15.22:0/1917198041 learned_addr learned my addr 172.21.15.22:0/1917198041 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675effd700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f676006c3d0 0x7f67600c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675e7fc700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67600b21b0 0x7f6760153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 -- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f676006c3d0 msgr2=0x7f67600c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:40.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f676006c3d0 0x7f67600c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 -- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67600b21b0 msgr2=0x7f6760153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67600b21b0 0x7f6760153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 -- 172.21.15.22:0/1917198041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009480 con 0x7f67600b2580 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f675f7fe700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676016ad70 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f675800d890 tx=0x7f6758008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67580125f0 con 0x7f67600b2580 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758012770 con 0x7f67600b2580 2023-10-08T00:36:40.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6760068890 con 0x7f67600b2580 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758012b30 con 0x7f67600b2580 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.402+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6760068e50 con 0x7f67600b2580 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.403+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676004c3c0 con 0x7f67600b2580 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.404+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f675801e460 con 0x7f67600b2580 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.404+0000 7f6756ffd700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6740067320 0x7f67400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.404+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f6758085480 con 0x7f67600b2580 2023-10-08T00:36:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.404+0000 7f675effd700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6740067320 0x7f67400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.405+0000 7f675effd700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6740067320 0x7f67400697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f67500076a0 tx=0x7f67500098f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.408+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6758052060 con 0x7f67600b2580 2023-10-08T00:36:40.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:40.602+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67600acb50 con 0x7f67600b2580 2023-10-08T00:36:41.257 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.256+0000 7f6756ffd700 1 -- 172.21.15.22:0/1917198041 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v206) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6758055680 con 0x7f67600b2580 2023-10-08T00:36:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.260+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6740067320 msgr2=0x7f67400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.260+0000 7f676590b700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6740067320 0x7f67400697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f67500076a0 tx=0x7f67500098f0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.260+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 msgr2=0x7f676016ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.260+0000 7f676590b700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676016ad70 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f675800d890 tx=0x7f6758008040 comp rx=0 tx=0).stop 2023-10-08T00:36:41.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 shutdown_connections 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67600b2580 0x7f676016ad70 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6740067320 0x7f67400697d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f676006c3d0 0x7f67600c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 --2- 172.21.15.22:0/1917198041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67600b21b0 0x7f6760153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 >> 172.21.15.22:0/1917198041 conn(0x7f676006b3e0 msgr2=0x7f67600cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 shutdown_connections 2023-10-08T00:36:41.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.261+0000 7f676590b700 1 -- 172.21.15.22:0/1917198041 wait complete. 2023-10-08T00:36:41.266 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2023-10-08T00:36:41.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T00:36:41.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.401+0000 7f3930684700 1 Processor -- start 2023-10-08T00:36:41.403 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.401+0000 7f3930684700 1 -- start start 2023-10-08T00:36:41.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f3930684700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3928159ec0 0x7f39280b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:41.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f3930684700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39280cf350 0x7f39280cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f3930684700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280b5b00 con 0x7f39280b53d0 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f3930684700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39280b5da0 con 0x7f39280cf350 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f3930684700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280b6080 con 0x7f3928159ec0 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f392ec21700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39280cf350 0x7f39280cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f392ec21700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f39280cf350 0x7f39280cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53328/0 (socket says 172.21.15.22:53328) 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f392dc1f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f39280b53d0 0x7f39280cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36570/0 (socket says 172.21.15.22:36570) 2023-10-08T00:36:41.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f392ec21700 1 -- 172.21.15.22:0/3035269588 learned_addr learned my addr 172.21.15.22:0/3035269588 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.402+0000 7f392e420700 1 --2- 172.21.15.22:0/3035269588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3928159ec0 0x7f39280b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392ec21700 1 -- 172.21.15.22:0/3035269588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3928159ec0 msgr2=0x7f39280b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392ec21700 1 --2- 172.21.15.22:0/3035269588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3928159ec0 0x7f39280b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392ec21700 1 -- 172.21.15.22:0/3035269588 >> v1:172.21.15.22:6789/0 conn(0x7f39280b53d0 legacy=0x7f39280cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392ec21700 1 -- 172.21.15.22:0/3035269588 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280cc100 con 0x7f39280cf350 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392d41e700 1 -- 172.21.15.22:0/3035269588 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619881488 0 0) 0x7f39280b5b00 con 0x7f39280b53d0 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392ec21700 1 --2- 172.21.15.22:0/3035269588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280cf350 0x7f39280cd010 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f3918009f20 tx=0x7f3918009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985e4eed4da8c0fd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:41.408 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392d41e700 1 -- 172.21.15.22:0/3035269588 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391800e070 con 0x7f39280cf350 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392d41e700 1 -- 172.21.15.22:0/3035269588 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391800b9d0 con 0x7f39280cf350 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f392d41e700 1 -- 172.21.15.22:0/3035269588 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39180092e0 con 0x7f39280cf350 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f3930684700 1 -- 172.21.15.22:0/3035269588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280cf350 msgr2=0x7f39280cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.403+0000 7f3930684700 1 --2- 172.21.15.22:0/3035269588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280cf350 0x7f39280cd010 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f3918009f20 tx=0x7f3918009840 comp rx=0 tx=0).stop 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.404+0000 7f3930684700 1 -- 172.21.15.22:0/3035269588 shutdown_connections 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.404+0000 7f3930684700 1 --2- 172.21.15.22:0/3035269588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280cf350 0x7f39280cd010 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.404+0000 7f3930684700 1 --2- 172.21.15.22:0/3035269588 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3928159ec0 0x7f39280b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.409 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.404+0000 7f3930684700 1 -- 172.21.15.22:0/3035269588 >> 172.21.15.22:0/3035269588 conn(0x7f39280999f0 msgr2=0x7f39280b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.404+0000 7f3930684700 1 -- 172.21.15.22:0/3035269588 shutdown_connections 2023-10-08T00:36:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.404+0000 7f3930684700 1 -- 172.21.15.22:0/3035269588 wait complete. 2023-10-08T00:36:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 Processor -- start 2023-10-08T00:36:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 -- start start 2023-10-08T00:36:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 0x7f392809dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39280cf350 0x7f392806a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3928159ec0 0x7f39281551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392809cce0 con 0x7f39280b53d0 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3928156cd0 con 0x7f3928159ec0 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.405+0000 7f3930684700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392809cf10 con 0x7f39280cf350 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 0x7f392809dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 0x7f392809dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53340/0 (socket says 172.21.15.22:53340) 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 -- 172.21.15.22:0/1455708769 learned_addr learned my addr 172.21.15.22:0/1455708769 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392dc1f700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39280cf350 0x7f392806a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392ec21700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3928159ec0 0x7f39281551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 -- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39280cf350 msgr2=0x7f392806a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39280cf350 0x7f392806a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 -- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3928159ec0 msgr2=0x7f39281551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3928159ec0 0x7f39281551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 -- 172.21.15.22:0/1455708769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3918009ae0 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392ec21700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3928159ec0 0x7f39281551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f392e420700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 0x7f392809dcd0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f392000ea00 tx=0x7f3920009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000c850 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392000c9b0 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392809d1f0 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392000cd30 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.406+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392809d7b0 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.407+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392809db20 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.408+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3920013680 con 0x7f39280b53d0 2023-10-08T00:36:41.416 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.408+0000 7f39267fc700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3914067320 0x7f39140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:41.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.408+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 5440+0+0 (secure 0 0 0) 0x7f3920085200 con 0x7f39280b53d0 2023-10-08T00:36:41.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.408+0000 7f392dc1f700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3914067320 0x7f39140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:41.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.409+0000 7f392dc1f700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3914067320 0x7f39140697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f392816dcf0 tx=0x7f391c007bf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:41.417 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.412+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3920051fa0 con 0x7f39280b53d0 2023-10-08T00:36:41.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:41.606+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3928063c90 con 0x7f39280b53d0 2023-10-08T00:36:42.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.258+0000 7f39267fc700 1 -- 172.21.15.22:0/1455708769 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v207) v1 ==== 169+0+0 (secure 0 0 0) 0x7f39200555c0 con 0x7f39280b53d0 2023-10-08T00:36:42.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.261+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3914067320 msgr2=0x7f39140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.261+0000 7f3930684700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3914067320 0x7f39140697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f392816dcf0 tx=0x7f391c007bf0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.261+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 msgr2=0x7f392809dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.261+0000 7f3930684700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 0x7f392809dcd0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f392000ea00 tx=0x7f3920009120 comp rx=0 tx=0).stop 2023-10-08T00:36:42.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 shutdown_connections 2023-10-08T00:36:42.264 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3928159ec0 0x7f39281551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39280b53d0 0x7f392809dcd0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f3914067320 0x7f39140697d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 --2- 172.21.15.22:0/1455708769 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f39280cf350 0x7f392806a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 >> 172.21.15.22:0/1455708769 conn(0x7f39280999f0 msgr2=0x7f39280b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:42.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 shutdown_connections 2023-10-08T00:36:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.262+0000 7f3930684700 1 -- 172.21.15.22:0/1455708769 wait complete. 2023-10-08T00:36:42.266 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2023-10-08T00:36:42.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T00:36:42.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.401+0000 7f7f9c846700 1 Processor -- start 2023-10-08T00:36:42.402 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.401+0000 7f7f9c846700 1 -- start start 2023-10-08T00:36:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9c846700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7f98159890 0x7f7f9815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9c846700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7f98069560 0x7f7f980699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9c846700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f98069ee0 con 0x7f7f98159c60 2023-10-08T00:36:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9c846700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9815a160 con 0x7f7f98069560 2023-10-08T00:36:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9c846700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980d13a0 con 0x7f7f98159890 2023-10-08T00:36:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7f98069560 0x7f7f980699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7f98069560 0x7f7f980699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53342/0 (socket says 172.21.15.22:53342) 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 -- 172.21.15.22:0/1150010256 learned_addr learned my addr 172.21.15.22:0/1150010256 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9659c700 1 --2- 172.21.15.22:0/1150010256 >> v2:172.21.15.192:3300/0 conn(0x7f7f98159890 0x7f7f9815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 -- 172.21.15.22:0/1150010256 >> v2:172.21.15.192:3300/0 conn(0x7f7f98159890 msgr2=0x7f7f9815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 --2- 172.21.15.22:0/1150010256 >> v2:172.21.15.192:3300/0 conn(0x7f7f98159890 0x7f7f9815abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 -- 172.21.15.22:0/1150010256 >> v1:172.21.15.192:6789/0 conn(0x7f7f98159c60 legacy=0x7f7f9815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 -- 172.21.15.22:0/1150010256 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9815e140 con 0x7f7f98069560 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f96d9d700 1 --2- 172.21.15.22:0/1150010256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f980699a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f7f980d1090 tx=0x7f7f90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3dffe8ede0f678 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:42.406 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.402+0000 7f7f9559a700 1 -- 172.21.15.22:0/1150010256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000e070 con 0x7f7f98069560 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9559a700 1 -- 172.21.15.22:0/1150010256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000ba10 con 0x7f7f98069560 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9559a700 1 -- 172.21.15.22:0/1150010256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900092e0 con 0x7f7f98069560 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 -- 172.21.15.22:0/1150010256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 msgr2=0x7f7f980699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 --2- 172.21.15.22:0/1150010256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f980699a0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f7f980d1090 tx=0x7f7f90009840 comp rx=0 tx=0).stop 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 -- 172.21.15.22:0/1150010256 shutdown_connections 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 --2- 172.21.15.22:0/1150010256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f980699a0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 --2- 172.21.15.22:0/1150010256 >> v2:172.21.15.192:3300/0 conn(0x7f7f98159890 0x7f7f9815abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 -- 172.21.15.22:0/1150010256 >> 172.21.15.22:0/1150010256 conn(0x7f7f98068e20 msgr2=0x7f7f980d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 -- 172.21.15.22:0/1150010256 shutdown_connections 2023-10-08T00:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.403+0000 7f7f9c846700 1 -- 172.21.15.22:0/1150010256 wait complete. 2023-10-08T00:36:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.404+0000 7f7f9c846700 1 Processor -- start 2023-10-08T00:36:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.404+0000 7f7f9c846700 1 -- start start 2023-10-08T00:36:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9c846700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f9815da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9c846700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f98159890 0x7f7f980c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9c846700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f98159c60 0x7f7f98151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9c846700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c7de0 con 0x7f7f98069560 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9c846700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c8be0 con 0x7f7f98159c60 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9c846700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980c7fd0 con 0x7f7f98159890 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f9815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f9815da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53356/0 (socket says 172.21.15.22:53356) 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 -- 172.21.15.22:0/503469034 learned_addr learned my addr 172.21.15.22:0/503469034 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f96d9d700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f98159c60 0x7f7f98151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f95d9b700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f98159890 0x7f7f980c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 -- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f98159890 msgr2=0x7f7f980c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.411 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f98159890 0x7f7f980c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 -- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f98159c60 msgr2=0x7f7f98151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f98159c60 0x7f7f98151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f9659c700 1 -- 172.21.15.22:0/503469034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009ae0 con 0x7f7f98069560 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.405+0000 7f7f95d9b700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f98159890 0x7f7f980c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.406+0000 7f7f9659c700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f9815da60 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800d890 tx=0x7f7f88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.406+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880125f0 con 0x7f7f98069560 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.406+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f88012750 con 0x7f7f98069560 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.406+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980c82b0 con 0x7f7f98069560 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.406+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88012ad0 con 0x7f7f98069560 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.406+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f980c8870 con 0x7f7f98069560 2023-10-08T00:36:42.412 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.407+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980c8ec0 con 0x7f7f98069560 2023-10-08T00:36:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.407+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7f8801e460 con 0x7f7f98069560 2023-10-08T00:36:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.407+0000 7f7f867fc700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f78067320 0x7f7f780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.408+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7f88084f90 con 0x7f7f98069560 2023-10-08T00:36:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.408+0000 7f7f95d9b700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f78067320 0x7f7f780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.413 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.408+0000 7f7f95d9b700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f78067320 0x7f7f780697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006fd0 tx=0x7f7f8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:42.414 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.412+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f88051f20 con 0x7f7f98069560 2023-10-08T00:36:42.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.605+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7f9804c3c0 con 0x7f7f98069560 2023-10-08T00:36:42.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.608+0000 7f7f867fc700 1 -- 172.21.15.22:0/503469034 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f88055540 con 0x7f7f98069560 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f78067320 msgr2=0x7f7f780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f78067320 0x7f7f780697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006fd0 tx=0x7f7f8c008040 comp rx=0 tx=0).stop 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 msgr2=0x7f7f9815da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f9815da60 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800d890 tx=0x7f7f88008040 comp rx=0 tx=0).stop 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 shutdown_connections 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7f98159c60 0x7f7f98151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f98069560 0x7f7f9815da60 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7f78067320 0x7f7f780697d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 --2- 172.21.15.22:0/503469034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7f98159890 0x7f7f980c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 >> 172.21.15.22:0/503469034 conn(0x7f7f98068e20 msgr2=0x7f7f98152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 shutdown_connections 2023-10-08T00:36:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.610+0000 7f7f9c846700 1 -- 172.21.15.22:0/503469034 wait complete. 2023-10-08T00:36:42.624 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-08T00:36:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.752+0000 7f7cdd85c700 1 Processor -- start 2023-10-08T00:36:42.754 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.752+0000 7f7cdd85c700 1 -- start start 2023-10-08T00:36:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cdd85c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cd8159c60 0x7f7cd815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cdd85c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cdd85c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd815a160 con 0x7f7cd8159890 2023-10-08T00:36:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cdd85c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd815df50 con 0x7f7cd8159c60 2023-10-08T00:36:42.755 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cdd85c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80d13a0 con 0x7f7cd815db10 2023-10-08T00:36:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cd67fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cd8159c60 0x7f7cd815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cd77fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:57068/0 (socket says 172.21.15.22:57068) 2023-10-08T00:36:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cd67fc700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cd8159c60 0x7f7cd815d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:55498/0 (socket says 172.21.15.22:55498) 2023-10-08T00:36:42.756 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.753+0000 7f7cd77fe700 1 -- 172.21.15.22:0/4033872698 learned_addr learned my addr 172.21.15.22:0/4033872698 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:42.760 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd67fc700 1 -- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 msgr2=0x7f7cd8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd67fc700 1 --2- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd67fc700 1 -- 172.21.15.22:0/4033872698 >> v1:172.21.15.192:6789/0 conn(0x7f7cd8159890 legacy=0x7f7cd815abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd5ffb700 1 -- 172.21.15.22:0/4033872698 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207506588 0 0) 0x7f7cd815a160 con 0x7f7cd8159890 2023-10-08T00:36:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd67fc700 1 -- 172.21.15.22:0/4033872698 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd815e140 con 0x7f7cd8159c60 2023-10-08T00:36:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd77fe700 1 --2- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:36:42.761 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd67fc700 1 --2- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd815d5d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80098e0 tx=0x7f7cc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced2872884082fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd5ffb700 1 -- 172.21.15.22:0/4033872698 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800b640 con 0x7f7cd8159c60 2023-10-08T00:36:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd5ffb700 1 -- 172.21.15.22:0/4033872698 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800b7a0 con 0x7f7cd8159c60 2023-10-08T00:36:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.754+0000 7f7cd5ffb700 1 -- 172.21.15.22:0/4033872698 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800bb40 con 0x7f7cd8159c60 2023-10-08T00:36:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 msgr2=0x7f7cd815d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd815d5d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80098e0 tx=0x7f7cc80091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.762 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4033872698 shutdown_connections 2023-10-08T00:36:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4033872698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd815d5d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4033872698 >> 172.21.15.22:0/4033872698 conn(0x7f7cd8068e20 msgr2=0x7f7cd80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4033872698 shutdown_connections 2023-10-08T00:36:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.755+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4033872698 wait complete. 2023-10-08T00:36:42.763 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.756+0000 7f7cdd85c700 1 Processor -- start 2023-10-08T00:36:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.756+0000 7f7cdd85c700 1 -- start start 2023-10-08T00:36:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cdd85c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 0x7f7cd815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cdd85c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd814b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cdd85c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cdd85c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80b14d0 con 0x7f7cd8159890 2023-10-08T00:36:42.764 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cdd85c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80b11f0 con 0x7f7cd8159c60 2023-10-08T00:36:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cdd85c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd815b600 con 0x7f7cd815db10 2023-10-08T00:36:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 0x7f7cd815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 0x7f7cd815d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53364/0 (socket says 172.21.15.22:53364) 2023-10-08T00:36:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 -- 172.21.15.22:0/4279133357 learned_addr learned my addr 172.21.15.22:0/4279133357 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd67fc700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.765 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd77fe700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 -- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 msgr2=0x7f7cd8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 -- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 msgr2=0x7f7cd814b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd814b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 -- 172.21.15.22:0/4279133357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0009ae0 con 0x7f7cd8159890 2023-10-08T00:36:42.766 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.757+0000 7f7cd6ffd700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 0x7f7cd815d1d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c7e0 tx=0x7f7ccc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.758+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0105c0 con 0x7f7cd8159890 2023-10-08T00:36:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.758+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8009420 con 0x7f7cd8159890 2023-10-08T00:36:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.758+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc010740 con 0x7f7cd8159890 2023-10-08T00:36:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.758+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc010b00 con 0x7f7cd8159890 2023-10-08T00:36:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.758+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd815bbc0 con 0x7f7cd8159890 2023-10-08T00:36:42.767 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.759+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd815bdb0 con 0x7f7cd8159890 2023-10-08T00:36:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.759+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7ccc01b3b0 con 0x7f7cd8159890 2023-10-08T00:36:42.768 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.759+0000 7f7cbeffd700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7cc4067320 0x7f7cc40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.760+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7ccc083fa0 con 0x7f7cd8159890 2023-10-08T00:36:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.760+0000 7f7cd67fc700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7cc4067320 0x7f7cc40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.760+0000 7f7cd67fc700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7cc4067320 0x7f7cc40697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80093f0 tx=0x7f7cc8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:42.769 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:42.764+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ccc050f30 con 0x7f7cd8159890 2023-10-08T00:36:43.043 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.042+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f7cd804c3c0 con 0x7f7cd8159890 2023-10-08T00:36:43.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.261+0000 7f7cbeffd700 1 -- 172.21.15.22:0/4279133357 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v565) v1 ==== 131+0+0 (secure 0 0 0) 0x7f7ccc017020 con 0x7f7cd8159890 2023-10-08T00:36:43.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.263+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7cc4067320 msgr2=0x7f7cc40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:43.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.263+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7cc4067320 0x7f7cc40697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7cc80093f0 tx=0x7f7cc8017000 comp rx=0 tx=0).stop 2023-10-08T00:36:43.265 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.263+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 msgr2=0x7f7cd815d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.263+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 0x7f7cd815d1d0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c7e0 tx=0x7f7ccc007df0 comp rx=0 tx=0).stop 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 shutdown_connections 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f7cc4067320 0x7f7cc40697d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7cd815db10 0x7f7cd8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd8159890 0x7f7cd815d1d0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 --2- 172.21.15.22:0/4279133357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cd8159c60 0x7f7cd814b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 >> 172.21.15.22:0/4279133357 conn(0x7f7cd8068e20 msgr2=0x7f7cd814d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 shutdown_connections 2023-10-08T00:36:43.266 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:43.264+0000 7f7cdd85c700 1 -- 172.21.15.22:0/4279133357 wait complete. 2023-10-08T00:36:43.280 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used ... ERROR 2023-10-08T00:36:43.280 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-08T00:36:43.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-08T00:36:43.282 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-08T00:36:43.283 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner:Ran 12 tests in 683.016s 2023-10-08T00:36:43.284 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-08T00:36:43.285 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-08T00:36:43.286 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-08T00:36:43.287 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-08T00:36:43.288 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-08T00:36:43.288 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-08T00:36:43.288 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-08T00:36:43.288 INFO:tasks.cephfs_test_runner: 2023-10-08T00:36:43.288 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:36:43.353 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=854c4b3c60964a8f9161a072f2f9198e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-08T00:36:43.354 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-08T00:36:43.364 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T00:36:43.390 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T00:36:43.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.391 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:36:43.418 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T00:36:43.419 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T00:36:43.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T00:36:43.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.494 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T00:36:43.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-10-08T00:36:43.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.667 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2023-10-08T00:36:43.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2023-10-08T00:36:43.750 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2023-10-08T00:36:43.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:36:43.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.751 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:36:43.769 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T00:36:43.770 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T00:36:43.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T00:36:43.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T00:36:43.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:43.926 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-08T00:36:44.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:44.033 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2023-10-08T00:36:44.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T00:36:44.048 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2023-10-08T00:36:44.117 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2023-10-08T00:36:44.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:36:44.118 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T00:36:44.128 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-08T00:36:44.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:36:44.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.248+0000 7f2d12ad2700 1 Processor -- start 2023-10-08T00:36:44.250 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.248+0000 7f2d12ad2700 1 -- start start 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d12ad2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2d0c155c10 0x7f2d0c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d12ad2700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d0c0ac6d0 0x7f2d0c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d12ad2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0acac0 con 0x7f2d0c0ac230 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d12ad2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0ad930 con 0x7f2d0c155c10 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d12ad2700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0acd20 con 0x7f2d0c0ac6d0 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d1086e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2d0c155c10 0x7f2d0c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d0bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2d0c0ac230 0x7f2d0c1568a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36574/0 (socket says 172.21.15.22:36574) 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.249+0000 7f2d0bfff700 1 -- 172.21.15.22:0/1687052421 learned_addr learned my addr 172.21.15.22:0/1687052421 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1106f700 1 --2- 172.21.15.22:0/1687052421 >> v2:172.21.15.192:3300/0 conn(0x7f2d0c0ac6d0 0x7f2d0c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1086e700 1 -- 172.21.15.22:0/1687052421 >> v2:172.21.15.192:3300/0 conn(0x7f2d0c0ac6d0 msgr2=0x7f2d0c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1086e700 1 --2- 172.21.15.22:0/1687052421 >> v2:172.21.15.192:3300/0 conn(0x7f2d0c0ac6d0 0x7f2d0c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1086e700 1 -- 172.21.15.22:0/1687052421 >> v1:172.21.15.22:6789/0 conn(0x7f2d0c0ac230 legacy=0x7f2d0c1568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d0b7fe700 1 -- 172.21.15.22:0/1687052421 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523943903 0 0) 0x7f2d0c0acac0 con 0x7f2d0c0ac230 2023-10-08T00:36:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1086e700 1 -- 172.21.15.22:0/1687052421 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0ad000 con 0x7f2d0c155c10 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1106f700 1 --2- 172.21.15.22:0/1687052421 >> v2:172.21.15.192:3300/0 conn(0x7f2d0c0ac6d0 0x7f2d0c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d1086e700 1 --2- 172.21.15.22:0/1687052421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c155fe0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0ae0c0 tx=0x7f2d04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5ae2f9d26d5525 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d0b7fe700 1 -- 172.21.15.22:0/1687052421 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400e070 con 0x7f2d0c155c10 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d0b7fe700 1 -- 172.21.15.22:0/1687052421 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400bc30 con 0x7f2d0c155c10 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d0b7fe700 1 -- 172.21.15.22:0/1687052421 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04012430 con 0x7f2d0c155c10 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1687052421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 msgr2=0x7f2d0c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.250+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1687052421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c155fe0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0ae0c0 tx=0x7f2d04009780 comp rx=0 tx=0).stop 2023-10-08T00:36:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.251+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1687052421 shutdown_connections 2023-10-08T00:36:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.251+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1687052421 >> v2:172.21.15.192:3300/0 conn(0x7f2d0c0ac6d0 0x7f2d0c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.251+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1687052421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c155fe0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.251+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1687052421 >> 172.21.15.22:0/1687052421 conn(0x7f2d0c06a320 msgr2=0x7f2d0c0cc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.251+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1687052421 shutdown_connections 2023-10-08T00:36:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.251+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1687052421 wait complete. 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.252+0000 7f2d12ad2700 1 Processor -- start 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.252+0000 7f2d12ad2700 1 -- start start 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0c0ac230 0x7f2d0c1447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d0c0ac6d0 0x7f2d0c13e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c146410 con 0x7f2d0c155c10 2023-10-08T00:36:44.259 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c145800 con 0x7f2d0c0ac6d0 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c145ae0 con 0x7f2d0c0ac230 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53378/0 (socket says 172.21.15.22:53378) 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 -- 172.21.15.22:0/1708400575 learned_addr learned my addr 172.21.15.22:0/1708400575 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1086e700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0c0ac230 0x7f2d0c1447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d0bfff700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d0c0ac6d0 0x7f2d0c13e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 -- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0c0ac230 msgr2=0x7f2d0c1447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.260 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0c0ac230 0x7f2d0c1447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 -- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d0c0ac6d0 msgr2=0x7f2d0c13e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d0c0ac6d0 0x7f2d0c13e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 -- 172.21.15.22:0/1708400575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d04009a20 con 0x7f2d0c155c10 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d1106f700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c147f70 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400c880 tx=0x7f2cf4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4011600 con 0x7f2d0c155c10 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf4011760 con 0x7f2d0c155c10 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4011b20 con 0x7f2d0c155c10 2023-10-08T00:36:44.261 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.253+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c145dc0 con 0x7f2d0c155c10 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.254+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c144d30 con 0x7f2d0c155c10 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.255+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c146580 con 0x7f2d0c155c10 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.255+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2cf401a400 con 0x7f2d0c155c10 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.255+0000 7f2d08ff9700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cec067320 0x7f2cec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.255+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2cf4084ca0 con 0x7f2d0c155c10 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.255+0000 7f2d1086e700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cec067320 0x7f2cec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.262 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.256+0000 7f2d1086e700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cec067320 0x7f2cec0697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0ae0c0 tx=0x7f2d04019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.263 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.259+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cf40555b0 con 0x7f2d0c155c10 2023-10-08T00:36:44.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.456+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d0c04c3c0 con 0x7f2d0c155c10 2023-10-08T00:36:44.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.456+0000 7f2d08ff9700 1 -- 172.21.15.22:0/1708400575 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+12275 (secure 0 0 0) 0x7f2cf4015090 con 0x7f2d0c155c10 2023-10-08T00:36:44.458 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:44.458 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":207,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:36:42.255943+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/3800835270":"2023-10-09T00:36:39.248425+0000","172.21.15.192:6835/3800835270":"2023-10-09T00:36:39.248425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:36:44.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cec067320 msgr2=0x7f2cec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cec067320 0x7f2cec0697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0ae0c0 tx=0x7f2d04019000 comp rx=0 tx=0).stop 2023-10-08T00:36:44.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 msgr2=0x7f2d0c147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c147f70 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400c880 tx=0x7f2cf4008040 comp rx=0 tx=0).stop 2023-10-08T00:36:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 shutdown_connections 2023-10-08T00:36:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d0c155c10 0x7f2d0c147f70 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f2cec067320 0x7f2cec0697d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d0c0ac230 0x7f2d0c1447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.458+0000 7f2d12ad2700 1 --2- 172.21.15.22:0/1708400575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d0c0ac6d0 0x7f2d0c13e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.459+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 >> 172.21.15.22:0/1708400575 conn(0x7f2d0c06a320 msgr2=0x7f2d0c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.459+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 shutdown_connections 2023-10-08T00:36:44.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.459+0000 7f2d12ad2700 1 -- 172.21.15.22:0/1708400575 wait complete. 2023-10-08T00:36:44.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T00:36:44.473 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:36:44.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.590+0000 7f02ba3e9700 1 Processor -- start 2023-10-08T00:36:44.592 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.590+0000 7f02ba3e9700 1 -- start start 2023-10-08T00:36:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02ba3e9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f02b4159890 0x7f02b415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02ba3e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159c60 0x7f02b415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02ba3e9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02b415db10 0x7f02b4069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02ba3e9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b415a160 con 0x7f02b415db10 2023-10-08T00:36:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02ba3e9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40d13a0 con 0x7f02b4159890 2023-10-08T00:36:44.595 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02ba3e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b415e140 con 0x7f02b4159c60 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02b8986700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02b415db10 0x7f02b4069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02b8986700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02b415db10 0x7f02b4069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53386/0 (socket says 172.21.15.22:53386) 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.591+0000 7f02b8986700 1 -- 172.21.15.22:0/1001550048 learned_addr learned my addr 172.21.15.22:0/1001550048 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b37fe700 1 --2- 172.21.15.22:0/1001550048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159c60 0x7f02b415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b3fff700 1 --2- 172.21.15.22:0/1001550048 >> v2:172.21.15.192:3300/0 conn(0x7f02b4159890 0x7f02b415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b8986700 1 -- 172.21.15.22:0/1001550048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159c60 msgr2=0x7f02b415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:44.596 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b8986700 1 --2- 172.21.15.22:0/1001550048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159c60 0x7f02b415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b8986700 1 -- 172.21.15.22:0/1001550048 >> v2:172.21.15.192:3300/0 conn(0x7f02b4159890 msgr2=0x7f02b415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b8986700 1 --2- 172.21.15.22:0/1001550048 >> v2:172.21.15.192:3300/0 conn(0x7f02b4159890 0x7f02b415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b8986700 1 -- 172.21.15.22:0/1001550048 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b415a3d0 con 0x7f02b415db10 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b3fff700 1 --2- 172.21.15.22:0/1001550048 >> v2:172.21.15.192:3300/0 conn(0x7f02b4159890 0x7f02b415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b8986700 1 --2- 172.21.15.22:0/1001550048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b415db10 0x7f02b4069560 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f02b40d1090 tx=0x7f02ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500fae162a9eed14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b2ffd700 1 -- 172.21.15.22:0/1001550048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00e070 con 0x7f02b415db10 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b2ffd700 1 -- 172.21.15.22:0/1001550048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac00ba50 con 0x7f02b415db10 2023-10-08T00:36:44.597 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02b2ffd700 1 -- 172.21.15.22:0/1001550048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0092e0 con 0x7f02b415db10 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 -- 172.21.15.22:0/1001550048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b415db10 msgr2=0x7f02b4069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/1001550048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b415db10 0x7f02b4069560 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f02b40d1090 tx=0x7f02ac009840 comp rx=0 tx=0).stop 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 -- 172.21.15.22:0/1001550048 shutdown_connections 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/1001550048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b415db10 0x7f02b4069560 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/1001550048 >> v2:172.21.15.192:3300/0 conn(0x7f02b4159890 0x7f02b415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/1001550048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159c60 0x7f02b415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.598 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.592+0000 7f02ba3e9700 1 -- 172.21.15.22:0/1001550048 >> 172.21.15.22:0/1001550048 conn(0x7f02b4068e20 msgr2=0x7f02b40d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:44.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.593+0000 7f02ba3e9700 1 -- 172.21.15.22:0/1001550048 shutdown_connections 2023-10-08T00:36:44.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.593+0000 7f02ba3e9700 1 -- 172.21.15.22:0/1001550048 wait complete. 2023-10-08T00:36:44.599 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 Processor -- start 2023-10-08T00:36:44.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 -- start start 2023-10-08T00:36:44.601 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159890 0x7f02b41440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 0x7f02b40cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02b415db10 0x7f02b40c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40ca740 con 0x7f02b4159c60 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40cf270 con 0x7f02b415db10 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.594+0000 7f02ba3e9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40ce6a0 con 0x7f02b4159890 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 0x7f02b40cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.602 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 0x7f02b40cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53396/0 (socket says 172.21.15.22:53396) 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 -- 172.21.15.22:0/2485578702 learned_addr learned my addr 172.21.15.22:0/2485578702 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b3fff700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159890 0x7f02b41440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 -- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159890 msgr2=0x7f02b41440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b8986700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02b415db10 0x7f02b40c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159890 0x7f02b41440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 -- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02b415db10 msgr2=0x7f02b40c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.603 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02b415db10 0x7f02b40c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 -- 172.21.15.22:0/2485578702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009ae0 con 0x7f02b4159c60 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02b37fe700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 0x7f02b40cf700 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f02a800d860 tx=0x7f02a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a80125f0 con 0x7f02b4159c60 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a8012750 con 0x7f02b4159c60 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b40ce940 con 0x7f02b4159c60 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8012ad0 con 0x7f02b4159c60 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.595+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b40cef80 con 0x7f02b4159c60 2023-10-08T00:36:44.604 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.596+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b40cf420 con 0x7f02b4159c60 2023-10-08T00:36:44.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.597+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f02a801e460 con 0x7f02b4159c60 2023-10-08T00:36:44.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.597+0000 7f029bfff700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a0067320 0x7f02a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.597+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f02a8084f90 con 0x7f02b4159c60 2023-10-08T00:36:44.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.597+0000 7f02b3fff700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a0067320 0x7f02a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.598+0000 7f02b3fff700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a0067320 0x7f02a00697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f02a4008a50 tx=0x7f02a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.606 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.601+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02b40cf420 con 0x7f02b4159c60 2023-10-08T00:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.791+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02b40cf3e0 con 0x7f02a0067320 2023-10-08T00:36:44.795 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.794+0000 7f029bfff700 1 -- 172.21.15.22:0/2485578702 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50597 (secure 0 0 0) 0x7f02b40cf3e0 con 0x7f02a0067320 2023-10-08T00:36:44.796 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:44.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a0067320 msgr2=0x7f02a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a0067320 0x7f02a00697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f02a4008a50 tx=0x7f02a4008040 comp rx=0 tx=0).stop 2023-10-08T00:36:44.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 msgr2=0x7f02b40cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 0x7f02b40cf700 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f02a800d860 tx=0x7f02a8008040 comp rx=0 tx=0).stop 2023-10-08T00:36:44.797 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 shutdown_connections 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02b415db10 0x7f02b40c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f02a0067320 0x7f02a00697d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f02b4159890 0x7f02b41440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 --2- 172.21.15.22:0/2485578702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b4159c60 0x7f02b40cf700 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 >> 172.21.15.22:0/2485578702 conn(0x7f02b4068e20 msgr2=0x7f02b415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 shutdown_connections 2023-10-08T00:36:44.798 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.795+0000 7f02ba3e9700 1 -- 172.21.15.22:0/2485578702 wait complete. 2023-10-08T00:36:44.799 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:36:44.809 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-10-08T00:36:44.553395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440792,"kb_used_data":21528,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752533928,"statfs":{"total":773094113280,"available":770594742272,"internally_reserved":0,"allocated":22044672,"data_stored":10574342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001225"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-10-08T00:34:44.521070+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:34:44.521070+0000","last_peered":"2023-10-08T00:34:44.521070+0000","last_clean":"2023-10-08T00:34:44.521070+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:34:44.521070+0000","last_undegraded":"2023-10-08T00:34:44.521070+0000","last_fullsized":"2023-10-08T00:34:44.521070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1767206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.34399999999999997,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.28599999999999998},"max":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.34200000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.81799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.25900000000000001},"max":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.47499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.372,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.875},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.88300000000000001,"15min":0.89100000000000001},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.317,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.753,"15min":0.79000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65700000000000003,"5min":0.87,"15min":1.048},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1170140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.434,"5min":0.313,"15min":0.27600000000000002},"max":{"1min":0.68899999999999995,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.76500000000000001,"5min":0.97299999999999998,"15min":1.145},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.873},"last":0.373}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":1.079},"last":0.44},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.496,"15min":1.496},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":1.02,"15min":1.1160000000000001},"last":0.495}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.629},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308032,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063808,"statfs":{"total":96636764160,"available":96321339392,"internally_reserved":0,"allocated":2613248,"data_stored":1176386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.39200000000000002,"15min":0.38300000000000001},"min":{"1min":0.34100000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.307}]},{"osd":3,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.433},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41599999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86799999999999999,"5min":0.95999999999999996,"15min":1.218},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.101,"15min":1.101},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.79800000000000004,"5min":1.121,"15min":1.294},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52800000000000002,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.1319999999999999,"15min":1.2549999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.871,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":1.1120000000000001,"15min":1.278},"last":0.45400000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.497,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":0.91100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":0.89600000000000002,"15min":1.087},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308596,"kb_used_data":3116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063244,"statfs":{"total":96636764160,"available":96320761856,"internally_reserved":0,"allocated":3190784,"data_stored":1760544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.224,"15min":0.216},"max":{"1min":0.5,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.38500000000000001,"15min":0.36799999999999999},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.38300000000000001},"min":{"1min":0.317,"5min":0.249,"15min":0.245},"max":{"1min":0.55000000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.35899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.376},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.59299999999999997,"5min":0.749,"15min":0.749},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.39700000000000002,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.48799999999999999,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.625},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65900000000000003,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0369999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.51900000000000002,"5min":0.39300000000000002,"15min":0.33600000000000002},"max":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.242},"last":0.497},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.96799999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64300000000000002,"15min":0.61199999999999999},"min":{"1min":0.55800000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.628,"15min":0.626},"min":{"1min":0.58399999999999996,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.24199999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38,"15min":0.371},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.65000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.34499999999999997,"5min":0.26800000000000002,"15min":0.23599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.376,"15min":0.372},"min":{"1min":0.311,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59399999999999997,"15min":0.60799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.70199999999999996},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.33000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.40999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0760000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.55400000000000005,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.34899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.278},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.137},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.62}]},{"osd":7,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.52400000000000002,"5min":0.42399999999999999,"15min":0.40699999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.1259999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.343},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303932,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067908,"statfs":{"total":96636764160,"available":96325537792,"internally_reserved":0,"allocated":2609152,"data_stored":1176352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.59699999999999998,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.38300000000000001,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.309,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.41499999999999998},"min":{"1min":0.36699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.70699999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.40400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.79700000000000004},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84099999999999997,"5min":1.47,"15min":1.47},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.35899999999999999},"max":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96399999999999997},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":1.385,"15min":1.385},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.54500000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.48099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":0.996},"last":0.76200000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89300000000000002,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.56200000000000006,"5min":0.44,"15min":0.435},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.006},"last":0.51100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303940,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067900,"statfs":{"total":96636764160,"available":96325529600,"internally_reserved":0,"allocated":2617344,"data_stored":1179559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.433,"5min":0.30499999999999999,"15min":0.246},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.67500000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":0.82999999999999996,"15min":1.712},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":0.86599999999999999,"15min":1.21},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":0.88900000000000001,"15min":6.0960000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.82499999999999996,"15min":0.873},"last":0.45300000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.66700000000000004,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":0.82899999999999996,"15min":1.002},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55000000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.625,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1170176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.86699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.88300000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55300000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.75700000000000001,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.83399999999999996,"15min":2.4870000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.78700000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80100000000000005},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30199999999999999},"max":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.56899999999999995},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.84399999999999997},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.85199999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56499999999999995,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:36:44.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:36:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.929+0000 7f061155a700 1 Processor -- start 2023-10-08T00:36:44.931 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.929+0000 7f061155a700 1 -- start start 2023-10-08T00:36:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f061155a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f060c1594d0 0x7f060c0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.933 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f061155a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c0b5fb0 0x7f060c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f061155a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0d01f0 con 0x7f060c159de0 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f061155a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c0cf5e0 con 0x7f060c1594d0 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f061155a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0cf8c0 con 0x7f060c0b5fb0 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f060affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f060c1594d0 0x7f060c0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f060affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f060c1594d0 0x7f060c0cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53412/0 (socket says 172.21.15.22:53412) 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f060affd700 1 -- 172.21.15.22:0/3659695792 learned_addr learned my addr 172.21.15.22:0/3659695792 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:44.934 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.930+0000 7f060a7fc700 1 --2- 172.21.15.22:0/3659695792 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c0b5fb0 0x7f060c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f060affd700 1 -- 172.21.15.22:0/3659695792 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c0b5fb0 msgr2=0x7f060c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f060affd700 1 --2- 172.21.15.22:0/3659695792 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c0b5fb0 0x7f060c1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f060affd700 1 -- 172.21.15.22:0/3659695792 >> v1:172.21.15.192:6789/0 conn(0x7f060c159de0 legacy=0x7f060c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f060affd700 1 -- 172.21.15.22:0/3659695792 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0cfba0 con 0x7f060c1594d0 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f060affd700 1 --2- 172.21.15.22:0/3659695792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c1594d0 0x7f060c0cd0f0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0099b0 tx=0x7f05fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560208a5e704d0ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f0609ffb700 1 -- 172.21.15.22:0/3659695792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc009ea0 con 0x7f060c1594d0 2023-10-08T00:36:44.935 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f0609ffb700 1 -- 172.21.15.22:0/3659695792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00b860 con 0x7f060c1594d0 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f0609ffb700 1 -- 172.21.15.22:0/3659695792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00bc00 con 0x7f060c1594d0 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 -- 172.21.15.22:0/3659695792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c1594d0 msgr2=0x7f060c0cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 --2- 172.21.15.22:0/3659695792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c1594d0 0x7f060c0cd0f0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0099b0 tx=0x7f05fc009250 comp rx=0 tx=0).stop 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 -- 172.21.15.22:0/3659695792 shutdown_connections 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 --2- 172.21.15.22:0/3659695792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c1594d0 0x7f060c0cd0f0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 --2- 172.21.15.22:0/3659695792 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c0b5fb0 0x7f060c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 -- 172.21.15.22:0/3659695792 >> 172.21.15.22:0/3659695792 conn(0x7f060c0d05f0 msgr2=0x7f060c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:44.936 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 -- 172.21.15.22:0/3659695792 shutdown_connections 2023-10-08T00:36:44.937 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.931+0000 7f061155a700 1 -- 172.21.15.22:0/3659695792 wait complete. 2023-10-08T00:36:44.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 Processor -- start 2023-10-08T00:36:44.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 -- start start 2023-10-08T00:36:44.939 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f060c0b5fb0 0x7f060c1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c1594d0 0x7f060c140740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 0x7f060c068390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c158430 con 0x7f060c159de0 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.933+0000 7f061155a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c158e00 con 0x7f060c0b5fb0 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f061155a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c140c80 con 0x7f060c1594d0 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 0x7f060c068390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 0x7f060c068390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53418/0 (socket says 172.21.15.22:53418) 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 -- 172.21.15.22:0/1537356650 learned_addr learned my addr 172.21.15.22:0/1537356650 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060a7fc700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c1594d0 0x7f060c140740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060affd700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f060c0b5fb0 0x7f060c1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 -- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c1594d0 msgr2=0x7f060c140740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c1594d0 0x7f060c140740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 -- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f060c0b5fb0 msgr2=0x7f060c1588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f060c0b5fb0 0x7f060c1588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 -- 172.21.15.22:0/1537356650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0094f0 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f060b7fe700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 0x7f060c068390 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f060400c840 tx=0x7f0604001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604012630 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040127b0 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c157820 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604012b70 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.934+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c157de0 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.935+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c04c3c0 con 0x7f060c159de0 2023-10-08T00:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.936+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f060401a3a0 con 0x7f060c159de0 2023-10-08T00:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.936+0000 7f05f2ffd700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f05f8067320 0x7f05f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.936+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0604084aa0 con 0x7f060c159de0 2023-10-08T00:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.936+0000 7f060affd700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f05f8067320 0x7f05f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.937+0000 7f060affd700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f05f8067320 0x7f05f80697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0099b0 tx=0x7f05fc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:44.940+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0604051a30 con 0x7f060c159de0 2023-10-08T00:36:45.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.127+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f060c158570 con 0x7f05f8067320 2023-10-08T00:36:45.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.130+0000 7f05f2ffd700 1 -- 172.21.15.22:0/1537356650 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50597 (secure 0 0 0) 0x7f060c158570 con 0x7f05f8067320 2023-10-08T00:36:45.132 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f05f8067320 msgr2=0x7f05f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f05f8067320 0x7f05f80697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0099b0 tx=0x7f05fc017000 comp rx=0 tx=0).stop 2023-10-08T00:36:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 msgr2=0x7f060c068390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 0x7f060c068390 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f060400c840 tx=0x7f0604001670 comp rx=0 tx=0).stop 2023-10-08T00:36:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 shutdown_connections 2023-10-08T00:36:45.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f060c159de0 0x7f060c068390 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f060c0b5fb0 0x7f060c1588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f05f8067320 0x7f05f80697d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 --2- 172.21.15.22:0/1537356650 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f060c1594d0 0x7f060c140740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 >> 172.21.15.22:0/1537356650 conn(0x7f060c0d05f0 msgr2=0x7f060c155080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 shutdown_connections 2023-10-08T00:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.132+0000 7f061155a700 1 -- 172.21.15.22:0/1537356650 wait complete. 2023-10-08T00:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:36:45.145 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-10-08T00:36:44.553395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440792,"kb_used_data":21528,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752533928,"statfs":{"total":773094113280,"available":770594742272,"internally_reserved":0,"allocated":22044672,"data_stored":10574342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001225"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-10-08T00:34:44.521070+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:34:44.521070+0000","last_peered":"2023-10-08T00:34:44.521070+0000","last_clean":"2023-10-08T00:34:44.521070+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:34:44.521070+0000","last_undegraded":"2023-10-08T00:34:44.521070+0000","last_fullsized":"2023-10-08T00:34:44.521070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1767206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.34399999999999997,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.28599999999999998},"max":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.34200000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.81799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.25900000000000001},"max":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.47499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.372,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.875},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.88300000000000001,"15min":0.89100000000000001},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.317,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.753,"15min":0.79000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65700000000000003,"5min":0.87,"15min":1.048},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1170140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.434,"5min":0.313,"15min":0.27600000000000002},"max":{"1min":0.68899999999999995,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.76500000000000001,"5min":0.97299999999999998,"15min":1.145},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.873},"last":0.373}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":1.079},"last":0.44},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.496,"15min":1.496},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":1.02,"15min":1.1160000000000001},"last":0.495}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.629},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308032,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063808,"statfs":{"total":96636764160,"available":96321339392,"internally_reserved":0,"allocated":2613248,"data_stored":1176386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.39200000000000002,"15min":0.38300000000000001},"min":{"1min":0.34100000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.307}]},{"osd":3,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.433},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41599999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86799999999999999,"5min":0.95999999999999996,"15min":1.218},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.101,"15min":1.101},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.79800000000000004,"5min":1.121,"15min":1.294},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52800000000000002,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.1319999999999999,"15min":1.2549999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.871,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":1.1120000000000001,"15min":1.278},"last":0.45400000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.497,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":0.91100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":0.89600000000000002,"15min":1.087},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308596,"kb_used_data":3116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063244,"statfs":{"total":96636764160,"available":96320761856,"internally_reserved":0,"allocated":3190784,"data_stored":1760544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.224,"15min":0.216},"max":{"1min":0.5,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.38500000000000001,"15min":0.36799999999999999},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.38300000000000001},"min":{"1min":0.317,"5min":0.249,"15min":0.245},"max":{"1min":0.55000000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.35899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.376},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.59299999999999997,"5min":0.749,"15min":0.749},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.39700000000000002,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.48799999999999999,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.625},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65900000000000003,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0369999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.51900000000000002,"5min":0.39300000000000002,"15min":0.33600000000000002},"max":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.242},"last":0.497},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.96799999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64300000000000002,"15min":0.61199999999999999},"min":{"1min":0.55800000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.628,"15min":0.626},"min":{"1min":0.58399999999999996,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.24199999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38,"15min":0.371},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.65000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.34499999999999997,"5min":0.26800000000000002,"15min":0.23599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.376,"15min":0.372},"min":{"1min":0.311,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59399999999999997,"15min":0.60799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.70199999999999996},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.33000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.40999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0760000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.55400000000000005,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.34899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.278},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.137},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.62}]},{"osd":7,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.52400000000000002,"5min":0.42399999999999999,"15min":0.40699999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.1259999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.343},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303932,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067908,"statfs":{"total":96636764160,"available":96325537792,"internally_reserved":0,"allocated":2609152,"data_stored":1176352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.59699999999999998,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.38300000000000001,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.309,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.41499999999999998},"min":{"1min":0.36699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.70699999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.40400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.79700000000000004},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84099999999999997,"5min":1.47,"15min":1.47},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.35899999999999999},"max":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96399999999999997},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":1.385,"15min":1.385},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.54500000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.48099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":0.996},"last":0.76200000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89300000000000002,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.56200000000000006,"5min":0.44,"15min":0.435},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.006},"last":0.51100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303940,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067900,"statfs":{"total":96636764160,"available":96325529600,"internally_reserved":0,"allocated":2617344,"data_stored":1179559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.433,"5min":0.30499999999999999,"15min":0.246},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.67500000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":0.82999999999999996,"15min":1.712},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":0.86599999999999999,"15min":1.21},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":0.88900000000000001,"15min":6.0960000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.82499999999999996,"15min":0.873},"last":0.45300000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.66700000000000004,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":0.82899999999999996,"15min":1.002},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55000000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.625,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1170176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.86699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.88300000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55300000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.75700000000000001,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.83399999999999996,"15min":2.4870000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.78700000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80100000000000005},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30199999999999999},"max":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.56899999999999995},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.84399999999999997},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.85199999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56499999999999995,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:36:45.147 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T00:36:45.148 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:36:45.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.266+0000 7f4f55ec7700 1 Processor -- start 2023-10-08T00:36:45.267 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.266+0000 7f4f55ec7700 1 -- start start 2023-10-08T00:36:45.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f55ec7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f50069d60 0x7f4f500c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f55ec7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.270 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f55ec7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f500c8650 con 0x7f4f500aca80 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f55ec7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5006bdb0 con 0x7f4f50069d60 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f55ec7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500cb370 con 0x7f4f500c81f0 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f50069d60 0x7f4f500c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f50069d60 0x7f4f500c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53432/0 (socket says 172.21.15.22:53432) 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 -- 172.21.15.22:0/895712151 learned_addr learned my addr 172.21.15.22:0/895712151 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4ffff700 1 --2- 172.21.15.22:0/895712151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.271 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 -- 172.21.15.22:0/895712151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 msgr2=0x7f4f500cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:45.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 --2- 172.21.15.22:0/895712151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 -- 172.21.15.22:0/895712151 >> v1:172.21.15.192:6789/0 conn(0x7f4f500aca80 legacy=0x7f4f5006aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 -- 172.21.15.22:0/895712151 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50159f60 con 0x7f4f50069d60 2023-10-08T00:36:45.272 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4effd700 1 --2- 172.21.15.22:0/895712151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f50069d60 0x7f4f500c7cb0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4f440099b0 tx=0x7f4f44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9189acc98573642 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:45.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4e7fc700 1 -- 172.21.15.22:0/895712151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44009ea0 con 0x7f4f50069d60 2023-10-08T00:36:45.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4e7fc700 1 -- 172.21.15.22:0/895712151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400b860 con 0x7f4f50069d60 2023-10-08T00:36:45.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.267+0000 7f4f4e7fc700 1 -- 172.21.15.22:0/895712151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400bc00 con 0x7f4f50069d60 2023-10-08T00:36:45.273 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.268+0000 7f4f55ec7700 1 -- 172.21.15.22:0/895712151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f50069d60 msgr2=0x7f4f500c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.268+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/895712151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f50069d60 0x7f4f500c7cb0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f4f440099b0 tx=0x7f4f44009250 comp rx=0 tx=0).stop 2023-10-08T00:36:45.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.268+0000 7f4f55ec7700 1 -- 172.21.15.22:0/895712151 shutdown_connections 2023-10-08T00:36:45.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.268+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/895712151 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.274 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.268+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/895712151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f50069d60 0x7f4f500c7cb0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.268+0000 7f4f55ec7700 1 -- 172.21.15.22:0/895712151 >> 172.21.15.22:0/895712151 conn(0x7f4f500cd670 msgr2=0x7f4f500cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:45.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.269+0000 7f4f55ec7700 1 -- 172.21.15.22:0/895712151 shutdown_connections 2023-10-08T00:36:45.275 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.269+0000 7f4f55ec7700 1 -- 172.21.15.22:0/895712151 wait complete. 2023-10-08T00:36:45.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.270+0000 7f4f55ec7700 1 Processor -- start 2023-10-08T00:36:45.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.270+0000 7f4f55ec7700 1 -- start start 2023-10-08T00:36:45.277 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f50069d60 0x7f4f5015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 0x7f4f501576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500aee40 con 0x7f4f500aca80 2023-10-08T00:36:45.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500b12e0 con 0x7f4f50069d60 2023-10-08T00:36:45.278 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500b0410 con 0x7f4f500c81f0 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 0x7f4f501576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 0x7f4f501576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53436/0 (socket says 172.21.15.22:53436) 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 -- 172.21.15.22:0/4067995530 learned_addr learned my addr 172.21.15.22:0/4067995530 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4ffff700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4f7fe700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f50069d60 0x7f4f5015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 -- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 msgr2=0x7f4f500ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.279 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 -- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f50069d60 msgr2=0x7f4f5015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f50069d60 0x7f4f5015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 -- 172.21.15.22:0/4067995530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440094f0 con 0x7f4f500aca80 2023-10-08T00:36:45.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f4effd700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 0x7f4f501576f0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4f5006c6a0 tx=0x7f4f44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:45.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44000d10 con 0x7f4f500aca80 2023-10-08T00:36:45.280 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4400bbe0 con 0x7f4f500aca80 2023-10-08T00:36:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f500b06d0 con 0x7f4f500aca80 2023-10-08T00:36:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.271+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44011670 con 0x7f4f500aca80 2023-10-08T00:36:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.272+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f500b0c90 con 0x7f4f500aca80 2023-10-08T00:36:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.273+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f500b1450 con 0x7f4f500aca80 2023-10-08T00:36:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.273+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4f44011aa0 con 0x7f4f500aca80 2023-10-08T00:36:45.281 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.273+0000 7f4f377fe700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f3c067320 0x7f4f3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.273+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4f440861c0 con 0x7f4f500aca80 2023-10-08T00:36:45.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.273+0000 7f4f4f7fe700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f3c067320 0x7f4f3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.274+0000 7f4f4f7fe700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f3c067320 0x7f4f3c0697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4f40007fd0 tx=0x7f4f40007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:45.282 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.278+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f44053150 con 0x7f4f500aca80 2023-10-08T00:36:45.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.467+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f5004c3c0 con 0x7f4f3c067320 2023-10-08T00:36:45.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.470+0000 7f4f377fe700 1 -- 172.21.15.22:0/4067995530 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50597 (secure 0 0 0) 0x7f4f5004c3c0 con 0x7f4f3c067320 2023-10-08T00:36:45.471 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f3c067320 msgr2=0x7f4f3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f3c067320 0x7f4f3c0697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4f40007fd0 tx=0x7f4f40007eb0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 msgr2=0x7f4f501576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 0x7f4f501576f0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4f5006c6a0 tx=0x7f4f44017000 comp rx=0 tx=0).stop 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 shutdown_connections 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f4f3c067320 0x7f4f3c0697d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f4f500c81f0 0x7f4f500ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f50069d60 0x7f4f5015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 --2- 172.21.15.22:0/4067995530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f500aca80 0x7f4f501576f0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 >> 172.21.15.22:0/4067995530 conn(0x7f4f500cd670 msgr2=0x7f4f501580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:45.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 shutdown_connections 2023-10-08T00:36:45.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.471+0000 7f4f55ec7700 1 -- 172.21.15.22:0/4067995530 wait complete. 2023-10-08T00:36:45.475 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:36:45.485 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":560,"stamp":"2023-10-08T00:36:44.553395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2440792,"kb_used_data":21528,"kb_used_omap":0,"kb_used_meta":2419200,"kb_avail":752533928,"statfs":{"total":773094113280,"available":770594742272,"internally_reserved":0,"allocated":22044672,"data_stored":10574342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2477260800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001225"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":318,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-10-08T00:34:44.521070+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:34:44.521070+0000","last_peered":"2023-10-08T00:34:44.521070+0000","last_clean":"2023-10-08T00:34:44.521070+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:34:44.521070+0000","last_undegraded":"2023-10-08T00:34:44.521070+0000","last_fullsized":"2023-10-08T00:34:44.521070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1767206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.34399999999999997,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.28599999999999998},"max":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.34200000000000003}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.81799999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.25900000000000001},"max":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.47499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.372,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.48899999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.875},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.97899999999999998},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.88300000000000001,"15min":0.89100000000000001},"last":0.62}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.317,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.753,"15min":0.79000000000000004},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65700000000000003,"5min":0.87,"15min":1.048},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1170140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.434,"5min":0.313,"15min":0.27600000000000002},"max":{"1min":0.68899999999999995,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.76500000000000001,"5min":0.97299999999999998,"15min":1.145},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.873},"last":0.373}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":1.079},"last":0.44},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.51900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.496,"15min":1.496},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":1.02,"15min":1.1160000000000001},"last":0.495}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.629},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308032,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063808,"statfs":{"total":96636764160,"available":96321339392,"internally_reserved":0,"allocated":2613248,"data_stored":1176386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.39200000000000002,"15min":0.38300000000000001},"min":{"1min":0.34100000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.307}]},{"osd":3,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.433},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.371},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41599999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86799999999999999,"5min":0.95999999999999996,"15min":1.218},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.101,"15min":1.101},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.79800000000000004,"5min":1.121,"15min":1.294},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52800000000000002,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.1319999999999999,"15min":1.2549999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.871,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":1.1120000000000001,"15min":1.278},"last":0.45400000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.497,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":0.91100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":0.89600000000000002,"15min":1.087},"last":0.46400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308596,"kb_used_data":3116,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063244,"statfs":{"total":96636764160,"available":96320761856,"internally_reserved":0,"allocated":3190784,"data_stored":1760544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.224,"15min":0.216},"max":{"1min":0.5,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.38500000000000001,"15min":0.36799999999999999},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35499999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.38300000000000001},"min":{"1min":0.317,"5min":0.249,"15min":0.245},"max":{"1min":0.55000000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.35899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.32000000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.376},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.59299999999999997,"5min":0.749,"15min":0.749},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.39700000000000002,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.48799999999999999,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.625},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65900000000000003,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0369999999999999},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.51900000000000002,"5min":0.39300000000000002,"15min":0.33600000000000002},"max":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.242},"last":0.497},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.96799999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64300000000000002,"15min":0.61199999999999999},"min":{"1min":0.55800000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.51500000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.628,"15min":0.626},"min":{"1min":0.58399999999999996,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"last":0.58499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1173979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.24199999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38,"15min":0.371},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.65000000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.34499999999999997,"5min":0.26800000000000002,"15min":0.23599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.376,"15min":0.372},"min":{"1min":0.311,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59399999999999997,"15min":0.60799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.70199999999999996},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.33000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.40999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0760000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.55400000000000005,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.34899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.278},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.137},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.62}]},{"osd":7,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.52400000000000002,"5min":0.42399999999999999,"15min":0.40699999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.1259999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.343},"last":0.70599999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303932,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067908,"statfs":{"total":96636764160,"available":96325537792,"internally_reserved":0,"allocated":2609152,"data_stored":1176352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.59699999999999998,"15min":0.66600000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.38300000000000001,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.309,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.41499999999999998},"min":{"1min":0.36699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.70699999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.40400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.79700000000000004},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84099999999999997,"5min":1.47,"15min":1.47},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.35899999999999999},"max":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96399999999999997},"last":0.46100000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":1.385,"15min":1.385},"last":0.44900000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.54500000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.48099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":0.996},"last":0.76200000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89300000000000002,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.56200000000000006,"5min":0.44,"15min":0.435},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.006},"last":0.51100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303940,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067900,"statfs":{"total":96636764160,"available":96325529600,"internally_reserved":0,"allocated":2617344,"data_stored":1179559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.433,"5min":0.30499999999999999,"15min":0.246},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47899999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.67500000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":0.82999999999999996,"15min":1.712},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":0.86599999999999999,"15min":1.21},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":0.88900000000000001,"15min":6.0960000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.82499999999999996,"15min":0.873},"last":0.45300000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.66700000000000004,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":0.82899999999999996,"15min":1.002},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55000000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.625,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.68700000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1170176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.86699999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.88300000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55300000000000005}]},{"osd":3,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.75700000000000001,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.83399999999999996,"15min":2.4870000000000001},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.78700000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80100000000000005},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30199999999999999},"max":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.56899999999999995},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.84399999999999997},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.85199999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56499999999999995,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:36:45.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T00:36:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.603+0000 7efcb1d26700 1 Processor -- start 2023-10-08T00:36:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.603+0000 7efcb1d26700 1 -- start start 2023-10-08T00:36:45.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.604+0000 7efcb1d26700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efcac1574d0 0x7efcac0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.609 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.604+0000 7efcb1d26700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0b16a0 con 0x7efcac0cc3c0 2023-10-08T00:36:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.604+0000 7efcb1d26700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcac0b1c60 con 0x7efcac06c0f0 2023-10-08T00:36:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.604+0000 7efcb1d26700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcac1578a0 con 0x7efcac1574d0 2023-10-08T00:36:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.604+0000 7efcabfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efcac0cc3c0 0x7efcac06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36586/0 (socket says 172.21.15.22:36586) 2023-10-08T00:36:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.604+0000 7efcabfff700 1 -- 172.21.15.22:0/3287463515 learned_addr learned my addr 172.21.15.22:0/3287463515 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcb0d24700 1 --2- 172.21.15.22:0/3287463515 >> v2:172.21.15.192:3300/0 conn(0x7efcac1574d0 0x7efcac0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486429446 0 0) 0x7efcac0b16a0 con 0x7efcac0cc3c0 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc98003570 con 0x7efcac0cc3c0 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65483691 0 0) 0x7efc98003570 con 0x7efcac0cc3c0 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 >> v2:172.21.15.192:3300/0 conn(0x7efcac1574d0 msgr2=0x7efcac0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 --2- 172.21.15.22:0/3287463515 >> v2:172.21.15.192:3300/0 conn(0x7efcac1574d0 0x7efcac0cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 >> v1:172.21.15.192:6789/0 conn(0x7efcac06c0f0 legacy=0x7efcac0b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac0cdb70 con 0x7efcac0cc3c0 2023-10-08T00:36:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7efc9c0017f0 con 0x7efcac0cc3c0 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 >> v1:172.21.15.22:6789/0 conn(0x7efcac0cc3c0 legacy=0x7efcac06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc98003a60 0x7efc98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc98004810 0x7efc98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc980051c0 0x7efc9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac1578a0 con 0x7efc980051c0 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9800c160 con 0x7efc98004810 2023-10-08T00:36:45.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9800c320 con 0x7efc98003a60 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcb1525700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc980051c0 0x7efc9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcabfff700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc98004810 0x7efc98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.605+0000 7efcb0d24700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc98003a60 0x7efc98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 -- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc98003a60 msgr2=0x7efc98003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efc98003a60 0x7efc98003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 -- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc98004810 msgr2=0x7efc98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc98004810 0x7efc98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 -- 172.21.15.22:0/3287463515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98003570 con 0x7efc980051c0 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 -- 172.21.15.22:0/3287463515 reap_dead start 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1525700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc980051c0 0x7efc9800ba60 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7efc94001880 tx=0x7efc94007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d04e0dae282697 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94012420 con 0x7efc980051c0 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc940125a0 con 0x7efc980051c0 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcab7fe700 1 -- 172.21.15.22:0/3287463515 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94012960 con 0x7efc980051c0 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 -- 172.21.15.22:0/3287463515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc980051c0 msgr2=0x7efc9800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc980051c0 0x7efc9800ba60 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7efc94001880 tx=0x7efc94007d30 comp rx=0 tx=0).stop 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 -- 172.21.15.22:0/3287463515 shutdown_connections 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 --2- 172.21.15.22:0/3287463515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc980051c0 0x7efc9800ba60 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 -- 172.21.15.22:0/3287463515 >> 172.21.15.22:0/3287463515 conn(0x7efcac0ce430 msgr2=0x7efcac0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 -- 172.21.15.22:0/3287463515 shutdown_connections 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.606+0000 7efcb1d26700 1 -- 172.21.15.22:0/3287463515 wait complete. 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.608+0000 7efcb1d26700 1 Processor -- start 2023-10-08T00:36:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.608+0000 7efcb1d26700 1 -- start start 2023-10-08T00:36:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.608+0000 7efcb1d26700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc980051c0 0x7efcac14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcac0c99a0 0x7efcac0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 0x7efcac0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0698b0 con 0x7efcac0c9e10 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcac14a5f0 con 0x7efc980051c0 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcac0c8c90 con 0x7efcac0c99a0 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 0x7efcac0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 0x7efcac0aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53456/0 (socket says 172.21.15.22:53456) 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 -- 172.21.15.22:0/882935484 learned_addr learned my addr 172.21.15.22:0/882935484 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb0d24700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc980051c0 0x7efcac14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcabfff700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcac0c99a0 0x7efcac0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 -- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcac0c99a0 msgr2=0x7efcac0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcac0c99a0 0x7efcac0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 -- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc980051c0 msgr2=0x7efcac14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc980051c0 0x7efcac14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 -- 172.21.15.22:0/882935484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac159d80 con 0x7efcac0c9e10 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1525700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 0x7efcac0aeb40 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7efcac0caa10 tx=0x7efc94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94012420 con 0x7efcac0c9e10 2023-10-08T00:36:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94001200 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcac0c8f40 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94011df0 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.609+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcac0c9500 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.610+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac069a60 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.611+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efc9401e640 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.611+0000 7efca8ff9700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc8c067320 0x7efc8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.611+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efc94085e10 con 0x7efcac0c9e10 2023-10-08T00:36:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.611+0000 7efcb0d24700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc8c067320 0x7efc8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.612+0000 7efcb0d24700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc8c067320 0x7efc8c0697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efcac0c81a0 tx=0x7efca4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.615+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcac069a60 con 0x7efcac0c9e10 2023-10-08T00:36:45.811 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.810+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcac069a60 con 0x7efcac0c9e10 2023-10-08T00:36:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.811+0000 7efca8ff9700 1 -- 172.21.15.22:0/882935484 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+12275 (secure 0 0 0) 0x7efcac069a60 con 0x7efcac0c9e10 2023-10-08T00:36:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:45.813 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":207,"fsid":"583a09b5-95bd-4449-bff4-3bbba2592bdd","created":"2023-10-08T00:24:34.770058+0000","modified":"2023-10-08T00:36:42.255943+0000","last_up_change":"2023-10-08T00:24:44.705998+0000","last_in_change":"2023-10-08T00:24:37.175161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T00:24:46.437265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"70c0c0c8-a26e-496f-9232-c306279b97f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":90833},{"type":"v1","addr":"172.21.15.22:6801","nonce":90833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":90833},{"type":"v1","addr":"172.21.15.22:6803","nonce":90833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":90833},{"type":"v1","addr":"172.21.15.22:6807","nonce":90833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":90833},{"type":"v1","addr":"172.21.15.22:6805","nonce":90833}]},"public_addr":"172.21.15.22:6801/90833","cluster_addr":"172.21.15.22:6803/90833","heartbeat_back_addr":"172.21.15.22:6807/90833","heartbeat_front_addr":"172.21.15.22:6805/90833","state":["exists","up"]},{"osd":1,"uuid":"b6694b00-d459-4d13-aae8-4df6fe7764a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":90842},{"type":"v1","addr":"172.21.15.22:6809","nonce":90842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":90842},{"type":"v1","addr":"172.21.15.22:6811","nonce":90842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":90842},{"type":"v1","addr":"172.21.15.22:6815","nonce":90842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":90842},{"type":"v1","addr":"172.21.15.22:6813","nonce":90842}]},"public_addr":"172.21.15.22:6809/90842","cluster_addr":"172.21.15.22:6811/90842","heartbeat_back_addr":"172.21.15.22:6815/90842","heartbeat_front_addr":"172.21.15.22:6813/90842","state":["exists","up"]},{"osd":2,"uuid":"375599f7-abb0-414a-b832-a1531da4e31a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":90850},{"type":"v1","addr":"172.21.15.22:6825","nonce":90850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":90850},{"type":"v1","addr":"172.21.15.22:6827","nonce":90850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":90850},{"type":"v1","addr":"172.21.15.22:6831","nonce":90850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":90850},{"type":"v1","addr":"172.21.15.22:6829","nonce":90850}]},"public_addr":"172.21.15.22:6825/90850","cluster_addr":"172.21.15.22:6827/90850","heartbeat_back_addr":"172.21.15.22:6831/90850","heartbeat_front_addr":"172.21.15.22:6829/90850","state":["exists","up"]},{"osd":3,"uuid":"5e95180c-0f8f-4ac9-9b42-f2fd67b04809","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":90849},{"type":"v1","addr":"172.21.15.22:6817","nonce":90849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":90849},{"type":"v1","addr":"172.21.15.22:6819","nonce":90849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":90849},{"type":"v1","addr":"172.21.15.22:6823","nonce":90849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":90849},{"type":"v1","addr":"172.21.15.22:6821","nonce":90849}]},"public_addr":"172.21.15.22:6817/90849","cluster_addr":"172.21.15.22:6819/90849","heartbeat_back_addr":"172.21.15.22:6823/90849","heartbeat_front_addr":"172.21.15.22:6821/90849","state":["exists","up"]},{"osd":4,"uuid":"67effb79-e51b-4db9-99b7-e5409f84380a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":91118},{"type":"v1","addr":"172.21.15.192:6816","nonce":91118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":91118},{"type":"v1","addr":"172.21.15.192:6819","nonce":91118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":91118},{"type":"v1","addr":"172.21.15.192:6823","nonce":91118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":91118},{"type":"v1","addr":"172.21.15.192:6821","nonce":91118}]},"public_addr":"172.21.15.192:6816/91118","cluster_addr":"172.21.15.192:6819/91118","heartbeat_back_addr":"172.21.15.192:6823/91118","heartbeat_front_addr":"172.21.15.192:6821/91118","state":["exists","up"]},{"osd":5,"uuid":"ea433699-7527-4139-9f5f-0edbe29e9228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":91131},{"type":"v1","addr":"172.21.15.192:6825","nonce":91131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":91131},{"type":"v1","addr":"172.21.15.192:6827","nonce":91131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":91131},{"type":"v1","addr":"172.21.15.192:6831","nonce":91131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":91131},{"type":"v1","addr":"172.21.15.192:6829","nonce":91131}]},"public_addr":"172.21.15.192:6825/91131","cluster_addr":"172.21.15.192:6827/91131","heartbeat_back_addr":"172.21.15.192:6831/91131","heartbeat_front_addr":"172.21.15.192:6829/91131","state":["exists","up"]},{"osd":6,"uuid":"1ffac83b-36fc-44b1-986b-20f6d54e596a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":91119},{"type":"v1","addr":"172.21.15.192:6804","nonce":91119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":91119},{"type":"v1","addr":"172.21.15.192:6808","nonce":91119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6815","nonce":91119},{"type":"v1","addr":"172.21.15.192:6817","nonce":91119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":91119},{"type":"v1","addr":"172.21.15.192:6812","nonce":91119}]},"public_addr":"172.21.15.192:6804/91119","cluster_addr":"172.21.15.192:6808/91119","heartbeat_back_addr":"172.21.15.192:6817/91119","heartbeat_front_addr":"172.21.15.192:6812/91119","state":["exists","up"]},{"osd":7,"uuid":"5897ff5b-cb55-4715-98a4-be89a8a85a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":91120},{"type":"v1","addr":"172.21.15.192:6801","nonce":91120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6803","nonce":91120},{"type":"v1","addr":"172.21.15.192:6805","nonce":91120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6811","nonce":91120},{"type":"v1","addr":"172.21.15.192:6813","nonce":91120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6807","nonce":91120},{"type":"v1","addr":"172.21.15.192:6809","nonce":91120}]},"public_addr":"172.21.15.192:6801/91120","cluster_addr":"172.21.15.192:6805/91120","heartbeat_back_addr":"172.21.15.192:6813/91120","heartbeat_front_addr":"172.21.15.192:6809/91120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.345307+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.335361+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.343117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.362556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.066311+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.374926+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.270071+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T00:24:42.365821+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/3800835270":"2023-10-09T00:36:39.248425+0000","172.21.15.192:6835/3800835270":"2023-10-09T00:36:39.248425+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T00:36:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc8c067320 msgr2=0x7efc8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc8c067320 0x7efc8c0697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7efcac0c81a0 tx=0x7efca4008040 comp rx=0 tx=0).stop 2023-10-08T00:36:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 msgr2=0x7efcac0aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 0x7efcac0aeb40 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7efcac0caa10 tx=0x7efc94015000 comp rx=0 tx=0).stop 2023-10-08T00:36:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 shutdown_connections 2023-10-08T00:36:45.815 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcac0c9e10 0x7efcac0aeb40 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc980051c0 0x7efcac14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7efc8c067320 0x7efc8c0697d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 --2- 172.21.15.22:0/882935484 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7efcac0c99a0 0x7efcac0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 >> 172.21.15.22:0/882935484 conn(0x7efcac0ce430 msgr2=0x7efcac153750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 shutdown_connections 2023-10-08T00:36:45.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:45.813+0000 7efcb1d26700 1 -- 172.21.15.22:0/882935484 wait complete. 2023-10-08T00:36:46.828 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T00:36:46.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.965+0000 7f8ed6e6b700 1 Processor -- start 2023-10-08T00:36:46.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.965+0000 7f8ed6e6b700 1 -- start start 2023-10-08T00:36:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ed6e6b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ed00cd910 0x7f8ed00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ed6e6b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed00b55a0 0x7f8ed00ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ed6e6b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00b5b00 con 0x7f8ed0159ec0 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ed6e6b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed00b5da0 con 0x7f8ed00cd910 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ed6e6b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00b6080 con 0x7f8ed00b55a0 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ecffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ed00cd910 0x7f8ed00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ecffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ed00cd910 0x7f8ed00ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42158/0 (socket says 172.21.15.22:42158) 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ecffff700 1 -- 172.21.15.22:0/844345618 learned_addr learned my addr 172.21.15.22:0/844345618 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ed5408700 1 --2- 172.21.15.22:0/844345618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed00b55a0 0x7f8ed00ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ecffff700 1 -- 172.21.15.22:0/844345618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed00b55a0 msgr2=0x7f8ed00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:46.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ecffff700 1 --2- 172.21.15.22:0/844345618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed00b55a0 0x7f8ed00ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.966+0000 7f8ecffff700 1 -- 172.21.15.22:0/844345618 >> v1:172.21.15.192:6789/0 conn(0x7f8ed0159ec0 legacy=0x7f8ed00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ecffff700 1 -- 172.21.15.22:0/844345618 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed00cc100 con 0x7f8ed00cd910 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ecffff700 1 --2- 172.21.15.22:0/844345618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed00cd910 0x7f8ed00ce340 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009f50 tx=0x7f8ec0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc051d58f7bac2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ecf7fe700 1 -- 172.21.15.22:0/844345618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000e070 con 0x7f8ed00cd910 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ecf7fe700 1 -- 172.21.15.22:0/844345618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000ba30 con 0x7f8ed00cd910 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ecf7fe700 1 -- 172.21.15.22:0/844345618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00092e0 con 0x7f8ed00cd910 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/844345618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed00cd910 msgr2=0x7f8ed00ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:46.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 --2- 172.21.15.22:0/844345618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed00cd910 0x7f8ed00ce340 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009f50 tx=0x7f8ec0009840 comp rx=0 tx=0).stop 2023-10-08T00:36:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/844345618 shutdown_connections 2023-10-08T00:36:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 --2- 172.21.15.22:0/844345618 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed00b55a0 0x7f8ed00ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 --2- 172.21.15.22:0/844345618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed00cd910 0x7f8ed00ce340 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/844345618 >> 172.21.15.22:0/844345618 conn(0x7f8ed00999f0 msgr2=0x7f8ed00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/844345618 shutdown_connections 2023-10-08T00:36:46.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.967+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/844345618 wait complete. 2023-10-08T00:36:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 Processor -- start 2023-10-08T00:36:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 -- start start 2023-10-08T00:36:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ed00b55a0 0x7f8ed0157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed0159ec0 0x7f8ed015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed016a460 0x7f8ed015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0157960 con 0x7f8ed016a460 2023-10-08T00:36:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0069e80 con 0x7f8ed00b55a0 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.969+0000 7f8ed6e6b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed015d8e0 con 0x7f8ed0159ec0 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed016a460 0x7f8ed015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed016a460 0x7f8ed015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42164/0 (socket says 172.21.15.22:42164) 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 -- 172.21.15.22:0/2479012045 learned_addr learned my addr 172.21.15.22:0/2479012045 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ecffff700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed0159ec0 0x7f8ed015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed4c07700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ed00b55a0 0x7f8ed0157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 -- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed0159ec0 msgr2=0x7f8ed015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:46.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8ed0159ec0 0x7f8ed015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 -- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ed00b55a0 msgr2=0x7f8ed0157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ed00b55a0 0x7f8ed0157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 -- 172.21.15.22:0/2479012045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009ae0 con 0x7f8ed016a460 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed4c07700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ed00b55a0 0x7f8ed0157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed5408700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed016a460 0x7f8ed015b200 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800d890 tx=0x7f8eb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80125f0 con 0x7f8ed016a460 2023-10-08T00:36:46.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8012770 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed015dbc0 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8012b30 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.970+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed0069b10 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.971+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ed0063c90 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8eb801e460 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8eccff9700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8eb0067320 0x7f8eb00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8eb8084ee0 con 0x7f8ed016a460 2023-10-08T00:36:46.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8eccff9700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7f8eb006d170 0x7f8eb006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 --> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8eb006fc50 con 0x7f8eb006d170 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eb8087440 con 0x7f8ed016a460 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.972+0000 7f8ed4c07700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8eb0067320 0x7f8eb00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.973+0000 7f8ecffff700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7f8eb006d170 0x7f8eb006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.973+0000 7f8ecffff700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7f8eb006d170 0x7f8eb006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.973+0000 7f8ed4c07700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8eb0067320 0x7f8eb00697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8002930 tx=0x7f8ec8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:46.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.973+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== osd.0 v2:172.21.15.22:6800/90833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8eb006fc50 con 0x7f8eb006d170 2023-10-08T00:36:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 --> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ed00718b0 con 0x7f8eb006d170 2023-10-08T00:36:46.989 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8eccff9700 1 -- 172.21.15.22:0/2479012045 <== osd.0 v2:172.21.15.22:6800/90833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8ed00718b0 con 0x7f8eb006d170 2023-10-08T00:36:46.990 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:46.990 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7f8eb006d170 msgr2=0x7f8eb006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:6800/90833,v1:172.21.15.22:6801/90833] conn(0x7f8eb006d170 0x7f8eb006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:46.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8eb0067320 msgr2=0x7f8eb00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8eb0067320 0x7f8eb00697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8002930 tx=0x7f8ec8009040 comp rx=0 tx=0).stop 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed016a460 msgr2=0x7f8ed015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 --2- 172.21.15.22:0/2479012045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ed016a460 0x7f8ed015b200 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800d890 tx=0x7f8eb8008040 comp rx=0 tx=0).stop 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed5408700 1 -- 172.21.15.22:0/2479012045 reap_dead start 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 shutdown_connections 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 >> 172.21.15.22:0/2479012045 conn(0x7f8ed00999f0 msgr2=0x7f8ed00c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 shutdown_connections 2023-10-08T00:36:46.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:46.988+0000 7f8ed6e6b700 1 -- 172.21.15.22:0/2479012045 wait complete. 2023-10-08T00:36:47.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T00:36:47.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.120+0000 7fe204297700 1 Processor -- start 2023-10-08T00:36:47.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.120+0000 7fe204297700 1 -- start start 2023-10-08T00:36:47.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.121+0000 7fe204297700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc069560 0x7fe1fc0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.121+0000 7fe204297700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc069ee0 con 0x7fe1fc159890 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.121+0000 7fe204297700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc15a160 con 0x7fe1fc159c60 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.121+0000 7fe204297700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0d13a0 con 0x7fe1fc069560 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.121+0000 7fe202033700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe1fc159890 0x7fe1fc15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36828/0 (socket says 172.21.15.22:36828) 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.121+0000 7fe202033700 1 -- 172.21.15.22:0/3196254921 learned_addr learned my addr 172.21.15.22:0/3196254921 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe202834700 1 --2- 172.21.15.22:0/3196254921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc069560 0x7fe1fc0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074085894 0 0) 0x7fe1fc069ee0 con 0x7fe1fc159890 2023-10-08T00:36:47.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e4003570 con 0x7fe1fc159890 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679477089 0 0) 0x7fe1fc15a160 con 0x7fe1fc159c60 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1fc069ee0 con 0x7fe1fc159c60 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe202834700 1 -- 172.21.15.22:0/3196254921 >> v1:172.21.15.192:6789/0 conn(0x7fe1fc159c60 legacy=0x7fe1fc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe202834700 1 -- 172.21.15.22:0/3196254921 >> v1:172.21.15.22:6789/0 conn(0x7fe1fc159890 legacy=0x7fe1fc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe202834700 1 -- 172.21.15.22:0/3196254921 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc15e140 con 0x7fe1fc069560 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe202834700 1 --2- 172.21.15.22:0/3196254921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc069560 0x7fe1fc0699a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009910 tx=0x7fe1f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87a4047623efc2e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4011630 con 0x7fe1fc069560 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4011790 con 0x7fe1fc069560 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.122+0000 7fe201031700 1 -- 172.21.15.22:0/3196254921 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4011b30 con 0x7fe1fc069560 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 -- 172.21.15.22:0/3196254921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc069560 msgr2=0x7fe1fc0699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 --2- 172.21.15.22:0/3196254921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc069560 0x7fe1fc0699a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009910 tx=0x7fe1f40091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 -- 172.21.15.22:0/3196254921 shutdown_connections 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 --2- 172.21.15.22:0/3196254921 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc069560 0x7fe1fc0699a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 -- 172.21.15.22:0/3196254921 >> 172.21.15.22:0/3196254921 conn(0x7fe1fc068e20 msgr2=0x7fe1fc0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 -- 172.21.15.22:0/3196254921 shutdown_connections 2023-10-08T00:36:47.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.123+0000 7fe204297700 1 -- 172.21.15.22:0/3196254921 wait complete. 2023-10-08T00:36:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.124+0000 7fe204297700 1 Processor -- start 2023-10-08T00:36:47.130 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.124+0000 7fe204297700 1 -- start start 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe204297700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 0x7fe1fc155140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe204297700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc159890 0x7fe1fc15c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe204297700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc159c60 0x7fe1fc0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe204297700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15c280 con 0x7fe1fc069560 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe204297700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15ddc0 con 0x7fe1fc159890 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe204297700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15b670 con 0x7fe1fc159c60 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 0x7fe1fc155140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.131 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 0x7fe1fc155140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42178/0 (socket says 172.21.15.22:42178) 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 -- 172.21.15.22:0/3959127174 learned_addr learned my addr 172.21.15.22:0/3959127174 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202834700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc159c60 0x7fe1fc0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe201832700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc159890 0x7fe1fc15c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 -- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc159c60 msgr2=0x7fe1fc0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc159c60 0x7fe1fc0b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 -- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc159890 msgr2=0x7fe1fc15c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.132 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc159890 0x7fe1fc15c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 -- 172.21.15.22:0/3959127174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4009420 con 0x7fe1fc069560 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe202033700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 0x7fe1fc155140 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec002250 tx=0x7fe1ec001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00ab30 con 0x7fe1fc069560 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.125+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec00ac90 con 0x7fe1fc069560 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.126+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc15b950 con 0x7fe1fc069560 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.126+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec007300 con 0x7fe1fc069560 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.126+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc15bf10 con 0x7fe1fc069560 2023-10-08T00:36:47.133 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.126+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc15c560 con 0x7fe1fc069560 2023-10-08T00:36:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.127+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe1ec0076f0 con 0x7fe1fc069560 2023-10-08T00:36:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.127+0000 7fe1fa7fc700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe1e8067320 0x7fe1e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.127+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe1ec084e70 con 0x7fe1fc069560 2023-10-08T00:36:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.128+0000 7fe201832700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe1e8067320 0x7fe1e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.134 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.128+0000 7fe201832700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe1e8067320 0x7fe1e80697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc15d2d0 tx=0x7fe1f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.135 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.132+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1ec051e80 con 0x7fe1fc069560 2023-10-08T00:36:47.327 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.326+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1fc15c3c0 con 0x7fe1e8067320 2023-10-08T00:36:47.328 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.326+0000 7fe1fa7fc700 1 -- 172.21.15.22:0/3959127174 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe1f000d660 con 0x7fe1e8067320 2023-10-08T00:36:47.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe1e8067320 msgr2=0x7fe1e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.330 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe1e8067320 0x7fe1e80697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc15d2d0 tx=0x7fe1f0009040 comp rx=0 tx=0).stop 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 msgr2=0x7fe1fc155140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 0x7fe1fc155140 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec002250 tx=0x7fe1ec001bb0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 shutdown_connections 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe1e8067320 0x7fe1e80697d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe1fc159c60 0x7fe1fc0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe1fc069560 0x7fe1fc155140 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 --2- 172.21.15.22:0/3959127174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe1fc159890 0x7fe1fc15c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.331 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 >> 172.21.15.22:0/3959127174 conn(0x7fe1fc068e20 msgr2=0x7fe1fc157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 shutdown_connections 2023-10-08T00:36:47.332 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.328+0000 7fe204297700 1 -- 172.21.15.22:0/3959127174 wait complete. 2023-10-08T00:36:47.332 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T00:36:47.342 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T00:36:47.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:47.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.464+0000 7f11d4a9a700 1 Processor -- start 2023-10-08T00:36:47.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.464+0000 7f11d4a9a700 1 -- start start 2023-10-08T00:36:47.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11d4a9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11d4a9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11d00ceb60 0x7f11d00cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11d4a9a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d015c320 con 0x7f11d0155360 2023-10-08T00:36:47.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11d4a9a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00cefc0 con 0x7f11d00ceb60 2023-10-08T00:36:47.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11d4a9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d015b710 con 0x7f11d00b42c0 2023-10-08T00:36:47.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11d00ceb60 0x7f11d00cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11d00ceb60 0x7f11d00cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42184/0 (socket says 172.21.15.22:42184) 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 -- 172.21.15.22:0/751514330 learned_addr learned my addr 172.21.15.22:0/751514330 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11c7fff700 1 --2- 172.21.15.22:0/751514330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 -- 172.21.15.22:0/751514330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 msgr2=0x7f11d00ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 --2- 172.21.15.22:0/751514330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 -- 172.21.15.22:0/751514330 >> v1:172.21.15.192:6789/0 conn(0x7f11d0155360 legacy=0x7f11d00b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:47.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 -- 172.21.15.22:0/751514330 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d015b9f0 con 0x7f11d00ceb60 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11ced9d700 1 --2- 172.21.15.22:0/751514330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00cc9c0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009f20 tx=0x7f11c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a54061f1b6c4044 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.465+0000 7f11cdd9b700 1 -- 172.21.15.22:0/751514330 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800e070 con 0x7f11d00ceb60 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11cdd9b700 1 -- 172.21.15.22:0/751514330 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c800ba40 con 0x7f11d00ceb60 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11cdd9b700 1 -- 172.21.15.22:0/751514330 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c80092e0 con 0x7f11d00ceb60 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 -- 172.21.15.22:0/751514330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 msgr2=0x7f11d00cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 --2- 172.21.15.22:0/751514330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00cc9c0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009f20 tx=0x7f11c8009840 comp rx=0 tx=0).stop 2023-10-08T00:36:47.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 -- 172.21.15.22:0/751514330 shutdown_connections 2023-10-08T00:36:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 --2- 172.21.15.22:0/751514330 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00cc9c0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 --2- 172.21.15.22:0/751514330 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 -- 172.21.15.22:0/751514330 >> 172.21.15.22:0/751514330 conn(0x7f11d006baf0 msgr2=0x7f11d006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 -- 172.21.15.22:0/751514330 shutdown_connections 2023-10-08T00:36:47.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.466+0000 7f11d4a9a700 1 -- 172.21.15.22:0/751514330 wait complete. 2023-10-08T00:36:47.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.467+0000 7f11d4a9a700 1 Processor -- start 2023-10-08T00:36:47.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.467+0000 7f11d4a9a700 1 -- start start 2023-10-08T00:36:47.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11d4a9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.474 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11d4a9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11d4a9a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11d0155360 0x7f11d00af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11d4a9a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b0f10 con 0x7f11d00ceb60 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11d4a9a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d015d080 con 0x7f11d0155360 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11d4a9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d015c790 con 0x7f11d00b42c0 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42186/0 (socket says 172.21.15.22:42186) 2023-10-08T00:36:47.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 -- 172.21.15.22:0/4123603680 learned_addr learned my addr 172.21.15.22:0/4123603680 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11ced9d700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11d0155360 0x7f11d00af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11ce59c700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 -- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 msgr2=0x7f11d00c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 -- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11d0155360 msgr2=0x7f11d00af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11d0155360 0x7f11d00af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11c7fff700 1 -- 172.21.15.22:0/4123603680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009ae0 con 0x7f11d00ceb60 2023-10-08T00:36:47.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11ced9d700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11d0155360 0x7f11d00af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.468+0000 7f11ce59c700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f11d00b42c0 0x7f11d00c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.469+0000 7f11c7fff700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00c3900 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c7d0 tx=0x7f11b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.469+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8011600 con 0x7f11d00ceb60 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.469+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8011760 con 0x7f11d00ceb60 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.469+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d015ca30 con 0x7f11d00ceb60 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.469+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8011b20 con 0x7f11d00ceb60 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.469+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d00b0260 con 0x7f11d00ceb60 2023-10-08T00:36:47.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.470+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11d00718b0 con 0x7f11d00ceb60 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.470+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f11b80193f0 con 0x7f11d00ceb60 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11c67fc700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11b0067320 0x7f11b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f11b8084e80 con 0x7f11d00ceb60 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11c67fc700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f11b006d170 0x7f11b006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 --> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11b006fc50 con 0x7f11b006d170 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b80873e0 con 0x7f11d00ceb60 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11ce59c700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11b0067320 0x7f11b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11ced9d700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f11b006d170 0x7f11b006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11ced9d700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f11b006d170 0x7f11b006f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.471+0000 7f11ce59c700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11b0067320 0x7f11b00697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f11c0006fd0 tx=0x7f11c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.472+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== osd.1 v2:172.21.15.22:6808/90842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f11b006fc50 con 0x7f11b006d170 2023-10-08T00:36:47.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 --> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f11d015bcd0 con 0x7f11b006d170 2023-10-08T00:36:47.487 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11c67fc700 1 -- 172.21.15.22:0/4123603680 <== osd.1 v2:172.21.15.22:6808/90842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f11d015bcd0 con 0x7f11b006d170 2023-10-08T00:36:47.488 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:47.488 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:47.488 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:47.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f11b006d170 msgr2=0x7f11b006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:6808/90842,v1:172.21.15.22:6809/90842] conn(0x7f11b006d170 0x7f11b006f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11b0067320 msgr2=0x7f11b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f11b0067320 0x7f11b00697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f11c0006fd0 tx=0x7f11c0008040 comp rx=0 tx=0).stop 2023-10-08T00:36:47.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 msgr2=0x7f11d00c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.489 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 --2- 172.21.15.22:0/4123603680 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d00ceb60 0x7f11d00c3900 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c7d0 tx=0x7f11b8008040 comp rx=0 tx=0).stop 2023-10-08T00:36:47.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11ced9d700 1 -- 172.21.15.22:0/4123603680 reap_dead start 2023-10-08T00:36:47.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 shutdown_connections 2023-10-08T00:36:47.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 >> 172.21.15.22:0/4123603680 conn(0x7f11d006baf0 msgr2=0x7f11d00b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 shutdown_connections 2023-10-08T00:36:47.490 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.486+0000 7f11d4a9a700 1 -- 172.21.15.22:0/4123603680 wait complete. 2023-10-08T00:36:47.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T00:36:47.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.617+0000 7fe666371700 1 Processor -- start 2023-10-08T00:36:47.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.617+0000 7fe666371700 1 -- start start 2023-10-08T00:36:47.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe666371700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6601593b0 0x7fe660159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe666371700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6600ceaa0 0x7fe6600b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe666371700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600b6570 con 0x7fe6600b1740 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe666371700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6600cfe20 con 0x7fe6600ceaa0 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe666371700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600cf210 con 0x7fe6601593b0 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6600ceaa0 0x7fe6600b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6600ceaa0 0x7fe6600b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42198/0 (socket says 172.21.15.22:42198) 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 -- 172.21.15.22:0/309630675 learned_addr learned my addr 172.21.15.22:0/309630675 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 -- 172.21.15.22:0/309630675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6601593b0 msgr2=0x7fe660159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 --2- 172.21.15.22:0/309630675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6601593b0 0x7fe660159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 -- 172.21.15.22:0/309630675 >> v1:172.21.15.192:6789/0 conn(0x7fe6600b1740 legacy=0x7fe66015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.618+0000 7fe664b6e700 1 -- 172.21.15.22:0/309630675 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600cf4f0 con 0x7fe6600ceaa0 2023-10-08T00:36:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe664b6e700 1 --2- 172.21.15.22:0/309630675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6600ceaa0 0x7fe6600b6030 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61484baa1dc955e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe65ffff700 1 -- 172.21.15.22:0/309630675 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400b820 con 0x7fe6600ceaa0 2023-10-08T00:36:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe65ffff700 1 -- 172.21.15.22:0/309630675 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400b980 con 0x7fe6600ceaa0 2023-10-08T00:36:47.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe65ffff700 1 -- 172.21.15.22:0/309630675 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400bd20 con 0x7fe6600ceaa0 2023-10-08T00:36:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 -- 172.21.15.22:0/309630675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6600ceaa0 msgr2=0x7fe6600b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 --2- 172.21.15.22:0/309630675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6600ceaa0 0x7fe6600b6030 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fe6540099b0 tx=0x7fe654009250 comp rx=0 tx=0).stop 2023-10-08T00:36:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 -- 172.21.15.22:0/309630675 shutdown_connections 2023-10-08T00:36:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 --2- 172.21.15.22:0/309630675 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6601593b0 0x7fe660159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 --2- 172.21.15.22:0/309630675 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6600ceaa0 0x7fe6600b6030 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 -- 172.21.15.22:0/309630675 >> 172.21.15.22:0/309630675 conn(0x7fe6600d1130 msgr2=0x7fe6600b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 -- 172.21.15.22:0/309630675 shutdown_connections 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.619+0000 7fe666371700 1 -- 172.21.15.22:0/309630675 wait complete. 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.620+0000 7fe666371700 1 Processor -- start 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.620+0000 7fe666371700 1 -- start start 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe666371700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6600b1740 0x7fe6600cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe666371700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6600ceaa0 0x7fe6600c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe666371700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 0x7fe6600c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe666371700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c6d90 con 0x7fe6601593b0 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe666371700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c7080 con 0x7fe6600b1740 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe666371700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600c7360 con 0x7fe6600ceaa0 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe665b70700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 0x7fe6600c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe665b70700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 0x7fe6600c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42208/0 (socket says 172.21.15.22:42208) 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.621+0000 7fe665b70700 1 -- 172.21.15.22:0/2553863369 learned_addr learned my addr 172.21.15.22:0/2553863369 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe664b6e700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6600ceaa0 0x7fe6600c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.627 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe66536f700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6600b1740 0x7fe6600cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe665b70700 1 -- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6600ceaa0 msgr2=0x7fe6600c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe665b70700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6600ceaa0 0x7fe6600c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe665b70700 1 -- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6600b1740 msgr2=0x7fe6600cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe665b70700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6600b1740 0x7fe6600cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe665b70700 1 -- 172.21.15.22:0/2553863369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6540094f0 con 0x7fe6601593b0 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe665b70700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 0x7fe6600c8120 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fe65000bbb0 tx=0x7fe650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6500092e0 con 0x7fe6601593b0 2023-10-08T00:36:47.628 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65000c7a0 con 0x7fe6601593b0 2023-10-08T00:36:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6600c7640 con 0x7fe6601593b0 2023-10-08T00:36:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65000cb40 con 0x7fe6601593b0 2023-10-08T00:36:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.622+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6600c7c00 con 0x7fe6601593b0 2023-10-08T00:36:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.623+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66004c3c0 con 0x7fe6601593b0 2023-10-08T00:36:47.629 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.623+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe650012070 con 0x7fe6601593b0 2023-10-08T00:36:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.624+0000 7fe65d7fa700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe64c067320 0x7fe64c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.624+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe6500846b0 con 0x7fe6601593b0 2023-10-08T00:36:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.624+0000 7fe66536f700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe64c067320 0x7fe64c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.624+0000 7fe66536f700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe64c067320 0x7fe64c0697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe658006fd0 tx=0x7fe658008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.630 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.628+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe650051640 con 0x7fe6601593b0 2023-10-08T00:36:47.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.821+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6600afa20 con 0x7fe64c067320 2023-10-08T00:36:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.821+0000 7fe65d7fa700 1 -- 172.21.15.22:0/2553863369 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe6600afa20 con 0x7fe64c067320 2023-10-08T00:36:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe64c067320 msgr2=0x7fe64c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe64c067320 0x7fe64c0697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe658006fd0 tx=0x7fe658008040 comp rx=0 tx=0).stop 2023-10-08T00:36:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 msgr2=0x7fe6600c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 0x7fe6600c8120 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fe65000bbb0 tx=0x7fe650009840 comp rx=0 tx=0).stop 2023-10-08T00:36:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 shutdown_connections 2023-10-08T00:36:47.825 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6601593b0 0x7fe6600c8120 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6600b1740 0x7fe6600cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe64c067320 0x7fe64c0697d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 --2- 172.21.15.22:0/2553863369 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe6600ceaa0 0x7fe6600c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 >> 172.21.15.22:0/2553863369 conn(0x7fe6600d1130 msgr2=0x7fe66015bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 shutdown_connections 2023-10-08T00:36:47.826 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.823+0000 7fe666371700 1 -- 172.21.15.22:0/2553863369 wait complete. 2023-10-08T00:36:47.827 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T00:36:47.837 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T00:36:47.837 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:47.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.959+0000 7f648a063700 1 Processor -- start 2023-10-08T00:36:47.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.959+0000 7f648a063700 1 -- start start 2023-10-08T00:36:47.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f648a063700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6484153850 0x7f64841596b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f648a063700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648415a030 con 0x7f6484153480 2023-10-08T00:36:47.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f648a063700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648415a480 con 0x7f6484159bf0 2023-10-08T00:36:47.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f648a063700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64840afb40 con 0x7f6484153850 2023-10-08T00:36:47.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6484153850 0x7f64841596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6484153850 0x7f64841596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42222/0 (socket says 172.21.15.22:42222) 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6489061700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6484153480 0x7f64840ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36832/0 (socket says 172.21.15.22:36832) 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 -- 172.21.15.22:0/2274453003 learned_addr learned my addr 172.21.15.22:0/2274453003 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 -- 172.21.15.22:0/2274453003 >> v1:172.21.15.192:6789/0 conn(0x7f6484159bf0 legacy=0x7f6484157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 -- 172.21.15.22:0/2274453003 >> v1:172.21.15.22:6789/0 conn(0x7f6484153480 legacy=0x7f64840ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 -- 172.21.15.22:0/2274453003 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840afe20 con 0x7f6484153850 2023-10-08T00:36:47.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.960+0000 7f6488860700 1 --2- 172.21.15.22:0/2274453003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f64841596b0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f647800ab50 tx=0x7f647800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51420c2449504f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f6483fff700 1 -- 172.21.15.22:0/2274453003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647800ca60 con 0x7f6484153850 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f6483fff700 1 -- 172.21.15.22:0/2274453003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647800cbc0 con 0x7f6484153850 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f6483fff700 1 -- 172.21.15.22:0/2274453003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780183f0 con 0x7f6484153850 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 -- 172.21.15.22:0/2274453003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 msgr2=0x7f64841596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 --2- 172.21.15.22:0/2274453003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f64841596b0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f647800ab50 tx=0x7f647800a3f0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 -- 172.21.15.22:0/2274453003 shutdown_connections 2023-10-08T00:36:47.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 --2- 172.21.15.22:0/2274453003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f64841596b0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 -- 172.21.15.22:0/2274453003 >> 172.21.15.22:0/2274453003 conn(0x7f6484068e20 msgr2=0x7f64840cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 -- 172.21.15.22:0/2274453003 shutdown_connections 2023-10-08T00:36:47.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.961+0000 7f648a063700 1 -- 172.21.15.22:0/2274453003 wait complete. 2023-10-08T00:36:47.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.962+0000 7f648a063700 1 Processor -- start 2023-10-08T00:36:47.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.962+0000 7f648a063700 1 -- start start 2023-10-08T00:36:47.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f648a063700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6484153480 0x7f6484155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f648a063700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f648414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.971 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f648a063700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6484159bf0 0x7f6484152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f648a063700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64841561d0 con 0x7f6484153850 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f648a063700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484169c20 con 0x7f6484159bf0 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f648a063700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648414c630 con 0x7f6484153480 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f6488860700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f648414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f6488860700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f648414b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42228/0 (socket says 172.21.15.22:42228) 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f6488860700 1 -- 172.21.15.22:0/1273935948 learned_addr learned my addr 172.21.15.22:0/1273935948 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.963+0000 7f6489061700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6484153480 0x7f6484155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6489862700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6484159bf0 0x7f6484152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6488860700 1 -- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6484153480 msgr2=0x7f6484155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6488860700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6484153480 0x7f6484155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6488860700 1 -- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6484159bf0 msgr2=0x7f6484152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6488860700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6484159bf0 0x7f6484152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6488860700 1 -- 172.21.15.22:0/1273935948 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647800a690 con 0x7f6484153850 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6489061700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f6484153480 0x7f6484155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6489862700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6484159bf0 0x7f6484152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f6488860700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f648414b5c0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f64840714a0 tx=0x7f6478019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478010600 con 0x7f6484153850 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6478010780 con 0x7f6484153850 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64841692f0 con 0x7f6484153850 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478010b40 con 0x7f6484153850 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.964+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64841698b0 con 0x7f6484153850 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.965+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f648404c3c0 con 0x7f6484153850 2023-10-08T00:36:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.965+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f647802a3b0 con 0x7f6484153850 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f64817fa700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6470067320 0x7f64700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6478086790 con 0x7f6484153850 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f64817fa700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f647006d170 0x7f647006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 --> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f647006fc50 con 0x7f647006d170 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6478086aa0 con 0x7f6484153850 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f6489862700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f647006d170 0x7f647006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f6489061700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6470067320 0x7f64700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.966+0000 7f6489862700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f647006d170 0x7f647006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.967+0000 7f6489061700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6470067320 0x7f64700697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f647c007120 tx=0x7f647c007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.967+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== osd.2 v2:172.21.15.22:6824/90850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f647006fc50 con 0x7f647006d170 2023-10-08T00:36:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.981+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 --> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64840b0100 con 0x7f647006d170 2023-10-08T00:36:47.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.981+0000 7f64817fa700 1 -- 172.21.15.22:0/1273935948 <== osd.2 v2:172.21.15.22:6824/90850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f64840b0100 con 0x7f647006d170 2023-10-08T00:36:47.983 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:47.983 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:47.983 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.981+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f647006d170 msgr2=0x7f647006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.981+0000 7f648a063700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:6824/90850,v1:172.21.15.22:6825/90850] conn(0x7f647006d170 0x7f647006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6470067320 msgr2=0x7f64700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6470067320 0x7f64700697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f647c007120 tx=0x7f647c007d80 comp rx=0 tx=0).stop 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 msgr2=0x7f648414b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 --2- 172.21.15.22:0/1273935948 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6484153850 0x7f648414b5c0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f64840714a0 tx=0x7f6478019000 comp rx=0 tx=0).stop 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f6489862700 1 -- 172.21.15.22:0/1273935948 reap_dead start 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 shutdown_connections 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 >> 172.21.15.22:0/1273935948 conn(0x7f6484068e20 msgr2=0x7f648406e390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 shutdown_connections 2023-10-08T00:36:47.986 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:47.982+0000 7f648a063700 1 -- 172.21.15.22:0/1273935948 wait complete. 2023-10-08T00:36:47.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T00:36:48.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.113+0000 7f839ee9a700 1 Processor -- start 2023-10-08T00:36:48.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.113+0000 7f839ee9a700 1 -- start start 2023-10-08T00:36:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839ee9a700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f839806c0f0 0x7f8398159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839ee9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f83980b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839ee9a700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8398143420 con 0x7f8398143050 2023-10-08T00:36:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839ee9a700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806a1e0 con 0x7f839806c0f0 2023-10-08T00:36:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839ee9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980695d0 con 0x7f83980b3810 2023-10-08T00:36:48.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839e699700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f83980b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839d697700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f839806c0f0 0x7f8398159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839d697700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f839806c0f0 0x7f8398159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:41318/0 (socket says 172.21.15.22:41318) 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839d697700 1 -- 172.21.15.22:0/2167096945 learned_addr learned my addr 172.21.15.22:0/2167096945 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.114+0000 7f839e699700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f83980b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:57234/0 (socket says 172.21.15.22:57234) 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839e699700 1 -- 172.21.15.22:0/2167096945 >> v2:172.21.15.192:3300/0 conn(0x7f839806c0f0 msgr2=0x7f8398159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839e699700 1 --2- 172.21.15.22:0/2167096945 >> v2:172.21.15.192:3300/0 conn(0x7f839806c0f0 0x7f8398159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839e699700 1 -- 172.21.15.22:0/2167096945 >> v1:172.21.15.192:6789/0 conn(0x7f8398143050 legacy=0x7f839806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839e699700 1 -- 172.21.15.22:0/2167096945 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980698b0 con 0x7f83980b3810 2023-10-08T00:36:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839e699700 1 --2- 172.21.15.22:0/2167096945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f83980b3c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8388009e60 tx=0x7f8388009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d8d276ee610aab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839ce96700 1 -- 172.21.15.22:0/2167096945 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838800e070 con 0x7f83980b3810 2023-10-08T00:36:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839ce96700 1 -- 172.21.15.22:0/2167096945 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838800bb60 con 0x7f83980b3810 2023-10-08T00:36:48.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.115+0000 7f839ce96700 1 -- 172.21.15.22:0/2167096945 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388012430 con 0x7f83980b3810 2023-10-08T00:36:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 -- 172.21.15.22:0/2167096945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 msgr2=0x7f83980b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2167096945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f83980b3c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8388009e60 tx=0x7f8388009780 comp rx=0 tx=0).stop 2023-10-08T00:36:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 -- 172.21.15.22:0/2167096945 shutdown_connections 2023-10-08T00:36:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2167096945 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f83980b3c70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2167096945 >> v2:172.21.15.192:3300/0 conn(0x7f839806c0f0 0x7f8398159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 -- 172.21.15.22:0/2167096945 >> 172.21.15.22:0/2167096945 conn(0x7f83980ce430 msgr2=0x7f83980ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 -- 172.21.15.22:0/2167096945 shutdown_connections 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.116+0000 7f839ee9a700 1 -- 172.21.15.22:0/2167096945 wait complete. 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.117+0000 7f839ee9a700 1 Processor -- start 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.117+0000 7f839ee9a700 1 -- start start 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 0x7f8398159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f839815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398143050 0x7f8398140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839815cb60 con 0x7f839806c0f0 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839815bf50 con 0x7f8398143050 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839815c230 con 0x7f83980b3810 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 0x7f8398159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 0x7f8398159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42244/0 (socket says 172.21.15.22:42244) 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 -- 172.21.15.22:0/2239693713 learned_addr learned my addr 172.21.15.22:0/2239693713 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839e699700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398143050 0x7f8398140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839d697700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f839815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 -- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 msgr2=0x7f839815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f839815e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 -- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398143050 msgr2=0x7f8398140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398143050 0x7f8398140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 -- 172.21.15.22:0/2239693713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8388009a20 con 0x7f839806c0f0 2023-10-08T00:36:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839e699700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398143050 0x7f8398140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839d697700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f839815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839de98700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 0x7f8398159070 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f839000c540 tx=0x7f8390001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011590 con 0x7f839806c0f0 2023-10-08T00:36:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900116f0 con 0x7f839806c0f0 2023-10-08T00:36:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.118+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839815c510 con 0x7f839806c0f0 2023-10-08T00:36:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.119+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390011ab0 con 0x7f839806c0f0 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.119+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83981595b0 con 0x7f839806c0f0 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.120+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839804c3c0 con 0x7f839806c0f0 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.120+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f839001b3b0 con 0x7f839806c0f0 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.120+0000 7f8395ffb700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8384067320 0x7f83840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.121+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8390083d90 con 0x7f839806c0f0 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.121+0000 7f839d697700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8384067320 0x7f83840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.121+0000 7f839d697700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8384067320 0x7f83840697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f839806d780 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.129 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.125+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8390050dd0 con 0x7f839806c0f0 2023-10-08T00:36:48.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.317+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f839815cca0 con 0x7f8384067320 2023-10-08T00:36:48.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.318+0000 7f8395ffb700 1 -- 172.21.15.22:0/2239693713 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f838c009a70 con 0x7f8384067320 2023-10-08T00:36:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8384067320 msgr2=0x7f83840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8384067320 0x7f83840697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f839806d780 tx=0x7f838c008040 comp rx=0 tx=0).stop 2023-10-08T00:36:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 msgr2=0x7f8398159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 0x7f8398159070 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f839000c540 tx=0x7f8390001070 comp rx=0 tx=0).stop 2023-10-08T00:36:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 shutdown_connections 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398143050 0x7f8398140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f839806c0f0 0x7f8398159070 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f8384067320 0x7f83840697d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 --2- 172.21.15.22:0/2239693713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f83980b3810 0x7f839815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 >> 172.21.15.22:0/2239693713 conn(0x7f83980ce430 msgr2=0x7f83980b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 shutdown_connections 2023-10-08T00:36:48.323 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.320+0000 7f839ee9a700 1 -- 172.21.15.22:0/2239693713 wait complete. 2023-10-08T00:36:48.324 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T00:36:48.334 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T00:36:48.334 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 Processor -- start 2023-10-08T00:36:48.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 -- start start 2023-10-08T00:36:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c155360 0x7f269c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f269c0b40f0 0x7f269c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f269c0ceb60 0x7f269c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c0b4560 con 0x7f269c0b40f0 2023-10-08T00:36:48.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f269c15c320 con 0x7f269c0ceb60 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.456+0000 7f26a2ad4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c0cef90 con 0x7f269c155360 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f269c0b40f0 0x7f269c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f269c0b40f0 0x7f269c0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42254/0 (socket says 172.21.15.22:42254) 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 -- 172.21.15.22:0/703484194 learned_addr learned my addr 172.21.15.22:0/703484194 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f26a0870700 1 --2- 172.21.15.22:0/703484194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c155360 0x7f269c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f26a1071700 1 --2- 172.21.15.22:0/703484194 >> v2:172.21.15.192:3300/0 conn(0x7f269c0ceb60 0x7f269c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 -- 172.21.15.22:0/703484194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c155360 msgr2=0x7f269c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 --2- 172.21.15.22:0/703484194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c155360 0x7f269c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 -- 172.21.15.22:0/703484194 >> v2:172.21.15.192:3300/0 conn(0x7f269c0ceb60 msgr2=0x7f269c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 --2- 172.21.15.22:0/703484194 >> v2:172.21.15.192:3300/0 conn(0x7f269c0ceb60 0x7f269c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 -- 172.21.15.22:0/703484194 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269c15b710 con 0x7f269c0b40f0 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f26a1071700 1 --2- 172.21.15.22:0/703484194 >> v2:172.21.15.192:3300/0 conn(0x7f269c0ceb60 0x7f269c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269bfff700 1 --2- 172.21.15.22:0/703484194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0b40f0 0x7f269c0ce620 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f269c070f60 tx=0x7f268c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f20d48c2c58bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269b7fe700 1 -- 172.21.15.22:0/703484194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c00e070 con 0x7f269c0b40f0 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269b7fe700 1 -- 172.21.15.22:0/703484194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c00ba20 con 0x7f269c0b40f0 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.457+0000 7f269b7fe700 1 -- 172.21.15.22:0/703484194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0092e0 con 0x7f269c0b40f0 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 -- 172.21.15.22:0/703484194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0b40f0 msgr2=0x7f269c0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/703484194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0b40f0 0x7f269c0ce620 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f269c070f60 tx=0x7f268c009840 comp rx=0 tx=0).stop 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 -- 172.21.15.22:0/703484194 shutdown_connections 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/703484194 >> v2:172.21.15.192:3300/0 conn(0x7f269c0ceb60 0x7f269c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/703484194 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c155360 0x7f269c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/703484194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0b40f0 0x7f269c0ce620 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 -- 172.21.15.22:0/703484194 >> 172.21.15.22:0/703484194 conn(0x7f269c06baf0 msgr2=0x7f269c06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 -- 172.21.15.22:0/703484194 shutdown_connections 2023-10-08T00:36:48.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.458+0000 7f26a2ad4700 1 -- 172.21.15.22:0/703484194 wait complete. 2023-10-08T00:36:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.459+0000 7f26a2ad4700 1 Processor -- start 2023-10-08T00:36:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.459+0000 7f26a2ad4700 1 -- start start 2023-10-08T00:36:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a2ad4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c0b40f0 0x7f269c14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a2ad4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0ceb60 0x7f269c153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a2ad4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f269c155360 0x7f269c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a2ad4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c14ed60 con 0x7f269c0ceb60 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a2ad4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f269c151570 con 0x7f269c155360 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a2ad4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269c150f40 con 0x7f269c0b40f0 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0ceb60 0x7f269c153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0ceb60 0x7f269c153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42258/0 (socket says 172.21.15.22:42258) 2023-10-08T00:36:48.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 -- 172.21.15.22:0/3195474464 learned_addr learned my addr 172.21.15.22:0/3195474464 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a1071700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f269c155360 0x7f269c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a0870700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c0b40f0 0x7f269c14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 -- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c0b40f0 msgr2=0x7f269c14e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c0b40f0 0x7f269c14e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 -- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f269c155360 msgr2=0x7f269c1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f269c155360 0x7f269c1543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 -- 172.21.15.22:0/3195474464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c009ae0 con 0x7f269c0ceb60 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a0870700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f269c0b40f0 0x7f269c14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f26a1071700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f269c155360 0x7f269c1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.460+0000 7f269bfff700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0ceb60 0x7f269c153e80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f269c06f610 tx=0x7f268c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.461+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c008c30 con 0x7f269c0ceb60 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.461+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c008db0 con 0x7f269c0ceb60 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.461+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269c0c40b0 con 0x7f269c0ceb60 2023-10-08T00:36:48.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.461+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c0266b0 con 0x7f269c0ceb60 2023-10-08T00:36:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.461+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c151200 con 0x7f269c0ceb60 2023-10-08T00:36:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.461+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f269c0718b0 con 0x7f269c0ceb60 2023-10-08T00:36:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.462+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f268c003040 con 0x7f269c0ceb60 2023-10-08T00:36:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.462+0000 7f2698ff9700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f267c067320 0x7f267c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f268c0868f0 con 0x7f269c0ceb60 2023-10-08T00:36:48.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f2698ff9700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f267c06d170 0x7f267c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 --> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f267c06fc50 con 0x7f267c06d170 2023-10-08T00:36:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f268c08b220 con 0x7f269c0ceb60 2023-10-08T00:36:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f26a0870700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f267c067320 0x7f267c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f26a1071700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f267c06d170 0x7f267c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.472 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f26a1071700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f267c06d170 0x7f267c06f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.463+0000 7f26a0870700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f267c067320 0x7f267c0697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2694009ce0 tx=0x7f2694008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.473 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.464+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== osd.3 v2:172.21.15.22:6816/90849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f267c06fc50 con 0x7f267c06d170 2023-10-08T00:36:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 --> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f269c15b9f0 con 0x7f267c06d170 2023-10-08T00:36:48.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f2698ff9700 1 -- 172.21.15.22:0/3195474464 <== osd.3 v2:172.21.15.22:6816/90849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f269c15b9f0 con 0x7f267c06d170 2023-10-08T00:36:48.480 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:48.480 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:48.480 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f267c06d170 msgr2=0x7f267c06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:6816/90849,v1:172.21.15.22:6817/90849] conn(0x7f267c06d170 0x7f267c06f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f267c067320 msgr2=0x7f267c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.481 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f267c067320 0x7f267c0697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2694009ce0 tx=0x7f2694008040 comp rx=0 tx=0).stop 2023-10-08T00:36:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0ceb60 msgr2=0x7f269c153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 --2- 172.21.15.22:0/3195474464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269c0ceb60 0x7f269c153e80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f269c06f610 tx=0x7f268c018000 comp rx=0 tx=0).stop 2023-10-08T00:36:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a1071700 1 -- 172.21.15.22:0/3195474464 reap_dead start 2023-10-08T00:36:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 shutdown_connections 2023-10-08T00:36:48.482 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 >> 172.21.15.22:0/3195474464 conn(0x7f269c06baf0 msgr2=0x7f269c15ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 shutdown_connections 2023-10-08T00:36:48.483 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.478+0000 7f26a2ad4700 1 -- 172.21.15.22:0/3195474464 wait complete. 2023-10-08T00:36:48.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T00:36:48.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.611+0000 7f905186e700 1 Processor -- start 2023-10-08T00:36:48.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.611+0000 7f905186e700 1 -- start start 2023-10-08T00:36:48.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f905186e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159890 0x7f904c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f905186e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f904c159c60 0x7f904c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f905186e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c15a160 con 0x7f904c15db10 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f905186e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0d13a0 con 0x7f904c159c60 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f905186e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c15e140 con 0x7f904c159890 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904a7fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f904c159c60 0x7f904c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f904c15db10 0x7f904c069560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36844/0 (socket says 172.21.15.22:36844) 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904b7fe700 1 -- 172.21.15.22:0/1173600295 learned_addr learned my addr 172.21.15.22:0/1173600295 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904affd700 1 --2- 172.21.15.22:0/1173600295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159890 0x7f904c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904a7fc700 1 -- 172.21.15.22:0/1173600295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159890 msgr2=0x7f904c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904a7fc700 1 --2- 172.21.15.22:0/1173600295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159890 0x7f904c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904a7fc700 1 -- 172.21.15.22:0/1173600295 >> v1:172.21.15.22:6789/0 conn(0x7f904c15db10 legacy=0x7f904c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904a7fc700 1 -- 172.21.15.22:0/1173600295 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c15a3d0 con 0x7f904c159c60 2023-10-08T00:36:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f9049ffb700 1 -- 172.21.15.22:0/1173600295 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101200591 0 0) 0x7f904c15a160 con 0x7f904c15db10 2023-10-08T00:36:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f904a7fc700 1 --2- 172.21.15.22:0/1173600295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c159c60 0x7f904c15d5d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f90340098e0 tx=0x7f90340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12c9899e8fd5b62 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.612+0000 7f9049ffb700 1 -- 172.21.15.22:0/1173600295 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034009e80 con 0x7f904c159c60 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f9049ffb700 1 -- 172.21.15.22:0/1173600295 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903400b860 con 0x7f904c159c60 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f9049ffb700 1 -- 172.21.15.22:0/1173600295 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400bbe0 con 0x7f904c159c60 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 -- 172.21.15.22:0/1173600295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c159c60 msgr2=0x7f904c15d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 --2- 172.21.15.22:0/1173600295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c159c60 0x7f904c15d5d0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f90340098e0 tx=0x7f90340091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 -- 172.21.15.22:0/1173600295 shutdown_connections 2023-10-08T00:36:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 --2- 172.21.15.22:0/1173600295 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159890 0x7f904c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 --2- 172.21.15.22:0/1173600295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c159c60 0x7f904c15d5d0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 -- 172.21.15.22:0/1173600295 >> 172.21.15.22:0/1173600295 conn(0x7f904c068e20 msgr2=0x7f904c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 -- 172.21.15.22:0/1173600295 shutdown_connections 2023-10-08T00:36:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.613+0000 7f905186e700 1 -- 172.21.15.22:0/1173600295 wait complete. 2023-10-08T00:36:48.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.614+0000 7f905186e700 1 Processor -- start 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.614+0000 7f905186e700 1 -- start start 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f905186e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f904c159890 0x7f904c149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f905186e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159c60 0x7f904c149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f905186e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 0x7f904c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f905186e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0b1760 con 0x7f904c15db10 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f905186e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c1520f0 con 0x7f904c159890 2023-10-08T00:36:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f905186e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c151e10 con 0x7f904c159c60 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f904b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 0x7f904c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f904b7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 0x7f904c0b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42278/0 (socket says 172.21.15.22:42278) 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f904b7fe700 1 -- 172.21.15.22:0/144488606 learned_addr learned my addr 172.21.15.22:0/144488606 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f904affd700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f904c159890 0x7f904c149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.615+0000 7f904a7fc700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159c60 0x7f904c149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f904b7fe700 1 -- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159c60 msgr2=0x7f904c149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f904b7fe700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159c60 0x7f904c149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f904b7fe700 1 -- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f904c159890 msgr2=0x7f904c149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f904b7fe700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f904c159890 0x7f904c149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f904b7fe700 1 -- 172.21.15.22:0/144488606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9034009420 con 0x7f904c15db10 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f904b7fe700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 0x7f904c0b3590 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c4f0 tx=0x7f903c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00cea0 con 0x7f904c15db10 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c005b30 con 0x7f904c15db10 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c0b1110 con 0x7f904c15db10 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0070d0 con 0x7f904c15db10 2023-10-08T00:36:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.616+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0b1bf0 con 0x7f904c15db10 2023-10-08T00:36:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.617+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c0b18d0 con 0x7f904c15db10 2023-10-08T00:36:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.617+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f903c007500 con 0x7f904c15db10 2023-10-08T00:36:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.618+0000 7f9042ffd700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f902c067320 0x7f902c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.618+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f903c083d80 con 0x7f904c15db10 2023-10-08T00:36:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.618+0000 7f904affd700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f902c067320 0x7f902c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.619+0000 7f904affd700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f902c067320 0x7f902c0697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9044009fd0 tx=0x7f9044009880 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.622+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f903c050c80 con 0x7f904c15db10 2023-10-08T00:36:48.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.816+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f904c0b0f90 con 0x7f902c067320 2023-10-08T00:36:48.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.816+0000 7f9042ffd700 1 -- 172.21.15.22:0/144488606 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9044017430 con 0x7f902c067320 2023-10-08T00:36:48.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f902c067320 msgr2=0x7f902c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f902c067320 0x7f902c0697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9044009fd0 tx=0x7f9044009880 comp rx=0 tx=0).stop 2023-10-08T00:36:48.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 msgr2=0x7f904c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 0x7f904c0b3590 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c4f0 tx=0x7f903c007f50 comp rx=0 tx=0).stop 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 shutdown_connections 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f904c15db10 0x7f904c0b3590 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f904c159890 0x7f904c149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f902c067320 0x7f902c0697d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 --2- 172.21.15.22:0/144488606 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f904c159c60 0x7f904c149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 >> 172.21.15.22:0/144488606 conn(0x7f904c068e20 msgr2=0x7f904c154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 shutdown_connections 2023-10-08T00:36:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.818+0000 7f905186e700 1 -- 172.21.15.22:0/144488606 wait complete. 2023-10-08T00:36:48.822 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T00:36:48.832 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T00:36:48.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:48.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.953+0000 7f45f759e700 1 Processor -- start 2023-10-08T00:36:48.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.953+0000 7f45f759e700 1 -- start start 2023-10-08T00:36:48.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f45f80b03c0 0x7f45f80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f81591e0 0x7f45f8159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f80cfa00 con 0x7f45f80b0790 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f759e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f80cb580 con 0x7f45f80b03c0 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80cf160 con 0x7f45f81591e0 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f45f80b03c0 0x7f45f80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f45f80b03c0 0x7f45f80cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42288/0 (socket says 172.21.15.22:42288) 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.954+0000 7f45f659c700 1 -- 172.21.15.22:0/3733241549 learned_addr learned my addr 172.21.15.22:0/3733241549 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f6d9d700 1 --2- 172.21.15.22:0/3733241549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f81591e0 0x7f45f8159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f659c700 1 -- 172.21.15.22:0/3733241549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f81591e0 msgr2=0x7f45f8159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f659c700 1 --2- 172.21.15.22:0/3733241549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f81591e0 0x7f45f8159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f659c700 1 -- 172.21.15.22:0/3733241549 >> v1:172.21.15.192:6789/0 conn(0x7f45f80b0790 legacy=0x7f45f80b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f659c700 1 -- 172.21.15.22:0/3733241549 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80cf440 con 0x7f45f80b03c0 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f659c700 1 --2- 172.21.15.22:0/3733241549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f80b03c0 0x7f45f80cea70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f45f00099e0 tx=0x7f45f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97bfe6e710dd913 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f559a700 1 -- 172.21.15.22:0/3733241549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000b7e0 con 0x7f45f80b03c0 2023-10-08T00:36:48.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f559a700 1 -- 172.21.15.22:0/3733241549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f000b940 con 0x7f45f80b03c0 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f559a700 1 -- 172.21.15.22:0/3733241549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f000bce0 con 0x7f45f80b03c0 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f759e700 1 -- 172.21.15.22:0/3733241549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f80b03c0 msgr2=0x7f45f80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.955+0000 7f45f759e700 1 --2- 172.21.15.22:0/3733241549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f80b03c0 0x7f45f80cea70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f45f00099e0 tx=0x7f45f0009250 comp rx=0 tx=0).stop 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.956+0000 7f45f759e700 1 -- 172.21.15.22:0/3733241549 shutdown_connections 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.956+0000 7f45f759e700 1 --2- 172.21.15.22:0/3733241549 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f81591e0 0x7f45f8159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.956+0000 7f45f759e700 1 --2- 172.21.15.22:0/3733241549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f80b03c0 0x7f45f80cea70 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.956+0000 7f45f759e700 1 -- 172.21.15.22:0/3733241549 >> 172.21.15.22:0/3733241549 conn(0x7f45f8063230 msgr2=0x7f45f8063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.956+0000 7f45f759e700 1 -- 172.21.15.22:0/3733241549 shutdown_connections 2023-10-08T00:36:48.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.956+0000 7f45f759e700 1 -- 172.21.15.22:0/3733241549 wait complete. 2023-10-08T00:36:48.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 Processor -- start 2023-10-08T00:36:48.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 -- start start 2023-10-08T00:36:48.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f80b03c0 0x7f45f80c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45f80b0790 0x7f45f815c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f81591e0 0x7f45f80c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f815da00 con 0x7f45f81591e0 2023-10-08T00:36:48.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f815c540 con 0x7f45f80b0790 2023-10-08T00:36:48.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.957+0000 7f45f759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80c8180 con 0x7f45f80b03c0 2023-10-08T00:36:48.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f81591e0 0x7f45f80c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f81591e0 0x7f45f80c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42298/0 (socket says 172.21.15.22:42298) 2023-10-08T00:36:48.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 -- 172.21.15.22:0/435959496 learned_addr learned my addr 172.21.15.22:0/435959496 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:48.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f659c700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f80b03c0 0x7f45f80c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f5d9b700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45f80b0790 0x7f45f815c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 -- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f80b03c0 msgr2=0x7f45f80c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f45f80b03c0 0x7f45f80c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 -- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45f80b0790 msgr2=0x7f45f815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45f80b0790 0x7f45f815c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 -- 172.21.15.22:0/435959496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00094f0 con 0x7f45f81591e0 2023-10-08T00:36:48.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f5d9b700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45f80b0790 0x7f45f815c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f6d9d700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f81591e0 0x7f45f80c8a00 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f45e800ceb0 tx=0x7f45e8007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e800ae40 con 0x7f45f81591e0 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8016430 con 0x7f45f81591e0 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80167d0 con 0x7f45f81591e0 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f80c8460 con 0x7f45f81591e0 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.958+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f815c1d0 con 0x7f45f81591e0 2023-10-08T00:36:48.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.959+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45f815bd50 con 0x7f45f81591e0 2023-10-08T00:36:48.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f45e8003020 con 0x7f45f81591e0 2023-10-08T00:36:48.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45ee7fc700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45d8067320 0x7f45d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f45e8012070 con 0x7f45f81591e0 2023-10-08T00:36:48.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45ee7fc700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f45d806d170 0x7f45d806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:48.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 --> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45d806fc50 con 0x7f45d806d170 2023-10-08T00:36:48.969 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45e8087c80 con 0x7f45f81591e0 2023-10-08T00:36:48.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45f659c700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45d8067320 0x7f45d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.960+0000 7f45f5d9b700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f45d806d170 0x7f45d806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:48.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.961+0000 7f45f659c700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45d8067320 0x7f45d80697d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f45f00099e0 tx=0x7f45f0016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.961+0000 7f45f5d9b700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f45d806d170 0x7f45d806f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:48.970 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.962+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== osd.4 v2:172.21.15.192:6814/91118 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f45d806fc50 con 0x7f45d806d170 2023-10-08T00:36:48.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.975+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 --> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45f804c3c0 con 0x7f45d806d170 2023-10-08T00:36:48.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45ee7fc700 1 -- 172.21.15.22:0/435959496 <== osd.4 v2:172.21.15.192:6814/91118 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45f804c3c0 con 0x7f45d806d170 2023-10-08T00:36:48.978 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:48.978 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:48.978 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:48.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f45d806d170 msgr2=0x7f45d806f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6814/91118,v1:172.21.15.192:6816/91118] conn(0x7f45d806d170 0x7f45d806f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:48.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45d8067320 msgr2=0x7f45d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f45d8067320 0x7f45d80697d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f45f00099e0 tx=0x7f45f0016000 comp rx=0 tx=0).stop 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f81591e0 msgr2=0x7f45f80c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 --2- 172.21.15.22:0/435959496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45f81591e0 0x7f45f80c8a00 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f45e800ceb0 tx=0x7f45e8007870 comp rx=0 tx=0).stop 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f6d9d700 1 -- 172.21.15.22:0/435959496 reap_dead start 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 shutdown_connections 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 >> 172.21.15.22:0/435959496 conn(0x7f45f8063230 msgr2=0x7f45f80cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.976+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 shutdown_connections 2023-10-08T00:36:48.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:48.977+0000 7f45f759e700 1 -- 172.21.15.22:0/435959496 wait complete. 2023-10-08T00:36:48.989 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T00:36:49.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.107+0000 7fe14821e700 1 Processor -- start 2023-10-08T00:36:49.109 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.108+0000 7fe14821e700 1 -- start start 2023-10-08T00:36:49.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.108+0000 7fe14821e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe14015abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.108+0000 7fe14821e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 0x7fe1400699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.111 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.108+0000 7fe14821e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14015a160 con 0x7fe140159c60 2023-10-08T00:36:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe14821e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe140069f20 con 0x7fe140069560 2023-10-08T00:36:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe14821e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400d13a0 con 0x7fe140159890 2023-10-08T00:36:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe1467bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 0x7fe1400699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe145fba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe14015abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe1467bb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 0x7fe1400699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.22:41366/0 (socket says 172.21.15.22:41366) 2023-10-08T00:36:49.112 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe145fba700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe14015abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.22:57304/0 (socket says 172.21.15.22:57304) 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe1467bb700 1 -- 172.21.15.22:0/1959106830 learned_addr learned my addr 172.21.15.22:0/1959106830 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe1457b9700 1 --1- 172.21.15.22:0/1959106830 >> v1:172.21.15.192:6789/0 conn(0x7fe140159c60 0x7fe14015d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.22:35186/0 (socket says 172.21.15.22:35186) 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe145fba700 1 -- 172.21.15.22:0/1959106830 >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 msgr2=0x7fe1400699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe145fba700 1 --2- 172.21.15.22:0/1959106830 >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 0x7fe1400699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe145fba700 1 -- 172.21.15.22:0/1959106830 >> v1:172.21.15.192:6789/0 conn(0x7fe140159c60 legacy=0x7fe14015d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe145fba700 1 -- 172.21.15.22:0/1959106830 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14015e140 con 0x7fe140159890 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.109+0000 7fe1467bb700 1 --2- 172.21.15.22:0/1959106830 >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 0x7fe1400699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:36:49.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe145fba700 1 --2- 172.21.15.22:0/1959106830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe14015abd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe138009e60 tx=0x7fe138009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=492168a1bc3434cb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe144fb8700 1 -- 172.21.15.22:0/1959106830 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800e070 con 0x7fe140159890 2023-10-08T00:36:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe144fb8700 1 -- 172.21.15.22:0/1959106830 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800bb60 con 0x7fe140159890 2023-10-08T00:36:49.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe144fb8700 1 -- 172.21.15.22:0/1959106830 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138012430 con 0x7fe140159890 2023-10-08T00:36:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 -- 172.21.15.22:0/1959106830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 msgr2=0x7fe14015abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 --2- 172.21.15.22:0/1959106830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe14015abd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe138009e60 tx=0x7fe138009780 comp rx=0 tx=0).stop 2023-10-08T00:36:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 -- 172.21.15.22:0/1959106830 shutdown_connections 2023-10-08T00:36:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 --2- 172.21.15.22:0/1959106830 >> v2:172.21.15.192:3300/0 conn(0x7fe140069560 0x7fe1400699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 --2- 172.21.15.22:0/1959106830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe14015abd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.117 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 -- 172.21.15.22:0/1959106830 >> 172.21.15.22:0/1959106830 conn(0x7fe140068e20 msgr2=0x7fe1400d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 -- 172.21.15.22:0/1959106830 shutdown_connections 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.110+0000 7fe14821e700 1 -- 172.21.15.22:0/1959106830 wait complete. 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.111+0000 7fe14821e700 1 Processor -- start 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.111+0000 7fe14821e700 1 -- start start 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe14821e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe140069560 0x7fe1400b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe14821e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe1400c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe14821e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 0x7fe140169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe14821e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b3a50 con 0x7fe140159c60 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe14821e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b3d30 con 0x7fe140069560 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe14821e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1400b4010 con 0x7fe140159890 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe1467bb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 0x7fe140169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe1467bb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 0x7fe140169fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42314/0 (socket says 172.21.15.22:42314) 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe1467bb700 1 -- 172.21.15.22:0/3326189686 learned_addr learned my addr 172.21.15.22:0/3326189686 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:49.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe145fba700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe140069560 0x7fe1400b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.112+0000 7fe1457b9700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe1400c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe1467bb700 1 -- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 msgr2=0x7fe1400c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe1467bb700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe1400c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe1467bb700 1 -- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe140069560 msgr2=0x7fe1400b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe1467bb700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe140069560 0x7fe1400b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe1467bb700 1 -- 172.21.15.22:0/3326189686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1300094f0 con 0x7fe140159c60 2023-10-08T00:36:49.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe1467bb700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 0x7fe140169fa0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fe13000ea40 tx=0x7fe130009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000ee80 con 0x7fe140159c60 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13000c850 con 0x7fe140159c60 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe138009a20 con 0x7fe140159c60 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000cbf0 con 0x7fe140159c60 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.113+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1400b45d0 con 0x7fe140159c60 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.114+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1400b47f0 con 0x7fe140159c60 2023-10-08T00:36:49.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.115+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe13000cd50 con 0x7fe140159c60 2023-10-08T00:36:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.115+0000 7fe13dffb700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe12c067320 0x7fe12c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.115+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe130084ab0 con 0x7fe140159c60 2023-10-08T00:36:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.115+0000 7fe145fba700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe12c067320 0x7fe12c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.116+0000 7fe145fba700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe12c067320 0x7fe12c0697d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe1380097c0 tx=0x7fe138019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.123 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.119+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe130051a40 con 0x7fe140159c60 2023-10-08T00:36:49.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.314+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe14004c3c0 con 0x7fe12c067320 2023-10-08T00:36:49.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.316+0000 7fe13dffb700 1 -- 172.21.15.22:0/3326189686 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe14004c3c0 con 0x7fe12c067320 2023-10-08T00:36:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe12c067320 msgr2=0x7fe12c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe12c067320 0x7fe12c0697d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe1380097c0 tx=0x7fe138019000 comp rx=0 tx=0).stop 2023-10-08T00:36:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 msgr2=0x7fe140169fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 0x7fe140169fa0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fe13000ea40 tx=0x7fe130009250 comp rx=0 tx=0).stop 2023-10-08T00:36:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 shutdown_connections 2023-10-08T00:36:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe140159c60 0x7fe140169fa0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe140069560 0x7fe1400b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fe12c067320 0x7fe12c0697d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 --2- 172.21.15.22:0/3326189686 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fe140159890 0x7fe1400c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 >> 172.21.15.22:0/3326189686 conn(0x7fe140068e20 msgr2=0x7fe140158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 shutdown_connections 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.317+0000 7fe14821e700 1 -- 172.21.15.22:0/3326189686 wait complete. 2023-10-08T00:36:49.320 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T00:36:49.330 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T00:36:49.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.452+0000 7f5df6ed7700 1 Processor -- start 2023-10-08T00:36:49.454 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.452+0000 7f5df6ed7700 1 -- start start 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5df6ed7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5df00cd910 0x7f5df00ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5df6ed7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5df00b55a0 0x7f5df00ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5df6ed7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00b5b00 con 0x7f5df0159ec0 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5df6ed7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00b5da0 con 0x7f5df00cd910 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5df6ed7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00b6080 con 0x7f5df00b55a0 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5df00cd910 0x7f5df00ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5df00cd910 0x7f5df00ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42318/0 (socket says 172.21.15.22:42318) 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 -- 172.21.15.22:0/1822281554 learned_addr learned my addr 172.21.15.22:0/1822281554 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5df5474700 1 --2- 172.21.15.22:0/1822281554 >> v2:172.21.15.192:3300/0 conn(0x7f5df00b55a0 0x7f5df00ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 -- 172.21.15.22:0/1822281554 >> v2:172.21.15.192:3300/0 conn(0x7f5df00b55a0 msgr2=0x7f5df00ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 --2- 172.21.15.22:0/1822281554 >> v2:172.21.15.192:3300/0 conn(0x7f5df00b55a0 0x7f5df00ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 -- 172.21.15.22:0/1822281554 >> v1:172.21.15.192:6789/0 conn(0x7f5df0159ec0 legacy=0x7f5df00b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 -- 172.21.15.22:0/1822281554 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00cc100 con 0x7f5df00cd910 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5deffff700 1 --2- 172.21.15.22:0/1822281554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00cd910 0x7f5df00ce340 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f5de00099b0 tx=0x7f5de0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fb6a1ba3fa1a2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5def7fe700 1 -- 172.21.15.22:0/1822281554 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0009ea0 con 0x7f5df00cd910 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5def7fe700 1 -- 172.21.15.22:0/1822281554 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000b820 con 0x7f5df00cd910 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.453+0000 7f5def7fe700 1 -- 172.21.15.22:0/1822281554 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000bbc0 con 0x7f5df00cd910 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 -- 172.21.15.22:0/1822281554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00cd910 msgr2=0x7f5df00ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 --2- 172.21.15.22:0/1822281554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00cd910 0x7f5df00ce340 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f5de00099b0 tx=0x7f5de0009250 comp rx=0 tx=0).stop 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 -- 172.21.15.22:0/1822281554 shutdown_connections 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 --2- 172.21.15.22:0/1822281554 >> v2:172.21.15.192:3300/0 conn(0x7f5df00b55a0 0x7f5df00ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 --2- 172.21.15.22:0/1822281554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00cd910 0x7f5df00ce340 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 -- 172.21.15.22:0/1822281554 >> 172.21.15.22:0/1822281554 conn(0x7f5df00999f0 msgr2=0x7f5df00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 -- 172.21.15.22:0/1822281554 shutdown_connections 2023-10-08T00:36:49.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.454+0000 7f5df6ed7700 1 -- 172.21.15.22:0/1822281554 wait complete. 2023-10-08T00:36:49.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.455+0000 7f5df6ed7700 1 Processor -- start 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.455+0000 7f5df6ed7700 1 -- start start 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df6ed7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00b55a0 0x7f5df01448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df6ed7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5df0159ec0 0x7f5df01451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df6ed7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5df01456e0 0x7f5df009a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df6ed7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00ad940 con 0x7f5df00b55a0 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df6ed7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df0145b80 con 0x7f5df0159ec0 2023-10-08T00:36:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df6ed7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df009c220 con 0x7f5df01456e0 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00b55a0 0x7f5df01448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00b55a0 0x7f5df01448f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42324/0 (socket says 172.21.15.22:42324) 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 -- 172.21.15.22:0/2591162161 learned_addr learned my addr 172.21.15.22:0/2591162161 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5deffff700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5df0159ec0 0x7f5df01451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 -- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5df01456e0 msgr2=0x7f5df009a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df5474700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5df01456e0 0x7f5df009a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5df01456e0 0x7f5df009a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 -- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5df0159ec0 msgr2=0x7f5df01451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5df0159ec0 0x7f5df01451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5df4c73700 1 -- 172.21.15.22:0/2591162161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de00094f0 con 0x7f5df00b55a0 2023-10-08T00:36:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.456+0000 7f5deffff700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5df0159ec0 0x7f5df01451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5df4c73700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00b55a0 0x7f5df01448f0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c7f0 tx=0x7f5dd8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011590 con 0x7f5df00b55a0 2023-10-08T00:36:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8011710 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df009b610 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8011ad0 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df009bbd0 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.457+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5df0063c90 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.458+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5dd801b3b0 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5decff9700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dd0067320 0x7f5dd00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5dd80845b0 con 0x7f5df00b55a0 2023-10-08T00:36:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5decff9700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f5dd006d170 0x7f5dd006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 --> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dd006fc50 con 0x7f5dd006d170 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dd8084850 con 0x7f5df00b55a0 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5deffff700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dd0067320 0x7f5dd00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5df5474700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f5dd006d170 0x7f5dd006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5deffff700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dd0067320 0x7f5dd00697d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5de00099b0 tx=0x7f5de0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.459+0000 7f5df5474700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f5dd006d170 0x7f5dd006f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.460+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== osd.5 v2:172.21.15.192:6824/91131 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5dd006fc50 con 0x7f5dd006d170 2023-10-08T00:36:49.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.474+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 --> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5df00718b0 con 0x7f5dd006d170 2023-10-08T00:36:49.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.474+0000 7f5decff9700 1 -- 172.21.15.22:0/2591162161 <== osd.5 v2:172.21.15.192:6824/91131 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5df00718b0 con 0x7f5dd006d170 2023-10-08T00:36:49.476 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:49.476 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:49.476 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f5dd006d170 msgr2=0x7f5dd006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.477 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6824/91131,v1:172.21.15.192:6825/91131] conn(0x7f5dd006d170 0x7f5dd006f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dd0067320 msgr2=0x7f5dd00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5dd0067320 0x7f5dd00697d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f5de00099b0 tx=0x7f5de0017000 comp rx=0 tx=0).stop 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00b55a0 msgr2=0x7f5df01448f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 --2- 172.21.15.22:0/2591162161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5df00b55a0 0x7f5df01448f0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800c7f0 tx=0x7f5dd8007f70 comp rx=0 tx=0).stop 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df5474700 1 -- 172.21.15.22:0/2591162161 reap_dead start 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 shutdown_connections 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 >> 172.21.15.22:0/2591162161 conn(0x7f5df00999f0 msgr2=0x7f5df00c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 shutdown_connections 2023-10-08T00:36:49.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.475+0000 7f5df6ed7700 1 -- 172.21.15.22:0/2591162161 wait complete. 2023-10-08T00:36:49.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T00:36:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.606+0000 7f5fa10e7700 1 Processor -- start 2023-10-08T00:36:49.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.606+0000 7f5fa10e7700 1 -- start start 2023-10-08T00:36:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5fa10e7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f9c159c60 0x7f5f9c15d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5fa10e7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 0x7f5f9c069560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5fa10e7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c15a160 con 0x7f5f9c159890 2023-10-08T00:36:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5fa10e7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c15df50 con 0x7f5f9c159c60 2023-10-08T00:36:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5fa10e7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0d13a0 con 0x7f5f9c15db10 2023-10-08T00:36:49.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5f9ad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5f9c159890 0x7f5f9c15abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36852/0 (socket says 172.21.15.22:36852) 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.607+0000 7f5f9ad9d700 1 -- 172.21.15.22:0/2053465944 learned_addr learned my addr 172.21.15.22:0/2053465944 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9a59c700 1 --2- 172.21.15.22:0/2053465944 >> v2:172.21.15.192:3300/0 conn(0x7f5f9c159c60 0x7f5f9c15d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9b59e700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 0x7f5f9c069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722403695 0 0) 0x7f5f9c15a160 con 0x7f5f9c159890 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f88003570 con 0x7f5f9c159890 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2692307559 0 0) 0x7f5f88003570 con 0x7f5f9c159890 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 msgr2=0x7f5f9c069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 0x7f5f9c069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 >> v2:172.21.15.192:3300/0 conn(0x7f5f9c159c60 msgr2=0x7f5f9c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 --2- 172.21.15.22:0/2053465944 >> v2:172.21.15.192:3300/0 conn(0x7f5f9c159c60 0x7f5f9c15d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c15e140 con 0x7f5f9c159890 2023-10-08T00:36:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f5f8c001470 con 0x7f5f9c159890 2023-10-08T00:36:49.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 >> v1:172.21.15.22:6789/0 conn(0x7f5f9c159890 legacy=0x7f5f9c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f88003a60 0x7f5f88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 0x7f5f88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f88004d50 0x7f5f880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0d13a0 con 0x7f5f88003a60 2023-10-08T00:36:49.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800ba60 con 0x7f5f88004d50 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8800bba0 con 0x7f5f9c15db10 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f88003a60 0x7f5f88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9a59c700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 0x7f5f88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9b59e700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f88004d50 0x7f5f880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9ad9d700 1 -- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 msgr2=0x7f5f88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f9c15db10 0x7f5f88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.608+0000 7f5f9ad9d700 1 -- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f88004d50 msgr2=0x7f5f880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f88004d50 0x7f5f880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f9ad9d700 1 -- 172.21.15.22:0/2053465944 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88003570 con 0x7f5f88003a60 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f88003a60 0x7f5f88003e70 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c3c0 tx=0x7f5f8c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddd39e8f696b14a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00cc30 con 0x7f5f88003a60 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00cdb0 con 0x7f5f88003a60 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f99d9b700 1 -- 172.21.15.22:0/2053465944 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c005b70 con 0x7f5f88003a60 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5fa10e7700 1 -- 172.21.15.22:0/2053465944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f88003a60 msgr2=0x7f5f88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/2053465944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f88003a60 0x7f5f88003e70 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c3c0 tx=0x7f5f8c001e90 comp rx=0 tx=0).stop 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5f9b59e700 1 -- 172.21.15.22:0/2053465944 reap_dead start 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5fa10e7700 1 -- 172.21.15.22:0/2053465944 shutdown_connections 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5fa10e7700 1 -- 172.21.15.22:0/2053465944 >> 172.21.15.22:0/2053465944 conn(0x7f5f9c068e20 msgr2=0x7f5f9c0d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5fa10e7700 1 -- 172.21.15.22:0/2053465944 shutdown_connections 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.609+0000 7f5fa10e7700 1 -- 172.21.15.22:0/2053465944 wait complete. 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 Processor -- start 2023-10-08T00:36:49.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 -- start start 2023-10-08T00:36:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f88003a60 0x7f5f9c0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f9c15bfb0 0x7f5f9c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 0x7f5f9c152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c1526d0 con 0x7f5f9c151d20 2023-10-08T00:36:49.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c16bfc0 con 0x7f5f9c15bfb0 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5fa10e7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0b4550 con 0x7f5f88003a60 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.611+0000 7f5f9b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 0x7f5f9c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 0x7f5f9c152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42342/0 (socket says 172.21.15.22:42342) 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 -- 172.21.15.22:0/1549275050 learned_addr learned my addr 172.21.15.22:0/1549275050 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9a59c700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f9c15bfb0 0x7f5f9c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f88003a60 0x7f5f9c0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.622 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 -- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f88003a60 msgr2=0x7f5f9c0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f88003a60 0x7f5f9c0b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 -- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f9c15bfb0 msgr2=0x7f5f9c148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f9c15bfb0 0x7f5f9c148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 -- 172.21.15.22:0/1549275050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c1496b0 con 0x7f5f9c151d20 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9a59c700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f9c15bfb0 0x7f5f9c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f88003a60 0x7f5f9c0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:49.623 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f9b59e700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 0x7f5f9c152190 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f5f940094d0 tx=0x7f5f9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400e040 con 0x7f5f9c151d20 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400f040 con 0x7f5f9c151d20 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400fe50 con 0x7f5f9c151d20 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c16b3b0 con 0x7f5f9c151d20 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.612+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c16b970 con 0x7f5f9c151d20 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.613+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c16c170 con 0x7f5f9c151d20 2023-10-08T00:36:49.624 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.614+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5f94015640 con 0x7f5f9c151d20 2023-10-08T00:36:49.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.614+0000 7f5f92ffd700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f7c067320 0x7f5f7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.614+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5f94085410 con 0x7f5f9c151d20 2023-10-08T00:36:49.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.614+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f7c067320 0x7f5f7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.615+0000 7f5f9ad9d700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f7c067320 0x7f5f7c0697d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c001ed0 tx=0x7f5f8c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.625 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.618+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f9c16c170 con 0x7f5f9c151d20 2023-10-08T00:36:49.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.816+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f9c159150 con 0x7f5f7c067320 2023-10-08T00:36:49.818 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.816+0000 7f5f92ffd700 1 -- 172.21.15.22:0/1549275050 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5f9c159150 con 0x7f5f7c067320 2023-10-08T00:36:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f7c067320 msgr2=0x7f5f7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f7c067320 0x7f5f7c0697d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c001ed0 tx=0x7f5f8c015000 comp rx=0 tx=0).stop 2023-10-08T00:36:49.820 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 msgr2=0x7f5f9c152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 0x7f5f9c152190 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f5f940094d0 tx=0x7f5f9400b040 comp rx=0 tx=0).stop 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 shutdown_connections 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f9c151d20 0x7f5f9c152190 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f5f7c067320 0x7f5f7c0697d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f5f88003a60 0x7f5f9c0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 --2- 172.21.15.22:0/1549275050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f9c15bfb0 0x7f5f9c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 >> 172.21.15.22:0/1549275050 conn(0x7f5f9c068e20 msgr2=0x7f5f9c154d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.821 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 shutdown_connections 2023-10-08T00:36:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.819+0000 7f5fa10e7700 1 -- 172.21.15.22:0/1549275050 wait complete. 2023-10-08T00:36:49.822 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T00:36:49.832 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T00:36:49.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:49.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.954+0000 7f9eef5de700 1 Processor -- start 2023-10-08T00:36:49.955 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.954+0000 7f9eef5de700 1 -- start start 2023-10-08T00:36:49.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eef5de700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9ee80cd910 0x7f9ee80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eef5de700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee80b5b00 con 0x7f9ee8159ec0 2023-10-08T00:36:49.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eef5de700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee80b5da0 con 0x7f9ee80b55a0 2023-10-08T00:36:49.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eef5de700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee80b6080 con 0x7f9ee80cd910 2023-10-08T00:36:49.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eecb79700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9ee80cd910 0x7f9ee80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eed37a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9ee8159ec0 0x7f9ee80b4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36856/0 (socket says 172.21.15.22:36856) 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eecb79700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9ee80cd910 0x7f9ee80ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42348/0 (socket says 172.21.15.22:42348) 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eed37a700 1 -- 172.21.15.22:0/1244186311 learned_addr learned my addr 172.21.15.22:0/1244186311 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eecb79700 1 -- 172.21.15.22:0/1244186311 >> v1:172.21.15.192:6789/0 conn(0x7f9ee80b55a0 legacy=0x7f9ee80ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eecb79700 1 -- 172.21.15.22:0/1244186311 >> v1:172.21.15.22:6789/0 conn(0x7f9ee8159ec0 legacy=0x7f9ee80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9edffff700 1 -- 172.21.15.22:0/1244186311 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172997520 0 0) 0x7f9ee80b5b00 con 0x7f9ee8159ec0 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eecb79700 1 -- 172.21.15.22:0/1244186311 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80cc100 con 0x7f9ee80cd910 2023-10-08T00:36:49.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9eecb79700 1 --2- 172.21.15.22:0/1244186311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee80cd910 0x7f9ee80ce340 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009910 tx=0x7f9ed80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931007adb692a4b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.955+0000 7f9edffff700 1 -- 172.21.15.22:0/1244186311 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800b7e0 con 0x7f9ee80cd910 2023-10-08T00:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9edffff700 1 -- 172.21.15.22:0/1244186311 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed800b940 con 0x7f9ee80cd910 2023-10-08T00:36:49.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9edffff700 1 -- 172.21.15.22:0/1244186311 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800bce0 con 0x7f9ee80cd910 2023-10-08T00:36:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 -- 172.21.15.22:0/1244186311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee80cd910 msgr2=0x7f9ee80ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 --2- 172.21.15.22:0/1244186311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee80cd910 0x7f9ee80ce340 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009910 tx=0x7f9ed80091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 -- 172.21.15.22:0/1244186311 shutdown_connections 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 --2- 172.21.15.22:0/1244186311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee80cd910 0x7f9ee80ce340 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 -- 172.21.15.22:0/1244186311 >> 172.21.15.22:0/1244186311 conn(0x7f9ee80999f0 msgr2=0x7f9ee80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 -- 172.21.15.22:0/1244186311 shutdown_connections 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.956+0000 7f9eef5de700 1 -- 172.21.15.22:0/1244186311 wait complete. 2023-10-08T00:36:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.957+0000 7f9eef5de700 1 Processor -- start 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.957+0000 7f9eef5de700 1 -- start start 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eef5de700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ee80b55a0 0x7f9ee8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eef5de700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ee8159ec0 0x7f9ee813e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eef5de700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee8158de0 0x7f9ee80c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eef5de700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81566c0 con 0x7f9ee8158de0 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eef5de700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8158020 con 0x7f9ee8159ec0 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eef5de700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8158300 con 0x7f9ee80b55a0 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee8158de0 0x7f9ee80c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee8158de0 0x7f9ee80c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42364/0 (socket says 172.21.15.22:42364) 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 -- 172.21.15.22:0/1799057850 learned_addr learned my addr 172.21.15.22:0/1799057850 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eecb79700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ee8159ec0 0x7f9ee813e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 -- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ee80b55a0 msgr2=0x7f9ee8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eed37a700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ee80b55a0 0x7f9ee8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f9ee80b55a0 0x7f9ee8156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 -- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ee8159ec0 msgr2=0x7f9ee813e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.958+0000 7f9eedb7b700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ee8159ec0 0x7f9ee813e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9eedb7b700 1 -- 172.21.15.22:0/1799057850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009420 con 0x7f9ee8158de0 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9eecb79700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ee8159ec0 0x7f9ee813e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9eedb7b700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee8158de0 0x7f9ee80c6800 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000bc30 tx=0x7f9ee0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000c9b0 con 0x7f9ee8158de0 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000cb50 con 0x7f9ee8158de0 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee81585e0 con 0x7f9ee8158de0 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0014410 con 0x7f9ee8158de0 2023-10-08T00:36:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.959+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee813ec10 con 0x7f9ee8158de0 2023-10-08T00:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.960+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ee8063c90 con 0x7f9ee8158de0 2023-10-08T00:36:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.960+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9ee0014800 con 0x7f9ee8158de0 2023-10-08T00:36:49.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9edd7fa700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ecc067320 0x7f9ecc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9ee0084aa0 con 0x7f9ee8158de0 2023-10-08T00:36:49.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9edd7fa700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7f9ecc06d170 0x7f9ecc06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:49.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 --> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ecc06fc50 con 0x7f9ecc06d170 2023-10-08T00:36:49.967 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee0089220 con 0x7f9ee8158de0 2023-10-08T00:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9eed37a700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ecc067320 0x7f9ecc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9eecb79700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7f9ecc06d170 0x7f9ecc06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9eed37a700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ecc067320 0x7f9ecc0697d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40017d0 tx=0x7f9ee4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.961+0000 7f9eecb79700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7f9ecc06d170 0x7f9ecc06f580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:49.968 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.962+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== osd.6 v2:172.21.15.192:6802/91119 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9ecc06fc50 con 0x7f9ecc06d170 2023-10-08T00:36:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.976+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 --> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ee80718b0 con 0x7f9ecc06d170 2023-10-08T00:36:49.978 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.976+0000 7f9edd7fa700 1 -- 172.21.15.22:0/1799057850 <== osd.6 v2:172.21.15.192:6802/91119 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9ee80718b0 con 0x7f9ecc06d170 2023-10-08T00:36:49.978 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:49.978 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:49.979 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:49.979 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7f9ecc06d170 msgr2=0x7f9ecc06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6802/91119,v1:172.21.15.192:6804/91119] conn(0x7f9ecc06d170 0x7f9ecc06f580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ecc067320 msgr2=0x7f9ecc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f9ecc067320 0x7f9ecc0697d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40017d0 tx=0x7f9ee4009040 comp rx=0 tx=0).stop 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee8158de0 msgr2=0x7f9ee80c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 --2- 172.21.15.22:0/1799057850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ee8158de0 0x7f9ee80c6800 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000bc30 tx=0x7f9ee0009820 comp rx=0 tx=0).stop 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eedb7b700 1 -- 172.21.15.22:0/1799057850 reap_dead start 2023-10-08T00:36:49.980 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 shutdown_connections 2023-10-08T00:36:49.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 >> 172.21.15.22:0/1799057850 conn(0x7f9ee80999f0 msgr2=0x7f9ee8151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:49.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 shutdown_connections 2023-10-08T00:36:49.981 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:49.977+0000 7f9eef5de700 1 -- 172.21.15.22:0/1799057850 wait complete. 2023-10-08T00:36:49.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T00:36:50.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.108+0000 7f1b006d3700 1 Processor -- start 2023-10-08T00:36:50.110 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.109+0000 7f1b006d3700 1 -- start start 2023-10-08T00:36:50.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.109+0000 7f1b006d3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1af806bcd0 0x7f1af80caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.109+0000 7f1b006d3700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1af815df50 0x7f1af815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.109+0000 7f1b006d3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af815d7e0 con 0x7f1af806c0a0 2023-10-08T00:36:50.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.109+0000 7f1b006d3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af815dac0 con 0x7f1af806bcd0 2023-10-08T00:36:50.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.109+0000 7f1b006d3700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af815aa30 con 0x7f1af815df50 2023-10-08T00:36:50.113 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afe46f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1af806bcd0 0x7f1af80caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afdc6e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1af806c0a0 0x7f1af815a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36868/0 (socket says 172.21.15.22:36868) 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afdc6e700 1 -- 172.21.15.22:0/1643388842 learned_addr learned my addr 172.21.15.22:0/1643388842 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afec70700 1 --2- 172.21.15.22:0/1643388842 >> v2:172.21.15.192:3300/0 conn(0x7f1af815df50 0x7f1af815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afe46f700 1 -- 172.21.15.22:0/1643388842 >> v2:172.21.15.192:3300/0 conn(0x7f1af815df50 msgr2=0x7f1af815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afe46f700 1 --2- 172.21.15.22:0/1643388842 >> v2:172.21.15.192:3300/0 conn(0x7f1af815df50 0x7f1af815e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afe46f700 1 -- 172.21.15.22:0/1643388842 >> v1:172.21.15.22:6789/0 conn(0x7f1af806c0a0 legacy=0x7f1af815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afe46f700 1 -- 172.21.15.22:0/1643388842 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af815ad10 con 0x7f1af806bcd0 2023-10-08T00:36:50.114 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afec70700 1 --2- 172.21.15.22:0/1643388842 >> v2:172.21.15.192:3300/0 conn(0x7f1af815df50 0x7f1af815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afe46f700 1 --2- 172.21.15.22:0/1643388842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806bcd0 0x7f1af80caa90 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f1af815d720 tx=0x7f1af00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f258337f2fe5a42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afd46d700 1 -- 172.21.15.22:0/1643388842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af000b6b0 con 0x7f1af806bcd0 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afd46d700 1 -- 172.21.15.22:0/1643388842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af000b810 con 0x7f1af806bcd0 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.110+0000 7f1afd46d700 1 -- 172.21.15.22:0/1643388842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af000bbb0 con 0x7f1af806bcd0 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 -- 172.21.15.22:0/1643388842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806bcd0 msgr2=0x7f1af80caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1643388842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806bcd0 0x7f1af80caa90 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f1af815d720 tx=0x7f1af00091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 -- 172.21.15.22:0/1643388842 shutdown_connections 2023-10-08T00:36:50.115 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1643388842 >> v2:172.21.15.192:3300/0 conn(0x7f1af815df50 0x7f1af815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1643388842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806bcd0 0x7f1af80caa90 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 -- 172.21.15.22:0/1643388842 >> 172.21.15.22:0/1643388842 conn(0x7f1af80ce600 msgr2=0x7f1af80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 -- 172.21.15.22:0/1643388842 shutdown_connections 2023-10-08T00:36:50.116 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.111+0000 7f1b006d3700 1 -- 172.21.15.22:0/1643388842 wait complete. 2023-10-08T00:36:50.118 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.112+0000 7f1b006d3700 1 Processor -- start 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.112+0000 7f1b006d3700 1 -- start start 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af806bcd0 0x7f1af80b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 0x7f1af80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815df50 0x7f1af80c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b3d50 con 0x7f1af806c0a0 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b2cf0 con 0x7f1af815df50 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af80b1710 con 0x7f1af806bcd0 2023-10-08T00:36:50.119 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 0x7f1af80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 0x7f1af80c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42382/0 (socket says 172.21.15.22:42382) 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 -- 172.21.15.22:0/1874018886 learned_addr learned my addr 172.21.15.22:0/1874018886 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afec70700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815df50 0x7f1af80c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 -- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af806bcd0 msgr2=0x7f1af80b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af806bcd0 0x7f1af80b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 -- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815df50 msgr2=0x7f1af80c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.120 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815df50 0x7f1af80c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 -- 172.21.15.22:0/1874018886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0009420 con 0x7f1af806c0a0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1afdc6e700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 0x7f1af80c6070 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00c590 tx=0x7f1aec001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec005b30 con 0x7f1af806c0a0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec005cb0 con 0x7f1af806c0a0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec007320 con 0x7f1af806c0a0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af80b19f0 con 0x7f1af806c0a0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.113+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af80b1fb0 con 0x7f1af806c0a0 2023-10-08T00:36:50.121 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.114+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af804c3c0 con 0x7f1af806c0a0 2023-10-08T00:36:50.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.115+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1aec007690 con 0x7f1af806c0a0 2023-10-08T00:36:50.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.115+0000 7f1af67fc700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ae4067320 0x7f1ae40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.115+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1aec083e40 con 0x7f1af806c0a0 2023-10-08T00:36:50.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.115+0000 7f1afe46f700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ae4067320 0x7f1ae40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.116+0000 7f1afe46f700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ae4067320 0x7f1ae40697d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1af815d720 tx=0x7f1af0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.122 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.120+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aec050dd0 con 0x7f1af806c0a0 2023-10-08T00:36:50.315 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.313+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f1af815aff0 con 0x7f1ae4067320 2023-10-08T00:36:50.316 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.314+0000 7f1af67fc700 1 -- 172.21.15.22:0/1874018886 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1af815aff0 con 0x7f1ae4067320 2023-10-08T00:36:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ae4067320 msgr2=0x7f1ae40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ae4067320 0x7f1ae40697d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1af815d720 tx=0x7f1af0017000 comp rx=0 tx=0).stop 2023-10-08T00:36:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 msgr2=0x7f1af80c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 0x7f1af80c6070 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f1aec00c590 tx=0x7f1aec001020 comp rx=0 tx=0).stop 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 shutdown_connections 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1af815df50 0x7f1af80c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f1ae4067320 0x7f1ae40697d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1af806bcd0 0x7f1af80b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 --2- 172.21.15.22:0/1874018886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1af806c0a0 0x7f1af80c6070 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 >> 172.21.15.22:0/1874018886 conn(0x7f1af80ce600 msgr2=0x7f1af8069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 shutdown_connections 2023-10-08T00:36:50.319 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.316+0000 7f1b006d3700 1 -- 172.21.15.22:0/1874018886 wait complete. 2023-10-08T00:36:50.320 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T00:36:50.330 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T00:36:50.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T00:36:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.451+0000 7f3075e82700 1 Processor -- start 2023-10-08T00:36:50.453 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.451+0000 7f3075e82700 1 -- start start 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f3075e82700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30701563b0 0x7f3070156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f3075e82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 0x7f30700acf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f3075e82700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307015a9b0 con 0x7f3070068890 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f3075e82700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307015ac90 con 0x7f30701563b0 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f3075e82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307015af70 con 0x7f307015a440 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3070068890 0x7f30700c8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:36874/0 (socket says 172.21.15.22:36874) 2023-10-08T00:36:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306ffff700 1 -- 172.21.15.22:0/1967034630 learned_addr learned my addr 172.21.15.22:0/1967034630 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306f7fe700 1 --2- 172.21.15.22:0/1967034630 >> v2:172.21.15.192:3300/0 conn(0x7f30701563b0 0x7f3070156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306effd700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 0x7f30700acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164039520 0 0) 0x7f307015a9b0 con 0x7f3070068890 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003570 con 0x7f3070068890 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672593473 0 0) 0x7f3058003570 con 0x7f3070068890 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 msgr2=0x7f30700acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306e7fc700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 0x7f30700acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.452+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 >> v2:172.21.15.192:3300/0 conn(0x7f30701563b0 msgr2=0x7f3070156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 --2- 172.21.15.22:0/1967034630 >> v2:172.21.15.192:3300/0 conn(0x7f30701563b0 0x7f3070156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307015b250 con 0x7f3070068890 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2196025431 0 0) 0x7f30680017f0 con 0x7f3070068890 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 >> v1:172.21.15.22:6789/0 conn(0x7f3070068890 legacy=0x7f30700c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058003ae0 0x7f3058003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 0x7f30580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015ac90 con 0x7f3058004810 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307015af70 con 0x7f3058003ae0 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305800dd20 con 0x7f307015a440 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306f7fe700 1 --2- 172.21.15.22:0/1967034630 >> v2:172.21.15.192:3300/0 conn(0x7f30701563b0 0x7f3070156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3058004810 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306ffff700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 0x7f30580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306f7fe700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058003ae0 0x7f3058003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 -- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 msgr2=0x7f30580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f307015a440 0x7f30580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 -- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058003ae0 msgr2=0x7f3058003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058003ae0 0x7f3058003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 -- 172.21.15.22:0/1967034630 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058003570 con 0x7f3058004810 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306f7fe700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058003ae0 0x7f3058003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306effd700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3058004810 0x7f3058004c80 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f3064009c00 tx=0x7f30640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb8ae49249372d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400e710 con 0x7f3058004810 2023-10-08T00:36:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306400e870 con 0x7f3058004810 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.453+0000 7f306e7fc700 1 -- 172.21.15.22:0/1967034630 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306400ec30 con 0x7f3058004810 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f3075e82700 1 -- 172.21.15.22:0/1967034630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3058004810 msgr2=0x7f3058004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f3075e82700 1 --2- 172.21.15.22:0/1967034630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3058004810 0x7f3058004c80 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f3064009c00 tx=0x7f30640091a0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f306ffff700 1 -- 172.21.15.22:0/1967034630 reap_dead start 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f3075e82700 1 -- 172.21.15.22:0/1967034630 shutdown_connections 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f3075e82700 1 -- 172.21.15.22:0/1967034630 >> 172.21.15.22:0/1967034630 conn(0x7f30700c8f90 msgr2=0x7f30700c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f3075e82700 1 -- 172.21.15.22:0/1967034630 shutdown_connections 2023-10-08T00:36:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.454+0000 7f3075e82700 1 -- 172.21.15.22:0/1967034630 wait complete. 2023-10-08T00:36:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.455+0000 7f3075e82700 1 Processor -- start 2023-10-08T00:36:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.455+0000 7f3075e82700 1 -- start start 2023-10-08T00:36:50.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f3075e82700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058004810 0x7f30700b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f3075e82700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30700c1250 0x7f30700b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.466 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f3075e82700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30700c16c0 0x7f30700b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f3075e82700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700b0d20 con 0x7f30700c16c0 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f3075e82700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c0210 con 0x7f3058004810 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f3075e82700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30700c04b0 con 0x7f30700c1250 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30700c16c0 0x7f30700b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30700c16c0 0x7f30700b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42400/0 (socket says 172.21.15.22:42400) 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 -- 172.21.15.22:0/2320787124 learned_addr learned my addr 172.21.15.22:0/2320787124 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:50.467 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306effd700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30700c1250 0x7f30700b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306f7fe700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058004810 0x7f30700b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 -- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30700c1250 msgr2=0x7f30700b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30700c1250 0x7f30700b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 -- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058004810 msgr2=0x7f30700b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3058004810 0x7f30700b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306ffff700 1 -- 172.21.15.22:0/2320787124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700c0790 con 0x7f30700c16c0 2023-10-08T00:36:50.468 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.456+0000 7f306effd700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f30700c1250 0x7f30700b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f306ffff700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30700c16c0 0x7f30700b07e0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f307006b950 tx=0x7f3068002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800ad80 con 0x7f30700c16c0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30680133f0 con 0x7f30700c16c0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30700c0a70 con 0x7f30700c16c0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30680137b0 con 0x7f30700c16c0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3070154ed0 con 0x7f30700c16c0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.457+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30700718b0 con 0x7f30700c16c0 2023-10-08T00:36:50.469 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.458+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3068013ba0 con 0x7f30700c16c0 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.458+0000 7f30577fe700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f305c067320 0x7f305c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f30680852f0 con 0x7f30700c16c0 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f30577fe700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f305c06d170 0x7f305c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 --> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f305c06fc50 con 0x7f305c06d170 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3068087850 con 0x7f30700c16c0 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f306f7fe700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f305c067320 0x7f305c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.470 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f306effd700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f305c06d170 0x7f305c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f306f7fe700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f305c067320 0x7f305c0697d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3060014350 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.459+0000 7f306effd700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f305c06d170 0x7f305c06f580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.471 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.460+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== osd.7 v2:172.21.15.192:6800/91120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f305c06fc50 con 0x7f305c06d170 2023-10-08T00:36:50.475 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.474+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 --> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f307006d6a0 con 0x7f305c06d170 2023-10-08T00:36:50.476 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.474+0000 7f30577fe700 1 -- 172.21.15.22:0/2320787124 <== osd.7 v2:172.21.15.192:6800/91120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f307006d6a0 con 0x7f305c06d170 2023-10-08T00:36:50.476 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2023-10-08T00:36:50.476 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T00:36:50.477 INFO:teuthology.orchestra.run.smithi022.stdout:} 2023-10-08T00:36:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f305c06d170 msgr2=0x7f305c06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6800/91120,v1:172.21.15.192:6801/91120] conn(0x7f305c06d170 0x7f305c06f580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f305c067320 msgr2=0x7f305c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f305c067320 0x7f305c0697d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3060014350 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-10-08T00:36:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30700c16c0 msgr2=0x7f30700b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.478 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 --2- 172.21.15.22:0/2320787124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30700c16c0 0x7f30700b07e0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f307006b950 tx=0x7f3068002140 comp rx=0 tx=0).stop 2023-10-08T00:36:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f306ffff700 1 -- 172.21.15.22:0/2320787124 reap_dead start 2023-10-08T00:36:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 shutdown_connections 2023-10-08T00:36:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 >> 172.21.15.22:0/2320787124 conn(0x7f30700c8f90 msgr2=0x7f3070158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 shutdown_connections 2023-10-08T00:36:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.475+0000 7f3075e82700 1 -- 172.21.15.22:0/2320787124 wait complete. 2023-10-08T00:36:50.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T00:36:50.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.606+0000 7effdf92f700 1 Processor -- start 2023-10-08T00:36:50.608 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.606+0000 7effdf92f700 1 -- start start 2023-10-08T00:36:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdf92f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7effd8159890 0x7effd815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.610 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdf92f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8069560 0x7effd80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdf92f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd8069ee0 con 0x7effd8159c60 2023-10-08T00:36:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdf92f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd815a160 con 0x7effd8159890 2023-10-08T00:36:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdf92f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80d13a0 con 0x7effd8069560 2023-10-08T00:36:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdd6cb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7effd8159890 0x7effd815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdd6cb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7effd8159890 0x7effd815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42412/0 (socket says 172.21.15.22:42412) 2023-10-08T00:36:50.611 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effdd6cb700 1 -- 172.21.15.22:0/1128411783 learned_addr learned my addr 172.21.15.22:0/1128411783 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.607+0000 7effddecc700 1 --2- 172.21.15.22:0/1128411783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8069560 0x7effd80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdd6cb700 1 -- 172.21.15.22:0/1128411783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8069560 msgr2=0x7effd80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdd6cb700 1 --2- 172.21.15.22:0/1128411783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8069560 0x7effd80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdd6cb700 1 -- 172.21.15.22:0/1128411783 >> v1:172.21.15.192:6789/0 conn(0x7effd8159c60 legacy=0x7effd815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdd6cb700 1 -- 172.21.15.22:0/1128411783 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd815e140 con 0x7effd8159890 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdd6cb700 1 --2- 172.21.15.22:0/1128411783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd815abd0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7effc8009f20 tx=0x7effc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997989760e7b8714 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.612 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effd7fff700 1 -- 172.21.15.22:0/1128411783 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc800e070 con 0x7effd8159890 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effd7fff700 1 -- 172.21.15.22:0/1128411783 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc800ba80 con 0x7effd8159890 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effd7fff700 1 -- 172.21.15.22:0/1128411783 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80092e0 con 0x7effd8159890 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdf92f700 1 -- 172.21.15.22:0/1128411783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 msgr2=0x7effd815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdf92f700 1 --2- 172.21.15.22:0/1128411783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd815abd0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7effc8009f20 tx=0x7effc8009840 comp rx=0 tx=0).stop 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdf92f700 1 -- 172.21.15.22:0/1128411783 shutdown_connections 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdf92f700 1 --2- 172.21.15.22:0/1128411783 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8069560 0x7effd80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdf92f700 1 --2- 172.21.15.22:0/1128411783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd815abd0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.608+0000 7effdf92f700 1 -- 172.21.15.22:0/1128411783 >> 172.21.15.22:0/1128411783 conn(0x7effd8068e20 msgr2=0x7effd80d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.609+0000 7effdf92f700 1 -- 172.21.15.22:0/1128411783 shutdown_connections 2023-10-08T00:36:50.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.609+0000 7effdf92f700 1 -- 172.21.15.22:0/1128411783 wait complete. 2023-10-08T00:36:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.610+0000 7effdf92f700 1 Processor -- start 2023-10-08T00:36:50.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.610+0000 7effdf92f700 1 -- start start 2023-10-08T00:36:50.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.610+0000 7effdf92f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd8069560 0x7effd8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.610+0000 7effdf92f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd80b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdf92f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8159c60 0x7effd80b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdf92f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cd0c0 con 0x7effd8159890 2023-10-08T00:36:50.617 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdf92f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cd360 con 0x7effd8069560 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdf92f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80b40d0 con 0x7effd8159c60 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd80b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd80b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42428/0 (socket says 172.21.15.22:42428) 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 -- 172.21.15.22:0/657846608 learned_addr learned my addr 172.21.15.22:0/657846608 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdd6cb700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd8069560 0x7effd8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effddecc700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8159c60 0x7effd80b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 -- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8159c60 msgr2=0x7effd80b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.618 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8159c60 0x7effd80b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 -- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd8069560 msgr2=0x7effd8158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd8069560 0x7effd8158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 -- 172.21.15.22:0/657846608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8009ae0 con 0x7effd8159890 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effddecc700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8159c60 0x7effd80b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdceca700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd80b4ed0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c590 tx=0x7effcc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc011590 con 0x7effd8159890 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effcc011710 con 0x7effd8159890 2023-10-08T00:36:50.619 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80b43b0 con 0x7effd8159890 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc011ad0 con 0x7effd8159890 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.611+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd80cfb90 con 0x7effd8159890 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.612+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd80cfd80 con 0x7effd8159890 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.613+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7effcc01b3b0 con 0x7effd8159890 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.613+0000 7effd57fa700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7effc4067320 0x7effc40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.613+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7effcc083eb0 con 0x7effd8159890 2023-10-08T00:36:50.620 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.613+0000 7effdd6cb700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7effc4067320 0x7effc40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.614+0000 7effdd6cb700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7effc4067320 0x7effc40697d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7effc8009880 tx=0x7effc8018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.621 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.617+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effd80cfd80 con 0x7effd8159890 2023-10-08T00:36:50.813 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.812+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7effd80cfd80 con 0x7effc4067320 2023-10-08T00:36:50.814 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.812+0000 7effd57fa700 1 -- 172.21.15.22:0/657846608 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7effd80cfd80 con 0x7effc4067320 2023-10-08T00:36:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7effc4067320 msgr2=0x7effc40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7effc4067320 0x7effc40697d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7effc8009880 tx=0x7effc8018000 comp rx=0 tx=0).stop 2023-10-08T00:36:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 msgr2=0x7effd80b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd80b4ed0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7effcc00c590 tx=0x7effcc00c8a0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.816 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 shutdown_connections 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7effc4067320 0x7effc40697d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7effd8159c60 0x7effd80b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effd8069560 0x7effd8158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 --2- 172.21.15.22:0/657846608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effd8159890 0x7effd80b4ed0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 >> 172.21.15.22:0/657846608 conn(0x7effd8068e20 msgr2=0x7effd80d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 shutdown_connections 2023-10-08T00:36:50.817 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.814+0000 7effdf92f700 1 -- 172.21.15.22:0/657846608 wait complete. 2023-10-08T00:36:50.818 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T00:36:50.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:36:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.945+0000 7ffb0ebd7700 1 Processor -- start 2023-10-08T00:36:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.945+0000 7ffb0ebd7700 1 -- start start 2023-10-08T00:36:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0ebd7700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb08159420 0x7ffb080b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0ebd7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffb081597f0 0x7ffb080b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0ebd7700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb080b11d0 con 0x7ffb0815d230 2023-10-08T00:36:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0ebd7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080b14b0 con 0x7ffb081597f0 2023-10-08T00:36:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0ebd7700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080b1790 con 0x7ffb08159420 2023-10-08T00:36:50.949 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffb081597f0 0x7ffb080b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ffb081597f0 0x7ffb080b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42436/0 (socket says 172.21.15.22:42436) 2023-10-08T00:36:50.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/81955823 learned_addr learned my addr 172.21.15.22:0/81955823 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:50.950 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0dbd5700 1 --2- 172.21.15.22:0/81955823 >> v2:172.21.15.192:3300/0 conn(0x7ffb08159420 0x7ffb080b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/81955823 >> v2:172.21.15.192:3300/0 conn(0x7ffb08159420 msgr2=0x7ffb080b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:36:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 --2- 172.21.15.22:0/81955823 >> v2:172.21.15.192:3300/0 conn(0x7ffb08159420 0x7ffb080b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/81955823 >> v1:172.21.15.192:6789/0 conn(0x7ffb0815d230 legacy=0x7ffb0815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.946+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/81955823 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb080b1a70 con 0x7ffb081597f0 2023-10-08T00:36:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0d3d4700 1 --2- 172.21.15.22:0/81955823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb080b2270 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ffb080b2f20 tx=0x7ffafc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c726e19e76b4b016 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0cbd3700 1 -- 172.21.15.22:0/81955823 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc009e70 con 0x7ffb081597f0 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0cbd3700 1 -- 172.21.15.22:0/81955823 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc00b860 con 0x7ffb081597f0 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0cbd3700 1 -- 172.21.15.22:0/81955823 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc00bc00 con 0x7ffb081597f0 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/81955823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 msgr2=0x7ffb080b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/81955823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb080b2270 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ffb080b2f20 tx=0x7ffafc009250 comp rx=0 tx=0).stop 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/81955823 shutdown_connections 2023-10-08T00:36:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/81955823 >> v2:172.21.15.192:3300/0 conn(0x7ffb08159420 0x7ffb080b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/81955823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb080b2270 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/81955823 >> 172.21.15.22:0/81955823 conn(0x7ffb080d0660 msgr2=0x7ffb080d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:50.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/81955823 shutdown_connections 2023-10-08T00:36:50.953 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.947+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/81955823 wait complete. 2023-10-08T00:36:50.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 Processor -- start 2023-10-08T00:36:50.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 -- start start 2023-10-08T00:36:50.956 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb08159420 0x7ffb08153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb0816a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0815d230 0x7ffb080c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0816ad20 con 0x7ffb081597f0 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0816bb80 con 0x7ffb0815d230 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0ebd7700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081535c0 con 0x7ffb08159420 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0d3d4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb0816a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0d3d4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb0816a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42438/0 (socket says 172.21.15.22:42438) 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.949+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/570473671 learned_addr learned my addr 172.21.15.22:0/570473671 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0e3d6700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0815d230 0x7ffb080c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0dbd5700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb08159420 0x7ffb08153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb08159420 msgr2=0x7ffb08153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0d3d4700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb08159420 0x7ffb08153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0815d230 msgr2=0x7ffb080c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0d3d4700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0815d230 0x7ffb080c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:50.958 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0d3d4700 1 -- 172.21.15.22:0/570473671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc0094f0 con 0x7ffb081597f0 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0dbd5700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb08159420 0x7ffb08153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0e3d6700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0815d230 0x7ffb080c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0d3d4700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb0816a5a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7ffb08089340 tx=0x7ffafc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc011420 con 0x7ffb081597f0 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc0115a0 con 0x7ffb081597f0 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0816aae0 con 0x7ffb081597f0 2023-10-08T00:36:50.959 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc011960 con 0x7ffb081597f0 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.950+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0816b250 con 0x7ffb081597f0 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.951+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0816bd30 con 0x7ffb081597f0 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.952+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffafc0253f0 con 0x7ffb081597f0 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.952+0000 7ffb05ffb700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffaf4067320 0x7ffaf40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.952+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ffafc086370 con 0x7ffb081597f0 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.952+0000 7ffb0dbd5700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffaf4067320 0x7ffaf40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:36:50.960 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.953+0000 7ffb0dbd5700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffaf4067320 0x7ffaf40697d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffb0815d0c0 tx=0x7ffaf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:36:50.961 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:50.956+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb0816bd30 con 0x7ffb081597f0 2023-10-08T00:36:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.143+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb0816bcf0 con 0x7ffaf4067320 2023-10-08T00:36:51.147 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.146+0000 7ffb05ffb700 1 -- 172.21.15.22:0/570473671 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50607 (secure 0 0 0) 0x7ffb0816bcf0 con 0x7ffaf4067320 2023-10-08T00:36:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:36:51.149 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.147+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffaf4067320 msgr2=0x7ffaf40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffaf4067320 0x7ffaf40697d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ffb0815d0c0 tx=0x7ffaf8008040 comp rx=0 tx=0).stop 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 msgr2=0x7ffb0816a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb0816a5a0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7ffb08089340 tx=0x7ffafc017000 comp rx=0 tx=0).stop 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 shutdown_connections 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0815d230 0x7ffb080c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffaf4067320 0x7ffaf40697d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:51.150 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb08159420 0x7ffb08153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:51.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 --2- 172.21.15.22:0/570473671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb081597f0 0x7ffb0816a5a0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:36:51.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 >> 172.21.15.22:0/570473671 conn(0x7ffb080d0660 msgr2=0x7ffb0815d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:36:51.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 shutdown_connections 2023-10-08T00:36:51.151 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:36:51.148+0000 7ffb0ebd7700 1 -- 172.21.15.22:0/570473671 wait complete. 2023-10-08T00:36:51.151 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:36:51.161 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":563,"stamp":"2023-10-08T00:36:50.554915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2445128,"kb_used_data":21768,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529592,"statfs":{"total":773094113280,"available":770590302208,"internally_reserved":0,"allocated":22290432,"data_stored":10684288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.298179"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":319,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-10-08T00:36:39.949380+0000","last_change":"2023-10-08T00:24:48.179737+0000","last_active":"2023-10-08T00:36:39.949380+0000","last_peered":"2023-10-08T00:36:39.949380+0000","last_clean":"2023-10-08T00:36:39.949380+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:36:39.949380+0000","last_undegraded":"2023-10-08T00:36:39.949380+0000","last_fullsized":"2023-10-08T00:36:39.949380+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T00:24:46.933250+0000","last_clean_scrub_stamp":"2023-10-08T00:24:46.933250+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T10:44:59.857192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304540,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067300,"statfs":{"total":96636764160,"available":96324915200,"internally_reserved":0,"allocated":3231744,"data_stored":1778312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.34399999999999997,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.28599999999999998},"max":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.81799999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.25900000000000001},"max":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.432}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.47499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.372,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.875},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.97899999999999998},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.88300000000000001,"15min":0.89100000000000001},"last":0.25}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.317,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.753,"15min":0.79000000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65700000000000003,"5min":0.87,"15min":1.048},"last":0.36199999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.316}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.434,"5min":0.313,"15min":0.27600000000000002},"max":{"1min":0.68899999999999995,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.76500000000000001,"5min":0.97299999999999998,"15min":1.145},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.873},"last":0.372}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":1.079},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.42699999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.496,"15min":1.496},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":1.02,"15min":1.1160000000000001},"last":0.504}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.437},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.47599999999999998}]},{"osd":7,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.46100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308056,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063784,"statfs":{"total":96636764160,"available":96321314816,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.255},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.42099999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.39200000000000002,"15min":0.38300000000000001},"min":{"1min":0.34100000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.433},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41599999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86799999999999999,"5min":0.95999999999999996,"15min":1.218},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.101,"15min":1.101},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.79800000000000004,"5min":1.121,"15min":1.294},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52800000000000002,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.1319999999999999,"15min":1.2549999999999999},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.871,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":1.1120000000000001,"15min":1.278},"last":0.624}]},{"osd":7,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.497,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":0.91100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":0.89600000000000002,"15min":1.087},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308636,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063204,"statfs":{"total":96636764160,"available":96320720896,"internally_reserved":0,"allocated":3231744,"data_stored":1778312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.245,"5min":0.224,"15min":0.216},"max":{"1min":0.5,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.38500000000000001,"15min":0.36799999999999999},"min":{"1min":0.29099999999999998,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.61799999999999999,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.34699999999999998}]},{"osd":2,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.40000000000000002,"15min":0.38300000000000001},"min":{"1min":0.317,"5min":0.249,"15min":0.245},"max":{"1min":0.55000000000000004,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.35899999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.60799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.38400000000000001,"15min":0.376},"min":{"1min":0.33200000000000002,"5min":0.253,"15min":0.20399999999999999},"max":{"1min":0.59299999999999997,"5min":0.749,"15min":0.749},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.44800000000000001,"15min":0.42899999999999999},"min":{"1min":0.39700000000000002,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.63100000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.379}]},{"osd":4,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.63500000000000001,"15min":0.61799999999999999},"min":{"1min":0.48799999999999999,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":1.002,"5min":1.085,"15min":1.085},"last":0.495},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65900000000000003,"15min":0.63400000000000001},"min":{"1min":0.55800000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.0369999999999999},"last":0.47099999999999997}]},{"osd":5,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.51900000000000002,"5min":0.39300000000000002,"15min":0.33600000000000002},"max":{"1min":0.91000000000000003,"5min":0.96099999999999997,"15min":1.242},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.442,"5min":0.375,"15min":0.375},"max":{"1min":0.96799999999999997,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53300000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.64300000000000002,"15min":0.61199999999999999},"min":{"1min":0.55800000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63200000000000001,"15min":0.61699999999999999},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.43099999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.54900000000000004,"5min":0.41099999999999998,"15min":0.375},"max":{"1min":0.89400000000000002,"5min":0.90300000000000002,"15min":1.0529999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.628,"15min":0.626},"min":{"1min":0.58399999999999996,"5min":0.38100000000000001,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":1.0249999999999999,"15min":1.1020000000000001},"last":0.44700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.251}]},{"osd":1,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38,"15min":0.371},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.65000000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.34499999999999997,"5min":0.26800000000000002,"15min":0.23599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.311}]},{"osd":3,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.376,"15min":0.372},"min":{"1min":0.311,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59399999999999997,"15min":0.60799999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.70199999999999996},"last":0.39700000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.33000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.40999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0760000000000001},"last":0.76300000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.55400000000000005,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.34899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.278},"last":0.81000000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.137},"last":0.622},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78100000000000003}]},{"osd":7,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.52400000000000002,"5min":0.42399999999999999,"15min":0.40699999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.1259999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.343},"last":0.64600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308056,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063784,"statfs":{"total":96636764160,"available":96321314816,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.36699999999999999,"15min":0.35199999999999998},"min":{"1min":0.26400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51600000000000001,"5min":0.59699999999999998,"15min":0.66600000000000004},"last":0.314},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.373},"min":{"1min":0.38300000000000001,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.56000000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.27500000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.36799999999999999,"15min":0.35199999999999998},"min":{"1min":0.309,"5min":0.24199999999999999,"15min":0.22800000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.64200000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.35899999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.441,"15min":0.41499999999999998},"min":{"1min":0.36699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.70699999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.47499999999999998,"15min":0.45100000000000001},"min":{"1min":0.40400000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.64600000000000002,"5min":0.69699999999999995,"15min":0.79700000000000004},"last":0.39500000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.84099999999999997,"5min":1.47,"15min":1.47},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.621,"15min":0.60499999999999998},"min":{"1min":0.46300000000000002,"5min":0.39100000000000001,"15min":0.35899999999999999},"max":{"1min":0.91800000000000004,"5min":0.95199999999999996,"15min":0.96399999999999997},"last":0.54000000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64300000000000002,"15min":0.63300000000000001},"min":{"1min":0.45500000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88100000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.51800000000000002,"5min":0.42799999999999999,"15min":0.36699999999999999},"max":{"1min":0.81799999999999995,"5min":1.385,"15min":1.385},"last":0.68500000000000005}]},{"osd":6,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64100000000000001,"15min":0.63200000000000001},"min":{"1min":0.54500000000000004,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90000000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.629},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66100000000000003,"15min":0.64500000000000002},"min":{"1min":0.48099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92300000000000004,"5min":0.996,"15min":0.996},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61499999999999999},"min":{"1min":0.48899999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89300000000000002,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.56200000000000006,"5min":0.44,"15min":0.435},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.006},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51900000000000002,"15min":0.497},"min":{"1min":0.433,"5min":0.30499999999999999,"15min":0.246},"max":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55700000000000005,"15min":0.53600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.28999999999999998},"max":{"1min":0.67100000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.67500000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76500000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.42499999999999999,"5min":0.38,"15min":0.32500000000000001},"max":{"1min":0.66100000000000003,"5min":0.82999999999999996,"15min":1.712},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.39200000000000002,"5min":0.374,"15min":0.34399999999999997},"max":{"1min":0.65500000000000003,"5min":0.86599999999999999,"15min":1.21},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"max":{"1min":0.63,"5min":0.88900000000000001,"15min":6.0960000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.495,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.71199999999999997,"5min":0.82499999999999996,"15min":0.873},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.48099999999999998,"15min":0.49299999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.66700000000000004,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":0.82899999999999996,"15min":1.002},"last":0.52100000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.34699999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.55000000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.443},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.625,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.50900000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:00 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55500000000000005,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68100000000000005,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.59599999999999997,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.59399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.86699999999999999},"last":0.432},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47699999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.497},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006}]},{"osd":2,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.88300000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.34200000000000003}]},{"osd":3,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.75700000000000001,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.83399999999999996,"15min":2.4870000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.78700000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80100000000000005},"last":0.52800000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30199999999999999},"max":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.56899999999999995},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.84399999999999997},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.85199999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56499999999999995,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:36:51.165 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T00:24:46.933250+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=0, tm_min=24, tm_sec=46, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=0, tm_min=36, tm_sec=45, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T00:36:51.166 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T00:37:02.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:37:02.612 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:37:11.166 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T00:37:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.299+0000 7f698b94c700 1 Processor -- start 2023-10-08T00:37:11.300 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.299+0000 7f698b94c700 1 -- start start 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f698b94c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f698406bcd0 0x7f6984140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f698b94c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f698406c0a0 0x7f6984141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f698b94c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69840c8e00 0x7f69840c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f698b94c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698415c2a0 con 0x7f698406bcd0 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f698b94c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698415b690 con 0x7f698406c0a0 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f698b94c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698415b970 con 0x7f69840c8e00 2023-10-08T00:37:11.303 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f69896e8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f698406bcd0 0x7f6984140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f69896e8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f698406bcd0 0x7f6984140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49252/0 (socket says 172.21.15.22:49252) 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.300+0000 7f69896e8700 1 -- 172.21.15.22:0/4265163861 learned_addr learned my addr 172.21.15.22:0/4265163861 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f6988ee7700 1 --2- 172.21.15.22:0/4265163861 >> v2:172.21.15.192:3300/0 conn(0x7f698406c0a0 0x7f6984141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f6989ee9700 1 --2- 172.21.15.22:0/4265163861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69840c8e00 0x7f69840c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f69896e8700 1 -- 172.21.15.22:0/4265163861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69840c8e00 msgr2=0x7f69840c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f69896e8700 1 --2- 172.21.15.22:0/4265163861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69840c8e00 0x7f69840c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f69896e8700 1 -- 172.21.15.22:0/4265163861 >> v2:172.21.15.192:3300/0 conn(0x7f698406c0a0 msgr2=0x7f6984141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:37:11.304 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f69896e8700 1 --2- 172.21.15.22:0/4265163861 >> v2:172.21.15.192:3300/0 conn(0x7f698406c0a0 0x7f6984141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f69896e8700 1 -- 172.21.15.22:0/4265163861 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698415bc50 con 0x7f698406bcd0 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f6988ee7700 1 --2- 172.21.15.22:0/4265163861 >> v2:172.21.15.192:3300/0 conn(0x7f698406c0a0 0x7f6984141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f69896e8700 1 --2- 172.21.15.22:0/4265163861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698406bcd0 0x7f6984140df0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f698406c6e0 tx=0x7f6974009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5ea7da8d430d17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f6983fff700 1 -- 172.21.15.22:0/4265163861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400b860 con 0x7f698406bcd0 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f6983fff700 1 -- 172.21.15.22:0/4265163861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400b9c0 con 0x7f698406bcd0 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.301+0000 7f6983fff700 1 -- 172.21.15.22:0/4265163861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400bd60 con 0x7f698406bcd0 2023-10-08T00:37:11.305 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 -- 172.21.15.22:0/4265163861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698406bcd0 msgr2=0x7f6984140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 --2- 172.21.15.22:0/4265163861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698406bcd0 0x7f6984140df0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f698406c6e0 tx=0x7f6974009250 comp rx=0 tx=0).stop 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 -- 172.21.15.22:0/4265163861 shutdown_connections 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 --2- 172.21.15.22:0/4265163861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698406bcd0 0x7f6984140df0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 --2- 172.21.15.22:0/4265163861 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f69840c8e00 0x7f69840c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 --2- 172.21.15.22:0/4265163861 >> v2:172.21.15.192:3300/0 conn(0x7f698406c0a0 0x7f6984141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 -- 172.21.15.22:0/4265163861 >> 172.21.15.22:0/4265163861 conn(0x7f69840ce600 msgr2=0x7f69840cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 -- 172.21.15.22:0/4265163861 shutdown_connections 2023-10-08T00:37:11.306 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.302+0000 7f698b94c700 1 -- 172.21.15.22:0/4265163861 wait complete. 2023-10-08T00:37:11.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.303+0000 7f698b94c700 1 Processor -- start 2023-10-08T00:37:11.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.303+0000 7f698b94c700 1 -- start start 2023-10-08T00:37:11.309 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f698b94c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f698406bcd0 0x7f69840c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f698b94c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f698406c0a0 0x7f69841692c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f698b94c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 0x7f6984168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f698b94c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c56b0 con 0x7f69840c8e00 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f698b94c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69840c7a40 con 0x7f698406bcd0 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f698b94c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69840b37b0 con 0x7f698406c0a0 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 0x7f6984168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 0x7f6984168b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49260/0 (socket says 172.21.15.22:49260) 2023-10-08T00:37:11.310 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 -- 172.21.15.22:0/2445341666 learned_addr learned my addr 172.21.15.22:0/2445341666 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6988ee7700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f698406c0a0 0x7f69841692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f69896e8700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f698406bcd0 0x7f69840c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 -- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f698406c0a0 msgr2=0x7f69841692c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f698406c0a0 0x7f69841692c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 -- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f698406bcd0 msgr2=0x7f69840c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f698406bcd0 0x7f69840c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 -- 172.21.15.22:0/2445341666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740094f0 con 0x7f69840c8e00 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6988ee7700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f698406c0a0 0x7f69841692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f69896e8700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f698406bcd0 0x7f69840c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.304+0000 7f6989ee9700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 0x7f6984168b10 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f697c007f20 tx=0x7f697c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.305+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00eca0 con 0x7f69840c8e00 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.305+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00ee20 con 0x7f69840c8e00 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.305+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69840b3a90 con 0x7f69840c8e00 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.305+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c014670 con 0x7f69840c8e00 2023-10-08T00:37:11.312 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.305+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69840b4050 con 0x7f69840c8e00 2023-10-08T00:37:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.306+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69840c5860 con 0x7f69840c8e00 2023-10-08T00:37:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.306+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f697c0149e0 con 0x7f69840c8e00 2023-10-08T00:37:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.306+0000 7f69817fa700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6970067320 0x7f69700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.307+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f697c0850a0 con 0x7f69840c8e00 2023-10-08T00:37:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.307+0000 7f69896e8700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6970067320 0x7f69700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.307+0000 7f69896e8700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6970067320 0x7f69700697d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f698406c6e0 tx=0x7f6974017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.311+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69840c5860 con 0x7f69840c8e00 2023-10-08T00:37:11.501 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.501+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 --> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69840c5860 con 0x7f6970067320 2023-10-08T00:37:11.504 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.503+0000 7f69817fa700 1 -- 172.21.15.22:0/2445341666 <== mgr.4103 v2:172.21.15.192:6832/90533 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50580 (secure 0 0 0) 0x7f69840c5860 con 0x7f6970067320 2023-10-08T00:37:11.505 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:37:11.506 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6970067320 msgr2=0x7f69700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6970067320 0x7f69700697d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f698406c6e0 tx=0x7f6974017000 comp rx=0 tx=0).stop 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 msgr2=0x7f6984168b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 0x7f6984168b10 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f697c007f20 tx=0x7f697c009860 comp rx=0 tx=0).stop 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 shutdown_connections 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69840c8e00 0x7f6984168b10 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f698406bcd0 0x7f69840c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.507 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7f6970067320 0x7f69700697d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 --2- 172.21.15.22:0/2445341666 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f698406c0a0 0x7f69841692c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 >> 172.21.15.22:0/2445341666 conn(0x7f69840ce600 msgr2=0x7f6984155fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:37:11.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 shutdown_connections 2023-10-08T00:37:11.508 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.506+0000 7f698b94c700 1 -- 172.21.15.22:0/2445341666 wait complete. 2023-10-08T00:37:11.508 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-08T00:37:11.518 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":573,"stamp":"2023-10-08T00:37:10.559387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2445128,"kb_used_data":21768,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752529592,"statfs":{"total":773094113280,"available":770590302208,"internally_reserved":0,"allocated":22290432,"data_stored":10684288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002578"},"pg_stats":[{"pgid":"1.0","version":"207'119","reported_seq":332,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-10-08T00:36:52.221088+0000","last_change":"2023-10-08T00:36:52.221053+0000","last_active":"2023-10-08T00:36:52.221088+0000","last_peered":"2023-10-08T00:36:52.221088+0000","last_clean":"2023-10-08T00:36:52.221088+0000","last_became_active":"2023-10-08T00:24:48.178592+0000","last_became_peered":"2023-10-08T00:24:48.178592+0000","last_unstale":"2023-10-08T00:36:52.221088+0000","last_undegraded":"2023-10-08T00:36:52.221088+0000","last_fullsized":"2023-10-08T00:36:52.221088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'119","last_scrub_stamp":"2023-10-08T00:36:52.220958+0000","last_deep_scrub":"207'119","last_deep_scrub_stamp":"2023-10-08T00:36:52.220958+0000","last_clean_scrub_stamp":"2023-10-08T00:36:52.220958+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T11:37:00.152269+0000","scrub_duration":0.0050508430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304540,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067300,"statfs":{"total":96636764160,"available":96324915200,"internally_reserved":0,"allocated":3231744,"data_stored":1778312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.34399999999999997,"15min":0.23999999999999999},"max":{"1min":0.73599999999999999,"5min":0.81000000000000005,"15min":0.83399999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.41499999999999998,"5min":0.33200000000000002,"15min":0.28599999999999998},"max":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.89700000000000002},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.39000000000000001,"5min":0.30499999999999999,"15min":0.27000000000000002},"max":{"1min":0.748,"5min":0.78500000000000003,"15min":0.81799999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.34200000000000003,"15min":0.25900000000000001},"max":{"1min":0.76100000000000001,"5min":0.80100000000000005,"15min":0.83199999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.47499999999999998,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.79400000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.443,"5min":0.372,"15min":0.28499999999999998},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.33000000000000002},"max":{"1min":0.82199999999999995,"5min":0.82399999999999995,"15min":0.875},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.308},"max":{"1min":0.73499999999999999,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.55700000000000005}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.50900000000000001,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.29999999999999999,"15min":0.254},"max":{"1min":0.71099999999999997,"5min":0.84699999999999998,"15min":0.97899999999999998},"last":0.625},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28399999999999997},"max":{"1min":0.71299999999999997,"5min":0.88300000000000001,"15min":0.89100000000000001},"last":0.432}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52100000000000002,"15min":0.53100000000000003},"min":{"1min":0.376,"5min":0.317,"15min":0.29099999999999998},"max":{"1min":0.69599999999999995,"5min":0.753,"15min":0.79000000000000004},"last":0.499},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.65700000000000003,"5min":0.87,"15min":1.048},"last":0.51400000000000001}]},{"osd":6,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.59399999999999997,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.73999999999999999,"5min":0.90500000000000003,"15min":1.0920000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59999999999999998,"15min":0.59899999999999998},"min":{"1min":0.36199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.434,"5min":0.313,"15min":0.27600000000000002},"max":{"1min":0.68899999999999995,"5min":0.79500000000000004,"15min":0.84399999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.36299999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.29599999999999999},"max":{"1min":0.76500000000000001,"5min":0.97299999999999998,"15min":1.145},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.72099999999999997,"5min":0.83899999999999997,"15min":0.873},"last":0.42199999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":1.079},"last":0.502},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.311},"max":{"1min":0.79600000000000004,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.629}]},{"osd":3,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57099999999999995,"15min":0.58199999999999996},"min":{"1min":0.40699999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77700000000000002,"5min":1.496,"15min":1.496},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":1.02,"15min":1.1160000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.317,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.59099999999999997,"5min":4.6440000000000001,"15min":4.6440000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.33800000000000002},"max":{"1min":0.70599999999999996,"5min":4.5460000000000003,"15min":4.5460000000000003},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.312,"15min":0.29399999999999998},"max":{"1min":0.67400000000000004,"5min":3.8370000000000002,"15min":3.8370000000000002},"last":0.376},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.71899999999999997,"5min":3.1520000000000001,"15min":3.1520000000000001},"last":0.57699999999999996}]},{"osd":7,"last update":"Sun Oct 8 00:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.309},"max":{"1min":0.66200000000000003,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.59599999999999997,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.441}]}]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308056,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063784,"statfs":{"total":96636764160,"available":96321314816,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.26800000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.59199999999999997,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.35899999999999999},"min":{"1min":0.26600000000000001,"5min":0.23899999999999999,"15min":0.218},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38700000000000001}]},{"osd":2,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.433},{"interface":"front","average":{"1min":0.439,"5min":0.39200000000000002,"15min":0.38300000000000001},"min":{"1min":0.34100000000000003,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.433},"min":{"1min":0.40899999999999997,"5min":0.27100000000000002,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40100000000000002},"min":{"1min":0.28599999999999998,"5min":0.24199999999999999,"15min":0.20499999999999999},"max":{"1min":0.56999999999999995,"5min":0.60299999999999998,"15min":0.84699999999999998},"last":0.32900000000000001}]},{"osd":4,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.621},"min":{"1min":0.41599999999999998,"5min":0.33500000000000002,"15min":0.314},"max":{"1min":0.86799999999999999,"5min":0.95999999999999996,"15min":1.218},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64600000000000002,"15min":0.629},"min":{"1min":0.50900000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88100000000000001,"5min":1.101,"15min":1.101},"last":0.75900000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.436,"5min":0.34999999999999998,"15min":0.311},"max":{"1min":0.79800000000000004,"5min":1.121,"15min":1.294},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.52800000000000002,"5min":0.40799999999999997,"15min":0.34200000000000003},"max":{"1min":0.84999999999999998,"5min":1.1319999999999999,"15min":1.2549999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61099999999999999,"15min":0.59899999999999998},"min":{"1min":0.42899999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.871,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.629,"15min":0.63},"min":{"1min":0.45800000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.92700000000000005,"5min":1.1120000000000001,"15min":1.278},"last":0.73999999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:36:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.497,"5min":0.38400000000000001,"15min":0.35799999999999998},"max":{"1min":0.91100000000000003,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.81599999999999995,"5min":0.89600000000000002,"15min":1.087},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308636,"kb_used_data":3156,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063204,"statfs":{"total":96636764160,"available":96320720896,"internally_reserved":0,"allocated":3231744,"data_stored":1778312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35999999999999999,"15min":0.34999999999999998},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.308},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39600000000000002,"15min":0.371},"min":{"1min":0.28299999999999997,"5min":0.20899999999999999,"15min":0.19900000000000001},"max":{"1min":0.59099999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.377}]},{"osd":2,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41399999999999998,"15min":0.38600000000000001},"min":{"1min":0.308,"5min":0.249,"15min":0.245},"max":{"1min":0.629,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.42199999999999999,"15min":0.39700000000000002},"min":{"1min":0.32000000000000001,"5min":0.25,"15min":0.20699999999999999},"max":{"1min":0.628,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42799999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.38900000000000001,"15min":0.375},"min":{"1min":0.251,"5min":0.251,"15min":0.20399999999999999},"max":{"1min":0.56200000000000006,"5min":0.749,"15min":0.749},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46000000000000002,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.29399999999999998,"15min":0.255},"max":{"1min":0.64000000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.5}]},{"osd":4,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.65100000000000002,"15min":0.622},"min":{"1min":0.36799999999999999,"5min":0.34000000000000002,"15min":0.33800000000000002},"max":{"1min":0.92500000000000004,"5min":1.085,"15min":1.085},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67300000000000004,"15min":0.63800000000000001},"min":{"1min":0.46400000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91400000000000003,"5min":1.002,"15min":1.0369999999999999},"last":0.628}]},{"osd":5,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.63},"min":{"1min":0.45300000000000001,"5min":0.39300000000000002,"15min":0.33600000000000002},"max":{"1min":0.93899999999999995,"5min":0.96099999999999997,"15min":1.242},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.86699999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.65600000000000003,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84999999999999998,"5min":0.94699999999999995,"15min":1.0800000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":0.89600000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 00:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65900000000000003,"15min":0.628},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.375},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0529999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63400000000000001,"15min":0.625},"min":{"1min":0.44700000000000001,"5min":0.41699999999999998,"15min":0.37},"max":{"1min":0.87,"5min":1.0249999999999999,"15min":1.1020000000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.253,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.57399999999999995,"5min":0.58099999999999996,"15min":0.60899999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29499999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.59099999999999997,"5min":0.65900000000000003,"15min":0.96799999999999997},"last":0.432}]},{"osd":1,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.38,"15min":0.371},"min":{"1min":0.34699999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.65000000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.39800000000000002,"15min":0.39700000000000002},"min":{"1min":0.34499999999999997,"5min":0.26800000000000002,"15min":0.23599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.376,"15min":0.372},"min":{"1min":0.311,"5min":0.248,"15min":0.23000000000000001},"max":{"1min":0.55500000000000005,"5min":0.59399999999999997,"15min":0.60799999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.40899999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.70199999999999996},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59799999999999998,"15min":0.58399999999999996},"min":{"1min":0.48899999999999999,"5min":0.41799999999999998,"15min":0.33000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63100000000000001,"15min":0.63},"min":{"1min":0.58499999999999996,"5min":0.42399999999999999,"15min":0.40999999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.0760000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.55400000000000005,"5min":0.379,"15min":0.36599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.93400000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.56399999999999995,"5min":0.45100000000000001,"15min":0.34899999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.278},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.63200000000000001,"15min":0.63700000000000001},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.38100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.137},"last":0.753},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.48499999999999999,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Sun Oct 8 00:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.52400000000000002,"5min":0.42399999999999999,"15min":0.40699999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.1259999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.343},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575001,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308056,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063784,"statfs":{"total":96636764160,"available":96321314816,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.379,"15min":0.35499999999999998},"min":{"1min":0.246,"5min":0.224,"15min":0.224},"max":{"1min":0.54500000000000004,"5min":0.59699999999999998,"15min":0.66600000000000004},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.40000000000000002,"15min":0.376},"min":{"1min":0.27500000000000002,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.38700000000000001}]},{"osd":1,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.377,"15min":0.35499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.22800000000000001},"max":{"1min":0.51500000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.38300000000000001},"min":{"1min":0.29199999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.59599999999999997,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.41899999999999998},"min":{"1min":0.29699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.66200000000000003,"5min":0.69299999999999995,"15min":0.70699999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48699999999999999,"15min":0.45400000000000001},"min":{"1min":0.35499999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.67200000000000004,"5min":0.69699999999999995,"15min":0.79700000000000004},"last":0.432}]},{"osd":4,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.82199999999999995,"5min":0.85299999999999998,"15min":1.47},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.35899999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.96399999999999997},"last":0.76400000000000001}]},{"osd":5,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77700000000000002,"5min":0.91200000000000003,"15min":0.99099999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.36699999999999999},"max":{"1min":0.90100000000000002,"5min":0.93000000000000005,"15min":1.385},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.40999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.0269999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66500000000000004,"15min":0.64600000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.39000000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.996},"last":0.56899999999999995}]},{"osd":7,"last update":"Sun Oct 8 00:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":1.4319999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.45000000000000001,"15min":0.435},"max":{"1min":0.875,"5min":0.92800000000000005,"15min":1.006},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.502},"min":{"1min":0.40699999999999997,"5min":0.30499999999999999,"15min":0.246},"max":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.91600000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.53700000000000003},"min":{"1min":0.41199999999999998,"5min":0.32200000000000001,"15min":0.28999999999999998},"max":{"1min":0.74399999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.373,"5min":0.34599999999999997,"15min":0.34200000000000003},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.33800000000000002},"max":{"1min":0.72899999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58399999999999996,"15min":0.58799999999999997},"min":{"1min":0.49099999999999999,"5min":0.38,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.82999999999999996,"15min":1.712},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.34399999999999997},"max":{"1min":0.64100000000000001,"5min":0.86599999999999999,"15min":1.21},"last":0.49099999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.59899999999999998},"min":{"1min":0.43099999999999999,"5min":0.39000000000000001,"15min":0.35599999999999998},"max":{"1min":0.749,"5min":0.88900000000000001,"15min":6.0960000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":0.82499999999999996,"15min":0.873},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.29499999999999998,"15min":0.28100000000000003},"max":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.83099999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79000000000000004,"5min":0.82899999999999996,"15min":1.002},"last":0.47799999999999998}]},{"osd":6,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51800000000000002,"15min":0.53600000000000003},"min":{"1min":0.371,"5min":0.34699999999999998,"15min":0.30399999999999999},"max":{"1min":0.65200000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.55400000000000005},"min":{"1min":0.36599999999999999,"5min":0.36399999999999999,"15min":0.32200000000000001},"max":{"1min":0.77500000000000002,"5min":0.78700000000000003,"15min":0.84199999999999997},"last":0.39000000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:37:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.54400000000000004,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.28999999999999998},"max":{"1min":0.75,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.434},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58399999999999996,"15min":0.60399999999999998},"min":{"1min":0.41899999999999998,"5min":0.34599999999999997,"15min":0.33400000000000002},"max":{"1min":0.74199999999999999,"5min":0.95199999999999996,"15min":0.97499999999999998},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303960,"kb_used_data":2576,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067880,"statfs":{"total":96636764160,"available":96325509120,"internally_reserved":0,"allocated":2637824,"data_stored":1187944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73599999999999999,"5min":0.78500000000000003,"15min":0.86699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.28799999999999998},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60499999999999998}]},{"osd":1,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55200000000000005,"15min":0.58399999999999996},"min":{"1min":0.41999999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.73399999999999999,"5min":0.89800000000000002,"15min":2.4169999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54900000000000004},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.32300000000000001},"max":{"1min":0.71199999999999997,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.56899999999999995},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.77000000000000002,"15min":0.88300000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.46000000000000002,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.79600000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73499999999999999}]},{"osd":3,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63300000000000001,"15min":0.58299999999999996},"min":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.32900000000000001},"max":{"1min":0.75700000000000001,"5min":7.2800000000000002,"15min":7.2800000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.83399999999999996,"15min":2.4870000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49299999999999999,"15min":0.52300000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71199999999999997,"5min":0.73999999999999999,"15min":0.78700000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.497,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80100000000000005},"last":0.48999999999999999}]},{"osd":6,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.30199999999999999},"max":{"1min":0.76400000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.56899999999999995},"min":{"1min":0.33700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77800000000000002,"5min":0.82599999999999996,"15min":0.84399999999999997},"last":0.50900000000000001}]},{"osd":7,"last update":"Sun Oct 8 00:36:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.85199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56499999999999995,"15min":0.59199999999999997},"min":{"1min":0.379,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.61899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T00:37:11.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T00:37:11.639 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.638+0000 7fae8dcbf700 1 Processor -- start 2023-10-08T00:37:11.640 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.638+0000 7fae8dcbf700 1 -- start start 2023-10-08T00:37:11.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae8dcbf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae881597d0 0x7fae8806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae8dcbf700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fae88159ba0 0x7fae8806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.642 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae8dcbf700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae880b13d0 con 0x7fae880c8da0 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae8dcbf700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae880c9910 con 0x7fae88159ba0 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae8dcbf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae88069fa0 con 0x7fae881597d0 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae87fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fae880c8da0 0x7fae880c9200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57106/0 (socket says 172.21.15.22:57106) 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.639+0000 7fae87fff700 1 -- 172.21.15.22:0/3472737812 learned_addr learned my addr 172.21.15.22:0/3472737812 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae86ffd700 1 --2- 172.21.15.22:0/3472737812 >> v2:172.21.15.192:3300/0 conn(0x7fae88159ba0 0x7fae8806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae877fe700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae881597d0 0x7fae8806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.643 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae867fc700 1 -- 172.21.15.22:0/3472737812 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157292882 0 0) 0x7fae880b13d0 con 0x7fae880c8da0 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae867fc700 1 -- 172.21.15.22:0/3472737812 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae70003570 con 0x7fae880c8da0 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae86ffd700 1 -- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae881597d0 msgr2=0x7fae8806ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae86ffd700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae881597d0 0x7fae8806ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae86ffd700 1 -- 172.21.15.22:0/3472737812 >> v1:172.21.15.22:6789/0 conn(0x7fae880c8da0 legacy=0x7fae880c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae86ffd700 1 -- 172.21.15.22:0/3472737812 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880c9af0 con 0x7fae88159ba0 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae877fe700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae881597d0 0x7fae8806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T00:37:11.644 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae86ffd700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae8806bfc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0098e0 tx=0x7fae7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1db03e59c4da741f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae867fc700 1 -- 172.21.15.22:0/3472737812 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011630 con 0x7fae88159ba0 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae867fc700 1 -- 172.21.15.22:0/3472737812 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c011790 con 0x7fae88159ba0 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.640+0000 7fae867fc700 1 -- 172.21.15.22:0/3472737812 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011b10 con 0x7fae88159ba0 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 -- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 msgr2=0x7fae8806bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae8806bfc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0098e0 tx=0x7fae7c0091a0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 -- 172.21.15.22:0/3472737812 shutdown_connections 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae881597d0 0x7fae8806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.645 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/3472737812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae8806bfc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 -- 172.21.15.22:0/3472737812 >> 172.21.15.22:0/3472737812 conn(0x7fae880ce610 msgr2=0x7fae880cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:37:11.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 -- 172.21.15.22:0/3472737812 shutdown_connections 2023-10-08T00:37:11.646 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.641+0000 7fae8dcbf700 1 -- 172.21.15.22:0/3472737812 wait complete. 2023-10-08T00:37:11.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.642+0000 7fae8dcbf700 1 Processor -- start 2023-10-08T00:37:11.648 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.642+0000 7fae8dcbf700 1 -- start start 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae8dcbf700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae880c8da0 0x7fae88142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae8dcbf700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 0x7fae880b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae8dcbf700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae880c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae8dcbf700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae88142640 con 0x7fae881597d0 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae8dcbf700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae880c80b0 con 0x7fae88159ba0 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae8dcbf700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae880b22b0 con 0x7fae880c8da0 2023-10-08T00:37:11.649 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae86ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 0x7fae880b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae86ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 0x7fae880b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49270/0 (socket says 172.21.15.22:49270) 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae86ffd700 1 -- 172.21.15.22:0/1064253117 learned_addr learned my addr 172.21.15.22:0/1064253117 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae877fe700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae880c8da0 0x7fae88142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.643+0000 7fae87fff700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae880c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae86ffd700 1 -- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae880c8da0 msgr2=0x7fae88142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae86ffd700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae880c8da0 0x7fae88142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae86ffd700 1 -- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 msgr2=0x7fae880c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.650 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae86ffd700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae880c3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae86ffd700 1 -- 172.21.15.22:0/1064253117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78009420 con 0x7fae881597d0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae86ffd700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 0x7fae880b1d70 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009ed0 tx=0x7fae7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c011900 con 0x7fae881597d0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c011a60 con 0x7fae881597d0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c01a680 con 0x7fae881597d0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c009420 con 0x7fae881597d0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.644+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae880c7780 con 0x7fae881597d0 2023-10-08T00:37:11.651 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.645+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae880c8240 con 0x7fae881597d0 2023-10-08T00:37:11.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.646+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fae7c01aa30 con 0x7fae881597d0 2023-10-08T00:37:11.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.646+0000 7fae6f7fe700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae74067350 0x7fae74069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.646+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fae7c085d10 con 0x7fae881597d0 2023-10-08T00:37:11.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.646+0000 7fae877fe700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae74067350 0x7fae74069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.647+0000 7fae877fe700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae74067350 0x7fae74069800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fae78009f40 tx=0x7fae780091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.652 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.650+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae7c052ca0 con 0x7fae881597d0 2023-10-08T00:37:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.844+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fae880c8440 con 0x7fae881597d0 2023-10-08T00:37:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.847+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fae7c052ca0 con 0x7fae881597d0 2023-10-08T00:37:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.848+0000 7fae6f7fe700 1 -- 172.21.15.22:0/1064253117 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) v1 ==== 123+0+0 (secure 0 0 0) 0x7fae7c0150c0 con 0x7fae881597d0 2023-10-08T00:37:11.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae74067350 msgr2=0x7fae74069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae74067350 0x7fae74069800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fae78009f40 tx=0x7fae780091a0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 msgr2=0x7fae880b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 0x7fae880b1d70 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fae7c009ed0 tx=0x7fae7c017000 comp rx=0 tx=0).stop 2023-10-08T00:37:11.851 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 shutdown_connections 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fae88159ba0 0x7fae880c3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7fae74067350 0x7fae74069800 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fae880c8da0 0x7fae88142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 --2- 172.21.15.22:0/1064253117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae881597d0 0x7fae880b1d70 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 >> 172.21.15.22:0/1064253117 conn(0x7fae880ce610 msgr2=0x7fae8806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 shutdown_connections 2023-10-08T00:37:11.852 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.850+0000 7fae8dcbf700 1 -- 172.21.15.22:0/1064253117 wait complete. 2023-10-08T00:37:11.863 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T00:37:11.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T00:37:11.982 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.982+0000 7ffb3b89d700 1 Processor -- start 2023-10-08T00:37:11.983 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.982+0000 7ffb3b89d700 1 -- start start 2023-10-08T00:37:11.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb3b89d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb34159c60 0x7ffb3415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.991 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb3b89d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3415a160 con 0x7ffb34159890 2023-10-08T00:37:11.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb3b89d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340d13a0 con 0x7ffb3415db10 2023-10-08T00:37:11.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb3b89d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3415df50 con 0x7ffb34159c60 2023-10-08T00:37:11.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb39639700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ffb34159890 0x7ffb3415abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57108/0 (socket says 172.21.15.22:57108) 2023-10-08T00:37:11.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb39639700 1 -- 172.21.15.22:0/124325769 learned_addr learned my addr 172.21.15.22:0/124325769 (peer_addr_for_me v1:172.21.15.22:0/0) 2023-10-08T00:37:11.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb38e38700 1 --2- 172.21.15.22:0/124325769 >> v2:172.21.15.192:3300/0 conn(0x7ffb34159c60 0x7ffb3415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.992 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb2bfff700 1 -- 172.21.15.22:0/124325769 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426647114 0 0) 0x7ffb3415a160 con 0x7ffb34159890 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb2bfff700 1 -- 172.21.15.22:0/124325769 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb20003570 con 0x7ffb34159890 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb38e38700 1 -- 172.21.15.22:0/124325769 >> v1:172.21.15.192:6789/0 conn(0x7ffb3415db10 legacy=0x7ffb34069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb38e38700 1 -- 172.21.15.22:0/124325769 >> v1:172.21.15.22:6789/0 conn(0x7ffb34159890 legacy=0x7ffb3415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.983+0000 7ffb38e38700 1 -- 172.21.15.22:0/124325769 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3415e140 con 0x7ffb34159c60 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb38e38700 1 --2- 172.21.15.22:0/124325769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb3415d5d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ffb240098e0 tx=0x7ffb240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1838392fc5af45b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb2bfff700 1 -- 172.21.15.22:0/124325769 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400b640 con 0x7ffb34159c60 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb2bfff700 1 -- 172.21.15.22:0/124325769 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffb2400b7a0 con 0x7ffb34159c60 2023-10-08T00:37:11.993 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb2bfff700 1 -- 172.21.15.22:0/124325769 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400bb60 con 0x7ffb34159c60 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb3b89d700 1 -- 172.21.15.22:0/124325769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 msgr2=0x7ffb3415d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/124325769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb3415d5d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ffb240098e0 tx=0x7ffb240091a0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb3b89d700 1 -- 172.21.15.22:0/124325769 shutdown_connections 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/124325769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb3415d5d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.984+0000 7ffb3b89d700 1 -- 172.21.15.22:0/124325769 >> 172.21.15.22:0/124325769 conn(0x7ffb34068e20 msgr2=0x7ffb340d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.985+0000 7ffb3b89d700 1 -- 172.21.15.22:0/124325769 shutdown_connections 2023-10-08T00:37:11.994 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.985+0000 7ffb3b89d700 1 -- 172.21.15.22:0/124325769 wait complete. 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.986+0000 7ffb3b89d700 1 Processor -- start 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.986+0000 7ffb3b89d700 1 -- start start 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 0x7ffb34169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb340b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3415db10 0x7ffb340c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340b4e20 con 0x7ffb34159890 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340cece0 con 0x7ffb34159c60 2023-10-08T00:37:11.995 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340cd350 con 0x7ffb3415db10 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 0x7ffb34169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 0x7ffb34169eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49274/0 (socket says 172.21.15.22:49274) 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 -- 172.21.15.22:0/2494519446 learned_addr learned my addr 172.21.15.22:0/2494519446 (peer_addr_for_me v2:172.21.15.22:0/0) 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb38e38700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb340b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39e3a700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3415db10 0x7ffb340c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 -- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3415db10 msgr2=0x7ffb340c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.996 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3415db10 0x7ffb340c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 -- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 msgr2=0x7ffb340b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb340b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 -- 172.21.15.22:0/2494519446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009420 con 0x7ffb34159890 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb38e38700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb340b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb39639700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 0x7ffb34169eb0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c590 tx=0x7ffb30007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30005b30 con 0x7ffb34159890 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffb30005cb0 con 0x7ffb34159890 2023-10-08T00:37:11.997 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb340b4860 con 0x7ffb34159890 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30007340 con 0x7ffb34159890 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.987+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340ce970 con 0x7ffb34159890 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.988+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3404c3c0 con 0x7ffb34159890 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.989+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffb3001b3b0 con 0x7ffb34159890 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.989+0000 7ffb297fa700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb18067320 0x7ffb180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.989+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ffb30083f30 con 0x7ffb34159890 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.990+0000 7ffb38e38700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb18067320 0x7ffb180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T00:37:11.998 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.990+0000 7ffb38e38700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb18067320 0x7ffb180697d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ffb240093f0 tx=0x7ffb240091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T00:37:11.999 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:11.994+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb30050f40 con 0x7ffb34159890 2023-10-08T00:37:12.230 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.230+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb340b0120 con 0x7ffb34159890 2023-10-08T00:37:12.231 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.230+0000 7ffb297fa700 1 -- 172.21.15.22:0/2494519446 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 139 v139) v1 ==== 95+0+3537 (secure 0 0 0) 0x7ffb30017090 con 0x7ffb34159890 2023-10-08T00:37:12.231 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-08T00:37:12.231 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":139,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2318568472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2318568472},{"type":"v1","addr":"172.21.15.192:6836","nonce":2318568472}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":7349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2358548841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2358548841},{"type":"v1","addr":"172.21.15.192:6837","nonce":2358548841}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3929191852","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3929191852},{"type":"v1","addr":"172.21.15.22:6835","nonce":3929191852}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":9087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6834/621192817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6833","nonce":621192817},{"type":"v1","addr":"172.21.15.22:6834","nonce":621192817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[]} 2023-10-08T00:37:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb18067320 msgr2=0x7ffb180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb18067320 0x7ffb180697d0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ffb240093f0 tx=0x7ffb240091a0 comp rx=0 tx=0).stop 2023-10-08T00:37:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 msgr2=0x7ffb34169eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T00:37:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 0x7ffb34169eb0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000c590 tx=0x7ffb30007e00 comp rx=0 tx=0).stop 2023-10-08T00:37:12.233 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 shutdown_connections 2023-10-08T00:37:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:6832/90533,v1:172.21.15.192:6833/90533] conn(0x7ffb18067320 0x7ffb180697d0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb3415db10 0x7ffb340c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb34159890 0x7ffb34169eb0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 --2- 172.21.15.22:0/2494519446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb34159c60 0x7ffb340b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T00:37:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 >> 172.21.15.22:0/2494519446 conn(0x7ffb34068e20 msgr2=0x7ffb340c5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T00:37:12.234 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 shutdown_connections 2023-10-08T00:37:12.235 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-08T00:37:12.232+0000 7ffb3b89d700 1 -- 172.21.15.22:0/2494519446 wait complete. 2023-10-08T00:37:12.235 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 139 2023-10-08T00:37:12.245 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-08T00:37:12.245 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T00:37:12.245 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T00:37:12.246 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.254 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T00:37:12.254 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T00:37:12.254 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.303 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T00:37:12.303 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T00:37:12.304 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.314 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T00:37:12.315 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T00:37:12.315 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.365 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T00:37:12.366 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T00:37:12.366 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T00:37:12.366 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.395 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T00:37:12.395 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T00:37:12.395 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.464 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T00:37:12.464 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T00:37:12.465 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.532 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T00:37:12.533 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T00:37:12.533 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.597 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T00:37:12.598 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T00:37:12.598 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.633 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T00:37:12.633 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T00:37:12.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.708 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T00:37:12.708 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T00:37:12.709 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.780 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T00:37:12.780 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T00:37:12.781 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.857 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T00:37:12.857 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T00:37:12.857 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T00:37:12.858 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.882 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T00:37:12.882 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T00:37:12.882 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.924 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T00:37:12.924 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T00:37:12.924 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T00:37:12.925 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.936 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T00:37:12.936 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T00:37:12.937 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:12.975 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T00:37:12.975 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T00:37:12.976 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T00:37:13.026 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T00:37:13.026 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T00:37:13.027 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-08T00:37:13.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:37:13.061 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T00:37:13.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:37:13.326 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T00:37:13.429 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:37:13.430 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T00:37:13.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:37:13.500 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T00:37:13.587 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:37:13.587 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T00:37:13.750 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:37:13.750 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T00:37:13.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:37:13.836 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T00:37:13.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:37:13.919 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T00:37:13.988 INFO:tasks.ceph:Archiving mon data... 2023-10-08T00:37:13.990 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/data/mon.a.tgz 2023-10-08T00:37:13.990 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-10-08T00:37:14.006 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.4rwCFfq0Hz 2023-10-08T00:37:14.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4rwCFfq0Hz 2023-10-08T00:37:14.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.4rwCFfq0Hz 2023-10-08T00:37:14.274 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.4rwCFfq0Hz is 591KB 2023-10-08T00:37:14.375 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.4rwCFfq0Hz 2023-10-08T00:37:14.390 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/data/mon.b.tgz 2023-10-08T00:37:14.391 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-10-08T00:37:14.407 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.RAB34neuYg 2023-10-08T00:37:14.407 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RAB34neuYg 2023-10-08T00:37:14.586 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.RAB34neuYg 2023-10-08T00:37:14.667 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.RAB34neuYg is 601KB 2023-10-08T00:37:14.765 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.RAB34neuYg 2023-10-08T00:37:14.779 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/data/mon.c.tgz 2023-10-08T00:37:14.779 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-10-08T00:37:14.833 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.pIwsdCOSeL 2023-10-08T00:37:14.833 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pIwsdCOSeL 2023-10-08T00:37:14.999 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.pIwsdCOSeL 2023-10-08T00:37:15.080 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.pIwsdCOSeL is 601KB 2023-10-08T00:37:15.178 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.pIwsdCOSeL 2023-10-08T00:37:15.192 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T00:37:15.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T00:37:15.196 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T00:37:15.255 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T00:37:15.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T00:37:15.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T00:37:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T00:37:15.321 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T00:37:15.327 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T00:37:15.329 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/remote/smithi022/crash 2023-10-08T00:37:15.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T00:37:15.366 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/remote/smithi192/crash 2023-10-08T00:37:15.367 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T00:37:15.391 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T00:37:15.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:37:15.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T00:37:15.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T00:37:15.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T00:37:15.533 INFO:tasks.ceph:Compressing logs... 2023-10-08T00:37:15.533 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T00:37:15.552 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T00:37:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97732.log 2023-10-08T00:37:15.576 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105054.log 2023-10-08T00:37:15.618 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99905.log 2023-10-08T00:37:15.618 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90807.log 2023-10-08T00:37:15.619 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.99905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100682.log 2023-10-08T00:37:15.619 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99905.log.gz 2023-10-08T00:37:15.619 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101089.log 2023-10-08T00:37:15.619 INFO:teuthology.orchestra.run.smithi192.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90807.log.gz 2023-10-08T00:37:15.619 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.100682.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T00:37:15.619 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100682.log.gz 2023-10-08T00:37:15.620 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.101089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97803.log 2023-10-08T00:37:15.620 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101089.log.gz 2023-10-08T00:37:15.620 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102291.log 2023-10-08T00:37:15.620 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.3.97803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98983.log 2023-10-08T00:37:15.620 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97803.log.gz 2023-10-08T00:37:15.620 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.102291.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.1.102291.log.gz/var/log/ceph/ceph-client.1.101509.log 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.98983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98185.log 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98983.log.gz 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.101509.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101509.log.gz 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.98185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90892.log 2023-10-08T00:37:15.621 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98185.log.gz 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97433.log 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99909.log 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.97433.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90892.log.gz 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97433.log.gz 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99514.log 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.99909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99909.log.gz 2023-10-08T00:37:15.622 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100299.log 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.99514.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99514.log.gz 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.100299.log: gzip 92.1%-5 --verbose -- replaced with /var/log/ceph/ceph.log.gz-- 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.d.log 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100299.log.gz 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90850.log 2023-10-08T00:37:15.623 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.97799.log 2023-10-08T00:37:15.625 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101891.log 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.3.97799.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90850.log.gz 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97799.log.gz 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.101891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101891.log.gz 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100678.log 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.100678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98979.log 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100678.log.gz 2023-10-08T00:37:15.626 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.1.98979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98979.log.gz 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102680.log 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98189.log 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.102680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102680.log.gz 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.98189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98189.log.gz 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101505.log 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T00:37:15.627 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.101505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90979.log 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101505.log.gz 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 /var/log/ceph/ceph-mds.b.log: --verbose -- /var/log/ceph/ceph-client.1.102295.log 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90979.log: /var/log/ceph/ceph-client.1.102295.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90979.log.gz 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102295.log.gz 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97441.log 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T00:37:15.628 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.97441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97441.log.gz 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98594.log 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.98594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98594.log.gz 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91022.log 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.91022.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91022.log.gz 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101887.log 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.101887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101887.log.gz 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99510.log 2023-10-08T00:37:15.629 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.99510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99510.log.gz 2023-10-08T00:37:15.630 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T00:37:15.630 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100303.log 2023-10-08T00:37:15.631 INFO:teuthology.orchestra.run.smithi192.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T00:37:15.631 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.100303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100303.log.gz 2023-10-08T00:37:15.631 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102684.log 2023-10-08T00:37:15.638 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.102684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102684.log.gz 2023-10-08T00:37:15.638 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90766.log 2023-10-08T00:37:15.638 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90766.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.90766.log.gz 2023-10-08T00:37:15.638 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90726.log 2023-10-08T00:37:15.643 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90726.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90726.log.gz 2023-10-08T00:37:15.643 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T00:37:15.650 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101093.log 2023-10-08T00:37:15.655 INFO:teuthology.orchestra.run.smithi192.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-08T00:37:15.662 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.101093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101093.log.gz 2023-10-08T00:37:15.663 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98598.log 2023-10-08T00:37:15.663 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.98598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98598.log.gz 2023-10-08T00:37:15.663 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90938.log 2023-10-08T00:37:15.663 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.admin.90938.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.90938.log.gz 2023-10-08T00:37:15.778 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164979.log 2023-10-08T00:37:15.778 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108239.log 2023-10-08T00:37:15.778 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.97732.log.gz 2023-10-08T00:37:15.778 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105054.log: /var/log/ceph/ceph-client.admin.164979.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84585.log 2023-10-08T00:37:15.778 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105054.log.gz 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108239.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164979.log.gz 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162879.log 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108239.log.gz 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.tmp-client.admin.84585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108323.log 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84585.log.gz 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180029.log 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157553.log 2023-10-08T00:37:15.779 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162879.log.gz 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108323.log.gz 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164078.log 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2%/var/log/ceph/ceph-client.admin.157553.log: -- replaced with /var/log/ceph/ceph-client.admin.180029.log.gz 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170694.log 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164078.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157553.log.gz 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100883.log 2023-10-08T00:37:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.170694.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164078.log.gz 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170819.log 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170694.log.gz 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174611.log 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100883.log.gz 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179277.log 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.170819.log.gz 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161677.log 2023-10-08T00:37:15.781 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6%/var/log/ceph/ceph-client.admin.179277.log: -- replaced with /var/log/ceph/ceph-client.admin.174611.log.gz 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157942.log 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161677.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179277.log.gz 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169800.log 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157942.log: gzip 89.2%-5 --verbose -- /var/log/ceph/ceph-client.admin.97055.log 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161677.log.gz 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97393.log 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106778.log 2023-10-08T00:37:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169800.log: /var/log/ceph/ceph-client.admin.97055.log: /var/log/ceph/ceph-client.admin.97393.log: gzip 89.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.157942.log.gz-- 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158668.log 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169800.log.gz 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106778.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97055.log.gz 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr:gzip 88.6%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.97393.log.gz/var/log/ceph/ceph-client.admin.98458.log 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106778.log.gz 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170053.log 2023-10-08T00:37:15.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161144.log 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158668.log.gz 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180113.log 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98458.log.gz 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170053.log.gz/var/log/ceph/ceph-client.admin.161144.log: 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174717.log 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161144.log.gz 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169188.log 2023-10-08T00:37:15.784 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180113.log.gz 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159598.log 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174717.log.gz 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179777.log 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102613.log 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169188.log.gz 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159598.log.gz 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176752.log 2023-10-08T00:37:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102613.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.179777.log.gz 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.168177.log 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176752.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102613.log.gz 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98500.log 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176752.log.gz 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106590.log 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167789.log 2023-10-08T00:37:15.786 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.168177.log.gz 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96409.log /var/log/ceph/ceph-client.admin.106590.log: 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98500.log.gz 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165021.log 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106590.log.gz 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96409.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167789.log.gz 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107194.log 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165021.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96409.log.gz 2023-10-08T00:37:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104800.log 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107194.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.165021.log.gz 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98878.log 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107194.log.gz 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105753.log 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98878.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104800.log.gz 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161761.log 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105753.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98878.log.gz 2023-10-08T00:37:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98920.log 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105753.log.gz 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97139.log 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98920.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161761.log.gz 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164470.log 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169628.log 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97139.log.gz 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.98920.log.gz 2023-10-08T00:37:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172763.log 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96751.log 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164470.log.gz 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6%/var/log/ceph/ceph-client.admin.172763.log: -- replaced with /var/log/ceph/ceph-client.admin.169628.log.gz 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100669.log 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172763.log.gz 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157891.log 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100669.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96751.log.gz 2023-10-08T00:37:15.790 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98085.log 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157891.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100669.log.gzgzip 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.176416.log 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157891.log.gz 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174350.log 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98085.log.gz 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174961.log 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174350.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176416.log.gz 2023-10-08T00:37:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166493.log 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174350.log.gz 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172035.log 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166995.log 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174961.log.gz 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107456.log 88.2% 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166493.log.gz 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172035.log.gz 2023-10-08T00:37:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96529.log 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107456.log: 87.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.166995.log.gz--verbose 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.97394.log 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96529.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107456.log.gz 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156721.log 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96529.log.gz 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178452.log 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97394.log.gz 2023-10-08T00:37:15.793 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102269.log 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178452.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156721.log.gz 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159369.log 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.178452.log.gz/var/log/ceph/ceph-client.admin.102269.log: 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107851.log 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102269.log.gz 2023-10-08T00:37:15.794 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.a.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159369.log.gz 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102395.log 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162403.log 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98416.log 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162403.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102395.log.gz 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.107851.log.gz 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161534.log 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162403.log.gz 2023-10-08T00:37:15.795 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179403.log 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98416.log: /var/log/ceph/ceph-client.admin.161534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169712.log 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98416.log.gz 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160504.log 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161534.log.gz 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179403.log.gz 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171435.log 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169712.log.gz 2023-10-08T00:37:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100290.log 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160504.log.gz/var/log/ceph/ceph-client.admin.171435.log: 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176500.log 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171435.log.gzgzip 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.168978.log 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176500.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.100290.log.gz-5 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:--verbose -- /var/log/ceph/ceph-client.admin.98752.log 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168978.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176500.log.gz 2023-10-08T00:37:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159556.log 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168978.log.gz 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171393.log 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159556.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98752.log.gz 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161635.log 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171393.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159556.log.gz 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179193.log 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.171393.log.gz 2023-10-08T00:37:15.798 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100543.log 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161635.log.gz 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178310.log 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100543.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179193.log.gz 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103976.log 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100543.log.gz 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.178310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176186.log 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178310.log.gz 2023-10-08T00:37:15.799 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106540.log 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178857.log 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103976.log.gz 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176186.log.gz 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180449.log 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2%/var/log/ceph/ceph-client.admin.178857.log: -- replaced with /var/log/ceph/ceph-client.admin.106540.log.gz 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173277.log 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180449.log: gzip 89.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.178857.log.gz--verbose 2023-10-08T00:37:15.800 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.166409.log 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180449.log.gz 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171687.log 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166409.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173277.log.gz 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179109.log 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171687.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166409.log.gz 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105837.log 2023-10-08T00:37:15.801 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.171687.log.gz 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105365.log 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105837.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179109.log.gz 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157475.log 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105837.log.gz 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104758.log 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167239.log 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.105365.log.gz 2023-10-08T00:37:15.802 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104758.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157475.log.gz 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104842.log 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104758.log.gz 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163005.log 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167239.log: /var/log/ceph/ceph-client.admin.104842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98836.log 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167239.log.gz 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163005.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104842.log.gz 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180510.log 2023-10-08T00:37:15.803 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98836.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163005.log.gz 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90832.log 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180510.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98836.log.gz 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170347.log 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3%/var/log/ceph/ceph-client.admin.90832.log: -- replaced with /var/log/ceph/ceph-client.admin.180510.log.gz 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162837.log 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170347.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90832.log.gz 2023-10-08T00:37:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173472.log 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162837.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170347.log.gz 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170389.log 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162837.log.gz 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173106.log 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170389.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173472.log.gz 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170431.log 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.173106.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170389.log.gz 2023-10-08T00:37:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162361.log 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.173106.log.gz 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106269.log 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177795.log 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.170431.log.gz 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167939.log 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162361.log.gz 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106269.log.gz 2023-10-08T00:37:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159786.log 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167939.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177795.log.gz 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106674.log 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167939.log.gz 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176458.log 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169272.log 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159786.log.gz 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176458.log: 88.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.106674.log.gz--verbose 2023-10-08T00:37:15.807 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.160756.log 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176458.log.gz 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165881.log 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108281.log 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169272.log.gz 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165881.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160756.log.gz 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104061.log 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165881.log.gz 2023-10-08T00:37:15.808 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159016.log 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104061.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108281.log.gzgzip 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.163952.log 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159016.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104061.log.gz 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173235.log 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159016.log.gz 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170497.log 2023-10-08T00:37:15.809 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179945.log 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163952.log.gz 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170497.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.173235.log.gz 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178005.log 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170497.log.gz 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159946.log 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178005.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179945.log.gzgzip 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.106980.log 2023-10-08T00:37:15.810 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159946.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178005.log.gz 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161450.log 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159946.log.gz 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165713.log 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161450.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.106980.log.gz--verbose 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.104291.log 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165713.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161450.log.gz 2023-10-08T00:37:15.811 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179361.log 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165713.log.gz 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100038.log 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175395.log 88.1% 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104291.log.gz 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100038.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179361.log.gz 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178306.log 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100038.log.gz 2023-10-08T00:37:15.812 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172913.log 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.178306.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175395.log.gz 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165755.log 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178306.log.gz 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173682.log 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172913.log.gz 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163352.log 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165755.log.gz 2023-10-08T00:37:15.813 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101709.log 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.163352.log: gzip -5 87.5%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.173682.log.gz/var/log/ceph/ceph-client.admin.169020.log 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163352.log.gz 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164036.log 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169020.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101709.log.gz 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103043.log 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169020.log.gz 2023-10-08T00:37:15.814 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179235.log 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 /var/log/ceph/ceph-client.admin.103043.log: --verbose -- /var/log/ceph/ceph-client.admin.175003.log 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164036.log.gz 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107917.log 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103043.log.gz 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179235.log.gz 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97972.log 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175003.log.gz 2023-10-08T00:37:15.815 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105879.log 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97972.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107917.log.gz 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97387.log 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97972.log.gz 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157159.log 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97387.log: gzip -5 88.1%--verbose -- /var/log/ceph/ceph-client.admin.97730.log -- replaced with /var/log/ceph/ceph-client.admin.105879.log.gz 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.816 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157159.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97387.log.gz 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166535.log 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157159.log.gz 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167579.log 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166535.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97730.log.gz 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179151.log 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97395.log 89.4% 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166535.log.gz 2023-10-08T00:37:15.817 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167579.log.gz 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163477.log 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177541.log 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179151.log.gz 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163477.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97395.log.gz 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157057.log 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.163477.log.gz 2023-10-08T00:37:15.818 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168852.log 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157057.log: gzip -5 88.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.177541.log.gz/var/log/ceph/ceph-client.admin.158364.log 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168852.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157057.log.gz 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162139.log 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168852.log.gz 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173870.log 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167663.log 2023-10-08T00:37:15.819 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173870.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.158364.log.gz 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.162139.log.gz--verbose -- 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106101.log 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173870.log.gz 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172469.log 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106101.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.167663.log.gzgzip 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.169454.log 2023-10-08T00:37:15.820 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106101.log.gz 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107106.log 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169454.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172469.log.gz 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163868.log 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169454.log.gz 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162751.log 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107106.log.gz 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161803.log 2023-10-08T00:37:15.821 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165283.log 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163868.log.gz 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161803.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162751.log.gz 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168684.log 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161803.log.gz 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160546.log 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173912.log 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165283.log.gz 2023-10-08T00:37:15.822 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160546.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168684.log.gz 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160546.log.gz 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167073.log 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- 88.1%/var/log/ceph/ceph-client.admin.106632.log 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173912.log.gz 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170095.log 2023-10-08T00:37:15.823 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167073.log.gz 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175479.log 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106632.log.gz 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156889.log 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170095.log: /var/log/ceph/ceph-client.admin.175479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164672.log 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170095.log.gz 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156889.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175479.log.gz 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171015.log 2023-10-08T00:37:15.824 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156889.log.gz 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171729.log 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164672.log.gz 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97386.log 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171015.log: /var/log/ceph/ceph-client.admin.171729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96843.log 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171015.log.gz 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97386.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171729.log.gz 2023-10-08T00:37:15.825 INFO:teuthology.orchestra.run.smithi022.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173724.log 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160462.log 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96843.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97386.log.gz 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161228.log 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96843.log.gz 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173724.log.gz 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173369.log 2023-10-08T00:37:15.826 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161228.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160462.log.gz 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166086.log 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161228.log.gz 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169544.log 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166086.log: gzip -5 --verbose -- 88.5%/var/log/ceph/ceph-client.2.99867.log 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.173369.log.gz 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166086.log.gz 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104886.log 2023-10-08T00:37:15.827 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169544.log.gz 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.2.99867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164282.log 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.99867.log.gz 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180550.log 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104886.log.gz 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166764.log 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.164282.log.gz/var/log/ceph/ceph-client.admin.180550.log: 2023-10-08T00:37:15.829 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98374.log 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166764.log: gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.180550.log.gz/var/log/ceph/ceph-client.admin.157328.log 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98374.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166764.log.gz 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108365.log 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98374.log.gz 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163435.log 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108365.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.157328.log.gz 2023-10-08T00:37:15.830 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174443.log 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163435.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108365.log.gz 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159411.log 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163435.log.gz 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90568.log 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159411.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174443.log.gz 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101364.log 2023-10-08T00:37:15.831 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5%/var/log/ceph/ceph-client.admin.90568.log: -- replaced with /var/log/ceph/ceph-client.admin.159411.log.gz 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159243.log 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1%/var/log/ceph/ceph-client.admin.101364.log: -- replaced with /var/log/ceph/ceph-client.admin.90568.log.gz 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161492.log 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101751.log 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101364.log.gz 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161492.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.159243.log.gz 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170221.log 2023-10-08T00:37:15.832 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161492.log.gz 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97396.log 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170221.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101751.log.gz 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103257.log 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97396.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170221.log.gz 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174248.log 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97396.log.gz 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101919.log 2023-10-08T00:37:15.833 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174248.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103257.log.gz 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173110.log 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101919.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174248.log.gz 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105628.log 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101919.log.gz 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.173110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174164.log 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.173110.log.gz 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.105628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106017.log 2023-10-08T00:37:15.834 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105628.log.gz 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157015.log 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174164.log.gz 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175671.log 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157015.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106017.log.gz 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179651.log 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175671.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157015.log.gz 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175909.log 2023-10-08T00:37:15.835 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175671.log.gz 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164886.log 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175909.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179651.log.gz 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175968.log 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.175909.log.gz 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107244.log 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164886.log.gz 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162709.log 2023-10-08T00:37:15.836 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107244.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.175968.log.gz-5 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr:--verbose -- /var/log/ceph/ceph-client.admin.171225.log 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100841.log 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107244.log.gz 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.162709.log.gz 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162667.log 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100841.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171225.log.gz 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176668.log 2023-10-08T00:37:15.837 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162667.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100841.log.gz 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157761.log 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162667.log.gz 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160798.log 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98076.log 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176668.log.gz 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160798.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157761.log.gz 2023-10-08T00:37:15.838 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156847.log 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160798.log.gz 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158878.log 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4%/var/log/ceph/ceph-client.admin.156847.log: -- replaced with /var/log/ceph/ceph-client.admin.98076.log.gz 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172119.log 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178047.log 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.156847.log.gz 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158878.log.gz 2023-10-08T00:37:15.839 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179693.log 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.172119.log.gz 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100164.log 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169104.log 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179693.log.gz 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100164.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.178047.log.gz 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175089.log 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159058.log 2023-10-08T00:37:15.840 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169104.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100164.log.gz 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174290.log 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169104.log.gz 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.175089.log.gz 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178627.log 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174290.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159058.log.gz 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160714.log 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174290.log.gz 2023-10-08T00:37:15.841 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171183.log 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.178627.log.gz 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167411.log 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171183.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160714.log.gz 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177107.log 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167411.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171183.log.gz 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175605.log 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167411.log.gz 2023-10-08T00:37:15.842 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177455.log 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165433.log 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177107.log.gz 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102311.log 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177455.log.gz 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165433.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.175605.log.gz 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162097.log 2023-10-08T00:37:15.843 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165433.log.gz 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169376.log 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162097.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.102311.log.gz 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:--verbose -- /var/log/ceph/ceph-client.admin.97733.log 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162097.log.gz 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172163.log 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168936.log 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169376.log.gz 2023-10-08T00:37:15.844 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172163.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97733.log.gz 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106059.log 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172163.log.gz 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101009.log 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103211.log 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168936.log.gz 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101009.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106059.log.gz 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164181.log 2023-10-08T00:37:15.845 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101009.log.gz 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98081.log 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163784.log 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103211.log.gz 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98081.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164181.log.gz 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106896.log 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98081.log.gz 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105138.log 2023-10-08T00:37:15.846 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106896.log: 89.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.163784.log.gz--verbose -- 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106143.log 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105138.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106896.log.gz 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96971.log 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105138.log.gz 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174080.log 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96971.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.106143.log.gz--verbose 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph.audit.log 2023-10-08T00:37:15.847 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174080.log: gzip 89.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.96971.log.gz--verbose 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.108155.log 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.174080.log.gz 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102003.log 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180239.log 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102003.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108155.log.gz 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160210.log 2023-10-08T00:37:15.848 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102003.log.gz 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175269.log 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107414.log 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160210.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180239.log.gz 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101582.log 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160210.log.gz 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164937.log 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107414.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175269.log.gz 2023-10-08T00:37:15.849 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160294.log 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107414.log.gz 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173193.log 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164937.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101582.log.gz 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176584.log 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164937.log.gz 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165065.log 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173193.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160294.log.gz 2023-10-08T00:37:15.850 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176584.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173193.log.gz 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177627.log 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162055.log 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165065.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176584.log.gz 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176228.log 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165065.log.gz 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162055.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.177627.log.gz 2023-10-08T00:37:15.851 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159471.log 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176228.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.162055.log.gz--verbose 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.165839.log 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159471.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176228.log.gz 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171099.log 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159471.log.gz 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159159.log 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171099.log: gzip 88.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.165839.log.gz--verbose 2023-10-08T00:37:15.852 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.98626.log 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159159.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171099.log.gz 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102739.log 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159159.log.gz 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:gzip /var/log/ceph/ceph-client.admin.98626.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.156805.log 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158026.log 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98626.log.gz 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175868.log 2023-10-08T00:37:15.853 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156805.log.gz 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158026.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.102739.log.gz 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166722.log 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158026.log.gz 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.175868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105306.log 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175868.log.gz 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105264.log 2023-10-08T00:37:15.854 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166722.log.gz 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104928.log 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178494.log 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105306.log.gz 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177371.log 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105264.log.gz 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104928.log.gz 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156931.log 2023-10-08T00:37:15.855 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177371.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178494.log.gz 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100711.log 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156931.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177371.log.gz 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103790.log 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.156931.log.gz 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103479.log 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100711.log.gz 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102353.log 2023-10-08T00:37:15.856 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103790.log.gz 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176794.log 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157412.log 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103479.log.gz 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176794.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102353.log.gz 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176794.log.gz 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102091.log 2023-10-08T00:37:15.857 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.c.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.157412.log.gzgzip 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.176939.log 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105096.log 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102091.log.gz 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106185.log 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176939.log.gz 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168538.log 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105096.log: /var/log/ceph/ceph-client.admin.106185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163994.log 2023-10-08T00:37:15.858 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105096.log.gz 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168538.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106185.log.gz 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106311.log 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176144.log 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168538.log.gz 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163994.log: /var/log/ceph/ceph-client.admin.106311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167367.log 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163994.log.gz 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106311.log.gz 2023-10-08T00:37:15.859 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163047.log 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176144.log: /var/log/ceph/ceph-client.admin.167367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179903.log 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176144.log.gz 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163047.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167367.log.gz 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104535.log 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179903.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.163047.log.gz 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104145.log 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179903.log.gz 2023-10-08T00:37:15.860 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102805.log 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104535.log: /var/log/ceph/ceph-client.admin.104145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104103.log 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104535.log.gz 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102805.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104145.log.gz 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174795.log 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103664.log 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104103.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102805.log.gz 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160336.log 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104103.log.gz 2023-10-08T00:37:15.861 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.174795.log.gz 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156582.log 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103664.log: /var/log/ceph/ceph-client.admin.160336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103748.log 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103664.log.gz 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156582.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160336.log.gz 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101624.log 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T00:37:15.862 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103748.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156582.log.gz 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159682.log 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103748.log.gz 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103521.log 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101624.log: /var/log/ceph/ceph-client.admin.159682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99054.log 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.101624.log.gz 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159682.log.gz 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158112.log 2023-10-08T00:37:15.863 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103521.log: /var/log/ceph/ceph-client.admin.99054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171645.log 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103521.log.gz 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99054.log.gz 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101484.log 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158112.log.gz 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177169.log 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101484.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171645.log.gz 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102998.log 2023-10-08T00:37:15.864 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101484.log.gz 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159514.log 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177169.log.gz 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.102998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107328.log 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.102998.log.gz 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168768.log 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159514.log.gz 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102479.log 2023-10-08T00:37:15.865 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171141.log 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107328.log.gz 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102479.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168768.log.gz 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167621.log 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102479.log.gz 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103299.log 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167621.log: gzip 88.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.171141.log.gz-- 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174206.log 2023-10-08T00:37:15.866 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103299.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167621.log.gz 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180407.log 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174206.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103299.log.gz 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107064.log 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180407.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.174206.log.gz 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177247.log 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180407.log.gz 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105711.log 2023-10-08T00:37:15.867 INFO:teuthology.orchestra.run.smithi022.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.107064.log.gz 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164842.log 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105711.log: gzip -5 --verbose -- 87.7%/var/log/ceph/ceph-client.admin.171993.log 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.177247.log.gz 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164842.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105711.log.gz 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159864.log 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.164842.log.gz 2023-10-08T00:37:15.868 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178410.log 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170263.log 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171993.log.gz 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178410.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.159864.log.gz 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104451.log 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178410.log.gz 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107286.log 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104451.log: gzip -5 --verbose 87.8%-- /var/log/ceph/ceph-client.admin.99954.log -- replaced with /var/log/ceph/ceph-client.admin.170263.log.gz 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.869 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107286.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104451.log.gz 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160378.log 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99954.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107286.log.gz 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159724.log 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160378.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99954.log.gzgzip 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.162963.log 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160378.log.gz 2023-10-08T00:37:15.870 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177413.log 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.159724.log.gz 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107809.log 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105624.log 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162963.log.gz 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107809.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177413.log.gz 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172595.log 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107809.log.gz 2023-10-08T00:37:15.871 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.105624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107683.log 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.105624.log.gz 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176052.log 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107683.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.172595.log.gz 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160840.log 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.107683.log.gz 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176981.log 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175353.log 2023-10-08T00:37:15.872 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176052.log.gz 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101877.log 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176981.log.gz 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175353.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.160840.log.gz 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98087.log 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101877.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.175353.log.gz 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.158154.log 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98087.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101877.log.gz 2023-10-08T00:37:15.873 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158430.log 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98087.log.gz 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175563.log 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158430.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.158154.log.gz 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100332.log 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158430.log.gz 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177921.log 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175563.log.gz 2023-10-08T00:37:15.874 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166367.log 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177921.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100332.log.gz 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164630.log 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166367.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177921.log.gz 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160420.log 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166367.log.gz 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167831.log 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160420.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.164630.log.gz--verbose 2023-10-08T00:37:15.875 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.176854.log 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167831.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160420.log.gz 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103706.log 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167831.log.gz 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr:gzip /var/log/ceph/ceph-client.admin.176854.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.158836.log 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177753.log 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176854.log.gz 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158836.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103706.log.gz 2023-10-08T00:37:15.876 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167323.log 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158836.log.gz 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96707.log 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167323.log: gzip 87.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.177753.log.gz--verbose 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.156973.log 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167323.log.gz 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98710.log 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96707.log.gz 2023-10-08T00:37:15.877 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172385.log 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98710.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.162201.log 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156973.log.gz 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172385.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98710.log.gz 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98084.log 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.172385.log.gz 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98542.log 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163089.log 88.1% 2023-10-08T00:37:15.878 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.162201.log.gz 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98542.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98084.log.gz 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105975.log 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98542.log.gz 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171351.log 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166806.log 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171351.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105975.log.gz 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163519.log 2023-10-08T00:37:15.879 INFO:teuthology.orchestra.run.smithi022.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.163089.log.gz 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171351.log.gz 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174401.log 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166806.log.gz 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174919.log 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174401.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.163519.log.gz--verbose 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.167537.log 2023-10-08T00:37:15.880 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174401.log.gz 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178983.log 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.174919.log.gz 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167453.log 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178983.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167537.log.gz 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179987.log 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178983.log.gz 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102697.log 2023-10-08T00:37:15.881 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179987.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167453.log.gz 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96663.log 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102697.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.179987.log.gz--verbose 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.104409.log 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102697.log.gz 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167155.log 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96663.log.gz 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98290.log 2023-10-08T00:37:15.882 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100206.log 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104409.log.gz 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167155.log.gz 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167197.log 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.98290.log.gz 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170137.log 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167197.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100206.log.gz 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101135.log 2023-10-08T00:37:15.883 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170137.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167197.log.gz 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104707.log 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.170137.log.gz 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164223.log 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157677.log 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101135.log.gz 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104707.log.gz 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158794.log 2023-10-08T00:37:15.884 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164223.log.gz 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97973.log 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106938.log 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157677.log.gz 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158794.log.gz 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169314.log 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97973.log.gz 2023-10-08T00:37:15.885 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107022.log 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179609.log 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106938.log.gz 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169314.log.gz 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171951.log 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107022.log.gz 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr:gzip /var/log/ceph/ceph-client.admin.179609.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.177329.log 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168219.log 2023-10-08T00:37:15.886 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.179609.log.gz 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171951.log.gz 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160030.log 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177329.log.gz 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101961.log 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180071.log 88.0% 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.168219.log.gz 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160030.log.gz 2023-10-08T00:37:15.887 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103622.log 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101961.log.gz 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169927.log 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161186.log 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180071.log.gz 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103622.log.gz 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158280.log 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.169927.log.gz 2023-10-08T00:37:15.888 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175521.log 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158280.log: gzip 87.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.161186.log.gz--verbose 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.173954.log 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158280.log.gz 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170690.log 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175521.log.gz 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157244.log 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.170690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165325.log 2023-10-08T00:37:15.889 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173954.log.gz 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170690.log.gz 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96929.log 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165325.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157244.log.gz 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164366.log 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165325.log.gz 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170777.log 2023-10-08T00:37:15.890 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166325.log 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96929.log.gz 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170777.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164366.log.gz 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101666.log 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170777.log.gz 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168810.log 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101666.log: gzip 89.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.166325.log.gz--verbose 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr:-- /var/log/ceph/ceph-client.admin.178773.log 2023-10-08T00:37:15.891 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168810.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101666.log.gz 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172679.log 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168810.log.gz 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172341.log 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108110.log 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178773.log.gz 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172341.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.172679.log.gz 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.172341.log.gz 2023-10-08T00:37:15.892 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.108110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176626.log 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108110.log.gz 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103127.log 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101261.log 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176626.log.gz 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161719.log 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103127.log.gz 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97097.log 2023-10-08T00:37:15.893 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101261.log: /var/log/ceph/ceph-client.admin.161719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107498.log 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101261.log.gz 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97097.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161719.log.gz 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164324.log 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97097.log.gz 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169146.log 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172511.log 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164324.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107498.log.gz 2023-10-08T00:37:15.894 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173996.log 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164324.log.gz 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169146.log.gz 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176374.log 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172511.log: /var/log/ceph/ceph-client.admin.173996.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172511.log.gz 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176374.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173996.log.gz 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96801.log 2023-10-08T00:37:15.895 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176374.log.gz 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169670.log 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177497.log 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96801.log: /var/log/ceph/ceph-client.admin.169670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157719.log 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96801.log.gz 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177497.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169670.log.gz 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162617.log 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96621.log 2023-10-08T00:37:15.896 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1%/var/log/ceph/ceph-client.admin.157719.log: -- replaced with /var/log/ceph/ceph-client.admin.177497.log.gz 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104187.log 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157719.log.gz 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96621.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162617.log.gz 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164756.log 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.96621.log.gz 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106395.log 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158322.log 2023-10-08T00:37:15.897 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104187.log.gz 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164756.log.gz 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156540.log 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177065.log 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158322.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106395.log.gz 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169756.log 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158322.log.gz 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161929.log 2023-10-08T00:37:15.898 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156540.log.gz 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169756.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.177065.log.gz 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166619.log 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107725.log 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161929.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169756.log.gz 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103874.log 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161929.log.gz 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4%/var/log/ceph/ceph-client.admin.107725.log: -- replaced with /var/log/ceph/ceph-client.admin.166619.log.gz 2023-10-08T00:37:15.899 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172847.log 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103874.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107725.log.gz 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98332.log 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178941.log 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103874.log.gz 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169586.log 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178941.log: 91.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172847.log.gz -- replaced with /var/log/ceph/ceph-client.admin.98332.log.gz 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.900 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169586.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.178941.log.gz 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100374.log 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169586.log.gz 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178351.log 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180365.log 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100374.log: /var/log/ceph/ceph-client.admin.178351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165626.log 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100374.log.gz 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.178351.log.gz 2023-10-08T00:37:15.901 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161576.log 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96236.log 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.165626.log: 0.0% 89.2% -- replaced with /var/log/ceph/ceph-client.0.165626.log.gz -- replaced with /var/log/ceph/ceph-client.admin.180365.log.gz 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173556.log 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100967.log 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161576.log.gz 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96236.log.gz 2023-10-08T00:37:15.902 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177669.log 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171603.log 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100967.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173556.log.gz 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173598.log 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100967.log.gz 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177669.log.gz 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99996.log 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161270.log 2023-10-08T00:37:15.903 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171603.log.gz 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173598.log: /var/log/ceph/ceph-client.admin.99996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97728.log 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173598.log.gz 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161270.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99996.log.gz 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172553.log 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97728.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.161270.log.gz 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99912.log 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164138.log 2023-10-08T00:37:15.904 INFO:teuthology.orchestra.run.smithi022.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.97728.log.gz 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.172553.log.gz 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101177.log 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104019.log 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164138.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99912.log.gz 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177837.log 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164138.log.gz 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104019.log: gzip -5 --verbose 88.1%-- /var/log/ceph/ceph-mon.a.log 2023-10-08T00:37:15.905 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101177.log.gz 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104019.log.gz 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165199.log 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99467.log 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mon.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177837.log.gz 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168437.log 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165199.log.gz 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.99467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99467.log.gz 2023-10-08T00:37:15.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168437.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.168437.log.gz 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163699.log 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102529.log 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178815.log 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.163699.log.gz/var/log/ceph/ceph-client.admin.102529.log: 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178815.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102529.log.gz 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178815.log.gz 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99508.log 2023-10-08T00:37:15.907 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167495.log 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.99508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173828.log 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99508.log.gz 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102141.log 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103341.log 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173828.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167495.log.gz 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102141.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.173828.log.gz 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103341.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102141.log.gz 2023-10-08T00:37:15.908 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103341.log.gz 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169969.log 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175437.log 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159327.log 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.169969.log.gz 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175437.log: /var/log/ceph/ceph-client.admin.159327.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175437.log.gz 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159327.log.gz 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90960.log 2023-10-08T00:37:15.909 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179025.log 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.90960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166890.log 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100627.log 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90960.log.gz 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166890.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179025.log.gz 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100627.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166890.log.gz 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100627.log.gz 2023-10-08T00:37:15.910 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103832.log 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171519.log 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162529.log 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166679.log 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103832.log.gz 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4%/var/log/ceph/ceph-client.admin.162529.log: -- replaced with /var/log/ceph/ceph-client.admin.171519.log.gz 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105012.log 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103002.log 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166679.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162529.log.gz 2023-10-08T00:37:15.911 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105012.log: gzip 88.5%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.166679.log.gz-- 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100925.log 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.103002.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105012.log.gz 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103002.log.gz 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100925.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100925.log.gz 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105669.log 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104663.log 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97734.log 2023-10-08T00:37:15.912 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96573.log 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105669.log.gz 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104663.log.gz 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97734.log: /var/log/ceph/ceph-client.admin.96573.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97734.log.gz 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96573.log.gz 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104493.log 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177023.log 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167873.log 2023-10-08T00:37:15.913 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158070.log 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104493.log.gz 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177023.log.gz 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157202.log 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161887.log 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158070.log: /var/log/ceph/ceph-client.admin.157202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158070.log.gz 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.167873.log.gz 2023-10-08T00:37:15.914 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161887.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.157202.log.gz 2023-10-08T00:37:15.915 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96885.log 2023-10-08T00:37:15.915 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161887.log.gz 2023-10-08T00:37:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104970.log 2023-10-08T00:37:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157847.log 2023-10-08T00:37:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96885.log: /var/log/ceph/ceph-client.admin.104970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164548.log 2023-10-08T00:37:15.916 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96885.log.gz 2023-10-08T00:37:15.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157847.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104970.log.gz 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103916.log 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164548.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157847.log.gz 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164548.log.gz 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97397.log 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103916.log.gz 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175183.log 2023-10-08T00:37:15.917 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108197.log 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97397.log.gz 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163348.log 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102225.log 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.108197.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175183.log.gz 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.163348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108197.log.gz 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163348.log.gz 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102225.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102225.log.gz 2023-10-08T00:37:15.918 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178899.log 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170903.log 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100122.log 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178899.log.gz 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97013.log 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179567.log 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100122.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.170903.log.gz 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97013.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100122.log.gz 2023-10-08T00:37:15.919 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179567.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97013.log.gz 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101093.log 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179567.log.gz 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165630.log 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174122.log 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101093.log: /var/log/ceph/ceph-client.0.165630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161408.log 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101093.log.gz 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.165630.log.gz 2023-10-08T00:37:15.920 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172257.log 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174122.log.gz 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164798.log 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163561.log 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172257.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161408.log.gz 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164798.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172257.log.gz 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163561.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164798.log.gz 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163561.log.gz 2023-10-08T00:37:15.921 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172805.log 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166025.log 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161099.log 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172805.log.gz 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166025.log: /var/log/ceph/ceph-client.0.161099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175311.log 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166025.log.gz 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161099.log.gz 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157635.log 2023-10-08T00:37:15.922 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176010.log 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175311.log.gz 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157635.log: /var/log/ceph/ceph-client.admin.176010.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157635.log.gz 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176010.log.gz 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156679.log 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172721.log 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160252.log 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164408.log 2023-10-08T00:37:15.923 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156679.log.gz 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172721.log.gz 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177963.log 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162487.log 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164408.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160252.log.gz 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107372.log 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164408.log.gz 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177963.log.gz 2023-10-08T00:37:15.924 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162487.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162487.log.gz 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107372.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107372.log.gz 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179861.log 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105222.log 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165935.log 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172207.log 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.179861.log.gz 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163910.log 2023-10-08T00:37:15.925 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105222.log.gz 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175045.log 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.165935.log.gz 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163910.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.172207.log.gz 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171869.log 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160122.log 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163910.log.gz 2023-10-08T00:37:15.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171869.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175045.log.gz 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160166.log 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161312.log 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160122.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171869.log.gz 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160166.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160122.log.gz 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161312.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160166.log.gz 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161312.log.gz 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98083.log 2023-10-08T00:37:15.927 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162445.log 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100458.log 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98083.log.gz 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179067.log 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158752.log 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100458.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162445.log.gz 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160080.log 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.100458.log.gz 2023-10-08T00:37:15.928 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163393.log 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179067.log.gz 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158752.log.gz 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168726.log 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose 87.8%-- /var/log/ceph/ceph-client.admin.158196.log -- replaced with /var/log/ceph/ceph-client.admin.160080.log.gz 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163393.log: /var/log/ceph/ceph-client.admin.168726.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163393.log.gz 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6%/var/log/ceph/ceph-client.admin.158196.log: -- replaced with /var/log/ceph/ceph-client.admin.168726.log.gz 2023-10-08T00:37:15.929 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158196.log.gz 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157099.log 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160588.log 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97223.log 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157099.log.gz 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157984.log 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172427.log 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97223.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160588.log.gz 2023-10-08T00:37:15.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104577.log 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97223.log.gz 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6%/var/log/ceph/ceph-client.admin.172427.log: -- replaced with /var/log/ceph/ceph-client.admin.157984.log.gz 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172427.log.gz 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104577.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.104577.log.gz 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173514.log 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162279.log 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176710.log 2023-10-08T00:37:15.931 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174527.log 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173514.log.gz 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179319.log 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162279.log.gz 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174527.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176710.log.gz 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101793.log 88.7% 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.174527.log.gz 2023-10-08T00:37:15.932 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.0.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179319.log.gz 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101793.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101793.log.gz 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103085.log 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101321.log 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176897.log 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101321.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103085.log.gz 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176897.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101321.log.gz 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176897.log.gz 2023-10-08T00:37:15.933 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162013.log 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168136.log 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165983.log 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.168136.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.162013.log.gz 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168136.log.gz 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165983.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165983.log.gz 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162921.log 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159201.log 2023-10-08T00:37:15.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173151.log 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159201.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162921.log.gz 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173151.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159201.log.gz 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173151.log.gz 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166283.log 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177711.log 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166283.log: /var/log/ceph/ceph-client.admin.177711.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166283.log.gz 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177711.log.gz 2023-10-08T00:37:15.935 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163155.log 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99459.log 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163155.log: /var/log/ceph/ceph-client.0.99459.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163155.log.gz 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99459.log.gz 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157803.log 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105180.log 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170735.log 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105180.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157803.log.gz 2023-10-08T00:37:15.936 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170735.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105180.log.gz 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170735.log.gz 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101219.log 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180155.log 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177585.log 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180155.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101219.log.gz 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177585.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180155.log.gz 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177585.log.gz 2023-10-08T00:37:15.937 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164714.log 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102183.log 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.164714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160672.log 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102183.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164714.log.gz 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102183.log.gz 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160672.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160672.log.gz 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169062.log 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107557.log 2023-10-08T00:37:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98668.log 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107557.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169062.log.gz 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107557.log.gz 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.98668.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98668.log.gz 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168642.log 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107150.log 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159988.log 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107150.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168642.log.gz 2023-10-08T00:37:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159988.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107150.log.gz 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159988.log.gz 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170011.log 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102571.log 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170011.log: /var/log/ceph/ceph-client.admin.102571.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.170011.log.gz 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102571.log.gz 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157286.log 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175864.log 2023-10-08T00:37:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.157286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163826.log 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.175864.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.157286.log.gz 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.175864.log.gz 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163826.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163826.log.gz 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167281.log 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163657.log 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167281.log: /var/log/ceph/ceph-client.admin.163657.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167281.log.gz 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163657.log.gz 2023-10-08T00:37:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175227.log 2023-10-08T00:37:15.942 INFO:teuthology.orchestra.run.smithi192.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T00:37:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105795.log 2023-10-08T00:37:15.964 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101406.log 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105795.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175227.log.gz 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101406.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105795.log.gz 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101406.log.gz 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101051.log 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160630.log 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162573.log 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160630.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101051.log.gz 2023-10-08T00:37:15.965 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162573.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160630.log.gz 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162573.log.gz 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171791.log 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176542.log 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163742.log 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176542.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171791.log.gz 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.163742.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176542.log.gz 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163742.log.gz 2023-10-08T00:37:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173766.log 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103563.log 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102655.log 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103563.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173766.log.gz 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102655.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103563.log.gz 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102655.log.gz 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165115.log 2023-10-08T00:37:15.967 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172637.log 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165115.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172637.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165115.log.gz 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mgr.y.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172637.log.gz 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102437.log 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103169.log 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102437.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102437.log.gz 2023-10-08T00:37:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.103169.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103169.log.gz 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170305.log 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97727.log 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170305.log: /var/log/ceph/ceph-client.admin.97727.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170305.log.gz 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97727.log.gz 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165241.log 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98794.log 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165241.log: /var/log/ceph/ceph-client.admin.98794.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165241.log.gz 2023-10-08T00:37:15.969 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98794.log.gz 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161971.log 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96459.log 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158623.log 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161971.log.gz 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.158623.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96459.log.gz 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.158623.log.gz 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180197.log 2023-10-08T00:37:15.970 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162795.log 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106455.log 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.162795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180197.log.gz 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162795.log.gz 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106455.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106455.log.gz 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169885.log 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102047.log 2023-10-08T00:37:15.971 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107641.log 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.102047.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169885.log.gz 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107641.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102047.log.gz 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107641.log.gz 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174485.log 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179819.log 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179735.log 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179819.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174485.log.gz 2023-10-08T00:37:15.972 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104229.log 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.179819.log.gz 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.179735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176312.log 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104229.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179735.log.gz 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.176312.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104229.log.gz 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176312.log.gz 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166241.log 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171267.log 2023-10-08T00:37:15.973 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173430.log 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171267.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166241.log.gz 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173430.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171267.log.gz 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173430.log.gz 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106227.log 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178586.log 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174038.log 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178586.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106227.log.gz 2023-10-08T00:37:15.974 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174038.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.178586.log.gz 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.174038.log.gz 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168303.log 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168395.log 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106498.log 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168395.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168303.log.gz 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168395.log.gz 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106498.log.gz 2023-10-08T00:37:15.975 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168132.log 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171477.log 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.168132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166451.log 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168132.log.gz 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180281.log 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.171477.log.gz 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180281.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.166451.log.gz 2023-10-08T00:37:15.976 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.180281.log.gz 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104619.log 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103383.log 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156763.log 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.104619.log: /var/log/ceph/ceph-client.admin.103383.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.104619.log.gz 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.156763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103383.log.gz 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.156763.log.gz 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100500.log 2023-10-08T00:37:15.977 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165797.log 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100248.log 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165797.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100500.log.gz 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100248.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.165797.log.gz 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100248.log.gz 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166932.log 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159285.log 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167747.log 2023-10-08T00:37:15.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159285.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166932.log.gz 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159285.log.gz 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167747.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167747.log.gz 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169230.log 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165157.log 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.169230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165367.log 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165157.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169230.log.gz 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165367.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165157.log.gz 2023-10-08T00:37:15.979 INFO:teuthology.orchestra.run.smithi022.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.165367.log.gz 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97724.log 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168894.log 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97398.log 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168894.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97724.log.gz 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97398.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168894.log.gz 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97398.log.gz 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100080.log 2023-10-08T00:37:15.980 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170861.log 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177879.log 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170861.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100080.log.gz 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.177879.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170861.log.gz 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.177879.log.gz 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158238.log 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.99871.log 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172299.log 2023-10-08T00:37:15.981 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.2.99871.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158238.log.gz 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.99871.log.gz 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.172299.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172299.log.gz 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158974.log 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158627.log 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180323.log 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.158627.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158974.log.gz 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.158627.log.gz 2023-10-08T00:37:15.982 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180323.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180323.log.gz 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174653.log 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169843.log 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174653.log: /var/log/ceph/ceph-client.admin.169843.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174653.log.gz 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169843.log.gz 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101835.log 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174569.log 2023-10-08T00:37:15.983 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.101835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175133.log 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174569.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101835.log.gz 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.175133.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.174569.log.gz 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.175133.log.gz 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107767.log 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170179.log 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107599.log 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.170179.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107767.log.gz 2023-10-08T00:37:15.984 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.107599.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170179.log.gz 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107599.log.gz 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100585.log 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168600.log 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100585.log: /var/log/ceph/ceph-client.admin.168600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100585.log.gz 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168600.log.gz 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174877.log 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173640.log 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.174877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165671.log 2023-10-08T00:37:15.985 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.173640.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174877.log.gz 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.165671.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.173640.log.gz 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165671.log.gz 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160906.log 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176270.log 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.160906.log: /var/log/ceph/ceph-client.admin.176270.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160906.log.gz 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176270.log.gz 2023-10-08T00:37:15.986 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168261.log 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171057.log 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158710.log 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171057.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168261.log.gz 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.158710.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171057.log.gz 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158710.log.gz 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106716.log 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172077.log 2023-10-08T00:37:15.987 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106716.log: /var/log/ceph/ceph-client.admin.172077.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106716.log.gz 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.172077.log.gz 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159100.log 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178113.log 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167705.log 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.178113.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.159100.log.gz 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.167705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.178113.log.gz 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167705.log.gz 2023-10-08T00:37:15.988 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108114.log 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180592.log 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.108114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171561.log 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108114.log.gz 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.180592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159640.log 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171561.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.180592.log.gz 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.159640.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171561.log.gz 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159640.log.gz 2023-10-08T00:37:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166199.log 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98584.log 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166199.log: /var/log/ceph/ceph-client.admin.98584.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166199.log.gz 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98584.log.gz 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105431.log 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106353.log 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.105431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100416.log 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.106353.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105431.log.gz 2023-10-08T00:37:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.100416.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106353.log.gz 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100416.log.gz 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171309.log 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.171309.log: /var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171309.log.gz 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161103.log 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168479.log 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.161103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161103.log.gz 2023-10-08T00:37:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.168479.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168479.log.gz 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97718.log 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97181.log 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.97718.log: /var/log/ceph/ceph-client.admin.97181.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97718.log.gz 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97181.log.gz 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161845.log 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166848.log 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.161845.log: 87.3%/var/log/ceph/ceph-client.admin.166848.log: -- replaced with /var/log/ceph/ceph-client.admin.161845.log.gz 2023-10-08T00:37:15.992 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166848.log.gz 2023-10-08T00:37:15.993 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96329.log 2023-10-08T00:37:15.993 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157370.log 2023-10-08T00:37:15.993 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.96329.log: /var/log/ceph/ceph-client.admin.157370.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96329.log.gz 2023-10-08T00:37:15.993 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157370.log.gz 2023-10-08T00:37:15.993 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166577.log 2023-10-08T00:37:15.993 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.166577.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166577.log.gz 2023-10-08T00:37:16.038 INFO:teuthology.orchestra.run.smithi192.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T00:37:16.358 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T00:37:16.387 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T00:37:16.394 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T00:37:16.430 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T00:37:16.495 INFO:teuthology.orchestra.run.smithi192.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T00:37:16.499 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T00:37:16.501 INFO:teuthology.orchestra.run.smithi192.stderr: 2023-10-08T00:37:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m0.914s 2023-10-08T00:37:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m4.792s 2023-10-08T00:37:16.501 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.183s 2023-10-08T00:37:16.611 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T00:37:16.641 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T00:37:16.644 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T00:37:16.765 INFO:teuthology.orchestra.run.smithi022.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T00:37:20.832 INFO:teuthology.orchestra.run.smithi022.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-08T00:37:20.834 INFO:teuthology.orchestra.run.smithi022.stderr: 2023-10-08T00:37:20.834 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m5.270s 2023-10-08T00:37:20.834 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m9.604s 2023-10-08T00:37:20.835 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m0.691s 2023-10-08T00:37:20.835 INFO:tasks.ceph:Archiving logs... 2023-10-08T00:37:20.835 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/remote/smithi022/log 2023-10-08T00:37:20.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T00:37:22.625 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/remote/smithi192/log 2023-10-08T00:37:22.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T00:37:23.231 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T00:37:23.243 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T00:37:23.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T00:37:23.246 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T00:37:23.320 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T00:37:23.331 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T00:37:23.332 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T00:37:23.334 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T00:37:23.347 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2023-10-08T00:37:23.348 INFO:teuthology.orchestra.run.smithi192.stderr:bash: ntpq: command not found 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:210 Number of sources = 4 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 10 -131us[ -131us] +/- 71ms 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 -354us[ -357us] +/- 69ms 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +492us[ +489us] +/- 69ms 2023-10-08T00:37:23.351 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:37:23.352 INFO:teuthology.orchestra.run.smithi192.stdout:210 Number of sources = 4 2023-10-08T00:37:23.352 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T00:37:23.353 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2023-10-08T00:37:23.353 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 -136us[ -136us] +/- 71ms 2023-10-08T00:37:23.353 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -352us[ -359us] +/- 69ms 2023-10-08T00:37:23.353 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +498us[ +498us] +/- 69ms 2023-10-08T00:37:23.353 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T00:37:23.353 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T00:37:23.370 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T00:37:23.371 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T00:37:23.418 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T00:37:23.476 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T00:37:23.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T00:37:23.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:37:23.598 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T00:37:23.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:37:23.628 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T00:37:23.639 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T00:37:23.664 INFO:teuthology.task.internal:Duration was 1434.313268 seconds 2023-10-08T00:37:23.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T00:37:23.715 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T00:37:23.715 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T00:37:23.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T00:37:23.762 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T00:37:23.763 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T00:37:24.094 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T00:37:24.094 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2023-10-08T00:37:24.094 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T00:37:24.115 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-10-08T00:37:24.115 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T00:37:24.134 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T00:37:24.134 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T00:37:24.159 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T00:37:24.214 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T00:37:24.214 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T00:37:24.216 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T00:37:24.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T00:37:24.341 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T00:37:24.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T00:37:24.367 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T00:37:24.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T00:37:24.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T00:37:24.410 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T00:37:24.432 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2023-10-08T00:37:24.455 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-10-08T00:37:24.468 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T00:37:24.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:37:24.501 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T00:37:24.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T00:37:24.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T00:37:24.534 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T00:37:24.535 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/remote/smithi022 2023-10-08T00:37:24.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T00:37:24.576 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128/remote/smithi192 2023-10-08T00:37:24.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T00:37:24.611 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T00:37:24.611 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T00:37:24.614 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T00:37:24.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T00:37:24.678 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T00:37:24.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T00:37:24.706 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T00:37:24.707 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T00:37:24.709 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T00:37:24.721 INFO:teuthology.orchestra.run.smithi022.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 00:37 /home/ubuntu/cephtest 2023-10-08T00:37:24.723 INFO:teuthology.orchestra.run.smithi192.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 00:37 /home/ubuntu/cephtest 2023-10-08T00:37:24.724 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T00:37:24.755 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T00:37:24.856 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T00:37:24.886 DEBUG:teuthology.nuke:shortname: smithi022 2023-10-08T00:37:24.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T00:37:24.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 00:06:03.230466', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZzmRSjpiIjPSanOdXhFf9PoViSqTfXRRFuwwpn579ZP6QNYrLiD+SmqZoh8c2nS1KuiPstJ7e8TTTwZ8m6h7c='} 2023-10-08T00:37:24.914 DEBUG:teuthology.nuke:shortname: smithi192 2023-10-08T00:37:24.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T00:37:24.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-07_22:15:20-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 00:06:03.232417', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+asrvhCEdDa/aeQL/fpC2MJoaq3naTK/kKRupFq02V/HwJ3Ozn5G6+UQZy0X3gPxbzxC4oV2BLTK1HSw6tbrs='} 2023-10-08T00:37:24.950 INFO:teuthology.orchestra.console.smithi022:Power off 2023-10-08T00:37:24.951 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T00:37:24.973 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-10-08T00:37:24.974 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:24.991 INFO:teuthology.orchestra.console.smithi192:Power off 2023-10-08T00:37:24.991 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T00:37:24.999 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-10-08T00:37:25.012 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-10-08T00:37:25.012 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:25.040 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-08T00:37:29.000 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:29.041 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:29.110 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-10-08T00:37:29.150 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-08T00:37:33.114 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:33.152 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:33.223 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-10-08T00:37:33.261 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-10-08T00:37:33.325 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-10-08T00:37:37.262 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T00:37:37.373 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-10-08T00:37:37.474 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-10-08T00:37:37.578 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1434.3132677078247 failure_reason: 'Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=854c4b3c60964a8f9161a072f2f9198e status: fail success: false 2023-10-08T00:37:37.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T00:37:37.658 INFO:teuthology.run:FAIL